<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body dir="auto">
<div style="-webkit-text-size-adjust: auto;">I checked it again and confirmed there is one guest VM is running on the top of this host. The log is as follows:</div>
<div style="-webkit-text-size-adjust: auto;"><br>
</div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);">[root@compute2-1 vdsm]# ps -ef | grep qemu<br>
qemu 2983 846 0 Dec19 ? <a href="x-apple-data-detectors://0" x-apple-data-detectors="true" x-apple-data-detectors-type="calendar-event" x-apple-data-detectors-result="0">00:00:00</a> [supervdsmServer] <defunct><br>
root 5489 3053 0 <a href="x-apple-data-detectors://1" x-apple-data-detectors="true" x-apple-data-detectors-type="calendar-event" x-apple-data-detectors-result="1">20:49</a> pts/0 <a href="x-apple-data-detectors://2" x-apple-data-detectors="true" x-apple-data-detectors-type="calendar-event" x-apple-data-detectors-result="2">00:00:00</a> grep
--color=auto qemu<br>
qemu 26128 1 0 Dec19 ? 01:09:19 /usr/libexec/qemu-kvm<br>
-name testvm2 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Nehalem -m<br>
500 -realtime mlock=off -smp 1,maxcpus=16,sockets=16,cores=1,threads=1<br>
-uuid e46bca87-4df5-4287-844b-90a26fccef33 -smbios<br>
type=1,manufacturer=oVirt,product=oVirt<br>
Node,version=7-0.1406.el7.centos.2.5,serial=4C4C4544-0030-3310-8059-B8C04F585231,uuid=e46bca87-4df5-4287-844b-90a26fccef33<br>
-no-user-config -nodefaults -chardev<br>
socket,id=charmonitor,path=/var/lib/libvirt/qemu/testvm2.monitor,server,nowait<br>
-mon chardev=charmonitor,id=monitor,mode=control -rtc<br>
base=2014-12-19T20:<a href="x-apple-data-detectors://4" x-apple-data-detectors="true" x-apple-data-detectors-type="calendar-event" x-apple-data-detectors-result="4">18:01</a>,driftfix=slew -no-kvm-pit-reinjection<br>
-no-hpet -no-shutdown -boot strict=on -device<br>
piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device<br>
virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device<br>
virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5<br>
-drive if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial=<br>
-device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0<br>
-drive file=/rhev/data-center/00000002-0002-0002-0002-0000000001e4/1dc71096-27c4-4256-b2ac-bd7265525c69/images/b4b5426b-95e3-41af-b286-da245891cdaf/0f688d49-97e3-4f1d-84d4-ac1432d903b3,if=none,id=drive-virtio-disk0,format=qcow2,serial=b4b5426b-95e3-41af-b286-da245891cdaf,cache=none,werror=stop,rerror=stop,aio=threads<br>
-device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1<br>
-netdev tap,fd=26,id=hostnet0,vhost=on,vhostfd=27 -device<br>
virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:db:94:01,bus=pci.0,addr=0x3<br>
-chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/e46bca87-4df5-4287-844b-90a26fccef33.com.redhat.rhevm.vdsm,server,nowait<br>
-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm<br>
-chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/e46bca87-4df5-4287-844b-90a26fccef33.org.qemu.guest_agent.0,server,nowait<br>
-device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0<br>
-chardev spicevmc,id=charchannel2,name=vdagent -device<br>
virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0<br>
-spice tls-port=5900,addr=10.0.0.92,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on<br>
-k en-us -vga qxl -global qxl-vga.ram_size=<a href="tel:67108864" x-apple-data-detectors="true" x-apple-data-detectors-type="telephone" x-apple-data-detectors-result="5">67108864</a> -global<br>
qxl-vga.vram_size=<a href="tel:33554432" x-apple-data-detectors="true" x-apple-data-detectors-type="telephone" x-apple-data-detectors-result="6">33554432</a> -incoming tcp:[::]:49152 -device<br>
virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x7<br>
[root@compute2-1 vdsm]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log<br>
MainThread::INFO::2014-12-28<br>
20:49:27,315::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)<br>
Local maintenance detected<br>
MainThread::INFO::2014-12-28<br>
20:49:27,646::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state LocalMaintenance (score: 0)<br>
MainThread::INFO::2014-12-28<br>
20:49:27,646::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.94 (id: 1, score: 2400)<br>
MainThread::INFO::2014-12-28<br>
20:49:37,732::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)<br>
Local maintenance detected<br>
MainThread::INFO::2014-12-28<br>
20:49:37,961::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state LocalMaintenance (score: 0)<br>
MainThread::INFO::2014-12-28<br>
20:49:37,961::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.94 (id: 1, score: 2400)<br>
MainThread::INFO::2014-12-28<br>
20:49:48,048::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)<br>
Local maintenance detected<br>
MainThread::INFO::2014-12-28<br>
20:49:48,319::states::208::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score)<br>
Score is 0 due to local maintenance mode<br>
MainThread::INFO::2014-12-28<br>
20:49:48,319::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state LocalMaintenance (score: 0)<br>
MainThread::INFO::2014-12-28<br>
20:49:48,319::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.94 (id: 1, score: 2400)</span></div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);"><br>
</span></div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);">Thanks,</span></div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);">Cong</span></div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);"><br>
</span></div>
<div style="-webkit-text-size-adjust: auto;"><br>
On 2014/12/28, at 3:46, "Artyom Lukianov" <<a href="mailto:alukiano@redhat.com">alukiano@redhat.com</a>> wrote:<br>
<br>
</div>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;">
<div><span>I see that you set local maintenance on host3 that do not have engine vm on it, so it nothing to migrate from this host.</span><br>
<span>If you set local maintenance on host1, vm must migrate to another host with positive score.</span><br>
<span>Thanks</span><br>
<span></span><br>
<span>----- Original Message -----</span><br>
<span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a>></span><br>
<span>To: "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a>></span><br>
<span>Cc: <a href="mailto:users@ovirt.org">users@ovirt.org</a></span><br>
<span>Sent: Saturday, December 27, 2014 6:58:32 PM</span><br>
<span>Subject: Re: [ovirt-users] VM failover with ovirt3.5</span><br>
<span></span><br>
<span>Hi</span><br>
<span></span><br>
<span>I had a try with "hosted-engine --set-maintence --mode=local" on</span><br>
<span>compute2-1, which is host 3 in my cluster. From the log, it shows</span><br>
<span>maintence mode is dectected, but migration does not happen.</span><br>
<span></span><br>
<span>The logs are as follows. Is there any other config I need to check?</span><br>
<span></span><br>
<span>[root@compute2-1 vdsm]# hosted-engine --vm-status</span><br>
<span></span><br>
<span></span><br>
<span>--== Host 1 status ==-</span><br>
<span></span><br>
<span>Status up-to-date : True</span><br>
<span>Hostname : 10.0.0.94</span><br>
<span>Host ID : 1</span><br>
<span>Engine status : {"health": "good", "vm": "up",</span><br>
<span>"detail": "up"}</span><br>
<span>Score : 2400</span><br>
<span>Local maintenance : False</span><br>
<span>Host timestamp : 836296</span><br>
<span>Extra metadata (valid at timestamp):</span><br>
<span>metadata_parse_version=1</span><br>
<span>metadata_feature_version=1</span><br>
<span>timestamp=836296 (Sat Dec 27 11:42:39 2014)</span><br>
<span>host-id=1</span><br>
<span>score=2400</span><br>
<span>maintenance=False</span><br>
<span>state=EngineUp</span><br>
<span></span><br>
<span></span><br>
<span>--== Host 2 status ==--</span><br>
<span></span><br>
<span>Status up-to-date : True</span><br>
<span>Hostname : 10.0.0.93</span><br>
<span>Host ID : 2</span><br>
<span>Engine status : {"reason": "vm not running on</span><br>
<span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
<span>Score : 2400</span><br>
<span>Local maintenance : False</span><br>
<span>Host timestamp : 687358</span><br>
<span>Extra metadata (valid at timestamp):</span><br>
<span>metadata_parse_version=1</span><br>
<span>metadata_feature_version=1</span><br>
<span>timestamp=687358 (Sat Dec 27 08:42:04 2014)</span><br>
<span>host-id=2</span><br>
<span>score=2400</span><br>
<span>maintenance=False</span><br>
<span>state=EngineDown</span><br>
<span></span><br>
<span></span><br>
<span>--== Host 3 status ==--</span><br>
<span></span><br>
<span>Status up-to-date : True</span><br>
<span>Hostname : 10.0.0.92</span><br>
<span>Host ID : 3</span><br>
<span>Engine status : {"reason": "vm not running on</span><br>
<span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
<span>Score : 0</span><br>
<span>Local maintenance : True</span><br>
<span>Host timestamp : 681827</span><br>
<span>Extra metadata (valid at timestamp):</span><br>
<span>metadata_parse_version=1</span><br>
<span>metadata_feature_version=1</span><br>
<span>timestamp=681827 (Sat Dec 27 08:42:40 2014)</span><br>
<span>host-id=3</span><br>
<span>score=0</span><br>
<span>maintenance=True</span><br>
<span>state=LocalMaintenance</span><br>
<span>[root@compute2-1 vdsm]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:42:41,109::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:42:51,198::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
<span>Local maintenance detected</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:42:51,420::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state LocalMaintenance (score: 0)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:42:51,420::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:01,507::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
<span>Local maintenance detected</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:01,773::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state LocalMaintenance (score: 0)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:01,773::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:11,859::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
<span>Local maintenance detected</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:12,072::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state LocalMaintenance (score: 0)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:12,072::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span></span><br>
<span></span><br>
<span></span><br>
<span>[root@compute2-3 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:28,855::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:39,130::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:39,130::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:49,449::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:49,449::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:59,739::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:59,739::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:37:09,779::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
<span>Engine vm running on localhost</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:37:10,026::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:37:10,026::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:37:20,331::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:37:20,331::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span></span><br>
<span></span><br>
<span>[root@compute2-2 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:12,462::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:22,797::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:22,798::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:32,876::states::437::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
<span>Engine vm is running on host 10.0.0.94 (id 1)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:33,169::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:33,169::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:43,567::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:43,567::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:53,858::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:53,858::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,028::state_machine::160::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Global metadata: {'maintenance': False}</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,028::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Host 10.0.0.94 (id 1): {'extra':</span><br>
<span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=835987</span><br>
<span>(Sat Dec 27 11:37:30</span><br>
<span>2014)\nhost-id=1\nscore=2400\nmaintenance=False\nstate=EngineUp\n',</span><br>
<span>'hostname': '10.0.0.94', 'alive': True, 'host-id': 1, 'engine-status':</span><br>
<span>{'health': 'good', 'vm': 'up', 'detail': 'up'}, 'score': 2400,</span><br>
<span>'maintenance': False, 'host-ts': 835987}</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,028::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Host 10.0.0.92 (id 3): {'extra':</span><br>
<span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=681528</span><br>
<span>(Sat Dec 27 08:37:41</span><br>
<span>2014)\nhost-id=3\nscore=0\nmaintenance=True\nstate=LocalMaintenance\n',</span><br>
<span>'hostname': '10.0.0.92', 'alive': True, 'host-id': 3, 'engine-status':</span><br>
<span>{'reason': 'vm not running on this host', 'health': 'bad', 'vm':</span><br>
<span>'down', 'detail': 'unknown'}, 'score': 0, 'maintenance': True,</span><br>
<span>'host-ts': 681528}</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,028::state_machine::168::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Local (id 2): {'engine-health': {'reason': 'vm not running on this</span><br>
<span>host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge':</span><br>
<span>True, 'mem-free': 15300.0, 'maintenance': False, 'cpu-load': 0.0215,</span><br>
<span>'gateway': True}</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,265::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,265::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span></span><br>
<span>Thanks,</span><br>
<span>Cong</span><br>
<span></span><br>
<blockquote type="cite"><span>On 2014/12/22, at 5:29, "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a>> wrote:</span><br>
</blockquote>
<blockquote type="cite"><span></span><br>
</blockquote>
<blockquote type="cite"><span></span><br>
</blockquote>
<blockquote type="cite"><span></span><br>
</blockquote>
<blockquote type="cite"><span>----- Original Message -----</span><br>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a>></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>To: "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a>></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Cc: <a href="mailto:users@ovirt.org">users@ovirt.org</a></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Sent: Friday, December 19, 2014 7:22:10 PM</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Subject: RE: [ovirt-users] VM failover with ovirt3.5</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Thanks for the information. This is the log for my three ovirt nodes.</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>From the output of hosted-engine --vm-status, it shows the engine state for</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>my 2nd and 3rd ovirt node is DOWN.</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Is this the reason why VM failover not work in my environment?</span><br>
</blockquote>
</blockquote>
<blockquote type="cite"><span></span><br>
</blockquote>
<blockquote type="cite"><span>No, they looks ok: you can run the engine VM on single host at a time.</span><br>
</blockquote>
<blockquote type="cite"><span></span><br>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>How can I make</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>also engine works for my 2nd and 3rd ovit nodes?</span><br>
</blockquote>
</blockquote>
<blockquote type="cite"><span></span><br>
</blockquote>
<blockquote type="cite"><span>If you put the host 1 in local maintenance mode ( hosted-engine --set-maintenance --mode=local ) the VM should migrate to host 2; if you reactivate host 1 ( hosted-engine --set-maintenance --mode=none ) and put host 2 in local
maintenance mode the VM should migrate again.</span><br>
</blockquote>
<blockquote type="cite"><span></span><br>
</blockquote>
<blockquote type="cite"><span>Can you please try that and post the logs if something is going bad?</span><br>
</blockquote>
<blockquote type="cite"><span></span><br>
</blockquote>
<blockquote type="cite"><span></span><br>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>--</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>--== Host 1 status ==--</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Status up-to-date : True</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Hostname : 10.0.0.94</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Host ID : 1</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Engine status : {"health": "good", "vm": "up",</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>"detail": "up"}</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Score : 2400</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Local maintenance : False</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Host timestamp : 150475</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>metadata_parse_version=1</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>metadata_feature_version=1</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>timestamp=150475 (Fri Dec 19 13:12:18 2014)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>host-id=1</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>score=2400</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>maintenance=False</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>state=EngineUp</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>--== Host 2 status ==--</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Status up-to-date : True</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Hostname : 10.0.0.93</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Host ID : 2</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Engine status : {"reason": "vm not running on</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Score : 2400</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Local maintenance : False</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Host timestamp : 1572</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>metadata_parse_version=1</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>metadata_feature_version=1</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>timestamp=1572 (Fri Dec 19 10:12:18 2014)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>host-id=2</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>score=2400</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>maintenance=False</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>state=EngineDown</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>--== Host 3 status ==--</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Status up-to-date : False</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Hostname : 10.0.0.92</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Host ID : 3</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Engine status : unknown stale-data</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Score : 2400</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Local maintenance : False</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Host timestamp : 987</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>metadata_parse_version=1</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>metadata_feature_version=1</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>timestamp=987 (Fri Dec 19 10:09:58 2014)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>host-id=3</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>score=2400</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>maintenance=False</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>state=EngineDown</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>--</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>And the /var/log/ovirt-hosted-engine-ha/agent.log for three ovirt nodes are</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>as follows:</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>--</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10.0.0.94(hosted-engine-1)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>---</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:09:33,716::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:09:33,716::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:09:44,017::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:09:44,017::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:09:54,303::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:09:54,303::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:04,342::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Engine vm running on localhost</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:04,617::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:04,617::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:14,657::state_machine::160::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Global metadata: {'maintenance': False}</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:14,657::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Host 10.0.0.93 (id 2): {'extra':</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1448</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>(Fri Dec 19 10:10:14</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineDown\n',</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>'hostname': '10.0.0.93', 'alive': True, 'host-id': 2, 'engine-status':</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>{'reason': 'vm not running on this host', 'health': 'bad', 'vm':</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>'down', 'detail': 'unknown'}, 'score': 2400, 'maintenance': False,</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>'host-ts': 1448}</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:14,657::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Host 10.0.0.92 (id 3): {'extra':</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=987</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>(Fri Dec 19 10:09:58</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>2014)\nhost-id=3\nscore=2400\nmaintenance=False\nstate=EngineDown\n',</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>'hostname': '10.0.0.92', 'alive': True, 'host-id': 3, 'engine-status':</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>{'reason': 'vm not running on this host', 'health': 'bad', 'vm':</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>'down', 'detail': 'unknown'}, 'score': 2400, 'maintenance': False,</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>'host-ts': 987}</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:14,658::state_machine::168::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up',</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>'detail': 'up'}, 'bridge': True, 'mem-free': 1079.0, 'maintenance':</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>False, 'cpu-load': 0.0269, 'gateway': True}</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:14,904::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:14,904::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:25,210::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:25,210::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:35,499::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:35,499::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:45,784::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:45,785::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:56,070::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:10:56,070::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:11:06,109::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Engine vm running on localhost</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:11:06,359::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:11:06,359::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:11:16,658::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:11:16,658::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:11:26,991::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:11:26,991::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:11:37,341::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>13:11:37,341::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>----</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10.0.0.93 (hosted-engine-2)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:12:18,339::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:12:18,339::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:12:28,651::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:12:28,652::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:12:39,010::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:12:39,010::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:12:49,338::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:12:49,338::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:12:59,642::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:12:59,642::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:13:10,010::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10:13:10,010::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>10.0.0.92(hosted-engine-3)</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>same as 10.0.0.93</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>--</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>-----Original Message-----</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>From: Simone Tiraboschi [<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>]</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Sent: Friday, December 19, 2014 12:28 AM</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>To: Yue, Cong</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Cc: <a href="mailto:users@ovirt.org">users@ovirt.org</a></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Subject: Re: [ovirt-users] VM failover with ovirt3.5</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>----- Original Message -----</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a>></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>To: <a href="mailto:users@ovirt.org">users@ovirt.org</a></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>Sent: Friday, December 19, 2014 2:14:33 AM</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>Subject: [ovirt-users] VM failover with ovirt3.5</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>Hi</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>In my environment, I have 3 ovirt nodes as one cluster. And on top of</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>host-1, there is one vm to host ovirt engine.</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>Also I have one external storage for the cluster to use as data domain</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>of engine and data.</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>I confirmed live migration works well in my environment.</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>But it seems very buggy for VM failover if I try to force to shut down</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>one ovirt node. Sometimes the VM in the node which is shutdown can</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>migrate to other host, but it take more than several minutes.</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>Sometimes, it can not migrate at all. Sometimes, only when the host is</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>back, the VM is beginning to move.</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>Can you please check or share the logs under /var/log/ovirt-hosted-engine-ha/</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>?</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>Is there some documentation to explain how VM failover is working? And</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>is there some bugs reported related with this?</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span><a href="http://www.ovirt.org/Features/Self_Hosted_Engine#Agent_State_Diagram">http://www.ovirt.org/Features/Self_Hosted_Engine#Agent_State_Diagram</a></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>Thanks in advance,</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>Cong</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>This e-mail message is for the sole use of the intended recipient(s)</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>and may contain confidential and privileged information. Any</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>unauthorized review, use, disclosure or distribution is prohibited. If</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>you are not the intended recipient, please contact the sender by reply</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>e-mail and destroy all copies of the original message. If you are the</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>intended recipient, please be advised that the content of this message</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>is subject to access, review and disclosure by the sender's e-mail System</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>Administrator.</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>_______________________________________________</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span>Users mailing list</span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span><a href="mailto:Users@ovirt.org">Users@ovirt.org</a></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite">
<blockquote type="cite"><span><a href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a></span><br>
</blockquote>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>This e-mail message is for the sole use of the intended recipient(s) and may</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>contain confidential and privileged information. Any unauthorized review,</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>use, disclosure or distribution is prohibited. If you are not the intended</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>recipient, please contact the sender by reply e-mail and destroy all copies</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>of the original message. If you are the intended recipient, please be</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>advised that the content of this message is subject to access, review and</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span>disclosure by the sender's e-mail System Administrator.</span><br>
</blockquote>
</blockquote>
<blockquote type="cite">
<blockquote type="cite"><span></span><br>
</blockquote>
</blockquote>
<span></span><br>
<span>This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact
the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's e-mail System Administrator.</span><br>
<span>_______________________________________________</span><br>
<span>Users mailing list</span><br>
<span><a href="mailto:Users@ovirt.org">Users@ovirt.org</a></span><br>
<span><a href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a></span><br>
</div>
</blockquote>
<br>
<hr>
<font face="Arial" color="Gray" size="1">This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's
e-mail System Administrator.<br>
</font>
</body>
</html>