<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body dir="auto">
<div style="-webkit-text-size-adjust: auto;">Thanks and the --vm-status log is as follows:</div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);">[root@compute2-2 ~]# hosted-engine --vm-status<br>
<br>
<br>
--== Host 1 status ==--<br>
<br>
Status up-to-date : True<br>
Hostname : 10.0.0.94<br>
Host ID : 1<br>
Engine status : {"health": "good", "vm": "up",<br>
"detail": "up"}<br>
Score : 2400<br>
Local maintenance : False<br>
Host timestamp : <a href="tel:1008087" x-apple-data-detectors="true" x-apple-data-detectors-type="telephone" x-apple-data-detectors-result="1">1008087</a><br>
Extra metadata (valid at timestamp):<br>
metadata_parse_version=1<br>
metadata_feature_version=1<br>
timestamp=<a href="tel:1008087" x-apple-data-detectors="true" x-apple-data-detectors-type="telephone" x-apple-data-detectors-result="2">1008087</a> (Mon Dec 29 11:25:51 2014)<br>
host-id=1<br>
score=2400<br>
maintenance=False<br>
state=EngineUp<br>
<br>
<br>
--== Host 2 status ==--<br>
<br>
Status up-to-date : True<br>
Hostname : 10.0.0.93<br>
Host ID : 2<br>
Engine status : {"reason": "vm not running on<br>
this host", "health": "bad", "vm": "down", "detail": "unknown"}<br>
Score : 0<br>
Local maintenance : True<br>
Host timestamp : 859142<br>
Extra metadata (valid at timestamp):<br>
metadata_parse_version=1<br>
metadata_feature_version=1<br>
timestamp=859142 (Mon Dec 29 08:25:08 2014)<br>
host-id=2<br>
score=0<br>
maintenance=True<br>
state=LocalMaintenance<br>
<br>
<br>
--== Host 3 status ==--<br>
<br>
Status up-to-date : True<br>
Hostname : 10.0.0.92<br>
Host ID : 3<br>
Engine status : {"reason": "vm not running on<br>
this host", "health": "bad", "vm": "down", "detail": "unknown"}<br>
Score : 0<br>
Local maintenance : True<br>
Host timestamp : 853615<br>
Extra metadata (valid at timestamp):<br>
metadata_parse_version=1<br>
metadata_feature_version=1<br>
timestamp=853615 (Mon Dec 29 08:25:57 2014)<br>
host-id=3<br>
score=0<br>
maintenance=True<br>
state=LocalMaintenance<br>
You have new mail in /var/spool/mail/root<br>
[root@compute2-2 ~]#</span></div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);"><br>
</span></div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);">Could you please explain how VM failover works inside ovirt? Is there any other debug option I can enable to check the problem?</span></div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);"><br>
</span></div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);">Thanks,</span></div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);">Cong</span></div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);"><br>
</span></div>
<div style="-webkit-text-size-adjust: auto;"><br>
On 2014/12/29, at 1:39, "Artyom Lukianov" <<a href="mailto:alukiano@redhat.com">alukiano@redhat.com</a>> wrote:<br>
<br>
</div>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;">
<div><span>Can you also provide output of hosted-engine --vm-status please, previous time it was useful, because I do not see something unusual.</span><br>
<span>Thanks</span><br>
<span></span><br>
<span>----- Original Message -----</span><br>
<span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a>></span><br>
<span>To: "Artyom Lukianov" <<a href="mailto:alukiano@redhat.com">alukiano@redhat.com</a>></span><br>
<span>Cc: "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a>>,
<a href="mailto:users@ovirt.org">users@ovirt.org</a></span><br>
<span>Sent: Monday, December 29, 2014 7:15:24 AM</span><br>
<span>Subject: Re: [ovirt-users] VM failover with ovirt3.5</span><br>
<span></span><br>
<span>Also I change the maintenance mode to local in another host. But also the VM in this host can not be migrated. The logs are as follows.</span><br>
<span></span><br>
<span>[root@compute2-2 ~]# hosted-engine --set-maintenance --mode=local</span><br>
<span>[root@compute2-2 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:04,184::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:14,603::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:14,603::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:24,903::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:24,904::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:35,026::states::437::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
<span>Engine vm is running on host 10.0.0.94 (id 1)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:35,236::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:35,236::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:45,604::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:45,604::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:55,691::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
<span>Local maintenance detected</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:55,701::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)</span><br>
<span>Trying: notify time=1419829795.7 type=state_transition</span><br>
<span>detail=EngineDown-LocalMaintenance hostname='compute2-2'</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:55,761::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)</span><br>
<span>Success, was notification of state_transition</span><br>
<span>(EngineDown-LocalMaintenance) sent? sent</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:55,990::states::208::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score)</span><br>
<span>Score is 0 due to local maintenance mode</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:55,990::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state LocalMaintenance (score: 0)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>21:09:55,991::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>^C</span><br>
<span>You have new mail in /var/spool/mail/root</span><br>
<span>[root@compute2-2 ~]# ps -ef | grep qemu</span><br>
<span>root 18420 2777 0 21:10<x-apple-data-detectors://39> pts/0 00:00:00<x-apple-data-detectors://40> grep --color=auto qemu</span><br>
<span>qemu 29809 1 0 Dec19 ? 01:17:20 /usr/libexec/qemu-kvm</span><br>
<span>-name testvm2-2 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Nehalem</span><br>
<span>-m 500 -realtime mlock=off -smp</span><br>
<span>1,maxcpus=16,sockets=16,cores=1,threads=1 -uuid</span><br>
<span>c31e97d0-135e-42da-9954-162b5228dce3 -smbios</span><br>
<span>type=1,manufacturer=oVirt,product=oVirt</span><br>
<span>Node,version=7-0.1406.el7.centos.2.5,serial=4C4C4544-0059-3610-8033-B4C04F395931,uuid=c31e97d0-135e-42da-9954-162b5228dce3</span><br>
<span>-no-user-config -nodefaults -chardev</span><br>
<span>socket,id=charmonitor,path=/var/lib/libvirt/qemu/testvm2-2.monitor,server,nowait</span><br>
<span>-mon chardev=charmonitor,id=monitor,mode=control -rtc</span><br>
<span>base=2014-12-19T20:17:17<x-apple-data-detectors://42>,driftfix=slew -no-kvm-pit-reinjection</span><br>
<span>-no-hpet -no-shutdown -boot strict=on -device</span><br>
<span>piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device</span><br>
<span>virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device</span><br>
<span>virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5</span><br>
<span>-drive if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial=</span><br>
<span>-device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0</span><br>
<span>-drive file=/rhev/data-center/00000002-0002-0002-0002-0000000001e4/1dc71096-27c4-4256-b2ac-bd7265525c69/images/5cbeb8c9-4f04-48d0-a5eb-78c49187c550/a0570e8c-9867-4ec4-818f-11e102fc4f9b,if=none,id=drive-virtio-disk0,format=qcow2,serial=5cbeb8c9-4f04-48d0-a5eb-78c49187c550,cache=none,werror=stop,rerror=stop,aio=threads</span><br>
<span>-device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1</span><br>
<span>-netdev tap,fd=28,id=hostnet0,vhost=on,vhostfd=29 -device</span><br>
<span>virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:db:94:00,bus=pci.0,addr=0x3</span><br>
<span>-chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/c31e97d0-135e-42da-9954-162b5228dce3.com.redhat.rhevm.vdsm,server,nowait</span><br>
<span>-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm</span><br>
<span>-chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/c31e97d0-135e-42da-9954-162b5228dce3.org.qemu.guest_agent.0,server,nowait</span><br>
<span>-device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0</span><br>
<span>-chardev spicevmc,id=charchannel2,name=vdagent -device</span><br>
<span>virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0</span><br>
<span>-spice tls-port=5901,addr=10.0.0.93,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on</span><br>
<span>-k en-us -vga qxl -global qxl-vga.ram_size=67108864<tel:67108864> -global</span><br>
<span>qxl-vga.vram_size=33554432<tel:33554432> -incoming tcp:[::]:49152 -device</span><br>
<span>virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x7</span><br>
<span>[root@compute2-2 ~]#</span><br>
<span></span><br>
<span>Thanks,</span><br>
<span>Cong</span><br>
<span></span><br>
<span></span><br>
<span>On 2014/12/28, at 20:53, "Yue, Cong" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>>> wrote:</span><br>
<span></span><br>
<span>I checked it again and confirmed there is one guest VM is running on the top of this host. The log is as follows:</span><br>
<span></span><br>
<span>[root@compute2-1 vdsm]# ps -ef | grep qemu</span><br>
<span>qemu 2983 846 0 Dec19 ? 00:00:00<x-apple-data-detectors://0> [supervdsmServer] <defunct></span><br>
<span>root 5489 3053 0 20:49<x-apple-data-detectors://1> pts/0 00:00:00<x-apple-data-detectors://2> grep --color=auto qemu</span><br>
<span>qemu 26128 1 0 Dec19 ? 01:09:19 /usr/libexec/qemu-kvm</span><br>
<span>-name testvm2 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Nehalem -m</span><br>
<span>500 -realtime mlock=off -smp 1,maxcpus=16,sockets=16,cores=1,threads=1</span><br>
<span>-uuid e46bca87-4df5-4287-844b-90a26fccef33 -smbios</span><br>
<span>type=1,manufacturer=oVirt,product=oVirt</span><br>
<span>Node,version=7-0.1406.el7.centos.2.5,serial=4C4C4544-0030-3310-8059-B8C04F585231,uuid=e46bca87-4df5-4287-844b-90a26fccef33</span><br>
<span>-no-user-config -nodefaults -chardev</span><br>
<span>socket,id=charmonitor,path=/var/lib/libvirt/qemu/testvm2.monitor,server,nowait</span><br>
<span>-mon chardev=charmonitor,id=monitor,mode=control -rtc</span><br>
<span>base=2014-12-19T20:18:01<x-apple-data-detectors://4>,driftfix=slew -no-kvm-pit-reinjection</span><br>
<span>-no-hpet -no-shutdown -boot strict=on -device</span><br>
<span>piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device</span><br>
<span>virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device</span><br>
<span>virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5</span><br>
<span>-drive if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial=</span><br>
<span>-device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0</span><br>
<span>-drive file=/rhev/data-center/00000002-0002-0002-0002-0000000001e4/1dc71096-27c4-4256-b2ac-bd7265525c69/images/b4b5426b-95e3-41af-b286-da245891cdaf/0f688d49-97e3-4f1d-84d4-ac1432d903b3,if=none,id=drive-virtio-disk0,format=qcow2,serial=b4b5426b-95e3-41af-b286-da245891cdaf,cache=none,werror=stop,rerror=stop,aio=threads</span><br>
<span>-device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1</span><br>
<span>-netdev tap,fd=26,id=hostnet0,vhost=on,vhostfd=27 -device</span><br>
<span>virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:db:94:01,bus=pci.0,addr=0x3</span><br>
<span>-chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/e46bca87-4df5-4287-844b-90a26fccef33.com.redhat.rhevm.vdsm,server,nowait</span><br>
<span>-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm</span><br>
<span>-chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/e46bca87-4df5-4287-844b-90a26fccef33.org.qemu.guest_agent.0,server,nowait</span><br>
<span>-device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0</span><br>
<span>-chardev spicevmc,id=charchannel2,name=vdagent -device</span><br>
<span>virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0</span><br>
<span>-spice tls-port=5900,addr=10.0.0.92,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on</span><br>
<span>-k en-us -vga qxl -global qxl-vga.ram_size=67108864<tel:67108864> -global</span><br>
<span>qxl-vga.vram_size=33554432<tel:33554432> -incoming tcp:[::]:49152 -device</span><br>
<span>virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x7</span><br>
<span>[root@compute2-1 vdsm]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>20:49:27,315::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
<span>Local maintenance detected</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>20:49:27,646::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state LocalMaintenance (score: 0)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>20:49:27,646::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>20:49:37,732::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
<span>Local maintenance detected</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>20:49:37,961::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state LocalMaintenance (score: 0)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>20:49:37,961::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>20:49:48,048::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
<span>Local maintenance detected</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>20:49:48,319::states::208::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score)</span><br>
<span>Score is 0 due to local maintenance mode</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>20:49:48,319::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state LocalMaintenance (score: 0)</span><br>
<span>MainThread::INFO::2014-12-28</span><br>
<span>20:49:48,319::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span></span><br>
<span>Thanks,</span><br>
<span>Cong</span><br>
<span></span><br>
<span></span><br>
<span>On 2014/12/28, at 3:46, "Artyom Lukianov" <<a href="mailto:alukiano@redhat.com">alukiano@redhat.com</a><<a href="mailto:alukiano@redhat.com">mailto:alukiano@redhat.com</a>>> wrote:</span><br>
<span></span><br>
<span>I see that you set local maintenance on host3 that do not have engine vm on it, so it nothing to migrate from this host.</span><br>
<span>If you set local maintenance on host1, vm must migrate to another host with positive score.</span><br>
<span>Thanks</span><br>
<span></span><br>
<span>----- Original Message -----</span><br>
<span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>>></span><br>
<span>To: "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a><<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>>></span><br>
<span>Cc: <a href="mailto:users@ovirt.org">users@ovirt.org</a><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>></span><br>
<span>Sent: Saturday, December 27, 2014 6:58:32 PM</span><br>
<span>Subject: Re: [ovirt-users] VM failover with ovirt3.5</span><br>
<span></span><br>
<span>Hi</span><br>
<span></span><br>
<span>I had a try with "hosted-engine --set-maintence --mode=local" on</span><br>
<span>compute2-1, which is host 3 in my cluster. From the log, it shows</span><br>
<span>maintence mode is dectected, but migration does not happen.</span><br>
<span></span><br>
<span>The logs are as follows. Is there any other config I need to check?</span><br>
<span></span><br>
<span>[root@compute2-1 vdsm]# hosted-engine --vm-status</span><br>
<span></span><br>
<span></span><br>
<span>--== Host 1 status ==-</span><br>
<span></span><br>
<span>Status up-to-date : True</span><br>
<span>Hostname : 10.0.0.94</span><br>
<span>Host ID : 1</span><br>
<span>Engine status : {"health": "good", "vm": "up",</span><br>
<span>"detail": "up"}</span><br>
<span>Score : 2400</span><br>
<span>Local maintenance : False</span><br>
<span>Host timestamp : 836296</span><br>
<span>Extra metadata (valid at timestamp):</span><br>
<span>metadata_parse_version=1</span><br>
<span>metadata_feature_version=1</span><br>
<span>timestamp=836296 (Sat Dec 27 11:42:39 2014)</span><br>
<span>host-id=1</span><br>
<span>score=2400</span><br>
<span>maintenance=False</span><br>
<span>state=EngineUp</span><br>
<span></span><br>
<span></span><br>
<span>--== Host 2 status ==--</span><br>
<span></span><br>
<span>Status up-to-date : True</span><br>
<span>Hostname : 10.0.0.93</span><br>
<span>Host ID : 2</span><br>
<span>Engine status : {"reason": "vm not running on</span><br>
<span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
<span>Score : 2400</span><br>
<span>Local maintenance : False</span><br>
<span>Host timestamp : 687358</span><br>
<span>Extra metadata (valid at timestamp):</span><br>
<span>metadata_parse_version=1</span><br>
<span>metadata_feature_version=1</span><br>
<span>timestamp=687358 (Sat Dec 27 08:42:04 2014)</span><br>
<span>host-id=2</span><br>
<span>score=2400</span><br>
<span>maintenance=False</span><br>
<span>state=EngineDown</span><br>
<span></span><br>
<span></span><br>
<span>--== Host 3 status ==--</span><br>
<span></span><br>
<span>Status up-to-date : True</span><br>
<span>Hostname : 10.0.0.92</span><br>
<span>Host ID : 3</span><br>
<span>Engine status : {"reason": "vm not running on</span><br>
<span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
<span>Score : 0</span><br>
<span>Local maintenance : True</span><br>
<span>Host timestamp : 681827</span><br>
<span>Extra metadata (valid at timestamp):</span><br>
<span>metadata_parse_version=1</span><br>
<span>metadata_feature_version=1</span><br>
<span>timestamp=681827 (Sat Dec 27 08:42:40 2014)</span><br>
<span>host-id=3</span><br>
<span>score=0</span><br>
<span>maintenance=True</span><br>
<span>state=LocalMaintenance</span><br>
<span>[root@compute2-1 vdsm]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:42:41,109::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:42:51,198::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
<span>Local maintenance detected</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:42:51,420::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state LocalMaintenance (score: 0)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:42:51,420::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:01,507::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
<span>Local maintenance detected</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:01,773::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state LocalMaintenance (score: 0)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:01,773::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:11,859::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
<span>Local maintenance detected</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:12,072::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state LocalMaintenance (score: 0)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:43:12,072::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span></span><br>
<span></span><br>
<span></span><br>
<span>[root@compute2-3 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:28,855::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:39,130::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:39,130::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:49,449::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:49,449::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:59,739::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:36:59,739::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:37:09,779::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
<span>Engine vm running on localhost</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:37:10,026::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:37:10,026::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:37:20,331::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>11:37:20,331::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span></span><br>
<span></span><br>
<span>[root@compute2-2 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:12,462::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:22,797::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:22,798::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:32,876::states::437::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
<span>Engine vm is running on host 10.0.0.94 (id 1)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:33,169::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:33,169::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:43,567::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:43,567::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:53,858::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:36:53,858::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,028::state_machine::160::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Global metadata: {'maintenance': False}</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,028::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Host 10.0.0.94 (id 1): {'extra':</span><br>
<span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=835987</span><br>
<span>(Sat Dec 27 11:37:30</span><br>
<span>2014)\nhost-id=1\nscore=2400\nmaintenance=False\nstate=EngineUp\n',</span><br>
<span>'hostname': '10.0.0.94', 'alive': True, 'host-id': 1, 'engine-status':</span><br>
<span>{'health': 'good', 'vm': 'up', 'detail': 'up'}, 'score': 2400,</span><br>
<span>'maintenance': False, 'host-ts': 835987}</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,028::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Host 10.0.0.92 (id 3): {'extra':</span><br>
<span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=681528</span><br>
<span>(Sat Dec 27 08:37:41</span><br>
<span>2014)\nhost-id=3\nscore=0\nmaintenance=True\nstate=LocalMaintenance\n',</span><br>
<span>'hostname': '10.0.0.92', 'alive': True, 'host-id': 3, 'engine-status':</span><br>
<span>{'reason': 'vm not running on this host', 'health': 'bad', 'vm':</span><br>
<span>'down', 'detail': 'unknown'}, 'score': 0, 'maintenance': True,</span><br>
<span>'host-ts': 681528}</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,028::state_machine::168::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Local (id 2): {'engine-health': {'reason': 'vm not running on this</span><br>
<span>host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge':</span><br>
<span>True, 'mem-free': 15300.0, 'maintenance': False, 'cpu-load': 0.0215,</span><br>
<span>'gateway': True}</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,265::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-27</span><br>
<span>08:37:04,265::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span></span><br>
<span>Thanks,</span><br>
<span>Cong</span><br>
<span></span><br>
<span>On 2014/12/22, at 5:29, "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a><<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>>> wrote:</span><br>
<span></span><br>
<span></span><br>
<span></span><br>
<span>----- Original Message -----</span><br>
<span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>>></span><br>
<span>To: "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a><<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>>></span><br>
<span>Cc: <a href="mailto:users@ovirt.org">users@ovirt.org</a><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>></span><br>
<span>Sent: Friday, December 19, 2014 7:22:10 PM</span><br>
<span>Subject: RE: [ovirt-users] VM failover with ovirt3.5</span><br>
<span></span><br>
<span>Thanks for the information. This is the log for my three ovirt nodes.</span><br>
<span>From the output of hosted-engine --vm-status, it shows the engine state for</span><br>
<span>my 2nd and 3rd ovirt node is DOWN.</span><br>
<span>Is this the reason why VM failover not work in my environment?</span><br>
<span></span><br>
<span>No, they looks ok: you can run the engine VM on single host at a time.</span><br>
<span></span><br>
<span>How can I make</span><br>
<span>also engine works for my 2nd and 3rd ovit nodes?</span><br>
<span></span><br>
<span>If you put the host 1 in local maintenance mode ( hosted-engine --set-maintenance --mode=local ) the VM should migrate to host 2; if you reactivate host 1 ( hosted-engine --set-maintenance --mode=none ) and put host 2 in local maintenance mode the VM
should migrate again.</span><br>
<span></span><br>
<span>Can you please try that and post the logs if something is going bad?</span><br>
<span></span><br>
<span></span><br>
<span>--</span><br>
<span>--== Host 1 status ==--</span><br>
<span></span><br>
<span>Status up-to-date : True</span><br>
<span>Hostname : 10.0.0.94</span><br>
<span>Host ID : 1</span><br>
<span>Engine status : {"health": "good", "vm": "up",</span><br>
<span>"detail": "up"}</span><br>
<span>Score : 2400</span><br>
<span>Local maintenance : False</span><br>
<span>Host timestamp : 150475</span><br>
<span>Extra metadata (valid at timestamp):</span><br>
<span>metadata_parse_version=1</span><br>
<span>metadata_feature_version=1</span><br>
<span>timestamp=150475 (Fri Dec 19 13:12:18 2014)</span><br>
<span>host-id=1</span><br>
<span>score=2400</span><br>
<span>maintenance=False</span><br>
<span>state=EngineUp</span><br>
<span></span><br>
<span></span><br>
<span>--== Host 2 status ==--</span><br>
<span></span><br>
<span>Status up-to-date : True</span><br>
<span>Hostname : 10.0.0.93</span><br>
<span>Host ID : 2</span><br>
<span>Engine status : {"reason": "vm not running on</span><br>
<span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
<span>Score : 2400</span><br>
<span>Local maintenance : False</span><br>
<span>Host timestamp : 1572</span><br>
<span>Extra metadata (valid at timestamp):</span><br>
<span>metadata_parse_version=1</span><br>
<span>metadata_feature_version=1</span><br>
<span>timestamp=1572 (Fri Dec 19 10:12:18 2014)</span><br>
<span>host-id=2</span><br>
<span>score=2400</span><br>
<span>maintenance=False</span><br>
<span>state=EngineDown</span><br>
<span></span><br>
<span></span><br>
<span>--== Host 3 status ==--</span><br>
<span></span><br>
<span>Status up-to-date : False</span><br>
<span>Hostname : 10.0.0.92</span><br>
<span>Host ID : 3</span><br>
<span>Engine status : unknown stale-data</span><br>
<span>Score : 2400</span><br>
<span>Local maintenance : False</span><br>
<span>Host timestamp : 987</span><br>
<span>Extra metadata (valid at timestamp):</span><br>
<span>metadata_parse_version=1</span><br>
<span>metadata_feature_version=1</span><br>
<span>timestamp=987 (Fri Dec 19 10:09:58 2014)</span><br>
<span>host-id=3</span><br>
<span>score=2400</span><br>
<span>maintenance=False</span><br>
<span>state=EngineDown</span><br>
<span></span><br>
<span>--</span><br>
<span>And the /var/log/ovirt-hosted-engine-ha/agent.log for three ovirt nodes are</span><br>
<span>as follows:</span><br>
<span>--</span><br>
<span>10.0.0.94(hosted-engine-1)</span><br>
<span>---</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:09:33,716::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:09:33,716::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:09:44,017::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:09:44,017::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:09:54,303::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:09:54,303::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:04,342::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
<span>Engine vm running on localhost</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:04,617::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:04,617::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:14,657::state_machine::160::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Global metadata: {'maintenance': False}</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:14,657::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Host 10.0.0.93 (id 2): {'extra':</span><br>
<span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1448</span><br>
<span>(Fri Dec 19 10:10:14</span><br>
<span>2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineDown\n',</span><br>
<span>'hostname': '10.0.0.93', 'alive': True, 'host-id': 2, 'engine-status':</span><br>
<span>{'reason': 'vm not running on this host', 'health': 'bad', 'vm':</span><br>
<span>'down', 'detail': 'unknown'}, 'score': 2400, 'maintenance': False,</span><br>
<span>'host-ts': 1448}</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:14,657::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Host 10.0.0.92 (id 3): {'extra':</span><br>
<span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=987</span><br>
<span>(Fri Dec 19 10:09:58</span><br>
<span>2014)\nhost-id=3\nscore=2400\nmaintenance=False\nstate=EngineDown\n',</span><br>
<span>'hostname': '10.0.0.92', 'alive': True, 'host-id': 3, 'engine-status':</span><br>
<span>{'reason': 'vm not running on this host', 'health': 'bad', 'vm':</span><br>
<span>'down', 'detail': 'unknown'}, 'score': 2400, 'maintenance': False,</span><br>
<span>'host-ts': 987}</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:14,658::state_machine::168::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
<span>Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up',</span><br>
<span>'detail': 'up'}, 'bridge': True, 'mem-free': 1079.0, 'maintenance':</span><br>
<span>False, 'cpu-load': 0.0269, 'gateway': True}</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:14,904::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:14,904::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:25,210::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:25,210::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:35,499::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:35,499::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:45,784::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:45,785::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:56,070::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:10:56,070::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:11:06,109::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
<span>Engine vm running on localhost</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:11:06,359::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:11:06,359::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:11:16,658::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:11:16,658::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:11:26,991::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:11:26,991::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:11:37,341::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineUp (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>13:11:37,341::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
<span>----</span><br>
<span></span><br>
<span>10.0.0.93 (hosted-engine-2)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:12:18,339::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:12:18,339::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:12:28,651::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:12:28,652::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:12:39,010::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:12:39,010::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:12:49,338::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:12:49,338::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:12:59,642::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:12:59,642::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:13:10,010::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Current state EngineDown (score: 2400)</span><br>
<span>MainThread::INFO::2014-12-19</span><br>
<span>10:13:10,010::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
<span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
<span></span><br>
<span></span><br>
<span>10.0.0.92(hosted-engine-3)</span><br>
<span>same as 10.0.0.93</span><br>
<span>--</span><br>
<span></span><br>
<span>-----Original Message-----</span><br>
<span>From: Simone Tiraboschi [<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>]</span><br>
<span>Sent: Friday, December 19, 2014 12:28 AM</span><br>
<span>To: Yue, Cong</span><br>
<span>Cc: <a href="mailto:users@ovirt.org">users@ovirt.org</a><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>></span><br>
<span>Subject: Re: [ovirt-users] VM failover with ovirt3.5</span><br>
<span></span><br>
<span></span><br>
<span></span><br>
<span>----- Original Message -----</span><br>
<span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>>></span><br>
<span>To: <a href="mailto:users@ovirt.org">users@ovirt.org</a><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>></span><br>
<span>Sent: Friday, December 19, 2014 2:14:33 AM</span><br>
<span>Subject: [ovirt-users] VM failover with ovirt3.5</span><br>
<span></span><br>
<span></span><br>
<span></span><br>
<span>Hi</span><br>
<span></span><br>
<span></span><br>
<span></span><br>
<span>In my environment, I have 3 ovirt nodes as one cluster. And on top of</span><br>
<span>host-1, there is one vm to host ovirt engine.</span><br>
<span></span><br>
<span>Also I have one external storage for the cluster to use as data domain</span><br>
<span>of engine and data.</span><br>
<span></span><br>
<span>I confirmed live migration works well in my environment.</span><br>
<span></span><br>
<span>But it seems very buggy for VM failover if I try to force to shut down</span><br>
<span>one ovirt node. Sometimes the VM in the node which is shutdown can</span><br>
<span>migrate to other host, but it take more than several minutes.</span><br>
<span></span><br>
<span>Sometimes, it can not migrate at all. Sometimes, only when the host is</span><br>
<span>back, the VM is beginning to move.</span><br>
<span></span><br>
<span>Can you please check or share the logs under /var/log/ovirt-hosted-engine-ha/</span><br>
<span>?</span><br>
<span></span><br>
<span>Is there some documentation to explain how VM failover is working? And</span><br>
<span>is there some bugs reported related with this?</span><br>
<span></span><br>
<span><a href="http://www.ovirt.org/Features/Self_Hosted_Engine#Agent_State_Diagram">http://www.ovirt.org/Features/Self_Hosted_Engine#Agent_State_Diagram</a></span><br>
<span></span><br>
<span>Thanks in advance,</span><br>
<span></span><br>
<span>Cong</span><br>
<span></span><br>
<span></span><br>
<span></span><br>
<span></span><br>
<span>This e-mail message is for the sole use of the intended recipient(s)</span><br>
<span>and may contain confidential and privileged information. Any</span><br>
<span>unauthorized review, use, disclosure or distribution is prohibited. If</span><br>
<span>you are not the intended recipient, please contact the sender by reply</span><br>
<span>e-mail and destroy all copies of the original message. If you are the</span><br>
<span>intended recipient, please be advised that the content of this message</span><br>
<span>is subject to access, review and disclosure by the sender's e-mail System</span><br>
<span>Administrator.</span><br>
<span></span><br>
<span>_______________________________________________</span><br>
<span>Users mailing list</span><br>
<span><a href="mailto:Users@ovirt.org">Users@ovirt.org</a><<a href="mailto:Users@ovirt.org">mailto:Users@ovirt.org</a>></span><br>
<span><a href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a></span><br>
<span></span><br>
<span>This e-mail message is for the sole use of the intended recipient(s) and may</span><br>
<span>contain confidential and privileged information. Any unauthorized review,</span><br>
<span>use, disclosure or distribution is prohibited. If you are not the intended</span><br>
<span>recipient, please contact the sender by reply e-mail and destroy all copies</span><br>
<span>of the original message. If you are the intended recipient, please be</span><br>
<span>advised that the content of this message is subject to access, review and</span><br>
<span>disclosure by the sender's e-mail System Administrator.</span><br>
<span></span><br>
<span></span><br>
<span>This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact
the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's e-mail System Administrator.</span><br>
<span>_______________________________________________</span><br>
<span>Users mailing list</span><br>
<span><a href="mailto:Users@ovirt.org">Users@ovirt.org</a><<a href="mailto:Users@ovirt.org">mailto:Users@ovirt.org</a>></span><br>
<span><a href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a></span><br>
<span></span><br>
<span>________________________________</span><br>
<span>This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact
the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's e-mail System Administrator.</span><br>
</div>
</blockquote>
<br>
<hr>
<font face="Arial" color="Gray" size="1">This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's
e-mail System Administrator.<br>
</font>
</body>
</html>