<div dir="ltr"><div><div><div><div>Ok, <br></div>Thanx already for all the help. I adapted some things for quicker respons:<br>engine-config --get FenceQuietTimeBetweenOperationsInSec-->180<br> engine-config --set FenceQuietTimeBetweenOperationsInSec=60<br>
<br> engine-config --get StorageDomainFalureTimeoutInMinutes-->180<br> engine-config --set StorageDomainFalureTimeoutInMinutes=1<br><br> engine-config --get SpmCommandFailOverRetries-->5<br> engine-config --set SpmCommandFailOverRetries<br>
<br> engine-config --get SPMFailOverAttempts-->3<br> engine-config --set SPMFailOverAttempts=1<br><br>engine-config --get NumberOfFailedRunsOnVds-->3<br> engine-config --set NumberOfFailedRunsOnVds=1<br><br>engine-config --get vdsTimeout-->180<br>
engine-config --set vdsTimeout=30<br><br>engine-config --get VDSAttemptsToResetCount-->2<br>engine-config --set VDSAttemptsToResetCount=1<br><br>engine-config --get TimeoutToResetVdsInSeconds-->60<br>engine-config --set TimeoutToResetVdsInSeconds=30<br>
<br></div>Now the result of this is that when the VM is not running on the SPM that it will migrate before going in pause mode.<br></div>But when we tried it, when the vm is running on the SPM, it get's in paused mode (for safety reasons, I know ;-) ). And stays there until the host gets MANUALLY fenced by rebooting it. So now my question is... How can I make the hypervisor fence (so reboots, so vm is moved) quicker?<br>
<br></div>Kind regards,<br><br>Koen<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-04-04 16:28 GMT+02:00 Koen Vanoppen <span dir="ltr"><<a href="mailto:vanoppen.koen@gmail.com" target="_blank">vanoppen.koen@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr">Ja das waar. Maar was aan't rijden... Dus ik stuur maar door dan :-). Ik heb reeds de time out aangepast. Die stond op 5 min voor hij den time out ging geven. Staat nu op 2 min</p>
<div class="HOEnZb"><div class="h5">
<div class="gmail_quote">On Apr 4, 2014 4:14 PM, "David Van Zeebroeck" <<a href="mailto:david.van.zeebroeck@brusselsairport.be" target="_blank">david.van.zeebroeck@brusselsairport.be</a>> wrote:<br type="attribution">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div link="blue" vlink="purple" lang="NL-BE">
<p></p>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Ik heb ze ook he<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Maar normaal had de fencing moeten werken als ik het zo lees<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Dus daar is ergens iets verkeerd gelopen zo te lezen<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US"> Koen Vanoppen [mailto:<a href="mailto:vanoppen.koen@gmail.com" target="_blank">vanoppen.koen@gmail.com</a>]
<br>
<b>Sent:</b> vrijdag 4 april 2014 16:07<br>
<b>To:</b> David Van Zeebroeck<br>
<b>Subject:</b> Fwd: Re: [Users] HA<u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal"></p>
</div>
</div>
<p></p>
<p> </p>
<p><span style="font-family:calibri;font-size:small;color:#e30613;font-weight:bold"></span><span style="font-family:Calibri;font-size:small;color:#e30613;font-weight:bold">David Van Zeebroeck</span> <span style="font-family:calibri;font-size:small;color:#e30613;font-weight:normal"></span></p>
<p><span style="font-style:italic;font-size:small;font-family:Calibri">Product Manager Unix Infrastructure</span></p>
<p><span style="font-family:calibri;font-size:small;font-weight:normal">Information & Communication Technology</span></p>
<p><font color="#000000" face="Calibri"><strong>Brussels Airport Company</strong></font></p>
<font face="Calibri"><strong></strong>
<p><span style="font-size:small;font-family:calibri"><span style="font-family:Calibri;font-size:small;font-weight:bold">T
</span><a href="tel:%2B32%20%280%292%20753%2066%2024" value="+3227536624" target="_blank">+32 (0)2 753 66 24</a></span> <span style="font-family:calibri;font-size:small"></span></p>
<p><span style="font-size:small;font-family:Calibri"><span style="font-size:small;font-family:Calibri;font-weight:bold">M
</span><a href="tel:%2B32%20%280%29497%2002%2017%2031" value="+32497021731" target="_blank">+32 (0)497 02 17 31</a></span></p>
</font><font face="Calibri"><strong></strong>
<p><span style="font-size:small;text-decoration:underline;font-family:Calibri"><span style="font-size:small;text-decoration:underline;font-family:Calibri"><a href="mailto:david.van.zeebroeck@brusselsairport.be" title="Click to send email to David Van Zeebroeck" target="_blank"><span style="font-size:small;text-decoration:underline;font-family:Calibri">david.van.zeebroeck@brusselsairport.be</span></a></span></span></p>
<p><font face="Calibri"><span style="font-size:small;text-decoration:underline;font-family:Calibri"><span style="font-size:small;text-decoration:underline;font-family:Calibri"><a title="Click to send email to "><span style="font-size:small;text-decoration:underline;font-family:Calibri"></span></a></span></span></font></p>
</font>
<p><font style="font-size:12pt;font-style:normal;font-family:Calibri" color="#000000" face="Calibri" size="3"><strong><a style="font-variant:normal;text-transform:none;font-size:small;font-style:normal;font-family:Calibri;font-weight:bold" href="http://www.brusselsairport.be" target="_blank">www.brusselsairport.be</a></strong></font></p>
<p> </p>
<p><font size="1"><img src="cid:image490c34.JPG@e2fa480e.4dae381e" border="0" height="56" vspace="10" width="140"></font></p>
<p><font face="Calibri" size="1"><strong></strong></font> </p>
<p><font face="Calibri" size="1"><strong>FOLLOW US ON:</strong></font></p>
<p><a href="http://https://nl-nl.facebook.com/BrusselsairportBRU" target="_blank"></a></p>
<p><a href="http://www.brusselsairport.be/en/mediaroom/brusm/" target="_blank"><img src="cid:image157135.JPG@d9b94c8c.46b7f25e" border="0" height="49" width="286"></a></p>
<p> </p>
<p><font color="#000000"><font color="#000000" face="Cambria" size="1"><a style="font-variant:normal;font-size:xx-small;font-style:normal;font-family:Calibri;font-weight:bold" href="http://www.brusselsairport.be/en/maildisclaimer/" target="_blank">Company
Info</a></font></font></p>
<p> </p>
<p></p>
<div>
<div>
<p class="MsoNormal">---------- Forwarded message ----------<br>
From: "Michal Skrivanek" <<a href="mailto:michal.skrivanek@redhat.com" target="_blank">michal.skrivanek@redhat.com</a>><br>
Date: Apr 4, 2014 3:39 PM<br>
Subject: Re: [Users] HA<br>
To: "Koen Vanoppen" <<a href="mailto:vanoppen.koen@gmail.com" target="_blank">vanoppen.koen@gmail.com</a>><br>
Cc: "ovirt-users Users" <<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>><br>
<br>
<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On 4 Apr 2014, at 15:14, Sander Grendelman wrote:<u></u><u></u></p>
</div>
<p class="MsoNormal"><br>
<br>
<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">Do you have power management configured?<u></u><u></u></p>
</div>
<p class="MsoNormal">Was the "failed" host fenced/rebooted?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Fri, Apr 4, 2014 at 2:21 PM, Koen Vanoppen <<a href="mailto:vanoppen.koen@gmail.com" target="_blank">vanoppen.koen@gmail.com</a>> wrote:<u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">So... It is possible for a fully automatic migration of the VM to another hypervisor in case Storage connection fails?<u></u><u></u></p>
</div>
<p class="MsoNormal">How can we make this happen? Because for the moment, when we tested the situation they stayed in pause state.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">(Test situation:<u></u><u></u></p>
<ul type="disc">
<li class="MsoNormal">
Unplug the 2 fibre cables from the hypervisor<u></u><u></u></li><li class="MsoNormal">
VM's go in pause state<u></u><u></u></li><li class="MsoNormal">
VM's stayed in pause state until the failure was solved<u></u><u></u></li></ul>
</div>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">as said before, it's not safe hence we (try to) not migrate them.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">They only get paused when they actually access the storage which may not be always the case. I.e. the storage connection is severed, host deemed NonOperational and VMs are getting migrated from it, then some of them will succeed if they
didn't access that "bad" storage … the paused VMs will remain (mostly, it can still happen that they appear paused migrated on other host when the disk access occurs only at the last stage of migration)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">so in other words, if you want to migrate the VMs without interruption it's not sometimes possible<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">if you are fine with the VMs restarted in short time on other host then power management/fencing will help here<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Thanks,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">michal<br>
<br>
<u></u><u></u></p>
<div>
<div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<div>
<div>
<p>)<u></u><u></u></p>
<p><u></u> <u></u></p>
</div>
<p class="MsoNormal">They only returned when we restored the fiber connection to the Hypervisor…<u></u><u></u></p>
</div>
</div>
</div>
</blockquote>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">yes, since 3.3 we have the autoresume feature<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Thanks,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">michal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><br>
<br>
<u></u><u></u></p>
<div>
<div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">Kind Regards,<br>
<br>
Koen<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><u></u> <u></u></p>
<div>
<p class="MsoNormal">2014-04-04 13:52 GMT+02:00 Koen Vanoppen <<a href="mailto:vanoppen.koen@gmail.com" target="_blank">vanoppen.koen@gmail.com</a>>:<u></u><u></u></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal">So... It is possible for a fully automatic migration of the VM to another hypervisor in case Storage connection fails?<u></u><u></u></p>
</div>
<p class="MsoNormal">How can we make this happen? Because for the moment, when we tested the situation they stayed in pause state.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">(Test situation:<u></u><u></u></p>
<ul type="disc">
<li class="MsoNormal">
Unplug the 2 fibre cables from the hypervisor<u></u><u></u></li><li class="MsoNormal">
VM's go in pause state<u></u><u></u></li><li class="MsoNormal">
VM's stayed in pause state until the failure was solved<u></u><u></u></li></ul>
<p>)<u></u><u></u></p>
<p><u></u> <u></u></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">They only returned when we restored the fiber connection to the Hypervisor...<u></u><u></u></p>
</div>
<p class="MsoNormal">Kind Regards,<br>
<br>
Koen<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><u></u> <u></u></p>
<div>
<p class="MsoNormal">2014-04-03 16:53 GMT+02:00 Koen Vanoppen <<a href="mailto:vanoppen.koen@gmail.com" target="_blank">vanoppen.koen@gmail.com</a>>:<u></u><u></u></p>
<div>
<div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<div>
<p class="MsoNormal">---------- Forwarded message ----------<br>
From: "Doron Fediuck" <<a href="mailto:dfediuck@redhat.com" target="_blank">dfediuck@redhat.com</a>><br>
Date: Apr 3, 2014 4:51 PM<br>
Subject: Re: [Users] HA<u></u><u></u></p>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">To: "Koen Vanoppen" <<a href="mailto:vanoppen.koen@gmail.com" target="_blank">vanoppen.koen@gmail.com</a>><br>
Cc: "Omer Frenkel" <<a href="mailto:ofrenkel@redhat.com" target="_blank">ofrenkel@redhat.com</a>>, <<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>>, "Federico Simoncelli" <<a href="mailto:fsimonce@redhat.com" target="_blank">fsimonce@redhat.com</a>>,
"Allon Mureinik" <<a href="mailto:amureini@redhat.com" target="_blank">amureini@redhat.com</a>><br>
<br>
<br>
<br>
----- Original Message -----<br>
> From: "Koen Vanoppen" <<a href="mailto:vanoppen.koen@gmail.com" target="_blank">vanoppen.koen@gmail.com</a>><br>
> To: "Omer Frenkel" <<a href="mailto:ofrenkel@redhat.com" target="_blank">ofrenkel@redhat.com</a>>,
<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a><br>
> Sent: Wednesday, April 2, 2014 4:17:36 PM<br>
> Subject: Re: [Users] HA<br>
><br>
> Yes, indeed. I meant not-operational. Sorry.<br>
> So, if I understand this correctly. When we ever come in a situation that we<br>
> loose both storage connections on our hypervisor, we will have to manually<br>
> restore the connections first?<br>
><br>
> And thanx for the tip for speeding up thins :-).<br>
><br>
> Kind regards,<br>
><br>
> Koen<br>
><br>
><br>
> 2014-04-02 15:14 GMT+02:00 Omer Frenkel < <a href="mailto:ofrenkel@redhat.com" target="_blank">
ofrenkel@redhat.com</a> > :<br>
><br>
><br>
><br>
><br>
><br>
> ----- Original Message -----<br>
> > From: "Koen Vanoppen" < <a href="mailto:vanoppen.koen@gmail.com" target="_blank">
vanoppen.koen@gmail.com</a> ><br>
> > To: <a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a><br>
> > Sent: Wednesday, April 2, 2014 4:07:19 PM<br>
> > Subject: [Users] HA<br>
> ><br>
> > Dear All,<br>
> ><br>
> > Due our acceptance testing, we discovered something. (Document will<br>
> > follow).<br>
> > When we disable one fiber path, no problem multipath finds it way no pings<br>
> > are lost.<br>
> > BUT when we disabled both the fiber paths (so one of the storage domain is<br>
> > gone on this host, but still available on the other host), vms go in paused<br>
> > mode... He chooses a new SPM (can we speed this up?), put's the host in<br>
> > non-responsive (can we speed this up, more important) and the VM's stay on<br>
> > Paused mode... I would expect that they would be migrated (yes, HA is<br>
><br>
> i guess you mean the host moves to not-operational (in contrast to<br>
> non-responsive)?<br>
> if so, the engine will not migrate vms that are paused to do io error,<br>
> because of data corruption risk.<br>
><br>
> to speed up you can look at the storage domain monitoring timeout:<br>
> engine-config --get StorageDomainFalureTimeoutInMinutes<br>
><br>
><br>
> > enabled) to the other host and reboot there... Any solution? We are still<br>
> > using oVirt 3.3.1 , but we are planning a upgrade to 3.4 after the easter<br>
> > holiday.<br>
> ><br>
> > Kind Regards,<br>
> ><br>
> > Koen<br>
> ><br>
<br>
Hi Koen,<br>
Resuming from paused due to io issues is supported (adding relevant folks).<br>
Regardless, if you did not define power management, you should manually approve<br>
source host was rebooted in order for migration to proceed. Otherwise we risk<br>
split-brain scenario.<br>
<br>
Doron<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div>
<p></p>
</div>
</blockquote></div>
</div></div></blockquote></div><br></div>