[Users] Is it possible to limit migration speed and number of concurrent migrations?
This is a multi-part message in MIME format. --------------080809060902070208070503 Content-Type: text/plain; charset=windows-1250; format=flowed Content-Transfer-Encoding: 8bit I want to put some of my hvs to maintenance, but that causes a migration storm, which causes an temporary unavailability of the hv and ovirt fences it, while migrations are still running. So I have to migrate one-by-one manually and then put the hv to maintenance. Is it possible to limit migration speed and number of concurrent migrations? -- Ernest Beinrohr, AXON PRO DevOps, Ing <http://www.beinrohr.sk/ing.php>, RHCE <http://www.beinrohr.sk/rhce.php>, RHCVA <http://www.beinrohr.sk/rhce.php>, LPIC <http://www.beinrohr.sk/lpic.php>, VCA <http://www.beinrohr.sk/vca.php>, +421-2--6241-0360 <callto://+421-2--6241-0360>, +421-903--482-603 <callto://+421-903--482-603> icq:28153343, skype:oernii-work <callto://oernii-work>, jabber:oernii@jabber.org ------------------------------------------------------------------------ For a successful technology, reality must take precedence over public relations, for Nature cannot be fooled. Richard Feynman --------------080809060902070208070503 Content-Type: text/html; charset=windows-1250 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=windows-1250"> </head> <body bgcolor="#FFFFFF" text="#000000"> I want to put some of my hvs to maintenance, but that causes a migration storm, which causes an temporary unavailability of the hv and ovirt fences it, while migrations are still running.<br> <br> So I have to migrate one-by-one manually and then put the hv to maintenance.<br> <br> Is it possible to limit migration speed and number of concurrent migrations?<br> <br> <div class="moz-signature">-- <br> <div id="oernii_footer" style="color: gray;"> <span style="font-family: Lucida Console, Luxi Mono, Courier, monospace; font-size: 90%;"> Ernest Beinrohr, AXON PRO<br> DevOps, <a style="text-decoration: none; color: gray;" href="http://www.beinrohr.sk/ing.php">Ing</a>, <a style="text-decoration: none; color: gray;" href="http://www.beinrohr.sk/rhce.php">RHCE</a>, <a style="text-decoration: none; color: gray;" href="http://www.beinrohr.sk/rhce.php">RHCVA</a>, <a style="text-decoration: none; color: gray;" href="http://www.beinrohr.sk/lpic.php">LPIC</a>, <a style="text-decoration: none; color: gray;" href="http://www.beinrohr.sk/vca.php">VCA</a>, <a style="text-decoration: none; color: gray;" href="callto://+421-2--6241-0360">+421-2--6241-0360</a>, <a style="text-decoration: none; color: gray;" href="callto://+421-903--482-603">+421-903--482-603</a><br> icq:28153343, <a style="text-decoration: none; color: gray;" href="callto://oernii-work">skype:oernii-work</a>, <a class="moz-txt-link-abbreviated" href="mailto:jabber:oernii@jabber.org">jabber:oernii@jabber.org</a> <br> </span> <hr style="height: 1px; width: 95%"> <span style="font-size: 70%;"> For a successful technology, reality must take precedence over public relations, for Nature cannot be fooled. Richard Feynman </span> </div> </div> <img src="http://nojsstats.appspot.com/UA-44497096-1/email.beinrohr.sk" moz-do-not-send="true" height="1" border="0" width="1"><br> </body> </html> --------------080809060902070208070503--
On Fri, Nov 29, 2013 at 11:49:05AM +0100, Ernest Beinrohr wrote:
I want to put some of my hvs to maintenance, but that causes a migration storm, which causes an temporary unavailability of the hv and ovirt fences it, while migrations are still running.
So I have to migrate one-by-one manually and then put the hv to maintenance.
Is it possible to limit migration speed and number of concurrent migrations?
You could set max_outgoing_migrations to 1 (in each /etc/vdsm/vdsm.conf), but even a single VM migrating may choke your connection (depends which wins, the CPU running qemu, or your bandwidth). Currently, your only option is to define a migration network for your cluster (say, over a different nic, or over a vlan), and use tools external to ovirt to throtle the bandwidth on it (virsh net-edit <network name> and http://libvirt.org/formatnetwork.html#elementQoS can come up handy). ovirt-3.4 should expose the ability to set QoS limits on migration networks. Dan.
On 11/29/2013 02:08 PM, Dan Kenigsberg wrote:
On Fri, Nov 29, 2013 at 11:49:05AM +0100, Ernest Beinrohr wrote:
I want to put some of my hvs to maintenance, but that causes a migration storm, which causes an temporary unavailability of the hv and ovirt fences it, while migrations are still running.
So I have to migrate one-by-one manually and then put the hv to maintenance.
Is it possible to limit migration speed and number of concurrent migrations?
You could set max_outgoing_migrations to 1 (in each /etc/vdsm/vdsm.conf), but even a single VM migrating may choke your connection (depends which wins, the CPU running qemu, or your bandwidth).
Currently, your only option is to define a migration network for your cluster (say, over a different nic, or over a vlan), and use tools external to ovirt to throtle the bandwidth on it (virsh net-edit <network name> and http://libvirt.org/formatnetwork.html#elementQoS can come up handy). ovirt-3.4 should expose the ability to set QoS limits on migration networks.
Dan. _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
I thought we can control both the number of concurrent migrations and the bandwidth per migration which defaults to 30MB/s?
On Sat, Nov 30, 2013 at 12:25:31AM +0200, Itamar Heim wrote:
On 11/29/2013 02:08 PM, Dan Kenigsberg wrote:
On Fri, Nov 29, 2013 at 11:49:05AM +0100, Ernest Beinrohr wrote:
I want to put some of my hvs to maintenance, but that causes a migration storm, which causes an temporary unavailability of the hv and ovirt fences it, while migrations are still running.
So I have to migrate one-by-one manually and then put the hv to maintenance.
Is it possible to limit migration speed and number of concurrent migrations?
You could set max_outgoing_migrations to 1 (in each /etc/vdsm/vdsm.conf), but even a single VM migrating may choke your connection (depends which wins, the CPU running qemu, or your bandwidth).
Currently, your only option is to define a migration network for your cluster (say, over a different nic, or over a vlan), and use tools external to ovirt to throtle the bandwidth on it (virsh net-edit <network name> and http://libvirt.org/formatnetwork.html#elementQoS can come up handy). ovirt-3.4 should expose the ability to set QoS limits on migration networks.
I thought we can control both the number of concurrent migrations and the bandwidth per migration which defaults to 30MB/s?
You are perfectly right: I forgot about 'migration_max_bandwidth', which vdsm sets to 32MiBps (per single migration). Sorry for misleading the list and its archives.
participants (3)
-
Dan Kenigsberg -
Ernest Beinrohr -
Itamar Heim