[Users] Choosing which network to run VM migration on ovirt 3.1
Hi, I'm running the following setup: 2 hosts, each has 2 physical NICs, the first NIC (which is bridged to ovirtmgmt) is a 100Mbps ethernet card connected to a switch (and to the internet) the 2nd NIC is a fast Infiniband card which is connected back-to-back to the other host. both links are running fine, and I managed to have the 2nd host mount the storage via the fast link. The problem is that VM migration takes place over the slow link. How do I configure the cluster so that the migration uses the fast link? I've already created a network using the web interface. the migration still uses the slow link. Thanks, Yuval
Hi Yuval i think migrate was only the RAM not die virtual hard disk. For so an scenario you need one separate Ovirt Engine (Management) one separate Storage and two Ovirt Nodes. An then you can build a HA Solution to reduce a Node failure. the single point of failure there will still give Eg. Storage, Ovirt Engine and Network. But i think you can cluster the application and storage from the nodes. Using drbd, ucarp, etc. greeting Andreas ----- Ursprüngliche Mail ----- Von: "Yuval M" <yuvalme@gmail.com> An: users@ovirt.org CC: "Limor Gavish" <lgavish@gmail.com> Gesendet: Sonntag, 6. Januar 2013 21:08:48 Betreff: [Users] Choosing which network to run VM migration on ovirt 3.1 Hi, I'm running the following setup: 2 hosts, each has 2 physical NICs, the first NIC (which is bridged to ovirtmgmt) is a 100Mbps ethernet card connected to a switch (and to the internet) the 2nd NIC is a fast Infiniband card which is connected back-to-back to the other host. both links are running fine, and I managed to have the 2nd host mount the storage via the fast link. The problem is that VM migration takes place over the slow link. How do I configure the cluster so that the migration uses the fast link? I've already created a network using the web interface. the migration still uses the slow link. Thanks, Yuval _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Andreas, I know the migration only transfers RAM from one node to the other. But this still takes over a minute at 100Mbps. My setup's purpose is research, redundancy is not the goal here. I'm running the NFS storage and the management on one of the nodes, if it's relevant. Yuval On Jan 6, 2013 11:05 PM, "Andreas Huser" <ahuser@7five-edv.de> wrote:
Hi Yuval
i think migrate was only the RAM not die virtual hard disk. For so an scenario you need one separate Ovirt Engine (Management) one separate Storage and two Ovirt Nodes. An then you can build a HA Solution to reduce a Node failure. the single point of failure there will still give Eg. Storage, Ovirt Engine and Network. But i think you can cluster the application and storage from the nodes. Using drbd, ucarp, etc.
greeting Andreas
----- Ursprüngliche Mail -----
Von: "Yuval M" <yuvalme@gmail.com> An: users@ovirt.org CC: "Limor Gavish" <lgavish@gmail.com> Gesendet: Sonntag, 6. Januar 2013 21:08:48 Betreff: [Users] Choosing which network to run VM migration on ovirt 3.1
Hi, I'm running the following setup: 2 hosts, each has 2 physical NICs, the first NIC (which is bridged to ovirtmgmt) is a 100Mbps ethernet card connected to a switch (and to the internet) the 2nd NIC is a fast Infiniband card which is connected back-to-back to the other host.
both links are running fine, and I managed to have the 2nd host mount the storage via the fast link. The problem is that VM migration takes place over the slow link.
How do I configure the cluster so that the migration uses the fast link? I've already created a network using the web interface. the migration still uses the slow link.
Thanks,
Yuval
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On Sun, Jan 06, 2013 at 10:08:48PM +0200, Yuval M wrote:
Hi, I'm running the following setup: 2 hosts, each has 2 physical NICs, the first NIC (which is bridged to ovirtmgmt) is a 100Mbps ethernet card connected to a switch (and to the internet) the 2nd NIC is a fast Infiniband card which is connected back-to-back to the other host.
both links are running fine, and I managed to have the 2nd host mount the storage via the fast link. The problem is that VM migration takes place over the slow link.
How do I configure the cluster so that the migration uses the fast link? I've already created a network using the web interface. the migration still uses the slow link.
Currently, oVirt always uses the ovirtmgmt network for migration data, even though libvirt already supports choosing a non-mananagement IP address for that. So I do not see how you could use the Infiniband card for migration without defining ovirtmgmt there, or with serious vdsm hacking. When I'm saying "serious", I mean something in the lines of (the untested!) http://gerrit.ovirt.org/10696 . To use this patch, you would first need to define a non-VM network over the Infiniband connection on both hosts, and provide them with IP address. Then, the name of this network should be passed as the value of a VM custom propery call 'mignet'. It would be great if you can try it out and debug it and/or comment on it. Dan
after a bit of playing with the system, I found a nice workaround: I added a host route on each host: # route add -host 10.100.101.101 gw 172.22.22.1 and on the other one: # route add -host 10.100.101.100 gw 172.22.22.2 where 10.100.101/24 is the slow network and 172.22.22/24 is the fast network. migration now works through the fast link, with nothing changed in ovirt's configuration. Yuval On Sun, Jan 6, 2013 at 11:49 PM, Dan Kenigsberg <danken@redhat.com> wrote:
On Sun, Jan 06, 2013 at 10:08:48PM +0200, Yuval M wrote:
Hi, I'm running the following setup: 2 hosts, each has 2 physical NICs, the first NIC (which is bridged to ovirtmgmt) is a 100Mbps ethernet card connected to a switch (and to the internet) the 2nd NIC is a fast Infiniband card which is connected back-to-back to the other host.
both links are running fine, and I managed to have the 2nd host mount the storage via the fast link. The problem is that VM migration takes place over the slow link.
How do I configure the cluster so that the migration uses the fast link? I've already created a network using the web interface. the migration still uses the slow link.
Currently, oVirt always uses the ovirtmgmt network for migration data, even though libvirt already supports choosing a non-mananagement IP address for that. So I do not see how you could use the Infiniband card for migration without defining ovirtmgmt there, or with serious vdsm hacking.
When I'm saying "serious", I mean something in the lines of (the untested!) http://gerrit.ovirt.org/10696 .
To use this patch, you would first need to define a non-VM network over the Infiniband connection on both hosts, and provide them with IP address. Then, the name of this network should be passed as the value of a VM custom propery call 'mignet'.
It would be great if you can try it out and debug it and/or comment on it.
Dan
On Mon, Jan 07, 2013 at 03:23:41PM +0200, Yuval M wrote:
after a bit of playing with the system, I found a nice workaround: I added a host route on each host:
# route add -host 10.100.101.101 gw 172.22.22.1 and on the other one: # route add -host 10.100.101.100 gw 172.22.22.2
where 10.100.101/24 is the slow network and 172.22.22/24 is the fast network. migration now works through the fast link, with nothing changed in ovirt's configuration.
Nice hack! But it means that all IP traffic between these two hosts is routed over Infiniband. That's a Good Thing in your use case, but may confuse other setups. I would like to suggest a brand new "migration network" role in http://www.ovirt.org/Features/Migration_Network to provide managenet/migration network separation.
On Tue, Jan 8, 2013 at 1:47 PM, Dan Kenigsberg > wrote:
I would like to suggest a brand new "migration network" role in http://www.ovirt.org/Features/Migration_Network to provide managenet/migration network separation. _______________________________________________
Hello, can I ask if this limitation about migration only taking place over mgmt link is present also in commercial RHEVM 3.1 or not? Any pointer in case? Thanks in advance, Gianluca
On Wed, Jan 30, 2013 at 04:29:41PM +0100, Gianluca Cecchi wrote:
On Tue, Jan 8, 2013 at 1:47 PM, Dan Kenigsberg > wrote:
I would like to suggest a brand new "migration network" role in http://www.ovirt.org/Features/Migration_Network to provide managenet/migration network separation. _______________________________________________
Hello, can I ask if this limitation about migration only taking place over mgmt link is present also in commercial RHEVM 3.1 or not? Any pointer in case? Thanks in advance, Gianluca
In the true spirit of free software, Red Hat tries very hard to make all RHEV code available in oVirt. There are very few exceptions (mostly branding or annoying backward compatibility stuff) and the Migration Network concept is not one of them. If you want a feature in RHEV, the best way is to put it in oVirt first. Dan.
Ok, I presumed that indeed. But right today one guy asked me about that feature in rhevm and I remembered this ovirt thread so I thought it could be the right place to ask for confirmation Thanks
On Wed, Jan 30, 2013 at 08:26:25PM +0100, Gianluca Cecchi wrote:
Ok, I presumed that indeed. But right today one guy asked me about that feature in rhevm and I remembered this ovirt thread so I thought it could be the right place to ask for confirmation
That's fine, I value your questions and bug report whereever they are placed.
participants (4)
-
Andreas Huser -
Dan Kenigsberg -
Gianluca Cecchi -
Yuval M