[Users] ovirt 3.3 vnic profile with bonding & vlans problem
Hi, I am attempting a little test with vnic profiles. I got a profile named "100mbit" with average: 100 peak: 100 burst: 0 (ovirt warns you can't set peak below average which is not true from libvirt perspective, it is an optional field) I attached this profile to a logical network with a vlan id, which is connected to one vm. when I start the vm, I see the correct information in the libvirtxml: <interface type='bridge'> <mac address='MY_MAC'/> <source bridge='MY_BRIDGE'/> <target dev='vnet0'/> <model type='virtio'/> <filterref filter='vdsm-no-mac-spoofing'/> <link state='up'/> <bandwidth> <inbound average='12800' peak='12800'/> <outbound average='12800' peak='12800'/> </bandwidth> However when I test the download and upload speed inside this vm, just the download (inbound) gets limited correctly, here is a sample test: Upload (too fast for 100mbit): root@qostest:~# tnftp -u ftp://ftphost.example.com/test/ install-amd64-minimal-20140220.iso Connected to ftphost.example.com. 220 (vsFTPd 2.2.2) 331 Please specify the password. 230 Login successful. Remote system type is UNIX. Using binary mode to transfer files. 200 Switching to Binary mode. 250 Directory successfully changed. local: install-amd64-minimal-20140220.iso remote: install-amd64-minimal-20140220.iso 229 Entering Extended Passive Mode (|||13353|) 150 Ok to send data. 100% |******************************************************************************************************************************************************************************************************************| 64979 KiB 40.77 MiB/s 00:00 ETA226 Transfer complete. 66539088 bytes sent in 00:01 (40.43 MiB/s) Download (works): root@qostest:~# tnftp ftp://myuser:mypassword@ftphost.example.com /test//install-amd64-minimal-20140220.iso Connected to ftphost.example.com. 220 (vsFTPd 2.2.2) 331 Please specify the password. 230 Login successful. Remote system type is UNIX. Using binary mode to transfer files. 200 Switching to Binary mode. 250 Directory successfully changed. local: install-amd64-minimal-20140220.iso remote: install-amd64-minimal-20140220.iso 229 Entering Extended Passive Mode (|||46847|) 150 Opening BINARY mode data connection for install-amd64-minimal-20140220.iso (266338304 bytes). 100% |******************************************************************************************************************************************************************************************************************| 254 MiB 11.94 MiB/s 00:00 ETA226 Transfer complete. 266338304 bytes received in 00:21 (11.94 MiB/s) 221 Goodbye. This is a CentOS based VM-Host with the following versions: rpm -qa | grep vdsm vdsm-4.13.3-3.el6.x86_64 vdsm-python-4.13.3-3.el6.x86_64 vdsm-xmlrpc-4.13.3-3.el6.noarch vdsm-cli-4.13.3-3.el6.noarch rpm -qa | grep libvirt libvirt-client-0.10.2-29.el6_5.3.x86_64 libvirt-lock-sanlock-0.10.2-29.el6_5.3.x86_64 libvirt-python-0.10.2-29.el6_5.3.x86_64 libvirt-0.10.2-29.el6_5.3.x86_64 ovirt engine 3.3.3-2.el6 I triple checked the libvirt xml, it looks correct. it also works for downloads, but not for uploads. The network setup is as following: eth0 and eth1 -> bond0 -> bond0.X (vlan) -> vm_net According to http://www.ovirt.org/Features/Network_QoS#VDSM libvirt version 1.0.1 or higher is needed, but this can't be true because of 2 things: 1. it works for downloads 2. http://libvirt.org/formatnetwork.html#elementQoS states: "The <bandwidth> element allows setting quality of service for a particular network (since 0.9.4)" Any help would be greatly appreciated. Could this be related to bonding? I'm pretty sure this worked before I bonded eth0 and eth1. -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
Hi Sven, disclaimer, not familiar with this feature that much (although I should), looks like the problem is in libvirt (according to your story). googling 'outbound libvirt not working' shows that you're not the only one :) http://www.redhat.com/archives/libvir-list/2011-August/msg00341.html http://www.redhat.com/archives/libvir-list/2012-June/msg01306.html Thanks, Gilad. ----- Original Message -----
From: "Sven Kieske" <S.Kieske@mittwald.de> To: "Users@ovirt.org List" <Users@ovirt.org> Sent: Thursday, April 3, 2014 6:21:00 PM Subject: [Users] ovirt 3.3 vnic profile with bonding & vlans problem
Hi,
I am attempting a little test with vnic profiles.
I got a profile named "100mbit" with average: 100 peak: 100 burst: 0
(ovirt warns you can't set peak below average which is not true from libvirt perspective, it is an optional field) I attached this profile to a logical network with a vlan id, which is connected to one vm.
when I start the vm, I see the correct information in the libvirtxml:
<interface type='bridge'> <mac address='MY_MAC'/> <source bridge='MY_BRIDGE'/> <target dev='vnet0'/> <model type='virtio'/> <filterref filter='vdsm-no-mac-spoofing'/> <link state='up'/> <bandwidth> <inbound average='12800' peak='12800'/> <outbound average='12800' peak='12800'/> </bandwidth>
However when I test the download and upload speed inside this vm, just the download (inbound) gets limited correctly, here is a sample test:
Upload (too fast for 100mbit):
root@qostest:~# tnftp -u ftp://ftphost.example.com/test/ install-amd64-minimal-20140220.iso Connected to ftphost.example.com. 220 (vsFTPd 2.2.2) 331 Please specify the password. 230 Login successful. Remote system type is UNIX. Using binary mode to transfer files. 200 Switching to Binary mode. 250 Directory successfully changed. local: install-amd64-minimal-20140220.iso remote: install-amd64-minimal-20140220.iso 229 Entering Extended Passive Mode (|||13353|) 150 Ok to send data. 100% |******************************************************************************************************************************************************************************************************************| 64979 KiB 40.77 MiB/s 00:00 ETA226 Transfer complete. 66539088 bytes sent in 00:01 (40.43 MiB/s)
Download (works):
root@qostest:~# tnftp ftp://myuser:mypassword@ftphost.example.com /test//install-amd64-minimal-20140220.iso Connected to ftphost.example.com. 220 (vsFTPd 2.2.2) 331 Please specify the password. 230 Login successful. Remote system type is UNIX. Using binary mode to transfer files. 200 Switching to Binary mode. 250 Directory successfully changed. local: install-amd64-minimal-20140220.iso remote: install-amd64-minimal-20140220.iso 229 Entering Extended Passive Mode (|||46847|) 150 Opening BINARY mode data connection for install-amd64-minimal-20140220.iso (266338304 bytes). 100% |******************************************************************************************************************************************************************************************************************| 254 MiB 11.94 MiB/s 00:00 ETA226 Transfer complete. 266338304 bytes received in 00:21 (11.94 MiB/s) 221 Goodbye.
This is a CentOS based VM-Host with the following versions:
rpm -qa | grep vdsm vdsm-4.13.3-3.el6.x86_64 vdsm-python-4.13.3-3.el6.x86_64 vdsm-xmlrpc-4.13.3-3.el6.noarch vdsm-cli-4.13.3-3.el6.noarch
rpm -qa | grep libvirt libvirt-client-0.10.2-29.el6_5.3.x86_64 libvirt-lock-sanlock-0.10.2-29.el6_5.3.x86_64 libvirt-python-0.10.2-29.el6_5.3.x86_64 libvirt-0.10.2-29.el6_5.3.x86_64
ovirt engine 3.3.3-2.el6
I triple checked the libvirt xml, it looks correct. it also works for downloads, but not for uploads.
The network setup is as following:
eth0 and eth1 -> bond0 -> bond0.X (vlan) -> vm_net
According to http://www.ovirt.org/Features/Network_QoS#VDSM
libvirt version 1.0.1 or higher is needed, but this can't be true because of 2 things:
1. it works for downloads 2. http://libvirt.org/formatnetwork.html#elementQoS states: "The <bandwidth> element allows setting quality of service for a particular network (since 0.9.4)"
Any help would be greatly appreciated.
Could this be related to bonding? I'm pretty sure this worked before I bonded eth0 and eth1.
-- Mit freundlichen Grüßen / Regards
Sven Kieske
Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi, and thanks for your effort. The root cause for this was found with help via IRC from apuimedo (Thanks again!) ovirt utilizes libvirt for the network qos, which just sets it for "protocol ip" and not for the whole device. This leads to unrestricted IPv6 traffic outbound. I'm currently trying to write a hook to alter the tc filters for the vms, so they get per device restricted rather than per protocol (which makes no sense at all TBH). When I got the time I'll file a BZ too. Thank you very, very much again, apuimedo for pushing me in the right direction and even proposing a solution! Am 03.04.2014 19:50, schrieb Gilad Chaplik:
Hi Sven,
disclaimer, not familiar with this feature that much (although I should), looks like the problem is in libvirt (according to your story). googling 'outbound libvirt not working' shows that you're not the only one :)
http://www.redhat.com/archives/libvir-list/2011-August/msg00341.html http://www.redhat.com/archives/libvir-list/2012-June/msg01306.html
Thanks, Gilad.
-- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
Well I created BZs for ovirt and libvirt for this apparently almost completely broken feature: libvirt: https://bugzilla.redhat.com/show_bug.cgi?id=1084444 ovirt: https://bugzilla.redhat.com/show_bug.cgi?id=1084448 -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
On Fri, Apr 04, 2014 at 11:25:15AM +0000, Sven Kieske wrote:
Well I created BZs for ovirt and libvirt for this apparently almost completely broken feature:
libvirt: https://bugzilla.redhat.com/show_bug.cgi?id=1084444 ovirt: https://bugzilla.redhat.com/show_bug.cgi?id=1084448 -- Mit freundlichen Grüßen / Regards
Sven Kieske
Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6
Nice to meet someone who works on my street (almost) ;-) Thanks for reporting these bugs !
32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
participants (3)
-
Dan Kenigsberg -
Gilad Chaplik -
Sven Kieske