Dear all, Ineed your help to understand how to configure the network of a new oVirt cluster. Mynew system will have a 4.3 engine thatruns in a virtual machine, andsome Dell R7525 AMD EPYC hypervisors, eachholding two 4-port PCI network cards. These servers will have node-ovirt image again in version 4.3. As for the network, there are two HPE Aruba 2540G, non-stackable, with 24 1Gbs ports and 2 10Gbs uplinks to the star center. This is a simplified scheme: My goal is to make the most of the server's 8 ethernet interfaces to have both reliability and maximum possible throughput. This cluster will have two virtual networks, one forovirt management and one for the traffic of individual virtual machines. With that said here's what my idea is. I would like to have two links aggregated by 4Gbs, one for ovrtmgt and the other for vmnet. With the ovirt web interface I can createan active-passive "Mode 1" bond, but this won'tallow me to go beyond 1Gbs. Alternatively I could create a "Mode 4" bond 802.3ad but unfortunately the switches are not stacked and therefore not even this solution applies. This is an example with active passive configuration: Can you tell me if ovirt can generate//nested bonds? Or do you have other solutions ? Thanks a lot ! Best Regards Enrico -- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti Mail: Enrico.Becchetti<at>pg.infn.it Pagina web personale: https://www.pg.infn.it/home/enrico-becchetti/ ______________________________________________________________________
+Ales Musil <amusil@redhat.com> can you help here? Il giorno mar 9 nov 2021 alle ore 16:13 Enrico Becchetti < enrico.becchetti@pg.infn.it> ha scritto:
Dear all, I need your help to understand how to configure the network of a new oVirt cluster.
My new system will have a 4.3 engine that runs in a virtual machine, and some Dell R7525 AMD EPYC hypervisors, each holding two 4-port PCI network cards. These servers will have node-ovirt image again in version 4.3.
As for the network, there are two HPE Aruba 2540G, non-stackable, with 24 1Gbs ports and 2 10Gbs uplinks to the star center.
This is a simplified scheme:
My goal is to make the most of the server's 8 ethernet interfaces to have both reliability and maximum possible throughput.
This cluster will have two virtual networks, one for ovirt management and one for the traffic of individual virtual machines.
With that said here's what my idea is. I would like to have two links aggregated by 4Gbs, one for ovrtmgt and the other for vmnet.
With the ovirt web interface I can create an active-passive "Mode 1" bond, but this won't allow me to go beyond 1Gbs. Alternatively I could create a "Mode 4" bond 802.3ad but unfortunately the switches are not stacked and therefore not even this solution applies.
This is an example with active passive configuration:
Can you tell me if ovirt can generate nested bonds? Or do you have other solutions ?
Thanks a lot ! Best Regards Enrico
-- _______________________________________________________________________
Enrico Becchetti Servizio di Calcolo e Reti
Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti Mail: Enrico.Becchetti<at>pg.infn.it Pagina web personale: https://www.pg.infn.it/home/enrico-becchetti/ ______________________________________________________________________
-- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo@redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*
Have you thought about bonding modes 2 with option 'xmit_hash_policy=layer3+4') or 6 ? Best Regards,Strahil Nikolov On Tue, Nov 9, 2021 at 18:22, Sandro Bonazzola<sbonazzo@redhat.com> wrote: _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/4FJNUF7FXWSC62...
Hi, On Tue, Nov 9, 2021 at 4:24 PM Enrico Becchetti <enrico.becchetti@pg.infn.it> wrote:
Dear all, I need your help to understand how to configure the network of a new oVirt cluster.
My new system will have a 4.3 engine that runs in a virtual machine, and some Dell R7525 AMD EPYC hypervisors, each holding two 4-port PCI network cards. These servers will have node-ovirt image again in version 4.3.
As for the network, there are two HPE Aruba 2540G, non-stackable, with 24 1Gbs ports and 2 10Gbs uplinks to the star center.
This is a simplified scheme:
My goal is to make the most of the server's 8 ethernet interfaces to have both reliability and maximum possible throughput.
This cluster will have two virtual networks, one for ovirt management and one for the traffic of individual virtual machines.
With that said here's what my idea is. I would like to have two links aggregated by 4Gbs, one for ovrtmgt and the other for vmnet.
With the ovirt web interface I can create an active-passive "Mode 1" bond, but this won't allow me to go beyond 1Gbs. Alternatively I could create a "Mode 4" bond 802.3ad but unfortunately the switches are not stacked and therefore not even this solution applies.
This is an example with active passive configuration:
Can you tell me if ovirt can generate nested bonds? Or do you have other solutions ?
No oVirt can't create nested bonds. This might be possible if created manually and then the network is assigned on top of that. However note that this was never tested and might not work at all. My guess would be that the oVirt UI would not be able to display it. As it was suggested by Strahil Nikolov, bond mode 2 might be the way to go. Best regards, Ales
Thanks a lot ! Best Regards Enrico
-- _______________________________________________________________________
Enrico Becchetti Servizio di Calcolo e Reti
Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti Mail: Enrico.Becchetti<at>pg.infn.it Pagina web personale: https://www.pg.infn.it/home/enrico-becchetti/ ______________________________________________________________________
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/YZUTTTLTKRIYBL...
-- Ales Musil Software Engineer - RHV Network Red Hat EMEA <https://www.redhat.com> amusil@redhat.com IM: amusil <https://red.ht/sig>
Dear all, I've made this settings: after that reading /var/log/messages I've seen this: /Nov 10 08:01:06 infn-vm09 kernel: ovirtmgmt: received packet on bond0 with own address as source address (addr:68:05:ca:b9:72:2e, vlan:0)/ and when I run a virtual machine I've notice that ssh from my desktop is extremely slow and in some cases the ssh session is terminated, for example from my desktop: $ ssh -l enrico 1.1.1.1 X11 forwarding request failed on channel 0 Last login: Tue Nov 9 14:34:58 2021 from becchetti-pc [enrico@centos-7 ~]$ Connection reset by 1.1.1.1 port 22 likely that this bond has features that are not compatible with my network. Thanks again. Best regards Enrico Il 10/11/2021 07:42, Ales Musil ha scritto:
Hi,
On Tue, Nov 9, 2021 at 4:24 PM Enrico Becchetti <enrico.becchetti@pg.infn.it> wrote:
Dear all, Ineed your help to understand how to configure the network of a new oVirt cluster.
Mynew system will have a 4.3 engine thatruns in a virtual machine, andsome Dell R7525 AMD EPYC hypervisors, eachholding two 4-port PCI network cards. These servers will have node-ovirt image again in version 4.3.
As for the network, there are two HPE Aruba 2540G, non-stackable, with 24 1Gbs ports and 2 10Gbs uplinks to the star center.
This is a simplified scheme:
My goal is to make the most of the server's 8 ethernet interfaces to have both reliability and maximum possible throughput.
This cluster will have two virtual networks, one forovirt management and one for the traffic of individual virtual machines.
With that said here's what my idea is. I would like to have two links aggregated by 4Gbs, one for ovrtmgt and the other for vmnet.
With the ovirt web interface I can createan active-passive "Mode 1" bond, but this won'tallow me to go beyond 1Gbs. Alternatively I could create a "Mode 4" bond 802.3ad but unfortunately the switches are not stacked and therefore not even this solution applies.
This is an example with active passive configuration:
Can you tell me if ovirt can generate//nested bonds? Or do you have other solutions ?
No oVirt can't create nested bonds. This might be possible if created manually and then the network is assigned on top of that. However note that this was never tested and might not work at all. My guess would be that the oVirt UI would not be able to display it.
As it was suggested by Strahil Nikolov, bond mode 2 might be the way to go.
Best regards, Ales
Thanks a lot ! Best Regards Enrico
-- _______________________________________________________________________
Enrico Becchetti Servizio di Calcolo e Reti
Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti Mail: Enrico.Becchetti<at>pg.infn.it <http://pg.infn.it> Pagina web personale:https://www.pg.infn.it/home/enrico-becchetti/ ______________________________________________________________________
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/YZUTTTLTKRIYBL...
--
Ales Musil
Software Engineer - RHV Network
Red Hat EMEA <https://www.redhat.com>
amusil@redhat.com IM: amusil
-- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti Mail: Enrico.Becchetti<at>pg.infn.it Pagina web personale:https://www.pg.infn.it/home/enrico-becchetti/ ______________________________________________________________________
This is outside of the ovirt scope, but... Mode 2 still requires switch support for static aggregation. This is not very common these days as LACP has long won this battle, so no idea if your switches support it. But it would be akin to creating a channel group but not enabling lacp. Static bonding has some weird side effects that may break your goals, namely a single link failure in a static channel group can still lose traffic in some scenarios. Personally i would just run a single switch, and get something that either does stacking or MC-LAG later down the road. The only other option is balance-rr which has it's own set of problems, like single links to each switch and needing to be completely layer 2 isolated from each other. On 2021-11-10 03:20, Enrico Becchetti wrote:
Dear all, I've made this settings:
after that reading /var/log/messages I've seen this:
_Nov 10 08:01:06 infn-vm09 kernel: ovirtmgmt: received packet on bond0 with own address as source address (addr:68:05:ca:b9:72:2e, vlan:0)_
and when I run a virtual machine I've notice that ssh from my desktop is extremely slow and in some cases the ssh session is terminated, for example from my desktop:
$ ssh -l enrico 1.1.1.1 X11 forwarding request failed on channel 0 Last login: Tue Nov 9 14:34:58 2021 from becchetti-pc
[enrico@centos-7 ~]$ Connection reset by 1.1.1.1 port 22
likely that this bond has features that are not compatible with my network. Thanks again. Best regards Enrico
Il 10/11/2021 07:42, Ales Musil ha scritto:
Hi,
On Tue, Nov 9, 2021 at 4:24 PM Enrico Becchetti <enrico.becchetti@pg.infn.it> wrote: Dear all, I need your help to understand how to configure the network of a new oVirt cluster.
My new system will have a 4.3 engine that runs in a virtual machine, and some Dell R7525 AMD EPYC hypervisors, each holding two 4-port PCI network cards. These servers will have node-ovirt image again in version 4.3.
As for the network, there are two HPE Aruba 2540G, non-stackable, with 24 1Gbs ports and 2 10Gbs uplinks to the star center.
This is a simplified scheme:
My goal is to make the most of the server's 8 ethernet interfaces to have both reliability and maximum possible throughput.
This cluster will have two virtual networks, one for ovirt management and one for the traffic of individual virtual machines.
With that said here's what my idea is. I would like to have two links aggregated by 4Gbs, one for ovrtmgt and the other for vmnet.
With the ovirt web interface I can create an active-passive "Mode 1" bond, but this won't allow me to go beyond 1Gbs. Alternatively I could create a "Mode 4" bond 802.3ad but unfortunately the switches are not stacked and therefore not even this solution applies.
This is an example with active passive configuration:
Can you tell me if ovirt can generate nested bonds? Or do you have other solutions ?
No oVirt can't create nested bonds. This might be possible if created manually and then the network is assigned on top of that. However note that this was never tested and might not work at all. My guess would be that the oVirt UI would not be able to display it.
As it was suggested by Strahil Nikolov, bond mode 2 might be the way to go.
Best regards, Ales
Thanks a lot ! Best Regards Enrico
-- _______________________________________________________________________
Enrico Becchetti Servizio di Calcolo e Reti
Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti [1] Mail: Enrico.Becchetti<at>pg.infn.it [2] Pagina web personale: https://www.pg.infn.it/home/enrico-becchetti/ ______________________________________________________________________ _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/YZUTTTLTKRIYBL...
--
Ales Musil
Software Engineer - RHV Network
Red Hat EMEA [3]
amusil@redhat.com IM: amusil
[4]
-- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti Mail: Enrico.Becchetti<at>pg.infn.it Pagina web personale: https://www.pg.infn.it/home/enrico-becchetti/ ______________________________________________________________________ _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JX5UXR6SQFNV2W... Links: ------ [1] http://mail.triadic.us/./#NOP [2] http://pg.infn.it [3] https://www.redhat.com [4] https://red.ht/sig
Dear all, I'm reviving this old thread because I have two new Aruba switches, they are stackable and therefore are seen by the HPE Proliant server as a single device. I put one of the servers in maintenance and I did a round robin configuration but I had some errors and I went back. Now I wanted to ask you if I insert 10Gbs interfaces in oVirt servers, how can I configure them ? Can these operations be done with the oVirt virtual machines running or not ? Can I put one node in maintenance at a time or does the server have to be removed from the cluster ? Thank you. Best Regards Enrico Il 10/11/21 10:16, Alex McWhirter ha scritto:
This is outside of the ovirt scope, but...
Mode 2 still requires switch support for static aggregation. This is not very common these days as LACP has long won this battle, so no idea if your switches support it. But it would be akin to creating a channel group but not enabling lacp. Static bonding has some weird side effects that may break your goals, namely a single link failure in a static channel group can still lose traffic in some scenarios.
Personally i would just run a single switch, and get something that either does stacking or MC-LAG later down the road.
The only other option is balance-rr which has it's own set of problems, like single links to each switch and needing to be completely layer 2 isolated from each other.
On 2021-11-10 03:20, Enrico Becchetti wrote:
Dear all, I've made this settings:
after that reading /var/log/messages I've seen this:
/Nov 10 08:01:06 infn-vm09 kernel: ovirtmgmt: received packet on bond0 with own address as source address (addr:68:05:ca:b9:72:2e, vlan:0)/
and when I run a virtual machine I've notice that ssh from my desktop is extremely slow and in some cases the ssh session is terminated, for example from my desktop:
$ ssh -l enrico 1.1.1.1 X11 forwarding request failed on channel 0 Last login: Tue Nov 9 14:34:58 2021 from becchetti-pc
[enrico@centos-7 ~]$ Connection reset by 1.1.1.1 port 22
likely that this bond has features that are not compatible with my network. Thanks again. Best regards Enrico
Il 10/11/2021 07:42, Ales Musil ha scritto:
Hi,
On Tue, Nov 9, 2021 at 4:24 PM Enrico Becchetti <enrico.becchetti@pg.infn.it <mailto:enrico.becchetti@pg.infn.it>> wrote:
Dear all, Ineed your help to understand how to configure the network of a new oVirt cluster.
Mynew system will have a 4.3 engine thatruns in a virtual machine, andsome Dell R7525 AMD EPYC hypervisors, eachholding two 4-port PCI network cards. These servers will have node-ovirt image again in version 4.3.
As for the network, there are two HPE Aruba 2540G, non-stackable, with 24 1Gbs ports and 2 10Gbs uplinks to the star center.
This is a simplified scheme:
My goal is to make the most of the server's 8 ethernet interfaces to have both reliability and maximum possible throughput.
This cluster will have two virtual networks, one forovirt management and one for the traffic of individual virtual machines.
With that said here's what my idea is. I would like to have two links aggregated by 4Gbs, one for ovrtmgt and the other for vmnet.
With the ovirt web interface I can createan active-passive "Mode 1" bond, but this won'tallow me to go beyond 1Gbs. Alternatively I could create a "Mode 4" bond 802.3ad but unfortunately the switches are not stacked and therefore not even this solution applies.
This is an example with active passive configuration:
Can you tell me if ovirt can generatenested bonds? Or do you have other solutions ?
No oVirt can't create nested bonds. This might be possible if created manually and then the network is assigned on top of that. However note that this was never tested and might not work at all. My guess would be that the oVirt UI would not be able to display it.
As it was suggested by Strahil Nikolov, bond mode 2 might be the way to go.
Best regards, Ales
Thanks a lot ! Best Regards Enrico
-- _______________________________________________________________________
Enrico Becchetti Servizio di Calcolo e Reti
Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti <./#NOP> Mail: Enrico.Becchetti<at>pg.infn.it <http://pg.infn.it> Pagina web personale:https://www.pg.infn.it/home/enrico-becchetti/ <https://www.pg.infn.it/home/enrico-becchetti/> ______________________________________________________________________
_______________________________________________ Users mailing list -- users@ovirt.org <mailto:users@ovirt.org> To unsubscribe send an email to users-leave@ovirt.org <mailto:users-leave@ovirt.org> Privacy Statement: https://www.ovirt.org/privacy-policy.html <https://www.ovirt.org/privacy-policy.html> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ <https://www.ovirt.org/community/about/community-guidelines/> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/YZUTTTLTKRIYBL... <https://lists.ovirt.org/archives/list/users@ovirt.org/message/YZUTTTLTKRIYBLJ3O5Z2D2K7MT44HUIP/>
--
Ales Musil
Software Engineer - RHV Network
Red Hat EMEA <https://www.redhat.com>
amusil@redhat.com <mailto:amusil@redhat.com> IM: amusil
-- _______________________________________________________________________
Enrico Becchetti Servizio di Calcolo e Reti
Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti <Skype:enrico_becchetti> Mail: Enrico.Becchetti<at>pg.infn.it Pagina web personale:https://www.pg.infn.it/home/enrico-becchetti/ <https://www.pg.infn.it/home/enrico-becchetti/> ______________________________________________________________________
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JX5UXR6SQFNV2W...
-- __________________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Mobile: +39 075 9696225 FAX: +39 075 5847296 Microsoft Teams:becchett@infn.it Mail: Enrico.Becchetti<at>pg.infn.it Skype:enrico_becchetti Pagina web personale:https://www.pg.infn.it/home/enrico-becchetti _________________________________________________________________________
participants (5)
-
Ales Musil -
Alex McWhirter -
Enrico Becchetti -
Sandro Bonazzola -
Strahil Nikolov