[ovirt-users] Ovirt Node NG 4.0.0 wants to bridge my infiniband link
Giorgio Biacchi
giorgio at di.unimi.it
Mon Jul 4 14:28:00 UTC 2016
Thanks,
setting the link as non VM networks let me configure the interface as needed.
Regards
On 07/04/2016 04:16 PM, Yevgeny Zaspitsky wrote:
> Infiniband should not be bridged.
> Ovirt tries to build a bridge over a NIC if the network is a VM one. Please
> verify that it isn't.
>
> On Mon, Jul 4, 2016 at 5:10 PM, Giorgio Biacchi <giorgio at di.unimi.it
> <mailto:giorgio at di.unimi.it>> wrote:
>
> As I said, Infiniband is not ethernet so it cannot be L2 bridged. This is normal
> and I understand why it can't be done. I'd like to know if there's a way to
> configure host networking for infiniband link without bridging because is not
> necessary to have a bridge there. In addition to this, 3.6 behavior was
> different. Here's all the relevant configuration files generated by 3.6 and 4.0:
>
> ------------- 3.6 ---------------
>
> [root at node3.6]# cat /etc/sysconfig/network-scripts/ifcfg-ib0
> # Generated by VDSM version 4.17.11-7.gitc0752ac.el7
> DEVICE=ib0
> HWADDR=80:00:00:48:fe:80:00:00:00:00:00:00:00:02:c9:03:00:0a:06:9f
> ONBOOT=yes
> BOOTPROTO=dhcp
> MTU=65520
> DEFROUTE=no
> NM_CONTROLLED=no
> IPV6INIT=no
>
> [root at node3.6]# cat /var/lib/vdsm/persistence/netconf/nets/ibstorage
> {
> "nic": "ib0",
> "bootproto": "dhcp",
> "blockingdhcp": true,
> "bridged": "false",
> "mtu": "65520"
> }
>
> ---------------------------------
>
> ------------- 4.0 ---------------
>
> [root at node4.0]# cat /etc/sysconfig/network-scripts/ifcfg-ib0
> # Generated by VDSM version 4.18.5.1-1.el7.centos
> DEVICE=ib0
> BRIDGE=ibstorage
> ONBOOT=yes
> MTU=65520
> NM_CONTROLLED=no
> IPV6INIT=no
>
> [root at node4.0]# cat /var/lib/vdsm/persistence/netconf/nets/ibstorage
> {
> "ipv6autoconf": false,
> "nic": "ib0",
> "mtu": 65520,
> "switch": "legacy",
> "dhcpv6": false,
> "stp": false,
> "bridged": true,
> "defaultRoute": false
> }
>
> [root at node4.0]# cat /var/lib/vdsm/persistence/netconf/nets/ib0
> {
> "ipv6autoconf": false,
> "nic": "ib0",
> "mtu": 65520,
> "switch": "legacy",
> "dhcpv6": false,
> "stp": false,
> "bridged": true,
> "defaultRoute": false
> }
>
> [root at node4.0]# cat /etc/sysconfig/network-scripts/ifcfg-ibstorage
> # Generated by VDSM version 4.18.5.1-1.el7.centos
> DEVICE=ibstorage
> TYPE=Bridge
> DELAY=0
> STP=off
> ONBOOT=yes
> DEFROUTE=no
> NM_CONTROLLED=no
> IPV6INIT=no
> MTU=65520
>
> ---------------------------------
>
> So it seems that 4.0 generates more files and wants to bridge an ethernet
> unbridgeable link. Steps to attempt to configure the connection for 4.0 was the
> same done successfully for 3.6.
>
> Thanks again
>
> On 07/04/2016 03:25 PM, Arman Khalatyan wrote:
> > As I remember the IBoIP is not fully implemented Ethernet protocol, it does not
> > support bridging.
> >
> >
> > ***********************************************************
> >
> > Dr. Arman Khalatyan eScience -SuperComputing
> > Leibniz-Institut für Astrophysik Potsdam (AIP)
> > An der Sternwarte 16, 14482 Potsdam, Germany
> >
> > ***********************************************************
> >
> > On Mon, Jul 4, 2016 at 2:58 PM, Yevgeny Zaspitsky <yzaspits at redhat.com <mailto:yzaspits at redhat.com>
> > <mailto:yzaspits at redhat.com <mailto:yzaspits at redhat.com>>> wrote:
> >
> > Hello,
> >
> > What's "couple of vdsm hooks"? Could you provide the source code of those?
> >
> > Regards,
> > Yevgeny
> >
> > On Mon, Jul 4, 2016 at 1:43 PM, Giorgio Biacchi <giorgio at di.unimi.it <mailto:giorgio at di.unimi.it>
> > <mailto:giorgio at di.unimi.it <mailto:giorgio at di.unimi.it>>> wrote:
> >
> > Hi list,
> > I'm trying a test installation of the new Ovirt Node Image and engine before
> > upgrading my 3.6 installation.
> >
> > In my current environment every hypervisor access the NFS shared data
> > domain via
> > infiniband. With a couple of vdsm hooks I was able to set the infiniband
> > link in
> > connected mode and set a MTU of 65520. In my case the infiniband link is
> > used as
> > a common NIC, I don't use RDMA, only IP over infiniband to access the
> > data domain.
> >
> > Now, when I attempt to setup host networking, the system try to bridge the
> > connection "ibstorage" (defined in networks tab) with ib0 device. But a non
> > ethernet device cannot be bridged that way and host networking setup fails.
> >
> > Any idea or suggestion? With 3.6 (node and engine) all was fine.
> >
> > Thanks
> > --
> > gb
> >
> > PGP Key: http://pgp.mit.edu/
> > Primary key fingerprint: C510 0765 943E EBED A4F2 69D3 16CC DC90 B9CB 0F34
> > _______________________________________________
> > Users mailing list
> > Users at ovirt.org <mailto:Users at ovirt.org> <mailto:Users at ovirt.org
> <mailto:Users at ovirt.org>>
> > http://lists.ovirt.org/mailman/listinfo/users
> >
> >
> >
> > _______________________________________________
> > Users mailing list
> > Users at ovirt.org <mailto:Users at ovirt.org> <mailto:Users at ovirt.org
> <mailto:Users at ovirt.org>>
> > http://lists.ovirt.org/mailman/listinfo/users
> >
> >
>
> --
> gb
>
> PGP Key: http://pgp.mit.edu/
> Primary key fingerprint: C510 0765 943E EBED A4F2 69D3 16CC DC90 B9CB 0F34
>
>
--
gb
PGP Key: http://pgp.mit.edu/
Primary key fingerprint: C510 0765 943E EBED A4F2 69D3 16CC DC90 B9CB 0F34
More information about the Users
mailing list