<div dir="ltr"><div>Infiniband should not be bridged.<br></div>Ovirt tries to build a bridge over a NIC if the network is a VM one. Please verify that it isn't.<div class=""><div id=":1s0" class="" tabindex="0"><img class="" src="https://ssl.gstatic.com/ui/v1/icons/mail/images/cleardot.gif"></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Jul 4, 2016 at 5:10 PM, Giorgio Biacchi <span dir="ltr"><<a href="mailto:giorgio@di.unimi.it" target="_blank">giorgio@di.unimi.it</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">As I said, Infiniband is not ethernet so it cannot be L2 bridged. This is normal<br>
and I understand why it can't be done. I'd like to know if there's a way to<br>
configure host networking for infiniband link without bridging because is not<br>
necessary to have a bridge there. In addition to this, 3.6 behavior was<br>
different. Here's all the relevant configuration files generated by 3.6 and 4.0:<br>
<br>
------------- 3.6 ---------------<br>
<br>
[root@node3.6]# cat /etc/sysconfig/network-scripts/ifcfg-ib0<br>
# Generated by VDSM version 4.17.11-7.gitc0752ac.el7<br>
DEVICE=ib0<br>
HWADDR=80:00:00:48:fe:80:00:00:00:00:00:00:00:02:c9:03:00:0a:06:9f<br>
ONBOOT=yes<br>
BOOTPROTO=dhcp<br>
MTU=65520<br>
DEFROUTE=no<br>
NM_CONTROLLED=no<br>
IPV6INIT=no<br>
<br>
[root@node3.6]# cat /var/lib/vdsm/persistence/netconf/nets/ibstorage<br>
{<br>
"nic": "ib0",<br>
"bootproto": "dhcp",<br>
"blockingdhcp": true,<br>
"bridged": "false",<br>
"mtu": "65520"<br>
}<br>
<br>
---------------------------------<br>
<br>
------------- 4.0 ---------------<br>
<br>
[root@node4.0]# cat /etc/sysconfig/network-scripts/ifcfg-ib0<br>
# Generated by VDSM version 4.18.5.1-1.el7.centos<br>
DEVICE=ib0<br>
BRIDGE=ibstorage<br>
ONBOOT=yes<br>
MTU=65520<br>
NM_CONTROLLED=no<br>
IPV6INIT=no<br>
<br>
[root@node4.0]# cat /var/lib/vdsm/persistence/netconf/nets/ibstorage<br>
{<br>
"ipv6autoconf": false,<br>
"nic": "ib0",<br>
"mtu": 65520,<br>
"switch": "legacy",<br>
"dhcpv6": false,<br>
"stp": false,<br>
"bridged": true,<br>
"defaultRoute": false<br>
}<br>
<br>
[root@node4.0]# cat /var/lib/vdsm/persistence/netconf/nets/ib0<br>
{<br>
"ipv6autoconf": false,<br>
"nic": "ib0",<br>
"mtu": 65520,<br>
"switch": "legacy",<br>
"dhcpv6": false,<br>
"stp": false,<br>
"bridged": true,<br>
"defaultRoute": false<br>
}<br>
<br>
[root@node4.0]# cat /etc/sysconfig/network-scripts/ifcfg-ibstorage<br>
# Generated by VDSM version 4.18.5.1-1.el7.centos<br>
DEVICE=ibstorage<br>
TYPE=Bridge<br>
DELAY=0<br>
STP=off<br>
ONBOOT=yes<br>
DEFROUTE=no<br>
NM_CONTROLLED=no<br>
IPV6INIT=no<br>
MTU=65520<br>
<br>
---------------------------------<br>
<br>
So it seems that 4.0 generates more files and wants to bridge an ethernet<br>
unbridgeable link. Steps to attempt to configure the connection for 4.0 was the<br>
same done successfully for 3.6.<br>
<br>
Thanks again<br>
<span class=""><br>
On 07/04/2016 03:25 PM, Arman Khalatyan wrote:<br>
> As I remember the IBoIP is not fully implemented Ethernet protocol, it does not<br>
> support bridging.<br>
><br>
><br>
> ***********************************************************<br>
><br>
> Dr. Arman Khalatyan eScience -SuperComputing<br>
> Leibniz-Institut für Astrophysik Potsdam (AIP)<br>
> An der Sternwarte 16, 14482 Potsdam, Germany<br>
><br>
> ***********************************************************<br>
><br>
> On Mon, Jul 4, 2016 at 2:58 PM, Yevgeny Zaspitsky <<a href="mailto:yzaspits@redhat.com">yzaspits@redhat.com</a><br>
</span><span class="">> <mailto:<a href="mailto:yzaspits@redhat.com">yzaspits@redhat.com</a>>> wrote:<br>
><br>
> Hello,<br>
><br>
> What's "couple of vdsm hooks"? Could you provide the source code of those?<br>
><br>
> Regards,<br>
> Yevgeny<br>
><br>
> On Mon, Jul 4, 2016 at 1:43 PM, Giorgio Biacchi <<a href="mailto:giorgio@di.unimi.it">giorgio@di.unimi.it</a><br>
</span><span class="">> <mailto:<a href="mailto:giorgio@di.unimi.it">giorgio@di.unimi.it</a>>> wrote:<br>
><br>
> Hi list,<br>
> I'm trying a test installation of the new Ovirt Node Image and engine before<br>
> upgrading my 3.6 installation.<br>
><br>
> In my current environment every hypervisor access the NFS shared data<br>
> domain via<br>
> infiniband. With a couple of vdsm hooks I was able to set the infiniband<br>
> link in<br>
> connected mode and set a MTU of 65520. In my case the infiniband link is<br>
> used as<br>
> a common NIC, I don't use RDMA, only IP over infiniband to access the<br>
> data domain.<br>
><br>
> Now, when I attempt to setup host networking, the system try to bridge the<br>
> connection "ibstorage" (defined in networks tab) with ib0 device. But a non<br>
> ethernet device cannot be bridged that way and host networking setup fails.<br>
><br>
> Any idea or suggestion? With 3.6 (node and engine) all was fine.<br>
><br>
> Thanks<br>
> --<br>
> gb<br>
><br>
> PGP Key: <a href="http://pgp.mit.edu/" rel="noreferrer" target="_blank">http://pgp.mit.edu/</a><br>
> Primary key fingerprint: C510 0765 943E EBED A4F2 69D3 16CC DC90 B9CB 0F34<br>
> _______________________________________________<br>
> Users mailing list<br>
</span>> <a href="mailto:Users@ovirt.org">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a>><br>
<span class="">> <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
><br>
><br>
><br>
> _______________________________________________<br>
> Users mailing list<br>
</span>> <a href="mailto:Users@ovirt.org">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a>><br>
> <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
<div class="HOEnZb"><div class="h5">><br>
><br>
<br>
--<br>
gb<br>
<br>
PGP Key: <a href="http://pgp.mit.edu/" rel="noreferrer" target="_blank">http://pgp.mit.edu/</a><br>
Primary key fingerprint: C510 0765 943E EBED A4F2 69D3 16CC DC90 B9CB 0F34<br>
</div></div></blockquote></div><br></div>