<div dir="ltr">Marcin,<div><br></div><div>Also I noticed in your original post it mentions:</div><div><br></div><div><code style="box-sizing:border-box;font-family:menlo,monaco,consolas,"courier new",monospace;font-size:14.4px;padding:2px 4px;color:rgb(199,37,78);background-color:rgb(249,242,244);border-radius:4px">ip link</code><span style="color:rgb(51,51,51);font-family:"source sans pro","open sans","helvetica neue",helvetica,arial,sans-serif;font-size:16px"> - the result should include a link called </span><code style="box-sizing:border-box;font-family:menlo,monaco,consolas,"courier new",monospace;font-size:14.4px;padding:2px 4px;color:rgb(199,37,78);background-color:rgb(249,242,244);border-radius:4px">genev_sys_ ...</code><br></div><div><br></div><div>I noticed that on my hosts I don't see any links with name: genev_sys_ ?? Could this be a problem?</div><div><br></div><div><div>lo:</div><div>enp4s0f0:<br></div><div>enp4s0f1:<br></div><div>enp7s0f0:<br></div><div>enp7s0f1:<br></div><div>bond0:<br></div><div>DEV-NOC:<br></div><div>ovirtmgmt:<br></div><div>bond0.700@bond0:<br></div><div>DEV-VM-NET:<br></div><div>bond0.705@bond0:<br></div><div>;vdsmdummy;:<br></div><div>vnet0:<br></div><div>vnet1:<br></div><div>vnet2:<br></div><div>vnet3:<br></div><div>vnet4:<br></div><div>ovs-system:<br></div><div>br-int:<br></div><div>vnet5:<br></div><div>vnet6:<br></div></div><div class="gmail_extra"><br></div><div class="gmail_extra"><br></div><div class="gmail_extra">However, the br-int appears to have been configured:</div><div class="gmail_extra"><br></div><div class="gmail_extra"><div class="gmail_extra">[root@las01-902-001 ~]# ovs-vsctl show</div><div class="gmail_extra">4c817c66-9842-471d-b53a-963e27e3364f</div><div class="gmail_extra"> Bridge br-int</div><div class="gmail_extra"> fail_mode: secure</div><div class="gmail_extra"> Port "vnet6"</div><div class="gmail_extra"> Interface "vnet6"</div><div class="gmail_extra"> Port "vnet5"</div><div class="gmail_extra"> Interface "vnet5"</div><div class="gmail_extra"> Port "ovn-456949-0"</div><div class="gmail_extra"> Interface "ovn-456949-0"</div><div class="gmail_extra"> type: geneve</div><div class="gmail_extra"> options: {csum="true", key=flow, remote_ip="172.10.10.74"}</div><div class="gmail_extra"> Port "ovn-252778-0"</div><div class="gmail_extra"> Interface "ovn-252778-0"</div><div class="gmail_extra"> type: geneve</div><div class="gmail_extra"> options: {csum="true", key=flow, remote_ip="172.10.10.75"}</div><div class="gmail_extra"> Port br-int</div><div class="gmail_extra"> Interface br-int</div><div class="gmail_extra"> type: internal</div><div class="gmail_extra"> ovs_version: "2.6.90"</div><div class="gmail_extra"><br></div><div class="gmail_extra">However there is no traffic showing:</div><div class="gmail_extra"><br></div><div class="gmail_extra"><div class="gmail_extra">[root@las01-902-001 ~]# ifconfig br-int</div><div class="gmail_extra">br-int: flags=4098<BROADCAST,MULTICAST> mtu 1500</div><div class="gmail_extra"> ether 2e:c4:a6:fa:0c:40 txqueuelen 0 (Ethernet)</div><div class="gmail_extra"> RX packets 0 bytes 0 (0.0 B)</div><div class="gmail_extra"> RX errors 0 dropped 0 overruns 0 frame 0</div><div class="gmail_extra"> TX packets 0 bytes 0 (0.0 B)</div><div class="gmail_extra"> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0</div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Dec 5, 2016 at 8:05 AM, Devin Acosta <span dir="ltr"><<a href="mailto:devin@pabstatencio.com" target="_blank">devin@pabstatencio.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div>Marcin,</div><div><br></div><div>For OVN to work properly does the port that the traffic flows over need to be a bridge, or OVS port? Right now it's just going over the ovirtmgmt network which is just a standard port. I know like in Neutron you have to configure (br-ex) and then it would need to be using the OVS protocol, and then all the nodes would need to be an OVS port. I presume OVN tries to simplify this setup?</div><div>I also seen that there is (openvswitch-ovn-vtep), would this need to be configured in any way? </div><div><br></div></div><div class="gmail-HOEnZb"><div class="gmail-h5"><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Dec 5, 2016 at 1:43 AM, Marcin Mirecki <span dir="ltr"><<a href="mailto:mmirecki@redhat.com" target="_blank">mmirecki@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Devin,<br>
<br>
Please not the OVN-controller is not the central part where OVN northd is running.<br>
OVN-controllers are the OVN processes deployed on the hosts.<br>
The correct usage of the 'vdsm-tool ovn-config'.<br>
- the IP of the OVN-central (not to be confused with OVN-controllers, which is the part of OVN running on the hosts)<br>
- the local host IP to be used for tunneling to other OVN hosts<br>
for example, if the OVN-central IP should be 10.10.10.1, and the IP of the local host used for tunneling: <a href="http://10.10.10.101" rel="noreferrer" target="_blank">10.10.10.101</a>:<br>
vdsm-tool ovn-config 10.10.10.1 10.10.10.101<br>
<br>
Looking at the output of 'ovs-vsctl' the tunnels have been created.<br>
<br>
The OVN log saying 'dropping duplicate flow' is worrying, let me forward this to<br>
the OVN team to take a look at it.<br>
<br>
Marcin<br>
<div><div class="gmail-m_-8905699103458912990h5"><br>
<br>
<br>
----- Original Message -----<br>
> From: "Devin Acosta" <<a href="mailto:devin@pabstatencio.com" target="_blank">devin@pabstatencio.com</a>><br>
> To: "users" <<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a>><br>
> Sent: Saturday, December 3, 2016 12:24:21 AM<br>
> Subject: [ovirt-users] oVIRT 4 / OVN / Communication issues of instances between nodes.<br>
><br>
><br>
> Note: When I configured vdsm-tool ovn-config, I passed it the IP address of<br>
> the OVN-Controller which is using the ovirtmgmt network, which is just one<br>
> of the NIC's on the nodes.<br>
><br>
> I am opening up new thread as this I feel differs a bit from my original<br>
> request. I have OVN which I believe is deployed correctly. I have noticed<br>
> that if instances get spun up on the same oVIRT node they can all talk<br>
> without issues to one another, however if one instance gets spun up on<br>
> another node even if it has the same (OVN network/subnet), it can't ping or<br>
> reach other instances in the subnet. I noticed that the OVN-Controller of<br>
> the instance that can't talk is logging:<br>
><br>
> 2016-12-02T22:50:54.907Z|00181<wbr>|pinctrl|INFO|DHCPOFFER 00:1a:4a:16:01:5c<br>
> 10.10.10.4<br>
> 2016-12-02T22:50:54.908Z|00182<wbr>|pinctrl|INFO|DHCPACK 00:1a:4a:16:01:5c<br>
> 10.10.10.4<br>
> 2016-12-02T22:50:55.695Z|00183<wbr>|ofctrl|INFO|Dropped 7 log messages in last 10<br>
> seconds (most recently, 0 seconds ago) due to excessive rate<br>
> 2016-12-02T22:50:55.695Z|00184<wbr>|ofctrl|INFO|dropping duplicate flow:<br>
> table_id=32, priority=150, reg10=0x2/0x2, actions=resubmit(,33)<br>
> 2016-12-02T22:51:10.705Z|00185<wbr>|ofctrl|INFO|Dropped 6 log messages in last 15<br>
> seconds (most recently, 5 seconds ago) due to excessive rate<br>
> 2016-12-02T22:51:10.705Z|00186<wbr>|ofctrl|INFO|dropping duplicate flow:<br>
> table_id=32, priority=150, reg10=0x2/0x2, actions=resubmit(,33)<br>
> 2016-12-02T22:51:20.710Z|00187<wbr>|ofctrl|INFO|Dropped 4 log messages in last 10<br>
> seconds (most recently, 5 seconds ago) due to excessive rate<br>
> 2016-12-02T22:51:20.710Z|00188<wbr>|ofctrl|INFO|dropping duplicate flow:<br>
> table_id=32, priority=150, reg10=0x2/0x2, actions=resubmit(,33)<br>
> 2016-12-02T22:51:35.718Z|00189<wbr>|ofctrl|INFO|Dropped 5 log messages in last 15<br>
> seconds (most recently, 5 seconds ago) due to excessive rate<br>
> 2016-12-02T22:51:35.718Z|00190<wbr>|ofctrl|INFO|dropping duplicate flow:<br>
> table_id=32, priority=150, reg10=0x2/0x2, actions=resubmit(,33)<br>
> 2016-12-02T22:51:45.724Z|00191<wbr>|ofctrl|INFO|Dropped 3 log messages in last 10<br>
> seconds (most recently, 5 seconds ago) due to excessive rate<br>
> 2016-12-02T22:51:45.724Z|00192<wbr>|ofctrl|INFO|dropping duplicate flow:<br>
> table_id=32, priority=150, reg10=0x2/0x2, actions=resubmit(,33)<br>
> 2016-12-02T22:51:55.730Z|00193<wbr>|ofctrl|INFO|Dropped 5 log messages in last 10<br>
> seconds (most recently, 0 seconds ago) due to excessive rate<br>
> 2016-12-02T22:51:55.730Z|00194<wbr>|ofctrl|INFO|dropping duplicate flow:<br>
> table_id=32, priority=150, reg10=0x2/0x2, actions=resubmit(,33)<br>
> 2016-12-02T22:52:10.738Z|00195<wbr>|ofctrl|INFO|Dropped 5 log messages in last 15<br>
> seconds (most recently, 5 seconds ago) due to excessive rate<br>
> 2016-12-02T22:52:10.739Z|00196<wbr>|ofctrl|INFO|dropping duplicate flow:<br>
> table_id=32, priority=150, reg10=0x2/0x2, actions=resubmit(,33)<br>
> 2016-12-02T22:52:20.744Z|00197<wbr>|ofctrl|INFO|Dropped 3 log messages in last 10<br>
> seconds (most recently, 5 seconds ago) due to excessive rate<br>
> 2016-12-02T22:52:20.744Z|00198<wbr>|ofctrl|INFO|dropping duplicate flow:<br>
> table_id=32, priority=150, reg10=0x2/0x2, actions=resubmit(,33)<br>
> 2016-12-02T22:52:35.752Z|00199<wbr>|ofctrl|INFO|Dropped 5 log messages in last 15<br>
> seconds (most recently, 5 seconds ago) due to excessive rate<br>
> 2016-12-02T22:52:35.752Z|00200<wbr>|ofctrl|INFO|dropping duplicate flow:<br>
> table_id=32, priority=150, reg10=0x2/0x2, actions=resubmit(,33)<br>
> 2016-12-02T22:52:45.758Z|00201<wbr>|ofctrl|INFO|Dropped 4 log messages in last 10<br>
> seconds (most recently, 5 seconds ago) due to excessive rate<br>
> 2016-12-02T22:52:45.758Z|00202<wbr>|ofctrl|INFO|dropping duplicate flow:<br>
> table_id=32, priority=150, reg10=0x2/0x2, actions=resubmit(,33)<br>
><br>
> From the OVN-Controller:<br>
><br>
> [root@dev001-022-002 ~]# ovn-nbctl show<br>
> switch ddb3b92f-b359-4b59-a41a-ebae6d<wbr>f7fe9a (devins-net)<br>
> port 6b289418-8b8e-42b4-8334-c71584<wbr>afcd3e<br>
> addresses: ["00:1a:4a:16:01:5c dynamic"]<br>
> port 71ef81f1-7c20-4c68-b536-d27470<wbr>3f7541<br>
> addresses: ["00:1a:4a:16:01:61 dynamic"]<br>
> port 91d4f4f5-4b9f-42c0-aa2c-8a1014<wbr>74bb84<br>
> addresses: ["00:1a:4a:16:01:5e dynamic"]<br>
><br>
> Do I need to do something special in order to allow communication between<br>
> nodes of instances on same OVN network?<br>
><br>
> Output of ovs-vsctl show from node3:<br>
><br>
> 61af799c-a621-445e-8183-23dcb3<wbr>8ea3cc<br>
> Bridge br-int<br>
> fail_mode: secure<br>
> Port "ovn-456949-0"<br>
> Interface "ovn-456949-0"<br>
> type: geneve<br>
> options: {csum="true", key=flow, remote_ip="172.10.10.74"}<br>
> Port "ovn-c0dc09-0"<br>
> Interface "ovn-c0dc09-0"<br>
> type: geneve<br>
> options: {csum="true", key=flow, remote_ip="172.10.10.73"}<br>
> Port br-int<br>
> Interface br-int<br>
> type: internal<br>
> ovs_version: "2.6.90"<br>
><br>
> --<br>
><br>
> Devin Acosta<br>
> Red Hat Certified Architect, LinuxStack<br>
> <a href="tel:602-354-1220" value="+16023541220" target="_blank">602-354-1220</a> || <a href="mailto:devin@linuxguru.co" target="_blank">devin@linuxguru.co</a><br>
><br>
</div></div>> ______________________________<wbr>_________________<br>
> Users mailing list<br>
> <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
> <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
><br>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail-m_-8905699103458912990gmail_signature"><div dir="ltr"><div><br></div><div>Devin Acosta</div><div>Red Hat Certified Architect, LinuxStack </div><div><a href="tel:602-354-1220" value="+16023541220" target="_blank">602-354-1220</a> || <a href="mailto:devin@linuxguru.co" target="_blank">devin@linuxguru.co</a></div></div></div>
</div>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div><br></div><div>Devin Acosta</div><div>Red Hat Certified Architect, LinuxStack </div><div>602-354-1220 || <a href="mailto:devin@linuxguru.co" target="_blank">devin@linuxguru.co</a></div></div></div>
</div></div>