[ovirt-users] Re: Ovirt OVN help needed

On Tue, Dec 17, 2019 at 9:17 AM Dominik Holler <dholler(a)redhat.com&gt; wrote: > > > > On Tue, Dec 17, 2019 at 6:28 AM Strahil <hunter86_bg(a)yahoo.com&gt; wrote: >> >> Hi Dominik, >> >> Thanks for your reply. >> >> On ovirt1 I got the following: >> [root@ovirt1 openvswitch]# less ovn-controller.log-20191216.gz >> 2019-12-15T01:49:02.988Z|00032|vlog|INFO|opened log file /var/log/openvswitch/ovn-controller.log >> 2019-12-16T01:18:02.114Z|00033|vlog|INFO|closing log file >> ovn-controller.log-20191216.gz (END) >> >> Same is on the other node: >> >> [root@ovirt2 openvswitch]# less ovn-controller.log-20191216.gz >> 2019-12-15T01:26:03.477Z|00028|vlog|INFO|opened log file /var/log/openvswitch/ovn-controller.log >> 2019-12-16T01:30:01.718Z|00029|vlog|INFO|closing log file >> ovn-controller.log-20191216.gz (END) >> >> The strange thing is that the geneve tunnels are there: > > > > Miguel, do you know how to remove and re-add the chassis to the southbound db? > (We have to check this to address bug https://bugzilla.redhat.com/1758289 ) "ovn-sbctl chassis-del CHASSIS" will get rid of the chassis / encap. Afterwards, the ovn-controller will re-register itself on OVN southbound. There's something weird about your chassis, I see you have listed 3 different chassis IDs on your port IDs: - ovn-chassis-id=&quot;5668499c-7dd0-41ee-bc5d-2e6ee9cd61c3(a)192.168.1.41&quot; - ovn-chassis-id=&quot;25cc77b3-046f-45c5-af0c-ffb2f77d73f1(a)192.168.1.64&quot; - ovn-chassis-id=&quot;baa0199e-d1a4-484c-af13-a41bcad19dbc(a)192.168.1.90&quot; From your 'ovs-vsctl show' I can see the IP encaps 192.168.1.41 and 192.168.1.64 are 'expected'. I would expect to see a duplicate chassis entry in the same IP . Who has this 192.168.1.90 IP ? A couple of further questions: - did you upgrade recently your environment ? If so, from which version to which version ? - what is the switch type of the cluster where you are running OVN ?

> >> >> [root@ovirt1 ~]# ovs-vsctl show >> c0e938f1-b5b5-4d5a-9cda-29dae2986f29 >> Bridge br-int >> fail_mode: secure >> Port "ovn-25cc77-0" >> Interface "ovn-25cc77-0" >> type: geneve >> options: {csum="true", key=flow, remote_ip="192.168.1.64"} Port "ovn-566849-0" >> Interface "ovn-566849-0" >> type: geneve >> options: {csum="true", key=flow, remote_ip="192.168.1.41"} Port br-int >> Interface br-int >> type: internal >> Port "vnet2" >> Interface "vnet2" >> ovs_version: "2.11.0" >> [root@ovirt1 ~]# ovs-vsctl list ports >> ovs-vsctl: unknown table "ports" >> [root@ovirt1 ~]# ovs-vsctl list port >> _uuid : fbf40569-925e-4430-a7c5-c78d58979bbc >> bond_active_slave : [] >> bond_downdelay : 0 >> bond_fake_iface : false >> bond_mode : [] >> bond_updelay : 0 >> cvlans : [] >> external_ids : {} >> fake_bridge : false >> interfaces : [3207c0cb-3000-40f2-a850-83548f76f090]lacp : [] >> mac : [] >> name : "vnet2" >> other_config : {} >> protected : false >> qos : [] >> rstp_statistics : {} >> rstp_status : {} >> statistics : {} >> status : {} >> tag : [] >> trunks : [] >> vlan_mode : [] >> >> _uuid : 8947f82d-a089-429b-8843-71371314cb52 >> bond_active_slave : [] >> bond_downdelay : 0 >> bond_fake_iface : false >> bond_mode : [] >> bond_updelay : 0 >> cvlans : [] >> external_ids : {} >> fake_bridge : false >> interfaces : [ec6a6688-e5d6-4346-ac47-ece1b8379440]lacp : [] >> mac : [] >> name : br-int >> other_config : {} >> protected : false >> qos : [] >> rstp_statistics : {} >> rstp_status : {} >> statistics : {} >> status : {} >> tag : [] >> trunks : [] >> vlan_mode : [] >> >> _uuid : 72d612be-853e-43e9-8f5c-ce66cef0bebe >> bond_active_slave : [] >> bond_downdelay : 0 >> bond_fake_iface : false >> bond_mode : [] >> bond_updelay : 0 >> cvlans : [] >> external_ids : {ovn-chassis-id=&quot;5668499c-7dd0-41ee-bc5d-2e6ee9cd61c3(a)192.168.1.41&quot;} >> fake_bridge : false >> interfaces : [a31574fe-515b-420b-859d-7f2ac729638f]lacp : [] >> mac : [] >> name : "ovn-566849-0" >> other_config : {} >> protected : false >> qos : [] >> rstp_statistics : {} >> rstp_status : {} >> statistics : {} >> status : {} >> tag : [] >> trunks : [] >> vlan_mode : [] >> >> _uuid : 2043a15f-ec39-4cc3-b875-7be00423dd7a >> bond_active_slave : [] >> bond_downdelay : 0 >> bond_fake_iface : false >> bond_mode : [] >> bond_updelay : 0 >> cvlans : [] >> external_ids : {ovn-chassis-id=&quot;25cc77b3-046f-45c5-af0c-ffb2f77d73f1(a)192.168.1.64&quot;} >> fake_bridge : false >> interfaces : [f9a9e3ff-070e-4044-b601-7f7394dc295f]lacp : [] >> mac : [] >> name : "ovn-25cc77-0" >> other_config : {} >> protected : false >> qos : [] >> rstp_statistics : {} >> rstp_status : {} >> statistics : {} >> status : {} >> tag : [] >> trunks : [] >> vlan_mode : [] >> [root@ovirt1 ~]# >> >> [root@ovirt2 ~]# ovs-vsctl show >> 3dbab138-6b90-44c5-af05-b8a944c9bf20 >> Bridge br-int >> fail_mode: secure >> Port "ovn-baa019-0" >> Interface "ovn-baa019-0" >> type: geneve >> options: {csum="true", key=flow, remote_ip="192.168.1.90"} Port br-int >> Interface br-int >> type: internal >> Port "vnet5" >> Interface "vnet5" >> Port "ovn-566849-0" >> Interface "ovn-566849-0" >> type: geneve >> options: {csum="true", key=flow, remote_ip="192.168.1.41"} >> ovs_version: "2.11.0" >> [root@ovirt2 ~]# ovs-vsctl list port >> _uuid : 151e1188-f07a-4750-a620-392a08e7e7fe >> bond_active_slave : [] >> bond_downdelay : 0 >> bond_fake_iface : false >> bond_mode : [] bond_updelay : 0 >> cvlans : [] >> external_ids : {ovn-chassis-id=&quot;baa0199e-d1a4-484c-af13-a41bcad19dbc(a)192.168.1.90&quot;} >> fake_bridge : false >> interfaces : [4d4bc12a-609a-4917-b839-d4f652acdc33]lacp : [] >> mac : [] >> name : "ovn-baa019-0" >> other_config : {} >> protected : false >> qos : [] >> rstp_statistics : {} >> rstp_status : {} >> statistics : {} >> status : {} >> tag : [] >> trunks : [] >> vlan_mode : [] >> >> _uuid : 3a862f96-b3ec-46a9-bcf6-f385e5def410 >> bond_active_slave : [] >> bond_downdelay : 0 >> bond_fake_iface : false >> bond_mode : [] >> bond_updelay : 0 >> cvlans : [] >> external_ids : {} >> fake_bridge : false >> interfaces : [777f2819-ca27-4890-8d2f-11349ca0d398]lacp : [] >> mac : [] >> name : br-int >> other_config : {} >> protected : false >> qos : [] >> rstp_statistics : {} >> rstp_status : {} >> statistics : {} >> status : {} >> tag : [] >> trunks : [] >> vlan_mode : [] >> >> _uuid : a65109fa-f8b4-4670-8ae8-a2bd0bf6aba3 >> bond_active_slave : [] >> bond_downdelay : 0 >> bond_fake_iface : false >> bond_mode : [] >> bond_updelay : 0 >> cvlans : [] >> external_ids : {ovn-chassis-id=&quot;5668499c-7dd0-41ee-bc5d-2e6ee9cd61c3(a)192.168.1.41&quot;} >> fake_bridge : false >> interfaces : [ed442077-f897-4e0b-97a1-a8051e9c3d56]lacp : [] >> mac : [] >> name : "ovn-566849-0" >> other_config : {} >> protected : false >> qos : [] >> rstp_statistics : {} >> rstp_status : {} >> statistics : {} >> status : {} >> tag : [] >> trunks : [] >> vlan_mode : [] >> >> _uuid : a1622e6f-fcd0-4a8a-b259-ca4d0ccf1cd2 >> bond_active_slave : [] >> bond_downdelay : 0 >> bond_fake_iface : false >> bond_mode : [] >> bond_updelay : 0 >> cvlans : [] >> external_ids : {} >> fake_bridge : false >> interfaces : [ca368654-54f3-49d0-a71c-8894426df6bf]lacp : [] >> mac : [] >> name : "vnet5" >> other_config : {} >> protected : false >> qos : [] >> rstp_statistics : {} >> rstp_status : {} >> statistics : {} >> status : {} >> tag : [] >> trunks : [] >> vlan_mode : [] >> [root@ovirt2 ~]# >> >> Best Regards, >> Strahil Nikolov >> >> On Dec 16, 2019 23:28, Dominik Holler <dholler(a)redhat.com&gt; wrote: >> > >> > >> > >> > On Sat, Dec 14, 2019 at 11:36 AM Strahil Nikolov <hunter86_bg(a)yahoo.com&gt; wrote: >> >> >> >> Hi Dominik, >> >> >> >> yes I was looking for those settings. >> >> >> >> I have added again the external provider , but I guess the mess is even bigger as I made some stupid decisions (like removing 2 port groups :) without knowing what I'm doing) . >> >> Sadly I can't remove all packages on the engine and hosts and reinstall them from scratch. >> >> >> >> Pip fails to install the openstacksdk (centOS7 is not great for such tasks) on the engine and my lack of knowledge in OVN makes it even more difficult. >> >> >> >> So the symptoms are that 2 machines can communicate with each other only if they are on the same host ,while on separate - no communications is happening. >> >> >> > >> > This indicates that the tunnels between the hosts are not created. >> > Can you please check the /var/log/openvswitch/ovn-controller.log on both hosts for errors and warnings, or share parts of the files here? >> > If this does not point us to a problem, ovn has to be reconfigured. If possible, most easy way to do this would be to ensure that >> > ovirt-provider-ovn is the default network provider of the cluster of the hosts, put one host after another in maintance mode and reinstall. >> > >> > >> >> >> >> How I created the network via UI: >> >> >> >> 1. Networks - new >> >> 2. Fill in the name >> >> 3. Create on external provider >> >> 4. Network Port security -> disabled (even undefined does not work) >> >> 5.Connect to physical network -> ovirtmgmt >> >> >> >> >> >> I would be happy to learn more about OVN and thus I would like to make it work. >> >> >> >> Here is some info from the engine: >> >> >> >> [root@engine ~]# ovn-nbctl show >> >> switch 1288ed26-471c-4bc2-8a7d-4531f306f44c (ovirt-pxelan-2a88b2e0-d04b-4196-ad50-074501e4ed08) >> >> port c1eba112-5eed-4c04-b25c-d3dcfb934546 >> >> addresses: ["56:6f:5a:65:00:06"] >> >> port 8b52ab60-f474-4d51-b258-cb2e0a53c34a >> >> type: localnet >> >> addresses: ["unknown"] >> >> port b2753040-881b-487a-92a1-9721da749be4 >> >> addresses: ["56:6f:5a:65:00:09"] >> >> [root@engine ~]# ovn-sbctl show >> >> Chassis "5668499c-7dd0-41ee-bc5d-2e6ee9cd61c3" >> >> hostname: "ovirt3.localdomain" >> >> Encap geneve >> >> ip: "192.168.1.41" >> >> options: {csum="true"} >> >> Chassis "baa0199e-d1a4-484c-af13-a41bcad19dbc" >> >> hostname: "ovirt1.localdomain" >> >> Encap geneve >> >> ip: "192.168.1.90" >> >> options: {csum="true"} >> >> Chassis "25cc77b3-046f-45c5-af0c-ffb2f77d73f1" >> >> hostname: "ovirt2.localdomain" >> >> Encap geneve >> >> ip: "192.168.1.64" >> >> options: {csum="true"} >> >> Port_Binding "b2753040-881b-487a-92a1-9721da749be4" >> >> Port_Binding &quo