Unstable network connections after installing vdsm
I've been experiencing peculiar and annoying networking behavior on my oVirt development hosts and I'm hoping someone familiar with vdsm networking configuration can help me get to the bottom of it. My setup is two mini-Dells acting as virt hosts and ovirt engine running on my laptop. The dells get their network config from a cobbler instance running on my laptop which also provides PXE services. After freshly installing the dells, I get a nice, stable network connection. After installing vdsm, the connection seems to drop occasionally. I have visit the machine, log into the console, and execute 'dhclient ovirtmgmt'. This fixes the problem again for awhile. Does this sound like anything someone has seen before? What would be the best way to start debugging/diagnosing this issue? Thanks in advance for your responses. -- Adam Litke
Hi Adam, there are some known issues, which depend on versions of software you are running. If you are using EL7 (or Fedoras?) you may want to switch SELinux to permissive mode and turn off NetworkManager (both are separate problems with bugs open for them [1, 2]). Then give it another go. I think this could be your case. Please begin with NM, which is my suspect. If you are on EL6 you might be experiencing the traffic control (tc) utility or even the kernel not supporting certain commands. I came to looking at this problem finally so I might be able to sort it out (or ask Toni for help). In the mean time, could you let us know what version of VDSM, selinux-policy and NetworkManager you are running? Could you attach /var/log/vdsm/supervdsm.log and /var/log/vdsm/vdsm.log? Does someting (NetworkManager!) in the journal seem fishy? Thanks, Ondra [1] https://bugzilla.redhat.com/show_bug.cgi?id=1138731 (I'll ask them for _working_ RPMs) [2] https://bugzilla.redhat.com/show_bug.cgi?id=1136843 (NetworkManager seems to touch more than we want) On 10.11.2014 15:34, Adam Litke wrote:
I've been experiencing peculiar and annoying networking behavior on my oVirt development hosts and I'm hoping someone familiar with vdsm networking configuration can help me get to the bottom of it.
My setup is two mini-Dells acting as virt hosts and ovirt engine running on my laptop. The dells get their network config from a cobbler instance running on my laptop which also provides PXE services.
After freshly installing the dells, I get a nice, stable network connection. After installing vdsm, the connection seems to drop occasionally. I have visit the machine, log into the console, and execute 'dhclient ovirtmgmt'. This fixes the problem again for awhile.
Does this sound like anything someone has seen before? What would be the best way to start debugging/diagnosing this issue? Thanks in advance for your responses.
On 10/11/14 11:19 -0500, Ondřej Svoboda wrote:
Hi Adam,
there are some known issues, which depend on versions of software you are running.
If you are using EL7 (or Fedoras?) you may want to switch SELinux to permissive mode and turn off NetworkManager (both are separate problems with bugs open for them [1, 2]). Then give it another go. I think this could be your case. Please begin with NM, which is my suspect.
Using Fedora 20 and I think this was the culprit. On my newly installed machines I am yet to reproduce the problem with NM disabled. Have we considered making the vdsm package conflict with NetworkManager? Or is this just a temporary situation?
If you are on EL6 you might be experiencing the traffic control (tc) utility or even the kernel not supporting certain commands. I came to looking at this problem finally so I might be able to sort it out (or ask Toni for help).
In the mean time, could you let us know what version of VDSM, selinux-policy and NetworkManager you are running? Could you attach /var/log/vdsm/supervdsm.log and /var/log/vdsm/vdsm.log? Does someting (NetworkManager!) in the journal seem fishy?
No repro but here are the package versions: vdsm-4.16.0-522.git4a3768f.fc20.x86_64 NetworkManager-0.9.9.0-46.git20131003.fc20.x86_64 selinux-policy-3.12.1-193.fc20.noarch -- Adam Litke
On 10/11/14 11:19 -0500, Ondřej Svoboda wrote:
Hi Adam,
there are some known issues, which depend on versions of software you are running.
If you are using EL7 (or Fedoras?) you may want to switch SELinux to permissive mode and turn off NetworkManager (both are separate problems with bugs open for them [1, 2]). Then give it another go. I think this could be your case. Please begin with NM, which is my suspect.
If you are on EL6 you might be experiencing the traffic control (tc) utility or even the kernel not supporting certain commands. I came to looking at this problem finally so I might be able to sort it out (or ask Toni for help).
In the mean time, could you let us know what version of VDSM, selinux-policy and NetworkManager you are running? Could you attach /var/log/vdsm/supervdsm.log and /var/log/vdsm/vdsm.log? Does someting (NetworkManager!) in the journal seem fishy?
I spoke too soon :( Happened again on my box. Please see https://bugzilla.redhat.com/show_bug.cgi?id=1162844 for a bug that I created to track this. I've uploaded the vdsm.log and supervdsm.log files too.
Thanks, Ondra
[1] https://bugzilla.redhat.com/show_bug.cgi?id=1138731 (I'll ask them for _working_ RPMs) [2] https://bugzilla.redhat.com/show_bug.cgi?id=1136843 (NetworkManager seems to touch more than we want)
On 10.11.2014 15:34, Adam Litke wrote:
I've been experiencing peculiar and annoying networking behavior on my oVirt development hosts and I'm hoping someone familiar with vdsm networking configuration can help me get to the bottom of it.
My setup is two mini-Dells acting as virt hosts and ovirt engine running on my laptop. The dells get their network config from a cobbler instance running on my laptop which also provides PXE services.
After freshly installing the dells, I get a nice, stable network connection. After installing vdsm, the connection seems to drop occasionally. I have visit the machine, log into the console, and execute 'dhclient ovirtmgmt'. This fixes the problem again for awhile.
Does this sound like anything someone has seen before? What would be the best way to start debugging/diagnosing this issue? Thanks in advance for your responses.
-- Adam Litke
----- Original Message -----
From: "Adam Litke" <alitke@redhat.com> To: devel@ovirt.org Sent: Monday, November 10, 2014 4:34:02 PM Subject: [ovirt-devel] Unstable network connections after installing vdsm
I've been experiencing peculiar and annoying networking behavior on my oVirt development hosts and I'm hoping someone familiar with vdsm networking configuration can help me get to the bottom of it.
My setup is two mini-Dells acting as virt hosts and ovirt engine running on my laptop. The dells get their network config from a cobbler instance running on my laptop which also provides PXE services.
After freshly installing the dells, I get a nice, stable network connection. After installing vdsm, the connection seems to drop occasionally. I have visit the machine, log into the console, and execute 'dhclient ovirtmgmt'. This fixes the problem again for awhile.
Sounds like an issue I have on Fedora 20 and RHEL 7 hosts. Antoni told me this is a known issue, and hopefully he can point us to the relevant bug.
Does this sound like anything someone has seen before? What would be the best way to start debugging/diagnosing this issue? Thanks in advance for your responses.
-- Adam Litke _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel
----- Original Message -----
From: "Nir Soffer" <nsoffer@redhat.com> To: "Adam Litke" <alitke@redhat.com> Cc: devel@ovirt.org, asegurap@redhat.com Sent: Monday, November 10, 2014 9:40:39 PM Subject: Re: [ovirt-devel] Unstable network connections after installing vdsm
----- Original Message -----
From: "Adam Litke" <alitke@redhat.com> To: devel@ovirt.org Sent: Monday, November 10, 2014 4:34:02 PM Subject: [ovirt-devel] Unstable network connections after installing vdsm
I've been experiencing peculiar and annoying networking behavior on my oVirt development hosts and I'm hoping someone familiar with vdsm networking configuration can help me get to the bottom of it.
My setup is two mini-Dells acting as virt hosts and ovirt engine running on my laptop. The dells get their network config from a cobbler instance running on my laptop which also provides PXE services.
After freshly installing the dells, I get a nice, stable network connection. After installing vdsm, the connection seems to drop occasionally. I have visit the machine, log into the console, and execute 'dhclient ovirtmgmt'. This fixes the problem again for awhile.
Sounds like an issue I have on Fedora 20 and RHEL 7 hosts. Antoni told me this is a known issue, and hopefully he can point us to the relevant bug.
Yes. It is a bug in /sbin/dhclient-script https://bugzilla.redhat.com/show_bug.cgi?id=1116004
Does this sound like anything someone has seen before? What would be the best way to start debugging/diagnosing this issue? Thanks in advance for your responses.
-- Adam Litke _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel
On 11/11/14 07:35, Antoni Segura Puimedon wrote:
Yes. It is a bug in /sbin/dhclient-script https://bugzilla.redhat.com/show_bug.cgi?id=1116004
Hi, this bug is marked as private, would it be possible to make it visible to the general public? Thanks! -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
----- Original Message -----
From: "Sven Kieske" <s.kieske@mittwald.de> To: devel@ovirt.org Sent: Tuesday, November 11, 2014 10:18:23 AM Subject: Re: [ovirt-devel] Unstable network connections after installing vdsm
On 11/11/14 07:35, Antoni Segura Puimedon wrote:
Yes. It is a bug in /sbin/dhclient-script https://bugzilla.redhat.com/show_bug.cgi?id=1116004
Hi,
this bug is marked as private, would it be possible to make it visible to the general public?
I'm very sorry. We have a public version of it, just my vimperator autocompleted to the wrong one :( https://bugzilla.redhat.com/show_bug.cgi?id=1142082 Apologies, Toni
Thanks!
-- Mit freundlichen Grüßen / Regards
Sven Kieske
Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel
participants (5)
-
Adam Litke -
Antoni Segura Puimedon -
Nir Soffer -
Ondřej Svoboda -
Sven Kieske