MacSpoof with multiple VM's -> bad/slow response on 3.5.3
Hi Guys, On a 3.5.3 updated cluster I see issues with macspoofed VM's. The cluster is a CcentOS 7 cluster which always performed well. I noticed that on my loadbalancers the macspoof true setting disspeared in the engine and when I added it and rebooted some other carp machines it was vanished at those machines. It's a quite simple setup: 2 static nodes in a mutiple hosts cluster with carp machines on it, per blade 1 Firewall, Pfsense, and one Loadbalancer ZEN. The cluster ID's differ on ZEN, and the carp IP's on pfsense have a different VHID's so I wondered if this is a known issue with the vanished macspoof true setting I found out (so the whole virtual IP doesn't work in that case). Some other cluster works fine without any issue, the spoofed systems here are on CentOS 6 This setup has run for more than a year without any issues. I hope someone has some information if this issue is known. Thanks Matt (sorry for my bad typing it's kinda early/late ;))
On Wed, Oct 21, 2015 at 07:51:28AM +0200, Matt . wrote:
Hi Guys,
On a 3.5.3 updated cluster I see issues with macspoofed VM's.
The cluster is a CcentOS 7 cluster which always performed well.
I noticed that on my loadbalancers the macspoof true setting disspeared in the engine and when I added it and rebooted some other carp machines it was vanished at those machines.
What do you mean by "vanished"? Does it not show on the UI? When did it happen? Can you share the domxml of the VMs that you start?
It's a quite simple setup:
2 static nodes in a mutiple hosts cluster with carp machines on it, per blade 1 Firewall, Pfsense, and one Loadbalancer ZEN.
The cluster ID's differ on ZEN, and the carp IP's on pfsense have a different VHID's so I wondered if this is a known issue with the vanished macspoof true setting I found out (so the whole virtual IP doesn't work in that case).
Some other cluster works fine without any issue, the spoofed systems here are on CentOS 6
This setup has run for more than a year without any issues.
I hope someone has some information if this issue is known.
Thanks Matt
(sorry for my bad typing it's kinda early/late ;)) _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Dan, Yes it vanished from the gui. The strange thing is I was looking using VdsClient and saw my loadbalancers where not started with macspoof true, but my Firewalls were. In the time between they have been migrated and restarted also in tests, so I cannot see if it has been running with macspoof true and it vanished from the gui, but I'm 200% it was in there (GUI). Now this is double checked etc all working fine again, I wonder if macspoof can have issues with multiple VHID groups in between the same hosts on the same vlan. It's kinda guessing as I cannot show how it was setup, this came up during some failover test after the machines have been moved to dedicated hosts some while ago. So, ask me, shoot me and maybe we can tackle if this could be a bug or so. Thanks, Matt 2015-10-21 14:44 GMT+02:00 Dan Kenigsberg <danken@redhat.com>:
On Wed, Oct 21, 2015 at 07:51:28AM +0200, Matt . wrote:
Hi Guys,
On a 3.5.3 updated cluster I see issues with macspoofed VM's.
The cluster is a CcentOS 7 cluster which always performed well.
I noticed that on my loadbalancers the macspoof true setting disspeared in the engine and when I added it and rebooted some other carp machines it was vanished at those machines.
What do you mean by "vanished"? Does it not show on the UI? When did it happen? Can you share the domxml of the VMs that you start?
It's a quite simple setup:
2 static nodes in a mutiple hosts cluster with carp machines on it, per blade 1 Firewall, Pfsense, and one Loadbalancer ZEN.
The cluster ID's differ on ZEN, and the carp IP's on pfsense have a different VHID's so I wondered if this is a known issue with the vanished macspoof true setting I found out (so the whole virtual IP doesn't work in that case).
Some other cluster works fine without any issue, the spoofed systems here are on CentOS 6
This setup has run for more than a year without any issues.
I hope someone has some information if this issue is known.
Thanks Matt
(sorry for my bad typing it's kinda early/late ;)) _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Updated Pfsense, rebooted where failovers where done, same issues occures in some way when the FW was rebooted or turned off/onn again. I happens randomly but is a pain in the ass to debug as you are expecting it should not vanish :) CARP IP's are not working anymore, sometimes they are... and finally you find out... macspoofing is gone as setting on the VM. More people seen this ? 2015-10-21 17:18 GMT+02:00 Matt . <yamakasi.014@gmail.com>:
Hi Dan,
Yes it vanished from the gui.
The strange thing is I was looking using VdsClient and saw my loadbalancers where not started with macspoof true, but my Firewalls were.
In the time between they have been migrated and restarted also in tests, so I cannot see if it has been running with macspoof true and it vanished from the gui, but I'm 200% it was in there (GUI).
Now this is double checked etc all working fine again, I wonder if macspoof can have issues with multiple VHID groups in between the same hosts on the same vlan.
It's kinda guessing as I cannot show how it was setup, this came up during some failover test after the machines have been moved to dedicated hosts some while ago.
So, ask me, shoot me and maybe we can tackle if this could be a bug or so.
Thanks,
Matt
2015-10-21 14:44 GMT+02:00 Dan Kenigsberg <danken@redhat.com>:
On Wed, Oct 21, 2015 at 07:51:28AM +0200, Matt . wrote:
Hi Guys,
On a 3.5.3 updated cluster I see issues with macspoofed VM's.
The cluster is a CcentOS 7 cluster which always performed well.
I noticed that on my loadbalancers the macspoof true setting disspeared in the engine and when I added it and rebooted some other carp machines it was vanished at those machines.
What do you mean by "vanished"? Does it not show on the UI? When did it happen? Can you share the domxml of the VMs that you start?
It's a quite simple setup:
2 static nodes in a mutiple hosts cluster with carp machines on it, per blade 1 Firewall, Pfsense, and one Loadbalancer ZEN.
The cluster ID's differ on ZEN, and the carp IP's on pfsense have a different VHID's so I wondered if this is a known issue with the vanished macspoof true setting I found out (so the whole virtual IP doesn't work in that case).
Some other cluster works fine without any issue, the spoofed systems here are on CentOS 6
This setup has run for more than a year without any issues.
I hope someone has some information if this issue is known.
Thanks Matt
(sorry for my bad typing it's kinda early/late ;)) _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On Sun, Nov 08, 2015 at 04:56:42AM +0100, Matt . wrote:
Updated Pfsense, rebooted where failovers where done, same issues occures in some way when the FW was rebooted or turned off/onn again.
I happens randomly but is a pain in the ass to debug as you are expecting it should not vanish :)
CARP IP's are not working anymore, sometimes they are... and finally you find out... macspoofing is gone as setting on the VM.
Is it a setting of the VM, or the more modern setting on the vnic profile? NOTHING in oVirt changes custom properties like this by its own volition. Could you share your vnic profile definition, and you VM definition when they are properly configured. Then, please share how they look after the setting is "gone". Then, maybe you can pinpoint when the definition is changed, and by whom. engine.log may provide clues.
Hi Dan, It's a little bit difficult to find some pinpoint, I already tried that earlier, but I won't giveup. It is the setting on the VM itself that vanished. 2015-11-08 9:31 GMT+01:00 Dan Kenigsberg <danken@redhat.com>:
On Sun, Nov 08, 2015 at 04:56:42AM +0100, Matt . wrote:
Updated Pfsense, rebooted where failovers where done, same issues occures in some way when the FW was rebooted or turned off/onn again.
I happens randomly but is a pain in the ass to debug as you are expecting it should not vanish :)
CARP IP's are not working anymore, sometimes they are... and finally you find out... macspoofing is gone as setting on the VM.
Is it a setting of the VM, or the more modern setting on the vnic profile?
NOTHING in oVirt changes custom properties like this by its own volition. Could you share your vnic profile definition, and you VM definition when they are properly configured. Then, please share how they look after the setting is "gone".
Then, maybe you can pinpoint when the definition is changed, and by whom. engine.log may provide clues.
On Sun, Nov 08, 2015 at 10:26:09PM +0100, Matt . wrote:
Hi Dan,
It's a little bit difficult to find some pinpoint, I already tried that earlier, but I won't giveup.
It is the setting on the VM itself that vanished.
The setting (ifacemacspoof) should better exist on the VNIC profile. Maybe if you provide a step-by-step explanation of what you are doing (screenshots are welcome as well), we could assist.
HI Dan, OK need to look that up. It's just a simple VM, turn it off reinstall or upgrade, nothing special. Another VM did that also yesterday. I also removed the disk there and aded a new one, maybe that makes it happen ? I agree that it should not happen and I'm really unable to find some pinpoint. I most of the see it when it already happened and things didn't work as before on that machine. Overall they run all OK. See this as a post-it, if you ever hear anything about it... it might be handy to have some more "he it happens" topics. 2015-11-09 8:38 GMT+01:00 Dan Kenigsberg <danken@redhat.com>:
On Sun, Nov 08, 2015 at 10:26:09PM +0100, Matt . wrote:
Hi Dan,
It's a little bit difficult to find some pinpoint, I already tried that earlier, but I won't giveup.
It is the setting on the VM itself that vanished.
The setting (ifacemacspoof) should better exist on the VNIC profile. Maybe if you provide a step-by-step explanation of what you are doing (screenshots are welcome as well), we could assist.
participants (2)
-
Dan Kenigsberg -
Matt .