I already did a virsh -r dumpxml on the host and everything seemed to be fine.
It's solved at the moment as there seemed to be some arp cache on the vm/host or switch and after changing the CARP IP to IP Alias, ping it, and set it back to CARP it works.
Even reboots (vm's/hosts) didn't fix it... so I think pfSense was the one here that did something maybe as I was able to ping other hosts even from the pfsense box but not the IP's on the pfsense box... I had that earlier too with another cluster I thought.