Hello all.
This issue is finally resolved. So what was the problem? Well dneary did put a comma in the wrong place.
No, just kidding, it was totally openshift related. Even to the point that another customer to openshift appearently had so many requests that it exploited some flaws in their setup. To the point that other customers(we) got affected.
To summarize it:
16:29:07 < Rydekull> blentz: finding anything?
16:31:01 < blentz> Rydekull: still working on it. we're trying a couple different ideas.
16:31:29 < Rydekull> but the problem is outside out httpd, right? cause I really cant see an error inside it
16:31:58 < mmcgrath> Rydekull: yeah it's not you, it's me :)
On the other hand, I've found some other issues, some that I've fixed and some that I'll note down for others to fix.