[ https://ovirt-jira.atlassian.net/browse/OVIRT-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=38451#comment-38451 ] Evgheni Dereveanchin commented on OVIRT-2586: --------------------------------------------- Had an issue now reported by [~eyonasi@redhat.com] that Jenkins was not responding. I was monitoring CPU and it was just 100% used (400-600% used normally and 800% during high load). So Jenkins was idling for a few minutes and logs seem to show long running requests finishing before it came back to normal: [04/Dec/2018:12:05:54 +0000] "POST /ajaxBuildQueue HTTP/1.1" 502 408 [04/Dec/2018:12:04:59 +0000] "GET /view/oVirt%20system%20tests/job/ovirt-system-tests_manual/build?delay=0sec HTTP/1.1" 502 497 [04/Dec/2018:12:05:45 +0000] "POST /ajaxExecutors HTTP/1.1" 502 406 [04/Dec/2018:12:05:49 +0000] "POST /ajaxExecutors HTTP/1.1" 502 406 [04/Dec/2018:12:05:03 +0000] "GET /job/system-sync_mirrors-centos-kvm-common-el7-x86_64/ HTTP/1.1" 502 485 [04/Dec/2018:12:05:44 +0000] "GET / HTTP/1.1" 502 379 [04/Dec/2018:12:05:44 +0000] "POST /ajaxBuildQueue HTTP/1.1" 502 408 [04/Dec/2018:12:03:47 +0000] "GET /sse-gateway/listen/jenkins-blueocean-core-js-1543923704114-zly0n HTTP/1.1" 200 139 [04/Dec/2018:12:04:07 +0000] "GET /sse-gateway/listen/jenkins-blueocean-core-js-1543923241074-hu9gfi HTTP/1.1" 200 112 [04/Dec/2018:12:04:07 +0000] "GET /sse-gateway/listen/jenkins-blueocean-core-js-1543917181943-ulooc HTTP/1.1" 200 111 [04/Dec/2018:12:03:40 +0000] "GET /sse-gateway/listen/jenkins-blueocean-core-js-1543915343510-2uggp HTTP/1.1" 200 112 [04/Dec/2018:12:04:08 +0000] "GET /sse-gateway/listen/jenkins-blueocean-core-js-1543844460885-fshsx HTTP/1.1" 200 112 [04/Dec/2018:12:03:45 +0000] "GET /sse-gateway/listen/jenkins-blueocean-core-js-1543916086881-v6zmif HTTP/1.1" 200 113 [04/Dec/2018:12:06:06 +0000] "GET /favicon.ico HTTP/1.1" 200 17542 As can be seen from this log, sse-gateway requests started around 12:03 terminated only after 12:06 which is just too long. As noted before, these requests are initiated from BlueOcean as it seems. [~bkorren@redhat.com] did we by chance recently add BlueOcean links to any report emails or something else that could increase popularity of BlueOcean and induce this behavior? There were no updates in the past month that could directly influence this so I'm trying to locate a possible root cause. I can note as well that there's a bunch of requests related to OpenShift yet I do not have any proof they are slowing doen the Master at this point.

Jenkins terribly slow and unresponsive --------------------------------------

Key: OVIRT-2586 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2586 Project: oVirt - virtualization made easy Issue Type: Outage Reporter: sbonazzo Assignee: Evgheni Dereveanchin Priority: Highest

Hi, jenkins is terribly slow and becoming worse every day. I tried to gain some speed by adding 4 cores to the VM through engine-phx. It's a bit better but the real issue doesn't seem related to CPU power. Can anybody investigate? -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo@redhat.com <https://red.ht/sig>

-- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)