From jira at ovirt-jira.atlassian.net Sun Nov 12 17:09:23 2017 Content-Type: multipart/mixed; boundary="===============3828357518557895155==" MIME-Version: 1.0 From: Barak Korren (oVirt JIRA) To: infra at ovirt.org Subject: [JIRA] (OVIRT-1756) configure jenkins.ovirt.org to G1 garbage collector Date: Sun, 12 Nov 2017 17:09:20 +0000 Message-ID: In-Reply-To: JIRA.33288.1510506037000@Atlassian.JIRA --===============3828357518557895155== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format... ------------=3D_1510506560-11603-140 Content-Type: text/plain; charset=3DUTF-8 Content-Transfer-Encoding: 7bit [ https://ovirt-jira.atlassian.net/browse/OVIRT-1756?page=3Dcom.atlass= ian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barak Korren reassigned OVIRT-1756: ----------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > configure jenkins.ovirt.org to G1 garbage collector > --------------------------------------------------- > > Key: OVIRT-1756 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1756 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Components: oVirt CI > Reporter: rgolanbb > Assignee: Evgheni Dereveanchin > > I noticed jenkins process cpu consumption going over 100% and stalling the > web handlers. The io wait is not a problem nor mem. > What I suspect is going on is tons of GC and GC pressure given that 12GB > heap and fairly nice amount of users and requests. > What we can do is to configure the gc logging to see if that is really GC > pauses really and to move to using the G1 garbage collector. > See this post from cloudbees on the move to G1 collector > https://www.cloudbees.com/blog/joining-big-leagues-tuning-jenkins-gc-resp= onsiveness-and-stability -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100070) ------------=3D_1510506560-11603-140 Content-Type: text/html; charset=3D"UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit 
[ https://ovirt-jira.atlassian.net/browse/OVIRT-1756?page=3Dcom.atlass=
ian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Barak Korren reassigned OVIRT-1756:

Assignee: Evgheni Dereveanchin  (was: infra)

configure jenkins.ovirt.org to G1 garbage collector

     Key: OVIRT-1756
     URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1756
 Project: oVirt - virtualization made easy
         Issue Type: Improvement
         Components: oVirt CI
Reporter: rgolanbb
Assignee: Evgheni Dereveanchin

I noticed jenkins process cpu consumption going over 100% and stalling t= he web handlers. The io wait is not a problem nor mem. What I suspect is go= ing on is tons of GC and GC pressure given that 12GB heap and fairly nice a= mount of users and requests. What we can do is to configure the gc logging = to see if that is really GC pauses really and to move to using the G1 garba= ge collector. See this post from cloudbees on the move to G1 collector https://www.cloudbees.com/blog/joining-big-l= eagues-tuning-jenkins-gc-responsiveness-and-stability

— This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#1000= 70)

3D"" ------------=3D_1510506560-11603-140-- --===============3828357518557895155== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4uLgoKLS0tLS0tLS0t LS0tPV8xNTEwNTA2NTYwLTExNjAzLTE0MApDb250ZW50LVR5cGU6IHRleHQvcGxhaW47IGNoYXJz ZXQ9VVRGLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoKCiAgICAgWyBodHRwczov L292aXJ0LWppcmEuYXRsYXNzaWFuLm5ldC9icm93c2UvT1ZJUlQtMTc1Nj9wYWdlPWNvbS5hdGxh c3NpYW4uamlyYS5wbHVnaW4uc3lzdGVtLmlzc3VldGFicGFuZWxzOmFsbC10YWJwYW5lbCBdCgpC YXJhayBLb3JyZW4gcmVhc3NpZ25lZCBPVklSVC0xNzU2OgotLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLQoKICAgIEFzc2lnbmVlOiBFdmdoZW5pIERlcmV2ZWFuY2hpbiAgKHdhczog aW5mcmEpCgo+IGNvbmZpZ3VyZSBqZW5raW5zLm92aXJ0Lm9yZyB0byBHMSBnYXJiYWdlIGNvbGxl Y3Rvcgo+IC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LQo+Cj4gICAgICAgICAgICAgICAgIEtleTogT1ZJUlQtMTc1Ngo+ICAgICAgICAgICAgICAgICBV Ukw6IGh0dHBzOi8vb3ZpcnQtamlyYS5hdGxhc3NpYW4ubmV0L2Jyb3dzZS9PVklSVC0xNzU2Cj4g ICAgICAgICAgICAgUHJvamVjdDogb1ZpcnQgLSB2aXJ0dWFsaXphdGlvbiBtYWRlIGVhc3kKPiAg ICAgICAgICBJc3N1ZSBUeXBlOiBJbXByb3ZlbWVudAo+ICAgICAgICAgIENvbXBvbmVudHM6IG9W aXJ0IENJCj4gICAgICAgICAgICBSZXBvcnRlcjogcmdvbGFuYmIKPiAgICAgICAgICAgIEFzc2ln bmVlOiBFdmdoZW5pIERlcmV2ZWFuY2hpbgo+Cj4gSSBub3RpY2VkIGplbmtpbnMgcHJvY2VzcyBj cHUgY29uc3VtcHRpb24gZ29pbmcgb3ZlciAxMDAlIGFuZCBzdGFsbGluZyB0aGUKPiB3ZWIgaGFu ZGxlcnMuIFRoZSBpbyB3YWl0IGlzIG5vdCBhIHByb2JsZW0gbm9yIG1lbS4KPiBXaGF0IEkgc3Vz cGVjdCBpcyBnb2luZyBvbiBpcyB0b25zIG9mIEdDIGFuZCBHQyBwcmVzc3VyZSBnaXZlbiB0aGF0 IDEyR0IKPiBoZWFwIGFuZCBmYWlybHkgbmljZSBhbW91bnQgb2YgdXNlcnMgYW5kIHJlcXVlc3Rz Lgo+IFdoYXQgd2UgY2FuIGRvIGlzIHRvIGNvbmZpZ3VyZSB0aGUgZ2MgbG9nZ2luZyB0byBzZWUg aWYgdGhhdCBpcyByZWFsbHkgR0MKPiBwYXVzZXMgcmVhbGx5IGFuZCB0byBtb3ZlIHRvIHVzaW5n IHRoZSBHMSBnYXJiYWdlIGNvbGxlY3Rvci4KPiBTZWUgdGhpcyBwb3N0IGZyb20gY2xvdWRiZWVz IG9uIHRoZSBtb3ZlIHRvIEcxIGNvbGxlY3Rvcgo+IGh0dHBzOi8vd3d3LmNsb3VkYmVlcy5jb20v YmxvZy9qb2luaW5nLWJpZy1sZWFndWVzLXR1bmluZy1qZW5raW5zLWdjLXJlc3BvbnNpdmVuZXNz LWFuZC1zdGFiaWxpdHkKCgoKLS0KVGhpcyBtZXNzYWdlIHdhcyBzZW50IGJ5IEF0bGFzc2lhbiBK aXJhCih2MTAwMS4wLjAtU05BUFNIT1QjMTAwMDcwKQoKLS0tLS0tLS0tLS0tPV8xNTEwNTA2NTYw LTExNjAzLTE0MApDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD0iVVRGLTgiCkNvbnRl bnQtRGlzcG9zaXRpb246IGlubGluZQpDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3Yml0Cgo8 aHRtbD48Ym9keT4KPHByZT5bIGh0dHBzOi8vb3ZpcnQtamlyYS5hdGxhc3NpYW4ubmV0L2Jyb3dz ZS9PVklSVC0xNzU2P3BhZ2U9Y29tLmF0bGFzc2lhbi5qaXJhLnBsdWdpbi5zeXN0ZW0uaXNzdWV0 YWJwYW5lbHM6YWxsLXRhYnBhbmVsIF08L3ByZT4KPGgzPkJhcmFrIEtvcnJlbiByZWFzc2lnbmVk IE9WSVJULTE3NTY6PC9oMz4KPHByZT5Bc3NpZ25lZTogRXZnaGVuaSBEZXJldmVhbmNoaW4gICh3 YXM6IGluZnJhKTwvcHJlPgo8YmxvY2txdW90ZT48aDM+Y29uZmlndXJlIGplbmtpbnMub3ZpcnQu b3JnIHRvIEcxIGdhcmJhZ2UgY29sbGVjdG9yPC9oMz4KPHByZT4gICAgIEtleTogT1ZJUlQtMTc1 NgogICAgIFVSTDogaHR0cHM6Ly9vdmlydC1qaXJhLmF0bGFzc2lhbi5uZXQvYnJvd3NlL09WSVJU LTE3NTYKIFByb2plY3Q6IG9WaXJ0IC0gdmlydHVhbGl6YXRpb24gbWFkZSBlYXN5CiAgICAgICAg IElzc3VlIFR5cGU6IEltcHJvdmVtZW50CiAgICAgICAgIENvbXBvbmVudHM6IG9WaXJ0IENJClJl cG9ydGVyOiByZ29sYW5iYgpBc3NpZ25lZTogRXZnaGVuaSBEZXJldmVhbmNoaW48L3ByZT4KPHA+ SSBub3RpY2VkIGplbmtpbnMgcHJvY2VzcyBjcHUgY29uc3VtcHRpb24gZ29pbmcgb3ZlciAxMDAl IGFuZCBzdGFsbGluZyB0aGUgd2ViIGhhbmRsZXJzLiBUaGUgaW8gd2FpdCBpcyBub3QgYSBwcm9i bGVtIG5vciBtZW0uIFdoYXQgSSBzdXNwZWN0IGlzIGdvaW5nIG9uIGlzIHRvbnMgb2YgR0MgYW5k IEdDIHByZXNzdXJlIGdpdmVuIHRoYXQgMTJHQiBoZWFwIGFuZCBmYWlybHkgbmljZSBhbW91bnQg b2YgdXNlcnMgYW5kIHJlcXVlc3RzLiBXaGF0IHdlIGNhbiBkbyBpcyB0byBjb25maWd1cmUgdGhl IGdjIGxvZ2dpbmcgdG8gc2VlIGlmIHRoYXQgaXMgcmVhbGx5IEdDIHBhdXNlcyByZWFsbHkgYW5k IHRvIG1vdmUgdG8gdXNpbmcgdGhlIEcxIGdhcmJhZ2UgY29sbGVjdG9yLiBTZWUgdGhpcyBwb3N0 IGZyb20gY2xvdWRiZWVzIG9uIHRoZSBtb3ZlIHRvIEcxIGNvbGxlY3RvciA8YSBocmVmPSJodHRw czovL3d3dy5jbG91ZGJlZXMuY29tL2Jsb2cvam9pbmluZy1iaWctbGVhZ3Vlcy10dW5pbmctamVu a2lucy1nYy1yZXNwb25zaXZlbmVzcy1hbmQtc3RhYmlsaXR5Ij5odHRwczovL3d3dy5jbG91ZGJl ZXMuY29tL2Jsb2cvam9pbmluZy1iaWctbGVhZ3Vlcy10dW5pbmctamVua2lucy1nYy1yZXNwb25z aXZlbmVzcy1hbmQtc3RhYmlsaXR5PC9hPjwvcD48L2Jsb2NrcXVvdGU+CjxwPiZtZGFzaDsgVGhp cyBtZXNzYWdlIHdhcyBzZW50IGJ5IEF0bGFzc2lhbiBKaXJhICh2MTAwMS4wLjAtU05BUFNIT1Qj MTAwMDcwKTwvcD4KCjxpbWcgc3JjPSJodHRwczovL3U0MDQzNDAyLmN0LnNlbmRncmlkLm5ldC93 Zi9vcGVuP3Vwbj1pNVRNV0dWOTlhbUpiTnhKcFNwMi0yQkNtcFlMeXpZUzNyMVE5MzlUMnNnejFh SGM2WG1vMWprckc1SkIwUlNrVEFMb0czdnNsN1VPMnp2eUFaMmRBVk4tMkJiQlIxQ3FQUnItMkJt RHhqaGxuYjRHTlhOSUNJTG02NjJyeEh0dmRtUlNuR3lYYmM0ZzRjdHByV2Zqd3BhWmc5U1NWV2hw SHp4dlIyOHF4U3YzRlZOTEk3ZHJtLTJGWWlqaU1idm0xTUZwNGFja0Y2M3NaaGwtMkYtMkZZZUZD dm1IanJzdGRtOWl6azVLVXJjaVNZZ0tWTWxMUnQ4LTNEIiBhbHQ9IiIgd2lkdGg9IjEiIGhlaWdo dD0iMSIgYm9yZGVyPSIwIiBzdHlsZT0iaGVpZ2h0OjFweCAhaW1wb3J0YW50O3dpZHRoOjFweCAh aW1wb3J0YW50O2JvcmRlci13aWR0aDowICFpbXBvcnRhbnQ7bWFyZ2luLXRvcDowICFpbXBvcnRh bnQ7bWFyZ2luLWJvdHRvbTowICFpbXBvcnRhbnQ7bWFyZ2luLXJpZ2h0OjAgIWltcG9ydGFudDtt YXJnaW4tbGVmdDowICFpbXBvcnRhbnQ7cGFkZGluZy10b3A6MCAhaW1wb3J0YW50O3BhZGRpbmct Ym90dG9tOjAgIWltcG9ydGFudDtwYWRkaW5nLXJpZ2h0OjAgIWltcG9ydGFudDtwYWRkaW5nLWxl ZnQ6MCAhaW1wb3J0YW50OyIvPgo8L2JvZHk+PC9odG1sPgoKLS0tLS0tLS0tLS0tPV8xNTEwNTA2 NTYwLTExNjAzLTE0MC0tCg== --===============3828357518557895155==--