From jira at ovirt-jira.atlassian.net Sun Nov 12 17:09:03 2017 Content-Type: multipart/mixed; boundary="===============6970668634109770255==" MIME-Version: 1.0 From: Barak Korren (oVirt JIRA) To: infra at ovirt.org Subject: [JIRA] (OVIRT-1756) configure jenkins.ovirt.org to G1 garbage collector Date: Sun, 12 Nov 2017 17:09:01 +0000 Message-ID: In-Reply-To: JIRA.33288.1510506037000@Atlassian.JIRA --===============6970668634109770255== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format... ------------=3D_1510506541-25426-133 Content-Type: text/plain; charset=3DUTF-8 Content-Transfer-Encoding: 7bit [ https://ovirt-jira.atlassian.net/browse/OVIRT-1756?page=3Dcom.atlass= ian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barak Korren updated OVIRT-1756: -------------------------------- Component/s: oVirt CI Epic Link: OVIRT-403 Issue Type: Improvement (was: By-EMAIL) > configure jenkins.ovirt.org to G1 garbage collector > --------------------------------------------------- > > Key: OVIRT-1756 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1756 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Components: oVirt CI > Reporter: rgolanbb > Assignee: infra > > I noticed jenkins process cpu consumption going over 100% and stalling the > web handlers. The io wait is not a problem nor mem. > What I suspect is going on is tons of GC and GC pressure given that 12GB > heap and fairly nice amount of users and requests. > What we can do is to configure the gc logging to see if that is really GC > pauses really and to move to using the G1 garbage collector. > See this post from cloudbees on the move to G1 collector > https://www.cloudbees.com/blog/joining-big-leagues-tuning-jenkins-gc-resp= onsiveness-and-stability -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100070) ------------=3D_1510506541-25426-133 Content-Type: text/html; charset=3D"UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit
[ https://ovirt-jira.atlassian.net/browse/OVIRT-1756?page=3Dcom.atlass=
ian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Barak Korren updated OVIRT-1756:

Component/s: oVirt CI
  Epic Link: OVIRT-403
 Issue Type: Improvement  (was: By-EMAIL)

configure jenkins.ovirt.org to G1 garbage collector

     Key: OVIRT-1756
     URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1756
 Project: oVirt - virtualization made easy
         Issue Type: Improvement
         Components: oVirt CI
Reporter: rgolanbb
Assignee: infra

I noticed jenkins process cpu consumption going over 100% and stalling t= he web handlers. The io wait is not a problem nor mem. What I suspect is go= ing on is tons of GC and GC pressure given that 12GB heap and fairly nice a= mount of users and requests. What we can do is to configure the gc logging = to see if that is really GC pauses really and to move to using the G1 garba= ge collector. See this post from cloudbees on the move to G1 collector https://www.cloudbees.com/blog/joining-big-l= eagues-tuning-jenkins-gc-responsiveness-and-stability

— This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#1000= 70)

3D"" ------------=3D_1510506541-25426-133-- --===============6970668634109770255== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4uLgoKLS0tLS0tLS0t LS0tPV8xNTEwNTA2NTQxLTI1NDI2LTEzMwpDb250ZW50LVR5cGU6IHRleHQvcGxhaW47IGNoYXJz ZXQ9VVRGLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoKCiAgICAgWyBodHRwczov L292aXJ0LWppcmEuYXRsYXNzaWFuLm5ldC9icm93c2UvT1ZJUlQtMTc1Nj9wYWdlPWNvbS5hdGxh c3NpYW4uamlyYS5wbHVnaW4uc3lzdGVtLmlzc3VldGFicGFuZWxzOmFsbC10YWJwYW5lbCBdCgpC YXJhayBLb3JyZW4gdXBkYXRlZCBPVklSVC0xNzU2OgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLQogICAgQ29tcG9uZW50L3M6IG9WaXJ0IENJCiAgICAgIEVwaWMgTGluazogT1ZJUlQt NDAzCiAgICAgSXNzdWUgVHlwZTogSW1wcm92ZW1lbnQgICh3YXM6IEJ5LUVNQUlMKQoKPiBjb25m aWd1cmUgamVua2lucy5vdmlydC5vcmcgdG8gRzEgZ2FyYmFnZSBjb2xsZWN0b3IKPiAtLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KPgo+ICAgICAgICAg ICAgICAgICBLZXk6IE9WSVJULTE3NTYKPiAgICAgICAgICAgICAgICAgVVJMOiBodHRwczovL292 aXJ0LWppcmEuYXRsYXNzaWFuLm5ldC9icm93c2UvT1ZJUlQtMTc1Ngo+ICAgICAgICAgICAgIFBy b2plY3Q6IG9WaXJ0IC0gdmlydHVhbGl6YXRpb24gbWFkZSBlYXN5Cj4gICAgICAgICAgSXNzdWUg VHlwZTogSW1wcm92ZW1lbnQKPiAgICAgICAgICBDb21wb25lbnRzOiBvVmlydCBDSQo+ICAgICAg ICAgICAgUmVwb3J0ZXI6IHJnb2xhbmJiCj4gICAgICAgICAgICBBc3NpZ25lZTogaW5mcmEKPgo+ IEkgbm90aWNlZCBqZW5raW5zIHByb2Nlc3MgY3B1IGNvbnN1bXB0aW9uIGdvaW5nIG92ZXIgMTAw JSBhbmQgc3RhbGxpbmcgdGhlCj4gd2ViIGhhbmRsZXJzLiBUaGUgaW8gd2FpdCBpcyBub3QgYSBw cm9ibGVtIG5vciBtZW0uCj4gV2hhdCBJIHN1c3BlY3QgaXMgZ29pbmcgb24gaXMgdG9ucyBvZiBH QyBhbmQgR0MgcHJlc3N1cmUgZ2l2ZW4gdGhhdCAxMkdCCj4gaGVhcCBhbmQgZmFpcmx5IG5pY2Ug YW1vdW50IG9mIHVzZXJzIGFuZCByZXF1ZXN0cy4KPiBXaGF0IHdlIGNhbiBkbyBpcyB0byBjb25m aWd1cmUgdGhlIGdjIGxvZ2dpbmcgdG8gc2VlIGlmIHRoYXQgaXMgcmVhbGx5IEdDCj4gcGF1c2Vz IHJlYWxseSBhbmQgdG8gbW92ZSB0byB1c2luZyB0aGUgRzEgZ2FyYmFnZSBjb2xsZWN0b3IuCj4g U2VlIHRoaXMgcG9zdCBmcm9tIGNsb3VkYmVlcyBvbiB0aGUgbW92ZSB0byBHMSBjb2xsZWN0b3IK PiBodHRwczovL3d3dy5jbG91ZGJlZXMuY29tL2Jsb2cvam9pbmluZy1iaWctbGVhZ3Vlcy10dW5p bmctamVua2lucy1nYy1yZXNwb25zaXZlbmVzcy1hbmQtc3RhYmlsaXR5CgoKCi0tClRoaXMgbWVz c2FnZSB3YXMgc2VudCBieSBBdGxhc3NpYW4gSmlyYQoodjEwMDEuMC4wLVNOQVBTSE9UIzEwMDA3 MCkKCi0tLS0tLS0tLS0tLT1fMTUxMDUwNjU0MS0yNTQyNi0xMzMKQ29udGVudC1UeXBlOiB0ZXh0 L2h0bWw7IGNoYXJzZXQ9IlVURi04IgpDb250ZW50LURpc3Bvc2l0aW9uOiBpbmxpbmUKQ29udGVu dC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoKPGh0bWw+PGJvZHk+CjxwcmU+WyBodHRwczovL292 aXJ0LWppcmEuYXRsYXNzaWFuLm5ldC9icm93c2UvT1ZJUlQtMTc1Nj9wYWdlPWNvbS5hdGxhc3Np YW4uamlyYS5wbHVnaW4uc3lzdGVtLmlzc3VldGFicGFuZWxzOmFsbC10YWJwYW5lbCBdPC9wcmU+ CjxoMz5CYXJhayBLb3JyZW4gdXBkYXRlZCBPVklSVC0xNzU2OjwvaDM+CjxwcmU+Q29tcG9uZW50 L3M6IG9WaXJ0IENJCiAgRXBpYyBMaW5rOiBPVklSVC00MDMKIElzc3VlIFR5cGU6IEltcHJvdmVt ZW50ICAod2FzOiBCeS1FTUFJTCk8L3ByZT4KPGJsb2NrcXVvdGU+PGgzPmNvbmZpZ3VyZSBqZW5r aW5zLm92aXJ0Lm9yZyB0byBHMSBnYXJiYWdlIGNvbGxlY3RvcjwvaDM+CjxwcmU+ICAgICBLZXk6 IE9WSVJULTE3NTYKICAgICBVUkw6IGh0dHBzOi8vb3ZpcnQtamlyYS5hdGxhc3NpYW4ubmV0L2Jy b3dzZS9PVklSVC0xNzU2CiBQcm9qZWN0OiBvVmlydCAtIHZpcnR1YWxpemF0aW9uIG1hZGUgZWFz eQogICAgICAgICBJc3N1ZSBUeXBlOiBJbXByb3ZlbWVudAogICAgICAgICBDb21wb25lbnRzOiBv VmlydCBDSQpSZXBvcnRlcjogcmdvbGFuYmIKQXNzaWduZWU6IGluZnJhPC9wcmU+CjxwPkkgbm90 aWNlZCBqZW5raW5zIHByb2Nlc3MgY3B1IGNvbnN1bXB0aW9uIGdvaW5nIG92ZXIgMTAwJSBhbmQg c3RhbGxpbmcgdGhlIHdlYiBoYW5kbGVycy4gVGhlIGlvIHdhaXQgaXMgbm90IGEgcHJvYmxlbSBu b3IgbWVtLiBXaGF0IEkgc3VzcGVjdCBpcyBnb2luZyBvbiBpcyB0b25zIG9mIEdDIGFuZCBHQyBw cmVzc3VyZSBnaXZlbiB0aGF0IDEyR0IgaGVhcCBhbmQgZmFpcmx5IG5pY2UgYW1vdW50IG9mIHVz ZXJzIGFuZCByZXF1ZXN0cy4gV2hhdCB3ZSBjYW4gZG8gaXMgdG8gY29uZmlndXJlIHRoZSBnYyBs b2dnaW5nIHRvIHNlZSBpZiB0aGF0IGlzIHJlYWxseSBHQyBwYXVzZXMgcmVhbGx5IGFuZCB0byBt b3ZlIHRvIHVzaW5nIHRoZSBHMSBnYXJiYWdlIGNvbGxlY3Rvci4gU2VlIHRoaXMgcG9zdCBmcm9t IGNsb3VkYmVlcyBvbiB0aGUgbW92ZSB0byBHMSBjb2xsZWN0b3IgPGEgaHJlZj0iaHR0cHM6Ly93 d3cuY2xvdWRiZWVzLmNvbS9ibG9nL2pvaW5pbmctYmlnLWxlYWd1ZXMtdHVuaW5nLWplbmtpbnMt Z2MtcmVzcG9uc2l2ZW5lc3MtYW5kLXN0YWJpbGl0eSI+aHR0cHM6Ly93d3cuY2xvdWRiZWVzLmNv bS9ibG9nL2pvaW5pbmctYmlnLWxlYWd1ZXMtdHVuaW5nLWplbmtpbnMtZ2MtcmVzcG9uc2l2ZW5l c3MtYW5kLXN0YWJpbGl0eTwvYT48L3A+PC9ibG9ja3F1b3RlPgo8cD4mbWRhc2g7IFRoaXMgbWVz c2FnZSB3YXMgc2VudCBieSBBdGxhc3NpYW4gSmlyYSAodjEwMDEuMC4wLVNOQVBTSE9UIzEwMDA3 MCk8L3A+Cgo8aW1nIHNyYz0iaHR0cHM6Ly91NDA0MzQwMi5jdC5zZW5kZ3JpZC5uZXQvd2Yvb3Bl bj91cG49aTVUTVdHVjk5YW1KYk54SnBTcDItMkJDbXBZTHl6WVMzcjFROTM5VDJzZ3owWk1hbVBM cGdYY1ZhZWdsVG81eWlEZlY4OU9zVjcxSGZGVzFLTVVucm4wb3B6Ump4MFRIelY2YlNpSnZwYjR1 SnBjMjUtMkZ0Zko3SkQ5SEdqanVLbi0yRlRQU2FSRHJxeDQ4aVI0ckJxUVN4ai0yRi0yQmRNcTFC MFdUUUpCUnVoOFFIZXI0YkREYmZSLTJGbGlYWnBUMWQ4Z2wyUnJYUDZ6VVBqdlpDRDctMkJQQWNz UXhBc3RyOWFYMkp5YzNuZjNjNUcxSVlrOS0yQlEtM0QiIGFsdD0iIiB3aWR0aD0iMSIgaGVpZ2h0 PSIxIiBib3JkZXI9IjAiIHN0eWxlPSJoZWlnaHQ6MXB4ICFpbXBvcnRhbnQ7d2lkdGg6MXB4ICFp bXBvcnRhbnQ7Ym9yZGVyLXdpZHRoOjAgIWltcG9ydGFudDttYXJnaW4tdG9wOjAgIWltcG9ydGFu dDttYXJnaW4tYm90dG9tOjAgIWltcG9ydGFudDttYXJnaW4tcmlnaHQ6MCAhaW1wb3J0YW50O21h cmdpbi1sZWZ0OjAgIWltcG9ydGFudDtwYWRkaW5nLXRvcDowICFpbXBvcnRhbnQ7cGFkZGluZy1i b3R0b206MCAhaW1wb3J0YW50O3BhZGRpbmctcmlnaHQ6MCAhaW1wb3J0YW50O3BhZGRpbmctbGVm dDowICFpbXBvcnRhbnQ7Ii8+CjwvYm9keT48L2h0bWw+CgotLS0tLS0tLS0tLS09XzE1MTA1MDY1 NDEtMjU0MjYtMTMzLS0K --===============6970668634109770255==--