From jira at ovirt-jira.atlassian.net Sun Nov 12 17:09:03 2017 Content-Type: multipart/mixed; boundary="===============3120890955381027978==" MIME-Version: 1.0 From: Barak Korren (oVirt JIRA) To: infra at ovirt.org Subject: [JIRA] (OVIRT-1756) configure jenkins.ovirt.org to G1 garbage collector Date: Sun, 12 Nov 2017 17:09:00 +0000 Message-ID: In-Reply-To: JIRA.33288.1510506037000@Atlassian.JIRA --===============3120890955381027978== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format... ------------=3D_1510506540-17733-147 Content-Type: text/plain; charset=3DUTF-8 Content-Transfer-Encoding: 7bit [ https://ovirt-jira.atlassian.net/browse/OVIRT-1756?page=3Dcom.atlass= ian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barak Korren updated OVIRT-1756: -------------------------------- Epic Link: OVIRT-403 > configure jenkins.ovirt.org to G1 garbage collector > --------------------------------------------------- > > Key: OVIRT-1756 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1756 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Components: oVirt CI > Reporter: rgolanbb > Assignee: infra > > I noticed jenkins process cpu consumption going over 100% and stalling the > web handlers. The io wait is not a problem nor mem. > What I suspect is going on is tons of GC and GC pressure given that 12GB > heap and fairly nice amount of users and requests. > What we can do is to configure the gc logging to see if that is really GC > pauses really and to move to using the G1 garbage collector. > See this post from cloudbees on the move to G1 collector > https://www.cloudbees.com/blog/joining-big-leagues-tuning-jenkins-gc-resp= onsiveness-and-stability -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100070) ------------=3D_1510506540-17733-147 Content-Type: text/html; charset=3D"UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit
[ https://ovirt-jira.atlassian.net/browse/OVIRT-1756?page=3Dcom.atlass=
ian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Barak Korren updated OVIRT-1756:

Epic Link: OVIRT-403

configure jenkins.ovirt.org to G1 garbage collector

     Key: OVIRT-1756
     URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1756
 Project: oVirt - virtualization made easy
         Issue Type: By-EMAIL
         Components: oVirt CI
Reporter: rgolanbb
Assignee: infra

I noticed jenkins process cpu consumption going over 100% and stalling t= he web handlers. The io wait is not a problem nor mem. What I suspect is go= ing on is tons of GC and GC pressure given that 12GB heap and fairly nice a= mount of users and requests. What we can do is to configure the gc logging = to see if that is really GC pauses really and to move to using the G1 garba= ge collector. See this post from cloudbees on the move to G1 collector https://www.cloudbees.com/blog/joining-big-l= eagues-tuning-jenkins-gc-responsiveness-and-stability

— This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#1000= 70)

3D"" ------------=3D_1510506540-17733-147-- --===============3120890955381027978== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4uLgoKLS0tLS0tLS0t LS0tPV8xNTEwNTA2NTQwLTE3NzMzLTE0NwpDb250ZW50LVR5cGU6IHRleHQvcGxhaW47IGNoYXJz ZXQ9VVRGLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoKCiAgICAgWyBodHRwczov L292aXJ0LWppcmEuYXRsYXNzaWFuLm5ldC9icm93c2UvT1ZJUlQtMTc1Nj9wYWdlPWNvbS5hdGxh c3NpYW4uamlyYS5wbHVnaW4uc3lzdGVtLmlzc3VldGFicGFuZWxzOmFsbC10YWJwYW5lbCBdCgpC YXJhayBLb3JyZW4gdXBkYXRlZCBPVklSVC0xNzU2OgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLQogICAgRXBpYyBMaW5rOiBPVklSVC00MDMKCj4gY29uZmlndXJlIGplbmtpbnMub3Zp cnQub3JnIHRvIEcxIGdhcmJhZ2UgY29sbGVjdG9yCj4gLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCj4KPiAgICAgICAgICAgICAgICAgS2V5OiBPVklS VC0xNzU2Cj4gICAgICAgICAgICAgICAgIFVSTDogaHR0cHM6Ly9vdmlydC1qaXJhLmF0bGFzc2lh bi5uZXQvYnJvd3NlL09WSVJULTE3NTYKPiAgICAgICAgICAgICBQcm9qZWN0OiBvVmlydCAtIHZp cnR1YWxpemF0aW9uIG1hZGUgZWFzeQo+ICAgICAgICAgIElzc3VlIFR5cGU6IEJ5LUVNQUlMCj4g ICAgICAgICAgQ29tcG9uZW50czogb1ZpcnQgQ0kKPiAgICAgICAgICAgIFJlcG9ydGVyOiByZ29s YW5iYgo+ICAgICAgICAgICAgQXNzaWduZWU6IGluZnJhCj4KPiBJIG5vdGljZWQgamVua2lucyBw cm9jZXNzIGNwdSBjb25zdW1wdGlvbiBnb2luZyBvdmVyIDEwMCUgYW5kIHN0YWxsaW5nIHRoZQo+ IHdlYiBoYW5kbGVycy4gVGhlIGlvIHdhaXQgaXMgbm90IGEgcHJvYmxlbSBub3IgbWVtLgo+IFdo YXQgSSBzdXNwZWN0IGlzIGdvaW5nIG9uIGlzIHRvbnMgb2YgR0MgYW5kIEdDIHByZXNzdXJlIGdp dmVuIHRoYXQgMTJHQgo+IGhlYXAgYW5kIGZhaXJseSBuaWNlIGFtb3VudCBvZiB1c2VycyBhbmQg cmVxdWVzdHMuCj4gV2hhdCB3ZSBjYW4gZG8gaXMgdG8gY29uZmlndXJlIHRoZSBnYyBsb2dnaW5n IHRvIHNlZSBpZiB0aGF0IGlzIHJlYWxseSBHQwo+IHBhdXNlcyByZWFsbHkgYW5kIHRvIG1vdmUg dG8gdXNpbmcgdGhlIEcxIGdhcmJhZ2UgY29sbGVjdG9yLgo+IFNlZSB0aGlzIHBvc3QgZnJvbSBj bG91ZGJlZXMgb24gdGhlIG1vdmUgdG8gRzEgY29sbGVjdG9yCj4gaHR0cHM6Ly93d3cuY2xvdWRi ZWVzLmNvbS9ibG9nL2pvaW5pbmctYmlnLWxlYWd1ZXMtdHVuaW5nLWplbmtpbnMtZ2MtcmVzcG9u c2l2ZW5lc3MtYW5kLXN0YWJpbGl0eQoKCgotLQpUaGlzIG1lc3NhZ2Ugd2FzIHNlbnQgYnkgQXRs YXNzaWFuIEppcmEKKHYxMDAxLjAuMC1TTkFQU0hPVCMxMDAwNzApCgotLS0tLS0tLS0tLS09XzE1 MTA1MDY1NDAtMTc3MzMtMTQ3CkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PSJVVEYt OCIKQ29udGVudC1EaXNwb3NpdGlvbjogaW5saW5lCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6 IDdiaXQKCjxodG1sPjxib2R5Pgo8cHJlPlsgaHR0cHM6Ly9vdmlydC1qaXJhLmF0bGFzc2lhbi5u ZXQvYnJvd3NlL09WSVJULTE3NTY/cGFnZT1jb20uYXRsYXNzaWFuLmppcmEucGx1Z2luLnN5c3Rl bS5pc3N1ZXRhYnBhbmVsczphbGwtdGFicGFuZWwgXTwvcHJlPgo8aDM+QmFyYWsgS29ycmVuIHVw ZGF0ZWQgT1ZJUlQtMTc1Njo8L2gzPgo8cHJlPkVwaWMgTGluazogT1ZJUlQtNDAzPC9wcmU+Cjxi bG9ja3F1b3RlPjxoMz5jb25maWd1cmUgamVua2lucy5vdmlydC5vcmcgdG8gRzEgZ2FyYmFnZSBj b2xsZWN0b3I8L2gzPgo8cHJlPiAgICAgS2V5OiBPVklSVC0xNzU2CiAgICAgVVJMOiBodHRwczov L292aXJ0LWppcmEuYXRsYXNzaWFuLm5ldC9icm93c2UvT1ZJUlQtMTc1NgogUHJvamVjdDogb1Zp cnQgLSB2aXJ0dWFsaXphdGlvbiBtYWRlIGVhc3kKICAgICAgICAgSXNzdWUgVHlwZTogQnktRU1B SUwKICAgICAgICAgQ29tcG9uZW50czogb1ZpcnQgQ0kKUmVwb3J0ZXI6IHJnb2xhbmJiCkFzc2ln bmVlOiBpbmZyYTwvcHJlPgo8cD5JIG5vdGljZWQgamVua2lucyBwcm9jZXNzIGNwdSBjb25zdW1w dGlvbiBnb2luZyBvdmVyIDEwMCUgYW5kIHN0YWxsaW5nIHRoZSB3ZWIgaGFuZGxlcnMuIFRoZSBp byB3YWl0IGlzIG5vdCBhIHByb2JsZW0gbm9yIG1lbS4gV2hhdCBJIHN1c3BlY3QgaXMgZ29pbmcg b24gaXMgdG9ucyBvZiBHQyBhbmQgR0MgcHJlc3N1cmUgZ2l2ZW4gdGhhdCAxMkdCIGhlYXAgYW5k IGZhaXJseSBuaWNlIGFtb3VudCBvZiB1c2VycyBhbmQgcmVxdWVzdHMuIFdoYXQgd2UgY2FuIGRv IGlzIHRvIGNvbmZpZ3VyZSB0aGUgZ2MgbG9nZ2luZyB0byBzZWUgaWYgdGhhdCBpcyByZWFsbHkg R0MgcGF1c2VzIHJlYWxseSBhbmQgdG8gbW92ZSB0byB1c2luZyB0aGUgRzEgZ2FyYmFnZSBjb2xs ZWN0b3IuIFNlZSB0aGlzIHBvc3QgZnJvbSBjbG91ZGJlZXMgb24gdGhlIG1vdmUgdG8gRzEgY29s bGVjdG9yIDxhIGhyZWY9Imh0dHBzOi8vd3d3LmNsb3VkYmVlcy5jb20vYmxvZy9qb2luaW5nLWJp Zy1sZWFndWVzLXR1bmluZy1qZW5raW5zLWdjLXJlc3BvbnNpdmVuZXNzLWFuZC1zdGFiaWxpdHki Pmh0dHBzOi8vd3d3LmNsb3VkYmVlcy5jb20vYmxvZy9qb2luaW5nLWJpZy1sZWFndWVzLXR1bmlu Zy1qZW5raW5zLWdjLXJlc3BvbnNpdmVuZXNzLWFuZC1zdGFiaWxpdHk8L2E+PC9wPjwvYmxvY2tx dW90ZT4KPHA+Jm1kYXNoOyBUaGlzIG1lc3NhZ2Ugd2FzIHNlbnQgYnkgQXRsYXNzaWFuIEppcmEg KHYxMDAxLjAuMC1TTkFQU0hPVCMxMDAwNzApPC9wPgoKPGltZyBzcmM9Imh0dHBzOi8vdTQwNDM0 MDIuY3Quc2VuZGdyaWQubmV0L3dmL29wZW4/dXBuPWk1VE1XR1Y5OWFtSmJOeEpwU3AyLTJCQ21w WUx5ellTM3IxUTkzOVQyc2d6M2F4RWk0YjFwb0l2OFdrUU5JbFlPdWVhMDBJRXI3ZFF6UU9na0pT cjlmYjFiaXdsS1dIYWFiTzlqQnJoY1YyM2J4RVM2SVlpTktYTHRSZDRqQnUtMkZNNGNrOFRFRk1Y SC0yQi0yQmZGZlgzZTdQOUNOWHlvUnRoVklsa3ZzOUVJNy0yQjRjcEdzOFZPd0stMkJkMzVkSDBC VzRBLTJGUWxUbi0yQmdMS1VmSlJjcmtaOGVhZTk3Z1puRjJqYTk4Q3Z3eW5Gd3NQY2puUEVrLTNE IiBhbHQ9IiIgd2lkdGg9IjEiIGhlaWdodD0iMSIgYm9yZGVyPSIwIiBzdHlsZT0iaGVpZ2h0OjFw eCAhaW1wb3J0YW50O3dpZHRoOjFweCAhaW1wb3J0YW50O2JvcmRlci13aWR0aDowICFpbXBvcnRh bnQ7bWFyZ2luLXRvcDowICFpbXBvcnRhbnQ7bWFyZ2luLWJvdHRvbTowICFpbXBvcnRhbnQ7bWFy Z2luLXJpZ2h0OjAgIWltcG9ydGFudDttYXJnaW4tbGVmdDowICFpbXBvcnRhbnQ7cGFkZGluZy10 b3A6MCAhaW1wb3J0YW50O3BhZGRpbmctYm90dG9tOjAgIWltcG9ydGFudDtwYWRkaW5nLXJpZ2h0 OjAgIWltcG9ydGFudDtwYWRkaW5nLWxlZnQ6MCAhaW1wb3J0YW50OyIvPgo8L2JvZHk+PC9odG1s PgoKLS0tLS0tLS0tLS0tPV8xNTEwNTA2NTQwLTE3NzMzLTE0Ny0tCg== --===============3120890955381027978==--