From jira at ovirt-jira.atlassian.net Tue Nov 7 08:17:37 2017 Content-Type: multipart/mixed; boundary="===============7300243582258561592==" MIME-Version: 1.0 From: Barak Korren (oVirt JIRA) To: infra at ovirt.org Subject: [JIRA] (OVIRT-1744) Revisit build artifact storage and retenesion Date: Tue, 07 Nov 2017 08:17:36 +0000 Message-ID: In-Reply-To: JIRA.33276.1510041086000@Atlassian.JIRA --===============7300243582258561592== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format... ------------=3D_1510042656-11287-520 Content-Type: text/plain; charset=3DUTF-8 Content-Transfer-Encoding: 7bit [ https://ovirt-jira.atlassian.net/browse/OVIRT-1744?page=3Dcom.atlass= ian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barak Korren updated OVIRT-1744: -------------------------------- Summary: Revisit build artifact storage and retenesion (was: Revisit b= uild artifact storage and retnesion) > Revisit build artifact storage and retenesion > --------------------------------------------- > > Key: OVIRT-1744 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1744 > Project: oVirt - virtualization made easy > Issue Type: New Feature > Components: Repositories Mgmt > Reporter: Barak Korren > Assignee: infra > Priority: Highest > Labels: artifacts, repositories > > We need to revisit how we store and manage build artifacts in our environ= ment. > We need to do this to reach several goals: > # Stop having to frequently deal with running out of space on the Jenkins= server > # Stop having to frequently deal with running out of space on the Resourc= es server > # Make Jenkins load faster > # Make publishing of artifacts faster (If can take up to 20m to publish t= o 'tested' ATM) > # Make it so that finding artifacts is possible without knowing the exact= details of the job that made them. We would like to be able to find artifa= cts by at least: > #* Knowing the build URL in Jenkins > #* Knowing the STDCI stage/project/branch/distro/arch/git hash combinatio= n. > #* Asking for STDCI stage/project/branch/distro/arch/latest artifact > We need to achieve the above without significantly harming the UX we prov= ide. For example, users should still be able to find artifacts by navigatin= g from links posted to Gerrit/GitHub to the Jenkins job result pages. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100070) ------------=3D_1510042656-11287-520 Content-Type: text/html; charset=3D"UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit 
[ https://ovirt-jira.atlassian.net/browse/OVIRT-1744?page=3Dcom.atlass=
ian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Barak Korren updated OVIRT-1744:

Summary: Revisit build artifact storage and retenesion  (was: Revisit =
build artifact storage and retnesion)

Revisit build artifact storage and retenesion

     Key: OVIRT-1744
     URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1744
 Project: oVirt - virtualization made easy
         Issue Type: New Feature
         Components: Repositories Mgmt
Reporter: Barak Korren
Assignee: infra
Priority: Highest
  Labels: artifacts, repositories

We need to revisit how we store and manage build artifacts in our enviro= nment. We need to do this to reach several goals: # Stop having to frequent= ly deal with running out of space on the Jenkins server # Stop having to fr= equently deal with running out of space on the Resources server # Make Jenk= ins load faster # Make publishing of artifacts faster (If can take up to 20= m to publish to ‘tested’ ATM) # Make it so that finding artifac= ts is possible without knowing the exact details of the job that made them.= We would like to be able to find artifacts by at least: #* Knowing the bui= ld URL in Jenkins #* Knowing the STDCI stage/project/branch/distro/arch/git= hash combination. #* Asking for STDCI stage/project/branch/distro/arch/lat= est artifact We need to achieve the above without significantly harming the= UX we provide. For example, users should still be able to find artifacts b= y navigating from links posted to Gerrit/GitHub to the Jenkins job result p= ages.

— This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#1000= 70)

3D"" ------------=3D_1510042656-11287-520-- --===============7300243582258561592== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4uLgoKLS0tLS0tLS0t LS0tPV8xNTEwMDQyNjU2LTExMjg3LTUyMApDb250ZW50LVR5cGU6IHRleHQvcGxhaW47IGNoYXJz ZXQ9VVRGLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoKCiAgICAgWyBodHRwczov L292aXJ0LWppcmEuYXRsYXNzaWFuLm5ldC9icm93c2UvT1ZJUlQtMTc0ND9wYWdlPWNvbS5hdGxh c3NpYW4uamlyYS5wbHVnaW4uc3lzdGVtLmlzc3VldGFicGFuZWxzOmFsbC10YWJwYW5lbCBdCgpC YXJhayBLb3JyZW4gdXBkYXRlZCBPVklSVC0xNzQ0OgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLQogICAgU3VtbWFyeTogUmV2aXNpdCBidWlsZCBhcnRpZmFjdCBzdG9yYWdlIGFuZCBy ZXRlbmVzaW9uICAod2FzOiBSZXZpc2l0IGJ1aWxkIGFydGlmYWN0IHN0b3JhZ2UgYW5kIHJldG5l c2lvbikKCj4gUmV2aXNpdCBidWlsZCBhcnRpZmFjdCBzdG9yYWdlIGFuZCByZXRlbmVzaW9uCj4g LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCj4KPiAgICAgICAg ICAgICAgICAgS2V5OiBPVklSVC0xNzQ0Cj4gICAgICAgICAgICAgICAgIFVSTDogaHR0cHM6Ly9v dmlydC1qaXJhLmF0bGFzc2lhbi5uZXQvYnJvd3NlL09WSVJULTE3NDQKPiAgICAgICAgICAgICBQ cm9qZWN0OiBvVmlydCAtIHZpcnR1YWxpemF0aW9uIG1hZGUgZWFzeQo+ICAgICAgICAgIElzc3Vl IFR5cGU6IE5ldyBGZWF0dXJlCj4gICAgICAgICAgQ29tcG9uZW50czogUmVwb3NpdG9yaWVzIE1n bXQKPiAgICAgICAgICAgIFJlcG9ydGVyOiBCYXJhayBLb3JyZW4KPiAgICAgICAgICAgIEFzc2ln bmVlOiBpbmZyYQo+ICAgICAgICAgICAgUHJpb3JpdHk6IEhpZ2hlc3QKPiAgICAgICAgICAgICAg TGFiZWxzOiBhcnRpZmFjdHMsIHJlcG9zaXRvcmllcwo+Cj4gV2UgbmVlZCB0byByZXZpc2l0IGhv dyB3ZSBzdG9yZSBhbmQgbWFuYWdlIGJ1aWxkIGFydGlmYWN0cyBpbiBvdXIgZW52aXJvbm1lbnQu Cj4gV2UgbmVlZCB0byBkbyB0aGlzIHRvIHJlYWNoIHNldmVyYWwgZ29hbHM6Cj4gIyBTdG9wIGhh dmluZyB0byBmcmVxdWVudGx5IGRlYWwgd2l0aCBydW5uaW5nIG91dCBvZiBzcGFjZSBvbiB0aGUg SmVua2lucyBzZXJ2ZXIKPiAjIFN0b3AgaGF2aW5nIHRvIGZyZXF1ZW50bHkgZGVhbCB3aXRoIHJ1 bm5pbmcgb3V0IG9mIHNwYWNlIG9uIHRoZSBSZXNvdXJjZXMgc2VydmVyCj4gIyBNYWtlIEplbmtp bnMgbG9hZCBmYXN0ZXIKPiAjIE1ha2UgcHVibGlzaGluZyBvZiBhcnRpZmFjdHMgZmFzdGVyIChJ ZiBjYW4gdGFrZSB1cCB0byAyMG0gdG8gcHVibGlzaCB0byAndGVzdGVkJyBBVE0pCj4gIyBNYWtl IGl0IHNvIHRoYXQgZmluZGluZyBhcnRpZmFjdHMgaXMgcG9zc2libGUgd2l0aG91dCBrbm93aW5n IHRoZSBleGFjdCBkZXRhaWxzIG9mIHRoZSBqb2IgdGhhdCBtYWRlIHRoZW0uIFdlIHdvdWxkIGxp a2UgdG8gYmUgYWJsZSB0byBmaW5kIGFydGlmYWN0cyBieSBhdCBsZWFzdDoKPiAjKiBLbm93aW5n IHRoZSBidWlsZCBVUkwgaW4gSmVua2lucwo+ICMqIEtub3dpbmcgdGhlIFNURENJIHN0YWdlL3By b2plY3QvYnJhbmNoL2Rpc3Ryby9hcmNoL2dpdCBoYXNoIGNvbWJpbmF0aW9uLgo+ICMqIEFza2lu ZyBmb3IgU1REQ0kgc3RhZ2UvcHJvamVjdC9icmFuY2gvZGlzdHJvL2FyY2gvbGF0ZXN0IGFydGlm YWN0Cj4gV2UgbmVlZCB0byBhY2hpZXZlIHRoZSBhYm92ZSB3aXRob3V0IHNpZ25pZmljYW50bHkg aGFybWluZyB0aGUgVVggd2UgcHJvdmlkZS4gRm9yIGV4YW1wbGUsIHVzZXJzIHNob3VsZCBzdGls bCBiZSBhYmxlIHRvIGZpbmQgYXJ0aWZhY3RzIGJ5IG5hdmlnYXRpbmcgZnJvbSBsaW5rcyBwb3N0 ZWQgdG8gR2Vycml0L0dpdEh1YiB0byB0aGUgSmVua2lucyBqb2IgcmVzdWx0IHBhZ2VzLgoKCgot LQpUaGlzIG1lc3NhZ2Ugd2FzIHNlbnQgYnkgQXRsYXNzaWFuIEppcmEKKHYxMDAxLjAuMC1TTkFQ U0hPVCMxMDAwNzApCgotLS0tLS0tLS0tLS09XzE1MTAwNDI2NTYtMTEyODctNTIwCkNvbnRlbnQt VHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PSJVVEYtOCIKQ29udGVudC1EaXNwb3NpdGlvbjogaW5s aW5lCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQKCjxodG1sPjxib2R5Pgo8cHJlPlsg aHR0cHM6Ly9vdmlydC1qaXJhLmF0bGFzc2lhbi5uZXQvYnJvd3NlL09WSVJULTE3NDQ/cGFnZT1j b20uYXRsYXNzaWFuLmppcmEucGx1Z2luLnN5c3RlbS5pc3N1ZXRhYnBhbmVsczphbGwtdGFicGFu ZWwgXTwvcHJlPgo8aDM+QmFyYWsgS29ycmVuIHVwZGF0ZWQgT1ZJUlQtMTc0NDo8L2gzPgo8cHJl PlN1bW1hcnk6IFJldmlzaXQgYnVpbGQgYXJ0aWZhY3Qgc3RvcmFnZSBhbmQgcmV0ZW5lc2lvbiAg KHdhczogUmV2aXNpdCBidWlsZCBhcnRpZmFjdCBzdG9yYWdlIGFuZCByZXRuZXNpb24pPC9wcmU+ CjxibG9ja3F1b3RlPjxoMz5SZXZpc2l0IGJ1aWxkIGFydGlmYWN0IHN0b3JhZ2UgYW5kIHJldGVu ZXNpb248L2gzPgo8cHJlPiAgICAgS2V5OiBPVklSVC0xNzQ0CiAgICAgVVJMOiBodHRwczovL292 aXJ0LWppcmEuYXRsYXNzaWFuLm5ldC9icm93c2UvT1ZJUlQtMTc0NAogUHJvamVjdDogb1ZpcnQg LSB2aXJ0dWFsaXphdGlvbiBtYWRlIGVhc3kKICAgICAgICAgSXNzdWUgVHlwZTogTmV3IEZlYXR1 cmUKICAgICAgICAgQ29tcG9uZW50czogUmVwb3NpdG9yaWVzIE1nbXQKUmVwb3J0ZXI6IEJhcmFr IEtvcnJlbgpBc3NpZ25lZTogaW5mcmEKUHJpb3JpdHk6IEhpZ2hlc3QKICBMYWJlbHM6IGFydGlm YWN0cywgcmVwb3NpdG9yaWVzPC9wcmU+CjxwPldlIG5lZWQgdG8gcmV2aXNpdCBob3cgd2Ugc3Rv cmUgYW5kIG1hbmFnZSBidWlsZCBhcnRpZmFjdHMgaW4gb3VyIGVudmlyb25tZW50LiBXZSBuZWVk IHRvIGRvIHRoaXMgdG8gcmVhY2ggc2V2ZXJhbCBnb2FsczogIyBTdG9wIGhhdmluZyB0byBmcmVx dWVudGx5IGRlYWwgd2l0aCBydW5uaW5nIG91dCBvZiBzcGFjZSBvbiB0aGUgSmVua2lucyBzZXJ2 ZXIgIyBTdG9wIGhhdmluZyB0byBmcmVxdWVudGx5IGRlYWwgd2l0aCBydW5uaW5nIG91dCBvZiBz cGFjZSBvbiB0aGUgUmVzb3VyY2VzIHNlcnZlciAjIE1ha2UgSmVua2lucyBsb2FkIGZhc3RlciAj IE1ha2UgcHVibGlzaGluZyBvZiBhcnRpZmFjdHMgZmFzdGVyIChJZiBjYW4gdGFrZSB1cCB0byAy MG0gdG8gcHVibGlzaCB0byAmbHNxdW87dGVzdGVkJnJzcXVvOyBBVE0pICMgTWFrZSBpdCBzbyB0 aGF0IGZpbmRpbmcgYXJ0aWZhY3RzIGlzIHBvc3NpYmxlIHdpdGhvdXQga25vd2luZyB0aGUgZXhh Y3QgZGV0YWlscyBvZiB0aGUgam9iIHRoYXQgbWFkZSB0aGVtLiBXZSB3b3VsZCBsaWtlIHRvIGJl IGFibGUgdG8gZmluZCBhcnRpZmFjdHMgYnkgYXQgbGVhc3Q6ICMqIEtub3dpbmcgdGhlIGJ1aWxk IFVSTCBpbiBKZW5raW5zICMqIEtub3dpbmcgdGhlIFNURENJIHN0YWdlL3Byb2plY3QvYnJhbmNo L2Rpc3Ryby9hcmNoL2dpdCBoYXNoIGNvbWJpbmF0aW9uLiAjKiBBc2tpbmcgZm9yIFNURENJIHN0 YWdlL3Byb2plY3QvYnJhbmNoL2Rpc3Ryby9hcmNoL2xhdGVzdCBhcnRpZmFjdCBXZSBuZWVkIHRv IGFjaGlldmUgdGhlIGFib3ZlIHdpdGhvdXQgc2lnbmlmaWNhbnRseSBoYXJtaW5nIHRoZSBVWCB3 ZSBwcm92aWRlLiBGb3IgZXhhbXBsZSwgdXNlcnMgc2hvdWxkIHN0aWxsIGJlIGFibGUgdG8gZmlu ZCBhcnRpZmFjdHMgYnkgbmF2aWdhdGluZyBmcm9tIGxpbmtzIHBvc3RlZCB0byBHZXJyaXQvR2l0 SHViIHRvIHRoZSBKZW5raW5zIGpvYiByZXN1bHQgcGFnZXMuPC9wPjwvYmxvY2txdW90ZT4KPHA+ Jm1kYXNoOyBUaGlzIG1lc3NhZ2Ugd2FzIHNlbnQgYnkgQXRsYXNzaWFuIEppcmEgKHYxMDAxLjAu MC1TTkFQU0hPVCMxMDAwNzApPC9wPgoKPGltZyBzcmM9Imh0dHBzOi8vdTQwNDM0MDIuY3Quc2Vu ZGdyaWQubmV0L3dmL29wZW4/dXBuPWk1VE1XR1Y5OWFtSmJOeEpwU3AyLTJCQ21wWUx5ellTM3Ix UTkzOVQyc2d6MlM4SXM1REp3WWxoUXh6NkxmZklnSDVaalpmZExHSnlPckp3Y2ZZYy0yRkZqcDh0 UFhLLTJCT2JWdnZWRTNCbTNFUkRIWkRCVUFsRWo4b2Zud015Z2oxLTJCMks3UDE2WUhWLTJGd2R1 VkNwSzhyc2lXSVpzdGV5U0pmSi0yQmJEMGtEc21jcS0yQjZzZmhEYWxvZmFmbjZqd0NiNjd0dzct MkJGOXg0WURaQUFHR2E1Q3h0d20wZGd2b1ZvWG90M2RZVG53MkphQTV3YkNrLTNEIiBhbHQ9IiIg d2lkdGg9IjEiIGhlaWdodD0iMSIgYm9yZGVyPSIwIiBzdHlsZT0iaGVpZ2h0OjFweCAhaW1wb3J0 YW50O3dpZHRoOjFweCAhaW1wb3J0YW50O2JvcmRlci13aWR0aDowICFpbXBvcnRhbnQ7bWFyZ2lu LXRvcDowICFpbXBvcnRhbnQ7bWFyZ2luLWJvdHRvbTowICFpbXBvcnRhbnQ7bWFyZ2luLXJpZ2h0 OjAgIWltcG9ydGFudDttYXJnaW4tbGVmdDowICFpbXBvcnRhbnQ7cGFkZGluZy10b3A6MCAhaW1w b3J0YW50O3BhZGRpbmctYm90dG9tOjAgIWltcG9ydGFudDtwYWRkaW5nLXJpZ2h0OjAgIWltcG9y dGFudDtwYWRkaW5nLWxlZnQ6MCAhaW1wb3J0YW50OyIvPgo8L2JvZHk+PC9odG1sPgoKLS0tLS0t LS0tLS0tPV8xNTEwMDQyNjU2LTExMjg3LTUyMC0tCg== --===============7300243582258561592==--