From jira at ovirt-jira.atlassian.net Tue Nov 7 07:51:29 2017 Content-Type: multipart/mixed; boundary="===============6935122113023266284==" MIME-Version: 1.0 From: Barak Korren (oVirt JIRA) To: infra at ovirt.org Subject: [JIRA] (OVIRT-1744) Revisit build artifact storage and retnesion Date: Tue, 07 Nov 2017 07:51:28 +0000 Message-ID: In-Reply-To: JIRA.33276.1510041086000@Atlassian.JIRA --===============6935122113023266284== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format... ------------=3D_1510041088-29267-458 Content-Type: text/plain; charset=3DUTF-8 Content-Transfer-Encoding: 7bit Barak Korren created OVIRT-1744: ----------------------------------- Summary: Revisit build artifact storage and retnesion Key: OVIRT-1744 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1744 Project: oVirt - virtualization made easy Issue Type: New Feature Components: Repositories Mgmt Reporter: Barak Korren Assignee: infra Priority: Highest We need to revisit how we store and manage build artifacts in our environme= nt. We need to do this to reach several goals: # Stop having to frequently deal with running out of space on the Jenkins s= erver # Stop having to frequently deal with running out of space on the Resources= server # Make Jenkins load faster # Make publishing of artifacts faster (If can take up to 20m to publish to = 'tested' ATM) # Make it so that finding artifacts is possible without knowing the exact d= etails of the job that made them is possible. We would like to be able to f= ind artifacts by at least: #* Knowing the build URL in Jenkins #* Knowing the STDCI stage/project/branch/distro/arch/git hash combination. #* Asking for STDCI stage/project/branch/distro/arch/latest artifact We need to achieve the above without significantly harming the UX we provid= e. For example, users should still be able to find artifacts by navigating = from links posted to Gerrit/GitHub to the Jenkins job result pages. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100070) ------------=3D_1510041088-29267-458 Content-Type: text/html; charset=3D"UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit

Barak Korren created OVIRT-1744:

   Summary: Revisit build artifact storage and retnesion
       Key: OVIRT-1744
       URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1744
   Project: oVirt - virtualization made easy
Issue Type: New Feature
Components: Repositories Mgmt
  Reporter: Barak Korren
  Assignee: infra
  Priority: Highest

We need to revisit how we store and manage build artifacts in our enviro= nment.

We need to do this to reach several goals: # Stop having to frequently d= eal with running out of space on the Jenkins server # Stop having to freque= ntly deal with running out of space on the Resources server # Make Jenkins = load faster # Make publishing of artifacts faster (If can take up to 20m to= publish to ‘tested’ ATM) # Make it so that finding artifacts i= s possible without knowing the exact details of the job that made them is p= ossible. We would like to be able to find artifacts by at least: #* Knowing= the build URL in Jenkins #* Knowing the STDCI stage/project/branch/distro/= arch/git hash combination. #* Asking for STDCI stage/project/branch/distro/= arch/latest artifact

We need to achieve the above without significantly harming the UX we pro= vide. For example, users should still be able to find artifacts by navigati= ng from links posted to Gerrit/GitHub to the Jenkins job result pages.

— This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#1000= 70)

=3D"" ------------=3D_1510041088-29267-458-- --===============6935122113023266284== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4uLgoKLS0tLS0tLS0t LS0tPV8xNTEwMDQxMDg4LTI5MjY3LTQ1OApDb250ZW50LVR5cGU6IHRleHQvcGxhaW47IGNoYXJz ZXQ9VVRGLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoKQmFyYWsgS29ycmVuIGNy ZWF0ZWQgT1ZJUlQtMTc0NDoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCiAg ICAgICAgICAgICBTdW1tYXJ5OiBSZXZpc2l0IGJ1aWxkIGFydGlmYWN0IHN0b3JhZ2UgYW5kIHJl dG5lc2lvbgogICAgICAgICAgICAgICAgIEtleTogT1ZJUlQtMTc0NAogICAgICAgICAgICAgICAg IFVSTDogaHR0cHM6Ly9vdmlydC1qaXJhLmF0bGFzc2lhbi5uZXQvYnJvd3NlL09WSVJULTE3NDQK ICAgICAgICAgICAgIFByb2plY3Q6IG9WaXJ0IC0gdmlydHVhbGl6YXRpb24gbWFkZSBlYXN5CiAg ICAgICAgICBJc3N1ZSBUeXBlOiBOZXcgRmVhdHVyZQogICAgICAgICAgQ29tcG9uZW50czogUmVw b3NpdG9yaWVzIE1nbXQKICAgICAgICAgICAgUmVwb3J0ZXI6IEJhcmFrIEtvcnJlbgogICAgICAg ICAgICBBc3NpZ25lZTogaW5mcmEKICAgICAgICAgICAgUHJpb3JpdHk6IEhpZ2hlc3QKCgpXZSBu ZWVkIHRvIHJldmlzaXQgaG93IHdlIHN0b3JlIGFuZCBtYW5hZ2UgYnVpbGQgYXJ0aWZhY3RzIGlu IG91ciBlbnZpcm9ubWVudC4KCldlIG5lZWQgdG8gZG8gdGhpcyB0byByZWFjaCBzZXZlcmFsIGdv YWxzOgojIFN0b3AgaGF2aW5nIHRvIGZyZXF1ZW50bHkgZGVhbCB3aXRoIHJ1bm5pbmcgb3V0IG9m IHNwYWNlIG9uIHRoZSBKZW5raW5zIHNlcnZlcgojIFN0b3AgaGF2aW5nIHRvIGZyZXF1ZW50bHkg ZGVhbCB3aXRoIHJ1bm5pbmcgb3V0IG9mIHNwYWNlIG9uIHRoZSBSZXNvdXJjZXMgc2VydmVyCiMg TWFrZSBKZW5raW5zIGxvYWQgZmFzdGVyCiMgTWFrZSBwdWJsaXNoaW5nIG9mIGFydGlmYWN0cyBm YXN0ZXIgKElmIGNhbiB0YWtlIHVwIHRvIDIwbSB0byBwdWJsaXNoIHRvICd0ZXN0ZWQnIEFUTSkK IyBNYWtlIGl0IHNvIHRoYXQgZmluZGluZyBhcnRpZmFjdHMgaXMgcG9zc2libGUgd2l0aG91dCBr bm93aW5nIHRoZSBleGFjdCBkZXRhaWxzIG9mIHRoZSBqb2IgdGhhdCBtYWRlIHRoZW0gaXMgcG9z c2libGUuIFdlIHdvdWxkIGxpa2UgdG8gYmUgYWJsZSB0byBmaW5kIGFydGlmYWN0cyBieSBhdCBs ZWFzdDoKIyogS25vd2luZyB0aGUgYnVpbGQgVVJMIGluIEplbmtpbnMKIyogS25vd2luZyB0aGUg U1REQ0kgc3RhZ2UvcHJvamVjdC9icmFuY2gvZGlzdHJvL2FyY2gvZ2l0IGhhc2ggY29tYmluYXRp b24uCiMqIEFza2luZyBmb3IgU1REQ0kgc3RhZ2UvcHJvamVjdC9icmFuY2gvZGlzdHJvL2FyY2gv bGF0ZXN0IGFydGlmYWN0CgpXZSBuZWVkIHRvIGFjaGlldmUgdGhlIGFib3ZlIHdpdGhvdXQgc2ln bmlmaWNhbnRseSBoYXJtaW5nIHRoZSBVWCB3ZSBwcm92aWRlLiBGb3IgZXhhbXBsZSwgdXNlcnMg c2hvdWxkIHN0aWxsIGJlIGFibGUgdG8gZmluZCBhcnRpZmFjdHMgYnkgbmF2aWdhdGluZyBmcm9t IGxpbmtzIHBvc3RlZCB0byBHZXJyaXQvR2l0SHViIHRvIHRoZSBKZW5raW5zIGpvYiByZXN1bHQg cGFnZXMuCgoKCi0tClRoaXMgbWVzc2FnZSB3YXMgc2VudCBieSBBdGxhc3NpYW4gSmlyYQoodjEw MDEuMC4wLVNOQVBTSE9UIzEwMDA3MCkKCi0tLS0tLS0tLS0tLT1fMTUxMDA0MTA4OC0yOTI2Ny00 NTgKQ29udGVudC1UeXBlOiB0ZXh0L2h0bWw7IGNoYXJzZXQ9IlVURi04IgpDb250ZW50LURpc3Bv c2l0aW9uOiBpbmxpbmUKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoKPGh0bWw+PGJv ZHk+CjxoMz5CYXJhayBLb3JyZW4gY3JlYXRlZCBPVklSVC0xNzQ0OjwvaDM+CjxwcmU+ICAgU3Vt bWFyeTogUmV2aXNpdCBidWlsZCBhcnRpZmFjdCBzdG9yYWdlIGFuZCByZXRuZXNpb24KICAgICAg IEtleTogT1ZJUlQtMTc0NAogICAgICAgVVJMOiBodHRwczovL292aXJ0LWppcmEuYXRsYXNzaWFu Lm5ldC9icm93c2UvT1ZJUlQtMTc0NAogICBQcm9qZWN0OiBvVmlydCAtIHZpcnR1YWxpemF0aW9u IG1hZGUgZWFzeQpJc3N1ZSBUeXBlOiBOZXcgRmVhdHVyZQpDb21wb25lbnRzOiBSZXBvc2l0b3Jp ZXMgTWdtdAogIFJlcG9ydGVyOiBCYXJhayBLb3JyZW4KICBBc3NpZ25lZTogaW5mcmEKICBQcmlv cml0eTogSGlnaGVzdDwvcHJlPgo8cD5XZSBuZWVkIHRvIHJldmlzaXQgaG93IHdlIHN0b3JlIGFu ZCBtYW5hZ2UgYnVpbGQgYXJ0aWZhY3RzIGluIG91ciBlbnZpcm9ubWVudC48L3A+CjxwPldlIG5l ZWQgdG8gZG8gdGhpcyB0byByZWFjaCBzZXZlcmFsIGdvYWxzOiAjIFN0b3AgaGF2aW5nIHRvIGZy ZXF1ZW50bHkgZGVhbCB3aXRoIHJ1bm5pbmcgb3V0IG9mIHNwYWNlIG9uIHRoZSBKZW5raW5zIHNl cnZlciAjIFN0b3AgaGF2aW5nIHRvIGZyZXF1ZW50bHkgZGVhbCB3aXRoIHJ1bm5pbmcgb3V0IG9m IHNwYWNlIG9uIHRoZSBSZXNvdXJjZXMgc2VydmVyICMgTWFrZSBKZW5raW5zIGxvYWQgZmFzdGVy ICMgTWFrZSBwdWJsaXNoaW5nIG9mIGFydGlmYWN0cyBmYXN0ZXIgKElmIGNhbiB0YWtlIHVwIHRv IDIwbSB0byBwdWJsaXNoIHRvICZsc3F1bzt0ZXN0ZWQmcnNxdW87IEFUTSkgIyBNYWtlIGl0IHNv IHRoYXQgZmluZGluZyBhcnRpZmFjdHMgaXMgcG9zc2libGUgd2l0aG91dCBrbm93aW5nIHRoZSBl eGFjdCBkZXRhaWxzIG9mIHRoZSBqb2IgdGhhdCBtYWRlIHRoZW0gaXMgcG9zc2libGUuIFdlIHdv dWxkIGxpa2UgdG8gYmUgYWJsZSB0byBmaW5kIGFydGlmYWN0cyBieSBhdCBsZWFzdDogIyogS25v d2luZyB0aGUgYnVpbGQgVVJMIGluIEplbmtpbnMgIyogS25vd2luZyB0aGUgU1REQ0kgc3RhZ2Uv cHJvamVjdC9icmFuY2gvZGlzdHJvL2FyY2gvZ2l0IGhhc2ggY29tYmluYXRpb24uICMqIEFza2lu ZyBmb3IgU1REQ0kgc3RhZ2UvcHJvamVjdC9icmFuY2gvZGlzdHJvL2FyY2gvbGF0ZXN0IGFydGlm YWN0PC9wPgo8cD5XZSBuZWVkIHRvIGFjaGlldmUgdGhlIGFib3ZlIHdpdGhvdXQgc2lnbmlmaWNh bnRseSBoYXJtaW5nIHRoZSBVWCB3ZSBwcm92aWRlLiBGb3IgZXhhbXBsZSwgdXNlcnMgc2hvdWxk IHN0aWxsIGJlIGFibGUgdG8gZmluZCBhcnRpZmFjdHMgYnkgbmF2aWdhdGluZyBmcm9tIGxpbmtz IHBvc3RlZCB0byBHZXJyaXQvR2l0SHViIHRvIHRoZSBKZW5raW5zIGpvYiByZXN1bHQgcGFnZXMu PC9wPgo8cD4mbWRhc2g7IFRoaXMgbWVzc2FnZSB3YXMgc2VudCBieSBBdGxhc3NpYW4gSmlyYSAo djEwMDEuMC4wLVNOQVBTSE9UIzEwMDA3MCk8L3A+Cgo8aW1nIHNyYz0iaHR0cHM6Ly91NDA0MzQw Mi5jdC5zZW5kZ3JpZC5uZXQvd2Yvb3Blbj91cG49aTVUTVdHVjk5YW1KYk54SnBTcDItMkJDbXBZ THl6WVMzcjFROTM5VDJzZ3oxaHFqajltZkpZVENjeHBNbkVnaS0yQklRa2JLTEo0Q3dXQmp3VWUt MkJQZHBBYndGLTJCMlhPclpTa2l3VTFJOThCTXRMMkpHQTRaY0s1TFVGc1doQi0yQjI5b2xNbm1D MXo4UFFBOEkwWUJOZlF2UGI1VlFPMzdNbDRYMThwRUJaMldnZnFlWng0Zm9ZSFlYLTJCbzI5N2Qw UDh2dG5yRVlKLTJCZk4tMkZtSURwYUQ2WUczekRTOFEtM0QtM0QiIGFsdD0iIiB3aWR0aD0iMSIg aGVpZ2h0PSIxIiBib3JkZXI9IjAiIHN0eWxlPSJoZWlnaHQ6MXB4ICFpbXBvcnRhbnQ7d2lkdGg6 MXB4ICFpbXBvcnRhbnQ7Ym9yZGVyLXdpZHRoOjAgIWltcG9ydGFudDttYXJnaW4tdG9wOjAgIWlt cG9ydGFudDttYXJnaW4tYm90dG9tOjAgIWltcG9ydGFudDttYXJnaW4tcmlnaHQ6MCAhaW1wb3J0 YW50O21hcmdpbi1sZWZ0OjAgIWltcG9ydGFudDtwYWRkaW5nLXRvcDowICFpbXBvcnRhbnQ7cGFk ZGluZy1ib3R0b206MCAhaW1wb3J0YW50O3BhZGRpbmctcmlnaHQ6MCAhaW1wb3J0YW50O3BhZGRp bmctbGVmdDowICFpbXBvcnRhbnQ7Ii8+CjwvYm9keT48L2h0bWw+CgotLS0tLS0tLS0tLS09XzE1 MTAwNDEwODgtMjkyNjctNDU4LS0K --===============6935122113023266284==--