Upgrade from 3.6 el7 job broken?

Fri Oct 14 08:24:42 UTC 2016

Hi Sandro,

This was fixed recently as we added hystrix to the respective puppet manifest:
https://gerrit.ovirt.org/#/c/65291/

I checked the failing job and it seems to be related to a single slave vm0026.
It seems to be broken (doesn't even show up in foreman so never applied 
the puppet class to install missing packages). I took it offline and will check 
what's wrong with it. Thanks for bringing this to my attention!

The jira ticket related to modifying the job and making the build part run
in mock and not rely on host packages is here:
https://ovirt-jira.atlassian.net/browse/OVIRT-616

Regards, 
Evgheni Dereveanchin 

----- Original Message -----
From: "Sandro Bonazzola" <sbonazzo at redhat.com>
To: "Roman Mohr" <rmohr at redhat.com>, "Evgheni Dereveanchin" <ederevea at redhat.com>, infra-support at ovirt.org
Cc: "infra" <infra at ovirt.org>, "devel" <devel at ovirt.org>
Sent: Friday, 14 October, 2016 9:09:10 AM
Subject: Re: Upgrade from 3.6 el7 job broken?

On Fri, Oct 14, 2016 at 8:59 AM, Roman Mohr <rmohr at redhat.com> wrote:

>
>
> On Fri, Oct 14, 2016 at 8:57 AM, Sandro Bonazzola <sbonazzo at redhat.com>
> wrote:
>
>>
>>
>> On Fri, Oct 14, 2016 at 8:48 AM, Sandro Bonazzola <sbonazzo at redhat.com>
>> wrote:
>>
>>>
>>>
>>> On Fri, Oct 14, 2016 at 8:44 AM, Roman Mohr <rmohr at redhat.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I saw a lot of failing builds lately on this job:
>>>>
>>>>   http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-fro
>>>> m-3.6_el7_created/
>>>>
>>>> One log which still exists is:
>>>>
>>>> http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-fro
>>>> m-3.6_el7_created/3666/
>>>> It seems like the BUILD ENGINE RPM step is failing, but I can't see any
>>>> reason why:
>>>>
>>>> BUILDING ENGINE RPM
>>>> + create_rpms /home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/tmp_repo/ovirt-engine-4.1.0-0.0.master.20161014001903.el7.centos.src.rpm /home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/tmp_repo .gitee47dd2
>>>> + local src_rpm=/home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/tmp_repo/ovirt-engine-4.1.0-0.0.master.20161014001903.el7.centos.src.rpm
>>>> + local dst_dir=/home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/tmp_repo
>>>> + local release=.gitee47dd2
>>>> + local workspace=/home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created
>>>> + local 'BUILD_JAVA_OPTS_MAVEN=    -XX:MaxPermSize=1G     -Dgwt.compiler.localWorkers=1 '
>>>> + local 'BUILD_JAVA_OPTS_GWT=    -XX:PermSize=512M     -XX:MaxPermSize=1G     -Xms1G     -Xmx6G '
>>>> + env 'BUILD_JAVA_OPTS_MAVEN=    -XX:MaxPermSize=1G     -Dgwt.compiler.localWorkers=1 ' 'BUILD_JAVA_OPTS_GWT=    -XX:PermSize=512M     -XX:MaxPermSize=1G     -Xms1G     -Xmx6G ' rpmbuild -D 'ovirt_build_minimal 1' -D 'release_suffix .gitee47dd2' -D 'ovirt_build_extra_flags -gs /home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/artifactory-ovirt-org-settings.xml' -D '_srcrpmdir /home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/tmp_repo' -D '_specdir /home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/tmp_repo' -D '_sourcedir /home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/tmp_repo' -D '_rpmdir /home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/tmp_repo' -D '_builddir /home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/tmp_repo' --rebuild /home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6_el7_created/tmp_repo/ovirt-engine-4.1.0-0.0.master.20161014001903.el7.centos.src.rpm
>>>> + return 1
>>>> Build step 'Execute shell' marked build as failure
>>>> Performing Post build task...
>>>> Match found for :.* : True
>>>> Logical operation result is TRUE
>>>> Running script  : #!/bin/bash -x
>>>>
>>>>
>>>> Best Regards,
>>>>
>>>>
>>>
>>> Rpmbuild fails on:
>>> error: Failed build dependencies:
>>> hystrix-core is needed by ovirt-engine-4.1.0-0.0.master.
>>> 20161014004451.git32a6f0c.el7.centos.noarch
>>> hystrix-metrics-event-stream is needed by ovirt-engine-4.1.0-0.0.master.
>>> 20161014004451.git32a6f0c.el7.centos.noarch
>>> Installing /home/jenkins/workspace/ovirt-engine_master_upgrade-from-3.6
>>> _el7_created/tmp_repo/ovirt-engine-4.1.0-0.0.master.20161014
>>> 004451.el7.centos.src.rpm
>>>
>>> I'll check why those rpms are missing.
>>>
>>
>> Looks like a temporary failure accessing EPEL repository.
>>
>>
> Hm, maybe it happens on some slaves only, but there always? Because it
> happens pretty often.
> Here is a good example:
>
> https://gerrit.ovirt.org/#/q/status:open+project:ovirt-
> engine+branch:master+topic:AuditLogableBase-inject
>
> All the broken builds are because of this. And that is just after the last
> rebase from Alon. Before that it was pretty much the same picture.
>

Found it. The job is not running in mock and is not installing build
dependencies. It just relies on the packages installed on the host.
Evgheni created several new slaves recently and seems like hystrix is
missing on them.
Evgheni can you please add hystrix-core and hystrix-metrics-event-stream to
the slave configuration?
Opening a ticket.
Thanks

>
>
>>
>>
>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>>
>>>> Roman
>>>>
>>>>
>>>> _______________________________________________
>>>> Infra mailing list
>>>> Infra at ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/infra
>>>>
>>>>
>>>
>>>
>>> --
>>> Sandro Bonazzola
>>> Better technology. Faster innovation. Powered by community collaboration.
>>> See how it works at redhat.com
>>> <https://www.redhat.com/it/about/events/red-hat-open-source-day-2016>
>>>
>>
>>
>>
>> --
>> Sandro Bonazzola
>> Better technology. Faster innovation. Powered by community collaboration.
>> See how it works at redhat.com
>> <https://www.redhat.com/it/about/events/red-hat-open-source-day-2016>
>>
>
>

-- 
Sandro Bonazzola
Better technology. Faster innovation. Powered by community collaboration.
See how it works at redhat.com
<https://www.redhat.com/it/about/events/red-hat-open-source-day-2016>