<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Jan 10, 2016 at 9:26 AM, Yedidyah Bar David <span dir="ltr"><<a href="mailto:didi@redhat.com" target="_blank">didi@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">On Fri, Jan 8, 2016 at 4:23 PM, Eyal Edri <<a href="mailto:eedri@redhat.com">eedri@redhat.com</a>> wrote:<br>
> Cleanup issue? Sandro/Simone - can you look?<br>
><br>
> topi.plugins.ovirt_engine_remove.base.core.misc misc._setup:90 Could not<br>
> detect a completed product setup<br>
> 2016-01-06 20:18:05 DEBUG otopi.plugins.otopi.dialog.human<br>
> dialog.__logString:219 DIALOG:SEND Please use the cleanup<br>
> utility only after a setup or after an upgrade from an older installation.<br>
> 2016-01-06 20:18:05 DEBUG otopi.context context._executeMethod:156 method<br>
> exception<br>
> Traceback (most recent call last):<br>
> File "/usr/lib/python2.6/site-packages/otopi/context.py", line 146, in<br>
> _executeMethod<br>
> method['method']()<br>
> File<br>
> "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-remove/base/core/misc.py",<br>
> line 102, in _setup<br>
> _('Could not detect product setup')<br>
<br>
</span>This is just what it says - cleanup doing nothing because it didn't<br>
find a setup.<br>
Most likely due to a failed setup in a previous job.<br>
Should be ignored.<br>
Note that in 3.6, we can easily identify if this was the reason for a failure<br>
and not something else, based on the exit code, see [1].<br>
Other exit codes are defined as EXIT_CODE_* constants, currently<br>
around [2] and [3].<br>
We might add more in the future, including in other places (such as<br>
dwh/reports).<br>
<br>
[1] <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1079726" rel="noreferrer" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1079726</a><br>
[2] <a href="https://gerrit.ovirt.org/gitweb?p=otopi.git;a=blob;f=src/otopi/constants.py;hb=HEAD#l84" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/gitweb?p=otopi.git;a=blob;f=src/otopi/constants.py;hb=HEAD#l84</a><br>
[3] <a href="https://gerrit.ovirt.org/gitweb?p=ovirt-engine.git;a=blob;f=packaging/setup/ovirt_engine_setup/constants.py;hb=HEAD#l267" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/gitweb?p=ovirt-engine.git;a=blob;f=packaging/setup/ovirt_engine_setup/constants.py;hb=HEAD#l267</a><br>
<br>
Some other comments:<br>
<span class=""><br>
> On Thu, Jan 7, 2016 at 6:37 PM, Allon Mureinik <<a href="mailto:amureini@redhat.com">amureini@redhat.com</a>> wrote:<br>
>><br>
>> Not the foggiest.<br>
>> But this job seems to be failing intermittently regardless of those<br>
>> patches.<br>
<br>
</span>A later run of this job 748 succeeded.<br>
<br>
The specific failure was likely due to rpmdb corruption:<br>
<br>
Rpmdb checksum is invalid: dCDPT(pkg checksums): ovirt-engine.noarch<br>
0:3.6.3-0.0.master.20160105173810.git7421257.el6 - u<br>
<br>
IMO we should try harder to:<br>
1. Uniquely mark the point at which a job decided that it failed,<br>
inside the output, so<br>
that it's easy to find, and easy to ignore unrelated error messages.<br>
2. Once we do that, add some of the preceding text directly to the<br>
message sent by mail and added in gerrit.<br></blockquote><div><br></div><div><br></div><div>The RPMDB corruption is a known bug still open on rpm in Bugzilla.</div><div>It happens because we install/remove numerous times the same packages without reinstalling the VM,</div><div>For now we have a script that will rebuild the rpmdb each run, but going forward the job will move to</div><div>Lago and run on an isolated new vm on each run.</div><div><br></div><div>E.</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div><div class="h5"><br>
>><br>
>> On Wed, Jan 6, 2016 at 10:18 PM, <<a href="mailto:jenkins@ovirt.org">jenkins@ovirt.org</a>> wrote:<br>
>>><br>
>>> Project:<br>
>>> <a href="http://jenkins.ovirt.org/job/ovirt-engine_3.6_upgrade-from-3.6_el6_merged/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/ovirt-engine_3.6_upgrade-from-3.6_el6_merged/</a><br>
>>> Build:<br>
>>> <a href="http://jenkins.ovirt.org/job/ovirt-engine_3.6_upgrade-from-3.6_el6_merged/741/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/ovirt-engine_3.6_upgrade-from-3.6_el6_merged/741/</a><br>
>>> Build Number: 741<br>
>>> Build Status: Still Failing<br>
>>> Triggered By: Triggered by Gerrit: <a href="https://gerrit.ovirt.org/51401" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/51401</a><br>
>>><br>
>>> -------------------------------------<br>
>>> Changes Since Last Success:<br>
>>> -------------------------------------<br>
>>> Changes for Build #735<br>
>>> [Maor Lipchuk] core: Refactor call back of CloneSingleCinderDisk<br>
>>><br>
>>><br>
>>> Changes for Build #736<br>
>>> [Maor Lipchuk] core: CoCo revert tasks of clone Cinder disks.<br>
>>><br>
>>><br>
>>> Changes for Build #737<br>
>>> [Maor Lipchuk] core: Add callback for create VM from Template with<br>
>>> Cinder.<br>
>>><br>
>>><br>
>>> Changes for Build #738<br>
>>> [Maor Lipchuk] core: Call concurrent execution callback on add vm<br>
>>> command.<br>
>>><br>
>>><br>
>>> Changes for Build #739<br>
>>> [Maor Lipchuk] core: CoCo, prevent using removeFromHirerchy on callback.<br>
>>><br>
>>><br>
>>> Changes for Build #740<br>
>>> [Maor Lipchuk] core: Lock VM should not be done on revert tasks<br>
>>><br>
>>><br>
>>> Changes for Build #741<br>
>>> [Maor Lipchuk] core: Filter out child Cinder commands on end action.<br>
>>><br>
>>><br>
>>><br>
>>><br>
>>> -----------------<br>
>>> Failed Tests:<br>
>>> -----------------<br>
>>> No tests ran.<br>
>>><br>
>>><br>
>>> _______________________________________________<br>
>>> Infra mailing list<br>
>>> <a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
>>> <a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/infra</a><br>
>>><br>
>><br>
>><br>
>> _______________________________________________<br>
>> Infra mailing list<br>
>> <a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
>> <a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/infra</a><br>
>><br>
><br>
><br>
><br>
> --<br>
> Eyal Edri<br>
> Associate Manager<br>
> EMEA ENG Virtualization R&D<br>
> Red Hat Israel<br>
><br>
> phone: <a href="tel:%2B972-9-7692018" value="+97297692018">+972-9-7692018</a><br>
> irc: eedri (on #tlv #rhev-dev #rhev-integ)<br>
><br>
> _______________________________________________<br>
> Infra mailing list<br>
> <a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
> <a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/infra</a><br>
><br>
<br>
<br>
<br>
--<br>
</div></div>Didi<br>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div>Eyal Edri<br>Associate Manager<br>EMEA ENG Virtualization R&D<br>Red Hat Israel<br><br>phone: +972-9-7692018<br>irc: eedri (on #tlv #rhev-dev #rhev-integ)</div></div></div>
</div></div>