[CQ]: 88046, 11 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests

[Eyal Edri]

On Tue, Feb 27, 2018 at 2:31 PM, Dafna Ron <dron at redhat.com> wrote:

> I left the test so that I can understand why this happens :) I suspected
> it was latency but wanted to see if indeed it is.
> the failure is a storage behaviour and they do not have a way to query
> tasks statuses before re-trying the same action.
> I can disable the test until the bug is fixed, however, I am not sure if
> that would happen and the question is if the test provides more benefits
> running and failing in case there is latency (which can actually help debug
> other issues) or is the noise of this failing every month or so is worse?
>

Let's monitor it next week and if it continues to fail, we'll disable it.
But in any case, we need to make sure that the bug is prioritized and
targeted for a fix during the next oVirt milestone.


>
>
>
> On Tue, Feb 27, 2018 at 12:13 PM, Eyal Edri <eedri at redhat.com> wrote:
>
>>
>>
>> On Tue, Feb 27, 2018 at 2:08 PM, Dafna Ron <dron at redhat.com> wrote:
>>
>>> this happens randomly when there is a delay of some sorts in the OST
>>> run.
>>>
>>
>> We have to understand why it happens and if we can't, the test should be
>> disabled, we can't allow known issues to be failing every once in a while.
>> If there is an effort to debug it and understand root cause then it might
>> be worth to let it fail a few more times, otherwise I suggest to see how we
>> can disable it until the bug will be fixed.
>>
>>
>>> I did not skip since its not failing often.
>>>
>>>
>>> On Tue, Feb 27, 2018 at 11:40 AM, Eyal Edri <eedri at redhat.com> wrote:
>>>
>>>>
>>>>
>>>> On Tue, Feb 27, 2018 at 1:32 PM, Dafna Ron <dron at redhat.com> wrote:
>>>>
>>>>> it is a bug in the test suite which is reported on OST bugzilla.
>>>>>
>>>>
>>>>
>>>> Is it possible to disable the test until we get a fix for it?
>>>>
>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Tue, Feb 27, 2018 at 10:52 AM, Sandro Bonazzola <
>>>>> sbonazzo at redhat.com> wrote:
>>>>>
>>>>>>
>>>>>>
>>>>>> 2018-02-26 13:39 GMT+01:00 oVirt Jenkins <jenkins at ovirt.org>:
>>>>>>
>>>>>>> Change 88046,11 (ovirt-hosted-engine-setup) is probably the reason
>>>>>>> behind
>>>>>>> recent system test failures in the "ovirt-master" change queue and
>>>>>>> needs to be
>>>>>>> fixed.
>>>>>>>
>>>>>>
>>>>>> I don't think so. Failure is:
>>>>>>
>>>>>> Error: Fault reason is "Operation Failed". Fault detail is "[Cannot deactivate Storage while there are running tasks on this Storage.
>>>>>> -Please wait until tasks will finish and try again.]". HTTP response code is 409.
>>>>>>
>>>>>>
>>>>>> in 007_sd_reattach.deactivate_storage_domain (from nosetests)
>>>>>>
>>>>>> and sounds like a bug in the test suite not waiting for running task
>>>>>> completion before deactivating the storage.
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> This change had been removed from the testing queue. Artifacts build
>>>>>>> from this
>>>>>>> change will not be released until it is fixed.
>>>>>>>
>>>>>>> For further details about the change see:
>>>>>>> https://gerrit.ovirt.org/#/c/88046/11
>>>>>>>
>>>>>>> For failed test results see:
>>>>>>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/
>>>>>>> _______________________________________________
>>>>>>> Infra mailing list
>>>>>>> Infra at ovirt.org
>>>>>>> http://lists.ovirt.org/mailman/listinfo/infra
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> SANDRO BONAZZOLA
>>>>>>
>>>>>> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
>>>>>>
>>>>>> Red Hat EMEA <https://www.redhat.com/>
>>>>>> <https://red.ht/sig>
>>>>>> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Infra mailing list
>>>>>> Infra at ovirt.org
>>>>>> http://lists.ovirt.org/mailman/listinfo/infra
>>>>>>
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Infra mailing list
>>>>> Infra at ovirt.org
>>>>> http://lists.ovirt.org/mailman/listinfo/infra
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> Eyal edri
>>>>
>>>>
>>>> MANAGER
>>>>
>>>> RHV DevOps
>>>>
>>>> EMEA VIRTUALIZATION R&D
>>>>
>>>>
>>>> Red Hat EMEA <https://www.redhat.com/>
>>>> <https://red.ht/sig> TRIED. TESTED. TRUSTED.
>>>> <https://redhat.com/trusted>
>>>> phone: +972-9-7692018 <+972%209-769-2018>
>>>> irc: eedri (on #tlv #rhev-dev #rhev-integ)
>>>>
>>>
>>>
>>
>>
>> --
>>
>> Eyal edri
>>
>>
>> MANAGER
>>
>> RHV DevOps
>>
>> EMEA VIRTUALIZATION R&D
>>
>>
>> Red Hat EMEA <https://www.redhat.com/>
>> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>
>> phone: +972-9-7692018 <+972%209-769-2018>
>> irc: eedri (on #tlv #rhev-dev #rhev-integ)
>>
>
>


-- 

Eyal edri


MANAGER

RHV DevOps

EMEA VIRTUALIZATION R&D


Red Hat EMEA <https://www.redhat.com/>
<https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>
phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/infra/attachments/20180301/57dfd3f4/attachment-0001.html>