Hi Dafna, Can you please direct me to the full test's log? *Regards,* *Shani Leviim* On Tue, May 21, 2019 at 11:57 AM Tal Nisan <tnisan@redhat.com> wrote:

Sure, Shani can you please have a look?

On Mon, May 20, 2019 at 8:30 PM Dafna Ron <dron@redhat.com> wrote:

...

Hi Tal,

I am seeing random failures for test 002_bootstrap.resize_and_refresh_storage_domain It looks like this is a timing issue since by the time we print out the error we actually see the resize succeeded. see example below:

http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/testRepo...

Can you please assign someone from the storage team to fix this test?

Thanks, Dafna

Hi Dafna If you see this failure again, please send us the link to the job. We are trying to reproduce it and find the root cause. Regards, Galit On Tue, May 21, 2019 at 5:15 PM Dafna Ron <dron@redhat.com> wrote:

sure

http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/artifact...

On Tue, May 21, 2019 at 3:04 PM Shani Leviim <sleviim@redhat.com> wrote:

...

Hi Dafna, Can you please direct me to the full test's log?

*Regards,*

*Shani Leviim*

On Tue, May 21, 2019 at 11:57 AM Tal Nisan <tnisan@redhat.com> wrote:

...

Sure, Shani can you please have a look?

On Mon, May 20, 2019 at 8:30 PM Dafna Ron <dron@redhat.com> wrote:

...

Hi Tal,

I am seeing random failures for test 002_bootstrap.resize_and_refresh_storage_domain It looks like this is a timing issue since by the time we print out the error we actually see the resize succeeded. see example below:

http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/testRepo...

Can you please assign someone from the storage team to fix this test?

Thanks, Dafna

_______________________________________________ Devel mailing list -- devel@ovirt.org To unsubscribe send an email to devel-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/P4UZJ4PWELVW2A...

-- GALIT ROSENTHAL SOFTWARE ENGINEER Red Hat <https://www.redhat.com/> galit@redhat.com T: 972-9-7692230 <https://red.ht/sig>

We didn't make any changes. I don't think retrie will help in this case we are trying to catch what cause this. If you see this again please let us know. We are still debugging it On Wed, Jun 5, 2019 at 10:56 AM Dafna Ron <dron@redhat.com> wrote:

Hi,

This is a random failure - so no, I have not. However, I looked at several failures and they are all the same, the action on engine/vdsm side succeeds and lago repots a failure but prints a success from logs. Did you add anything more to the tests to allow better debugging? Did you add a re-try to the test?

Thanks, Dafna

On Wed, Jun 5, 2019 at 8:21 AM Galit Rosenthal <grosenth@redhat.com> wrote:

...

Hi Dafna

If you see this failure again, please send us the link to the job.

We are trying to reproduce it and find the root cause.

Regards, Galit

On Tue, May 21, 2019 at 5:15 PM Dafna Ron <dron@redhat.com> wrote:

...

sure

http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/artifact...

On Tue, May 21, 2019 at 3:04 PM Shani Leviim <sleviim@redhat.com> wrote:

...

Hi Dafna, Can you please direct me to the full test's log?

*Regards,*

*Shani Leviim*

On Tue, May 21, 2019 at 11:57 AM Tal Nisan <tnisan@redhat.com> wrote:

...

Sure, Shani can you please have a look?

On Mon, May 20, 2019 at 8:30 PM Dafna Ron <dron@redhat.com> wrote:

...

Hi Tal,

I am seeing random failures for test 002_bootstrap.resize_and_refresh_storage_domain It looks like this is a timing issue since by the time we print out the error we actually see the resize succeeded. see example below:

http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/testRepo...

Can you please assign someone from the storage team to fix this test?

Thanks, Dafna

_______________________________________________ Devel mailing list -- devel@ovirt.org To unsubscribe send an email to devel-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/P4UZJ4PWELVW2A...

--

GALIT ROSENTHAL

SOFTWARE ENGINEER

Red Hat

<https://www.redhat.com/>

galit@redhat.com T: 972-9-7692230 <https://red.ht/sig>

-- GALIT ROSENTHAL SOFTWARE ENGINEER Red Hat <https://www.redhat.com/> galit@redhat.com T: 972-9-7692230 <https://red.ht/sig>

and another: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14559/ On Fri, Jun 14, 2019 at 9:05 AM Dafna Ron <dron@redhat.com> wrote:

here you go: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14561/ I pressed the save build forever button. please press the don't keep button once you get the info from the failure.

Thanks, Dafna

On Wed, Jun 5, 2019 at 9:09 AM Galit Rosenthal <grosenth@redhat.com> wrote:

...

We didn't make any changes. I don't think retrie will help in this case we are trying to catch what cause this.

If you see this again please let us know.

We are still debugging it

On Wed, Jun 5, 2019 at 10:56 AM Dafna Ron <dron@redhat.com> wrote:

...

Hi,

This is a random failure - so no, I have not. However, I looked at several failures and they are all the same, the action on engine/vdsm side succeeds and lago repots a failure but prints a success from logs. Did you add anything more to the tests to allow better debugging? Did you add a re-try to the test?

Thanks, Dafna

On Wed, Jun 5, 2019 at 8:21 AM Galit Rosenthal <grosenth@redhat.com> wrote:

...

Hi Dafna

If you see this failure again, please send us the link to the job.

We are trying to reproduce it and find the root cause.

Regards, Galit

On Tue, May 21, 2019 at 5:15 PM Dafna Ron <dron@redhat.com> wrote:

...

sure

http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/artifact...

On Tue, May 21, 2019 at 3:04 PM Shani Leviim <sleviim@redhat.com> wrote:

...

Hi Dafna, Can you please direct me to the full test's log?

*Regards,*

*Shani Leviim*

On Tue, May 21, 2019 at 11:57 AM Tal Nisan <tnisan@redhat.com> wrote:

> Sure, Shani can you please have a look? > > On Mon, May 20, 2019 at 8:30 PM Dafna Ron <dron@redhat.com> wrote: > >> Hi Tal, >> >> I am seeing random failures for test >> 002_bootstrap.resize_and_refresh_storage_domain >> It looks like this is a timing issue since by the time we print out >> the error we actually see the resize succeeded. see example below: >> >> >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/testRepo... >> >> Can you please assign someone from the storage team to fix this >> test? >> >> Thanks, >> Dafna >> >> _______________________________________________ Devel mailing list -- devel@ovirt.org To unsubscribe send an email to devel-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/P4UZJ4PWELVW2A...

--

GALIT ROSENTHAL

SOFTWARE ENGINEER

Red Hat

<https://www.redhat.com/>

galit@redhat.com T: 972-9-7692230 <https://red.ht/sig>

--

GALIT ROSENTHAL

SOFTWARE ENGINEER

Red Hat

<https://www.redhat.com/>

galit@redhat.com T: 972-9-7692230 <https://red.ht/sig>

Hi Shani, Thanks for the patch I will monitor and in case we see any further failures will let you know. Thanks again, Dafna On Sun, Jun 16, 2019 at 3:53 PM Shani Leviim <sleviim@redhat.com> wrote:

I've worked on this patch: https://gerrit.ovirt.org/#/c/100852/ Dafna, can you please try it?

*Regards,*

*Shani Leviim*

On Fri, Jun 14, 2019 at 11:07 AM Dafna Ron <dron@redhat.com> wrote:

...

and another: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14559/

On Fri, Jun 14, 2019 at 9:05 AM Dafna Ron <dron@redhat.com> wrote:

...

here you go: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14561/ I pressed the save build forever button. please press the don't keep button once you get the info from the failure.

Thanks, Dafna

On Wed, Jun 5, 2019 at 9:09 AM Galit Rosenthal <grosenth@redhat.com> wrote:

...

We didn't make any changes. I don't think retrie will help in this case we are trying to catch what cause this.

If you see this again please let us know.

We are still debugging it

On Wed, Jun 5, 2019 at 10:56 AM Dafna Ron <dron@redhat.com> wrote:

...

Hi,

This is a random failure - so no, I have not. However, I looked at several failures and they are all the same, the action on engine/vdsm side succeeds and lago repots a failure but prints a success from logs. Did you add anything more to the tests to allow better debugging? Did you add a re-try to the test?

Thanks, Dafna

On Wed, Jun 5, 2019 at 8:21 AM Galit Rosenthal <grosenth@redhat.com> wrote:

...

Hi Dafna

If you see this failure again, please send us the link to the job.

We are trying to reproduce it and find the root cause.

Regards, Galit

On Tue, May 21, 2019 at 5:15 PM Dafna Ron <dron@redhat.com> wrote:

> sure > > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/artifact... > > > On Tue, May 21, 2019 at 3:04 PM Shani Leviim <sleviim@redhat.com> > wrote: > >> Hi Dafna, >> Can you please direct me to the full test's log? >> >> >> *Regards,* >> >> *Shani Leviim* >> >> >> On Tue, May 21, 2019 at 11:57 AM Tal Nisan <tnisan@redhat.com> >> wrote: >> >>> Sure, Shani can you please have a look? >>> >>> On Mon, May 20, 2019 at 8:30 PM Dafna Ron <dron@redhat.com> wrote: >>> >>>> Hi Tal, >>>> >>>> I am seeing random failures for test >>>> 002_bootstrap.resize_and_refresh_storage_domain >>>> It looks like this is a timing issue since by the time we print >>>> out the error we actually see the resize succeeded. see example below: >>>> >>>> >>>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/testRepo... >>>> >>>> Can you please assign someone from the storage team to fix this >>>> test? >>>> >>>> Thanks, >>>> Dafna >>>> >>>> _______________________________________________ > Devel mailing list -- devel@ovirt.org > To unsubscribe send an email to devel-leave@ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/devel@ovirt.org/message/P4UZJ4PWELVW2A... >

--

GALIT ROSENTHAL

SOFTWARE ENGINEER

Red Hat

<https://www.redhat.com/>

galit@redhat.com T: 972-9-7692230 <https://red.ht/sig>

--

GALIT ROSENTHAL

SOFTWARE ENGINEER

Red Hat

<https://www.redhat.com/>

galit@redhat.com T: 972-9-7692230 <https://red.ht/sig>

Hi Dafna, A patch for backporting was done: https://gerrit.ovirt.org/#/c/101113/ Waiting for merging it. *Regards,* *Shani Leviim* On Mon, Jun 24, 2019 at 11:17 AM Dafna Ron <dron@redhat.com> wrote:

Hi Shani and Tal,

Can you backport this to 4.3 as well? we had a failure on 4.3 for same issue but not for master.

Thanks, Dafna

On Thu, Jun 20, 2019 at 3:39 PM Dafna Ron <dron@redhat.com> wrote:

...

Hi Shani,

Thanks for the patch I will monitor and in case we see any further failures will let you know.

Thanks again, Dafna

On Sun, Jun 16, 2019 at 3:53 PM Shani Leviim <sleviim@redhat.com> wrote:

...

I've worked on this patch: https://gerrit.ovirt.org/#/c/100852/ Dafna, can you please try it?

*Regards,*

*Shani Leviim*

On Fri, Jun 14, 2019 at 11:07 AM Dafna Ron <dron@redhat.com> wrote:

...

and another: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14559/

On Fri, Jun 14, 2019 at 9:05 AM Dafna Ron <dron@redhat.com> wrote:

...

here you go: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14561/ I pressed the save build forever button. please press the don't keep button once you get the info from the failure.

Thanks, Dafna

On Wed, Jun 5, 2019 at 9:09 AM Galit Rosenthal <grosenth@redhat.com> wrote:

...

We didn't make any changes. I don't think retrie will help in this case we are trying to catch what cause this.

If you see this again please let us know.

We are still debugging it

On Wed, Jun 5, 2019 at 10:56 AM Dafna Ron <dron@redhat.com> wrote:

> Hi, > > This is a random failure - so no, I have not. > However, I looked at several failures and they are all the same, the > action on engine/vdsm side succeeds and lago repots a failure but prints a > success from logs. > Did you add anything more to the tests to allow better debugging? > Did you add a re-try to the test? > > Thanks, > Dafna > > > > On Wed, Jun 5, 2019 at 8:21 AM Galit Rosenthal <grosenth@redhat.com> > wrote: > >> Hi Dafna >> >> If you see this failure again, please send us the link to the job. >> >> We are trying to reproduce it and find the root cause. >> >> Regards, >> Galit >> >> On Tue, May 21, 2019 at 5:15 PM Dafna Ron <dron@redhat.com> wrote: >> >>> sure >>> >>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/artifact... >>> >>> >>> On Tue, May 21, 2019 at 3:04 PM Shani Leviim <sleviim@redhat.com> >>> wrote: >>> >>>> Hi Dafna, >>>> Can you please direct me to the full test's log? >>>> >>>> >>>> *Regards,* >>>> >>>> *Shani Leviim* >>>> >>>> >>>> On Tue, May 21, 2019 at 11:57 AM Tal Nisan <tnisan@redhat.com> >>>> wrote: >>>> >>>>> Sure, Shani can you please have a look? >>>>> >>>>> On Mon, May 20, 2019 at 8:30 PM Dafna Ron <dron@redhat.com> >>>>> wrote: >>>>> >>>>>> Hi Tal, >>>>>> >>>>>> I am seeing random failures for test >>>>>> 002_bootstrap.resize_and_refresh_storage_domain >>>>>> It looks like this is a timing issue since by the time we print >>>>>> out the error we actually see the resize succeeded. see example below: >>>>>> >>>>>> >>>>>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/testRepo... >>>>>> >>>>>> Can you please assign someone from the storage team to fix this >>>>>> test? >>>>>> >>>>>> Thanks, >>>>>> Dafna >>>>>> >>>>>> _______________________________________________ >>> Devel mailing list -- devel@ovirt.org >>> To unsubscribe send an email to devel-leave@ovirt.org >>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct: >>> https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: >>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/P4UZJ4PWELVW2A... >>> >> >> >> -- >> >> GALIT ROSENTHAL >> >> SOFTWARE ENGINEER >> >> Red Hat >> >> <https://www.redhat.com/> >> >> galit@redhat.com T: 972-9-7692230 >> <https://red.ht/sig> >> >

--

GALIT ROSENTHAL

SOFTWARE ENGINEER

Red Hat

<https://www.redhat.com/>

galit@redhat.com T: 972-9-7692230 <https://red.ht/sig>

It was already merged and will be included from ovirt-engine-4.3.5.2. *Regards,* *Shani Leviim* On Mon, Jul 1, 2019 at 3:47 PM Dafna Ron <dron@redhat.com> wrote:

Thanks Shani. Tal, any updates on merging this?

On Mon, Jun 24, 2019 at 2:18 PM Shani Leviim <sleviim@redhat.com> wrote:

...

Hi Dafna, A patch for backporting was done: https://gerrit.ovirt.org/#/c/101113/ Waiting for merging it.

*Regards,*

*Shani Leviim*

On Mon, Jun 24, 2019 at 11:17 AM Dafna Ron <dron@redhat.com> wrote:

...

Hi Shani and Tal,

Can you backport this to 4.3 as well? we had a failure on 4.3 for same issue but not for master.

Thanks, Dafna

On Thu, Jun 20, 2019 at 3:39 PM Dafna Ron <dron@redhat.com> wrote:

...

Hi Shani,

Thanks for the patch I will monitor and in case we see any further failures will let you know.

Thanks again, Dafna

On Sun, Jun 16, 2019 at 3:53 PM Shani Leviim <sleviim@redhat.com> wrote:

...

I've worked on this patch: https://gerrit.ovirt.org/#/c/100852/ Dafna, can you please try it?

*Regards,*

*Shani Leviim*

On Fri, Jun 14, 2019 at 11:07 AM Dafna Ron <dron@redhat.com> wrote:

...

and another: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14559/

On Fri, Jun 14, 2019 at 9:05 AM Dafna Ron <dron@redhat.com> wrote:

> here you go: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14561/ > I pressed the save build forever button. please press the don't keep > button once you get the info from the failure. > > Thanks, > Dafna > > > On Wed, Jun 5, 2019 at 9:09 AM Galit Rosenthal <grosenth@redhat.com> > wrote: > >> We didn't make any changes. >> I don't think retrie will help in this case >> we are trying to catch what cause this. >> >> If you see this again please let us know. >> >> We are still debugging it >> >> On Wed, Jun 5, 2019 at 10:56 AM Dafna Ron <dron@redhat.com> wrote: >> >>> Hi, >>> >>> This is a random failure - so no, I have not. >>> However, I looked at several failures and they are all the same, >>> the action on engine/vdsm side succeeds and lago repots a failure but >>> prints a success from logs. >>> Did you add anything more to the tests to allow better debugging? >>> Did you add a re-try to the test? >>> >>> Thanks, >>> Dafna >>> >>> >>> >>> On Wed, Jun 5, 2019 at 8:21 AM Galit Rosenthal < >>> grosenth@redhat.com> wrote: >>> >>>> Hi Dafna >>>> >>>> If you see this failure again, please send us the link to the job. >>>> >>>> We are trying to reproduce it and find the root cause. >>>> >>>> Regards, >>>> Galit >>>> >>>> On Tue, May 21, 2019 at 5:15 PM Dafna Ron <dron@redhat.com> >>>> wrote: >>>> >>>>> sure >>>>> >>>>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/artifact... >>>>> >>>>> >>>>> On Tue, May 21, 2019 at 3:04 PM Shani Leviim <sleviim@redhat.com> >>>>> wrote: >>>>> >>>>>> Hi Dafna, >>>>>> Can you please direct me to the full test's log? >>>>>> >>>>>> >>>>>> *Regards,* >>>>>> >>>>>> *Shani Leviim* >>>>>> >>>>>> >>>>>> On Tue, May 21, 2019 at 11:57 AM Tal Nisan <tnisan@redhat.com> >>>>>> wrote: >>>>>> >>>>>>> Sure, Shani can you please have a look? >>>>>>> >>>>>>> On Mon, May 20, 2019 at 8:30 PM Dafna Ron <dron@redhat.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Tal, >>>>>>>> >>>>>>>> I am seeing random failures for test >>>>>>>> 002_bootstrap.resize_and_refresh_storage_domain >>>>>>>> It looks like this is a timing issue since by the time we >>>>>>>> print out the error we actually see the resize succeeded. see example >>>>>>>> below: >>>>>>>> >>>>>>>> >>>>>>>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14185/testRepo... >>>>>>>> >>>>>>>> Can you please assign someone from the storage team to fix >>>>>>>> this test? >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Dafna >>>>>>>> >>>>>>>> _______________________________________________ >>>>> Devel mailing list -- devel@ovirt.org >>>>> To unsubscribe send an email to devel-leave@ovirt.org >>>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>>> oVirt Code of Conduct: >>>>> https://www.ovirt.org/community/about/community-guidelines/ >>>>> List Archives: >>>>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/P4UZJ4PWELVW2A... >>>>> >>>> >>>> >>>> -- >>>> >>>> GALIT ROSENTHAL >>>> >>>> SOFTWARE ENGINEER >>>> >>>> Red Hat >>>> >>>> <https://www.redhat.com/> >>>> >>>> galit@redhat.com T: 972-9-7692230 >>>> <https://red.ht/sig> >>>> >>> >> >> -- >> >> GALIT ROSENTHAL >> >> SOFTWARE ENGINEER >> >> Red Hat >> >> <https://www.redhat.com/> >> >> galit@redhat.com T: 972-9-7692230 >> <https://red.ht/sig> >> >