November 2020 - Infra - oVirt List Archives

oVirt infra daily report - unstable production jobs - 1374
by jenkins＠jenkins.phx.ovirt.org 14 Nov '20

14 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1374//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 572 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Nov '20

13 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 572 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #572 [Shani Leviim] basic_sanity: add test for creating a floating disk ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.004_basic_sanity.test_live_storage_migration Error Message: AssertionError: False != True after 600 seconds Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7f64d503d610> @order_by(_TEST_LIST) def test_live_storage_migration(engine_api): engine = engine_api.system_service() disk_service = test_utils.get_disk_service(engine, DISK0_NAME) correlation_id = 'live_storage_migration' disk_service.move( async=False, filter=False, storage_domain=types.StorageDomain( name=SD_ISCSI_NAME ), query={'correlation_id': correlation_id} ) assertions.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id)) # Assert that the disk is on the correct storage domain, # its status is OK and the snapshot created for the migration # has been merged assertions.assert_true_within_long( > lambda: engine_api.follow_link(disk_service.get().storage_domains[0]).name == SD_ISCSI_NAME ) ../basic-suite-master/test-scenarios/004_basic_sanity.py:608: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../ost_utils/ost_utils/assertions.py:98: in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) ../ost_utils/ost_utils/assertions.py:83: in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ func = <function <lambda> at 0x7f64cec23050>, value = True, timeout = 600 allowed_exceptions = [], initial_wait = 0 error_message = 'False != True after 600 seconds' def assert_equals_within( func, value, timeout, allowed_exceptions=None, initial_wait=10, error_message=None ): allowed_exceptions = allowed_exceptions or [] res = '<no-result-obtained>' with _EggTimer(timeout) as timer: while not timer.elapsed(): try: res = func() if res == value: return except Exception as exc: if _instance_of_any(exc, allowed_exceptions): time.sleep(3) continue LOGGER.exception("Unhandled exception in %s", func) raise if initial_wait == 0: time.sleep(3) else: time.sleep(initial_wait) initial_wait = 0 try: if error_message is None: error_message = '%s != %s after %s seconds' % (res, value, timeout) > raise AssertionError(error_message) E AssertionError: False != True after 600 seconds ../ost_utils/ost_utils/assertions.py:61: AssertionError

1 5

oVirt infra daily report - unstable production jobs - 1373
by jenkins＠jenkins.phx.ovirt.org 13 Nov '20

13 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1373//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3058) OST check-patch jobs are stuck on archive artifacts stage
by Amit Bawer (oVirt JIRA) 12 Nov '20

12 Nov '20

Amit Bawer created OVIRT-3058: --------------------------------- Summary: OST check-patch jobs are stuck on archive artifacts stage Key: OVIRT-3058 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3058 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Amit Bawer Assignee: infra Hi, Exemplified here, started last night and still hasn't finished archiving: https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13195… Thanks. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100150)

1 0

[JIRA] (OVIRT-3057) Re: [ovirt-devel] OST check-patch jobs are stuck on archive artifacts stage
by Amit Bawer (oVirt JIRA) 12 Nov '20

12 Nov '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3057?page=com.atlassian.jira.… ] Amit Bawer commented on OVIRT-3057: ----------------------------------- Thanks. Maybe the jobs is starved? Is it last comes first served basis in the CI queue? On Sun, Nov 8, 2020 at 1:57 PM Ehud Yonasi <eyonasi(a)redhat.com> wrote: > Hi, > > The 2 remaining jobs are waiting for el8 host to be available and > currently there are only 3 of those, so it's creating a bottleneck. > > Regards, > Ehud. > > On Sun, Nov 8, 2020 at 12:46 PM Amit Bawer <abawer(a)redhat.com> wrote: > >> Hi, >> >> Exemplified here, started last night and still hasn't finished archiving: >> >> https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13195… >> >> Thanks. >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/privacy-policy.html >> oVirt Code of Conduct: >> https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: >> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/WDOYYLFSE3NCV… >> > > Re: [ovirt-devel] OST check-patch jobs are stuck on archive artifacts stage > --------------------------------------------------------------------------- > > Key: OVIRT-3057 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3057 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Ehud Yonasi > Assignee: infra > > Hi, > The 2 remaining jobs are waiting for el8 host to be available and currently > there are only 3 of those, so it's creating a bottleneck. > Regards, > Ehud. > On Sun, Nov 8, 2020 at 12:46 PM Amit Bawer <abawer(a)redhat.com> wrote: > > Hi, > > > > Exemplified here, started last night and still hasn't finished archiving: > > > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13195… > > > > Thanks. > > _______________________________________________ > > Devel mailing list -- devel(a)ovirt.org > > To unsubscribe send an email to devel-leave(a)ovirt.org > > Privacy Statement: https://www.ovirt.org/privacy-policy.html > > oVirt Code of Conduct: > > https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: > > https://lists.ovirt.org/archives/list/devel@ovirt.org/message/WDOYYLFSE3NCV… > > -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100150)

1 0

[JIRA] (OVIRT-3057) Re: [ovirt-devel] OST check-patch jobs are stuck on archive artifacts stage
by Ehud Yonasi (oVirt JIRA) 12 Nov '20

12 Nov '20

Ehud Yonasi created OVIRT-3057: ---------------------------------- Summary: Re: [ovirt-devel] OST check-patch jobs are stuck on archive artifacts stage Key: OVIRT-3057 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3057 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Ehud Yonasi Assignee: infra Hi, The 2 remaining jobs are waiting for el8 host to be available and currently there are only 3 of those, so it's creating a bottleneck. Regards, Ehud. On Sun, Nov 8, 2020 at 12:46 PM Amit Bawer <abawer(a)redhat.com> wrote: > Hi, > > Exemplified here, started last night and still hasn't finished archiving: > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13195… > > Thanks. > _______________________________________________ > Devel mailing list -- devel(a)ovirt.org > To unsubscribe send an email to devel-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/devel@ovirt.org/message/WDOYYLFSE3NCV… > -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100150)

1 0

[JIRA] (OVIRT-3056) Re: check patch does not create artifacts and seems to hang
by Ehud Yonasi (oVirt JIRA) 12 Nov '20

12 Nov '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3056?page=com.atlassian.jira.… ] Ehud Yonasi commented on OVIRT-3056: ------------------------------------ I see it now, it was waiting for el8 bare metal. I don’t think we have one atm in CI. We will have in the future for sure though. I’ve stopped the job for now. > On 6 Nov 2020, at 9:16, Eitan Raviv <eraviv(a)redhat.com> wrote: > > It does not look like a queue problem. The jobs started very quickly but [1] but they do not terminate. [1] has been running for 21 hours now. > > > [1] https://gerrit.ovirt.org/#/c/112087/ <https://gerrit.ovirt.org/#/c/112087/> > On Thu, Nov 5, 2020 at 7:24 PM Ehud Yonasi <eyonasi(a)redhat.com <mailto:eyonasi@redhat.com>> wrote: > Thanks for reporting, > > I see there are only 4 containers running atm which is low, @Evgheni Dereveanchin <mailto:ederevea@redhat.com> @Shlomi Zidmi <mailto:szidmi@redhat.com> can you please check the hosts in openshift? > we should be able to run ~40 at the same time. > > Regards, > Ehud. > > On Thu, Nov 5, 2020 at 4:21 PM Eitan Raviv <eraviv(a)redhat.com <mailto:eraviv@redhat.com>> wrote: > Looks like more hanging jobs: [1] has been running for 5 hours (only waited 1 minute in queue) > > [1] https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13110/ <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13110/> > > thanks > > On Wed, Nov 4, 2020 at 7:50 PM Eitan Raviv <eraviv(a)redhat.com <mailto:eraviv@redhat.com>> wrote: > Hi, > IIUC check-patch [1] has failed but there are no artifacts and check-patch [2] seems to hang for some hours. > > Could you please have a look? > Thanks > > [1] https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/12989/ <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/12989/> > [2] https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13034/ <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13034/> > Re: check patch does not create artifacts and seems to hang > ----------------------------------------------------------- > > Key: OVIRT-3056 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3056 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Eitan Raviv > Assignee: infra > > Looks like more hanging jobs: [1] has been running for 5 hours (only waited > 1 minute in queue) > [1] > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13110/ > thanks > On Wed, Nov 4, 2020 at 7:50 PM Eitan Raviv <eraviv(a)redhat.com> wrote: > > Hi, > > IIUC check-patch [1] has failed but there are no artifacts and check-patch > > [2] seems to hang for some hours. > > > > Could you please have a look? > > Thanks > > > > [1] > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/12989/ > > [2] > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13034/ > > -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100150)

1 0

[JIRA] (OVIRT-3056) Re: check patch does not create artifacts and seems to hang
by Eitan Raviv (oVirt JIRA) 12 Nov '20

12 Nov '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3056?page=com.atlassian.jira.… ] Eitan Raviv commented on OVIRT-3056: ------------------------------------ It does not look like a queue problem. The jobs started very quickly but [1] but they do not terminate. [1] has been running for 21 hours now. [1] https://gerrit.ovirt.org/#/c/112087/ On Thu, Nov 5, 2020 at 7:24 PM Ehud Yonasi <eyonasi(a)redhat.com> wrote: > Thanks for reporting, > > I see there are only 4 containers running atm which is low, @Evgheni > Dereveanchin <ederevea(a)redhat.com> @Shlomi Zidmi <szidmi(a)redhat.com> can > you please check the hosts in openshift? > we should be able to run ~40 at the same time. > > Regards, > Ehud. > > On Thu, Nov 5, 2020 at 4:21 PM Eitan Raviv <eraviv(a)redhat.com> wrote: > >> Looks like more hanging jobs: [1] has been running for 5 hours (only >> waited 1 minute in queue) >> >> [1] >> https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13110/ >> >> thanks >> >> On Wed, Nov 4, 2020 at 7:50 PM Eitan Raviv <eraviv(a)redhat.com> wrote: >> >>> Hi, >>> IIUC check-patch [1] has failed but there are no artifacts and >>> check-patch [2] seems to hang for some hours. >>> >>> Could you please have a look? >>> Thanks >>> >>> [1] >>> https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/12989/ >>> [2] >>> https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13034/ >>> >> > Re: check patch does not create artifacts and seems to hang > ----------------------------------------------------------- > > Key: OVIRT-3056 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3056 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Eitan Raviv > Assignee: infra > > Looks like more hanging jobs: [1] has been running for 5 hours (only waited > 1 minute in queue) > [1] > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13110/ > thanks > On Wed, Nov 4, 2020 at 7:50 PM Eitan Raviv <eraviv(a)redhat.com> wrote: > > Hi, > > IIUC check-patch [1] has failed but there are no artifacts and check-patch > > [2] seems to hang for some hours. > > > > Could you please have a look? > > Thanks > > > > [1] > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/12989/ > > [2] > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13034/ > > -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100150)

1 0

[JIRA] (OVIRT-3056) Re: check patch does not create artifacts and seems to hang
by Ehud Yonasi (oVirt JIRA) 12 Nov '20

12 Nov '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3056?page=com.atlassian.jira.… ] Ehud Yonasi commented on OVIRT-3056: ------------------------------------ Thanks for reporting, I see there are only 4 containers running atm which is low, @Evgheni Dereveanchin <ederevea(a)redhat.com> @Shlomi Zidmi <szidmi(a)redhat.com> can you please check the hosts in openshift? we should be able to run ~40 at the same time. Regards, Ehud. On Thu, Nov 5, 2020 at 4:21 PM Eitan Raviv <eraviv(a)redhat.com> wrote: > Looks like more hanging jobs: [1] has been running for 5 hours (only > waited 1 minute in queue) > > [1] > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13110/ > > thanks > > On Wed, Nov 4, 2020 at 7:50 PM Eitan Raviv <eraviv(a)redhat.com> wrote: > >> Hi, >> IIUC check-patch [1] has failed but there are no artifacts and >> check-patch [2] seems to hang for some hours. >> >> Could you please have a look? >> Thanks >> >> [1] >> https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/12989/ >> [2] >> https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13034/ >> > > Re: check patch does not create artifacts and seems to hang > ----------------------------------------------------------- > > Key: OVIRT-3056 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3056 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Eitan Raviv > Assignee: infra > > Looks like more hanging jobs: [1] has been running for 5 hours (only waited > 1 minute in queue) > [1] > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13110/ > thanks > On Wed, Nov 4, 2020 at 7:50 PM Eitan Raviv <eraviv(a)redhat.com> wrote: > > Hi, > > IIUC check-patch [1] has failed but there are no artifacts and check-patch > > [2] seems to hang for some hours. > > > > Could you please have a look? > > Thanks > > > > [1] > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/12989/ > > [2] > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13034/ > > -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100150)

1 0

[JIRA] (OVIRT-3056) Re: check patch does not create artifacts and seems to hang
by Eitan Raviv (oVirt JIRA) 12 Nov '20

12 Nov '20

Eitan Raviv created OVIRT-3056: ---------------------------------- Summary: Re: check patch does not create artifacts and seems to hang Key: OVIRT-3056 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3056 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Eitan Raviv Assignee: infra Looks like more hanging jobs: [1] has been running for 5 hours (only waited 1 minute in queue) [1] https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13110/ thanks On Wed, Nov 4, 2020 at 7:50 PM Eitan Raviv <eraviv(a)redhat.com> wrote: > Hi, > IIUC check-patch [1] has failed but there are no artifacts and check-patch > [2] seems to hang for some hours. > > Could you please have a look? > Thanks > > [1] > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/12989/ > [2] > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13034/ > -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100150)

1 0