- Infra - oVirt List Archives

[JIRA] (OVIRT-3063) gtar Cannot write: Input/output error (was: Change in ovirt-system-tests[master]: pytest: he: Port 008_restart_he_vm.py to pytest)
by Shlomi Zidmi (oVirt JIRA) 25 Nov '20

25 Nov '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3063?page=com.atlassian.jira.… ] Shlomi Zidmi commented on OVIRT-3063: ------------------------------------- I’m still reviewing this issue. I don’t think that’s a disk space issue since only 15% of the disk is being used. Also no info is returned from dmesg regarding any errrors/failures. For now I’ve disabled the node (ovirt-srv22) on Jenkins until we figure this out > gtar Cannot write: Input/output error (was: Change in ovirt-system-tests[master]: pytest: he: Port 008_restart_he_vm.py to pytest) > ---------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3063 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3063 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Yedidyah Bar David > Assignee: infra > > Hi all, > On Tue, Nov 24, 2020 at 8:54 PM Code Review <gerrit(a)ovirt.org> wrote: > > > > From Jenkins CI <jenkins(a)ovirt.org>: > > > > Jenkins CI has posted comments on this change. > > > > Change subject: pytest: he: Port 008_restart_he_vm.py to pytest > > ...................................................................... > > > > > > Patch Set 12: Continuous-Integration-1 > > > > Build Failed > > > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/14018/ : FAILURE > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/14018… > [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Extract appliance to > local VM directory] > [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "dest": > "/var/tmp/localvm3i6cjs21", "extract_results": {"cmd": > ["/usr/bin/gtar", "--extract", "-C", "/var/tmp/localvm3i6cjs21", "-z", > "--show-transformed-names", "--sparse", "-f", > "/usr/share/ovirt-engine-appliance/ovirt-engine-appliance-4.4-20201124175128.1.el8.ova"], > "err": "/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot write: Input/output error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot utime: Input/output error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot change ownership to uid 0, gid 0: Input/output > error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot change mode to rwxr-xr-x: Input/output error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d.meta: > Cannot open: Input/output error\n/usr/bin/gtar: Exiting with failure > status due to previous errors\n", "out": "", "rc": 2}, "handler": > "TgzArchive", "msg": "failed to unpack > /usr/share/ovirt-engine-appliance/ovirt-engine-appliance-4.4-20201124175128.1.el8.ova > to /var/tmp/localvm3i6cjs21", "src": > "/usr/share/ovirt-engine-appliance/ovirt-engine-appliance-4.4-20201124175128.1.el8.ova"} > Other such failures already happened several times recently. Perhaps > some disk-space issue? Or something similar? > Thanks, > > > > > > -- > > To view, visit https://gerrit.ovirt.org/112273 > > To unsubscribe, visit https://gerrit.ovirt.org/settings > > > > Gerrit-Project: ovirt-system-tests > > Gerrit-Branch: master > > Gerrit-MessageType: comment > > Gerrit-Change-Id: Ib510a1624ac5baad0f637a96919c5fd6040e89aa > > Gerrit-Change-Number: 112273 > > Gerrit-PatchSet: 12 > > Gerrit-Owner: Yedidyah Bar David <didi(a)redhat.com> > > Gerrit-Reviewer: Anonymous Coward (1001916) > > Gerrit-Reviewer: Anton Marchukov <amarchuk(a)redhat.com> > > Gerrit-Reviewer: Dafna Ron <dron(a)redhat.com> > > Gerrit-Reviewer: Dusan Fodor <dfodor(a)redhat.com> > > Gerrit-Reviewer: Gal Ben Haim <galbh2(a)gmail.com> > > Gerrit-Reviewer: Galit Rosenthal <grosenth(a)redhat.com> > > Gerrit-Reviewer: Jenkins CI <jenkins(a)ovirt.org> > > Gerrit-Reviewer: Marcin Sobczyk <msobczyk(a)redhat.com> > > Gerrit-Reviewer: Yedidyah Bar David <didi(a)redhat.com> > > Gerrit-Comment-Date: Tue, 24 Nov 2020 18:54:46 +0000 > > Gerrit-HasComments: No > > > -- > Didi -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100151)

1 0

[JIRA] (OVIRT-3063) gtar Cannot write: Input/output error (was: Change in ovirt-system-tests[master]: pytest: he: Port 008_restart_he_vm.py to pytest)
by Anton Marchukov (oVirt JIRA) 25 Nov '20

25 Nov '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3063?page=com.atlassian.jira.… ] Anton Marchukov commented on OVIRT-3063: ---------------------------------------- [~accountid:5c977456c430371a3c67dbf6] how is it going? any update? > gtar Cannot write: Input/output error (was: Change in ovirt-system-tests[master]: pytest: he: Port 008_restart_he_vm.py to pytest) > ---------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3063 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3063 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Yedidyah Bar David > Assignee: infra > > Hi all, > On Tue, Nov 24, 2020 at 8:54 PM Code Review <gerrit(a)ovirt.org> wrote: > > > > From Jenkins CI <jenkins(a)ovirt.org>: > > > > Jenkins CI has posted comments on this change. > > > > Change subject: pytest: he: Port 008_restart_he_vm.py to pytest > > ...................................................................... > > > > > > Patch Set 12: Continuous-Integration-1 > > > > Build Failed > > > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/14018/ : FAILURE > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/14018… > [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Extract appliance to > local VM directory] > [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "dest": > "/var/tmp/localvm3i6cjs21", "extract_results": {"cmd": > ["/usr/bin/gtar", "--extract", "-C", "/var/tmp/localvm3i6cjs21", "-z", > "--show-transformed-names", "--sparse", "-f", > "/usr/share/ovirt-engine-appliance/ovirt-engine-appliance-4.4-20201124175128.1.el8.ova"], > "err": "/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot write: Input/output error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot utime: Input/output error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot change ownership to uid 0, gid 0: Input/output > error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot change mode to rwxr-xr-x: Input/output error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d.meta: > Cannot open: Input/output error\n/usr/bin/gtar: Exiting with failure > status due to previous errors\n", "out": "", "rc": 2}, "handler": > "TgzArchive", "msg": "failed to unpack > /usr/share/ovirt-engine-appliance/ovirt-engine-appliance-4.4-20201124175128.1.el8.ova > to /var/tmp/localvm3i6cjs21", "src": > "/usr/share/ovirt-engine-appliance/ovirt-engine-appliance-4.4-20201124175128.1.el8.ova"} > Other such failures already happened several times recently. Perhaps > some disk-space issue? Or something similar? > Thanks, > > > > > > -- > > To view, visit https://gerrit.ovirt.org/112273 > > To unsubscribe, visit https://gerrit.ovirt.org/settings > > > > Gerrit-Project: ovirt-system-tests > > Gerrit-Branch: master > > Gerrit-MessageType: comment > > Gerrit-Change-Id: Ib510a1624ac5baad0f637a96919c5fd6040e89aa > > Gerrit-Change-Number: 112273 > > Gerrit-PatchSet: 12 > > Gerrit-Owner: Yedidyah Bar David <didi(a)redhat.com> > > Gerrit-Reviewer: Anonymous Coward (1001916) > > Gerrit-Reviewer: Anton Marchukov <amarchuk(a)redhat.com> > > Gerrit-Reviewer: Dafna Ron <dron(a)redhat.com> > > Gerrit-Reviewer: Dusan Fodor <dfodor(a)redhat.com> > > Gerrit-Reviewer: Gal Ben Haim <galbh2(a)gmail.com> > > Gerrit-Reviewer: Galit Rosenthal <grosenth(a)redhat.com> > > Gerrit-Reviewer: Jenkins CI <jenkins(a)ovirt.org> > > Gerrit-Reviewer: Marcin Sobczyk <msobczyk(a)redhat.com> > > Gerrit-Reviewer: Yedidyah Bar David <didi(a)redhat.com> > > Gerrit-Comment-Date: Tue, 24 Nov 2020 18:54:46 +0000 > > Gerrit-HasComments: No > > > -- > Didi -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100151)

1 0

Re: [ovirt-devel] VDSM CI patches stuck in queue for several hours
by Marcin Sobczyk 25 Nov '20

25 Nov '20

On 11/24/20 8:12 AM, Ales Musil wrote: > Hi, > > most of my patches lately are getting stuck in CI. For example [0] is > hanging there for > 17 hours waiting for a container that would be able to run nmstate > functional tests. > > Can someone please take a look at that? So your jobs states: This script required nodes with label: (fc30 || fc31 || fc32 || rhel7 || rhel8) but the only fc30 node we have is down right now: https://jenkins.ovirt.org/label/fc30/ https://jenkins.ovirt.org/computer/vm0148.workers-phx.ovirt.org/ It's better to post things like these to +infra. Regards, Marcin > > Thanks, > Ales > > [0] https://jenkins.ovirt.org/job/vdsm_standard-check-patch/25066/ > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/25066/> > -- > > Ales Musil > > Software Engineer - RHV Network > > Red Hat EMEA <https://www.redhat.com> > > amusil(a)redhat.com <mailto:amusil@redhat.com> IM: amusil > > <https://red.ht/sig> > > > _______________________________________________ > Devel mailing list -- devel(a)ovirt.org > To unsubscribe send an email to devel-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/DWG2KAZIVYFLB…

2 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 601 - Failure!
by jenkins＠jenkins.phx.ovirt.org 25 Nov '20

25 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 601 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #601 [Michal Skrivanek] lagofy: better error handling when initialization fails ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.test_004_basic_sanity.test_sparsify_disk1 Error Message: AssertionError: False != True after 600 seconds Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7f32cdb11850> @order_by(_TEST_LIST) def test_sparsify_disk1(engine_api): engine = engine_api.system_service() disk_service = test_utils.get_disk_service(engine, DISK1_NAME) with engine_utils.wait_for_event(engine, 1325): # USER_SPARSIFY_IMAGE_START event disk_service.sparsify() with engine_utils.wait_for_event(engine, 1326): # USER_SPARSIFY_IMAGE_FINISH_SUCCESS > pass ../basic-suite-master/test-scenarios/test_004_basic_sanity.py:330: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib64/python2.7/contextlib.py:24: in __exit__ self.gen.next() ../ost_utils/ost_utils/engine_utils.py:44: in wait_for_event lambda: ../ost_utils/ost_utils/assertions.py:98: in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) ../ost_utils/ost_utils/assertions.py:83: in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ func = <function <lambda> at 0x7f32cca0aa28>, value = True, timeout = 600 allowed_exceptions = [], initial_wait = 0 error_message = 'False != True after 600 seconds' def assert_equals_within( func, value, timeout, allowed_exceptions=None, initial_wait=10, error_message=None ): allowed_exceptions = allowed_exceptions or [] res = '<no-result-obtained>' with _EggTimer(timeout) as timer: while not timer.elapsed(): try: res = func() if res == value: return except Exception as exc: if _instance_of_any(exc, allowed_exceptions): time.sleep(3) continue LOGGER.exception("Unhandled exception in %s", func) raise if initial_wait == 0: time.sleep(3) else: time.sleep(initial_wait) initial_wait = 0 try: if error_message is None: error_message = '%s != %s after %s seconds' % (res, value, timeout) > raise AssertionError(error_message) E AssertionError: False != True after 600 seconds ../ost_utils/ost_utils/assertions.py:61: AssertionError

1 11

[CQ]: 112335,2 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 25 Nov '20

25 Nov '20

Change 112335,2 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/112335/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4114/

1 0

[CQ]: 112335, 2 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 25 Nov '20

25 Nov '20

Change 112335,2 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/112335/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27052/

1 0

[oVirt Jenkins] deploy-to-gated-ovirt-master - Build #630 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 25 Nov '20

25 Nov '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-ovirt-master/630/ Build Name: #630 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[JIRA] (OVIRT-3063) gtar Cannot write: Input/output error (was: Change in ovirt-system-tests[master]: pytest: he: Port 008_restart_he_vm.py to pytest)
by Evgheni Dereveanchin (oVirt JIRA) 25 Nov '20

25 Nov '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3063?page=com.atlassian.jira.… ] Evgheni Dereveanchin commented on OVIRT-3063: --------------------------------------------- I’ve seen some issues on 80gig-disk labeled nodes before. [~accountid:5c977456c430371a3c67dbf6] could you please inspect them and rebuild if necessary? [https://jenkins.ovirt.org/label/80gb-disk/|https://jenkins.ovirt.org/label/…] > gtar Cannot write: Input/output error (was: Change in ovirt-system-tests[master]: pytest: he: Port 008_restart_he_vm.py to pytest) > ---------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3063 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3063 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Yedidyah Bar David > Assignee: infra > > Hi all, > On Tue, Nov 24, 2020 at 8:54 PM Code Review <gerrit(a)ovirt.org> wrote: > > > > From Jenkins CI <jenkins(a)ovirt.org>: > > > > Jenkins CI has posted comments on this change. > > > > Change subject: pytest: he: Port 008_restart_he_vm.py to pytest > > ...................................................................... > > > > > > Patch Set 12: Continuous-Integration-1 > > > > Build Failed > > > > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/14018/ : FAILURE > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/14018… > [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Extract appliance to > local VM directory] > [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "dest": > "/var/tmp/localvm3i6cjs21", "extract_results": {"cmd": > ["/usr/bin/gtar", "--extract", "-C", "/var/tmp/localvm3i6cjs21", "-z", > "--show-transformed-names", "--sparse", "-f", > "/usr/share/ovirt-engine-appliance/ovirt-engine-appliance-4.4-20201124175128.1.el8.ova"], > "err": "/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot write: Input/output error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot utime: Input/output error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot change ownership to uid 0, gid 0: Input/output > error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d: > Cannot change mode to rwxr-xr-x: Input/output error\n/usr/bin/gtar: > images/1519176a-e693-4425-b47b-7acfdd7f180b/4904ac49-1535-47d9-9d52-b803df4f869d.meta: > Cannot open: Input/output error\n/usr/bin/gtar: Exiting with failure > status due to previous errors\n", "out": "", "rc": 2}, "handler": > "TgzArchive", "msg": "failed to unpack > /usr/share/ovirt-engine-appliance/ovirt-engine-appliance-4.4-20201124175128.1.el8.ova > to /var/tmp/localvm3i6cjs21", "src": > "/usr/share/ovirt-engine-appliance/ovirt-engine-appliance-4.4-20201124175128.1.el8.ova"} > Other such failures already happened several times recently. Perhaps > some disk-space issue? Or something similar? > Thanks, > > > > > > -- > > To view, visit https://gerrit.ovirt.org/112273 > > To unsubscribe, visit https://gerrit.ovirt.org/settings > > > > Gerrit-Project: ovirt-system-tests > > Gerrit-Branch: master > > Gerrit-MessageType: comment > > Gerrit-Change-Id: Ib510a1624ac5baad0f637a96919c5fd6040e89aa > > Gerrit-Change-Number: 112273 > > Gerrit-PatchSet: 12 > > Gerrit-Owner: Yedidyah Bar David <didi(a)redhat.com> > > Gerrit-Reviewer: Anonymous Coward (1001916) > > Gerrit-Reviewer: Anton Marchukov <amarchuk(a)redhat.com> > > Gerrit-Reviewer: Dafna Ron <dron(a)redhat.com> > > Gerrit-Reviewer: Dusan Fodor <dfodor(a)redhat.com> > > Gerrit-Reviewer: Gal Ben Haim <galbh2(a)gmail.com> > > Gerrit-Reviewer: Galit Rosenthal <grosenth(a)redhat.com> > > Gerrit-Reviewer: Jenkins CI <jenkins(a)ovirt.org> > > Gerrit-Reviewer: Marcin Sobczyk <msobczyk(a)redhat.com> > > Gerrit-Reviewer: Yedidyah Bar David <didi(a)redhat.com> > > Gerrit-Comment-Date: Tue, 24 Nov 2020 18:54:46 +0000 > > Gerrit-HasComments: No > > > -- > Didi -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100151)

1 0

oVirt infra daily report - unstable production jobs - 1385
by jenkins＠jenkins.phx.ovirt.org 25 Nov '20

25 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1385//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3064) review and remove jobs running on EOL fedora
by Evgheni Dereveanchin (oVirt JIRA) 24 Nov '20

24 Nov '20

Evgheni Dereveanchin created OVIRT-3064: ------------------------------------------- Summary: review and remove jobs running on EOL fedora Key: OVIRT-3064 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3064 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Evgheni Dereveanchin Assignee: infra I noticed a large number of jobs in the build queue due labels such as fc30 being requested. For example, currently vdsm_standard-check-patch #25071 is waiting for 1 day with this message: This script required nodes with label: (fc30 || fc31 || fc32 || rhel7 || rhel8) Another example is vdsm_master_standard-poll-upstream-sources which runs on fc30 I had to bring vm0148 with fc30 back online but we should remove all jobs that need this distro or if el7 is not enough - decide on the replacement (el8?) and bring up some VMs to cover the needs - we have capacity in PHX for that -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100151)

1 0