March 2018 - Infra - oVirt List Archives

[vdsm][tag][ovirt-4.2] Vdsm tagged: v4.20.23
by Francesco Romani 21 Mar '18

21 Mar '18

Hi infra, we have a new Vdsm tag on branch ovirt-4.2 for oVirt 4.2.2: tag v4.20.23 Tagger: Francesco Romani <fromani(a)redhat.com> Date: Wed Mar 21 10:15:25 2018 +0100 Vdsm 4.20.23 for oVirt 4.2.2 RC 6 commit 139c9457000fc086cd0e096b5429047d163665f1 Bests, -- Francesco Romani Senior SW Eng., Virtualization R&D Red Hat IRC: fromani github: @fromanirh

1 0

Re: Change in ovirt-system-tests[master]: Test hosted-engine cleanup
by Yedidyah Bar David 21 Mar '18

21 Mar '18

On Wed, Mar 21, 2018 at 2:45 AM, Code Review <gerrit(a)ovirt.org> wrote: > From Jenkins CI: > > Jenkins CI has posted comments on this change. > > Change subject: Test hosted-engine cleanup > ...................................................................... > > > Patch Set 19: Continuous-Integration-1 > > Build Failed > > http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_… : FAILURE Failed with: 18:57:59 [ ERROR ] Failed to execute stage 'Misc configuration': Command '/usr/bin/sudo' failed to execute ... 18:57:59 [ ERROR ] Failed to execute stage 'Clean up': Force Fail: stage 14 priority 5000 (that's intended) ... 18:57:59 [ ERROR ] Hosted Engine deployment failed: please check the logs for the issue, fix accordingly or re-deploy from scratch. 18:57:59 Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20180320145201-homqsx.log 00:44:51 Build timed out (after 360 minutes). Marking the build as failed. No idea why it timed out. Then: 00:44:51 Build was aborted 00:44:51 mkdir: cannot create directory 'exported-artifacts/mock_logs': Permission denied ... 00:44:53 + chown -R jenkins /home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64 00:44:53 chown: changing ownership of '/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/automation/change_resolver_conf.pyc': Operation not permitted 00:44:53 chown: changing ownership of '/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/he-basic-iscsi-suite-master/LagoInitFile': Operation not permitted 00:44:53 chown: changing ownership of '/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/mock_logs.K2yic9nv/mocker-epel-7-x86_64.el7.check-patch.sh/check-patch.sh.log': Operation not permitted 00:44:53 chown: changing ownership of '/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/change_resolver.log': Operation not permitted 00:44:53 chown: changing ownership of '/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/exported-artifacts': Operation not permitted 00:44:53 chown: cannot read directory '/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/.pki': Permission denied And build-artifacts is almost empty. Any clue? If it's bad permissions on the git repo, then: 1. How come we have so many recently? Did we change anything? 2. Perhaps we should verify it at the beginning, and either abort quickly or try to fix (by removing everything and cloning from scratch)? Looked at the various git commands. Can't see errors, but do see a few like: 18:44:46 > git rev-parse --verify HEAD # timeout=10 18:44:46 No valid HEAD. Skipping the resetting No idea if that's a problem, or indicates one. Thanks, -- Didi

2 1

[JIRA] (OVIRT-1940) Do not show injected variables in Jenklins
by Barak Korren (oVirt JIRA) 21 Mar '18

21 Mar '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1940?page=com.atlassian.jira.… ] Barak Korren commented on OVIRT-1940: ------------------------------------- Seeing the variables is VERY useful when debugging issues. I'm not sure how effected are we by this, looking at this: http://jenkins.ovirt.org/job/jenkins_master_check-patch-el7-x86_64/3973/inj… I see the variables with secret data, but **** are displayed instead of the values. If its just a matter of build history before t a certain update, this will fix itself soon because we generally do not keep too much history. > Do not show injected variables in Jenklins > ------------------------------------------ > > Key: OVIRT-1940 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1940 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Evgheni Dereveanchin > Assignee: infra > -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100082)

1 0

[oVirt Jenkins] ovirt-system-tests_he-basic-ansible-suite-master - Build # 92 - Failure!
by jenkins＠jenkins.phx.ovirt.org 20 Mar '18

20 Mar '18

------=_Part_413_277120413.1521557907816 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-mast… Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-mast… Build Number: 92 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #92 [Eyal Shenitzky] Add test for VM leases [Yedidyah Bar David] cleanup_slave.sh: Remove stuff from /dev/shm ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_413_277120413.1521557907816--

1 1

[CQ]: 86267, 11 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 20 Mar '18

20 Mar '18

A system test invoked by the "ovirt-master" change queue including change 86267,11 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 88777,3 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 88777,3 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86267/11 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/88777/3 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6478/

1 0

[CQ]: 89235, 1 (ovirt-engine) failed "ovirt-4.2" system tests, but isn't the failure root cause
by oVirt Jenkins 20 Mar '18

20 Mar '18

A system test invoked by the "ovirt-4.2" change queue including change 89235,1 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 89165,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 89165,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/89235/1 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/89165/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/1393/

1 0

[JIRA] (OVIRT-1940) Do not show injected variables in Jenklins
by Evgheni Dereveanchin (oVirt JIRA) 20 Mar '18

20 Mar '18

This is a multi-part message in MIME format... ------------=_1521571391-31396-342 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Evgheni Dereveanchin created OVIRT-1940: ------------------------------------------- Summary: Do not show injected variables in Jenklins Key: OVIRT-1940 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1940 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Evgheni Dereveanchin Assignee: infra We use the Environment Injector Plugin and a recent security advisory for Jenkins recommends disabling display of injected variables via the UI/API to avoid leakage of sensitive data: https://jenkins.io/security/advisory/2018-02-26/#SECURITY-248 This can be done in settings -> Configure Global Security -> Do not show injected variables I performed this change on staging already. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100082) ------------=_1521571391-31396-342 Content-Type: text/html; charset="UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit <html><body> <h3>Evgheni Dereveanchin created OVIRT-1940:</h3> <pre> Summary: Do not show injected variables in Jenklins Key: OVIRT-1940 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1940 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Evgheni Dereveanchin Assignee: infra</pre> <p>We use the Environment Injector Plugin and a recent security advisory for Jenkins recommends disabling display of injected variables via the UI/API to avoid leakage of sensitive data: <a href="https://jenkins.io/security/advisory/2018-02-26/#SECURITY-248">https://jenkins.io/security/advisory/2018-02-26/#SECURITY-248</a></p> <p>This can be done in settings -> Configure Global Security -> Do not show injected variables</p> <p>I performed this change on staging already.</p> <p>— This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100082)</p> <img src="https://u4043402.ct.sendgrid.net/wf/open?upn=i5TMWGV99amJbNxJpSp2-2BJ33BSM3…" alt="" width="1" height="1" border="0" style="height:1px !important;width:1px !important;border-width:0 !important;margin-top:0 !important;margin-bottom:0 !important;margin-right:0 !important;margin-left:0 !important;padding-top:0 !important;padding-bottom:0 !important;padding-right:0 !important;padding-left:0 !important;"/> </body></html> ------------=_1521571391-31396-342--

1 0

[CQ]: 89206, 2 (ovirt-engine) failed "ovirt-4.2" system tests, but isn't the failure root cause
by oVirt Jenkins 20 Mar '18

20 Mar '18

A system test invoked by the "ovirt-4.2" change queue including change 89206,2 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 89165,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 89165,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/89206/2 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/89165/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/1390/

1 0

[ OST Failure Report ] [ oVirt 4.2 (ovirt-engine) ] [ 19-03-2018 ] [ 004_basic_sanity.verify_vm_import ]
by Dafna Ron 20 Mar '18

20 Mar '18

Hi, We have a failed change on test 004_basic_sanity.verify_vm_import. I can't see anything in the logs that suggests there was a problem with the import and the error in the junit also suggest this can possibly be in the api version. can you please check the issue? *Link and headline of suspected patches: * *core: Call endAction() of all child commands in ImportVmCommand - https://gerrit.ovirt.org/#/c/89165/ <https://gerrit.ovirt.org/#/c/89165/>Link to Job:http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/1362 <http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/1362>Link to all logs:http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/1362/artifa… <http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/1362/artifact/ex…>(Relevant) error snippet from the log: <error>2018-03-19 11:01:59,679-04 INFO [org.ovirt.engine.core.bll.exportimport.ImportVmCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-22) [] Lock freed to object 'EngineLock:{exclusiveLocks='[imported_vm=VM_NAME, 3494a94b-c253-440b-a6cb-c4c818b19ae1=VM]', sharedLocks='[cc4255e8-8e1d-4608-a3fe-a2096ed4e9f9=REMOTE_VM]'}'* Error Message False != True after 180 seconds Stacktrace Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 78, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/workspace/ovirt-4.2_change-queue-tester/ovirt-system-tests/basic-suite-4.2/test-scenarios/004_basic_sanity.py", line 596, in verify_vm_import lambda: vm_service.get().status == types.VmStatus.DOWN File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 267, in assert_true_within_short assert_equals_within_short(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 251, in assert_equals_within_short func, value, SHORT_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 237, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 180 seconds *</error>*

2 3

[JIRA] (OVIRT-1939) Failed to clean docker images
by Evgheni Dereveanchin (oVirt JIRA) 20 Mar '18

20 Mar '18

This is a multi-part message in MIME format... ------------=_1521553891-22644-199 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Evgheni Dereveanchin created OVIRT-1939: ------------------------------------------- Summary: Failed to clean docker images Key: OVIRT-1939 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1939 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Evgheni Dereveanchin Assignee: infra CQ was failed on cleanup due to some containers being left over. Looks like it's some bug that can be fixed in cleanup code: ... Deleted: sha256:01f26bebce703d4cdf051be97f3f4e7112efb86715d3f14e4853e104bfa4951d Deleted: sha256:64c5d1920a0ec20e595383bc81eae301ff7c36974b1d205e58302ce9f25dbc75 Error response from daemon: conflict: unable to delete 2454d64ffcd3 (cannot be forced) - image has dependent child images Error response from daemon: conflict: unable to delete bcec0ae8107e (cannot be forced) - image has dependent child images ERROR: Failed to clean docker images Sample job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6471/consoleF… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100082) ------------=_1521553891-22644-199 Content-Type: text/html; charset="UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit <html><body> <h3>Evgheni Dereveanchin created OVIRT-1939:</h3> <pre> Summary: Failed to clean docker images Key: OVIRT-1939 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1939 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Evgheni Dereveanchin Assignee: infra</pre> <p>CQ was failed on cleanup due to some containers being left over. Looks like it's some bug that can be fixed in cleanup code:</p> <p>… Deleted: sha256:01f26bebce703d4cdf051be97f3f4e7112efb86715d3f14e4853e104bfa4951d Deleted: sha256:64c5d1920a0ec20e595383bc81eae301ff7c36974b1d205e58302ce9f25dbc75 Error response from daemon: conflict: unable to delete 2454d64ffcd3 (cannot be forced) – image has dependent child images Error response from daemon: conflict: unable to delete bcec0ae8107e (cannot be forced) – image has dependent child images ERROR: Failed to clean docker images</p> <p>Sample job: <a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6471/consoleF…">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6471/consoleF…</a></p> <p>— This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100082)</p> <img src="https://u4043402.ct.sendgrid.net/wf/open?upn=i5TMWGV99amJbNxJpSp2-2BJ33BSM3…" alt="" width="1" height="1" border="0" style="height:1px !important;width:1px !important;border-width:0 !important;margin-top:0 !important;margin-bottom:0 !important;margin-right:0 !important;margin-left:0 !important;padding-top:0 !important;padding-bottom:0 !important;padding-right:0 !important;padding-left:0 !important;"/> </body></html> ------------=_1521553891-22644-199--

1 0