- Infra - oVirt List Archives

[CQ]: 89266, 8 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 14 May '18

14 May '18

A system test invoked by the "ovirt-master" change queue including change 89266,8 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 85805,12 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 85805,12 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/89266/8 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/85805/12 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7576/

1 0

[oVirt Jenkins] ovirt-system-tests_he-basic-iscsi-suite-master - Build # 148 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 May '18

14 May '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-master… Build Number: 148 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #148 [Your Name] networking: Introducing create_vnic method for virtlib.Vm ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_he_hosts Error Message: Host lago-he-basic-iscsi-suite-master-host-1 is in non operational state -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _he_host_is_up_4 at 0x7f5c7f643f50> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 389, in _he_host_is_up_4 raise RuntimeError('Host %s is in non operational state' % api_host.name) RuntimeError: Host lago-he-basic-iscsi-suite-master-host-1 is in non operational state --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 358, in add_he_hosts add_he_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 404, in add_he_hosts_4 testlib.assert_true_within(_he_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 263, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 389, in _he_host_is_up_4 raise RuntimeError('Host %s is in non operational state' % api_host.name) 'Host lago-he-basic-iscsi-suite-master-host-1 is in non operational state\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function _he_host_is_up_4 at 0x7f5c7f643f50>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 389, in _he_host_is_up_4\n raise RuntimeError(\'Host %s is in non operational state\' % api_host.name)\nRuntimeError: Host lago-he-basic-iscsi-suite-master-host-1 is in non operational state\n--------------------- >> end captured logging << ---------------------'

1 1

[CQ]: 90787, 8 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 14 May '18

14 May '18

A system test invoked by the "ovirt-master" change queue including change 90787,8 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 85805,12 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 85805,12 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/90787/8 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/85805/12 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7573/

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 151 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 May '18

14 May '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/151/ Build Number: 151 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #151 [Gal Ben Haim] 4.1 basic: Increase verify_suspend_vm timeout [Sandro Bonazzola] ovirt-host: add fc28 on master [Evgheni Dereveanchin] Verify IPv6 router advertisement settings from global_setup ----------------- Failed Tests: ----------------- No tests ran.

1 16

[JIRA] (OVIRT-2025) Document STDCI "V1.5" poll upstream sources jobs
by Daniel Belenky (oVirt JIRA) 14 May '18

14 May '18

Daniel Belenky created OVIRT-2025: ------------------------------------- Summary: Document STDCI "V1.5" poll upstream sources jobs Key: OVIRT-2025 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2025 Project: oVirt - virtualization made easy Issue Type: Task Components: Standard CI (Pipelines), STDCI DSL Reporter: Daniel Belenky Assignee: infra Since we're about to introduce pipeline based poll-upstream-sources jobs, we need to have documentation for the process. Docs should include: # How to create such job for a given project: implement a JJB temlpate # How to configure STDCI configuration file so poll-upstream-sources will work. If anything else is needed to be documented regarding this feature, please add it as a comment. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100084)

1 0

[JIRA] (OVIRT-2025) Document STDCI "V1.5" poll upstream sources jobs
by Daniel Belenky (oVirt JIRA) 14 May '18

14 May '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2025?page=com.atlassian.jira.… ] Daniel Belenky updated OVIRT-2025: ---------------------------------- Epic Link: OVIRT-400 > Document STDCI "V1.5" poll upstream sources jobs > ------------------------------------------------ > > Key: OVIRT-2025 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2025 > Project: oVirt - virtualization made easy > Issue Type: Task > Components: Standard CI (Pipelines), STDCI DSL > Reporter: Daniel Belenky > Assignee: infra > > Since we're about to introduce pipeline based poll-upstream-sources jobs, we need to have documentation for the process. Docs should include: > # How to create such job for a given project: implement a JJB temlpate > # How to configure STDCI configuration file so poll-upstream-sources will work. > If anything else is needed to be documented regarding this feature, please add it as a comment. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100084)

1 0

[CQ]: 85805,12 (ovirt-engine) failed "ovirt-master" system tests
by oVirt Jenkins 14 May '18

14 May '18

Change 85805,12 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/85805/12 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7568/

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 368 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 May '18

14 May '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/368/ Build Number: 368 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #368 [Marcin Mirecki] network: lookup ovn port by vnic id [Evgheni Dereveanchin] Verify IPv6 router advertisement settings from global_setup ----------------- Failed Tests: ----------------- No tests ran.

1 16

[JIRA] (OVIRT-2024) virt-sparsify fails silently
by Dafna Ron (oVirt JIRA) 14 May '18

14 May '18

Dafna Ron created OVIRT-2024: -------------------------------- Summary: virt-sparsify fails silently Key: OVIRT-2024 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2024 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Dafna Ron Assignee: infra virt-sparsify fails silently (intentionally silently). you can see the error in the host vdsm log (even on successful builds) 018-05-14 07:15:02,271-0400 ERROR (tasks/6) [root] Job u'796dd36e-0095-4adc-afb9-8b011f6b8ced' failed (jobs:221) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/jobs.py", line 157, in run self._run() File "/usr/lib/python2.7/site-packages/vdsm/storage/sdm/api/sparsify_volume.py", line 56, in _run virtsparsify.sparsify_inplace(self._vol_info.path) File "/usr/lib/python2.7/site-packages/vdsm/virtsparsify.py", line 71, in sparsify_inplace raise cmdutils.Error(cmd, rc, out, err) Error: Command ['/usr/bin/virt-sparsify', '--machine-readable', '--in-place', u'/rhev/data-center/mnt/192.168.200.4:_exports_nfs_share1/96157fda-d60a-49d1-adb8-f306e402a0cf/images/156eaf32-5219-4be7-b61e-b5104f2b6c4d/77eb6602-13ac-46aa-a4 39-af9e51e3c2cb'] failed with rc=1 out=['3/12'] err=['virt-sparsify: error: libguestfs error: guestfs_launch failed.', 'This usually means the libguestfs appliance failed to start or crashed.', 'Do:', ' export LIBGUESTFS_DEBUG=1 LIBGUEST FS_TRACE=1', 'and run the command again. For further information, read:', ' http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs', "You can also run 'libguestfs-test-tool' and post the *complete* output", 'into a bug report or message to the libguestfs mailing list.', '', 'If reporting bugs, run virt-sparsify with debugging enabled and include the ', 'complete output:', '', ' virt-sparsify -v -x [...]'] 2018-05-14 07:15:02,273-0400 INFO (tasks/6) [root] Job u'796dd36e-0095-4adc-afb9-8b011f6b8ced' will be deleted in 3600 seconds (jobs:249) 2018-05-14 07:15:02,273-0400 DEBUG (tasks/6) [jsonrpc.Notification] Sending event {"params": {"status": "failed", "description": "sparsify_volume", "job_type": "storage", "error": {"message": "General Exception: ('Command [\\'/usr/bin/vir t-sparsify\\', \\'--machine-readable\\', \\'--in-place\\', u\\'/rhev/data-center/mnt/192.168.200.4:_exports_nfs_share1/96157fda-d60a-49d1-adb8-f306e402a0cf/images/156eaf32-5219-4be7-b61e-b5104f2b6c4d/77eb6602-13ac-46aa-a439-af9e51e3c2cb\\ '] failed with rc=1 out=[\\'3/12\\'] err=[\\'virt-sparsify: error: libguestfs error: guestfs_launch failed.\\', \\'This usually means the libguestfs appliance failed to start or crashed.\\', \\'Do:\\', \\' export LIBGUESTFS_DEBUG=1 LIBGU ESTFS_TRACE=1\\', \\'and run the command again. For further information, read:\\', \\' http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\\', \"You can also run \\'libguestfs-test-tool\\' and post the *complete* output\", \\' into a bug report or message to the libguestfs mailing list.\\', \\'\\', \\'If reporting bugs, run virt-sparsify with debugging enabled and include the \\', \\'complete output:\\', \\'\\', \\' virt-sparsify -v -x [...]\\']',)", "code": 1 00}, "notify_time": 4295843980, "id": "796dd36e-0095-4adc-afb9-8b011f6b8ced"}, "jsonrpc": "2.0", "method": "|jobs|status|796dd36e-0095-4adc-afb9-8b011f6b8ced"} (__init__:180) 2018-05-14 07:15:02,273-0400 DEBUG (tasks/6) [vds] Sending notification |jobs|status|796dd36e-0095-4adc-afb9-8b011f6b8ced with params {'status': 'failed', 'description': 'sparsify_volume', 'job_type': 'storage', 'error': {'message': 'Gene ral Exception: (\'Command [\\\'/usr/bin/virt-sparsify\\\', \\\'--machine-readable\\\', \\\'--in-place\\\', u\\\'/rhev/data-center/mnt/192.168.200.4:_exports_nfs_share1/96157fda-d60a-49d1-adb8-f306e402a0cf/images/156eaf32-5219-4be7-b61e-b5 104f2b6c4d/77eb6602-13ac-46aa-a439-af9e51e3c2cb\\\'] failed with rc=1 out=[\\\'3/12\\\'] err=[\\\'virt-sparsify: error: libguestfs error: guestfs_launch failed.\\\', \\\'This usually means the libguestfs appliance failed to start or crash ed.\\\', \\\'Do:\\\', \\\' export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\\\', \\\'and run the command again. For further information, read:\\\', \\\' http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\\\', "You can also run \ \\'libguestfs-test-tool\\\' and post the *complete* output", \\\'into a bug report or message to the libguestfs mailing list.\\\', \\\'\\\', \\\'If reporting bugs, run virt-sparsify with debugging enabled and include the \\\', \\\'complet e output:\\\', \\\'\\\', \\\' virt-sparsify -v -x [...]\\\']\',)', 'code': 100}, 'notify_time': 4295843980, 'id': u'796dd36e-0095-4adc-afb9-8b011f6b8ced'} (clientIF:225) 2018-05-14 07:15:02,274-0400 INFO (tasks/6) [storage.ThreadPool.WorkerThread] FINISH task 041a7423-8c05-44b2-b3c9-6d5cf8710edc (threadPool:210) 2018-05-14 07:15:04,229-0400 DEBUG (qgapoller/1) [vds] Not sending QEMU-GA command 'guest-get-users' to vm_id='e1317264-a572-47e0-98b4-d492239e285e', command is not supported (qemuguestagent:192) 2018-05-14 07:15:04,230-0400 DEBUG (qgapoller/2) [vds] Not sending QEMU-GA command 'guest-get-users' to vm_id='29a56e04-51c7-4f25-b3c8-6df5489b2445', command is not supported (qemuguestagent:192) 2018-05-14 07:15:05,186-0400 DEBUG (vmchannels) [vds] Timeout on fileno 63. (vmchannels:126) Shmuel is investigating and we need to follow up with him. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100084)

1 0

[JIRA] (OVIRT-2021) CQ reporting wrong change as root cause
by Dafna Ron (oVirt JIRA) 14 May '18

14 May '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2021?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2021: ---------------------------------- Arik is investigating the failure and he thinks he knows the cause. I looked at CQ to try and see what the issue is and I can see 3 changes tested (all merged by Arik) and all 3 failed on the same issue. The first change ran here: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7552/ and it was marked as failed due to https://gerrit.ovirt.org/#/c/91084/1 which I think was not fixed yet. hence, all other failures were marked with https://gerrit.ovirt.org/#/c/91084/1 in CQ. I asked Arik to let me know if he can pin point the failure to a specific patch but I am 99% sure it is the first one that failed. > CQ reporting wrong change as root cause > ---------------------------------------- > > Key: OVIRT-2021 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2021 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > > [CQ]: 91188, 2 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause > For further details about the change see: > https://gerrit.ovirt.org/#/c/91188/2 > For further details about the change that seems to be the root cause behind the > testing failures see: > https://gerrit.ovirt.org/#/c/91084/1 > For failed test results see: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7552/ > The failure is a time out which was caused by a NPE (which is a real bug). > CQ reported the failure as related to JSONRPC which after discussing it with the developers has nothing to do with the NPE. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100084)

1 0