Subject: [ OST Failure Report ] [ oVirt master ] [ 26.11.17 ] [ 001_initialize_engine ]
Suspected patches: https://gerrit.ovirt.org/#/c/84618/2 Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4158/ Link to all logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4158/artifact/... Error snippet from "ovirt-engine-setup.log": 017-11-26 11:48:42,863-0500 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine.db.schema plugin.execute:926 execute-output: ['/usr/share/ovirt-engine/dbscripts/schema.sh', '-s', 'localhost', '-p', '5432', '-u', 'engine', '-d', 'engine', '-l', '/var/log/ovirt-engine/setup/ovirt-engine-setup-20171126114742-1yt09f.log', '-c', 'apply'] stderr: FATAL: Operation aborted, found duplicate version: 04020770 2017-11-26 11:48:42,863-0500 ERROR otopi.plugins.ovirt_engine_setup.ovirt_engine.db.schema schema._misc:374 schema.sh: FATAL: Operation aborted, found duplicate version: 04020770 2017-11-26 11:48:42,863-0500 DEBUG otopi.context context._executeMethod:143 method exception Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in _executeMethod method['method']() File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/db/schema.py", line 376, in _misc raise RuntimeError(_('Engine schema refresh failed')) RuntimeError: Engine schema refresh failed 2017-11-26 11:48:42,864-0500 ERROR otopi.context context._executeMethod:152 Failed to execute stage 'Misc configuration': Engine schema refresh failed -- *GAL bEN HAIM* RHV DEVOPS
The analysis is completely wrong. The offending patch is [1]. I assume the reason for the failure is that gap between when the CI passed (Nov 21) and when it was merged (Nov 26). In the five days in between, other patches entered master and invalidated this CI result. To quote the job's log: """ *16:36:04* [ovirt-master_change-queue-tester] Running shell script*16:36:05* Testing 5 changes:*16:36:05* - 84680,2 (ovirt-engine) - https://gerrit.ovirt.org/#/c/84680/2*16:36:05* - 84681,2 (ovirt-engine) - https://gerrit.ovirt.org/#/c/84681/2*16:36:05* - 84039,4 (ovirt-engine) - https://gerrit.ovirt.org/#/c/84039/4*16:36:05* - 84609,3 (vdsm) - https://gerrit.ovirt.org/#/c/84609/3*16:36:05* - 84480,8 (vdsm) - https://gerrit.ovirt.org/#/c/84480/8*16:36:05* """ I noticed this by chance yesterday and merged [2] (which is listed as the probable cause here, of all things!) to fix it. Once the change queue catches up to this, you should be OK. [1] https://gerrit.ovirt.org/#/c/84039/ [2] https://gerrit.ovirt.org/#/c/84687/ On Sun, Nov 26, 2017 at 7:25 PM, Gal Ben Haim <gbenhaim@redhat.com> wrote:
Suspected patches: https://gerrit.ovirt.org/#/c/84618/2
Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4158/
Link to all logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue- tester/4158/artifact/exported-artifacts/basic-suit-master-el7/
Error snippet from "ovirt-engine-setup.log":
017-11-26 11:48:42,863-0500 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine.db.schema plugin.execute:926 execute-output: ['/usr/share/ovirt-engine/dbscripts/schema.sh', '-s', 'localhost', '-p', '5432', '-u', 'engine', '-d', 'engine', '-l', '/var/log/ovirt-engine/setup/ovirt-engine-setup-20171126114742-1yt09f.log', '-c', 'apply'] stderr: FATAL: Operation aborted, found duplicate version: 04020770
2017-11-26 11:48:42,863-0500 ERROR otopi.plugins.ovirt_engine_setup.ovirt_engine.db.schema schema._misc:374 schema.sh: FATAL: Operation aborted, found duplicate version: 04020770 2017-11-26 11:48:42,863-0500 DEBUG otopi.context context._executeMethod:143 method exception Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in _executeMethod method['method']() File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/db/schema.py", line 376, in _misc raise RuntimeError(_('Engine schema refresh failed')) RuntimeError: Engine schema refresh failed 2017-11-26 11:48:42,864-0500 ERROR otopi.context context._executeMethod:152 Failed to execute stage 'Misc configuration': Engine schema refresh failed
-- *GAL bEN HAIM* RHV DEVOPS
On Mon, Nov 27, 2017 at 2:30 PM, Allon Mureinik <amureini@redhat.com> wrote:
The analysis is completely wrong.
The offending patch is [1]. I assume the reason for the failure is that gap between when the CI passed (Nov 21) and when it was merged (Nov 26). In the five days in between, other patches entered master and invalidated this CI result.
To quote the job's log: """
*16:36:04* [ovirt-master_change-queue-tester] Running shell script*16:36:05* Testing 5 changes:*16:36:05* - 84680,2 (ovirt-engine) - https://gerrit.ovirt.org/#/c/84680/2*16:36:05* - 84681,2 (ovirt-engine) - https://gerrit.ovirt.org/#/c/84681/2*16:36:05* - 84039,4 (ovirt-engine) - https://gerrit.ovirt.org/#/c/84039/4*16:36:05* - 84609,3 (vdsm) - https://gerrit.ovirt.org/#/c/84609/3*16:36:05* - 84480,8 (vdsm) - https://gerrit.ovirt.org/#/c/84480/8*16:36:05*
"""
I noticed this by chance yesterday and merged [2] (which is listed as the probable cause here, of all things!) to fix it.
The statement in parenthesis is not true - my apologies, wrong link clicked. Regardless, the rest of the analysis is correct, and the problem has already been fixed. Engine develoeprs are advised to rebase on top of [2] below.
Once the change queue catches up to this, you should be OK.
[1] https://gerrit.ovirt.org/#/c/84039/ [2] https://gerrit.ovirt.org/#/c/84687/
On Sun, Nov 26, 2017 at 7:25 PM, Gal Ben Haim <gbenhaim@redhat.com> wrote:
Suspected patches: https://gerrit.ovirt.org/#/c/84618/2
Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4158/
Link to all logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-teste r/4158/artifact/exported-artifacts/basic-suit-master-el7/
Error snippet from "ovirt-engine-setup.log":
017-11-26 11:48:42,863-0500 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine.db.schema plugin.execute:926 execute-output: ['/usr/share/ovirt-engine/dbscripts/schema.sh', '-s', 'localhost', '-p', '5432', '-u', 'engine', '-d', 'engine', '-l', '/var/log/ovirt-engine/setup/ovirt-engine-setup-20171126114742-1yt09f.log', '-c', 'apply'] stderr: FATAL: Operation aborted, found duplicate version: 04020770
2017-11-26 11:48:42,863-0500 ERROR otopi.plugins.ovirt_engine_setup.ovirt_engine.db.schema schema._misc:374 schema.sh: FATAL: Operation aborted, found duplicate version: 04020770 2017-11-26 11:48:42,863-0500 DEBUG otopi.context context._executeMethod:143 method exception Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in _executeMethod method['method']() File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/db/schema.py", line 376, in _misc raise RuntimeError(_('Engine schema refresh failed')) RuntimeError: Engine schema refresh failed 2017-11-26 11:48:42,864-0500 ERROR otopi.context context._executeMethod:152 Failed to execute stage 'Misc configuration': Engine schema refresh failed
-- *GAL bEN HAIM* RHV DEVOPS
participants (2)
-
Allon Mureinik -
Gal Ben Haim