Some update:

So the upgrade suite failure is actually due to my change, while fixing multiple issues with 7.5 yesterday, I've noticed our upgrade from release to master suite is actually upgrading from 4.1 to master
and not 4.2, so I've changed that to reflect the real suite name. However I've missed the fact that there might be changed needed there, my mistake.

I've restored the suite to upgrade from 4.1 to master [1] and also fixed the broken gluster 3.8 repo, so it should work now.
On Sunday we'll need to add a new suite that upgrade 4.2->master or replace the current one if we're not interested to test 4.1->4.3 flow.

I'll re-merge the vdsm-jsonrpc-java version bump, so it should pass now.

[1] https://gerrit.ovirt.org/#/c/91175/

On Fri, May 11, 2018 at 9:48 PM, Dafna Ron <dron@redhat.com> wrote:
Thanks Dominic.
I think we should find the change that caused it and revert because it seems that its effecting multiple projects and that its not easily fixed.

Thanks!
Dafna


On Fri, May 11, 2018 at 7:49 PM, Dominik Holler <dholler@redhat.com> wrote:
On Fri, 11 May 2018 13:05:54 +0300
Dafna Ron <dron@redhat.com> wrote:

> Hi,
>
> We are failing in 001_initialize_engine.test_initialize_engine in the
> upgrade suite.
> the issue seems to be related to ovn configuration.
>
> The changes reported by CQ are not the cause of this failure and I
> may be mistaken but I suspect it may be related to one of the below
> changes.
>
> *Link and headline of suspected patches: *
>
>
>
> *https://gerrit.ovirt.org/#/c/90784/
> <https://gerrit.ovirt.org/#/c/90784/>
> - network: default ovn provider client is returned by
> fixturehttps://gerrit.ovirt.org/#/c/90327/
> <https://gerrit.ovirt.org/#/c/90327/> - backend, packing: Add default
> MTU for tunnelled networksLink to Job:*
> *http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7492/
> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7492/>*
> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7488/
>
>
>
>
> *Link to all
> logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7492/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/
> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7492/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/>(Relevant)
> error snippet from the log: <error>*
>
> 2018-05-11 04:14:34,940-0400 DEBUG otopi.context
> context._executeMethod:143 method exception
> Traceback (most recent call last):
>   File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133,
> in _executeMethod
>     method['method']()
>   File
> "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/network/ovirtproviderovn.py",
> line 779, in _customization self._query_install_ovn()
>   File
> "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/network/ovirtproviderovn.py",
> line 399, in _query_install_ovn default=True
>   File "/usr/lib/python2.7/site-packages/ovirt_setup_lib/dialog.py",
> line 47, in queryBoolean
>     default=true if default else false,
>   File "/usr/share/otopi/plugins/otopi/dialog/human.py", line 211, in
> queryString
>     value = self._readline(hidden=hidden)
>   File "/usr/lib/python2.7/site-packages/otopi/dialog.py", line 248,
> in _readline
>     raise IOError(_('End of file'))
> IOError: End of file
> 2018-05-11 04:14:34,942-0400 ERROR otopi.context
> context._executeMethod:152 Failed to execute stage 'Environment
> customization': End of file
> 2018-05-11 04:14:34,972-0400 DEBUG
> otopi.plugins.otopi.debug.debug_failure.debug_failure
> debug_failure._notification:100 tcp connections:
> id uid local foreign state pid exe
> 0: 0 0.0.0.0:111 0.0.0.0:0 LISTEN 1829 /usr/sbin/rpcbind
> 1: 29 0.0.0.0:662 0.0.0.0:0 LISTEN 1868 /usr/sbin/rpc.statd
> 2: 0 0.0.0.0:22 0.0.0.0:0 LISTEN 970 /usr/sbin/sshd
> 3: 0 192.168.201.2:3260 0.0.0.0:0 LISTEN UnknownPID UnknownEXE
> 4: 0 192.168.200.2:3260 0.0.0.0:0 LISTEN UnknownPID UnknownEXE
> 5: 0 0.0.0.0:892 0.0.0.0:0 LISTEN 1874 /usr/sbin/rpc.mountd
> 6: 0 0.0.0.0:2049 0.0.0.0:0 LISTEN UnknownPID UnknownEXE
> 7: 0 0.0.0.0:32803 0.0.0.0:0 LISTEN UnknownPID UnknownEXE
> 8: 0 192.168.201.2:22 192.168.201.1:33338 ESTABLISHED
> 5544 /usr/sbin/sshd 2018-05-11 04:14:34,973-0400 DEBUG otopi.context
> context.dumpEnvironment:859 ENVIRONMENT DUMP - BEGIN
> 2018-05-11 04:14:34,973-0400 DEBUG otopi.context
> context.dumpEnvironment:869 ENV BASE/error=bool:'True'
> 2018-05-11 04:14:34,973-0400 DEBUG otopi.context
> context.dumpEnvironment:869 ENV BASE/exceptionInfo=list:'[(<type
> 'exceptions.IOError'>, IOError('End of file',), <traceback object at
> 0x239ab90>)]' 
> 2018-05-11 04:14:34,974-0400 DEBUG otopi.context
> context.dumpEnvironment:873 ENVIRONMENT DUMP - END
> 2018-05-11 04:14:34,975-0400 INFO otopi.context
> context.runSequence:741 Stage: Clean up
> 2018-05-11 04:14:34,975-0400 DEBUG otopi.context
> context.runSequence:745 STAGE cleanup
> 2018-05-11 04:14:34,976-0400 DEBUG otopi.context
> context._executeMethod:128 Stage cleanup METHOD
> otopi.plugins.otopi.dialog.answer_file.Plugin._generate_answer_file
> 2018-05-11 04:14:34,977-0400 DEBUG otopi.context
> context.dumpEnvironment:859 ENVIRONMENT DUMP - BEGIN
> 2018-05-11 04:14:34,977-0400 DEBUG otopi.context
> context.dumpEnvironment:869 ENV DIALOG/answerFileContent=str:'# OTOPI
> answer file, generated by human dialog
> [environment:default]
> '
>
>
>
>
> *</error>Thanks, Dafna*


The upgrade suite looks like the change of the initial version of
oVirt from 4.1 to 4.2 is not yet completed.
https://gerrit.ovirt.org/#/c/91172/ fixes this issue, but the next one
seems to be
[ INFO  ] Configuring WebSocket Proxy\n
[ INFO  ] Backing up database localhost:engine to
\'/var/lib/ovirt-engine/backups/engine-20180511123046.d7PUoD.dump\'.\n
[ INFO  ] Creating/refreshing Engine database schema\n
[ ERROR ] schema.sh: FATAL:
Cannot execute sql command:
--file=/usr/share/ovirt-engine/dbscripts/upgrade/04_03_0070_add_missing_indexes.sql\n
[ ERROR ] Failed to execute stage \'Misc configuration\': Engine schema
refresh failed\n
[WARNING] Rollback of DWH database postponed to Stage "Clean up"\n
[ INFO  ] Rolling back database schema\n
[ INFO  ] Clearing Engine
database engine\n
[ INFO  ] Restoring Engine database engine\n





--

Eyal edri


MANAGER

RHV DevOps

EMEA VIRTUALIZATION R&D


Red Hat EMEA

TRIED. TESTED. TRUSTED.
phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)