On Tue, May 30, 2017 at 10:21 AM, Simone Tiraboschi <stirabos@redhat.com> wrote:


On Tue, May 30, 2017 at 9:57 AM, Sandro Bonazzola <sbonazzo@redhat.com> wrote:


On Tue, May 30, 2017 at 9:50 AM, Sahina Bose <sabose@redhat.com> wrote:


On Tue, May 30, 2017 at 12:30 PM, Sandro Bonazzola <sbonazzo@redhat.com> wrote:


On Tue, May 30, 2017 at 5:53 AM, <jenkins@jenkins.phx.ovirt.org> wrote:
Project: http://jenkins.ovirt.org/job/ovirt_master_hc-system-tests/
Build: http://jenkins.ovirt.org/job/ovirt_master_hc-system-tests/115/

I'm not able to debug this.
As far as I can tell, engine-setup logs are truncated before engine-setup termination.

postgresql not running?
2017-05-29 23:11:03,016-0400 DEBUG otopi.ovirt_engine_setup.engine_common.database database.getCredentials:1179 dbenv: {'OVESETUP_DB/database': 'engine', 'OVESETUP_DB/host': 'localhost', 'OVESETUP_DB/user': 'engine', 'OVESETUP_DB/secured': False, 'OVESETUP_DB/securedHostValidation': False, 'OVESETUP_DB/password': '**FILTERED**', 'OVESETUP_DB/port': 5432}
2017-05-29 23:11:03,017-0400 DEBUG otopi.ovirt_engine_setup.engine_common.database database.execute:212 Database: 'None', Statement: '
                select count(*) as count
                from pg_catalog.pg_tables
                where schemaname = 'public';
            ', args: {}
2017-05-29 23:11:03,017-0400 DEBUG otopi.ovirt_engine_setup.engine_common.database database.execute:217 Creating own connection
2017-05-29 23:11:03,017-0400 DEBUG otopi.ovirt_engine_setup.engine_common.database database.getCredentials:1211 database connection failed
Traceback (most recent call last):
  File "/usr/share/ovirt-engine/setup/ovirt_engine_setup/engine_common/database.py", line 1209, in getCredentials
    ] = self.isNewDatabase()
  File "/usr/share/ovirt-engine/setup/ovirt_engine_setup/engine_common/database.py", line 405, in isNewDatabase
    transaction=False,
  File "/usr/share/ovirt-engine/setup/ovirt_engine_setup/engine_common/database.py", line 226, in execute
    database=database,
  File "/usr/share/ovirt-engine/setup/ovirt_engine_setup/engine_common/database.py", line 160, in connect
    sslmode=sslmode,
  File "/usr/lib64/python2.7/site-packages/psycopg2/__init__.py", line 164, in connect
    conn = _connect(dsn, connection_factory=connection_factory, async=async)
OperationalError: could not connect to server: Connection refused
	Is the server running on host "localhost" (::1) and accepting
	TCP/IP connections on port 5432?
could not connect to server: Connection refused
	Is the server running on host "localhost" (127.0.0.1) and accepting
	TCP/IP connections on port 5432?


Not sure. postgresql not running shouldn't truncate engine-setup logs. Adding Didi and Simone


That one is failing at customization but, if I'm not wrong, we are not going to start the DB till misc stage.
On my opinion is a regression somewhere.

But I don't expect it's going to make engine-setup crash/truncate the logs just by itself.

That job is failing since http://jenkins.ovirt.org/job/ovirt_master_hc-system-tests/111/ from May 27th and it seams it's always hanging at:
2017-05-26 23:10:54,739-0400 DEBUG otopi.plugins.otopi.network.firewalld plugin.executeRaw:813 execute: ('/bin/firewall-cmd', '--list-all-zones'), executable='None', cwd='None', env=None


I see:
type=USER_AVC msg=audit(1495854655.350:143): pid=520 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg='avc:  denied  { send_msg } for msgtype=method_return dest=:1.37 spid=578 tpid=4560 scontext=system_u:system_r:firewalld_t:s0 tcontext=system_u:system_r:cloud_init_t:s0 tclass=dbus  exe="/usr/bin/dbus-daemon" sauid=81 hostname=? addr=? terminal=?'
type=USER_AVC msg=audit(1495854655.365:144): pid=520 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg='avc:  denied  { send_msg } for msgtype=method_return dest=:1.37 spid=578 tpid=4560 scontext=system_u:system_r:firewalld_t:s0 tcontext=system_u:system_r:cloud_init_t:s0 tclass=dbus  exe="/usr/bin/dbus-daemon" sauid=81 hostname=? addr=? terminal=?'
type=USER_AVC msg=audit(1495854655.386:145): pid=520 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg='avc:  denied  { send_msg } for msgtype=method_return dest=:1.37 spid=578 tpid=4560 scontext=system_u:system_r:firewalld_t:s0 tcontext=system_u:system_r:cloud_init_t:s0 tclass=dbus  exe="/usr/bin/dbus-daemon" sauid=81 hostname=? addr=? terminal=?'
type=USER_AVC msg=audit(1495854655.407:146): pid=520 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg='avc:  denied  { send_msg } for msgtype=method_return dest=:1.37 spid=578 tpid=4560 scontext=system_u:system_r:firewalld_t:s0 tcontext=system_u:system_r:cloud_init_t:s0 tclass=dbus  exe="/usr/bin/dbus-daemon" sauid=81 hostname=? addr=? terminal=?'
type=SERVICE_START msg=audit(1495854672.223:147): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-hostnamed comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
type=SERVICE_STOP msg=audit(1495854672.224:148): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-hostnamed comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
type=USER_AVC msg=audit(1495854680.227:149): pid=520 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg='avc:  denied  { send_msg } for msgtype=method_return dest=:1.37 spid=578 tpid=4560 scontext=system_u:system_r:firewalld_t:s0 tcontext=system_u:system_r:cloud_init_t:s0 tclass=dbus  exe="/usr/bin/dbus-daemon" sauid=81 hostname=? addr=? terminal=?'




 

 


 
 


 


Build Number: 115

Build Status:  Still Failing

Triggered By: Started by timer



-------------------------------------

Changes Since Last Success:

-------------------------------------

Changes for Build #111

[Roy Golan] Add metrics to basic suite



[Sandro Bonazzola] ovirt-release: add fc26 support



[Sandro Bonazzola] cockpit-ovirt: add fedora 26





Changes for Build #112

[Roy Golan] Add metrics to basic suite





Changes for Build #113

[Benny Zlotnik] Add live storage migration test





Changes for Build #114

[Daniel Belenky] Adding change resolver to check-patch for better changes detection.



[Sandro Bonazzola] ovirt-engine-nodejs: add fedora 26



[Sandro Bonazzola] ovirt-engine-nodejs-modules: add fedora 26



[Sandro Bonazzola] ovirt-engine-yarn: add fedora 26



[Eyal Edri] remove ovirt-web-ui project



[Barak Korren] Add PyYAML package to all slaves



[Barak Korren] Add retries to mirror_client on JSON errors



[Barak Korren] Enabled loading mirrors data from local file



[Barak Korren] Added GerritMergedChange class





Changes for Build #115

[Daniel Belenky] Adding change resolver to check-patch for better changes detection.









-----------------

Failed Tests:

-----------------

1 tests failed.

FAILED:  002_bootstrap.wait_engine



Error Message:

None != True after 600 seconds



Stack Trace:

Traceback (most recent call last):

  File "/usr/lib64/python2.7/unittest/case.py", line 369, in run

    testMethod()

  File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest

    self.test(*self.arg)

  File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test

    test()

  File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper

    return func(get_test_prefix(), *args, **kwargs)

  File "/home/jenkins/workspace/ovirt_master_hc-system-tests/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 102, in wait_engine

    testlib.assert_true_within(_engine_is_up, timeout=10 * 60)

  File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 256, in assert_true_within

    assert_equals_within(func, True, timeout, allowed_exceptions)

  File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 230, in assert_equals_within

    '%s != %s after %s seconds' % (res, value, timeout)

AssertionError: None != True after 600 seconds
_______________________________________________

Infra mailing list

Infra@ovirt.org

http://lists.ovirt.org/mailman/listinfo/infra





-- 
SANDRO BONAZZOLA
ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
Red Hat EMEA










-- 
SANDRO BONAZZOLA
ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
Red Hat EMEA










-- 
SANDRO BONAZZOLA
ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
Red Hat EMEA