<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 30, 2017 at 10:21 AM, Simone Tiraboschi <span dir="ltr">&lt;<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="gmail-h5">On Tue, May 30, 2017 at 9:57 AM, Sandro Bonazzola <span dir="ltr">&lt;<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 30, 2017 at 9:50 AM, Sahina Bose <span dir="ltr">&lt;<a href="mailto:sabose@redhat.com" target="_blank">sabose@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span>On Tue, May 30, 2017 at 12:30 PM, Sandro Bonazzola <span dir="ltr">&lt;<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>&gt;</span> wrote:<br><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 30, 2017 at 5:53 AM,  <span dir="ltr">&lt;<a href="mailto:jenkins@jenkins.phx.ovirt.org" target="_blank">jenkins@jenkins.phx.ovirt.org</a><wbr>&gt;</span> wrote:<br><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote">Project: <a rel="noreferrer" href="http://jenkins.ovirt.org/job/ovirt_master_hc-system-tests/" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt_master_hc-system-tests/</a><br>
Build: <a rel="noreferrer" href="http://jenkins.ovirt.org/job/ovirt_master_hc-system-tests/115/" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt_master_hc-system-tests/11<wbr>5/</a></blockquote><div><br></div><div>I&#39;m not able to debug this.</div><div>As far as I can tell, engine-setup logs are truncated before engine-setup termination.</div></div></div></div></blockquote><div><br></div></span><div>postgresql not running?<br></div><div><pre>2017-05-29 23:11:03,016-0400 DEBUG otopi.ovirt_engine_setup.engin<wbr>e_common.database database.getCredentials:1179 dbenv: {&#39;OVESETUP_DB/database&#39;: &#39;engine&#39;, &#39;OVESETUP_DB/host&#39;: &#39;localhost&#39;, &#39;OVESETUP_DB/user&#39;: &#39;engine&#39;, &#39;OVESETUP_DB/secured&#39;: False, &#39;OVESETUP_DB/securedHostValida<wbr>tion&#39;: False, &#39;OVESETUP_DB/password&#39;: &#39;**FILTERED**&#39;, &#39;OVESETUP_DB/port&#39;: 5432}
2017-05-29 23:11:03,017-0400 DEBUG otopi.ovirt_engine_setup.engin<wbr>e_common.database database.execute:212 Database: &#39;None&#39;, Statement: &#39;
                select count(*) as count
                from pg_catalog.pg_tables
                where schemaname = &#39;public&#39;;
            &#39;, args: {}
2017-05-29 23:11:03,017-0400 DEBUG otopi.ovirt_engine_setup.engin<wbr>e_common.database database.execute:217 Creating own connection
2017-05-29 23:11:03,017-0400 DEBUG otopi.ovirt_engine_setup.engin<wbr>e_common.database database.getCredentials:1211 database connection failed
Traceback (most recent call last):
  File &quot;/usr/share/ovirt-engine/setup<wbr>/ovirt_engine_setup/engine_com<wbr>mon/database.py&quot;, line 1209, in getCredentials
    ] = self.isNewDatabase()
  File &quot;/usr/share/ovirt-engine/setup<wbr>/ovirt_engine_setup/engine_com<wbr>mon/database.py&quot;, line 405, in isNewDatabase
    transaction=False,
  File &quot;/usr/share/ovirt-engine/setup<wbr>/ovirt_engine_setup/engine_com<wbr>mon/database.py&quot;, line 226, in execute
    database=database,
  File &quot;/usr/share/ovirt-engine/setup<wbr>/ovirt_engine_setup/engine_com<wbr>mon/database.py&quot;, line 160, in connect
    sslmode=sslmode,
  File &quot;/usr/lib64/python2.7/site-pac<wbr>kages/psycopg2/__init__.py&quot;, line 164, in connect
    conn = _connect(dsn, connection_factory=connection_<wbr>factory, async=async)
OperationalError: could not connect to server: Connection refused
        Is the server running on host &quot;localhost&quot; (::1) and accepting
        TCP/IP connections on port 5432?
could not connect to server: Connection refused
        Is the server running on host &quot;localhost&quot; (127.0.0.1) and accepting
        TCP/IP connections on port 5432?
<br><br></pre></div></div></div></div></blockquote><div><br></div><div>Not sure. postgresql not running shouldn&#39;t truncate engine-setup logs. Adding Didi and Simone</div></div></div></div></blockquote><div><br></div><div><br></div></div></div><div>That one is failing at customization but, if I&#39;m not wrong, we are not going to start the DB till misc stage.</div><div>On my opinion is a regression somewhere.</div><div><br></div><div>But I don&#39;t expect it&#39;s going to make engine-setup crash/truncate the logs just by itself.</div><div><br></div><div>That job is failing since <a href="http://jenkins.ovirt.org/job/ovirt_master_hc-system-tests/111/" target="_blank">http://jenkins.ovirt.<wbr>org/job/ovirt_master_hc-<wbr>system-tests/111/</a> from May 27th and it seams it&#39;s always hanging at:</div><div><pre style="color:rgb(0,0,0)">2017-05-26 23:10:54,739-0400 DEBUG otopi.plugins.otopi.network.<wbr>firewalld plugin.executeRaw:813 execute: (&#39;/bin/firewall-cmd&#39;, &#39;--list-all-zones&#39;), executable=&#39;None&#39;, cwd=&#39;None&#39;, env=None</pre></div><div><div class="gmail-h5"><div><br></div></div></div></div></div></div></blockquote><div><br></div><div>I see:</div><div><pre style="color:rgb(0,0,0);word-wrap:break-word;white-space:pre-wrap">type=USER_AVC msg=audit(1495854655.350:143): pid=520 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg=&#39;avc:  denied  { send_msg } for msgtype=method_return dest=:1.37 spid=578 tpid=4560 scontext=system_u:system_r:firewalld_t:s0 tcontext=system_u:system_r:cloud_init_t:s0 tclass=dbus  exe=&quot;/usr/bin/dbus-daemon&quot; sauid=81 hostname=? addr=? terminal=?&#39;
type=USER_AVC msg=audit(1495854655.365:144): pid=520 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg=&#39;avc:  denied  { send_msg } for msgtype=method_return dest=:1.37 spid=578 tpid=4560 scontext=system_u:system_r:firewalld_t:s0 tcontext=system_u:system_r:cloud_init_t:s0 tclass=dbus  exe=&quot;/usr/bin/dbus-daemon&quot; sauid=81 hostname=? addr=? terminal=?&#39;
type=USER_AVC msg=audit(1495854655.386:145): pid=520 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg=&#39;avc:  denied  { send_msg } for msgtype=method_return dest=:1.37 spid=578 tpid=4560 scontext=system_u:system_r:firewalld_t:s0 tcontext=system_u:system_r:cloud_init_t:s0 tclass=dbus  exe=&quot;/usr/bin/dbus-daemon&quot; sauid=81 hostname=? addr=? terminal=?&#39;
type=USER_AVC msg=audit(1495854655.407:146): pid=520 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg=&#39;avc:  denied  { send_msg } for msgtype=method_return dest=:1.37 spid=578 tpid=4560 scontext=system_u:system_r:firewalld_t:s0 tcontext=system_u:system_r:cloud_init_t:s0 tclass=dbus  exe=&quot;/usr/bin/dbus-daemon&quot; sauid=81 hostname=? addr=? terminal=?&#39;
type=SERVICE_START msg=audit(1495854672.223:147): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg=&#39;unit=systemd-hostnamed comm=&quot;systemd&quot; exe=&quot;/usr/lib/systemd/systemd&quot; hostname=? addr=? terminal=? res=success&#39;
type=SERVICE_STOP msg=audit(1495854672.224:148): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg=&#39;unit=systemd-hostnamed comm=&quot;systemd&quot; exe=&quot;/usr/lib/systemd/systemd&quot; hostname=? addr=? terminal=? res=success&#39;
type=USER_AVC msg=audit(1495854680.227:149): pid=520 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg=&#39;avc:  denied  { send_msg } for msgtype=method_return dest=:1.37 spid=578 tpid=4560 scontext=system_u:system_r:firewalld_t:s0 tcontext=system_u:system_r:cloud_init_t:s0 tclass=dbus  exe=&quot;/usr/bin/dbus-daemon&quot; sauid=81 hostname=? addr=? terminal=?&#39;</pre></div><div><br></div><div><br></div><div><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><div class="gmail-h5"><div></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><pre></pre> </div><div><div class="gmail-m_-4385406999767206120gmail-m_6867239973925959466h5"><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br></div><div><br></div><div> </div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><br>
Build Number: 115<br>
Build Status:  Still Failing<br>
Triggered By: Started by timer<br>
<br>
------------------------------<wbr>-------<br>
Changes Since Last Success:<br>
------------------------------<wbr>-------<br>
Changes for Build #111<br>
[Roy Golan] Add metrics to basic suite<br>
<br>
[Sandro Bonazzola] ovirt-release: add fc26 support<br>
<br>
[Sandro Bonazzola] cockpit-ovirt: add fedora 26<br>
<br>
<br>
Changes for Build #112<br>
[Roy Golan] Add metrics to basic suite<br>
<br>
<br>
Changes for Build #113<br>
[Benny Zlotnik] Add live storage migration test<br>
<br>
<br>
Changes for Build #114<br>
[Daniel Belenky] Adding change resolver to check-patch for better changes detection.<br>
<br>
[Sandro Bonazzola] ovirt-engine-nodejs: add fedora 26<br>
<br>
[Sandro Bonazzola] ovirt-engine-nodejs-modules: add fedora 26<br>
<br>
[Sandro Bonazzola] ovirt-engine-yarn: add fedora 26<br>
<br>
[Eyal Edri] remove ovirt-web-ui project<br>
<br>
[Barak Korren] Add PyYAML package to all slaves<br>
<br>
[Barak Korren] Add retries to mirror_client on JSON errors<br>
<br>
[Barak Korren] Enabled loading mirrors data from local file<br>
<br>
[Barak Korren] Added GerritMergedChange class<br>
<br>
<br>
Changes for Build #115<br>
[Daniel Belenky] Adding change resolver to check-patch for better changes detection.<br>
<br>
<br>
<br>
<br>
-----------------<br>
Failed Tests:<br>
-----------------<br>
1 tests failed.<br>
FAILED:  002_bootstrap.wait_engine<br>
<br>
Error Message:<br>
None != True after 600 seconds<br>
<br>
Stack Trace:<br>
Traceback (most recent call last):<br>
  File &quot;/usr/lib64/python2.7/unittest<wbr>/case.py&quot;, line 369, in run<br>
    testMethod()<br>
  File &quot;/usr/lib/python2.7/site-packa<wbr>ges/nose/case.py&quot;, line 197, in runTest<br>
    self.test(*self.arg)<br>
  File &quot;/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/testlib.py&quot;, line 129, in wrapped_test<br>
    test()<br>
  File &quot;/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/testlib.py&quot;, line 59, in wrapper<br>
    return func(get_test_prefix(), *args, **kwargs)<br>
  File &quot;/home/jenkins/workspace/ovirt<wbr>_master_hc-system-tests/ovirt-<wbr>system-tests/hc-basic-suite-ma<wbr>ster/test-scenarios/002_bootst<wbr>rap.py&quot;, line 102, in wait_engine<br>
    testlib.assert_true_within(_en<wbr>gine_is_up, timeout=10 * 60)<br>
  File &quot;/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/testlib.py&quot;, line 256, in assert_true_within<br>
    assert_equals_within(func, True, timeout, allowed_exceptions)<br>
  File &quot;/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/testlib.py&quot;, line 230, in assert_equals_within<br>
    &#39;%s != %s after %s seconds&#39; % (res, value, timeout)<br>
AssertionError: None != True after 600 seconds<br>______________________________<wbr>_________________<br>
Infra mailing list<br>
<a href="mailto:Infra@ovirt.org" target="_blank">Infra@ovirt.org</a><br>
<a rel="noreferrer" href="http://lists.ovirt.org/mailman/listinfo/infra" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/infra</a><br>
<br></blockquote></div><span class="gmail-m_-4385406999767206120gmail-m_6867239973925959466m_-5326814739454402690gmail-HOEnZb"><font color="#888888"><br><br clear="all"><span class="gmail-m_-4385406999767206120gmail-HOEnZb"><font color="#888888"><div><br></div>-- <br><div class="gmail-m_-4385406999767206120gmail-m_6867239973925959466m_-5326814739454402690gmail-m_3255426433847328389gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>SANDRO</span> <span>BONAZZOLA</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&amp;D</span></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a style="color:rgb(0,136,206);margin:0px" href="https://www.redhat.com/" target="_blank">Red Hat <span>EMEA</span></a></p><table style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium" border="0"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img height="auto" width="90"></a></td><td style="font-size:10px"><div><a style="color:rgb(204,0,0);font-weight:bold" href="https://redhat.com/trusted" target="_blank">TRIED. TESTED. TRUSTED.</a></div></td></tr></tbody></table></div></div></div></div></div></div></div>
</font></span></font></span></div></div><span class="gmail-m_-4385406999767206120gmail-HOEnZb"><font color="#888888">
</font></span></blockquote></div></div></div><span class="gmail-m_-4385406999767206120gmail-HOEnZb"><font color="#888888"><br></font></span></div></div><span class="gmail-m_-4385406999767206120gmail-HOEnZb"><font color="#888888">
</font></span></blockquote></div><span class="gmail-m_-4385406999767206120gmail-HOEnZb"><font color="#888888"><br><br clear="all"><div><br></div>-- <br><div class="gmail-m_-4385406999767206120gmail-m_6867239973925959466gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>SANDRO</span> <span>BONAZZOLA</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&amp;D</span></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat <span>EMEA</span></a></p><table border="0" style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img width="90" height="auto"></a></td><td style="font-size:10px"><div><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></div></td></tr></tbody></table></div></div></div></div></div></div></div>
</font></span></div></div>
</blockquote></div></div></div><br></div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>SANDRO</span> <span>BONAZZOLA</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&amp;D</span></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat <span>EMEA</span></a></p><table border="0" style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img src="https://www.redhat.com/profiles/rh/themes/redhatdotcom/img/logo-red-hat-black.png" width="90" height="auto"></a></td><td style="font-size:10px"><div><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></div></td></tr></tbody></table></div></div></div></div></div></div></div>
</div></div>