<div dir="ltr"><div><div><b>Also worth mentioning:</b></div><div><b><br></b></div><div><b><br></b></div><div>"job1": <a href="http://jenkins.ovirt.org/job/ovirt-engine_3.5_dao-unit-tests_gerrit">http://jenkins.ovirt.org/job/ovirt-engine_3.5_dao-unit-tests_gerrit</a>, does:</div><div><ol><li>does some sql-foo to create a db with some data</li><li>runs maven as follows:</li></ol></div><div><font face="monospace, monospace">export MAVEN_OPTS=" -XX:MaxPermSize=512m"<br></font></div><div><font face="monospace, monospace">mvn \</font></div><div><span style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"> </span><font face="monospace, monospace">-P enable-dao-tests \</font></div><div><span style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"> </span><font face="monospace, monospace">-D engine.db.username=engine \</font></div><div><span style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"> </span><font face="monospace, monospace">-D engine.db.password=engine \</font></div><div><span style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"> </span><font face="monospace, monospace">-s /home/jenkins/workspace/ovirt-engine_3.5_dao-unit-tests_gerrit/artifactory-ovirt-org-settings.xml \</font></div><div><span style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"> </span><font face="monospace, monospace">-Dengine.db.url=jdbc:postgresql://localhost/ovirt_engine_3_5_dao_unit_tests_gerrit_369 \</font></div><div><span style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"> </span><font face="monospace, monospace">install</font></div></div><div><br></div><div>"job2": <a href="http://jenkins.ovirt.org/job/ovirt-engine_3.5_unit_tests_gerrit">http://jenkins.ovirt.org/job/ovirt-engine_3.5_unit_tests_gerrit</a>, does:</div><div><ol><li>Run maven (I've "beautified" this just to ease on comparison, and it's indirect run via wrapped up make target):<br></li></ol></div><div><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px">mvn \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-f ovirt-engine/pom.xml \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-s /home/jenkins/workspace/ovirt-engine_3.5_unit_tests_gerrit/artifactory-ovirt-org-settings.xml \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_HOST=<a href="http://gerrit.ovirt.org">gerrit.ovirt.org</a> \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_PATCHSET_UPLOADER="Alon Bar-Lev <<a href="mailto:alonbl@redhat.com">alonbl@redhat.com</a>>" \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_EVENT_ACCOUNT_NAME="Alon Bar-Lev" \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_EVENT_TYPE=patchset-created \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_CHANGE_ID=I97fa20e0f5205ebddb6aff1cbfebf3f2879fa34e \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_TOPIC=host-deploy \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_CHANGE_NUMBER=44875 \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_VERSION="2.10.3.1" \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_PATCHSET_UPLOADER_NAME="Alon Bar-Lev" \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> -D</span>GERRIT_CHANGE_COMMIT_MESSAGE=aG9zdC1kZXBsb3k6IHJlbW92ZSB0aW1lc3RhbXAgY2FjaGUgY2hlY2sgZm9yIHRhcmJhbGwKCndoZW4gbXVsdGlwbGUgcGFja2FnZXMgbWFuYWdlIHRoZSBkaXJlY3RvcnkgdHJlZSwgdGhlIGxhc3QgZmlsZQp0aW1lc3RhbXAgY2Fubm90IGJlIHVzZWQgYXMgcmVmZXJlbmNlIHRvIGNhY2hlIGludGVncml0eSBhcyBhbiBvbGRlcgpwYWNrYWdlIG1heSBiZSBhcHBsaWVkIGFmdGVyIG5ld2VyIG9uZS4KCndlIGNvdWxkIGhhdmUgdXNlZCBoYXNoIG1lY2hhbmlzbSwgYnV0IHRoZW4gd2UgaGFkIHRvIHJlYWQgZmlsZXMgb25jZQpwZXIgaGFzaCBhbmQgb25jZSBwZXIgY3JlYXRpb24sIHNvIGJldHRlciB0byBqdXN0IGNyZWF0ZSB0aGUgdGFyYmFsbCBhdApkZXNpZ25hdGVkIGludGVydmFsLgoKQnVnLVVybDogaHR0cHM6Ly9idWd6aWxsYS5yZWRoYXQuY29tL3Nob3dfYnVnLmNnaT9pZD0xMjUyMzY0CkNoYW5nZS1JZDogSTk3ZmEyMGUwZjUyMDVlYmRkYjZhZmYxY2JmZWJmM2YyODc5ZmEzNGUKU2lnbmVkLW9mZi1ieTogQWxvbiBCYXItTGV2IDxhbG9uYmxAcmVkaGF0LmNvbT4K \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_PATCHSET_UPLOADER_EMAIL=<a href="mailto:alonbl@redhat.com">alonbl@redhat.com</a> \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_BRANCH=ovirt-engine-3.5 \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_EVENT_HASH=-1504677913 \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_PORT=29418 \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_NAME=<a href="http://gerrit.ovirt.org">gerrit.ovirt.org</a> \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_CHANGE_OWNER_NAME="Alon Bar-Lev" \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_EVENT_ACCOUNT="Alon Bar-Lev <<a href="mailto:alonbl@redhat.com">alonbl@redhat.com</a>>" \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_EVENT_ACCOUNT_EMAIL=<a href="mailto:alonbl@redhat.com">alonbl@redhat.com</a> \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_CHANGE_OWNER="Alon Bar-Lev <<a href="mailto:alonbl@redhat.com">alonbl@redhat.com</a>>" \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_CHANGE_URL=<a href="https://gerrit.ovirt.org/44875" style="color:rgb(92,53,102);word-wrap:break-word">https://gerrit.ovirt.org/44875</a> \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_SCHEME=ssh \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_CHANGE_SUBJECT="host-deploy: remove timestamp cache check for tarball" \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_REFSPEC=refs/changes/75/44875/1 \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_PATCHSET_NUMBER=1 \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_PATCHSET_REVISION=fb26eba4f8ebe696a31c584e162edca9c17ef801 \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_PROJECT=ovirt-engine \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-DGERRIT_CHANGE_OWNER_EMAIL=<a href="mailto:alonbl@redhat.com">alonbl@redhat.com</a> \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>-Dmaven.repo.local=/home/jenkins/workspace/ovirt-engine_3.5_unit_tests_gerrit/.repository \</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><span style="font-family:arial,sans-serif"> </span>test</pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><br></pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px"><br></pre><pre class="console-output" style="white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:13px">Maybe we could do as follows: <span style="font-family:arial,sans-serif">sequential run of combined job doing </span></pre></div><div><pre class="console-output" style="word-wrap:break-word;margin-top:0px;margin-bottom:0px"><ol><li style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><span style="font-family:arial,sans-serif">maybe in parallel:</span></li><ol><li style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><span style="font-family:arial,sans-serif">run: sql foo</span></li><li style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><span style="font-family:arial,sans-serif">job2 run - general unit tests:
</span><font face="monospace, monospace">mvn clean test <with params of job2></font></li></ol><li><span style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap;font-family:arial,sans-serif">wait for 1.1 and 1.2. to complete, and then </span><font color="#333333"><span style="font-size:13px;white-space:pre-wrap"><font face="arial, sans-serif">job1 run:
</font><font face="monospace, monospace">mvn test -P enable-dao-tests <with params of job1></font></span></font></li></ol><div style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><font face="arial, sans-serif"><br></font></div><div style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><font face="arial, sans-serif">The above could theoretically reduce total runtime of job1+job2 by 1/3.</font></div><div style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><br></div><div style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><font face="arial, sans-serif">Given: job1 runs ~16m, </font><span style="font-family:arial,sans-serif">job2 runs ~15m [most time ~10m is spent waiting for artifactory downloads, IIRC]</span></div><div style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><span style="font-family:arial,sans-serif">Expected outcome:</span><br></div><div style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><span style="font-family:arial,sans-serif">we could save 10m, reaching 21m, or even more, if </span><span style="font-family:arial,sans-serif">the 2nd mvn run could probably reuse some of already compiled .class files, </span><span style="font-family:arial,sans-serif">we'd could be even faster than 20m.</span></div><div style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><br></div><div style="color:rgb(51,51,51);font-size:13px;white-space:pre-wrap"><span style="font-family:arial,sans-serif">Possible Pitfals:</span></div><div><ol><li><span style="color:rgb(51,51,51);font-family:arial,sans-serif;font-size:13px;white-space:pre-wrap">problems combining tests result reports [if it indeed happens. <b>devs</b>, please comment]</span></li><li><span style="white-space:pre-wrap;font-family:arial,sans-serif">we might need to be able to run job1 and job2 separately:</span></li><ul><li><span style="font-family:arial,sans-serif;white-space:pre-wrap">Workaround:</span></li><ul><li><span style="font-family:arial,sans-serif;white-space:pre-wrap">split job1 into II parts: job1.sql-foo and job1.mvn</span></li><li><span style="font-family:arial,sans-serif;white-space:pre-wrap">run "workflow" (sharing workspace): </span><span style="font-family:arial,sans-serif;white-space:pre-wrap">parallel(job1.sql-foo,job2) ==> </span><span style="font-family:arial,sans-serif;white-space:pre-wrap">run job1.mvn</span></li></ul></ul></ol></div><div><font face="arial, sans-serif"><span style="white-space:pre-wrap">WDYT?</span></font></div><div><font face="arial, sans-serif"><span style="white-space:pre-wrap"><br></span></font></div><div><font face="arial, sans-serif"><span style="white-space:pre-wrap"><br></span></font></div></pre></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Aug 17, 2015 at 2:22 PM, David Caro <span dir="ltr"><<a href="mailto:dcaro@redhat.com" target="_blank">dcaro@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><br>
Hi everyone!<br>
<br>
Lately there have been found issues with the findbugs job:<br>
<a href="http://jenkins.ovirt.org/job/ovirt-engine_3.5_find-bugs_merged/1373/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/ovirt-engine_3.5_find-bugs_merged/1373/</a><br>
<br>
It turns out that it was running only on fc20 hosts, and there it ran well, but<br>
fc20 hosts have been removed (not supported anymore) and the test started<br>
running on el6/el7 hosts, and the version there is slightly different and it<br>
started complaining about issues it did not complain before.<br>
<br>
The quick fix is to solve the issue:<br>
<br>
BackendApiResource.java:264, DE_MIGHT_IGNORE, Priority: Low<br>
org.ovirt.engine.api.restapi.resource.BackendApiResource.getSchema() might ignore java.io.IOException<br>
<br>
<br>
But that leaves another question, which plataforms should we run findbugs on?<br>
should we use a matrix of platforms? always the same?<br>
<br>
It's your call, so please let me know what you want to do (I'll just pin it to<br>
el7 host for now, to avoid flaky tests).<br>
<br>
Thanks!!<br>
<span class="HOEnZb"><font color="#888888"><br>
<br>
--<br>
David Caro<br>
<br>
Red Hat S.L.<br>
Continuous Integration Engineer - EMEA ENG Virtualization R&D<br>
<br>
Tel.: <a href="tel:%2B420%20532%20294%20605" value="+420532294605">+420 532 294 605</a><br>
Email: <a href="mailto:dcaro@redhat.com">dcaro@redhat.com</a><br>
Web: <a href="http://www.redhat.com" rel="noreferrer" target="_blank">www.redhat.com</a><br>
RHT Global #: 82-62605<br>
</font></span><br>_______________________________________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/devel</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div>Max Kovgan</div><div><br></div><div>Senior Software Engineer</div><div>Red Hat - EMEA ENG Virtualization R&D</div><div>Tel.: +972 9769 2060</div><div>Email: mkovgan [at] redhat [dot] com</div><div>Web: <a href="http://www.redhat.com" target="_blank">http://www.redhat.com</a></div><div>RHT Global #: 82-72060</div></div></div>
</div>