<div dir="ltr">connection issues to gerrit?</div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Sep 26, 2016 at 2:51 PM,  <span dir="ltr">&lt;<a href="mailto:jenkins@jenkins.phx.ovirt.org" target="_blank">jenkins@jenkins.phx.ovirt.org</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">See &lt;<a href="http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/464/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt_4.0_system-tests/464/</a>&gt;<br>
<br>
------------------------------<wbr>------------<br>
Started by timer<br>
[EnvInject] - Loading node environment variables.<br>
Building remotely on <a href="http://ovirt-srv19.phx.ovirt.org" rel="noreferrer" target="_blank">ovirt-srv19.phx.ovirt.org</a> (phx physical integ-tests fc24) in workspace &lt;<a href="http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt_4.0_system-tests/ws/</a>&gt;<br>
Cloning the remote Git repository<br>
Cloning repository git://<a href="http://gerrit.ovirt.org/ovirt-system-tests.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/ovirt-<wbr>system-tests.git</a><br>
 &gt; git init &lt;<a href="http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt_4.0_system-tests/ws/<wbr>ovirt-system-tests</a>&gt; # timeout=10<br>
Fetching upstream changes from git://<a href="http://gerrit.ovirt.org/ovirt-system-tests.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/ovirt-<wbr>system-tests.git</a><br>
 &gt; git --version # timeout=10<br>
 &gt; git -c core.askpass=true fetch --tags --progress git://<a href="http://gerrit.ovirt.org/ovirt-system-tests.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/ovirt-<wbr>system-tests.git</a> +refs/heads/*:refs/remotes/<wbr>origin/*<br>
 &gt; git config remote.origin.url git://<a href="http://gerrit.ovirt.org/ovirt-system-tests.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/ovirt-<wbr>system-tests.git</a> # timeout=10<br>
 &gt; git config --add remote.origin.fetch +refs/heads/*:refs/remotes/<wbr>origin/* # timeout=10<br>
 &gt; git config remote.origin.url git://<a href="http://gerrit.ovirt.org/ovirt-system-tests.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/ovirt-<wbr>system-tests.git</a> # timeout=10<br>
Cleaning workspace<br>
 &gt; git rev-parse --verify HEAD # timeout=10<br>
No valid HEAD. Skipping the resetting<br>
 &gt; git clean -fdx # timeout=10<br>
Pruning obsolete local branches<br>
Fetching upstream changes from git://<a href="http://gerrit.ovirt.org/ovirt-system-tests.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/ovirt-<wbr>system-tests.git</a><br>
 &gt; git -c core.askpass=true fetch --tags --progress git://<a href="http://gerrit.ovirt.org/ovirt-system-tests.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/ovirt-<wbr>system-tests.git</a> refs/heads/master --prune<br>
ERROR: Error fetching remote repo &#39;origin&#39;<br>
hudson.plugins.git.<wbr>GitException: Failed to fetch from git://<a href="http://gerrit.ovirt.org/ovirt-system-tests.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/ovirt-<wbr>system-tests.git</a><br>
        at hudson.plugins.git.GitSCM.<wbr>fetchFrom(GitSCM.java:766)<br>
        at hudson.plugins.git.GitSCM.<wbr>retrieveChanges(GitSCM.java:<wbr>1022)<br>
        at hudson.plugins.git.GitSCM.<wbr>checkout(GitSCM.java:1053)<br>
        at org.jenkinsci.plugins.<wbr>multiplescms.MultiSCM.<wbr>checkout(MultiSCM.java:129)<br>
        at hudson.scm.SCM.checkout(SCM.<wbr>java:485)<br>
        at hudson.model.AbstractProject.<wbr>checkout(AbstractProject.java:<wbr>1269)<br>
        at hudson.model.AbstractBuild$<wbr>AbstractBuildExecution.<wbr>defaultCheckout(AbstractBuild.<wbr>java:607)<br>
        at jenkins.scm.<wbr>SCMCheckoutStrategy.checkout(<wbr>SCMCheckoutStrategy.java:86)<br>
        at hudson.model.AbstractBuild$<wbr>AbstractBuildExecution.run(<wbr>AbstractBuild.java:529)<br>
        at hudson.model.Run.execute(Run.<wbr>java:1738)<br>
        at hudson.model.FreeStyleBuild.<wbr>run(FreeStyleBuild.java:43)<br>
        at hudson.model.<wbr>ResourceController.execute(<wbr>ResourceController.java:98)<br>
        at hudson.model.Executor.run(<wbr>Executor.java:410)<br>
Caused by: hudson.plugins.git.<wbr>GitException: Command &quot;git -c core.askpass=true fetch --tags --progress git://<a href="http://gerrit.ovirt.org/ovirt-system-tests.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/ovirt-<wbr>system-tests.git</a> refs/heads/master --prune&quot; returned status code 128:<br>
stdout:<br>
stderr: fatal: unable to connect to <a href="http://gerrit.ovirt.org" rel="noreferrer" target="_blank">gerrit.ovirt.org</a>:<br>
<a href="http://gerrit.ovirt.org" rel="noreferrer" target="_blank">gerrit.ovirt.org</a>[0: 107.22.212.69]: errno=Connection timed out<br>
<br>
<br>
        at org.jenkinsci.plugins.<wbr>gitclient.CliGitAPIImpl.<wbr>launchCommandIn(CliGitAPIImpl.<wbr>java:1640)<br>
        at org.jenkinsci.plugins.<wbr>gitclient.CliGitAPIImpl.<wbr>launchCommandWithCredentials(<wbr>CliGitAPIImpl.java:1388)<br>
        at org.jenkinsci.plugins.<wbr>gitclient.CliGitAPIImpl.<wbr>access$300(CliGitAPIImpl.java:<wbr>62)<br>
        at org.jenkinsci.plugins.<wbr>gitclient.CliGitAPIImpl$1.<wbr>execute(CliGitAPIImpl.java:<wbr>313)<br>
        at org.jenkinsci.plugins.<wbr>gitclient.RemoteGitImpl$<wbr>CommandInvocationHandler$1.<wbr>call(RemoteGitImpl.java:152)<br>
        at org.jenkinsci.plugins.<wbr>gitclient.RemoteGitImpl$<wbr>CommandInvocationHandler$1.<wbr>call(RemoteGitImpl.java:145)<br>
        at hudson.remoting.UserRequest.<wbr>perform(UserRequest.java:152)<br>
        at hudson.remoting.UserRequest.<wbr>perform(UserRequest.java:50)<br>
        at hudson.remoting.Request$2.run(<wbr>Request.java:332)<br>
        at hudson.remoting.<wbr>InterceptingExecutorService$1.<wbr>call(<wbr>InterceptingExecutorService.<wbr>java:68)<br>
        at java.util.concurrent.<wbr>FutureTask.run(FutureTask.<wbr>java:266)<br>
        at java.util.concurrent.<wbr>ThreadPoolExecutor.runWorker(<wbr>ThreadPoolExecutor.java:1142)<br>
        at java.util.concurrent.<wbr>ThreadPoolExecutor$Worker.run(<wbr>ThreadPoolExecutor.java:617)<br>
        at java.lang.Thread.run(Thread.<wbr>java:745)<br>
        at ......remote call to <a href="http://ovirt-srv19.phx.ovirt.org" rel="noreferrer" target="_blank">ovirt-srv19.phx.ovirt.org</a>(<wbr>Native Method)<br>
        at hudson.remoting.Channel.<wbr>attachCallSiteStackTrace(<wbr>Channel.java:1416)<br>
        at hudson.remoting.UserResponse.<wbr>retrieve(UserRequest.java:252)<br>
        at hudson.remoting.Channel.call(<wbr>Channel.java:781)<br>
        at org.jenkinsci.plugins.<wbr>gitclient.RemoteGitImpl$<wbr>CommandInvocationHandler.<wbr>execute(RemoteGitImpl.java:<wbr>145)<br>
        at sun.reflect.<wbr>GeneratedMethodAccessor512.<wbr>invoke(Unknown Source)<br>
        at sun.reflect.<wbr>DelegatingMethodAccessorImpl.<wbr>invoke(<wbr>DelegatingMethodAccessorImpl.<wbr>java:43)<br>
        at java.lang.reflect.Method.<wbr>invoke(Method.java:606)<br>
        at org.jenkinsci.plugins.<wbr>gitclient.RemoteGitImpl$<wbr>CommandInvocationHandler.<wbr>invoke(RemoteGitImpl.java:131)<br>
        at com.sun.proxy.$Proxy60.<wbr>execute(Unknown Source)<br>
        at hudson.plugins.git.GitSCM.<wbr>fetchFrom(GitSCM.java:764)<br>
        ... 12 more<br>
ERROR: null<br>
Performing Post build task...<br>
Match found for :.* : True<br>
Logical operation result is TRUE<br>
Running script  : #!/bin/bash -xe<br>
echo &#39;shell_scripts/<a href="http://system_tests.collect_logs.sh" rel="noreferrer" target="_blank">system_tests.<wbr>collect_logs.sh</a>&#39;<br>
<br>
#<br>
# Required jjb vars:<br>
#    version<br>
#<br>
VERSION=4.0<br>
SUITE_TYPE=<br>
<br>
WORKSPACE=&quot;$PWD&quot;<br>
OVIRT_SUITE=&quot;$SUITE_TYPE_<wbr>suite_$VERSION&quot;<br>
TESTS_LOGS=&quot;$WORKSPACE/ovirt-<wbr>system-tests/exported-<wbr>artifacts&quot;<br>
<br>
rm -rf &quot;$WORKSPACE/exported-<wbr>artifacts&quot;<br>
mkdir -p &quot;$WORKSPACE/exported-<wbr>artifacts&quot;<br>
<br>
if [[ -d &quot;$TESTS_LOGS&quot; ]]; then<br>
    mv &quot;$TESTS_LOGS/&quot;* &quot;$WORKSPACE/exported-<wbr>artifacts/&quot;<br>
fi<br>
<br>
[ovirt_4.0_system-tests] $ /bin/bash -xe /tmp/<wbr>hudson5354774381234585939.sh<br>
+ echo shell_scripts/<a href="http://system_tests.collect_logs.sh" rel="noreferrer" target="_blank">system_tests.<wbr>collect_logs.sh</a><br>
shell_scripts/<a href="http://system_tests.collect_logs.sh" rel="noreferrer" target="_blank">system_tests.<wbr>collect_logs.sh</a><br>
+ VERSION=4.0<br>
+ SUITE_TYPE=<br>
+ WORKSPACE=&lt;<a href="http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/" rel="noreferrer" target="_blank">http://jenkins.<wbr>ovirt.org/job/ovirt_4.0_<wbr>system-tests/ws/</a>&gt;<br>
+ OVIRT_SUITE=4.0<br>
+ TESTS_LOGS=&lt;<a href="http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/exported-artifacts" rel="noreferrer" target="_blank">http://jenkins.<wbr>ovirt.org/job/ovirt_4.0_<wbr>system-tests/ws/ovirt-system-<wbr>tests/exported-artifacts</a>&gt;<br>
+ rm -rf &lt;<a href="http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/464/artifact/exported-artifacts" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt_4.0_system-tests/464/<wbr>artifact/exported-artifacts</a>&gt;<br>
+ mkdir -p &lt;<a href="http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/464/artifact/exported-artifacts" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt_4.0_system-tests/464/<wbr>artifact/exported-artifacts</a>&gt;<br>
+ [[ -d &lt;<a href="http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/exported-artifacts" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt_4.0_system-tests/ws/<wbr>ovirt-system-tests/exported-<wbr>artifacts</a>&gt; ]]<br>
POST BUILD TASK : SUCCESS<br>
END OF POST BUILD TASK : 0<br>
Match found for :.* : True<br>
Logical operation result is TRUE<br>
Running script  : #!/bin/bash -xe<br>
echo &quot;shell-scripts/mock_cleanup.<wbr>sh&quot;<br>
<br>
shopt -s nullglob<br>
<br>
<br>
WORKSPACE=&quot;$PWD&quot;<br>
<br>
# Make clear this is the cleanup, helps reading the jenkins logs<br>
cat &lt;&lt;EOC<br>
______________________________<wbr>______________________________<wbr>___________<br>
##############################<wbr>##############################<wbr>###########<br>
#                                                                     #<br>
#                               CLEANUP                               #<br>
#                                                                     #<br>
##############################<wbr>##############################<wbr>###########<br>
EOC<br>
<br>
<br>
# Archive the logs, we want them anyway<br>
logs=(<br>
    ./*log<br>
    ./*/logs<br>
)<br>
if [[ &quot;$logs&quot; ]]; then<br>
    tar cvzf exported-artifacts/logs.tgz &quot;${logs[@]}&quot;<br>
    rm -rf &quot;${logs[@]}&quot;<br>
fi<br>
<br>
# stop any processes running inside the chroot<br>
failed=false<br>
mock_confs=(&quot;$WORKSPACE&quot;/*/<wbr>mocker*)<br>
# Clean current jobs mockroot if any<br>
for mock_conf_file in &quot;${mock_confs[@]}&quot;; do<br>
    [[ &quot;$mock_conf_file&quot; ]] || continue<br>
    echo &quot;Cleaning up mock $mock_conf&quot;<br>
    mock_root=&quot;${mock_conf_file##*<wbr>/}&quot;<br>
    mock_root=&quot;${mock_root%.*}&quot;<br>
    my_mock=&quot;/usr/bin/mock&quot;<br>
    my_mock+=&quot; --configdir=${mock_conf_file%/<wbr>*}&quot;<br>
    my_mock+=&quot; --root=${mock_root}&quot;<br>
    my_mock+=&quot; --resultdir=$WORKSPACE&quot;<br>
<br>
    #TODO: investigate why mock --clean fails to umount certain dirs sometimes,<br>
    #so we can use it instead of manually doing all this.<br>
    echo &quot;Killing all mock orphan processes, if any.&quot;<br>
    $my_mock \<br>
        --orphanskill \<br>
    || {<br>
        echo &quot;ERROR:  Failed to kill orphans on $chroot.&quot;<br>
        failed=true<br>
    }<br>
<br>
    mock_root=&quot;$(\<br>
        grep \<br>
            -Po &quot;(?&lt;=config_opts\[&#39;root&#39;\] = &#39;)[^&#39;]*&quot; \<br>
            &quot;$mock_conf_file&quot; \<br>
    )&quot; || :<br>
    [[ &quot;$mock_root&quot; ]] || continue<br>
    mounts=($(mount | awk &#39;{print $3}&#39; | grep &quot;$mock_root&quot;)) || :<br>
    if [[ &quot;$mounts&quot; ]]; then<br>
        echo &quot;Found mounted dirs inside the chroot $chroot. Trying to umount.&quot;<br>
    fi<br>
    for mount in &quot;${mounts[@]}&quot;; do<br>
        sudo umount --lazy &quot;$mount&quot; \<br>
        || {<br>
            echo &quot;ERROR:  Failed to umount $mount.&quot;<br>
            failed=true<br>
        }<br>
    done<br>
done<br>
<br>
# Clean any leftover chroot from other jobs<br>
for mock_root in /var/lib/mock/*; do<br>
    this_chroot_failed=false<br>
    mounts=($(mount | awk &#39;{print $3}&#39; | grep &quot;$mock_root&quot;)) || :<br>
    if [[ &quot;$mounts&quot; ]]; then<br>
        echo &quot;Found mounted dirs inside the chroot $mock_root.&quot; \<br>
             &quot;Trying to umount.&quot;<br>
    fi<br>
    for mount in &quot;${mounts[@]}&quot;; do<br>
        sudo umount --lazy &quot;$mount&quot; \<br>
        || {<br>
            echo &quot;ERROR:  Failed to umount $mount.&quot;<br>
            failed=true<br>
            this_chroot_failed=true<br>
        }<br>
    done<br>
    if ! $this_chroot_failed; then<br>
        sudo rm -rf &quot;$mock_root&quot;<br>
    fi<br>
done<br>
<br>
if $failed; then<br>
    echo &quot;Aborting.&quot;<br>
    exit 1<br>
fi<br>
<br>
# remove mock system cache, we will setup proxies to do the caching and this<br>
# takes lots of space between runs<br>
shopt -u nullglob<br>
sudo rm -Rf /var/cache/mock/*<br>
<br>
# restore the permissions in the working dir, as sometimes it leaves files<br>
# owned by root and then the &#39;cleanup workspace&#39; from jenkins job fails to<br>
# clean and breaks the jobs<br>
sudo chown -R &quot;$USER&quot; &quot;$WORKSPACE&quot;<br>
<br>
[ovirt_4.0_system-tests] $ /bin/bash -xe /tmp/<wbr>hudson7676240485039544411.sh<br>
+ echo shell-scripts/mock_cleanup.sh<br>
shell-scripts/mock_cleanup.sh<br>
+ shopt -s nullglob<br>
+ WORKSPACE=&lt;<a href="http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/" rel="noreferrer" target="_blank">http://jenkins.<wbr>ovirt.org/job/ovirt_4.0_<wbr>system-tests/ws/</a>&gt;<br>
+ cat<br>
______________________________<wbr>______________________________<wbr>___________<br>
##############################<wbr>##############################<wbr>###########<br>
#                                                                     #<br>
#                               CLEANUP                               #<br>
#                                                                     #<br>
##############################<wbr>##############################<wbr>###########<br>
+ logs=(./*log ./*/logs)<br>
+ [[ -n &#39;&#39; ]]<br>
+ failed=false<br>
+ mock_confs=(&quot;$WORKSPACE&quot;/*/<wbr>mocker*)<br>
+ false<br>
+ shopt -u nullglob<br>
+ sudo rm -Rf &#39;/var/cache/mock/*&#39;<br>
+ sudo chown -R jenkins &lt;<a href="http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt_4.0_system-tests/ws/</a>&gt;<br>
POST BUILD TASK : SUCCESS<br>
END OF POST BUILD TASK : 1<br>
Recording test results<br>
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?<br>
Archiving artifacts<br>
______________________________<wbr>_________________<br>
Infra mailing list<br>
<a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/infra</a><br>
<br>
<br>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>Eyal Edri<br>Associate Manager</div><div>RHV DevOps<br>EMEA ENG Virtualization R&amp;D<br>Red Hat Israel<br><br>phone: +972-9-7692018<br>irc: eedri (on #tlv #rhev-dev #rhev-integ)</div></div></div></div></div></div></div>
</div>