<div dir="ltr">Hi David,<div><br></div><div>I'll write this as an AI to discuss in the next rhev-ci meeting</div><div><br></div><div>Thanks</div><div>Gil</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 17, 2016 at 12:32 PM, dcaro <span dir="ltr"><<a href="mailto:dcaro@redhat.com" target="_blank">dcaro@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">On 05/17 11:20, dcaro wrote:<br>
> On 05/17 10:36, Gil Shinar wrote:<br>
> > Hi,<br>
> ><br>
> > I have tried to debug this issue yesterday with the help of Barak.<br>
> > I don't think that the problem is history as I saw another failure like<br>
> > this yesterday (it happens from time to time). Problem is the slave it<br>
> > builds on being taken by another build and cleans the workspace. I tried to<br>
> > look for logs under the workspace and they missing probably because a newer<br>
> > build is being built on the same slave.<br>
><br>
> How did you find out about that?<br>
> That has happened before when the same slave was added twice on jenkins with<br>
> different names, but the behavior was way different (you'd get things like the<br>
> dir does not exist and such, not errors when running yum inside mock)<br>
<br>
<br>
</span>An example of yum failure:<br>
<br>
<br>
<a href="http://jenkins.ovirt.org/view/Master%20branch%20per%20project/view/vdsm/job/vdsm_master_check-patch-el7-x86_64/1523/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/view/Master%20branch%20per%20project/view/vdsm/job/vdsm_master_check-patch-el7-x86_64/1523/</a><br>
<br>
You can see there the log in the console:<br>
<br>
03:00:58 Start: yum install<br>
03:01:07 ERROR: Command failed. See logs for output.<br>
03:01:07 # /usr/bin/yum-deprecated --installroot /var/lib/mock/epel-7-x86_64-46ef12ce4362729a0f4c411e00edd8fc/root/ --releasever 7 install @buildsys-build --setopt=tsflags=nocontexts<br>
<br>
Then, in the archived artifacts logs.tgz, under<br>
vdsm/logs/mocker-epel-7-x86_64.el7.init/root.log, you can see the error log:<br>
<br>
<br>
DEBUG util.py:474: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/epel-7-x86_64-46ef12ce4362729a0f4c411e00edd8fc/root/', '--releasever', '7', 'install', '@buildsys-build', '--setopt=tsflags=nocontexts'] with env {'SHELL': '/bin/bash', 'CCACHE_DIR': '/tmp/ccache', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'CCACHE_UMASK': '002', 'LC_MESSAGES': 'C', 'PROMPT_COMMAND': 'printf "\x1b]0;<mock-chroot>\x07<mock-chroot>"', 'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'HOSTNAME': 'mock', 'LD_PRELOAD': '/tmp/tmpxqactgv2/$LIB/nosync.so'} and shell False<br>
DEBUG util.py:399: Yum command has been deprecated, use dnf instead.<br>
DEBUG util.py:399: See 'man dnf' and 'man yum2dnf' for more information.<br>
DEBUG util.py:399: <a href="http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/bbf11fe5f13b4c6d0a9a242b422885c6ed41e05ae718d4ea3abfc3550ef4f243-comps-epel7.xml.xz" rel="noreferrer" target="_blank">http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/bbf11fe5f13b4c6d0a9a242b422885c6ed41e05ae718d4ea3abfc3550ef4f243-comps-epel7.xml.xz</a>: [Errno 14] HTTP Error 404 - Not Found<br>
DEBUG util.py:399: Trying other mirror.<br>
DEBUG util.py:399: <a href="http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/4e6f7cf18ae8bc3553da486c7847ac8f9a50671406d26c72a4d0765f914c5c76-updateinfo.xml.bz2" rel="noreferrer" target="_blank">http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/4e6f7cf18ae8bc3553da486c7847ac8f9a50671406d26c72a4d0765f914c5c76-updateinfo.xml.bz2</a>: [Errno 14] HTTP Error 404 - Not Found<br>
DEBUG util.py:399: Trying other mirror.<br>
DEBUG util.py:399: <a href="http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/ff94d6a6fd8803f1ba27ab562b8e99c2b5f7f4ffa5d49b97689f3df6ca57e367-primary.sqlite.xz" rel="noreferrer" target="_blank">http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/ff94d6a6fd8803f1ba27ab562b8e99c2b5f7f4ffa5d49b97689f3df6ca57e367-primary.sqlite.xz</a>: [Errno 14] HTTP Error 404 - Not Found<br>
DEBUG util.py:399: Trying other mirror.<br>
DEBUG util.py:399: <a href="http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/ff94d6a6fd8803f1ba27ab562b8e99c2b5f7f4ffa5d49b97689f3df6ca57e367-primary.sqlite.xz" rel="noreferrer" target="_blank">http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/ff94d6a6fd8803f1ba27ab562b8e99c2b5f7f4ffa5d49b97689f3df6ca57e367-primary.sqlite.xz</a>: [Errno 14] HTTP Error 404 - Not Found<br>
DEBUG util.py:399: Trying other mirror.<br>
DEBUG util.py:399: <a href="http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/ff94d6a6fd8803f1ba27ab562b8e99c2b5f7f4ffa5d49b97689f3df6ca57e367-primary.sqlite.xz" rel="noreferrer" target="_blank">http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/ff94d6a6fd8803f1ba27ab562b8e99c2b5f7f4ffa5d49b97689f3df6ca57e367-primary.sqlite.xz</a>: [Errno 14] HTTP Error 404 - Not Found<br>
DEBUG util.py:399: Trying other mirror.<br>
DEBUG util.py:399: One of the configured repositories failed ("Custom epel"),<br>
DEBUG util.py:399: and yum doesn't have enough cached data to continue. At this point the only<br>
DEBUG util.py:399: safe thing yum can do is fail. There are a few ways to work "fix" this:<br>
DEBUG util.py:399: 1. Contact the upstream for the repository and get them to fix the problem.<br>
DEBUG util.py:399: 2. Reconfigure the baseurl/etc. for the repository, to point to a working<br>
DEBUG util.py:399: upstream. This is most often useful if you are using a newer<br>
DEBUG util.py:399: distribution release than is supported by the repository (and the<br>
DEBUG util.py:399: packages for the previous distribution release still work).<br>
DEBUG util.py:399: 3. Disable the repository, so yum won't use it by default. Yum will then<br>
DEBUG util.py:399: just ignore the repository until you permanently enable it again or use<br>
DEBUG util.py:399: --enablerepo for temporary usage:<br>
DEBUG util.py:399: yum-config-manager --disable epel<br>
DEBUG util.py:399: 4. Configure the failing repository to be skipped, if it is unavailable.<br>
DEBUG util.py:399: Note that yum will try to contact the repo. when it runs most commands,<br>
DEBUG util.py:399: so will have to try and fail each time (and thus. yum will be be much<br>
DEBUG util.py:399: slower). If it is a very temporary problem though, this is often a nice<br>
DEBUG util.py:399: compromise:<br>
DEBUG util.py:399: yum-config-manager --save --setopt=epel.skip_if_unavailable=true<br>
DEBUG util.py:399: failure: repodata/ff94d6a6fd8803f1ba27ab562b8e99c2b5f7f4ffa5d49b97689f3df6ca57e367-primary.sqlite.xz from epel: [Errno 256] No more mirrors to try.<br>
DEBUG util.py:399: <a href="http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/ff94d6a6fd8803f1ba27ab562b8e99c2b5f7f4ffa5d49b97689f3df6ca57e367-primary.sqlite.xz" rel="noreferrer" target="_blank">http://download.fedoraproject.org/pub/epel/7/x86_64/repodata/ff94d6a6fd8803f1ba27ab562b8e99c2b5f7f4ffa5d49b97689f3df6ca57e367-primary.sqlite.xz</a>: [Errno 14] HTTP Error 404 - Not Found<br>
DEBUG util.py:521: Child return code was: 1<br>
<br>
<br>
That usually means that the mirrors were in the middle of an update, and the<br>
md5sums in the metadata were not consistent at that point it time (happens from<br>
time to time).<br>
<br>
We could try to minimize that issue handling a mirror ourselves, though that<br>
would mean another service to maintain (with it's own potential issues, like<br>
not being updated and such, but that's another subject)<br>
<div class="HOEnZb"><div class="h5"><br>
<br>
><br>
> ><br>
> > Gil<br>
> ><br>
> > On Tue, May 17, 2016 at 8:52 AM, Eyal Edri <<a href="mailto:eedri@redhat.com">eedri@redhat.com</a>> wrote:<br>
> ><br>
> > > Can we increase the history for builds on that job? We should be able to<br>
> > > debug jobs at least a week back. Artifacts are not needed<br>
> > > On May 16, 2016 11:42 PM, "David Caro" <<a href="mailto:dcaro@redhat.com">dcaro@redhat.com</a>> wrote:<br>
> > ><br>
> > >> On 05/15 23:23, Nir Soffer wrote:<br>
> > >> > Another instance:<br>
> > >> ><br>
> > >> > 19:38:15 Start: yum install<br>
> > >> > 19:38:22 ERROR: Command failed. See logs for output.<br>
> > >><br>
> > >> That means that there was an issue with the yum repos, most common causes<br>
> > >> are:<br>
> > >><br>
> > >> * The repos were actually down (mirrors fail once a day usually, while<br>
> > >> syncing<br>
> > >> the rpms, though the cause is just a guess)<br>
> > >> * Repoproxy (that we use to cache rpms) was overloaded<br>
> > >><br>
> > >> Both jobs histories are now gone, in order to be able to debug those<br>
> > >> issues<br>
> > >> (for the next time), try looking into the mock logs, under the 'logs.tgz'<br>
> > >> file<br>
> > >> that's archived in the job, then under the path:<br>
> > >> /./vdsm/logs/mocker-epel-7-x86_64.el7.init/<br>
> > >> or<br>
> > >> /./vdsm/logs/mocker-epel-7-x86_64.el7.install_packages/<br>
> > >><br>
> > >> Usually in the log named 'root.log' (check which one has more size).<br>
> > >><br>
> > >> ><br>
> > >> ><br>
> > >> <a href="http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/1213/console" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/1213/console</a><br>
> > >><br>
> > >> ><br>
> > >> > On Sun, May 15, 2016 at 11:21 PM, Nir Soffer <<a href="mailto:nsoffer@redhat.com">nsoffer@redhat.com</a>><br>
> > >> wrote:<br>
> > >> > ><br>
> > >> <a href="http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/1209/console" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/1209/console</a><br>
> > >> > ><br>
> > >> > > 19:30:56 Start: yum install<br>
> > >> > > 19:31:03 ERROR: Command failed. See logs for output.<br>
> > >> > ><br>
> > >> > > Including the to make sure it will not disapper<br>
> > >> > > ----<br>
> > >> > ><br>
> > >> > > 19:30:48 Triggered by Gerrit: <a href="https://gerrit.ovirt.org/56550" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/56550</a><br>
> > >> > > 19:30:48 Building remotely on <a href="http://fc23-vm07.phx.ovirt.org" rel="noreferrer" target="_blank">fc23-vm07.phx.ovirt.org</a> (fc23 nested)<br>
> > >> in<br>
> > >> > > workspace /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64<br>
> > >> > > 19:30:48 > git rev-parse --is-inside-work-tree # timeout=10<br>
> > >> > > 19:30:49 Fetching changes from the remote Git repository<br>
> > >> > > 19:30:49 > git config remote.origin.url<br>
> > >> > > git://<a href="http://gerrit.ovirt.org/vdsm.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/vdsm.git</a> # timeout=10<br>
> > >> > > 19:30:49 Cleaning workspace<br>
> > >> > > 19:30:49 > git rev-parse --verify HEAD # timeout=10<br>
> > >> > > 19:30:49 Resetting working tree<br>
> > >> > > 19:30:49 > git reset --hard # timeout=10<br>
> > >> > > 19:30:49 > git clean -fdx # timeout=10<br>
> > >> > > 19:30:49 Pruning obsolete local branches<br>
> > >> > > 19:30:49 Fetching upstream changes from git://<br>
> > >> <a href="http://gerrit.ovirt.org/vdsm.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/vdsm.git</a><br>
> > >> > > 19:30:49 > git --version # timeout=10<br>
> > >> > > 19:30:49 > git -c core.askpass=true fetch --tags --progress<br>
> > >> > > git://<a href="http://gerrit.ovirt.org/vdsm.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/vdsm.git</a> refs/changes/50/56550/6 --prune<br>
> > >> > > 19:30:52 > git rev-parse<br>
> > >> > > 0940208483f3a21261eb5d725348e65c23becdc0^{commit} # timeout=10<br>
> > >> > > 19:30:52 Checking out Revision<br>
> > >> 0940208483f3a21261eb5d725348e65c23becdc0 (master)<br>
> > >> > > 19:30:52 > git config core.sparsecheckout # timeout=10<br>
> > >> > > 19:30:52 > git checkout -f 0940208483f3a21261eb5d725348e65c23becdc0<br>
> > >> > > 19:30:52 > git rev-parse FETCH_HEAD^{commit} # timeout=10<br>
> > >> > > 19:30:52 > git rev-list a09c577837b939096f97108fdbbcafe5980d4a0d #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git branch -a # timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/master^{commit} # timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.1^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.2^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.3^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.3.0^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.4^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.5^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.5-gluster^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.5.0^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.5.2^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.5.4^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.5.6^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.6^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.6.0^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.6.1^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.6.2^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:52 > git rev-parse remotes/origin/ovirt-3.6.3^{commit} #<br>
> > >> timeout=10<br>
> > >> > > 19:30:53 > git rev-parse --is-inside-work-tree # timeout=10<br>
> > >> > > 19:30:53 Fetching changes from the remote Git repository<br>
> > >> > > 19:30:53 > git config remote.origin.url<br>
> > >> > > git://<a href="http://gerrit.ovirt.org/jenkins.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/jenkins.git</a> # timeout=10<br>
> > >> > > 19:30:53 Cleaning workspace<br>
> > >> > > 19:30:53 > git rev-parse --verify HEAD # timeout=10<br>
> > >> > > 19:30:53 Resetting working tree<br>
> > >> > > 19:30:53 > git reset --hard # timeout=10<br>
> > >> > > 19:30:53 > git clean -fdx # timeout=10<br>
> > >> > > 19:30:53 Pruning obsolete local branches<br>
> > >> > > 19:30:53 Fetching upstream changes from git://<br>
> > >> <a href="http://gerrit.ovirt.org/jenkins.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/jenkins.git</a><br>
> > >> > > 19:30:53 > git --version # timeout=10<br>
> > >> > > 19:30:53 > git -c core.askpass=true fetch --tags --progress<br>
> > >> > > git://<a href="http://gerrit.ovirt.org/jenkins.git" rel="noreferrer" target="_blank">gerrit.ovirt.org/jenkins.git</a><br>
> > >> +refs/heads/*:refs/remotes/origin/*<br>
> > >> > > --prune<br>
> > >> > > 19:30:53 > git rev-parse origin/master^{commit} # timeout=10<br>
> > >> > > 19:30:53 Checking out Revision<br>
> > >> > > 68a517c3ccc1fe58a6c52646e3a99f3ab22ddab9 (origin/master)<br>
> > >> > > 19:30:53 > git config core.sparsecheckout # timeout=10<br>
> > >> > > 19:30:53 > git checkout -f 68a517c3ccc1fe58a6c52646e3a99f3ab22ddab9<br>
> > >> > > 19:30:53 > git rev-list 68a517c3ccc1fe58a6c52646e3a99f3ab22ddab9 #<br>
> > >> timeout=10<br>
> > >> > > 19:30:53 > git branch -a # timeout=10<br>
> > >> > > 19:30:53 > git rev-parse remotes/origin/master^{commit} # timeout=10<br>
> > >> > > 19:30:53 [vdsm_master_check-patch-el7-x86_64] $ /bin/bash -e<br>
> > >> > > /tmp/hudson8265618520208925180.sh<br>
> > >> > > 19:30:53 shell-scripts/cleanup_slave.sh<br>
> > >> > > 19:30:53<br>
> > >> ###################################################################<br>
> > >> > > 19:30:53 # Cleaning up slave<br>
> > >> #<br>
> > >> > > 19:30:53<br>
> > >> ###################################################################<br>
> > >> > > 19:30:53 Filesystem Size Used Avail<br>
> > >> > > Use% Mounted on<br>
> > >> > > 19:30:53 devtmpfs 3.9G 0<br>
> > >> 3.9G 0% /dev<br>
> > >> > > 19:30:53 tmpfs 3.9G 0 3.9G<br>
> > >> > > 0% /dev/shm<br>
> > >> > > 19:30:53 tmpfs 3.9G 2.1M<br>
> > >> 3.9G 1% /run<br>
> > >> > > 19:30:53 tmpfs 3.9G 0 3.9G<br>
> > >> > > 0% /sys/fs/cgroup<br>
> > >> > > 19:30:53 /dev/mapper/fedora--server_fc23--base-root 35G 6.4G<br>
> > >> 27G 20% /<br>
> > >> > > 19:30:53 tmpfs 3.9G 244K<br>
> > >> 3.9G 1% /tmp<br>
> > >> > > 19:30:53 /dev/vda1 988M 94M<br>
> > >> 828M 11% /boot<br>
> > >> > > 19:30:53 tmpfs 799M 0 799M<br>
> > >> > > 0% /run/user/1000<br>
> > >> > > 19:30:53<br>
> > >> ---------------------------------------------------------------<br>
> > >> > > 19:30:53 Cleaning up postgres databases<br>
> > >> > > 19:30:53 Postgres installation not found, skipping<br>
> > >> > > 19:30:53 Cleaning up journal logs (if any)<br>
> > >> > > 19:30:53 Redirecting to /bin/systemctl restart<br>
> > >> systemd-journald.service<br>
> > >> > > 19:30:54 Cleaning up /var/tmp<br>
> > >> > > 19:30:54 done<br>
> > >> > > 19:30:54 Emptying some common logs<br>
> > >> > > 19:30:54 /var/log/wtmp<br>
> > >> > > 19:30:54 Done<br>
> > >> > > 19:30:54 Making sure there are no device mappings...<br>
> > >> > > 19:30:54 Removing the used loop devices...<br>
> > >> > > 19:30:54 Redirecting to /bin/systemctl restart libvirtd.service<br>
> > >> > > 19:30:54<br>
> > >> ---------------------------------------------------------------<br>
> > >> > > 19:30:54 Filesystem Size Used Avail<br>
> > >> > > Use% Mounted on<br>
> > >> > > 19:30:54 devtmpfs 3.9G 0<br>
> > >> 3.9G 0% /dev<br>
> > >> > > 19:30:54 tmpfs 3.9G 0 3.9G<br>
> > >> > > 0% /dev/shm<br>
> > >> > > 19:30:54 tmpfs 3.9G 2.1M<br>
> > >> 3.9G 1% /run<br>
> > >> > > 19:30:54 tmpfs 3.9G 0 3.9G<br>
> > >> > > 0% /sys/fs/cgroup<br>
> > >> > > 19:30:54 /dev/mapper/fedora--server_fc23--base-root 35G 6.4G<br>
> > >> 27G 20% /<br>
> > >> > > 19:30:54 tmpfs 3.9G 244K<br>
> > >> 3.9G 1% /tmp<br>
> > >> > > 19:30:54 /dev/vda1 988M 94M<br>
> > >> 828M 11% /boot<br>
> > >> > > 19:30:54 tmpfs 799M 0 799M<br>
> > >> > > 0% /run/user/1000<br>
> > >> > > 19:30:54<br>
> > >> ###################################################################<br>
> > >> > > 19:30:54 # Slave cleanup done<br>
> > >> #<br>
> > >> > > 19:30:54<br>
> > >> ###################################################################<br>
> > >> > > 19:30:54 [vdsm_master_check-patch-el7-x86_64] $ /bin/bash -xe<br>
> > >> > > /tmp/hudson7354644880288923842.sh<br>
> > >> > > 19:30:54 + echo shell-scripts/global_setup.sh<br>
> > >> > > 19:30:54 shell-scripts/global_setup.sh<br>
> > >> > > 19:30:54 + rm -rf<br>
> > >> /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/tmp<br>
> > >> > > 19:30:54 + mkdir -p<br>
> > >> > > /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/tmp<br>
> > >> > > 19:30:54 [vdsm_master_check-patch-el7-x86_64] $ /bin/bash -xe<br>
> > >> > > /tmp/hudson4023353013258685526.sh<br>
> > >> > > 19:30:54 + echo shell-scripts/mock_setup.sh<br>
> > >> > > 19:30:54 shell-scripts/mock_setup.sh<br>
> > >> > > 19:30:54 + shopt -s nullglob<br>
> > >> > > 19:30:54 + [[ '' == \t\r\u\e ]]<br>
> > >> > > 19:30:54 + failed=false<br>
> > >> > > 19:30:54 +<br>
> > >> mock_dir=/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/mock<br>
> > >> > > 19:30:54 + chroots=("$WORKSPACE"/mock/*)<br>
> > >> > > 19:30:54 + false<br>
> > >> > > 19:30:54 + sudo rm -Rf mock mock-cache exported-artifacts<br>
> > >> > > 19:30:54 + mkdir -p mock exported-artifacts<br>
> > >> > > 19:30:54 + chgrp mock mock<br>
> > >> > > /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64<br>
> > >> > ><br>
> > >> /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/exported-artifacts<br>
> > >> > > 19:30:54 + chmod g+rws mock<br>
> > >> > > 19:30:54 + sudo touch<br>
> > >> > > 19:30:54 + :<br>
> > >> > > 19:30:54 + sudo yum clean all<br>
> > >> > > 19:30:54 Yum command has been deprecated, redirecting to '/usr/bin/dnf<br>
> > >> > > clean all'.<br>
> > >> > > 19:30:54 See 'man dnf' and 'man yum2dnf' for more information.<br>
> > >> > > 19:30:54 To transfer transaction metadata from yum to DNF, run:<br>
> > >> > > 19:30:54 'dnf install python-dnf-plugins-extras-migrate && dnf-2<br>
> > >> migrate'<br>
> > >> > > 19:30:54<br>
> > >> > > 19:30:55 Cleaning repos: updates ci-tools fedora<br>
> > >> > > 19:30:55 Cleaning up Everything<br>
> > >> > > 19:30:55 + exit 0<br>
> > >> > > 19:30:55 [vdsm_master_check-patch-el7-x86_64] $ /bin/bash -e<br>
> > >> > > /tmp/hudson4405890361943185034.sh<br>
> > >> > > 19:30:55 shell-scripts/standard_check_patch.sh<br>
> > >> > > 19:30:55 ##########################################################<br>
> > >> > > 19:30:55 ##########################################################<br>
> > >> > > 19:30:55 ## Sun May 15 15:30:55 EDT 2016 Running env:<br>
> > >> el7:epel-7-x86_64<br>
> > >> > > 19:30:55 ##########################################################<br>
> > >> > > 19:30:55<br>
> > >> @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@<br>
> > >> > > 19:30:55 @@ Sun May 15 15:30:55 EDT 2016 Running chroot for script:<br>
> > >> > > automation/check-patch.sh<br>
> > >> > > 19:30:55<br>
> > >> @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@<br>
> > >> > > 19:30:55 Using base mock conf<br>
> > >> > ><br>
> > >> /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/jenkins/mock_configs/epel-7-x86_64.cfg<br>
> > >> > > 19:30:55 Using proxified config<br>
> > >> > ><br>
> > >> /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/jenkins/mock_configs/epel-7-x86_64_proxied.cfg<br>
> > >> > > 19:30:55 Generating temporary mock conf<br>
> > >> > ><br>
> > >> /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/mocker-epel-7-x86_64.el7<br>
> > >> > > 19:30:55 Skipping mount points<br>
> > >> > > 19:30:55 Using temp chroot =<br>
> > >> epel-7-x86_64-46ef12ce4362729a0f4c411e00edd8fc<br>
> > >> > > 19:30:55 Adding repo ovirt-snapshot -><br>
> > >> > > <a href="http://resources.ovirt.org/pub/ovirt-master-snapshot/rpm/el7" rel="noreferrer" target="_blank">http://resources.ovirt.org/pub/ovirt-master-snapshot/rpm/el7</a><br>
> > >> > > 19:30:55 Adding repo ovirt-snapshot-static -><br>
> > >> > > <a href="http://resources.ovirt.org/pub/ovirt-master-snapshot-static/rpm/el7" rel="noreferrer" target="_blank">http://resources.ovirt.org/pub/ovirt-master-snapshot-static/rpm/el7</a><br>
> > >> > > 19:30:55 Adding repo centos-glusterfs -><br>
> > >> > > <a href="http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.7/" rel="noreferrer" target="_blank">http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.7/</a><br>
> > >> > > 19:30:55 Adding repo centos-ovirt40-candidate -><br>
> > >> > > <a href="http://cbs.centos.org/repos/virt7-ovirt-40-candidate/x86_64/os/" rel="noreferrer" target="_blank">http://cbs.centos.org/repos/virt7-ovirt-40-candidate/x86_64/os/</a><br>
> > >> > > 19:30:55 Adding repo lago -><br>
> > >> > > <a href="http://resources.ovirt.org/repos/lago/stable/0.0/rpm/el7" rel="noreferrer" target="_blank">http://resources.ovirt.org/repos/lago/stable/0.0/rpm/el7</a><br>
> > >> > > 19:30:55 Adding repo epel -><br>
> > >> <a href="http://download.fedoraproject.org/pub/epel/7/x86_64" rel="noreferrer" target="_blank">http://download.fedoraproject.org/pub/epel/7/x86_64</a><br>
> > >> > > 19:30:55 ========== Initializing chroot<br>
> > >> > > 19:30:55 mock \<br>
> > >> > > 19:30:55<br>
> > >> > ><br>
> > >> --configdir="/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm"<br>
> > >> > > \<br>
> > >> > > 19:30:55 --root="mocker-epel-7-x86_64.el7" \<br>
> > >> > > 19:30:55 --resultdir="logs/mocker-epel-7-x86_64.el7.init" \<br>
> > >> > > 19:30:55 --init<br>
> > >> > > 19:30:55 WARNING: Could not find required logging config file:<br>
> > >> > ><br>
> > >> /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/logging.ini.<br>
> > >> > > Using default...<br>
> > >> > > 19:30:55 INFO: mock.py version 1.2.14 starting (python version =<br>
> > >> 3.4.3)...<br>
> > >> > > 19:30:55 Start: init plugins<br>
> > >> > > 19:30:55 INFO: selinux enabled<br>
> > >> > > 19:30:55 Finish: init plugins<br>
> > >> > > 19:30:55 Start: run<br>
> > >> > > 19:30:55 Start: clean chroot<br>
> > >> > > 19:30:55 Finish: clean chroot<br>
> > >> > > 19:30:55 Start: chroot init<br>
> > >> > > 19:30:55 INFO: calling preinit hooks<br>
> > >> > > 19:30:55 INFO: enabled root cache<br>
> > >> > > 19:30:55 INFO: enabled yum cache<br>
> > >> > > 19:30:55 Start: cleaning yum metadata<br>
> > >> > > 19:30:55 Finish: cleaning yum metadata<br>
> > >> > > 19:30:55 INFO: enabled ccache<br>
> > >> > > 19:30:55 Mock Version: 1.2.14<br>
> > >> > > 19:30:55 INFO: Mock Version: 1.2.14<br>
> > >> > > 19:30:56 Start: yum install<br>
> > >> > > 19:31:03 ERROR: Command failed. See logs for output.<br>
> > >> > > 19:31:03 # /usr/bin/yum-deprecated --installroot<br>
> > >> > > /var/lib/mock/epel-7-x86_64-46ef12ce4362729a0f4c411e00edd8fc/root/<br>
> > >> > > --releasever 7 install @buildsys-build --setopt=tsflags=nocontexts<br>
> > >> > > 19:31:03 Init took 8 seconds<br>
> > >> > > 19:31:03 ============================<br>
> > >> > > 19:31:03<br>
> > >> @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@<br>
> > >> > > 19:31:03 @@ Sun May 15 15:31:03 EDT 2016 automation/check-patch.sh<br>
> > >> > > chroot finished<br>
> > >> > > 19:31:03 @@ took 8 seconds<br>
> > >> > > 19:31:03 @@ rc = 1<br>
> > >> > > 19:31:03<br>
> > >> @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@<br>
> > >> > > 19:31:03 ##########################################################<br>
> > >> > > 19:31:03 ## Sun May 15 15:31:03 EDT 2016 Finished env:<br>
> > >> el7:epel-7-x86_64<br>
> > >> > > 19:31:03 ## took 8 seconds<br>
> > >> > > 19:31:03 ## rc = 1<br>
> > >> > > 19:31:03 ##########################################################<br>
> > >> > > 19:31:03 ##! ERROR vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv<br>
> > >> > > 19:31:03 ##! Last 20 log enties:<br>
> > >> > > logs/mocker-epel-7-x86_64.el7.init/stdout_stderr.log<br>
> > >> > > 19:31:03 ##!<br>
> > >> > > 19:31:03 ========== Initializing chroot<br>
> > >> > > 19:31:03 mock \<br>
> > >> > > 19:31:03<br>
> > >> > ><br>
> > >> --configdir="/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm"<br>
> > >> > > \<br>
> > >> > > 19:31:03 --root="mocker-epel-7-x86_64.el7" \<br>
> > >> > > 19:31:03 --resultdir="logs/mocker-epel-7-x86_64.el7.init" \<br>
> > >> > > 19:31:03 --init<br>
> > >> > > 19:31:03 Init took 8 seconds<br>
> > >> > > 19:31:03 ============================<br>
> > >> > > 19:31:03 ##!<br>
> > >> > > 19:31:03 ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^<br>
> > >> > > 19:31:03 ##!########################################################<br>
> > >> > > 19:31:03 Build step 'Execute shell' marked build as failure<br>
> > >> > > 19:31:03 Performing Post build task...<br>
> > >> > > 19:31:03 Match found for :.* : True<br>
> > >> > > 19:31:03 Logical operation result is TRUE<br>
> > >> > > 19:31:03 Running script : #!/bin/bash -xe<br>
> > >> > > 19:31:03 echo "shell-scripts/mock_cleanup.sh"<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 shopt -s nullglob<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 WORKSPACE="$PWD"<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 # Make clear this is the cleanup, helps reading the jenkins<br>
> > >> logs<br>
> > >> > > 19:31:03 cat <<EOC<br>
> > >> > > 19:31:03<br>
> > >> _______________________________________________________________________<br>
> > >> > > 19:31:03<br>
> > >> #######################################################################<br>
> > >> > > 19:31:03 #<br>
> > >> #<br>
> > >> > > 19:31:03 # CLEANUP<br>
> > >> #<br>
> > >> > > 19:31:03 #<br>
> > >> #<br>
> > >> > > 19:31:03<br>
> > >> #######################################################################<br>
> > >> > > 19:31:03 EOC<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 # Archive the logs, we want them anyway<br>
> > >> > > 19:31:03 logs=(<br>
> > >> > > 19:31:03 ./*log<br>
> > >> > > 19:31:03 ./*/logs<br>
> > >> > > 19:31:03 )<br>
> > >> > > 19:31:03 if [[ "$logs" ]]; then<br>
> > >> > > 19:31:03 tar cvzf exported-artifacts/logs.tgz "${logs[@]}"<br>
> > >> > > 19:31:03 rm -rf "${logs[@]}"<br>
> > >> > > 19:31:03 fi<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 # stop any processes running inside the chroot<br>
> > >> > > 19:31:03 failed=false<br>
> > >> > > 19:31:03 mock_confs=("$WORKSPACE"/*/mocker*)<br>
> > >> > > 19:31:03 # Clean current jobs mockroot if any<br>
> > >> > > 19:31:03 for mock_conf_file in "${mock_confs[@]}"; do<br>
> > >> > > 19:31:03 [[ "$mock_conf_file" ]] || continue<br>
> > >> > > 19:31:03 echo "Cleaning up mock $mock_conf"<br>
> > >> > > 19:31:03 mock_root="${mock_conf_file##*/}"<br>
> > >> > > 19:31:03 mock_root="${mock_root%.*}"<br>
> > >> > > 19:31:03 my_mock="/usr/bin/mock"<br>
> > >> > > 19:31:03 my_mock+=" --configdir=${mock_conf_file%/*}"<br>
> > >> > > 19:31:03 my_mock+=" --root=${mock_root}"<br>
> > >> > > 19:31:03 my_mock+=" --resultdir=$WORKSPACE"<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 #TODO: investigate why mock --clean fails to umount<br>
> > >> > > certain dirs sometimes,<br>
> > >> > > 19:31:03 #so we can use it instead of manually doing all this.<br>
> > >> > > 19:31:03 echo "Killing all mock orphan processes, if any."<br>
> > >> > > 19:31:03 $my_mock \<br>
> > >> > > 19:31:03 --orphanskill \<br>
> > >> > > 19:31:03 || {<br>
> > >> > > 19:31:03 echo "ERROR: Failed to kill orphans on $chroot."<br>
> > >> > > 19:31:03 failed=true<br>
> > >> > > 19:31:03 }<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 mock_root="$(\<br>
> > >> > > 19:31:03 grep \<br>
> > >> > > 19:31:03 -Po "(?<=config_opts\['root'\] = ')[^']*" \<br>
> > >> > > 19:31:03 "$mock_conf_file" \<br>
> > >> > > 19:31:03 )" || :<br>
> > >> > > 19:31:03 [[ "$mock_root" ]] || continue<br>
> > >> > > 19:31:03 mounts=($(mount | awk '{print $3}' | grep "$mock_root"))<br>
> > >> || :<br>
> > >> > > 19:31:03 if [[ "$mounts" ]]; then<br>
> > >> > > 19:31:03 echo "Found mounted dirs inside the chroot $chroot.<br>
> > >> > > Trying to umount."<br>
> > >> > > 19:31:03 fi<br>
> > >> > > 19:31:03 for mount in "${mounts[@]}"; do<br>
> > >> > > 19:31:03 sudo umount "$mount" \<br>
> > >> > > 19:31:03 || {<br>
> > >> > > 19:31:03 echo "ERROR: Failed to umount $mount."<br>
> > >> > > 19:31:03 failed=true<br>
> > >> > > 19:31:03 }<br>
> > >> > > 19:31:03 done<br>
> > >> > > 19:31:03 done<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 # Clean any leftover chroot from other jobs<br>
> > >> > > 19:31:03 for mock_root in /var/lib/mock/*; do<br>
> > >> > > 19:31:03 this_chroot_failed=false<br>
> > >> > > 19:31:03 mounts=($(mount | awk '{print $3}' | grep "$mock_root"))<br>
> > >> || :<br>
> > >> > > 19:31:03 if [[ "$mounts" ]]; then<br>
> > >> > > 19:31:03 echo "Found mounted dirs inside the chroot<br>
> > >> $mock_root." \<br>
> > >> > > 19:31:03 "Trying to umount."<br>
> > >> > > 19:31:03 fi<br>
> > >> > > 19:31:03 for mount in "${mounts[@]}"; do<br>
> > >> > > 19:31:03 sudo umount "$mount" \<br>
> > >> > > 19:31:03 || {<br>
> > >> > > 19:31:03 echo "ERROR: Failed to umount $mount."<br>
> > >> > > 19:31:03 failed=true<br>
> > >> > > 19:31:03 this_chroot_failed=true<br>
> > >> > > 19:31:03 }<br>
> > >> > > 19:31:03 done<br>
> > >> > > 19:31:03 if ! $this_chroot_failed; then<br>
> > >> > > 19:31:03 sudo rm -rf "$mock_root"<br>
> > >> > > 19:31:03 fi<br>
> > >> > > 19:31:03 done<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 if $failed; then<br>
> > >> > > 19:31:03 echo "Aborting."<br>
> > >> > > 19:31:03 exit 1<br>
> > >> > > 19:31:03 fi<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 # remove mock system cache, we will setup proxies to do the<br>
> > >> > > caching and this<br>
> > >> > > 19:31:03 # takes lots of space between runs<br>
> > >> > > 19:31:03 shopt -u nullglob<br>
> > >> > > 19:31:03 sudo rm -Rf /var/cache/mock/*<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 # restore the permissions in the working dir, as sometimes it<br>
> > >> > > leaves files<br>
> > >> > > 19:31:03 # owned by root and then the 'cleanup workspace' from jenkins<br>
> > >> > > job fails to<br>
> > >> > > 19:31:03 # clean and breaks the jobs<br>
> > >> > > 19:31:03 sudo chown -R "$USER" "$WORKSPACE"<br>
> > >> > > 19:31:03<br>
> > >> > > 19:31:03 [vdsm_master_check-patch-el7-x86_64] $ /bin/bash -xe<br>
> > >> > > /tmp/hudson3681642653853563663.sh<br>
> > >> > > 19:31:03 + echo shell-scripts/mock_cleanup.sh<br>
> > >> > > 19:31:03 shell-scripts/mock_cleanup.sh<br>
> > >> > > 19:31:03 + shopt -s nullglob<br>
> > >> > > 19:31:03 +<br>
> > >> WORKSPACE=/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64<br>
> > >> > > 19:31:03 + cat<br>
> > >> > > 19:31:03<br>
> > >> _______________________________________________________________________<br>
> > >> > > 19:31:03<br>
> > >> #######################################################################<br>
> > >> > > 19:31:03 #<br>
> > >> #<br>
> > >> > > 19:31:03 # CLEANUP<br>
> > >> #<br>
> > >> > > 19:31:03 #<br>
> > >> #<br>
> > >> > > 19:31:03<br>
> > >> #######################################################################<br>
> > >> > > 19:31:03 + logs=(./*log ./*/logs)<br>
> > >> > > 19:31:03 + [[ -n ./vdsm/logs ]]<br>
> > >> > > 19:31:03 + tar cvzf exported-artifacts/logs.tgz ./vdsm/logs<br>
> > >> > > 19:31:03 ./vdsm/logs/<br>
> > >> > > 19:31:03 ./vdsm/logs/mocker-epel-7-x86_64.el7.init/<br>
> > >> > > 19:31:03 ./vdsm/logs/mocker-epel-7-x86_64.el7.init/root.log<br>
> > >> > > 19:31:03 ./vdsm/logs/mocker-epel-7-x86_64.el7.init/state.log<br>
> > >> > > 19:31:03 ./vdsm/logs/mocker-epel-7-x86_64.el7.init/stdout_stderr.log<br>
> > >> > > 19:31:03 ./vdsm/logs/mocker-epel-7-x86_64.el7.init/build.log<br>
> > >> > > 19:31:03 + rm -rf ./vdsm/logs<br>
> > >> > > 19:31:03 + failed=false<br>
> > >> > > 19:31:03 + mock_confs=("$WORKSPACE"/*/mocker*)<br>
> > >> > > 19:31:03 + for mock_conf_file in '"${mock_confs[@]}"'<br>
> > >> > > 19:31:03 + [[ -n<br>
> > >> > ><br>
> > >> /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/mocker-epel-7-x86_64.el7.cfg<br>
> > >> > > ]]<br>
> > >> > > 19:31:03 + echo 'Cleaning up mock '<br>
> > >> > > 19:31:03 Cleaning up mock<br>
> > >> > > 19:31:03 + mock_root=mocker-epel-7-x86_64.el7.cfg<br>
> > >> > > 19:31:03 + mock_root=mocker-epel-7-x86_64.el7<br>
> > >> > > 19:31:03 + my_mock=/usr/bin/mock<br>
> > >> > > 19:31:03 + my_mock+='<br>
> > >> > ><br>
> > >> --configdir=/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm'<br>
> > >> > > 19:31:03 + my_mock+=' --root=mocker-epel-7-x86_64.el7'<br>
> > >> > > 19:31:03 + my_mock+='<br>
> > >> > ><br>
> > >> --resultdir=/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64'<br>
> > >> > > 19:31:03 + echo 'Killing all mock orphan processes, if any.'<br>
> > >> > > 19:31:03 Killing all mock orphan processes, if any.<br>
> > >> > > 19:31:03 + /usr/bin/mock<br>
> > >> > ><br>
> > >> --configdir=/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm<br>
> > >> > > --root=mocker-epel-7-x86_64.el7<br>
> > >> > > --resultdir=/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64<br>
> > >> > > --orphanskill<br>
> > >> > > 19:31:04 WARNING: Could not find required logging config file:<br>
> > >> > ><br>
> > >> /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/logging.ini.<br>
> > >> > > Using default...<br>
> > >> > > 19:31:04 INFO: mock.py version 1.2.14 starting (python version =<br>
> > >> 3.4.3)...<br>
> > >> > > 19:31:04 Start: init plugins<br>
> > >> > > 19:31:04 INFO: selinux enabled<br>
> > >> > > 19:31:04 Finish: init plugins<br>
> > >> > > 19:31:04 Start: run<br>
> > >> > > 19:31:04 Finish: run<br>
> > >> > > 19:31:04 ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*'<br>
> > >> > ><br>
> > >> /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/mocker-epel-7-x86_64.el7.cfg<br>
> > >> > > 19:31:04 + mock_root=epel-7-x86_64-46ef12ce4362729a0f4c411e00edd8fc<br>
> > >> > > 19:31:04 + [[ -n epel-7-x86_64-46ef12ce4362729a0f4c411e00edd8fc ]]<br>
> > >> > > 19:31:04 + mounts=($(mount | awk '{print $3}' | grep "$mock_root"))<br>
> > >> > > 19:31:04 ++ mount<br>
> > >> > > 19:31:04 ++ grep epel-7-x86_64-46ef12ce4362729a0f4c411e00edd8fc<br>
> > >> > > 19:31:04 ++ awk '{print $3}'<br>
> > >> > > 19:31:04 + :<br>
> > >> > > 19:31:04 + [[ -n '' ]]<br>
> > >> > > 19:31:04 + for mock_root in '/var/lib/mock/*'<br>
> > >> > > 19:31:04 + this_chroot_failed=false<br>
> > >> > > 19:31:04 + mounts=($(mount | awk '{print $3}' | grep "$mock_root"))<br>
> > >> > > 19:31:04 ++ mount<br>
> > >> > > 19:31:04 ++ grep<br>
> > >> /var/lib/mock/epel-7-x86_64-46ef12ce4362729a0f4c411e00edd8fc<br>
> > >> > > 19:31:04 ++ awk '{print $3}'<br>
> > >> > > 19:31:04 + :<br>
> > >> > > 19:31:04 + [[ -n '' ]]<br>
> > >> > > 19:31:04 + false<br>
> > >> > > 19:31:04 + sudo rm -rf<br>
> > >> > > /var/lib/mock/epel-7-x86_64-46ef12ce4362729a0f4c411e00edd8fc<br>
> > >> > > 19:31:04 + false<br>
> > >> > > 19:31:04 + shopt -u nullglob<br>
> > >> > > 19:31:04 + sudo rm -Rf<br>
> > >> > > /var/cache/mock/epel-7-x86_64-46ef12ce4362729a0f4c411e00edd8fc<br>
> > >> > > 19:31:04 + sudo chown -R jenkins<br>
> > >> > > /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64<br>
> > >> > > 19:31:04 POST BUILD TASK : SUCCESS<br>
> > >> > > 19:31:04 END OF POST BUILD TASK : 0<br>
> > >> > > 19:31:04 Archiving artifacts<br>
> > >> > > 19:31:04 Build step 'Groovy Postbuild' marked build as failure<br>
> > >> > > 19:31:04 Started calculate disk usage of build<br>
> > >> > > 19:31:04 Finished Calculation of disk usage of build in 0 seconds<br>
> > >> > > 19:31:04 Started calculate disk usage of workspace<br>
> > >> > > 19:31:04 Finished Calculation of disk usage of workspace in 0 seconds<br>
> > >> > > 19:31:04 Finished: FAILURE<br>
> > >> > _______________________________________________<br>
> > >> > Infra mailing list<br>
> > >> > <a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
> > >> > <a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/infra</a><br>
> > >><br>
> > >> --<br>
> > >> David Caro<br>
> > >><br>
> > >> Red Hat S.L.<br>
> > >> Continuous Integration Engineer - EMEA ENG Virtualization R&D<br>
> > >><br>
> > >> Tel.: +420 532 294 605<br>
> > >> Email: <a href="mailto:dcaro@redhat.com">dcaro@redhat.com</a><br>
> > >> IRC: dcaro|dcaroest@{freenode|oftc|redhat}<br>
> > >> Web: <a href="http://www.redhat.com" rel="noreferrer" target="_blank">www.redhat.com</a><br>
> > >> RHT Global #: 82-62605<br>
> > >><br>
> > >> _______________________________________________<br>
> > >> Infra mailing list<br>
> > >> <a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
> > >> <a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/infra</a><br>
> > >><br>
> > >><br>
> > > _______________________________________________<br>
> > > Infra mailing list<br>
> > > <a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
> > > <a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/infra</a><br>
> > ><br>
> > ><br>
><br>
> --<br>
> David Caro<br>
><br>
> Red Hat S.L.<br>
> Continuous Integration Engineer - EMEA ENG Virtualization R&D<br>
><br>
> Tel.: +420 532 294 605<br>
> Email: <a href="mailto:dcaro@redhat.com">dcaro@redhat.com</a><br>
> IRC: dcaro|dcaroest@{freenode|oftc|redhat}<br>
> Web: <a href="http://www.redhat.com" rel="noreferrer" target="_blank">www.redhat.com</a><br>
> RHT Global #: 82-62605<br>
<br>
<br>
<br>
--<br>
David Caro<br>
<br>
Red Hat S.L.<br>
Continuous Integration Engineer - EMEA ENG Virtualization R&D<br>
<br>
Tel.: +420 532 294 605<br>
Email: <a href="mailto:dcaro@redhat.com">dcaro@redhat.com</a><br>
IRC: dcaro|dcaroest@{freenode|oftc|redhat}<br>
Web: <a href="http://www.redhat.com" rel="noreferrer" target="_blank">www.redhat.com</a><br>
RHT Global #: 82-62605<br>
</div></div></blockquote></div><br></div>