Hi all, All the vdsm builds seem to fail now because of this error: 23:11:19 + loops=($(losetup -a | grep -E "$WORKSPACE|\(build/disk" | awk '{print $1}' | sed -e 's/://')) 23:11:19 ++ losetup -a 23:11:19 /tmp/hudson7768123740643865272.sh: line 80: losetup: command not found 23:11:19 ++ grep -E '/home/jenkins/workspace/vdsm_master_check-patch-fc23-x86_64|\(build/disk' 23:11:19 ++ awk '{print $1}' 23:11:19 ++ sed -e s/:// 23:11:19 + [[ -n '' ]] 23:11:19 /tmp/hudson7768123740643865272.sh: line 87: syntax error near unexpected token `\ ' 23:11:19 POST BUILD TASK : FAILURE 23:11:19 END OF POST BUILD TASK : 0 23:11:19 ESCALATE FAILED POST BUILD TASK TO JOB STATUS 23:11:19 Build step 'Post build task' changed build result to FAILURE 23:11:19 Archiving artifacts 23:11:22 Build step 'Groovy Postbuild' marked build as failure 23:11:22 Finished: FAILURE See http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/1978/con... Can someone from infra can look into this error?

A recent mock cleanup patch seems to introduce the issue. Someone can merge this revert of the patch until there is a final solution: https://gerrit.ovirt.org/51546 Revert "Clean up after livemedia-creator" - fabian On Fri, Jan 8, 2016 at 8:26 AM, Fabian Deutsch <fdeutsch(a)redhat.com&gt; wrote: > On Fri, Jan 8, 2016 at 12:19 AM, Nir Soffer <nsoffer(a)redhat.com&gt; wrote: >> Hi all, >> >> All the vdsm builds seem to fail now because of this error: >> >> 23:11:19 + loops=($(losetup -a | grep -E "$WORKSPACE|\(build/disk" >> | awk '{print $1}' | sed -e 's/://')) >> 23:11:19 ++ losetup -a >> 23:11:19 /tmp/hudson7768123740643865272.sh: line 80: losetup: command not found >> 23:11:19 ++ grep -E >> '/home/jenkins/workspace/vdsm_master_check-patch-fc23-x86_64|\(build/disk' >> 23:11:19 ++ awk '{print $1}' >> 23:11:19 ++ sed -e s/:// >> 23:11:19 + [[ -n '' ]] >> 23:11:19 /tmp/hudson7768123740643865272.sh: line 87: syntax error near >> unexpected token `\ ' >> 23:11:19 POST BUILD TASK : FAILURE >> 23:11:19 END OF POST BUILD TASK : 0 >> 23:11:19 ESCALATE FAILED POST BUILD TASK TO JOB STATUS >> 23:11:19 Build step 'Post build task' changed build result to FAILURE >> 23:11:19 Archiving artifacts >> 23:11:22 Build step 'Groovy Postbuild' marked build as failure >> 23:11:22 Finished: FAILURE >> >> See http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/1978/con... >> >> Can someone from infra can look into this error? > > +1 > > - fabian -- Fabian Deutsch <fdeutsch(a)redhat.com&gt; RHEV Hypervisor Red Hat

On Fri, Jan 8, 2016 at 3:02 PM, Eyal Edri <eedri(a)redhat.com&gt; wrote: > merged. > > e. Thanks. But it looks like some manual work is needed to cleanup all affected workspaces. git clean -fdx is failing if any file can not be removed - this is the case if any file was caretd while sudo was used. That means that someone needs to clean the workspaces manually, to unblock all affected jobs failing on the git checkout. - fabian > On Fri, Jan 8, 2016 at 10:19 AM, Fabian Deutsch <fdeutsch(a)redhat.com&gt; wrote: >> >> A recent mock cleanup patch seems to introduce the issue. >> >> Someone can merge this revert of the patch until there is a final >> solution: >> >> https://gerrit.ovirt.org/51546 Revert "Clean up after livemedia-creator" >> >> - fabian >> >> On Fri, Jan 8, 2016 at 8:26 AM, Fabian Deutsch <fdeutsch(a)redhat.com&gt; >> wrote: >> > On Fri, Jan 8, 2016 at 12:19 AM, Nir Soffer <nsoffer(a)redhat.com&gt; wrote: >> >> Hi all, >> >> >> >> All the vdsm builds seem to fail now because of this error: >> >> >> >> 23:11:19 + loops=($(losetup -a | grep -E "$WORKSPACE|\(build/disk" >> >> | awk '{print $1}' | sed -e 's/://')) >> >> 23:11:19 ++ losetup -a >> >> 23:11:19 /tmp/hudson7768123740643865272.sh: line 80: losetup: command >> >> not found >> >> 23:11:19 ++ grep -E >> >> >> >> '/home/jenkins/workspace/vdsm_master_check-patch-fc23-x86_64|\(build/disk' >> >> 23:11:19 ++ awk '{print $1}' >> >> 23:11:19 ++ sed -e s/:// >> >> 23:11:19 + [[ -n '' ]] >> >> 23:11:19 /tmp/hudson7768123740643865272.sh: line 87: syntax error near >> >> unexpected token `\ ' >> >> 23:11:19 POST BUILD TASK : FAILURE >> >> 23:11:19 END OF POST BUILD TASK : 0 >> >> 23:11:19 ESCALATE FAILED POST BUILD TASK TO JOB STATUS >> >> 23:11:19 Build step 'Post build task' changed build result to FAILURE >> >> 23:11:19 Archiving artifacts >> >> 23:11:22 Build step 'Groovy Postbuild' marked build as failure >> >> 23:11:22 Finished: FAILURE >> >> >> >> See >> >> http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/1978/con... >> >> >> >> Can someone from infra can look into this error? >> > >> > +1 >> > >> > - fabian >> >> >> >> -- >> Fabian Deutsch <fdeutsch(a)redhat.com&gt; >> RHEV Hypervisor >> Red Hat > > > > > -- > Eyal Edri > Associate Manager > EMEA ENG Virtualization R&D > Red Hat Israel > > phone: +972-9-7692018 > irc: eedri (on #tlv #rhev-dev #rhev-integ) -- Fabian Deutsch <fdeutsch(a)redhat.com&gt; RHEV Hypervisor Red Hat

On Fri, Jan 8, 2016 at 3:29 PM, Eyal Edri <eedri(a)redhat.com&gt; wrote: > Do you know the commands that you run locally in order to do it? rm -rf $WORKSPACE for each affected job on each slave? This is a guess, as I can not access the builders for a detailed review. - fabian > e. > > On Fri, Jan 8, 2016 at 4:25 PM, Fabian Deutsch <fdeutsch(a)redhat.com&gt; wrote: >> >> On Fri, Jan 8, 2016 at 3:02 PM, Eyal Edri <eedri(a)redhat.com&gt; wrote: >> > merged. >> > >> > e. >> >> Thanks. >> >> But it looks like some manual work is needed to cleanup all affected >> workspaces. >> git clean -fdx is failing if any file can not be removed - this is the >> case if any file was caretd while sudo was used. >> >> That means that someone needs to clean the workspaces manually, to >> unblock all affected jobs failing on the git checkout. >> >> - fabian >> >> > On Fri, Jan 8, 2016 at 10:19 AM, Fabian Deutsch <fdeutsch(a)redhat.com&gt; >> > wrote: >> >> >> >> A recent mock cleanup patch seems to introduce the issue. >> >> >> >> Someone can merge this revert of the patch until there is a final >> >> solution: >> >> >> >> https://gerrit.ovirt.org/51546 Revert "Clean up after >> >> livemedia-creator" >> >> >> >> - fabian >> >> >> >> On Fri, Jan 8, 2016 at 8:26 AM, Fabian Deutsch <fdeutsch(a)redhat.com&gt; >> >> wrote: >> >> > On Fri, Jan 8, 2016 at 12:19 AM, Nir Soffer <nsoffer(a)redhat.com&gt; >> >> > wrote: >> >> >> Hi all, >> >> >> >> >> >> All the vdsm builds seem to fail now because of this error: >> >> >> >> >> >> 23:11:19 + loops=($(losetup -a | grep -E >> >> >> "$WORKSPACE|\(build/disk" >> >> >> | awk '{print $1}' | sed -e 's/://')) >> >> >> 23:11:19 ++ losetup -a >> >> >> 23:11:19 /tmp/hudson7768123740643865272.sh: line 80: losetup: >> >> >> command >> >> >> not found >> >> >> 23:11:19 ++ grep -E >> >> >> >> >> >> >> >> >> '/home/jenkins/workspace/vdsm_master_check-patch-fc23-x86_64|\(build/disk' >> >> >> 23:11:19 ++ awk '{print $1}' >> >> >> 23:11:19 ++ sed -e s/:// >> >> >> 23:11:19 + [[ -n '' ]] >> >> >> 23:11:19 /tmp/hudson7768123740643865272.sh: line 87: syntax error >> >> >> near >> >> >> unexpected token `\ ' >> >> >> 23:11:19 POST BUILD TASK : FAILURE >> >> >> 23:11:19 END OF POST BUILD TASK : 0 >> >> >> 23:11:19 ESCALATE FAILED POST BUILD TASK TO JOB STATUS >> >> >> 23:11:19 Build step 'Post build task' changed build result to >> >> >> FAILURE >> >> >> 23:11:19 Archiving artifacts >> >> >> 23:11:22 Build step 'Groovy Postbuild' marked build as failure >> >> >> 23:11:22 Finished: FAILURE >> >> >> >> >> >> See >> >> >> >> >> >> http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/1978/con... >> >> >> >> >> >> Can someone from infra can look into this error? >> >> > >> >> > +1 >> >> > >> >> > - fabian >> >> >> >> >> >> >> >> -- >> >> Fabian Deutsch <fdeutsch(a)redhat.com&gt; >> >> RHEV Hypervisor >> >> Red Hat >> > >> > >> > >> > >> > -- >> > Eyal Edri >> > Associate Manager >> > EMEA ENG Virtualization R&D >> > Red Hat Israel >> > >> > phone: +972-9-7692018 >> > irc: eedri (on #tlv #rhev-dev #rhev-integ) >> >> >> >> -- >> Fabian Deutsch <fdeutsch(a)redhat.com&gt; >> RHEV Hypervisor >> Red Hat > > > > > -- > Eyal Edri > Associate Manager > EMEA ENG Virtualization R&D > Red Hat Israel > > phone: +972-9-7692018 > irc: eedri (on #tlv #rhev-dev #rhev-integ) -- Fabian Deutsch <fdeutsch(a)redhat.com&gt; RHEV Hypervisor Red Hat