- Infra - oVirt List Archives

[JIRA] (OVIRT-2645) [VDSM] Tests mounting loop devices fail randomly again
by Nir Soffer (oVirt JIRA) 09 Jan '19

09 Jan '19

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2645?page=com.atlassian.jira.… ] Nir Soffer commented on OVIRT-2645: ----------------------------------- On Wed, Jan 9, 2019 at 2:25 AM Nir Soffer (oVirt JIRA) < After discussion with Barak and Daniel, we decided to create more loop devices. If this does not fix the issue we will have to invest more time in this. https://gerrit.ovirt.org/c/96752/ > [VDSM] Tests mounting loop devices fail randomly again > ------------------------------------------------------ > > Key: OVIRT-2645 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2645 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Nir Soffer > Assignee: infra > > We had this issue few years ago, and it was solved when we started > to create loop devices to the slave in check-path.sh. > Before we run the tests, we created loop devices. Looking at the log, we > had 5 > nodes and we added 3 nodes - this is typical log. > + create_loop_devices 8 > + local last=7 > + local min > ++ seq 0 7 > + for min in '`seq 0 $last`' > + local name=/dev/loop0 > + '[' '!' -e /dev/loop0 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop1 > + '[' '!' -e /dev/loop1 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop2 > + '[' '!' -e /dev/loop2 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop3 > + '[' '!' -e /dev/loop3 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop4 > + '[' '!' -e /dev/loop4 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop5 > + '[' '!' -e /dev/loop5 ']' > + mknod --mode 0666 /dev/loop5 b 7 5 > + for min in '`seq 0 $last`' > + local name=/dev/loop6 > + '[' '!' -e /dev/loop6 ']' > + mknod --mode 0666 /dev/loop6 b 7 6 > + for min in '`seq 0 $last`' > + local name=/dev/loop7 > + '[' '!' -e /dev/loop7 ']' > + mknod --mode 0666 /dev/loop7 b 7 7 > But mounting images failed later as you can see bellow. > Failed build: > https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_st… > The same tests run fine in travis inside a container: > https://travis-ci.org/nirs/vdsm/jobs/471920126 > Anyone has idea why mounting fail randomly in Jenkins slaves, and how we > can fix this issue? > ====================================================================== > ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content. > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 211, in test_mkFloppyFs > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,720 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/sbin/mkfs.msdos -C > /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img > 1440 -n FSLABEL (cwd None) (commands:198) > 2019-01-08 23:46:19,729 DEBUG (MainThread) [root] SUCCESS: <err> = ''; > <rc> = 0 (commands:219) > 2019-01-08 23:46:19,731 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img > at /tmp/tmpSejvmr (mount:204) > 2019-01-08 23:46:19,731 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -t vfat -o loop > /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img > /tmp/tmpSejvmr (cwd None) (commands:198) > 2019-01-08 23:46:19,743 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- > ====================================================================== > ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content. > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 211, in test_mkFloppyFs > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,750 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/sbin/mkfs.msdos -C > /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img > 1440 (cwd None) (commands:198) > 2019-01-08 23:46:19,759 DEBUG (MainThread) [root] SUCCESS: <err> = ''; > <rc> = 0 (commands:219) > 2019-01-08 23:46:19,761 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img > at /tmp/tmpiDcstj (mount:204) > 2019-01-08 23:46:19,762 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -t vfat -o loop > /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img > /tmp/tmpiDcstj (cwd None) (commands:198) > 2019-01-08 23:46:19,773 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- > ====================================================================== > ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 230, in test_mkFloppyFs_overwrite > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,779 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/sbin/mkfs.msdos -C > /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img > 1440 -n FSLABEL (cwd None) (commands:198) > 2019-01-08 23:46:19,789 DEBUG (MainThread) [root] SUCCESS: <err> = ''; > <rc> = 0 (commands:219) > 2019-01-08 23:46:19,790 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img > at /tmp/tmpX4UcrB (mount:204) > 2019-01-08 23:46:19,791 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -t vfat -o loop > /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img > /tmp/tmpX4UcrB (cwd None) (commands:198) > 2019-01-08 23:46:19,803 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- > ====================================================================== > ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 230, in test_mkFloppyFs_overwrite > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,809 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/sbin/mkfs.msdos -C > /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img > 1440 (cwd None) (commands:198) > 2019-01-08 23:46:19,821 DEBUG (MainThread) [root] SUCCESS: <err> = ''; > <rc> = 0 (commands:219) > 2019-01-08 23:46:19,822 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img > at /tmp/tmpJNTkWb (mount:204) > 2019-01-08 23:46:19,823 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -t vfat -o loop > /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img > /tmp/tmpJNTkWb (cwd None) (commands:198) > 2019-01-08 23:46:19,836 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- > ====================================================================== > ERROR: Tests mkimage.mkIsoFs creating an image and checking its content > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 252, in test_mkIsoFs > m.mount(mntOpts='loop') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << > --------------------Coverage.py warning: Module > /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never > imported. (module-not-imported) > 2019-01-08 23:46:19,851 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mkisofs -R -J -o > /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img > -V fslabel /tmp/tmphPPnKt (cwd None) (commands:198) > 2019-01-08 23:46:19,882 DEBUG (MainThread) [root] SUCCESS: <err> = > 'Total translation table size: 0\nTotal rockridge attributes bytes: > 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk > space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 > (commands:219) > 2019-01-08 23:46:19,885 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img > at /tmp/vdsm-mkimage-testsS16Km7/work (mount:204) > 2019-01-08 23:46:19,886 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -o loop > /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img > /tmp/vdsm-mkimage-testsS16Km7/work (cwd None) (commands:198) > 2019-01-08 23:46:19,898 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- > ====================================================================== > ERROR: Tests mkimage.mkIsoFs creating an image and checking its content > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 252, in test_mkIsoFs > m.mount(mntOpts='loop') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,907 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mkisofs -R -J -o > /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img > /tmp/tmpfk8az9 (cwd None) (commands:198) > 2019-01-08 23:46:19,931 DEBUG (MainThread) [root] SUCCESS: <err> = > 'Total translation table size: 0\nTotal rockridge attributes bytes: > 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk > space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 > (commands:219) > 2019-01-08 23:46:19,933 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img > at /tmp/vdsm-mkimage-testsxv7k7G/work (mount:204) > 2019-01-08 23:46:19,934 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -o loop > /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img > /tmp/vdsm-mkimage-testsxv7k7G/work (cwd None) (commands:198) > 2019-01-08 23:46:19,946 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100097)

1 0

[JIRA] (OVIRT-2645) [VDSM] Tests mounting loop devices fail randomly again
by Nir Soffer (oVirt JIRA) 09 Jan '19

09 Jan '19

Nir Soffer created OVIRT-2645: --------------------------------- Summary: [VDSM] Tests mounting loop devices fail randomly again Key: OVIRT-2645 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2645 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Nir Soffer Assignee: infra We had this issue few years ago, and it was solved when we started to create loop devices to the slave in check-path.sh. Before we run the tests, we created loop devices. Looking at the log, we had 5 nodes and we added 3 nodes - this is typical log. + create_loop_devices 8 + local last=7 + local min ++ seq 0 7 + for min in '`seq 0 $last`' + local name=/dev/loop0 + '[' '!' -e /dev/loop0 ']' + for min in '`seq 0 $last`' + local name=/dev/loop1 + '[' '!' -e /dev/loop1 ']' + for min in '`seq 0 $last`' + local name=/dev/loop2 + '[' '!' -e /dev/loop2 ']' + for min in '`seq 0 $last`' + local name=/dev/loop3 + '[' '!' -e /dev/loop3 ']' + for min in '`seq 0 $last`' + local name=/dev/loop4 + '[' '!' -e /dev/loop4 ']' + for min in '`seq 0 $last`' + local name=/dev/loop5 + '[' '!' -e /dev/loop5 ']' + mknod --mode 0666 /dev/loop5 b 7 5 + for min in '`seq 0 $last`' + local name=/dev/loop6 + '[' '!' -e /dev/loop6 ']' + mknod --mode 0666 /dev/loop6 b 7 6 + for min in '`seq 0 $last`' + local name=/dev/loop7 + '[' '!' -e /dev/loop7 ']' + mknod --mode 0666 /dev/loop7 b 7 7 But mounting images failed later as you can see bellow. Failed build: https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_st… The same tests run fine in travis inside a container: https://travis-ci.org/nirs/vdsm/jobs/471920126 Anyone has idea why mounting fail randomly in Jenkins slaves, and how we can fix this issue? ====================================================================== ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content. ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 211, in test_mkFloppyFs floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs injectFilesToFs(floppy, files, 'vfat') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs m.mount(mntOpts='loop', vfstype=fstype) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << -------------------- 2019-01-08 23:46:19,720 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img 1440 -n FSLABEL (cwd None) (commands:198) 2019-01-08 23:46:19,729 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) 2019-01-08 23:46:19,731 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img at /tmp/tmpSejvmr (mount:204) 2019-01-08 23:46:19,731 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img /tmp/tmpSejvmr (cwd None) (commands:198) 2019-01-08 23:46:19,743 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content. ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 211, in test_mkFloppyFs floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs injectFilesToFs(floppy, files, 'vfat') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs m.mount(mntOpts='loop', vfstype=fstype) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << -------------------- 2019-01-08 23:46:19,750 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img 1440 (cwd None) (commands:198) 2019-01-08 23:46:19,759 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) 2019-01-08 23:46:19,761 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img at /tmp/tmpiDcstj (mount:204) 2019-01-08 23:46:19,762 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img /tmp/tmpiDcstj (cwd None) (commands:198) 2019-01-08 23:46:19,773 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 230, in test_mkFloppyFs_overwrite floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs injectFilesToFs(floppy, files, 'vfat') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs m.mount(mntOpts='loop', vfstype=fstype) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << -------------------- 2019-01-08 23:46:19,779 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img 1440 -n FSLABEL (cwd None) (commands:198) 2019-01-08 23:46:19,789 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) 2019-01-08 23:46:19,790 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img at /tmp/tmpX4UcrB (mount:204) 2019-01-08 23:46:19,791 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img /tmp/tmpX4UcrB (cwd None) (commands:198) 2019-01-08 23:46:19,803 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 230, in test_mkFloppyFs_overwrite floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs injectFilesToFs(floppy, files, 'vfat') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs m.mount(mntOpts='loop', vfstype=fstype) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << -------------------- 2019-01-08 23:46:19,809 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img 1440 (cwd None) (commands:198) 2019-01-08 23:46:19,821 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) 2019-01-08 23:46:19,822 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img at /tmp/tmpJNTkWb (mount:204) 2019-01-08 23:46:19,823 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img /tmp/tmpJNTkWb (cwd None) (commands:198) 2019-01-08 23:46:19,836 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: Tests mkimage.mkIsoFs creating an image and checking its content ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 252, in test_mkIsoFs m.mount(mntOpts='loop') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << --------------------Coverage.py warning: Module /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never imported. (module-not-imported) 2019-01-08 23:46:19,851 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mkisofs -R -J -o /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img -V fslabel /tmp/tmphPPnKt (cwd None) (commands:198) 2019-01-08 23:46:19,882 DEBUG (MainThread) [root] SUCCESS: <err> = 'Total translation table size: 0\nTotal rockridge attributes bytes: 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 (commands:219) 2019-01-08 23:46:19,885 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img at /tmp/vdsm-mkimage-testsS16Km7/work (mount:204) 2019-01-08 23:46:19,886 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -o loop /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img /tmp/vdsm-mkimage-testsS16Km7/work (cwd None) (commands:198) 2019-01-08 23:46:19,898 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: Tests mkimage.mkIsoFs creating an image and checking its content ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 252, in test_mkIsoFs m.mount(mntOpts='loop') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << -------------------- 2019-01-08 23:46:19,907 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mkisofs -R -J -o /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img /tmp/tmpfk8az9 (cwd None) (commands:198) 2019-01-08 23:46:19,931 DEBUG (MainThread) [root] SUCCESS: <err> = 'Total translation table size: 0\nTotal rockridge attributes bytes: 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 (commands:219) 2019-01-08 23:46:19,933 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img at /tmp/vdsm-mkimage-testsxv7k7G/work (mount:204) 2019-01-08 23:46:19,934 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -o loop /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img /tmp/vdsm-mkimage-testsxv7k7G/work (cwd None) (commands:198) 2019-01-08 23:46:19,946 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100097)

2 1

[CQ]: 96621, 3 (ovirt-provider-ovn) failed "ovirt-master" system tests
by oVirt Jenkins 09 Jan '19

09 Jan '19

Change 96621,3 (ovirt-provider-ovn) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/96621/3 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/12251/

2 1

[JIRA] (OVIRT-2646) FC29 Is not compatible with older versions of dnf and yum
by Ehud Yonasi (oVirt JIRA) 09 Jan '19

09 Jan '19

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2646?page=com.atlassian.jira.… ] Ehud Yonasi reassigned OVIRT-2646: ---------------------------------- Assignee: Ehud Yonasi (was: infra) > FC29 Is not compatible with older versions of dnf and yum > --------------------------------------------------------- > > Key: OVIRT-2646 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2646 > Project: oVirt - virtualization made easy > Issue Type: Outage > Reporter: Ehud Yonasi > Assignee: Ehud Yonasi > > FC29 Is not compatible with older versions of dnf and yum, > thus we can't run mock with older versions. > [~ederevea] sent a PR and is trying to fix it on the side of dnf. > I found that what i tested with fc29 running el7 mock had yum-deprecated package that mock > used that package in order to bring mock up. > I will sent a patch to global_setup to add that package to dnf. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100097)

1 0

[JIRA] (OVIRT-2646) FC29 Is not compatible with older versions of dnf and yum
by Ehud Yonasi (oVirt JIRA) 09 Jan '19

09 Jan '19

Ehud Yonasi created OVIRT-2646: ---------------------------------- Summary: FC29 Is not compatible with older versions of dnf and yum Key: OVIRT-2646 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2646 Project: oVirt - virtualization made easy Issue Type: Outage Reporter: Ehud Yonasi Assignee: infra FC29 Is not compatible with older versions of dnf and yum, thus we can't run mock with older versions. [~ederevea] sent a PR and is trying to fix it on the side of dnf. I found that what i tested with fc29 running el7 mock had yum-deprecated package that mock used that package in order to bring mock up. I will sent a patch to global_setup to add that package to dnf. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100097)

1 0

[JIRA] (OVIRT-2645) [VDSM] Tests mounting loop devices fail randomly again
by Daniel Belenky (oVirt JIRA) 09 Jan '19

09 Jan '19

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2645?page=com.atlassian.jira.… ] Daniel Belenky commented on OVIRT-2645: --------------------------------------- Nir, I think that you have a bug in create_loop_devices() From the log you've sent, it seems that it created just devices 5, 6 and 7dsf while skipping devices 1-4 because they already existed. I'm not sure how your tests know which loop devices were created by you and which already existed and might be busy, but maybe you should create loop devices until you have enough and store them in a file? On Wed, Jan 9, 2019 at 2:24 AM Nir Soffer <nsoffer(a)redhat.com> wrote: > We had this issue few years ago, and it was solved when we started > to create loop devices to the slave in check-path.sh. > > Before we run the tests, we created loop devices. Looking at the log, we > had 5 > nodes and we added 3 nodes - this is typical log. > > + create_loop_devices 8 > + local last=7 > + local min > ++ seq 0 7 > + for min in '`seq 0 $last`' > + local name=/dev/loop0 > + '[' '!' -e /dev/loop0 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop1 > + '[' '!' -e /dev/loop1 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop2 > + '[' '!' -e /dev/loop2 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop3 > + '[' '!' -e /dev/loop3 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop4 > + '[' '!' -e /dev/loop4 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop5 > + '[' '!' -e /dev/loop5 ']' > + mknod --mode 0666 /dev/loop5 b 7 5 > + for min in '`seq 0 $last`' > + local name=/dev/loop6 > + '[' '!' -e /dev/loop6 ']' > + mknod --mode 0666 /dev/loop6 b 7 6 > + for min in '`seq 0 $last`' > + local name=/dev/loop7 > + '[' '!' -e /dev/loop7 ']' > + mknod --mode 0666 /dev/loop7 b 7 7 > > > But mounting images failed later as you can see bellow. > > Failed build: > > https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_st… > > > The same tests run fine in travis inside a container: > https://travis-ci.org/nirs/vdsm/jobs/471920126 > > Anyone has idea why mounting fail randomly in Jenkins slaves, and how we > can fix this issue? > > ====================================================================== > > ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content. > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 211, in test_mkFloppyFs > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,720 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img 1440 -n FSLABEL (cwd None) (commands:198) > 2019-01-08 23:46:19,729 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) > 2019-01-08 23:46:19,731 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img at /tmp/tmpSejvmr (mount:204) > 2019-01-08 23:46:19,731 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img /tmp/tmpSejvmr (cwd None) (commands:198) > 2019-01-08 23:46:19,743 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) > --------------------- >> end captured logging << --------------------- > > ====================================================================== > ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content. > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 211, in test_mkFloppyFs > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,750 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img 1440 (cwd None) (commands:198) > 2019-01-08 23:46:19,759 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) > 2019-01-08 23:46:19,761 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img at /tmp/tmpiDcstj (mount:204) > 2019-01-08 23:46:19,762 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img /tmp/tmpiDcstj (cwd None) (commands:198) > 2019-01-08 23:46:19,773 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) > --------------------- >> end captured logging << --------------------- > > ====================================================================== > ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 230, in test_mkFloppyFs_overwrite > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,779 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img 1440 -n FSLABEL (cwd None) (commands:198) > 2019-01-08 23:46:19,789 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) > 2019-01-08 23:46:19,790 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img at /tmp/tmpX4UcrB (mount:204) > 2019-01-08 23:46:19,791 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img /tmp/tmpX4UcrB (cwd None) (commands:198) > 2019-01-08 23:46:19,803 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) > --------------------- >> end captured logging << --------------------- > > ====================================================================== > ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 230, in test_mkFloppyFs_overwrite > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,809 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img 1440 (cwd None) (commands:198) > 2019-01-08 23:46:19,821 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) > 2019-01-08 23:46:19,822 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img at /tmp/tmpJNTkWb (mount:204) > 2019-01-08 23:46:19,823 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img /tmp/tmpJNTkWb (cwd None) (commands:198) > 2019-01-08 23:46:19,836 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) > --------------------- >> end captured logging << --------------------- > > ====================================================================== > ERROR: Tests mkimage.mkIsoFs creating an image and checking its content > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 252, in test_mkIsoFs > m.mount(mntOpts='loop') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << --------------------Coverage.py warning: Module /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never imported. (module-not-imported) > > 2019-01-08 23:46:19,851 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mkisofs -R -J -o /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img -V fslabel /tmp/tmphPPnKt (cwd None) (commands:198) > 2019-01-08 23:46:19,882 DEBUG (MainThread) [root] SUCCESS: <err> = 'Total translation table size: 0\nTotal rockridge attributes bytes: 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 (commands:219) > 2019-01-08 23:46:19,885 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img at /tmp/vdsm-mkimage-testsS16Km7/work (mount:204) > 2019-01-08 23:46:19,886 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -o loop /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img /tmp/vdsm-mkimage-testsS16Km7/work (cwd None) (commands:198) > 2019-01-08 23:46:19,898 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) > --------------------- >> end captured logging << --------------------- > > ====================================================================== > ERROR: Tests mkimage.mkIsoFs creating an image and checking its content > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 252, in test_mkIsoFs > m.mount(mntOpts='loop') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,907 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mkisofs -R -J -o /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img /tmp/tmpfk8az9 (cwd None) (commands:198) > 2019-01-08 23:46:19,931 DEBUG (MainThread) [root] SUCCESS: <err> = 'Total translation table size: 0\nTotal rockridge attributes bytes: 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 (commands:219) > 2019-01-08 23:46:19,933 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img at /tmp/vdsm-mkimage-testsxv7k7G/work (mount:204) > 2019-01-08 23:46:19,934 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -o loop /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img /tmp/vdsm-mkimage-testsxv7k7G/work (cwd None) (commands:198) > 2019-01-08 23:46:19,946 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) > --------------------- >> end captured logging << --------------------- > > > _______________________________________________ > Infra mailing list -- infra(a)ovirt.org > To unsubscribe send an email to infra-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/infra@ovirt.org/message/USZV6PWV5PS7J… > -- DANIEL BELENKY > [VDSM] Tests mounting loop devices fail randomly again > ------------------------------------------------------ > > Key: OVIRT-2645 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2645 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Nir Soffer > Assignee: infra > > We had this issue few years ago, and it was solved when we started > to create loop devices to the slave in check-path.sh. > Before we run the tests, we created loop devices. Looking at the log, we > had 5 > nodes and we added 3 nodes - this is typical log. > + create_loop_devices 8 > + local last=7 > + local min > ++ seq 0 7 > + for min in '`seq 0 $last`' > + local name=/dev/loop0 > + '[' '!' -e /dev/loop0 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop1 > + '[' '!' -e /dev/loop1 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop2 > + '[' '!' -e /dev/loop2 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop3 > + '[' '!' -e /dev/loop3 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop4 > + '[' '!' -e /dev/loop4 ']' > + for min in '`seq 0 $last`' > + local name=/dev/loop5 > + '[' '!' -e /dev/loop5 ']' > + mknod --mode 0666 /dev/loop5 b 7 5 > + for min in '`seq 0 $last`' > + local name=/dev/loop6 > + '[' '!' -e /dev/loop6 ']' > + mknod --mode 0666 /dev/loop6 b 7 6 > + for min in '`seq 0 $last`' > + local name=/dev/loop7 > + '[' '!' -e /dev/loop7 ']' > + mknod --mode 0666 /dev/loop7 b 7 7 > But mounting images failed later as you can see bellow. > Failed build: > https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_st… > The same tests run fine in travis inside a container: > https://travis-ci.org/nirs/vdsm/jobs/471920126 > Anyone has idea why mounting fail randomly in Jenkins slaves, and how we > can fix this issue? > ====================================================================== > ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content. > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 211, in test_mkFloppyFs > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,720 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/sbin/mkfs.msdos -C > /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img > 1440 -n FSLABEL (cwd None) (commands:198) > 2019-01-08 23:46:19,729 DEBUG (MainThread) [root] SUCCESS: <err> = ''; > <rc> = 0 (commands:219) > 2019-01-08 23:46:19,731 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img > at /tmp/tmpSejvmr (mount:204) > 2019-01-08 23:46:19,731 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -t vfat -o loop > /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img > /tmp/tmpSejvmr (cwd None) (commands:198) > 2019-01-08 23:46:19,743 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- > ====================================================================== > ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content. > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 211, in test_mkFloppyFs > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,750 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/sbin/mkfs.msdos -C > /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img > 1440 (cwd None) (commands:198) > 2019-01-08 23:46:19,759 DEBUG (MainThread) [root] SUCCESS: <err> = ''; > <rc> = 0 (commands:219) > 2019-01-08 23:46:19,761 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img > at /tmp/tmpiDcstj (mount:204) > 2019-01-08 23:46:19,762 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -t vfat -o loop > /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img > /tmp/tmpiDcstj (cwd None) (commands:198) > 2019-01-08 23:46:19,773 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- > ====================================================================== > ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 230, in test_mkFloppyFs_overwrite > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,779 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/sbin/mkfs.msdos -C > /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img > 1440 -n FSLABEL (cwd None) (commands:198) > 2019-01-08 23:46:19,789 DEBUG (MainThread) [root] SUCCESS: <err> = ''; > <rc> = 0 (commands:219) > 2019-01-08 23:46:19,790 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img > at /tmp/tmpX4UcrB (mount:204) > 2019-01-08 23:46:19,791 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -t vfat -o loop > /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img > /tmp/tmpX4UcrB (cwd None) (commands:198) > 2019-01-08 23:46:19,803 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- > ====================================================================== > ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 230, in test_mkFloppyFs_overwrite > floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 137, in mkFloppyFs > injectFilesToFs(floppy, files, 'vfat') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", > line 113, in injectFilesToFs > m.mount(mntOpts='loop', vfstype=fstype) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,809 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/sbin/mkfs.msdos -C > /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img > 1440 (cwd None) (commands:198) > 2019-01-08 23:46:19,821 DEBUG (MainThread) [root] SUCCESS: <err> = ''; > <rc> = 0 (commands:219) > 2019-01-08 23:46:19,822 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img > at /tmp/tmpJNTkWb (mount:204) > 2019-01-08 23:46:19,823 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -t vfat -o loop > /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img > /tmp/tmpJNTkWb (cwd None) (commands:198) > 2019-01-08 23:46:19,836 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- > ====================================================================== > ERROR: Tests mkimage.mkIsoFs creating an image and checking its content > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 252, in test_mkIsoFs > m.mount(mntOpts='loop') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << > --------------------Coverage.py warning: Module > /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never > imported. (module-not-imported) > 2019-01-08 23:46:19,851 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mkisofs -R -J -o > /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img > -V fslabel /tmp/tmphPPnKt (cwd None) (commands:198) > 2019-01-08 23:46:19,882 DEBUG (MainThread) [root] SUCCESS: <err> = > 'Total translation table size: 0\nTotal rockridge attributes bytes: > 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk > space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 > (commands:219) > 2019-01-08 23:46:19,885 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img > at /tmp/vdsm-mkimage-testsS16Km7/work (mount:204) > 2019-01-08 23:46:19,886 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -o loop > /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img > /tmp/vdsm-mkimage-testsS16Km7/work (cwd None) (commands:198) > 2019-01-08 23:46:19,898 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- > ====================================================================== > ERROR: Tests mkimage.mkIsoFs creating an image and checking its content > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", > line 142, in wrapper > return f(self, *args) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", > line 194, in wrapper > return f(*args, **kwargs) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", > line 252, in test_mkIsoFs > m.mount(mntOpts='loop') > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 207, in mount > cgroup=cgroup) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 277, in _mount > _runcmd(cmd) > File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", > line 305, in _runcmd > raise MountError(rc, b";".join((out, err))) > MountError: (32, ';mount: > /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: > failed to setup loop device: No such file or directory\n') > -------------------- >> begin captured logging << -------------------- > 2019-01-08 23:46:19,907 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mkisofs -R -J -o > /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img > /tmp/tmpfk8az9 (cwd None) (commands:198) > 2019-01-08 23:46:19,931 DEBUG (MainThread) [root] SUCCESS: <err> = > 'Total translation table size: 0\nTotal rockridge attributes bytes: > 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk > space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 > (commands:219) > 2019-01-08 23:46:19,933 INFO (MainThread) [storage.Mount] mounting > /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img > at /tmp/vdsm-mkimage-testsxv7k7G/work (mount:204) > 2019-01-08 23:46:19,934 DEBUG (MainThread) [root] /usr/bin/taskset > --cpu-list 0-1 /usr/bin/mount -o loop > /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img > /tmp/vdsm-mkimage-testsxv7k7G/work (cwd None) (commands:198) > 2019-01-08 23:46:19,946 DEBUG (MainThread) [root] FAILED: <err> = > 'mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: > failed to setup loop device: No such file or directory\n'; <rc> = 32 > (commands:219) > --------------------- >> end captured logging << --------------------- -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100097)

1 0

[VDSM] Tests mounting loop devices fail randomly again
by Nir Soffer 09 Jan '19

09 Jan '19

We had this issue few years ago, and it was solved when we started to create loop devices to the slave in check-path.sh. Before we run the tests, we created loop devices. Looking at the log, we had 5 nodes and we added 3 nodes - this is typical log. + create_loop_devices 8 + local last=7 + local min ++ seq 0 7 + for min in '`seq 0 $last`' + local name=/dev/loop0 + '[' '!' -e /dev/loop0 ']' + for min in '`seq 0 $last`' + local name=/dev/loop1 + '[' '!' -e /dev/loop1 ']' + for min in '`seq 0 $last`' + local name=/dev/loop2 + '[' '!' -e /dev/loop2 ']' + for min in '`seq 0 $last`' + local name=/dev/loop3 + '[' '!' -e /dev/loop3 ']' + for min in '`seq 0 $last`' + local name=/dev/loop4 + '[' '!' -e /dev/loop4 ']' + for min in '`seq 0 $last`' + local name=/dev/loop5 + '[' '!' -e /dev/loop5 ']' + mknod --mode 0666 /dev/loop5 b 7 5 + for min in '`seq 0 $last`' + local name=/dev/loop6 + '[' '!' -e /dev/loop6 ']' + mknod --mode 0666 /dev/loop6 b 7 6 + for min in '`seq 0 $last`' + local name=/dev/loop7 + '[' '!' -e /dev/loop7 ']' + mknod --mode 0666 /dev/loop7 b 7 7 But mounting images failed later as you can see bellow. Failed build: https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_st… The same tests run fine in travis inside a container: https://travis-ci.org/nirs/vdsm/jobs/471920126 Anyone has idea why mounting fail randomly in Jenkins slaves, and how we can fix this issue? ====================================================================== ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content. ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 211, in test_mkFloppyFs floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs injectFilesToFs(floppy, files, 'vfat') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs m.mount(mntOpts='loop', vfstype=fstype) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << -------------------- 2019-01-08 23:46:19,720 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img 1440 -n FSLABEL (cwd None) (commands:198) 2019-01-08 23:46:19,729 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) 2019-01-08 23:46:19,731 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img at /tmp/tmpSejvmr (mount:204) 2019-01-08 23:46:19,731 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img /tmp/tmpSejvmr (cwd None) (commands:198) 2019-01-08 23:46:19,743 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content. ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 211, in test_mkFloppyFs floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs injectFilesToFs(floppy, files, 'vfat') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs m.mount(mntOpts='loop', vfstype=fstype) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << -------------------- 2019-01-08 23:46:19,750 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img 1440 (cwd None) (commands:198) 2019-01-08 23:46:19,759 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) 2019-01-08 23:46:19,761 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img at /tmp/tmpiDcstj (mount:204) 2019-01-08 23:46:19,762 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img /tmp/tmpiDcstj (cwd None) (commands:198) 2019-01-08 23:46:19,773 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 230, in test_mkFloppyFs_overwrite floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs injectFilesToFs(floppy, files, 'vfat') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs m.mount(mntOpts='loop', vfstype=fstype) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << -------------------- 2019-01-08 23:46:19,779 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img 1440 -n FSLABEL (cwd None) (commands:198) 2019-01-08 23:46:19,789 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) 2019-01-08 23:46:19,790 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img at /tmp/tmpX4UcrB (mount:204) 2019-01-08 23:46:19,791 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img /tmp/tmpX4UcrB (cwd None) (commands:198) 2019-01-08 23:46:19,803 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 230, in test_mkFloppyFs_overwrite floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs injectFilesToFs(floppy, files, 'vfat') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs m.mount(mntOpts='loop', vfstype=fstype) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << -------------------- 2019-01-08 23:46:19,809 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img 1440 (cwd None) (commands:198) 2019-01-08 23:46:19,821 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219) 2019-01-08 23:46:19,822 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img at /tmp/tmpJNTkWb (mount:204) 2019-01-08 23:46:19,823 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img /tmp/tmpJNTkWb (cwd None) (commands:198) 2019-01-08 23:46:19,836 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: Tests mkimage.mkIsoFs creating an image and checking its content ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 252, in test_mkIsoFs m.mount(mntOpts='loop') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << --------------------Coverage.py warning: Module /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never imported. (module-not-imported) 2019-01-08 23:46:19,851 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mkisofs -R -J -o /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img -V fslabel /tmp/tmphPPnKt (cwd None) (commands:198) 2019-01-08 23:46:19,882 DEBUG (MainThread) [root] SUCCESS: <err> = 'Total translation table size: 0\nTotal rockridge attributes bytes: 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 (commands:219) 2019-01-08 23:46:19,885 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img at /tmp/vdsm-mkimage-testsS16Km7/work (mount:204) 2019-01-08 23:46:19,886 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -o loop /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img /tmp/vdsm-mkimage-testsS16Km7/work (cwd None) (commands:198) 2019-01-08 23:46:19,898 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: Tests mkimage.mkIsoFs creating an image and checking its content ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper return f(self, *args) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper return f(*args, **kwargs) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 252, in test_mkIsoFs m.mount(mntOpts='loop') File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount cgroup=cgroup) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount _runcmd(cmd) File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd raise MountError(rc, b";".join((out, err))) MountError: (32, ';mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: failed to setup loop device: No such file or directory\n') -------------------- >> begin captured logging << -------------------- 2019-01-08 23:46:19,907 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mkisofs -R -J -o /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img /tmp/tmpfk8az9 (cwd None) (commands:198) 2019-01-08 23:46:19,931 DEBUG (MainThread) [root] SUCCESS: <err> = 'Total translation table size: 0\nTotal rockridge attributes bytes: 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 (commands:219) 2019-01-08 23:46:19,933 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img at /tmp/vdsm-mkimage-testsxv7k7G/work (mount:204) 2019-01-08 23:46:19,934 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -o loop /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img /tmp/vdsm-mkimage-testsxv7k7G/work (cwd None) (commands:198) 2019-01-08 23:46:19,946 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219) --------------------- >> end captured logging << ---------------------

2 1

Build failed in Jenkins: system-sync_mirrors-centos-kvm-common-el7-x86_64 #2085
by jenkins＠jenkins.phx.ovirt.org 08 Jan '19

08 Jan '19

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-kvm-common-el7-x86_…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-kvm-common-el7-x86_…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/changes/59/95959/1:test --prune > git rev-parse origin/test^{commit} # timeout=10 > git rev-parse test^{commit} # timeout=10 Checking out Revision 05b40dfb4ec43a82530e8c471395d1858e5c59e1 (test) > git config core.sparsecheckout # timeout=10 > git checkout -f 05b40dfb4ec43a82530e8c471395d1858e5c59e1 Commit message: "mirror-reposync: remove gluster-3.10 mirror" > git rev-list --no-walk 05b40dfb4ec43a82530e8c471395d1858e5c59e1 # timeout=10 [system-sync_mirrors-centos-kvm-common-el7-x86_64] $ /bin/bash -xe /tmp/jenkins557032158534410757.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-kvm-common-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-kvm-common-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-kvm-common-el7' Build step 'Execute shell' marked build as failure

1 1

Build failed in Jenkins: system-sync_mirrors-fedora-base-fc29-x86_64 #188
by jenkins＠jenkins.phx.ovirt.org 08 Jan '19

08 Jan '19

See <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc29-x86_64/18…> Changes: [Gal Ben Haim] ovirt-guest-agent: Drop 4.1 jobs ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc29-x86_64/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 3980a490238a988869b7a2e070c14777d44a1226 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 3980a490238a988869b7a2e070c14777d44a1226 Commit message: "ovirt-guest-agent: Drop 4.1 jobs" > git rev-list --no-walk 41ba10d144e43636af927b6600c9a897656644c2 # timeout=10 [system-sync_mirrors-fedora-base-fc29-x86_64] $ /bin/bash -xe /tmp/jenkins2213412723554411166.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf + MIRRORS_MP_BASE=/var/www/html/repos + MIRRORS_HTTP_BASE=http://mirrors.phx.ovirt.org/repos + MIRRORS_CACHE=/home/jenkins/mirrors_cache + MAX_LOCK_ATTEMPTS=120 + LOCK_WAIT_INTERVAL=5 + LOCK_BASE=/home/jenkins + OLD_MD_TO_KEEP=100 + HTTP_SELINUX_TYPE=httpd_sys_content_t + HTTP_FILE_MODE=644 + main resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf + local command=resync_yum_mirror + command_args=("${@:2}") + local command_args + cmd_resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf + local repo_name=fedora-base-fc29 + local repo_archs=x86_64 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local sync_needed + mkdir -p /home/jenkins/mirrors_cache + verify_repo_fs fedora-base-fc29 yum + local repo_name=fedora-base-fc29 + local repo_type=yum + sudo install -o jenkins -d /var/www/html/repos/yum /var/www/html/repos/yum/fedora-base-fc29 /var/www/html/repos/yum/fedora-base-fc29/base + check_yum_sync_needed fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf sync_needed + local repo_name=fedora-base-fc29 + local repo_archs=x86_64 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local p_sync_needed=sync_needed + local reposync_out + echo 'Checking if mirror needs a resync' Checking if mirror needs a resync + rm -rf /home/jenkins/mirrors_cache/fedora-base-fc29 ++ IFS=, ++ echo x86_64 + for arch in '$(IFS=,; echo $repo_archs)' ++ run_reposync fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf --urls --quiet ++ local repo_name=fedora-base-fc29 ++ local repo_arch=x86_64 ++ local reposync_conf=jenkins/data/mirrors-reposync.conf ++ extra_args=("${@:4}") ++ local extra_args ++ reposync --config=jenkins/data/mirrors-reposync.conf --repoid=fedora-base-fc29 --arch=x86_64 --cachedir=/home/jenkins/mirrors_cache --download_path=/var/www/html/repos/yum/fedora-base-fc29/base --norepopath --newest-only --urls --quiet Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-kvm-common-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-kvm-common-el7' + reposync_out= Build step 'Execute shell' marked build as failure

1 1

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 08 Jan '19

08 Jan '19

Failed to run project_setup.sh for: #1292 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0035.workers-phx.ovirt.org.

1 0