[JIRA] (OVIRT-2645) [VDSM] Tests mounting loop devices fail
randomly again
by Nir Soffer (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2645?page=com.atlassian.jir... ]
Nir Soffer commented on OVIRT-2645:
-----------------------------------
On Wed, Jan 9, 2019 at 2:25 AM Nir Soffer (oVirt JIRA) <
After discussion with Barak and Daniel, we decided to create more loop
devices. If this does
not fix the issue we will have to invest more time in this.
https://gerrit.ovirt.org/c/96752/
> [VDSM] Tests mounting loop devices fail randomly again
> ------------------------------------------------------
>
> Key: OVIRT-2645
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2645
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Nir Soffer
> Assignee: infra
>
> We had this issue few years ago, and it was solved when we started
> to create loop devices to the slave in check-path.sh.
> Before we run the tests, we created loop devices. Looking at the log, we
> had 5
> nodes and we added 3 nodes - this is typical log.
> + create_loop_devices 8
> + local last=7
> + local min
> ++ seq 0 7
> + for min in '`seq 0 $last`'
> + local name=/dev/loop0
> + '[' '!' -e /dev/loop0 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop1
> + '[' '!' -e /dev/loop1 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop2
> + '[' '!' -e /dev/loop2 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop3
> + '[' '!' -e /dev/loop3 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop4
> + '[' '!' -e /dev/loop4 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop5
> + '[' '!' -e /dev/loop5 ']'
> + mknod --mode 0666 /dev/loop5 b 7 5
> + for min in '`seq 0 $last`'
> + local name=/dev/loop6
> + '[' '!' -e /dev/loop6 ']'
> + mknod --mode 0666 /dev/loop6 b 7 6
> + for min in '`seq 0 $last`'
> + local name=/dev/loop7
> + '[' '!' -e /dev/loop7 ']'
> + mknod --mode 0666 /dev/loop7 b 7 7
> But mounting images failed later as you can see bellow.
> Failed build:
> https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
> The same tests run fine in travis inside a container:
> https://travis-ci.org/nirs/vdsm/jobs/471920126
> Anyone has idea why mounting fail randomly in Jenkins slaves, and how we
> can fix this issue?
> ======================================================================
> ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content.
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 211, in test_mkFloppyFs
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,720 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/sbin/mkfs.msdos -C
> /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
> 1440 -n FSLABEL (cwd None) (commands:198)
> 2019-01-08 23:46:19,729 DEBUG (MainThread) [root] SUCCESS: <err> = '';
> <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,731 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
> at /tmp/tmpSejvmr (mount:204)
> 2019-01-08 23:46:19,731 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -t vfat -o loop
> /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
> /tmp/tmpSejvmr (cwd None) (commands:198)
> 2019-01-08 23:46:19,743 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content.
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 211, in test_mkFloppyFs
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,750 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/sbin/mkfs.msdos -C
> /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
> 1440 (cwd None) (commands:198)
> 2019-01-08 23:46:19,759 DEBUG (MainThread) [root] SUCCESS: <err> = '';
> <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,761 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
> at /tmp/tmpiDcstj (mount:204)
> 2019-01-08 23:46:19,762 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -t vfat -o loop
> /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
> /tmp/tmpiDcstj (cwd None) (commands:198)
> 2019-01-08 23:46:19,773 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 230, in test_mkFloppyFs_overwrite
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,779 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/sbin/mkfs.msdos -C
> /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
> 1440 -n FSLABEL (cwd None) (commands:198)
> 2019-01-08 23:46:19,789 DEBUG (MainThread) [root] SUCCESS: <err> = '';
> <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,790 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
> at /tmp/tmpX4UcrB (mount:204)
> 2019-01-08 23:46:19,791 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -t vfat -o loop
> /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
> /tmp/tmpX4UcrB (cwd None) (commands:198)
> 2019-01-08 23:46:19,803 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 230, in test_mkFloppyFs_overwrite
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,809 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/sbin/mkfs.msdos -C
> /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
> 1440 (cwd None) (commands:198)
> 2019-01-08 23:46:19,821 DEBUG (MainThread) [root] SUCCESS: <err> = '';
> <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,822 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
> at /tmp/tmpJNTkWb (mount:204)
> 2019-01-08 23:46:19,823 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -t vfat -o loop
> /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
> /tmp/tmpJNTkWb (cwd None) (commands:198)
> 2019-01-08 23:46:19,836 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> ERROR: Tests mkimage.mkIsoFs creating an image and checking its content
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 252, in test_mkIsoFs
> m.mount(mntOpts='loop')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging <<
> --------------------Coverage.py warning: Module
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never
> imported. (module-not-imported)
> 2019-01-08 23:46:19,851 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mkisofs -R -J -o
> /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
> -V fslabel /tmp/tmphPPnKt (cwd None) (commands:198)
> 2019-01-08 23:46:19,882 DEBUG (MainThread) [root] SUCCESS: <err> =
> 'Total translation table size: 0\nTotal rockridge attributes bytes:
> 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk
> space used 22000\n199 extents written (0 MB)\n'; <rc> = 0
> (commands:219)
> 2019-01-08 23:46:19,885 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
> at /tmp/vdsm-mkimage-testsS16Km7/work (mount:204)
> 2019-01-08 23:46:19,886 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -o loop
> /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
> /tmp/vdsm-mkimage-testsS16Km7/work (cwd None) (commands:198)
> 2019-01-08 23:46:19,898 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> ERROR: Tests mkimage.mkIsoFs creating an image and checking its content
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 252, in test_mkIsoFs
> m.mount(mntOpts='loop')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,907 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mkisofs -R -J -o
> /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
> /tmp/tmpfk8az9 (cwd None) (commands:198)
> 2019-01-08 23:46:19,931 DEBUG (MainThread) [root] SUCCESS: <err> =
> 'Total translation table size: 0\nTotal rockridge attributes bytes:
> 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk
> space used 22000\n199 extents written (0 MB)\n'; <rc> = 0
> (commands:219)
> 2019-01-08 23:46:19,933 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
> at /tmp/vdsm-mkimage-testsxv7k7G/work (mount:204)
> 2019-01-08 23:46:19,934 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -o loop
> /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
> /tmp/vdsm-mkimage-testsxv7k7G/work (cwd None) (commands:198)
> 2019-01-08 23:46:19,946 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100097)
5 years, 10 months
- 1
- 0
[JIRA] (OVIRT-2645) [VDSM] Tests mounting loop devices fail
randomly again
by Nir Soffer (oVirt JIRA)
Nir Soffer created OVIRT-2645:
---------------------------------
Summary: [VDSM] Tests mounting loop devices fail randomly again
Key: OVIRT-2645
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2645
Project: oVirt - virtualization made easy
Issue Type: By-EMAIL
Reporter: Nir Soffer
Assignee: infra
We had this issue few years ago, and it was solved when we started
to create loop devices to the slave in check-path.sh.
Before we run the tests, we created loop devices. Looking at the log, we
had 5
nodes and we added 3 nodes - this is typical log.
+ create_loop_devices 8
+ local last=7
+ local min
++ seq 0 7
+ for min in '`seq 0 $last`'
+ local name=/dev/loop0
+ '[' '!' -e /dev/loop0 ']'
+ for min in '`seq 0 $last`'
+ local name=/dev/loop1
+ '[' '!' -e /dev/loop1 ']'
+ for min in '`seq 0 $last`'
+ local name=/dev/loop2
+ '[' '!' -e /dev/loop2 ']'
+ for min in '`seq 0 $last`'
+ local name=/dev/loop3
+ '[' '!' -e /dev/loop3 ']'
+ for min in '`seq 0 $last`'
+ local name=/dev/loop4
+ '[' '!' -e /dev/loop4 ']'
+ for min in '`seq 0 $last`'
+ local name=/dev/loop5
+ '[' '!' -e /dev/loop5 ']'
+ mknod --mode 0666 /dev/loop5 b 7 5
+ for min in '`seq 0 $last`'
+ local name=/dev/loop6
+ '[' '!' -e /dev/loop6 ']'
+ mknod --mode 0666 /dev/loop6 b 7 6
+ for min in '`seq 0 $last`'
+ local name=/dev/loop7
+ '[' '!' -e /dev/loop7 ']'
+ mknod --mode 0666 /dev/loop7 b 7 7
But mounting images failed later as you can see bellow.
Failed build:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
The same tests run fine in travis inside a container:
https://travis-ci.org/nirs/vdsm/jobs/471920126
Anyone has idea why mounting fail randomly in Jenkins slaves, and how we
can fix this issue?
======================================================================
ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content.
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 211, in test_mkFloppyFs
floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 137, in mkFloppyFs
injectFilesToFs(floppy, files, 'vfat')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 113, in injectFilesToFs
m.mount(mntOpts='loop', vfstype=fstype)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging << --------------------
2019-01-08 23:46:19,720 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/sbin/mkfs.msdos -C
/tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
1440 -n FSLABEL (cwd None) (commands:198)
2019-01-08 23:46:19,729 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (commands:219)
2019-01-08 23:46:19,731 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
at /tmp/tmpSejvmr (mount:204)
2019-01-08 23:46:19,731 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -t vfat -o loop
/tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
/tmp/tmpSejvmr (cwd None) (commands:198)
2019-01-08 23:46:19,743 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content.
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 211, in test_mkFloppyFs
floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 137, in mkFloppyFs
injectFilesToFs(floppy, files, 'vfat')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 113, in injectFilesToFs
m.mount(mntOpts='loop', vfstype=fstype)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging << --------------------
2019-01-08 23:46:19,750 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/sbin/mkfs.msdos -C
/tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
1440 (cwd None) (commands:198)
2019-01-08 23:46:19,759 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (commands:219)
2019-01-08 23:46:19,761 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
at /tmp/tmpiDcstj (mount:204)
2019-01-08 23:46:19,762 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -t vfat -o loop
/tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
/tmp/tmpiDcstj (cwd None) (commands:198)
2019-01-08 23:46:19,773 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 230, in test_mkFloppyFs_overwrite
floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 137, in mkFloppyFs
injectFilesToFs(floppy, files, 'vfat')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 113, in injectFilesToFs
m.mount(mntOpts='loop', vfstype=fstype)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging << --------------------
2019-01-08 23:46:19,779 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/sbin/mkfs.msdos -C
/tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
1440 -n FSLABEL (cwd None) (commands:198)
2019-01-08 23:46:19,789 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (commands:219)
2019-01-08 23:46:19,790 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
at /tmp/tmpX4UcrB (mount:204)
2019-01-08 23:46:19,791 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -t vfat -o loop
/tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
/tmp/tmpX4UcrB (cwd None) (commands:198)
2019-01-08 23:46:19,803 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 230, in test_mkFloppyFs_overwrite
floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 137, in mkFloppyFs
injectFilesToFs(floppy, files, 'vfat')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 113, in injectFilesToFs
m.mount(mntOpts='loop', vfstype=fstype)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging << --------------------
2019-01-08 23:46:19,809 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/sbin/mkfs.msdos -C
/tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
1440 (cwd None) (commands:198)
2019-01-08 23:46:19,821 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (commands:219)
2019-01-08 23:46:19,822 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
at /tmp/tmpJNTkWb (mount:204)
2019-01-08 23:46:19,823 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -t vfat -o loop
/tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
/tmp/tmpJNTkWb (cwd None) (commands:198)
2019-01-08 23:46:19,836 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Tests mkimage.mkIsoFs creating an image and checking its content
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 252, in test_mkIsoFs
m.mount(mntOpts='loop')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging <<
--------------------Coverage.py warning: Module
/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never
imported. (module-not-imported)
2019-01-08 23:46:19,851 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mkisofs -R -J -o
/tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
-V fslabel /tmp/tmphPPnKt (cwd None) (commands:198)
2019-01-08 23:46:19,882 DEBUG (MainThread) [root] SUCCESS: <err> =
'Total translation table size: 0\nTotal rockridge attributes bytes:
1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk
space used 22000\n199 extents written (0 MB)\n'; <rc> = 0
(commands:219)
2019-01-08 23:46:19,885 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
at /tmp/vdsm-mkimage-testsS16Km7/work (mount:204)
2019-01-08 23:46:19,886 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -o loop
/tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
/tmp/vdsm-mkimage-testsS16Km7/work (cwd None) (commands:198)
2019-01-08 23:46:19,898 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Tests mkimage.mkIsoFs creating an image and checking its content
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 252, in test_mkIsoFs
m.mount(mntOpts='loop')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging << --------------------
2019-01-08 23:46:19,907 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mkisofs -R -J -o
/tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
/tmp/tmpfk8az9 (cwd None) (commands:198)
2019-01-08 23:46:19,931 DEBUG (MainThread) [root] SUCCESS: <err> =
'Total translation table size: 0\nTotal rockridge attributes bytes:
1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk
space used 22000\n199 extents written (0 MB)\n'; <rc> = 0
(commands:219)
2019-01-08 23:46:19,933 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
at /tmp/vdsm-mkimage-testsxv7k7G/work (mount:204)
2019-01-08 23:46:19,934 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -o loop
/tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
/tmp/vdsm-mkimage-testsxv7k7G/work (cwd None) (commands:198)
2019-01-08 23:46:19,946 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100097)
5 years, 10 months
- 2
- 1
[CQ]: 96621, 3 (ovirt-provider-ovn) failed "ovirt-master" system tests
by oVirt Jenkins
Change 96621,3 (ovirt-provider-ovn) is probably the reason behind recent system
test failures in the "ovirt-master" change queue and needs to be fixed.
This change had been removed from the testing queue. Artifacts build from this
change will not be released until it is fixed.
For further details about the change see:
https://gerrit.ovirt.org/#/c/96621/3
For failed test results see:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/12251/
5 years, 10 months
- 2
- 1
[JIRA] (OVIRT-2646) FC29 Is not compatible with older versions of
dnf and yum
by Ehud Yonasi (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2646?page=com.atlassian.jir... ]
Ehud Yonasi reassigned OVIRT-2646:
----------------------------------
Assignee: Ehud Yonasi (was: infra)
> FC29 Is not compatible with older versions of dnf and yum
> ---------------------------------------------------------
>
> Key: OVIRT-2646
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2646
> Project: oVirt - virtualization made easy
> Issue Type: Outage
> Reporter: Ehud Yonasi
> Assignee: Ehud Yonasi
>
> FC29 Is not compatible with older versions of dnf and yum,
> thus we can't run mock with older versions.
> [~ederevea] sent a PR and is trying to fix it on the side of dnf.
> I found that what i tested with fc29 running el7 mock had yum-deprecated package that mock
> used that package in order to bring mock up.
> I will sent a patch to global_setup to add that package to dnf.
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100097)
5 years, 10 months
- 1
- 0
[JIRA] (OVIRT-2646) FC29 Is not compatible with older versions of
dnf and yum
by Ehud Yonasi (oVirt JIRA)
Ehud Yonasi created OVIRT-2646:
----------------------------------
Summary: FC29 Is not compatible with older versions of dnf and yum
Key: OVIRT-2646
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2646
Project: oVirt - virtualization made easy
Issue Type: Outage
Reporter: Ehud Yonasi
Assignee: infra
FC29 Is not compatible with older versions of dnf and yum,
thus we can't run mock with older versions.
[~ederevea] sent a PR and is trying to fix it on the side of dnf.
I found that what i tested with fc29 running el7 mock had yum-deprecated package that mock
used that package in order to bring mock up.
I will sent a patch to global_setup to add that package to dnf.
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100097)
5 years, 10 months
- 1
- 0
[JIRA] (OVIRT-2645) [VDSM] Tests mounting loop devices fail
randomly again
by Daniel Belenky (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2645?page=com.atlassian.jir... ]
Daniel Belenky commented on OVIRT-2645:
---------------------------------------
Nir,
I think that you have a bug in create_loop_devices()
From the log you've sent, it seems that it created just devices 5, 6 and
7dsf
while skipping devices 1-4 because they already existed.
I'm not sure how your tests know which loop devices were created by you
and which already existed and might be busy, but maybe you should
create loop devices until you have enough and store them in a file?
On Wed, Jan 9, 2019 at 2:24 AM Nir Soffer <nsoffer(a)redhat.com> wrote:
> We had this issue few years ago, and it was solved when we started
> to create loop devices to the slave in check-path.sh.
>
> Before we run the tests, we created loop devices. Looking at the log, we
> had 5
> nodes and we added 3 nodes - this is typical log.
>
> + create_loop_devices 8
> + local last=7
> + local min
> ++ seq 0 7
> + for min in '`seq 0 $last`'
> + local name=/dev/loop0
> + '[' '!' -e /dev/loop0 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop1
> + '[' '!' -e /dev/loop1 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop2
> + '[' '!' -e /dev/loop2 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop3
> + '[' '!' -e /dev/loop3 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop4
> + '[' '!' -e /dev/loop4 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop5
> + '[' '!' -e /dev/loop5 ']'
> + mknod --mode 0666 /dev/loop5 b 7 5
> + for min in '`seq 0 $last`'
> + local name=/dev/loop6
> + '[' '!' -e /dev/loop6 ']'
> + mknod --mode 0666 /dev/loop6 b 7 6
> + for min in '`seq 0 $last`'
> + local name=/dev/loop7
> + '[' '!' -e /dev/loop7 ']'
> + mknod --mode 0666 /dev/loop7 b 7 7
>
>
> But mounting images failed later as you can see bellow.
>
> Failed build:
>
> https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>
>
> The same tests run fine in travis inside a container:
> https://travis-ci.org/nirs/vdsm/jobs/471920126
>
> Anyone has idea why mounting fail randomly in Jenkins slaves, and how we
> can fix this issue?
>
> ======================================================================
>
> ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content.
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 211, in test_mkFloppyFs
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,720 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img 1440 -n FSLABEL (cwd None) (commands:198)
> 2019-01-08 23:46:19,729 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,731 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img at /tmp/tmpSejvmr (mount:204)
> 2019-01-08 23:46:19,731 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img /tmp/tmpSejvmr (cwd None) (commands:198)
> 2019-01-08 23:46:19,743 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219)
> --------------------- >> end captured logging << ---------------------
>
> ======================================================================
> ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content.
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 211, in test_mkFloppyFs
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,750 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img 1440 (cwd None) (commands:198)
> 2019-01-08 23:46:19,759 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,761 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img at /tmp/tmpiDcstj (mount:204)
> 2019-01-08 23:46:19,762 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img /tmp/tmpiDcstj (cwd None) (commands:198)
> 2019-01-08 23:46:19,773 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219)
> --------------------- >> end captured logging << ---------------------
>
> ======================================================================
> ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 230, in test_mkFloppyFs_overwrite
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,779 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img 1440 -n FSLABEL (cwd None) (commands:198)
> 2019-01-08 23:46:19,789 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,790 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img at /tmp/tmpX4UcrB (mount:204)
> 2019-01-08 23:46:19,791 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img /tmp/tmpX4UcrB (cwd None) (commands:198)
> 2019-01-08 23:46:19,803 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219)
> --------------------- >> end captured logging << ---------------------
>
> ======================================================================
> ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 230, in test_mkFloppyFs_overwrite
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py", line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,809 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/sbin/mkfs.msdos -C /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img 1440 (cwd None) (commands:198)
> 2019-01-08 23:46:19,821 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,822 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img at /tmp/tmpJNTkWb (mount:204)
> 2019-01-08 23:46:19,823 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t vfat -o loop /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img /tmp/tmpJNTkWb (cwd None) (commands:198)
> 2019-01-08 23:46:19,836 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219)
> --------------------- >> end captured logging << ---------------------
>
> ======================================================================
> ERROR: Tests mkimage.mkIsoFs creating an image and checking its content
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 252, in test_mkIsoFs
> m.mount(mntOpts='loop')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------Coverage.py warning: Module /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never imported. (module-not-imported)
>
> 2019-01-08 23:46:19,851 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mkisofs -R -J -o /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img -V fslabel /tmp/tmphPPnKt (cwd None) (commands:198)
> 2019-01-08 23:46:19,882 DEBUG (MainThread) [root] SUCCESS: <err> = 'Total translation table size: 0\nTotal rockridge attributes bytes: 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,885 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img at /tmp/vdsm-mkimage-testsS16Km7/work (mount:204)
> 2019-01-08 23:46:19,886 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -o loop /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img /tmp/vdsm-mkimage-testsS16Km7/work (cwd None) (commands:198)
> 2019-01-08 23:46:19,898 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219)
> --------------------- >> end captured logging << ---------------------
>
> ======================================================================
> ERROR: Tests mkimage.mkIsoFs creating an image and checking its content
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py", line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py", line 252, in test_mkIsoFs
> m.mount(mntOpts='loop')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py", line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,907 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mkisofs -R -J -o /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img /tmp/tmpfk8az9 (cwd None) (commands:198)
> 2019-01-08 23:46:19,931 DEBUG (MainThread) [root] SUCCESS: <err> = 'Total translation table size: 0\nTotal rockridge attributes bytes: 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk space used 22000\n199 extents written (0 MB)\n'; <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,933 INFO (MainThread) [storage.Mount] mounting /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img at /tmp/vdsm-mkimage-testsxv7k7G/work (mount:204)
> 2019-01-08 23:46:19,934 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -o loop /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img /tmp/vdsm-mkimage-testsxv7k7G/work (cwd None) (commands:198)
> 2019-01-08 23:46:19,946 DEBUG (MainThread) [root] FAILED: <err> = 'mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img: failed to setup loop device: No such file or directory\n'; <rc> = 32 (commands:219)
> --------------------- >> end captured logging << ---------------------
>
>
> _______________________________________________
> Infra mailing list -- infra(a)ovirt.org
> To unsubscribe send an email to infra-leave(a)ovirt.org
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
> https://lists.ovirt.org/archives/list/infra@ovirt.org/message/USZV6PWV5PS...
>
--
DANIEL BELENKY
> [VDSM] Tests mounting loop devices fail randomly again
> ------------------------------------------------------
>
> Key: OVIRT-2645
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2645
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Nir Soffer
> Assignee: infra
>
> We had this issue few years ago, and it was solved when we started
> to create loop devices to the slave in check-path.sh.
> Before we run the tests, we created loop devices. Looking at the log, we
> had 5
> nodes and we added 3 nodes - this is typical log.
> + create_loop_devices 8
> + local last=7
> + local min
> ++ seq 0 7
> + for min in '`seq 0 $last`'
> + local name=/dev/loop0
> + '[' '!' -e /dev/loop0 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop1
> + '[' '!' -e /dev/loop1 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop2
> + '[' '!' -e /dev/loop2 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop3
> + '[' '!' -e /dev/loop3 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop4
> + '[' '!' -e /dev/loop4 ']'
> + for min in '`seq 0 $last`'
> + local name=/dev/loop5
> + '[' '!' -e /dev/loop5 ']'
> + mknod --mode 0666 /dev/loop5 b 7 5
> + for min in '`seq 0 $last`'
> + local name=/dev/loop6
> + '[' '!' -e /dev/loop6 ']'
> + mknod --mode 0666 /dev/loop6 b 7 6
> + for min in '`seq 0 $last`'
> + local name=/dev/loop7
> + '[' '!' -e /dev/loop7 ']'
> + mknod --mode 0666 /dev/loop7 b 7 7
> But mounting images failed later as you can see bellow.
> Failed build:
> https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
> The same tests run fine in travis inside a container:
> https://travis-ci.org/nirs/vdsm/jobs/471920126
> Anyone has idea why mounting fail randomly in Jenkins slaves, and how we
> can fix this issue?
> ======================================================================
> ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content.
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 211, in test_mkFloppyFs
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,720 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/sbin/mkfs.msdos -C
> /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
> 1440 -n FSLABEL (cwd None) (commands:198)
> 2019-01-08 23:46:19,729 DEBUG (MainThread) [root] SUCCESS: <err> = '';
> <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,731 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
> at /tmp/tmpSejvmr (mount:204)
> 2019-01-08 23:46:19,731 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -t vfat -o loop
> /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
> /tmp/tmpSejvmr (cwd None) (commands:198)
> 2019-01-08 23:46:19,743 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content.
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 211, in test_mkFloppyFs
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,750 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/sbin/mkfs.msdos -C
> /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
> 1440 (cwd None) (commands:198)
> 2019-01-08 23:46:19,759 DEBUG (MainThread) [root] SUCCESS: <err> = '';
> <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,761 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
> at /tmp/tmpiDcstj (mount:204)
> 2019-01-08 23:46:19,762 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -t vfat -o loop
> /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
> /tmp/tmpiDcstj (cwd None) (commands:198)
> 2019-01-08 23:46:19,773 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 230, in test_mkFloppyFs_overwrite
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,779 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/sbin/mkfs.msdos -C
> /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
> 1440 -n FSLABEL (cwd None) (commands:198)
> 2019-01-08 23:46:19,789 DEBUG (MainThread) [root] SUCCESS: <err> = '';
> <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,790 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
> at /tmp/tmpX4UcrB (mount:204)
> 2019-01-08 23:46:19,791 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -t vfat -o loop
> /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
> /tmp/tmpX4UcrB (cwd None) (commands:198)
> 2019-01-08 23:46:19,803 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 230, in test_mkFloppyFs_overwrite
> floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 137, in mkFloppyFs
> injectFilesToFs(floppy, files, 'vfat')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
> line 113, in injectFilesToFs
> m.mount(mntOpts='loop', vfstype=fstype)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,809 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/sbin/mkfs.msdos -C
> /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
> 1440 (cwd None) (commands:198)
> 2019-01-08 23:46:19,821 DEBUG (MainThread) [root] SUCCESS: <err> = '';
> <rc> = 0 (commands:219)
> 2019-01-08 23:46:19,822 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
> at /tmp/tmpJNTkWb (mount:204)
> 2019-01-08 23:46:19,823 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -t vfat -o loop
> /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
> /tmp/tmpJNTkWb (cwd None) (commands:198)
> 2019-01-08 23:46:19,836 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> ERROR: Tests mkimage.mkIsoFs creating an image and checking its content
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 252, in test_mkIsoFs
> m.mount(mntOpts='loop')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging <<
> --------------------Coverage.py warning: Module
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never
> imported. (module-not-imported)
> 2019-01-08 23:46:19,851 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mkisofs -R -J -o
> /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
> -V fslabel /tmp/tmphPPnKt (cwd None) (commands:198)
> 2019-01-08 23:46:19,882 DEBUG (MainThread) [root] SUCCESS: <err> =
> 'Total translation table size: 0\nTotal rockridge attributes bytes:
> 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk
> space used 22000\n199 extents written (0 MB)\n'; <rc> = 0
> (commands:219)
> 2019-01-08 23:46:19,885 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
> at /tmp/vdsm-mkimage-testsS16Km7/work (mount:204)
> 2019-01-08 23:46:19,886 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -o loop
> /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
> /tmp/vdsm-mkimage-testsS16Km7/work (cwd None) (commands:198)
> 2019-01-08 23:46:19,898 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> ERROR: Tests mkimage.mkIsoFs creating an image and checking its content
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
> line 142, in wrapper
> return f(self, *args)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
> line 194, in wrapper
> return f(*args, **kwargs)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
> line 252, in test_mkIsoFs
> m.mount(mntOpts='loop')
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 207, in mount
> cgroup=cgroup)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 277, in _mount
> _runcmd(cmd)
> File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
> line 305, in _runcmd
> raise MountError(rc, b";".join((out, err)))
> MountError: (32, ';mount:
> /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img:
> failed to setup loop device: No such file or directory\n')
> -------------------- >> begin captured logging << --------------------
> 2019-01-08 23:46:19,907 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mkisofs -R -J -o
> /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
> /tmp/tmpfk8az9 (cwd None) (commands:198)
> 2019-01-08 23:46:19,931 DEBUG (MainThread) [root] SUCCESS: <err> =
> 'Total translation table size: 0\nTotal rockridge attributes bytes:
> 1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk
> space used 22000\n199 extents written (0 MB)\n'; <rc> = 0
> (commands:219)
> 2019-01-08 23:46:19,933 INFO (MainThread) [storage.Mount] mounting
> /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
> at /tmp/vdsm-mkimage-testsxv7k7G/work (mount:204)
> 2019-01-08 23:46:19,934 DEBUG (MainThread) [root] /usr/bin/taskset
> --cpu-list 0-1 /usr/bin/mount -o loop
> /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
> /tmp/vdsm-mkimage-testsxv7k7G/work (cwd None) (commands:198)
> 2019-01-08 23:46:19,946 DEBUG (MainThread) [root] FAILED: <err> =
> 'mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img:
> failed to setup loop device: No such file or directory\n'; <rc> = 32
> (commands:219)
> --------------------- >> end captured logging << ---------------------
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100097)
5 years, 10 months
- 1
- 0
[VDSM] Tests mounting loop devices fail randomly again
by Nir Soffer
We had this issue few years ago, and it was solved when we started
to create loop devices to the slave in check-path.sh.
Before we run the tests, we created loop devices. Looking at the log, we
had 5
nodes and we added 3 nodes - this is typical log.
+ create_loop_devices 8
+ local last=7
+ local min
++ seq 0 7
+ for min in '`seq 0 $last`'
+ local name=/dev/loop0
+ '[' '!' -e /dev/loop0 ']'
+ for min in '`seq 0 $last`'
+ local name=/dev/loop1
+ '[' '!' -e /dev/loop1 ']'
+ for min in '`seq 0 $last`'
+ local name=/dev/loop2
+ '[' '!' -e /dev/loop2 ']'
+ for min in '`seq 0 $last`'
+ local name=/dev/loop3
+ '[' '!' -e /dev/loop3 ']'
+ for min in '`seq 0 $last`'
+ local name=/dev/loop4
+ '[' '!' -e /dev/loop4 ']'
+ for min in '`seq 0 $last`'
+ local name=/dev/loop5
+ '[' '!' -e /dev/loop5 ']'
+ mknod --mode 0666 /dev/loop5 b 7 5
+ for min in '`seq 0 $last`'
+ local name=/dev/loop6
+ '[' '!' -e /dev/loop6 ']'
+ mknod --mode 0666 /dev/loop6 b 7 6
+ for min in '`seq 0 $last`'
+ local name=/dev/loop7
+ '[' '!' -e /dev/loop7 ']'
+ mknod --mode 0666 /dev/loop7 b 7 7
But mounting images failed later as you can see bellow.
Failed build:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
The same tests run fine in travis inside a container:
https://travis-ci.org/nirs/vdsm/jobs/471920126
Anyone has idea why mounting fail randomly in Jenkins slaves, and how we
can fix this issue?
======================================================================
ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content.
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 211, in test_mkFloppyFs
floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 137, in mkFloppyFs
injectFilesToFs(floppy, files, 'vfat')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 113, in injectFilesToFs
m.mount(mntOpts='loop', vfstype=fstype)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging << --------------------
2019-01-08 23:46:19,720 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/sbin/mkfs.msdos -C
/tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
1440 -n FSLABEL (cwd None) (commands:198)
2019-01-08 23:46:19,729 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (commands:219)
2019-01-08 23:46:19,731 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
at /tmp/tmpSejvmr (mount:204)
2019-01-08 23:46:19,731 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -t vfat -o loop
/tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img
/tmp/tmpSejvmr (cwd None) (commands:198)
2019-01-08 23:46:19,743 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testsxtGqen/images/vmId_floppy.e83b907eacb704d3942b8cab79561d2a.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Tests mkimage.mkFloppyFs creating an image and checking its content.
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 211, in test_mkFloppyFs
floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 137, in mkFloppyFs
injectFilesToFs(floppy, files, 'vfat')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 113, in injectFilesToFs
m.mount(mntOpts='loop', vfstype=fstype)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging << --------------------
2019-01-08 23:46:19,750 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/sbin/mkfs.msdos -C
/tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
1440 (cwd None) (commands:198)
2019-01-08 23:46:19,759 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (commands:219)
2019-01-08 23:46:19,761 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
at /tmp/tmpiDcstj (mount:204)
2019-01-08 23:46:19,762 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -t vfat -o loop
/tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img
/tmp/tmpiDcstj (cwd None) (commands:198)
2019-01-08 23:46:19,773 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testsnlTJrM/images/vmId_floppy.4f26a597fe7f8a916fd808350e62bdc0.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 230, in test_mkFloppyFs_overwrite
floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 137, in mkFloppyFs
injectFilesToFs(floppy, files, 'vfat')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 113, in injectFilesToFs
m.mount(mntOpts='loop', vfstype=fstype)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging << --------------------
2019-01-08 23:46:19,779 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/sbin/mkfs.msdos -C
/tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
1440 -n FSLABEL (cwd None) (commands:198)
2019-01-08 23:46:19,789 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (commands:219)
2019-01-08 23:46:19,790 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
at /tmp/tmpX4UcrB (mount:204)
2019-01-08 23:46:19,791 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -t vfat -o loop
/tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img
/tmp/tmpX4UcrB (cwd None) (commands:198)
2019-01-08 23:46:19,803 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testslSTYsV/images/vmId_floppy.3af4c566a929c30f605091dd7a5b7deb.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Test that mkimage.mkFloppyFs handle situation when the floppy image
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 230, in test_mkFloppyFs_overwrite
floppy = mkimage.mkFloppyFs("vmId_floppy", self.files, label)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 137, in mkFloppyFs
injectFilesToFs(floppy, files, 'vfat')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/mkimage.py",
line 113, in injectFilesToFs
m.mount(mntOpts='loop', vfstype=fstype)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging << --------------------
2019-01-08 23:46:19,809 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/sbin/mkfs.msdos -C
/tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
1440 (cwd None) (commands:198)
2019-01-08 23:46:19,821 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (commands:219)
2019-01-08 23:46:19,822 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
at /tmp/tmpJNTkWb (mount:204)
2019-01-08 23:46:19,823 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -t vfat -o loop
/tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img
/tmp/tmpJNTkWb (cwd None) (commands:198)
2019-01-08 23:46:19,836 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testsOy036Z/images/vmId_floppy.7d36c87a8c8c6c8ad83dc972edfcb3cc.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Tests mkimage.mkIsoFs creating an image and checking its content
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 252, in test_mkIsoFs
m.mount(mntOpts='loop')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging <<
--------------------Coverage.py warning: Module
/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never
imported. (module-not-imported)
2019-01-08 23:46:19,851 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mkisofs -R -J -o
/tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
-V fslabel /tmp/tmphPPnKt (cwd None) (commands:198)
2019-01-08 23:46:19,882 DEBUG (MainThread) [root] SUCCESS: <err> =
'Total translation table size: 0\nTotal rockridge attributes bytes:
1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk
space used 22000\n199 extents written (0 MB)\n'; <rc> = 0
(commands:219)
2019-01-08 23:46:19,885 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
at /tmp/vdsm-mkimage-testsS16Km7/work (mount:204)
2019-01-08 23:46:19,886 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -o loop
/tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img
/tmp/vdsm-mkimage-testsS16Km7/work (cwd None) (commands:198)
2019-01-08 23:46:19,898 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testsS16Km7/images/vmId_iso.1d6daeff12530405cbf56a511812e581.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Tests mkimage.mkIsoFs creating an image and checking its content
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/mkimage_test.py",
line 252, in test_mkIsoFs
m.mount(mntOpts='loop')
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 207, in mount
cgroup=cgroup)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 277, in _mount
_runcmd(cmd)
File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/storage/mount.py",
line 305, in _runcmd
raise MountError(rc, b";".join((out, err)))
MountError: (32, ';mount:
/tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img:
failed to setup loop device: No such file or directory\n')
-------------------- >> begin captured logging << --------------------
2019-01-08 23:46:19,907 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mkisofs -R -J -o
/tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
/tmp/tmpfk8az9 (cwd None) (commands:198)
2019-01-08 23:46:19,931 DEBUG (MainThread) [root] SUCCESS: <err> =
'Total translation table size: 0\nTotal rockridge attributes bytes:
1796\nTotal directory bytes: 8192\nPath table size(bytes): 64\nMax brk
space used 22000\n199 extents written (0 MB)\n'; <rc> = 0
(commands:219)
2019-01-08 23:46:19,933 INFO (MainThread) [storage.Mount] mounting
/tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
at /tmp/vdsm-mkimage-testsxv7k7G/work (mount:204)
2019-01-08 23:46:19,934 DEBUG (MainThread) [root] /usr/bin/taskset
--cpu-list 0-1 /usr/bin/mount -o loop
/tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img
/tmp/vdsm-mkimage-testsxv7k7G/work (cwd None) (commands:198)
2019-01-08 23:46:19,946 DEBUG (MainThread) [root] FAILED: <err> =
'mount: /tmp/vdsm-mkimage-testsxv7k7G/images/vmId_iso.afeec73d2b486c5f33df966a0306836a.img:
failed to setup loop device: No such file or directory\n'; <rc> = 32
(commands:219)
--------------------- >> end captured logging << ---------------------
5 years, 10 months
- 2
- 1
Build failed in Jenkins:
system-sync_mirrors-centos-kvm-common-el7-x86_64 #2085
by jenkins＠jenkins.phx.ovirt.org
See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-kvm-common-el7-x8...>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-kvm-common-el7-x8...>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Pruning obsolete local branches
Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git
> git --version # timeout=10
> git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/changes/59/95959/1:test --prune
> git rev-parse origin/test^{commit} # timeout=10
> git rev-parse test^{commit} # timeout=10
Checking out Revision 05b40dfb4ec43a82530e8c471395d1858e5c59e1 (test)
> git config core.sparsecheckout # timeout=10
> git checkout -f 05b40dfb4ec43a82530e8c471395d1858e5c59e1
Commit message: "mirror-reposync: remove gluster-3.10 mirror"
> git rev-list --no-walk 05b40dfb4ec43a82530e8c471395d1858e5c59e1 # timeout=10
[system-sync_mirrors-centos-kvm-common-el7-x86_64] $ /bin/bash -xe /tmp/jenkins557032158534410757.sh
+ jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-kvm-common-el7 x86_64 jenkins/data/mirrors-reposync.conf
Checking if mirror needs a resync
Traceback (most recent call last):
File "/usr/bin/reposync", line 343, in <module>
main()
File "/usr/bin/reposync", line 175, in main
my.doRepoSetup()
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup
return self._getRepos(thisrepo, True)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos
self._repos.doSetup(thisrepo)
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup
self.retrieveAllMD()
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD
dl = repo._async and repo._commonLoadRepoXML(repo)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML
local = self.cachedir + '/repomd.xml'
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda>
cachedir = property(lambda self: self._dirGetAttr('cachedir'))
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr
self.dirSetup()
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup
self._dirSetupMkdir_p(dir)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p
raise Errors.RepoError, msg
yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-kvm-common-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-kvm-common-el7'
Build step 'Execute shell' marked build as failure
5 years, 10 months
- 1
- 1
Build failed in Jenkins:
system-sync_mirrors-fedora-base-fc29-x86_64 #188
by jenkins＠jenkins.phx.ovirt.org
See <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc29-x86_64/...>
Changes:
[Gal Ben Haim] ovirt-guest-agent: Drop 4.1 jobs
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc29-x86_64/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Pruning obsolete local branches
Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git
> git --version # timeout=10
> git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3980a490238a988869b7a2e070c14777d44a1226 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3980a490238a988869b7a2e070c14777d44a1226
Commit message: "ovirt-guest-agent: Drop 4.1 jobs"
> git rev-list --no-walk 41ba10d144e43636af927b6600c9a897656644c2 # timeout=10
[system-sync_mirrors-fedora-base-fc29-x86_64] $ /bin/bash -xe /tmp/jenkins2213412723554411166.sh
+ jenkins/scripts/mirror_mgr.sh resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf
+ MIRRORS_MP_BASE=/var/www/html/repos
+ MIRRORS_HTTP_BASE=http://mirrors.phx.ovirt.org/repos
+ MIRRORS_CACHE=/home/jenkins/mirrors_cache
+ MAX_LOCK_ATTEMPTS=120
+ LOCK_WAIT_INTERVAL=5
+ LOCK_BASE=/home/jenkins
+ OLD_MD_TO_KEEP=100
+ HTTP_SELINUX_TYPE=httpd_sys_content_t
+ HTTP_FILE_MODE=644
+ main resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf
+ local command=resync_yum_mirror
+ command_args=("${@:2}")
+ local command_args
+ cmd_resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf
+ local repo_name=fedora-base-fc29
+ local repo_archs=x86_64
+ local reposync_conf=jenkins/data/mirrors-reposync.conf
+ local sync_needed
+ mkdir -p /home/jenkins/mirrors_cache
+ verify_repo_fs fedora-base-fc29 yum
+ local repo_name=fedora-base-fc29
+ local repo_type=yum
+ sudo install -o jenkins -d /var/www/html/repos/yum /var/www/html/repos/yum/fedora-base-fc29 /var/www/html/repos/yum/fedora-base-fc29/base
+ check_yum_sync_needed fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf sync_needed
+ local repo_name=fedora-base-fc29
+ local repo_archs=x86_64
+ local reposync_conf=jenkins/data/mirrors-reposync.conf
+ local p_sync_needed=sync_needed
+ local reposync_out
+ echo 'Checking if mirror needs a resync'
Checking if mirror needs a resync
+ rm -rf /home/jenkins/mirrors_cache/fedora-base-fc29
++ IFS=,
++ echo x86_64
+ for arch in '$(IFS=,; echo $repo_archs)'
++ run_reposync fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf --urls --quiet
++ local repo_name=fedora-base-fc29
++ local repo_arch=x86_64
++ local reposync_conf=jenkins/data/mirrors-reposync.conf
++ extra_args=("${@:4}")
++ local extra_args
++ reposync --config=jenkins/data/mirrors-reposync.conf --repoid=fedora-base-fc29 --arch=x86_64 --cachedir=/home/jenkins/mirrors_cache --download_path=/var/www/html/repos/yum/fedora-base-fc29/base --norepopath --newest-only --urls --quiet
Traceback (most recent call last):
File "/usr/bin/reposync", line 343, in <module>
main()
File "/usr/bin/reposync", line 175, in main
my.doRepoSetup()
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup
return self._getRepos(thisrepo, True)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos
self._repos.doSetup(thisrepo)
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup
self.retrieveAllMD()
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD
dl = repo._async and repo._commonLoadRepoXML(repo)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML
local = self.cachedir + '/repomd.xml'
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda>
cachedir = property(lambda self: self._dirGetAttr('cachedir'))
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr
self.dirSetup()
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup
self._dirSetupMkdir_p(dir)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p
raise Errors.RepoError, msg
yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-kvm-common-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-kvm-common-el7'
+ reposync_out=
Build step 'Execute shell' marked build as failure
5 years, 10 months
- 1
- 1
[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org
Failed to run project_setup.sh for:
#1292 vdsm [check-patch].
It probably means that docker_cleanup.py failed.
This step doesn't fail the job, but we do collect
data about such failures to find the root cause.
Infra owner, ensure that we're not running out of
disk space on vm0035.workers-phx.ovirt.org.
5 years, 10 months
- 1
- 0