[oVirt Jenkins] ovirt-system-tests_compat-4.3-suite-master - Build
# 371 - Failure!
by jenkins@jenkins.phx.ovirt.org
Project: https://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.3-suite-master/
Build: https://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.3-suite-master/...
Build Number: 371
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #371
[jenkins CI] Auto create ovirt-4.3-release
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 002_bootstrap.configure_storage_43
Error Message:
setup_storage.sh failed. Exit code is 1
-------------------- >> begin captured logging << --------------------
lago.ssh: DEBUG: start task:50d2df36-1491-4ee2-8674-ac9cf4fe32fc:Get ssh client for lago-compat-4-3-suite-master-engine:
lago.ssh: DEBUG: end task:50d2df36-1491-4ee2-8674-ac9cf4fe32fc:Get ssh client for lago-compat-4-3-suite-master-engine:
lago.ssh: DEBUG: Running 015f4bd2 on lago-compat-4-3-suite-master-engine: /tmp/setup_storage.sh
lago.ssh: DEBUG: Command 015f4bd2 on lago-compat-4-3-suite-master-engine returned with 1
lago.ssh: DEBUG: Command 015f4bd2 on lago-compat-4-3-suite-master-engine output:
Last metadata expiration check: 0:11:18 ago on Sat 07 Mar 2020 08:02:07 PM EST.
Package nfs-utils-1:2.3.3-26.el8.x86_64 is already installed.
Package rpcbind-1.2.5-4.el8.x86_64 is already installed.
Package lvm2-8:2.03.05-5.el8.0.1.x86_64 is already installed.
Package sg3_utils-1.44-3.el8.x86_64 is already installed.
Package iscsi-initiator-utils-6.2.0.877-1.gitf71581b.el8.x86_64 is already installed.
Package lsscsi-0.30-1.el8.x86_64 is already installed.
Package policycoreutils-python-utils-2.9-3.el8.noarch is already installed.
Dependencies resolved.
================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
targetcli noarch 2.1.fb49-1.el8 centos-appstream-el8 73 k
Upgrading:
policycoreutils x86_64 2.9-3.el8_1.1 centos-base-el8 377 k
policycoreutils-python-utils
noarch 2.9-3.el8_1.1 centos-base-el8 250 k
python3-policycoreutils noarch 2.9-3.el8_1.1 centos-base-el8 2.2 M
Installing dependencies:
fontconfig x86_64 2.13.1-3.el8 centos-base-el8 275 k
python3-configshell noarch 1:1.1.fb25-1.el8 centos-base-el8 74 k
python3-kmod x86_64 0.9-20.el8 centos-base-el8 90 k
python3-pyparsing noarch 2.1.10-7.el8 centos-base-el8 142 k
python3-rtslib noarch 2.1.fb69-3.el8 centos-base-el8 100 k
python3-urwid x86_64 1.3.1-4.el8 centos-base-el8 783 k
target-restore noarch 2.1.fb69-3.el8 centos-base-el8 23 k
cairo x86_64 1.15.12-3.el8 centos-appstream-el8 721 k
cairo-gobject x86_64 1.15.12-3.el8 centos-appstream-el8 33 k
libX11 x86_64 1.6.7-1.el8 centos-appstream-el8 612 k
libX11-common noarch 1.6.7-1.el8 centos-appstream-el8 157 k
libXau x86_64 1.0.8-13.el8 centos-appstream-el8 36 k
libXext x86_64 1.3.3-9.el8 centos-appstream-el8 45 k
libXrender x86_64 0.9.10-7.el8 centos-appstream-el8 33 k
libxcb x86_64 1.13-5.el8 centos-appstream-el8 230 k
pixman x86_64 0.36.0-1.el8 centos-appstream-el8 256 k
python3-cairo x86_64 1.16.3-6.el8 centos-appstream-el8 90 k
python3-gobject x86_64 3.28.3-1.el8 centos-appstream-el8 25 k
Transaction Summary
================================================================================
Install 19 Packages
Upgrade 3 Packages
Total download size: 6.6 M
Downloading Packages:
(1/22): fontconfig-2.13.1-3.el8.x86_64.rpm 909 kB/s | 275 kB 00:00
(2/22): python3-pyparsing-2.1.10-7.el8.noarch.r 1.9 MB/s | 142 kB 00:00
(3/22): python3-rtslib-2.1.fb69-3.el8.noarch.rp 2.6 MB/s | 100 kB 00:00
(4/22): python3-urwid-1.3.1-4.el8.x86_64.rpm 6.9 MB/s | 783 kB 00:00
(5/22): target-restore-2.1.fb69-3.el8.noarch.rp 551 kB/s | 23 kB 00:00
(6/22): cairo-1.15.12-3.el8.x86_64.rpm 8.5 MB/s | 721 kB 00:00
(7/22): cairo-gobject-1.15.12-3.el8.x86_64.rpm 653 kB/s | 33 kB 00:00
(8/22): libX11-1.6.7-1.el8.x86_64.rpm 7.2 MB/s | 612 kB 00:00
(9/22): libX11-common-1.6.7-1.el8.noarch.rpm 3.3 MB/s | 157 kB 00:00
(10/22): libXau-1.0.8-13.el8.x86_64.rpm 684 kB/s | 36 kB 00:00
(11/22): libXext-1.3.3-9.el8.x86_64.rpm 1.0 MB/s | 45 kB 00:00
(12/22): libXrender-0.9.10-7.el8.x86_64.rpm 936 kB/s | 33 kB 00:00
(13/22): libxcb-1.13-5.el8.x86_64.rpm 4.6 MB/s | 230 kB 00:00
(14/22): pixman-0.36.0-1.el8.x86_64.rpm 5.2 MB/s | 256 kB 00:00
(15/22): python3-cairo-1.16.3-6.el8.x86_64.rpm 1.9 MB/s | 90 kB 00:00
(16/22): python3-gobject-3.28.3-1.el8.x86_64.rp 535 kB/s | 25 kB 00:00
(17/22): targetcli-2.1.fb49-1.el8.noarch.rpm 1.3 MB/s | 73 kB 00:00
(18/22): policycoreutils-2.9-3.el8_1.1.x86_64.r 5.0 MB/s | 377 kB 00:00
(19/22): policycoreutils-python-utils-2.9-3.el8 3.9 MB/s | 250 kB 00:00
(20/22): python3-policycoreutils-2.9-3.el8_1.1. 14 MB/s | 2.2 MB 00:00
[MIRROR] python3-configshell-1.1.fb25-1.el8.noarch.rpm: Curl error (28): Timeout was reached for http://mirror.centos.org/centos-8/8/BaseOS/x86_64/os/Packages/python3-con... [Connection timed out after 30001 milliseconds]
[MIRROR] python3-kmod-0.9-20.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.centos.org/centos-8/8/BaseOS/x86_64/os/Packages/python3-kmo... [Connection timed out after 30001 milliseconds]
[MIRROR] python3-configshell-1.1.fb25-1.el8.noarch.rpm: Curl error (28): Timeout was reached for http://mirror.centos.org/centos-8/8/BaseOS/x86_64/os/Packages/python3-con... [Connection timed out after 30000 milliseconds]
[FAILED] python3-configshell-1.1.fb25-1.el8.noarch.rpm: No more mirrors to try - All mirrors were already tried without success
The downloaded packages were saved in cache until the next successful transaction.
You can remove cached packages by executing 'dnf clean packages'.
lago.ssh: DEBUG: Command 015f4bd2 on lago-compat-4-3-suite-master-engine errors:
+ set -xe
+ MAIN_NFS_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_2
+ ISCSI_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_3
+ NUM_LUNS=5
++ uname -r
++ awk -F. '{print $(NF-1)}'
+ DIST=el8_1
+ main
++ hostname
+ [[ lago-compat-4-3-suite-master-engine == *\i\p\v\6* ]]
+ install_deps
+ systemctl disable --now kdump.service
Removed /etc/systemd/system/multi-user.target.wants/kdump.service.
+ yum install --nogpgcheck -y nfs-utils rpcbind lvm2 targetcli sg3_utils iscsi-initiator-utils lsscsi policycoreutils-python-utils
Error: Error downloading packages:
Cannot download Packages/python3-configshell-1.1.fb25-1.el8.noarch.rpm: All mirrors were tried
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/home/jenkins/agent/workspace/ovirt-system-tests_compat-4.3-suite-master/ovirt-system-tests/compat-4.3-suite-master/test-scenarios/002_bootstrap.py", line 423, in configure_storage
result.code, 0, 'setup_storage.sh failed. Exit code is %s' % result.code
File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in eq_
raise AssertionError(msg or "%r != %r" % (a, b))
"setup_storage.sh failed. Exit code is 1\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:50d2df36-1491-4ee2-8674-ac9cf4fe32fc:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: end task:50d2df36-1491-4ee2-8674-ac9cf4fe32fc:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: Running 015f4bd2 on lago-compat-4-3-suite-master-engine: /tmp/setup_storage.sh\nlago.ssh: DEBUG: Command 015f4bd2 on lago-compat-4-3-suite-master-engine returned with 1\nlago.ssh: DEBUG: Command 015f4bd2 on lago-compat-4-3-suite-master-engine output:\n Last metadata expiration check: 0:11:18 ago on Sat 07 Mar 2020 08:02:07 PM EST.\nPackage nfs-utils-1:2.3.3-26.el8.x86_64 is already installed.\nPackage rpcbind-1.2.5-4.el8.x86_64 is already installed.\nPackage lvm2-8:2.03.05-5.el8.0.1.x86_64 is already installed.\nPackage sg3_utils-1.44-3.el8.x86_64 is already installed.\nPackage iscsi-initiator-utils-6.2.0.877-1.gitf71581b.el8.x86_64 is already installed.\nPackage lsscsi-0.30-1.el8.x86_64 is already installed.\nPackage policycoreutils-python-utils-2.9-3.el8.noarch is already installed.\nDependencies resolved.\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n targetcli noarch 2.1.fb49-1.el8 centos-appstream-el8 73 k\nUpgrading:\n policycoreutils x86_64 2.9-3.el8_1.1 centos-base-el8 377 k\n policycoreutils-python-utils\n noarch 2.9-3.el8_1.1 centos-base-el8 250 k\n python3-policycoreutils noarch 2.9-3.el8_1.1 centos-base-el8 2.2 M\nInstalling dependencies:\n fontconfig x86_64 2.13.1-3.el8 centos-base-el8 275 k\n python3-configshell noarch 1:1.1.fb25-1.el8 centos-base-el8 74 k\n python3-kmod x86_64 0.9-20.el8 centos-base-el8 90 k\n python3-pyparsing noarch 2.1.10-7.el8 centos-base-el8 142 k\n python3-rtslib noarch 2.1.fb69-3.el8 centos-base-el8 100 k\n python3-urwid x86_64 1.3.1-4.el8 centos-base-el8 783 k\n target-restore noarch 2.1.fb69-3.el8 centos-base-el8 23 k\n cairo x86_64 1.15.12-3.el8 centos-appstream-el8 721 k\n cairo-gobject x86_64 1.15.12-3.el8 centos-appstream-el8 33 k\n libX11 x86_64 1.6.7-1.el8 centos-appstream-el8 612 k\n libX11-common noarch 1.6.7-1.el8 centos-appstream-el8 157 k\n libXau x86_64 1.0.8-13.el8 centos-appstream-el8 36 k\n libXext x86_64 1.3.3-9.el8 centos-appstream-el8 45 k\n libXrender x86_64 0.9.10-7.el8 centos-appstream-el8 33 k\n libxcb x86_64 1.13-5.el8 centos-appstream-el8 230 k\n pixman x86_64 0.36.0-1.el8 centos-appstream-el8 256 k\n python3-cairo x86_64 1.16.3-6.el8 centos-appstream-el8 90 k\n python3-gobject x86_64 3.28.3-1.el8 centos-appstream-el8 25 k\n\nTransaction Summary\n================================================================================\nInstall 19 Packages\nUpgrade 3 Packages\n\nTotal download size: 6.6 M\nDownloading Packages:\n(1/22): fontconfig-2.13.1-3.el8.x86_64.rpm 909 kB/s | 275 kB 00:00 \n(2/22): python3-pyparsing-2.1.10-7.el8.noarch.r 1.9 MB/s | 142 kB 00:00 \n(3/22): python3-rtslib-2.1.fb69-3.el8.noarch.rp 2.6 MB/s | 100 kB 00:00 \n(4/22): python3-urwid-1.3.1-4.el8.x86_64.rpm 6.9 MB/s | 783 kB 00:00 \n(5/22): target-restore-2.1.fb69-3.el8.noarch.rp 551 kB/s | 23 kB 00:00 \n(6/22): cairo-1.15.12-3.el8.x86_64.rpm 8.5 MB/s | 721 kB 00:00 \n(7/22): cairo-gobject-1.15.12-3.el8.x86_64.rpm 653 kB/s | 33 kB 00:00 \n(8/22): libX11-1.6.7-1.el8.x86_64.rpm 7.2 MB/s | 612 kB 00:00 \n(9/22): libX11-common-1.6.7-1.el8.noarch.rpm 3.3 MB/s | 157 kB 00:00 \n(10/22): libXau-1.0.8-13.el8.x86_64.rpm 684 kB/s | 36 kB 00:00 \n(11/22): libXext-1.3.3-9.el8.x86_64.rpm 1.0 MB/s | 45 kB 00:00 \n(12/22): libXrender-0.9.10-7.el8.x86_64.rpm 936 kB/s | 33 kB 00:00 \n(13/22): libxcb-1.13-5.el8.x86_64.rpm 4.6 MB/s | 230 kB 00:00 \n(14/22): pixman-0.36.0-1.el8.x86_64.rpm 5.2 MB/s | 256 kB 00:00 \n(15/22): python3-cairo-1.16.3-6.el8.x86_64.rpm 1.9 MB/s | 90 kB 00:00 \n(16/22): python3-gobject-3.28.3-1.el8.x86_64.rp 535 kB/s | 25 kB 00:00 \n(17/22): targetcli-2.1.fb49-1.el8.noarch.rpm 1.3 MB/s | 73 kB 00:00 \n(18/22): policycoreutils-2.9-3.el8_1.1.x86_64.r 5.0 MB/s | 377 kB 00:00 \n(19/22): policycoreutils-python-utils-2.9-3.el8 3.9 MB/s | 250 kB 00:00 \n(20/22): python3-policycoreutils-2.9-3.el8_1.1. 14 MB/s | 2.2 MB 00:00 \n[MIRROR] python3-configshell-1.1.fb25-1.el8.noarch.rpm: Curl error (28): Timeout was reached for http://mirror.centos.org/centos-8/8/BaseOS/x86_64/os/Packages/python3-con... [Connection timed out after 30001 milliseconds]\n[MIRROR] python3-kmod-0.9-20.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.centos.org/centos-8/8/BaseOS/x86_64/os/Packages/python3-kmo... [Connection timed out after 30001 milliseconds]\n[MIRROR] python3-configshell-1.1.fb25-1.el8.noarch.rpm: Curl error (28): Timeout was reached for http://mirror.centos.org/centos-8/8/BaseOS/x86_64/os/Packages/python3-con... [Connection timed out after 30000 milliseconds]\n[FAILED] python3-configshell-1.1.fb25-1.el8.noarch.rpm: No more mirrors to try - All mirrors were already tried without success\n\nThe downloaded packages were saved in cache until the next successful transaction.\nYou can remove cached packages by executing 'dnf clean packages'.\n\nlago.ssh: DEBUG: Command 015f4bd2 on lago-compat-4-3-suite-master-engine errors:\n + set -xe\n+ MAIN_NFS_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_2\n+ ISCSI_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_3\n+ NUM_LUNS=5\n++ uname -r\n++ awk -F. '{print $(NF-1)}'\n+ DIST=el8_1\n+ main\n++ hostname\n+ [[ lago-compat-4-3-suite-master-engine == *\\i\\p\\v\\6* ]]\n+ install_deps\n+ systemctl disable --now kdump.service\nRemoved /etc/systemd/system/multi-user.target.wants/kdump.service.\n+ yum install --nogpgcheck -y nfs-utils rpcbind lvm2 targetcli sg3_utils iscsi-initiator-utils lsscsi policycoreutils-python-utils\nError: Error downloading packages:\n Cannot download Packages/python3-configshell-1.1.fb25-1.el8.noarch.rpm: All mirrors were tried\n\n--------------------- >> end captured logging << ---------------------"
4 years, 8 months
Fix ansible-hosted-engine publishing (was: [oVirt Jenkins]
ovirt-system-tests_he-basic-suite-4.3 - Build # 373 - Still Failing!)
by Yedidyah Bar David
On Sun, Mar 8, 2020 at 4:30 AM <jenkins(a)jenkins.phx.ovirt.org> wrote:
>
> Project: https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.3/
> Build: https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.3/373/
This broke because it uses ovirt-ansible-hosted-engine-setup master
branch, which recently changed to use 'ip -j rule', which does not
exist on el7:
https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.3/373/a...
2020-03-07 21:27:51,291-0500 DEBUG ansible on_any args localhostTASK:
ovirt.hosted_engine_setup : Get routing rules, IPv4 kwargs
2020-03-07 21:27:52,074-0500 DEBUG var changed: host "localhost" var
"route_rules_ipv4" type "<type 'dict'>" value: "{
"changed": true,
"cmd": [
"ip",
"-j",
"rule"
],
"delta": "0:00:00.007015",
"end": "2020-03-07 21:27:51.641695",
"failed": true,
"msg": "non-zero return code",
"rc": 255,
"start": "2020-03-07 21:27:51.634680",
"stderr": "Option \"-j\" is unknown, try \"ip -help\".",
"stderr_lines": [
"Option \"-j\" is unknown, try \"ip -help\"."
],
"stdout": "",
"stdout_lines": []
}"
Asaf and Evgeny recently branched the project for 4.3, and are working
on publishing each branch to the correct repo:
https://github.com/oVirt/ovirt-ansible-hosted-engine-setup/pull/300
Once this is ready and merged, we might need infra's help in removing
the too-new package from 4.3 repos, and escort the 4.3 build through
the change-queue to 4.3 repos.
Best regards,
--
Didi
4 years, 8 months