- Infra - oVirt List Archives

[oVirt Jenkins] deploy-to-gated-ovirt-master - Build #585 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-ovirt-master/585/ Build Name: #585 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

oVirt infra daily report - unstable production jobs - 1363
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1363//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 111643,21 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 02 Nov '20

02 Nov '20

Change 111643,21 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111643/21 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4029/

1 0

[CQ]: 111643, 21 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 02 Nov '20

02 Nov '20

Change 111643,21 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111643/21 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26752/

1 0

[oVirt Jenkins] deploy-to-gated-ovirt-master - Build #581 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-ovirt-master/581/ Build Name: #581 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[CQ]: 111913, 4 (ovirt-system-tests) failed "ovirt-4.3" system tests, but isn't the failure root cause
by oVirt Jenkins 02 Nov '20

02 Nov '20

A system test invoked by the "ovirt-4.3" change queue including change 111913,4 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 111946,2 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 111946,2 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/111913/4 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/111946/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4026/

1 0

[CQ]: 111913, 4 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 02 Nov '20

02 Nov '20

A system test invoked by the "ovirt-master" change queue including change 111913,4 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 111946,2 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 111946,2 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/111913/4 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/111946/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26733/

1 0

[oVirt Jenkins] deploy-to-gated-ovirt-4.3 - Build #584 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-ovirt-4.3/584/ Build Name: #584 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24751 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0144.workers-phx.ovirt.org.

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24752 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0141.workers-phx.ovirt.org.

1 0

[JIRA] (OVIRT-3051) [FIRING:1] LowDiskSpace_NodeExporter_v1_0 resources.ovirt.org:9100 ovirt-resources (/dev/mapper/resources_lvm-data ext4 /srv/resources)
by Shlomi Zidmi (oVirt JIRA) 02 Nov '20

02 Nov '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3051?page=com.atlassian.jira.… ] Shlomi Zidmi updated OVIRT-3051: -------------------------------- Resolution: Fixed Status: Done (was: To Do) This alert was fired before the cleanup occurred. Let's re-adjust the alert rule to wait for a longer period of time before firing the alert. > [FIRING:1] LowDiskSpace_NodeExporter_v1_0 resources.ovirt.org:9100 ovirt-resources (/dev/mapper/resources_lvm-data ext4 /srv/resources) > --------------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3051 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3051 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="LowDiskSpace_NodeExporter_v1_0",instance="resources.ovirt.org:9100",job="ovirt-resources"} > > Labels: > - alertname = LowDiskSpace_NodeExporter_v1_0 > - device = /dev/mapper/resources_lvm-data > - fstype = ext4 > - instance = resources.ovirt.org:9100 > - job = ovirt-resources > - mountpoint = /srv/resources > Annotations: > - description = resources.ovirt.org:9100 of job ovirt-resources has less than 10% free disk space > Source: http://prometheus-0:9090/graph?g0.expr=node_filesystem_free_bytes+%2F+node_… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24737 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0141.workers-phx.ovirt.org.

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24733 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0144.workers-phx.ovirt.org.

1 0

[CQ]: 112002,1 (jenkins) failed "dummy-master" system tests
by oVirt Jenkins 02 Nov '20

02 Nov '20

Change 112002,1 (jenkins) is probably the reason behind recent system test failures in the "dummy-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/112002/1 For failed test results see: https://jenkins.ovirt.org/job/dummy-master_change-queue-tester/549/

1 0

[oVirt Jenkins] deploy-to-gated-dummy-master - Build #403 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-dummy-master/403/ Build Name: #403 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24732 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0144.workers-phx.ovirt.org.

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24729 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0141.workers-phx.ovirt.org.

1 0

[CQ]: 112002,1 (jenkins) failed "dummy-master" system tests
by oVirt Jenkins 02 Nov '20

02 Nov '20

Change 112002,1 (jenkins) is probably the reason behind recent system test failures in the "dummy-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/112002/1 For failed test results see: https://jenkins-staging.phx.ovirt.org/job/dummy-master_change-queue-tester/…

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 543 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 543 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #543 [hbraha] network: remove xfail from active bond test ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.100_basic_ui_sanity.test_login[firefox] Error Message: test setup failure Stack Trace: engine_fqdn = 'engine', engine_ip = '192.168.201.4' @pytest.fixture(scope="session") def hub_url(engine_fqdn, engine_ip): env_url = _env_hub_url() if env_url is not None: yield env_url else: backend = _grid_backend() if backend == "podman": if os_utils.on_centos(8) and os_utils.inside_mock(): pytest.skip("podman doesn't work in mock") hub_port = network_utils.find_free_port(4444, 4544) with podman.grid(engine_fqdn, engine_ip, hub_port=hub_port) as hub_url: yield hub_url elif backend == "docker": > with docker.grid(engine_fqdn, engine_ip) as hub_url: ../ost_utils/ost_utils/pytest/fixtures/selenium/__init__.py:76: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib64/python2.7/contextlib.py:17: in __enter__ return self.gen.next() ../ost_utils/ost_utils/selenium/docker.py:118: in grid with _network(network_name): /usr/lib64/python2.7/contextlib.py:17: in __enter__ return self.gen.next() ../ost_utils/ost_utils/selenium/docker.py:61: in _network shell(["docker", "network", "create", network_name]) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker', 'network', 'create', 'grid'], bytes_output = False kwargs = {}, process = <subprocess.Popen object at 0x7fc8801d7190>, out = '' err = 'Error response from daemon: network with name grid already exists ' def shell(args, bytes_output=False, **kwargs): process = subprocess.Popen(args, stdout=subprocess.PIPE, stderr=subprocess.PIPE, **kwargs) out, err = process.communicate() if not bytes_output: out = out.decode("utf-8") err = err.decode("utf-8") if process.returncode: > raise ShellError(process.returncode, out, err) E ShellError: Command failed with rc=1. Stdout: E E Stderr: E Error response from daemon: network with name grid already exists ../ost_utils/ost_utils/shell.py:51: ShellError

1 1

[oVirt Jenkins] ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly - Build # 476 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-prevrelease-s… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-prevrelease-s… Build Number: 476 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #476 [hbraha] network: remove xfail from active bond test ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_performance-suite-master - Build # 1628 - Failure!
by jenkins＠jenkins.phx.ovirt.org 01 Nov '20

01 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/1… Build Number: 1628 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1628 [parthdhanjal] Updating gluster-inventory file ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 1000_analyze_postgresql.analyze_postgres Error Message: Failed to perform the postgres analysis. Exit code is 1 -------------------- >> begin captured logging << -------------------- lago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: ?[0m?[0m lago.ssh: DEBUG: start task:8c5a6a6c-5e73-4189-8d00-0521d30b5f6d:Get ssh client for lago-performance-suite-master-engine: lago.ssh: DEBUG: end task:8c5a6a6c-5e73-4189-8d00-0521d30b5f6d:Get ssh client for lago-performance-suite-master-engine: lago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: ?[32mSuccess?[0m (in 0:00:00) lago.ssh: DEBUG: start task:48f7a31c-2afe-493b-8aaf-7112c63109ac:Get ssh client for lago-performance-suite-master-engine: lago.ssh: DEBUG: end task:48f7a31c-2afe-493b-8aaf-7112c63109ac:Get ssh client for lago-performance-suite-master-engine: lago.ssh: DEBUG: Running dc1924fc on lago-performance-suite-master-engine: /root/analyze_postgresql.sh lago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine returned with 1 lago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine output: Last metadata expiration check: 0:10:09 ago on Sat 31 Oct 2020 11:00:48 PM EDT. pgdg-redhat-repo-42.0-11.noarch.rpm 8.5 kB/s | 11 kB 00:01 Dependencies resolved. ================================================================================ Package Architecture Version Repository Size ================================================================================ Installing: pgdg-redhat-repo noarch 42.0-11 @commandline 11 k Transaction Summary ================================================================================ Install 1 Package Total size: 11 k Installed size: 11 k Downloading Packages: Running transaction check Transaction check succeeded. Running transaction test Transaction test succeeded. Running transaction Preparing : 1/1 Installing : pgdg-redhat-repo-42.0-11.noarch 1/1 Verifying : pgdg-redhat-repo-42.0-11.noarch 1/1 Installed: pgdg-redhat-repo-42.0-11.noarch Complete! PostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 172 kB/s | 449 kB 00:02 PostgreSQL 12 for RHEL/CentOS 8 - x86_64 199 kB/s | 335 kB 00:01 PostgreSQL 11 for RHEL/CentOS 8 - x86_64 318 kB/s | 517 kB 00:01 PostgreSQL 10 for RHEL/CentOS 8 - x86_64 226 kB/s | 370 kB 00:01 PostgreSQL 9.6 for RHEL/CentOS 8 - x86_64 232 kB/s | 359 kB 00:01 PostgreSQL 9.5 for RHEL/CentOS 8 - x86_64 197 kB/s | 314 kB 00:01 Dependencies resolved. ================================================================================ Package Arch Version Repository Size ================================================================================ Installing: pgbadger noarch 11.3-1.rhel8 pgdg-common 348 k pgcluu noarch 3.1-2.rhel8 pgdg-common 356 k Installing dependencies: perl-Text-CSV_XS x86_64 1.40-1.el8 epel-el8 145 k perl-UNIVERSAL-isa noarch 1.20171012-4.el8 epel-el8 24 k Transaction Summary ================================================================================ Install 4 Packages Total download size: 874 k Installed size: 3.5 M Downloading Packages: (1/4): perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm 2.6 MB/s | 145 kB 00:00 (2/4): perl-UNIVERSAL-isa-1.20171012-4.el8.noar 571 kB/s | 24 kB 00:00 (3/4): pgbadger-11.3-1.rhel8.noarch.rpm 1.2 MB/s | 348 kB 00:00 (4/4): pgcluu-3.1-2.rhel8.noarch.rpm 980 kB/s | 356 kB 00:00 -------------------------------------------------------------------------------- Total 2.3 MB/s | 874 kB 00:00 PostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 1.6 MB/s | 1.7 kB 00:00 Key imported successfully Extra Packages for Enterprise Linux 8 - x86_64 7.3 kB/s | 1.6 kB 00:00 Key imported successfully Running transaction check Transaction check succeeded. Running transaction test Transaction test succeeded. Running transaction Preparing : 1/1 Installing : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 1/4 Installing : perl-Text-CSV_XS-1.40-1.el8.x86_64 2/4 Installing : pgbadger-11.3-1.rhel8.noarch 3/4 Installing : pgcluu-3.1-2.rhel8.noarch 4/4 Running scriptlet: pgcluu-3.1-2.rhel8.noarch 4/4 Verifying : pgbadger-11.3-1.rhel8.noarch 1/4 Verifying : pgcluu-3.1-2.rhel8.noarch 2/4 Verifying : perl-Text-CSV_XS-1.40-1.el8.x86_64 3/4 Verifying : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 4/4 Installed: perl-Text-CSV_XS-1.40-1.el8.x86_64 perl-UNIVERSAL-isa-1.20171012-4.el8.noarch pgbadger-11.3-1.rhel8.noarch pgcluu-3.1-2.rhel8.noarch Complete! lago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine errors: + pg_datadir=/var/lib/pgsql/data + pg_service=postgresql.service + pgdg= + scl_enable= ++ get_engine_pg_scl ++ engine_pg_scl_conf=(/etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf) ++ local engine_pg_scl_conf ++ local res= ++ [[ -e /etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf ]] ++ echo '' + engine_pg_scl= + [[ -n '' ]] ++ rpm -q postgresql + pgver=postgresql-12.1-2.module_el8.1.0+273+979c16e6.x86_64 + case "${pgver}" in + pgdg=https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/… + [[ -n https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgdg-… ]] + yum install -y https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgdg-… + yum install -y pgbadger pgcluu warning: /var/cache/dnf/pgdg-common-38b6c5045045f841/packages/pgbadger-11.3-1.rhel8.noarch.rpm: Header V4 DSA/SHA1 Signature, key ID 442df0f8: NOKEY Importing GPG key 0x442DF0F8: Userid : "PostgreSQL RPM Building Project <pgsqlrpms-hackers(a)pgfoundry.org>" Fingerprint: 68C9 E2B9 1A37 D136 FE74 D176 1F16 D2E1 442D F0F8 From : /etc/pki/rpm-gpg/RPM-GPG-KEY-PGDG warning: /var/cache/dnf/epel-el8-e791ead165840057/packages/perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID 2f86d6a1: NOKEY Importing GPG key 0x2F86D6A1: Userid : "Fedora EPEL (8) <epel(a)fedoraproject.org>" Fingerprint: 94E2 79EB 8D8F 25B2 1810 ADF1 21EA 45AB 2F86 D6A1 From : https://dl.fedoraproject.org/pub/epel/RPM-GPG-KEY-EPEL-8 ++ su - postgres -c 'psql postgres postgres -t -c '\''show log_directory'\''' ++ sed 2d + pglogdir=' log' + pglogdir=log + cd /var/lib/pgsql/data/log/ ++ su - postgres -c 'psql postgres postgres -t -c '\''show log_filename'\''' ++ sed 2d + pglog=' postgresql-%m.log' ++ date +postgresql-%m.log + pglog=postgresql-10.log + mkdir pgbadger + pgbadger -f stderr postgresql-10.log --outdir pgbadger FATAL: logfile "postgresql-10.log" must exist! - Error at line 2410 --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/1000_analyze_postgresql.py", line 52, in analyze_postgres ' Exit code is %s' % result.code File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in eq_ raise AssertionError(msg or "%r != %r" % (a, b)) 'Failed to perform the postgres analysis. Exit code is 1\n-------------------- >> begin captured logging << --------------------\nlago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: \x1b[0m\x1b[0m\nlago.ssh: DEBUG: start task:8c5a6a6c-5e73-4189-8d00-0521d30b5f6d:Get ssh client for lago-performance-suite-master-engine:\nlago.ssh: DEBUG: end task:8c5a6a6c-5e73-4189-8d00-0521d30b5f6d:Get ssh client for lago-performance-suite-master-engine:\nlago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: \x1b[32mSuccess\x1b[0m (in 0:00:00)\nlago.ssh: DEBUG: start task:48f7a31c-2afe-493b-8aaf-7112c63109ac:Get ssh client for lago-performance-suite-master-engine:\nlago.ssh: DEBUG: end task:48f7a31c-2afe-493b-8aaf-7112c63109ac:Get ssh client for lago-performance-suite-master-engine:\nlago.ssh: DEBUG: Running dc1924fc on lago-performance-suite-master-engine: /root/analyze_postgresql.sh\nlago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine returned with 1\nlago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine output:\n Last metadata expiration check: 0:10:09 ago on Sat 31 Oct 2020 11:00:48 PM EDT.\npgdg-redhat-repo-42.0-11.noarch.rpm 8.5 kB/s | 11 kB 00:01 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling:\n pgdg-redhat-repo noarch 42.0-11 @commandline 11 k\n\nTransaction Summary\n================================================================================\nInstall 1 Package\n\nTotal size: 11 k\nInstalled size: 11 k\nDownloading Packages:\nRunning transaction check\nTransaction check succeeded.\nRunning transaction test\nTransaction test succeeded.\nRunning transaction\n Preparing : 1/1 \n Installing : pgdg-redhat-repo-42.0-11.noarch 1/1 \n Verifying : pgdg-redhat-repo-42.0-11.noarch 1/1 \n\nInstalled:\n pgdg-redhat-repo-42.0-11.noarch \n\nComplete!\nPostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 172 kB/s | 449 kB 00:02 \nPostgreSQL 12 for RHEL/CentOS 8 - x86_64 199 kB/s | 335 kB 00:01 \nPostgreSQL 11 for RHEL/CentOS 8 - x86_64 318 kB/s | 517 kB 00:01 \nPostgreSQL 10 for RHEL/CentOS 8 - x86_64 226 kB/s | 370 kB 00:01 \nPostgreSQL 9.6 for RHEL/CentOS 8 - x86_64 232 kB/s | 359 kB 00:01 \nPostgreSQL 9.5 for RHEL/CentOS 8 - x86_64 197 kB/s | 314 kB 00:01 \nDependencies resolved.\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n pgbadger noarch 11.3-1.rhel8 pgdg-common 348 k\n pgcluu noarch 3.1-2.rhel8 pgdg-common 356 k\nInstalling dependencies:\n perl-Text-CSV_XS x86_64 1.40-1.el8 epel-el8 145 k\n perl-UNIVERSAL-isa noarch 1.20171012-4.el8 epel-el8 24 k\n\nTransaction Summary\n================================================================================\nInstall 4 Packages\n\nTotal download size: 874 k\nInstalled size: 3.5 M\nDownloading Packages:\n(1/4): perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm 2.6 MB/s | 145 kB 00:00 \n(2/4): perl-UNIVERSAL-isa-1.20171012-4.el8.noar 571 kB/s | 24 kB 00:00 \n(3/4): pgbadger-11.3-1.rhel8.noarch.rpm 1.2 MB/s | 348 kB 00:00 \n(4/4): pgcluu-3.1-2.rhel8.noarch.rpm 980 kB/s | 356 kB 00:00 \n--------------------------------------------------------------------------------\nTotal 2.3 MB/s | 874 kB 00:00 \nPostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 1.6 MB/s | 1.7 kB 00:00 \nKey imported successfully\nExtra Packages for Enterprise Linux 8 - x86_64 7.3 kB/s | 1.6 kB 00:00 \nKey imported successfully\nRunning transaction check\nTransaction check succeeded.\nRunning transaction test\nTransaction test succeeded.\nRunning transaction\n Preparing : 1/1 \n Installing : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 1/4 \n Installing : perl-Text-CSV_XS-1.40-1.el8.x86_64 2/4 \n Installing : pgbadger-11.3-1.rhel8.noarch 3/4 \n Installing : pgcluu-3.1-2.rhel8.noarch 4/4 \n Running scriptlet: pgcluu-3.1-2.rhel8.noarch 4/4 \n Verifying : pgbadger-11.3-1.rhel8.noarch 1/4 \n Verifying : pgcluu-3.1-2.rhel8.noarch 2/4 \n Verifying : perl-Text-CSV_XS-1.40-1.el8.x86_64 3/4 \n Verifying : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 4/4 \n\nInstalled:\n perl-Text-CSV_XS-1.40-1.el8.x86_64 perl-UNIVERSAL-isa-1.20171012-4.el8.noarch\n pgbadger-11.3-1.rhel8.noarch pgcluu-3.1-2.rhel8.noarch \n\nComplete!\n\nlago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine errors:\n + pg_datadir=/var/lib/pgsql/data\n+ pg_service=postgresql.service\n+ pgdg=\n+ scl_enable=\n++ get_engine_pg_scl\n++ engine_pg_scl_conf=(/etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf)\n++ local engine_pg_scl_conf\n++ local res=\n++ [[ -e /etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf ]]\n++ echo \'\'\n+ engine_pg_scl=\n+ [[ -n \'\' ]]\n++ rpm -q postgresql\n+ pgver=postgresql-12.1-2.module_el8.1.0+273+979c16e6.x86_64\n+ case "${pgver}" in\n+ pgdg=https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/… [[ -n https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgdg-… ]]\n+ yum install -y https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgdg-… yum install -y pgbadger pgcluu\nwarning: /var/cache/dnf/pgdg-common-38b6c5045045f841/packages/pgbadger-11.3-1.rhel8.noarch.rpm: Header V4 DSA/SHA1 Signature, key ID 442df0f8: NOKEY\nImporting GPG key 0x442DF0F8:\n Userid : "PostgreSQL RPM Building Project <pgsqlrpms-hackers(a)pgfoundry.org>"\n Fingerprint: 68C9 E2B9 1A37 D136 FE74 D176 1F16 D2E1 442D F0F8\n From : /etc/pki/rpm-gpg/RPM-GPG-KEY-PGDG\nwarning: /var/cache/dnf/epel-el8-e791ead165840057/packages/perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID 2f86d6a1: NOKEY\nImporting GPG key 0x2F86D6A1:\n Userid : "Fedora EPEL (8) <epel(a)fedoraproject.org>"\n Fingerprint: 94E2 79EB 8D8F 25B2 1810 ADF1 21EA 45AB 2F86 D6A1\n From : https://dl.fedoraproject.org/pub/epel/RPM-GPG-KEY-EPEL-8\n++ su - postgres -c \'psql postgres postgres -t -c \'\\\'\'show log_directory\'\\\'\'\'\n++ sed 2d\n+ pglogdir=\' log\'\n+ pglogdir=log\n+ cd /var/lib/pgsql/data/log/\n++ su - postgres -c \'psql postgres postgres -t -c \'\\\'\'show log_filename\'\\\'\'\'\n++ sed 2d\n+ pglog=\' postgresql-%m.log\'\n++ date +postgresql-%m.log\n+ pglog=postgresql-10.log\n+ mkdir pgbadger\n+ pgbadger -f stderr postgresql-10.log --outdir pgbadger\nFATAL: logfile "postgresql-10.log" must exist!\n - Error at line 2410\n\n--------------------- >> end captured logging << ---------------------'

1 1

oVirt infra daily report - unstable production jobs - 1362
by jenkins＠jenkins.phx.ovirt.org 01 Nov '20

01 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1362//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 111946,2 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 01 Nov '20

01 Nov '20

Change 111946,2 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111946/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4024/

1 0

[CQ]: 111946, 2 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 01 Nov '20

01 Nov '20

Change 111946,2 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111946/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26731/

1 0

[JIRA] (OVIRT-3052) [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://www.gtlib.gatech.edu/pub/oVirt/pub
by Alertmanager_Bot (oVirt JIRA) 01 Nov '20

01 Nov '20

Alertmanager_Bot created OVIRT-3052: --------------------------------------- Summary: [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://www.gtlib.gatech.edu/pub/oVirt/pub Key: OVIRT-3052 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3052 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = MirrorIsOutOfSync - instance = web-ovirt-mirrorchecker.apps.ovirt.org:80 - job = oVirt-mirrors-health - url = http://www.gtlib.gatech.edu/pub/oVirt/pub Annotations: - description = http://www.gtlib.gatech.edu/pub/oVirt/pub (measured by oVirt-mirrors-health) has not been synced in the past two days. Source: http://prometheus-0:9090/graph?g0.expr=mirror_health_check+%3E+259200&g0.ta… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0