[oVirt Jenkins] ovirt-system-tests_compat-4.3-suite-master - Build # 374 - Still Failing!

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.3-suite-master/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.3-suite-master/... Build Number: 374 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #373 [Michal Skrivanek] upgrade browsers to 3.141.59-zirconium [Shlomi] Fixed hardcoded link for fedora-base-fc29 [Sandro Bonazzola] Drop failovermethod key in mock config. Changes for Build #374 [Andrej Cernek] network-suite-master: fix setup_networks not cleaning hosts ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.verify_engine_backup_43 Error Message: False != True after 600 seconds -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:7de26b7f-520d-4747-83e8-20f16421814e:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: end task:7de26b7f-520d-4747-83e8-20f16421814e:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: Running dc3b697c on lago-compat-4-3-suite-master-engine: mkdir /var/log/ost-engine-backup lago.ssh: DEBUG: Command dc3b697c on lago-compat-4-3-suite-master-engine returned with 0 lago.ssh: DEBUG: start task:61c308b4-08a7-4135-9a2b-bd20703e358a:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: end task:61c308b4-08a7-4135-9a2b-bd20703e358a:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: Running dc86bfc6 on lago-compat-4-3-suite-master-engine: engine-backup --mode=backup --file=/var/log/ost-engine-backup/backup.tgz --log=/var/log/ost-engine-backup/log.txt lago.ssh: DEBUG: Command dc86bfc6 on lago-compat-4-3-suite-master-engine returned with 1 lago.ssh: DEBUG: Command dc86bfc6 on lago-compat-4-3-suite-master-engine output: Start of engine-backup with mode 'backup' scope: all archive file: /var/log/ost-engine-backup/backup.tgz log file: /var/log/ost-engine-backup/log.txt Backing up: Notifying engine - Files Notifying engine lago.ssh: DEBUG: Command dc86bfc6 on lago-compat-4-3-suite-master-engine errors: tar: etc/pki/ovirt-engine: file changed as we read it FATAL: Failed backing up /etc/ovirt-engine /etc/ovirt-engine-dwh /etc/ovirt-provider-ovn/conf.d /etc/ovirt-provider-ovn/logger.conf /etc/ovirt-vmconsole /etc/pki/ovirt-engine /etc/pki/ovirt-vmconsole /etc/ovirt-engine-setup.conf.d /etc/httpd/conf.d/ovirt-engine-root-redirect.conf /etc/httpd/conf.d/ssl.conf /etc/httpd/conf.d/z-ovirt-engine-proxy.conf /etc/httpd/http.keytab /etc/httpd/conf.d/ovirt-sso.conf /etc/yum/pluginconf.d/versionlock.list /etc/dnf/plugins/versionlock.list /etc/firewalld/services/ovirt-https.xml /etc/firewalld/services/ovirt-http.xml /etc/firewalld/services/ovirt-postgres.xml /etc/firewalld/services/ovirt-provider-ovn.xml /etc/firewalld/services/ovn-central-firewall-service.xml /var/lib/openvswitch /var/lib/ovirt-engine/content /var/lib/ovirt-engine/engine.up /var/lib/ovirt-engine/external_truststore /var/lib/ovirt-engine/kernel /var/lib/ovirt-engine/setup /var/lib/ovirt-engine/timer-service-data /var/lib/ovirt-engine/tx-object-store --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_compat-4.3-suite-master/ovirt-system-tests/compat-4.3-suite-master/test-scenarios/002_bootstrap.py", line 1327, in verify_engine_backup 'Failed to run engine-backup with code {0}. Output: {1}'.format(result.code, result.out) File "/usr/lib64/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/jenkins/agent/workspace/ovirt-system-tests_compat-4.3-suite-master/ovirt-system-tests/compat-4.3-suite-master/test_utils/__init__.py", line 290, in TestEvent lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) "False != True after 600 seconds\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:7de26b7f-520d-4747-83e8-20f16421814e:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: end task:7de26b7f-520d-4747-83e8-20f16421814e:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: Running dc3b697c on lago-compat-4-3-suite-master-engine: mkdir /var/log/ost-engine-backup\nlago.ssh: DEBUG: Command dc3b697c on lago-compat-4-3-suite-master-engine returned with 0\nlago.ssh: DEBUG: start task:61c308b4-08a7-4135-9a2b-bd20703e358a:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: end task:61c308b4-08a7-4135-9a2b-bd20703e358a:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: Running dc86bfc6 on lago-compat-4-3-suite-master-engine: engine-backup --mode=backup --file=/var/log/ost-engine-backup/backup.tgz --log=/var/log/ost-engine-backup/log.txt\nlago.ssh: DEBUG: Command dc86bfc6 on lago-compat-4-3-suite-master-engine returned with 1\nlago.ssh: DEBUG: Command dc86bfc6 on lago-compat-4-3-suite-master-engine output:\n Start of engine-backup with mode 'backup'\nscope: all\narchive file: /var/log/ost-engine-backup/backup.tgz\nlog file: /var/log/ost-engine-backup/log.txt\nBacking up:\nNotifying engine\n- Files\nNotifying engine\n\nlago.ssh: DEBUG: Command dc86bfc6 on lago-compat-4-3-suite-master-engine errors:\n tar: etc/pki/ovirt-engine: file changed as we read it\nFATAL: Failed backing up /etc/ovirt-engine\n/etc/ovirt-engine-dwh\n/etc/ovirt-provider-ovn/conf.d\n/etc/ovirt-provider-ovn/logger.conf\n/etc/ovirt-vmconsole\n/etc/pki/ovirt-engine\n/etc/pki/ovirt-vmconsole\n/etc/ovirt-engine-setup.conf.d\n/etc/httpd/conf.d/ovirt-engine-root-redirect.conf\n/etc/httpd/conf.d/ssl.conf\n/etc/httpd/conf.d/z-ovirt-engine-proxy.conf\n/etc/httpd/http.keytab\n/etc/httpd/conf.d/ovirt-sso.conf\n/etc/yum/pluginconf.d/versionlock.list\n/etc/dnf/plugins/versionlock.list\n/etc/firewalld/services/ovirt-https.xml\n/etc/firewalld/services/ovirt-http.xml\n/etc/firewalld/services/ovirt-postgres.xml\n/etc/firewalld/services/ovirt-provider-ovn.xml\n/etc/firewalld/services/ovn-central-firewall-service.xml\n/var/lib/openvswitch\n/var/lib/ovirt-engine/content\n/var/lib/ovirt-engine/engine.up\n/var/lib/ovirt-engine/external_truststore\n/var/lib/ovirt-engine/kernel\n/var/lib/ovirt-engine/setup\n/var/lib/ovirt-engine/timer-service-data\n/var/lib/ovirt-engine/tx-object-store\n\n--------------------- >> end captured logging << ---------------------"