Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/859... Build Number: 859 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #859 [Michal Skrivanek] drop zuul config ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.verify_engine_backup Error Message: False != True after 600 seconds -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:f01de9e6-33e8-40d9-a0d9-d7ba66b99fd9:Get ssh client for lago-basic-suite-4-3-engine: lago.ssh: DEBUG: end task:f01de9e6-33e8-40d9-a0d9-d7ba66b99fd9:Get ssh client for lago-basic-suite-4-3-engine: lago.ssh: DEBUG: Running 68829430 on lago-basic-suite-4-3-engine: mkdir /var/log/ost-engine-backup lago.ssh: DEBUG: Command 68829430 on lago-basic-suite-4-3-engine returned with 0 lago.ssh: DEBUG: start task:0522c55c-1c01-4e1e-b5a8-bf2445b918ba:Get ssh client for lago-basic-suite-4-3-engine: lago.ssh: DEBUG: end task:0522c55c-1c01-4e1e-b5a8-bf2445b918ba:Get ssh client for lago-basic-suite-4-3-engine: lago.ssh: DEBUG: Running 68ec69c8 on lago-basic-suite-4-3-engine: engine-backup --mode=backup --file=/var/log/ost-engine-backup/backup.tgz --log=/var/log/ost-engine-backup/log.txt lago.ssh: DEBUG: Command 68ec69c8 on lago-basic-suite-4-3-engine returned with 1 lago.ssh: DEBUG: Command 68ec69c8 on lago-basic-suite-4-3-engine output: Start of engine-backup with mode 'backup' scope: all archive file: /var/log/ost-engine-backup/backup.tgz log file: /var/log/ost-engine-backup/log.txt Backing up: Notifying engine - Files Notifying engine lago.ssh: DEBUG: Command 68ec69c8 on lago-basic-suite-4-3-engine errors: FATAL: Failed backing up /etc/ovirt-engine /etc/ovirt-engine-dwh /etc/ovirt-provider-ovn/conf.d /etc/ovirt-provider-ovn/logger.conf /etc/ovirt-vmconsole /etc/pki/ovirt-engine /etc/pki/ovirt-vmconsole /etc/ovirt-engine-setup.conf.d /etc/httpd/conf.d/ovirt-engine-root-redirect.conf /etc/httpd/conf.d/ssl.conf /etc/httpd/conf.d/z-ovirt-engine-proxy.conf /etc/httpd/http.keytab /etc/httpd/conf.d/ovirt-sso.conf /etc/yum/pluginconf.d/versionlock.list /etc/dnf/plugins/versionlock.list /etc/firewalld/services/ovirt-https.xml /etc/firewalld/services/ovirt-http.xml /etc/firewalld/services/ovirt-postgres.xml /etc/firewalld/services/ovirt-provider-ovn.xml /etc/firewalld/services/ovn-central-firewall-service.xml /var/lib/openvswitch /var/lib/ovirt-engine/content /var/lib/ovirt-engine/engine.up /var/lib/ovirt-engine/external_truststore /var/lib/ovirt-engine/kernel /var/lib/ovirt-engine/setup /var/lib/ovirt-engine/timer-service-data /var/lib/ovirt-engine/tx-object-store --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/002_bootstrap.py", line 1278, in verify_engine_backup 'Failed to run engine-backup with code {0}. Output: {1}'.format(result.code, result.out) File "/usr/lib64/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test_utils/__init__.py", line 265, in TestEvent lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) "False != True after 600 seconds\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:f01de9e6-33e8-40d9-a0d9-d7ba66b99fd9:Get ssh client for lago-basic-suite-4-3-engine:\nlago.ssh: DEBUG: end task:f01de9e6-33e8-40d9-a0d9-d7ba66b99fd9:Get ssh client for lago-basic-suite-4-3-engine:\nlago.ssh: DEBUG: Running 68829430 on lago-basic-suite-4-3-engine: mkdir /var/log/ost-engine-backup\nlago.ssh: DEBUG: Command 68829430 on lago-basic-suite-4-3-engine returned with 0\nlago.ssh: DEBUG: start task:0522c55c-1c01-4e1e-b5a8-bf2445b918ba:Get ssh client for lago-basic-suite-4-3-engine:\nlago.ssh: DEBUG: end task:0522c55c-1c01-4e1e-b5a8-bf2445b918ba:Get ssh client for lago-basic-suite-4-3-engine:\nlago.ssh: DEBUG: Running 68ec69c8 on lago-basic-suite-4-3-engine: engine-backup --mode=backup --file=/var/log/ost-engine-backup/backup.tgz --log=/var/log/ost-engine-backup/log.txt\nlago.ssh: DEBUG: Command 68ec69c8 on lago-basic-suite-4-3-engine returned with 1\nlago.ssh: DEBUG: Command 68ec69c8 on lago-basic-suite-4-3-engine output:\n Start of engine-backup with mode 'backup'\nscope: all\narchive file: /var/log/ost-engine-backup/backup.tgz\nlog file: /var/log/ost-engine-backup/log.txt\nBacking up:\nNotifying engine\n- Files\nNotifying engine\n\nlago.ssh: DEBUG: Command 68ec69c8 on lago-basic-suite-4-3-engine errors:\n FATAL: Failed backing up /etc/ovirt-engine\n/etc/ovirt-engine-dwh\n/etc/ovirt-provider-ovn/conf.d\n/etc/ovirt-provider-ovn/logger.conf\n/etc/ovirt-vmconsole\n/etc/pki/ovirt-engine\n/etc/pki/ovirt-vmconsole\n/etc/ovirt-engine-setup.conf.d\n/etc/httpd/conf.d/ovirt-engine-root-redirect.conf\n/etc/httpd/conf.d/ssl.conf\n/etc/httpd/conf.d/z-ovirt-engine-proxy.conf\n/etc/httpd/http.keytab\n/etc/httpd/conf.d/ovirt-sso.conf\n/etc/yum/pluginconf.d/versionlock.list\n/etc/dnf/plugins/versionlock.list\n/etc/firewalld/services/ovirt-https.xml\n/etc/firewalld/services/ovirt-http.xml\n/etc/firewalld/services/ovirt-postgres.xml\n/etc/firewalld/services/ovirt-provider-ovn.xml\n/etc/firewalld/services/ovn-central-firewall-service.xml\n/var/lib/openvswitch\n/var/lib/ovirt-engine/content\n/var/lib/ovirt-engine/engine.up\n/var/lib/ovirt-engine/external_truststore\n/var/lib/ovirt-engine/kernel\n/var/lib/ovirt-engine/setup\n/var/lib/ovirt-engine/timer-service-data\n/var/lib/ovirt-engine/tx-object-store\n\n--------------------- >> end captured logging << ---------------------"