March 2020 - Infra - oVirt List Archives

[CQ]: 107239,16 (ovirt-engine) failed "ovirt-master" system tests
by oVirt Jenkins 12 Mar '20

12 Mar '20

Change 107239,16 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/107239/16 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/21179/

1 0

How to trigger re-merge in github?
by Yedidyah Bar David 12 Mar '20

12 Mar '20

Hi all, The docs say [1] that for gerrit we can comment 'ci re-merge please'. But for github [2] I don't see anything similar, only 'test|check' and 'build'. Latest merged PR for ovirt-ansible-hosted-engine-setup [3] failed due to an unrelated reason (see thread "OST basic suite fails on 002_bootstrap.add_secondary_storage_domains"), now fixed, and I want CQ to handle [3] again. How? Thanks! [1] https://ovirt-infra-docs.readthedocs.io/en/latest/CI/Using_STDCI_with_Gerri… [2] https://ovirt-infra-docs.readthedocs.io/en/latest/CI/Using_STDCI_with_GitHu… [3] https://github.com/oVirt/ovirt-ansible-hosted-engine-setup/pull/306 -- Didi

4 5

[oVirt Jenkins] ovirt-system-tests_compat-4.3-suite-master - Build # 373 - Failure!
by jenkins＠jenkins.phx.ovirt.org 12 Mar '20

12 Mar '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.3-suite-master/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.3-suite-master/37… Build Number: 373 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #373 [Michal Skrivanek] upgrade browsers to 3.141.59-zirconium [Shlomi] Fixed hardcoded link for fedora-base-fc29 [Sandro Bonazzola] Drop failovermethod key in mock config. ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 001_initialize_engine.initialize_engine_43 Error Message: engine-setup failed. Exit code is 1 -------------------- >> begin captured logging << -------------------- lago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_compat-4.3-suite-master/ovirt-system-tests/compat-4.3-suite-master/engine-answer-file.conf to lago-compat-4-3-suite-master-engine:/tmp/answer-file: ?[0m?[0m lago.ssh: DEBUG: start task:134b749a-fc5a-4aaa-abd8-d875f575845d:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: end task:134b749a-fc5a-4aaa-abd8-d875f575845d:Get ssh client for lago-compat-4-3-suite-master-engine: lago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_compat-4.3-suite-master/ovirt-system-tests/compat-4.3-suite-master/engine-answer-file.conf to lago-compat-4-3-suite-master-engine:/tmp/answer-file: ?[32mSuccess?[0m (in 0:00:00) lago.plugins.vm: INFO: * Copy /tmp/tmpOE5S7k to lago-compat-4-3-suite-master-engine:/etc/ovirt-engine/engine.conf.d/99-custom-fqdn.conf: ?[0m?[0m lago.ssh: DEBUG: start task:afc9f252-2a1a-4f5b-967f-753032d5934e:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: end task:afc9f252-2a1a-4f5b-967f-753032d5934e:Get ssh client for lago-compat-4-3-suite-master-engine: lago.plugins.vm: INFO: * Copy /tmp/tmpOE5S7k to lago-compat-4-3-suite-master-engine:/etc/ovirt-engine/engine.conf.d/99-custom-fqdn.conf: ?[32mSuccess?[0m (in 0:00:00) lago.ssh: DEBUG: start task:00147e45-80f7-4128-b7d1-a869a0f21e95:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: end task:00147e45-80f7-4128-b7d1-a869a0f21e95:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: Running bca57704 on lago-compat-4-3-suite-master-engine: chmod 644 /etc/ovirt-engine/engine.conf.d/99-custom-fqdn.conf lago.ssh: DEBUG: Command bca57704 on lago-compat-4-3-suite-master-engine returned with 0 lago.ssh: DEBUG: start task:4d4db94a-48d4-4132-8046-d2eb6ee2b45f:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: end task:4d4db94a-48d4-4132-8046-d2eb6ee2b45f:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: Running bce406cc on lago-compat-4-3-suite-master-engine: engine-setup --config-append=/tmp/answer-file --accept-defaults lago.ssh: DEBUG: Command bce406cc on lago-compat-4-3-suite-master-engine returned with 1 lago.ssh: DEBUG: Command bce406cc on lago-compat-4-3-suite-master-engine output: [ INFO ] Stage: Initializing [ INFO ] Stage: Environment setup Configuration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/10-packaging.conf, /tmp/answer-file Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20200309210157-9t8x9u.log Version: otopi-1.9.0 (otopi-1.9.0-1.el8) [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup (late) [ INFO ] Stage: Environment customization --== PRODUCT OPTIONS ==-- Set up Cinderlib integration (Currently in tech preview) (Yes, No) [No]: Configure ovirt-provider-ovn (Yes, No) [Yes]: --== PACKAGES ==-- [ INFO ] Checking for an update for Setup... An update for the Setup packages ovirt-engine-setup ovirt-engine-setup-plugin-websocket-proxy was found. Please update that package by running: "dnf update ovirt-engine-setup ovirt-engine-setup-plugin-websocket-proxy" and then execute Setup again. [ ERROR ] Failed to execute stage 'Environment customization': Please update the Setup packages [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20200309210157-9t8x9u.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20200309210208-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed lago.ssh: DEBUG: start task:2f9afdad-7d09-46e5-9ec4-51c06af6aab5:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: end task:2f9afdad-7d09-46e5-9ec4-51c06af6aab5:Get ssh client for lago-compat-4-3-suite-master-engine: lago.ssh: DEBUG: Running c4d1ebe2 on lago-compat-4-3-suite-master-engine: ss -anp lago.ssh: DEBUG: Command c4d1ebe2 on lago-compat-4-3-suite-master-engine returned with 0 lago.ssh: DEBUG: Command c4d1ebe2 on lago-compat-4-3-suite-master-engine output: Netid State Recv-Q Send-Q Local Address:Port Peer Address:Port nl UNCONN 0 0 0:17096 * nl UNCONN 0 0 0:909 * nl UNCONN 0 0 0:0 * nl UNCONN 0 0 0:1319 * nl UNCONN 0 0 0:-314572096 * nl UNCONN 0 0 0:17096 * nl UNCONN 0 0 0:1319 * nl UNCONN 0 0 0:909 * nl UNCONN 0 0 0:-314572096 * nl UNCONN 4352 0 4:25794 * nl UNCONN 768 0 4:0 * nl UNCONN 0 0 6:0 * nl UNCONN 0 0 7:708 * nl UNCONN 2304 0 7:21158 * nl UNCONN 0 0 7:1 * nl UNCONN 0 0 7:0 * nl UNCONN 2304 0 7:21158 * nl UNCONN 0 0 7:708 * nl UNCONN 0 0 7:1 * nl UNCONN 0 0 9:1 * nl UNCONN 0 0 9:667 * nl UNCONN 0 0 9:708 * nl UNCONN 0 0 9:0 * nl UNCONN 0 0 10:0 * nl UNCONN 0 0 11:0 * nl UNCONN 0 0 12:0 * nl UNCONN 0 0 15:-1863852827 * nl UNCONN 0 0 15:909 * nl UNCONN 0 0 15:-2078905477 * nl UNCONN 0 0 15:921 * nl UNCONN 0 0 15:21158 * nl UNCONN 0 0 15:885 * nl UNCONN 0 0 15:1 * nl UNCONN 0 0 15:-497488 * nl UNCONN 0 0 15:0 * nl UNCONN 0 0 15:-1737723545 * nl UNCONN 0 0 15:-132959899 * nl UNCONN 0 0 15:21158 * nl UNCONN 0 0 15:921 * nl UNCONN 0 0 15:-1863852827 * nl UNCONN 0 0 15:909 * nl UNCONN 0 0 15:-497488 * nl UNCONN 0 0 15:-132959899 * nl UNCONN 0 0 15:-1737723545 * nl UNCONN 0 0 15:885 * nl UNCONN 0 0 15:-2078905477 * nl UNCONN 0 0 15:1 * nl UNCONN 0 0 16:909 * nl UNCONN 0 0 16:0 * nl UNCONN 0 0 18:0 * p_dgr UNCONN 0 0 arp:virbr0 * users:(("NetworkManager",pid=909,fd=30)) u_dgr UNCONN 0 0 /run/systemd/notify 11272 * 0 users:(("systemd",pid=1,fd=21)) u_dgr UNCONN 0 0 /run/systemd/cgroups-agent 11274 * 0 users:(("systemd",pid=1,fd=22)) u_str LISTEN 0 1 @irqbalance703.sock 21594 * 0 users:(("irqbalance",pid=703,fd=5)) u_dgr UNCONN 0 0 /run/user/0/systemd/notify 82705 * 0 users:(("systemd",pid=21158,fd=15)) u_str LISTEN 0 128 /run/user/0/systemd/private 82709 * 0 users:(("systemd",pid=21158,fd=18)) u_str LISTEN 0 128 /run/systemd/journal/stdout 11286 * 0 users:(("systemd-journal",pid=589,fd=4),("systemd",pid=1,fd=107)) u_dgr UNCONN 0 0 /run/systemd/journal/socket 11290 * 0 users:(("systemd-journal",pid=589,fd=5),("systemd",pid=1,fd=108)) u_str LISTEN 0 128 /run/user/0/bus 82717 * 0 users:(("systemd",pid=21158,fd=11)) u_seq LISTEN 0 128 /run/udev/control 18471 * 0 users:(("systemd-udevd",pid=663,fd=4),("systemd",pid=1,fd=111)) u_str LISTEN 0 128 /run/systemd/private 14120 * 0 users:(("systemd",pid=1,fd=15)) u_dgr UNCONN 0 0 /run/systemd/journal/dev-log 11310 * 0 users:(("systemd-journal",pid=589,fd=3),("systemd",pid=1,fd=105)) u_str LISTEN 0 10 /var/lib/gssproxy/default.sock 47090 * 0 users:(("gssproxy",pid=13738,fd=8)) u_str LISTEN 0 128 /run/rpcbind.sock 46642 * 0 users:(("rpcbind",pid=20621,fd=3),("systemd",pid=1,fd=77)) u_str LISTEN 0 128 /run/dbus/system_bus_socket 20284 * 0 users:(("dbus-daemon",pid=708,fd=3),("systemd",pid=1,fd=100)) u_str LISTEN 0 128 /var/run/.heim_org.h5l.kcm-socket 20288 * 0 users:(("systemd",pid=1,fd=112)) u_str LISTEN 0 128 /var/run/libvirt/libvirt-sock 57666 * 0 users:(("systemd",pid=1,fd=106)) u_str LISTEN 0 20 /var/run/libvirt/libvirt-admin-sock 57668 * 0 users:(("systemd",pid=1,fd=110)) u_str LISTEN 0 128 /var/run/libvirt/libvirt-sock-ro 57670 * 0 users:(("systemd",pid=1,fd=101)) u_str LISTEN 0 128 /var/run/libvirt/virtlogd-sock 57675 * 0 users:(("systemd",pid=1,fd=115)) u_str LISTEN 0 128 /var/run/libvirt/virtlockd-sock 57677 * 0 users:(("systemd",pid=1,fd=113)) u_str LISTEN 0 128 /var/lib/sss/pipes/private/sbus-dp_implicit_files.777 21870 * 0 users:(("sssd_be",pid=777,fd=15)) u_seq LISTEN 0 128 /run/systemd/coredump 14213 * 0 users:(("systemd",pid=1,fd=104)) u_str LISTEN 0 128 /run/lvm/lvmpolld.socket 46273 * 0 users:(("systemd",pid=1,fd=114)) u_dgr UNCONN 0 0 /var/run/chrony/chronyd.sock 20944 * 0 users:(("chronyd",pid=719,fd=7)) u_str LISTEN 0 128 /var/lib/sss/pipes/private/sbus-monitor 21285 * 0 users:(("sssd",pid=704,fd=12)) u_str LISTEN 0 10 /var/lib/sss/pipes/nss 22086 * 0 users:(("sssd_nss",pid=842,fd=16)) u_str LISTEN 0 10 /run/gssproxy.sock 47091 * 0 users:(("gssproxy",pid=13738,fd=9)) u_dgr UNCONN 0 0 * 82687 * 11310 users:(("(sd-pam",pid=21162,fd=9)) u_dgr UNCONN 0 0 * 20884 * 11310 users:(("chronyd",pid=719,fd=3)) u_str ESTAB 0 0 * 105090 * 109454 users:(("crond",pid=934,fd=6)) u_str ESTAB 0 0 * 109412 * 105015 users:(("snmptrapd",pid=25580,fd=2),("snmptrapd",pid=25580,fd=1)) u_str ESTAB 0 0 * 22528 * 0 users:(("tuned",pid=921,fd=4)) u_dgr UNCONN 0 0 * 21227 * 0 users:(("sssd",pid=704,fd=8)) u_str ESTAB 0 0 /run/systemd/journal/stdout 21691 * 21155 users:(("systemd-journal",pid=589,fd=23),("systemd",pid=1,fd=59)) u_dgr UNCONN 0 0 * 22029 * 0 users:(("sssd_nss",pid=842,fd=10)) u_str ESTAB 0 0 * 82711 * 83462 users:(("systemd",pid=21158,fd=19)) u_str ESTAB 0 0 * 23379 * 22124 users:(("systemd-logind",pid=885,fd=12)) u_str ESTAB 0 0 * 23335 * 22110 users:(("systemd-logind",pid=885,fd=2),("systemd-logind",pid=885,fd=1)) u_dgr UNCONN 0 0 * 20606 * 11310 users:(("auditd",pid=667,fd=7)) u_str ESTAB 0 0 /run/systemd/journal/stdout 22237 * 23696 users:(("systemd-journal",pid=589,fd=26),("systemd",pid=1,fd=64)) u_str ESTAB 0 0 * 27687 * 0 users:(("firewalld",pid=828,fd=8)) u_dgr UNCONN 0 0 * 20640 * 20641 users:(("systemd-udevd",pid=663,fd=7)) u_str ESTAB 0 0 /var/lib/sss/pipes/private/sbus-monitor 21430 * 21932 users:(("sssd",pid=704,fd=16)) u_str ESTAB 0 0 * 20608 * 20607 users:(("auditd",pid=667,fd=9)) u_dgr UNCONN 0 0 * 23369 * 11290 users:(("systemd-logind",pid=885,fd=3)) u_str ESTAB 0 0 /run/systemd/journal/stdout 20421 * 20420 users:(("systemd-journal",pid=589,fd=21),("systemd",pid=1,fd=54)) u_str ESTAB 0 0 /run/dbus/system_bus_socket 25133 * 25132 users:(("dbus-daemon",pid=708,fd=20)) u_dgr UNCONN 0 0 * 20641 * 20640 users:(("systemd-udevd",pid=663,fd=8)) u_dgr UNCONN 0 0 * 47087 * 11310 users:(("gssproxy",pid=13738,fd=3)) u_str ESTAB 0 0 * 21286 * 21287 users:(("sssd",pid=704,fd=13)) u_str ESTAB 0 0 /var/lib/sss/pipes/private/sbus-dp_implicit_files.777 21880 * 21879 users:(("sssd_be",pid=777,fd=17)) u_str ESTAB 0 0 /run/dbus/system_bus_socket 83462 * 82711 users:(("dbus-daemon",pid=708,fd=26)) u_dgr UNCONN 0 0 * 23539 * 0 users:(("NetworkManager",pid=909,fd=5)) u_dgr UNCONN 0 0 * 82708 * 82707 users:(("systemd",pid=21158,fd=17)) u_str ESTAB 0 0 /run/dbus/system_bus_socket 28219 * 29105 users:(("dbus-daemon",pid=708,fd=16)) u_str ESTAB 0 0 /var/lib/sss/pipes/private/sbus-dp_implicit_files.777 22085 * 22046 users:(("sssd_be",pid=777,fd=21)) u_str ESTAB 0 0 * 21630 * 21629 users:(("dbus-daemon",pid=708,fd=9)) u_str ESTAB 0 0 /var/lib/sss/pipes/private/sbus-monitor 21287 * 21286 users:(("sssd",pid=704,fd=14)) u_str ESTAB 0 0 * 25132 * 25133 users:(("tuned",pid=921,fd=7)) u_str ESTAB 0 0 * 27688 * 27689 users:(("firewalld",pid=828,fd=11)) u_str ESTAB 0 0 * 24119 * 24611 users:(("NetworkManager",pid=909,fd=18)) u_str ESTAB 0 0 * 22046 * 22085 users:(("sssd_nss",pid=842,fd=11)) u_str ESTAB 0 0 /run/systemd/journal/stdout 22110 * 23335 users:(("systemd-journal",pid=589,fd=20),("systemd",pid=1,fd=60)) u_str ESTAB 0 0 /run/systemd/journal/stdout 105015 * 109412 users:(("systemd-journal",pid=589,fd=27),("systemd",pid=1,fd=27)) u_str ESTAB 0 0 /run/dbus/system_bus_socket 24611 * 24119 users:(("dbus-daemon",pid=708,fd=18)) u_dgr UNCONN 0 0 * 82707 * 82708 users:(("systemd",pid=21158,fd=16)) u_str --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_compat-4.3-suite-master/ovirt-system-tests/compat-4.3-suite-master/test-scenarios/001_initialize_engine.py", line 78, in initialize_engine result.code, 0, 'engine-setup failed. Exit code is %s' % result.code File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in eq_ raise AssertionError(msg or "%r != %r" % (a, b)) 'engine-setup failed. Exit code is 1\n-------------------- >> begin captured logging << --------------------\nlago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_compat-4.3-suite-master/ovirt-system-tests/compat-4.3-suite-master/engine-answer-file.conf to lago-compat-4-3-suite-master-engine:/tmp/answer-file: \x1b[0m\x1b[0m\nlago.ssh: DEBUG: start task:134b749a-fc5a-4aaa-abd8-d875f575845d:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: end task:134b749a-fc5a-4aaa-abd8-d875f575845d:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_compat-4.3-suite-master/ovirt-system-tests/compat-4.3-suite-master/engine-answer-file.conf to lago-compat-4-3-suite-master-engine:/tmp/answer-file: \x1b[32mSuccess\x1b[0m (in 0:00:00)\nlago.plugins.vm: INFO: * Copy /tmp/tmpOE5S7k to lago-compat-4-3-suite-master-engine:/etc/ovirt-engine/engine.conf.d/99-custom-fqdn.conf: \x1b[0m\x1b[0m\nlago.ssh: DEBUG: start task:afc9f252-2a1a-4f5b-967f-753032d5934e:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: end task:afc9f252-2a1a-4f5b-967f-753032d5934e:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.plugins.vm: INFO: * Copy /tmp/tmpOE5S7k to lago-compat-4-3-suite-master-engine:/etc/ovirt-engine/engine.conf.d/99-custom-fqdn.conf: \x1b[32mSuccess\x1b[0m (in 0:00:00)\nlago.ssh: DEBUG: start task:00147e45-80f7-4128-b7d1-a869a0f21e95:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: end task:00147e45-80f7-4128-b7d1-a869a0f21e95:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: Running bca57704 on lago-compat-4-3-suite-master-engine: chmod 644 /etc/ovirt-engine/engine.conf.d/99-custom-fqdn.conf\nlago.ssh: DEBUG: Command bca57704 on lago-compat-4-3-suite-master-engine returned with 0\nlago.ssh: DEBUG: start task:4d4db94a-48d4-4132-8046-d2eb6ee2b45f:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: end task:4d4db94a-48d4-4132-8046-d2eb6ee2b45f:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: Running bce406cc on lago-compat-4-3-suite-master-engine: engine-setup --config-append=/tmp/answer-file --accept-defaults\nlago.ssh: DEBUG: Command bce406cc on lago-compat-4-3-suite-master-engine returned with 1\nlago.ssh: DEBUG: Command bce406cc on lago-compat-4-3-suite-master-engine output:\n [ INFO ] Stage: Initializing\n[ INFO ] Stage: Environment setup\n Configuration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/10-packaging.conf, /tmp/answer-file\n Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20200309210157-9t8x9u.log\n Version: otopi-1.9.0 (otopi-1.9.0-1.el8)\n[ INFO ] Stage: Environment packages setup\n[ INFO ] Stage: Programs detection\n[ INFO ] Stage: Environment setup (late)\n[ INFO ] Stage: Environment customization\n \n --== PRODUCT OPTIONS ==--\n \n Set up Cinderlib integration\n (Currently in tech preview)\n (Yes, No) [No]: \n Configure ovirt-provider-ovn (Yes, No) [Yes]: \n \n --== PACKAGES ==--\n \n[ INFO ] Checking for an update for Setup...\n An update for the Setup packages ovirt-engine-setup ovirt-engine-setup-plugin-websocket-proxy was found. Please update that package by running:\n "dnf update ovirt-engine-setup ovirt-engine-setup-plugin-websocket-proxy"\n and then execute Setup again.\n[ ERROR ] Failed to execute stage \'Environment customization\': Please update the Setup packages\n[ INFO ] Stage: Clean up\n Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20200309210157-9t8x9u.log\n[ INFO ] Generating answer file \'/var/lib/ovirt-engine/setup/answers/20200309210208-setup.conf\'\n[ INFO ] Stage: Pre-termination\n[ INFO ] Stage: Termination\n[ ERROR ] Execution of setup failed\n\nlago.ssh: DEBUG: start task:2f9afdad-7d09-46e5-9ec4-51c06af6aab5:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: end task:2f9afdad-7d09-46e5-9ec4-51c06af6aab5:Get ssh client for lago-compat-4-3-suite-master-engine:\nlago.ssh: DEBUG: Running c4d1ebe2 on lago-compat-4-3-suite-master-engine: ss -anp\nlago.ssh: DEBUG: Command c4d1ebe2 on lago-compat-4-3-suite-master-engine returned with 0\nlago.ssh: DEBUG: Command c4d1ebe2 on lago-compat-4-3-suite-master-engine output:\n Netid State Recv-Q Send-Q Local Address:Port Peer Address:Port \nnl UNCONN 0 0 0:17096 * \nnl UNCONN 0 0 0:909 * \nnl UNCONN 0 0 0:0 * \nnl UNCONN 0 0 0:1319 * \nnl UNCONN 0 0 0:-314572096 * \nnl UNCONN 0 0 0:17096 * \nnl UNCONN 0 0 0:1319 * \nnl UNCONN 0 0 0:909 * \nnl UNCONN 0 0 0:-314572096 * \nnl UNCONN 4352 0 4:25794 * \nnl UNCONN 768 0 4:0 * \nnl UNCONN 0 0 6:0 * \nnl UNCONN 0 0 7:708 * \nnl UNCONN 2304 0 7:21158 * \nnl UNCONN 0 0 7:1 * \nnl UNCONN 0 0 7:0 * \nnl UNCONN 2304 0 7:21158 * \nnl UNCONN 0 0 7:708 * \nnl UNCONN 0 0 7:1 * \nnl UNCONN 0 0 9:1 * \nnl UNCONN 0 0 9:667 * \nnl UNCONN 0 0 9:708 * \nnl UNCONN 0 0 9:0 * \nnl UNCONN 0 0 10:0 * \nnl UNCONN 0 0 11:0 * \nnl UNCONN 0 0 12:0 * \nnl UNCONN 0 0 15:-1863852827 * \nnl UNCONN 0 0 15:909 * \nnl UNCONN 0 0 15:-2078905477 * \nnl UNCONN 0 0 15:921 * \nnl UNCONN 0 0 15:21158 * \nnl UNCONN 0 0 15:885 * \nnl UNCONN 0 0 15:1 * \nnl UNCONN 0 0 15:-497488 * \nnl UNCONN 0 0 15:0 * \nnl UNCONN 0 0 15:-1737723545 * \nnl UNCONN 0 0 15:-132959899 * \nnl UNCONN 0 0 15:21158 * \nnl UNCONN 0 0 15:921 * \nnl UNCONN 0 0 15:-1863852827 * \nnl UNCONN 0 0 15:909 * \nnl UNCONN 0 0 15:-497488 * \nnl UNCONN 0 0 15:-132959899 * \nnl UNCONN 0 0 15:-1737723545 * \nnl UNCONN 0 0 15:885 * \nnl UNCONN 0 0 15:-2078905477 * \nnl UNCONN 0 0 15:1 * \nnl UNCONN 0 0 16:909 * \nnl UNCONN 0 0 16:0 * \nnl UNCONN 0 0 18:0 * \np_dgr UNCONN 0 0 arp:virbr0 * users:(("NetworkManager",pid=909,fd=30)) \nu_dgr UNCONN 0 0 /run/systemd/notify 11272 * 0 users:(("systemd",pid=1,fd=21)) \nu_dgr UNCONN 0 0 /run/systemd/cgroups-agent 11274 * 0 users:(("systemd",pid=1,fd=22)) \nu_str LISTEN 0 1 @irqbalance703.sock 21594 * 0 users:(("irqbalance",pid=703,fd=5)) \nu_dgr UNCONN 0 0 /run/user/0/systemd/notify 82705 * 0 users:(("systemd",pid=21158,fd=15)) \nu_str LISTEN 0 128 /run/user/0/systemd/private 82709 * 0 users:(("systemd",pid=21158,fd=18)) \nu_str LISTEN 0 128 /run/systemd/journal/stdout 11286 * 0 users:(("systemd-journal",pid=589,fd=4),("systemd",pid=1,fd=107)) \nu_dgr UNCONN 0 0 /run/systemd/journal/socket 11290 * 0 users:(("systemd-journal",pid=589,fd=5),("systemd",pid=1,fd=108)) \nu_str LISTEN 0 128 /run/user/0/bus 82717 * 0 users:(("systemd",pid=21158,fd=11)) \nu_seq LISTEN 0 128 /run/udev/control 18471 * 0 users:(("systemd-udevd",pid=663,fd=4),("systemd",pid=1,fd=111)) \nu_str LISTEN 0 128 /run/systemd/private 14120 * 0 users:(("systemd",pid=1,fd=15)) \nu_dgr UNCONN 0 0 /run/systemd/journal/dev-log 11310 * 0 users:(("systemd-journal",pid=589,fd=3),("systemd",pid=1,fd=105)) \nu_str LISTEN 0 10 /var/lib/gssproxy/default.sock 47090 * 0 users:(("gssproxy",pid=13738,fd=8)) \nu_str LISTEN 0 128 /run/rpcbind.sock 46642 * 0 users:(("rpcbind",pid=20621,fd=3),("systemd",pid=1,fd=77)) \nu_str LISTEN 0 128 /run/dbus/system_bus_socket 20284 * 0 users:(("dbus-daemon",pid=708,fd=3),("systemd",pid=1,fd=100)) \nu_str LISTEN 0 128 /var/run/.heim_org.h5l.kcm-socket 20288 * 0 users:(("systemd",pid=1,fd=112)) \nu_str LISTEN 0 128 /var/run/libvirt/libvirt-sock 57666 * 0 users:(("systemd",pid=1,fd=106)) \nu_str LISTEN 0 20 /var/run/libvirt/libvirt-admin-sock 57668 * 0 users:(("systemd",pid=1,fd=110)) \nu_str LISTEN 0 128 /var/run/libvirt/libvirt-sock-ro 57670 * 0 users:(("systemd",pid=1,fd=101)) \nu_str LISTEN 0 128 /var/run/libvirt/virtlogd-sock 57675 * 0 users:(("systemd",pid=1,fd=115)) \nu_str LISTEN 0 128 /var/run/libvirt/virtlockd-sock 57677 * 0 users:(("systemd",pid=1,fd=113)) \nu_str LISTEN 0 128 /var/lib/sss/pipes/private/sbus-dp_implicit_files.777 21870 * 0 users:(("sssd_be",pid=777,fd=15)) \nu_seq LISTEN 0 128 /run/systemd/coredump 14213 * 0 users:(("systemd",pid=1,fd=104)) \nu_str LISTEN 0 128 /run/lvm/lvmpolld.socket 46273 * 0 users:(("systemd",pid=1,fd=114)) \nu_dgr UNCONN 0 0 /var/run/chrony/chronyd.sock 20944 * 0 users:(("chronyd",pid=719,fd=7)) \nu_str LISTEN 0 128 /var/lib/sss/pipes/private/sbus-monitor 21285 * 0 users:(("sssd",pid=704,fd=12)) \nu_str LISTEN 0 10 /var/lib/sss/pipes/nss 22086 * 0 users:(("sssd_nss",pid=842,fd=16)) \nu_str LISTEN 0 10 /run/gssproxy.sock 47091 * 0 users:(("gssproxy",pid=13738,fd=9)) \nu_dgr UNCONN 0 0 * 82687 * 11310 users:(("(sd-pam",pid=21162,fd=9)) \nu_dgr UNCONN 0 0 * 20884 * 11310 users:(("chronyd",pid=719,fd=3)) \nu_str ESTAB 0 0 * 105090 * 109454 users:(("crond",pid=934,fd=6)) \nu_str ESTAB 0 0 * 109412 * 105015 users:(("snmptrapd",pid=25580,fd=2),("snmptrapd",pid=25580,fd=1)) \nu_str ESTAB 0 0 * 22528 * 0 users:(("tuned",pid=921,fd=4)) \nu_dgr UNCONN 0 0 * 21227 * 0 users:(("sssd",pid=704,fd=8)) \nu_str ESTAB 0 0 /run/systemd/journal/stdout 21691 * 21155 users:(("systemd-journal",pid=589,fd=23),("systemd",pid=1,fd=59)) \nu_dgr UNCONN 0 0 * 22029 * 0 users:(("sssd_nss",pid=842,fd=10)) \nu_str ESTAB 0 0 * 82711 * 83462 users:(("systemd",pid=21158,fd=19)) \nu_str ESTAB 0 0 * 23379 * 22124 users:(("systemd-logind",pid=885,fd=12)) \nu_str ESTAB 0 0 * 23335 * 22110 users:(("systemd-logind",pid=885,fd=2),("systemd-logind",pid=885,fd=1)) \nu_dgr UNCONN 0 0 * 20606 * 11310 users:(("auditd",pid=667,fd=7)) \nu_str ESTAB 0 0 /run/systemd/journal/stdout 22237 * 23696 users:(("systemd-journal",pid=589,fd=26),("systemd",pid=1,fd=64)) \nu_str ESTAB 0 0 * 27687 * 0 users:(("firewalld",pid=828,fd=8)) \nu_dgr UNCONN 0 0 * 20640 * 20641 users:(("systemd-udevd",pid=663,fd=7)) \nu_str ESTAB 0 0 /var/lib/sss/pipes/private/sbus-monitor 21430 * 21932 users:(("sssd",pid=704,fd=16)) \nu_str ESTAB 0 0 * 20608 * 20607 users:(("auditd",pid=667,fd=9)) \nu_dgr UNCONN 0 0 * 23369 * 11290 users:(("systemd-logind",pid=885,fd=3)) \nu_str ESTAB 0 0 /run/systemd/journal/stdout 20421 * 20420 users:(("systemd-journal",pid=589,fd=21),("systemd",pid=1,fd=54)) \nu_str ESTAB 0 0 /run/dbus/system_bus_socket 25133 * 25132 users:(("dbus-daemon",pid=708,fd=20)) \nu_dgr UNCONN 0 0 * 20641 * 20640 users:(("systemd-udevd",pid=663,fd=8)) \nu_dgr UNCONN 0 0 * 47087 * 11310 users:(("gssproxy",pid=13738,fd=3)) \nu_str ESTAB 0 0 * 21286 * 21287 users:(("sssd",pid=704,fd=13)) \nu_str ESTAB 0 0 /var/lib/sss/pipes/private/sbus-dp_implicit_files.777 21880 * 21879 users:(("sssd_be",pid=777,fd=17)) \nu_str ESTAB 0 0 /run/dbus/system_bus_socket 83462 * 82711 users:(("dbus-daemon",pid=708,fd=26)) \nu_dgr UNCONN 0 0 * 23539 * 0 users:(("NetworkManager",pid=909,fd=5)) \nu_dgr UNCONN 0 0 * 82708 * 82707 users:(("systemd",pid=21158,fd=17)) \nu_str ESTAB 0 0 /run/dbus/system_bus_socket 28219 * 29105 users:(("dbus-daemon",pid=708,fd=16)) \nu_str ESTAB 0 0 /var/lib/sss/pipes/private/sbus-dp_implicit_files.777 22085 * 22046 users:(("sssd_be",pid=777,fd=21)) \nu_str ESTAB 0 0 * 21630 * 21629 users:(("dbus-daemon",pid=708,fd=9)) \nu_str ESTAB 0 0 /var/lib/sss/pipes/private/sbus-monitor 21287 * 21286 users:(("sssd",pid=704,fd=14)) \nu_str ESTAB 0 0 * 25132 * 25133 users:(("tuned",pid=921,fd=7)) \nu_str ESTAB 0 0 * 27688 * 27689 users:(("firewalld",pid=828,fd=11)) \nu_str ESTAB 0 0 * 24119 * 24611 users:(("NetworkManager",pid=909,fd=18)) \nu_str ESTAB 0 0 * 22046 * 22085 users:(("sssd_nss",pid=842,fd=11)) \nu_str ESTAB 0 0 /run/systemd/journal/stdout 22110 * 23335 users:(("systemd-journal",pid=589,fd=20),("systemd",pid=1,fd=60)) \nu_str ESTAB 0 0 /run/systemd/journal/stdout 105015 * 109412 users:(("systemd-journal",pid=589,fd=27),("systemd",pid=1,fd=27)) \nu_str ESTAB 0 0 /run/dbus/system_bus_socket 24611 * 24119 users:(("dbus-daemon",pid=708,fd=18)) \nu_dgr UNCONN 0 0 * 82707 * 82708 users:(("systemd",pid=21158,fd=16)) \nu_str \n--------------------- >> end captured logging << ---------------------'

1 2

[oVirt Jenkins] cleanup-gated-dummy-master - Build #75 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 12 Mar '20

12 Mar '20

Build: https://jenkins.ovirt.org/job/cleanup-gated-dummy-master/75/ Build Name: #75 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 7

oVirt infra daily report - unstable production jobs - 1127
by jenkins＠jenkins.phx.ovirt.org 11 Mar '20

11 Mar '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1127//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] deploy-to-gated-dummy-master - Build #261 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 11 Mar '20

11 Mar '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-dummy-master/261/ Build Name: #261 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[CQ]: 107457, 6 (vdsm) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 11 Mar '20

11 Mar '20

A system test invoked by the "ovirt-master" change queue including change 107457,6 (vdsm) failed. However, this change seems not to be the root cause for this failure. Change 107442,7 (vdsm) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 107442,7 (vdsm) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/107457/6 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/107442/7 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/21177/

1 0

[CQ]: 107442,7 (vdsm) failed "ovirt-master" system tests
by oVirt Jenkins 11 Mar '20

11 Mar '20

Change 107442,7 (vdsm) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/107442/7 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/21173/

1 0

[CQ]: 107465,4 (vdsm) failed "ovirt-master" system tests
by oVirt Jenkins 11 Mar '20

11 Mar '20

Change 107465,4 (vdsm) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/107465/4 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/21172/

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 11 Mar '20

11 Mar '20

Failed to run project_setup.sh for: #19294 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0136.workers-phx.ovirt.org.

1 0