- Devel - oVirt List Archives

vdsm [check-patch] failures - error with nmstate repo
by Liran Rotenberg 19 Dec '19

19 Dec '19

Hi, VDSM check patch keep failing, Console output taken from[2]: *15:33:30* failure: repodata/repomd.xml from nmstate: [Errno 256] No more mirrors to try.*15:33:30* https://copr-be.cloud.fedoraproject.org/results/nmstate/nmstate-git-fedora/…: [Errno 14] HTTPS Error 404 - Not Found *15:33:33* ERROR: Command failed: *15:33:33* # /usr/bin/dnf --installroot /var/lib/mock/fedora-30-x86_64-b4b1fa43be798f48f41c1f0af664447e-6272/root/ --releasever 30 --setopt=deltarpm=False --allowerasing --disableplugin=local --disableplugin=spacewalk install @buildsys-build autoconf automake createrepo dnf dnf-utils e2fsprogs gcc gdb git iproute-tc iscsi-initiator-utils libguestfs-tools-c lshw make mom openvswitch ovirt-imageio-common python3-augeas python3-blivet python3-coverage python3-dateutil python3-dbus python3-decorator python3-devel python3-dmidecode python3-inotify python3-ioprocess-1.3.0 python3-libselinux python3-libvirt python3-magic python3-netaddr python3-nose python3-pip python3-policycoreutils python3-pyudev python3-pyyaml python3-requests python3-sanlock python3-six python3-yaml rpm-build rpmlint sudo xfsprogs --setopt=tsflags=nocontexts*15:33:33* No matches found for the following disable plugin patterns: local, spacewalk*15:33:33* Custom fc30-updates-debuginfo 1.8 MB/s | 13 MB 00:07 *15:33:33* Custom tested 16 MB/s | 570 kB 00:00 *15:33:33* Custom vdo 61 kB/s | 8.1 kB 00:00 *15:33:33* Custom virt-preview 770 kB/s | 139 kB 00:00 *15:33:33* Custom nmstate 4.7 kB/s | 341 B 00:00 *15:33:33* Error: Failed to download metadata for repo 'nmstate': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried [1] https://jenkins.ovirt.org/job/vdsm_standard-check-patch/16055/ [2] https://jenkins.ovirt.org/job/vdsm_standard-check-patch/16058/

2 2

Package does not exist and cannot find symbol even though they exist
by Prajith Kesava Prasad 18 Dec '19

18 Dec '19

Hi, During make install build of ovirt , sometimes i get compilation errors for eg:- Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default-compile) on project uicommonweb: Compilation failure: Compilation failure: [ERROR] /home/vagrant/workspace/ovirt-engine/frontend/webadmin/modules/uicommonweb/src/main/java/org/ovirt/engine/ui/uicommonweb/models/hosts/HostListModel.java:[19,41] package org.ovirt.engine.core.bll.gluster does not exist But they do exists and, usually they go away after a couple of make clean installs, but this time its not going also i was curious if anyone managed to find the root cause for such issues? Thanks in advance, Prajith

1 0

Flaky jsonrpc test? looks like timeout
by Nir Soffer 18 Dec '19

18 Dec '19

I had this failure today, that looks like a timeout, based on the test duration: 18.16s call tests/lib/yajsonrpc/jsonrpcserver_test.py::JsonRpcServerTests::testMethodBadParameters(True) Looking at the log it smells like the known race when connecting to server. Also we see: - ERROR vds.dispatcher:betterAsyncore.py:179 uncaptured python exception, closing channel Should never happen, means we did not handle exceptions in some handler. - WARNING vds.dispatcher:betterAsyncore.py:179 unhandled write event Should not happen, means that we did not implement handle_write() in some dispatcher. See logs below. Nir --- Build log: https://jenkins.ovirt.org/job/vdsm_standard-check-patch/15978//artifact/che… Error: =================================== FAILURES =================================== _______________ JsonRpcServerTests.testMethodBadParameters(True) _______________ self = <jsonrpcserver_test.JsonRpcServerTests testMethod=testMethodBadParameters(True)> use_ssl = True @permutations(USE_SSL) def testMethodBadParameters(self, use_ssl): # Without a schema the server returns an internal error ssl_ctx = self.ssl_ctx if use_ssl else None bridge = _DummyBridge() with constructClient(self.log, bridge, ssl_ctx) as clientFactory: with self._client(clientFactory) as client: with self.assertRaises(JsonRpcErrorBase) as cm: self._callTimeout(client, "echo", [], CALL_ID) self.assertEqual(cm.exception.code, > JsonRpcInternalError().code) E AssertionError: -32605 != -32603 lib/yajsonrpc/jsonrpcserver_test.py:209: AssertionError ------------------------------ Captured log call ------------------------------- WARNING vds.dispatcher:betterAsyncore.py:179 unhandled write event ERROR vds.dispatcher:betterAsyncore.py:179 uncaptured python exception, closing channel <yajsonrpc.betterAsyncore.Dispatcher ('::1', 40156, 0, 0) at 0x7f842cd7d7f0> (<class 'ValueError'>:'b'ept-version:1.2'' contains illegal character ':' [/usr/lib64/python3.6/asyncore.py|readwrite|108] [/usr/lib64/python3.6/asyncore.py|handle_read_event|423] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|handle_read|71] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|_delegate_call|168] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/protocoldetector.py|handle_read|129] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|handle_socket|413] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/rpc/bindingjsonrpc.py|add_socket|54] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|createListener|379] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|StompListener|345] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|__init__|47] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|switch_implementation|86] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|init|363] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/rpc/bindingjsonrpc.py|_onAccept|57] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|set_message_handler|645] [/usr/lib64/python3.6/asyncore.py|handle_read_event|423] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|handle_read|71] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|_delegate_call|168] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|handle_read|421] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|parse|323] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|_parse_command|245] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|decode_value|167]) WARNING vds.dispatcher:betterAsyncore.py:179 unhandled close event =============================== warnings summary =============================== /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334 /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334: PytestUnknownMarkWarning: Unknown pytest.mark.stress - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html PytestUnknownMarkWarning, /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334 /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334: PytestUnknownMarkWarning: Unknown pytest.mark.slow - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html PytestUnknownMarkWarning, /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/models.py:442 /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/models.py:442: DeprecationWarning: invalid escape sequence \D nicsRexp = re.compile("^(\D*)(\d*)(.*)$") /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/link/validator.py:38 /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/link/validator.py:38: DeprecationWarning: invalid escape sequence \w bond for bond in bonds if not re.match('^bond\w+$', bond) /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/link/validator.py:44 /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/link/validator.py:44: DeprecationWarning: invalid escape sequence \w and not re.match('^bond\w+$', net_attrs['bonding']) /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:78 /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:78: DeprecationWarning: invalid escape sequence \d _SSH_AUTH_RE = b'(SSH_AUTH_SOCK)=([^;]+).*;\nSSH_AGENT_PID=(\d+)' /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:1420 /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:1420: DeprecationWarning: invalid escape sequence \^ '(?P<m2_base>[0-9]+){sp}\^{sp}(?P<m2_exp>{exp}))'.format( /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334 /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334: PytestUnknownMarkWarning: Unknown pytest.mark.xpass - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html PytestUnknownMarkWarning, -- Docs: https://docs.pytest.org/en/latest/warnings.html ----------- coverage: platform linux, python 3.6.8-final-0 ----------- Coverage HTML written to dir htmlcov-lib ========================== slowest 10 test durations =========================== 18.16s call tests/lib/yajsonrpc/jsonrpcserver_test.py::JsonRpcServerTests::testMethodBadParameters(True) 2.92s call tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client_concurrency(False) 2.86s call tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client(True) 2.76s call tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client_concurrency(True) 2.63s call tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client(False) 1.28s call tests/pywatch_test.py::TestPyWatch::test_timeout_backtrace 0.89s call tests/pywatch_test.py::TestPyWatch::test_kill_grandkids 0.89s call tests/lib/protocoldetector_test.py::AcceptorTests::test_detect_slow_client_concurrency(True) 0.88s call tests/pywatch_test.py::TestPyWatch::test_timeout_output 0.80s call tests/lib/protocoldetector_test.py::AcceptorTests::test_detect_slow_client(False) =========================== short test summary info ============================

2 2

Bug 1779527 - Hosted engine deploys failed as "Failed to connect to guest agent channel" when creating target vm.
by Sandro Bonazzola 18 Dec '19

18 Dec '19

Hi, QE found *Bug 1779527* <https://bugzilla.redhat.com/show_bug.cgi?id=1779527> - Hosted engine deploys failed as "Failed to connect to guest agent channel" when creating target vm. while testing hosted engine deployment on the downstream version of oVirt Node 4.4. At first look, seems like vdsm is searching for guest agent. If this is the ovirt-guest-agent, we are not adding it anymore to the engine appliance as per virt team request. Can you provide hints on why this test is done on vdsm side and if we can get rid of it or if we need to re-add the ovirt-guest-agent to the appliance? Thanks, -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/>*Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

2 2

CI system outage
by Evgheni Dereveanchin 17 Dec '19

17 Dec '19

Hello everyone, We received several reports of Jenkins jobs not running properly. The reason turned out to be the Jenkins Master which did not start jobs properly. It has been restarted and is working properly now. If you have any jobs that failed or did not start at all today - please re-trigger them or reach out to me for assistance. -- Regards, Evgheni Dereveanchin

1 0

published master engine is 13 days old
by Yedidyah Bar David 17 Dec '19

17 Dec '19

Hi all, $subject. [1] has ovirt-engine-4.4.0-0.0.master.20191204120550.git04d5d05.el7.noarch . Tried to look around, and I have a few notes/questions: 1. Last successful run of [2] is 3 days old, but apparently it wasn't published. Any idea why? 2. Failed runs of [2] are reported to infra, with emails such as: [CQ]: 105472, 5 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause Is anyone monitoring these? Is this the only alerting that CI generates on such failures? If first is No and second is Yes, then we need someone/something to start monitoring. This was discussed a lot, but I do not see any change. Ideally, such alerts should be To'ed or Cc'ed to the author and reviewers of the patch that CI found to be guilty (which might be wrong, that's not the point). Do we plan to have something like this? Any idea when it will be ready? 3. I looked at a few recent failures of [2], specifically [3][4]. Both seem to have been killed after a timeout, while running 'engine-config'. For [3] that's clear, see [5]: 2019-12-16 17:11:44,766::log_utils.py::__exit__::611::lago.ssh::DEBUG::end task:fb6611dc-55bb-4251-aeda-2578b2ec83a2:Get ssh client for lago-basic-suite-master-engine: 2019-12-16 17:11:44,931::ssh.py::ssh::58::lago.ssh::DEBUG::Running 22e2b6b6 on lago-basic-suite-master-engine: engine-config --set VdsmUseNmstate=true 2019-12-16 19:55:21,965::cmd.py::exit_handler::921::cli::DEBUG::signal 15 was caught Can't find stdout/stderr of engine-config, so it's hard to tell if it outputted anything helpful to understand why it was stuck. It's hard to tell that about [4], because it has very few artifacts collected, no idea why, notably no lago.log, but [6] does show: [36m # initialize_engine: [32mSuccess [0m (in 0:04:00) [0m [36m # engine_config: [0m [0m [0m [36m * Collect artifacts: [0m [0m [0m [36m - [Thread-34] lago-basic-suite-master-engine: [31mERROR [0m (in 0:00:04) [0m [36m * Collect artifacts: [31mERROR [0m (in 0:00:04) [0m [36m # engine_config: [31mERROR [0m (in 2:42:57) [0m /bin/bash: line 31: 5225 Killed ${_STDCI_TIMEOUT_CMD} "3h" "$script_path" < /dev/null If I run 'engine-config --set VdsmUseNmstate=true' on my 20191204120550.git04d5d05 engine, it returns quickly. Tried also adding a repo pointing at last successful run of [7], which is currently [8], and it prompts me to input a version, probably as a result of [9]. Ales/Martin, can you please have a look? Thanks. [1] https://resources.ovirt.org/pub/ovirt-master-snapshot/rpm/el7/noarch/ [2] https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/ [3] https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/17768/ [4] https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/17761/ [5] https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/17768/artifa… [6] https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/17761/artifa… [7] https://jenkins.ovirt.org/job/ovirt-engine_standard-on-merge/ [8] https://jenkins.ovirt.org/job/ovirt-engine_standard-on-merge/384/ [9] https://gerrit.ovirt.org/105440 -- Didi

3 3

Failed to start Vagrant
by Ritesh Chikatwar 15 Dec '19

15 Dec '19

Hello, [root@localhost vagrant]# vagrant reload Error while connecting to libvirt: Error making a connection to libvirt URI qemu:///system?no_verify=1&keyfile=/root/.ssh/id_rsa: Call to virConnectOpen failed: authentication failed: Failed to start SASL negotiation: -4 (SASL(-4): no mechanism available: No worthy mechs found) Status Of libvirtd https://pastebin.com/H7yNqXU7 (It is active) I cannot see any logs in /var/log/libvirt/qemu/vagrant_default.log My Vagrant file: https://pastebin.com/JXBd5ci1 Any help would be appreciated. Ritesh CHikatwar

1 0

oVirt 4.4.0 Alpha release is now available for testing
by Sandro Bonazzola 13 Dec '19

13 Dec '19

oVirt 4.4.0 Alpha release is now available for testing The oVirt Project is excited to announce the availability of the alpha release of oVirt 4.4.0 for testing, as of December 13th, 2019 This release unleashes an altogether more powerful and flexible open source virtualization solution that encompasses hundreds of individual changes and a wide range of enhancements across the engine, storage, network, user interface, and analytics on top of oVirt 4.3. Important notes before you try it Please note this is an Alpha release. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not to be used in production, and it is not feature complete. In particular, please note that upgrades from 4.3 and future upgrades from this alpha to the final 4.4 release from this version are not supported. Some of the features included in oVirt 4.4.0 Alpha require content that will be available in CentOS Linux 8.1 which is currently being built from Red Hat Enterprise Linux 8.1. If you want to have a better experience you can test oVirt 4.4.0 Alpha on Red Hat Enterprise Linux 8.1. Known Issues - After installation open the Default cluster and hit “Save”, for any other new Cluster using CPU autodetection the dialog needs to be explicitly saved after the detection happens, after first host is added. (bug https://bugzilla.redhat.com/1770697) - Migrate, Cluster Upgrade, Export VM buttons cannot be clicked. Fixed in ovirt-engine-ui-extensions-1.0.11 Installation instructions For the engine: either use appliance or: - Install CentOS Linux 7.7 minimal from http://centos.mirror.garr.it/centos/7.7.1908/isos/x86_64/CentOS-7-x86_64-Mi… - yum install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - yum update (reboot if needed) - yum install ovirt-engine - engine-setup For the nodes: Either use oVirt Node ISO or: - Install CentOS Linux 8.0 from http://centos.mirror.garr.it/centos/8.0.1905/isos/x86_64/CentOS-8-x86_64-19… ; select minimal installation - yum config-manager --set-enabled PowerTools - yum install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - yum update (reboot if needed) - Attach the host to engine and let it be deployed. What’s new in oVirt 4.4.0 Alpha? - Hypervisors based on CentOS Linux 8 (rebuilt from award winning RHEL8), for both oVirt Node and standalone CentOS Linux hosts - Easier network management and configuration flexibility with NetworkManager - VMs based on a more modern Q35 chipset with legacy seabios and UEFI firmware - Support for direct passthrough of local host disks to VMs - Live migration improvements for High Performance guests. - New Windows Guest tools installer based on WiX framework now moved to VirtioWin project - Dropped support for cluster level prior to 4.2 - Dropped SDK3 support - 4K disks support - Exporting a VM to a data domain - Editing of floating disks - Integrating ansible-runner into engine, which allows a more detailed monitoring of playbooks executed from engine - Adding/reinstalling hosts are now completely based on Ansible - The OpenStack Neutron Agent cannot be configured by oVirt anymore, it should be configured by TripleO instead This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 7.7 or later (but < 8.0) * CentOS Linux (or similar) 7.7 or later (but < 8.0) This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.0 or later * CentOS Linux (or similar) 8.0 or later * oVirt Node 4.4 based on CentOS Linux 8.0 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. If you manage more than one oVirt instance, OKD or RDO we also recommend to try ManageIQ <http://manageiq.org/>. In such a case, please be sure to take the qc2 image and not the ova image. Notes: - oVirt Appliance is already available for CentOS Linux 8 - oVirt Node NG is already available for CentOS Linux 8 Additional Resources: * Read more about the oVirt 4.4.0 release highlights: http://www.ovirt.org/release/4.4.0/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.0/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/>*Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

2 2

CI: jsonrpcserver test fails
by Amit Bawer 11 Dec '19

11 Dec '19

Hi devel, We have (also) frequent connectivity/timeout failures on CI tests for jsonrpcserver tests. Example: https://jenkins.ovirt.org/job/vdsm_standard-check-patch/15642//artifact/che… Proposing the following patches: https://gerrit.ovirt.org/#/c/105518/ https://gerrit.ovirt.org/#/c/105519/ You are most welcome to review or suggest alternative ones. Thanks.

2 3

Vdsm/CI: Failed to synchronize cache for repo 'epel-el8'
by Milan Zamazal 11 Dec '19

11 Dec '19

Hi, I've seen this error more than once in Jenkins runs on Vdsm patches posted to gerrit: + python3 tests/profile debuginfo-install debuginfo-install -y python3 Error: Failed to synchronize cache for repo 'epel-el8' PROFILE {"command": ["debuginfo-install", "-y", "python3"], "cpu": 25.8319700558958, "elapsed": 39.049031019210815, "idrss": 0, "inblock": 0, "isrss": 0, "ixrss": 0, "majflt": 0, "maxrss": 92900, "minflt": 35674, "msgrcv": 0, "msgsnd": 0, "name": "debuginfo-install", "nivcsw": 1096, "nsignals": 0, "nswap": 0, "nvcsw": 904, "oublock": 64848, "start": 1575653575.116399, "status": 1, "stime": 1.135238, "utime": 8.951896} + teardown + res=1 + '[' 1 -ne 0 ']' + echo '*** err: 1' *** err: 1 See e.g. https://jenkins.ovirt.org/blue/organizations/jenkins/vdsm_standard-check-pa… Does anybody know what's going on and how to remedy it? Thanks, Milan

4 9