- Devel - oVirt List Archives

[vdsm][ci] EL7 failing for timeout lately
by Francesco Romani 04 Apr '18

04 Apr '18

Hi all, in the last few days quite a lot of CI tests on LE7 workers failed for timeout. Random example: http://jenkins.ovirt.org/job/vdsm_4.2_check-patch-el7-x86_64/246/consoleFull This happened both on 4.2 and on master test suite, quite often but not always. I wonder if we should just increase the timeout or if something else is going on. Thoughts? -- Francesco Romani Senior SW Eng., Virtualization R&D Red Hat IRC: fromani github: @fromanirh

2 1

oVirt log analyzer
by Milan Zamazal 04 Apr '18

04 Apr '18

Hi, during last year Outreachy internship a tool for analyzing oVirt logs was created. When it is provided with oVirt logs (such as SOS reports, logs gathered by Lago, single or multiple log files) it tries to identify and classify important lines from the logs and present them in a structured form. Its primary purpose is to get a quick and easy overview of actions and errors. The tool analyses given logs and produces text files with the extracted information. There is an Emacs user interface that presents the output in a nice way with added functionality such as filtering. Emacs haters can use the plain text files or write another user interface. :-) You can get ovirt-log-analyzer from https://github.com/mz-pdm/ovirt-log-analyzer README.md explains how to use it. Note that ovirt-log-analyzer has been created within the limited resources of an Outreachy internship with some additional work and not everything is perfect. Feel free to make improvements. Regards, Milan

6 10

[ OST Failure Report ] [ oVirt 4.2 ] [ 2018-04-03 ] [006_migrations.prepare_migration_attachments_ipv6]
by Barak Korren 04 Apr '18

04 Apr '18

Test failed: [ 006_migrations.prepare_migration_attachments_ipv6 ] Link to suspected patches: (Patch seems unrelated - do we have sporadic communication issues arising in PST?) https://gerrit.ovirt.org/c/89737/1 - vdsm - automation: check-patch: attempt to install vdsm-gluster Link to Job: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/1521/ Link to all logs: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/1521/artifact/ex… Error snippet from log: <error> Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 78, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/workspace/ovirt-4.2_change-queue-tester/ovirt-system-tests/basic-suite-4.2/test-scenarios/006_migrations.py", line 139, in prepare_migration_attachments_ipv6 engine, host_service, MIGRATION_NETWORK, ip_configuration) File "/home/jenkins/workspace/ovirt-4.2_change-queue-tester/ovirt-system-tests/basic-suite-4.2/test_utils/network_utils_v4.py", line 71, in modify_ip_config check_connectivity=True) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 36729, in setup_networks return self._internal_action(action, 'setupnetworks', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault self._raise_error(response, body) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. </error> -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

4 7

Lago v0.43 Release Announcement
by Gal Ben Haim 03 Apr '18

03 Apr '18

Hi All, On behalf of the Lago team, I'm pleased to announce Lago v0.43 is available! For a detailed release announcement please refer to our Github page at: https://github.com/lago-project/lago/releases/tag/0.43 Resources ========== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Pypi: https://pypi.python.org/pypi/lago Changelog: http://lago.readthedocs.io/en/0.43/_static/ChangeLog.txt As always, if you find any problems, or willing to contribute, visit our GitHub page. Enjoy! -- *GAL bEN HAIM* RHV DEVOPS

1 0

Failed To Build ovirt-node following the guide
by sundw 02 Apr '18

02 Apr '18

This is a multi-part message in MIME format. ------=_001_NextPart058565458615_=---- Content-Type: text/plain; charset="GB2312" Content-Transfer-Encoding: base64 SGVsbG8sZ3V5c6OhDQoNCkkgYnVpbHQgb3ZpcnQtbm9kZSBmb2xsb3dpbmcgdGhpcyBndWlkZSho dHRwczovL3d3dy5vdmlydC5vcmcvZGV2ZWxvcC9wcm9qZWN0cy9ub2RlL2J1aWxkaW5nLykuDQpC dXQgSSBmYWlsZWQuDQpJIGdvdCB0aGUgZm9sbG93aW5nIEVycm9yIG1lc3NhZ2UgYWZ0ZXIgcnVu bmluZyAibWFrZSBpc28gcHVibGlzaCI6DQoNCkVycm9yIGNyZWF0aW5nIExpdmUgQ0QgOiBGYWls ZWQgdG8gZmluZCBwYWNrYWdlICdvdmlydC1ub2RlLXBsdWdpbi12ZHNtJyA6IE5vIHBhY2thZ2Uo cykgYXZhaWxhYmxlIHRvIGluc3RhbGwNCg0KQ291bGQgeW91IHBsZWFzZSBnaXZlIHNvbWUgYWR2 aWNlPw0KDQpCVFc6IElzIHRoZSBjb250ZW50IG9mIHRoaXMgdXJsICJodHRwczovL3d3dy5vdmly dC5vcmcvZGV2ZWxvcC9wcm9qZWN0cy9ub2RlL2J1aWxkaW5nLyIgT1VUIE9GIERBVEU/DQoNCg0K DQrL77TzzqENCrGxvqm/xtL4vqmzyby8yvXT0M/euavLvi/QwrL6xrfR0Leisr8NCjEzMzc4MTA1 NjI1DQo= ------=_001_NextPart058565458615_=---- Content-Type: text/html; charset="GB2312" Content-Transfer-Encoding: quoted-printable <html><head><meta http-equiv=3D"content-type" content=3D"text/html; charse= t=3DGB2312"><style>body { line-height: 1.5; }body { font-size: 10.5pt; fon= t-family: =CE=A2=C8=ED=D1=C5=BA=DA; color: rgb(0, 0, 0); line-height: 1.5;= }</style></head><body>=0A<div><span></span><span style=3D"color: rgb(0, 0= , 0); background-color: rgba(0, 0, 0, 0);">Hello,guys=A3=A1</span></div><d= iv><span style=3D"color: rgb(0, 0, 0); background-color: rgba(0, 0, 0, 0);= "><br>I built ovirt-node following this guide(htt= ps://www.ovirt.org/develop/projects/node/building/)<br>But I fa= iled.<br>I got the following Error message after = running "make iso publish":<br><br>Error creating&nbsp= ;Live CD : Failed to find package 'ovir= t-node-plugin-vdsm' : No package(s) available to&= nbsp;install<br><br>Could you please give some ad= vice?</span></div><div><span style=3D"color: rgb(0, 0, 0); background-colo= r: rgba(0, 0, 0, 0);"><br></span></div><div><b><span style=3D"color: rgb(0= , 0, 0); background-color: rgba(0, 0, 0, 0);">BTW: Is the content of this = url "</span><span style=3D"font-size: 10.5pt; line-height: 1.5; background= -color: window;">https://www.ovirt.org/develop/projects/node/building/</sp= an><span style=3D"background-color: rgba(0, 0, 0, 0); font-size: 10.5pt; l= ine-height: 1.5;">" OUT OF DATE?</span></b></div><div><br></div><hr style= =3D"width: 210px; height: 1px;" color=3D"#b5c4df" size=3D"1" align=3D"left= ">=0A<div><span><div style=3D"margin: 10px; font-size: 21px;"><b><font fac= e=3D"=BB=AA=CE=C4=D0=C2=CE=BA">=CB=EF=B4=F3=CE=A1</font></b></div><div sty= le=3D"MARGIN: 10px; FONT-FAMILY: verdana; FONT-SIZE: 10pt">=B1=B1=BE=A9=BF= =C6=D2=F8=BE=A9=B3=C9=BC=BC=CA=F5=D3=D0=CF=DE=B9=AB=CB=BE/=D0=C2=B2=FA=C6= =B7=D1=D0=B7=A2=B2=BF</div><div style=3D"MARGIN: 10px; FONT-FAMILY: verdan= a; FONT-SIZE: 10pt">13378105625</div></span></div>=0A</body></html> ------=_001_NextPart058565458615_=------

3 2

Build virt-node on fedora26 failed
by sundw 02 Apr '18

02 Apr '18

This is a multi-part message in MIME format. ------=_001_NextPart018013562620_=---- Content-Type: text/plain; charset="GB2312" Content-Transfer-Encoding: base64 SGkhDQpJIGJ1aWxkIHZpcnQtbm9kZSBiYXNlIG9uIHRoaXMgZ3VpZGUoaHR0cHM6Ly93d3cub3Zp cnQub3JnL2RldmVsb3AvcHJvamVjdHMvbm9kZS9idWlsZGluZy8pLg0KSSBnb3QgdGhlIGZvbGxv d2luZyBlcnJvciBtZXNzYWdlcyBhZnRlciBJIHJ1biAibWFrZSBwdWJsaXNoIjoNCg0KSW5zdGFs bGluZyB0bXAucmVwb3MvU1JQTVMvb3ZpcnQtbm9kZS0zLjcuMC0wLjAubWFzdGVyLmZjMjcuc3Jj LnJwbQ0KZXJyb3I6IEZhaWxlZCBidWlsZCBkZXBlbmRlbmNpZXM6DQovdXNyL3NoYXJlL3NlbGlu dXgvZGV2ZWwvcG9saWN5aGVscCBpcyBuZWVkZWQgYnkgb3ZpcnQtbm9kZS0zLjcuMC0wLjAubWFz dGVyLmZjMjcubm9hcmNoDQptYWtlWzFdOiAqKiogW01ha2VmaWxlOjgxMzogcnBtXSBFcnJvciAx DQptYWtlWzFdOiBMZWF2aW5nIGRpcmVjdG9yeSAnL2hvbWUvY29yZXRlay9naXQvb3ZpcnQtbm9k ZScNCm1ha2U6ICoqKiBbTWFrZWZpbGU6ODI3OiBwdWJsaXNoXSBFcnJvciAyDQoNCkNhbiBhbnlv bmUgZ2l2ZSBtZSBzb21lIHN1Z2dlc3Rpb25zPyANClRoYW5rcyENCg0KDQoNCg0Ky++0886hDQqx sb6pv8bS+L6ps8m8vMr109DP3rmry74v0MKy+sa30dC3orK/DQoxMzM3ODEwNTYyNQ0K ------=_001_NextPart018013562620_=---- Content-Type: text/html; charset="GB2312" Content-Transfer-Encoding: quoted-printable <html><head><meta http-equiv=3D"content-type" content=3D"text/html; charse= t=3DGB2312"><style>body { line-height: 1.5; }body { font-size: 10.5pt; fon= t-family: =CE=A2=C8=ED=D1=C5=BA=DA; color: rgb(0, 0, 0); line-height: 1.5;= }</style></head><body>=0A<div><span></span>Hi!</div><div>I build virt-nod= e base on this guide(<span style=3D"background-color: rgba(0, 0, 0, 0); fo= nt-size: 10.5pt; line-height: 1.5;">https://www.ovirt.org/develop/projects= /node/building/</span><span style=3D"font-size: 10.5pt; line-height: 1.5; = background-color: window;">).</span></div><div>I got the following error m= essages after I run "make publish":</div><div><br></div><div><span style= =3D"color: rgb(0, 0, 0); background-color: rgba(0, 0, 0, 0);">Installing&n= bsp;tmp.repos/SRPMS/ovirt-node-3.7.0-0.0.master.fc27.src.rpm<br>error:&nbs= p;Failed build dependencies:<br><span style=3D"white-space: pre;= "> </span>/usr/share/selinux/devel/policyhelp is needed by&= nbsp;ovirt-node-3.7.0-0.0.master.fc27.noarch<br>make[1]: *** [Ma= kefile:813: rpm] Error 1<br>make[1]: Leaving dire= ctory '/home/coretek/git/ovirt-node'<br>make: *** [Makefile= :827: publish] Error 2</span></div><div><span style=3D"colo= r: rgb(0, 0, 0); background-color: rgba(0, 0, 0, 0);"><br></span></div><di= v><span style=3D"color: rgb(0, 0, 0); background-color: rgba(0, 0, 0, 0);"= >Can anyone give me some suggestions? </span></div><div><span style= =3D"color: rgb(0, 0, 0); background-color: rgba(0, 0, 0, 0);">Thanks!</spa= n></div><div><br></div>=0A<div><br></div><hr style=3D"width: 210px; height= : 1px;" color=3D"#b5c4df" size=3D"1" align=3D"left">=0A<div><span><div sty= le=3D"margin: 10px; font-size: 21px;"><b><font face=3D"=BB=AA=CE=C4=D0=C2= =CE=BA">=CB=EF=B4=F3=CE=A1</font></b></div><div style=3D"MARGIN: 10px; FON= T-FAMILY: verdana; FONT-SIZE: 10pt">=B1=B1=BE=A9=BF=C6=D2=F8=BE=A9=B3=C9= =BC=BC=CA=F5=D3=D0=CF=DE=B9=AB=CB=BE/=D0=C2=B2=FA=C6=B7=D1=D0=B7=A2=B2=BF<= /div><div style=3D"MARGIN: 10px; FONT-FAMILY: verdana; FONT-SIZE: 10pt">13= 378105625</div></span></div>=0A</body></html> ------=_001_NextPart018013562620_=------

2 1

[ OST Failure Report ] [ oVirt Master (ovirt-engine) ] [ 27-03-2018 ] [ 004_basic_sanity.disk_operations ]
by Dafna Ron 02 Apr '18

02 Apr '18

Hi, We have a failure on 004_basic_sanity.disk_operations. the reported change seems to me to be connected to the failure. *Link and headline of suspected patches: core: introduce CreateSnapshotForVm - https://gerrit.ovirt.org/#/c/87671/ <https://gerrit.ovirt.org/#/c/87671/>Link to Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6564/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6564/>Link to all logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6564/art… <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6564/artifact…>(Relevant) error snippet from the log: <error>2018-03-27 11:30:16,167-04 WARN [org.ovirt.engine.core.bll.snapshots.CreateSnapshotForVmCommand] (default task-11) [9f713a3d-82a9-4db8-8207-bb69a0a2c550] Validation of action 'CreateSnapshotForVm' failed for user admin@internal-authz. Reasons: VAR__ACTION__CREATE,VAR__TYPE__SNAPSHOT,ACTION_TYPE_FAILED_SNAPSHOT_IS_BEING_TAKEN_FOR_VM,$VmName vm12018-03-27 11:30:16,176-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-11) [9f713a3d-82a9-4db8-8207-bb69a0a2c550] method: runAction, params: [CreateSnapshotForVm, CreateSnapshotForVmParameters:{commandId='d8bfdb0e-5ae4-4fed-8852-a0b29e377708', user='null', commandType='Unknown', vmId='65e7fea5-8b7d-4281-bd0d-6a84de207a00'}], timeElapsed: 57ms2018-03-27 11:30:16,186-04 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-11) [] Operation Failed: [Cannot create Snapshot. Snapshot is currently being created for VM vm1.]2018-03-27 11:30:16,820-04 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-100) [16c08ce6-9a73-489f-a1f2-56e21699f14a] Command 'CopyImageGroupVolumesData' (id: '4c4023b4-21e8-4a98-8ac3-aba51967d160') waiting on child command id: '3d96b933-6e3b-4838-94bc-db3ff0cadcdc' type:'CopyData' to complete2018-03-27 11:30:16,833-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (EE-ManagedThreadFactory-engineScheduled-Thread-100) [16c08ce6-9a73-489f-a1f2-56e21699f14a] method: get, params: [a85992e9-40b8-4c80-9c93-3bf767f6efa4], timeElapsed: 8ms</error>*

4 9

[ OST Failure Report ] [ oVirt 4.2 ] [ 2018-04-01 ] [007_sd_reattach.reattach_storage_domain]
by Barak Korren 01 Apr '18

01 Apr '18

Test failed: [ 007_sd_reattach.reattach_storage_domain ] Link to suspected patches: https://gerrit.ovirt.org/c/89634/2 (ovirt-imageio): daemon: Fix OPTIONS to reflect actual capabilities Link to Job: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/1502/ Link to all logs: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/1502/artifact/ex… Error snippet from log: <error> Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. </error> -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

1 0

[VDSM] Network test failing randomly - needs un-ordered compare?
by Nir Soffer 30 Mar '18

30 Mar '18

We have this failure in unrelated patch: http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/22723/conso… The issue seems to comparing strings instead of sets. The next run was successful. I did not check if it run on the same slave. http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/22724/ *00:08:51.242* =================================== FAILURES =================================== *00:08:51.243* ________________ LinkBondTests.test_bond_set_two_arp_ip_targets ________________*00:08:51.243* *00:08:51.243* self = <network.integration.link_bond_test.LinkBondTests testMethod=test_bond_set_two_arp_ip_targets>*00:08:51.244* *00:08:51.244* def test_bond_set_two_arp_ip_targets(self):*00:08:51.244* OPTIONS = {*00:08:51.244* 'mode': '1',*00:08:51.245* 'arp_interval': '1000',*00:08:51.245* 'arp_ip_target': '10.1.3.1,10.1.2.1'}*00:08:51.245* *00:08:51.245* with bond_device() as bond:*00:08:51.245* bond.set_options(OPTIONS)*00:08:51.246* bond.refresh()*00:08:51.246* > self.assertEqual(bond.options, OPTIONS)*00:08:51.246* E AssertionError: {'mode': '1', 'arp_interval': '1000', 'arp_ip_target': '10.1.2.1,10.1.3.1'} != {'mode': '1', 'arp_interval': '1000', 'arp_ip_target': '10.1.3.1,10.1.2.1'}*00:08:51.248* E - {'arp_interval': '1000', 'arp_ip_target': '10.1.2.1,10.1.3.1', 'mode': '1'}*00:08:51.248* E ? ---------*00:08:51.249* E *00:08:51.249* E + {'arp_interval': '1000', 'arp_ip_target': '10.1.3.1,10.1.2.1', 'mode': '1'}*00:08:51.249* E ? +++++++++*00:08:51.250* *00:08:51.250* network/integration/link_bond_test.py:159: AssertionError*00:08:51.250* ------------------------------ Captured log call -------------------------------*00:08:51.251* sysfs_driver.py 57 INFO Bond bond_ge9DfJ has been created.*00:08:51.251* cmdutils.py 150 DEBUG /sbin/ip link set dev bond_ge9DfJ down (cwd None)*00:08:51.252* cmdutils.py 158 DEBUG SUCCESS: <err> = ''; <rc> = 0*00:08:51.252* sysfs_driver.py 102 INFO Bond bond_ge9DfJ options set: {'mode': '1', 'arp_interval': '1000', 'arp_ip_target': '10.1.3.1,10.1.2.1'}.*00:08:51.253* sysfs_driver.py 67 INFO Bond bond_ge9DfJ has been destroyed.*00:08:51.254* =============== 1 failed, 36 passed, 12 skipped in 10.57 seconds ===============

1 0

new time-based test randomly failing
by Dan Kenigsberg 29 Mar '18

29 Mar '18

I suppose this test should be reworked, or at least, have its constants tweaked. FAIL: test_slow_handler_sync (common.logutils_test.TestThreadedHandler) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/jenkins/workspace/vdsm_master_check-patch-fc27-x86_64/vdsm/tests/common/logutils_test.py", line 319, in test_slow_handler_sync self.assertGreater(max(workers_time), 0.9) AssertionError: 0.8714249134063721 not greater than 0.9

2 5