- Devel - oVirt List Archives

issue in vdsm monitoring
by Dafna Ron 13 Sep '18

13 Sep '18

Hi, I have been seeing random failures of tests in different projects caused by vdsm monitoring. I need someone from vdsm to please help debug this issue. From what I can see, the test suspend/resume vm failed because we could not query the status of the vm on the host. you can see full log from failed tests here: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10208/artifa… Here are the errors that I can see in the vdsm which seem to suggest that there is an issue getting stats on the vm which was suspended and caused the failure of the test: 2018-09-11 00:40:05,896-0400 INFO (monitor/c1fe6e6) [storage.StorageDomain] Removing remnants of deleted images [] (fileSD:734) 2018-09-11 00:40:07,957-0400 DEBUG (qgapoller/1) [vds] Not sending QEMU-GA command 'guest-get-users' to vm_id='8214433a-f233-4aaa-aeda-2ce1d31c78dc', command is not supported (qemuguestagent:192) 2018-09-11 00:40:08,068-0400 DEBUG (periodic/3) [virt.sampling.VMBulkstatsMonitor] sampled timestamp 4296118.49 elapsed 0.010 acquired True domains all (sampling:443) 2018-09-11 00:40:08,271-0400 DEBUG (jsonrpc/1) [jsonrpc.JsonRpcServer] Calling 'Image.prepare' in bridge with {u'allowIllegal': True, u'storagepoolID': u'e80a56d9-74da-498a-b010-4a9df287f11d', u'imageID': u'd4c831e6-02d2-4d89-b516-0ec4597 5e024', u'volumeID': u'15b07af1-625b-42e3-b62a-8e7c7a120a56', u'storagedomainID': u'f1744940-41b6-4d35-b7bf-870c4e07d995'} (__init__:329) 2018-09-11 00:40:10,846-0400 DEBUG (vmchannels) [virt.vm] (vmId='8214433a-f233-4aaa-aeda-2ce1d31c78dc') Guest connection timed out (guestagent:556) 2018-09-11 00:40:11,637-0400 DEBUG (jsonrpc/5) [jsonrpc.JsonRpcServer] Calling 'Host.getStats' in bridge with {} (__init__:329) 2018-09-11 00:40:11,637-0400 INFO (jsonrpc/5) [api.host] START getStats() from=::ffff:192.168.201.4,49184 (api:47) 2018-09-11 00:40:11,643-0400 DEBUG (jsonrpc/5) [root] cannot read eth0 speed (nic:42) 2018-09-11 00:40:11,645-0400 DEBUG (jsonrpc/5) [root] cannot read eth1 speed (nic:42) 2018-09-11 00:40:11,647-0400 DEBUG (jsonrpc/5) [root] cannot read eth2 speed (nic:42) 2018-09-11 00:40:11,649-0400 DEBUG (jsonrpc/5) [root] cannot read eth3 speed (nic:42) 2018-09-11 00:40:11,667-0400 INFO (jsonrpc/5) [api.host] FINISH getStats error=[Errno 22] Invalid argument from=::ffff:192.168.201.4,49184 (api:51) 2018-09-11 00:40:11,667-0400 ERROR (jsonrpc/5) [jsonrpc.JsonRpcServer] Internal server error (__init__:350) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 345, in _handle_request res = method(**params) File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 202, in _dynamicMethod result = fn(*methodArgs) File "<string>", line 2, in getStats File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 49, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1407, in getStats multipath=True)} File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 49, in get_stats decStats = stats.produce(first_sample, last_sample) File "/usr/lib/python2.7/site-packages/vdsm/host/stats.py", line 71, in produce stats.update(get_interfaces_stats()) File "/usr/lib/python2.7/site-packages/vdsm/host/stats.py", line 153, in get_interfaces_stats return net_api.network_stats() File "/usr/lib/python2.7/site-packages/vdsm/network/api.py", line 63, in network_stats return netstats.report() File "/usr/lib/python2.7/site-packages/vdsm/network/netstats.py", line 31, in report stats = link_stats.report() File "/usr/lib/python2.7/site-packages/vdsm/network/link/stats.py", line 41, in report speed = vlan.speed(i.device) File "/usr/lib/python2.7/site-packages/vdsm/network/link/vlan.py", line 36, in speed dev_speed = nic.read_speed_using_sysfs(dev_name) File "/usr/lib/python2.7/site-packages/vdsm/network/link/nic.py", line 48, in read_speed_using_sysfs s = int(f.read()) IOError: [Errno 22] Invalid argument 2018-09-11 00:40:11,669-0400 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getStats failed (error -32603) in 0.03 seconds (__init__:312) 2018-09-11 00:40:14,656-0400 DEBUG (jsonrpc/2) [jsonrpc.JsonRpcServer] Calling 'Host.getAllVmStats' in bridge with {} (__init__:329) 2018-09-11 00:40:14,657-0400 INFO (jsonrpc/2) [api.host] START getAllVmStats() from=::1,46772 (api:47) 2018-09-11 00:40:14,659-0400 INFO (jsonrpc/2) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,46772 (api:53) 2018-09-11 00:40:14,660-0400 DEBUG (jsonrpc/2) [jsonrpc.JsonRpcServer] Return 'Host.getAllVmStats' in bridge with (suppressed) (__init__:356) 2018-09-11 00:40:14,661-0400 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:312) 2018-09-11 00:40:14,674-0400 DEBUG (jsonrpc/1) [jsonrpc.JsonRpcServer] Calling 'Host.getAllVmIoTunePolicies' in bridge with {} (__init__:329) 2018-09-11 00:40:14,675-0400 INFO (jsonrpc/1) [api.host] START getAllVmIoTunePolicies() from=::1,46772 (api:47) 2018-09-11 00:40:14,675-0400 INFO (jsonrpc/1) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'8214433a-f233-4aaa-aeda-2ce1d31c78dc': {'policy': [], 'current_values': [{'ioTune': {'write_bytes_sec': 0L, 'total_iops_sec': 0L, 'read_iops_sec': 0L, 'read_bytes_sec': 0L, 'write_iops_sec': 0L, 'total_bytes_sec': 0L}, 'path': '/rhev/data-center/mnt/blockSD/f1744940-41b6-4d35-b7bf-870c4e07d995/images/9a3659dc-339e-4b3f-a1d1-6ee3debb6168/e2570635-a798-4e9e-a0ea-88436d5b296f', 'name': 'vda'}]}}} from=::1,46772 (api:53) 2018-09-11 00:40:14,675-0400 DEBUG (jsonrpc/1) [jsonrpc.JsonRpcServer] Return 'Host.getAllVmIoTunePolicies' in bridge with {'8214433a-f233-4aaa-aeda-2ce1d31c78dc': {'policy': [], 'current_values': [{'ioTune': {'write_bytes_sec': 0L, 'total_iops_sec': 0L, 'read_iops_sec': 0L, 'read_bytes_sec': 0L, 'write_iops_sec': 0L, 'total_bytes_sec': 0L}, 'path': '/rhev/data-center/mnt/blockSD/f1744940-41b6-4d35-b7bf-870c4e07d995/images/9a3659dc-339e-4b3f-a1d1-6ee3debb6168/e2570635-a798-4e9e-a0ea-88436d5b296f', 'name': 'vda'}]}} (__init__:356) 2018-09-11 00:40:14,675-0400 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:312) 2018-09-11 00:40:16,118-0400 DEBUG (jsonrpc/7) [jsonrpc.JsonRpcServer] Calling 'Host.getAllVmStats' in bridge with {} (__init__:329) 2018-09-11 00:40:16,119-0400 INFO (jsonrpc/7) [api.host] START getAllVmStats() from=::ffff:192.168.201.4,49184 (api:47) 2018-09-11 00:40:16,121-0400 INFO (jsonrpc/7) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::ffff:192.168.201.4,49184 (api:53) 2018-09-11 00:40:16,122-0400 DEBUG (jsonrpc/7) [jsonrpc.JsonRpcServer] Return 'Host.getAllVmStats' in bridge with (suppressed) (__init__:356) 2018-09-11 00:40:16,122-0400 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:312) 2018-09-11 00:40:17,956-0400 DEBUG (qgapoller/2) [vds] Not sending QEMU-GA command 'guest-get-users' to vm_id='8214433a-f233-4aaa-aeda-2ce1d31c78dc', command is not supported (qemuguestagent:192) 2018-09-11 00:40:18,025-0400 DEBUG (periodic/3) [virt.periodic] Looking for stale paused VMs (periodic:388) I can also see this in Super vdsm which may be related but I an not 100% sure its related to current issue: MainProcess|jsonrpc/2::DEBUG::2018-09-11 00:33:20,012::cmdutils::159::root::(exec_cmd) SUCCESS: <err> = ''; <rc> = 0 ifup/on039d2d88d8ee4::DEBUG::2018-09-11 00:33:20,238::cmdutils::159::root::(exec_cmd) FAILED: <err> = 'Running scope as unit 2f1f417d-85b9-46c0-b7d7-6082836daaae.scope.\n/etc/sysconfig/network-scripts/ifup-eth: line 321: 20715 Terminated /sbin/dhclient ${DHCLIENTARGS} ${DEVICE}\nDevice "on039d2d88d8ee4" does not exist.\nCannot find device "on039d2d88d8ee4"\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d 8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevic e "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d 8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevic e "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d 8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevic e "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\n'; <rc> = 1 ifup/on039d2d88d8ee4::ERROR::2018-09-11 00:33:20,238::concurrent::202::root::(run) FINISH thread <Thread(ifup/on039d2d88d8ee4, stopped daemon 140281550731008)> failed Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/common/concurrent.py", line 195, in run ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/network/configurators/ifcfg.py", line 948, in _exec_ifup _exec_ifup_by_name(iface.name, cgroup) File "/usr/lib/python2.7/site-packages/vdsm/network/configurators/ifcfg.py", line 934, in _exec_ifup_by_name raise ConfigNetworkError(ERR_FAILED_IFUP, out[-1] if out else '') ConfigNetworkError: (29, '\n') thanks, Dafna

3 12

[ OST Failure Report ] [ oVirt Master (ovirt-engine) ] [ 11-09-2018 ] [ 002_bootstrap.add_cluster ]
by Dafna Ron 13 Sep '18

13 Sep '18

Hi, we have failures on both upgrade and basic suites for master. The patch reported as cause is: https://gerrit.ovirt.org/#/c/93345/10 - engine : Add finer grained monitoring thresholds for memory consumption on Hypervisors Ravi, can you please check this issue? You can see the logs here: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10187/artifa… Here is the error: 2018-09-11 02:08:44,511-04 WARN [org.ovirt.engine.core.bll.AddClusterCommand] (default task-2) [1362d97c-9d55-40d2-9b03-ebe93ae2fe67] Validation of action 'AddCluster' failed for user admin@internal-authz. Reasons: VAR__TYPE__CLUSTER,VAR __ACTION__CREATE,must be greater than or equal to 1,$groups [Ljava.lang.Class;@29a040fc,$message {javax.validation.constraints.Min.message},$payload [Ljava.lang.Class;@64094510,$value 1,ACTION_TYPE_FAILED_ATTRIBUTE_PATH,$path cluster.logM axMemoryUsedThreshold,$validatedValue 0 2018-09-11 02:08:44,511-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-2) [1362d97c-9d55-40d2-9b03-ebe93ae2fe67] method: runAction, params: [AddCluster, ManagementNetworkOnClusterOperationPara meters:{commandId='e5eb6cf6-4e3d-4f50-be6a-9fe18bfc4d97', user='null', commandType='Unknown'}], timeElapsed: 56ms 2018-09-11 02:08:44,516-04 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-2) [] Operation Failed: [must be greater than or equal to 1, Attribute: cluster.logMaxMemoryUsedThreshold] 2018-09-11 02:08:44,533-04 DEBUG [org.ovirt.engine.core.aaa.filters.SsoRestApiAuthFilter] (default task-2) [] Entered SsoRestApiAuthFilter Thanks, Dafna

3 12

Issue in host deploy
by Ravi Shankar Nori 12 Sep '18

12 Sep '18

Hi, Host deploy is failing on master with errors. The issue seems to be that the opcode that is returned from vdsm has Unicode null characters in it (obtained using a break point in VdsDeploy.userVisibleLog). "Failed to execute stage 'Initializing': Invalid response opcode '\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000CONFIRM'" Resulting in below errors when the message is inserted into database. Can someone take a look 2018-09-11 13:38:11,121-04 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [669a0081] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host 192.168.122.57. Stage: Initializing. 2018-09-11 13:38:39,231-04 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (VdsDeploy) [669a0081] transaction rolled back 2018-09-11 13:38:39,231-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [669a0081] Error during deploy dialog 2018-09-11 13:38:39,246-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-11) [669a0081] Error during host 192.168.122.57 install 2018-09-11 13:38:41,791-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-11) [669a0081] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host 192.168.122.57: CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00.

2 3

[ OST Failure Report ] [ oVirt Master (ovirt-ansible-manageiq) ] [ 11-09-2018 ] [ metrics_bootstrap.metrics_and_log_collector ]
by Dafna Ron 11 Sep '18

11 Sep '18

Hi, we have a failure in basic suite for test metrics_bootstrap.metrics_and_log_collector. We failed to configure the hosts for metrics collection which causes failure in the test. The change that is reported as cause of failure is: https://github.com/oVirt/ovirt-ansible-manageiq/commit/ 6697fc98f934beb9fece6d0224c0b013411b84e6 You can see the full logs here: https://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3078/artifact/b… error: PLAY RECAP ********************************************************************* lago-basic-suite-4-2-host-0 : ok=1 changed=0 unreachable=0 failed=1 lago-basic-suite-4-2-host-1 : ok=1 changed=0 unreachable=0 failed=1 localhost : ok=53 changed=24 unreachable=0 failed=0 2018-09-11 09:06:18,713::ssh.py::ssh::96::lago.ssh::DEBUG::Command d69e71be on lago-basic-suite-4-2-engine errors: [WARNING]: Could not match supplied host pattern, ignoring: metrics_store 2018-09-11 09:06:18,713::utils.py::_ret_via_queue::60::lago.utils::ERROR::Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue queue.put({'return': func()}) File "/home/jenkins/workspace/ovirt-4.2_change-queue-tester/ovirt-system-tests/basic-suite-4.2/test-scenarios/003_00_metrics_bootstrap.py", line 54, in configure_metrics ' Exit code is %s' % result.code File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in eq_ raise AssertionError(msg or "%r != %r" % (a, b)) AssertionError: Configuring ovirt machines for metrics failed. Exit code is 2 2018-09-11 09:06:38,897::ssh.py::ssh::81::lago.ssh::DEBUG::Command d648c70a on lago-basic-suite-4-2-engine returned with 0 2018-09-11 09:06:38,897::ssh.py::ssh::89::lago.ssh::DEBUG::Command d648c70a on lago-basic-suite-4-2-engine output: This command will collect system configuration and diagnostic information from this system.

2 1

failure in ost test - Invalid argument - help in debugging issue
by Dafna Ron 11 Sep '18

11 Sep '18

Hi, can someone please have a look at this ost failure? it is not related to the change that failed and I think its probably a race. you can find the logs here: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10175/artifa… The error I can see is this: https://pastebin.com/pm6x0W62 Thanks, Dafna

3 2

vdsm has been tagged (v4.20.39.1)
by Francesco Romani 07 Sep '18

07 Sep '18

Vdsm 4.20.39.1 for oVirt 4.2.6 (async) sub-branch ovirt-4.2.6 created -- Francesco Romani (@fromanirh)

1 0

[OST failure] Basic suite for 4.2 failing with "Error: Package: ovirt-imageio-daemon"
by Ales Musil 05 Sep '18

05 Sep '18

Hello, the OST CI is failing for patch [1] with: + yum -y install ovirt-host Error: Package: ovirt-imageio-daemon-1.4.2-0.201807122005.gitae0c56d.el7.noarch (alocalsync) Requires: ovirt-imageio-common = 1.4.2 Available: ovirt-imageio-common-1.4.2-0.201807122005.gitae0c56d.el7.noarch (alocalsync) ovirt-imageio-common = 1.4.2-0.201807122005.gitae0c56d.el7 Installing: ovirt-imageio-common-1.4.4-0.el7.x86_64 (alocalsync) ovirt-imageio-common = 1.4.4-0.el7 Full log [2]. Any idea what could be possibly wrong? As the patch shouldn't be related to imageio rpm. Thank you. Best regards, Ales Musil [1] https://gerrit.ovirt.org/c/93978/ [2] https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/1791/… -- ALES MUSIL Associate Software Engineer - rhv network Red Hat EMEA <https://www.redhat.com/> amusil(a)redhat.com IM: amusil <https://red.ht/sig>

3 4

Fwd: [rhev-devel] Error Message in HE master suite: "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM ....
by Ehud Yonasi 04 Sep '18

04 Sep '18

Hey, I see failures on hosted-engine and when i was looking at the build-artifacts jobs of he-setup: http://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_master_build-artifac… I can see a lot of triggering of old patches, so as far as i understand you restored that repository. Is the error below is the root cause of that recovery? Would appreciate a quick answer because we need to merge a patch to fix CQ failures because of that. Thanks in advance! Ehud Yonasi. ---------- Forwarded message --------- From: Yaniv Kaul <ykaul(a)redhat.com> Date: Tue, Sep 4, 2018 at 10:03 AM Subject: Re: [rhev-devel] Error Message in HE master suite: "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM .... To: Galit Rosenthal <grosenth(a)redhat.com> Cc: rhev-devel <rhev-devel(a)redhat.com> Well, looking at engine.log[1], there's NPE around: ERROR [org.ovirt.engine.core.vdsbroker.monitoring.FullListAdapter] (EE-ManagedThreadFactory-engineScheduled-Thread-74) [57b53db9] Failed during parsing configuration of VM b9c1bf34-c42f-4999-97d4-8d4895826abd (<domain type='kvm' id='1'> <name>HostedEngine</name> ... </domain> ), error is: {}: java.lang.NullPointerException at org.ovirt.engine.core.vdsbroker.libvirt.VmConverter.extractCoreGeneralInfo(VmConverter.java:47) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.libvirt.VmConverter.convert(VmConverter.java:36) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.monitoring.FullListAdapter.extractCoreInfo(FullListAdapter.java:86) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.monitoring.FullListAdapter.lambda$dumpXmls$0(FullListAdapter.java:54) [vdsbroker.jar:] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_181] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_181] Y. [1] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… On Tue, Sep 4, 2018 at 9:21 AM, Galit Rosenthal <grosenth(a)redhat.com> wrote: > > Hi, > > This is an example of a he basic suite master that fails on : > > Error Message: > > *00:26:36* Error while running thread > > *00:26:36* Traceback (most recent call last): > > *00:26:36* File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue > > *00:26:36* queue.put({'return': func()}) > > *00:26:36* File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4 > > *00:26:36* deploy_hosted_engine=True, > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11530, in add > > *00:26:36* return self._internal_add(host, headers, query, wait) > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add > > *00:26:36* return future.wait() if wait else future > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait > > *00:26:36* return self._code(response) > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback > > *00:26:36* self._check_fault(response) > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault > > *00:26:36* self._raise_error(response, body) > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error > > *00:26:36* raise error > > *00:26:36* Error: Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409. > > > > https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… > > Who can help me with this issue? > > Thanks, > Galit > > -- > > GALIT ROSENTHAL > > SOFTWARE ENGINEER > > Red Hat > > <https://www.redhat.com/> > > galit(a)gmail.com T: 972-9-7692230 > <https://red.ht/sig> >

2 6

Failing OST Suites
by Anton Marchukov 04 Sep '18

04 Sep '18

Hello All. This is a reminder to corresponding maintainers to check the OST suits [1], there are failing ones such as: ovirt-system-tests_ansible-suite-master ovirt-system-tests_compat-3.6-suite-master ovirt-system-tests_compat-4.0-suite-master ovirt-system-tests_compat-4.1-suite-master ovirt-system-tests_compat-4.2-suite-master ovirt-system-tests_hc-basic-suite-4.2 ovirt-system-tests_he-node-ng-suite-master If everything is not needed we might also consider disabling/deleting. Thanks. [1] https://jenkins.ovirt.org/view/oVirt%20system%20tests/

3 4

[ OST Failure Report ] [ oVirt master (ovirt-ansible-engine-setup) ] [ Aug 31 ] [ 001_upgrade_engine.test_initialize_engine ]
by Anton Marchukov 31 Aug '18

31 Aug '18

Hello All. We have a failure in OST master. The link to job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9255/ and to the output: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9255/testRepo… It seems like schema fails to apply during upgrade: File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/db/schema.py", line 437, in _misc raise RuntimeError(_('Engine schema refresh failed')) RuntimeError: Engine schema refresh failed I think the patch referred by the job is not the cause as ovirt-ansible-engine-setup has only release bumps recently as I see. I will reply here if I find a probably cause. -- Anton Marchukov Team Lead - Release Management - RHV DevOps - Red Hat

2 2