- Devel - oVirt List Archives

oVirt vdsm Bulk-API deep dive
by Nir Soffer 09 Jul '20

09 Jul '20

I want to share an interesting talk on the new StorageDomain dump API. When: Thursday, July 9⋅16:00 – 16:45 (Israel time) Where: https://redhat.bluejeans.com/212781836 Who: Amit Bawer StorageDomain dump API is a faster way to query oVirt storage domain contents, optimized for bulk operations such as collecting sos reports or importing storage domains during disaster recovery. In recent tests we found that it is 295 times faster compared with vdsm-tool dump-volume-chains: https://bugzilla.redhat.com/show_bug.cgi?id=1557147#c26 What can you do with this API? Query volumes metadata by disk id: # vdsm-client StorageDomain dump sd_id=56ecc03c-4bb5-4792-8971-3c51ea924d2e | jq '.volumes | .[] | select(.image=="d7ead22a-0fbf-475c-a62f-6f7bc8473acb")' { "apparentsize": 6442450944, "capacity": 6442450944, "ctime": 1593128884, "description": "{\"DiskAlias\":\"fedora-32.raw\",\"DiskDescription\":\"Uploaded disk\"}", "disktype": "DATA", "format": "RAW", "generation": 0, "image": "d7ead22a-0fbf-475c-a62f-6f7bc8473acb", "legality": "LEGAL", "parent": "00000000-0000-0000-0000-000000000000", "status": "OK", "truesize": 6442455040, "type": "PREALLOCATED", "voltype": "LEAF" } Find all templates: # vdsm-client StorageDomain dump sd_id=56ecc03c-4bb5-4792-8971-3c51ea924d2e | jq '.volumes | .[] | select(.voltype=="SHARED")' { "apparentsize": 6442450944, "capacity": 6442450944, "ctime": 1593116563, "description": "{\"DiskAlias\":\"fedora-32.raw\",\"DiskDescription\":\"Uploaded disk\"}", "disktype": "DATA", "format": "RAW", "generation": 0, "image": "9b62b5fa-920e-4d0c-baf6-40406106e48e", "legality": "LEGAL", "parent": "00000000-0000-0000-0000-000000000000", "status": "OK", "truesize": 6442516480, "type": "PREALLOCATED", "voltype": "SHARED" } Please join the talk if you want to learn more. Cheers, Nir

2 2

ovirt-engine has been tagged (ovirt-engine-4.3.11.2)
by Tal Nisan 09 Jul '20

09 Jul '20

1 0

Re: [oVirt Jenkins] ovirt-system-tests_he-basic-suite-master - Build # 1655 - Still Failing!
by Yedidyah Bar David 07 Jul '20

07 Jul '20

On Sun, Jun 28, 2020 at 6:23 AM <jenkins(a)jenkins.phx.ovirt.org> wrote: > > Project: https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/ > Build: https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/1655/ This fails for some time now. Checked last one ^^, and it failed in: https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/1655… 2020-06-27 23:05:02,253-0400 INFO ansible task start {'status': 'OK', 'ansible_type': 'task', 'ansible_playbook': '/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml', 'ansible_task': 'ovirt.hosted_engine_setup : Check OVF_STORE volume status'} 2020-06-27 23:05:02,253-0400 DEBUG ansible on_any args TASK: ovirt.hosted_engine_setup : Check OVF_STORE volume status kwargs is_conditional:False 2020-06-27 23:05:02,254-0400 DEBUG ansible on_any args localhostTASK: ovirt.hosted_engine_setup : Check OVF_STORE volume status kwargs 2020-06-27 23:05:03,816-0400 DEBUG ansible on_any args <ansible.executor.task_result.TaskResult object at 0x7f454e3d1eb8> kwargs ... 2020-06-27 23:09:39,166-0400 DEBUG var changed: host "localhost" var "ovf_store_status" type "<class 'dict'>" value: "{ "changed": true, "failed": true, "msg": "All items completed", "results": [ { "ansible_loop_var": "item", "attempts": 12, Meaning, it ran 12 times the command: vdsm-client Volume getInfo storagepoolID=41c9fdea-b8e9-11ea-ae2a-5452c0a8c863 storagedomainID=10a69775-8fb6-437d-9e78-2ecfd77c0a45 imageID=c2ad2065-1c8b-4ec1-afdd-f7cefc708cf9 volumeID=6b835f55-a512-4f83-9d25-f6837d8b5cb1 and never got a result with output including "Updated". Any idea? Perhaps it's just a bug in the test, and we should test something else other than "Updated"? Or perhaps there was some other problem but I failed to find it? Thanks, > Build Number: 1655 > Build Status: Still Failing > Triggered By: Started by timer > > ------------------------------------- > Changes Since Last Success: > ------------------------------------- > Changes for Build #1643 > [Galit] Add missing repo which has collectd-write_syslog > > [Sandro Bonazzola] Revert "ovirt-release: run only on fc29 nodes" > > > Changes for Build #1644 > [Michal Skrivanek] make GLANCE failures fatal > > > Changes for Build #1645 > [Michal Skrivanek] use // in glance URL > > > Changes for Build #1646 > [Galit] Fix: No module named ost_utils.memoized > > > Changes for Build #1647 > [Martin Necas] ansible: fix deploy scripts to el8 > > [arachmani] Add arachman(a)redhat.com to jenkins recipient lists > > > Changes for Build #1648 > [Martin Necas] ansible: fix deploy scripts to el8 > > [Evgheni Dereveanchin] Do not run jenkins check-patch job on fc29 > > > Changes for Build #1649 > [Martin Necas] ansible: fix deploy scripts to el8 > > > Changes for Build #1650 > [Martin Necas] ansible: fix deploy scripts to el8 > > > Changes for Build #1651 > [Galit] Add centos8.2 official to templates > > > Changes for Build #1652 > [Evgeny Slutsky] he-basic-suite-master: Add Domain_name to the host when vm_run > > [Gal Ben Haim] Add gcc to fcraw > > [Sandro Bonazzola] pipelines: add ovirt-dependencies > > > Changes for Build #1653 > [Evgeny Slutsky] he-basic-suite-master: Add Domain_name to the host when vm_run > > > Changes for Build #1654 > [Galit] Add centos 8.2 image: el8.2-base > > [Evgheni Dereveanchin] do not expand values in run_oc_playbook > > > Changes for Build #1655 > [Galit] Add centos 8.2 image: el8.2-base > > > > > ----------------- > Failed Tests: > ----------------- > No tests ran. -- Didi

3 5

sic transit gloria mundi
by Dan Kenigsberg 06 Jul '20

06 Jul '20

Seven years ago, in June 2013, Giuseppe Valarelli introduced tests/functional/networkTests.py in https://gerrit.ovirt.org/#/c/14840/. It held high aspirations: to provide a comprehensive functional test for Vdsm's network API, in order to ease development of new code and reduce chances of reintroducing old bugs. 390 commits later, Andrej Cernak removed the last lines of code from that file in https://gerrit.ovirt.org/#/c/109182/. In between, many many other developers contributed to the set of tests, and later dissipated its content to multiple pytest-driven test modules. tests/functional/networkTests.py was never an emblem of great software design; it makes me happy to see it gone. But it was very useful and its spirit lives on: API tests are now the rule of Vdsm development, not an exception. I'd like to thank all the people who made this possible. $ git log 1c5f15c9b~ -- tests/functional/networkTests.py|grep Author|sort|uniq -c|sort -nr 72 Author: Edward Haas <edwardh(a)redhat.com> 58 Author: Ido Barkan <ibarkan(a)redhat.com> 46 Author: Ondřej Svoboda <osvoboda(a)redhat.com> 40 Author: Petr Horáček <phoracek(a)redhat.com> 35 Author: Dan Kenigsberg <danken(a)redhat.com> 34 Author: Antoni S. Puimedon <asegurap(a)redhat.com> 24 Author: Bell Levin <blevin(a)redhat.com> 23 Author: Leon Goldberg <lgoldber(a)redhat.com> 18 Author: Giuseppe Vallarelli <gvallare(a)redhat.com> 8 Author: Assaf Muller <amuller(a)redhat.com> 5 Author: Sveta Haas <sveta.haas(a)gmail.com> 4 Author: Mark Wu <wudxw(a)linux.vnet.ibm.com> 3 Author: Nir Soffer <nsoffer(a)redhat.com> 2 Author: Yaniv Bronhaim <ybronhei(a)redhat.com> 2 Author: Sagi Shnaidman <sshnaidm(a)redhat.com> 2 Author: Petr Sebek <psebek(a)redhat.com> 2 Author: Miguel Angel Ajo <miguelangel(a)ajo.es> 2 Author: Andrej Cernek <acernek(a)redhat.com> 1 Author: Viliam Serecun <v.serecun(a)gmail.com> 1 Author: Vered Volansky <vvolansk(a)redhat.com> 1 Author: Timothy Asir Jeyasingh <tjeyasin(a)redhat.com> 1 Author: shlad <a.shlado(a)gmail.com> 1 Author: pkliczewski <piotr.kliczewski(a)gmail.com> 1 Author: Petr Benas <pbenas(a)redhat.com> 1 Author: Marcin Sobczyk <msobczyk(a)redhat.com> 1 Author: Marcin Mirecki <mmirecki(a)redhat.com> 1 Author: Ilia Meerovich <iliam(a)redhat.com> 1 Author: Genadi Chereshnya <gcheresh(a)redhat.com> 1 Author: Dominik Holler <dholler(a)redhat.com>

2 1

ovirt-engine has been tagged (ovirt-engine-4.4.1.7)
by Sandro Bonazzola 03 Jul '20

03 Jul '20

1 0

Backup: how to download only used extents from imageio backend
by Michael Ablassmeier 02 Jul '20

02 Jul '20

hi, im currently looking at the new incremental backup api that has been part of the 4.4 and RHV 4.4-beta release. So far i was able to create full/incremental backups and restore without any problem. Now, using the backup_vm.py example from the ovirt-engine-sdk i get the following is happening during a full backup: 1) imageio client api requests transfer 2) starts qemu-img to create a local qemu image with same size 3) starts qemu-nbd to serve this image 4) reads used extents from provided imageio source, passes data to qemu-nbd process 5) resulting file is a thin provisioned qcow image with the actual data of the VM's used space. while this works great, it has one downside: if i backup a virtual machine with lots of used extents, or multiple virtual machines at the same time, i may run out of space, if my primary backup target is not a regular disk. Imagine i want to stream the FULL backup to tape directly like backup_vm.py full [..] <vm_uuid> /dev/nst0 thats currently not possible, because qemu-img is not able to open a tape device directly, given its nature of the qcow2 format. So what iam basically looking for, is a way to download only the extents from the imageio server that are really in use, not depending on qemu-* tools, to be able to pipe the data somehwere else. Standard tools, like for example curl, will allways download the full provisioned image from the imageio backend (of course). I noticed is that it is possible to query the extents via: https://tranfer_node:54322/images/d471c659-889f-4e7f-b55a-a475649c48a6/exte… As i failed to find them, are there any existing functions/api calls that could be used to download only the used extents to a file/fifo pipe? So far, i played around with the _internal.io.copy function, beeing able to at least read the data into a in memory BytesIO stream, but thats not the solution to my "problem" :) bye, - michael

3 7

ovirt-engine has been tagged (ovirt-engine-4.4.1.6)
by Tal Nisan 02 Jul '20

02 Jul '20

1 0

Issue while installing ovirt-imageio-daemon
by Sandro Bonazzola 02 Jul '20

02 Jul '20

Hi, just noticed in appliance build at https://jenkins.ovirt.org/job/ovirt-appliance_standard-check-patch/286/cons… 15:18:22,373 INFO anaconda:program: Installing : ovirt-imageio-daemon-2.0.9-1.el8.x86_64 90/223 <https://jenkins.ovirt.org/job/ovirt-appliance_standard-check-patch/286/cons…> 15:18:22,373 INFO anaconda:program: warning: group Development/Debug does not exist - using root <https://jenkins.ovirt.org/job/ovirt-appliance_standard-check-patch/286/cons…> 15:18:22,373 INFO anaconda:program: <https://jenkins.ovirt.org/job/ovirt-appliance_standard-check-patch/286/cons…> 15:18:22,374 INFO anaconda:program: Running scriptlet: ovirt-imageio-daemon-2.0.9-1.el8.x86_64 90/223 Sounds like a bug in the spec file. -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. <https://mojo.redhat.com/docs/DOC-1199578>*

3 3

Re: [ovirt-users] Re: ETL service aggregation error
by Shirly Radco 02 Jul '20

02 Jul '20

Hi, I was unable to view your log file. But if its indeed an the issue please run: systemctl stop ovirt-engine-dwhd ovirt_engine_history=# UPDATE history_configuration set var_datetime = date_trunc('hour', now())- interval '2 hour' WHERE var_name = 'lastHourAggr'; ovirt_engine_history=# UPDATE history_configuration set var_datetime = date_trunc('hour', now())- interval '1 day' WHERE var_name = 'lastDayAggr'; systemctl restart ovirt-engine-dwhd If you would like me to review the errors please attach the dwh log file. Best regards, -- Shirly Radco BI Principal Software Engineer Red Hat <https://www.redhat.com/> <https://www.redhat.com/> On Fri, Jun 26, 2020 at 10:28 PM Staniforth, Paul < P.Staniforth(a)leedsbeckett.ac.uk> wrote: > Hello Ayansh, > It looks like the lastHourAgg is wrong is should > be 2 hours before the runTime but is 1:30 hours before runtime. > > Try > > systemctl stop ovirt-engine-dwhd > > in ovirt_engine_history database > > UPDATE history_configuration set var_datetime = var_datetime - interval '24 hour' WHERE var_name = 'lastHourAggr'; > > UPDATE history_configuration set var_datetime = var_datetime - interval '1 day' WHERE var_name = 'lastDayAggr'; > > systemctl stop ovirt-engine-dwhd > > > see https://www.mail-archive.com/users@ovirt.org/msg53055.html > > > Regards, > > Paul Staniforth > > School of Built Environment Engineering and Computing. > > Leeds Beckett University > > Networked Systems Analyst, Research and Engineering Support. > Technical Lead Architect IMS and oVirt Virtualization > > tel: +44 (0)113 28123754 > email: p.staniforth(a)leedsbeckett.ac.uk > > <https://www.gofundme.com/f/bytes-for-heroes> > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 26 June 2020 17:10 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < > users(a)ovirt.org>; devel(a)ovirt.org <devel(a)ovirt.org> > *Subject:* Re: [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Can we fix this any how guys. > > On Thu, Jun 25, 2020 at 5:53 PM Ayansh Rocks <shashank123rastogi(a)gmail.com> > wrote: > > Is it a bug ? > > > On Thu, Jun 25, 2020 at 4:11 PM Ayansh Rocks <shashank123rastogi(a)gmail.com> > wrote: > > See below as well if it helps - > > [root@iondelvm149 ~]# date > Thu Jun 25 16:09:45 IST 2020 > [root@iondelvm149 ~]# psql -h localhost -U ovirt_engine_history -d > ovirt_engine_history > Password for user ovirt_engine_history: > psql (9.2.24, server 10.6) > WARNING: psql version 9.2, server version 10.0. > Some psql features might not work. > Type "help" for help. > > ovirt_engine_history=> select * from history_configuration; > var_name | var_value | var_datetime > -------------------+-----------+------------------------ > default_language | en_US | > firstSync | false | 2018-03-23 12:27:00-04 > lastHourAggr | | 2020-06-25 05:00:00-04 > HourlyAggFailed | false | > lastDayAggr | | 2020-06-24 01:00:00-04 > MinimalETLVersion | 4.3.0 | > (6 rows) > > ovirt_engine_history=> > > On Thu, Jun 25, 2020 at 4:06 PM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > > Hello Shashank, > is it on the hour? it sounds like it got a > problem aggregating the samples to create the hourly samples. > > I had to update the java memory usage as it was running out of heap memory. > > The defaults are > > DWH_HEAP_MIN=1g > DWH_HEAP_MAX=1g > > see > > /usr/share/ovirt-engine-dwh/services/ovirt-engine-dwhd/ovirt-engine-dwhd.conf > > for settings. > > Regards, > Paul S. > > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 25 June 2020 10:40 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < > users(a)ovirt.org> > *Subject:* Re: [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Hi Paul, > > Yes i am able to connect to the database from ovirt engine machine. > > port is already open. what could be issue, i am getting this error in > every hour. > > Thanks > > On Wed, Jun 24, 2020 at 6:30 PM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > > Hello Shashank, > it looks like it's had a problem for over 2 > years, is the Data Warehouse database local or remote? is there a firewall > port open? > > Can you connect to the database from the engine machine? > > The credentials should be in > /etc/ovirt-engine-dwh/ovirt-engine-dwhd.conf.d/10-setup-database.conf > > as your using 4.3 the version of postgresql is 10 and using scl > > scl enable rh-postgresql10 "psql -h localhost -U ovirt_engine_history > -d ovirt_engine_history" > > if it's using the standard user, database and is local. > > > Regards, > Paul S. > . > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 24 June 2020 12:47 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < > users(a)ovirt.org> > *Subject:* Re: [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Please find the attached error logs. > > On Thu, Jun 4, 2020 at 8:17 PM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > > Hello Shashank, > I can't see any of your images and also it > would be better to have the log file as text. > > Regards, > Paul S. > > > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 04 June 2020 15:16 > *To:* users <users(a)ovirt.org> > *Subject:* [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Any update on this ? > > On Tue, May 26, 2020 at 1:41 PM Ayansh Rocks <shashank123rastogi(a)gmail.com> > wrote: > > Hi, > > I am using 4.3.7 self hosted engine. From Few days i am getting regular > below error messages :- > [image: image.png] > > Logs in /var/log/ovirt-engine-dwh/ovirt-engine-dwhd.log > [image: image.png] > > What could be the reason for this? > > Thanks > Shashank > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/BCU7ZTSVHZR7P… >

1 0

VM rebooted during OST test_hotplug_cpu
by Yedidyah Bar David 01 Jul '20

01 Jul '20

Hi all, I am trying to verify fixes for ovirt-engine-rename, specifically for OVN. Engine top patch is [1], OST patch [2]. Ran the manual job on these [3]. In previous patches, OST failed in earlier tests. Now, it passed these tests, so I hope that my patches are enough for what I am trying to do. However, [3] did fail later, during test_hotplug_cpu - it set the number of CPUs, then tried to connect to the VM, and timed out. The logs imply that right after it changed the number of CPUs, the VM was rebooted, apparently by libvirtd. Relevant log snippets: vdsm [4]: 2020-06-29 10:21:10,889-0400 DEBUG (jsonrpc/1) [virt.vm] (vmId='7474280d-4501-4355-9425-63898757682b') Setting number of cpus to : 2 (vm:3089) 2020-06-29 10:21:10,952-0400 INFO (jsonrpc/1) [api.virt] FINISH setNumberOfCpus return={'status': {'code': 0, 'message': 'Done'}, 'vmList': {}} from=::ffff:192.168.201.4,54576, flow_id=7f9503ed, vmId=7474280d-4501-4355-9425-63898757682b (api:54) 2020-06-29 10:21:11,111-0400 DEBUG (periodic/0) [virt.sampling.VMBulkstatsMonitor] sampled timestamp 2925.602824355 elapsed 0.160 acquired True domains all (sampling:451) 2020-06-29 10:21:11,430-0400 DEBUG (jsonrpc/1) [jsonrpc.JsonRpcServer] Return 'VM.setNumberOfCpus' in bridge with {} (__init__:356) 2020-06-29 10:21:11,432-0400 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call VM.setNumberOfCpus succeeded in 0.56 seconds (__init__:312) 2020-06-29 10:21:12,228-0400 INFO (libvirt/events) [virt.vm] (vmId='7474280d-4501-4355-9425-63898757682b') reboot event (vm:1033) qemu [5]: 2020-06-29T14:21:12.260303Z qemu-kvm: terminating on signal 15 from pid 42224 (<unknown process>) 2020-06-29 14:21:12.462+0000: shutting down, reason=destroyed libvirtd [6] itself does not log anything relevant AFAICT, but at least it shows that the above unknown process is itself: 2020-06-29 14:18:16.212+0000: 42224: error : qemuMonitorIO:620 : internal error: End of file from qemu monitor (Note that above line is from 3 minutes before the reboot, and the only place in the log with '42224'. No other log there has 42224, other than these and audit.log). Any idea? Is this a bug in libvirt? vdsm? I'd at least expect something in the log for such a severe step. [1] https://gerrit.ovirt.org/109961 [2] https://gerrit.ovirt.org/109734 [3] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… [4] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… [5] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… [6] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… -- Didi

4 6