March 2014 - Devel - oVirt List Archives

[Engine-devel] Asynchronous tasks for live merge
by Adam Litke 03 Mar '14

03 Mar '14

Hi all, As part of our plan to support live merging of VM disk snapshots it seems we will need a new form of asynchronous task in ovirt-engine. I am aware of AsyncTaskManager but it seems to be limited to managing SPM tasks. For live merge, we are going to need something called VmTasks since the async command can be run only on the host that currently runs the VM. The way I see this working from an engine perspective is: 1. RemoveSnapshotCommand in bll is invoked as usual but since the VM is found to be up, we activate an alternative live merge flow. 2. We submit a LiveMerge VDS Command for each impacted disk. This is an asynchronous command which we need to monitor for completion. 3. A VmJob is inserted into the DB so we'll remember to handle it. 4. The VDS Broker monitors the operation via an extension to the already collected VmStatistics data. Vdsm will report active Block Jobs only. Once the job stops (in error or success) it will cease to be reported by vdsm and engine will know to proceed. 5. When the job has completed, VDS Broker raises an event up to bll. Maybe this could be done via VmJobDAO on the stored VmJob? 6. Bll receives the event and issues a series of VDS commands to complete the operation: a) Verify the new image chain matches our expectations (the snap is no longer present in the chain). b) Delete the snapshot volume c) Remove the VmJob from the DB Could you guys review this proposed flow for sanity? The main conceptual gaps I am left with concern #5 and #6. What is the appropriate way for VDSBroker to communicate with BLL? Is there an event mechanism I can explore or should I use the database? I am leaning toward the database because it is persistent and will ensure #6 gets completed even if engine is restarted somewhere in the middle. For #6, is there an existing polling / event loop in bll that I can plug into? Thanks in advance for taking the time to think about this flow and for providing your insights! -- Adam Litke

3 6

[Engine-devel] Install rhevm-guest-agent on SLES guest
by Vikas Kokare 03 Mar '14

03 Mar '14

We want to install the rhevm-guest-agent package on a virtual machine with Suse Linux as the guest OS. The RHEVM 3.2 documentation provides install instructions for RHEL and Windows guests but not for Suse Linux. This agent is important to monitor virtual resources on guest machines, hence the need. How can this be done?

4 3

[Engine-devel] oVirt 3.4.0 branch creation
by Sandro Bonazzola 03 Mar '14

03 Mar '14

Hi, we're going to create ovirt-engine-3.4.0 branch tomorrow morning 09:00 UTC. oVirt 3.4.1 development will continue on ovirt-engine-3.4 branch. Critical fixes for oVirt 3.4.0 GA will need to be pushed to 3.4.0 branch too starting tomorrow morning 09:00 UTC. Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

[Engine-devel] oVirt February 2014 Updates
by Itamar Heim 03 Mar '14

03 Mar '14

1. Releases - oVirt 3.3.3 was released early in the month: http://www.ovirt.org/OVirt_3.3.3_release_notes - oVirt 3.3.4 about to release. http://www.ovirt.org/OVirt_3.3.4_release_notes - oVirt 3.4.0 about to release! 2. Events - Leonardo Vaz is organizing ovirt attendance at FISL15, the largest FOSS conference in LATAM which will happen from 7th to 10th of May in Porto Alegre, Brazil: http://softwarelivre.org/fisl15 - Allon Mureinik gave a presentation on DR with oVirt at devconf.cz http://www.slideshare.net/AllonMureinik/dev-conf-ovirt-dr - oVirt workshop in korea slides (korean) http://www.slideshare.net/rogan/20140208-ovirtkorea-01 https://www.facebook.com/groups/ovirt.korea - Rogan also presented oVirt integration with OpenStack in OpenStack day in Korea http://alturl.com/m3jnx - Pat Pierson posted on basic network setup http://izen.ghostpeppersrus.com/setting-up-networks/ - Fosdem 2014 sessions (slides and videos) are at: http://www.ovirt.org/FOSDEM_2014 - and some at Infrastructure.Next Ghent the week after forsdem. 3. oVirt Activity (software) - oVirt Jenkins plugin by Dustin Kut Moy Cheung to control VM slaves managed by ovirt/RHEV https://github.com/thescouser89/ovirt-slaves-plugin - Opaque oVirt/RHEV/Proxmox client and source code released https://play.google.com/store/apps/details?id=com.undatech.opaque - great to see the NUMA push from HP: http://www.ovirt.org/Features/NUMA_and_Virtual_NUMA http://www.ovirt.org/Features/Detailed_NUMA_and_Virtual_NUMA 4. oVirt Activity (blogs, preso's) - oVirt's has been accepted as a mentoring project for the Google Summer of Code 2014. - Oved Ourfali posted on "Importing Glance images as oVirt templates" http://alturl.com/h7xid - v2v had seen many active discussions. here's a post by Jon Archer on how to Import regular kvm image to oVirt or RHEV http://jonarcher.info/2014/02/import-regular-kvm-image-ovirt-rhev/ - great reviews on amazon.com for "Getting Started with oVirt 3.3" http://alturl.com/5rk2p - oVirt Deep Dive 3.3 slides (Chinese) http://www.slideshare.net/mobile/johnwoolee/ovirt-deep-dive# - oVirt intro video (russian) http://alturl.com/it546 - how to install oVirt 3.3 on CentOS 6.5 http://www.youtube.com/watch?v=5i5ilSKsmbo 5. Related - NetApp GA'd their Virtual Storage Console for RHEV, which is implemented as an oVirt UI plugin (and then some) http://captainkvm.com/2014/02/vsc-for-rhev-is-ga-today/#more-660

1 0

[Engine-devel] Usage of Dynamic Queries
by Liran Zelkha 03 Mar '14

03 Mar '14

Hi All, As part of an ongoing effort to improve oVirt performance, we're trying to reduce the number of Dynamic Queries usage in the code, and replace it with Postgres stored procedures. You wouldn't believe the performance gain. Please consider before making use of the Dynamic Queries feature - it should ONLY be used for places where users can enter search queries - and not for any other usage. Thanks. Liran

1 0

[Engine-devel] ReST API docs
by Vikas Kokare 02 Mar '14

02 Mar '14

Only https://access.redhat.com/site/documentation/en-US/Red_Hat_Enterprise_Virtu… the ReST API document available, and not corresponding versions for 3.1, 3.2 and 3.3. I see differences in 3.0 ReST data structure and what is returned back from RHEVM 3.2 installation. Please point to the REST API Guide for RHEVM 3.2.

2 1

[Engine-devel] [ATN] ovirt-engine dbscritps cleanup (master)
by Alon Bar-Lev 02 Mar '14

02 Mar '14

Hello All, The dbscripts of ovirt-engine master were cleaned up, to match other scripts in tree. Developer visible changes are: 1. Removal of create_schema.sh, upgrade.sh, cleandb.sh, refreshStoredProcedures.sh in favour of single schema.sh script, note the -c parameter. Usage: ./schema.sh [options] -h - This help text. -v - Turn on verbosity (WARNING: lots of output) -l LOGFILE - The logfile for capturing output (def. ) -s HOST - The database servername for the database (def. localhost) -p PORT - The database port for the database (def. 5432) -u USER - The username for the database (def. engine) -d DATABASE - The database name (def. engine) -m MD5FILE - Where to store schema MD5 files (def. ) -c COMMAND - Command: apply|refresh|drop -t - Force cleaning tasks and compensation info. 2. Introduction of schema-dev.sh as a wrapper to schema.sh with defaults as a utility for developers. - always enable md5. - always enable logging. - apply command as default. 3. Shell upgrade script is not receives entire settings via DBFUNC_* environment variables. Regards, Alon Bar-Lev

2 1

[Engine-devel] hosted-engine rebooting in the middle of setup (was: [vdsm] [Users] [ANN] oVirt 3.4.0 Release Candidate is now available)
by Yedidyah Bar David 02 Mar '14

02 Mar '14

----- Original Message ----- > From: "Darrell Budic" <darrell.budic(a)zenfire.com> > To: "Sandro Bonazzola" <sbonazzo(a)redhat.com> > Cc: announce(a)ovirt.org, "engine-devel" <engine-devel(a)ovirt.org>, "arch" <arch(a)ovirt.org>, Users(a)ovirt.org, "VDSM > Project Development" <vdsm-devel(a)lists.fedorahosted.org> > Sent: Saturday, March 1, 2014 1:56:23 AM > Subject: Re: [vdsm] [Users] [ANN] oVirt 3.4.0 Release Candidate is now available > > Started testing this on two self-hosted clusters, with mixed results. There > were updates from 3.4.0 beta 3. > > On both, got informed the system was going to reboot in 2 minutes while it > was still installing yum updates. > > On the faster system, the whole update process finished before the 2 minutes > were up, the VM restarted, and all appears normal. > > On the other, slower cluster, the 2 minutes hit while the yum updates were > still being installed, and the system rebooted. It continued rebooting every > 3 minutes or so, and the engine console web pages are not available because > the engine doesn’t start. it did this at least 3 times before I went ahead > and reran engine-setup, which completed successfully. The system stopped > restarting and the web interface was available again. A quick perusal of > system logs and engine-setup logs didn’t reveal what requested the reboot. > > That was rather impolite of something to do that without warning :) At least > it was recoverable. Seems like scheduling the reboot while the yum updates > were still running seems like a poor idea as well. Can you please post relevant logs? hosts: /var/log/ovirt-hosted-engine-setup/*, /var/log/ovirt-hosted-engine-ha/*, /var/log/vdsm/* engine: /var/log/ovirt-engine/setup/*, /var/log/ovirt-engine/* You can of course open a bug on bugzilla and attach there logs if you want. Thanks, and thanks for the report! -- Didi

1 0