- Devel - oVirt List Archives

[Engine-devel] [ANN] New development environment for ovirt-engine
by Alon Bar-Lev 15 May '13

15 May '13

Hello all ovirt-engine developers, When I first joined the ovirt project, it took me about two weeks to setup a development environment, I needed to work on a bug related to host-deploy so I needed an environment that could use the ssh, PKI, vdsm-bootstrap and communicate with vdsm using SSL, this was virtually impossible to do so without tweaking the product in a way that it is so different from production use, that I cannot guarantee that whatever tested in development will actually work in production. I peeked at the installation script in a hope that I can create partial environment similar to production, but I found that the packaging implementation makes to much assumption and is very difficult to adopt. The fact that I do not use fedora/rhel for my development made it even worse. I had no other option than to create rpms after each of my changes and test each in real production like setup. It was obvious to me that the manual customization of developers to achieve working product will eventually break as product grow and move away from being developer friendly to production friendly. For example, product defaults cannot be these which serve developers, but these which serve production the best, or having a valid PKI setup cannot be optional any more as components do need to use it. Same for location of files and configuration, for example, if we write a pluggable infrastructure for branding, we cannot damage the interface just because developers runs the product in their own manual customization. I took the opportunity handed to me to port the ovirt-engine to other distributions in order to provide a development environment that is similar to production setup. Together with Sandro Bonazzola and Alex Lourie we re-wrote the whole installation of the product which can also be used to setup the desired development environment. Within this environment the product is set up using the same tools and configuration as in production, while the process does not require special privileges nor changes the state of the developer machine. A complete documentation is available[1], I preferred to use README within the source tree as wiki tend to quickly become obsolete, while documentation within source tree can be modified by the commit that introduces a change. I will redirect to this file from the current wiki once the site will be up. In a nut shell, after installing prerequisites, build and install the product using: $ make clean install-dev PREFIX=$HOME/ovirt-engine This will run maven and create product installation at $HOME/ovirt-engine Next, a setup phase is required just like in production, to initialize configuration and database: $ $HOME/ovirt-engine/bin/engine-setup-2 You have now fully functional product, including PKI, SSL, host-deploy, tools. No manual database updates are required, no lose of functionality. All that is left is to start the engine service: $ $HOME/ovirt-engine/share/ovirt-engine/services/ovirt-engine.py start Access to application: http://localhost:8080 https://localhost:8443 Debugging port is opened at port 8787. Farther information exists in the documentation[1]. There are several inherit benefits of the new environment, the major one is the ability to manage several environments in parallel on the same host. For example, if we develop two separate features on two branches we can install the product into $HOME/ovirt-engine-feature1 and $HOME/ovirt-engine-feature-2 and have a separate database for each, if we modify the ports jboss is listening to we can run two instances of engine at the same time! We will be happy to work with all developers to assist in porting into the new development environment, the simplest is to create a new database for this effort. Moti has a sequence of converting the existing database owned by postgres to be owned by the engine, Moti, can you please share that? We are sure there are missing bits, we will be happy to know these so we can improve. I am aware that developers (especially java) are conservative, but I ask you to give us a chance, so that we make it easy for developers to join the project, and to allow us to drop the parallel effort of packaging to production and fixing the broken development environment. A special thanks to developers who took the time to test and provide feedback before the merged: - Yaniv Bronheim - Moti Asayag - Limor Gavish - Sharad Mishra - Ofer Schreiber We are hoping that after migration you will be find this environment useful and friendly, Sandro Bonazzola, Alex Lourie, Alon Bar-Lev. [1] http://gerrit.ovirt.org/gitweb?p=ovirt-engine.git;a=blob;f=README.developer…

7 13

[Engine-devel] Engine config and device custom properties
by Martin Perina 15 May '13

15 May '13

Hi, I'm working on a patch to support custom device properties in ovirt-engine. I would like that custom device properties format can be set using engine-config command in a similar way as UserDefinedVMProperties. What is needed to be done to support this? Thanks Martin

3 2

[Engine-devel] UI Plugins: issue with REST API keep-alive heartbeat fixed
by Vojtech Szocs 14 May '13

14 May '13

Hi guys, just a quick update, recently we fixed an issue [1] with UI Plugin REST API integration trying to keep-alive the current REST API session, which was causing repeated "User logged in" events in GUI, along with new REST API session created each time the heartbeat request was fired. Please refer to commit message for more details on this issue. There are some things to be aware of with regard to UI Plugin REST API integration: - all plugins still receive a single session ID based on WebAdmin user credentials, i.e. keep the current "single-admin-session-for-all-plugins" behavior - session timeout is set to 6 hours --> 2x more than default REST API session timeout - WebAdmin will *not* try to keep-alive the session via periodic heartbeat requests, i.e. break the current "keep-session-alive-while-user-stays-authenticated" behavior In practice, this means that after a user logs into WebAdmin, if no plugin interacts with the REST API session via provided ID for more than 6 hours, the session will time-out eventually. Unfortunately, for now, we can't support the session keep-alive mechanism due to issues with HTTP 'Authorization' header handling in web browsers, but with RFE [2] it would be possible to re-implement the session keep-alive mechanism. On the other hand, we'll most likely revisit the current "single-admin-session-for-all-plugins" behavior in future, i.e. have special Engine users created for use with UI Plugin REST API integration, with permissions of such users under control by the admin. This would change the current behavior to something like "separate-user-session-for-each-plugin", with individual plugins able to create their own REST API session on demand. Regards, Vojtech [1] http://gerrit.ovirt.org/#/c/14411/

2 2

[Engine-devel] What type of DB inheritance to use?
by Mike Kolesnik 14 May '13

14 May '13

------=_Part_165720_1428728257.1368351734157 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi All, I would like to have your opinions on which inheritance type to use in the DB. We are adding an "external provider" entity to the system which will be able to provide various resources (networks, hosts, etc). These providers will be distinguishable by "type". The basic definition of a provider contains: * name * description * url * type Some providers might need additional properties such as: * user * password In Java this is easily represented by inheritance. In the DB however, there are 3 approaches that we can take: 1. No inheritance. This means that each type will wit in his own table, with no relation or re-use. 2. Single table inheritance. All types sit in a single table, and each has his corresponding columns. 3. Multiple table inheritance. Each type sists in his own table, where the PK is FK for the most basic table (providers). Pros for each approach: 1. None that I can think of. 2. No joins: Better performance Easier for developer to see the DB info Facilitate column reuse 3. Constraints can be set on each column Cons for each approach: 1. No reuse of DB entities + no compliance for column types Most cumbersome to query all providers 2. Can't put some constraints on non-base columns (esp. not null) 3. Joins are needed - opposite of the pros of 2. >From personal experience, I find #2 to be better and easier to work with & maintain. What are your thoughts? Regards, Mike ------=_Part_165720_1428728257.1368351734157 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><div>Hi All,<br></div><div><br></div>= <div>I would like to have your opinions on which inheritance type to use in= the DB.<br></div><div>We are adding an "external provider" entity to the s= ystem which will be able to provide various resources (networks, hosts, etc= ).<br></div><div><br></div><div>These providers will be distinguishable by = "type".<br></div><div>The basic definition of a provider contains:</div><di= v><ul><li> name</li><li>description</li><li>url</li><li>type</li></ul><div>= Some providers might need additional properties such as:<br></div><div><ul>= <li>user<br></li><li>password<br></li></ul><div>In Java this is easily repr= esented by inheritance.<br></div><div><br></div><div>In the DB however, the= re are 3 approaches that we can take:<br></div><div><ol><li>No inheritance.= <br>This means that each type will wit in his own table, with no relation o= r re-use.<br></li><li>Single table inheritance.<br>All types sit in a singl= e table, and each has his corresponding columns.<br></li><li>Multiple table= inheritance.<br>Each type sists in his own table, where the PK is FK for t= he most basic table (providers).<br></li></ol><div><br></div><div>Pros for = each approach:<br></div><div><ol><li>None that I can think of.<br></li><li>= No joins:<br>    Better performance<br>  &nbs= p; Easier for developer to see the DB info<br>    = Facilitate column reuse<br></li><li>Constraints can be set on each column<b= r></li></ol></div></div></div></div><div>Cons for each approach:<br></div><= div><ol><li>No reuse of DB entities + no compliance for column types<br>Mos= t cumbersome to query all providers<br></li><li>Can't put some constraints = on non-base columns (esp. not null)<br></li><li>Joins are needed - opposite= of the pros of 2.<br></li></ol><div>From personal experience, I find #2 to= be better and easier to work with & maintain.<br></div><div><br></div>= <div>What are your thoughts?<br></div></div><div><br></div><div><span name= =3D"x"></span>Regards,<br>Mike<span name=3D"x"></span><br></div><div><br></= div></div></body></html> ------=_Part_165720_1428728257.1368351734157--

8 22

[Engine-devel] 答复: Engine-devel Digest, Vol 20, Issue 39
by wlbleaboy＠126 14 May '13

14 May '13

Re: ovirt-engine-sdk with C (Jarod. w) Yes, you understanded my idea, I want to use c to invoke ovirt engine RestAPI directly, I'll try it(libcurl), but is there any exist example in ovirt-engine project. I just want to connect to ovirt-engine and get vms info, console vm and do some action(start, stop.). thinks. -----ÓÊŒþÔŒþ----- ·¢ŒþÈË: engine-devel-bounces(a)ovirt.org [mailto:engine-devel-bounces@ovirt.org] Žú±í engine-devel-request(a)ovirt.org ·¢ËÍÊ±Œä: 2013Äê5ÔÂ14ÈÕ 14:19 ÊÕŒþÈË: engine-devel(a)ovirt.org Ö÷Ìâ: Engine-devel Digest, Vol 20, Issue 39 Send Engine-devel mailing list submissions to engine-devel(a)ovirt.org To subscribe or unsubscribe via the World Wide Web, visit http://lists.ovirt.org/mailman/listinfo/engine-devel or, via email, send a message with subject or body 'help' to engine-devel-request(a)ovirt.org You can reach the person managing the list at engine-devel-owner(a)ovirt.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Engine-devel digest..." Today's Topics: 1. Re: ovirt-engine-sdk with C (Jarod. w) 2. Re: [ANN] New development environment for ovirt-engine (Yair Zaslavsky) 3. Re: [ANN] New development environment for ovirt-engine (Alon Bar-Lev) 4. Re: [ANN] New development environment for ovirt-engine (Alon Bar-Lev) ---------------------------------------------------------------------- Message: 1 Date: Tue, 14 May 2013 10:27:11 +0800 From: "Jarod. w" <work.iec23801(a)gmail.com> To: "leaboy@126" <wlbleaboy(a)126.com> Cc: engine-devel(a)ovirt.org Subject: Re: [Engine-devel] ovirt-engine-sdk with C Message-ID: <CAGEoUW8a4XP=VA_NHXd1wD6sqA5dBdPPauMPrQE0RiKQ4Za8Aw(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" 2013/5/13 leaboy@126 <wlbleaboy(a)126.com> > Hi?All**** > > I felt oivrt-engine-sdk coded with Python is slowly to connect*** > * > > ovirt-engine and console vm when a user have many vms, So, I just**** > > want to rewrite the sdk with C(ANSI C Language). Just rewrite a sdk**** > > with C to connect overt-engine and console vm, would anyone give **** > > me some suggestion. > Do you want to use c to invoke ovirt engine RestAPI, right? If yes, you can use libcurl to do the thing, and it'll make you happy. > **** > > ** ** > > Now, the problem is how can I connect to ovit-engine with C, and* > *** > > how can I get some information of vms, and how ovirrt-engine can **** > > respond my action(start,stop, .eg) > Agree with Michael Pasternak. You should parse your code into the mail list, or someone can't help you. > **** > > ** ** > > > Leaboy@beijing**** > > Thinks*** > * > > _______________________________________________ > Engine-devel mailing list > Engine-devel(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/engine-devel > > -- --- Best Regards Jarod.W

1 0

[Engine-devel] spice-xpi(firefox) plugin for Windows
by Christophe Fergeau 13 May '13

13 May '13

--tsOsTdHNUZQcU9Ye Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi everyone, Lately I've been hacking on getting the spice-xpi plugin to work on Windows. This is the Firefox plugin that is used on Linux to implement the portal SPICE console. This work has now been merged upstream ( http://cgit.freedesktop.org/spice/spice-xpi/ ), and I've pushed a scratch build using mingw available from http://koji.fedoraproject.org/koji/taskinfo?taskID=5265107 (this will go away in several days). Copying this dll + its dependencies to the C:\Program Files\Mozilla Firefox\plugins directory are enough to get a spice-xpi plugin to show up in about:plugins, and to then be able to start a SPICE client from the spice-xpi test page ( http://teuf.fedorapeople.org/plugins/test.html ). The dependencies I had to copy are: gspawn-win32-helper-console.exe gspawn-win32-helper.exe iconv.dll libffi-6.dll libgcc_s_sjlj-1.dll libgio-2.0-0.dll libglib-2.0-0.dll libgmodule-2.0-0.dll libgobject-2.0-0.dll libgthread-2.0-0.dll libintl-8.dll libstdc++-6.dll pthreadGC2.dll zlib1.dll (I picked them from the various mingw-* fedora packages). The reason for this email is that to be usable from oVirt, some portal changes are needed as it currently only tries to use the spice-xpi plugin on Linux platforms. Another fuzzy bit is how to get this plugin to the users' machines... And that's about all I had to say in that email ;) Let me know if that's useful to oVirt, how you want to integrate this, ... Cheers, Christophe --tsOsTdHNUZQcU9Ye Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.13 (GNU/Linux) iEYEARECAAYFAlFumXkACgkQJKRp+3pW945+vwCglgqxiHD3g6EOC12U9Ydg8pVS kmMAoIRXM5MepmgnvK+UJMF1rjiVJ4r/ =QcGM -----END PGP SIGNATURE----- --tsOsTdHNUZQcU9Ye--

5 6

[Engine-devel] DB performance optimization
by Liran Zelkha 13 May '13

13 May '13

Hi all, There is a WIP for caching and DB performance optimization. Please look at - http://gerrit.ovirt.org/#/c/14188/4 To summarize, it includes automatic caching for some business entities (*_static for instance), break up of VDS to VDS_static, VDS_dynamic and VDS_statistics, and support for batch updates. Please share if/where you think batch updates can be used (for a usage scenario, please check InterfaceDaoDbFacadeImpl.massUpdateStatisticsForVds()). Future tasks will include update sensitivity, better Collection caching and trying to minimize getConnection() calls. Would love your comments and ideas. Thanks.

3 3

[Engine-devel] [ANN] Technology preview of new ovirt-engine setup
by Alon Bar-Lev 12 May '13

12 May '13

Hello, We[1] are working on a re-implementation of ovirt-engine setup to a more advanced and customizable implementation. A significant feature is the ability to use the installer on different distributions, first was Gentoo[2], I am working on Ubuntu. Another[3] major features is the ability to use the same setup procedure for production and development. Among of other changes is the option to install product into existing database without having the DBA user, avoid redirection of root URI into application, ability to customize almost anything, and the option of localization. Although this is technology preview and likely to break, we merged this so people may experience the new setup at early stage and provide feedback so we may solve as many issues as we can before product release. So come on, you brave people... let's see you break our setup! This should be available at tomorrow's nightly packages. STATUS Side-by-side installation New installer and legacy installers are available side-by-side. Legacy installer: engine-setup, engine-upgrade, engine-cleanup. New installer: engine-seutp-2, engine-cleanup-2. This means that once ovirt-engine is installed, there is an option to use the legacy setup or the new setup. Compatibility Onces setup is done by either, it cannot be updated by the other. We will work toward having a solution of upgrade legacy to the new, but not the other way around. Coverage setup should be feature complete. cleanup currently only clean files that were created by the setup, not these which were modified. upgrade is implemented using re-execution of setup, currently only database upgrade is performed, no package upgrade. Thank you, Sandro Bonazzola, Alex Lourie, Alon Bar-Lev [1] Sandro Bonazzola, Alex Lourie, Alon Bar-Lev [2] https://wiki.gentoo.org/wiki/OVirt [3] http://lists.ovirt.org/pipermail/engine-devel/2013-May/004532.html

1 0

[Engine-devel] VDSM Fake
by Libor Spevak 12 May '13

12 May '13

Hi, let me introduce an experimental project called VDSM Fake. This is a small Java web application simulating selected VDSM features, but only from the Engine point of view. The aim was to get oVirt-Engine top performance characteristics in core features simulating hundreds of fake hosts and VMs, and in ecologic way. More info: http://www.ovirt.org/VDSM_Fake Sources: git clone git://github.com/lspevak/ovirt-vdsmfake.git git clone git://github.com/lspevak/ovirt-restapiconf.git Regards, Libor

5 6

[Engine-devel] Build ovirt-engine with Eclipse
by wanglibo 12 May '13

12 May '13

ÕâÊÇÒ»·â MIME žñÊœµÄ¶à²¿·ÖÓÊŒþ¡£ ------=_NextPart_000_000F_01CE4D65.DC494CB0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi, all: I want to know which IDE or environment you are using to develop ovirt-engine, Recently, I want to build and debug ovirt-engine with Eclipse, but when I install all the plugins for build it in eclipse, and install jboss and postgre-sql, and then how can I built it , and deploy it, and debug it . I tried to use eclipse like http://www.ovirt.org/Building_Ovirt_Engine/IDE , but failed. ------=_NextPart_000_000F_01CE4D65.DC494CB0 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"> <meta name=3DGenerator content=3D"Microsoft Word 12 (filtered medium)"> <style>  </style>  </head> <body lang=3DZH-CN link=3Dblue vlink=3Dpurple = style=3D'text-justify-trim:punctuation'> <div class=3DSection1> <p class=3DMsoNormal><span lang=3DEN-US>Hi, all:<o:p></o:p></span></p> <p class=3DMsoNormal><span = lang=3DEN-US>         I want to know which IDE or environment you are using to develop = ovirt-engine,<o:p></o:p></span></p> <p class=3DMsoNormal><span lang=3DEN-US>Recently, I want to build and = debug ovirt-engine with Eclipse, but when I install all the <o:p></o:p></span></p> <p class=3DMsoNormal><span lang=3DEN-US>plugins for build it in eclipse, = and install jboss and postgre-sql, and then how can I <o:p></o:p></span></p> <p class=3DMsoNormal><span lang=3DEN-US>built it , and deploy it, and = debug it . <o:p></o:p></span></p> <p class=3DMsoNormal><span = lang=3DEN-US>         I tried to use eclipse like <a href=3D"http://www.ovirt.org/Building_Ovirt_Engine/IDE">http://www.ovirt.= org/Building_Ovirt_Engine/IDE</a> , but<o:p></o:p></span></p> <p class=3DMsoNormal><span lang=3DEN-US>failed.<o:p></o:p></span></p> <p class=3DMsoNormal><span lang=3DEN-US><o:p> </o:p></span></p> <p class=3DMsoNormal><span lang=3DEN-US><o:p> </o:p></span></p> </div> </body> </html> ------=_NextPart_000_000F_01CE4D65.DC494CB0--

2 1