February 2013 - Devel - oVirt List Archives

[Engine-devel] DB Performance Monitoring
by Libor Spevak 15 Mar '13

15 Mar '13

Hi, I just wanted to share a partial result from testing of engine db load during operation (SQL queries frequencies). Maybe, we can decide later, if some SQL queries result CACHING can boost throughput for larger deployments. The caching technology can be from a simple HashMap lookup to deployments of something like http://ehcache.org/ (memory database). I prepared two simple scenarios: - oVirt engine, 2 hosts, 1 VM, running 15 minutes (Power on + Up state) - oVirt engine, 2 hosts, 10 VMs from one pool, running 15 minutes (Power on + Up state) Appending 2 spreadsheets with data about the most used SQL queries (generated by PostgreSQL standard pg_statements_stat module). e.g. - 2nd row shows number of granted connections from the db pool (e.g. can be used to set optimal connection pool size) (check of connection health: select 1) - most of the queries are wrapped by a PLSQL function so we see a wrapper: /select * from getvdsgroupbyvdsgroupid($1, $2, $3)/ and near to it the 'real' query: /SELECT vds_groups_view.*// // FROM vds_groups_view// // WHERE vds_group_id = v_vds_group_id// // AND (NOT v_is_filtered OR EXISTS (SELECT 1// // FROM user_vds_groups_permissions_view// // WHERE user_id = v_user_id AND entity_id = v_vds_group_id))// / Just as an example, I selected in yellow color some queries, which probably do not change often, but are very frequent. Other tools like 'pg_top' can provide runtime statistics of db processes (cpu, mem, locks, ... views). By enabling debug level logging of PostgreSQL we can check real values to the queries. Of course, it would be useful to run such tests with many hosts and VMs to predict scaling issues. More info about tools configuration: http://www.ovirt.org/Engine_database_performance_monitoring Regards, Libor

5 6

[Engine-devel] How to debug in frontend project
by Chen, Wei D 05 Mar '13

05 Mar '13

Hi, How to debug the code in frontend project? I mean, print out some debug message from "onSave" method in the java file of "VmListModel.java" which is located in uicommonweb project. Thanks in advance. Best Regards, Dave Chen

5 6

[Engine-devel] oVirt Engine GUI: builders infrastructure feedback (conf: 712 886 7405#)
by Einav Cohen 28 Feb '13

28 Feb '13

------=_Part_12312836_889011943.1362081100296 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit The following is a new meeting request: Subject: oVirt Engine GUI: builders infrastructure feedback (conf: 712 886 7405#) Organizer: "Einav Cohen" <ecohen(a)redhat.com> Location: Intercall conf code: 712 886 7405# Time: Tuesday, March 5, 2013, 9:30:00 AM - 11:00:00 AM GMT -05:00 US/Canada Eastern Invitees: tjelinek(a)redhat.com; engine-devel(a)ovirt.org *~*~*~*~*~*~*~*~*~* Following the correspondence in the builders infrastructure patch [1] and engine-devel thread [2]: In the first part of the meeting, Tomas Jelinek <tjelinek(a)redhat.com> will present his builders infrastructure solution. In the second part of the meeting, we will hear feedback about this solution from the other parties and try to converge to a final, unanimous decision. conference call details: ======================== Intercall dial-in numbers: https://www.intercallonline.com/listNumbersByCode.action?confCode=7128867405 Intercall conf code: 712 886 7405# elluminate session: =================== https://sas.elluminate.com/m.jnlp?sid=819&password=M.A7793C4C197B25A20229D7… ---- [1] http://gerrit.ovirt.org/#/c/10874/ [2] http://lists.ovirt.org/pipermail/engine-devel/2013-January/003528.html ------=_Part_12312836_889011943.1362081100296 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><h3>The following is a new meeting request:</h3> <p> <table border=3D'0'> <tr><th align=3Dleft>Subject:</th><td>oVirt Engine GUI: builders infrastruc= ture feedback (conf: 712 886 7405#) </td></tr> <tr><th align=3Dleft>Organizer:</th><td>"Einav Cohen" <ecohen(a)redhat.com= > </td></tr> </table> <p> <table border=3D'0'> <tr><th align=3Dleft>Location:</th><td>Intercall conf code: 712 886 7405# <= /td></tr> <tr><th align=3Dleft>Time:</th><td>Tuesday, March 5, 2013, 9:30:00 AM - 11:= 00:00 AM GMT -05:00 US/Canada Eastern </td></tr></table> <p> <table border=3D'0'> <tr><th align=3Dleft>Invitees:</th><td>tjelinek(a)redhat.com; engine-devel@ov= irt.org </td></tr> </table> <div>*~*~*~*~*~*~*~*~*~*</div><br>Following the correspondence in the build= ers infrastructure patch [1] and engine-devel thread [2]: <br>In the first = part of the meeting, Tomas Jelinek <tjelinek(a)redhat.com> will present= his builders infrastructure solution. <br>In the second part of the meetin= g, we will hear feedback about this solution from the other parties and try= to converge to a final, unanimous decision.<br><br><br>conference call det= ails:<br>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D<br>Intercall dial-in numbers:<br>https://www.intercallonline.com/lis= tNumbersByCode.action?confCode=3D7128867405<br><br>Intercall conf code:<br>= 712 886 7405#<br><br><br>elluminate session:<br>=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>https://sas.elluminate.com/m.jnlp?sid=3D8= 19&password=3DM.A7793C4C197B25A20229D725900B25<br><br>----<br><br>[1] h= ttp://gerrit.ovirt.org/#/c/10874/<br><br>[2] http://lists.ovirt.org/piperma= il/engine-devel/2013-January/003528.html<br></body></html> ------=_Part_12312836_889011943.1362081100296 Content-Type: text/calendar; charset=utf-8; method=REQUEST; name=meeting.ics Content-Transfer-Encoding: 7bit BEGIN:VCALENDAR PRODID:Zimbra-Calendar-Provider VERSION:2.0 METHOD:REQUEST BEGIN:VTIMEZONE TZID:America/New_York BEGIN:STANDARD DTSTART:19710101T020000 TZOFFSETTO:-0500 TZOFFSETFROM:-0400 RRULE:FREQ=YEARLY;WKST=MO;INTERVAL=1;BYMONTH=11;BYDAY=1SU TZNAME:EST END:STANDARD BEGIN:DAYLIGHT DTSTART:19710101T020000 TZOFFSETTO:-0400 TZOFFSETFROM:-0500 RRULE:FREQ=YEARLY;WKST=MO;INTERVAL=1;BYMONTH=3;BYDAY=2SU TZNAME:EDT END:DAYLIGHT END:VTIMEZONE BEGIN:VEVENT UID:ff2166d5-2b56-42f8-bd01-f41759b97dd9 SUMMARY:oVirt Engine GUI: builders infrastructure feedback (conf: 712 886 74 05#) LOCATION:Intercall conf code: 712 886 7405# ATTENDEE;CN=Thomas Jelinek;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=T RUE:mailto:tjelinek@redhat.com ATTENDEE;CN=engine-devel;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TRU E:mailto:engine-devel@ovirt.org ORGANIZER;CN=Einav Cohen:mailto:ecohen@redhat.com DTSTART;TZID="America/New_York":20130305T093000 DTEND;TZID="America/New_York":20130305T110000 STATUS:CONFIRMED CLASS:PUBLIC X-MICROSOFT-CDO-INTENDEDSTATUS:BUSY TRANSP:OPAQUE LAST-MODIFIED:20130228T195140Z DTSTAMP:20130228T195140Z SEQUENCE:0 DESCRIPTION:The following is a new meeting request:\n\nSubject: oVirt Engine GUI: builders infrastructure feedback (conf: 712 886 7405#) \nOrganizer: "E inav Cohen" <ecohen(a)redhat.com> \n\nLocation: Intercall conf code: 712 886 7 405# \nTime: Tuesday\, March 5\, 2013\, 9:30:00 AM - 11:00:00 AM GMT -05:00 US/Canada Eastern\n \nInvitees: tjelinek(a)redhat.com\; engine-devel(a)ovirt.org \n\n\n*~*~*~*~*~*~*~*~*~*\n\nFollowing the correspondence in the builders i nfrastructure patch [1] and engine-devel thread [2]: \nIn the first part of the meeting\, Tomas Jelinek <tjelinek(a)redhat.com> will present his builders infrastructure solution. \nIn the second part of the meeting\, we will hear feedback about this solution from the other parties and try to converge to a final\, unanimous decision.\n\n\nconference call details:\n================ ========\nIntercall dial-in numbers:\nhttps://www.intercallonline.com/listNu mbersByCode.action?confCode=7128867405\n\nIntercall conf code:\n712 886 7405 #\n\n\nelluminate session:\n===================\nhttps://sas.elluminate.com/ m.jnlp?sid=819&password=M.A7793C4C197B25A20229D725900B25\n\n----\n\n[1] http ://gerrit.ovirt.org/#/c/10874/\n\n[2] http://lists.ovirt.org/pipermail/engin e-devel/2013-January/003528.html\n X-ALT-DESC;FMTTYPE=text/html:<html><body><h3>The following is a new meeting request:</h3>\n\n<p>\n<table border='0'>\n<tr><th align=left>Subject:</th><t d>oVirt Engine GUI: builders infrastructure feedback (conf: 712 886 7405#) < /td></tr>\n<tr><th align=left>Organizer:</th><td>"Einav Cohen" &lt\;ecohen@r edhat.com&gt\; </td></tr>\n</table>\n<p>\n<table border='0'>\n<tr><th align= left>Location:</th><td>Intercall conf code: 712 886 7405# </td></tr>\n<tr><t h align=left>Time:</th><td>Tuesday\, March 5\, 2013\, 9:30:00 AM - 11:00:00 AM GMT -05:00 US/Canada Eastern\n </td></tr></table>\n<p>\n<table border='0' >\n<tr><th align=left>Invitees:</th><td>tjelinek(a)redhat.com\; engine-devel@o virt.org </td></tr>\n</table>\n<div>*~*~*~*~*~*~*~*~*~*</div><br>Following t he correspondence in the builders infrastructure patch [1] and engine-devel thread [2]: <br>In the first part of the meeting\, Tomas Jelinek &lt\;tjelin ek(a)redhat.com&gt\; will present his builders infrastructure solution. <br>In the second part of the meeting\, we will hear feedback about this solution from the other parties and try to converge to a final\, unanimous decision.< br><br><br>conference call details:<br>========================<br>Intercall dial-in numbers:<br>https://www.intercallonline.com/listNumbersByCode.actio n?confCode=7128867405<br><br>Intercall conf code:<br>712 886 7405#<br><br><b r>elluminate session:<br>===================<br>https://sas.elluminate.com/m .jnlp?sid=819&amp\;password=M.A7793C4C197B25A20229D725900B25<br><br>----<br> <br>[1] http://gerrit.ovirt.org/#/c/10874/<br><br>[2] http://lists.ovirt.org /pipermail/engine-devel/2013-January/003528.html<br></body></html> BEGIN:VALARM ACTION:DISPLAY TRIGGER;RELATED=START:-PT15M DESCRIPTION:Reminder END:VALARM END:VEVENT END:VCALENDAR ------=_Part_12312836_889011943.1362081100296--

1 0

[Engine-devel] Rebasing a patch on an updated dependency
by Morrissey, Christopher 27 Feb '13

27 Feb '13

Hi All, I have a patch, http://gerrit.ovirt.org/#/c/11783/, that is dependent on another unmerged patch and the dependent patch has been updated with a new patch set. I know I need to somehow rebase my patch on the updated dependent patch set, but I'm new to git and gerrit and have not been able to figure out the right combination of git commands to accomplish this. Any ideas on what steps I need to take? Thanks! -Chris Chris Morrissey Software Engineer NetApp Inc. 919.476.4428

2 2

[Engine-devel] Engine table comments
by Libor Spevak 27 Feb '13

27 Feb '13

This is a multi-part message in MIME format. --------------090900020406030601070406 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Hi, I would like to propose to create a patch assigning sql comment to each Engine table. The comments will be a part of the exported DB schema report, too. The terminology is not always consistent across all application layers, so for the newcomers it would be easier to understand the model. But, what would be general guidelines? I recommend to use singular form of entity name as used from end-user point of view (if somehow visible, of course), or just used frequently inside code. Examples: storage_pool ... Data center vds_groups ... Cluster but: vm_static ... Virtual machine configuration vm_dynamic ... Virtual machine runtime data vm_statistics ... Virtual machine statistics data ... etc. This command prepares a template for the patch: /psql engine -U postgres -c "select 'COMMENT ON TABLE ' || relname || ' IS ''TODO'';' sql from pg_stat_user_tables t WHERE schemaname='public' order by t.relname" > comments_to_do.sql// / or just I can prepare a page on the wiki with table containing table names and volunteers :-) can propose simple understandable comments for known tables. Is it useful? Thanks. Regards, Libor --------------090900020406030601070406 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=ISO-8859-1"> </head> <body bgcolor="#FFFFFF" text="#000000"> Hi, <br> I would like to propose to create a patch assigning sql comment to each Engine table.<br> The comments will be a part of the exported DB schema report, too.<br> The terminology is not always consistent across all application layers, so for the newcomers it would be easier to understand the model.<br> <br> But, what would be general guidelines?<br> <br> I recommend to use singular form of entity name as used from end-user point of view (if somehow visible, of course), or just used frequently inside code.<br> <br> Examples:<br> storage_pool ... Data center<br> vds_groups ... Cluster<br> but:<br> vm_static  ... Virtual machine configuration<br> vm_dynamic ... Virtual machine runtime data<br> vm_statistics ... Virtual machine statistics data<br> ...<br> etc.<br> <br> This command prepares a template for the patch:<br> <br> <i>psql engine -U postgres -c "select 'COMMENT ON TABLE ' || relname || ' IS ''TODO'';' sql from pg_stat_user_tables t WHERE schemaname='public' order by t.relname" > comments_to_do.sql</i><i><br> </i><br> or just I can prepare a page on the wiki with table containing table names and volunteers :-) can propose simple understandable comments for known tables.<br> <br> Is it useful?<br> <br> Thanks.<br> <br> Regards,<br> Libor<br> </body> </html> --------------090900020406030601070406--

3 3

[Engine-devel] ovirt-engine-sdk-java 1.0.0.3-1 released
by Michael Pasternak 25 Feb '13

25 Feb '13

* Wed Jan 30 2013 Michael Pasternak <mpastern(a)redhat.com> - 1.0.0.3-1 - implement SSL support (without host verification) - implement shutdown() to deallocate system resources - to cluster added tunnel_migration property - to DataCenter added Clusters sub-collection - to root collection resource Disk added Permissions sub-collectio - to root collection resource Disk added Statistic sub-collection - host can be attached to cluster now either by id or name - to StorageDomainTemplate added Disks sub-collection - to StorageDomainVM added Disks sub-collection - to template.display added keyboard_layout property - to template added tunnel_migration property - to vm.display added keyboard_layout property - to vm added tunnel_migration property - to VMSnapshot added preview method - to VMSnapshot added undo method - to VMSnapshot added commit method More details can be found at [1]. [1] http://www.ovirt.org/Java-sdk-changelog -- Michael Pasternak RedHat, ENG-Virtualization R&D

1 1

[Engine-devel] Changing Gerrit -1 message
by Ofer Schreiber 25 Feb '13

25 Feb '13

I feel that the current "-1 I would prefer that you didn't submit this" message in Gerrit is pretty rude, as usually those -1 reviews are just small fix-ups in the code itself. Any thoughts about a more suitable "-1" message? I thought about "-1 Please fix your code" or something similar. Thanks, Ofer Schreiber

12 11

[Engine-devel] Secret quartz update checks
by Doron Fediuck 25 Feb '13

25 Feb '13

Hi, While deploying a development setup in a new machine I noticed the following quartz line: 2013-02-25 16:10:28,546 INFO [org.jboss.as.server] (DeploymentScanner-threads - 2) JBAS018559: Deployed "engine.ear" 2013-02-25 16:10:30,143 INFO [org.quartz.utils.UpdateChecker] (Timer-1) New Quartz update(s) found: 2.1.6 [http://www.terracotta.org/kit/reflector?kitID=default&pageID=QuartzChangeLog] This is suggesting that quartz is reaching out to verify on new updates. Do we really need it? Do we really want it?

2 2

[Engine-devel] REST API calls from the GUI
by Libor Spevak 25 Feb '13

25 Feb '13

Hi, I would like to ask, if there have been discussions about an option to call REST API services directly from the Frontend (GWT layer)? GWT compiles Java frontend-side to Javascript, calls to backend services are performed "transparently" by the framework using AJAX support. But, there is still a need to have a special set of data objects and the server-side logic can duplicate. Java REST API SDK enables to build "thick" client. The calls are realized using e.g. Apache HttClient and supported libraries. I think the requirements of GWT can be a little bit different, but something overlaps. I found several links about REST API support from GWT, so there is something for inspiration... - http://www.spiffyui.org/ - http://www.zackgrossbart.com/hackito/gwt-rest/ - http://code.google.com/p/gwt-rest/ - http://restygwt.fusesource.org/ But, do you think it would be useful and what drawbacks can occur (authentication, authorization, response times, need to support larger set of services, painful refactoring, ...)? Regards, Libor

10 29

[Engine-devel] new ovirt-dwh & ovirt-reports nightly builds are avaliable for fedora 18
by Eyal Edri 25 Feb '13

25 Feb '13

fyi, per request, ovirt-dwh & ovirt-reports are now built nightly and published on ovirt.org repos. http://resources.ovirt.org/releases/nightly/rpm/Fedora/18/noarch/ Eyal Edri oVirt infra team.

1 0