March 2013 - Devel - oVirt List Archives

[Engine-devel] Cloud-Init integration
by Greg Padgett 17 Jun '13

17 Jun '13

Hi Everyone, I'd like to propose a feature we've been doing some investigation into, which is to integrate cloud-init support into oVirt. Cloud-init is used to help provision new Linux systems by setting the hostname, ip, ssh keys, timezone, injecting files, and more. It's used by OpenStack (amongst others) now, and has a lot of features that may be helpful to our users. Details are still evolving, but for more info please see the wiki page: http://www.ovirt.org/Features/Cloud-Init_Integration All feedback is welcome! Thanks, Greg

8 11

[Engine-devel] Proposal VDSM <=> Engine Data Statistics Retrieval Optimization
by Vinzenz Feenstra 30 May '13

30 May '13

This is a multi-part message in MIME format. --------------020305070807050907000005 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Please find the prettier version on the wiki: http://www.ovirt.org/Proposal_VDSM_-_Engine_Data_Statistics_Retrieval Proposal VDSM - Engine Data Statistics Retrieval VDSM <=> Engine data retrieval optimization Motivation: Currently the RHEVM engine is polling the a lot of data from VDSM every 15 seconds. This should be optimized and the amount of data requested should be more specific. For each VM the data currently contains much more information than actually needed which blows up the size of the XML content quite big. We could optimize this by splitting the reply on the getVmStats based on the request of the engine into sections. For this reason Omer Frenkel and me have split up the data into parts based on their usage. This data can and usually does change during the lifetime of the VM. Rarely Changed: This data is change not very frequent and it should be enough to update this only once in a while. Most commonly this data changes after changes made in the UI or after a migration of the VM to another Host. *Status* = Running *acpiEnable* = true *vmType* = kvm *guestName* = W864GUESTAGENTT *displayType* = qxl *guestOs* = Win 8 *kvmEnable* = true #/*this should be constant and never changed*/ *pauseCode* = NOERR *monitorResponse* = 0 *session* = Locked # unused *netIfaces* = [{'name': 'Realtek RTL8139C+ Fast Ethernet NIC', 'inet6': ['fe80::490c:92bb:bbcc:9f87'], 'inet': ['10.34.60.148'], 'hw': '00:1a:4a:22:3c:db'}] *appsList* = ['RHEV-Tools 3.2.4', 'RHEV-Agent64 3.2.3', 'RHEV-Serial64 3.2.3', 'RHEV-Network64 3.2.2', 'RHEV-Network64 3.2.3', 'RHEV-Block64 3.2.3', 'RHEV-Balloon64 3.2.3', 'RHEV-Balloon64 3.2.2', 'RHEV-Agent64 3.2.2', 'RHEV-USB 3.2.3', 'RHEV-Block64 3.2.2', 'RHEV-Serial64 3.2.2'] *pid* = 11314 *guestIPs* = 10.34.60.148 # duplicated info *displayIp* = 0 *displayPort* = 5902 *displaySecurePort* = 5903 *username* = user@W864GUESTAGENTT *clientIp* = *lastLogin* = 1361976900.67 Often Changed: This data is changed quite often however it is not necessary to update this data every 15 seconds. As this is cumulative data and reflects the current status, and it does not need to be snapshotted every 15 seconds to retrieve statistics. The data can be retrieved in much more generous time slices. (e.g. Every 5 minutes) *network* = {'vnet1': {'macAddr': '00:1a:4a:22:3c:db', 'rxDropped': '0', 'txDropped': '0', 'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '100', 'name': 'vnet1'}} *disksUsage* = [{'path': 'c:\\', 'total': '64055406592', 'fs': 'NTFS', 'used': '19223846912'}, {'path': 'd:\\', 'total': '3490912256', 'fs': 'UDF', 'used': '3490912256'}] *timeOffset* = 14422 *elapsedTime* = 68591 *hash* = 2335461227228498964 *statsAge* = 0.09 # unused Often Changed but unused This data does not seem to be used in the engine at all. It is *not* even used in the data warehouse. *memoryStats* = {'swap_out': '0', 'majflt': '0', 'mem_free': '1466884', 'swap_in': '0', 'pageflt': '0', 'mem_total': '2096736', 'mem_unused': '1466884'} *balloonInfo* = {'balloon_max': 2097152, 'balloon_cur': 2097152} *disks* = {'vda': {'readLatency': '0', 'apparentsize': '64424509440', 'writeLatency': '1754496', 'imageID': '28abb923-7b89-4638-84f8-1700f0b76482', 'flushLatency': '156549', 'readRate': '0.00', 'truesize': '18855059456', 'writeRate': '952.05'}, 'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}} Very frequent uppdates needed by webadmin portal: This data is mostly needed for the webadmin portal and might be required to be updated quite often. An exception here is the statsAge field, which seems to be unused by the Engine. This data could be requested every 15 seconds to keep things as they are now. *cpuSys* = 2.32 *cpuUser* = 1.34 *memUsage* = 30 Proposed Solution for VDSM & Engine: We will introduce new optional parameters to getVmStats, getAllVmStats and list to allow a finer grained specification of data which should be included. *Parameter:* *statsType*=/*<string>*/ (getVmStats, getAllVmStats only) *Allowed values:* * full (default to keep backwards compatibility) * app-list (Just send the application list) * rare (include everything from rarely changed to very frequent) * often (include everything from often changed to very frequent) * frequent (only send the very frequently changed items) *Parameter:* *clientId*=*<string>* The client id is specified by the client and should be unique however constantly used. *Parameter:* *diff*=*<boolean>* In combination with the clientId VDSM will send only differences to the previous request from the named clientId. (if diff=true) Additional Change: Besides the introduction of the new parameters for list, getVmStats and getAllVmStats it might make sense to include a hash for the appList into the rarely changed section of the response which would allow to identify changes and avoid having to sent the complete appList every so often and only if the hash known to the client is outdated. *Note:* The appList (Application List) reported by the guest agent could be fully implemented on request only, as long as the guest agent installed supports this. As there seems to be a request to have the complete list of installed applications on all guests this data could be quite extensive and a huge list. On the other hand this data is only rarely visible and therefore it should not be requested all the time and only on demand. Improvement of the Guest Agent: As part of the proposed solution it is necessary to improve the guest agent as well. For the full application list there should be implemented a caching system which will be fully reactive and should not poll the application list for example all the time. The guest can create a prepared data file containing all data in the JSON format (as used for the communication with VDSM via VIO) and just have to read that file from disk and directly sends it to VDSM. However it is quite possible that this list is to big and it might have to be chunked into pieces. (Multiple messages, which would have to be supported by VDSM then as well) The solution for this is to make VDSM request this data and it will retrieve the data necessary on request only. -- Regards, Vinzenz Feenstra | Senior Software Engineer RedHat Engineering Virtualization R & D Phone: +420 532 294 625 IRC: vfeenstr or evilissimo Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com --------------020305070807050907000005 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=ISO-8859-1"> </head> <body bgcolor="#FFFFFF" text="#000000"> Please find the prettier version on the wiki: <a class="moz-txt-link-freetext" href="http://www.ovirt.org/Proposal_VDSM_-_Engine_Data_Statistics_Retrieval">http://www.ovirt.org/Proposal_VDSM_-_Engine_Data_Statistics_Retrieval</a> <h1 id="firstHeading" class="firstHeading page-header">Proposal VDSM - Engine Data Statistics Retrieval</h1> <h2>VDSM <=> Engine data retrieval optimization </h2> <h3> Motivation: </h3> Currently the RHEVM engine is polling the a lot of data from VDSM every 15 seconds. This should be optimized and the amount of data requested should be more specific. For each VM the data currently contains much more information than actually needed which blows up the size of the XML content quite big. We could optimize this by splitting the reply on the getVmStats based on the request of the engine into sections. For this reason Omer Frenkel and me have split up the data into parts based on their usage. This data can and usually does change during the lifetime of the VM. <h4> Rarely Changed: </h4> This data is change not very frequent and it should be enough to update this only once in a while. Most commonly this data changes after changes made in the UI or after a migration of the VM to another Host. <pre> Status = Running acpiEnable = true vmType = kvm guestName = W864GUESTAGENTT displayType = qxl guestOs = Win 8 kvmEnable = true # this should be constant and never changed pauseCode = NOERR monitorResponse = 0 session = Locked # unused netIfaces = [{'name': 'Realtek RTL8139C+ Fast Ethernet NIC', 'inet6': ['fe80::490c:92bb:bbcc:9f87'], 'inet': ['10.34.60.148'], 'hw': '00:1a:4a:22:3c:db'}] appsList = ['RHEV-Tools 3.2.4', 'RHEV-Agent64 3.2.3', 'RHEV-Serial64 3.2.3', 'RHEV-Network64 3.2.2', 'RHEV-Network64 3.2.3', 'RHEV-Block64 3.2.3', 'RHEV-Balloon64 3.2.3', 'RHEV-Balloon64 3.2.2', 'RHEV-Agent64 3.2.2', 'RHEV-USB 3.2.3', 'RHEV-Block64 3.2.2', 'RHEV-Serial64 3.2.2'] pid = 11314 guestIPs = 10.34.60.148 # duplicated info displayIp = 0 displayPort = 5902 displaySecurePort = 5903 username = user@W864GUESTAGENTT clientIp = lastLogin = 1361976900.67 </pre> <h4> Often Changed: </h4> This data is changed quite often however it is not necessary to update this data every 15 seconds. As this is cumulative data and reflects the current status, and it does not need to be snapshotted every 15 seconds to retrieve statistics. The data can be retrieved in much more generous time slices. (e.g. Every 5 minutes) <pre> network = {'vnet1': {'macAddr': '00:1a:4a:22:3c:db', 'rxDropped': '0', 'txDropped': '0', 'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '100', 'name': 'vnet1'}} disksUsage = [{'path': 'c:\\', 'total': '64055406592', 'fs': 'NTFS', 'used': '19223846912'}, {'path': 'd:\\', 'total': '3490912256', 'fs': 'UDF', 'used': '3490912256'}] timeOffset = 14422 elapsedTime = 68591 hash = 2335461227228498964 statsAge = 0.09 # unused </pre> <h4> Often Changed but unused </h4> This data does not seem to be used in the engine at all. It is not even used in the data warehouse. <pre> memoryStats = {'swap_out': '0', 'majflt': '0', 'mem_free': '1466884', 'swap_in': '0', 'pageflt': '0', 'mem_total': '2096736', 'mem_unused': '1466884'} balloonInfo = {'balloon_max': 2097152, 'balloon_cur': 2097152} disks = {'vda': {'readLatency': '0', 'apparentsize': '64424509440', 'writeLatency': '1754496', 'imageID': '28abb923-7b89-4638-84f8-1700f0b76482', 'flushLatency': '156549', 'readRate': '0.00', 'truesize': '18855059456', 'writeRate': '952.05'}, 'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}} </pre> <h4> Very frequent uppdates needed by webadmin portal: </h4> This data is mostly needed for the webadmin portal and might be required to be updated quite often. An exception here is the statsAge field, which seems to be unused by the Engine. This data could be requested every 15 seconds to keep things as they are now. <pre> cpuSys = 2.32 cpuUser = 1.34 memUsage = 30 </pre> <h2> Proposed Solution for VDSM & Engine: </h2> We will introduce new optional parameters to getVmStats, getAllVmStats and list to allow a finer grained specification of data which should be included. Parameter: statsType=<string> (getVmStats, getAllVmStats only) Allowed values: <ul> <li> full (default to keep backwards compatibility) </li> <li> app-list (Just send the application list) </li> <li> rare (include everything from rarely changed to very frequent) </li> <li> often (include everything from often changed to very frequent) </li> <li> frequent (only send the very frequently changed items) </li> </ul> Parameter: clientId=<string> The client id is specified by the client and should be unique however constantly used. Parameter: diff=<boolean> In combination with the clientId VDSM will send only differences to the previous request from the named clientId. (if diff=true) <h3> Additional Change: </h3> Besides the introduction of the new parameters for list, getVmStats and getAllVmStats it might make sense to include a hash for the appList into the rarely changed section of the response which would allow to identify changes and avoid having to sent the complete appList every so often and only if the hash known to the client is outdated. Note: The appList (Application List) reported by the guest agent could be fully implemented on request only, as long as the guest agent installed supports this. As there seems to be a request to have the complete list of installed applications on all guests this data could be quite extensive and a huge list. On the other hand this data is only rarely visible and therefore it should not be requested all the time and only on demand. <h3> Improvement of the Guest Agent: </h3> As part of the proposed solution it is necessary to improve the guest agent as well. For the full application list there should be implemented a caching system which will be fully reactive and should not poll the application list for example all the time. The guest can create a prepared data file containing all data in the JSON format (as used for the communication with VDSM via VIO) and just have to read that file from disk and directly sends it to VDSM. However it is quite possible that this list is to big and it might have to be chunked into pieces. (Multiple messages, which would have to be supported by VDSM then as well) The solution for this is to make VDSM request this data and it will retrieve the data necessary on request only. <pre class="moz-signature" cols="72">-- Regards, Vinzenz Feenstra | Senior Software Engineer RedHat Engineering Virtualization R & D Phone: +420 532 294 625 IRC: vfeenstr or evilissimo Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com</pre> </body> </html> --------------020305070807050907000005--

8 23

[Engine-devel] [ANN] Development environment and Gentoo packaging (preview)
by Alon Bar-Lev 16 May '13

16 May '13

Hello All, We[1] are working to rewrite the current installer to something more portable and flexible. Currently two milestones had been reached: 1. Ability to install almost fully functioning ovirt-engine at $HOME for development environment. 2. Porting ovirt-engine to run on different distribution, Gentoo. We will be glad to receive feedback on either. Code is located at github[2] for now, at otopi branch. Instructions for setting up development environment are available[3]. Gentoo overlay for live ebuilds is available[4], the following packages are valid: - app-emulation/otopi - app-emulation/ovirt-host-deploy - app-emulation/ovirt-jboss-bin - app-emulation/ovirt-engine Why Gentoo first? because source based distributions demands the highest level of customization, solving the complex issue ease to continue porting to binary based distributions. Please remember that this is work in progress, and not guarantee to be stable or even work... The installer was re-written from scratch so expect issues at this point. Any feedback is welcomed, we are focusing first in providing the functionality of the existing installer to be able to replace it entirely before going into new adventures. Regards, Alon Bar-Lev. [1] Alex Lourie, Sandro Bonazzola, Alon Bar-Lev [2] https://github.com/alonbl/ovirt-engine [3] https://github.com/alonbl/ovirt-engine/blob/otopi/README.developer [4] https://github.com/alonbl/ovirt-overlay

2 1

[Engine-devel] Migrating engine-setup to otopi
by Alex Lourie 10 May '13

10 May '13

Hi All Recent development of the otopi [1] framework allows us to migrate the engine-setup, upgrade and cleanup (and potentially other) utilities to implementation as an otopi plugin. Potential benefits of such a move are: 1. Be able to port engine to other distributions. 2. Be able to install engine in a development mode. 3. Be able to customize installation easily. 4. Share installation of components (reports, dwh). 5. Modular implementation, reduce maintenance costs. 6. Code reuse of installer code for multiple purposes (host-deploy, enigne-setup). Currently we are in the process of creating a 'setup' plugin for the otopi, and the progress can be monitored at [2]. The current roadmap for the feature is as follows: 1. Recreate the configuration utilities as plugins in otopi. 2. Support side-by side installation using both the old and the new utilities. 3. Switch to the new utility when the confidence that it is on-par with an old one is high. Our goal is to have the new utilities ready for 3.3 release (at least for the step 2 in the roadmap). We'd like to hear as much feedback as possible, so we could address it as soon as possible. Thanks! [1] http://gerrit.ovirt.org/#/q/project:otopi,n,z [2] http://www.ovirt.org/Features/Otopi_Infra_Migration

6 12

[Engine-devel] Any way to setup ovirt engine 3.2.0 or 3.2.1 running enviroment?
by Chen, Wei D 03 May '13

03 May '13

Hi, We notice that ovirt-engine's version (rpm package and source code) has updated from 3.2.0 to 3.2.1. As our development process is always based on 3.2.0. Is there any way to re-setup 3.2.0 running environment? Besides, we also cannot setup 3.2.1 ovrit-engine running environment as its dependent package glusterfs-3.4 cannot be found from ovirt repo or fedora18 repo. How can I fix this issue? Thanks. Best Regards, Dave Chen

4 7

[Engine-devel] FeatureSupported and compatibility versions
by Shireesh Anjal 02 May '13

02 May '13

Hi all, The current mechanism in oVirt to check whether a feature is supported in a particular compatibility version is to use the FeatureSupported class. e.g. FeatureSupported.networkLinking(getVm().getVdsGroupCompatibilityVersion()) Checks whether the "network linking" feature is supported for the the VM's cluster compatibility version. This internally checks whether the value of the corresponding config (NetworkLinkingSupported) for the given compatibility version is true/false. I'm not sure if this is a good idea, since a feature is typically supported "from" a particular version. E.g. Gluster support was introduced in 3.1, and it continues to be available in all subsequent versions. So I see no point in adding configuration for every version indicating whether the feature is supported in that version or not. I suggest to use either of the following options: 1) Instead of using a boolean config for each version, use a single string config that indicates the "supported from" version e.g. GlusterSupportedFrom = 3.1. There could be rare cases where a feature, for some reason, is removed in some release. In such cases, we could use one additional config for the "supported to" version. 2) Continue with the boolean approach, but do not have entries for every version; rather make use of the "default value" for majority of cases, and add the explicit version mapping for the minority e.g. GlusterSupported = true by default, and false in case of 3.0 (only one config required for 3.0) Thoughts? Regards, Shireesh

7 16

[Engine-devel] UI Plugin API improvements
by Vojtech Szocs 06 Apr '13

06 Apr '13

Hi guys, I've just merged some UI Plugin patches that improve existing API functions, as well as add some new API functions. Please read on to learn what's new. Modal dialog API ================ Function improved: showDialog New signature: showDialog(title, dialogToken, contentUrl, width, height [, options]) Example usage: showDialog('My Dialog', 'my-dialog', 'http://www.foobar.com/', '800px', '600px', { // Default value = empty array (no buttons) buttons: [ { label: 'Do stuff', onClick: function() { alert('Bump!'); } } ], // Default value = false resizeEnabled: true, // Default value = true closeIconVisible: true, // Default value = true closeOnEscKey: true }); Notable changes: * modal dialogs now look & feel the same as standard WebAdmin dialogs * width & height are strings containing CSS units * the reason why buttons default to empty array is to give plugin authors the choice to provide custom buttons (or similar input elements) via dialog content (iframe), and use HTML5 window.postMessage to call the plugin (coming soon!) -- New function: setDialogContentUrl New signature: setDialogContentUrl(dialogToken, contentUrl) Example usage: setDialogContentUrl('my-dialog', 'http://www.example.com/') -- New function: closeDialog New signature: closeDialog(dialogToken) Example usage: closeDialog('my-dialog') Tab API ======= Functions improved: addMainTab & addSubTab New signatures: addMainTab(label, historyToken, contentUrl [, options]) addSubTab(entityTypeName, label, historyToken, contentUrl [, options]) Example usage: // Tab is left-aligned by default addMainTab('Foo Tab', 'foo-tab', 'http://www.foo.com/'); // Tab is right-aligned via options object addSubTab('VirtualMachine', 'Bar Tab', 'bar-tab', 'http://www.bar.com/', { alignRight: true }); -- Regards, Vojtech

5 8

[Engine-devel] Open Attestation integration with oVirt engine proposal has submitted patchset5 for your review
by Chen, Wei D 02 Apr '13

02 Apr '13

Hi all, Before submitting this patch set, we has updated our design page, and new feature about VM template has added to this patchset. In patchset a lot of frontend changes has been imported. Welcome to review our patchset and thanks advance for your suggestion. Detailed description: http://wiki.ovirt.org/Trusted_compute_pools In this patch set, follow changes has been introduced: 1. GUI changes to support for creating a trusted VM on a trusted physical host. 2. View/Edit VM changes to enable end user switch between three run on options. 3. Template relevant changes to support end user create a trusted VM template and create trusted VM based on this template afterwards. 4. Bug fixing and code cleanup. 5. wiki design page update. Best Regards, Dave Chen

4 7

[Engine-devel] Move SQL out of stored procedures
by Juan Hernandez 02 Apr '13

02 Apr '13

Hello, I would like to start a discussion about the subject. I think this is something we need to do if one day we want to be able to use any database other than PostgreSQL. I did an small example of what it takes and how it looks like to have the SQL code into the DAOs: http://gerrit.ovirt.org/13347 It isn't rocket science, it isn't an exciting task, it isn't fun, but something I think we should eventually do. I appreciate any comment about how and when to do this, including those saying that instead of this primitive approach we should use this or that ORM framework. Regards, Juan Hernandez -- Dirección Comercial: C/Jose Bardasano Baos, 9, Edif. Gorbea 3, planta 3ºD, 28016 Madrid, Spain Inscrita en el Reg. Mercantil de Madrid – C.I.F. B82657941 - Red Hat S.L.

13 25

[Engine-devel] Sandro Bonazzola as a tools maintainer
by Keith Robertson 02 Apr '13

02 Apr '13

I would like to propose that we add Sandro Bonazzola as a maintainer for the Ovirt ISO Uploader, Image Uploader and Log Collector. He too has been enormously helpful with the maintenance of the tools. Thanks, Keith Robertson

6 5

[Engine-devel] Generatic Mac Pool Ranges - feedback requested
by Alex Lourie 31 Mar '13

31 Mar '13

Hi In a current setup flow there are 3 ways of generating mac pool ranges: 1. Generated from the second and third parts of the first non-local IP: {base MAC}:{IP part2}:{IP part3}:00-{base MAC}:{IP part2}:{IP part3}:ff 2. If (1) could not be done for some reason, we have default values in setup. 3. If (2) didn't work for some reason, the values are left as created during DB creation. Assuming that we want (1) to work the best way possible, and to create "random" enough values for Mac Pool ranges, I would ask for an opinion for a better way. I am considering creating random int values instead of fetching the IP as it's simpler and safer than parsing 'ip a' output. Thanks. Alex Lourie Software Engineer in Integration Red Hat.

1 0

Re: [Engine-devel] webadmin: UI plugin dialog API improved
by Vojtech Szocs 29 Mar '13

29 Mar '13

Hi Daniel, these are excellent questions! I'm CC'ing engine-devel to reach out to everyone who might be interested in them. > why dialogToken is mandatory? (wouldn't it be more convenience to make it optional?) dialogToken is used to work with the dialog once it's displayed via showDialog API function. For example, there are no buttons defined for the dialog by default, so you might want to define at least a "Close" button: api.showDialog('My Dialog', 'my-dialog', 'http://www.abc.com/', '800px', '600px', { buttons: [ { label: 'Close', onClick: function() { api.closeDialog('my-dialog'); } } ] }); As you can see, you need dialogToken at least to close the dialog :) another example of a dialog button: { label: 'Load different content', onClick: function() { api.setDialogContentUrl('my-dialog', 'http://www.xyz.com/'); } } (The above are just simple examples, you can put whatever code you like into onClick function.) > what are dialogToken's restrictions (no-spaces?/etc...) Unlike historyToken in custom tab API (addMainTab/addSubTab/etc.), dialogToken doesn't have any restrictions. It's recommended to use "token-string-lowercase-without-spaces" syntax, but it's just a recommendation. As for historyToken in custom tab API, the "token-string-lowercase-without-spaces" syntax is preferred, because historyToken value will be part of WebAdmin URL (e.g. WebAdmin.html#my-main-tab) when navigating to the given custom tab. Regards, Vojtech ----- Original Message ----- From: "Daniel Erez" <derez(a)redhat.com> To: "Vojtech Szocs" <vszocs(a)redhat.com> Sent: Thursday, March 28, 2013 8:14:38 PM Subject: webadmin: UI plugin dialog API improved Hi Voj, Some qqs about showDialog api: * why dialogToken is mandatory? (wouldn't it be more convenience to make it optional?) * what are dialogToken's restrictions (no-spaces?/etc...) 10x, Daniel

1 0

[Engine-devel] Kiril Nesenko as a tools maintainer
by Keith Robertson 29 Mar '13

29 Mar '13

I would like to propose that we add Kiril Nesenko as a maintainer for the Ovirt ISO Uploader, Image Uploader and Log Collector. He has been enormously helpful with the maintenance of the tools. Thanks, Keith Robertson

8 8

[Engine-devel] oVirt web GUI no longer supports Microsoft Internet Explorer 6 and 7
by Vojtech Szocs 29 Mar '13

29 Mar '13

Hello everyone, please be advised that oVirt web GUI (WebAdmin & UserPortal) no longer supports Microsoft Internet Explorer 6 and 7. It's still possible to use Internet Explorer 8, although it has known performance issues which impact overall application performance. For WebAdmin, it's recommended to use Internet Explorer 9 or above. We decided to drop support for Internet Explorer 6 and 7 mainly because of poor JavaScript & rendering engine performance and poor compliance to HTML5 standards. Regards, Vojtech

1 0

[Engine-devel] UI Plugins: addMainTabActionButton API improved
by Vojtech Szocs 29 Mar '13

29 Mar '13

Hi guys, it's now possible to specify location (representation) of buttons added via addMainTabActionButton API. For example: api.addMainTabActionButton('Host', 'My Button', { location: 'OnlyFromContext', onClick: function() { ... }, ... }); Supported values for button location: * 'OnlyFromContext' - button available only from context menu * 'OnlyFromToolBar' - button available only from toolbar (action panel) * 'ContextAndToolBar' (default) - button available from both context menu and toolbar (action panel) Regards, Vojtech

1 0

[Engine-devel] No need to compile for all browsers when debugging oVirt Frontend applications
by Vojtech Szocs 29 Mar '13

29 Mar '13

Hi guys, I've just learned that it's not necessary to do GWT compilation for *all browsers* in order to debug given oVirt Frontend application (WebAdmin or UserPortal). Full oVirt build & deploy to Engine is still recommended, but you can use "gwt.userAgent" property to restrict GWT compilation only for a couple of browsers: $ mvn clean install -Pdep,gwt-admin,gwt-user -Dgwt.userAgent=gecko1_8,ie8 The example above means "compile only for Firefox and IE8". I suspect it's because of GWT permutation selector script (*.nocache.js) being optimized-out in case you perform compilation for a single browser, which might interfere with the way how GWT plugin connects to Development Mode. Regards, Vojtech

1 0

[Engine-devel] Adding JCommander library to projects
by Martin Perina 28 Mar '13

28 Mar '13

Hi, I'm currently working on bug 904029, support for POSIX parameters and values in engine-manage-domains. I think there are two possible solutions: 1) Write custom parser (similar to EngineConfigCLIParser used for engine-config) 2) Add CLI parsing library to project and use it for all command line clients (first implementation could be for engine-manage-domains) I think 2) is much better approach, but I'm not sure about the process of adding new library to project. Personally I like JCommander ( http://jcommander.org ), using annotation for parameter specification is great. JCommander is licensed with Apache 2.0 license, so the addition shouldn't be a problem. So, would it be possible to add JCommander library to project? Martin Perina

2 2

[Engine-devel] Adding support for OpenLDAP to oVirt
by Uwe Grawert 26 Mar '13

26 Mar '13

Hello together, regarding support for OpenLDAP as domain provider I found this mail from last year on ovirt-users list :http://lists.ovirt.org/pipermail/users/2012-July/002791.html I would like to add support for OpenLDAP to oVirt. As a start I had a look at ovirt-engine/backend/manager/modules/bll/src/main/java/org/ovirt/engine/core/bll/adbroker/ITDS* which seems to be very similar to the RHDS classes. I simply copied all ITDS*.java files to OpenLdap*.java and changed class names and so forth from ITDS/itds to OpenLdap/openLdap. I also changed user and group attributes to make sense for OpenLDAP. Additionally I enhanced the LdapQueryMetadataFactoryImpl class, again copying mostly from ITDS and others. To the very last I enhanced the enum at ovirt-engine/backend/manager/modules/utils/src/main/java/org/ovirt/engine/core/ldap/LdapProviderType.java with an OpenLDAP entry. Right now I do not oversee the whole LDAPBroker code. Especially I do not know how enum at LdapProviderType.java is related the code found at bll/adbroker/*. Could you please give me some guidance and advise, if I am on the right track? I could also send a diff of all changes to the list, if that is helpful. Thanks very much.

3 13

[Engine-devel] Best place for new interfaces used by bll
by Ravi Nori 22 Mar '13

22 Mar '13

Hi, I am working on refactoring some of the backend code in bll and need to create interfaces so that I can eliminate the dependency between bll and the new module. Currently I created the interfaces in org.ovirt.engine.core.common.interfaces, but from what I understand this module is used by both frontend and backend. The new interfaces will only be used by the backend. What would be the best place to put these new interfaces? Ravi

6 6

[Engine-devel] Error during "Create new VM"
by Deepak C Shetty 21 Mar '13

21 Mar '13

Hi, I get the following error in the engine web gui while trying to create a new VM (server or desktop) Error: gvm: Cannot add VM if custom VM properties are in invalid format. Please check the input. Whats custom property is it talking about ? Under 'Custom Property' in new VM Dialog.. it has nothing.. it says "no properties" I am on a git based engine setup.... trying to validate gluster storage domain, but unable to proceed from this step. Any workarounds/inputs appreciate thanx, deepak

2 4

[Engine-devel] watchdog patchset
by Laszlo Hornyak 21 Mar '13

21 Mar '13

Hi, The watchdog patch was broken down into a patchset: http://gerrit.ovirt.org/13057 http://gerrit.ovirt.org/13058 http://gerrit.ovirt.org/13059 http://gerrit.ovirt.org/13060 You are welcome to review it, it is working, however due to internal changes it is being completely rewritten. Laszlo

1 0

[Engine-devel] Features requests for the setup/configuration utilities - feedback requested
by Alex Lourie 19 Mar '13

19 Mar '13

Hi All As we are working on the configuration utilities (engine-setup, engine-upgrade and engine-cleanup), we would like to get as much community involvement as possible. As such, we'd like to hear the wishes of the community in regards with those tools. I've created a wiki page [1] where we will keep the list of feature requests. We would appreciate adding features to the list of by replying to this thread directly. Please do not bugs to that list - the bugs should be resolved in due course according to their priorities and should not affect the features that we would like to implement. Thank you. [1] http://www.ovirt.org/Features/Engine-Config-Utilities -- Alex Lourie Software Engineer in RHEVM Integration Red Hat

4 10

[Engine-devel] Controlling GWT compiler JVM arguments
by Vojtech Szocs 19 Mar '13

19 Mar '13

Hi guys, for those of you getting "Exception: java.lang.OutOfMemoryError" or similar errors during GWT compilation of WebAdmin/UserPortal, it's now possible to override default JVM arguments for GWT compiler via command line. For example: $ mvn clean install -Pdep,gwt-admin,gwt-user -Dgwt-plugin.extraJvmArgs="-Xms1024M -Xmx2048M -XX:PermSize=256M -XX:MaxPermSize=512M" Note: you can find default "gwt-plugin.extraJvmArgs" value in $OVIRT_HOME/frontend/webadmin/modules/pom.xml Regards, Vojtech

1 0

[Engine-devel] vfs_type not being sent by engine to VDSM for GLUSTER DOMAIN case
by Deepak C Shetty 19 Mar '13

19 Mar '13

This is a multi-part message in MIME format. --------------040206010801040103040709 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit I by mistake sent this earlier to users@ovirt I think the right list is engine-devel, hence resending. Sorry for the mispost earlier. -------- Original Message -------- Subject: vfs_type not being sent by engine to VDSM for GLUSTER DOMAIN case Date: Mon, 18 Mar 2013 20:23:57 +0530 From: Deepak C Shetty <deepakcs(a)linux.vnet.ibm.com> Organization: IBM India Pvt. Ltd. To: users(a)ovirt.org <users(a)ovirt.org>, Sharad Mishra <snmishra(a)us.ibm.com> Hi All, I am validating GLUSTERFS Storage domain engine patches (worked on by Sharad, in Cc) as posted here... http://gerrit.ovirt.org/#/q/status:open+project:ovirt-engine+branch:master+… against VDSM Glusterfs domain support (already upstream in VDSM) I see the below issue as part of me creatign a new Gluster Storage DOmain in the UI Engine logs... 2013-03-18 13:27:29,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (http--0.0.0.0-8700-1) [4b751967] START, ConnectStorageServerVDSCommand(HostName = vm-vdsm-de-1, HostId = c0ff5edc-4e30-4553-9125-2d1cee9f19ec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = GLUSTERFS, connectionList = [{ id: null, connection: vm-vdsm-de-1:dpkvol4, iqn: null, vfsType: glusterfs, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: f88d42d VDSM Logs... Thread-77::INFO::2013-03-18 13:32:35,541::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=7, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'vm-vdsm-de-1:dpkvol4', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None)*--> Notice no vfs_type here !!!* VDSM doesn't recv. the vfs_type in the conList dict !!! I had this small chat with Saggi of VDSM, just to confirm that there isn't a possibility that VDSM might be stripping args that are recd. from Engine.. and it doesn't. --------------------------------------------------------------------------------------------------------------------- <deepakcs> saggi, Hi <saggi> deepakcs: hi <deepakcs> saggi, Is it possible that VDSM might strip down some of the connparams that are recd. as part of connectStorageServer ? <deepakcs> saggi, In engine log for GLUSTERFS_DOMAIN i see vfsType being passed, but connectStorageServer log doesn't show vfs_type in the params dict <deepakcs> saggi, so wodering where vfs_type is getting dropped in this whole process <saggi> Probably not being sent <saggi> if it's not being logged <deepakcs> saggi, engine log has this.... <deepakcs> 2013-03-18 13:27:29,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (http--0.0.0.0-8700-1) [4b751967] START, ConnectStorageServerVDSCommand(HostName = vm-vdsm-de-1, HostId = c0ff5edc-4e30-4553-9125-2d1cee9f19ec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = GLUSTERFS, connectionList = [{ id: null, connection: vm-vdsm-de-1:dpkvol4, iqn: null, vfsType: glusterfs, mountOptions: null, nfsVersion: nul <deepakcs> l, nfsRetrans: null, nfsTimeo: null };]), log id: f88d42d <deepakcs> saggi, on VDSM side i see this... <deepakcs> Thread-77::INFO::2013-03-18 13:32:35,541::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=7, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'vm-vdsm-de-1:dpkvol4', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) --> Notice no vfs_type here !!! <saggi> Then you are not sending the correct connection type <deepakcs> saggi, 'you' means the engine side of code ? engine patches is being done by Sharad, and I amtrying to work with them on this issue <deepakcs> saggi, domType=7 is GLUSTERFS_DOMAIN, so its correct on that front <saggi> If it show nfsRetrans you are using nfs which doesn't have a vfs_type argument <deepakcs> saggi, but engine log says storageType = GLUSTERFS <deepakcs> saggi, maybe i can send mail to users@ovirt list to see if anybody can provide more clues <deepakcs> saggi, but definitely this doesn't looks like a vdsm side of issue rite ? <saggi> We log the params as we get them <deepakcs> saggi, right, thats what i also see.. just wanted to confirm once with you, before i sent mail to ovirt folks --------------------------------------------------------------------------------------------------------------------- Can someone help provide any clues on what might be the issue here ? Because VDSM doesn't see vfs_type, the connectStorageServer fails and hence new SD cannot be created ! thanx, deepak --------------040206010801040103040709 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=ISO-8859-1"> </head> <body bgcolor="#FFFFFF" text="#000000"> <tt>I by mistake sent this earlier to users@ovirt I think the right list is engine-devel, hence resending. Sorry for the mispost earlier. </tt> <div class="moz-forward-container"> -------- Original Message -------- <table class="moz-email-headers-table" border="0" cellpadding="0" cellspacing="0"> <tbody> <tr> <th align="RIGHT" nowrap="nowrap" valign="BASELINE">Subject: </th> <td>vfs_type not being sent by engine to VDSM for GLUSTER DOMAIN case</td> </tr> <tr> <th align="RIGHT" nowrap="nowrap" valign="BASELINE">Date: </th> <td>Mon, 18 Mar 2013 20:23:57 +0530</td> </tr> <tr> <th align="RIGHT" nowrap="nowrap" valign="BASELINE">From: </th> <td>Deepak C Shetty <a class="moz-txt-link-rfc2396E" href="mailto:deepakcs@linux.vnet.ibm.com"><deepakcs(a)linux.vnet.ibm.com></a></td> </tr> <tr> <th align="RIGHT" nowrap="nowrap" valign="BASELINE">Organization: </th> <td>IBM India Pvt. Ltd.</td> </tr> <tr> <th align="RIGHT" nowrap="nowrap" valign="BASELINE">To: </th> <td><a class="moz-txt-link-abbreviated" href="mailto:users@ovirt.org">users(a)ovirt.org</a> <a class="moz-txt-link-rfc2396E" href="mailto:users@ovirt.org"><users(a)ovirt.org></a>, Sharad Mishra <a class="moz-txt-link-rfc2396E" href="mailto:snmishra@us.ibm.com"><snmishra(a)us.ibm.com></a></td> </tr> </tbody> </table> <meta http-equiv="content-type" content="text/html; charset=ISO-8859-1"> <tt>Hi All,     I am validating GLUSTERFS Storage domain engine patches (worked on by Sharad, in Cc) as posted here... <a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://gerrit.ovirt.org/#/q/status:open+project:ovirt-engine+branch:master+…">http://gerrit.ovirt.org/#/q/status:open+project:ovirt-engine+branch:master+…</a> against VDSM Glusterfs domain support (already upstream in VDSM) I see the below issue as part of me creatign a new Gluster Storage DOmain in the UI Engine logs... 2013-03-18 13:27:29,149 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (http--0.0.0.0-8700-1) [4b751967] START, ConnectStorageServerVDSCommand(HostName = vm-vdsm-de-1, HostId = c0ff5edc-4e30-4553-9125-2d1cee9f19ec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = GLUSTERFS, connectionList = [{ id: null, connection: vm-vdsm-de-1:dpkvol4, iqn: null, vfsType: glusterfs, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: f88d42d VDSM Logs... Thread-77::<a moz-do-not-send="true" class="moz-txt-link-freetext" href="INFO::2013-03-18">INFO::2013-03-18</a> 13:32:35,541::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=7, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'vm-vdsm-de-1:dpkvol4', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) --> Notice no vfs_type here !!! VDSM doesn't recv. the vfs_type in the conList dict !!! I had this small chat with Saggi of VDSM, just to confirm that there isn't a possibility that VDSM might be stripping args that are recd. from Engine.. and it doesn't. </tt> <tt><tt>--------------------------------------------------------------------------------------------------------------------- </tt><deepakcs> saggi, Hi <saggi> deepakcs: hi <deepakcs> saggi, Is it possible that VDSM might strip down some of the connparams that are recd. as part of connectStorageServer ? <deepakcs> saggi, In engine log for GLUSTERFS_DOMAIN i see vfsType being passed, but connectStorageServer log doesn't show vfs_type in the params dict <deepakcs> saggi, so wodering where vfs_type is getting dropped in this whole process <saggi> Probably not being sent <saggi> if it's not being logged <deepakcs> saggi, engine log has this.... <deepakcs> 2013-03-18 13:27:29,149 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (http--0.0.0.0-8700-1) [4b751967] START, ConnectStorageServerVDSCommand(HostName = vm-vdsm-de-1, HostId = c0ff5edc-4e30-4553-9125-2d1cee9f19ec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = GLUSTERFS, connectionList = [{ id: null, connection: vm-vdsm-de-1:dpkvol4, iqn: null, vfsType: glusterfs, mountOptions: null, nfsVersion: nul <deepakcs> l, nfsRetrans: null, nfsTimeo: null };]), log id: f88d42d <deepakcs> saggi,  on VDSM side i see this... <deepakcs> Thread-77::<a moz-do-not-send="true" class="moz-txt-link-freetext" href="INFO::2013-03-18">INFO::2013-03-18</a> 13:32:35,541::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=7, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'vm-vdsm-de-1:dpkvol4', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) --> Notice no vfs_type here !!! <saggi> Then you are not sending the correct connection type <deepakcs> saggi, 'you' means the engine side of code ? engine patches is being done by Sharad, and I amtrying to work with them on this issue <deepakcs> saggi, domType=7 is GLUSTERFS_DOMAIN, so its correct on that front <saggi> If it show nfsRetrans you are using nfs which doesn't have a vfs_type argument <deepakcs> saggi, but engine log says storageType = GLUSTERFS <deepakcs> saggi, maybe i can send mail to users@ovirt list to see if anybody can provide more clues <deepakcs> saggi, but definitely this doesn't looks like a vdsm side of issue rite ? <saggi> We log the params as we get them <deepakcs> saggi, right, thats what i also see.. just wanted to confirm once with you, before i sent mail to ovirt folks --------------------------------------------------------------------------------------------------------------------- Can someone help provide any clues on what might be the issue here ? Because VDSM doesn't see vfs_type, the connectStorageServer fails and hence new SD cannot be created ! thanx, deepak </tt> </div> </body> </html> --------------040206010801040103040709--

3 2

[Engine-devel] restapi - domains
by Shireesh Anjal 18 Mar '13

18 Mar '13

Hi, We are trying to develop a simple android app to monitor and manage gluster clusters by consuming the restapi exposed by engine. The first screen is the login screen, which is similar to the webadmin login screen. Here, we want to populate the combo box of "domains" by fetching it from the restapi. However, the domains api cannot be invoked without authentication! So we have a sort of a chicken-and-egg problem. Any suggestions on how to tackle this? I feel the "domains" api should be "public", in the sense it should not expect authentication. Regards, Shireesh

6 9