- Devel - oVirt List Archives

[Engine-devel] Supposed to add per CPU usage related infomation into engine core and vdsm
by Liao, Chuan (Jason Liao, HPservers-Core-OE-PSC) 10 Mar '14

10 Mar '14

--_000_B63C858E777679458338A30A991BB524015C4A99G2W2441americas_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi All, In order to support NUMA and guest NUMA feature in ovirt. We need per NUMA node CPU usage or per CPU usage related information on eng= ine core. This information will be used for VM who have NUMA aware information and fi= nd the best Host to run it on with best performance. Approach 1: 1. Sample data in vdsm for each CPU stats. (sys, usr, iowait, idle) 2. Calculate the each CPU usage information. (%sys, %usr, %iowait, %id= le) 3. Transport the usage data to engine core. 4. Engine core merge per NUMA node CPU usage. (%sys, %usr, %iowait, %i= dle) Approach 2: 1. Sample data in vdsm for each CPU stats. (sys, usr, iowait, idle) 2. Calculate the each CPU usage information. (%sys, %usr, %iowait, %id= le) 3. VDSM merge per NUMA node CPU usage. (%sys, %usr, %iowait, %idle) 4. Transport the usage data to engine core. Which one do you prefer, and why, or other solution. Best Regards, Jason Liao --_000_B63C858E777679458338A30A991BB524015C4A99G2W2441americas_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"= > <meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang=3D"ZH-CN" link=3D"#0563C1" vlink=3D"#954F72" style=3D"text-justi= fy-trim:punctuation"> <div class=3D"WordSection1"> Hi All,<o:p></o:p> <o:p> </o:p> In order to support NUMA and guest = NUMA feature in ovirt.<o:p></o:p> We need per NUMA node CPU usage or = per CPU usage related information on engine core.<o:p></o:p> <o:p> </o:p> This information will be used for V= M who have NUMA aware information and find the best Host to run it on with = best performance.<o:p></o:p> <o:p> </o:p> Approach 1:<o:p></o:p> <![if !supportLists]>1.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Sample data in vdsm for eac= h CPU stats. (sys, usr, iowait, idle)<o:p></o:p> <![if !supportLists]>2.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Calculate the each CPU usag= e information. (%sys, %usr, %iowait, %idle)<o:p></o:p> <![if !supportLists]>3.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Transport the usage data to= engine core.<o:p></o:p> <![if !supportLists]>4.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Engine core merge per NUMA = node CPU usage. (%sys, %usr, %iowait, %idle)<o:p></o:p> <o:p> </o:p> Approach 2:<o:p></o:p> <![if !supportLists]>1.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Sample data in vdsm for eac= h CPU stats. (sys, usr, iowait, idle)<o:p></o:p> <![if !supportLists]>2.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Calculate the each CPU usag= e information. (%sys, %usr, %iowait, %idle)<o:p></o:p> <![if !supportLists]>3.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>VDSM merge per NUMA node CP= U usage. (%sys, %usr, %iowait, %idle)<o:p></o:p> <![if !supportLists]>4.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Transport the usage data to= engine core.<o:p></o:p> <o:p> </o:p> Which one do you prefer, and why, o= r other solution.<o:p></o:p> <o:p> </o:p> Best= Regards, Jason Liao= <o:p></o:p> <o:p> </o:p> </div> </body> </html> --_000_B63C858E777679458338A30A991BB524015C4A99G2W2441americas_--

3 2

Re: [Engine-devel] [Users] GSoC 14 Idea Discussion - virt-sparsify integration
by Yedidyah Bar David 09 Mar '14

09 Mar '14

----- Original Message ----- > From: "Utkarsh Singh" <utkarshsins(a)gmail.com> > To: users(a)ovirt.org > Sent: Friday, March 7, 2014 7:23:16 PM > Subject: [Users] GSoC 14 Idea Discussion - virt-sparsify integration > > Hello, > > I am Utkarsh, a 4th year undergrad from IIT Delhi and a GSoC-14 > aspirant. I have been lately involved in an ongoing project Baadal > Cloud Computing Platform in my institute, which has got me interested > in oVirt for a potential GSoC project. > > I was going through the virt-sparsify integration project idea. I have > gone through the architecture documentation on the oVirt website. As > far as I understand, the virt-sparsify integration needs to be done on > the VDSM daemon, and it's control is either going to be completely > independent of ovirt-engine (for example running it once every 24 > hours), or it's something that is centrally controlled by the > ovirt-engine through XML/RPC calls. The details are not specified in > the project ideas page. I would like to ask - > > 1. What would be the proposed ideal implementation? (Central-Control > or Independent-Control) > 2. Is virt-sparsify usage going to be automated or > administrator-triggered, or a combination of both? > > > There are some aspects of the idea, which I would like to discuss > before I start working on a proposal. > > It's not necessary that an automated usage of virt-sparsify is limited > to any simple idea. Architecture documentation states that > ovirt-engine has features like Monitoring that would allow > administrators (and possibly users) to be aware of vm-guest > performance as well as vm-host performance. I am not very sure about > how this data is collected, Is it done through MoM, or Is this > directly done by VDSM, or is someone else doing this (for hosts). It > would be great if someone can explain that to me. This information > about vm-guest usage and vm-host health can help in determining how > virt-sparsify is to be used. > > I am also not very clear about the Shared Storage component in the > architecture. Does oVirt make any assumptions about the Shared > Storage. For example, the performance difference between running > virt-sparsify on NFS as compared to running it (if possible) directly > on storage hardware. If the Storage solution is necessarily a NAS > instance, then virt-sparsify on NFS mount is the only option. > > > > Right now, I am in the process of setting up oVirt on my system, and > getting more familiar with the architecture. Regarding my experience. > I am acquainted with both Java and Python. I have little experience > with JBoss, but I have worked on some other Web Application Servers > like web2py and Play Framework. My involvement in Baadal Platform has > got me acquainted with libvirt/QEMU, the details of which I have > mentioned below (if anyone is interested). > > Please advise me about the things that I am missing about this > project. If there are some implementation details that I need to know, > kindly help me with that too. > > > > Looking forward. Thanks. > ===================== > Utkarsh > IIT Delhi > > Ongoing project details - > > Article (Old) > http://www.cc.iitd.ernet.in/CSC/index.php?view=article&id=123:baadal-the-ii… > > Github > https://github.com/apoorvemohan/newbaadal > > My contribution - Deployment Scripting and Sandbox Environment Setup for > Testing > https://github.com/apoorvemohan/newbaadal/tree/master/baadaltesting/sandbox > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > (Adding vdsm-devel and engine-devel) -- Didi

1 0

[Engine-devel] Switched to thread-based GWT worker factory
by Vojtech Szocs 07 Mar '14

07 Mar '14

Hi guys, with patch [1] merged into master, GWT compiler will now use only thread-based GWT worker factory (ThreadedPermutationWorkerFactory) when compiling WebAdmin & UserPortal GUI. [1] http://gerrit.ovirt.org/#/c/25163/ In practice, this means that GWT compiler will spawn up to: max_worker_threads = min(localWorkers, 4) when compiling specific permutations (i.e. browser x locale). Note that localWorkers value can be controlled through: EXTRA_BUILD_FLAGS="-Dgwt.compiler.localWorkers=..." DEV_EXTRA_BUILD_FLAGS="-Dgwt.compiler.localWorkers=..." Before this patch was merged, GWT compiler spawned up to: max_external_processes = localWorkers i.e. using separate Java sub-process (CompilePermsServer) that communicates with GWT compiler process via socket. For localWorkers == 1, tests show minimal-to-zero improvement. However, for localWorkers > 1, tests show a slight improvement in favor of thread-based approach. Let me know if you have any questions. Regards, Vojtech

1 0

[Engine-devel] unable to create ui plugin
by Rohit Agrawal 07 Mar '14

07 Mar '14

i am trying to add the sample space shooter plugin and also helloWorld plugin in webadmin of ovirt engine. here is what i followed: 1. copied the folder through git to /usr/share/ovirt-engine/uiplugins 2. restart ovirt-engine Still unable to see the plugin. Any kind of help is appreciated -- rohit

2 1

[Engine-devel] unable to create ui plugin
by Rohit Agrawal 07 Mar '14

07 Mar '14

i am trying to add the sample space shooter plugin and also helloWorld plugin in webadmin of ovirt engine. here is what i followed: 1. copied the folder through git to /usr/share/ovirt-engine/uiplugins 2. restart ovirt-engine Still unable to see the plugin. Any kind of help is appreciated -- rohit

1 0

[Engine-devel] Tweaking backup/restore of engine
by Sven Kieske 06 Mar '14

06 Mar '14

Hi, currently all events are stored in the table audit_log which all gets saved when you use the engine-backup shell script. the event log is full of these login lines (engine 3.3.2): 25652 fdfc627c-d875-11e0-90f0-83df133b58cc admin@internal 00000000-0000-0000-0000-000000000000 \N \N \N \N \N 2014-01-20 06:39:17.222+01 USER_VDC_LOGIN 30 0 User admin@internal logged in. f \N \N 00000000-0000-0000-0000-000000000000 \N \N \N \N 00000000-0000-0000-0000-000000000000 \N oVirt -1 30 f \N this makes the log and db grow very large when you use the REST-API to query ovirt for various data. Is this necessary for a working restore? It would be cool if we could tweak the engine-backup tool to just dump necessary tables so you don't have to restore events from the past no one is interested in. How does ovirt react, if I do not restore the content of the audit_log table? If this works (restore without audit_log) I would prefer to have this code upstream in ovirt git so I don't have to maintain my own backupscript. Would it be possible to extend the existing backupscript with a switch to not backup logs? Currently it's just "all" or "just db". I also recall that there shouldn't occur multiple login events any more since ovirt 3.3. but it still seems to be the case. I also do not understand how you would manage a stored authentication via REST as REST is stateless. I would appreciate any feedback or thoughts on this topic. -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

6 16

[Engine-devel] oVirt 3.4 RC test day
by Doron Fediuck 05 Mar '14

05 Mar '14

Hi everyone, tomorrow we're planning the last test day for 3.4, based on the RC release. All the needed information can be found in the 3.4 test day wiki[1]. See you all tomorrow, Doron [1] http://www.ovirt.org/OVirt_3.4_Test_Day

1 0

[Engine-devel] Schema upgrade failure on master
by Adam Litke 05 Mar '14

05 Mar '14

Hi, I've recently rebased to master and it looks like the 03_05_0050_event_notification_methods.sql script is failing on schema upgrade. Is this a bug or am I doing something wrong? To upgrade I did the normal proceedure with my development installation: make install-dev ... ~/ovirt/bin/engine-setup Got this result in the log file: psql:/home/alitke/ovirt-**FILTERED**/share/ovirt-**FILTERED**/dbscripts/upgrade/03_05_0050_event_notification_methods.sql:10: ERROR: column "notification_method" contains null values FATAL: Cannot execute sql command: --file=/home/alitke/ovirt-**FILTERED**/share/ovirt-**FILTERED**/dbscripts/upgrade/03_05_0050_event_notification_methods.sql 2014-03-03 17:20:34 DEBUG otopi.context context._executeMethod:152 method exception Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/otopi/context.py", line 142, in _executeMethod method['method']() File "/home/alitke/ovirt-**FILTERED**/share/ovirt-**FILTERED**/setup/bin/../plugins/ovirt-**FILTERED**-setup/ovirt-**FILTERED**/db/schema.py", line 280, in _misc osetupcons.DBEnv.PGPASS_FILE File "/usr/lib/python2.7/site-packages/otopi/plugin.py", line 451, in execute command=args[0], RuntimeError: Command '/home/alitke/ovirt-**FILTERED**/share/ovirt-**FILTERED**/dbscripts/schema.sh' failed to execute -- Adam Litke

6 8

[Engine-devel] [ATN][devenv] update for otopi
by Alon Bar-Lev 05 Mar '14

05 Mar '14

Hello All, I would like to ask you to update your otopi package on your development machines to at least otopi-1.2.0_0.7. It is much closer to what we are going to release and will avoid many unrelated errors within log file due to a change in engine that soon to be applied. Please also notice that the nightly repository was modified recently and it is now changed place and was split here[1] and here[2], so it is a good opportunity to modify this as well in your /etc/yum.repo.d and have them both, dropping the old nightly. Thank you, Alon [1] http://resources.ovirt.org/pub/ovirt-snapshot/ [2] http://resources.ovirt.org/pub/ovirt-snapshot-static/

1 0

[Engine-devel] [ANN] oVirt 3.3.4 release
by Sandro Bonazzola 04 Mar '14

04 Mar '14

The oVirt development team is pleased to announce the general availability of oVirt 3.3.4 as of March 4th 2014. This release solidifies oVirt as a leading KVM management application and open source alternative to VMware vSphere. oVirt is available now for Fedora 19 and Red Hat Enterprise Linux 6.5 (or similar). This release of oVirt includes numerous bug fixes. See the release notes [1] for a list of the new features and bugs fixed. The existing repository ovirt-stable has been updated for delivering this release without the need of enabling any other repository. A new oVirt Node build is also available [2]. [1] http://www.ovirt.org/OVirt_3.3.4_release_notes [2] http://resources.ovirt.org/releases/3.3.4/iso/ovirt-node-iso-3.0.4-1.0.2014… -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0