March 2014 - Devel - oVirt List Archives

[Engine-devel] Vms search issue
by Moti Asayag 18 Mar '14

18 Mar '14

Hi, As a result of patch "core : Search VMs based on MAC address" [1] The same vm is returned by the search query as the number of its nics. I'd suggest to revert this patch and not introduce a join between vnics to vm_static vms: first, it won't return the expected result when a vm has more than a signle nic, second due to adding great impact on that view. As an alternative, I'd suggest utilizing the join in the search-engine with vm_interface_view. See SearchObjectAutoCompleter: // vms - vm network interface addJoin(SearchObjects.VM_OBJ_NAME, "vm_guid", SearchObjects.VM_NETWORK_INTERFACE_OBJ_NAME, "vm_guid"); So the query will look like: "vms: vnic.MAC = 'xx:xx:xx:xx:xx:xx'" [1] http://gerrit.ovirt.org/#/c/25805 Regards, Moti

2 1

[Engine-devel] migration of VM, which protocol actually works?
by aditya mamidwar 17 Mar '14

17 Mar '14

i wanted to learn about the modules so that i could understand how the engine POSTS and sends data to the backend sql database and other scripts to perform various options. for e.g i need to know which code actually collects the storage path for the ISO s during ISCSI storage domain setup. also how the hosts, clusters and data centers are made and stored at the backend. if i want to add a new UI that bypasses some of these complicated tasks (again for personal understanding), will I be able to do that. Also i would like to mention that am working on making a little changes to how the ISCSI protocol works.. My another doubt is: when are the NFS/ISCSI/FC protocols actually used in ovirt. like what part of the VM running state? are their purpose limited to just copying the ISO from the storage center to the path required by the Host. Are the protocols them self responsible for sending and getting data during VM execution on a node. The concept of node and migration has left me a little confused. since each node can run multiple VMs , so during the running/execution of the VM , do the network protocols actully work, if not , then how is that achieved. if yes, again my question arises, which module should i focus on regarding this issue. thanks -- -Aditya Mamidwar

2 1

Re: [Engine-devel] Bug 1076530 – engine shouldn't kill the vds running the VM with the hosted engine
by Doron Fediuck 17 Mar '14

17 Mar '14

----- Original Message ----- > From: "Yedidyah Bar David" <didi(a)redhat.com> > To: "Doron Fediuck" <dfediuck(a)redhat.com> > Cc: "Sandro Bonazzola" <sbonazzo(a)redhat.com>, "Jiri Moskovcak" <jmoskovc(a)redhat.com> > Sent: Sunday, March 16, 2014 12:28:27 PM > Subject: Re: Bug 1076530 – engine shouldn't kill the vds running the VM with the hosted engine > > Might be better to discuss this on bugzilla. > Bugzilla is not a mailing list. Moving to engine-devel. > ----- Original Message ----- > > From: "Doron Fediuck" <dfediuck(a)redhat.com> > > To: "Sandro Bonazzola" <sbonazzo(a)redhat.com> > > Cc: "Yedidyah Bar David" <didi(a)redhat.com>, "Jiri Moskovcak" > > <jmoskovc(a)redhat.com> > > Sent: Sunday, March 16, 2014 12:01:51 PM > > Subject: Bug 1076530 – engine shouldn't kill the vds running the VM with > > the hosted engine > > > > https://bugzilla.redhat.com/show_bug.cgi?id=1076530 > > > > Sandro, > > I think this would be solved by a better validation during setup / > > deployment. > > This can't be done during Validation in the otopi sense of the word. > At that point the engine does not exist yet and so we can't know what > versions it supports etc. > Why not? You have the vdsm supported versions in a file (dsaversion IIRC) and you should be able to get the relevant engine info before or after deploying the DB. > It might be possible (didn't check) to check the versions right before > trying to add the host to the cluster. This means we do not want to > abort (as we can do during Validation if something does not pass it). > What can we do? Perhaps offer a few options: > 1. Do abort (will do mostly what happens today) > 2. Let the user try to manually fix, probably by trying to change > the compatibility version of the cluster, and then try adding the > host again > 3. Try to fix ourselves (same) and try adding again > 4. Best would be to someone upgrade libvirt and reconfigure vdsm. > Not sure that's easy or even possible at this stage, where VM is > running and we do not want to loose it. > > Thinking about this again, I am not sure the current behavior is that > bad. "Fixing" by re-installing with the correct versions is probably > way simpler than fixing after installation is (mostly) complete. > > > > > I'm not keen on adding hosted-engine logic into the engine code. > > Not sure about that. Not that it would help much, because the root > problem will still have to be solved, but in principle it might be > a good thing if the engine knows that killing some host will kill itself, > and so try harder to not do that and just leave it in some zombie, > requires-manual-action state. This is obviously more important during > normal operation than during installation. > -- > Didi >

3 7

[Engine-devel] Source code unerstanding
by aditya mamidwar 16 Mar '14

16 Mar '14

Hey, is there a simpler way to know which code is responsible for which module of the engine. is there a documentation maintained. or how can identify the files which are important for me. -- -Aditya Mamidwar

4 3

[Engine-devel] adding scripts
by aditya mamidwar 14 Mar '14

14 Mar '14

I want to commit changes to the engine by adding some bash scripts. the scripts should be invoked once a button or tab is selected in the webadmin portal by the user. can someone guide on achieving this. -- -Aditya Mamidwar

3 2

[Engine-devel] attn ui devs: why do we use inputs for labels?
by Greg Sheremeta 14 Mar '14

14 Mar '14

Hi fellow UI developers, Can someone explain why we are using "input type=text" fields to render labels? (see screenshot[1]) This seems like bad practice for a few reasons: * it's not semantic HTML * inputs do not have variable sizing like text. They cannot shrink down to the size of the text, which makes positioning difficult. * common browser extensions such as LastPass can be confused (see screenshot[1] -- lastpass sees these labels for the text fields they are, and attempts to help the user fill them in -- that's what those gray asterisks are. Very confusing.) I'd like to pursue correcting this, if possible. Thanks, Greg [1] http://i.imgur.com/AweOhJe.png Greg Sheremeta Red Hat, Inc. Sr. Software Engineer, RHEV Cell: 919-807-1086 gshereme(a)redhat.com

3 4

[Engine-devel] [ANN] oVirt Node ISO for oVirt 3.4 RC 2
by Fabian Deutsch 14 Mar '14

14 Mar '14

--=-XfnQPOo0nEpleRZqDZq2 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hey, let me announce a respun oVirt Node for oVirt 3.4 RC 2. After some time this is finally available from where it belongs: http://resources.ovirt.org/releases/3.4.0_pre/iso/ovirt-node-iso-3.0.4-1.0.= 201401291204.vdsm34rc2.el6.iso There are also older releases of oVirt Node, in case that the latest version has unknown regressions. http://resources.ovirt.org/releases/3.4.0_pre/iso/ Please let us known about issues you run into. You can also let us know when Node "Just Works (TM)". Greetings fabian --=-XfnQPOo0nEpleRZqDZq2 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) iQIcBAABAgAGBQJTIykgAAoJEC9+uOgSHVGUnX4P/2TUR2eMvhscP0KSgL9T5hmV 23+zzQVc8xIVSAY2ko+GLlaYsZ9Ui7C5fB1mDOx0zjUQ8qqwsDvBzkTDJAX3sFhD HzIjfcF97CPKdRVbpT6qrFVyHew4dR+CloJT5iuxiidO3dXlDGvUarByfeYZ97cJ /T1BDx4Gi3vxx0hVG0/rzDZvqmrYa34SlbM9B7mP1OhVwU2ZgfD0+KjrnaLbeGUJ Y2jh//Zr9g+0mzGWTdjEZ1dlR4XXf6qLG53r49cX00zkC66BOLeaBoI67ngD6ah5 9Qj2zDhgN98TvF8QWQk6clzFFDuqTwX2fKbNnjy/6khH1xg9S95Vxn8f3o3HPtS0 CSh1mg+fs3EoMWj8W2kYrmVjs6CkXa0YI+pAAGacKkInLzuMgvTYUEDNYbAKdTFu kNz+Eps6ay8wWXHgR9QOXCakBfGliWcIVcR7CbwGbB+lsWrh5/l3eGKY0KzTaDR8 q/ieq6O6F7Uik2N+J347Sh9fyobUftaa75cbfQS9bfF7n4F44PRDJeYUjEkpZEo6 mRUhdi3OWlP+kergTaDst68NsR91F1P6FsO9cc3QlejmjH7ZpmtQDsqAtRDMvoCG 25Oqj5Rq425GOx9OfMwvRpZ1N8PjiPLxP4wLLaR6bgyw4EG4VirugPRImtfCf+4d Bd+qMPHfWkLunO8mioec =DTiV -----END PGP SIGNATURE----- --=-XfnQPOo0nEpleRZqDZq2--

1 0

[Engine-devel] Dependency checking tool
by Rohit Agrawal 12 Mar '14

12 Mar '14

hi, i am now trying to make some changes in ovirt engine code for which i neede to see the dependency. As there are many pom.xml files. Is there any dependency tool to see all the dependency. -- Regards, rohit

4 3

Re: [Engine-devel] oVirt Engine 3.2 ReST API
by Omer Frenkel 12 Mar '14

12 Mar '14

------=_Part_25735698_241434152.1394606717688 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit ----- Original Message ----- > From: "Vikas Kokare" <vikaskokare(a)gmail.com> > To: "Omer Frenkel" <ofrenkel(a)redhat.com> > Sent: Wednesday, March 12, 2014 5:24:11 AM > Subject: Re: [Engine-devel] oVirt Engine 3.2 ReST API > The problem is this situation is not obvious from the documentation. The data > center field on the cluster is defined as required during creation and > non-updatable. How can that be explained? So its a question not just for > this example but for other entity associations too. i guess this is a bug in the documentation, this field is editable in this specific case only. can you open a bug? > On Tue, Mar 11, 2014 at 5:56 PM, Omer Frenkel < ofrenkel(a)redhat.com > wrote: > > > From: "Vikas Kokare" < vikaskokare(a)gmail.com > > > > > > > To: engine-devel(a)ovirt.org > > > > > > Sent: Tuesday, March 11, 2014 12:11:41 PM > > > > > > Subject: [Engine-devel] oVirt Engine 3.2 ReST API > > > > > > As per the API documentation, the host cluster element "data_center id=" > > > is > > > both required at creation(exclamation in a triangle) as well as > > > non-updatable(lock sign). Is it right to consider that, not only is this > > > a > > > required element, but it can't be changed and deleting(disassociation) is > > > out of question? > > > > > > We have a RHEVM environment, where one such host cluster was created > > > initially being associated to a data center. Later someone changed > > > something, that resulted in the specific host cluster having no > > > "data_center" element on it. Could it be that the association was > > > deleted, > > > or that the data_center itself was deleted, but the system didn't honor > > > referential integrity, that it was being referred by other objects? > > > > > > _______________________________________________ > > > > > > Engine-devel mailing list > > > > > > Engine-devel(a)ovirt.org > > > > > > http://lists.ovirt.org/mailman/listinfo/engine-devel > > > > > it is possible to remove a data-center, even if it has clusters, > > > as long there is no usage in the storage (vms, templates..) > > > this makes the clusters to have no data-center, > > > and then the cluster can be joined to a different data center > > (new/existing) > ------=_Part_25735698_241434152.1394606717688 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><div> </div><div> </div><hr id= =3D"zwchr"><blockquote style=3D"border-left:2px solid #1010FF;margin-left:5= px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-de= coration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-= mce-style=3D"border-left: 2px solid #1010FF; margin-left: 5px; padding-left= : 5px; color: #000; font-weight: normal; font-style: normal; text-decoratio= n: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;">From= : "Vikas Kokare" <vikaskokare(a)gmail.com> To: "Omer Fren= kel" <ofrenkel(a)redhat.com> Sent: Wednesday, March 12, 2014 = 5:24:11 AM Subject: Re: [Engine-devel] oVirt Engine 3.2 ReST API<= br><div> </div><div dir=3D"ltr">The problem is this situation is not obv= ious from the documentation. The data center field on the cluster is define= d as required during creation and non-updatable. How can that be explained?= So its a question not just for this example but for other entity associati= ons too. </div></blockquote><div>i guess this is a bug in the documentat= ion, </div><div>this field is editable in this specific case only. </= div><div>can you open a bug? </div><blockquote style=3D"border-left:2px = solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:norma= l;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-s= erif;font-size:12pt;" data-mce-style=3D"border-left: 2px solid #1010FF; mar= gin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-st= yle: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif= ; font-size: 12pt;"><div class=3D"gmail_extra"><div> </div><div class=3D= "gmail_quote">On Tue, Mar 11, 2014 at 5:56 PM, Omer Frenkel <<a href=3D"mailto:ofrenkel@redhat.com" target=3D"_blank" data-mce-hr= ef=3D"mailto:ofrenkel@redhat.com">ofrenkel(a)redhat.com</a>> wrote:= <blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-lef= t:1px #ccc solid;padding-left:1ex" data-mce-style=3D"margin: 0 0 0 .8ex; bo= rder-left: 1px #ccc solid; padding-left: 1ex;"><div><div style=3D"font-size= :12pt;font-family:times new roman,new york,times,serif" data-mce-style=3D"f= ont-size: 12pt; font-family: times new roman,new york,times,serif;"><div><b= r></div><div> </div><hr><blockquote style=3D"padding-left:5px;font-size:= 12pt;font-style:normal;margin-left:5px;font-family:Helvetica,Arial,sans-ser= if;text-decoration:none;font-weight:normal;border-left:2px solid #1010ff" d= ata-mce-style=3D"padding-left: 5px; font-size: 12pt; font-style: normal; ma= rgin-left: 5px; font-family: Helvetica,Arial,sans-serif; text-decoration: n= one; font-weight: normal; border-left: 2px solid #1010ff;">From: "Vi= kas Kokare" <<a href=3D"mailto:vikaskokare@gmail.com" target=3D"_blank" = data-mce-href=3D"mailto:vikaskokare@gmail.com">vikaskokare(a)gmail.com</a>&gt= ; To: <a href=3D"mailto:engine-devel@ovirt.org" target=3D"_blank"= data-mce-href=3D"mailto:engine-devel@ovirt.org">engine-devel(a)ovirt.org</a>= Sent: Tuesday, March 11, 2014 12:11:41 PM Subject: [En= gine-devel] oVirt Engine 3.2 ReST API<div class=3D""> <div> </div><di= v dir=3D"ltr"><div>As per the API documentation, the host cluster element "= data_center id=3D" is both required at creation(exclamation in a triangle) = as well as non-updatable(lock sign). Is it right to consider that, not only= is this a required element, but it can't be changed and deleting(disassoci= ation) is out of question? </div>We have a RHEVM environment, where = one such host cluster was created initially being associated to a data cent= er. Later someone changed something, that resulted in the specific host clu= ster having no "data_center" element on it. Could it be that the associatio= n was deleted, or that the data_center itself was deleted, but the system d= idn't honor referential integrity, that it was being referred by other obje= cts? </div> </div>_______________________________________________ = Engine-devel mailing list <a href=3D"mailto:Engine-devel@ovirt.org" targ= et=3D"_blank" data-mce-href=3D"mailto:Engine-devel@ovirt.org">Engine-devel@= ovirt.org</a> <a href=3D"http://lists.ovirt.org/mailman/listinfo/engine-= devel" target=3D"_blank" data-mce-href=3D"http://lists.ovirt.org/mailman/li= stinfo/engine-devel">http://lists.ovirt.org/mailman/listinfo/engine-devel</= a> </blockquote><div> </div><div>it is possible to remove a data-cent= er, even if it has clusters, </div><div>as long there is no usage in the= storage (vms, templates..) </div><div>this makes the clusters to have n= o data-center, </div><div>and then the cluster can be joined to a differ= ent data center (new/existing) </div></div></div></blockquote></div> = </div></blockquote><div> </div></div></body></html> ------=_Part_25735698_241434152.1394606717688--

1 0

[Engine-devel] Consider iowait add into usage CPU percentage
by Liao, Chuan (Jason Liao, HPservers-Core-OE-PSC) 11 Mar '14

11 Mar '14

--_000_B63C858E777679458338A30A991BB524015C66EBG1W3780americas_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi All, On engine core, The usage CPU percentage is calculated by %sys + %usr class VdsBrokerObjectsBuilder function updateVDSStatisticsData vds.setCpuSys(AssignDoubleValue(xmlRpcStruct, VdsProperties.cpu_sys)); vds.setCpuUser(AssignDoubleValue(xmlRpcStruct, VdsProperties.cpu_us= er)); if (vds.getCpuSys() !=3D null && vds.getCpuUser() !=3D null) { vds.setUsageCpuPercent((int) (vds.getCpuSys() + vds.getCpuUser(= ))); } On vdsm, The %sys, %usr and %idle is calculated like below workflow, class API function getStats decStats =3D self._cif._hostStats.get() class clientIF function __init__ self._hostStats =3D sampling.HostStatsThread(log=3Dlog) self._hostStats.start() class HostStatsThread function get hs0, hs1 =3D self._samples[0], self._samples[-1] ... jiffies =3D (hs1.totcpu.user - hs0.totcpu.user) % (2 ** = 32) stats['cpuUser'] =3D jiffies / interval / self._ncpus jiffies =3D (hs1.totcpu.sys - hs0.totcpu.sys) % (2 ** 32) stats['cpuSys'] =3D jiffies / interval / self._ncpus stats['cpuIdle'] =3D max(0.0, 100.0 - stats['cpuUser'] - stats['cpu= Sys']) class HostSample function __init__ self.totcpu =3D TotalCpuSample() class TotalCpuSample function __init__ self.user, userNice, self.sys, self.idle =3D \ map(int, file('/proc/stat').readline().split()[1:5]) self.user +=3D userNice Question1: Why stats['cpuIdle'] do not use the sampling data totcpu.idle fo= r calculating? Question2: There is another data named iowait in /proc/stat, do we need to = consider add this into usage CPU percentage for calculating? Best Regards, Jason Liao --_000_B63C858E777679458338A30A991BB524015C66EBG1W3780americas_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"= > <meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang=3D"ZH-CN" link=3D"#0563C1" vlink=3D"#954F72" style=3D"text-justi= fy-trim:punctuation"> <div class=3D"WordSection1"> Hi All,<o:p></o:p> <o:p> </o:p> On engine core, The usage CPU perce= ntage is calculated by %sys + %usr<o:p></o:p> <o:p> </o:p> class VdsBrokerObjectsBuilder <o:p></o:p> function updateVDSStatisticsData<o:= p></o:p> <spa= n lang=3D"EN-US" style=3D"font-family:"HP Simplified","sans-= serif"">vds.setCpuSys(AssignDoubleValue(xmlRpcStruct, VdsProperties.cp= u_sys));<o:p></o:p>      &nbsp= ;  vds.setCpuUser(AssignDoubleValue(xmlRpcStruct, VdsProperties.cpu_us= er));<o:p></o:p>      &nbsp= ;  if (vds.getCpuSys() !=3D null && vds.getCpuUser() !=3D null= ) {<o:p></o:p>      &nbsp= ;      vds.setUsageCpuPercent((int) (vds.getCpuSys= () + vds.getCpuUser()));<o:p></o:p>      &nbsp= ;  }<o:p></o:p> <o:p> </o:p> On vdsm, The %sys, %usr and %idle i= s calculated like below workflow,<o:p></o:p> <o:p> </o:p> class API<o:p></o:p> function getStats<o:p></o:p>= <spa= n lang=3D"EN-US" style=3D"font-family:"HP Simplified","sans-= serif"">decStats =3D self._cif._hostStats.get()<o:p></o:p> class clientIF<o:p></o:p></p= > function __init__<o:p></o:p>=      &nbsp= ;             s= elf._hostStats =3D sampling.HostStatsThread(log=3Dlog)<o:p></o:p></p= >      &nbsp= ;  self._hostStats.start()<o:p></o:p> class HostStatsThread<o:p></o:p></s= pan> function get<o:p></o:p>      &nbsp= ;             h= s0, hs1 =3D self._samples[0], self._samples[-1]<o:p></o:p>      &nbsp= ;             &= #8230;<o:p></o:p>      &nbsp= ;             j= iffies =3D (hs1.totcpu.user - hs0.totcpu.user) % (2 ** 32)<o:p></o:p></span= >      &nbsp= ;  stats['cpuUser'] =3D jiffies / interval / self._ncpus<o:p></o:p></s= pan>      &nbsp= ;  jiffies =3D (hs1.totcpu.sys - hs0.totcpu.sys) % (2 ** 32)<o:p></o:p= >      &nbsp= ;  stats['cpuSys'] =3D jiffies / interval / self._ncpus<o:p></o:p></sp= an>      &nbsp= ;  stats['cpuIdle'] =3D max(0.0, 100.0 - stats['cpuUser'] - stats['cpu= Sys'])<o:p></o:p> class HostSample<o:p></o:p><= /p> function __init__<o:p></o:p>=      &nbsp= ;             s= elf.totcpu =3D TotalCpuSample()<o:p></o:p> class TotalCpuSample<o:p></o:p></sp= an> function __init__<o:p></o:p>=      &nbsp= ;   self.user, userNice, self.sys, self.idle =3D \<o:p></o:p></sp= an>      &nbsp= ;      map(int, file('/proc/stat').readline().spli= t()[1:5])<o:p></o:p>      &nbsp= ;  self.user +=3D userNice<o:p></o:p> <o:p> </o:p> Question1: Why stats[‘cpuIdle= ’] do not use the sampling data totcpu.idle for calculating?<o:p></o:= p> <o:p> </o:p> Question2: There is another data na= med iowait in /proc/stat, do we need to consider add this into usage CPU pe= rcentage for calculating?<o:p></o:p> <o:p> </o:p> Best= Regards, Jason Liao= <o:p></o:p> <o:p> </o:p> </div> </body> </html> --_000_B63C858E777679458338A30A991BB524015C66EBG1W3780americas_--

2 2

[Engine-devel] oVirt Engine 3.2 ReST API
by Vikas Kokare 11 Mar '14

11 Mar '14

As per the API documentation, the host cluster element "data_center id=" is both required at creation(exclamation in a triangle) as well as non-updatable(lock sign). Is it right to consider that, not only is this a required element, but it can't be changed and deleting(disassociation) is out of question? We have a RHEVM environment, where one such host cluster was created initially being associated to a data center. Later someone changed something, that resulted in the specific host cluster having no "data_center" element on it. Could it be that the association was deleted, or that the data_center itself was deleted, but the system didn't honor referential integrity, that it was being referred by other objects?

2 1

[Engine-devel] Fwd: [vdsm] ovirt-guest-agent on debian
by Sven Kieske 11 Mar '14

11 Mar '14

Forwarding to engine devel, because it seems there is no interest in this feature on vdsm-devel. Could this get integrated somehow? I managed to reuse the ubuntu build of ovirt-guest-agent for debian. -------- Original-Nachricht -------- Betreff: [vdsm] ovirt-guest-agent on debian Datum: Mon, 10 Mar 2014 09:36:11 +0000 Von: Sven Kieske <S.Kieske(a)mittwald.de> An: VDSM Project Development <vdsm-devel(a)lists.fedorahosted.org> Hi, I just did some additional research, here are my results: on a clean debian 7 x64 VM inside oVirt: I did as root: apt-get install python-software-properties add-apt-repository -y ppa:zhshzhou/vdsm-ubuntu vim /etc/apt/sources.list.d/zhshzhou-vdsm-ubuntu-wheezy.list change the following lines from: deb http://ppa.launchpad.net/zhshzhou/vdsm-ubuntu/ubuntu wheezy main deb-src http://ppa.launchpad.net/zhshzhou/vdsm-ubuntu/ubuntu wheezy main to: deb http://ppa.launchpad.net/zhshzhou/vdsm-ubuntu/ubuntu precise main deb-src http://ppa.launchpad.net/zhshzhou/vdsm-ubuntu/ubuntu precise main then: apt-get update apt-get install ovirt-guest-agent You get an error: Setting up ovirt-guest-agent (1.0.8.201309301944.gitb7f8f2-1ppa1) ... chown: cannot access `/var/log/ovirt-guest-agent/ovirt-guest-agent.log': No such file or directory but it works: ls -lashi /var/log/ovirt-guest-agent/ovirt-guest-agent.log 533212 4.0K -rw-r--r-- 1 ovirtagent ovirtagent 208 Mar 10 10:20 /var/log/ovirt-guest-agent/ovirt-guest-agent.log service ovirt-guest-agent status [ ok ] ovirt-guest-agent is running. IP information shows up in ovirt. it would be cool if the folder "precise" on the ppa could be cloned to be a folder "wheezy". So you would not need to change the apt-sources entries. I don't know why this chown error occurs, but it seems to work! -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen _______________________________________________ vdsm-devel mailing list vdsm-devel(a)lists.fedorahosted.org https://lists.fedorahosted.org/mailman/listinfo/vdsm-devel

3 2

[Engine-devel] ovirt-engine-3.4.0 is broken
by Omer Frenkel 11 Mar '14

11 Mar '14

Hi, looks like both commits: http://gerrit.ovirt.org/#/c/25436/ http://gerrit.ovirt.org/#/c/25313/ introduced an upgrade script with the same number to the 3.4.0 branch, and now build fails. can you please fix this?

4 3

[Engine-devel] Supposed to add per CPU usage related infomation into engine core and vdsm
by Liao, Chuan (Jason Liao, HPservers-Core-OE-PSC) 10 Mar '14

10 Mar '14

--_000_B63C858E777679458338A30A991BB524015C4A99G2W2441americas_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi All, In order to support NUMA and guest NUMA feature in ovirt. We need per NUMA node CPU usage or per CPU usage related information on eng= ine core. This information will be used for VM who have NUMA aware information and fi= nd the best Host to run it on with best performance. Approach 1: 1. Sample data in vdsm for each CPU stats. (sys, usr, iowait, idle) 2. Calculate the each CPU usage information. (%sys, %usr, %iowait, %id= le) 3. Transport the usage data to engine core. 4. Engine core merge per NUMA node CPU usage. (%sys, %usr, %iowait, %i= dle) Approach 2: 1. Sample data in vdsm for each CPU stats. (sys, usr, iowait, idle) 2. Calculate the each CPU usage information. (%sys, %usr, %iowait, %id= le) 3. VDSM merge per NUMA node CPU usage. (%sys, %usr, %iowait, %idle) 4. Transport the usage data to engine core. Which one do you prefer, and why, or other solution. Best Regards, Jason Liao --_000_B63C858E777679458338A30A991BB524015C4A99G2W2441americas_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"= > <meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang=3D"ZH-CN" link=3D"#0563C1" vlink=3D"#954F72" style=3D"text-justi= fy-trim:punctuation"> <div class=3D"WordSection1"> Hi All,<o:p></o:p> <o:p> </o:p> In order to support NUMA and guest = NUMA feature in ovirt.<o:p></o:p> We need per NUMA node CPU usage or = per CPU usage related information on engine core.<o:p></o:p> <o:p> </o:p> This information will be used for V= M who have NUMA aware information and find the best Host to run it on with = best performance.<o:p></o:p> <o:p> </o:p> Approach 1:<o:p></o:p> <![if !supportLists]>1.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Sample data in vdsm for eac= h CPU stats. (sys, usr, iowait, idle)<o:p></o:p> <![if !supportLists]>2.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Calculate the each CPU usag= e information. (%sys, %usr, %iowait, %idle)<o:p></o:p> <![if !supportLists]>3.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Transport the usage data to= engine core.<o:p></o:p> <![if !supportLists]>4.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Engine core merge per NUMA = node CPU usage. (%sys, %usr, %iowait, %idle)<o:p></o:p> <o:p> </o:p> Approach 2:<o:p></o:p> <![if !supportLists]>1.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Sample data in vdsm for eac= h CPU stats. (sys, usr, iowait, idle)<o:p></o:p> <![if !supportLists]>2.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Calculate the each CPU usag= e information. (%sys, %usr, %iowait, %idle)<o:p></o:p> <![if !supportLists]>3.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>VDSM merge per NUMA node CP= U usage. (%sys, %usr, %iowait, %idle)<o:p></o:p> <![if !supportLists]>4.<sp= an style=3D"font:7.0pt "Times New Roman"">   &nbsp= ;  <![endif]>Transport the usage data to= engine core.<o:p></o:p> <o:p> </o:p> Which one do you prefer, and why, o= r other solution.<o:p></o:p> <o:p> </o:p> Best= Regards, Jason Liao= <o:p></o:p> <o:p> </o:p> </div> </body> </html> --_000_B63C858E777679458338A30A991BB524015C4A99G2W2441americas_--

3 2

Re: [Engine-devel] [Users] GSoC 14 Idea Discussion - virt-sparsify integration
by Yedidyah Bar David 09 Mar '14

09 Mar '14

----- Original Message ----- > From: "Utkarsh Singh" <utkarshsins(a)gmail.com> > To: users(a)ovirt.org > Sent: Friday, March 7, 2014 7:23:16 PM > Subject: [Users] GSoC 14 Idea Discussion - virt-sparsify integration > > Hello, > > I am Utkarsh, a 4th year undergrad from IIT Delhi and a GSoC-14 > aspirant. I have been lately involved in an ongoing project Baadal > Cloud Computing Platform in my institute, which has got me interested > in oVirt for a potential GSoC project. > > I was going through the virt-sparsify integration project idea. I have > gone through the architecture documentation on the oVirt website. As > far as I understand, the virt-sparsify integration needs to be done on > the VDSM daemon, and it's control is either going to be completely > independent of ovirt-engine (for example running it once every 24 > hours), or it's something that is centrally controlled by the > ovirt-engine through XML/RPC calls. The details are not specified in > the project ideas page. I would like to ask - > > 1. What would be the proposed ideal implementation? (Central-Control > or Independent-Control) > 2. Is virt-sparsify usage going to be automated or > administrator-triggered, or a combination of both? > > > There are some aspects of the idea, which I would like to discuss > before I start working on a proposal. > > It's not necessary that an automated usage of virt-sparsify is limited > to any simple idea. Architecture documentation states that > ovirt-engine has features like Monitoring that would allow > administrators (and possibly users) to be aware of vm-guest > performance as well as vm-host performance. I am not very sure about > how this data is collected, Is it done through MoM, or Is this > directly done by VDSM, or is someone else doing this (for hosts). It > would be great if someone can explain that to me. This information > about vm-guest usage and vm-host health can help in determining how > virt-sparsify is to be used. > > I am also not very clear about the Shared Storage component in the > architecture. Does oVirt make any assumptions about the Shared > Storage. For example, the performance difference between running > virt-sparsify on NFS as compared to running it (if possible) directly > on storage hardware. If the Storage solution is necessarily a NAS > instance, then virt-sparsify on NFS mount is the only option. > > > > Right now, I am in the process of setting up oVirt on my system, and > getting more familiar with the architecture. Regarding my experience. > I am acquainted with both Java and Python. I have little experience > with JBoss, but I have worked on some other Web Application Servers > like web2py and Play Framework. My involvement in Baadal Platform has > got me acquainted with libvirt/QEMU, the details of which I have > mentioned below (if anyone is interested). > > Please advise me about the things that I am missing about this > project. If there are some implementation details that I need to know, > kindly help me with that too. > > > > Looking forward. Thanks. > ===================== > Utkarsh > IIT Delhi > > Ongoing project details - > > Article (Old) > http://www.cc.iitd.ernet.in/CSC/index.php?view=article&id=123:baadal-the-ii… > > Github > https://github.com/apoorvemohan/newbaadal > > My contribution - Deployment Scripting and Sandbox Environment Setup for > Testing > https://github.com/apoorvemohan/newbaadal/tree/master/baadaltesting/sandbox > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > (Adding vdsm-devel and engine-devel) -- Didi

1 0

[Engine-devel] Switched to thread-based GWT worker factory
by Vojtech Szocs 07 Mar '14

07 Mar '14

Hi guys, with patch [1] merged into master, GWT compiler will now use only thread-based GWT worker factory (ThreadedPermutationWorkerFactory) when compiling WebAdmin & UserPortal GUI. [1] http://gerrit.ovirt.org/#/c/25163/ In practice, this means that GWT compiler will spawn up to: max_worker_threads = min(localWorkers, 4) when compiling specific permutations (i.e. browser x locale). Note that localWorkers value can be controlled through: EXTRA_BUILD_FLAGS="-Dgwt.compiler.localWorkers=..." DEV_EXTRA_BUILD_FLAGS="-Dgwt.compiler.localWorkers=..." Before this patch was merged, GWT compiler spawned up to: max_external_processes = localWorkers i.e. using separate Java sub-process (CompilePermsServer) that communicates with GWT compiler process via socket. For localWorkers == 1, tests show minimal-to-zero improvement. However, for localWorkers > 1, tests show a slight improvement in favor of thread-based approach. Let me know if you have any questions. Regards, Vojtech

1 0

[Engine-devel] unable to create ui plugin
by Rohit Agrawal 07 Mar '14

07 Mar '14

i am trying to add the sample space shooter plugin and also helloWorld plugin in webadmin of ovirt engine. here is what i followed: 1. copied the folder through git to /usr/share/ovirt-engine/uiplugins 2. restart ovirt-engine Still unable to see the plugin. Any kind of help is appreciated -- rohit

2 1

[Engine-devel] unable to create ui plugin
by Rohit Agrawal 07 Mar '14

07 Mar '14

i am trying to add the sample space shooter plugin and also helloWorld plugin in webadmin of ovirt engine. here is what i followed: 1. copied the folder through git to /usr/share/ovirt-engine/uiplugins 2. restart ovirt-engine Still unable to see the plugin. Any kind of help is appreciated -- rohit

1 0

[Engine-devel] Tweaking backup/restore of engine
by Sven Kieske 06 Mar '14

06 Mar '14

Hi, currently all events are stored in the table audit_log which all gets saved when you use the engine-backup shell script. the event log is full of these login lines (engine 3.3.2): 25652 fdfc627c-d875-11e0-90f0-83df133b58cc admin@internal 00000000-0000-0000-0000-000000000000 \N \N \N \N \N 2014-01-20 06:39:17.222+01 USER_VDC_LOGIN 30 0 User admin@internal logged in. f \N \N 00000000-0000-0000-0000-000000000000 \N \N \N \N 00000000-0000-0000-0000-000000000000 \N oVirt -1 30 f \N this makes the log and db grow very large when you use the REST-API to query ovirt for various data. Is this necessary for a working restore? It would be cool if we could tweak the engine-backup tool to just dump necessary tables so you don't have to restore events from the past no one is interested in. How does ovirt react, if I do not restore the content of the audit_log table? If this works (restore without audit_log) I would prefer to have this code upstream in ovirt git so I don't have to maintain my own backupscript. Would it be possible to extend the existing backupscript with a switch to not backup logs? Currently it's just "all" or "just db". I also recall that there shouldn't occur multiple login events any more since ovirt 3.3. but it still seems to be the case. I also do not understand how you would manage a stored authentication via REST as REST is stateless. I would appreciate any feedback or thoughts on this topic. -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

6 16

[Engine-devel] oVirt 3.4 RC test day
by Doron Fediuck 05 Mar '14

05 Mar '14

Hi everyone, tomorrow we're planning the last test day for 3.4, based on the RC release. All the needed information can be found in the 3.4 test day wiki[1]. See you all tomorrow, Doron [1] http://www.ovirt.org/OVirt_3.4_Test_Day

1 0

[Engine-devel] Schema upgrade failure on master
by Adam Litke 05 Mar '14

05 Mar '14

Hi, I've recently rebased to master and it looks like the 03_05_0050_event_notification_methods.sql script is failing on schema upgrade. Is this a bug or am I doing something wrong? To upgrade I did the normal proceedure with my development installation: make install-dev ... ~/ovirt/bin/engine-setup Got this result in the log file: psql:/home/alitke/ovirt-**FILTERED**/share/ovirt-**FILTERED**/dbscripts/upgrade/03_05_0050_event_notification_methods.sql:10: ERROR: column "notification_method" contains null values FATAL: Cannot execute sql command: --file=/home/alitke/ovirt-**FILTERED**/share/ovirt-**FILTERED**/dbscripts/upgrade/03_05_0050_event_notification_methods.sql 2014-03-03 17:20:34 DEBUG otopi.context context._executeMethod:152 method exception Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/otopi/context.py", line 142, in _executeMethod method['method']() File "/home/alitke/ovirt-**FILTERED**/share/ovirt-**FILTERED**/setup/bin/../plugins/ovirt-**FILTERED**-setup/ovirt-**FILTERED**/db/schema.py", line 280, in _misc osetupcons.DBEnv.PGPASS_FILE File "/usr/lib/python2.7/site-packages/otopi/plugin.py", line 451, in execute command=args[0], RuntimeError: Command '/home/alitke/ovirt-**FILTERED**/share/ovirt-**FILTERED**/dbscripts/schema.sh' failed to execute -- Adam Litke

6 8

[Engine-devel] [ATN][devenv] update for otopi
by Alon Bar-Lev 05 Mar '14

05 Mar '14

Hello All, I would like to ask you to update your otopi package on your development machines to at least otopi-1.2.0_0.7. It is much closer to what we are going to release and will avoid many unrelated errors within log file due to a change in engine that soon to be applied. Please also notice that the nightly repository was modified recently and it is now changed place and was split here[1] and here[2], so it is a good opportunity to modify this as well in your /etc/yum.repo.d and have them both, dropping the old nightly. Thank you, Alon [1] http://resources.ovirt.org/pub/ovirt-snapshot/ [2] http://resources.ovirt.org/pub/ovirt-snapshot-static/

1 0

[Engine-devel] [ANN] oVirt 3.3.4 release
by Sandro Bonazzola 04 Mar '14

04 Mar '14

The oVirt development team is pleased to announce the general availability of oVirt 3.3.4 as of March 4th 2014. This release solidifies oVirt as a leading KVM management application and open source alternative to VMware vSphere. oVirt is available now for Fedora 19 and Red Hat Enterprise Linux 6.5 (or similar). This release of oVirt includes numerous bug fixes. See the release notes [1] for a list of the new features and bugs fixed. The existing repository ovirt-stable has been updated for delivering this release without the need of enabling any other repository. A new oVirt Node build is also available [2]. [1] http://www.ovirt.org/OVirt_3.3.4_release_notes [2] http://resources.ovirt.org/releases/3.3.4/iso/ovirt-node-iso-3.0.4-1.0.2014… -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

[Engine-devel] oVrit 3.4.0 branch created
by Sandro Bonazzola 04 Mar '14

04 Mar '14

Hi, as announced yesterday the new branch ovirt-engine-3.4.0 branch has been created from 3.4. Branch commit was: * 9ab9f01 - (origin/ovirt-engine-3.4) core: Remove error messages from log when adding host <lzelkha(a)redhat.com> Only critical fixes will be accepted on ovirt-engine-3.4.0 branch. Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

[Engine-devel] python docs in wiki up to date?
by Sven Kieske 04 Mar '14

04 Mar '14

Hi, is this still state of the art? http://www.ovirt.org/Testing/PythonApi If not I could update it myself if you provide me with the necessary information. Thanks -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

1 0