Re: [Engine-devel] ovirt-engine repo up in gerrit.ovirt.org!
Hi Yair, I managed to install the two missing dependencies from the web and now the build seem to run ok but apparently 8gb of RAM are not sufficient to build ovirt-engine so I'll have to give it a pass for now and wait for binary releases. Regards, Dennis On 10/30/2011 01:46 PM, Yair Zaslavsky wrote:
Hi Dennis, Do you still need assistance with this?
Kind regards, Yair
On 10/30/2011 02:24 PM, Dennis Jacobfeuerborn wrote:
On 10/30/2011 06:09 AM, Livnat Peer wrote:
On 10/30/2011 01:36 AM, Dennis Jacobfeuerborn wrote:
On 10/29/2011 10:39 PM, Livnat Peer wrote:
On 10/29/2011 10:08 PM, Dennis Jacobfeuerborn wrote:
On 10/29/2011 07:15 PM, Livnat Peer wrote: > On 10/29/2011 05:48 PM, Dennis Jacobfeuerborn wrote: >> On 10/28/2011 02:09 AM, Livnat Peer wrote: >>> On 10/27/2011 11:51 PM, Itamar Heim wrote: >>>> Here we go... >>>> >>>> - gerrit is up. >>>> - ovirt-engine git repo is there. >>>> - will upload the other repositories soon. >>>> >>>> below you can find the steps on how to get the code (yes, >>>> coming to >>>> you >>>> in wiki soon). >>>> a link to the wiki on how to build oVirt will be sent soon by >>>> Livnat. >>>> >>>> It's exciting to see everyone coming together to build a >>>> community, >>>> and >>>> I'm looking forward to working together on oVirt. >>>> >>>> Welcome everyone, >>>> Itamar >>>> >>> >>> Welcome indeed, >>> >>> A link to a wiki with info for setting development environment - >>> http://www.ovirt.org/wiki/Building_Ovirt_Engine >> >> I tried building with these instructions but get "9 required >> artifacts >> are missing." Also I get a *lot* of "unable to fine resource" >> info/warning messages. I've attached the output of the maven run. >> >> Regards, >> Dennis >> > > Hi Dennis, > Maven tries to download dependencies that are required by your > project, > in this case oVirt. > For each dependency maven iterates over all the repositories > defined in > the pom.xml and stops when it finds the required dependency, if it > does > not find the Jar in a repository it issues info message and looks in > the > next repsitory. The info message looks like "[INFO] Unable to find > resource XXX in repository YYY" and does not indicate on a problem. > > For the errors you get - > > I looked into the first missing jar commons-httpclient-2.0.2, it > can be > found in - > http://repository.jboss.org/maven2/apache-httpclient/commons-httpclient/2.0.... > > > > > but it looks like you get - > > Authorization failed: Access denied to: > http://repository.jboss.org/maven2/apache-httpclient/commons-httpclient/2.0.... > > > > > Any idea why you got authorization error? I can access it locally. > Can you try again? maybe a temporary problem.
When I access that URL in a browser I still get a 403 Forbidden response. I can access http://repository.jboss.org/ but not http://repository.jboss.org/maven2/.
In fact the maven2 directory doesn't show up in the directory listing when requesting http://repository.jboss.org/ which could potentially be an SELinux issue on the server. Has this directory perhaps been manually copied to the server without the correct SELinux labels?
Regards, Dennis
Can you access this - https://repository.jboss.org/nexus/content/repositories/central/commons-http...
Yes, this URL works fine.
Regards, Dennis
Hi Dennis, It looks like repo - http://repository.jboss.org/maven2/ is deprecated and can only be accessed within RedHat Network, probably for JBoss engineers.
I have attached a temporary patch with another URL for this repo. The new URL is accessible from outside of RedHat but we should replace it with the new repositories in Nexus.
As i have to catch a flight in a few hours i have no time to test it so i hope it will do the work.
This improved the situation but there are still two missing artifacts:
1) sun-jaxb:jaxb-api:jar:2.1.9 2) oswego-concurrent:concurrent:jar:1.3.4
jaxb-api seems to be present in the new repository but only version 2.0.5 and concurrent seems to be missing completely.
Regards, Dennis
_______________________________________________ Engine-devel mailing list Engine-devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/engine-devel
On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote:
Hi Yair, I managed to install the two missing dependencies from the web and now the build seem to run ok but apparently 8gb of RAM are not sufficient to build ovirt-engine so I'll have to give it a pass for now and wait for binary releases.
8GB are more than enough. probably some config for the JVM. what's the error you are getting? did you set the JAVA_OPTS?
Regards, Dennis
On 10/30/2011 01:46 PM, Yair Zaslavsky wrote:
Hi Dennis, Do you still need assistance with this?
Kind regards, Yair
On 10/30/2011 02:24 PM, Dennis Jacobfeuerborn wrote:
On 10/30/2011 06:09 AM, Livnat Peer wrote:
On 10/30/2011 01:36 AM, Dennis Jacobfeuerborn wrote:
On 10/29/2011 10:39 PM, Livnat Peer wrote:
On 10/29/2011 10:08 PM, Dennis Jacobfeuerborn wrote: > On 10/29/2011 07:15 PM, Livnat Peer wrote: >> On 10/29/2011 05:48 PM, Dennis Jacobfeuerborn wrote: >>> On 10/28/2011 02:09 AM, Livnat Peer wrote: >>>> On 10/27/2011 11:51 PM, Itamar Heim wrote: >>>>> Here we go... >>>>> >>>>> - gerrit is up. >>>>> - ovirt-engine git repo is there. >>>>> - will upload the other repositories soon. >>>>> >>>>> below you can find the steps on how to get the code (yes, >>>>> coming to >>>>> you >>>>> in wiki soon). >>>>> a link to the wiki on how to build oVirt will be sent soon by >>>>> Livnat. >>>>> >>>>> It's exciting to see everyone coming together to build a >>>>> community, >>>>> and >>>>> I'm looking forward to working together on oVirt. >>>>> >>>>> Welcome everyone, >>>>> Itamar >>>>> >>>> >>>> Welcome indeed, >>>> >>>> A link to a wiki with info for setting development environment - >>>> http://www.ovirt.org/wiki/Building_Ovirt_Engine >>> >>> I tried building with these instructions but get "9 required >>> artifacts >>> are missing." Also I get a *lot* of "unable to fine resource" >>> info/warning messages. I've attached the output of the maven run. >>> >>> Regards, >>> Dennis >>> >> >> Hi Dennis, >> Maven tries to download dependencies that are required by your >> project, >> in this case oVirt. >> For each dependency maven iterates over all the repositories >> defined in >> the pom.xml and stops when it finds the required dependency, if it >> does >> not find the Jar in a repository it issues info message and >> looks in >> the >> next repsitory. The info message looks like "[INFO] Unable to find >> resource XXX in repository YYY" and does not indicate on a problem. >> >> For the errors you get - >> >> I looked into the first missing jar commons-httpclient-2.0.2, it >> can be >> found in - >> http://repository.jboss.org/maven2/apache-httpclient/commons-httpclient/2.0.... >> >> >> >> >> >> but it looks like you get - >> >> Authorization failed: Access denied to: >> http://repository.jboss.org/maven2/apache-httpclient/commons-httpclient/2.0.... >> >> >> >> >> >> Any idea why you got authorization error? I can access it locally. >> Can you try again? maybe a temporary problem. > > When I access that URL in a browser I still get a 403 Forbidden > response. > I can access http://repository.jboss.org/ but not > http://repository.jboss.org/maven2/. > > In fact the maven2 directory doesn't show up in the directory > listing > when requesting http://repository.jboss.org/ which could > potentially be > an SELinux issue on the server. Has this directory perhaps been > manually > copied to the server without the correct SELinux labels? > > Regards, > Dennis
Can you access this - https://repository.jboss.org/nexus/content/repositories/central/commons-http...
Yes, this URL works fine.
Regards, Dennis
Hi Dennis, It looks like repo - http://repository.jboss.org/maven2/ is deprecated and can only be accessed within RedHat Network, probably for JBoss engineers.
I have attached a temporary patch with another URL for this repo. The new URL is accessible from outside of RedHat but we should replace it with the new repositories in Nexus.
As i have to catch a flight in a few hours i have no time to test it so i hope it will do the work.
This improved the situation but there are still two missing artifacts:
1) sun-jaxb:jaxb-api:jar:2.1.9 2) oswego-concurrent:concurrent:jar:1.3.4
jaxb-api seems to be present in the new repository but only version 2.0.5 and concurrent seems to be missing completely.
Regards, Dennis
_______________________________________________ Engine-devel mailing list Engine-devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/engine-devel
_______________________________________________ Engine-devel mailing list Engine-devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/engine-devel
On 10/31/2011 03:27 AM, Itamar Heim wrote:
On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote:
Hi Yair, I managed to install the two missing dependencies from the web and now the build seem to run ok but apparently 8gb of RAM are not sufficient to build ovirt-engine so I'll have to give it a pass for now and wait for binary releases.
8GB are more than enough. probably some config for the JVM. what's the error you are getting? did you set the JAVA_OPTS?
I don't get an error. The build process simply uses up all memory and the desktop becomes unusable. If I don't switch to another virtual terminal and issue a "killall java" then the system would probably die in the end and require a reboot (or the OOM Killer would step in an kill some processes before that happens). This is a plain Fedora 15 System and I'm following the build instructions from the wiki so right now there are no custom settings applied. Regards, Dennis
On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 03:27 AM, Itamar Heim wrote:
On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote:
Hi Yair, I managed to install the two missing dependencies from the web and now the build seem to run ok but apparently 8gb of RAM are not sufficient to build ovirt-engine so I'll have to give it a pass for now and wait for binary releases.
8GB are more than enough. probably some config for the JVM. what's the error you are getting? did you set the JAVA_OPTS?
I don't get an error. The build process simply uses up all memory and the desktop becomes unusable. If I don't switch to another virtual terminal and issue a "killall java" then the system would probably die in the end and require a reboot (or the OOM Killer would step in an kill some processes before that happens).
This is a plain Fedora 15 System and I'm following the build instructions from the wiki so right now there are no custom settings applied.
we are all building on F15, and with less than 8GB as well. which command are you running causing the hang? what does top shows when it hangs? what does maven output show when it hangs (i.e., which part of the project is causing the hang). Thanks, Itamar
Regards, Dennis
On 10/31/2011 05:55 AM, Itamar Heim wrote:
On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 03:27 AM, Itamar Heim wrote:
On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote:
Hi Yair, I managed to install the two missing dependencies from the web and now the build seem to run ok but apparently 8gb of RAM are not sufficient to build ovirt-engine so I'll have to give it a pass for now and wait for binary releases.
8GB are more than enough. probably some config for the JVM. what's the error you are getting? did you set the JAVA_OPTS?
I don't get an error. The build process simply uses up all memory and the desktop becomes unusable. If I don't switch to another virtual terminal and issue a "killall java" then the system would probably die in the end and require a reboot (or the OOM Killer would step in an kill some processes before that happens).
This is a plain Fedora 15 System and I'm following the build instructions from the wiki so right now there are no custom settings applied.
we are all building on F15, and with less than 8GB as well. which command are you running causing the hang? what does top shows when it hangs? what does maven output show when it hangs (i.e., which part of the project is causing the hang).
The compilation of the GWT applications can take very long (more than 10 minutes in a core i5 with 8GB) with intensive use of all the CPUs. This could be what you are observing. Can try to build without the "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this is your issue. -- Dirección Comercial: C/Jose Bardasano Baos, 9, Edif. Gorbea 3, planta 3ºD, 28016 Madrid, Spain Inscrita en el Reg. Mercantil de Madrid – C.I.F. B82657941 - Red Hat S.L.
On 10/31/2011 09:34 AM, Juan Hernandez wrote:
On 10/31/2011 05:55 AM, Itamar Heim wrote:
On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 03:27 AM, Itamar Heim wrote:
On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote:
Hi Yair, I managed to install the two missing dependencies from the web and now the build seem to run ok but apparently 8gb of RAM are not sufficient to build ovirt-engine so I'll have to give it a pass for now and wait for binary releases.
8GB are more than enough. probably some config for the JVM. what's the error you are getting? did you set the JAVA_OPTS?
I don't get an error. The build process simply uses up all memory and the desktop becomes unusable. If I don't switch to another virtual terminal and issue a "killall java" then the system would probably die in the end and require a reboot (or the OOM Killer would step in an kill some processes before that happens).
This is a plain Fedora 15 System and I'm following the build instructions from the wiki so right now there are no custom settings applied.
we are all building on F15, and with less than 8GB as well. which command are you running causing the hang? what does top shows when it hangs? what does maven output show when it hangs (i.e., which part of the project is causing the hang).
The compilation of the GWT applications can take very long (more than 10 minutes in a core i5 with 8GB) with intensive use of all the CPUs. This could be what you are observing. Can try to build without the "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this is your issue.
This seems to be the problem. I already sent the information to Yair Zaslavsky (and Daniel Erez) who contacted me off-list about this (though I think this really belongs on the list so everybody can chime in). I attached the output I get. At the end I had to kill the process because memory usage was at about 99%. The command I'm running is: mvn install -Pgwt-admin,gwt-user The system monitor shows cpu usage very low (up to the problematic point the build seems to spend 90% of its time trying to download jar files from bogus sources) and memory usage increasing slightly as expected until the build reaches that last problematic part where all cpu cores go to 100% and memory usage increases until all memory is consumed. Regards, Dennis
On 10/31/2011 12:04 PM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 09:34 AM, Juan Hernandez wrote:
On 10/31/2011 05:55 AM, Itamar Heim wrote:
On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 03:27 AM, Itamar Heim wrote:
On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote:
Hi Yair, I managed to install the two missing dependencies from the web and now the build seem to run ok but apparently 8gb of RAM are not sufficient to build ovirt-engine so I'll have to give it a pass for now and wait for binary releases.
8GB are more than enough. probably some config for the JVM. what's the error you are getting? did you set the JAVA_OPTS?
I don't get an error. The build process simply uses up all memory and the desktop becomes unusable. If I don't switch to another virtual terminal and issue a "killall java" then the system would probably die in the end and require a reboot (or the OOM Killer would step in an kill some processes before that happens).
This is a plain Fedora 15 System and I'm following the build instructions from the wiki so right now there are no custom settings applied.
we are all building on F15, and with less than 8GB as well. which command are you running causing the hang? what does top shows when it hangs? what does maven output show when it hangs (i.e., which part of the project is causing the hang).
The compilation of the GWT applications can take very long (more than 10 minutes in a core i5 with 8GB) with intensive use of all the CPUs. This could be what you are observing. Can try to build without the "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this is your issue.
This seems to be the problem. I already sent the information to Yair Zaslavsky (and Daniel Erez) who contacted me off-list about this (though I think this really belongs on the list so everybody can chime in). I attached the output I get. At the end I had to kill the process because memory usage was at about 99%.
The command I'm running is: mvn install -Pgwt-admin,gwt-user The system monitor shows cpu usage very low (up to the problematic point the build seems to spend 90% of its time trying to download jar files from bogus sources) and memory usage increasing slightly as expected until the build reaches that last problematic part where all cpu cores go to 100% and memory usage increases until all memory is consumed.
All those messages are expected, except the "Destroying process ..." at the end. I assume that you get that when you kill the Java processes. How long did you wait before killing them? I would suggest that you try again and give it time to complete. GWT compiling is extremelly Also you can reduce the number of permutations generated by the GWT compiler and that will reduce the time it takes to compile. For example, if you are going to use Firefox only as the client you can apply the following patch to reduce the number of permutations to just one: --- a/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml +++ b/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml @@ -19,6 +19,9 @@ <set-property name="gwt.logging.logLevel" value="INFO" /> <set-property name="gwt.logging.popupHandler" value="DISABLED" /> + <!-- Reduce the number of permutations to compile, just for tests: --> + <set-property name="user.agent" value="gecko1_8"/> + <!-- Inherit oVirt UiCommon Web modules and GWT deRPC module --> <inherits name="org.ovirt.engine.ui.GwtExtension" /> <inherits name="org.ovirt.engine.ui.UICommonWeb" /> Then compile with "-Pgwt-admin" only. That will generate the GUI but only for Firefox. In my environment (Intel Core i5 8GB) this reduces the GWT compilation to 4 minutes: [INFO] WebAdmin ... SUCCESS [4:22.581s]
On 10/31/2011 01:29 PM, Juan Hernandez wrote:
On 10/31/2011 12:04 PM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 09:34 AM, Juan Hernandez wrote:
On 10/31/2011 05:55 AM, Itamar Heim wrote:
On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 03:27 AM, Itamar Heim wrote:
On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote: > Hi Yair, > I managed to install the two missing dependencies from the web and now > the build seem to run ok but apparently 8gb of RAM are not sufficient to > build ovirt-engine so I'll have to give it a pass for now and wait for > binary releases.
8GB are more than enough. probably some config for the JVM. what's the error you are getting? did you set the JAVA_OPTS?
I don't get an error. The build process simply uses up all memory and the desktop becomes unusable. If I don't switch to another virtual terminal and issue a "killall java" then the system would probably die in the end and require a reboot (or the OOM Killer would step in an kill some processes before that happens).
This is a plain Fedora 15 System and I'm following the build instructions from the wiki so right now there are no custom settings applied.
we are all building on F15, and with less than 8GB as well. which command are you running causing the hang? what does top shows when it hangs? what does maven output show when it hangs (i.e., which part of the project is causing the hang).
The compilation of the GWT applications can take very long (more than 10 minutes in a core i5 with 8GB) with intensive use of all the CPUs. This could be what you are observing. Can try to build without the "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this is your issue.
This seems to be the problem. I already sent the information to Yair Zaslavsky (and Daniel Erez) who contacted me off-list about this (though I think this really belongs on the list so everybody can chime in). I attached the output I get. At the end I had to kill the process because memory usage was at about 99%.
The command I'm running is: mvn install -Pgwt-admin,gwt-user The system monitor shows cpu usage very low (up to the problematic point the build seems to spend 90% of its time trying to download jar files from bogus sources) and memory usage increasing slightly as expected until the build reaches that last problematic part where all cpu cores go to 100% and memory usage increases until all memory is consumed.
All those messages are expected, except the "Destroying process ..." at the end. I assume that you get that when you kill the Java processes. How long did you wait before killing them? I would suggest that you try again and give it time to complete. GWT compiling is extremelly
Also you can reduce the number of permutations generated by the GWT compiler and that will reduce the time it takes to compile. For example, if you are going to use Firefox only as the client you can apply the following patch to reduce the number of permutations to just one:
maybe worth to create target profiles of web admin limited to a single browser then? or allow to set this as an evnironment property so gwt_user.agent=gecko1_8 mvn clean install -Pgwt-admin can be used for this during devel?
--- a/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml +++ b/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml @@ -19,6 +19,9 @@ <set-property name="gwt.logging.logLevel" value="INFO" /> <set-property name="gwt.logging.popupHandler" value="DISABLED" />
+<!-- Reduce the number of permutations to compile, just for tests: --> +<set-property name="user.agent" value="gecko1_8"/> + <!-- Inherit oVirt UiCommon Web modules and GWT deRPC module --> <inherits name="org.ovirt.engine.ui.GwtExtension" /> <inherits name="org.ovirt.engine.ui.UICommonWeb" />
Then compile with "-Pgwt-admin" only. That will generate the GUI but only for Firefox. In my environment (Intel Core i5 8GB) this reduces the GWT compilation to 4 minutes:
[INFO] WebAdmin ... SUCCESS [4:22.581s]
On 10/31/2011 01:11 PM, Itamar Heim wrote:
On 10/31/2011 01:29 PM, Juan Hernandez wrote:
On 10/31/2011 12:04 PM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 09:34 AM, Juan Hernandez wrote:
On 10/31/2011 05:55 AM, Itamar Heim wrote:
On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 03:27 AM, Itamar Heim wrote: > On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote: >> Hi Yair, >> I managed to install the two missing dependencies from the web and now >> the build seem to run ok but apparently 8gb of RAM are not sufficient to >> build ovirt-engine so I'll have to give it a pass for now and wait for >> binary releases. > > 8GB are more than enough. probably some config for the JVM. > what's the error you are getting? > did you set the JAVA_OPTS?
I don't get an error. The build process simply uses up all memory and the desktop becomes unusable. If I don't switch to another virtual terminal and issue a "killall java" then the system would probably die in the end and require a reboot (or the OOM Killer would step in an kill some processes before that happens).
This is a plain Fedora 15 System and I'm following the build instructions from the wiki so right now there are no custom settings applied.
we are all building on F15, and with less than 8GB as well. which command are you running causing the hang? what does top shows when it hangs? what does maven output show when it hangs (i.e., which part of the project is causing the hang).
The compilation of the GWT applications can take very long (more than 10 minutes in a core i5 with 8GB) with intensive use of all the CPUs. This could be what you are observing. Can try to build without the "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this is your issue.
This seems to be the problem. I already sent the information to Yair Zaslavsky (and Daniel Erez) who contacted me off-list about this (though I think this really belongs on the list so everybody can chime in). I attached the output I get. At the end I had to kill the process because memory usage was at about 99%.
The command I'm running is: mvn install -Pgwt-admin,gwt-user The system monitor shows cpu usage very low (up to the problematic point the build seems to spend 90% of its time trying to download jar files from bogus sources) and memory usage increasing slightly as expected until the build reaches that last problematic part where all cpu cores go to 100% and memory usage increases until all memory is consumed.
All those messages are expected, except the "Destroying process ..." at the end. I assume that you get that when you kill the Java processes. How long did you wait before killing them? I would suggest that you try again and give it time to complete. GWT compiling is extremelly
Also you can reduce the number of permutations generated by the GWT compiler and that will reduce the time it takes to compile. For example, if you are going to use Firefox only as the client you can apply the following patch to reduce the number of permutations to just one:
maybe worth to create target profiles of web admin limited to a single browser then? or allow to set this as an evnironment property so gwt_user.agent=gecko1_8 mvn clean install -Pgwt-admin can be used for this during devel?
Maybe. What I use for quick and dirty builds is a "build.sh" script with the following content: #!/bin/bash cd repository # Patch the GWT descriptors to use only one permutation: patch -N -p1 <<'.' diff --git a/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml b/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml index d0d2fd7..172bff0 100644 --- a/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml +++ b/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml @@ -19,6 +19,9 @@ <set-property name="gwt.logging.logLevel" value="INFO" /> <set-property name="gwt.logging.popupHandler" value="DISABLED" /> + <!-- Reduce the number of permutations to compile, just for tests: --> + <set-property name="user.agent" value="gecko1_8"/> + <!-- Inherit oVirt UiCommon Web modules and GWT deRPC module --> <inherits name="org.ovirt.engine.ui.GwtExtension" /> <inherits name="org.ovirt.engine.ui.UICommonWeb" /> . # Call maven to perform the build: mvn -Dmaven.test.skip=true -Pgwt-admin install
On 10/31/2011 12:29 PM, Juan Hernandez wrote:
On 10/31/2011 12:04 PM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 09:34 AM, Juan Hernandez wrote:
On 10/31/2011 05:55 AM, Itamar Heim wrote:
On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 03:27 AM, Itamar Heim wrote:
On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote: > Hi Yair, > I managed to install the two missing dependencies from the web and now > the build seem to run ok but apparently 8gb of RAM are not sufficient to > build ovirt-engine so I'll have to give it a pass for now and wait for > binary releases.
8GB are more than enough. probably some config for the JVM. what's the error you are getting? did you set the JAVA_OPTS?
I don't get an error. The build process simply uses up all memory and the desktop becomes unusable. If I don't switch to another virtual terminal and issue a "killall java" then the system would probably die in the end and require a reboot (or the OOM Killer would step in an kill some processes before that happens).
This is a plain Fedora 15 System and I'm following the build instructions from the wiki so right now there are no custom settings applied.
we are all building on F15, and with less than 8GB as well. which command are you running causing the hang? what does top shows when it hangs? what does maven output show when it hangs (i.e., which part of the project is causing the hang).
The compilation of the GWT applications can take very long (more than 10 minutes in a core i5 with 8GB) with intensive use of all the CPUs. This could be what you are observing. Can try to build without the "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this is your issue.
This seems to be the problem. I already sent the information to Yair Zaslavsky (and Daniel Erez) who contacted me off-list about this (though I think this really belongs on the list so everybody can chime in). I attached the output I get. At the end I had to kill the process because memory usage was at about 99%.
The command I'm running is: mvn install -Pgwt-admin,gwt-user The system monitor shows cpu usage very low (up to the problematic point the build seems to spend 90% of its time trying to download jar files from bogus sources) and memory usage increasing slightly as expected until the build reaches that last problematic part where all cpu cores go to 100% and memory usage increases until all memory is consumed.
All those messages are expected, except the "Destroying process ..." at the end. I assume that you get that when you kill the Java processes. How long did you wait before killing them? I would suggest that you try again and give it time to complete. GWT compiling is extremelly
Also you can reduce the number of permutations generated by the GWT compiler and that will reduce the time it takes to compile. For example, if you are going to use Firefox only as the client you can apply the following patch to reduce the number of permutations to just one:
--- a/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml +++ b/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml @@ -19,6 +19,9 @@ <set-property name="gwt.logging.logLevel" value="INFO" /> <set-property name="gwt.logging.popupHandler" value="DISABLED" />
+<!-- Reduce the number of permutations to compile, just for tests: --> +<set-property name="user.agent" value="gecko1_8"/> + <!-- Inherit oVirt UiCommon Web modules and GWT deRPC module --> <inherits name="org.ovirt.engine.ui.GwtExtension" /> <inherits name="org.ovirt.engine.ui.UICommonWeb" />
Then compile with "-Pgwt-admin" only. That will generate the GUI but only for Firefox. In my environment (Intel Core i5 8GB) this reduces the GWT compilation to 4 minutes:
[INFO] WebAdmin ... SUCCESS [4:22.581s]
With the patch the build was successfull. I then went ahead and freed up some memory by stopping some applications and with that even the fill build tops out at about 90% memory usage so it seems that 8gb is enough after all but only barely. With the patch memory usage topped out at 40% so this would definitely make a difference for people with smaller build systems. The deployment works as well but when I start jboss I get the attached errors. Also the build instructions talk about "<server>:<port>" to access the deployed services. I presume <server> is localhost but what port do I use to access the services? Regards, Dennis
Can you check if the file quartz-1.8.3.jar is in the folder: JBOSS_HOME/common/lib ? According to the error there are quartz classes that are missing. ----- Original Message -----
From: "Dennis Jacobfeuerborn" <dennisml@conversis.de> To: "Juan Hernandez" <juan.hernandez@redhat.com> Cc: engine-devel@ovirt.org Sent: Monday, October 31, 2011 3:17:59 PM Subject: Re: [Engine-devel] ovirt-engine repo up in gerrit.ovirt.org!
On 10/31/2011 12:29 PM, Juan Hernandez wrote:
On 10/31/2011 12:04 PM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 09:34 AM, Juan Hernandez wrote:
On 10/31/2011 05:55 AM, Itamar Heim wrote:
On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 03:27 AM, Itamar Heim wrote: > On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote: >> Hi Yair, >> I managed to install the two missing dependencies from the >> web and now >> the build seem to run ok but apparently 8gb of RAM are not >> sufficient to >> build ovirt-engine so I'll have to give it a pass for now and >> wait for >> binary releases. > > 8GB are more than enough. probably some config for the JVM. > what's the error you are getting? > did you set the JAVA_OPTS?
I don't get an error. The build process simply uses up all memory and the desktop becomes unusable. If I don't switch to another virtual terminal and issue a "killall java" then the system would probably die in the end and require a reboot (or the OOM Killer would step in an kill some processes before that happens).
This is a plain Fedora 15 System and I'm following the build instructions from the wiki so right now there are no custom settings applied.
we are all building on F15, and with less than 8GB as well. which command are you running causing the hang? what does top shows when it hangs? what does maven output show when it hangs (i.e., which part of the project is causing the hang).
The compilation of the GWT applications can take very long (more than 10 minutes in a core i5 with 8GB) with intensive use of all the CPUs. This could be what you are observing. Can try to build without the "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this is your issue.
This seems to be the problem. I already sent the information to Yair Zaslavsky (and Daniel Erez) who contacted me off-list about this (though I think this really belongs on the list so everybody can chime in). I attached the output I get. At the end I had to kill the process because memory usage was at about 99%.
The command I'm running is: mvn install -Pgwt-admin,gwt-user The system monitor shows cpu usage very low (up to the problematic point the build seems to spend 90% of its time trying to download jar files from bogus sources) and memory usage increasing slightly as expected until the build reaches that last problematic part where all cpu cores go to 100% and memory usage increases until all memory is consumed.
All those messages are expected, except the "Destroying process ..." at the end. I assume that you get that when you kill the Java processes. How long did you wait before killing them? I would suggest that you try again and give it time to complete. GWT compiling is extremelly
Also you can reduce the number of permutations generated by the GWT compiler and that will reduce the time it takes to compile. For example, if you are going to use Firefox only as the client you can apply the following patch to reduce the number of permutations to just one:
--- a/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml +++ b/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml @@ -19,6 +19,9 @@ <set-property name="gwt.logging.logLevel" value="INFO" /> <set-property name="gwt.logging.popupHandler" value="DISABLED" />
+<!-- Reduce the number of permutations to compile, just for tests: --> +<set-property name="user.agent" value="gecko1_8"/> + <!-- Inherit oVirt UiCommon Web modules and GWT deRPC module --> <inherits name="org.ovirt.engine.ui.GwtExtension" /> <inherits name="org.ovirt.engine.ui.UICommonWeb" />
Then compile with "-Pgwt-admin" only. That will generate the GUI but only for Firefox. In my environment (Intel Core i5 8GB) this reduces the GWT compilation to 4 minutes:
[INFO] WebAdmin ... SUCCESS [4:22.581s]
With the patch the build was successfull. I then went ahead and freed up some memory by stopping some applications and with that even the fill build tops out at about 90% memory usage so it seems that 8gb is enough after all but only barely. With the patch memory usage topped out at 40% so this would definitely make a difference for people with smaller build systems.
The deployment works as well but when I start jboss I get the attached errors.
Also the build instructions talk about "<server>:<port>" to access the deployed services. I presume <server> is localhost but what port do I use to access the services?
Regards, Dennis
_______________________________________________ Engine-devel mailing list Engine-devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/engine-devel
No, this file doesn't seem to be a part of the http://sourceforge.net/projects/jboss/files/JBoss/JBoss-5.1.0.GA/jboss-5.1.0... package referenced on the build page. I tried downloading the file and putting it there manually but when I run jboss I just an endless flood of exceptions and after a ctrl-c jboss hangs and needs to be terminated with a kill -9. I deleted the file again as that apparently doesn't make things better. Regards, Dennis On 10/31/2011 02:24 PM, Oved Ourfalli wrote:
Can you check if the file quartz-1.8.3.jar is in the folder: JBOSS_HOME/common/lib
?
According to the error there are quartz classes that are missing.
----- Original Message -----
From: "Dennis Jacobfeuerborn"<dennisml@conversis.de> To: "Juan Hernandez"<juan.hernandez@redhat.com> Cc: engine-devel@ovirt.org Sent: Monday, October 31, 2011 3:17:59 PM Subject: Re: [Engine-devel] ovirt-engine repo up in gerrit.ovirt.org!
On 10/31/2011 12:29 PM, Juan Hernandez wrote:
On 10/31/2011 12:04 PM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 09:34 AM, Juan Hernandez wrote:
On 10/31/2011 05:55 AM, Itamar Heim wrote:
On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote: > On 10/31/2011 03:27 AM, Itamar Heim wrote: >> On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote: >>> Hi Yair, >>> I managed to install the two missing dependencies from the >>> web and now >>> the build seem to run ok but apparently 8gb of RAM are not >>> sufficient to >>> build ovirt-engine so I'll have to give it a pass for now and >>> wait for >>> binary releases. >> >> 8GB are more than enough. probably some config for the JVM. >> what's the error you are getting? >> did you set the JAVA_OPTS? > > I don't get an error. The build process simply uses up all > memory and > the desktop becomes unusable. If I don't switch to another > virtual > terminal and issue a "killall java" then the system would > probably die > in the end and require a reboot (or the OOM Killer would step > in an kill > some processes before that happens). > > This is a plain Fedora 15 System and I'm following the build > instructions from the wiki so right now there are no custom > settings > applied.
we are all building on F15, and with less than 8GB as well. which command are you running causing the hang? what does top shows when it hangs? what does maven output show when it hangs (i.e., which part of the project is causing the hang).
The compilation of the GWT applications can take very long (more than 10 minutes in a core i5 with 8GB) with intensive use of all the CPUs. This could be what you are observing. Can try to build without the "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this is your issue.
This seems to be the problem. I already sent the information to Yair Zaslavsky (and Daniel Erez) who contacted me off-list about this (though I think this really belongs on the list so everybody can chime in). I attached the output I get. At the end I had to kill the process because memory usage was at about 99%.
The command I'm running is: mvn install -Pgwt-admin,gwt-user The system monitor shows cpu usage very low (up to the problematic point the build seems to spend 90% of its time trying to download jar files from bogus sources) and memory usage increasing slightly as expected until the build reaches that last problematic part where all cpu cores go to 100% and memory usage increases until all memory is consumed.
All those messages are expected, except the "Destroying process ..." at the end. I assume that you get that when you kill the Java processes. How long did you wait before killing them? I would suggest that you try again and give it time to complete. GWT compiling is extremelly
Also you can reduce the number of permutations generated by the GWT compiler and that will reduce the time it takes to compile. For example, if you are going to use Firefox only as the client you can apply the following patch to reduce the number of permutations to just one:
--- a/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml +++ b/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml @@ -19,6 +19,9 @@ <set-property name="gwt.logging.logLevel" value="INFO" /> <set-property name="gwt.logging.popupHandler" value="DISABLED" />
+<!-- Reduce the number of permutations to compile, just for tests: --> +<set-property name="user.agent" value="gecko1_8"/> + <!-- Inherit oVirt UiCommon Web modules and GWT deRPC module --> <inherits name="org.ovirt.engine.ui.GwtExtension" /> <inherits name="org.ovirt.engine.ui.UICommonWeb" />
Then compile with "-Pgwt-admin" only. That will generate the GUI but only for Firefox. In my environment (Intel Core i5 8GB) this reduces the GWT compilation to 4 minutes:
[INFO] WebAdmin ... SUCCESS [4:22.581s]
With the patch the build was successfull. I then went ahead and freed up some memory by stopping some applications and with that even the fill build tops out at about 90% memory usage so it seems that 8gb is enough after all but only barely. With the patch memory usage topped out at 40% so this would definitely make a difference for people with smaller build systems.
The deployment works as well but when I start jboss I get the attached errors.
Also the build instructions talk about "<server>:<port>" to access the deployed services. I presume<server> is localhost but what port do I use to access the services?
Regards, Dennis
_______________________________________________ Engine-devel mailing list Engine-devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/engine-devel
It doesn't come with jboss, but it is copied there when deploying the oVirt engine (maven "dep" profile: "-Pdep"). Did you build the engine with this profile as well? ----- Original Message -----
From: "Dennis Jacobfeuerborn" <dennisml@conversis.de> To: "Oved Ourfalli" <ovedo@redhat.com> Cc: engine-devel@ovirt.org, "Juan Hernandez" <juan.hernandez@redhat.com> Sent: Monday, October 31, 2011 4:07:45 PM Subject: Re: [Engine-devel] ovirt-engine repo up in gerrit.ovirt.org!
No, this file doesn't seem to be a part of the http://sourceforge.net/projects/jboss/files/JBoss/JBoss-5.1.0.GA/jboss-5.1.0... package referenced on the build page.
I tried downloading the file and putting it there manually but when I run jboss I just an endless flood of exceptions and after a ctrl-c jboss hangs and needs to be terminated with a kill -9. I deleted the file again as that apparently doesn't make things better.
Regards, Dennis
On 10/31/2011 02:24 PM, Oved Ourfalli wrote:
Can you check if the file quartz-1.8.3.jar is in the folder: JBOSS_HOME/common/lib
?
According to the error there are quartz classes that are missing.
----- Original Message -----
From: "Dennis Jacobfeuerborn"<dennisml@conversis.de> To: "Juan Hernandez"<juan.hernandez@redhat.com> Cc: engine-devel@ovirt.org Sent: Monday, October 31, 2011 3:17:59 PM Subject: Re: [Engine-devel] ovirt-engine repo up in gerrit.ovirt.org!
On 10/31/2011 12:29 PM, Juan Hernandez wrote:
On 10/31/2011 12:04 PM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 09:34 AM, Juan Hernandez wrote:
On 10/31/2011 05:55 AM, Itamar Heim wrote: > On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote: >> On 10/31/2011 03:27 AM, Itamar Heim wrote: >>> On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote: >>>> Hi Yair, >>>> I managed to install the two missing dependencies from the >>>> web and now >>>> the build seem to run ok but apparently 8gb of RAM are not >>>> sufficient to >>>> build ovirt-engine so I'll have to give it a pass for now >>>> and >>>> wait for >>>> binary releases. >>> >>> 8GB are more than enough. probably some config for the JVM. >>> what's the error you are getting? >>> did you set the JAVA_OPTS? >> >> I don't get an error. The build process simply uses up all >> memory and >> the desktop becomes unusable. If I don't switch to another >> virtual >> terminal and issue a "killall java" then the system would >> probably die >> in the end and require a reboot (or the OOM Killer would step >> in an kill >> some processes before that happens). >> >> This is a plain Fedora 15 System and I'm following the build >> instructions from the wiki so right now there are no custom >> settings >> applied. > > we are all building on F15, and with less than 8GB as well. > which command are you running causing the hang? > what does top shows when it hangs? > what does maven output show when it hangs (i.e., which part of > the > project is causing the hang).
The compilation of the GWT applications can take very long (more than 10 minutes in a core i5 with 8GB) with intensive use of all the CPUs. This could be what you are observing. Can try to build without the "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this is your issue.
This seems to be the problem. I already sent the information to Yair Zaslavsky (and Daniel Erez) who contacted me off-list about this (though I think this really belongs on the list so everybody can chime in). I attached the output I get. At the end I had to kill the process because memory usage was at about 99%.
The command I'm running is: mvn install -Pgwt-admin,gwt-user The system monitor shows cpu usage very low (up to the problematic point the build seems to spend 90% of its time trying to download jar files from bogus sources) and memory usage increasing slightly as expected until the build reaches that last problematic part where all cpu cores go to 100% and memory usage increases until all memory is consumed.
All those messages are expected, except the "Destroying process ..." at the end. I assume that you get that when you kill the Java processes. How long did you wait before killing them? I would suggest that you try again and give it time to complete. GWT compiling is extremelly
Also you can reduce the number of permutations generated by the GWT compiler and that will reduce the time it takes to compile. For example, if you are going to use Firefox only as the client you can apply the following patch to reduce the number of permutations to just one:
--- a/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml +++ b/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml @@ -19,6 +19,9 @@ <set-property name="gwt.logging.logLevel" value="INFO" /> <set-property name="gwt.logging.popupHandler" value="DISABLED" />
+<!-- Reduce the number of permutations to compile, just for tests: --> +<set-property name="user.agent" value="gecko1_8"/> + <!-- Inherit oVirt UiCommon Web modules and GWT deRPC module --> <inherits name="org.ovirt.engine.ui.GwtExtension" /> <inherits name="org.ovirt.engine.ui.UICommonWeb" />
Then compile with "-Pgwt-admin" only. That will generate the GUI but only for Firefox. In my environment (Intel Core i5 8GB) this reduces the GWT compilation to 4 minutes:
[INFO] WebAdmin ... SUCCESS [4:22.581s]
With the patch the build was successfull. I then went ahead and freed up some memory by stopping some applications and with that even the fill build tops out at about 90% memory usage so it seems that 8gb is enough after all but only barely. With the patch memory usage topped out at 40% so this would definitely make a difference for people with smaller build systems.
The deployment works as well but when I start jboss I get the attached errors.
Also the build instructions talk about "<server>:<port>" to access the deployed services. I presume<server> is localhost but what port do I use to access the services?
Regards, Dennis
_______________________________________________ Engine-devel mailing list Engine-devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/engine-devel
On 10/31/2011 04:11 PM, Oved Ourfalli wrote:
It doesn't come with jboss, but it is copied there when deploying the oVirt engine (maven "dep" profile: "-Pdep"). Did you build the engine with this profile as well? Actually for the first time, it's better to use: mvn clean install -Pdep,gwt-admin,setup_postgres
setup_postgres - will copy postgresql datasource file and additional configuration files to jboss. setup_postgres won't be required until specific changes to those configuration files is made. dep - will copy the ear and quartz to jboss deploy folder.
----- Original Message -----
From: "Dennis Jacobfeuerborn" <dennisml@conversis.de> To: "Oved Ourfalli" <ovedo@redhat.com> Cc: engine-devel@ovirt.org, "Juan Hernandez" <juan.hernandez@redhat.com> Sent: Monday, October 31, 2011 4:07:45 PM Subject: Re: [Engine-devel] ovirt-engine repo up in gerrit.ovirt.org!
No, this file doesn't seem to be a part of the http://sourceforge.net/projects/jboss/files/JBoss/JBoss-5.1.0.GA/jboss-5.1.0... package referenced on the build page.
I tried downloading the file and putting it there manually but when I run jboss I just an endless flood of exceptions and after a ctrl-c jboss hangs and needs to be terminated with a kill -9. I deleted the file again as that apparently doesn't make things better.
Regards, Dennis
On 10/31/2011 02:24 PM, Oved Ourfalli wrote:
Can you check if the file quartz-1.8.3.jar is in the folder: JBOSS_HOME/common/lib
?
According to the error there are quartz classes that are missing.
----- Original Message -----
From: "Dennis Jacobfeuerborn"<dennisml@conversis.de> To: "Juan Hernandez"<juan.hernandez@redhat.com> Cc: engine-devel@ovirt.org Sent: Monday, October 31, 2011 3:17:59 PM Subject: Re: [Engine-devel] ovirt-engine repo up in gerrit.ovirt.org!
On 10/31/2011 12:29 PM, Juan Hernandez wrote:
On 10/31/2011 12:04 PM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 09:34 AM, Juan Hernandez wrote: > On 10/31/2011 05:55 AM, Itamar Heim wrote: >> On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote: >>> On 10/31/2011 03:27 AM, Itamar Heim wrote: >>>> On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote: >>>>> Hi Yair, >>>>> I managed to install the two missing dependencies from the >>>>> web and now >>>>> the build seem to run ok but apparently 8gb of RAM are not >>>>> sufficient to >>>>> build ovirt-engine so I'll have to give it a pass for now >>>>> and >>>>> wait for >>>>> binary releases. >>>> >>>> 8GB are more than enough. probably some config for the JVM. >>>> what's the error you are getting? >>>> did you set the JAVA_OPTS? >>> >>> I don't get an error. The build process simply uses up all >>> memory and >>> the desktop becomes unusable. If I don't switch to another >>> virtual >>> terminal and issue a "killall java" then the system would >>> probably die >>> in the end and require a reboot (or the OOM Killer would step >>> in an kill >>> some processes before that happens). >>> >>> This is a plain Fedora 15 System and I'm following the build >>> instructions from the wiki so right now there are no custom >>> settings >>> applied. >> >> we are all building on F15, and with less than 8GB as well. >> which command are you running causing the hang? >> what does top shows when it hangs? >> what does maven output show when it hangs (i.e., which part of >> the >> project is causing the hang). > > The compilation of the GWT applications can take very long > (more > than 10 > minutes in a core i5 with 8GB) with intensive use of all the > CPUs. This > could be what you are observing. Can try to build without the > "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this > is > your issue. >
This seems to be the problem. I already sent the information to Yair Zaslavsky (and Daniel Erez) who contacted me off-list about this (though I think this really belongs on the list so everybody can chime in). I attached the output I get. At the end I had to kill the process because memory usage was at about 99%.
The command I'm running is: mvn install -Pgwt-admin,gwt-user The system monitor shows cpu usage very low (up to the problematic point the build seems to spend 90% of its time trying to download jar files from bogus sources) and memory usage increasing slightly as expected until the build reaches that last problematic part where all cpu cores go to 100% and memory usage increases until all memory is consumed.
All those messages are expected, except the "Destroying process ..." at the end. I assume that you get that when you kill the Java processes. How long did you wait before killing them? I would suggest that you try again and give it time to complete. GWT compiling is extremelly
Also you can reduce the number of permutations generated by the GWT compiler and that will reduce the time it takes to compile. For example, if you are going to use Firefox only as the client you can apply the following patch to reduce the number of permutations to just one:
--- a/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml +++ b/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml @@ -19,6 +19,9 @@ <set-property name="gwt.logging.logLevel" value="INFO" /> <set-property name="gwt.logging.popupHandler" value="DISABLED" />
+<!-- Reduce the number of permutations to compile, just for tests: --> +<set-property name="user.agent" value="gecko1_8"/> + <!-- Inherit oVirt UiCommon Web modules and GWT deRPC module --> <inherits name="org.ovirt.engine.ui.GwtExtension" /> <inherits name="org.ovirt.engine.ui.UICommonWeb" />
Then compile with "-Pgwt-admin" only. That will generate the GUI but only for Firefox. In my environment (Intel Core i5 8GB) this reduces the GWT compilation to 4 minutes:
[INFO] WebAdmin ... SUCCESS [4:22.581s]
With the patch the build was successfull. I then went ahead and freed up some memory by stopping some applications and with that even the fill build tops out at about 90% memory usage so it seems that 8gb is enough after all but only barely. With the patch memory usage topped out at 40% so this would definitely make a difference for people with smaller build systems.
The deployment works as well but when I start jboss I get the attached errors.
Also the build instructions talk about "<server>:<port>" to access the deployed services. I presume<server> is localhost but what port do I use to access the services?
Regards, Dennis
_______________________________________________ Engine-devel mailing list Engine-devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/engine-devel
_______________________________________________ Engine-devel mailing list Engine-devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/engine-devel
On 10/31/2011 03:34 PM, Moti Asayag wrote:
On 10/31/2011 04:11 PM, Oved Ourfalli wrote:
It doesn't come with jboss, but it is copied there when deploying the oVirt engine (maven "dep" profile: "-Pdep"). Did you build the engine with this profile as well? Actually for the first time, it's better to use: mvn clean install -Pdep,gwt-admin,setup_postgres
setup_postgres - will copy postgresql datasource file and additional configuration files to jboss. setup_postgres won't be required until specific changes to those configuration files is made.
dep - will copy the ear and quartz to jboss deploy folder.
Hm, initially I used "mvn clean install -Pdep,setup_postgres" as the build page suggests but apparently that didn't copy the quartz file? I just did a "mvn install -Pdep" again and this time the quartz jar was copied. Also the exception flood was apparently caused because postgresql was not running. After I started it things look great now. I did a test api call and browsed both webadmin and userportal and things seem to work as they should for the moment. Regards, Dennis
On 10/31/2011 03:17 PM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 12:29 PM, Juan Hernandez wrote:
On 10/31/2011 12:04 PM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 09:34 AM, Juan Hernandez wrote:
On 10/31/2011 05:55 AM, Itamar Heim wrote:
On 10/31/2011 04:52 AM, Dennis Jacobfeuerborn wrote:
On 10/31/2011 03:27 AM, Itamar Heim wrote: > On 10/30/2011 04:32 PM, Dennis Jacobfeuerborn wrote: >> Hi Yair, >> I managed to install the two missing dependencies from the web >> and now >> the build seem to run ok but apparently 8gb of RAM are not >> sufficient to >> build ovirt-engine so I'll have to give it a pass for now and >> wait for >> binary releases. > > 8GB are more than enough. probably some config for the JVM. > what's the error you are getting? > did you set the JAVA_OPTS?
I don't get an error. The build process simply uses up all memory and the desktop becomes unusable. If I don't switch to another virtual terminal and issue a "killall java" then the system would probably die in the end and require a reboot (or the OOM Killer would step in an kill some processes before that happens).
This is a plain Fedora 15 System and I'm following the build instructions from the wiki so right now there are no custom settings applied.
we are all building on F15, and with less than 8GB as well. which command are you running causing the hang? what does top shows when it hangs? what does maven output show when it hangs (i.e., which part of the project is causing the hang).
The compilation of the GWT applications can take very long (more than 10 minutes in a core i5 with 8GB) with intensive use of all the CPUs. This could be what you are observing. Can try to build without the "-Pgwt-user" and "-Pgwt-admin" options? Just to check if this is your issue.
This seems to be the problem. I already sent the information to Yair Zaslavsky (and Daniel Erez) who contacted me off-list about this (though I think this really belongs on the list so everybody can chime in). I attached the output I get. At the end I had to kill the process because memory usage was at about 99%.
The command I'm running is: mvn install -Pgwt-admin,gwt-user The system monitor shows cpu usage very low (up to the problematic point the build seems to spend 90% of its time trying to download jar files from bogus sources) and memory usage increasing slightly as expected until the build reaches that last problematic part where all cpu cores go to 100% and memory usage increases until all memory is consumed.
All those messages are expected, except the "Destroying process ..." at the end. I assume that you get that when you kill the Java processes. How long did you wait before killing them? I would suggest that you try again and give it time to complete. GWT compiling is extremelly
Also you can reduce the number of permutations generated by the GWT compiler and that will reduce the time it takes to compile. For example, if you are going to use Firefox only as the client you can apply the following patch to reduce the number of permutations to just one:
--- a/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml
+++ b/frontend/webadmin/modules/webadmin/src/main/java/org/ovirt/engine/ui/webadmin/WebAdmin.gwt.xml
@@ -19,6 +19,9 @@ <set-property name="gwt.logging.logLevel" value="INFO" /> <set-property name="gwt.logging.popupHandler" value="DISABLED" />
+<!-- Reduce the number of permutations to compile, just for tests: --> +<set-property name="user.agent" value="gecko1_8"/> + <!-- Inherit oVirt UiCommon Web modules and GWT deRPC module --> <inherits name="org.ovirt.engine.ui.GwtExtension" /> <inherits name="org.ovirt.engine.ui.UICommonWeb" />
Then compile with "-Pgwt-admin" only. That will generate the GUI but only for Firefox. In my environment (Intel Core i5 8GB) this reduces the GWT compilation to 4 minutes:
[INFO] WebAdmin ... SUCCESS [4:22.581s]
With the patch the build was successfull. I then went ahead and freed up some memory by stopping some applications and with that even the fill build tops out at about 90% memory usage so it seems that 8gb is enough after all but only barely. With the patch memory usage topped out at 40% so this would definitely make a difference for people with smaller build systems.
The deployment works as well but when I start jboss I get the attached errors.
Also the build instructions talk about "<server>:<port>" to access the deployed services. I presume <server> is localhost but what port do I use to access the services?
assuming by deployment you mean (cd ear; mvn clean install -Pdep) port is :8080 url is: 8080/api 8080/webadmin 8080/userportal (you need to build with -Pgwt-admin,gwt-user)
Regards, Dennis
participants (5)
-
Dennis Jacobfeuerborn -
Itamar Heim -
Juan Hernandez -
Moti Asayag -
Oved Ourfalli