September 2012 - Devel - oVirt List Archives

[Engine-devel] Splitting out the oVirt engine installer
by Derek Higgins 30 Oct '12

30 Oct '12

Hi All, First time poster here so let me know if this is better directed some where else I have been writing a installer for openstack and as a base for this I've split out the generic parts of your engine-setup utility[1]. In order to do this I've created a generic installer[2] that is basically all of the parts of the oVirt engine installer that I needed for my openstack installer[3] I'd now like to see if there is interest here to use this generic installer for oVirt. I may have stripped out some stuff from the installer that I should have left in, if that is the case I'm open to recreating this repository with anything generic I shouldn't have stripped out so that the original history is maintained. Would anybody here like to look into the work necessary to use this installer in oVirt? For openstack I've made exclusive use of the plugin functionality and I suspect most changes that would be needed for oVirt would be to move a lot of the code into a similar pattern. If you have any questions/comments just let me know, hopefully you will find this useful and other projects could make use of the great work you have done developing this setup utility Thanks, Derek. [1] https://github.com/derekhiggins/ovirt-engine/tree/master/packaging/fedora/s… [2] https://github.com/derekhiggins/installer [3] https://github.com/derekhiggins/os-installer

2 2

[Engine-devel] AsyncTaskManager and the irsbroker
by Laszlo Hornyak 24 Oct '12

24 Oct '12

hi, I have just noticed that AsyncTaskManager is - almost all of the public methods are synchronized - and it is singleton - calling to VDS operations (line 291) Therefore this may be a performance bottleneck. Even when you want to create an asynchronous task or query a task's state, you may have to wait till a remote vdsm responds. Would it be ok to remove the synchronization from e.g. the query-like methods? Or the one initiating remote calls? Laszlo

2 1

[Engine-devel] RFE: Netwrok Main Tab
by Alona Kaplan 15 Oct '12

15 Oct '12

Hi all, Please review the wiki and add your comments. http://wiki.ovirt.org/wiki/Feature/NetworkMainTab RFE: https://bugzilla.redhat.com/858742 Thanks, Alona.

7 19

[Engine-devel] libosinfo integration
by Roy Golan 11 Oct '12

11 Oct '12

Here's a draft wiki of the libosinfo integration with the engine http://wiki.ovirt.org/wiki/Libosinfo please share your comments on this thread and I'll update the wiki accordingly. Thanks, Roy

7 13

[Engine-devel] Frontend questions.
by snmishra＠linux.vnet.ibm.com 02 Oct '12

02 Oct '12

Hi, I am looking at adding support for novnc in ovirt. I have not worked on the frontend and thought of asking some questions to the list to save time. Currently, when a user selects to open console on a VM with VNC. They get a popup window with IP, port and password for VNC session. I plan to take this info to host and run the command - novnc_server --vnc IP:(port-5900) This command returns a URL, use this url to open a new browser window which will be a vnc session to the VM. My questions are - 1. How to run the novnc-server command on the host? 2. How to open a new URL for VNC session? Thanks Sharad Mishra

4 3

[Engine-devel] Running test suites on other OSs
by Allon Mureinik 30 Sep '12

30 Sep '12

Hi guys, After some on-and-off work over the last week (thanks Daniel!), as of this morning, engine's test suite runs successfully on a couple of non-fedora/rhel OSs[1]. The easier to get/build/test the code, the more likely we'll be to get more developers on board, so let's try and keep it this way. How to achieve this, in one sentence: "Assumption is the mother of all screw-ups" Some slightly more detailed pointers: 1. File separators: Remember File.separatorChar? good. 2. TimeZones: If your test implicitly assumes a time zone (i.e., has anything to do with date formatting, DST changes, etc.), set it explicitly - don't assume that everyone's env shares your timezone 3. org.junit.Assume is your friend Thanks, Allon [1] Don't ask, don't tell: http://gerrit.ovirt.org/#/c/8192/5

1 0

[Engine-devel] [ATTENTION] Engine now uses PKCS#12 format to store private keys
by Alon Bar-Lev 30 Sep '12

30 Sep '12

Hello All, We committed a change in the method engine uses to store private keys. So far the engine used Java proprietary JKS format, this format enabled only Java applications to access the keys, and made it hard to manipulate them using external programs. >From now the engine is using the standard PKCS#12 format to store keys and associated certificate chain. PKCS#12 format is standard and supported by many applications, and it allowed simpler enrollment procedure. We also issue different certificate and key to be used as engine authentication (SSH, VDSM), and to be used for engine web interface (HTTPS). This change has two reasons: 1. Allow simpler migration to 3rd party certificate for the web interface. 2. Separate between different private key usages (signature and key exchange). engine-upgrade script has been modified to upgrade the environment to the new state. Please CC me for every issue you may experience. Regards, Alon.

1 0

[Engine-devel] Local build failing.
by snmishra＠linux.vnet.ibm.com 27 Sep '12

27 Sep '12

Hi, My local build is failing today. I cloned the ovirt-engine repo and ran 'mvn clean install". Failed with following error - Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:compile (default-compile) on project vdsbroker: Compilation failure [ERROR] /tmp/ovirt-engine/backend/manager/modules/vdsbroker/src/main/java/org/ovirt/engine/core/vdsbroker/VdsManager.java:[604,44] illegal start of expression I noticed that Jenkins build succeeded after this change was merged. -Sharad

4 3

[Engine-devel] Serial Execution of Async Tasks
by Allon Mureinik 27 Sep '12

27 Sep '12

Hi guys, As you may know the engine currently has the ability to fire an SPM task, and be asynchronously be "woken-up" when it ends. This is great, but we found the for the Live Storage Migration feature we need something a bit complex - the ability to have a series of async tasks in a single control flow. Here's my initial design for this, your comments and criticism would be welcome: http://wiki.ovirt.org/wiki/Features/Serial_Execution_of_Asynchronous_Tasks_… -Allon

8 25

[Engine-devel] engine build AD/LDAP error
by Dead Horse 25 Sep '12

25 Sep '12

I have built ovirt-engine from the latest GIT master over the past few nights and am running into a MS AD/LDAP error. This same MS AD setup works fine with Released 3.1. Current nightly builds from jenkins are not building all the GWT permutations (Internet Explorer for example) so I have been attempting to re-build the engine so I can test using Internet Explorer. It would be nice if the nightly jenkins builds could be changed to do the build with all GWT permutations enabled. I am building in an FC17 environment with updates applied and current as of today. Accordingly maven3 and all build dependencies are installed from the FC17 repositories. I tried the latest nightly from Jenkins and it does not exhibit the below error. I am guessing I must not have the build recipe/env correct. The AD error I am running into looks like: 2012-09-24 16:15:44,037 ERROR [org.ovirt.engine.core.bll.adbroker.DirectorySearcher] (ajp--127.0.0.1-8702-4) Failed ldap search server LDAP:// someserver.foo.com:389 due to Kerberos error. Please check log for further details.. We should not try the next server 2012-09-24 16:15:44,039 ERROR [org.ovirt.engine.core.bll.adbroker.GSSAPIDirContextAuthenticationStrategy] (ajp--127.0.0.1-8702-2) Error from Kerberos: java.lang.NullPointerException at org.ovirt.engine.core.bll.adbroker.GSSAPICallbackHandler.handle(GSSAPICallbackHandler.java:47) at javax.security.auth.login.LoginContext$SecureCallbackHandler$1.run(LoginContext.java:969) at javax.security.auth.login.LoginContext$SecureCallbackHandler$1.run(LoginContext.java:966) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.login.LoginContext$SecureCallbackHandler.handle(LoginContext.java:965) at com.sun.security.auth.module.Krb5LoginModule.promptForPass(Krb5LoginModule.java:870) at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:715) at com.sun.security.auth.module.Krb5LoginModule.login(Krb5LoginModule.java:580) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at javax.security.auth.login.LoginContext.invoke(LoginContext.java:784) at javax.security.auth.login.LoginContext.access$000(LoginContext.java:203) at javax.security.auth.login.LoginContext$4.run(LoginContext.java:698) at javax.security.auth.login.LoginContext$4.run(LoginContext.java:696) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:695) at javax.security.auth.login.LoginContext.login(LoginContext.java:594) at org.ovirt.engine.core.bll.adbroker.GSSAPIDirContextAuthenticationStrategy.authenticateToKDC(GSSAPIDirContextAuthenticationStrategy.java:127) at org.ovirt.engine.core.bll.adbroker.GSSAPIDirContextAuthenticationStrategy.explicitAuth(GSSAPIDirContextAuthenticationStrategy.java:119) at org.ovirt.engine.core.bll.adbroker.GSSAPIDirContextAuthenticationStrategy.authenticate(GSSAPIDirContextAuthenticationStrategy.java:111) at org.ovirt.engine.core.bll.adbroker.GSSAPILdapTemplateWrapper.useAuthenticationStrategy(GSSAPILdapTemplateWrapper.java:86) at org.ovirt.engine.core.bll.adbroker.PrepareLdapConnectionTask.call(PrepareLdapConnectionTask.java:56) at org.ovirt.engine.core.bll.adbroker.DirectorySearcher.find(DirectorySearcher.java:103) at org.ovirt.engine.core.bll.adbroker.DirectorySearcher.FindAll(DirectorySearcher.java:48) at org.ovirt.engine.core.bll.adbroker.LdapSearchGroupsByQueryCommand.executeQuery(LdapSearchGroupsByQueryCommand.java:22) at org.ovirt.engine.core.bll.adbroker.LdapBrokerCommandBase.execute(LdapBrokerCommandBase.java:69) at org.ovirt.engine.core.bll.adbroker.LdapBrokerBase.RunAdAction(LdapBrokerBase.java:18) at org.ovirt.engine.core.bll.SearchQuery.adSearch(SearchQuery.java:194) at org.ovirt.engine.core.bll.SearchQuery.searchAdGroups(SearchQuery.java:172) at org.ovirt.engine.core.bll.SearchQuery.executeQueryCommand(SearchQuery.java:79) at org.ovirt.engine.core.bll.QueriesCommandBase.ExecuteCommand(QueriesCommandBase.java:71) at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:41) at org.ovirt.engine.core.bll.Backend.runQueryImpl(Backend.java:384) at org.ovirt.engine.core.bll.Backend.RunQuery(Backend.java:367) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) at org.ovirt.engine.core.utils.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:11) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view9.RunQuery(Unknown Source) at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunQuery(GenericApiGWTServiceImpl.java:51) at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:161) at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:222) at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:489) at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:153) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:368) at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:505) at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:445) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:930) at java.lang.Thread.run(Thread.java:722) - DHC

3 3