April 2014 - Devel - oVirt List Archives

short recap of today's vdsm call (29.4.2014)
by Dan Kenigsberg 29 Apr '14

29 Apr '14

Few things mentioned on today's call: - ovirt-3.3 is no longer supported: only security patches need to be merged there. - fenceSpmStorage turned into noop - intenetionally - infra code is expected to move around to its own subdir, as warned 2 weeks ago. - with pthreading used, any os.fork() causes a nasty warning Bug 1084500 - threading._after_fork spews "cannot notify on un-acquired lock" when os.fork is called from a thread - a huge json-rpc by Piotr needs to be broken to manageable pieces and reviewed. - Adam to create json-to-yaml schema conversion script (as a backward task) - sanlock fencing - Saggi's worries are to be addressed on the mailing list thread.

1 0

Re: [ovirt-devel] [vdsm] Missing numactl
by Vinzenz Feenstra 29 Apr '14

29 Apr '14

Seems pretty much like it On 04/28/2014 12:30 PM, Piotr Kliczewski wrote: > Hello, > > I pulled the latest changes from master to test my code and during > getCaps I got: > > Thread-14::ERROR::2014-04-28 > 12:11:44,394::__init__::484::jsonrpc.JsonRpcServer::(_serveRequest) > [Errno 2] No such file or directory > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line > 480, in _serveRequest > res = method(**params) > File "/usr/share/vdsm/Bridge.py", line 211, in _dynamicMethod > result = fn(*methodArgs) > File "/usr/share/vdsm/API.py", line 1184, in getCapabilities > c = caps.get() > File "/usr/share/vdsm/caps.py", line 459, in get > caps['numaNodeDistance'] = _getNumaNodeDistance() > File "/usr/lib64/python2.7/site-packages/vdsm/utils.py", line 1003, > in __call__ > value = self.func(*args) > File "/usr/share/vdsm/caps.py", line 209, in _getNumaNodeDistance > retcode, out, err = utils.execCmd(['numactl', '--hardware']) > File "/usr/lib64/python2.7/site-packages/vdsm/utils.py", line 732, in execCmd > deathSignal=deathSignal, childUmask=childUmask) > File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line > 50, in __init__ > stderr=PIPE) > File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__ > errread, errwrite) > File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line > 80, in _execute_child_v275 > self._childUmask) > OSError: [Errno 2] No such file or directory > > When I installed numactl rpm getCaps work again. > > Do we need to add this dependency to spec file? > > Thanks, > Piotr > _______________________________________________ > vdsm-devel mailing list > vdsm-devel(a)lists.fedorahosted.org > https://lists.fedorahosted.org/mailman/listinfo/vdsm-devel -- Regards, Vinzenz Feenstra | Senior Software Engineer RedHat Engineering Virtualization R & D Phone: +420 532 294 625 IRC: vfeenstr or evilissimo Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 1

[Devel] QoS Aggregate
by Gilad Chaplik 29 Apr '14

29 Apr '14

Hi list, While oVirt is rapidly continues to grow and gather features, it’s important to wrap already existing features with new ones, for better UX reasons. In oVirt 3.5, there are going to be 2 new QoS objects, CPU limits and blkio limits, added to the existing one network QoS (since 3.3). You are more than welcome to review my proposal to aggregate all features under the same umbrella: http://www.ovirt.org/Features/aggregate_QoS Thanks, Gilad.

2 4

Cooking with Python?
by Nir Soffer 29 Apr '14

29 Apr '14

You may like this free (as beer) online version: http://chimera.labs.oreilly.com/books/1230000000393 Nir

1 0

Fwd: [vdsm] Missing numactl
by Piotr Kliczewski 28 Apr '14

28 Apr '14

Hello, I pulled the latest changes from master to test my code and during getCaps I got: Thread-14::ERROR::2014-04-28 12:11:44,394::__init__::484::jsonrpc.JsonRpcServer::(_serveRequest) [Errno 2] No such file or directory Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 480, in _serveRequest res = method(**params) File "/usr/share/vdsm/Bridge.py", line 211, in _dynamicMethod result = fn(*methodArgs) File "/usr/share/vdsm/API.py", line 1184, in getCapabilities c = caps.get() File "/usr/share/vdsm/caps.py", line 459, in get caps['numaNodeDistance'] = _getNumaNodeDistance() File "/usr/lib64/python2.7/site-packages/vdsm/utils.py", line 1003, in __call__ value = self.func(*args) File "/usr/share/vdsm/caps.py", line 209, in _getNumaNodeDistance retcode, out, err = utils.execCmd(['numactl', '--hardware']) File "/usr/lib64/python2.7/site-packages/vdsm/utils.py", line 732, in execCmd deathSignal=deathSignal, childUmask=childUmask) File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line 50, in __init__ stderr=PIPE) File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__ errread, errwrite) File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line 80, in _execute_child_v275 self._childUmask) OSError: [Errno 2] No such file or directory When I installed numactl rpm getCaps work again. Do we need to add this dependency to spec file? Thanks, Piotr

1 0

new feature
by Martin Mucha 28 Apr '14

28 Apr '14

Hi, I'd like to notify you about new feature, which allows to specify distinct MAC pools, currently one per data center. http://www.ovirt.org/Scoped_MacPoolManager any comments/proposals for improvement are very welcomed. Martin.

6 23

ERRORs in server.log ovirt 3.3.3 el6
by Sven Kieske 25 Apr '14

25 Apr '14

Hi, I found some weird repeating errors in my server.log including some SQL Exceptions. here are some excerpts: 2014-03-28 17:12:56,755 ERROR [org.jboss.as.ejb3.tx.CMTTxInterceptor] (pool-6-thread-48) javax.ejb.EJBTransactionRolledbackException: Could not get JDBC Connection; nested exception is java.sql.SQLException: jav ax.resource.ResourceException: IJ000460: Error checking for a transaction 2014-03-28 17:12:56,757 ERROR [org.jboss.ejb3.invocation] (pool-6-thread-48) JBAS014134: EJB Invocation failed on component Backend for method public abstract org.ovirt.engine.core.common.action.VdcReturnValueBa se org.ovirt.engine.core.bll.interfaces.BackendInternal.runInternalAction(org.ovirt.engine.core.common.action.VdcActionType,org.ovirt.engine.core.common.action.VdcActionParametersBase,org.ovirt.engine.core.bll.c ontext.CommandContext): javax.ejb.EJBTransactionRolledbackException: Could not get JDBC Connection; nested exception is java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error checking for a tra nsaction at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleInCallerTx(CMTTxInterceptor.java:139) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] 2014-03-27 13:55:29,022 WARN [org.jboss.resteasy.core.SynchronousDispatcher] (ajp--127.0.0.1-8702-4) Unknown exception while executing GET : java.lang.IllegalStateException: setAttribute: Session already invali dated at org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1289) [jbossweb-7.0.13.Final.jar:] I got ldap/kerberos locally setup on the engine host. this is centos 6.5 the total numbers are way to high I guess: grep "ERROR" /var/log/ovirt-engine/server.log | wc -l 65734 I can provide complete logs if someone can debug this with me. -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

2 6

HTTP 500 on expired session request
by Yevgeny Zaspitsky 25 Apr '14

25 Apr '14

This is a multi-part message in MIME format. --------------060806010209080006030500 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Below is the error I get with HTTP code 500 when I sent a request from a client to REST-API that was left open and the server was restarted. Evidently the session is expired, but why do we return HTTP 500? Is this a server internal error? IMHO one of 400 codes is more appropriate for that error. E.g. 401 (Unauthorized) or 440 (Login Timeout according to http://en.wikipedia.org/wiki/List_of_HTTP_status_codes) *type* Exception report *message* *description* _The server encountered an internal error () that prevented it from fulfilling this request._ *exception* org.jboss.resteasy.spi.UnhandledException: java.lang.IllegalStateException: setAttribute: Session already invalidated org.jboss.resteasy.core.SynchronousDispatcher.handleException(SynchronousDispatcher.java:245) org.jboss.resteasy.core.SynchronousDispatcher.handleInvokerException(SynchronousDispatcher.java:190) org.jboss.resteasy.core.SynchronousDispatcher.getResponse(SynchronousDispatcher.java:540) org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:502) org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:119) org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:208) org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:55) org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:50) javax.servlet.http.HttpServlet.service(HttpServlet.java:847) org.ovirt.engine.core.authentication.AuthenticationFilter.doFilter(AuthenticationFilter.java:80) *root cause* java.lang.IllegalStateException: setAttribute: Session already invalidated org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1289) org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1254) org.apache.catalina.session.StandardSessionFacade.setAttribute(StandardSessionFacade.java:130) org.ovirt.engine.api.common.security.auth.SessionUtils.setEngineSessionId(SessionUtils.java:74) org.ovirt.engine.api.common.security.auth.Challenger.executeBasicAuthentication(Challenger.java:194) org.ovirt.engine.api.common.security.auth.Challenger.preProcess(Challenger.java:116) org.jboss.resteasy.core.ResourceMethod.invokeOnTarget(ResourceMethod.java:247) org.jboss.resteasy.core.ResourceMethod.invoke(ResourceMethod.java:222) * English - detected * English * Hebrew * Russian * English * Hebrew * Russian <javascript:void(0);> --------------060806010209080006030500 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=ISO-8859-1"> <link href="chrome://translator/skin/popup.css" type="text/css" rel="stylesheet"> </head> <body text="#000000" bgcolor="#FFFFFF"> Below is the error I get with HTTP code 500 when I sent a request from a client to REST-API that was left open and the server was restarted.<br> <br> Evidently the session is expired, but why do we return HTTP 500? Is this a server internal error?<br> IMHO one of 400 codes is more appropriate for that error. E.g. 401 (Unauthorized) or 440 (Login Timeout according to <a class="moz-txt-link-freetext" href="http://en.wikipedia.org/wiki/List_of_HTTP_status_codes">http://en.wikipedia.org/wiki/List_of_HTTP_status_codes</a>).<br> <p><b>type</b> Exception report</p> <p><b>message</b> </p> <p><b>description</b> <u>The server encountered an internal error () that prevented it from fulfilling this request.</u></p> <p><b>exception</b> </p> org.jboss.resteasy.spi.UnhandledException: java.lang.IllegalStateException: setAttribute: Session already invalidated org.jboss.resteasy.core.SynchronousDispatcher.handleException(SynchronousDispatcher.java:245) org.jboss.resteasy.core.SynchronousDispatcher.handleInvokerException(SynchronousDispatcher.java:190) org.jboss.resteasy.core.SynchronousDispatcher.getResponse(SynchronousDispatcher.java:540) org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:502) org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:119) org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:208) org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:55) org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:50) javax.servlet.http.HttpServlet.service(HttpServlet.java:847) org.ovirt.engine.core.authentication.AuthenticationFilter.doFilter(AuthenticationFilter.java:80) <p><b>root cause</b> </p> java.lang.IllegalStateException: setAttribute: Session already invalidated org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1289) org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1254) org.apache.catalina.session.StandardSessionFacade.setAttribute(StandardSessionFacade.java:130) org.ovirt.engine.api.common.security.auth.SessionUtils.setEngineSessionId(SessionUtils.java:74) org.ovirt.engine.api.common.security.auth.Challenger.executeBasicAuthentication(Challenger.java:194) org.ovirt.engine.api.common.security.auth.Challenger.preProcess(Challenger.java:116) org.jboss.resteasy.core.ResourceMethod.invokeOnTarget(ResourceMethod.java:247) org.jboss.resteasy.core.ResourceMethod.invoke(ResourceMethod.java:222) <div style="top: auto; max-width: 400px; max-height: 442px; bottom: 0px; left: auto; right: 0px; display: none;" class="translator-theme-default" id="translator-popup"> <div id="translator-popup-toolbar"> <div id="translator-popup-title"> <div id="translator-popup-source-languages-wrapper"> <ul style="margin-top: -18px;" id="translator-popup-source-languages"> <li id="translator-popup-source-language-auto" code="auto">English - detected</li> <li code="en">English</li> <li code="iw">Hebrew</li> <li code="ru">Russian</li> </ul> <div id="translator-popup-source-languages-scroller"></div> </div> <div id="translator-popup-languages-direction"></div> <div id="translator-popup-target-languages-wrapper"> <ul style="margin-top: -36px;" id="translator-popup-target-languages"> <li code="en">English</li> <li code="iw">Hebrew</li> <li code="ru">Russian</li> </ul> <div id="translator-popup-target-languages-scroller"></div> </div> </div> <div class="translator-popup-toolbar-spring"></div> <a title="Copy translated text to clipboard" href="javascript:void(0);" id="translator-popup-button-copy"></a></div> <div style="max-height: 392px; opacity: 1;" class="translator-message-type-normal" id="translator-popup-message"></div> <div style="display: none;" id="translator-popup-notice"></div> <textarea style="display: none;" id="translator-popup-textarea"></textarea></div> <div style="bottom: 0px; left: auto; right: 0px; top: auto; display: none;" title="Translating..." class="translator-theme-default" id="translator-popup-loading"></div> </body> </html> --------------060806010209080006030500--

2 1

Re: [ovirt-devel] [node-devel] Node Design ideas - And what you would like to see in or how you would like to see Node
by Doron Fediuck 25 Apr '14

25 Apr '14

Sharing with ovirt devel list to get additional awareness. ----- Original Message ----- From: "Fabian Deutsch" <fabiand(a)redhat.com> To: "node-devel" <node-devel(a)ovirt.org> Sent: Thursday, April 24, 2014 5:57:07 PM Subject: [node-devel] Node Design ideas - And what you would like to see in or how you would like to see Node Hey, lately - well for some time now - I noticed how often I asked myself why we had this or that bug, or why it was so hard to implement some features. For example. Getting iSCSI and EFI right in our installer is still "fragile". Because it's hard to get right. Or enabling and disabling services easily with standard tools at runtime on our Fedora based images is not possible, because it's not easily implementable with bind mounts (well, cumbersome). Or enable "live plugins" - plugins which can be installed at runtime. They are also difficult because of our use of bind mounts. Because of this I thought about how we could - from the ground up - change some designs to leverage more existing code (and have less code to maintain) and make some feature development easier. The two areas I looked at are already mentioned. It's the (a) installer - which is complex because of all the storage enumeration [0], EFI, iSCSI and it's age - and (b) how we work with the read-only rootfs - aka the LiveCD based design. For (a) I looked into Fedora's anaconda [1]. It has support for EFI, iSCSI and so one. Even high-level features to configure networking or add users (for which we also maintain some code). And for (b) I thought about a design based around LVM and thin volumes [2][3]. But changing parts of Node might result in Node having different properties. For example - Using the LVM based approach above would increase the size of the runtime rootfs to ~1GB. OTOH it would allow an arbitrary number of "layers" (for e.g. live plugins). And thus - before I start to think (only to think) about bigger changes in Node - I would like to know what properties of Node _you_ like, and which you would like to keep. Some ideas about what you could like or not: - installation size (~250MB)? - runtime size (~250MB)? - way of installation (kargs)? - TUI (simple instaler, setup)? - "firmware-like" feeling (read-only rootfs)? - ... And also - what changes you would like to see which ain't there yet! Greetings fabian -- [0] http://gerrit.ovirt.org/gitweb?p=ovirt-node.git;a=blob;f=src/ovirtnode/stor… [1] https://github.com/fabiand/imgbased/ [2] https://git.fedorahosted.org/cgit/anaconda.git/ [3] http://dummdida.tumblr.com/post/82392428141/imgbased-or-keeping-the-nature-…

1 0

Feature AAA JDBC password hashing
by Sven Kieske 24 Apr '14

24 Apr '14

Hi, I got a question/remark regarding this page: http://www.ovirt.org/Features/AAA_JDBC It states: Account Password Hash function, default sha256 Well this is not a secure default. I don't know if nothing better can be used but here are some viable alternatives, in decreasing order (when we talk about security): scrypt, bcrypt, PBKDF2 Would it be possible to use one of these as a default? -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

2 6