short recap of today's vdsm call (29.4.2014)
by Dan Kenigsberg
Few things mentioned on today's call:
- ovirt-3.3 is no longer supported: only security patches need to be merged
there.
- fenceSpmStorage turned into noop - intenetionally
- infra code is expected to move around to its own subdir, as warned 2
weeks ago.
- with pthreading used, any os.fork() causes a nasty warning
Bug 1084500 - threading._after_fork spews "cannot notify on
un-acquired lock" when os.fork is called from a thread
- a huge json-rpc by Piotr needs to be broken to manageable pieces and
reviewed.
- Adam to create json-to-yaml schema conversion script (as a backward task)
- sanlock fencing - Saggi's worries are to be addressed on the mailing
list thread.
10 years, 11 months
Re: [ovirt-devel] [vdsm] Missing numactl
by Vinzenz Feenstra
Seems pretty much like it
On 04/28/2014 12:30 PM, Piotr Kliczewski wrote:
> Hello,
>
> I pulled the latest changes from master to test my code and during
> getCaps I got:
>
> Thread-14::ERROR::2014-04-28
> 12:11:44,394::__init__::484::jsonrpc.JsonRpcServer::(_serveRequest)
> [Errno 2] No such file or directory
> Traceback (most recent call last):
> File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line
> 480, in _serveRequest
> res = method(**params)
> File "/usr/share/vdsm/Bridge.py", line 211, in _dynamicMethod
> result = fn(*methodArgs)
> File "/usr/share/vdsm/API.py", line 1184, in getCapabilities
> c = caps.get()
> File "/usr/share/vdsm/caps.py", line 459, in get
> caps['numaNodeDistance'] = _getNumaNodeDistance()
> File "/usr/lib64/python2.7/site-packages/vdsm/utils.py", line 1003,
> in __call__
> value = self.func(*args)
> File "/usr/share/vdsm/caps.py", line 209, in _getNumaNodeDistance
> retcode, out, err = utils.execCmd(['numactl', '--hardware'])
> File "/usr/lib64/python2.7/site-packages/vdsm/utils.py", line 732, in execCmd
> deathSignal=deathSignal, childUmask=childUmask)
> File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line
> 50, in __init__
> stderr=PIPE)
> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> errread, errwrite)
> File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line
> 80, in _execute_child_v275
> self._childUmask)
> OSError: [Errno 2] No such file or directory
>
> When I installed numactl rpm getCaps work again.
>
> Do we need to add this dependency to spec file?
>
> Thanks,
> Piotr
> _______________________________________________
> vdsm-devel mailing list
> vdsm-devel(a)lists.fedorahosted.org
> https://lists.fedorahosted.org/mailman/listinfo/vdsm-devel
--
Regards,
Vinzenz Feenstra | Senior Software Engineer
RedHat Engineering Virtualization R & D
Phone: +420 532 294 625
IRC: vfeenstr or evilissimo
Better technology. Faster innovation. Powered by community collaboration.
See how it works at redhat.com
10 years, 11 months
[Devel] QoS Aggregate
by Gilad Chaplik
Hi list,
While oVirt is rapidly continues to grow and gather features, it’s important to wrap already existing features with new ones, for better UX reasons.
In oVirt 3.5, there are going to be 2 new QoS objects, CPU limits and blkio limits, added to the existing one network QoS (since 3.3).
You are more than welcome to review my proposal to aggregate all features under the same umbrella:
http://www.ovirt.org/Features/aggregate_QoS
Thanks,
Gilad.
10 years, 11 months
Fwd: [vdsm] Missing numactl
by Piotr Kliczewski
Hello,
I pulled the latest changes from master to test my code and during
getCaps I got:
Thread-14::ERROR::2014-04-28
12:11:44,394::__init__::484::jsonrpc.JsonRpcServer::(_serveRequest)
[Errno 2] No such file or directory
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line
480, in _serveRequest
res = method(**params)
File "/usr/share/vdsm/Bridge.py", line 211, in _dynamicMethod
result = fn(*methodArgs)
File "/usr/share/vdsm/API.py", line 1184, in getCapabilities
c = caps.get()
File "/usr/share/vdsm/caps.py", line 459, in get
caps['numaNodeDistance'] = _getNumaNodeDistance()
File "/usr/lib64/python2.7/site-packages/vdsm/utils.py", line 1003,
in __call__
value = self.func(*args)
File "/usr/share/vdsm/caps.py", line 209, in _getNumaNodeDistance
retcode, out, err = utils.execCmd(['numactl', '--hardware'])
File "/usr/lib64/python2.7/site-packages/vdsm/utils.py", line 732, in execCmd
deathSignal=deathSignal, childUmask=childUmask)
File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line
50, in __init__
stderr=PIPE)
File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
errread, errwrite)
File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line
80, in _execute_child_v275
self._childUmask)
OSError: [Errno 2] No such file or directory
When I installed numactl rpm getCaps work again.
Do we need to add this dependency to spec file?
Thanks,
Piotr
10 years, 11 months
ERRORs in server.log ovirt 3.3.3 el6
by Sven Kieske
Hi,
I found some weird repeating errors in my server.log
including some SQL Exceptions.
here are some excerpts:
2014-03-28 17:12:56,755 ERROR [org.jboss.as.ejb3.tx.CMTTxInterceptor]
(pool-6-thread-48) javax.ejb.EJBTransactionRolledbackException: Could
not get JDBC Connection; nested exception is java.sql.SQLException: jav
ax.resource.ResourceException: IJ000460: Error checking for a transaction
2014-03-28 17:12:56,757 ERROR [org.jboss.ejb3.invocation]
(pool-6-thread-48) JBAS014134: EJB Invocation failed on component
Backend for method public abstract
org.ovirt.engine.core.common.action.VdcReturnValueBa
se
org.ovirt.engine.core.bll.interfaces.BackendInternal.runInternalAction(org.ovirt.engine.core.common.action.VdcActionType,org.ovirt.engine.core.common.action.VdcActionParametersBase,org.ovirt.engine.core.bll.c
ontext.CommandContext): javax.ejb.EJBTransactionRolledbackException:
Could not get JDBC Connection; nested exception is
java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error
checking for a tra
nsaction
at
org.jboss.as.ejb3.tx.CMTTxInterceptor.handleInCallerTx(CMTTxInterceptor.java:139)
[jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
2014-03-27 13:55:29,022 WARN
[org.jboss.resteasy.core.SynchronousDispatcher] (ajp--127.0.0.1-8702-4)
Unknown exception while executing GET : java.lang.IllegalStateException:
setAttribute: Session already invali
dated
at
org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1289)
[jbossweb-7.0.13.Final.jar:]
I got ldap/kerberos locally setup on the engine host.
this is centos 6.5
the total numbers are way to high I guess:
grep "ERROR" /var/log/ovirt-engine/server.log | wc -l
65734
I can provide complete logs if someone can debug this with me.
--
Mit freundlichen Grüßen / Regards
Sven Kieske
Systemadministrator
Mittwald CM Service GmbH & Co. KG
Königsberger Straße 6
32339 Espelkamp
T: +49-5772-293-100
F: +49-5772-293-333
https://www.mittwald.de
Geschäftsführer: Robert Meyer
St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen
Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
10 years, 11 months
HTTP 500 on expired session request
by Yevgeny Zaspitsky
This is a multi-part message in MIME format.
--------------060806010209080006030500
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Below is the error I get with HTTP code 500 when I sent a request from a
client to REST-API that was left open and the server was restarted.
Evidently the session is expired, but why do we return HTTP 500? Is this
a server internal error?
IMHO one of 400 codes is more appropriate for that error. E.g. 401
(Unauthorized) or 440 (Login Timeout according to
http://en.wikipedia.org/wiki/List_of_HTTP_status_codes).
*type* Exception report
*message*
*description* _The server encountered an internal error () that
prevented it from fulfilling this request._
*exception*
org.jboss.resteasy.spi.UnhandledException:
java.lang.IllegalStateException: setAttribute: Session already
invalidated
org.jboss.resteasy.core.SynchronousDispatcher.handleException(SynchronousDispatcher.java:245)
org.jboss.resteasy.core.SynchronousDispatcher.handleInvokerException(SynchronousDispatcher.java:190)
org.jboss.resteasy.core.SynchronousDispatcher.getResponse(SynchronousDispatcher.java:540)
org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:502)
org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:119)
org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:208)
org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:55)
org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:50)
javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
org.ovirt.engine.core.authentication.AuthenticationFilter.doFilter(AuthenticationFilter.java:80)
*root cause*
java.lang.IllegalStateException: setAttribute: Session already
invalidated
org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1289)
org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1254)
org.apache.catalina.session.StandardSessionFacade.setAttribute(StandardSessionFacade.java:130)
org.ovirt.engine.api.common.security.auth.SessionUtils.setEngineSessionId(SessionUtils.java:74)
org.ovirt.engine.api.common.security.auth.Challenger.executeBasicAuthentication(Challenger.java:194)
org.ovirt.engine.api.common.security.auth.Challenger.preProcess(Challenger.java:116)
org.jboss.resteasy.core.ResourceMethod.invokeOnTarget(ResourceMethod.java:247)
org.jboss.resteasy.core.ResourceMethod.invoke(ResourceMethod.java:222)
* English - detected
* English
* Hebrew
* Russian
* English
* Hebrew
* Russian
<javascript:void(0);>
--------------060806010209080006030500
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=ISO-8859-1">
<link href="chrome://translator/skin/popup.css" type="text/css"
rel="stylesheet">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Below is the error I get with HTTP code 500 when I sent a request
from a client to REST-API that was left open and the server was
restarted.<br>
<br>
Evidently the session is expired, but why do we return HTTP 500? Is
this a server internal error?<br>
IMHO one of 400 codes is more appropriate for that error. E.g. 401
(Unauthorized) or 440 (Login Timeout according to
<a class="moz-txt-link-freetext" href="http://en.wikipedia.org/wiki/List_of_HTTP_status_codes">http://en.wikipedia.org/wiki/List_of_HTTP_status_codes</a>).<br>
<p><b>type</b> Exception report</p>
<p><b>message</b> </p>
<p><b>description</b> <u>The server encountered an internal error
() that prevented it from fulfilling this request.</u></p>
<p><b>exception</b> </p>
org.jboss.resteasy.spi.UnhandledException:
java.lang.IllegalStateException: setAttribute: Session already
invalidated
org.jboss.resteasy.core.SynchronousDispatcher.handleException(SynchronousDispatcher.java:245)
org.jboss.resteasy.core.SynchronousDispatcher.handleInvokerException(SynchronousDispatcher.java:190)
org.jboss.resteasy.core.SynchronousDispatcher.getResponse(SynchronousDispatcher.java:540)
org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:502)
org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:119)
org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:208)
org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:55)
org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:50)
javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
org.ovirt.engine.core.authentication.AuthenticationFilter.doFilter(AuthenticationFilter.java:80)
<p><b>root cause</b> </p>
java.lang.IllegalStateException: setAttribute: Session already
invalidated
org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1289)
org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1254)
org.apache.catalina.session.StandardSessionFacade.setAttribute(StandardSessionFacade.java:130)
org.ovirt.engine.api.common.security.auth.SessionUtils.setEngineSessionId(SessionUtils.java:74)
org.ovirt.engine.api.common.security.auth.Challenger.executeBasicAuthentication(Challenger.java:194)
org.ovirt.engine.api.common.security.auth.Challenger.preProcess(Challenger.java:116)
org.jboss.resteasy.core.ResourceMethod.invokeOnTarget(ResourceMethod.java:247)
org.jboss.resteasy.core.ResourceMethod.invoke(ResourceMethod.java:222)
<div style="top: auto; max-width: 400px; max-height: 442px; bottom:
0px; left: auto; right: 0px; display: none;"
class="translator-theme-default" id="translator-popup">
<div id="translator-popup-toolbar">
<div id="translator-popup-title">
<div id="translator-popup-source-languages-wrapper">
<ul style="margin-top: -18px;"
id="translator-popup-source-languages">
<li id="translator-popup-source-language-auto" code="auto">English
- detected</li>
<li code="en">English</li>
<li code="iw">Hebrew</li>
<li code="ru">Russian</li>
</ul>
<div id="translator-popup-source-languages-scroller"></div>
</div>
<div id="translator-popup-languages-direction"></div>
<div id="translator-popup-target-languages-wrapper">
<ul style="margin-top: -36px;"
id="translator-popup-target-languages">
<li code="en">English</li>
<li code="iw">Hebrew</li>
<li code="ru">Russian</li>
</ul>
<div id="translator-popup-target-languages-scroller"></div>
</div>
</div>
<div class="translator-popup-toolbar-spring"></div>
<a title="Copy translated text to clipboard"
href="javascript:void(0);" id="translator-popup-button-copy"></a></div>
<div style="max-height: 392px; opacity: 1;"
class="translator-message-type-normal"
id="translator-popup-message"></div>
<div style="display: none;" id="translator-popup-notice"></div>
<textarea style="display: none;" id="translator-popup-textarea"></textarea></div>
<div style="bottom: 0px; left: auto; right: 0px; top: auto; display:
none;" title="Translating..." class="translator-theme-default"
id="translator-popup-loading"></div>
</body>
</html>
--------------060806010209080006030500--
10 years, 11 months
Re: [ovirt-devel] [node-devel] Node Design ideas - And what you would like to see in or how you would like to see Node
by Doron Fediuck
Sharing with ovirt devel list to get additional awareness.
----- Original Message -----
From: "Fabian Deutsch" <fabiand(a)redhat.com>
To: "node-devel" <node-devel(a)ovirt.org>
Sent: Thursday, April 24, 2014 5:57:07 PM
Subject: [node-devel] Node Design ideas - And what you would like to see in or how you would like to see Node
Hey,
lately - well for some time now - I noticed how often I asked myself why
we had this or that bug, or why it was so hard to implement some
features.
For example. Getting iSCSI and EFI right in our installer is still
"fragile". Because it's hard to get right.
Or enabling and disabling services easily with standard tools at runtime
on our Fedora based images is not possible, because it's not easily
implementable with bind mounts (well, cumbersome).
Or enable "live plugins" - plugins which can be installed at runtime.
They are also difficult because of our use of bind mounts.
Because of this I thought about how we could - from the ground up -
change some designs to leverage more existing code (and have less code
to maintain) and make some feature development easier.
The two areas I looked at are already mentioned. It's the (a) installer
- which is complex because of all the storage enumeration [0], EFI,
iSCSI and it's age - and (b) how we work with the read-only rootfs - aka
the LiveCD based design.
For (a) I looked into Fedora's anaconda [1]. It has support for EFI,
iSCSI and so one. Even high-level features to configure networking or
add users (for which we also maintain some code).
And for (b) I thought about a design based around LVM and thin volumes
[2][3].
But changing parts of Node might result in Node having different
properties.
For example - Using the LVM based approach above would increase the size
of the runtime rootfs to ~1GB. OTOH it would allow an arbitrary number
of "layers" (for e.g. live plugins).
And thus - before I start to think (only to think) about bigger changes
in Node - I would like to know what properties of Node _you_ like, and
which you would like to keep.
Some ideas about what you could like or not:
- installation size (~250MB)?
- runtime size (~250MB)?
- way of installation (kargs)?
- TUI (simple instaler, setup)?
- "firmware-like" feeling (read-only rootfs)?
- ...
And also - what changes you would like to see which ain't there yet!
Greetings
fabian
--
[0]
http://gerrit.ovirt.org/gitweb?p=ovirt-node.git;a=blob;f=src/ovirtnode/st...
[1] https://github.com/fabiand/imgbased/
[2] https://git.fedorahosted.org/cgit/anaconda.git/
[3]
http://dummdida.tumblr.com/post/82392428141/imgbased-or-keeping-the-natur...
10 years, 11 months
Feature AAA JDBC password hashing
by Sven Kieske
Hi,
I got a question/remark regarding this page:
http://www.ovirt.org/Features/AAA_JDBC
It states:
Account Password
Hash function, default sha256
Well this is not a secure default.
I don't know if nothing better can be used
but here are some viable alternatives, in
decreasing order (when we talk about security):
scrypt, bcrypt, PBKDF2
Would it be possible to use one of these
as a default?
--
Mit freundlichen Grüßen / Regards
Sven Kieske
Systemadministrator
Mittwald CM Service GmbH & Co. KG
Königsberger Straße 6
32339 Espelkamp
T: +49-5772-293-100
F: +49-5772-293-333
https://www.mittwald.de
Geschäftsführer: Robert Meyer
St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen
Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
10 years, 11 months
