Re: [ovirt-devel] URGENT! OST broken! please stop merging patches to ovirt-engine!
by Greg Sheremeta
On Aug 30, 2017 8:46 AM, "Maor Lipchuk" <mlipchuk(a)redhat.com> wrote:
Yes, there is already an acked patch that solves it.
The weird thing is that the OST ran successfully when running with "ci
please build" although it seems that the artifact was not added to it.
That doesn't run full OST. It only runs build-artifacts :)
On Wed, Aug 30, 2017 at 3:17 PM, Greg Sheremeta <gshereme(a)redhat.com> wrote:
>
> On Wed, Aug 30, 2017 at 7:13 AM, Barak Korren <bkorren(a)redhat.com> wrote:
>>
>> We have two unresolved issues that are currently causing all master
>> OST runs to fail and preventing us from effectively finding
>> regressions.
>>
>> The 1st issue, which was already reported on Sunday, is a regression
>> that is causing vm_run to fail and was probably introduced by this
>> patch:
>> https://gerrit.ovirt.org/#/c/79033/41
>
>
> cc'd Shubham and Maor. Is anyone looking into this?
>
>>
>>
>>
>> Here is a recent run that failed with this:
>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2147/
>>
>> Logs are here:
>>
>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-
tester/2147/artifact/exported-artifacts/basic-suit-master-
el7/test_logs/basic-suite-master/post-002_bootstrap.py/
>>
>> The 2nd issue is a new one, that seems to be causing add-host failures
>> and I've just send another email about it. The gist of this is that
>> I'm siing the following failures in the supervdsm logs, and vdsm is
>> not loading:
>>
>> MainThread::ERROR::2017-08-30
>> 05:55:59,476::initializer::53::root::(_lldp_init) Failed to enable
>> LLDP on eth1
>> Traceback (most recent call last):
>> File "/usr/lib/python2.7/site-packages/vdsm/network/initializer.py",
>> line 51, in _lldp_init
>> Lldp.enable_lldp_on_iface(device)
>> File "/usr/lib/python2.7/site-packages/vdsm/network/lldp/lldpad.py",
>> line 30, in enable_lldp_on_iface
>> lldptool.enable_lldp_on_iface(iface, rx_only)
>> File "/usr/lib/python2.7/site-packages/vdsm/network/lldpad/
lldptool.py",
>> line 46, in enable_lldp_on_iface
>> raise EnableLldpError(rc, out, err, iface)
>> EnableLldpError: (1,
>> "timeout\n'M00000001C3040000000c04eth1000badminStatus0002rx' command
>> timed out.\n", '', 'eth1')
>> MainThread::DEBUG::2017-08-30
>> 05:55:59,477::cmdutils::133::root::(exec_cmd) /usr/sbin/lldptool
>> get-lldp -i eth0 adminStatus (cwd None)
>>
>>
>> This failure does not seem to have been introduced by the platform and
>> not oVirt code, because it also happens on code that already passed
>> OST a few days ago.
>>
>> Please avoid merging any patches except to the purpose of resolving
>> these issues. Nothing is making it into the 'tested' and nightly
>> snapshot repos anyway ATM.
>>
>> --
>> Barak Korren
>> RHV DevOps team , RHCE, RHCi
>> Red Hat EMEA
>> redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted
>> _______________________________________________
>> Devel mailing list
>> Devel(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/devel
>
>
7 years, 3 months
URGENT! OST broken! please stop merging patches to ovirt-engine!
by Barak Korren
We have two unresolved issues that are currently causing all master
OST runs to fail and preventing us from effectively finding
regressions.
The 1st issue, which was already reported on Sunday, is a regression
that is causing vm_run to fail and was probably introduced by this
patch:
https://gerrit.ovirt.org/#/c/79033/41
Here is a recent run that failed with this:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2147/
Logs are here:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2147/artifa...
The 2nd issue is a new one, that seems to be causing add-host failures
and I've just send another email about it. The gist of this is that
I'm siing the following failures in the supervdsm logs, and vdsm is
not loading:
MainThread::ERROR::2017-08-30
05:55:59,476::initializer::53::root::(_lldp_init) Failed to enable
LLDP on eth1
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/vdsm/network/initializer.py",
line 51, in _lldp_init
Lldp.enable_lldp_on_iface(device)
File "/usr/lib/python2.7/site-packages/vdsm/network/lldp/lldpad.py",
line 30, in enable_lldp_on_iface
lldptool.enable_lldp_on_iface(iface, rx_only)
File "/usr/lib/python2.7/site-packages/vdsm/network/lldpad/lldptool.py",
line 46, in enable_lldp_on_iface
raise EnableLldpError(rc, out, err, iface)
EnableLldpError: (1,
"timeout\n'M00000001C3040000000c04eth1000badminStatus0002rx' command
timed out.\n", '', 'eth1')
MainThread::DEBUG::2017-08-30
05:55:59,477::cmdutils::133::root::(exec_cmd) /usr/sbin/lldptool
get-lldp -i eth0 adminStatus (cwd None)
This failure does not seem to have been introduced by the platform and
not oVirt code, because it also happens on code that already passed
OST a few days ago.
Please avoid merging any patches except to the purpose of resolving
these issues. Nothing is making it into the 'tested' and nightly
snapshot repos anyway ATM.
--
Barak Korren
RHV DevOps team , RHCE, RHCi
Red Hat EMEA
redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted
7 years, 3 months
[ oVirt Devel ] [oVirt master ] [ OST Failure Report ] [ basic_suite_master & upgrade_suites failed ]
by Daniel Belenky
*Test Failed:*
1. *basic_suite: *002_bootstrap.add_dc and
2. *upgrade_from_release: *001_upgrade_engine.test_initialize_engine
3. *upgrade_from_prevrelease*:
*Link to test logs:*
1. *basic suite logs
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2136/artifa...>*
2. *upgrade from prev release suite logs
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2136/artifa...>*
3. *upgrade from release suite logs
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2136/artifa...>*
*Suspected patch: https://gerrit.ovirt.org/#/c/79033/41
<https://gerrit.ovirt.org/#/c/79033/41>*
*Please note that this change was the only change under those tests.*
*Error snippet from basic-suite /var/log/ovirt-engine/server.log:*
ERROR [io.undertow.request] (default task-5) UT005023: Exception
handling request to /ovirt-engine/api/v4/datacenters:
java.lang.RuntimeException: org.jboss.resteasy.spi.UnhandledException:
java.lang.NoClassDefFoundError:
org/ovirt/api/metamodel/server/ValidationException
at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImpl(RequestDispatcherImpl.java:245)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImplSetup(RequestDispatcherImpl.java:147)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.spec.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:111)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:180)
[restapi-jaxrs.jar:]
at org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:98)
[restapi-jaxrs.jar:]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:117)
[restapi-jaxrs.jar:]
at org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:72)
[restapi-jaxrs.jar:]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.ovirt.engine.core.aaa.filters.RestApiSessionMgmtFilter.doFilter(RestApiSessionMgmtFilter.java:78)
[aaa.jar:]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.ovirt.engine.core.aaa.filters.EnforceAuthFilter.doFilter(EnforceAuthFilter.java:42)
[aaa.jar:]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.ovirt.engine.core.aaa.filters.SsoRestApiNegotiationFilter.doFilter(SsoRestApiNegotiationFilter.java:84)
[aaa.jar:]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.ovirt.engine.core.aaa.filters.SsoRestApiAuthFilter.doFilter(SsoRestApiAuthFilter.java:47)
[aaa.jar:]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.ovirt.engine.core.aaa.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:59)
[aaa.jar:]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.ovirt.engine.core.aaa.filters.RestApiSessionValidationFilter.doFilter(RestApiSessionValidationFilter.java:35)
[aaa.jar:]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:111)
[restapi-jaxrs.jar:]
at org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:102)
[restapi-jaxrs.jar:]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.ovirt.engine.core.utils.servlet.CORSSupportFilter.doFilter(CORSSupportFilter.java:284)
[utils.jar:]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78)
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61)
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.lambda$create$0(SecurityContextThreadSetupAction.java:105)
at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1508)
at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1508)
at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1508)
at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.server.Connectors.executeRootHandler(Connectors.java:326)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:812)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[rt.jar:1.8.0_141]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[rt.jar:1.8.0_141]
at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_141]
Caused by: org.jboss.resteasy.spi.UnhandledException:
java.lang.NoClassDefFoundError:
org/ovirt/api/metamodel/server/ValidationException
at org.jboss.resteasy.core.ExceptionHandler.handleApplicationException(ExceptionHandler.java:78)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.core.ExceptionHandler.handleException(ExceptionHandler.java:222)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.core.SynchronousDispatcher.writeException(SynchronousDispatcher.java:179)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:422)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:213)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:228)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
[jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final]
at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:81)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
[undertow-core-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:274)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.handlers.ServletInitialHandler.dispatchToPath(ServletInitialHandler.java:209)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImpl(RequestDispatcherImpl.java:221)
[undertow-servlet-1.4.18.Final.jar:1.4.18.Final]
... 73 more
Caused by: java.lang.NoClassDefFoundError:
org/ovirt/api/metamodel/server/ValidationException
at org.ovirt.engine.api.resource.DataCentersResource.doAdd(DataCentersResource.java:58)
[restapi-definition.jar:]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[rt.jar:1.8.0_141]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[rt.jar:1.8.0_141]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_141]
at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_141]
at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:140)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.core.ResourceLocatorInvoker.invokeOnTargetObject(ResourceLocatorInvoker.java:138)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.core.ResourceLocatorInvoker.invoke(ResourceLocatorInvoker.java:101)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:406)
[resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final]
... 88 more
Caused by: java.lang.ClassNotFoundException:
org.ovirt.api.metamodel.server.ValidationException from [Module
"org.ovirt.engine.api.restapi-definition" from local module loader
@61064425 (finder: local module finder @7b1d7fff (roots:
/usr/share/ovirt-engine-wildfly-overlay/modules,/usr/share/ovirt-engine/modules/common,/usr/share/ovirt-engine-extension-aaa-jdbc/modules,/usr/share/ovirt-engine-extension-aaa-ldap/modules,/usr/share/ovirt-engine-wildfly/modules,/usr/share/ovirt-engine-wildfly/modules/system/layers/base))]
at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:198)
[jboss-modules.jar:1.6.0.CR2]
at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:412)
[jboss-modules.jar:1.6.0.CR2]
at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:400)
[jboss-modules.jar:1.6.0.CR2]
at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:116)
[jboss-modules.jar:1.6.0.CR2]
... 99 more
*Error snippet from both upgrade suites (engine setup output):*[ ERROR
] Failed to execute stage 'Closing up': Command '/bin/firewall-cmd'
failed to execute
--
DANIEL BELENKY
RHV DEVOPS
Red Hat EMEA <https://www.redhat.com/>
IRC: #rhev-integ #rhev-dev
<https://red.ht/sig>
7 years, 3 months
vdsm fails with: [Errno 2] No such file or directory: '/var/run/vdsm/svdsm.sock'
by Marcin Mirecki
Hi,
I'm trying to add a add a new host, but each time the installation fails
due to service supervdsm failing with:
Aug 29 11:33:23 f25_55 daemonAdapter[1166]: Traceback (most recent call
last):
Aug 29 11:33:23 f25_55 daemonAdapter[1166]: File
"/usr/lib64/python2.7/multiprocessing/util.py", line 274, in _run_finalizers
Aug 29 11:33:23 f25_55 daemonAdapter[1166]: finalizer()
Aug 29 11:33:23 f25_55 daemonAdapter[1166]: File
"/usr/lib64/python2.7/multiprocessing/util.py", line 207, in __call__
Aug 29 11:33:23 f25_55 daemonAdapter[1166]: res =
self._callback(*self._args, **self._kwargs)
Aug 29 11:33:23 f25_55 daemonAdapter[1166]: OSError: [Errno 2] No such file
or directory: '/var/run/vdsm/svdsm.sock'
Aug 29 11:33:23 f25_55 systemd[1]: supervdsmd.service: Main process exited,
code=exited, status=1/FAILURE
Aug 29 11:33:23 f25_55 systemd[1]: supervdsmd.service: Unit entered failed
state.
I tried it on different freshly intalled f25 hosts.
Tried installing vdsm from engine and manually, the problem occurs every
time.
Thanks,
Marcin
7 years, 3 months
Re: [ovirt-devel] CI failure with tox
by Barak Korren
On 29 August 2017 at 11:28, Francesco Romani <fromani(a)redhat.com> wrote:
> Hi Infra,
>
>
> while running CI on some patches (example:
> https://gerrit.ovirt.org/#/c/80967/) I see this failure[1]
>
> It seems to me something on the CI worker is broken, could anyone check?
>
> let me stress that the tests pass on my fedora laptop and that the
> failure seems unrelated to my patch(es).
Note that its failing inside the EL7 chroot but not the FC25 chroot.
Could you be using some version of a library call that does not exist
on EL7 or returns different output?
Not that test scripts always run inside an isolated chroot, so chances
of something in the build slave affecting them are slim as long as
you're not trying to connect to any external services or devices.
This does not look like an obvious build slave issue, so CCing devel.
--
Barak Korren
RHV DevOps team , RHCE, RHCi
Red Hat EMEA
redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted
7 years, 3 months
[ OST Failure Report ] [ oVirt master ] [ 20-08-2017 ] [add_cluster]
by Barak Korren
Test failed: [ 002_bootstrap.add_cluster ]
Link to suspected patches:
https://gerrit.ovirt.org/#/c/80692/7
Link to Job:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2066
Link to all logs:
Error snippet from log:
<error>
Fault reason is "Operation Failed". Fault detail is
"javax.ejb.EJBException: java.lang.NullPointerException
at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleExceptionInNoTx(CMTTxInterceptor.java:214)
at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:266)
at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379)
...
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
at org.ovirt.engine.core.bll.Backend.evaluateCorrelationId(Backend.java:506)
at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:492)
at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:481)
at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:434)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
...
</error>
*********************
Please note that all OST tests including recent engine patches had
been broken since a patch perviously reported. We report this because
we've noticed a change in the failing test.
Note that no new engine-patches are being accepted into the 'tested'
repositories, and this is expected to continue until the existing
issues are fixed.
*********************
--
Barak Korren
RHV DevOps team , RHCE, RHCi
Red Hat EMEA
redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted
7 years, 3 months
ImageIO issues
by Piotr Kliczewski
Hi,
For some time I am attempting to upload 14GB image over my local
network. I faced network service crash on my vdsm host (it runs
imageio daemon). Now I got following issue:
- daemon side:
2017-08-28 12:02:01,289 ERROR (Thread-194) [web] 192.168.1.107 - PUT
/db08fc46-76f3-448a-8899-acd14a7cda41 500 210 (263.16s)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/ovirt_imageio_common/web.py",
line 48, in __call__
resp = self.dispatch(request)
File "/usr/lib/python2.7/site-packages/ovirt_imageio_common/web.py",
line 73, in dispatch
return method(*match.groups())
File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py",
line 162, in put
op.run()
File "/usr/lib/python2.7/site-packages/ovirt_imageio_common/directio.py",
line 68, in run
self._run()
File "/usr/lib/python2.7/site-packages/ovirt_imageio_common/directio.py",
line 156, in _run
self._receive_chunk(dst, buf, count)
File "/usr/lib/python2.7/site-packages/ovirt_imageio_common/directio.py",
line 192, in _receive_chunk
raise errors.PartialContent(self.size, self.done)
PartialContent: Requested 8388608 bytes, available 6389760 bytes
- proxy side:
192.168.1.107 - - [28/Aug/2017 12:01:56] "PUT
/images/db08fc46-76f3-448a-8899-acd14a7cda41 HTTP/1.1" 500 59
----------------------------------------
Exception happened during processing of request from ('192.168.1.107', 51716)
Traceback (most recent call last):
File "/usr/lib64/python2.7/SocketServer.py", line 596, in
process_request_thread
self.finish_request(request, client_address)
File "/usr/lib64/python2.7/SocketServer.py", line 331, in finish_request
self.RequestHandlerClass(request, client_address, self)
File "/usr/lib64/python2.7/SocketServer.py", line 654, in __init__
self.finish()
File "/usr/lib64/python2.7/SocketServer.py", line 713, in finish
self.wfile.close()
File "/usr/lib64/python2.7/socket.py", line 283, in close
self.flush()
File "/usr/lib64/python2.7/socket.py", line 307, in flush
self._sock.sendall(view[write_offset:write_offset+buffer_size])
File "/usr/lib64/python2.7/ssl.py", line 753, in sendall
v = self.send(data[count:])
File "/usr/lib64/python2.7/ssl.py", line 719, in send
v = self._sslobj.write(data)
error: [Errno 32] Broken pipe
----------------------------------------
I am using sources from couple of days ago and running both services
on fedora 25. Is it known issue or should I open BZ for it?
Thanks,
Piotr
7 years, 3 months
