- Devel - oVirt List Archives

[ OST Failure Report ] [ oVirt master ] [ 2017-08-30 ] [add_hosts]
by Barak Korren 31 Aug '17

31 Aug '17

Test failed: [ 002_bootstrap.add_hosts ] Link to suspected patches: We suspect this is due to change to LLDPAD in upstream CentOS repos. We can't tell the exact point it was introduced because other ovirt-engine regressions introduced too much noise into the system. It also seems that the failure is not 100% reproducible sine we have runs that do not encounter it. Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2151 (This job checked a specific patch to ovirt-log-collector but failure seems unrelated, and also happens on vanille 'tested' repo right now). Link to all logs: VDSM logs seem to be most relevant here: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2151/artifact… Error snippet from log: - From VDSM logs (note it exists very quickly): <error> 2017-08-30 05:55:52,208-0400 INFO (MainThread) [vds] (PID: 4594) I am the actual vdsm 4.20.2-133.git0ce4485.el7.centos lago-basic-suite-master-host-0 (3.10.0-514.2.2.el7.x86_64) (vdsmd:148) 2017-08-30 05:55:52,209-0400 INFO (MainThread) [vds] VDSM will run with cpu affinity: frozenset([1]) (vdsmd:254) 2017-08-30 05:55:52,253-0400 INFO (MainThread) [storage.check] Starting check service (check:92) 2017-08-30 05:55:52,257-0400 INFO (MainThread) [storage.Dispatcher] Starting StorageDispatcher... (dispatcher:48) 2017-08-30 05:55:52,257-0400 INFO (check/loop) [storage.asyncevent] Starting <EventLoop running=True closed=False at 0x45317520> (asyncevent:125) 2017-08-30 05:55:52,288-0400 INFO (MainThread) [vdsm.api] START registerDomainStateChangeCallback(callbackFunc=<functools.partial object at 0x2b47b50>) from=internal, task_id=2cebe9ef-358e-47d7-81a6-8c4b54b9cd6d (api:46) 2017-08-30 05:55:52,288-0400 INFO (MainThread) [vdsm.api] FINISH registerDomainStateChangeCallback return=None from=internal, task_id=2cebe9ef-358e-47d7-81a6-8c4b54b9cd6d (api:52) 2017-08-30 05:55:52,288-0400 INFO (MainThread) [MOM] Preparing MOM interface (momIF:53) 2017-08-30 05:55:52,289-0400 INFO (MainThread) [MOM] Using named unix socket /var/run/vdsm/mom-vdsm.sock (momIF:62) 2017-08-30 05:55:52,289-0400 INFO (MainThread) [root] Unregistering all secrets (secret:91) 2017-08-30 05:55:52,307-0400 INFO (MainThread) [vds] Setting channels' timeout to 30 seconds. (vmchannels:221) 2017-08-30 05:55:52,309-0400 INFO (vmrecovery) [vds] recovery: completed in 0s (clientIF:516) 2017-08-30 05:55:52,310-0400 INFO (MainThread) [vds.MultiProtocolAcceptor] Listening at :::54321 (protocoldetector:196) 2017-08-30 05:55:52,496-0400 INFO (http) [vds] Server running (http:58) 2017-08-30 05:55:52,742-0400 INFO (periodic/1) [vdsm.api] START repoStats(domains=()) from=internal, task_id=85768015-8ecb-48e3-9307-f671bfc33c65 (api:46) 2017-08-30 05:55:52,743-0400 INFO (periodic/1) [vdsm.api] FINISH repoStats return={} from=internal, task_id=85768015-8ecb-48e3-9307-f671bfc33c65 (api:52) 2017-08-30 05:55:52,743-0400 WARN (periodic/1) [throttled] MOM not available. (throttledlog:103) 2017-08-30 05:55:52,744-0400 WARN (periodic/1) [throttled] MOM not available, KSM stats will be missing. (throttledlog:103) 2017-08-30 05:55:55,043-0400 INFO (MainThread) [vds] Received signal 15, shutting down (vdsmd:67) 2017-08-30 05:55:55,045-0400 INFO (MainThread) [jsonrpc.JsonRpcServer] Stopping JsonRPC Server (__init__:759) 2017-08-30 05:55:55,049-0400 INFO (MainThread) [vds] Stopping http server (http:79) 2017-08-30 05:55:55,049-0400 INFO (http) [vds] Server stopped (http:69) 2017-08-30 05:55:55,050-0400 INFO (MainThread) [root] Unregistering all secrets (secret:91) 2017-08-30 05:55:55,052-0400 INFO (MainThread) [vdsm.api] START prepareForShutdown(options=None) from=internal, task_id=ffde5caa-fa44-49ab-bdd1-df81519680a3 (api:46) 2017-08-30 05:55:55,089-0400 INFO (MainThread) [storage.Monitor] Shutting down domain monitors (monitor:222) 2017-08-30 05:55:55,090-0400 INFO (MainThread) [storage.check] Stopping check service (check:105) 2017-08-30 05:55:55,090-0400 INFO (check/loop) [storage.asyncevent] Stopping <EventLoop running=True closed=False at 0x45317520> (asyncevent:220) 2017-08-30 05:55:55,090-0400 INFO (MainThread) [vdsm.api] FINISH prepareForShutdown return=None from=internal, task_id=ffde5caa-fa44-49ab-bdd1-df81519680a3 (api:52) 2017-08-30 05:55:55,091-0400 INFO (MainThread) [vds] Stopping threads (vdsmd:159) 2017-08-30 05:55:55,091-0400 INFO (MainThread) [vds] Exiting (vdsmd:170) </error> - From SuperVDSM logs: <error> MainThread::ERROR::2017-08-30 05:55:59,476::initializer::53::root::(_lldp_init) Failed to enable LLDP on eth1 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/network/initializer.py", line 51, in _lldp_init Lldp.enable_lldp_on_iface(device) File "/usr/lib/python2.7/site-packages/vdsm/network/lldp/lldpad.py", line 30, in enable_lldp_on_iface lldptool.enable_lldp_on_iface(iface, rx_only) File "/usr/lib/python2.7/site-packages/vdsm/network/lldpad/lldptool.py", line 46, in enable_lldp_on_iface raise EnableLldpError(rc, out, err, iface) EnableLldpError: (1, "timeout\n'M00000001C3040000000c04eth1000badminStatus0002rx' command timed out.\n", '', 'eth1') MainThread::DEBUG::2017-08-30 05:55:59,477::cmdutils::133::root::(exec_cmd) /usr/sbin/lldptool get-lldp -i eth0 adminStatus (cwd None) </error> -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

7 16

master OST is now green. Thanks everyone who helped!
by Barak Korren 31 Aug '17

31 Aug '17

The following OST run, that included 82 different patches and ~40 engine patches among them was successful: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2208/ This means that engine master is not longer broken, and there are no other issues that affect OST. Thanks everyone who worked hard on this! You are free to resume merging any engine patches you may have refrained from merging so far. Thanks, Barak. -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

1 0

GSoC final evaluation
by Valentina Makarova 31 Aug '17

31 Aug '17

Hello oVirt Team! I'm GSoC participant and yesterday was last day of GSoC 2017 program. Thank you very much for help, answers on my questions, great project and interesting experience! There is my report about my work in ovirt-system-tests https://gist.github.com/vmakarova/62c2941d4723bc2673427db22cf72a29 Good luck! Sincerely, Valentina Makarova

3 2

Please note: ovirt-hosted-engine-ha builds are failing
by Barak Korren 31 Aug '17

31 Aug '17

Hi, Builds of ovirt-hosted-engine-ha had been failing for the last 3 merged patches. This is currently not being reported on gerrit because of a known issue we are working to fix [1]. The 1st patch where builds started failing is: https://gerrit.ovirt.org/#/c/81224/ Failing build jobs for this patch are the following: - http://jenkins.ovirt.org/job/ovirt-hosted-engine-ha_master_build-artifacts-… - http://jenkins.ovirt.org/job/ovirt-hosted-engine-ha_master_build-artifacts-… Build logs for failing jobs are respectively at these locations: - http://jenkins.ovirt.org/job/ovirt-hosted-engine-ha_master_build-artifacts-… - http://jenkins.ovirt.org/job/ovirt-hosted-engine-ha_master_build-artifacts-… [1]: https://ovirt-jira.atlassian.net/browse/OVIRT-1502 -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

2 2

Re: [ovirt-devel] URGENT! OST broken! please stop merging patches to ovirt-engine!
by Greg Sheremeta 30 Aug '17

30 Aug '17

On Aug 30, 2017 8:46 AM, "Maor Lipchuk" <mlipchuk(a)redhat.com> wrote: Yes, there is already an acked patch that solves it. The weird thing is that the OST ran successfully when running with "ci please build" although it seems that the artifact was not added to it. That doesn't run full OST. It only runs build-artifacts :) On Wed, Aug 30, 2017 at 3:17 PM, Greg Sheremeta <gshereme(a)redhat.com> wrote: > > On Wed, Aug 30, 2017 at 7:13 AM, Barak Korren <bkorren(a)redhat.com> wrote: >> >> We have two unresolved issues that are currently causing all master >> OST runs to fail and preventing us from effectively finding >> regressions. >> >> The 1st issue, which was already reported on Sunday, is a regression >> that is causing vm_run to fail and was probably introduced by this >> patch: >> https://gerrit.ovirt.org/#/c/79033/41 > > > cc'd Shubham and Maor. Is anyone looking into this? > >> >> >> >> Here is a recent run that failed with this: >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2147/ >> >> Logs are here: >> >> http://jenkins.ovirt.org/job/ovirt-master_change-queue- tester/2147/artifact/exported-artifacts/basic-suit-master- el7/test_logs/basic-suite-master/post-002_bootstrap.py/ >> >> The 2nd issue is a new one, that seems to be causing add-host failures >> and I've just send another email about it. The gist of this is that >> I'm siing the following failures in the supervdsm logs, and vdsm is >> not loading: >> >> MainThread::ERROR::2017-08-30 >> 05:55:59,476::initializer::53::root::(_lldp_init) Failed to enable >> LLDP on eth1 >> Traceback (most recent call last): >> File "/usr/lib/python2.7/site-packages/vdsm/network/initializer.py", >> line 51, in _lldp_init >> Lldp.enable_lldp_on_iface(device) >> File "/usr/lib/python2.7/site-packages/vdsm/network/lldp/lldpad.py", >> line 30, in enable_lldp_on_iface >> lldptool.enable_lldp_on_iface(iface, rx_only) >> File "/usr/lib/python2.7/site-packages/vdsm/network/lldpad/ lldptool.py", >> line 46, in enable_lldp_on_iface >> raise EnableLldpError(rc, out, err, iface) >> EnableLldpError: (1, >> "timeout\n'M00000001C3040000000c04eth1000badminStatus0002rx' command >> timed out.\n", '', 'eth1') >> MainThread::DEBUG::2017-08-30 >> 05:55:59,477::cmdutils::133::root::(exec_cmd) /usr/sbin/lldptool >> get-lldp -i eth0 adminStatus (cwd None) >> >> >> This failure does not seem to have been introduced by the platform and >> not oVirt code, because it also happens on code that already passed >> OST a few days ago. >> >> Please avoid merging any patches except to the purpose of resolving >> these issues. Nothing is making it into the 'tested' and nightly >> snapshot repos anyway ATM. >> >> -- >> Barak Korren >> RHV DevOps team , RHCE, RHCi >> Red Hat EMEA >> redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted >> _______________________________________________ >> Devel mailing list >> Devel(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel > >

2 1

URGENT! OST broken! please stop merging patches to ovirt-engine!
by Barak Korren 30 Aug '17

30 Aug '17

We have two unresolved issues that are currently causing all master OST runs to fail and preventing us from effectively finding regressions. The 1st issue, which was already reported on Sunday, is a regression that is causing vm_run to fail and was probably introduced by this patch: https://gerrit.ovirt.org/#/c/79033/41 Here is a recent run that failed with this: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2147/ Logs are here: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2147/artifact… The 2nd issue is a new one, that seems to be causing add-host failures and I've just send another email about it. The gist of this is that I'm siing the following failures in the supervdsm logs, and vdsm is not loading: MainThread::ERROR::2017-08-30 05:55:59,476::initializer::53::root::(_lldp_init) Failed to enable LLDP on eth1 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/network/initializer.py", line 51, in _lldp_init Lldp.enable_lldp_on_iface(device) File "/usr/lib/python2.7/site-packages/vdsm/network/lldp/lldpad.py", line 30, in enable_lldp_on_iface lldptool.enable_lldp_on_iface(iface, rx_only) File "/usr/lib/python2.7/site-packages/vdsm/network/lldpad/lldptool.py", line 46, in enable_lldp_on_iface raise EnableLldpError(rc, out, err, iface) EnableLldpError: (1, "timeout\n'M00000001C3040000000c04eth1000badminStatus0002rx' command timed out.\n", '', 'eth1') MainThread::DEBUG::2017-08-30 05:55:59,477::cmdutils::133::root::(exec_cmd) /usr/sbin/lldptool get-lldp -i eth0 adminStatus (cwd None) This failure does not seem to have been introduced by the platform and not oVirt code, because it also happens on code that already passed OST a few days ago. Please avoid merging any patches except to the purpose of resolving these issues. Nothing is making it into the 'tested' and nightly snapshot repos anyway ATM. -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

4 3

[ oVirt Devel ] [oVirt master ] [ OST Failure Report ] [ basic_suite_master & upgrade_suites failed ]
by Daniel Belenky 30 Aug '17

30 Aug '17

*Test Failed:* 1. *basic_suite: *002_bootstrap.add_dc and 2. *upgrade_from_release: *001_upgrade_engine.test_initialize_engine 3. *upgrade_from_prevrelease*: *Link to test logs:* 1. *basic suite logs <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2136/artifact…>* 2. *upgrade from prev release suite logs <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2136/artifact…>* 3. *upgrade from release suite logs <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2136/artifact…>* *Suspected patch: https://gerrit.ovirt.org/#/c/79033/41 <https://gerrit.ovirt.org/#/c/79033/41>* *Please note that this change was the only change under those tests.* *Error snippet from basic-suite /var/log/ovirt-engine/server.log:* ERROR [io.undertow.request] (default task-5) UT005023: Exception handling request to /ovirt-engine/api/v4/datacenters: java.lang.RuntimeException: org.jboss.resteasy.spi.UnhandledException: java.lang.NoClassDefFoundError: org/ovirt/api/metamodel/server/ValidationException at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImpl(RequestDispatcherImpl.java:245) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImplSetup(RequestDispatcherImpl.java:147) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.spec.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:111) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:180) [restapi-jaxrs.jar:] at org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:98) [restapi-jaxrs.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:117) [restapi-jaxrs.jar:] at org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:72) [restapi-jaxrs.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.ovirt.engine.core.aaa.filters.RestApiSessionMgmtFilter.doFilter(RestApiSessionMgmtFilter.java:78) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.ovirt.engine.core.aaa.filters.EnforceAuthFilter.doFilter(EnforceAuthFilter.java:42) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.ovirt.engine.core.aaa.filters.SsoRestApiNegotiationFilter.doFilter(SsoRestApiNegotiationFilter.java:84) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.ovirt.engine.core.aaa.filters.SsoRestApiAuthFilter.doFilter(SsoRestApiAuthFilter.java:47) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.ovirt.engine.core.aaa.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:59) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.ovirt.engine.core.aaa.filters.RestApiSessionValidationFilter.doFilter(RestApiSessionValidationFilter.java:35) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:111) [restapi-jaxrs.jar:] at org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:102) [restapi-jaxrs.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.ovirt.engine.core.utils.servlet.CORSSupportFilter.doFilter(CORSSupportFilter.java:284) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.lambda$create$0(SecurityContextThreadSetupAction.java:105) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1508) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1508) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1508) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.server.Connectors.executeRootHandler(Connectors.java:326) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:812) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_141] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_141] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_141] Caused by: org.jboss.resteasy.spi.UnhandledException: java.lang.NoClassDefFoundError: org/ovirt/api/metamodel/server/ValidationException at org.jboss.resteasy.core.ExceptionHandler.handleApplicationException(ExceptionHandler.java:78) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.core.ExceptionHandler.handleException(ExceptionHandler.java:222) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.core.SynchronousDispatcher.writeException(SynchronousDispatcher.java:179) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:422) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:213) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:228) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final] at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:81) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:274) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.handlers.ServletInitialHandler.dispatchToPath(ServletInitialHandler.java:209) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImpl(RequestDispatcherImpl.java:221) [undertow-servlet-1.4.18.Final.jar:1.4.18.Final] ... 73 more Caused by: java.lang.NoClassDefFoundError: org/ovirt/api/metamodel/server/ValidationException at org.ovirt.engine.api.resource.DataCentersResource.doAdd(DataCentersResource.java:58) [restapi-definition.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_141] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_141] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_141] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_141] at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:140) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.core.ResourceLocatorInvoker.invokeOnTargetObject(ResourceLocatorInvoker.java:138) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.core.ResourceLocatorInvoker.invoke(ResourceLocatorInvoker.java:101) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:406) [resteasy-jaxrs-3.0.24.Final.jar:3.0.24.Final] ... 88 more Caused by: java.lang.ClassNotFoundException: org.ovirt.api.metamodel.server.ValidationException from [Module "org.ovirt.engine.api.restapi-definition" from local module loader @61064425 (finder: local module finder @7b1d7fff (roots: /usr/share/ovirt-engine-wildfly-overlay/modules,/usr/share/ovirt-engine/modules/common,/usr/share/ovirt-engine-extension-aaa-jdbc/modules,/usr/share/ovirt-engine-extension-aaa-ldap/modules,/usr/share/ovirt-engine-wildfly/modules,/usr/share/ovirt-engine-wildfly/modules/system/layers/base))] at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:198) [jboss-modules.jar:1.6.0.CR2] at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:412) [jboss-modules.jar:1.6.0.CR2] at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:400) [jboss-modules.jar:1.6.0.CR2] at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:116) [jboss-modules.jar:1.6.0.CR2] ... 99 more *Error snippet from both upgrade suites (engine setup output):*[ ERROR ] Failed to execute stage 'Closing up': Command '/bin/firewall-cmd' failed to execute -- DANIEL BELENKY RHV DEVOPS Red Hat EMEA <https://www.redhat.com/> IRC: #rhev-integ #rhev-dev <https://red.ht/sig>

3 3

vdsm fails with: [Errno 2] No such file or directory: '/var/run/vdsm/svdsm.sock'
by Marcin Mirecki 29 Aug '17

29 Aug '17

Hi, I'm trying to add a add a new host, but each time the installation fails due to service supervdsm failing with: Aug 29 11:33:23 f25_55 daemonAdapter[1166]: Traceback (most recent call last): Aug 29 11:33:23 f25_55 daemonAdapter[1166]: File "/usr/lib64/python2.7/multiprocessing/util.py", line 274, in _run_finalizers Aug 29 11:33:23 f25_55 daemonAdapter[1166]: finalizer() Aug 29 11:33:23 f25_55 daemonAdapter[1166]: File "/usr/lib64/python2.7/multiprocessing/util.py", line 207, in __call__ Aug 29 11:33:23 f25_55 daemonAdapter[1166]: res = self._callback(*self._args, **self._kwargs) Aug 29 11:33:23 f25_55 daemonAdapter[1166]: OSError: [Errno 2] No such file or directory: '/var/run/vdsm/svdsm.sock' Aug 29 11:33:23 f25_55 systemd[1]: supervdsmd.service: Main process exited, code=exited, status=1/FAILURE Aug 29 11:33:23 f25_55 systemd[1]: supervdsmd.service: Unit entered failed state. I tried it on different freshly intalled f25 hosts. Tried installing vdsm from engine and manually, the problem occurs every time. Thanks, Marcin

2 2

Re: [ovirt-devel] CI failure with tox
by Barak Korren 29 Aug '17

29 Aug '17

On 29 August 2017 at 11:28, Francesco Romani <fromani(a)redhat.com> wrote: > Hi Infra, > > > while running CI on some patches (example: > https://gerrit.ovirt.org/#/c/80967/) I see this failure[1] > > It seems to me something on the CI worker is broken, could anyone check? > > let me stress that the tests pass on my fedora laptop and that the > failure seems unrelated to my patch(es). Note that its failing inside the EL7 chroot but not the FC25 chroot. Could you be using some version of a library call that does not exist on EL7 or returns different output? Not that test scripts always run inside an isolated chroot, so chances of something in the build slave affecting them are slim as long as you're not trying to connect to any external services or devices. This does not look like an obvious build slave issue, so CCing devel. -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

1 0

[ OST Failure Report ] [ oVirt master ] [ 20-08-2017 ] [add_cluster]
by Barak Korren 29 Aug '17

29 Aug '17

Test failed: [ 002_bootstrap.add_cluster ] Link to suspected patches: https://gerrit.ovirt.org/#/c/80692/7 Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/2066 Link to all logs: Error snippet from log: <error> Fault reason is "Operation Failed". Fault detail is "javax.ejb.EJBException: java.lang.NullPointerException at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleExceptionInNoTx(CMTTxInterceptor.java:214) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:266) at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) ... at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at org.ovirt.engine.core.bll.Backend.evaluateCorrelationId(Backend.java:506) at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:492) at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:481) at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:434) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ... </error> ********************* Please note that all OST tests including recent engine patches had been broken since a patch perviously reported. We report this because we've noticed a change in the failing test. Note that no new engine-patches are being accepted into the 'tested' repositories, and this is expected to continue until the existing issues are fixed. ********************* -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

1 1