<p dir="ltr">Michal,</p>
<p dir="ltr">Is it known issue?</p>
<p dir="ltr">Thanks,<br>
Piotr</p>
<div class="gmail_extra"><br><div class="gmail_quote">29 paź 2016 18:24 &quot;Yaniv Kaul&quot; &lt;<a href="mailto:ykaul@redhat.com">ykaul@redhat.com</a>&gt; napisał(a):<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">IDK - still fails for me, though on potentiall different issue:<div>Cluster creation fails with:</div><div>RequestError: </div><div>status: 400</div><div>reason: Bad Request</div><div>detail: Cannot create Cluster. The chosen CPU is not supported.</div><div><br></div><div><br></div><div>The chosen CPU is the same CPU I&#39;ve used for several weeks now...</div><div><br></div><div>Engine.log shows:</div><div><div>2016-10-29 12:18:50,952 DEBUG [org.ovirt.engine.core.dal.<wbr>dbbroker.generic.<wbr>DBConfigUtils] (ServerService Thread Pool -- 54) [] Didn&#39;t find the value of &#39;ServerCPUList&#39; in DB for version &#39;4.1&#39; - using default: &#39;1:</div><div>pentium3:vmx:pentium3;2:intel-<wbr>qemu64-nx:vmx,sse2:qemu64,-nx,<wbr>+sse2;3:intel-qemu64:vmx,sse2,<wbr>nx:qemu64,+sse2;2:amd-qemu64-<wbr>nx:svm,sse2:qemu64,-nx,+sse2;<wbr>3:amd-qemu64:svm,sse2,nx:<wbr>qemu64,+sse2&#39;</div><div>2016-10-29 12:18:50,952 ERROR [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Error getting info for CPU &#39;1:pentium3:vmx:pentium3&#39;, not in expected format.</div><div>2016-10-29 12:18:50,952 ERROR [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Error getting info for CPU &#39;2:intel-qemu64-nx:vmx,sse2:<wbr>qemu64,-nx,+sse2&#39;, not in expected for</div><div>mat.</div><div>2016-10-29 12:18:50,952 ERROR [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Error getting info for CPU &#39;3:intel-qemu64:vmx,sse2,nx:<wbr>qemu64,+sse2&#39;, not in expected format.</div><div>2016-10-29 12:18:50,952 ERROR [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Error getting info for CPU &#39;2:amd-qemu64-nx:svm,sse2:<wbr>qemu64,-nx,+sse2&#39;, not in expected forma</div><div>t.</div><div>2016-10-29 12:18:50,952 ERROR [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Error getting info for CPU &#39;3:amd-qemu64:svm,sse2,nx:<wbr>qemu64,+sse2&#39;, not in expected format.</div><div>2016-10-29 12:18:50,953 DEBUG [org.ovirt.engine.core.dal.<wbr>dbbroker.generic.<wbr>DBConfigUtils] (ServerService Thread Pool -- 54) [] Didn&#39;t find the value of &#39;ServerCPUList&#39; in DB for version &#39;4.0&#39; - using default: &#39;1:</div><div>pentium3:vmx:pentium3;2:intel-<wbr>qemu64-nx:vmx,sse2:qemu64,-nx,<wbr>+sse2;3:intel-qemu64:vmx,sse2,<wbr>nx:qemu64,+sse2;2:amd-qemu64-<wbr>nx:svm,sse2:qemu64,-nx,+sse2;<wbr>3:amd-qemu64:svm,sse2,nx:<wbr>qemu64,+sse2&#39;</div><div>2016-10-29 12:18:50,953 ERROR [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Error getting info for CPU &#39;1:pentium3:vmx:pentium3&#39;, not in expected format.</div><div>2016-10-29 12:18:50,953 ERROR [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Error getting info for CPU &#39;2:intel-qemu64-nx:vmx,sse2:<wbr>qemu64,-nx,+sse2&#39;, not in expected for</div><div>mat.</div><div>2016-10-29 12:18:50,953 ERROR [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Error getting info for CPU &#39;3:intel-qemu64:vmx,sse2,nx:<wbr>qemu64,+sse2&#39;, not in expected format.</div><div>2016-10-29 12:18:50,953 ERROR [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Error getting info for CPU &#39;2:amd-qemu64-nx:svm,sse2:<wbr>qemu64,-nx,+sse2&#39;, not in expected forma</div><div>t.</div><div>2016-10-29 12:18:50,953 ERROR [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Error getting info for CPU &#39;3:amd-qemu64:svm,sse2,nx:<wbr>qemu64,+sse2&#39;, not in expected format.</div><div>2016-10-29 12:18:50,954 INFO  [org.ovirt.engine.core.bll.<wbr>CpuFlagsManagerHandler] (ServerService Thread Pool -- 54) [] Finished initializing dictionaries</div></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Oct 27, 2016 at 10:01 PM, Allon Mureinik <span dir="ltr">&lt;<a href="mailto:amureini@redhat.com" target="_blank">amureini@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:monospace,monospace">And now the CI job is [finally] passing.</div><div class="gmail_default" style="font-family:monospace,monospace">Piotr/Eli - the stomp timeout may be worth investigating, but it&#39;s definitely NOT the root cause of the previous failures, so feel free to deprioritize it as you see fit.</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">Thanks to everyone who helped debug/investigate/review these issues, and sorry for the noise.</div></div><div class="m_4153144374945307261HOEnZb"><div class="m_4153144374945307261h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Oct 27, 2016 at 6:40 PM, Allon Mureinik <span dir="ltr">&lt;<a href="mailto:amureini@redhat.com" target="_blank">amureini@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:monospace,monospace">The 004 CI is now passing, and it fails on 006.</div><div class="gmail_default" style="font-family:monospace,monospace">I merged a patch for the failure, let&#39;s see where we get next.</div></div><div class="m_4153144374945307261m_-6296164892056994649HOEnZb"><div class="m_4153144374945307261m_-6296164892056994649h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Oct 27, 2016 at 3:13 PM, Allon Mureinik <span dir="ltr">&lt;<a href="mailto:amureini@redhat.com" target="_blank">amureini@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:monospace,monospace">Now I also see it in the CI.</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">I merged the patch so we can squeeze in as many CI runs as possible before the weekend.</div></div><div class="m_4153144374945307261m_-6296164892056994649m_1082396609458582807HOEnZb"><div class="m_4153144374945307261m_-6296164892056994649m_1082396609458582807h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Oct 27, 2016 at 11:38 AM, Allon Mureinik <span dir="ltr">&lt;<a href="mailto:amureini@redhat.com" target="_blank">amureini@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:monospace,monospace">[Adding Martin Sivak.]<br></div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">That reproduces on my setup too, but didn&#39;t see it in CI, and is not related to the recent injection issues.</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">Martin - This issue seems to have been introduced in your patch 0e4ae6b.</div><div class="gmail_default" style="font-family:monospace,monospace">I&#39;m not sure eaxctly why java doesn&#39;t like the @NotNull annotation on schedule, but ampyrically it does, as removing it solves the issue.</div><div class="gmail_default" style="font-family:monospace,monospace">I&#39;ve posted <a href="https://gerrit.ovirt.org/65784" target="_blank">https://gerrit.ovirt.or<wbr>g/65784</a> to do so - please review (or suggest a better solution, of course :-))</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">Thanks,</div><div class="gmail_default" style="font-family:monospace,monospace">Allon</div></div><div class="m_4153144374945307261m_-6296164892056994649m_1082396609458582807m_9173589964607238016HOEnZb"><div class="m_4153144374945307261m_-6296164892056994649m_1082396609458582807m_9173589964607238016h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Oct 27, 2016 at 9:12 AM, Yaniv Kaul <span dir="ltr">&lt;<a href="mailto:ykaul@redhat.com" target="_blank">ykaul@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I still fail to run a VM:<div><div>2016-10-27 02:01:02,849 ERROR [org.ovirt.engine.core.bll.Run<wbr>VmOnceCommand] (default task-17) [78897d21] Command &#39;org.ovirt.engine.core.bll.Run<wbr>VmOnceCommand&#39; failed: HV000186: The constraint of type &#39;javax.valida</div><div>tion.constraints.NotNull&#39; defined on &#39;schedule.&lt;return value&gt;&#39; has multiple matching constraint validators which is due to an additional value handler of type &#39;org.hibernate.validator.inter<wbr>nal.engine.valuehandli</div><div>ng.OptionalValueUnwrapper&#39;. It is unclear which value needs validating. Clarify configuration via @UnwrapValidatedValue.</div><div>2016-10-27 02:01:02,849 ERROR [org.ovirt.engine.core.bll.Run<wbr>VmOnceCommand] (default task-17) [78897d21] Exception: javax.validation.UnexpectedTyp<wbr>eException: HV000186: The constraint of type &#39;javax.validation.con</div><div>straints.NotNull&#39; defined on &#39;schedule.&lt;return value&gt;&#39; has multiple matching constraint validators which is due to an additional value handler of type &#39;org.hibernate.validator.inter<wbr>nal.engine.valuehandling.Optio</div><div>nalValueUnwrapper&#39;. It is unclear which value needs validating. Clarify configuration via @UnwrapValidatedValue.</div><div>        at org.hibernate.validator.intern<wbr>al.engine.constraintvalidation<wbr>.ConstraintTree.getConstraintV<wbr>alidatorInstanceForAutomaticUn<wbr>wrapping(ConstraintTree.java:2<wbr>66) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Fin</div><div>al]</div><div>        at org.hibernate.validator.intern<wbr>al.engine.constraintvalidation<wbr>.ConstraintTree.getInitialized<wbr>ConstraintValidator(Constraint<wbr>Tree.java:163) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Final]</div><div>        at org.hibernate.validator.intern<wbr>al.engine.constraintvalidation<wbr>.ConstraintTree.validateConstr<wbr>aints(ConstraintTree.java:116) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Final]</div><div>        at org.hibernate.validator.intern<wbr>al.engine.constraintvalidation<wbr>.ConstraintTree.validateConstr<wbr>aints(ConstraintTree.java:87) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Final]</div><div>        at org.hibernate.validator.intern<wbr>al.metadata.core.MetaConstrain<wbr>t.validateConstraint(MetaConst<wbr>raint.java:73) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Final]</div><div>        at org.hibernate.validator.intern<wbr>al.engine.ValidatorImpl.valida<wbr>teConstraintsForGroup(Validato<wbr>rImpl.java:1488) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Final]</div><div>        at org.hibernate.validator.intern<wbr>al.engine.ValidatorImpl.valida<wbr>teReturnValueForSingleGroup(Va<wbr>lidatorImpl.java:1459) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Final]</div><div>        at org.hibernate.validator.intern<wbr>al.engine.ValidatorImpl.valida<wbr>teReturnValueForGroup(Validato<wbr>rImpl.java:1422) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Final]</div><div>        at org.hibernate.validator.intern<wbr>al.engine.ValidatorImpl.valida<wbr>teReturnValueInContext(Validat<wbr>orImpl.java:1338) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Final]</div><div>        at org.hibernate.validator.intern<wbr>al.engine.ValidatorImpl.valida<wbr>teReturnValue(ValidatorImpl.ja<wbr>va:317) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Final]</div><div>        at org.hibernate.validator.intern<wbr>al.engine.ValidatorImpl.valida<wbr>teReturnValue(ValidatorImpl.ja<wbr>va:277) [hibernate-validator-5.2.4.Fin<wbr>al.jar:5.2.4.Final]</div><div>        at sun.reflect.NativeMethodAccess<wbr>orImpl.invoke0(Native Method) [rt.jar:1.8.0_111]</div><div>        at sun.reflect.NativeMethodAccess<wbr>orImpl.invoke(NativeMethodAcce<wbr>ssorImpl.java:62) [rt.jar:1.8.0_111]</div><div>        at sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43) [rt.jar:1.8.0_111]</div><div>        at java.lang.reflect.Method.invok<wbr>e(Method.java:498) [rt.jar:1.8.0_111]</div><div>        at org.jboss.weld.bean.proxy.Abst<wbr>ractBeanInstance.invoke(Abstra<wbr>ctBeanInstance.java:38) [weld-core-impl-2.3.5.Final.ja<wbr>r:2.3.5.Final]</div><div>        at org.jboss.weld.bean.proxy.Prox<wbr>yMethodHandler.invoke(ProxyMet<wbr>hodHandler.java:100) [weld-core-impl-2.3.5.Final.ja<wbr>r:2.3.5.Final]</div><div>        at org.jboss.weldx.validation.Exe<wbr>cutableValidator$Validator$976<wbr>505265$Proxy$_$$_WeldClientPro<wbr>xy.validateReturnValue(Unknown Source)</div><div>        at org.hibernate.validator.intern<wbr>al.cdi.interceptor.ValidationI<wbr>nterceptor.validateMethodInvoc<wbr>ation(ValidationInterceptor.ja<wbr>va:80) [hibernate-validator-cdi-5.2.4<wbr>.Final.jar:5.2.4.Final]</div><div>        at sun.reflect.NativeMethodAccess<wbr>orImpl.invoke0(Native Method) [rt.jar:1.8.0_111]</div><div>        at sun.reflect.NativeMethodAccess<wbr>orImpl.invoke(NativeMethodAcce<wbr>ssorImpl.java:62) [rt.jar:1.8.0_111]</div><div>        at sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43) [rt.jar:1.8.0_111]</div><div>        at java.lang.reflect.Method.invok<wbr>e(Method.java:498) [rt.jar:1.8.0_111]</div><div>        at org.jboss.weld.interceptor.rea<wbr>der.SimpleInterceptorInvocatio<wbr>n$SimpleMethodInvocation.invok<wbr>e(SimpleInterceptorInvocation.<wbr>java:74) [weld-core-impl-2.3.5.Final.ja<wbr>r:2.3.5.Final]</div><div>        at <a href="http://org.jboss.weld.interceptor.pro" target="_blank">org.jboss.weld.interceptor.pro</a><wbr>xy.InterceptorMethodHandler.ex<wbr>ecuteAroundInvoke(InterceptorM<wbr>ethodHandler.java:84) [weld-core-impl-2.3.5.Final.ja<wbr>r:2.3.5.Final]</div><div>        at <a href="http://org.jboss.weld.interceptor.pro" target="_blank">org.jboss.weld.interceptor.pro</a><wbr>xy.InterceptorMethodHandler.ex<wbr>ecuteInterception(InterceptorM<wbr>ethodHandler.java:72) [weld-core-impl-2.3.5.Final.ja<wbr>r:2.3.5.Final]</div><div>        at <a href="http://org.jboss.weld.interceptor.pro" target="_blank">org.jboss.weld.interceptor.pro</a><a href="http://xy.InterceptorMethodHandler.in" target="_blank"><wbr>xy.InterceptorMethodHandler.in</a><wbr>voke(InterceptorMethodHandler.<wbr>java:56) [weld-core-impl-2.3.5.Final.ja<wbr>r:2.3.5.Final]</div><div>        at org.jboss.weld.bean.proxy.Comb<wbr>inedInterceptorAndDecoratorSta<wbr>ckMethodHandler.invoke(Combine<wbr>dInterceptorAndDecoratorStackM<wbr>ethodHandler.java:79) [weld-core-impl-2.3.5.Final.ja<wbr>r:2.3.5.Final]</div><div>        at org.jboss.weld.bean.proxy.Comb<wbr>inedInterceptorAndDecoratorSta<wbr>ckMethodHandler.invoke(Combine<wbr>dInterceptorAndDecoratorStackM<wbr>ethodHandler.java:68) [weld-core-impl-2.3.5.Final.ja<wbr>r:2.3.5.Final]</div><div>        at org.ovirt.engine.core.bll.sche<wbr>duling.SchedulingManager$Proxy<wbr>$_$$_WeldSubclass.schedule(Unk<wbr>nown Source) [bll.jar:]</div><div>        at org.ovirt.engine.core.bll.RunV<wbr>mCommand.getVdsToRunOn(RunVmCo<wbr>mmand.java:818) [bll.jar:]</div><div>        at org.ovirt.engine.core.bll.RunV<wbr>mCommand.runVm(RunVmCommand.ja<wbr>va:231) [bll.jar:]</div><div>        at org.ovirt.engine.core.bll.RunV<wbr>mCommand.perform(RunVmCommand.<wbr>java:414) [bll.jar:]</div><div>        at org.ovirt.engine.core.bll.RunV<wbr>mCommand.executeVmCommand(RunV<wbr>mCommand.java:339) [bll.jar:]</div><div>        at org.ovirt.engine.core.bll.VmCo<wbr>mmand.executeCommand(VmCommand<wbr>.java:106) [bll.jar:]</div></div><div><br></div></div><div class="m_4153144374945307261m_-6296164892056994649m_1082396609458582807m_9173589964607238016m_1587945714222818840HOEnZb"><div class="m_4153144374945307261m_-6296164892056994649m_1082396609458582807m_9173589964607238016m_1587945714222818840h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Oct 27, 2016 at 5:12 AM, Allon Mureinik <span dir="ltr">&lt;<a href="mailto:amureini@redhat.com" target="_blank">amureini@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:monospace,monospace">Seems like we cleared up the engine issues related to the recent injection changes.</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">I am now seeing stop errors, e.g.:</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace"><pre style="color:rgb(0,0,0)">{&quot;jsonrpc&quot;: &quot;2.0&quot;, &quot;id&quot;: &quot;ea0c564f-bc17-4fc2-8f1b-67c4d<wbr>28257c6&quot;, &quot;result&quot;: {&quot;cpuStatistics&quot;: {&quot;1&quot;: {&quot;cpuUser&quot;: &quot;3.07&quot;, &quot;nodeIndex&quot;: 0, &quot;cpuSys&quot;: &quot;3.00&quot;, &quot;cpuIdle&quot;: &quot;93.93&quot;}, &quot;0&quot;: {&quot;cpuUser&quot;: &quot;1.67&quot;, &quot;nodeIndex&quot;: 0, &quot;cpuSys&quot;: &quot;2.07&quot;, &quot;cpuIdle&quot;: &quot;96.26&quot;}}, &quot;numaNodeMemFree&quot;: {&quot;0&quot;: {&quot;memPercent&quot;: 83, &quot;memFree&quot;: &quot;359&quot;}}, &quot;memShared&quot;: 0, &quot;thpState&quot;: &quot;always&quot;, &quot;ksmMergeAcrossNodes&quot;: true, &quot;vmCount&quot;: 0, &quot;memUsed&quot;: &quot;20&quot;, &quot;storageDomains&quot;: {&quot;b2bb3220-1eb3-426a-90c2-5e23<wbr>6aefbe1a&quot;: {&quot;code&quot;: 0, &quot;actual&quot;: true, &quot;version&quot;: 0, &quot;acquired&quot;: true, &quot;delay&quot;: &quot;0.000840117&quot;, &quot;lastCheck&quot;: &quot;7.1&quot;, &quot;valid&quot;: true}, &quot;3130195a-73f9-4490-b554-98a92<wbr>05cead6&quot;: {&quot;code&quot;: 0, &quot;actual&quot;: true, &quot;version&quot;: 4, &quot;acquired&quot;: true, &quot;delay&quot;: &quot;0.00150771&quot;, &quot;lastCheck&quot;: &quot;7.5&quot;, &quot;valid&quot;: true}, &quot;1a9e202b-83b7-4bdc-9b0c-e76b8<wbr>3676068&quot;: {&quot;code&quot;: 0, &quot;actual&quot;: true, &quot;version&quot;: 4, &quot;acquired&quot;: true, &quot;delay&quot;: &quot;0.000590956&quot;,
2016-10-26 21:51:09,878 DEBUG [org.ovirt.engine.core.utils.t<wbr>imer.FixedDelayJobListener] (DefaultQuartzScheduler7) [6d206bd1] Rescheduling DEFAULT.org.ovirt.engine.core.<wbr>bll.tasks.CommandCallbacksPoll<wbr>er.invokeCallbackMethods#-9223<wbr>372036854775783 as there is no unfired trigger.
2016-10-26 21:51:28,705 DEBUG [org.ovirt.vdsm.jsonrpc.client<wbr>.reactors.ReactorClient] (SSL Stomp Reactor) [383dd6a0] Heartbeat exceeded. Closing channel
2016-10-26 21:51:28,708 DEBUG [org.ovirt.vdsm.jsonrpc.client<wbr>.reactors.Reactor] (SSL Stomp Reactor) [383dd6a0] Internal server error: null: java.lang.NullPointerException
        at org.ovirt.vdsm.jsonrpc.client.<wbr>reactors.SSLClient.write(SSLCl<wbr>ient.java:102) [vdsm-jsonrpc-java-client.jar:<wbr>]
        at org.ovirt.vdsm.jsonrpc.client.<wbr>reactors.ReactorClient.process<wbr>Outgoing(ReactorClient.java:24<wbr>5) [vdsm-jsonrpc-java-client.jar:<wbr>]
        at org.ovirt.vdsm.jsonrpc.client.<wbr>reactors.ReactorClient.process<wbr>(ReactorClient.java:208) [vdsm-jsonrpc-java-client.jar:<wbr>]
        at org.ovirt.vdsm.jsonrpc.client.<wbr>reactors.SSLClient.process(SSL<wbr>Client.java:125) [vdsm-jsonrpc-java-client.jar:<wbr>]
        at org.ovirt.vdsm.jsonrpc.client.<wbr>reactors.Reactor.processChanne<wbr>ls(Reactor.java:89) [vdsm-jsonrpc-java-client.jar:<wbr>]
        at org.ovirt.vdsm.jsonrpc.client.<wbr>reactors.Reactor.run(Reactor.j<wbr>ava:65) [vdsm-jsonrpc-java-client.jar:<wbr>]</pre><pre style="color:rgb(0,0,0)"><br></pre><pre style="color:rgb(0,0,0)">Piotr - any idea?</pre></div></div><div class="m_4153144374945307261m_-6296164892056994649m_1082396609458582807m_9173589964607238016m_1587945714222818840m_-1962689436822442088HOEnZb"><div class="m_4153144374945307261m_-6296164892056994649m_1082396609458582807m_9173589964607238016m_1587945714222818840m_-1962689436822442088h5"><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Oct 26, 2016 at 9:34 PM, Nadav Goldin <span dir="ltr">&lt;<a href="mailto:ngoldin@redhat.com" target="_blank">ngoldin@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Its running now:<br>
<a href="http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_64/1037/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-engine_master_build-artif<wbr>acts-fc24-x86_64/1037/</a>,<br>
when it finishes it will trigger the deploy job which will trigger the<br>
experimental job. The build_artifacts job is triggered approximately<br>
every 2 hours(depends on the load).<br>
Inside the build-artifacts job you can see the last<br>
commit(<a href="https://gerrit.ovirt.org/65776" rel="noreferrer" target="_blank">https://gerrit.ovirt.or<wbr>g/65776</a>, which is already after your<br>
commit)<br>
<div class="m_4153144374945307261m_-6296164892056994649m_1082396609458582807m_9173589964607238016m_1587945714222818840m_-1962689436822442088m_-431670564461846890HOEnZb"><div class="m_4153144374945307261m_-6296164892056994649m_1082396609458582807m_9173589964607238016m_1587945714222818840m_-1962689436822442088m_-431670564461846890h5"><br>
<br>
On Wed, Oct 26, 2016 at 9:26 PM, Allon Mureinik &lt;<a href="mailto:amureini@redhat.com" target="_blank">amureini@redhat.com</a>&gt; wrote:<br>
&gt; @Infra - the last experimental job I saw was from ~17:30 local Israel time.<br>
&gt; Any idea why another one isn&#39;t being triggered (or am I just being daft)?<br>
&gt;<br>
&gt; On Wed, Oct 26, 2016 at 6:27 PM, Allon Mureinik &lt;<a href="mailto:amureini@redhat.com" target="_blank">amureini@redhat.com</a>&gt; wrote:<br>
&gt;&gt;<br>
&gt;&gt; Yipes.<br>
&gt;&gt; [1] should fix that, waiting for the CI to run to merge.<br>
&gt;&gt;<br>
&gt;&gt; [1] <a href="https://gerrit.ovirt.org/#/c/65768/" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/6<wbr>5768/</a><br>
&gt;&gt;<br>
&gt;&gt; On Wed, Oct 26, 2016 at 3:42 PM, Nadav Goldin &lt;<a href="mailto:ngoldin@redhat.com" target="_blank">ngoldin@redhat.com</a>&gt; wrote:<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; Unfortunately it is still failing, see[1], the repository used was<br>
&gt;&gt;&gt; built from commit [2]. If you want to check the logs same links<br>
&gt;&gt;&gt; apply(just replace build number 2759-&gt;2782)<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; [1] <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/2782" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_ma<wbr>ster/2782</a><br>
&gt;&gt;&gt; [2] <a href="https://gerrit.ovirt.org/#/c/65740/" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/6<wbr>5740/</a><br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; On Wed, Oct 26, 2016 at 11:33 AM, Tal Nisan &lt;<a href="mailto:tnisan@redhat.com" target="_blank">tnisan@redhat.com</a>&gt; wrote:<br>
&gt;&gt;&gt; &gt; Should be fixed now on master as those patches were just merged:<br>
&gt;&gt;&gt; &gt;<br>
&gt;&gt;&gt; &gt; <a href="https://gerrit.ovirt.org/#/c/65738/" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/6<wbr>5738/</a> - &quot;Move InjectorRule to VdsBroker&quot;:<br>
&gt;&gt;&gt; &gt; aligns the InjectorRule&#39;s package with the Injector so it can<br>
&gt;&gt;&gt; &gt; essentially be<br>
&gt;&gt;&gt; &gt; used wherever the Injector is used [+12, -4]<br>
&gt;&gt;&gt; &gt; <a href="https://gerrit.ovirt.org/#/c/65739" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/6<wbr>5739</a> - &quot;InjectorRule: override injector<br>
&gt;&gt;&gt; &gt; anyway&quot;: Fixes a bug in InjectorRule where the Injector is only mocked<br>
&gt;&gt;&gt; &gt; if<br>
&gt;&gt;&gt; &gt; you call InjectorRule.bind [+6, -1]<br>
&gt;&gt;&gt; &gt; <a href="https://gerrit.ovirt.org/#/c/65740" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/6<wbr>5740</a> - &quot;core: InjectorRule for injecting<br>
&gt;&gt;&gt; &gt; members&quot;: Fixes a bug in InjectorRule to allow using<br>
&gt;&gt;&gt; &gt; Injector.injectMembers<br>
&gt;&gt;&gt; &gt; when using it [+18, -5]<br>
&gt;&gt;&gt; &gt; <a href="https://gerrit.ovirt.org/#/c/65725" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/6<wbr>5725</a> - &quot;core: Fix AuditLogging&quot;: The<br>
&gt;&gt;&gt; &gt; actual<br>
&gt;&gt;&gt; &gt; fix. Basically, goes over all the places that create an<br>
&gt;&gt;&gt; &gt; AuditLoggableBase<br>
&gt;&gt;&gt; &gt; that needs injecting and take care of it [+155, -160]<br>
&gt;&gt;&gt; &gt;<br>
&gt;&gt;&gt; &gt;<br>
&gt;&gt;&gt; &gt; On Wed, Oct 26, 2016 at 10:04 AM, Nadav Goldin &lt;<a href="mailto:ngoldin@redhat.com" target="_blank">ngoldin@redhat.com</a>&gt;<br>
&gt;&gt;&gt; &gt; wrote:<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; Hi,<br>
&gt;&gt;&gt; &gt;&gt; We have new failure on OST from patches merged to master yesterday,<br>
&gt;&gt;&gt; &gt;&gt; the failure started after the merge of [1], but as there were quite a<br>
&gt;&gt;&gt; &gt;&gt; few patches merged quickly I can&#39;t make sure it is the one causing<br>
&gt;&gt;&gt; &gt;&gt; it(OST aren&#39;t ran per-patch).<br>
&gt;&gt;&gt; &gt;&gt; The test that fails is [2] when attempting to start the VM.<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; The error from the API side:<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; RequestError:<br>
&gt;&gt;&gt; &gt;&gt; status: 500<br>
&gt;&gt;&gt; &gt;&gt; reason: Internal Server Error<br>
&gt;&gt;&gt; &gt;&gt; detail: javax.ejb.EJBException: java.lang.NullPointerException<br>
&gt;&gt;&gt; &gt;&gt;     at<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; org.jboss.as.ejb3.tx.CMTTxInte<wbr>rceptor.handleExceptionInNoTx(<wbr>CMTTxInterceptor.java:213)<br>
&gt;&gt;&gt; &gt;&gt;     at<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; org.jboss.as.ejb3.tx.CMTTxInte<wbr>rceptor.invokeInNoTx(CMTTxInte<wbr>rceptor.java:265)<br>
&gt;&gt;&gt; &gt;&gt;     at<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; org.jboss.as.ejb3.tx.CMTTxInte<wbr>rceptor.supports(CMTTxIntercep<wbr>tor.java:374)<br>
&gt;&gt;&gt; &gt;&gt;     at<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; org.jboss.as.ejb3.tx.CMTTxInte<wbr>rceptor.processInvocation(CMTT<wbr>xInterceptor.java:243)<br>
&gt;&gt;&gt; &gt;&gt;     at<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:340)<br>
&gt;&gt;&gt; &gt;&gt; ....<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; In the engine logs there are a few &#39;java.lang.NullPointerExceptio<wbr>n&#39;<br>
&gt;&gt;&gt; &gt;&gt; errors:<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; 2016-10-25 11:53:52,845 INFO<br>
&gt;&gt;&gt; &gt;&gt; [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gableBase]<br>
&gt;&gt;&gt; &gt;&gt; (org.ovirt.thread.pool-6-threa<wbr>d-2) [5e6a88be] Failed to get vds<br>
&gt;&gt;&gt; &gt;&gt; &#39;d60db21f-95f0-487b-9f17-44861<wbr>e2610a7&#39;, error: null<br>
&gt;&gt;&gt; &gt;&gt; 2016-10-25 11:53:52,864 DEBUG<br>
&gt;&gt;&gt; &gt;&gt; [org.ovirt.engine.core.utils.t<wbr>imer.FixedDelayJobListener]<br>
&gt;&gt;&gt; &gt;&gt; (DefaultQuartzScheduler5) [] Rescheduling<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; DEFAULT.org.ovirt.engine.core.<wbr>bll.tasks.AsyncTaskManager.tim<wbr>erElapsed#-9223372036854775787<br>
&gt;&gt;&gt; &gt;&gt; as there is no unfired trigger.<br>
&gt;&gt;&gt; &gt;&gt; ...<br>
&gt;&gt;&gt; &gt;&gt; 2016-10-25 11:53:52,845 DEBUG<br>
&gt;&gt;&gt; &gt;&gt; [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gableBase]<br>
&gt;&gt;&gt; &gt;&gt; (org.ovirt.thread.pool-6-threa<wbr>d-2) [5e6a88be] Exception:<br>
&gt;&gt;&gt; &gt;&gt; java.lang.NullPointerException<br>
&gt;&gt;&gt; &gt;&gt;         at<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; org.ovirt.engine.core.dal.dbbr<wbr>oker.auditloghandling.AuditLog<wbr>ableBase.getVdsStatic(AuditLog<wbr>ableBase.java:633)<br>
&gt;&gt;&gt; &gt;&gt; [dal.jar:]<br>
&gt;&gt;&gt; &gt;&gt;         at<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; org.ovirt.engine.core.dal.dbbr<wbr>oker.auditloghandling.AuditLog<wbr>ableBase.getVdsName(AuditLogab<wbr>leBase.java:504)<br>
&gt;&gt;&gt; &gt;&gt; [dal.jar:]<br>
&gt;&gt;&gt; &gt;&gt; ...<br>
&gt;&gt;&gt; &gt;&gt; 2016-10-25 11:53:52,837 INFO<br>
&gt;&gt;&gt; &gt;&gt; [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gableBase]<br>
&gt;&gt;&gt; &gt;&gt; (org.ovirt.thread.pool-6-threa<wbr>d-2) [5e6a88be] Failed to get vds<br>
&gt;&gt;&gt; &gt;&gt; &#39;d60db21f-95f0-487b-9f17-44861<wbr>e2610a7&#39;, error: null<br>
&gt;&gt;&gt; &gt;&gt; 2016-10-25 11:53:52,837 DEBUG<br>
&gt;&gt;&gt; &gt;&gt; [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gableBase]<br>
&gt;&gt;&gt; &gt;&gt; (org.ovirt.thread.pool-6-threa<wbr>d-2) [5e6a88be] Exception:<br>
&gt;&gt;&gt; &gt;&gt; java.lang.NullPointerException<br>
&gt;&gt;&gt; &gt;&gt;         at<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; org.ovirt.engine.core.dal.dbbr<wbr>oker.auditloghandling.AuditLog<wbr>ableBase.getVdsStatic(AuditLog<wbr>ableBase.java:633)<br>
&gt;&gt;&gt; &gt;&gt; [dal.jar:]<br>
&gt;&gt;&gt; &gt;&gt;         at<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; org.ovirt.engine.core.dal.dbbr<wbr>oker.auditloghandling.AuditLog<wbr>ableBase.getVdsName(AuditLogab<wbr>leBase.java:504)<br>
&gt;&gt;&gt; &gt;&gt; [dal.jar:]<br>
&gt;&gt;&gt; &gt;&gt; ...<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; The full engine logs can be found here[3] and the entire test suite<br>
&gt;&gt;&gt; &gt;&gt; logs here[4].<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; Can anyone have a look?<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; Thanks,<br>
&gt;&gt;&gt; &gt;&gt; Nadav.<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; [1] <a href="https://gerrit.ovirt.org/#/c/65198/" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/6<wbr>5198/</a><br>
&gt;&gt;&gt; &gt;&gt; [2]<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; <a href="https://github.com/oVirt/ovirt-system-tests/blob/master/basic_suite_master/test-scenarios/004_basic_sanity.py#L322" rel="noreferrer" target="_blank">https://github.com/oVirt/ovirt<wbr>-system-tests/blob/master/basi<wbr>c_suite_master/test-scenarios/<wbr>004_basic_sanity.py#L322</a><br>
&gt;&gt;&gt; &gt;&gt; [3]<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/2759/artifact/exported-artifacts/basic_suite_master.sh-fc24/exported-artifacts/test_logs/basic_suite_master/post-004_basic_sanity.py/*zip*/post-004_basic_sanity.py.zip" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_ma<wbr>ster/2759/artifact/exported-ar<wbr>tifacts/basic_suite_master.sh-<wbr>fc24/exported-artifacts/test_l<wbr>ogs/basic_suite_master/post-00<wbr>4_basic_sanity.py/*zip*/post-0<wbr>04_basic_sanity.py.zip</a><br>
&gt;&gt;&gt; &gt;&gt; [4]<br>
&gt;&gt;&gt; &gt;&gt;<br>
&gt;&gt;&gt; &gt;&gt; <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/2759/artifact/exported-artifacts/basic_suite_master.sh-fc24/exported-artifacts/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_ma<wbr>ster/2759/artifact/exported-ar<wbr>tifacts/basic_suite_master.sh-<wbr>fc24/exported-artifacts/</a><br>
&gt;&gt;&gt; &gt;&gt; ______________________________<wbr>_________________<br>
&gt;&gt;&gt; &gt;&gt; Devel mailing list<br>
&gt;&gt;&gt; &gt;&gt; <a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
&gt;&gt;&gt; &gt;&gt; <a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/devel</a><br>
&gt;&gt;&gt; &gt;<br>
&gt;&gt;&gt; &gt;<br>
&gt;&gt;<br>
&gt;&gt;<br>
&gt;<br>
</div></div></blockquote></div><br></div>
</div></div><br>______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/devel</a><br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</blockquote></div></div>