On 17 Mar 2017, at 20:49, Yaniv Kaul <ykaul@redhat.com> wrote: =20 =20 =20 On Thu, Mar 16, 2017 at 8:16 PM, Michal Skrivanek <mskrivan@redhat.com = <mailto:mskrivan@redhat.com>> wrote: =20
On 16 Mar 2017, at 15:18, Yaniv Kaul <ykaul@redhat.com = <mailto:ykaul@redhat.com>> wrote: =20 =20 =20 On Thu, Mar 16, 2017 at 10:46 AM, Nir Soffer <nsoffer@redhat.com = <mailto:nsoffer@redhat.com>> wrote: If found this error in system tests - looks like wrong assert - code = should check if disk is not None before checking state. =20 I'm not sure who is the owner of this test, so posting here. =20 Theoretically, perhaps.=20 Practically, it worked (until yesterday?) and now I'm also seeing =
--Apple-Mail=_FAE55184-0204-4B4B-B082-EFABEC5CA0A7 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii this failure - it's not a coincidence.
However, looking at my failure[1], I'm seeing other nasty stuff, = which may explain the later on failures =20 For example, new NPE I have not seen in the past: 2017-03-16 09:57:57,581-04 INFO = [org.ovirt.engine.core.bll.AddVmTemplateCommand] = (DefaultQuartzScheduler1) [5d94233] Ending command = 'org.ovirt.engine.core.bll.AddVmTemplateCommand' successfully. =20 Is this IST or which TZ? =20 Interesting question - I guess that's why we need the offset from UTC = or use UTC in the logs. =20 Likely https://gerrit.ovirt.org/#/c/69323 = <https://gerrit.ovirt.org/#/c/69323> merged 10:33:20 CET today=20 =20 That's the cause or the fix?
Y. =20 =20
2017-03-16 09:57:57,591-04 INFO = [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] = (DefaultQuartzScheduler1) [5d94233] START, SetVmStatusVDSCommand( = SetVmStatusVDSCommandParameters:{runAsync=3D'true', = vmId=3D'00000000-0000-0000-0000-000000000000', status=3D'Down', = exitStatus=3D'Normal'}), log id: 30ee3299 2017-03-16 09:57:57,593-04 DEBUG = [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimple= JdbcCall] (DefaultQuartzScheduler1) [5d94233] Compiled stored procedure. = Call string is [{call getvmdynamicbyvmguid(?)}] 2017-03-16 09:57:57,594-04 DEBUG = [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimple= JdbcCall] (DefaultQuartzScheduler1) [5d94233] SqlCall for procedure = [GetVmDynamicByVmGuid] compiled 2017-03-16 09:57:57,595-04 ERROR = [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] = (DefaultQuartzScheduler1) [5d94233] Command 'SetVmStatusVDSCommand( = SetVmStatusVDSCommandParameters:{runAsync=3D'true', = vmId=3D'00000000-0000-0000-0000-000000000000', status=3D'Down', = exitStatus=3D'Normal'})' execution failed: null 2017-03-16 09:57:57,595-04 DEBUG = [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] = (DefaultQuartzScheduler1) [5d94233] Exception: = java.lang.NullPointerException at = org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand.executeVDSCommand(Se= tVmStatusVDSCommand.java:33) [vdsbroker.jar:] at = org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBa= se.java:73) [vdsbroker.jar:] at = org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) = [dal.jar:] at = org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execut= e(DefaultVdsCommandExecutor.java:14) [vdsbroker.jar:] at = org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceMana= ger.java:404) [vdsbroker.jar:] at = org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runVdsCommand(VDSBrokerFro= ntendImpl.java:33) [bll.jar:] at = org.ovirt.engine.core.bll.VmHandler.unLockVm(VmHandler.java:377) = [bll.jar:] =20 =20 =20 Y. =20 [1] = http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86= _64/326/artifact/exported-artifacts/basic_suite_master__logs/test_logs/bas= ic-suite-master/post-004_basic_sanity.py/lago-basic-suite-master-engine/_v= ar_log/ovirt-engine/engine.log = <http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x8= 6_64/326/artifact/exported-artifacts/basic_suite_master__logs/test_logs/ba= sic-suite-master/post-004_basic_sanity.py/lago-basic-suite-master-engine/_= var_log/ovirt-engine/engine.log> =20 =20 08:28:05 # snapshots_merge:=20 08:28:31 Unhandled exception in <function <lambda> at 0x276a5f0> 08:28:31 Traceback (most recent call last): 08:28:31 File = "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 217, in = assert_equals_within 08:28:31 res =3D func() 08:28:31 File = "/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basi= c-suite-master/test-scenarios/004_basic_sanity.py", line 466, in = <lambda> 08:28:31 api.vms.get(VM0_NAME).disks.ge = <http://disks.ge/>t(disk_name).status.state =3D=3D 'ok' 08:28:31 AttributeError: 'NoneType' object has no attribute 'state' 08:28:31 Error while running thread 08:28:31 Traceback (most recent call last): 08:28:31 File "/usr/lib/python2.7/site-packages/lago/utils.py", =
oh, sorry, the cause. we were not able to find anyone to confirm and resolve it today = unfortunately line 57, in _ret_via_queue
08:28:31 queue.put({'return': func()}) 08:28:31 File = "/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basi= c-suite-master/test-scenarios/004_basic_sanity.py", line 465, in = snapshot_live_merge 08:28:31 lambda: 08:28:31 File = "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 264, in = assert_true_within_long 08:28:31 assert_equals_within_long(func, True, = allowed_exceptions) 08:28:31 File = "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 251, in = assert_equals_within_long 08:28:31 func, value, LONG_TIMEOUT, = allowed_exceptions=3Dallowed_exceptions 08:28:31 File = "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 217, in = assert_equals_within 08:28:31 res =3D func() 08:28:31 File = "/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basi= c-suite-master/test-scenarios/004_basic_sanity.py", line 466, in = <lambda> 08:28:31 api.vms.get(VM0_NAME).disks.ge = <http://disks.ge/>t(disk_name).status.state =3D=3D 'ok' 08:28:31 AttributeError: 'NoneType' object has no attribute 'state' =20 =20 _______________________________________________ Devel mailing list Devel@ovirt.org <mailto:Devel@ovirt.org> http://lists.ovirt.org/mailman/listinfo/devel = <http://lists.ovirt.org/mailman/listinfo/devel> =20 _______________________________________________ Devel mailing list Devel@ovirt.org <mailto:Devel@ovirt.org> http://lists.ovirt.org/mailman/listinfo/devel = <http://lists.ovirt.org/mailman/listinfo/devel> =20
--Apple-Mail=_FAE55184-0204-4B4B-B082-EFABEC5CA0A7 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dus-ascii"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><br class=3D""><div><blockquote type=3D"cite" class=3D""><div = class=3D"">On 17 Mar 2017, at 20:49, Yaniv Kaul <<a = href=3D"mailto:ykaul@redhat.com" class=3D"">ykaul@redhat.com</a>> = wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><div = dir=3D"ltr" class=3D""><br class=3D""><div class=3D"gmail_extra"><br = class=3D""><div class=3D"gmail_quote">On Thu, Mar 16, 2017 at 8:16 PM, = Michal Skrivanek <span dir=3D"ltr" class=3D""><<a = href=3D"mailto:mskrivan@redhat.com" target=3D"_blank" = class=3D"">mskrivan@redhat.com</a>></span> wrote:<br = class=3D""><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 = .8ex;border-left:1px #ccc solid;padding-left:1ex"><div = style=3D"word-wrap:break-word" class=3D""><br class=3D""><div = class=3D""><span class=3D""><blockquote type=3D"cite" class=3D""><div = class=3D"">On 16 Mar 2017, at 15:18, Yaniv Kaul <<a = href=3D"mailto:ykaul@redhat.com" target=3D"_blank" = class=3D"">ykaul@redhat.com</a>> wrote:</div><br = class=3D"m_-2867758101781581971Apple-interchange-newline"><div = class=3D""><div dir=3D"ltr" = style=3D"font-family:Helvetica;font-size:12px;font-style:normal;font-varia= nt-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;t= ext-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" = class=3D""><div class=3D"gmail_extra"><br = class=3D"m_-2867758101781581971Apple-interchange-newline"><br = class=3D""><div class=3D"gmail_quote">On Thu, Mar 16, 2017 at 10:46 AM, = Nir Soffer<span = class=3D"m_-2867758101781581971Apple-converted-space"> </span><span = dir=3D"ltr" class=3D""><<a href=3D"mailto:nsoffer@redhat.com" = target=3D"_blank" class=3D"">nsoffer@redhat.com</a>></span><span = class=3D"m_-2867758101781581971Apple-converted-space"> </span>wr<wbr = class=3D"">ote:<br class=3D""><blockquote class=3D"gmail_quote" = style=3D"margin:0px 0px 0px = 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(= 204,204,204);padding-left:1ex"><div dir=3D"ltr" class=3D"">If found this = error in system tests - looks like wrong assert - code should check<div = class=3D"">if disk is not None before checking state.<br class=3D""><div = class=3D""><br class=3D""></div><div class=3D"">I'm not sure who is the = owner of this test, so posting here.</div></div></div></blockquote><div = class=3D""><br class=3D""></div><div class=3D"">Theoretically, = perhaps. </div><div class=3D"">Practically, it worked (until = yesterday?) and now I'm also seeing this failure - it's not a = coincidence.</div></div></div></div></div></blockquote><blockquote = type=3D"cite" class=3D""><div class=3D""><div dir=3D"ltr" = style=3D"font-family:Helvetica;font-size:12px;font-style:normal;font-varia= nt-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;t= ext-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" = class=3D""><div class=3D"gmail_extra"><div class=3D"gmail_quote"><div = class=3D"">However, looking at my failure[1], I'm seeing other nasty = stuff, which may explain the later on failures</div><div class=3D""><br = class=3D""></div><div class=3D"">For example, new NPE I have not seen in = the past:</div><div class=3D""><div class=3D"">2017-03-16 = 09:57:57,581-04 INFO [org.ovirt.engine.core.bll.<wbr = class=3D"">AddVmTemplateCommand] (DefaultQuartzScheduler1) [5d94233] = Ending command 'org.ovirt.engine.core.bll.<wbr = class=3D"">AddVmTemplateCommand' = successfully.</div></div></div></div></div></div></blockquote><div = class=3D""><br class=3D""></div></span>Is this IST or which = TZ?</div></div></blockquote><div class=3D""><br class=3D""></div><div = class=3D"">Interesting question - I guess that's why we need the offset = from UTC or use UTC in the logs.</div><div = class=3D""> </div><blockquote class=3D"gmail_quote" style=3D"margin:0= 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div = style=3D"word-wrap:break-word" class=3D""><div class=3D"">Likely <a = href=3D"https://gerrit.ovirt.org/#/c/69323" target=3D"_blank" = class=3D"">https://gerrit.ovirt.org/#/c/<wbr = class=3D"">69323</a> merged 10:33:20 CET = today </div></div></blockquote><div class=3D""><br = class=3D""></div><div class=3D"">That's the cause or the = fix?</div></div></div></div></div></blockquote><div><br = class=3D""></div>oh, sorry, the cause.</div><div>we were not able to = find anyone to confirm and resolve it today unfortunately</div><div><br = class=3D""><blockquote type=3D"cite" class=3D""><div class=3D""><div = dir=3D"ltr" class=3D""><div class=3D"gmail_extra"><div = class=3D"gmail_quote"><div class=3D"">Y.</div><div = class=3D""> </div><blockquote class=3D"gmail_quote" style=3D"margin:0= 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div = style=3D"word-wrap:break-word" class=3D""><div class=3D""><div = class=3D"h5"><div class=3D""><br class=3D""><blockquote type=3D"cite" = class=3D""><div class=3D""><div dir=3D"ltr" = style=3D"font-family:Helvetica;font-size:12px;font-style:normal;font-varia= nt-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;t= ext-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" = class=3D""><div class=3D"gmail_extra"><div class=3D"gmail_quote"><div = class=3D""><div class=3D"">2017-03-16 09:57:57,591-04 INFO = [org.ovirt.engine.core.<wbr class=3D"">vdsbroker.<wbr = class=3D"">SetVmStatusVDSCommand] (DefaultQuartzScheduler1) [5d94233] = START, SetVmStatusVDSCommand( SetVmStatusVDSCommandParameter<wbr = class=3D"">s:{runAsync=3D'true', vmId=3D'00000000-0000-0000-0000-<wbr = class=3D"">000000000000', status=3D'Down', exitStatus=3D'Normal'}), log = id: 30ee3299</div><div class=3D"">2017-03-16 09:57:57,593-04 DEBUG = [org.ovirt.engine.core.dal.<wbr class=3D"">dbbroker.<wbr = class=3D"">PostgresDbEngineDialect$<wbr class=3D"">PostgresSimpleJdbcCall]= (DefaultQuartzScheduler1) [5d94233] Compiled stored procedure. Call = string is [{call getvmdynamicbyvmguid(?)}]</div><div class=3D"">2017-03-16= 09:57:57,594-04 DEBUG [org.ovirt.engine.core.dal.<wbr = class=3D"">dbbroker.<wbr class=3D"">PostgresDbEngineDialect$<wbr = class=3D"">PostgresSimpleJdbcCall] (DefaultQuartzScheduler1) [5d94233] = SqlCall for procedure [GetVmDynamicByVmGuid] compiled</div><div = class=3D"">2017-03-16 09:57:57,595-04 ERROR [org.ovirt.engine.core.<wbr = class=3D"">vdsbroker.<wbr class=3D"">SetVmStatusVDSCommand] = (DefaultQuartzScheduler1) [5d94233] Command 'SetVmStatusVDSCommand( = SetVmStatusVDSCommandParameter<wbr class=3D"">s:{runAsync=3D'true', = vmId=3D'00000000-0000-0000-0000-<wbr class=3D"">000000000000', = status=3D'Down', exitStatus=3D'Normal'})' execution failed: = null</div><div class=3D"">2017-03-16 09:57:57,595-04 DEBUG = [org.ovirt.engine.core.<wbr class=3D"">vdsbroker.<wbr = class=3D"">SetVmStatusVDSCommand] (DefaultQuartzScheduler1) [5d94233] = Exception: java.lang.NullPointerException</div><div class=3D""><span = class=3D"m_-2867758101781581971gmail-Apple-tab-span" = style=3D"white-space:pre-wrap"> </span>at org.ovirt.engine.core.<wbr = class=3D"">vdsbroker.<wbr class=3D"">SetVmStatusVDSCommand.<wbr = class=3D"">executeVDSCommand(<wbr = class=3D"">SetVmStatusVDSCommand.java:33) [vdsbroker.jar:]</div><div = class=3D""><span class=3D"m_-2867758101781581971gmail-Apple-tab-span" = style=3D"white-space:pre-wrap"> </span>at org.ovirt.engine.core.<wbr = class=3D"">vdsbroker.VDSCommandBase.<wbr = class=3D"">executeCommand(VDSCommandBase.<wbr class=3D"">java:73) = [vdsbroker.jar:]</div><div class=3D""><span = class=3D"m_-2867758101781581971gmail-Apple-tab-span" = style=3D"white-space:pre-wrap"> </span>at org.ovirt.engine.core.dal.<wbr = class=3D"">VdcCommandBase.execute(<wbr class=3D"">VdcCommandBase.java:33) = [dal.jar:]</div><div class=3D""><span = class=3D"m_-2867758101781581971gmail-Apple-tab-span" = style=3D"white-space:pre-wrap"> </span>at org.ovirt.engine.core.<wbr = class=3D"">vdsbroker.vdsbroker.<wbr = class=3D"">DefaultVdsCommandExecutor.<wbr class=3D"">execute(<wbr = class=3D"">DefaultVdsCommandExecutor.<wbr class=3D"">java:14) = [vdsbroker.jar:]</div><div class=3D""><span = class=3D"m_-2867758101781581971gmail-Apple-tab-span" = style=3D"white-space:pre-wrap"> </span>at org.ovirt.engine.core.<wbr = class=3D"">vdsbroker.ResourceManager.<wbr = class=3D"">runVdsCommand(ResourceManager.<wbr class=3D"">java:404) = [vdsbroker.jar:]</div><div class=3D""><span = class=3D"m_-2867758101781581971gmail-Apple-tab-span" = style=3D"white-space:pre-wrap"> </span>at org.ovirt.engine.core.bll.<wbr = class=3D"">VDSBrokerFrontendImpl.<wbr class=3D"">runVdsCommand(<wbr = class=3D"">VDSBrokerFrontendImpl.java:33) [bll.jar:]</div><div = class=3D""><span class=3D"m_-2867758101781581971gmail-Apple-tab-span" = style=3D"white-space:pre-wrap"> </span>at org.ovirt.engine.core.bll.<wbr = class=3D"">VmHandler.unLockVm(VmHandler.<wbr class=3D"">java:377) = [bll.jar:]</div></div><div class=3D""><br class=3D""></div><div = class=3D""><br class=3D""></div><div class=3D""><br class=3D""></div><div = class=3D"">Y.</div><div class=3D""><br class=3D""></div><div = class=3D"">[1] <a = href=3D"http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch= -el7-x86_64/326/artifact/exported-artifacts/basic_suite_master__logs/test_= logs/basic-suite-master/post-004_basic_sanity.py/lago-basic-suite-master-e= ngine/_var_log/ovirt-engine/engine.log" target=3D"_blank" = class=3D"">http://jenkins.ovirt.org/job/<wbr = class=3D"">ovirt-system-tests_master_<wbr = class=3D"">check-patch-el7-x86_64/326/<wbr = class=3D"">artifact/exported-artifacts/<wbr = class=3D"">basic_suite_master__logs/test_<wbr = class=3D"">logs/basic-suite-master/post-<wbr = class=3D"">004_basic_sanity.py/lago-<wbr = class=3D"">basic-suite-master-engine/_<wbr = class=3D"">var_log/ovirt-engine/engine.<wbr class=3D"">log</a></div><div = class=3D""><br class=3D""></div><blockquote class=3D"gmail_quote" = style=3D"margin:0px 0px 0px = 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(= 204,204,204);padding-left:1ex"><div dir=3D"ltr" class=3D""><div = class=3D""><div class=3D""><br class=3D""></div><div class=3D""><pre = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-con= sole-output" = style=3D"box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;m= argin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:16px"><span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:05</b> </span><span = style=3D"box-sizing:border-box;color:rgb(0,205,205)" class=3D""> # = snapshots_merge: </span> <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span><span = style=3D"box-sizing:border-box;color:rgb(205,0,0)" class=3D"">Unhandled = exception in <function <lambda> at 0x276a5f0> <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span>Traceback (most recent call last): <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> File = "/usr/lib/python2.7/site-packa<wbr class=3D"">ges/ovirtlago/testlib.py", = line 217, in assert_equals_within <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> res =3D func() <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> File = "/home/jenkins/workspace/ovirt<wbr = class=3D"">-system-tests_manual/ovirt-<wbr = class=3D"">system-tests/basic-suite-<wbr = class=3D"">master/test-scenarios/004_<wbr class=3D"">basic_sanity.py", = line 466, in <lambda> <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> api.vms.get(VM0_NAME).<a = href=3D"http://disks.ge/" class=3D"">disks.ge</a><wbr = class=3D"">t(disk_name).status.state =3D=3D 'ok' <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span>AttributeError: 'NoneType' object has no = attribute 'state'</span> <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span><span = style=3D"box-sizing:border-box;color:rgb(205,0,0)" class=3D"">Error = while running thread <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span>Traceback (most recent call last): <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> File = "/usr/lib/python2.7/site-packa<wbr class=3D"">ges/lago/utils.py", line = 57, in _ret_via_queue <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> queue.put({'return': func()}) <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> File = "/home/jenkins/workspace/ovirt<wbr = class=3D"">-system-tests_manual/ovirt-<wbr = class=3D"">system-tests/basic-suite-<wbr = class=3D"">master/test-scenarios/004_<wbr class=3D"">basic_sanity.py", = line 465, in snapshot_live_merge <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> lambda: <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> File = "/usr/lib/python2.7/site-packa<wbr class=3D"">ges/ovirtlago/testlib.py", = line 264, in assert_true_within_long <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> assert_equals_within_long(func<wbr = class=3D"">, True, allowed_exceptions) <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> File = "/usr/lib/python2.7/site-packa<wbr class=3D"">ges/ovirtlago/testlib.py", = line 251, in assert_equals_within_long <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> func, value, LONG_TIMEOUT, = allowed_exceptions=3Dallowed_exc<wbr class=3D"">eptions <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> File = "/usr/lib/python2.7/site-packa<wbr class=3D"">ges/ovirtlago/testlib.py", = line 217, in assert_equals_within <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> res =3D func() <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> File = "/home/jenkins/workspace/ovirt<wbr = class=3D"">-system-tests_manual/ovirt-<wbr = class=3D"">system-tests/basic-suite-<wbr = class=3D"">master/test-scenarios/004_<wbr class=3D"">basic_sanity.py", = line 466, in <lambda> <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span> api.vms.get(VM0_NAME).<a = href=3D"http://disks.ge/" class=3D"">disks.ge</a><wbr = class=3D"">t(disk_name).status.state =3D=3D 'ok' <span = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-tim= estamp" style=3D"box-sizing:border-box"><b style=3D"box-sizing:border-box"= class=3D"">08:28:31</b> </span>AttributeError: 'NoneType' object has no = attribute 'state'</span> </pre><br = class=3D"m_-2867758101781581971gmail-m_-3711950224702553848inbox-inbox-App= le-interchange-newline"></div></div></div><br = class=3D"">______________________________<wbr = class=3D"">_________________<br class=3D"">Devel mailing list<br = class=3D""><a href=3D"mailto:Devel@ovirt.org" target=3D"_blank" = class=3D"">Devel@ovirt.org</a><br class=3D""><a = href=3D"http://lists.ovirt.org/mailman/listinfo/devel" rel=3D"noreferrer" = target=3D"_blank" class=3D"">http://lists.ovirt.org/mailman<wbr = class=3D"">/listinfo/devel</a><br class=3D""></blockquote></div><br = class=3D""></div></div><span = style=3D"font-family:Helvetica;font-size:12px;font-style:normal;font-varia= nt-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;t= ext-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;flo= at:none;display:inline!important" = class=3D"">______________________________<wbr = class=3D"">_________________</span><br = style=3D"font-family:Helvetica;font-size:12px;font-style:normal;font-varia= nt-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;t= ext-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" = class=3D""><span = style=3D"font-family:Helvetica;font-size:12px;font-style:normal;font-varia= nt-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;t= ext-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;flo= at:none;display:inline!important" class=3D"">Devel mailing = list</span><br = style=3D"font-family:Helvetica;font-size:12px;font-style:normal;font-varia= nt-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;t= ext-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" = class=3D""><a href=3D"mailto:Devel@ovirt.org" = style=3D"font-family:Helvetica;font-size:12px;font-style:normal;font-varia= nt-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;t= ext-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" = target=3D"_blank" class=3D"">Devel@ovirt.org</a><br = style=3D"font-family:Helvetica;font-size:12px;font-style:normal;font-varia= nt-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;t= ext-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" = class=3D""><a href=3D"http://lists.ovirt.org/mailman/listinfo/devel" = style=3D"font-family:Helvetica;font-size:12px;font-style:normal;font-varia= nt-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;t= ext-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" = target=3D"_blank" class=3D"">http://lists.ovirt.org/<wbr = class=3D"">mailman/listinfo/devel</a></div></blockquote></div><br = class=3D""></div></div></div></blockquote></div><br = class=3D""></div></div> </div></blockquote></div><br class=3D""></body></html>= --Apple-Mail=_FAE55184-0204-4B4B-B082-EFABEC5CA0A7--