[ovirt-devel] [ OST Failure Report ] [ oVirt 4.1 && oVirt master ] [ 20-03-2017 ] [ 004_basic_sanity.snapshots_merge ]

[Alexander Wels]

On Monday, March 20, 2017 11:01:21 AM EDT Yaniv Kaul wrote:
> On Mon, Mar 20, 2017 at 4:18 PM, Shlomo Ben David <sbendavi at redhat.com>
> 
> wrote:
> > Hi,
> > 
> > 
> > Test failed: [ 004_basic_sanity.snapshots_merge ]
> > 
> > Link to suspected patches: N/A
> > 
> > Link to Job:
> >    1. http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.1/1007
> >    2. http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_
> >    master/5918
> 
> They look similar, but master has an additional failure (unrelated to the
> snap merge failure).
> Allon/Tal - can you have someone from storage look at the failures?
> Alexander - can you take a look at the below?
> 
> 
> 2017-03-20 09:30:10,283-04 DEBUG
> [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJd
> bcCall] (ServerService Thread Pool -- 48) [] SqlCall for procedure
> [GetAllMacPoolRangesByMacPoolId] compiled
> 2017-03-20 09:30:10,283-04 INFO  [org.ovirt.engine.core.bll.TagsDirector]
> (ServerService Thread Pool -- 41) [] Finished initializing TagsDirector
> 2017-03-20 09:30:10,275-04 ERROR
> [org.ovirt.engine.ui.frontend.server.dashboard.DashboardDataServlet.CacheUpd
> ate.Utilization] (EE-ManagedThreadFactory-default-Thread-2) [] Could not
> update the Utilization Cache: Error while running SQL query:
> org.ovirt.engine.ui.frontend.server.dashboard.DashboardDataException: Error
> while running SQL query
> at
> org.ovirt.engine.ui.frontend.server.dashboard.dao.BaseDao.runQuery(BaseDao.j
> ava:60) [frontend.jar:]
> at
> org.ovirt.engine.ui.frontend.server.dashboard.dao.HostDwhDao.getTotalCpuMemC
> ount(HostDwhDao.java:78) [frontend.jar:]
> at
> org.ovirt.engine.ui.frontend.server.dashboard.HourlySummaryHelper.getTotalCp
> uMemCount(HourlySummaryHelper.java:43) [frontend.jar:]
> at
> org.ovirt.engine.ui.frontend.server.dashboard.HourlySummaryHelper.getCpuMemS
> ummary(HourlySummaryHelper.java:21) [frontend.jar:]
> at
> org.ovirt.engine.ui.frontend.server.dashboard.DashboardDataServlet.lookupGlo
> balUtilization(DashboardDataServlet.java:287) [frontend.jar:]
> at
> org.ovirt.engine.ui.frontend.server.dashboard.DashboardDataServlet.getDashbo
> ard(DashboardDataServlet.java:261) [frontend.jar:]
> 

So it looks like a communication failure with the DWH. But when I look at the 
associated logs, the error is not in there, nor do the time stamps match. Is 
this error from the same run or a previous one? I was trying to get more 
information than a partial stack trace.

> >    1.
> > 
> > Link to all logs:
> >    1. http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_
> >    4.1/1007/artifact/exported-artifacts/basic-suit-4.1-el7/
> >    test_logs/basic-suite-4.1/post-004_basic_sanity.py/
> >    <http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.1/1007/art
> >    ifact/exported-artifacts/basic-suit-4.1-el7/test_logs/basic-suite-4.1/p
> >    ost-004_basic_sanity.py/> 2.
> >    http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_
> >    master/5918/artifact/exported-artifacts/basic-suit-master-
> >    el7/test_logs/basic-suite-master/post-004_basic_sanity.py/
> >    <http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/5918/
> >    artifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite
> >    -master/post-004_basic_sanity.py/>> 
> > Error snippet from the log:
> > 
> > <error>
> > 
> > ovirtlago.testlib: ERROR: Unhandled exception in <function <lambda> at
> > 0x446a758>
> > 
> > Traceback (most recent call last):
> >   File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 217,
> > 
> > in assert_equals_within
> > 
> >     res = func()
> >   
> >   File "/home/jenkins/workspace/test-repo_ovirt_experimental_4.1/
> > 
> > ovirt-system-tests/basic-suite-4.1/test-scenarios/004_basic_sanity.py",
> > line 449, in <lambda>
> > 
> >     api.vms.get(VM0_NAME).disks.get(disk_name).status.state == 'ok'
> > 
> > AttributeError: 'NoneType' object has no attribute 'state'
> > lago.utils: ERROR: Error while running thread
> > 
> > Traceback (most recent call last):
> >   File "/usr/lib/python2.7/site-packages/lago/utils.py", line 57, in
> > 
> > _ret_via_queue
> > 
> >     queue.put({'return': func()})
> >   
> >   File "/home/jenkins/workspace/test-repo_ovirt_experimental_4.1/
> > 
> > ovirt-system-tests/basic-suite-4.1/test-scenarios/004_basic_sanity.py",
> > line 448, in snapshot_live_merge
> > 
> >     lambda:
> >   File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 264,
> > 
> > in assert_true_within_long
> > 
> >     assert_equals_within_long(func, True, allowed_exceptions)
> >   
> >   File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 251,
> > 
> > in assert_equals_within_long
> > 
> >     func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions
> >   
> >   File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 217,
> > 
> > in assert_equals_within
> > 
> >     res = func()
> >   
> >   File "/home/jenkins/workspace/test-repo_ovirt_experimental_4.1/
> > 
> > ovirt-system-tests/basic-suite-4.1/test-scenarios/004_basic_sanity.py",
> > line 449, in <lambda>
> > 
> >     api.vms.get(VM0_NAME).disks.get(disk_name).status.state == 'ok'
> > 
> > AttributeError: 'NoneType' object has no attribute 'state'
> > 
> > </error>
> > 
> > 
> > Best Regards,
> > 
> > Shlomi Ben-David | Software Engineer | Red Hat ISRAEL
> > RHCSA | RHCVA | RHCE
> > IRC: shlomibendavid (on #rhev-integ, #rhev-dev, #rhev-ci)
> > 
> > OPEN SOURCE - 1 4 011 && 011 4 1
> > 
> > 
> > _______________________________________________
> > Devel mailing list
> > Devel at ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/devel