<div dir="ltr">Looks like the actuall error is in VDSM log:<div><pre style="color:rgb(0,0,0)">2017-03-22 11:01:22,410-0400 ERROR (jsonrpc/7) [storage.TaskManager.Task] (Task='179424c1-b23d-40aa-a091-3c197971f420') Unexpected error (task:871)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 878, in _run
return fn(*args, **kargs)
File "/usr/lib/python2.7/site-packages/vdsm/logUtils.py", line 52, in wrapper
res = f(*args, **kwargs)
File "/usr/share/vdsm/storage/hsm.py", line 3060, in getVolumeInfo
volUUID=volUUID).getInfo()
File "/usr/share/vdsm/storage/sd.py", line 748, in produceVolume
volUUID)
File "/usr/share/vdsm/storage/fileVolume.py", line 361, in __init__
manifest = self.manifestClass(repoPath, sdUUID, imgUUID, volUUID)
File "/usr/share/vdsm/storage/fileVolume.py", line 61, in __init__
volUUID)
File "/usr/share/vdsm/storage/volume.py", line 86, in __init__
self.validate()
File "/usr/share/vdsm/storage/volume.py", line 109, in validate
self.validateVolumePath()
File "/usr/share/vdsm/storage/fileVolume.py", line 120, in validateVolumePath
raise se.VolumeDoesNotExist(self.volUUID)
VolumeDoesNotExist: Volume does not exist: (u'5133a146-d4bc-49a1-8358-7e14522ffc4b',)
2017-03-22 11:01:22,413-0400 INFO (jsonrpc/7) [storage.TaskManager.Task] (Task='179424c1-b23d-40aa-a091-3c197971f420') aborting: Task is aborted: 'Volume does not exist' - code 201 (task:1176)
2017-03-22 11:01:22,414-0400 ERROR (jsonrpc/7) [storage.Dispatcher] {'status': {'message': "Volume does not exist: (u'5133a146-d4bc-49a1-8358-7e14522ffc4b',)", 'code': 201}} (dispatcher:78)</pre></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Mar 22, 2017 at 10:57 AM, Gil Shinar <span dir="ltr"><<a href="mailto:gshinar@redhat.com" target="_blank">gshinar@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">It has happened again:<div><a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.1/1033/artifact/exported-artifacts/basic-suit-4.1-el7/test_logs/basic-suite-4.1/post-004_basic_sanity.py/" target="_blank">http://jenkins.ovirt.org/job/<wbr>test-repo_ovirt_experimental_<wbr>4.1/1033/artifact/exported-<wbr>artifacts/basic-suit-4.1-el7/<wbr>test_logs/basic-suite-4.1/<wbr>post-004_basic_sanity.py/</a><br></div><div><br></div><div>Any news concerning this issue?</div><div><br></div><div>Thanks</div><span class="HOEnZb"><font color="#888888"><div>Gil</div></font></span></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Mar 20, 2017 at 5:53 PM, Alexander Wels <span dir="ltr"><<a href="mailto:awels@redhat.com" target="_blank">awels@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span>On Monday, March 20, 2017 11:01:21 AM EDT Yaniv Kaul wrote:<br>
> On Mon, Mar 20, 2017 at 4:18 PM, Shlomo Ben David <<a href="mailto:sbendavi@redhat.com" target="_blank">sbendavi@redhat.com</a>><br>
><br>
> wrote:<br>
> > Hi,<br>
> ><br>
> ><br>
> > Test failed: [ 004_basic_sanity.snapshots_mer<wbr>ge ]<br>
> ><br>
> > Link to suspected patches: N/A<br>
> ><br>
> > Link to Job:<br>
</span>> > 1. <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.1/1007" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_4.<wbr>1/1007</a><br>
> > 2. <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_</a><br>
<div><div class="m_398850444981516307h5">> > master/5918<br>
><br>
> They look similar, but master has an additional failure (unrelated to the<br>
> snap merge failure).<br>
> Allon/Tal - can you have someone from storage look at the failures?<br>
> Alexander - can you take a look at the below?<br>
><br>
><br>
> 2017-03-20 09:30:10,283-04 DEBUG<br>
> [org.ovirt.engine.core.dal.dbb<wbr>roker.PostgresDbEngineDialect$<wbr>PostgresSimpleJd<br>
> bcCall] (ServerService Thread Pool -- 48) [] SqlCall for procedure<br>
> [GetAllMacPoolRangesByMacPoolI<wbr>d] compiled<br>
> 2017-03-20 09:30:10,283-04 INFO [org.ovirt.engine.core.bll.Tag<wbr>sDirector]<br>
> (ServerService Thread Pool -- 41) [] Finished initializing TagsDirector<br>
> 2017-03-20 09:30:10,275-04 ERROR<br>
> [org.ovirt.engine.ui.frontend.<wbr>server.dashboard.DashboardData<wbr>Servlet.CacheUpd<br>
> ate.Utilization] (EE-ManagedThreadFactory-defau<wbr>lt-Thread-2) [] Could not<br>
> update the Utilization Cache: Error while running SQL query:<br>
> org.ovirt.engine.ui.frontend.s<wbr>erver.dashboard.DashboardDataE<wbr>xception: Error<br>
> while running SQL query<br>
> at<br>
> org.ovirt.engine.ui.frontend.s<wbr><a href="http://erver.dashboard.dao.BaseDao.ru">erver.dashboard.dao.BaseDao.ru</a><wbr>nQuery(BaseDao.j<br>
> ava:60) [frontend.jar:]<br>
> at<br>
> org.ovirt.engine.ui.frontend.s<wbr>erver.dashboard.dao.HostDwhDao<wbr>.getTotalCpuMemC<br>
> ount(HostDwhDao.java:78) [frontend.jar:]<br>
> at<br>
> org.ovirt.engine.ui.frontend.s<wbr>erver.dashboard.HourlySummaryH<wbr>elper.getTotalCp<br>
> uMemCount(HourlySummaryHelper.<wbr>java:43) [frontend.jar:]<br>
> at<br>
> org.ovirt.engine.ui.frontend.s<wbr>erver.dashboard.HourlySummaryH<wbr>elper.getCpuMemS<br>
> ummary(HourlySummaryHelper.jav<wbr>a:21) [frontend.jar:]<br>
> at<br>
> org.ovirt.engine.ui.frontend.s<wbr>erver.dashboard.DashboardDataS<wbr>ervlet.lookupGlo<br>
> balUtilization(DashboardDataSe<wbr>rvlet.java:287) [frontend.jar:]<br>
> at<br>
> org.ovirt.engine.ui.frontend.s<wbr>erver.dashboard.DashboardDataS<wbr>ervlet.getDashbo<br>
> ard(DashboardDataServlet.java:<wbr>261) [frontend.jar:]<br>
><br>
<br>
</div></div>So it looks like a communication failure with the DWH. But when I look at the<br>
associated logs, the error is not in there, nor do the time stamps match. Is<br>
this error from the same run or a previous one? I was trying to get more<br>
information than a partial stack trace.<br>
<br>
> > 1.<br>
> ><br>
> > Link to all logs:<br>
> > 1. <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_</a><br>
> > 4.1/1007/artifact/exported-art<wbr>ifacts/basic-suit-4.1-el7/<br>
> > test_logs/basic-suite-4.1/<a href="http://post-004_basic_sanity.py/" rel="noreferrer" target="_blank">post<wbr>-004_basic_sanity.py/</a><br>
> > <<a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.1/1007/art" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>test-repo_ovirt_experimental_4<wbr>.1/1007/art</a><br>
> > ifact/exported-artifacts/basic<wbr>-suit-4.1-el7/test_logs/basic-<wbr>suite-4.1/p<br>
> > <a href="http://ost-004_basic_sanity.py/" rel="noreferrer" target="_blank">ost-004_basic_sanity.py/</a>> 2.<br>
> > <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_</a><br>
> > master/5918/artifact/exported-<wbr>artifacts/basic-suit-master-<br>
> > el7/test_logs/basic-suite-mast<wbr>er/<a href="http://post-004_basic_sanity.py/" rel="noreferrer" target="_blank">post-004_basic_sanity.py/</a><br>
> > <<a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/5918/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>test-repo_ovirt_experimental_m<wbr>aster/5918/</a><br>
> > artifact/exported-artifacts/ba<wbr>sic-suit-master-el7/test_logs/<wbr>basic-suite<br>
> > -master/<a href="http://post-004_basic_sanity.py/" rel="noreferrer" target="_blank">post-004_basic_sanity.<wbr>py/</a>>><br>
<div class="m_398850444981516307HOEnZb"><div class="m_398850444981516307h5">> > Error snippet from the log:<br>
> ><br>
> > <error><br>
> ><br>
> > ovirtlago.testlib: ERROR: Unhandled exception in <function <lambda> at<br>
> > 0x446a758><br>
> ><br>
> > Traceback (most recent call last):<br>
> > File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/testlib.py", line 217,<br>
> ><br>
> > in assert_equals_within<br>
> ><br>
> > res = func()<br>
> ><br>
> > File "/home/jenkins/workspace/test-<wbr>repo_ovirt_experimental_4.1/<br>
> ><br>
> > ovirt-system-tests/basic-suite<wbr>-4.1/test-scenarios/004_basic_<wbr>sanity.py",<br>
> > line 449, in <lambda><br>
> ><br>
> > api.vms.get(VM0_NAME).disks.g<wbr>et(disk_name).status.state == 'ok'<br>
> ><br>
> > AttributeError: 'NoneType' object has no attribute 'state'<br>
> > lago.utils: ERROR: Error while running thread<br>
> ><br>
> > Traceback (most recent call last):<br>
> > File "/usr/lib/python2.7/site-packa<wbr>ges/lago/utils.py", line 57, in<br>
> ><br>
> > _ret_via_queue<br>
> ><br>
> > queue.put({'return': func()})<br>
> ><br>
> > File "/home/jenkins/workspace/test-<wbr>repo_ovirt_experimental_4.1/<br>
> ><br>
> > ovirt-system-tests/basic-suite<wbr>-4.1/test-scenarios/004_basic_<wbr>sanity.py",<br>
> > line 448, in snapshot_live_merge<br>
> ><br>
> > lambda:<br>
> > File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/testlib.py", line 264,<br>
> ><br>
> > in assert_true_within_long<br>
> ><br>
> > assert_equals_within_long(fun<wbr>c, True, allowed_exceptions)<br>
> ><br>
> > File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/testlib.py", line 251,<br>
> ><br>
> > in assert_equals_within_long<br>
> ><br>
> > func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exc<wbr>eptions<br>
> ><br>
> > File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/testlib.py", line 217,<br>
> ><br>
> > in assert_equals_within<br>
> ><br>
> > res = func()<br>
> ><br>
> > File "/home/jenkins/workspace/test-<wbr>repo_ovirt_experimental_4.1/<br>
> ><br>
> > ovirt-system-tests/basic-suite<wbr>-4.1/test-scenarios/004_basic_<wbr>sanity.py",<br>
> > line 449, in <lambda><br>
> ><br>
> > api.vms.get(VM0_NAME).disks.g<wbr>et(disk_name).status.state == 'ok'<br>
> ><br>
> > AttributeError: 'NoneType' object has no attribute 'state'<br>
> ><br>
> > </error><br>
> ><br>
> ><br>
> > Best Regards,<br>
> ><br>
> > Shlomi Ben-David | Software Engineer | Red Hat ISRAEL<br>
> > RHCSA | RHCVA | RHCE<br>
> > IRC: shlomibendavid (on #rhev-integ, #rhev-dev, #rhev-ci)<br>
> ><br>
> > OPEN SOURCE - 1 4 011 && 011 4 1<br>
> ><br>
> ><br>
> > ______________________________<wbr>_________________<br>
> > Devel mailing list<br>
> > <a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
> > <a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/devel</a><br>
<br>
<br>
______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/devel</a><br>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>