[ovirt-devel] [ OST Failure Report ] [ oVirt Master ] [ 14-12-2017 ] [ 004_basic_sanity.disk_operations ]

[Michal Skrivanek]

> On 14 Dec 2017, at 13:22, Francesco Romani <fromani at redhat.com> wrote:
> 
> 
> On 12/14/2017 01:12 PM, Michal Skrivanek wrote:
>> 
>>> On 14 Dec 2017, at 13:00, Dafna Ron <dron at redhat.com <mailto:dron at redhat.com>> wrote:
>>> 
>>> Hi, 
>>> We have a failure on basic suite on test: 004_basic_sanity.disk_operations
>>> I think that we query a snapshot that was already deleted successfully and report the snapshot as gone. and that is because of a different error in update vm query which happens before. 
>>> 
>>>  Link and headline of suspected patches: 
>>> https://gerrit.ovirt.org/#/c/85168/ <https://gerrit.ovirt.org/#/c/85168/> - core: Prevent retry lease hotplag in case of failure.
>>> 
>>> Link to Job:
>>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4393 <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4393>
>>> 
>>> Link to all logs:
>>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4393/artifact/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4393/artifact/>
>>> 
>>> (Relevant) error snippet from the log: 
>>> <error>
>>> 
>>> 
>>> vdsm: 
>>> 
>>> 2017-12-14 02:34:45,222-0500 ERROR (jsonrpc/7) [jsonrpc.JsonRpcServer] Internal server error (__init__:611)
>>> Traceback (most recent call last):
>>>   File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 606, in _handle_request
>>>     res = method(**params)
>>>   File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 201, in _dynamicMethod
>>>     result = fn(*methodArgs)
>>>   File "<string>", line 2, in getAllVmStats
>>>   File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method
>>>     ret = func(*args, **kwargs)
>>>   File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1342, in getAllVmStats
>>>     statsList = self._cif.getAllVmStats()
>>>   File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 518, in getAllVmStats
>>>     return [v.getStats() for v in self.vmContainer.values()]
>>>   File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 1699, in getStats
>>>     oga_stats = self._getGuestStats()
>>>   File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 1895, in _getGuestStats
>>>     self._update_guest_disk_mapping()
>>>   File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 1909, in _update_guest_disk_mapping
>>>     self._sync_metadata()
>>>   File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 4995, in _sync_metadata
>>>     self._md_desc.dump(self._dom)
>>>   File "/usr/lib/python2.7/site-packages/vdsm/virt/metadata.py", line 477, in dump
>>>     dom.setMetadata(libvirt.VIR_DOMAIN_METADATA_ELEMENT,
>>>   File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 47, in __getattr__
>>>     % self.vmid)
>>> NotConnectedError: VM '7cab7e5a-cb12-4977-ac4f-65218532df7e' was not defined yet or was undefined
>> 
>> it doesn’t seem to be relevant to this failure, but it deserves a fix nevertheless
>> Francesco?
>> 
> 
> Smells like a race on shutdown.

and suspend/resume
looks harmless, but we want to clear up as many tracebacks as we can:)

> 
> -- 
> Francesco Romani
> Senior SW Eng., Virtualization R&D
> Red Hat
> IRC: fromani github: @fromanirh

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/devel/attachments/20171214/004e7413/attachment-0001.html>