OST failure on master in 'snapshot_merge' test

Hi, There is a new failure in master, on 'snapshot_merge' test(not live), vdsm.log shows: 2016-12-13 09:57:30,399 ERROR (tasks/0) [storage.Image] delete() takes exactly 4 arguments (3 given) (image:1321) Traceback (most recent call last): File "/usr/share/vdsm/storage/image.py", line 1309, in merge sdDom, srcVolParams, volParams, reqSize, chain) File "/usr/share/vdsm/storage/image.py", line 1068, in _baseCowVolumeMerge tmpVol.delete(postZero=False, force=True) TypeError: delete() takes exactly 4 arguments (3 given) 2016-12-13 09:57:30,401 ERROR (tasks/0) [storage.TaskManager.Task] (Task='085bee3e-681f-4e3f-9b37-d9abbd6b2903') Unexpected error (task:870) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 877, in _run return fn(*args, **kargs) File "/usr/share/vdsm/storage/task.py", line 333, in run return self.cmd(*self.argslist, **self.argsdict) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/share/vdsm/storage/sp.py", line 1837, in mergeSnapshots discard) File "/usr/share/vdsm/storage/image.py", line 1322, in merge raise se.SourceImageActionError(imgUUID, sdUUID, str(e)) This failure is from recent hours. The hosts and engine logs can be found here[1] Could someone take a look? Thanks, Nadav. [1] http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/4160/artifa...

Idan, can you check this? On Tue, Dec 13, 2016 at 7:16 PM, Nadav Goldin <ngoldin@redhat.com> wrote:
Hi, There is a new failure in master, on 'snapshot_merge' test(not live), vdsm.log shows:
2016-12-13 09:57:30,399 ERROR (tasks/0) [storage.Image] delete() takes exactly 4 arguments (3 given) (image:1321) Traceback (most recent call last): File "/usr/share/vdsm/storage/image.py", line 1309, in merge sdDom, srcVolParams, volParams, reqSize, chain) File "/usr/share/vdsm/storage/image.py", line 1068, in _baseCowVolumeMerge tmpVol.delete(postZero=False, force=True) TypeError: delete() takes exactly 4 arguments (3 given) 2016-12-13 09:57:30,401 ERROR (tasks/0) [storage.TaskManager.Task] (Task='085bee3e-681f-4e3f-9b37-d9abbd6b2903') Unexpected error (task:870) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 877, in _run return fn(*args, **kargs) File "/usr/share/vdsm/storage/task.py", line 333, in run return self.cmd(*self.argslist, **self.argsdict) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/share/vdsm/storage/sp.py", line 1837, in mergeSnapshots discard) File "/usr/share/vdsm/storage/image.py", line 1322, in merge raise se.SourceImageActionError(imgUUID, sdUUID, str(e))
This failure is from recent hours. The hosts and engine logs can be found here[1]
Could someone take a look?
Thanks,
Nadav.
[1] http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/4160/artifa... _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/devel

We also know about a bug in the test that is being fixed now, but I don't remember seeing this error on vdsm, so it might be something new. On Dec 13, 2016 19:17, "Nadav Goldin" <ngoldin@redhat.com> wrote:
Hi, There is a new failure in master, on 'snapshot_merge' test(not live), vdsm.log shows:
2016-12-13 09:57:30,399 ERROR (tasks/0) [storage.Image] delete() takes exactly 4 arguments (3 given) (image:1321) Traceback (most recent call last): File "/usr/share/vdsm/storage/image.py", line 1309, in merge sdDom, srcVolParams, volParams, reqSize, chain) File "/usr/share/vdsm/storage/image.py", line 1068, in _baseCowVolumeMerge tmpVol.delete(postZero=False, force=True) TypeError: delete() takes exactly 4 arguments (3 given) 2016-12-13 09:57:30,401 ERROR (tasks/0) [storage.TaskManager.Task] (Task='085bee3e-681f-4e3f-9b37-d9abbd6b2903') Unexpected error (task:870) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 877, in _run return fn(*args, **kargs) File "/usr/share/vdsm/storage/task.py", line 333, in run return self.cmd(*self.argslist, **self.argsdict) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/share/vdsm/storage/sp.py", line 1837, in mergeSnapshots discard) File "/usr/share/vdsm/storage/image.py", line 1322, in merge raise se.SourceImageActionError(imgUUID, sdUUID, str(e))
This failure is from recent hours. The hosts and engine logs can be found here[1]
Could someone take a look?
Thanks,
Nadav.
[1] http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_ master/4160/artifact/exported-artifacts/basic_suite_master. sh-el7/exported-artifacts/test_logs/basic-suite-master/ post-004_basic_sanity.py/ _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/devel

On Dec 13, 2016 7:34 PM, "Eyal Edri" <eedri@redhat.com> wrote: We also know about a bug in the test that is being fixed now, but I don't remember seeing this error on vdsm, so it might be something new. It ia new, unrelated, I think. Y. On Dec 13, 2016 19:17, "Nadav Goldin" <ngoldin@redhat.com> wrote:
Hi, There is a new failure in master, on 'snapshot_merge' test(not live), vdsm.log shows:
2016-12-13 09:57:30,399 ERROR (tasks/0) [storage.Image] delete() takes exactly 4 arguments (3 given) (image:1321) Traceback (most recent call last): File "/usr/share/vdsm/storage/image.py", line 1309, in merge sdDom, srcVolParams, volParams, reqSize, chain) File "/usr/share/vdsm/storage/image.py", line 1068, in _baseCowVolumeMerge tmpVol.delete(postZero=False, force=True) TypeError: delete() takes exactly 4 arguments (3 given) 2016-12-13 09:57:30,401 ERROR (tasks/0) [storage.TaskManager.Task] (Task='085bee3e-681f-4e3f-9b37-d9abbd6b2903') Unexpected error (task:870) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 877, in _run return fn(*args, **kargs) File "/usr/share/vdsm/storage/task.py", line 333, in run return self.cmd(*self.argslist, **self.argsdict) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/share/vdsm/storage/sp.py", line 1837, in mergeSnapshots discard) File "/usr/share/vdsm/storage/image.py", line 1322, in merge raise se.SourceImageActionError(imgUUID, sdUUID, str(e))
This failure is from recent hours. The hosts and engine logs can be found here[1]
Could someone take a look?
Thanks,
Nadav.
[1] http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_ma ster/4160/artifact/exported-artifacts/basic_suite_master.sh- el7/exported-artifacts/test_logs/basic-suite-master/post- 004_basic_sanity.py/ _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/devel

On Tue, Dec 13, 2016 at 7:16 PM, Nadav Goldin <ngoldin@redhat.com> wrote:
Hi, There is a new failure in master, on 'snapshot_merge' test(not live), vdsm.log shows:
2016-12-13 09:57:30,399 ERROR (tasks/0) [storage.Image] delete() takes exactly 4 arguments (3 given) (image:1321) Traceback (most recent call last): File "/usr/share/vdsm/storage/image.py", line 1309, in merge sdDom, srcVolParams, volParams, reqSize, chain) File "/usr/share/vdsm/storage/image.py", line 1068, in _baseCowVolumeMerge tmpVol.delete(postZero=False, force=True) TypeError: delete() takes exactly 4 arguments (3 given)
Caused by https://gerrit.ovirt.org/67925 merge eariler today. Should be fixed by https://gerrit.ovirt.org/68398 Nadav, can you run the system tests with this patch? Do we have an easy way to trigger such tests on the CI machines? Nir
2016-12-13 09:57:30,401 ERROR (tasks/0) [storage.TaskManager.Task] (Task='085bee3e-681f-4e3f-9b37-d9abbd6b2903') Unexpected error (task:870) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 877, in _run return fn(*args, **kargs) File "/usr/share/vdsm/storage/task.py", line 333, in run return self.cmd(*self.argslist, **self.argsdict) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/share/vdsm/storage/sp.py", line 1837, in mergeSnapshots discard) File "/usr/share/vdsm/storage/image.py", line 1322, in merge raise se.SourceImageActionError(imgUUID, sdUUID, str(e))
This failure is from recent hours. The hosts and engine logs can be found here[1]
Could someone take a look?
Thanks,
Nadav.
[1] http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/4160/artifa... _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/devel

On Tue, Dec 13, 2016 at 10:08 PM, Nir Soffer <nsoffer@redhat.com> wrote:
On Tue, Dec 13, 2016 at 7:16 PM, Nadav Goldin <ngoldin@redhat.com> wrote:
Hi, There is a new failure in master, on 'snapshot_merge' test(not live), vdsm.log shows:
2016-12-13 09:57:30,399 ERROR (tasks/0) [storage.Image] delete() takes exactly 4 arguments (3 given) (image:1321) Traceback (most recent call last): File "/usr/share/vdsm/storage/image.py", line 1309, in merge sdDom, srcVolParams, volParams, reqSize, chain) File "/usr/share/vdsm/storage/image.py", line 1068, in _baseCowVolumeMerge tmpVol.delete(postZero=False, force=True) TypeError: delete() takes exactly 4 arguments (3 given)
Caused by https://gerrit.ovirt.org/67925 merge eariler today.
Should be fixed by https://gerrit.ovirt.org/68398
Nadav, can you run the system tests with this patch?
I'm running it now.
Do we have an easy way to trigger such tests on the CI machines?
Not yet, but we're working on it. Of course you can run it locally on your laptop quite easy.
Nir
2016-12-13 09:57:30,401 ERROR (tasks/0) [storage.TaskManager.Task] (Task='085bee3e-681f-4e3f-9b37-d9abbd6b2903') Unexpected error (task:870) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 877, in _run return fn(*args, **kargs) File "/usr/share/vdsm/storage/task.py", line 333, in run return self.cmd(*self.argslist, **self.argsdict) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/share/vdsm/storage/sp.py", line 1837, in mergeSnapshots discard) File "/usr/share/vdsm/storage/image.py", line 1322, in merge raise se.SourceImageActionError(imgUUID, sdUUID, str(e))
This failure is from recent hours. The hosts and engine logs can be found here[1]
Could someone take a look?
Thanks,
Nadav.
[1] http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_ master/4160/artifact/exported-artifacts/basic_suite_master. sh-el7/exported-artifacts/test_logs/basic-suite-master/ post-004_basic_sanity.py/ _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/devel
Infra mailing list Infra@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/infra
-- Eyal Edri Associate Manager RHV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

Hi, The patch that fixes the bug is merged - https://gerrit.ovirt.org/#/c/68398/ . Thanks Nir! Regards, Idan On Wed, Dec 14, 2016 at 9:56 AM, Eyal Edri <eedri@redhat.com> wrote:
On Tue, Dec 13, 2016 at 10:08 PM, Nir Soffer <nsoffer@redhat.com> wrote:
On Tue, Dec 13, 2016 at 7:16 PM, Nadav Goldin <ngoldin@redhat.com> wrote:
Hi, There is a new failure in master, on 'snapshot_merge' test(not live), vdsm.log shows:
2016-12-13 09:57:30,399 ERROR (tasks/0) [storage.Image] delete() takes exactly 4 arguments (3 given) (image:1321) Traceback (most recent call last): File "/usr/share/vdsm/storage/image.py", line 1309, in merge sdDom, srcVolParams, volParams, reqSize, chain) File "/usr/share/vdsm/storage/image.py", line 1068, in _baseCowVolumeMerge tmpVol.delete(postZero=False, force=True) TypeError: delete() takes exactly 4 arguments (3 given)
Caused by https://gerrit.ovirt.org/67925 merge eariler today.
Should be fixed by https://gerrit.ovirt.org/68398
Nadav, can you run the system tests with this patch?
I'm running it now.
Do we have an easy way to trigger such tests on the CI machines?
Not yet, but we're working on it. Of course you can run it locally on your laptop quite easy.
Nir
2016-12-13 09:57:30,401 ERROR (tasks/0) [storage.TaskManager.Task] (Task='085bee3e-681f-4e3f-9b37-d9abbd6b2903') Unexpected error (task:870) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 877, in _run return fn(*args, **kargs) File "/usr/share/vdsm/storage/task.py", line 333, in run return self.cmd(*self.argslist, **self.argsdict) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/share/vdsm/storage/sp.py", line 1837, in mergeSnapshots discard) File "/usr/share/vdsm/storage/image.py", line 1322, in merge raise se.SourceImageActionError(imgUUID, sdUUID, str(e))
This failure is from recent hours. The hosts and engine logs can be found here[1]
Could someone take a look?
Thanks,
Nadav.
[1] http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_ma ster/4160/artifact/exported-artifacts/basic_suite_master.sh- el7/exported-artifacts/test_logs/basic-suite-master/post- 004_basic_sanity.py/ _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/devel
Infra mailing list Infra@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/infra
-- Eyal Edri Associate Manager RHV DevOps EMEA ENG Virtualization R&D Red Hat Israel
phone: +972-9-7692018 <+972%209-769-2018> irc: eedri (on #tlv #rhev-dev #rhev-integ)
_______________________________________________ Devel mailing list Devel@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/devel
participants (5)
-
Eyal Edri
-
Idan Shaby
-
Nadav Goldin
-
Nir Soffer
-
Yaniv Kaul