Clearing asynchronous task Unknown

Hi, We're running oVirt 4.1.9 (I know there's a new version, we can't upgrade until [1] is implemented). The thing is that since some days we're having an event that floods our event list: Clearing asynchronous task Unknown that started at Tue Jan 22 14:33:17 WET 2019 The event shows up every minute. We tried restarting the ovirt-engine, but after some time it starts flooding again. No pending tasks in the task list. How can I check what is happening and how to solve it? Thanks. [1]: https://github.com/oVirt/ovirt-web-ui/issues/490

Hi Nicolas, We had a similar issue and it was caused by a stuck task in VDSM on the host that was the SPM. We found that VDSM tasks don't always show up in the oVirt GUI. You can check using 'vdsm-client Host getAllTasksStatuses' on the SPM host. We could not manually cancel any of the stuck VDSM tasks or move the SPM to another host. The only solution we found was to migrate all the VM's off that host and restart it. Once the remaining hosts had contended to be the new SPM, we gave the engine a restart too. Hope that helps, Nick On Fri, 25 Jan 2019 at 12:02, <nicolas@devels.es> wrote:
Hi,
We're running oVirt 4.1.9 (I know there's a new version, we can't upgrade until [1] is implemented). The thing is that since some days we're having an event that floods our event list:
Clearing asynchronous task Unknown that started at Tue Jan 22 14:33:17 WET 2019
The event shows up every minute. We tried restarting the ovirt-engine, but after some time it starts flooding again. No pending tasks in the task list.
How can I check what is happening and how to solve it?
Thanks.
[1]: https://github.com/oVirt/ovirt-web-ui/issues/490 _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/YQ35IGLYZBYGY7...

Hi Nicholas, Thanks for this. Indeed, that was the problem. I opened the vdsm log and saw a lot of exceptions like this: 2019-01-28 10:56:54,792+0000 INFO (jsonrpc/2) [vdsm.api] FINISH clearTask error=Operation is not allowed in this task state: ("can't clean in state running",) from=::ffff:10.6.4.10,49326, flow_id=12aea163, task_id=b66d9abc-cfb2-4a62-bd54-5f46d32ca1c3 (api:50) 2019-01-28 10:56:54,792+0000 ERROR (jsonrpc/2) [storage.TaskManager.Task] (Task='b66d9abc-cfb2-4a62-bd54-5f46d32ca1c3') Unexpected error (task:872) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 879, in _run return fn(*args, **kargs) File "<string>", line 2, in clearTask File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method ret = func(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 2260, in clearTask return self.taskMng.clearTask(taskID=taskID) File "/usr/share/vdsm/storage/taskManager.py", line 175, in clearTask t.clean() File "/usr/share/vdsm/storage/task.py", line 1049, in clean raise se.TaskStateError("can't clean in state %s" % self.state) TaskStateError: Operation is not allowed in this task state: ("can't clean in state running",) I migrated all VMs to a different host, forcibly rebooted the SPM host and now the event stopped showing. Thanks. Regards. El 2019-01-25 16:19, Nicholas Vaughan escribió:
Hi Nicolas,
We had a similar issue and it was caused by a stuck task in VDSM on the host that was the SPM.
We found that VDSM tasks don't always show up in the oVirt GUI. You can check using 'vdsm-client Host getAllTasksStatuses' on the SPM host.
We could not manually cancel any of the stuck VDSM tasks or move the SPM to another host. The only solution we found was to migrate all the VM's off that host and restart it. Once the remaining hosts had contended to be the new SPM, we gave the engine a restart too.
Hope that helps, Nick
On Fri, 25 Jan 2019 at 12:02, <nicolas@devels.es> wrote:
Hi,
We're running oVirt 4.1.9 (I know there's a new version, we can't upgrade until [1] is implemented). The thing is that since some days we're having an event that floods our event list:
Clearing asynchronous task Unknown that started at Tue Jan 22 14:33:17 WET 2019
The event shows up every minute. We tried restarting the ovirt-engine, but after some time it starts flooding again. No pending tasks in the task list.
How can I check what is happening and how to solve it?
Thanks.
[1]: https://github.com/oVirt/ovirt-web-ui/issues/490 [1] _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ [2] oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ [3] List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/YQ35IGLYZBYGY7...
[4]
Links: ------ [1] https://github.com/oVirt/ovirt-web-ui/issues/490 [2] https://www.ovirt.org/site/privacy-policy/ [3] https://www.ovirt.org/community/about/community-guidelines/ [4] https://lists.ovirt.org/archives/list/users@ovirt.org/message/YQ35IGLYZBYGY7...
participants (2)
-
Nicholas Vaughan
-
nicolas@devels.es