<div dir="ltr"><div>Anyone know how to fix this broken task ?<br><br></div><div>It's persisted through a reboot of all hosts and the engine, something needs deleting from the database to clear the task and release the locked disk<br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On 8 September 2016 at 13:25, Maton, Brett <span dir="ltr"><<a href="mailto:matonb@ltresources.co.uk" target="_blank">matonb@ltresources.co.uk</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks for the pointer Mikhail, however I don't get any tasks listed with that command:<br><br>vdsClient -s 0 getAllTasksStatuses<br><br>/usr/share/vdsm/vdsClient.py:<wbr>33: DeprecationWarning: vdscli uses xmlrpc. since ovirt 3.6 xmlrpc is deprecated, please use vdsm.jsonrpcvdscli<br> from vdsm import utils, vdscli, constants<br><br>{'status': {'message': 'OK', 'code': 0}, 'allTasksStatus': {}}<br><br></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On 8 September 2016 at 09:51, Краснобаев Михаил <span dir="ltr"><<a href="mailto:milo1@ya.ru" target="_blank">milo1@ya.ru</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>Hi,</div><div> </div><div>There is a way to cancel a running task - look here <a href="http://lists.ovirt.org/pipermail/users/2014-November/028946.html" target="_blank">http://lists.ovirt.org/piperma<wbr>il/users/2014-November/028946.<wbr>html</a></div><div>I was able to stop snapshot deletion this way.</div><div> </div><div>Best, Mikhail.</div><div> </div><div>08.09.2016, 08:14, "Maton, Brett" <<a href="mailto:matonb@ltresources.co.uk" target="_blank">matonb@ltresources.co.uk</a>>:</div><blockquote type="cite"><div><div><div><div><div>Any suggestions ?<br><br></div>THe task has been hung for 5 days now, I can't start the machine or destroy it.<br><br></div></div><div><br><div>On 7 September 2016 at 06:49, Maton, Brett <span><<a href="mailto:matonb@ltresources.co.uk" target="_blank">matonb@ltresources.co.uk</a>></span> wrote:<br><blockquote style="margin:0 0 0 0.8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div>Sorry just hit reply....<br><br></div>I'm seeing these errors in the logs which look related to the problem:<br><br><br><span>2016-09-07 06</span>:46:35,123 ERROR [org.ovirt.engine.core.bll.tas<wbr>ks.CommandCallbacksPoller] (DefaultQuartzScheduler6) [19c58c0d] Failed invoking callback end method 'onFailed' for command '<span>07608003</span>-ca05-4e2e-b917-85ce5<wbr>25c011b' with exception 'null', the callback is marked for end method retries<br><span>2016-09-07 06</span>:46:45,184 ERROR [<a href="http://org.ovirt.engine.core.bll.Com">org.ovirt.engine.core.bll.Com</a><wbr>mandsFactory] (DefaultQuartzScheduler7) [19c58c0d] Error in invocating CTOR of command 'LiveMigrateDisk': null<br><span>2016-09-07 06</span>:46:45,185 ERROR [org.ovirt.engine.core.bll.tas<wbr>ks.CommandCallbacksPoller] (DefaultQuartzScheduler7) [19c58c0d] Failed invoking callback end method 'onFailed' for command '<span>07608003</span>-ca05-4e2e-b917-85ce5<wbr>25c011b' with exception 'null', the callback is marked for end method retries</div><div><div><div><div><div><div><br><div>On 5 September 2016 at 06:46, Nir Soffer <span><<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>></span> wrote:<br><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid #cccccc;padding-left:1ex">Hi Maton,<br> <br> Please reply to the list, not to me directly.<br> <br> Ala, can you look at this? is this a known issue?<br> <br> Thanks,<br> Nir<br><div><div><br> On Mon, Sep 5, 2016 at 8:43 AM, Maton, Brett <<a href="mailto:matonb@ltresources.co.uk" target="_blank">matonb@ltresources.co.uk</a>> wrote:<br> > Log files as requested<br> ><br> > <a href="https://ufile.io/4fc35" target="_blank">https://ufile.io/4fc35</a> vdsm log<br> > <a href="https://ufile.io/e9836" target="_blank">https://ufile.io/e9836</a> engine 03-Sep<br> > <a href="https://ufile.io/15f37" target="_blank">https://ufile.io/15f37</a> engine 04-Sep<br> ><br> > vdsm log stops on the 01-Sep...<br> ><br> > Couple of entries from the event log:<br> ><br> > Sep 3, 2016 7:31:07 PM Snapshot 'Auto-generated for Live Storage<br> > Migration' deletion for VM 'lv01' has been completed.<br> > Sep 3, 2016 6:46:46 PM Snapshot 'Auto-generated for Live Storage<br> > Migration' deletion for VM 'lv01' was initiated by SYSTEM<br> ><br> > And the related tasks<br> ><br> > Removing Snapshot Auto-generated for Live Storage Migration of VM lv01<br> > Sep 3, 2016 6:46:44 PM N/A 29f45ca9<br> > Validating Sep 3, 2016 6:46:44 PM until Sep 3, 2016 6:46:44 PM<br> > Executing Sep 3, 2016 6:46:44 PM until Sep 3, 2016 7:31:06 PM<br> ><br> > Finalizing Sep 3, 2016 7:31:06 PM N/A<br> ><br> ><br> ><br> > On 4 September 2016 at 14:27, Nir Soffer <<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>> wrote:<br> >><br> >> On Sun, Sep 4, 2016 at 12:40 PM, Maton, Brett <<a href="mailto:matonb@ltresources.co.uk" target="_blank">matonb@ltresources.co.uk</a>><br> >> wrote:<br> >>><br> >>> How do I fix / kill a hung vdsm task?<br> >>><br> >>> It seems to have completed the task but is stuck finalising.<br> >>><br> >>> Removing Snapshot Auto-generated for Live Storage Migration<br> >>> Validating<br> >>> Executing<br> >>> (hour glass) Finalizing<br> >>><br> >>> Task has been 'stuck' finalising for over 13 hours<br> >><br> >><br> >> Can you share engine and vdsm logs since the time the merge was started?<br> >><br> >> Nir<br> ><br> ></div></div></blockquote></div></div></div></div></div></div></div></div></blockquote></div></div></div></div>,<p>______________________________<wbr>_________________<br>Users mailing list<br><a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br><a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a></p></blockquote><span><font color="#888888"><div> </div><div> </div><div>-- </div><div>С уважением, Краснобаев Михаил.</div><div> </div><div> </div></font></span></blockquote></div><br></div>
</div></div></blockquote></div><br></div>