<div dir="ltr">Uh oh, looks like an upgrade to version 4 is the only option then.... unless I'm missing something.</div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jan 19, 2017 at 1:36 AM, Pavel Gashev <span dir="ltr"><<a href="mailto:Pax@acronis.com" target="_blank">Pax@acronis.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="white" lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="m_270318491348943888WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Beau,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Looks like you have upgraded to CentOS 7.3. Now you have to update the vdsm package to 4.17.35.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><u></u> <u></u></span></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-family:Calibri;color:black">From: </span>
</b><span style="font-family:Calibri;color:black"><<a href="mailto:users-bounces@ovirt.org" target="_blank">users-bounces@ovirt.org</a>> on behalf of Beau Sapach <<a href="mailto:bsapach@ualberta.ca" target="_blank">bsapach@ualberta.ca</a>><br>
<b>Date: </b>Wednesday 18 January 2017 at 23:56<br>
<b>To: </b>"<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>" <<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>><br>
<b>Subject: </b>[ovirt-users] Select As SPM Fails<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div><span class="">
<p class="MsoNormal">Hello everyone, <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I'm about to start digging through the mailing list archives in search of a solution but thought I would post to the list as well. I'm running oVirt 3.6 on a 2 node CentOS7 cluster backed by fiber channel storage and with a separate engine
VM running outside of the cluster (NOT hosted-engine).<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">When I try to move the SPM role from one node to the other I get the following in the web interface:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</span><div>
<blockquote style="margin-left:30.0pt;margin-right:0cm">
<div>
<p class="MsoNormal"><img width="544" height="65" id="m_270318491348943888_x0000_i1025" src="cid:image001.png@01D27248.482239A0" alt="nline image 1"><u></u><u></u></p>
</div>
</blockquote>
</div><div><div class="h5">
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">When I look into /var/log/ovirt-engine/engine.<wbr>log I see the following:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<blockquote style="margin-left:30.0pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal">2017-01-18 13:35:09,332 ERROR [org.ovirt.engine.core.<wbr>vdsbroker.vdsbroker.<wbr>HSMGetAllTasksStatusesVDSComma<wbr>nd] (default task-26) [6990cfca] Failed in 'HSMGetAllTasksStatusesVDS' method<u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">2017-01-18 13:35:09,340 ERROR [org.ovirt.engine.core.dal.<wbr>dbbroker.auditloghandling.<wbr>AuditLogDirector] (default task-26) [6990cfca] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM v6 command failed: Logical Volume
extend failed<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">When I look at the task list on the host currently holding the SPM role (in this case 'v6'), using: vdsClient -s 0 getAllTasks, I see a long list like this:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<blockquote style="margin-left:30.0pt;margin-right:0cm">
<div>
<div>
<div>
<p class="MsoNormal">dc75d3e7-cea7-449b-9a04-<wbr>76fd8ef0f82b :<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> verb = downloadImageFromStream<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> code = 554<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> state = recovered<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> tag = spm<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> result =<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> message = Logical Volume extend failed<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> id = dc75d3e7-cea7-449b-9a04-<wbr>76fd8ef0f82b<u></u><u></u></p>
</div>
</div>
</div>
</blockquote>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">When I look at /var/log/vdsm/vdsm.log on the host in question (v6) I see messages like this:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<blockquote style="margin-left:30.0pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal">'531dd533-22b1-47a0-aae8-<wbr>76c1dd7d9a56': {'code': 554, 'tag': u'spm', 'state': 'recovered', 'verb': 'downloadImageFromStreaam', 'result': '', 'message': 'Logical Volume extend failed', 'id': '531dd533-22b1-47a0-aae8-<wbr>76c1dd7d9a56'}<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">As well as the error from the attempted extend of the logical volume:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<blockquote style="margin-left:30.0pt;margin-right:0cm">
<div>
<div>
<div>
<p class="MsoNormal">e980df5f-d068-4c84-8aa7-<wbr>9ce792690562::ERROR::2017-01-<wbr>18 13:24:50,710::task::866::<wbr>Storage.TaskManager.Task::(_<wbr>setError) Task=`e980df5f-d068-4c84-8aa7-<wbr>9ce792690562`::Unexpected error<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Traceback (most recent call last):<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> File "/usr/share/vdsm/storage/task.<wbr>py", line 873, in _run<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> return fn(*args, **kargs)<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> File "/usr/share/vdsm/storage/task.<wbr>py", line 332, in run<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> return self.cmd(*self.argslist, **self.argsdict)<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> File "/usr/share/vdsm/storage/<wbr>securable.py", line 77, in wrapper<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> return method(self, *args, **kwargs)<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> File "/usr/share/vdsm/storage/sp.<wbr>py", line 1776, in downloadImageFromStream<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> .copyToImage(methodArgs, sdUUID, imgUUID, volUUID)<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> File "/usr/share/vdsm/storage/<wbr>image.py", line 1373, in copyToImage<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> / volume.BLOCK_SIZE)<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> File "/usr/share/vdsm/storage/<wbr>blockVolume.py", line 310, in extend<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> lvm.extendLV(self.sdUUID, self.volUUID, sizemb)<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> File "/usr/share/vdsm/storage/lvm.<wbr>py", line 1179, in extendLV<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> _resizeLV("lvextend", vgName, lvName, size)<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> File "/usr/share/vdsm/storage/lvm.<wbr>py", line 1175, in _resizeLV<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> raise se.LogicalVolumeExtendError(<wbr>vgName, lvName, "%sM" % (size, ))<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">LogicalVolumeExtendError:<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Logical Volume extend failed: 'vgname=ae05947f-875c-4507-<wbr>ad51-62b0d35ef567 lvname=caaef597-eddd-4c24-<wbr>8df2-a61f35f744f8 newsize=1M'<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">e980df5f-d068-4c84-8aa7-<wbr>9ce792690562::DEBUG::2017-01-<wbr>18 13:24:50,711::task::885::<wbr>Storage.TaskManager.Task::(_<wbr>run) Task=`e980df5f-d068-4c84-8aa7-<wbr>9ce792690562`::Task._run: e980df5f-d068-4c84-8aa7-<wbr>9ce792690562 () {} failed - stopping task<u></u><u></u></p>
</div>
</div>
</div>
</blockquote>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">The logical volume in question is an OVF_STORE disk that lives on one of the fiber channel backed LUNs. If I run:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<blockquote style="margin-left:30.0pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal">vdsClient -s 0 ClearTask TASK-UUID-HERE<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</blockquote>
<p class="MsoNormal">for each task that appears in the: <u></u><u></u></p>
<blockquote style="margin-left:30.0pt;margin-right:0cm">
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">vdsClient -s 0 getAllTasks <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</blockquote>
<p class="MsoNormal">output then they disappear and I'm able to move the SPM role to the other host.<u></u><u></u></p>
<div>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">This problem then crops up again on the new host once the SPM role is moved. What's going on here? Does anyone have any insight as to how to prevent this task from re-appearing? Or why it's failing in the first place?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Beau<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div>
</div>
</div>
</div></div></div>
</div>
</div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><font size="1" face="arial, helvetica, sans-serif">Beau Sapach</font></div><div><font size="1" face="arial, helvetica, sans-serif" color="#999999"><b>System Administrator | Information Technology Services | University of Alberta Libraries</b></font></div><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small;background-color:rgb(255,255,255)"><font color="#999999"><b>Phone: 780.492.4181 | Email: <a href="mailto:Beau.Sapach@ualberta.ca" target="_blank">Beau.Sapach@ualberta.ca</a></b></font></span></div><div><br></div></div></div>
</div>