<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.E-MailFormatvorlage17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="DE" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Hi all,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span lang="EN-GB"> we did a live storage migration of one of three disks of a vm that failed because the vm became not responding when deleting the auto-snapshot:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-16 15:07:32.084+01 | 0 | Snapshot 'VMNAME_Disk2 Auto-generated for Live Storage Migration' creation for VM 'VMNAME' was initiated by xxx<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-16 15:07:32.097+01 | 0 | User xxx moving disk VMNAME_Disk2 to domain VMHOST_LUN_211.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-16 15:08:56.304+01 | 0 | Snapshot 'VMNAME_Disk2 Auto-generated for Live Storage Migration' creation for VM 'VMNAME' has been completed.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-16 16:40:48.89+01 | 0 | Snapshot 'VMNAME_Disk2 Auto-generated for Live Storage Migration' deletion for VM 'VMNAME' was initiated by xxx.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-16 16:44:44.813+01 | 1 | VM VMNAME is not responding.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-18 18:40:51.258+01 | 2 | Failed to delete snapshot 'VMNAME_Disk2 Auto-generated for Live Storage Migration' for VM 'VMNAME'.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-18 18:40:54.506+01 | 1 | Possible failure while deleting VMNAME_Disk2 from the source Storage Domain VMHOST_LUN_211 during the move operation. The Storage
Domain may be manually cleaned-up from possible leftover<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">s (User:xxx).<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB">Now we cannot start the vm anymore as long as this disk is online. Error message is
</span><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">“VM VMNAME is down with error. Exit message: Bad volume specification {'index': 2, 'domainID': 'ecc71a64-62c1-43f4-bf1f-3bc1b22c7a8a', 'reqsize': '0', 'name': 'vdc', 'truesize': '2147483648',
'format': 'cow', 'discard': False, 'volumeID': '4659b5e0-93c1-478d-97d0-ec1cf4052028', 'apparentsize': '2147483648', 'imageID': 'c1a05108-90d7-421d-a9b4-d4cc65c48429', 'specParams': {}, 'iface': 'virtio', 'cache': 'none', 'propagateErrors': 'off', 'poolID':
'5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/mnt/blockSD/ecc71a64-62c1-43f4-bf1f-3bc1b22c7a8a/images/c1a05108-90d7-421d-a9b4-d4cc65c48429/4659b5e0-93c1-478d-97d0-ec1cf4052028', 'serial': 'c1a05108-90d7-421d-a9b4-d4cc65c48429',
'diskType': 'block', 'type': 'block'}.”</span><span lang="EN-GB"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB">vdsm.log:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-18 21:53:33,815+0100 ERROR (vm/7d05e511) [storage.TaskManager.Task] (Task='fc3bac16-64f3-4910-8bc4-6cfdd4d270da') Unexpected error (task:875)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">Traceback (most recent call last):<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> return fn(*args, **kargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> File "<string>", line 2, in prepareImage<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> ret = func(*args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 3179, in prepareImage<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> raise se.prepareIllegalVolumeError(volUUID)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">prepareIllegalVolumeError: Cannot prepare illegal volume: ('4c6475b1-352a-4114-b647-505cccbe6663',)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-18 21:53:33,816+0100 INFO (vm/7d05e511) [storage.TaskManager.Task] (Task='fc3bac16-64f3-4910-8bc4-6cfdd4d270da') aborting: Task is aborted: "Cannot prepare illegal
volume: ('4c6475b1-352a-4114-b647-505cccbe6663',)" - code 227 (task:1181)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-18 21:53:33,816+0100 ERROR (vm/7d05e511) [storage.Dispatcher] FINISH prepareImage error=Cannot prepare illegal volume: ('4c6475b1-352a-4114-b647-505cccbe6663',)
(dispatcher:82)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-18 21:53:33,816+0100 ERROR (vm/7d05e511) [virt.vm] (vmId='7d05e511-2e97-4002-bded-285ec4e30587') The vm start process failed (vm:927)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">Traceback (most recent call last):<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 856, in _startUnderlyingVm<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> self._run()<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2661, in _run<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> self._devices = self._make_devices()<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2608, in _make_devices<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> self._preparePathsForDrives(disk_params)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 1001, in _preparePathsForDrives<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> drive['path'] = self.cif.prepareVolumePath(drive, self.id)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 393, in prepareVolumePath<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New""> raise vm.VolumeError(drive)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">VolumeError: Bad volume specification {'index': 2, 'domainID': 'ecc71a64-62c1-43f4-bf1f-3bc1b22c7a8a', 'reqsize': '0', 'name': 'vdc', 'truesize': '2147483648', 'format':
'cow', 'discard': False, 'volumeID': '4659b5e0-93c1-478d-97d0-ec1cf4052028', 'apparentsize': '2147483648', 'imageID': 'c1a05108-90d7-421d-a9b4-d4cc65c48429', 'specParams': {}, 'iface': 'virtio', 'cache': 'none', 'propagateErrors': 'off', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3',
'device': 'disk', 'path': '/rhev/data-center/mnt/blockSD/ecc71a64-62c1-43f4-bf1f-3bc1b22c7a8a/images/c1a05108-90d7-421d-a9b4-d4cc65c48429/4659b5e0-93c1-478d-97d0-ec1cf4052028', 'serial': 'c1a05108-90d7-421d-a9b4-d4cc65c48429', 'diskType': 'block', 'type':
'block'}<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Courier New"">2018-03-18 21:53:33,817+0100 INFO (vm/7d05e511) [virt.vm] (vmId='7d05e511-2e97-4002-bded-285ec4e30587') Changed state to Down: Bad volume specification {'index': 2, 'domainID':
'ecc71a64-62c1-43f4-bf1f-3bc1b22c7a8a', 'reqsize': '0', 'name': 'vdc', 'truesize': '2147483648', 'format': 'cow', 'discard': False, 'volumeID': '4659b5e0-93c1-478d-97d0-ec1cf4052028', 'apparentsize': '2147483648', 'imageID': 'c1a05108-90d7-421d-a9b4-d4cc65c48429',
'specParams': {}, 'iface': 'virtio', 'cache': 'none', 'propagateErrors': 'off', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/mnt/blockSD/ecc71a64-62c1-43f4-bf1f-3bc1b22c7a8a/images/c1a05108-90d7-421d-a9b4-d4cc65c48429/4659b5e0-93c1-478d-97d0-ec1cf4052028',
'serial': 'c1a05108-90d7-421d-a9b4-d4cc65c48429', 'diskType': 'block', 'type': 'block'} (code=1) (vm:1646)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB">Is there a way to recover this disk?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="mso-fareast-language:DE">Thank you,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="mso-fareast-language:DE">Simone<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB"><o:p> </o:p></span></p>
</div>
</body>
</html>