Cannot activate storage domain

28 Feb 2018

      --_000_2CB4E8C8E00E594EA06D4AC427E429920FE500D1fabamailserverf_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hi all,

  we run a small oVirt installation that we also use for automated testing =
(automatically creating, dropping vms).

We got an inactive FC storage domain that we cannot activate any more. We s=
ee several events at that time starting with:

VM perftest-c17 is down with error. Exit message: Unable to get volume size=
 for domain b83c159c-4ad6-4613-ba16-bab95ccd10c0 volume 686376c1-4be1-44c3-=
89a3-0a8addc8fdf2.

Trying to activate the strorage domain results in the following alert event=
 for each host:

VDSM <hostname> command GetVGInfoVDS failed: Volume Group does not exist: (=
u'vg_uuid: 813oRe-64r8-mloU-k9G2-LFsS-dXSG-hpN4kf',)

And after those messages from all hosts we get:

VDSM command ActivateStorageDomainVDS failed: Storage domain does not exist=
: (u'b83c159c-4ad6-4613-ba16-bab95ccd10c0',)

Failed to activate Storage Domain VMHOST_LUN_205 (Data Center Production) b=
y <user>

Invalid status on Data Center Production. Setting status to Non Responsive.

Storage Pool Manager runs on Host vmhost003.fabagl.fabasoft.com (Address: v=
mhost003.fabagl.fabasoft.com), Data Center Production.

Checking the hosts with multipath -ll we see the LUN without errors.

We run oVirt 4.2.1 on CentOS 7.4. Hosts are CentOS 7.4 hosts with oVirt ins=
talled using oVirt engine.

Hosts are connected to about 30 FC LUNs (8 TB each) on two all-flash storag=
e arrays.

Thank you,

Simone Bruckner

--_000_2CB4E8C8E00E594EA06D4AC427E429920FE500D1fabamailserverf_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
...
...
</p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">Invalid status on Data Center P=
roduction. Setting status to Non Responsive.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">Storage Pool Manager runs on Ho=
st vmhost003.fabagl.fabasoft.com (Address: vmhost003.fabagl.fabasoft.com), =
Data Center Production.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">Checking the hosts with multipa=
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0cm;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;
	mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:#0563C1;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:#954F72;
	text-decoration:underline;}
span.E-MailFormatvorlage17
	{mso-style-type:personal-compose;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-family:"Calibri",sans-serif;
	mso-fareast-language:EN-US;}
@page WordSection1
	{size:612.0pt 792.0pt;
	margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=3D"DE" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal">Hi all,<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">  we run a small oVirt ins=
tallation that we also use for automated testing (automatically creating, d=
ropping vms).<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">We got an inactive FC storage d=
omain that we cannot activate any more. We see several events at that time =
starting with:<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">VM perftest-c17 is down with er=
ror. Exit message: Unable to get volume size for domain b83c159c-4ad6-4613-=
ba16-bab95ccd10c0 volume 686376c1-4be1-44c3-89a3-0a8addc8fdf2.<o:p></o:p></=
span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">Trying to activate the strorage=
 domain results in the following alert event for each host:<o:p></o:p></spa=
n></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">VDSM <hostname> command G=
etVGInfoVDS failed: Volume Group does not exist: (u'vg_uuid: 813oRe-64r8-ml=
oU-k9G2-LFsS-dXSG-hpN4kf',)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">And after those messages from a=
ll hosts we get:<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">VDSM command ActivateStorageDom=
ainVDS failed: Storage domain does not exist: (u'b83c159c-4ad6-4613-ba16-ba=
b95ccd10c0',)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">Failed to activate Storage Doma=
in VMHOST_LUN_205 (Data Center Production) by <user><o:p></o:p></span=
th –ll we see the LUN without errors.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">We run oVirt 4.2.1 on CentOS 7.=
4. Hosts are CentOS 7.4 hosts with oVirt installed using oVirt engine.<o:p>=
</o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB">Hosts are connected to about 30=
 FC LUNs (8 TB each) on two all-flash storage arrays.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"DE-AT" style=3D"mso-fareast-language:D=
E">Thank you,<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"DE-AT" style=3D"mso-fareast-language:D=
E">Simone Bruckner</span><span style=3D"font-size:8.0pt;font-family:"A=
rial",sans-serif;mso-fareast-language:DE"><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Ari=
al",sans-serif;mso-fareast-language:DE"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"DE-AT"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-GB"><o:p> </o:p></span></p>
</div>
</body>
</html>

--_000_2CB4E8C8E00E594EA06D4AC427E429920FE500D1fabamailserverf_--

Bruckner, Simone

Bruckner, Simone

Bruckner, Simone

Bruckner, Simone

Shani Leviim

Bruckner, Simone

Bruckner, Simone

Shani Leviim

Bruckner, Simone

tags

participants (2)