--_004_MWHPR09MB1421C61F4ECC6928C57E614787CB0MWHPR09MB1421namp_
Content-Type: multipart/alternative;
boundary="_000_MWHPR09MB1421C61F4ECC6928C57E614787CB0MWHPR09MB1421namp_"
--_000_MWHPR09MB1421C61F4ECC6928C57E614787CB0MWHPR09MB1421namp_
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
FYI: My miss. Firewall port for VDSM needed to be added to my zone(s).
Yay! The host is now in GREEN status within the Default Cluster.
Sent using OWA for iPhone
________________________________
From: Langley, Robert
Sent: Monday, June 5, 2017 5:16:51 PM
To: Sandro Bonazzola; Sahina Bose
Cc: Simone Tiraboschi; Nir Soffer; Allon Mureinik; Tal Nisan; users
Subject: RE: [ovirt-users] Hosted-Engine Deploy - Error Creating a Storage =
Domain
I have good news. With the IOProcess connection, I was suspecting maybe it =
would be something with the system (BIOS related).
The Dell PE R730 was at BIOS version 2.2.5 and there was an update in April=
to version 2.4.3 (with another inbetween these two). There were a couple o=
f fixes between the version the server had and the latest, which had me won=
dering if they may be related to the IOProcess issue I was experiencing.
After applying this update the Hosted Engine deployment went further.
It could explain why I could not add this host in a previous installation.
I=92ll start another thread for this next bump I=92m running into, unless I=
can figure it out. Has to do with the VDSM host. Engine says it cannot com=
municate with this host its running on. So, the setup timed out waiting for=
the VDSM host to start.
From: Sandro Bonazzola [mailto:sbonazzo@redhat.com]
Sent: Monday, June 5, 2017 9:00 AM
To: Langley, Robert <Robert.Langley(a)ventura.org>; Sahina Bose <sabose@redha=
t.com
Cc: Simone Tiraboschi <stirabos(a)redhat.com>; Nir Soffer
<nsoffer(a)redhat.com=
; Allon Mureinik <amureini(a)redhat.com>; Tal Nisan
<tnisan(a)redhat.com>; use=
rs <users(a)ovirt.org
Subject:
Re: [ovirt-users] Hosted-Engine Deploy - Error Creating a Storage =
Domain
On Fri, Jun 2, 2017 at 6:16 PM, Langley, Robert <Robert.Langley(a)ventura.org=
<mailto:Robert.Langley@ventura.org>> wrote:
Any progress?
Nir? Allon? Tal?
One thing that has been going through my mind is whether oVirt allows a Glu=
sterFS storage domain to work with multiple CPU types?
Sahina?
The two dedicated GlusterFS storage servers are AMD Opteron. And the third =
server for the replica 3, which I am hoping I can also use as an oVirt host=
is a new Intel Xeon (Dell PE R830). I know GlusterFS allows for mixed hard=
ware, but I=92m not sure about when oVirt manages GlusterFS, if mixed hardw=
are and mixed use has been accounted for?
From: Simone Tiraboschi [mailto:stirabos@redhat.com<mailto:stirabos@redhat.=
com>]
Sent: Wednesday, May 31, 2017 8:41 AM
To: Langley, Robert <Robert.Langley@ventura.org<mailto:Robert.Langley@ventu=
ra.org>
Cc: Sandro Bonazzola
<sbonazzo@redhat.com<mailto:sbonazzo@redhat.com>>; Nir=
Soffer <nsoffer@redhat.com<mailto:nsoffer@redhat.com>>; Allon Mureinik
<am=
ureini@redhat.com<mailto:amureini@redhat.com>>; Tal Nisan <tnisan(a)redhat.co=
m<mailto:tnisan@redhat.com>>; users
<users@ovirt.org<mailto:users@ovirt.org=
>
Subject: Re: [ovirt-users] Hosted-Engine Deploy - Error Creating a Storage =
Domain
It seams something related to IOProcess connection.
2017-05-25 20:54:40,362-0700 INFO (jsonrpc/4) [IOProcessClient] Starting c=
lient ioprocess-3 (__init__:330)
2017-05-25 20:54:40,370-0700 INFO (ioprocess/31239) [IOProcess] Starting i=
oprocess (__init__:452)
2017-05-25 20:54:40,407-0700 ERROR (jsonrpc/4) [storage.TaskManager.Task] (=
Task=3D'89dd17d2-8a38-4825-9ba2-f231f1aff9f5') Unexpected error (task:870)
Traceback (most recent call last):
File "/usr/share/vdsm/storage/task.py", line 877, in _run
return fn(*args, **kargs)
File "/usr/lib/python2.7/site-packages/vdsm/logUtils.py", line 52, in wra=
pper
res =3D f(*args, **kwargs)
File "/usr/share/vdsm/storage/hsm.py", line 2581, in createStorageDomain
storageType, domVersion)
File "/usr/share/vdsm/storage/nfsSD.py", line 87, in create
remotePath, storageType, version)
File "/usr/share/vdsm/storage/fileSD.py", line 421, in _prepareMetadata
procPool.fileUtils.createdir(metadataDir, 0o775)
File "/usr/lib/python2.7/site-packages/vdsm/storage/outOfProcess.py", lin=
e 166, in createdir
self._iop.mkdir(tmpPath, mode)
File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 524, =
in mkdir
self.timeout)
File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 466, =
in _sendCommand
raise OSError(errcode, errstr)
OSError: [Errno 61] No data available
2017-05-25 20:54:40,409-0700 INFO (jsonrpc/4) [storage.TaskManager.Task] (=
Task=3D'89dd17d2-8a38-4825-9ba2-f231f1aff9f5') aborting: Task is aborted: u=
'[Errno 61] No data available' - code 100 (task:1175)
2017-05-25 20:54:40,409-0700 ERROR (jsonrpc/4) [storage.Dispatcher] [Errno =
61] No data available (dispatcher:80)
Traceback (most recent call last):
File "/usr/share/vdsm/storage/dispatcher.py", line 72, in wrapper
result =3D ctask.prepare(func, *args, **kwargs)
File "/usr/share/vdsm/storage/task.py", line 105, in wrapper
return m(self, *a, **kw)
File "/usr/share/vdsm/storage/task.py", line 1183, in prepare
raise self.error
OSError: [Errno 61] No data available
2017-05-25 20:54:40,410-0700 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC =
call StorageDomain.create failed (error 351) in 0.24 seconds (__init__:533)
Nir, any hint?
On Wed, May 31, 2017 at 5:24 PM, Langley, Robert <Robert.Langley(a)ventura.or=
g<mailto:Robert.Langley@ventura.org>> wrote:
SOSReport attached, with md5. Thank you
From: Sandro Bonazzola [mailto:sbonazzo@redhat.com<mailto:sbonazzo@redhat.c=
om>]
Sent: Wednesday, May 31, 2017 12:00 AM
To: Langley, Robert <Robert.Langley@ventura.org<mailto:Robert.Langley@ventu=
ra.org>>; Nir Soffer <nsoffer@redhat.com<mailto:nsoffer@redhat.com>>;
Allon=
Mureinik <amureini@redhat.com<mailto:amureini@redhat.com>>; Tal Nisan
<tni=
san@redhat.com<mailto:tnisan@redhat.com>>; Simone Tiraboschi <stirabos@redh=
at.com<mailto:stirabos@redhat.com
>
Cc:
users <users@ovirt.org<mailto:users@ovirt.org
>
Subject: Re: [ovirt-users] Hosted-Engine Deploy - Error Creating a Storage =
Domain
On Tue, May 30, 2017 at 11:50 PM, Langley, Robert <Robert.Langley(a)ventura.o=
rg<mailto:Robert.Langley@ventura.org>> wrote:
While going through the hosted engine deployment, I am not able to have it =
successfully complete. Even going through the setup log, I=92m not able to =
identify what is wrong. Why it thinks the system is not reliable.
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/otopi/context.py", line 132, in _e=
xecuteMethod
method['method']()
File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-setup=
/storage/storage.py", line 957, in _misc
self._createStorageDomain()
File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-setup=
/storage/storage.py", line 546, in _createStorageDomain
raise RuntimeError(status['status']['message'])
RuntimeError: Error creating a storage domain: (u'storageType=3D7, sdUUID=
=3Da2494209-f823-4745-8eea-a122889d48f6, domainName=3Dhosted_storage, domCl=
ass=3D1, typeSpecificArg=3Dgsa-stor1.stor.local:/engine domVersion=3D3',)
Can you please provide vdsm logs or better a full sos report (sosreport -a)=
?
_______________________________________________
Users mailing list
Users@ovirt.org<mailto:Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
SANDRO BONAZZOLA
ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
Red Hat
EMEA<https://www.redhat.com/
[Image
removed by sender.]<https://red.ht/sig
TRIED. TESTED.
TRUSTED.<https://redhat.com/trusted
--
SANDRO BONAZZOLA
ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
Red Hat
EMEA<https://www.redhat.com/
[
https://www.redhat.com/profiles/rh/themes/redhatdotcom/img/logo-red-hat-bl=
ack.png]<https://red.ht/sig
TRIED. TESTED.
TRUSTED.<https://redhat.com/trusted
--_000_MWHPR09MB1421C61F4ECC6928C57E614787CB0MWHPR09MB1421namp_
Content-Type: text/html; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml"
xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word"
=
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml"
xmlns=3D"http:=
//www.w3.org/TR/REC-html40"
<head
<meta http-equiv=3D"Content-Type"
content=3D"text/html; charset=3DWindows-1=
252"
<meta
name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)"
<!--[if !mso]><style>v\:*
{behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /
</xml><![endif]--><!--[if gte mso
9]><xml
<o:shapelayout
v:ext=3D"edit"
<o:idmap v:ext=3D"edit"
data=3D"1" /
</o:shapelayout></xml><![endif]--
</head
<body lang=3D"EN-US"
link=3D"blue" vlink=3D"purple"
FYI: My
miss. Firewall port for VDSM needed to be added to my zone(s).<br
Yay! The host is now in GREEN status within the Default
Cluster.<br
<br
Sent
using OWA for iPhone
<hr style=3D"display:inline-block;width:98%" tabindex=3D"-1"
<div id=3D"divRplyFwdMsg"
dir=3D"ltr"><font face=3D"Calibri, sans-serif" st=
yle=3D"font-size:11pt" color=3D"#000000"><b>From:</b>
Langley, Robert<br
<b>Sent:</b> Monday,
June 5, 2017 5:16:51 PM<br
<b>To:</b> Sandro
Bonazzola; Sahina Bose<br
<b>Cc:</b> Simone
Tiraboschi; Nir Soffer; Allon Mureinik; Tal Nisan; users<=
br
<b>Subject:</b> RE: [ovirt-users] Hosted-Engine
Deploy - Error Creating a S=
torage Domain</font
<div> </div
</div
<div
<div
class=3D"WordSection1"
<p
class=3D"MsoNormal"><span
style=3D"font-size:11.0pt;font-family:"Ca=
libri",sans-serif">I have good news. With the IOProcess connection, I =
was suspecting maybe it would be something with the system (BIOS related).<=
o:p></o:p></span></p
<p
class=3D"MsoNormal"><span
style=3D"font-size:11.0pt;font-family:"Ca=
libri",sans-serif">The Dell PE R730 was at BIOS version 2.2.5 and ther=
e was an update in April to version 2.4.3 (with another inbetween these two=
). There were a couple of fixes between the version
the server had and the latest, which had me wondering if they may be relat=
ed to the IOProcess issue I was
experiencing.<o:p></o:p></span></p
<p
class=3D"MsoNormal"><span
style=3D"font-size:11.0pt;font-family:"Ca=
libri",sans-serif">After applying this update the Hosted Engine deploy=
ment went further.<o:p></o:p></span></p
<p
class=3D"MsoNormal"><span
style=3D"font-size:11.0pt;font-family:"Ca=
libri",sans-serif">It could explain why I could not add this host in a=
previous installation.<o:p></o:p></span></p
<p class=3D"MsoNormal"><span
style=3D"font-size:11.0pt;font-family:"Ca=
libri",sans-serif"><o:p> </o:p></span></p
<p class=3D"MsoNormal"><span
style=3D"font-size:11.0pt;font-family:"Ca=
libri",sans-serif">I=92ll start another thread for this next bump I=92=
m running into, unless I can figure it out. Has to do with the VDSM host. E=
ngine says it cannot communicate with this host its
running on. So, the setup timed out waiting for the VDSM host to start.<o:=
p></o:p></span></p
<p
class=3D"MsoNormal"><a name=3D"_MailEndCompose"><span
style=3D"font-size=
:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span=
</a></p>
<span
style=3D"mso-bookmark:_MailEndCompose"></span
<p
class=3D"MsoNormal"><b><span
style=3D"font-size:11.0pt;font-family:"=
;Calibri",sans-serif">From:</span></b><span
style=3D"font-size:11.0pt;=
font-family:"Calibri",sans-serif"> Sandro Bonazzola
[mailto:sbona=
zzo(a)redhat.com]
<br
<b>Sent:</b> Monday, June 5, 2017 9:00 AM<br
<b>To:</b> Langley, Robert
&lt;Robert.Langley(a)ventura.org&gt;; Sahina Bose =
&lt;sabose(a)redhat.com&gt;<br
<b>Cc:</b> Simone Tiraboschi &lt;stirabos(a)redhat.com&gt;; Nir
Soffer <ns=
offer(a)redhat.com&gt;; Allon Mureinik &lt;amureini(a)redhat.com&gt;; Tal Nisan=
&lt;tnisan(a)redhat.com&gt;; users &lt;users(a)ovirt.org&gt;<br
<b>Subject:</b> Re: [ovirt-users] Hosted-Engine
Deploy - Error Creating a S=
torage Domain<o:p></o:p></span></p
<p
class=3D"MsoNormal"><o:p> </o:p></p
<div
<p
class=3D"MsoNormal"><o:p> </o:p></p
<div
<p
class=3D"MsoNormal"><o:p> </o:p></p
<div
<p
class=3D"MsoNormal">On Fri, Jun 2, 2017 at 6:16 PM, Langley, Robert
<=
<a href=3D"mailto:Robert.Langley@ventura.org"
target=3D"_blank">Robert.Lang=
ley(a)ventura.org</a>&gt; wrote:<o:p
</o:p></p>
<blockquote
style=3D"border:none;border-left:solid #CCCCCC 1.0pt;padding:0i=
n 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in"
<div
<div
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><span
style=3D"font-size:11.0pt;font-family:"Calibri",sa=
ns-serif">Any progress?</span><o:p
</o:p></p>
</div
</div
</blockquote
<div
<p
class=3D"MsoNormal"><o:p> </o:p></p
</div
<div
<p
class=3D"MsoNormal">Nir? Allon? Tal?<o:p
</o:p></p>
</div
<div
<p
class=3D"MsoNormal"> <o:p
</o:p></p>
</div
<blockquote style=3D"border:none;border-left:solid #CCCCCC
1.0pt;padding:0i=
n 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in"
<div
<div
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><span
style=3D"font-size:11.0pt;font-family:"Calibri",sa=
ns-serif"> </span><o:p
</o:p></p>
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><span
style=3D"font-size:11.0pt;font-family:"Calibri",sa=
ns-serif">One thing that has been going through my mind is whether oVirt al=
lows a GlusterFS storage domain to work with multiple
CPU types?</span><o:p
</o:p></p>
</div
</div
</blockquote
<div
<p
class=3D"MsoNormal"><o:p> </o:p></p
</div
<div
<p
class=3D"MsoNormal">Sahina?<o:p
</o:p></p>
</div
<div
<p
class=3D"MsoNormal"> <o:p
</o:p></p>
</div
<blockquote style=3D"border:none;border-left:solid #CCCCCC
1.0pt;padding:0i=
n 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in"
<div
<div
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><span
style=3D"font-size:11.0pt;font-family:"Calibri",sa=
ns-serif">The two dedicated GlusterFS storage servers are AMD Opteron. And =
the third server for the replica 3, which I am hoping
I can also use as an oVirt host is a new Intel Xeon (Dell PE R830). I know=
GlusterFS allows for mixed hardware, but I=92m not sure about when oVirt m=
anages GlusterFS, if mixed hardware and mixed use has been accounted for?</=
span><o:p
</o:p></p>
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><a
name=3D"m_-3878724381547807496__MailEndCompose"><span style=3D"=
font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><=
/a><o:p
</o:p></p>
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><b><span
style=3D"font-size:11.0pt;font-family:"Calibri"=
,sans-serif">From:</span></b><span
style=3D"font-size:11.0pt;font-family:&q=
uot;Calibri",sans-serif"> Simone Tiraboschi [mailto:<a
href=3D"mailto:=
stirabos(a)redhat.com" target=3D"_blank">stirabos(a)redhat.com</a>]
<br
<b>Sent:</b> Wednesday, May 31, 2017 8:41
AM<br
<b>To:</b> Langley,
Robert <<a href=3D"mailto:Robert.Langley@ventura.org=
"
target=3D"_blank">Robert.Langley(a)ventura.org</a>&gt;<br
<b>Cc:</b> Sandro Bonazzola <<a
href=3D"mailto:sbonazzo@redhat.com" targ=
et=3D"_blank">sbonazzo(a)redhat.com</a>&gt;; Nir Soffer <<a
href=3D"mailto=
:nsoffer@redhat.com"
target=3D"_blank">nsoffer(a)redhat.com</a>&gt;; Allon Mu=
reinik <<a href=3D"mailto:amureini@redhat.com"
target=3D"_blank">amurein=
i(a)redhat.com</a>&gt;;
Tal Nisan <<a href=3D"mailto:tnisan@redhat.com"
target=3D"_blank">tnisa=
n(a)redhat.com</a>&gt;; users <<a
href=3D"mailto:users@ovirt.org" target=
=3D"_blank">users@ovirt.org</a>></span><o:p
</o:p></p>
<div
<div
<p
class=3D"MsoNormal"><br
<b>Subject:</b> Re: [ovirt-users] Hosted-Engine Deploy - Error Creating
a S=
torage Domain<o:p
</o:p></p>
</div
</div
<div
<div
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">It seams something related to IOProcess connection.<o:p
</o:p></p>
<div
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
<div
<div
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">2017-05-25 20:54:40,362-0700 INFO (jsonrpc/4) [IOProcessClie=
nt] Starting client ioprocess-3 (__init__:330)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">2017-05-25 20:54:40,370-0700 INFO (ioprocess/31239) [IOProce=
ss] Starting ioprocess (__init__:452)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">2017-05-25 20:54:40,407-0700 ERROR (jsonrpc/4) [storage.TaskManage=
r.Task] (Task=3D'89dd17d2-8a38-4825-9ba2-f231f1aff9f5') Unexpected error (t=
ask:870)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">Traceback (most recent call last):<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File "/usr/share/vdsm/storage/task.py", line
877,=
in _run<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> return fn(*args, **kargs)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File
"/usr/lib/python2.7/site-packages/vdsm/logUtils.p=
y", line 52, in wrapper<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> res =3D f(*args, **kwargs)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File "/usr/share/vdsm/storage/hsm.py", line
2581,=
in createStorageDomain<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> storageType, domVersion)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File "/usr/share/vdsm/storage/nfsSD.py",
line 87,=
in create<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> remotePath, storageType, version)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File "/usr/share/vdsm/storage/fileSD.py",
line 42=
1, in _prepareMetadata<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> procPool.fileUtils.createdir(metadataDir,
0o775)<o:p=
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File
"/usr/lib/python2.7/site-packages/vdsm/storage/ou=
tOfProcess.py", line 166, in createdir<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> self._iop.mkdir(tmpPath, mode)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File
"/usr/lib/python2.7/site-packages/ioprocess/__ini=
t__.py", line 524, in mkdir<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> self.timeout)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File
"/usr/lib/python2.7/site-packages/ioprocess/__ini=
t__.py", line 466, in _sendCommand<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> raise OSError(errcode, errstr)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">OSError: [Errno 61] No data available<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">2017-05-25 20:54:40,409-0700 INFO (jsonrpc/4) [storage.TaskM=
anager.Task] (Task=3D'89dd17d2-8a38-4825-9ba2-f231f1aff9f5') aborting: Task=
is aborted: u'[Errno 61] No data available'
- code 100 (task:1175)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">2017-05-25 20:54:40,409-0700 ERROR (jsonrpc/4) [storage.Dispatcher=
] [Errno 61] No data available (dispatcher:80)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">Traceback (most recent call last):<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File
"/usr/share/vdsm/storage/dispatcher.py", lin=
e 72, in wrapper<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> result =3D ctask.prepare(func, *args,
**kwargs)<o:p>=
</o:p></p
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File "/usr/share/vdsm/storage/task.py", line
105,=
in wrapper<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> return m(self, *a, **kw)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File "/usr/share/vdsm/storage/task.py", line
1183=
, in prepare<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> raise self.error<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">OSError: [Errno 61] No data available<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">2017-05-25 20:54:40,410-0700 INFO (jsonrpc/4) [jsonrpc.JsonR=
pcServer] RPC call StorageDomain.create failed (error 351) in 0.24 seconds =
(__init__:533)<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">Nir, any hint?<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">On Wed, May 31, 2017 at 5:24 PM, Langley, Robert <<a
href=3D"ma=
ilto:Robert.Langley@ventura.org"
target=3D"_blank">Robert.Langley(a)ventura.o=
rg</a>> wrote:<o:p
</o:p></p>
<blockquote
style=3D"border:none;border-left:solid #CCCCCC 1.0pt;padding:0i=
n 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-=
bottom:5.0pt"
<div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><span
style=3D"font-size:11.0pt;font-family:"Calibri",sa=
ns-serif">SOSReport attached, with md5. Thank you</span><o:p
</o:p></p>
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><span
style=3D"font-size:11.0pt;font-family:"Calibri",sa=
ns-serif"> </span><o:p
</o:p></p>
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><a
name=3D"m_-3878724381547807496_m_495014787910235"><span style=
=3D"font-size:11.0pt;font-family:"Calibri",sans-serif"> </sp=
an></a><o:p
</o:p></p>
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><b><span
style=3D"font-size:11.0pt;font-family:"Calibri"=
,sans-serif">From:</span></b><span
style=3D"font-size:11.0pt;font-family:&q=
uot;Calibri",sans-serif"> Sandro Bonazzola [mailto:<a
href=3D"mailto:s=
bonazzo(a)redhat.com" target=3D"_blank">sbonazzo(a)redhat.com</a>]
<br
<b>Sent:</b> Wednesday, May 31, 2017 12:00
AM<br
<b>To:</b> Langley,
Robert <<a href=3D"mailto:Robert.Langley@ventura.org=
" target=3D"_blank">Robert.Langley(a)ventura.org</a>&gt;; Nir
Soffer <<a h=
ref=3D"mailto:nsoffer@redhat.com"
target=3D"_blank">nsoffer(a)redhat.com</a>&=
gt;; Allon Mureinik <<a href=3D"mailto:amureini@redhat.com"
target=3D"_b=
lank">amureini(a)redhat.com</a>&gt;;
Tal Nisan <<a href=3D"mailto:tnisan@redhat.com"
target=3D"_blank">tnisa=
n(a)redhat.com</a>&gt;; Simone Tiraboschi <<a
href=3D"mailto:stirabos@redh=
at.com"
target=3D"_blank">stirabos(a)redhat.com</a>&gt;<br
<b>Cc:</b> users <<a
href=3D"mailto:users@ovirt.org" target=3D"_blank">u=
sers(a)ovirt.org</a>&gt;<br
<b>Subject:</b> Re: [ovirt-users] Hosted-Engine Deploy - Error Creating
a S=
torage Domain</span><o:p
</o:p></p>
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">On Tue, May 30, 2017 at 11:50 PM, Langley, Robert <<a
href=3D"m=
ailto:Robert.Langley@ventura.org"
target=3D"_blank">Robert.Langley(a)ventura.=
org</a>> wrote:<o:p
</o:p></p>
<blockquote
style=3D"border:none;border-left:solid #CCCCCC 1.0pt;padding:0i=
n 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-=
bottom:5.0pt"
<div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><span
style=3D"font-size:11.0pt;font-family:"Calibri",sa=
ns-serif">While going through the hosted engine deployment, I am not able t=
o have it successfully complete. Even going through
the setup log, I=92m not able to identify what is wrong. Why it thinks the=
system is not reliable.</span><o:p
</o:p></p>
</div
</div
</blockquote
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
<div
<div
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">Traceback (most recent call last):<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File
"/usr/lib/python2.7/site-packages/otopi/context.p=
y", line 132, in _executeMethod<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> method['method']()<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File
"/usr/share/ovirt-hosted-engine-setup/scripts/../=
plugins/gr-he-setup/storage/storage.py", line 957, in
_misc<o:p></o:p>=
</p
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> self._createStorageDomain()<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> File
"/usr/share/ovirt-hosted-engine-setup/scripts/../=
plugins/gr-he-setup/storage/storage.py", line 546, in _createStorageDo=
main<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> raise
RuntimeError(status['status']['message'])<o:p>=
</o:p></p
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">RuntimeError: Error creating a storage domain: (u'storageType=3D7,=
sdUUID=3Da2494209-f823-4745-8eea-a122889d48f6, domainName=3Dhosted_storage=
, domClass=3D1, typeSpecificArg=3Dgsa-stor1.stor.local:/engine
domVersion=3D3',)<o:p
</o:p></p>
</div
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">Can you please provide vdsm logs or better a full sos report (sosr=
eport -a)?<o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
<blockquote style=3D"border:none;border-left:solid
#CCCCCC 1.0pt;padding:0i=
n 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-=
bottom:5.0pt"
<div
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><span
style=3D"font-size:11.0pt;font-family:"Calibri",sa=
ns-serif"> </span><o:p
</o:p></p>
</div
</div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;margin-bottom:12.0p=
t"><br
_______________________________________________<br
Users
mailing list<br
<a
href=3D"mailto:Users@ovirt.org"
target=3D"_blank">Users(a)ovirt.org</a><br=
<a
href=3D"http://lists.ovirt.org/mailman/listinfo/users"
target=3D"_blank"=
>http://lists.ovirt.org/mailman/listinfo/users</a><o:p
</o:p></p>
</blockquote
</div
<p
class=3D"MsoNormal" style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><br
<br clear=3D"all"
<o:p
</o:p></p>
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto">--
<o:p
</o:p></p>
<div
<div
<div
<div
<div
<div
<div
<p
style=3D"margin:0in;margin-bottom:.0001pt"><b><span
style=3D"font-size:1=
0.5pt;font-family:"Arial",sans-serif;color:black;text-transform:u=
ppercase">SANDRO BONAZZOLA</span></b><o:p
</o:p></p>
<p
style=3D"margin-bottom:3.0pt"><span
style=3D"font-size:7.5pt;font-family=
:"Arial",sans-serif;color:black;text-transform:uppercase">ASSOCIA=
TE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D</span><o:=
p
</o:p></p>
<p
style=3D"margin:0in;margin-bottom:.0001pt"><span
style=3D"font-size:7.5p=
t;font-family:"Arial",sans-serif;color:#999999"><a
href=3D"https:=
//www.redhat.com/" target=3D"_blank"><span
style=3D"color:#0088CE">Red Hat&=
nbsp;EMEA</span></a></span><o:p
</o:p></p>
<table
class=3D"MsoNormalTable" border=3D"0" cellspacing=3D"3"
cellpadding=
=3D"0"
<tbody
<tr
<td style=3D"padding:.75pt
.75pt .75pt .75pt"
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><span
style=3D"font-size:13.5pt;font-family:"Arial",sans=
-serif;color:black"><a href=3D"https://red.ht/sig"
target=3D"_blank"><span =
style=3D"border:solid windowtext
1.0pt;padding:0in;text-decoration:none"><i=
mg border=3D"0" width=3D"90" height=3D"90"
style=3D"width:.9416in;height:.9=
416in" id=3D"m_-3878724381547807496gmail-m_4950147879102358971_x005f_x0000_=
i1025" alt=3D"Image removed by sender."
src=3D"cid:image001.jpg@01D2DE1C.71=
C21100"></span></a></span><o:p
</o:p></p>
</td
<td
style=3D"padding:.75pt .75pt .75pt .75pt"
<div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"><span
style=3D"font-size:7.5pt;font-family:"Arial",sans-=
serif;color:black"><a
href=3D"https://redhat.com/trusted"
target=3D"_blank"=
<b><span style=3D"color:#CC0000">TRIED. TESTED.
TRUSTED.</span></b></a></s=
pan><o:p
</o:p></p>
</div
</td
</tr
</tbody
</table
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
</div
</div
</div
</div
</div
</div
</div
</div
</div
</div
</blockquote
</div
<p class=3D"MsoNormal"
style=3D"mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto"> <o:p
</o:p></p>
</div
</div
</div
</div
</div
</div
</div
</blockquote
</div
<p
class=3D"MsoNormal"><br
<br
clear=3D"all"
<o:p
</o:p></p>
<div
<p
class=3D"MsoNormal"><o:p> </o:p></p
</div
<p
class=3D"MsoNormal">-- <o:p
</o:p></p>
<div
<div
<div
<div
<div
<div
<div
<p
style=3D"margin:0in;margin-bottom:.0001pt"><b><span
style=3D"font-size:1=
0.5pt;font-family:"Arial",sans-serif;color:black;text-transform:u=
ppercase">SANDRO BONAZZOLA<o:p></o:p></span></b></p
<p
style=3D"mso-margin-top-alt:0in;margin-right:0in;margin-bottom:3.0pt;mar=
gin-left:0in"
<span
style=3D"font-size:7.5pt;font-family:"Arial",sans-serif;col=
or:black;text-transform:uppercase">ASSOCIATE MANAGER, SOFTWARE ENGINEERING,=
EMEA ENG VIRTUALIZATION R&D<o:p></o:p></span></p
<p
style=3D"margin:0in;margin-bottom:.0001pt"><span
style=3D"font-size:7.5p=
t;font-family:"Arial",sans-serif;color:#999999"><a
href=3D"https:=
//www.redhat.com/" target=3D"_blank"><span
style=3D"color:#0088CE">Red Hat&=
nbsp;EMEA</span></a><o:p></o:p></span></p
<table class=3D"MsoNormalTable"
border=3D"0" cellspacing=3D"3" cellpadding=
=3D"0"
<tbody
<tr
<td style=3D"padding:.75pt
.75pt .75pt .75pt"
<p
class=3D"MsoNormal"><span
style=3D"font-size:13.5pt;font-family:"Ar=
ial",sans-serif;color:black"><a href=3D"https://red.ht/sig"
target=3D"=
_blank"><span style=3D"text-decoration:none"><img
border=3D"0" width=3D"90"=
style=3D"width:.9416in" id=3D"_x0000_i1026"
src=3D"https://www.redhat.com/=
profiles/rh/themes/redhatdotcom/img/logo-red-hat-black.png"></span></a><o:p=
></o:p></span></p
</td
<td style=3D"padding:.75pt
.75pt .75pt .75pt"
<div
<p
class=3D"MsoNormal"><span
style=3D"font-size:7.5pt;font-family:"Ari=
al",sans-serif;color:black"><a
href=3D"https://redhat.com/trusted" tar=
get=3D"_blank"><b><span style=3D"color:#CC0000">TRIED.
TESTED. TRUSTED.</sp=
an></b></a><o:p></o:p></span></p
</div
</td
</tr
</tbody
</table
<p
class=3D"MsoNormal"><o:p> </o:p></p
</div
</div
</div
</div
</div
</div
</div
</div
</div
</div
</div
</body
</html
--_000_MWHPR09MB1421C61F4ECC6928C57E614787CB0MWHPR09MB1421namp_--
--_004_MWHPR09MB1421C61F4ECC6928C57E614787CB0MWHPR09MB1421namp_
Content-Type: image/jpeg; name="image001.jpg"
Content-Description: image001.jpg
Content-Disposition: inline; filename="image001.jpg"; size=500;
creation-date="Tue, 06 Jun 2017 00:16:50 GMT";
modification-date="Tue, 06 Jun 2017 00:16:51 GMT"
Content-ID: <image001.jpg(a)01D2DE1C.71C21100
Content-Transfer-Encoding: base64
/9j/4AAQSkZJRgABAQEAeAB4AAD/2wBDAAoHBwkHBgoJCAkLCwoMDxkQDw4ODx4WFxIZJCAmJSMg
IyIoLTkwKCo2KyIjMkQyNjs9QEBAJjBGS0U+Sjk/QD3/wAALCABxAHEBAREA/8QAHwAAAQUBAQEB
AQEAAAAAAAAAAAECAwQFBgcICQoL/8QAtRAAAgEDAwIEAwUFBAQAAAF9AQIDAAQRBRIhMUEGE1Fh
ByJxFDKBkaEII0KxwRVS0fAkM2JyggkKFhcYGRolJicoKSo0NTY3ODk6Q0RFRkdISUpTVFVWV1hZ
WmNkZWZnaGlqc3R1dnd4eXqDhIWGh4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5usLDxMXG
x8jJytLT1NXW19jZ2uHi4+Tl5ufo6erx8vP09fb3+Pn6/9oACAEBAAA/APZqKKKKKKKKKKKKKKKK
KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKK
KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKK
KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKK/9k=
--_004_MWHPR09MB1421C61F4ECC6928C57E614787CB0MWHPR09MB1421namp_--