1:38 a.m.
--_f31905e4-ea0b-4151-8ac2-28be84666cee_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Hi all=2C
while attempting a from-scratch self-hosted-engine installation on CentOS 6=
.5 (also freshly reinstalled from scratch) on a physical node (oVirt 3.4.0_=
pre + GlusterFS 3.5.0beta4=3B NFS storage for engine VM)=2C the process fai=
ls almost immediately with:
[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/ovhe-s=
etup-answers.conf
[ INFO ] Stage: Initializing
Continuing will configure this host for serving as hypervisor and=
create a VM where you have to install oVirt Engine afterwards.
Are you sure you want to continue? (Yes=2C No)[Yes]:
[ INFO ] Generating a temporary VNC password.
[ INFO ] Stage: Environment setup
Configuration files: ['/root/ovhe-setup-answers.conf']
Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-=
setup-20140313010526.log
Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)
[ INFO ] Hardware supports virtualization
[ INFO ] Bridge ovirtmgmt already created
[ INFO ] Stage: Environment packages setup
[ INFO ] Stage: Programs detection
[ INFO ] Stage: Environment setup
[ INFO ] Generating VDSM certificates
[ ERROR ] Failed to execute stage 'Environment setup': [Errno 2] No such fi=
le or directory: '/etc/pki/libvirt/clientcert.pem'
[ INFO ] Stage: Clean up
[ INFO ] Stage: Pre-termination
[ INFO ] Stage: Termination
The /root/ovhe-setup-answers.conf has been saved from a previous installati=
on (before reinstalling) and only minimally edited (removed some lines with=
UUIDs etc.).
The /etc/pki/libvirt dir is completely missing on both nodes=3B last time I=
tried the whole setup I do not recall of having such problems=2C but maybe=
something was different then.
The generated /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-=
20140313010526.log has been saved as:
http://pastebin.com/ezAJETBN
I hope to be able to progress further to test the whole 2-nodes setup (seco=
nd node freshly reinstalled too and already up with GlusterFS and waiting t=
o be added to oVirt cluster) and datacenter configuration.
Many thanks in advance for any suggestions/help=2C
Giuseppe
=
--_f31905e4-ea0b-4151-8ac2-28be84666cee_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<style><!--
.hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 12pt=3B
font-family:Calibri
}
--></style></head>
<body class=3D'hmmessage'><div dir=3D'ltr'>Hi
all=2C<br>while attempting a =
from-scratch self-hosted-engine installation on CentOS 6.5 (also freshly re=
installed from scratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5=
.0beta4=3B NFS storage for engine VM)=2C the process fails almost immediate=
ly with:<br><br>[root@cluster1 ~]# ovirt-hosted-engine-setup --config-appen=
d=3D/root/ovhe-setup-answers.conf<br>[ INFO =3B ] Stage: Initializing<b=
r> =3B =3B =3B =3B =3B =3B =3B =3B =3B
=
Continuing will configure this host for serving as hypervisor and create a =
VM where you have to install oVirt Engine
afterwards.<br> =3B =3B&n=
bsp=3B =3B =3B =3B =3B =3B =3B Are you
sure you wan=
t to continue? (Yes=2C No)[Yes]:<br>[ INFO =3B ] Generating a temporary=
VNC password.<br>[ INFO =3B ] Stage: Environment
setup<br> =3B&nbs=
p=3B =3B =3B =3B =3B =3B =3B =3B
Configuration =
files:
['/root/ovhe-setup-answers.conf']<br> =3B =3B =3B =
=3B =3B =3B =3B =3B =3B Log file:
/var/log/ovirt-hosted=
-engine-setup/ovirt-hosted-engine-setup-20140313010526.log<br> =3B =
=3B =3B =3B =3B =3B =3B =3B =3B
Version: otopi-=
1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)<br>[ INFO =3B ] Hardware supports v=
irtualization<br>[ INFO =3B ] Bridge ovirtmgmt already created<br>[
INF=
O =3B ] Stage: Environment packages setup<br>[ INFO =3B ] Stage:
Pr=
ograms detection<br>[ INFO =3B ] Stage: Environment setup<br>[
INFO&nbs=
p=3B ] Generating VDSM certificates<br>[ ERROR ] Failed to execute stage 'E=
nvironment setup': [Errno 2] No such file or directory: '/etc/pki/libvirt/c=
lientcert.pem'<br>[ INFO =3B ] Stage: Clean up<br>[
INFO =3B ] Stag=
e: Pre-termination<br>[ INFO =3B ] Stage: Termination<br><br>The
/root/=
ovhe-setup-answers.conf has been saved from a previous installation (before=
reinstalling) and only minimally edited (removed some lines with UUIDs etc=
.).<br><br>The /etc/pki/libvirt dir is completely missing on both nodes=3B =
last time I tried the whole setup I do not recall of having such problems=
=2C but maybe something was different then.<br><br>The generated /var/log/o=
virt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log has b=
een saved as:<br><br>http://pastebin.com/ezAJETBN<br><br>I hope to
be able =
to progress further to test the whole 2-nodes setup (second node freshly re=
installed too and already up with GlusterFS and waiting to be added to oVir=
t cluster) and datacenter configuration.<br><br>Many thanks in advance for =
any suggestions/help=2C<br>Giuseppe<br><br>
</div></body>
</html>=
--_f31905e4-ea0b-4151-8ac2-28be84666cee_--
7:46 a.m.
------=_Part_19485849_1756403293.1394693210709
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
From: "Giuseppe Ragusa"
<giuseppe.ragusa(a)hotmail.com>
To: users(a)ovirt.org
Sent: Thursday, March 13, 2014 2:38:42 AM
Subject: [Users] Self-hosted-engine setup error
Hi all,
while attempting a from-scratch self-hosted-engine installation on CentOS 6.5
(also freshly reinstalled from scratch) on a physical node (oVirt 3.4.0_pre
+ GlusterFS 3.5.0beta4; NFS storage for engine VM), the process fails almost
immediately with:
[root@cluster1 ~]# ovirt-hosted-engine-setup
--config-append=/root/ovhe-setup-answers.conf
[ INFO ] Stage: Initializing
Continuing will configure this host for serving as hypervisor and create a VM
where you have to install oVirt Engine afterwards.
Are you sure you want to continue? (Yes, No)[Yes]:
[ INFO ] Generating a temporary VNC password.
[ INFO ] Stage: Environment setup
Configuration files: ['/root/ovhe-setup-answers.conf']
Log file:
/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log
Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)
[ INFO ] Hardware supports virtualization
[ INFO ] Bridge ovirtmgmt already created
[ INFO ] Stage: Environment packages setup
[ INFO ] Stage: Programs detection
[ INFO ] Stage: Environment setup
[ INFO ] Generating VDSM certificates
[ ERROR ] Failed to execute stage 'Environment setup': [Errno 2] No such file
or directory: '/etc/pki/libvirt/clientcert.pem'
I already got another such report yesterday - seems like a bug in the fix for
https://bugzilla.redhat.com/show_bug.cgi?id=1034634 .
I hope to push a fix later today.
[ INFO ] Stage: Clean up
[ INFO ] Stage: Pre-termination
[ INFO ] Stage: Termination
The /root/ovhe-setup-answers.conf has been saved from a previous
installation
(before reinstalling) and only minimally edited (removed some lines with
UUIDs etc.).
The /etc/pki/libvirt dir is completely missing on both nodes; last
time I
tried the whole setup I do not recall of having such problems, but maybe
something was different then.
The generated
/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log
has been saved as:
I hope to be able to progress further to test the whole 2-nodes setup
(second
node freshly reinstalled too and already up with GlusterFS and waiting to be
added to oVirt cluster) and datacenter configuration.
Many thanks in advance for any suggestions/help,
For now, you can simply:
mkdir /etc/pki/libvirt
This should be enough.
Thanks for the report!
--
Didi
------=_Part_19485849_1756403293.1394693210709
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable
<html><body><div style=3D"font-family: times new roman, new york,
times, se=
rif; font-size: 12pt; color: #000000"><div></div><blockquote
style=3D"borde=
r-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-w=
eight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,A=
rial,sans-serif;font-size:12pt;" data-mce-style=3D"border-left: 2px solid #=
1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: norm=
al; font-style: normal; text-decoration: none; font-family: Helvetica,Arial=
,sans-serif; font-size: 12pt;"><b>From: </b>"Giuseppe
Ragusa" <giuseppe.=
ragusa(a)hotmail.com&gt;<br><b>To:
</b>users(a)ovirt.org<br><b>Sent: </b>Thursd=
ay, March 13, 2014 2:38:42 AM<br><b>Subject: </b>[Users]
Self-hosted-engine=
setup error<br><div><br></div><style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 12pt;
font-family:Calibri
}
--></style><div dir=3D"ltr">Hi all,<br>while attempting a
from-scratch self=
-hosted-engine installation on CentOS 6.5 (also freshly reinstalled from sc=
ratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4; NFS stor=
age for engine VM), the process fails almost immediately
with:<br><div><br>=
</div>[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/=
ovhe-setup-answers.conf<br>[ INFO ] Stage:
Initializing<br> &nbs=
p; Continuing will
configure this=
host for serving as hypervisor and create a VM where you have to install o=
Virt Engine
afterwards.<br> =
Are you sure you want to continue? (Yes, No)[Yes]:<br>[ INFO
]=
Generating a temporary VNC password.<br>[ INFO ] Stage: Environment =
setup<br>
Configurati=
on files:
['/root/ovhe-setup-answers.conf']<br> &nbs=
p; Log file:
/var/log/ovirt-hosted-engine-setup/ovi=
rt-hosted-engine-setup-20140313010526.log<br> =
Version: otopi-1.2.0_rc3
(otopi-1.2.0-0.9.rc3.el6)=
<br>[ INFO ] Hardware supports virtualization<br>[ INFO ]
Bridg=
e ovirtmgmt already created<br>[ INFO ] Stage: Environment packages s=
etup<br>[ INFO ] Stage: Programs detection<br>[ INFO ]
Stage: E=
nvironment setup<br>[ INFO ] Generating VDSM certificates<br>[ ERROR
=
] Failed to execute stage 'Environment setup': [Errno 2] No such file or di=
rectory:
'/etc/pki/libvirt/clientcert.pem'</div></blockquote><div><br></div=
<div>I already got another such report yesterday - seems like a
bug in the=
fix for <a
href=3D"https://bugzilla.redhat.com/show_bug.cgi?id=3D1034=
634" data-mce-href=3D"https://bugzilla.redhat.com/show_bug.cgi?id=3D1034634=
">https://bugzilla.redhat.com/show_bug.cgi?id=3D1034634</a> .</div><di=
v>I hope to push a fix later
today.</div><div><br></div><blockquote style=
=3D"border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#0=
00;font-weight:normal;font-style:normal;text-decoration:none;font-family:He=
lvetica,Arial,sans-serif;font-size:12pt;" data-mce-style=3D"border-left: 2p=
x solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-wei=
ght: normal; font-style: normal; text-decoration: none; font-family: Helvet=
ica,Arial,sans-serif; font-size: 12pt;"><div
dir=3D"ltr"><br>[ INFO ]=
Stage: Clean up<br>[ INFO ] Stage: Pre-termination<br>[
INFO ]=
Stage: Termination<br><div><br></div>The
/root/ovhe-setup-answers.conf has=
been saved from a previous installation (before reinstalling) and only min=
imally edited (removed some lines with UUIDs
etc.).<br><div><br></div>The /=
etc/pki/libvirt dir is completely missing on both nodes; last time I tried =
the whole setup I do not recall of having such problems, but maybe somethin=
g was different then.<br><div><br></div>The generated
/var/log/ovirt-hosted=
-engine-setup/ovirt-hosted-engine-setup-20140313010526.log has been saved a=
s:<br><div><br></div>http://pastebin.com/ezAJETBN...
hope =
to be able to progress further to test the whole 2-nodes setup (second node=
freshly reinstalled too and already up with GlusterFS and waiting to be ad=
ded to oVirt cluster) and datacenter
configuration.<br><div><br></div>Many =
thanks in advance for any
suggestions/help,</div></blockquote><div><br></di=
v><div>For now, you can simply:</div><div>mkdir <span
style=3D"font-fa=
mily: Helvetica, Arial, sans-serif;" data-mce-style=3D"font-family: Helveti=
ca, Arial,
sans-serif;">/etc/pki/libvirt</span></div><div><br></div><div>Th=
is should be enough.</div><div><br></div><div>Thanks for the
report!</div><=
div>-- <br></div><div><span
name=3D"x"></span>Didi<br><span
name=3D"x"></sp=
an><br></div></div></body></html>
------=_Part_19485849_1756403293.1394693210709--
1:15 a.m.
--_505c5a17-3726-4b19-9312-8472b03ce7cd_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Hi Didi=2C
Date: Thu=2C 13 Mar 2014 02:46:50 -0400
From: didi(a)redhat.com
To: giuseppe.ragusa(a)hotmail.com
CC: users(a)ovirt.org
Subject: Re: [Users] Self-hosted-engine setup error
From: "Giuseppe Ragusa" <giuseppe.ragusa(a)hotmail.com To: users(a)ovirt.org
Sent: Thursday=2C March 13=2C 2014 2:38:42 AM
Subject: [Users] Self-hosted-engine setup error
Hi all=2C
while attempting a from-scratch self-hosted-engine installation on CentOS 6=
.5 (also freshly reinstalled from scratch) on a physical node (oVirt 3.4.0_=
pre + GlusterFS 3.5.0beta4=3B NFS storage for engine VM)=2C the process fai=
ls almost immediately with:
[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/ovhe-s=
etup-answers.conf
[ INFO ] Stage: Initializing
Continuing will configure this host for serving as hypervisor and=
create a VM where you have to install oVirt Engine afterwards.
Are you sure you want to continue? (Yes=2C No)[Yes]:
[ INFO ] Generating a temporary VNC password.
[ INFO ] Stage: Environment setup
Configuration files: ['/root/ovhe-setup-answers.conf']
Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-=
setup-20140313010526.log
Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)
[ INFO ] Hardware supports virtualization
[ INFO ] Bridge ovirtmgmt already created
[ INFO ] Stage: Environment packages setup
[ INFO ] Stage: Programs detection
[ INFO ] Stage: Environment setup
[ INFO ] Generating VDSM certificates
[ ERROR ] Failed to execute stage 'Environment setup': [Errno 2] No such fi=
le or directory: '/etc/pki/libvirt/clientcert.pem'
I already got another such report yesterday - seems like a bug in the fix f=
or https://bugzilla.redhat.com/show_bug.cgi?id=3D1034634 .I hope to push a =
fix later today.
I look forward to have the fix pushed/merged in actual packages.
[ INFO ] Stage: Clean up
[ INFO ] Stage: Pre-termination
[ INFO ] Stage: Termination
The /root/ovhe-setup-answers.conf has been saved from a previous installati=
on (before reinstalling) and only minimally edited (removed some lines with=
UUIDs etc.).
The /etc/pki/libvirt dir is completely missing on both nodes=3B last time I=
tried the whole setup I do not recall of having such problems=2C but maybe=
something was different then.
The generated /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-=
20140313010526.log has been saved as:
http://pastebin.com/ezAJETBN
I hope to be able to progress further to test the whole 2-nodes setup (seco=
nd node freshly reinstalled too and already up with GlusterFS and waiting t=
o be added to oVirt cluster) and datacenter configuration.
Many thanks in advance for any suggestions/help=2C
For now=2C you can simply:mkdir /etc/pki/libvirt
This should be enough.
The workaround works: the self-hosted-engine installation proceeds now.
Thanks for the report!--=20
Didi
Many thanks for your kind and prompt assistance=2C
Giuseppe
=
--_505c5a17-3726-4b19-9312-8472b03ce7cd_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html <head <style><!--
.hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 12pt=3B
font-family:Calibri
}
--></style></head <body
class=3D'hmmessage'><div dir=3D'ltr'>Hi
Didi=2C<br><br><div><hr id=3D=
"stopSpelling">Date: Thu=2C 13 Mar 2014 02:46:50 -0400<br>From:
didi@redhat=
.com<br>To: giuseppe.ragusa(a)hotmail.com<br>CC:
users(a)ovirt.org<br>Subject: =
Re: [Users] Self-hosted-engine setup error<br><br><div
style=3D"font-family=
:times new roman=2C new york=2C times=2C serif=3Bfont-size:12pt=3Bcolor:#00=
0000=3B"><div></div><blockquote style=3D"border-left:2px solid
#1010FF=3Bpa=
dding-left:5px=3Bcolor:#000=3Bfont-weight:normal=3Bfont-style:normal=3Btext=
-decoration:none=3Bfont-family:Helvetica=2CArial=2Csans-serif=3Bfont-size:1=
2pt=3B" data-mce-style=3D"border-left: 2px solid #1010FF=3B margin-left: 5p=
x=3B padding-left: 5px=3B color: #000=3B font-weight: normal=3B font-style:=
normal=3B text-decoration: none=3B font-family: Helvetica=2CArial=2Csans-s=
erif=3B font-size: 12pt=3B"><b>From: </b>"Giuseppe Ragusa"
<=3Bgiuseppe.r=
agusa(a)hotmail.com&gt=3B<br><b>To:
</b>users(a)ovirt.org<br><b>Sent: </b>Thurs=
day=2C March 13=2C 2014 2:38:42 AM<br><b>Subject: </b>[Users]
Self-hosted-e=
ngine setup error<br><div><br></div><style><!--=0A=
.ExternalClass .ecxhmmessage P {=0A=
padding:0px=3B=0A=
}=0A=
=0A=
.ExternalClass body.ecxhmmessage {=0A=
font-size:12pt=3B=0A=
font-family:Calibri=3B=0A=
}=0A=
=0A=
--></style><div dir=3D"ltr">Hi all=2C<br>while attempting a
from-scratch se=
lf-hosted-engine installation on CentOS 6.5 (also freshly reinstalled from =
scratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4=3B NFS =
storage for engine VM)=2C the process fails almost immediately with:<br><di=
v><br></div>[root@cluster1 ~]# ovirt-hosted-engine-setup
--config-append=3D=
/root/ovhe-setup-answers.conf<br>[ INFO =3B ] Stage:
Initializing<br>&n=
bsp=3B =3B =3B =3B =3B =3B =3B =3B =3B
Cont=
inuing will configure this host for serving as hypervisor and create a VM w=
here you have to install oVirt Engine
afterwards.<br> =3B =3B =
=3B =3B =3B =3B =3B =3B =3B Are you sure
you want t=
o continue? (Yes=2C No)[Yes]:<br>[ INFO =3B ] Generating a temporary VN=
C password.<br>[ INFO =3B ] Stage: Environment
setup<br> =3B =
=3B =3B =3B =3B =3B =3B =3B =3B
Configuration f=
iles:
['/root/ovhe-setup-answers.conf']<br> =3B =3B =3B =3B=
 =3B =3B =3B =3B =3B Log file:
/var/log/ovirt-hosted-en=
gine-setup/ovirt-hosted-engine-setup-20140313010526.log<br> =3B =3B=
 =3B =3B =3B =3B =3B =3B =3B
Version: otopi-1.2=
.0_rc3 (otopi-1.2.0-0.9.rc3.el6)<br>[ INFO =3B ] Hardware supports virt=
ualization<br>[ INFO =3B ] Bridge ovirtmgmt already created<br>[
INFO&n=
bsp=3B ] Stage: Environment packages setup<br>[ INFO =3B ] Stage: Progr=
ams detection<br>[ INFO =3B ] Stage: Environment setup<br>[
INFO =
=3B ] Generating VDSM certificates<br>[ ERROR ] Failed to execute stage 'En=
vironment setup': [Errno 2] No such file or directory: '/etc/pki/libvirt/cl=
ientcert.pem'</div></blockquote><div><br></div><div>I
already got another s=
uch report yesterday - seems like a bug in the fix for =3B<a href=3D"ht=
tps://bugzilla.redhat.com/show_bug.cgi?id=3D1034634" data-mce-href=3D"https=
://bugzilla.redhat.com/show_bug.cgi?id=3D1034634"
target=3D"_blank">https:/=
/bugzilla.redhat.com/show_bug.cgi?id=3D1034634</a> =3B.</div><div>I
hop=
e to push a fix later today.<br><br>I look forward to have the fix pushed/m=
erged in actual
packages.<br></div><div><br></div><blockquote
style=3D"bord=
er-left:2px solid #1010FF=3Bpadding-left:5px=3Bcolor:#000=3Bfont-weight:nor=
mal=3Bfont-style:normal=3Btext-decoration:none=3Bfont-family:Helvetica=2CAr=
ial=2Csans-serif=3Bfont-size:12pt=3B" data-mce-style=3D"border-left: 2px so=
lid #1010FF=3B margin-left: 5px=3B padding-left: 5px=3B color: #000=3B font=
-weight: normal=3B font-style: normal=3B text-decoration: none=3B font-fami=
ly: Helvetica=2CArial=2Csans-serif=3B font-size: 12pt=3B"><div
dir=3D"ltr">=
<br>[ INFO =3B ] Stage: Clean up<br>[ INFO =3B ] Stage:
Pre-termina=
tion<br>[ INFO =3B ] Stage:
Termination<br><div><br></div>The /root/ovh=
e-setup-answers.conf has been saved from a previous installation (before re=
installing) and only minimally edited (removed some lines with UUIDs etc.).=
<br><div><br></div>The /etc/pki/libvirt dir is completely missing
on both n=
odes=3B last time I tried the whole setup I do not recall of having such pr=
oblems=2C but maybe something was different
then.<br><div><br></div>The gen=
erated /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-2014031=
3010526.log has been saved
as:<br><div><br></div>http://pastebin.com/ezAJET=
BN<br><div><br></div>I hope to be able to progress further to test
the whol=
e 2-nodes setup (second node freshly reinstalled too and already up with Gl=
usterFS and waiting to be added to oVirt cluster) and datacenter configurat=
ion.<br><div><br></div>Many thanks in advance for any
suggestions/help=2C</=
div></blockquote><div><br></div><div>For now=2C you can
simply:</div><div>m=
kdir =3B<span style=3D"font-family:Helvetica=2C Arial=2C
sans-serif=3B"=
data-mce-style=3D"font-family: Helvetica=2C Arial=2C sans-serif=3B">/etc/p=
ki/libvirt</span></div><div><br></div><div>This should
be enough.<br><br>Th=
e workaround works: the self-hosted-engine installation proceeds now.<br></=
div><div><br></div><div>Thanks for the
report!</div><div>-- <br></div><div>=
<span></span>Didi<br><span></span><br>Many thanks for
your kind and prompt =
assistance=2C<br>Giuseppe<br><br></div></div></div>
</div></body=
</html>=
--_505c5a17-3726-4b19-9312-8472b03ce7cd_--
10:14 a.m.
------=_Part_269393_882485354.1394961279967
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
From: "Giuseppe Ragusa"
<giuseppe.ragusa(a)hotmail.com>
To: "Yedidyah Bar David" <didi(a)redhat.com>
Cc: users(a)ovirt.org
Sent: Saturday, March 15, 2014 2:15:18 AM
Subject: RE: [Users] Self-hosted-engine setup error
Hi Didi,
Date: Thu, 13 Mar 2014 02:46:50 -0400
From: didi(a)redhat.com
To: giuseppe.ragusa(a)hotmail.com
CC: users(a)ovirt.org
Subject: Re: [Users] Self-hosted-engine setup error
> From: "Giuseppe Ragusa"
<giuseppe.ragusa(a)hotmail.com>
> To: users(a)ovirt.org
> Sent: Thursday, March 13, 2014 2:38:42 AM
> Subject: [Users] Self-hosted-engine setup error
> Hi all,
> while attempting a from-scratch self-hosted-engine installation on CentOS
> 6.5
> (also freshly reinstalled from scratch) on a physical node (oVirt 3.4.0_pre
> + GlusterFS 3.5.0beta4; NFS storage for engine VM), the process fails
> almost
> immediately with:
> [root@cluster1 ~]# ovirt-hosted-engine-setup
> --config-append=/root/ovhe-setup-answers.conf
> [ INFO ] Stage: Initializing
> Continuing will configure this host for serving as hypervisor and create a
> VM
> where you have to install oVirt Engine afterwards.
> Are you sure you want to continue? (Yes, No)[Yes]:
> [ INFO ] Generating a temporary VNC password.
> [ INFO ] Stage: Environment setup
> Configuration files: ['/root/ovhe-setup-answers.conf']
> Log file:
> /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log
> Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)
> [ INFO ] Hardware supports virtualization
> [ INFO ] Bridge ovirtmgmt already created
> [ INFO ] Stage: Environment packages setup
> [ INFO ] Stage: Programs detection
> [ INFO ] Stage: Environment setup
> [ INFO ] Generating VDSM certificates
> [ ERROR ] Failed to execute stage 'Environment setup': [Errno 2] No such
> file
> or directory: '/etc/pki/libvirt/clientcert.pem'
I already got another such report yesterday - seems like a bug in the
fix for
https://bugzilla.redhat.com/show_bug.cgi?id=1034634 .
I hope to push a fix later today.
I look forward to have the fix pushed/merged in actual packages.
> [ INFO ] Stage: Clean up
> [ INFO ] Stage: Pre-termination
> [ INFO ] Stage: Termination
> The /root/ovhe-setup-answers.conf has been saved from a
previous
> installation
> (before reinstalling) and only minimally edited (removed some lines with
> UUIDs etc.).
> The /etc/pki/libvirt dir is completely missing on both nodes;
last time I
> tried the whole setup I do not recall of having such problems, but maybe
> something was different then.
> The generated
> /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log
> has been saved as:
> I hope to be able to progress further to test the whole 2-nodes
setup
> (second
> node freshly reinstalled too and already up with GlusterFS and waiting to
> be
> added to oVirt cluster) and datacenter configuration.
> Many thanks in advance for any suggestions/help,
For now, you can simply:
mkdir /etc/pki/libvirt
This should be enough.
The workaround works: the self-hosted-engine installation proceeds
now.
Thanks for the report!
--
Didi
Many thanks for your kind and prompt assistance,
Giuseppe
Thanks for the report. The workaround is probably not enough, depends on what you
are trying to do. 'mkdir /etc/pki/libvirt/private' is needed too. Without it, the
code that
copies there a key will create a file 'private' instead of copying it into a
directory 'private'.
Fix [1] was merged to all branches.
[1] http://gerrit.ovirt.org/25747
Best regards,
--
Didi
------=_Part_269393_882485354.1394961279967
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable
<html><body><div style=3D"font-family: times new roman, new york,
times, se=
rif; font-size: 12pt; color: #000000"><div></div><blockquote
style=3D"borde=
r-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-w=
eight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,A=
rial,sans-serif;font-size:12pt;"><b>From: </b>"Giuseppe
Ragusa" <giusepp=
e.ragusa(a)hotmail.com&gt;<br><b>To: </b>"Yedidyah Bar
David" <didi@redhat=
.com><br><b>Cc: </b>users(a)ovirt.org<br><b>Sent:
</b>Saturday, March 15, =
2014 2:15:18 AM<br><b>Subject: </b>RE: [Users] Self-hosted-engine setup
err=
or<br><div><br></div>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 12pt;
font-family:Calibri
}
--></style>
<div dir=3D"ltr">Hi
Didi,<br><div><br></div><div><hr
id=3D"stopSpelling">Da=
te: Thu, 13 Mar 2014 02:46:50 -0400<br>From: didi(a)redhat.com<br>To: giusepp=
e.ragusa(a)hotmail.com<br>CC: users(a)ovirt.org<br>Subject: Re: [Users] Self-ho=
sted-engine setup error<br><div><br></div><div
style=3D"font-family:times n=
ew roman, new york, times,
serif;font-size:12pt;color:#000000;"><div></div>=
<blockquote style=3D"border-left:2px solid #1010FF;padding-left:5px;color:#=
000;font-weight:normal;font-style:normal;text-decoration:none;font-family:H=
elvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Giuseppe
Ragusa" &=
lt;giuseppe.ragusa(a)hotmail.com&gt;<br><b>To:
</b>users(a)ovirt.org<br><b>Sent=
: </b>Thursday, March 13, 2014 2:38:42 AM<br><b>Subject:
</b>[Users] Self-h=
osted-engine setup error<br><div><br></div><style><!--
.ExternalClass .ecxhmmessage P {
padding:0px;
}
.ExternalClass body.ecxhmmessage {
font-size:12pt;
font-family:Calibri;
}
--></style><div dir=3D"ltr">Hi all,<br>while attempting a
from-scratch self=
-hosted-engine installation on CentOS 6.5 (also freshly reinstalled from sc=
ratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4; NFS stor=
age for engine VM), the process fails almost immediately
with:<br><div><br>=
</div>[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/=
ovhe-setup-answers.conf<br>[ INFO ] Stage:
Initializing<br> &nbs=
p; Continuing will
configure this=
host for serving as hypervisor and create a VM where you have to install o=
Virt Engine
afterwards.<br> =
Are you sure you want to continue? (Yes, No)[Yes]:<br>[ INFO
]=
Generating a temporary VNC password.<br>[ INFO ] Stage: Environment =
setup<br>
Configurati=
on files:
['/root/ovhe-setup-answers.conf']<br> &nbs=
p; Log file:
/var/log/ovirt-hosted-engine-setup/ovi=
rt-hosted-engine-setup-20140313010526.log<br> =
Version: otopi-1.2.0_rc3
(otopi-1.2.0-0.9.rc3.el6)=
<br>[ INFO ] Hardware supports virtualization<br>[ INFO ]
Bridg=
e ovirtmgmt already created<br>[ INFO ] Stage: Environment packages s=
etup<br>[ INFO ] Stage: Programs detection<br>[ INFO ]
Stage: E=
nvironment setup<br>[ INFO ] Generating VDSM certificates<br>[ ERROR
=
] Failed to execute stage 'Environment setup': [Errno 2] No such file or di=
rectory:
'/etc/pki/libvirt/clientcert.pem'</div></blockquote><div><br></div=
<div>I already got another such report yesterday - seems like a
bug in the=
fix for <a
href=3D"https://bugzilla.redhat.com/show_bug.cgi?id=3D1034=
634"
target=3D"_blank">https://bugzilla.redhat.com/show_bug.cgi?i...
4</a> .</div><div>I hope to push a fix later
today.<br><div><br></div>=
I look forward to have the fix pushed/merged in actual
packages.<br></div><=
div><br></div><blockquote style=3D"border-left:2px solid
#1010FF;padding-le=
ft:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none=
;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><div
dir=3D"ltr"><=
br>[ INFO ] Stage: Clean up<br>[ INFO ] Stage:
Pre-termination<=
br>[ INFO ] Stage: Termination<br><div><br></div>The
/root/ovhe-setup=
-answers.conf has been saved from a previous installation (before reinstall=
ing) and only minimally edited (removed some lines with UUIDs etc.).<br><di=
v><br></div>The /etc/pki/libvirt dir is completely missing on both nodes;
l=
ast time I tried the whole setup I do not recall of having such problems, b=
ut maybe something was different then.<br><div><br></div>The
generated /var=
/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log=
has been saved
as:<br><div><br></div>http://pastebin.com/ezAJETB...
<br></div>I hope to be able to progress further to test the whole 2-nodes s=
etup (second node freshly reinstalled too and already up with GlusterFS and=
waiting to be added to oVirt cluster) and datacenter configuration.<br><di=
v><br></div>Many thanks in advance for any
suggestions/help,</div></blockqu=
ote><div><br></div><div>For now, you can
simply:</div><div>mkdir <span=
style=3D"font-family:Helvetica, Arial,
sans-serif;">/etc/pki/libvirt</span=
</div><div><br></div><div>This should be
enough.<br><div><br></div>The wor=
karound works: the
self-hosted-engine installation proceeds now.<br></div><=
div><br></div><div>Thanks for the report!</div><div>--
<br></div><div><span=
</span>Didi<br><span></span><br>Many
thanks for your kind and prompt assis=
tance,<br>Giuseppe<br><div><br></div></div></div></div>
=09=09 =09 =09=09=
</div>
</blockquote><div><br>Thanks for the report. The workaround is probably
not=
enough, depends on what you</div><div>are trying to do. 'mkdir
/etc/pki/li=
bvirt/private' is needed too. Without it, the code that</div><div>copies
th=
ere a key will create a file 'private' instead of copying it into a directo=
ry 'private'.</div><div><br></div><div>Fix [1] was
merged to all branches.<=
/div><div><br></div><div>[1] <a
href=3D"http://gerrit.ovirt.org/25747"=
div><div><span style=3D"font-size:
12pt;">-- </span></div><div><span n=
ame=3D"x"></span>Didi<br><span
name=3D"x"></span><br></div></div></body></h=
tml>
------=_Part_269393_882485354.1394961279967--
3:14 p.m.
--_c189dc68-9b60-4630-aa76-ab3facfb40b4_
Content-Type: text/plain; charset="windows-1256"
Content-Transfer-Encoding: base64
DQpEYXRlOiBTdW4sIDE2IE1hciAyMDE0IDA1OjE0OjM5IC0wNDAwDQpGcm9tOiBkaWRpQHJlZGhh
dC5jb20NClRvOiBnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb20NCkNDOiB1c2Vyc0BvdmlydC5v
cmcNClN1YmplY3Q6IFJlOiBbVXNlcnNdIFNlbGYtaG9zdGVkLWVuZ2luZSBzZXR1cCBlcnJvcg0K
DQpGcm9tOiAiR2l1c2VwcGUgUmFndXNhIiA8Z2l1c2VwcGUucmFndXNhQGhvdG1haWwuY29tPg0K
VG86ICJZZWRpZHlhaCBCYXIgRGF2aWQiIDxkaWRpQHJlZGhhdC5jb20+DQpDYzogdXNlcnNAb3Zp
cnQub3JnDQpTZW50OiBTYXR1cmRheSwgTWFyY2ggMTUsIDIwMTQgMjoxNToxOCBBTQ0KU3ViamVj
dDogUkU6IFtVc2Vyc10gU2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGVycm9yDQoNCgoKCkhpIERp
ZGksDQoNCkRhdGU6IFRodSwgMTMgTWFyIDIwMTQgMDI6NDY6NTAgLTA0MDANCkZyb206IGRpZGlA
cmVkaGF0LmNvbQ0KVG86IGdpdXNlcHBlLnJhZ3VzYUBob3RtYWlsLmNvbQ0KQ0M6IHVzZXJzQG92
aXJ0Lm9yZw0KU3ViamVjdDogUmU6IFtVc2Vyc10gU2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGVy
cm9yDQoNCkZyb206ICJHaXVzZXBwZSBSYWd1c2EiIDxnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5j
b20+DQpUbzogdXNlcnNAb3ZpcnQub3JnDQpTZW50OiBUaHVyc2RheSwgTWFyY2ggMTMsIDIwMTQg
MjozODo0MiBBTQ0KU3ViamVjdDogW1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJy
b3INCg0KSGkgYWxsLA0Kd2hpbGUgYXR0ZW1wdGluZyBhIGZyb20tc2NyYXRjaCBzZWxmLWhvc3Rl
ZC1lbmdpbmUgaW5zdGFsbGF0aW9uIG9uIENlbnRPUyA2LjUgKGFsc28gZnJlc2hseSByZWluc3Rh
bGxlZCBmcm9tIHNjcmF0Y2gpIG9uIGEgcGh5c2ljYWwgbm9kZSAob1ZpcnQgMy40LjBfcHJlICsg
R2x1c3RlckZTIDMuNS4wYmV0YTQ7IE5GUyBzdG9yYWdlIGZvciBlbmdpbmUgVk0pLCB0aGUgcHJv
Y2VzcyBmYWlscyBhbG1vc3QgaW1tZWRpYXRlbHkgd2l0aDoNCg0KW3Jvb3RAY2x1c3RlcjEgfl0j
IG92aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAgLS1jb25maWctYXBwZW5kPS9yb290L292aGUtc2V0
dXAtYW5zd2Vycy5jb25mDQpbIElORk8gIF0gU3RhZ2U6IEluaXRpYWxpemluZw0KICAgICAgICAg
IENvbnRpbnVpbmcgd2lsbCBjb25maWd1cmUgdGhpcyBob3N0IGZvciBzZXJ2aW5nIGFzIGh5cGVy
dmlzb3IgYW5kIGNyZWF0ZSBhIFZNIHdoZXJlIHlvdSBoYXZlIHRvIGluc3RhbGwgb1ZpcnQgRW5n
aW5lIGFmdGVyd2FyZHMuDQogICAgICAgICAgQXJlIHlvdSBzdXJlIHlvdSB3YW50IHRvIGNvbnRp
bnVlPyAoWWVzLCBObylbWWVzXToNClsgSU5GTyAgXSBHZW5lcmF0aW5nIGEgdGVtcG9yYXJ5IFZO
QyBwYXNzd29yZC4NClsgSU5GTyAgXSBTdGFnZTogRW52aXJvbm1lbnQgc2V0dXANCiAgICAgICAg
ICBDb25maWd1cmF0aW9uIGZpbGVzOiBbJy9yb290L292aGUtc2V0dXAtYW5zd2Vycy5jb25mJ10N
CiAgICAgICAgICBMb2cgZmlsZTogL3Zhci9sb2cvb3ZpcnQtaG9zdGVkLWVuZ2luZS1zZXR1cC9v
dmlydC1ob3N0ZWQtZW5naW5lLXNldHVwLTIwMTQwMzEzMDEwNTI2LmxvZw0KICAgICAgICAgIFZl
cnNpb246IG90b3BpLTEuMi4wX3JjMyAob3RvcGktMS4yLjAtMC45LnJjMy5lbDYpDQpbIElORk8g
IF0gSGFyZHdhcmUgc3VwcG9ydHMgdmlydHVhbGl6YXRpb24NClsgSU5GTyAgXSBCcmlkZ2Ugb3Zp
cnRtZ210IGFscmVhZHkgY3JlYXRlZA0KWyBJTkZPICBdIFN0YWdlOiBFbnZpcm9ubWVudCBwYWNr
YWdlcyBzZXR1cA0KWyBJTkZPICBdIFN0YWdlOiBQcm9ncmFtcyBkZXRlY3Rpb24NClsgSU5GTyAg
XSBTdGFnZTogRW52aXJvbm1lbnQgc2V0dXANClsgSU5GTyAgXSBHZW5lcmF0aW5nIFZEU00gY2Vy
dGlmaWNhdGVzDQpbIEVSUk9SIF0gRmFpbGVkIHRvIGV4ZWN1dGUgc3RhZ2UgJ0Vudmlyb25tZW50
IHNldHVwJzogW0Vycm5vIDJdIE5vIHN1Y2ggZmlsZSBvciBkaXJlY3Rvcnk6ICcvZXRjL3BraS9s
aWJ2aXJ0L2NsaWVudGNlcnQucGVtJw0KSSBhbHJlYWR5IGdvdCBhbm90aGVyIHN1Y2ggcmVwb3J0
IHllc3RlcmRheSAtIHNlZW1zIGxpa2UgYSBidWcgaW4gdGhlIGZpeCBmb3IgaHR0cHM6Ly9idWd6
aWxsYS5yZWRoYXQuY29tL3Nob3dfYnVnLmNnaT9pZD0xMDM0NjM0IC5JIGhvcGUgdG8gcHVzaCBh
IGZpeCBsYXRlciB0b2RheS4NCg0KSSBsb29rIGZvcndhcmQgdG8gaGF2ZSB0aGUgZml4IHB1c2hl
ZC9tZXJnZWQgaW4gYWN0dWFsIHBhY2thZ2VzLg0KDQoNClsgSU5GTyAgXSBTdGFnZTogQ2xlYW4g
dXANClsgSU5GTyAgXSBTdGFnZTogUHJlLXRlcm1pbmF0aW9uDQpbIElORk8gIF0gU3RhZ2U6IFRl
cm1pbmF0aW9uDQoNClRoZSAvcm9vdC9vdmhlLXNldHVwLWFuc3dlcnMuY29uZiBoYXMgYmVlbiBz
YXZlZCBmcm9tIGEgcHJldmlvdXMgaW5zdGFsbGF0aW9uIChiZWZvcmUgcmVpbnN0YWxsaW5nKSBh
bmQgb25seSBtaW5pbWFsbHkgZWRpdGVkIChyZW1vdmVkIHNvbWUgbGluZXMgd2l0aCBVVUlEcyBl
dGMuKS4NCg0KVGhlIC9ldGMvcGtpL2xpYnZpcnQgZGlyIGlzIGNvbXBsZXRlbHkgbWlzc2luZyBv
biBib3RoIG5vZGVzOyBsYXN0IHRpbWUgSSB0cmllZCB0aGUgd2hvbGUgc2V0dXAgSSBkbyBub3Qg
cmVjYWxsIG9mIGhhdmluZyBzdWNoIHByb2JsZW1zLCBidXQgbWF5YmUgc29tZXRoaW5nIHdhcyBk
aWZmZXJlbnQgdGhlbi4NCg0KVGhlIGdlbmVyYXRlZCAvdmFyL2xvZy9vdmlydC1ob3N0ZWQtZW5n
aW5lLXNldHVwL292aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAtMjAxNDAzMTMwMTA1MjYubG9nIGhh
cyBiZWVuIHNhdmVkIGFzOg0KDQpodHRwOi8vcGFzdGViaW4uY29tL2V6QUpFVEJODQoNCkkgaG9w
ZSB0byBiZSBhYmxlIHRvIHByb2dyZXNzIGZ1cnRoZXIgdG8gdGVzdCB0aGUgd2hvbGUgMi1ub2Rl
cyBzZXR1cCAoc2Vjb25kIG5vZGUgZnJlc2hseSByZWluc3RhbGxlZCB0b28gYW5kIGFscmVhZHkg
dXAgd2l0aCBHbHVzdGVyRlMgYW5kIHdhaXRpbmcgdG8gYmUgYWRkZWQgdG8gb1ZpcnQgY2x1c3Rl
cikgYW5kIGRhdGFjZW50ZXIgY29uZmlndXJhdGlvbi4NCg0KTWFueSB0aGFua3MgaW4gYWR2YW5j
ZSBmb3IgYW55IHN1Z2dlc3Rpb25zL2hlbHAsDQpGb3Igbm93LCB5b3UgY2FuIHNpbXBseTpta2Rp
ciAvZXRjL3BraS9saWJ2aXJ0DQpUaGlzIHNob3VsZCBiZSBlbm91Z2guDQoNClRoZSB3b3JrYXJv
dW5kIHdvcmtzOiB0aGUgc2VsZi1ob3N0ZWQtZW5naW5lIGluc3RhbGxhdGlvbiBwcm9jZWVkcyBu
b3cuDQoNClRoYW5rcyBmb3IgdGhlIHJlcG9ydCEtLSANCkRpZGkNCg0KTWFueSB0aGFua3MgZm9y
IHlvdXIga2luZCBhbmQgcHJvbXB0IGFzc2lzdGFuY2UsDQpHaXVzZXBwZQ0KDQogCQkgCSAgIAkJ
ICAKDQpUaGFua3MgZm9yIHRoZSByZXBvcnQuIFRoZSB3b3JrYXJvdW5kIGlzIHByb2JhYmx5IG5v
dCBlbm91Z2gsIGRlcGVuZHMgb24gd2hhdCB5b3VhcmUgdHJ5aW5nIHRvIGRvLiAnbWtkaXIgL2V0
Yy9wa2kvbGlidmlydC9wcml2YXRlJyBpcyBuZWVkZWQgdG9vLiBXaXRob3V0IGl0LCB0aGUgY29k
ZSB0aGF0Y29waWVzIHRoZXJlIGEga2V5IHdpbGwgY3JlYXRlIGEgZmlsZSAncHJpdmF0ZScgaW5z
dGVhZCBvZiBjb3B5aW5nIGl0IGludG8gYSBkaXJlY3RvcnkgJ3ByaXZhdGUnLg0KRml4IFsxXSB3
YXMgbWVyZ2VkIHRvIGFsbCBicmFuY2hlcy4NClsxXSBodHRwOi8vZ2Vycml0Lm92aXJ0Lm9yZy8y
NTc0Nw0KQmVzdCByZWdhcmRzLC0tIERpZGkNCg0KSGkgRGlkaSwNCnRoZSB3b3JrYXJvdW5kIHNl
ZW1lZCBhY3R1YWxseSB0byBiZSBlbm91Z2ggdG8gbWFrZSB0aGUgc2VsZi1ob3N0ZWQtZW5naW5l
IHNldHVwIGdvIHRocm91Z2ggdXAgdG8gdGhlIGVuZCB3aXRob3V0IGFueSB1c2VyLXZpc2libGUg
ZXJyb3IsIGJ1dCBpdCBsZWZ0IG1lIHdpdGggYSBub24tcnVubmluZyBFbmdpbmUgVk0gYWZ0ZXJ3
YXJkcyAoYmFzaWNhbGx5IGl0IGRpZCBub3QgcmVzdGFydCB1cCBhdXRvbWF0aWNhbGx5IHVuZGVy
IEhBIHByb3RlY3Rpb24pLg0KDQpJIGNvbGxlY3RlZCBhbGwgbG9ncyBhbmQgcmVwb3J0ZWQgaXQg
aW4gYSBzZXBhcmF0ZSBtZXNzYWdlIHdpdGggc3ViamVjdCAiU2VsZi1ob3N0ZWQgZW5naW5lIHNl
dHVwIG9rIGJ1dCBubyBlbmdpbmUgdm0gcnVubmluZ/4gIiBidXQgZ290IG5vIGNvbW1lbnRzIHll
dC4NCg0KSWYgSSBnZXQgbm8gc3VnZ2VzdGlvbnMgSSB3aWxsIHRyeSB0byBwZXJmb3JtIHNvbWUg
ImNvcnJlY3RpdmUgYWN0aW9ucyIgYmFzZWQgb24gbXkgdW5kZXJzdGFuZGluZyBvZiB0aGUgcHJv
YmxlbXMgYXQgaGFuZCwgYnV0IEkgZGlkIG5vdCB3YW50IHRvICJjb3JydXB0IiB0aGUgZXhhY3Qg
c3RhdGUgdG8gaGVscCBpbiBkZWJ1Z2dpbmcgKHN0YXJ0aW5nIGFnYWluIGZyb20gc2NyYXRjaCB3
aXRoIGZ1bGwgZmlyc3Qgbm9kZSByZWluc3RhbGxhdGlvbiBpcyBhIHNvbWV3aGF0IGxlbmdodHkg
cHJvY2VzcyBzaW5jZSBJIGhhdmUgbm8gbG9jYWwgcmVwbyBtaXJyb3JzKS4NCg0KTWFueSB0aGFu
a3MgYWdhaW4sDQpHaXVzZXBwZQ0KDQoKIAkJIAkgICAJCSAg
--_c189dc68-9b60-4630-aa76-ab3facfb40b4_
Content-Type: text/html; charset="windows-1256"
Content-Transfer-Encoding: base64
PGh0bWw+DQo8aGVhZD4NCjxzdHlsZT48IS0tDQouaG1tZXNzYWdlIFANCnsNCm1hcmdpbjowcHg7
DQpwYWRkaW5nOjBweA0KfQ0KYm9keS5obW1lc3NhZ2UNCnsNCmZvbnQtc2l6ZTogMTJwdDsNCmZv
bnQtZmFtaWx5OkNhbGlicmkNCn0NCi0tPjwvc3R5bGU+PC9oZWFkPg0KPGJvZHkgY2xhc3M9J2ht
bWVzc2FnZSc+PGRpdiBkaXI9J2x0cic+PGJyPjxkaXYgZGlyPSJsdHIiPjxkaXY+PGhyIGlkPSJz
dG9wU3BlbGxpbmciPkRhdGU6IFN1biwgMTYgTWFyIDIwMTQgMDU6MTQ6MzkgLTA0MDA8YnI+RnJv
bTogZGlkaUByZWRoYXQuY29tPGJyPlRvOiBnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb208YnI+
Q0M6IHVzZXJzQG92aXJ0Lm9yZzxicj5TdWJqZWN0OiBSZTogW1VzZXJzXSBTZWxmLWhvc3RlZC1l
bmdpbmUgc2V0dXAgZXJyb3I8YnI+PGJyPjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OnRpbWVzIG5l
dyByb21hbiwgbmV3IHlvcmssIHRpbWVzLCBzZXJpZjtmb250LXNpemU6MTJwdDtjb2xvcjojMDAw
MDAwOyI+PGRpdj48L2Rpdj48YmxvY2txdW90ZSBzdHlsZT0iYm9yZGVyLWxlZnQ6MnB4IHNvbGlk
ICMxMDEwRkY7cGFkZGluZy1sZWZ0OjVweDtjb2xvcjojMDAwO2ZvbnQtd2VpZ2h0Om5vcm1hbDtm
b250LXN0eWxlOm5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9uZTtmb250LWZhbWlseTpIZWx2ZXRp
Y2EsQXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTJwdDsiPjxiPkZyb206IDwvYj4iR2l1c2Vw
cGUgUmFndXNhIiAmbHQ7Z2l1c2VwcGUucmFndXNhQGhvdG1haWwuY29tJmd0Ozxicj48Yj5Ubzog
PC9iPiJZZWRpZHlhaCBCYXIgRGF2aWQiICZsdDtkaWRpQHJlZGhhdC5jb20mZ3Q7PGJyPjxiPkNj
OiA8L2I+dXNlcnNAb3ZpcnQub3JnPGJyPjxiPlNlbnQ6IDwvYj5TYXR1cmRheSwgTWFyY2ggMTUs
IDIwMTQgMjoxNToxOCBBTTxicj48Yj5TdWJqZWN0OiA8L2I+UkU6IFtVc2Vyc10gU2VsZi1ob3N0
ZWQtZW5naW5lIHNldHVwIGVycm9yPGJyPjxkaXY+PGJyPjwvZGl2PgoKPHN0eWxlPjwhLS0KLkV4
dGVybmFsQ2xhc3MgLmVjeGhtbWVzc2FnZSBQIHsKcGFkZGluZzowcHg7Cn0KCi5FeHRlcm5hbENs
YXNzIGJvZHkuZWN4aG1tZXNzYWdlIHsKZm9udC1zaXplOjEycHQ7CmZvbnQtZmFtaWx5OkNhbGli
cmk7Cn0KCi0tPjwvc3R5bGU+CjxkaXYgZGlyPSJsdHIiPkhpIERpZGksPGJyPjxkaXY+PGJyPjwv
ZGl2PjxkaXY+PGhyIGlkPSJlY3hzdG9wU3BlbGxpbmciPkRhdGU6IFRodSwgMTMgTWFyIDIwMTQg
MDI6NDY6NTAgLTA0MDA8YnI+RnJvbTogZGlkaUByZWRoYXQuY29tPGJyPlRvOiBnaXVzZXBwZS5y
YWd1c2FAaG90bWFpbC5jb208YnI+Q0M6IHVzZXJzQG92aXJ0Lm9yZzxicj5TdWJqZWN0OiBSZTog
W1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJyb3I8YnI+PGRpdj48YnI+PC9kaXY+
PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6dGltZXMgbmV3IHJvbWFuLCBuZXcgeW9yaywgdGltZXMs
IHNlcmlmO2ZvbnQtc2l6ZToxMnB0O2NvbG9yOiMwMDAwMDA7Ij48ZGl2PjwvZGl2PjxibG9ja3F1
b3RlIHN0eWxlPSJib3JkZXItbGVmdDoycHggc29saWQgIzEwMTBGRjtwYWRkaW5nLWxlZnQ6NXB4
O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZvbnQtc3R5bGU6bm9ybWFsO3RleHQtZGVj
b3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZldGljYSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQt
c2l6ZToxMnB0OyI+PGI+RnJvbTogPC9iPiJHaXVzZXBwZSBSYWd1c2EiICZsdDtnaXVzZXBwZS5y
YWd1c2FAaG90bWFpbC5jb20mZ3Q7PGJyPjxiPlRvOiA8L2I+dXNlcnNAb3ZpcnQub3JnPGJyPjxi
PlNlbnQ6IDwvYj5UaHVyc2RheSwgTWFyY2ggMTMsIDIwMTQgMjozODo0MiBBTTxicj48Yj5TdWJq
ZWN0OiA8L2I+W1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJyb3I8YnI+PGRpdj48
YnI+PC9kaXY+PHN0eWxlPjwhLS0KLkV4dGVybmFsQ2xhc3MgLmVjeGhtbWVzc2FnZSBQIHsKcGFk
ZGluZzowcHg7Cn0KCi5FeHRlcm5hbENsYXNzIGJvZHkuZWN4aG1tZXNzYWdlIHsKZm9udC1zaXpl
OjEycHQ7CmZvbnQtZmFtaWx5OkNhbGlicmk7Cn0KCgotLT48L3N0eWxlPjxkaXYgZGlyPSJsdHIi
PkhpIGFsbCw8YnI+d2hpbGUgYXR0ZW1wdGluZyBhIGZyb20tc2NyYXRjaCBzZWxmLWhvc3RlZC1l
bmdpbmUgaW5zdGFsbGF0aW9uIG9uIENlbnRPUyA2LjUgKGFsc28gZnJlc2hseSByZWluc3RhbGxl
ZCBmcm9tIHNjcmF0Y2gpIG9uIGEgcGh5c2ljYWwgbm9kZSAob1ZpcnQgMy40LjBfcHJlICsgR2x1
c3RlckZTIDMuNS4wYmV0YTQ7IE5GUyBzdG9yYWdlIGZvciBlbmdpbmUgVk0pLCB0aGUgcHJvY2Vz
cyBmYWlscyBhbG1vc3QgaW1tZWRpYXRlbHkgd2l0aDo8YnI+PGRpdj48YnI+PC9kaXY+W3Jvb3RA
Y2x1c3RlcjEgfl0jIG92aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAgLS1jb25maWctYXBwZW5kPS9y
b290L292aGUtc2V0dXAtYW5zd2Vycy5jb25mPGJyPlsgSU5GTyZuYnNwOyBdIFN0YWdlOiBJbml0
aWFsaXppbmc8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i
c3A7Jm5ic3A7IENvbnRpbnVpbmcgd2lsbCBjb25maWd1cmUgdGhpcyBob3N0IGZvciBzZXJ2aW5n
IGFzIGh5cGVydmlzb3IgYW5kIGNyZWF0ZSBhIFZNIHdoZXJlIHlvdSBoYXZlIHRvIGluc3RhbGwg
b1ZpcnQgRW5naW5lIGFmdGVyd2FyZHMuPGJyPiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw
OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBBcmUgeW91IHN1cmUgeW91IHdhbnQgdG8gY29udGlu
dWU/IChZZXMsIE5vKVtZZXNdOjxicj5bIElORk8mbmJzcDsgXSBHZW5lcmF0aW5nIGEgdGVtcG9y
YXJ5IFZOQyBwYXNzd29yZC48YnI+WyBJTkZPJm5ic3A7IF0gU3RhZ2U6IEVudmlyb25tZW50IHNl
dHVwPGJyPiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu
YnNwOyBDb25maWd1cmF0aW9uIGZpbGVzOiBbJy9yb290L292aGUtc2V0dXAtYW5zd2Vycy5jb25m
J108YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i
c3A7IExvZyBmaWxlOiAvdmFyL2xvZy9vdmlydC1ob3N0ZWQtZW5naW5lLXNldHVwL292aXJ0LWhv
c3RlZC1lbmdpbmUtc2V0dXAtMjAxNDAzMTMwMTA1MjYubG9nPGJyPiZuYnNwOyZuYnNwOyZuYnNw
OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBWZXJzaW9uOiBvdG9waS0xLjIu
MF9yYzMgKG90b3BpLTEuMi4wLTAuOS5yYzMuZWw2KTxicj5bIElORk8mbmJzcDsgXSBIYXJkd2Fy
ZSBzdXBwb3J0cyB2aXJ0dWFsaXphdGlvbjxicj5bIElORk8mbmJzcDsgXSBCcmlkZ2Ugb3ZpcnRt
Z210IGFscmVhZHkgY3JlYXRlZDxicj5bIElORk8mbmJzcDsgXSBTdGFnZTogRW52aXJvbm1lbnQg
cGFja2FnZXMgc2V0dXA8YnI+WyBJTkZPJm5ic3A7IF0gU3RhZ2U6IFByb2dyYW1zIGRldGVjdGlv
bjxicj5bIElORk8mbmJzcDsgXSBTdGFnZTogRW52aXJvbm1lbnQgc2V0dXA8YnI+WyBJTkZPJm5i
c3A7IF0gR2VuZXJhdGluZyBWRFNNIGNlcnRpZmljYXRlczxicj5bIEVSUk9SIF0gRmFpbGVkIHRv
IGV4ZWN1dGUgc3RhZ2UgJ0Vudmlyb25tZW50IHNldHVwJzogW0Vycm5vIDJdIE5vIHN1Y2ggZmls
ZSBvciBkaXJlY3Rvcnk6ICcvZXRjL3BraS9saWJ2aXJ0L2NsaWVudGNlcnQucGVtJzwvZGl2Pjwv
YmxvY2txdW90ZT48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgYWxyZWFkeSBnb3QgYW5vdGhlciBzdWNo
IHJlcG9ydCB5ZXN0ZXJkYXkgLSBzZWVtcyBsaWtlIGEgYnVnIGluIHRoZSBmaXggZm9yJm5ic3A7
PGEgaHJlZj0iaHR0cHM6Ly9idWd6aWxsYS5yZWRoYXQuY29tL3Nob3dfYnVnLmNnaT9pZD0xMDM0
NjM0IiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9idWd6aWxsYS5yZWRoYXQuY29tL3Nob3dfYnVn
LmNnaT9pZD0xMDM0NjM0PC9hPiZuYnNwOy48L2Rpdj48ZGl2PkkgaG9wZSB0byBwdXNoIGEgZml4
IGxhdGVyIHRvZGF5Ljxicj48ZGl2Pjxicj48L2Rpdj5JIGxvb2sgZm9yd2FyZCB0byBoYXZlIHRo
ZSBmaXggcHVzaGVkL21lcmdlZCBpbiBhY3R1YWwgcGFja2FnZXMuPGJyPjwvZGl2PjxkaXY+PGJy
PjwvZGl2PjxibG9ja3F1b3RlIHN0eWxlPSJib3JkZXItbGVmdDoycHggc29saWQgIzEwMTBGRjtw
YWRkaW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZvbnQtc3R5bGU6
bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZldGljYSxBcmlhbCxz
YW5zLXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGRpdiBkaXI9Imx0ciI+PGJyPlsgSU5GTyZuYnNw
OyBdIFN0YWdlOiBDbGVhbiB1cDxicj5bIElORk8mbmJzcDsgXSBTdGFnZTogUHJlLXRlcm1pbmF0
aW9uPGJyPlsgSU5GTyZuYnNwOyBdIFN0YWdlOiBUZXJtaW5hdGlvbjxicj48ZGl2Pjxicj48L2Rp
dj5UaGUgL3Jvb3Qvb3ZoZS1zZXR1cC1hbnN3ZXJzLmNvbmYgaGFzIGJlZW4gc2F2ZWQgZnJvbSBh
IHByZXZpb3VzIGluc3RhbGxhdGlvbiAoYmVmb3JlIHJlaW5zdGFsbGluZykgYW5kIG9ubHkgbWlu
aW1hbGx5IGVkaXRlZCAocmVtb3ZlZCBzb21lIGxpbmVzIHdpdGggVVVJRHMgZXRjLikuPGJyPjxk
aXY+PGJyPjwvZGl2PlRoZSAvZXRjL3BraS9saWJ2aXJ0IGRpciBpcyBjb21wbGV0ZWx5IG1pc3Np
bmcgb24gYm90aCBub2RlczsgbGFzdCB0aW1lIEkgdHJpZWQgdGhlIHdob2xlIHNldHVwIEkgZG8g
bm90IHJlY2FsbCBvZiBoYXZpbmcgc3VjaCBwcm9ibGVtcywgYnV0IG1heWJlIHNvbWV0aGluZyB3
YXMgZGlmZmVyZW50IHRoZW4uPGJyPjxkaXY+PGJyPjwvZGl2PlRoZSBnZW5lcmF0ZWQgL3Zhci9s
b2cvb3ZpcnQtaG9zdGVkLWVuZ2luZS1zZXR1cC9vdmlydC1ob3N0ZWQtZW5naW5lLXNldHVwLTIw
MTQwMzEzMDEwNTI2LmxvZyBoYXMgYmVlbiBzYXZlZCBhczo8YnI+PGRpdj48YnI+PC9kaXY+aHR0
cDovL3Bhc3RlYmluLmNvbS9lekFKRVRCTjxicj48ZGl2Pjxicj48L2Rpdj5JIGhvcGUgdG8gYmUg
YWJsZSB0byBwcm9ncmVzcyBmdXJ0aGVyIHRvIHRlc3QgdGhlIHdob2xlIDItbm9kZXMgc2V0dXAg
KHNlY29uZCBub2RlIGZyZXNobHkgcmVpbnN0YWxsZWQgdG9vIGFuZCBhbHJlYWR5IHVwIHdpdGgg
R2x1c3RlckZTIGFuZCB3YWl0aW5nIHRvIGJlIGFkZGVkIHRvIG9WaXJ0IGNsdXN0ZXIpIGFuZCBk
YXRhY2VudGVyIGNvbmZpZ3VyYXRpb24uPGJyPjxkaXY+PGJyPjwvZGl2Pk1hbnkgdGhhbmtzIGlu
IGFkdmFuY2UgZm9yIGFueSBzdWdnZXN0aW9ucy9oZWxwLDwvZGl2PjwvYmxvY2txdW90ZT48ZGl2
Pjxicj48L2Rpdj48ZGl2PkZvciBub3csIHlvdSBjYW4gc2ltcGx5OjwvZGl2PjxkaXY+bWtkaXIm
bmJzcDs8c3BhbiBzdHlsZT0iZm9udC1mYW1pbHk6SGVsdmV0aWNhLCBBcmlhbCwgc2Fucy1zZXJp
ZjsiPi9ldGMvcGtpL2xpYnZpcnQ8L3NwYW4+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5UaGlz
IHNob3VsZCBiZSBlbm91Z2guPGJyPjxkaXY+PGJyPjwvZGl2PlRoZSB3b3JrYXJvdW5kIHdvcmtz
OiB0aGUgc2VsZi1ob3N0ZWQtZW5naW5lIGluc3RhbGxhdGlvbiBwcm9jZWVkcyBub3cuPGJyPjwv
ZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhhbmtzIGZvciB0aGUgcmVwb3J0ITwvZGl2PjxkaXY+
LS0gPGJyPjwvZGl2PjxkaXY+PHNwYW4+PC9zcGFuPkRpZGk8YnI+PHNwYW4+PC9zcGFuPjxicj5N
YW55IHRoYW5rcyBmb3IgeW91ciBraW5kIGFuZCBwcm9tcHQgYXNzaXN0YW5jZSw8YnI+R2l1c2Vw
cGU8YnI+PGRpdj48YnI+PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+IAkJIAkgICAJCSAgPC9kaXY+
CjwvYmxvY2txdW90ZT48ZGl2Pjxicj5UaGFua3MgZm9yIHRoZSByZXBvcnQuIFRoZSB3b3JrYXJv
dW5kIGlzIHByb2JhYmx5IG5vdCBlbm91Z2gsIGRlcGVuZHMgb24gd2hhdCB5b3U8L2Rpdj48ZGl2
PmFyZSB0cnlpbmcgdG8gZG8uICdta2RpciAvZXRjL3BraS9saWJ2aXJ0L3ByaXZhdGUnIGlzIG5l
ZWRlZCB0b28uIFdpdGhvdXQgaXQsIHRoZSBjb2RlIHRoYXQ8L2Rpdj48ZGl2PmNvcGllcyB0aGVy
ZSBhIGtleSB3aWxsIGNyZWF0ZSBhIGZpbGUgJ3ByaXZhdGUnIGluc3RlYWQgb2YgY29weWluZyBp
dCBpbnRvIGEgZGlyZWN0b3J5ICdwcml2YXRlJy48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PkZp
eCBbMV0gd2FzIG1lcmdlZCB0byBhbGwgYnJhbmNoZXMuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRp
dj5bMV0mbmJzcDs8YSBocmVmPSJodHRwOi8vZ2Vycml0Lm92aXJ0Lm9yZy8yNTc0NyIgdGFyZ2V0
PSJfYmxhbmsiPmh0dHA6Ly9nZXJyaXQub3ZpcnQub3JnLzI1NzQ3PC9hPjwvZGl2PjxkaXY+PGJy
PjwvZGl2PjxkaXY+QmVzdCByZWdhcmRzLDwvZGl2PjxkaXY+PHNwYW4gc3R5bGU9ImZvbnQtc2l6
ZToxMnB0OyI+LS0mbmJzcDs8L3NwYW4+PC9kaXY+PGRpdj48c3Bhbj48L3NwYW4+RGlkaTxicj48
c3Bhbj48L3NwYW4+PGJyPkhpIERpZGksPGJyPnRoZSB3b3JrYXJvdW5kIHNlZW1lZCBhY3R1YWxs
eSB0byBiZSBlbm91Z2ggdG8gbWFrZSB0aGUgc2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGdvIHRo
cm91Z2ggdXAgdG8gdGhlIGVuZCB3aXRob3V0IGFueSB1c2VyLXZpc2libGUgZXJyb3IsIGJ1dCBp
dCBsZWZ0IG1lIHdpdGggYSBub24tcnVubmluZyBFbmdpbmUgVk0gYWZ0ZXJ3YXJkcyAoYmFzaWNh
bGx5IGl0IGRpZCBub3QgcmVzdGFydCB1cCBhdXRvbWF0aWNhbGx5IHVuZGVyIEhBIHByb3RlY3Rp
b24pLjxicj48YnI+SSBjb2xsZWN0ZWQgYWxsIGxvZ3MgYW5kIHJlcG9ydGVkIGl0IGluIGEgc2Vw
YXJhdGUgbWVzc2FnZSB3aXRoIHN1YmplY3QgIlNlbGYtaG9zdGVkIGVuZ2luZSBzZXR1cCBvayBi
dXQgbm8gZW5naW5lIHZtIHJ1bm5pbmf+ICIgYnV0IGdvdCBubyBjb21tZW50cyB5ZXQuPGJyPjxi
cj5JZiBJIGdldCBubyBzdWdnZXN0aW9ucyBJIHdpbGwgdHJ5IHRvIHBlcmZvcm0gc29tZSAiY29y
cmVjdGl2ZSBhY3Rpb25zIiBiYXNlZCBvbiBteSB1bmRlcnN0YW5kaW5nIG9mIHRoZSBwcm9ibGVt
cyBhdCBoYW5kLCBidXQgSSBkaWQgbm90IHdhbnQgdG8gImNvcnJ1cHQiIHRoZSBleGFjdCBzdGF0
ZSB0byBoZWxwIGluIGRlYnVnZ2luZyAoc3RhcnRpbmcgYWdhaW4gZnJvbSBzY3JhdGNoIHdpdGgg
ZnVsbCBmaXJzdCBub2RlIHJlaW5zdGFsbGF0aW9uIGlzIGEgc29tZXdoYXQgbGVuZ2h0eSBwcm9j
ZXNzIHNpbmNlIEkgaGF2ZSBubyBsb2NhbCByZXBvIG1pcnJvcnMpLjxicj48YnI+TWFueSB0aGFu
a3MgYWdhaW4sPGJyPkdpdXNlcHBlPGJyPjxicj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj4KIAkJ
IAkgICAJCSAgPC9kaXY+PC9ib2R5Pg0KPC9odG1sPg==
--_c189dc68-9b60-4630-aa76-ab3facfb40b4_--
12:34 a.m.
--_8711780c-91f0-4b4d-8c2f-fff1588abc18_
Content-Type: text/plain; charset="windows-1256"
Content-Transfer-Encoding: base64
SGkgRGlkaSwNCnNvcnJ5IGZvciB0aGUgZGVsYXkgaW4gcmVwb3J0aW5nIGZpbmFsIHJlc3VsdHMu
DQoNCkkgY2FuIGNvbmZpcm0gdGhhdCBzaW1wbHkgY3JlYXRpbmcgL2V0Yy9wa2kvbGlidmlydCBz
dWZmaWNlczogdGhlICJwcml2YXRlIiBzdWJkaXIgZ2V0cyBhdXRvbWF0aWNhbGx5IGNvcnJlY3Rs
eSBjcmVhdGVkIChhbG9uZyB3aXRoIGFsbCBjZXJ0aWZpY2F0ZXMgZXRjLikgIGFuZCBzZXR1cCBj
b21wbGV0ZXMgZmluZS4NCg0KSXQgZGlkIG5vdCBzdGFydCB1cCBiZWNhdXNlIG9mIEJaICMxMDc1
MTI2IChIQSBhZ2VudCBkaWVkKSBidXQgSSBub3RpY2VkIChieSBjaGFuY2UpIHRoYXQgdGhlcmUg
aXMgYW4gdXBkYXRlZCAoMTgvMDMvMjAxNCkgd29ya2Fyb3VuZCBhbmQgYWZ0ZXIgbWFudWFsbHkg
YXBwbHlpbmcgaXQgKG5vIG9WaXJ0IG5ldyBwYWNrYWdlcyBoYXZlIGJlZW4gcHVibGlzaGVkIHll
dCkgdGhlIEVuZ2luZSBWTSBzdGFydGVkIGZpbmUuDQoNCk5vdyBJJ20gYmF0dGxpbmcgd2l0aCBh
biAoYXBwYXJlbnRseSkgR2x1c3RlckZTICgzLjUuMGJldGE0KSBidWcgdGhhdCBtYWtlcyB0aGUg
KE5GUyBiYXNlZCwgYnV0IEdsdXN0ZXItcHJvdmlkZWQpIEVuZ2luZSBzdG9yYWdlIGRvbWFpbiBz
aHV0ZG93biBieSBpdHNlbGYgYWZ0ZXIgYSB3aGlsZSAoY2F1c2luZyBFbmdpbmUgVk0gdG8gZGll
KS4NCg0KTWFueSB0aGFua3MgYWdhaW4gZm9yIHlvdXIgc3VwcG9ydCwNCkdpdXNlcHBlDQoNClBT
OiB3b3VsZCB5b3Ugc3VnZ2VzdCBhIGNvbXBsZXRlIHJlaW5zdGFsbCB3aXRoIEdsdXN0ZXJGUyAz
LjQueCBzdGFibGUgaW5zdGVhZD8gOz4NCg0KUFMyOiBzb3JyeSBmb3IgdG9wLXBvc3RpbmcgKGJ1
dCBIb3RtYWlsIGtlZXBzIGZhaWxpbmcgb24gcHJvcGVyIHF1b3RpbmcuLi4pDQoNCkZyb206IGdp
dXNlcHBlLnJhZ3VzYUBob3RtYWlsLmNvbQ0KVG86IGRpZGlAcmVkaGF0LmNvbQ0KRGF0ZTogU3Vu
LCAxNiBNYXIgMjAxNCAxNToxNDowNyArMDEwMA0KQ0M6IHVzZXJzQG92aXJ0Lm9yZw0KU3ViamVj
dDogUmU6IFtVc2Vyc10gU2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGVycm9yDQoNCgoKCg0KRGF0
ZTogU3VuLCAxNiBNYXIgMjAxNCAwNToxNDozOSAtMDQwMA0KRnJvbTogZGlkaUByZWRoYXQuY29t
DQpUbzogZ2l1c2VwcGUucmFndXNhQGhvdG1haWwuY29tDQpDQzogdXNlcnNAb3ZpcnQub3JnDQpT
dWJqZWN0OiBSZTogW1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJyb3INCg0KRnJv
bTogIkdpdXNlcHBlIFJhZ3VzYSIgPGdpdXNlcHBlLnJhZ3VzYUBob3RtYWlsLmNvbT4NClRvOiAi
WWVkaWR5YWggQmFyIERhdmlkIiA8ZGlkaUByZWRoYXQuY29tPg0KQ2M6IHVzZXJzQG92aXJ0Lm9y
Zw0KU2VudDogU2F0dXJkYXksIE1hcmNoIDE1LCAyMDE0IDI6MTU6MTggQU0NClN1YmplY3Q6IFJF
OiBbVXNlcnNdIFNlbGYtaG9zdGVkLWVuZ2luZSBzZXR1cCBlcnJvcg0KDQoKCgpIaSBEaWRpLA0K
DQpEYXRlOiBUaHUsIDEzIE1hciAyMDE0IDAyOjQ2OjUwIC0wNDAwDQpGcm9tOiBkaWRpQHJlZGhh
dC5jb20NClRvOiBnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb20NCkNDOiB1c2Vyc0BvdmlydC5v
cmcNClN1YmplY3Q6IFJlOiBbVXNlcnNdIFNlbGYtaG9zdGVkLWVuZ2luZSBzZXR1cCBlcnJvcg0K
DQpGcm9tOiAiR2l1c2VwcGUgUmFndXNhIiA8Z2l1c2VwcGUucmFndXNhQGhvdG1haWwuY29tPg0K
VG86IHVzZXJzQG92aXJ0Lm9yZw0KU2VudDogVGh1cnNkYXksIE1hcmNoIDEzLCAyMDE0IDI6Mzg6
NDIgQU0NClN1YmplY3Q6IFtVc2Vyc10gU2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGVycm9yDQoN
CkhpIGFsbCwNCndoaWxlIGF0dGVtcHRpbmcgYSBmcm9tLXNjcmF0Y2ggc2VsZi1ob3N0ZWQtZW5n
aW5lIGluc3RhbGxhdGlvbiBvbiBDZW50T1MgNi41IChhbHNvIGZyZXNobHkgcmVpbnN0YWxsZWQg
ZnJvbSBzY3JhdGNoKSBvbiBhIHBoeXNpY2FsIG5vZGUgKG9WaXJ0IDMuNC4wX3ByZSArIEdsdXN0
ZXJGUyAzLjUuMGJldGE0OyBORlMgc3RvcmFnZSBmb3IgZW5naW5lIFZNKSwgdGhlIHByb2Nlc3Mg
ZmFpbHMgYWxtb3N0IGltbWVkaWF0ZWx5IHdpdGg6DQoNCltyb290QGNsdXN0ZXIxIH5dIyBvdmly
dC1ob3N0ZWQtZW5naW5lLXNldHVwIC0tY29uZmlnLWFwcGVuZD0vcm9vdC9vdmhlLXNldHVwLWFu
c3dlcnMuY29uZg0KWyBJTkZPICBdIFN0YWdlOiBJbml0aWFsaXppbmcNCiAgICAgICAgICBDb250
aW51aW5nIHdpbGwgY29uZmlndXJlIHRoaXMgaG9zdCBmb3Igc2VydmluZyBhcyBoeXBlcnZpc29y
IGFuZCBjcmVhdGUgYSBWTSB3aGVyZSB5b3UgaGF2ZSB0byBpbnN0YWxsIG9WaXJ0IEVuZ2luZSBh
ZnRlcndhcmRzLg0KICAgICAgICAgIEFyZSB5b3Ugc3VyZSB5b3Ugd2FudCB0byBjb250aW51ZT8g
KFllcywgTm8pW1llc106DQpbIElORk8gIF0gR2VuZXJhdGluZyBhIHRlbXBvcmFyeSBWTkMgcGFz
c3dvcmQuDQpbIElORk8gIF0gU3RhZ2U6IEVudmlyb25tZW50IHNldHVwDQogICAgICAgICAgQ29u
ZmlndXJhdGlvbiBmaWxlczogWycvcm9vdC9vdmhlLXNldHVwLWFuc3dlcnMuY29uZiddDQogICAg
ICAgICAgTG9nIGZpbGU6IC92YXIvbG9nL292aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAvb3ZpcnQt
aG9zdGVkLWVuZ2luZS1zZXR1cC0yMDE0MDMxMzAxMDUyNi5sb2cNCiAgICAgICAgICBWZXJzaW9u
OiBvdG9waS0xLjIuMF9yYzMgKG90b3BpLTEuMi4wLTAuOS5yYzMuZWw2KQ0KWyBJTkZPICBdIEhh
cmR3YXJlIHN1cHBvcnRzIHZpcnR1YWxpemF0aW9uDQpbIElORk8gIF0gQnJpZGdlIG92aXJ0bWdt
dCBhbHJlYWR5IGNyZWF0ZWQNClsgSU5GTyAgXSBTdGFnZTogRW52aXJvbm1lbnQgcGFja2FnZXMg
c2V0dXANClsgSU5GTyAgXSBTdGFnZTogUHJvZ3JhbXMgZGV0ZWN0aW9uDQpbIElORk8gIF0gU3Rh
Z2U6IEVudmlyb25tZW50IHNldHVwDQpbIElORk8gIF0gR2VuZXJhdGluZyBWRFNNIGNlcnRpZmlj
YXRlcw0KWyBFUlJPUiBdIEZhaWxlZCB0byBleGVjdXRlIHN0YWdlICdFbnZpcm9ubWVudCBzZXR1
cCc6IFtFcnJubyAyXSBObyBzdWNoIGZpbGUgb3IgZGlyZWN0b3J5OiAnL2V0Yy9wa2kvbGlidmly
dC9jbGllbnRjZXJ0LnBlbScNCkkgYWxyZWFkeSBnb3QgYW5vdGhlciBzdWNoIHJlcG9ydCB5ZXN0
ZXJkYXkgLSBzZWVtcyBsaWtlIGEgYnVnIGluIHRoZSBmaXggZm9yIGh0dHBzOi8vYnVnemlsbGEu
cmVkaGF0LmNvbS9zaG93X2J1Zy5jZ2k/aWQ9MTAzNDYzNCAuSSBob3BlIHRvIHB1c2ggYSBmaXgg
bGF0ZXIgdG9kYXkuDQoNCkkgbG9vayBmb3J3YXJkIHRvIGhhdmUgdGhlIGZpeCBwdXNoZWQvbWVy
Z2VkIGluIGFjdHVhbCBwYWNrYWdlcy4NCg0KDQpbIElORk8gIF0gU3RhZ2U6IENsZWFuIHVwDQpb
IElORk8gIF0gU3RhZ2U6IFByZS10ZXJtaW5hdGlvbg0KWyBJTkZPICBdIFN0YWdlOiBUZXJtaW5h
dGlvbg0KDQpUaGUgL3Jvb3Qvb3ZoZS1zZXR1cC1hbnN3ZXJzLmNvbmYgaGFzIGJlZW4gc2F2ZWQg
ZnJvbSBhIHByZXZpb3VzIGluc3RhbGxhdGlvbiAoYmVmb3JlIHJlaW5zdGFsbGluZykgYW5kIG9u
bHkgbWluaW1hbGx5IGVkaXRlZCAocmVtb3ZlZCBzb21lIGxpbmVzIHdpdGggVVVJRHMgZXRjLiku
DQoNClRoZSAvZXRjL3BraS9saWJ2aXJ0IGRpciBpcyBjb21wbGV0ZWx5IG1pc3Npbmcgb24gYm90
aCBub2RlczsgbGFzdCB0aW1lIEkgdHJpZWQgdGhlIHdob2xlIHNldHVwIEkgZG8gbm90IHJlY2Fs
bCBvZiBoYXZpbmcgc3VjaCBwcm9ibGVtcywgYnV0IG1heWJlIHNvbWV0aGluZyB3YXMgZGlmZmVy
ZW50IHRoZW4uDQoNClRoZSBnZW5lcmF0ZWQgL3Zhci9sb2cvb3ZpcnQtaG9zdGVkLWVuZ2luZS1z
ZXR1cC9vdmlydC1ob3N0ZWQtZW5naW5lLXNldHVwLTIwMTQwMzEzMDEwNTI2LmxvZyBoYXMgYmVl
biBzYXZlZCBhczoNCg0KaHR0cDovL3Bhc3RlYmluLmNvbS9lekFKRVRCTg0KDQpJIGhvcGUgdG8g
YmUgYWJsZSB0byBwcm9ncmVzcyBmdXJ0aGVyIHRvIHRlc3QgdGhlIHdob2xlIDItbm9kZXMgc2V0
dXAgKHNlY29uZCBub2RlIGZyZXNobHkgcmVpbnN0YWxsZWQgdG9vIGFuZCBhbHJlYWR5IHVwIHdp
dGggR2x1c3RlckZTIGFuZCB3YWl0aW5nIHRvIGJlIGFkZGVkIHRvIG9WaXJ0IGNsdXN0ZXIpIGFu
ZCBkYXRhY2VudGVyIGNvbmZpZ3VyYXRpb24uDQoNCk1hbnkgdGhhbmtzIGluIGFkdmFuY2UgZm9y
IGFueSBzdWdnZXN0aW9ucy9oZWxwLA0KRm9yIG5vdywgeW91IGNhbiBzaW1wbHk6bWtkaXIgL2V0
Yy9wa2kvbGlidmlydA0KVGhpcyBzaG91bGQgYmUgZW5vdWdoLg0KDQpUaGUgd29ya2Fyb3VuZCB3
b3JrczogdGhlIHNlbGYtaG9zdGVkLWVuZ2luZSBpbnN0YWxsYXRpb24gcHJvY2VlZHMgbm93Lg0K
DQpUaGFua3MgZm9yIHRoZSByZXBvcnQhLS0gDQpEaWRpDQoNCk1hbnkgdGhhbmtzIGZvciB5b3Vy
IGtpbmQgYW5kIHByb21wdCBhc3Npc3RhbmNlLA0KR2l1c2VwcGUNCg0KIAkJIAkgICAJCSAgCg0K
VGhhbmtzIGZvciB0aGUgcmVwb3J0LiBUaGUgd29ya2Fyb3VuZCBpcyBwcm9iYWJseSBub3QgZW5v
dWdoLCBkZXBlbmRzIG9uIHdoYXQgeW91YXJlIHRyeWluZyB0byBkby4gJ21rZGlyIC9ldGMvcGtp
L2xpYnZpcnQvcHJpdmF0ZScgaXMgbmVlZGVkIHRvby4gV2l0aG91dCBpdCwgdGhlIGNvZGUgdGhh
dGNvcGllcyB0aGVyZSBhIGtleSB3aWxsIGNyZWF0ZSBhIGZpbGUgJ3ByaXZhdGUnIGluc3RlYWQg
b2YgY29weWluZyBpdCBpbnRvIGEgZGlyZWN0b3J5ICdwcml2YXRlJy4NCkZpeCBbMV0gd2FzIG1l
cmdlZCB0byBhbGwgYnJhbmNoZXMuDQpbMV0gaHR0cDovL2dlcnJpdC5vdmlydC5vcmcvMjU3NDcN
CkJlc3QgcmVnYXJkcywtLSBEaWRpDQoNCkhpIERpZGksDQp0aGUgd29ya2Fyb3VuZCBzZWVtZWQg
YWN0dWFsbHkgdG8gYmUgZW5vdWdoIHRvIG1ha2UgdGhlIHNlbGYtaG9zdGVkLWVuZ2luZSBzZXR1
cCBnbyB0aHJvdWdoIHVwIHRvIHRoZSBlbmQgd2l0aG91dCBhbnkgdXNlci12aXNpYmxlIGVycm9y
LCBidXQgaXQgbGVmdCBtZSB3aXRoIGEgbm9uLXJ1bm5pbmcgRW5naW5lIFZNIGFmdGVyd2FyZHMg
KGJhc2ljYWxseSBpdCBkaWQgbm90IHJlc3RhcnQgdXAgYXV0b21hdGljYWxseSB1bmRlciBIQSBw
cm90ZWN0aW9uKS4NCg0KSSBjb2xsZWN0ZWQgYWxsIGxvZ3MgYW5kIHJlcG9ydGVkIGl0IGluIGEg
c2VwYXJhdGUgbWVzc2FnZSB3aXRoIHN1YmplY3QgIlNlbGYtaG9zdGVkIGVuZ2luZSBzZXR1cCBv
ayBidXQgbm8gZW5naW5lIHZtIHJ1bm5pbmf+ICIgYnV0IGdvdCBubyBjb21tZW50cyB5ZXQuDQoN
CklmIEkgZ2V0IG5vIHN1Z2dlc3Rpb25zIEkgd2lsbCB0cnkgdG8gcGVyZm9ybSBzb21lICJjb3Jy
ZWN0aXZlIGFjdGlvbnMiIGJhc2VkIG9uIG15IHVuZGVyc3RhbmRpbmcgb2YgdGhlIHByb2JsZW1z
IGF0IGhhbmQsIGJ1dCBJIGRpZCBub3Qgd2FudCB0byAiY29ycnVwdCIgdGhlIGV4YWN0IHN0YXRl
IHRvIGhlbHAgaW4gZGVidWdnaW5nIChzdGFydGluZyBhZ2FpbiBmcm9tIHNjcmF0Y2ggd2l0aCBm
dWxsIGZpcnN0IG5vZGUgcmVpbnN0YWxsYXRpb24gaXMgYSBzb21ld2hhdCBsZW5naHR5IHByb2Nl
c3Mgc2luY2UgSSBoYXZlIG5vIGxvY2FsIHJlcG8gbWlycm9ycykuDQoNCk1hbnkgdGhhbmtzIGFn
YWluLA0KR2l1c2VwcGUNCg0KCiAJCSAJICAgCQkgIAoNCl9fX19fX19fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fClVzZXJzIG1haWxpbmcgbGlzdApVc2Vyc0BvdmlydC5v
cmcKaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIAkJIAkgICAJ
CSAg
--_8711780c-91f0-4b4d-8c2f-fff1588abc18_
Content-Type: text/html; charset="windows-1256"
Content-Transfer-Encoding: base64
PGh0bWw+DQo8aGVhZD4NCjxzdHlsZT48IS0tDQouaG1tZXNzYWdlIFANCnsNCm1hcmdpbjowcHg7
DQpwYWRkaW5nOjBweA0KfQ0KYm9keS5obW1lc3NhZ2UNCnsNCmZvbnQtc2l6ZTogMTJwdDsNCmZv
bnQtZmFtaWx5OkNhbGlicmkNCn0NCi0tPjwvc3R5bGU+PC9oZWFkPg0KPGJvZHkgY2xhc3M9J2ht
bWVzc2FnZSc+PGRpdiBkaXI9J2x0cic+SGkgRGlkaSw8YnI+c29ycnkgZm9yIHRoZSBkZWxheSBp
biByZXBvcnRpbmcgZmluYWwgcmVzdWx0cy48YnI+PGJyPkkgY2FuIGNvbmZpcm0gdGhhdCBzaW1w
bHkgY3JlYXRpbmcgL2V0Yy9wa2kvbGlidmlydCBzdWZmaWNlczogdGhlICJwcml2YXRlIiBzdWJk
aXIgZ2V0cyBhdXRvbWF0aWNhbGx5IGNvcnJlY3RseSBjcmVhdGVkIChhbG9uZyB3aXRoIGFsbCBj
ZXJ0aWZpY2F0ZXMgZXRjLikmbmJzcDsgYW5kIHNldHVwIGNvbXBsZXRlcyBmaW5lLjxicj48YnI+
SXQgZGlkIG5vdCBzdGFydCB1cCBiZWNhdXNlIG9mIEJaICMxMDc1MTI2IChIQSBhZ2VudCBkaWVk
KSBidXQgSSBub3RpY2VkIChieSBjaGFuY2UpIHRoYXQgdGhlcmUgaXMgYW4gdXBkYXRlZCAoMTgv
MDMvMjAxNCkgd29ya2Fyb3VuZCBhbmQgYWZ0ZXIgbWFudWFsbHkgYXBwbHlpbmcgaXQgKG5vIG9W
aXJ0IG5ldyBwYWNrYWdlcyBoYXZlIGJlZW4gcHVibGlzaGVkIHlldCkgdGhlIEVuZ2luZSBWTSBz
dGFydGVkIGZpbmUuPGJyPjxicj5Ob3cgSSdtIGJhdHRsaW5nIHdpdGggYW4gKGFwcGFyZW50bHkp
IEdsdXN0ZXJGUyAoMy41LjBiZXRhNCkgYnVnIHRoYXQgbWFrZXMgdGhlIChORlMgYmFzZWQsIGJ1
dCBHbHVzdGVyLXByb3ZpZGVkKSBFbmdpbmUgc3RvcmFnZSBkb21haW4gc2h1dGRvd24gYnkgaXRz
ZWxmIGFmdGVyIGEgd2hpbGUgKGNhdXNpbmcgRW5naW5lIFZNIHRvIGRpZSkuPGJyPjxicj5NYW55
IHRoYW5rcyBhZ2FpbiBmb3IgeW91ciBzdXBwb3J0LDxicj5HaXVzZXBwZTxicj48YnI+UFM6IHdv
dWxkIHlvdSBzdWdnZXN0IGEgY29tcGxldGUgcmVpbnN0YWxsIHdpdGggR2x1c3RlckZTIDMuNC54
IHN0YWJsZSBpbnN0ZWFkPyA7Jmd0Ozxicj48YnI+UFMyOiBzb3JyeSBmb3IgdG9wLXBvc3Rpbmcg
KGJ1dCBIb3RtYWlsIGtlZXBzIGZhaWxpbmcgb24gcHJvcGVyIHF1b3RpbmcuLi4pPGJyPjxicj48
ZGl2PjxociBpZD0ic3RvcFNwZWxsaW5nIj5Gcm9tOiBnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5j
b208YnI+VG86IGRpZGlAcmVkaGF0LmNvbTxicj5EYXRlOiBTdW4sIDE2IE1hciAyMDE0IDE1OjE0
OjA3ICswMTAwPGJyPkNDOiB1c2Vyc0BvdmlydC5vcmc8YnI+U3ViamVjdDogUmU6IFtVc2Vyc10g
U2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGVycm9yPGJyPjxicj4KCjxzdHlsZT48IS0tCi5FeHRl
cm5hbENsYXNzIC5lY3hobW1lc3NhZ2UgUCB7CnBhZGRpbmc6MHB4Owp9CgouRXh0ZXJuYWxDbGFz
cyBib2R5LmVjeGhtbWVzc2FnZSB7CmZvbnQtc2l6ZToxMnB0Owpmb250LWZhbWlseTpDYWxpYnJp
Owp9CgotLT48L3N0eWxlPgo8ZGl2IGRpcj0ibHRyIj48YnI+PGRpdiBkaXI9Imx0ciI+PGRpdj48
aHIgaWQ9ImVjeHN0b3BTcGVsbGluZyI+RGF0ZTogU3VuLCAxNiBNYXIgMjAxNCAwNToxNDozOSAt
MDQwMDxicj5Gcm9tOiBkaWRpQHJlZGhhdC5jb208YnI+VG86IGdpdXNlcHBlLnJhZ3VzYUBob3Rt
YWlsLmNvbTxicj5DQzogdXNlcnNAb3ZpcnQub3JnPGJyPlN1YmplY3Q6IFJlOiBbVXNlcnNdIFNl
bGYtaG9zdGVkLWVuZ2luZSBzZXR1cCBlcnJvcjxicj48YnI+PGRpdiBzdHlsZT0iZm9udC1mYW1p
bHk6dGltZXMgbmV3IHJvbWFuLCBuZXcgeW9yaywgdGltZXMsIHNlcmlmO2ZvbnQtc2l6ZToxMnB0
O2NvbG9yOiMwMDAwMDA7Ij48ZGl2PjwvZGl2PjxibG9ja3F1b3RlIHN0eWxlPSJib3JkZXItbGVm
dDoycHggc29saWQgIzEwMTBGRjtwYWRkaW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13ZWln
aHQ6bm9ybWFsO2ZvbnQtc3R5bGU6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFt
aWx5OkhlbHZldGljYSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGI+RnJvbTog
PC9iPiJHaXVzZXBwZSBSYWd1c2EiICZsdDtnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb20mZ3Q7
PGJyPjxiPlRvOiA8L2I+IlllZGlkeWFoIEJhciBEYXZpZCIgJmx0O2RpZGlAcmVkaGF0LmNvbSZn
dDs8YnI+PGI+Q2M6IDwvYj51c2Vyc0BvdmlydC5vcmc8YnI+PGI+U2VudDogPC9iPlNhdHVyZGF5
LCBNYXJjaCAxNSwgMjAxNCAyOjE1OjE4IEFNPGJyPjxiPlN1YmplY3Q6IDwvYj5SRTogW1VzZXJz
XSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJyb3I8YnI+PGRpdj48YnI+PC9kaXY+Cgo8c3R5
bGU+PCEtLQouRXh0ZXJuYWxDbGFzcyAuZWN4aG1tZXNzYWdlIFAgewpwYWRkaW5nOjBweDsKfQoK
LkV4dGVybmFsQ2xhc3MgYm9keS5lY3hobW1lc3NhZ2Ugewpmb250LXNpemU6MTJwdDsKZm9udC1m
YW1pbHk6Q2FsaWJyaTsKfQoKCi0tPjwvc3R5bGU+CjxkaXYgZGlyPSJsdHIiPkhpIERpZGksPGJy
PjxkaXY+PGJyPjwvZGl2PjxkaXY+PGhyIGlkPSJlY3hzdG9wU3BlbGxpbmciPkRhdGU6IFRodSwg
MTMgTWFyIDIwMTQgMDI6NDY6NTAgLTA0MDA8YnI+RnJvbTogZGlkaUByZWRoYXQuY29tPGJyPlRv
OiBnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb208YnI+Q0M6IHVzZXJzQG92aXJ0Lm9yZzxicj5T
dWJqZWN0OiBSZTogW1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJyb3I8YnI+PGRp
dj48YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6dGltZXMgbmV3IHJvbWFuLCBuZXcg
eW9yaywgdGltZXMsIHNlcmlmO2ZvbnQtc2l6ZToxMnB0O2NvbG9yOiMwMDAwMDA7Ij48ZGl2Pjwv
ZGl2PjxibG9ja3F1b3RlIHN0eWxlPSJib3JkZXItbGVmdDoycHggc29saWQgIzEwMTBGRjtwYWRk
aW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZvbnQtc3R5bGU6bm9y
bWFsO3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZldGljYSxBcmlhbCxzYW5z
LXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGI+RnJvbTogPC9iPiJHaXVzZXBwZSBSYWd1c2EiICZs
dDtnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb20mZ3Q7PGJyPjxiPlRvOiA8L2I+dXNlcnNAb3Zp
cnQub3JnPGJyPjxiPlNlbnQ6IDwvYj5UaHVyc2RheSwgTWFyY2ggMTMsIDIwMTQgMjozODo0MiBB
TTxicj48Yj5TdWJqZWN0OiA8L2I+W1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJy
b3I8YnI+PGRpdj48YnI+PC9kaXY+PHN0eWxlPjwhLS0KLkV4dGVybmFsQ2xhc3MgLmVjeGhtbWVz
c2FnZSBQIHsKcGFkZGluZzowcHg7Cn0KCi5FeHRlcm5hbENsYXNzIGJvZHkuZWN4aG1tZXNzYWdl
IHsKZm9udC1zaXplOjEycHQ7CmZvbnQtZmFtaWx5OkNhbGlicmk7Cn0KCgotLT48L3N0eWxlPjxk
aXYgZGlyPSJsdHIiPkhpIGFsbCw8YnI+d2hpbGUgYXR0ZW1wdGluZyBhIGZyb20tc2NyYXRjaCBz
ZWxmLWhvc3RlZC1lbmdpbmUgaW5zdGFsbGF0aW9uIG9uIENlbnRPUyA2LjUgKGFsc28gZnJlc2hs
eSByZWluc3RhbGxlZCBmcm9tIHNjcmF0Y2gpIG9uIGEgcGh5c2ljYWwgbm9kZSAob1ZpcnQgMy40
LjBfcHJlICsgR2x1c3RlckZTIDMuNS4wYmV0YTQ7IE5GUyBzdG9yYWdlIGZvciBlbmdpbmUgVk0p
LCB0aGUgcHJvY2VzcyBmYWlscyBhbG1vc3QgaW1tZWRpYXRlbHkgd2l0aDo8YnI+PGRpdj48YnI+
PC9kaXY+W3Jvb3RAY2x1c3RlcjEgfl0jIG92aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAgLS1jb25m
aWctYXBwZW5kPS9yb290L292aGUtc2V0dXAtYW5zd2Vycy5jb25mPGJyPlsgSU5GTyZuYnNwOyBd
IFN0YWdlOiBJbml0aWFsaXppbmc8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i
c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IENvbnRpbnVpbmcgd2lsbCBjb25maWd1cmUgdGhpcyBob3N0
IGZvciBzZXJ2aW5nIGFzIGh5cGVydmlzb3IgYW5kIGNyZWF0ZSBhIFZNIHdoZXJlIHlvdSBoYXZl
IHRvIGluc3RhbGwgb1ZpcnQgRW5naW5lIGFmdGVyd2FyZHMuPGJyPiZuYnNwOyZuYnNwOyZuYnNw
OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBBcmUgeW91IHN1cmUgeW91IHdh
bnQgdG8gY29udGludWU/IChZZXMsIE5vKVtZZXNdOjxicj5bIElORk8mbmJzcDsgXSBHZW5lcmF0
aW5nIGEgdGVtcG9yYXJ5IFZOQyBwYXNzd29yZC48YnI+WyBJTkZPJm5ic3A7IF0gU3RhZ2U6IEVu
dmlyb25tZW50IHNldHVwPGJyPiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu
YnNwOyZuYnNwOyZuYnNwOyBDb25maWd1cmF0aW9uIGZpbGVzOiBbJy9yb290L292aGUtc2V0dXAt
YW5zd2Vycy5jb25mJ108YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i
c3A7Jm5ic3A7Jm5ic3A7IExvZyBmaWxlOiAvdmFyL2xvZy9vdmlydC1ob3N0ZWQtZW5naW5lLXNl
dHVwL292aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAtMjAxNDAzMTMwMTA1MjYubG9nPGJyPiZuYnNw
OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBWZXJzaW9u
OiBvdG9waS0xLjIuMF9yYzMgKG90b3BpLTEuMi4wLTAuOS5yYzMuZWw2KTxicj5bIElORk8mbmJz
cDsgXSBIYXJkd2FyZSBzdXBwb3J0cyB2aXJ0dWFsaXphdGlvbjxicj5bIElORk8mbmJzcDsgXSBC
cmlkZ2Ugb3ZpcnRtZ210IGFscmVhZHkgY3JlYXRlZDxicj5bIElORk8mbmJzcDsgXSBTdGFnZTog
RW52aXJvbm1lbnQgcGFja2FnZXMgc2V0dXA8YnI+WyBJTkZPJm5ic3A7IF0gU3RhZ2U6IFByb2dy
YW1zIGRldGVjdGlvbjxicj5bIElORk8mbmJzcDsgXSBTdGFnZTogRW52aXJvbm1lbnQgc2V0dXA8
YnI+WyBJTkZPJm5ic3A7IF0gR2VuZXJhdGluZyBWRFNNIGNlcnRpZmljYXRlczxicj5bIEVSUk9S
IF0gRmFpbGVkIHRvIGV4ZWN1dGUgc3RhZ2UgJ0Vudmlyb25tZW50IHNldHVwJzogW0Vycm5vIDJd
IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3Rvcnk6ICcvZXRjL3BraS9saWJ2aXJ0L2NsaWVudGNlcnQu
cGVtJzwvZGl2PjwvYmxvY2txdW90ZT48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgYWxyZWFkeSBnb3Qg
YW5vdGhlciBzdWNoIHJlcG9ydCB5ZXN0ZXJkYXkgLSBzZWVtcyBsaWtlIGEgYnVnIGluIHRoZSBm
aXggZm9yJm5ic3A7PGEgaHJlZj0iaHR0cHM6Ly9idWd6aWxsYS5yZWRoYXQuY29tL3Nob3dfYnVn
LmNnaT9pZD0xMDM0NjM0IiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9idWd6aWxsYS5yZWRoYXQu
Y29tL3Nob3dfYnVnLmNnaT9pZD0xMDM0NjM0PC9hPiZuYnNwOy48L2Rpdj48ZGl2PkkgaG9wZSB0
byBwdXNoIGEgZml4IGxhdGVyIHRvZGF5Ljxicj48ZGl2Pjxicj48L2Rpdj5JIGxvb2sgZm9yd2Fy
ZCB0byBoYXZlIHRoZSBmaXggcHVzaGVkL21lcmdlZCBpbiBhY3R1YWwgcGFja2FnZXMuPGJyPjwv
ZGl2PjxkaXY+PGJyPjwvZGl2PjxibG9ja3F1b3RlIHN0eWxlPSJib3JkZXItbGVmdDoycHggc29s
aWQgIzEwMTBGRjtwYWRkaW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFs
O2ZvbnQtc3R5bGU6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZl
dGljYSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGRpdiBkaXI9Imx0ciI+PGJy
PlsgSU5GTyZuYnNwOyBdIFN0YWdlOiBDbGVhbiB1cDxicj5bIElORk8mbmJzcDsgXSBTdGFnZTog
UHJlLXRlcm1pbmF0aW9uPGJyPlsgSU5GTyZuYnNwOyBdIFN0YWdlOiBUZXJtaW5hdGlvbjxicj48
ZGl2Pjxicj48L2Rpdj5UaGUgL3Jvb3Qvb3ZoZS1zZXR1cC1hbnN3ZXJzLmNvbmYgaGFzIGJlZW4g
c2F2ZWQgZnJvbSBhIHByZXZpb3VzIGluc3RhbGxhdGlvbiAoYmVmb3JlIHJlaW5zdGFsbGluZykg
YW5kIG9ubHkgbWluaW1hbGx5IGVkaXRlZCAocmVtb3ZlZCBzb21lIGxpbmVzIHdpdGggVVVJRHMg
ZXRjLikuPGJyPjxkaXY+PGJyPjwvZGl2PlRoZSAvZXRjL3BraS9saWJ2aXJ0IGRpciBpcyBjb21w
bGV0ZWx5IG1pc3Npbmcgb24gYm90aCBub2RlczsgbGFzdCB0aW1lIEkgdHJpZWQgdGhlIHdob2xl
IHNldHVwIEkgZG8gbm90IHJlY2FsbCBvZiBoYXZpbmcgc3VjaCBwcm9ibGVtcywgYnV0IG1heWJl
IHNvbWV0aGluZyB3YXMgZGlmZmVyZW50IHRoZW4uPGJyPjxkaXY+PGJyPjwvZGl2PlRoZSBnZW5l
cmF0ZWQgL3Zhci9sb2cvb3ZpcnQtaG9zdGVkLWVuZ2luZS1zZXR1cC9vdmlydC1ob3N0ZWQtZW5n
aW5lLXNldHVwLTIwMTQwMzEzMDEwNTI2LmxvZyBoYXMgYmVlbiBzYXZlZCBhczo8YnI+PGRpdj48
YnI+PC9kaXY+aHR0cDovL3Bhc3RlYmluLmNvbS9lekFKRVRCTjxicj48ZGl2Pjxicj48L2Rpdj5J
IGhvcGUgdG8gYmUgYWJsZSB0byBwcm9ncmVzcyBmdXJ0aGVyIHRvIHRlc3QgdGhlIHdob2xlIDIt
bm9kZXMgc2V0dXAgKHNlY29uZCBub2RlIGZyZXNobHkgcmVpbnN0YWxsZWQgdG9vIGFuZCBhbHJl
YWR5IHVwIHdpdGggR2x1c3RlckZTIGFuZCB3YWl0aW5nIHRvIGJlIGFkZGVkIHRvIG9WaXJ0IGNs
dXN0ZXIpIGFuZCBkYXRhY2VudGVyIGNvbmZpZ3VyYXRpb24uPGJyPjxkaXY+PGJyPjwvZGl2Pk1h
bnkgdGhhbmtzIGluIGFkdmFuY2UgZm9yIGFueSBzdWdnZXN0aW9ucy9oZWxwLDwvZGl2PjwvYmxv
Y2txdW90ZT48ZGl2Pjxicj48L2Rpdj48ZGl2PkZvciBub3csIHlvdSBjYW4gc2ltcGx5OjwvZGl2
PjxkaXY+bWtkaXImbmJzcDs8c3BhbiBzdHlsZT0iZm9udC1mYW1pbHk6SGVsdmV0aWNhLCBBcmlh
bCwgc2Fucy1zZXJpZjsiPi9ldGMvcGtpL2xpYnZpcnQ8L3NwYW4+PC9kaXY+PGRpdj48YnI+PC9k
aXY+PGRpdj5UaGlzIHNob3VsZCBiZSBlbm91Z2guPGJyPjxkaXY+PGJyPjwvZGl2PlRoZSB3b3Jr
YXJvdW5kIHdvcmtzOiB0aGUgc2VsZi1ob3N0ZWQtZW5naW5lIGluc3RhbGxhdGlvbiBwcm9jZWVk
cyBub3cuPGJyPjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhhbmtzIGZvciB0aGUgcmVwb3J0
ITwvZGl2PjxkaXY+LS0gPGJyPjwvZGl2PjxkaXY+PHNwYW4+PC9zcGFuPkRpZGk8YnI+PHNwYW4+
PC9zcGFuPjxicj5NYW55IHRoYW5rcyBmb3IgeW91ciBraW5kIGFuZCBwcm9tcHQgYXNzaXN0YW5j
ZSw8YnI+R2l1c2VwcGU8YnI+PGRpdj48YnI+PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+IAkJIAkg
ICAJCSAgPC9kaXY+CjwvYmxvY2txdW90ZT48ZGl2Pjxicj5UaGFua3MgZm9yIHRoZSByZXBvcnQu
IFRoZSB3b3JrYXJvdW5kIGlzIHByb2JhYmx5IG5vdCBlbm91Z2gsIGRlcGVuZHMgb24gd2hhdCB5
b3U8L2Rpdj48ZGl2PmFyZSB0cnlpbmcgdG8gZG8uICdta2RpciAvZXRjL3BraS9saWJ2aXJ0L3By
aXZhdGUnIGlzIG5lZWRlZCB0b28uIFdpdGhvdXQgaXQsIHRoZSBjb2RlIHRoYXQ8L2Rpdj48ZGl2
PmNvcGllcyB0aGVyZSBhIGtleSB3aWxsIGNyZWF0ZSBhIGZpbGUgJ3ByaXZhdGUnIGluc3RlYWQg
b2YgY29weWluZyBpdCBpbnRvIGEgZGlyZWN0b3J5ICdwcml2YXRlJy48L2Rpdj48ZGl2Pjxicj48
L2Rpdj48ZGl2PkZpeCBbMV0gd2FzIG1lcmdlZCB0byBhbGwgYnJhbmNoZXMuPC9kaXY+PGRpdj48
YnI+PC9kaXY+PGRpdj5bMV0mbmJzcDs8YSBocmVmPSJodHRwOi8vZ2Vycml0Lm92aXJ0Lm9yZy8y
NTc0NyIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9nZXJyaXQub3ZpcnQub3JnLzI1NzQ3PC9hPjwv
ZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+QmVzdCByZWdhcmRzLDwvZGl2PjxkaXY+PHNwYW4gc3R5
bGU9ImZvbnQtc2l6ZToxMnB0OyI+LS0mbmJzcDs8L3NwYW4+PC9kaXY+PGRpdj48c3Bhbj48L3Nw
YW4+RGlkaTxicj48c3Bhbj48L3NwYW4+PGJyPkhpIERpZGksPGJyPnRoZSB3b3JrYXJvdW5kIHNl
ZW1lZCBhY3R1YWxseSB0byBiZSBlbm91Z2ggdG8gbWFrZSB0aGUgc2VsZi1ob3N0ZWQtZW5naW5l
IHNldHVwIGdvIHRocm91Z2ggdXAgdG8gdGhlIGVuZCB3aXRob3V0IGFueSB1c2VyLXZpc2libGUg
ZXJyb3IsIGJ1dCBpdCBsZWZ0IG1lIHdpdGggYSBub24tcnVubmluZyBFbmdpbmUgVk0gYWZ0ZXJ3
YXJkcyAoYmFzaWNhbGx5IGl0IGRpZCBub3QgcmVzdGFydCB1cCBhdXRvbWF0aWNhbGx5IHVuZGVy
IEhBIHByb3RlY3Rpb24pLjxicj48YnI+SSBjb2xsZWN0ZWQgYWxsIGxvZ3MgYW5kIHJlcG9ydGVk
IGl0IGluIGEgc2VwYXJhdGUgbWVzc2FnZSB3aXRoIHN1YmplY3QgIlNlbGYtaG9zdGVkIGVuZ2lu
ZSBzZXR1cCBvayBidXQgbm8gZW5naW5lIHZtIHJ1bm5pbmf+ICIgYnV0IGdvdCBubyBjb21tZW50
cyB5ZXQuPGJyPjxicj5JZiBJIGdldCBubyBzdWdnZXN0aW9ucyBJIHdpbGwgdHJ5IHRvIHBlcmZv
cm0gc29tZSAiY29ycmVjdGl2ZSBhY3Rpb25zIiBiYXNlZCBvbiBteSB1bmRlcnN0YW5kaW5nIG9m
IHRoZSBwcm9ibGVtcyBhdCBoYW5kLCBidXQgSSBkaWQgbm90IHdhbnQgdG8gImNvcnJ1cHQiIHRo
ZSBleGFjdCBzdGF0ZSB0byBoZWxwIGluIGRlYnVnZ2luZyAoc3RhcnRpbmcgYWdhaW4gZnJvbSBz
Y3JhdGNoIHdpdGggZnVsbCBmaXJzdCBub2RlIHJlaW5zdGFsbGF0aW9uIGlzIGEgc29tZXdoYXQg
bGVuZ2h0eSBwcm9jZXNzIHNpbmNlIEkgaGF2ZSBubyBsb2NhbCByZXBvIG1pcnJvcnMpLjxicj48
YnI+TWFueSB0aGFua3MgYWdhaW4sPGJyPkdpdXNlcHBlPGJyPjxicj48L2Rpdj48L2Rpdj48L2Rp
dj48L2Rpdj4KIAkJIAkgICAJCSAgPC9kaXY+Cjxicj5fX19fX19fX19fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fXwpVc2VycyBtYWlsaW5nIGxpc3QKVXNlcnNAb3ZpcnQub3Jn
Cmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VyczwvZGl2PiAJCSAJ
ICAgCQkgIDwvZGl2PjwvYm9keT4NCjwvaHRtbD4=
--_8711780c-91f0-4b4d-8c2f-fff1588abc18_--
8:46 a.m.
------=_Part_5747590_2051761120.1395560787350
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Hi Giuseppe,=20
----- Original Message -----
From: "Giuseppe Ragusa"
<giuseppe.ragusa(a)hotmail.com>
To: "Yedidyah Bar David" <didi(a)redhat.com>
Cc: users(a)ovirt.org
Sent: Sunday, March 23, 2014 1:34:04 AM
Subject: RE: [Users] Self-hosted-engine setup error
Hi Didi,
sorry for the delay in reporting final results.
I can confirm that simply creating /etc/pki/libvirt suffices: the
"privat=
e"
subdir gets automatically correctly created (along with all
certificates
etc.) and setup completes fine.
OK, thanks for reporting...=20
It did not start up because of BZ #1075126 (HA agent died) but I
noticed =
(by
chance) that there is an updated (18/03/2014) workaround and after
manual=
ly
applying it (no oVirt new packages have been published yet) the
Engine VM
started fine.
Now I'm battling with an (apparently) GlusterFS (3.5.0beta4) bug
that mak=
es
the (NFS based, but Gluster-provided) Engine storage domain shutdown
by
itself after a while (causing Engine VM to die).
Many thanks again for your support,
Giuseppe
PS: would you suggest a complete reinstall with GlusterFS 3.4.x
stable
instead? ;>
No idea, I have zero experience with glusterfs.=20
PS2: sorry for top-posting (but Hotmail keeps failing on proper
quoting..=
.)
:-(=20
--=20
Didi=20
From: giuseppe.ragusa(a)hotmail.com
To: didi(a)redhat.com
Date: Sun, 16 Mar 2014 15:14:07 +0100
CC: users(a)ovirt.org
Subject: Re: [Users] Self-hosted-engine setup error
Date: Sun, 16 Mar 2014 05:14:39 -0400
From: didi(a)redhat.com
To: giuseppe.ragusa(a)hotmail.com
CC: users(a)ovirt.org
Subject: Re: [Users] Self-hosted-engine setup error
> From: "Giuseppe Ragusa"
<giuseppe.ragusa(a)hotmail.com>
=20
> To: "Yedidyah Bar David" <didi(a)redhat.com>
=20
> Cc: users(a)ovirt.org
=20
> Sent: Saturday, March 15, 2014 2:15:18 AM
=20
> Subject: RE: [Users] Self-hosted-engine setup error
=20
> Hi Didi,
=20
> Date: Thu, 13 Mar 2014 02:46:50 -0400
=20
> From: didi(a)redhat.com
=20
> To: giuseppe.ragusa(a)hotmail.com
=20
> CC: users(a)ovirt.org
=20
> Subject: Re: [Users] Self-hosted-engine setup error
=20
> > From: "Giuseppe Ragusa"
<giuseppe.ragusa(a)hotmail.com>
>=20
=20
> > To: users(a)ovirt.org
>=20
=20
> > Sent: Thursday, March 13, 2014 2:38:42 AM
>=20
=20
> > Subject: [Users] Self-hosted-engine setup error
>=20
=20
> > Hi all,
>=20
=20
> > while attempting a from-scratch self-hosted-engine installation on Ce=
ntOS
> > 6.5
> > (also freshly reinstalled from scratch) on a physical node (oVirt
> > 3.4.0_pre
> > + GlusterFS 3.5.0beta4; NFS storage for engine VM), the process fails
> > almost
> > immediately with:
>=20
=20
> > [root@cluster1 ~]# ovirt-hosted-engine-setup
> > --config-append=3D/root/ovhe-setup-answers.conf
>=20
=20
> > [ INFO ] Stage: Initializing
>=20
=20
> > Continuing will configure this host for serving as hypervisor and cre=
ate
> > a
> > VM
> > where you have to install oVirt Engine afterwards.
>=20
=20
> > Are you sure you want to continue? (Yes, No)[Yes]:
>=20
=20
> > [ INFO ] Generating a temporary VNC password.
>=20
=20
> > [ INFO ] Stage: Environment setup
>=20
=20
> > Configuration files: ['/root/ovhe-setup-answers.conf']
>=20
=20
> > Log file:
> > /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313=
010526.log
>=20
=20
> > Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)
>=20
=20
> > [ INFO ] Hardware supports virtualization
>=20
=20
> > [ INFO ] Bridge ovirtmgmt already created
>=20
=20
> > [ INFO ] Stage: Environment packages setup
>=20
=20
> > [ INFO ] Stage: Programs detection
>=20
=20
> > [ INFO ] Stage: Environment setup
>=20
=20
> > [ INFO ] Generating VDSM certificates
>=20
=20
> > [ ERROR ] Failed to execute stage 'Environment setup': [Errno 2] No s=
uch
> > file
> > or directory: '/etc/pki/libvirt/clientcert.pem'
>=20
=20
> I already got another such report yesterday - seems like a bug
in the f=
ix
> for
> https://bugzilla.redhat.com/show_bug.cgi?id=3D1034634 .
=20
> I hope to push a fix later today.
=20
> I look forward to have the fix pushed/merged in actual
packages.
=20
> > [ INFO ] Stage: Clean up
>=20
=20
> > [ INFO ] Stage: Pre-termination
>=20
=20
> > [ INFO ] Stage: Termination
>=20
=20
> > The /root/ovhe-setup-answers.conf has been saved from a
previous
> > installation
> > (before reinstalling) and only minimally edited (removed some lines w=
ith
> > UUIDs etc.).
>=20
=20
> > The /etc/pki/libvirt dir is completely missing on both
nodes; last ti=
me I
> > tried the whole setup I do not recall of having such
problems, but ma=
ybe
> > something was different then.
>=20
=20
> > The generated
> > /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313=
010526.log
> > has been saved as:
>=20
=20
> > http://pastebin.com/ezAJETBN
>=20
=20
> > I hope to be able to progress further to test the whole
2-nodes setup
> > (second
> > node freshly reinstalled too and already up with GlusterFS and waitin=
g
to
> > be
> > added to oVirt cluster) and datacenter configuration.
>=20
=20
> > Many thanks in advance for any suggestions/help,
>=20
=20
> For now, you can simply:
=20
> mkdir /etc/pki/libvirt
=20
> This should be enough.
=20
> The workaround works: the self-hosted-engine installation
proceeds now.
=20
> Thanks for the report!
=20
> --
=20
> Didi
=20
> Many thanks for your kind and prompt assistance,
=20
> Giuseppe
=20
Thanks for the report. The workaround is probably not enough, depends
on =
what
you
are trying to do. 'mkdir /etc/pki/libvirt/private' is needed too. Without=
it,
the code that
copies there a key will create a file 'private' instead of copying it int=
o a
directory 'private'.
Fix [1] was merged to all branches.
Best regards,
--
Didi
Hi Didi,
the workaround seemed actually to be enough to make the self-hosted-engin=
e
setup go through up to the end without any user-visible error, but it
lef=
t
me with a non-running Engine VM afterwards (basically it did not
restart =
up
automatically under HA protection).
I collected all logs and reported it in a separate message with
subject
"Self-hosted engine setup ok but no engine vm running=E2=80=8F " but got =
no comments
yet.
If I get no suggestions I will try to perform some "corrective
actions" b=
ased
on my understanding of the problems at hand, but I did not want to
"corru=
pt"
the exact state to help in debugging (starting again from scratch
with fu=
ll
first node reinstallation is a somewhat lenghty process since I have
no
local repo mirrors).
Many thanks again,
Giuseppe
_______________________________________________ Users mailing list
Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--=20
Didi=20
------=_Part_5747590_2051761120.1395560787350
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable
<html><body><div style=3D"font-family: times new roman, new york,
times, se=
rif; font-size: 12pt; color: #000000"><div>Hi <span
style=3D"font-fami=
ly: Helvetica, Arial, sans-serif;" data-mce-style=3D"font-family: Helvetica=
, Arial,
sans-serif;">Giuseppe,</span></div><div><br></div><hr
id=3D"zwchr"=
<blockquote style=3D"border-left:2px solid
#1010FF;margin-left:5px;padding=
-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:n=
one;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From:
</b>"G=
iuseppe Ragusa" &lt;giuseppe.ragusa(a)hotmail.com&gt;<br><b>To:
</b>"Yedidyah=
Bar David" &lt;didi(a)redhat.com&gt;<br><b>Cc:
</b>users(a)ovirt.org<br><b>Sen=
t: </b>Sunday, March 23, 2014 1:34:04 AM<br><b>Subject: </b>RE:
[Users] Sel=
f-hosted-engine setup
error<br><div><br></div><style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 12pt;
font-family:Calibri
}
--></style><div dir=3D"ltr">Hi Didi,<br>sorry for the delay
in reporting fi=
nal results.<br><div><br></div>I can confirm that simply creating
/etc/pki/=
libvirt suffices: the "private" subdir gets automatically correctly created=
(along with all certificates etc.) and setup completes fine.</div></=
blockquote><div><br></div><div>OK, thanks for
reporting...</div><div><br></=
div><blockquote style=3D"border-left:2px solid #1010FF;margin-left:5px;padd=
ing-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoratio=
n:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><div
dir=3D"=
ltr"><br><div><br></div>It did not start up because of BZ
#1075126 (HA agen=
t died) but I noticed (by chance) that there is an updated (18/03/2014) wor=
karound and after manually applying it (no oVirt new packages have been pub=
lished yet) the Engine VM started fine.<br><div><br></div>Now
I'm battling =
with an (apparently) GlusterFS (3.5.0beta4) bug that makes the (NFS based, =
but Gluster-provided) Engine storage domain shutdown by itself after a whil=
e (causing Engine VM to die).<br><div><br></div>Many thanks again
for your =
support,<br>Giuseppe<br><div><br></div>PS: would you suggest
a complete rei=
nstall with GlusterFS 3.4.x stable instead?
;></div></blockquote><div><b=
r></div><div>No idea, I have zero experience with
glusterfs.</div><div><br>=
</div><blockquote style=3D"border-left:2px solid
#1010FF;margin-left:5px;pa=
dding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decorat=
ion:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><div dir=
=3D"ltr"><br><div><br></div>PS2: sorry for
top-posting (but Hotmail keeps f=
ailing on proper
quoting...)</div></blockquote><div><br></div><div>:-(</div=
<div>-- </div><div>Didi</div><div><br></div><blockquote
style=3D"bord=
er-left:2px solid
#1010FF;margin-left:5px;padding-left:5px;color:#000;font-=
weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,=
Arial,sans-serif;font-size:12pt;"><div
dir=3D"ltr"><br><div><br></div><div>=
<hr id=3D"stopSpelling">From: giuseppe.ragusa(a)hotmail.com<br>To:
didi@redha=
t.com<br>Date: Sun, 16 Mar 2014 15:14:07 +0100<br>CC:
users(a)ovirt.org<br>Su=
bject: Re: [Users] Self-hosted-engine setup
error<br><div><br></div><style>=
<!--
.ExternalClass .ecxhmmessage P {
padding:0px;
}
.ExternalClass body.ecxhmmessage {
font-size:12pt;
font-family:Calibri;
}
--></style><div dir=3D"ltr"><br><div
dir=3D"ltr"><div><hr id=3D"ecxstopSpel=
ling">Date: Sun, 16 Mar 2014 05:14:39 -0400<br>From:
didi@redhat.com<br>To:=
giuseppe.ragusa(a)hotmail.com<br>CC: users(a)ovirt.org<br>Subject: Re: [Users]=
Self-hosted-engine setup error<br><div><br></div><div
style=3D"font-family=
:times new roman, new york, times, serif;font-size:12pt;color:#000000;"><bl=
ockquote style=3D"border-left:2px solid #1010FF;padding-left:5px;color:#000=
;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helv=
etica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Giuseppe
Ragusa" <=
giuseppe.ragusa(a)hotmail.com&gt;<br><b>To: </b>"Yedidyah Bar
David" <didi=
@redhat.com><br><b>Cc:
</b>users(a)ovirt.org<br><b>Sent: </b>Saturday, Mar=
ch 15, 2014 2:15:18 AM<br><b>Subject: </b>RE: [Users] Self-hosted-engine
se=
tup error<br><div><br></div><style><!--
.ExternalClass .ecxhmmessage P {
padding:0px;
}
.ExternalClass body.ecxhmmessage {
font-size:12pt;
font-family:Calibri;
}
--></style><div dir=3D"ltr">Hi
Didi,<br><div><br></div><div><hr id=3D"ecxst=
opSpelling">Date: Thu, 13 Mar 2014 02:46:50 -0400<br>From:
didi(a)redhat.com<=
br>To: giuseppe.ragusa(a)hotmail.com<br>CC: users(a)ovirt.org<br>Subject: Re:
[=
Users] Self-hosted-engine setup error<br><div><br></div><div
style=3D"font-=
family:times new roman, new york, times, serif;font-size:12pt;color:#000000=
;"><blockquote style=3D"border-left:2px solid
#1010FF;padding-left:5px;colo=
r:#000;font-weight:normal;font-style:normal;text-decoration:none;font-famil=
y:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From:
</b>"Giuseppe Ragusa=
" &lt;giuseppe.ragusa(a)hotmail.com&gt;<br><b>To:
</b>users(a)ovirt.org<br><b>S=
ent: </b>Thursday, March 13, 2014 2:38:42 AM<br><b>Subject:
</b>[Users] Sel=
f-hosted-engine setup
error<br><div><br></div><style><!--
.ExternalClass .ecxhmmessage P {
padding:0px;
}
.ExternalClass body.ecxhmmessage {
font-size:12pt;
font-family:Calibri;
}
--></style><div dir=3D"ltr">Hi all,<br>while attempting a
from-scratch self=
-hosted-engine installation on CentOS 6.5 (also freshly reinstalled from sc=
ratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4; NFS stor=
age for engine VM), the process fails almost immediately
with:<br><div><br>=
</div>[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/=
ovhe-setup-answers.conf<br>[ INFO ] Stage:
Initializing<br> &nbs=
p; Continuing will
configure this=
host for serving as hypervisor and create a VM where you have to install o=
Virt Engine
afterwards.<br> =
Are you sure you want to continue? (Yes, No)[Yes]:<br>[ INFO
]=
Generating a temporary VNC password.<br>[ INFO ] Stage: Environment =
setup<br>
Configurati=
on files:
['/root/ovhe-setup-answers.conf']<br> &nbs=
p; Log file:
/var/log/ovirt-hosted-engine-setup/ovi=
rt-hosted-engine-setup-20140313010526.log<br> =
Version: otopi-1.2.0_rc3
(otopi-1.2.0-0.9.rc3.el6)=
<br>[ INFO ] Hardware supports virtualization<br>[ INFO ]
Bridg=
e ovirtmgmt already created<br>[ INFO ] Stage: Environment packages s=
etup<br>[ INFO ] Stage: Programs detection<br>[ INFO ]
Stage: E=
nvironment setup<br>[ INFO ] Generating VDSM certificates<br>[ ERROR
=
] Failed to execute stage 'Environment setup': [Errno 2] No such file or di=
rectory:
'/etc/pki/libvirt/clientcert.pem'</div></blockquote><div><br></div=
<div>I already got another such report yesterday - seems like a
bug in the=
fix for <a
href=3D"https://bugzilla.redhat.com/show_bug.cgi?id=3D1034=
634"
target=3D"_blank">https://bugzilla.redhat.com/show_bug.cgi?i...
4</a> .</div><div>I hope to push a fix later
today.<br><div><br></div>=
I look forward to have the fix pushed/merged in actual
packages.<br></div><=
div><br></div><blockquote style=3D"border-left:2px solid
#1010FF;padding-le=
ft:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none=
;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><div
dir=3D"ltr"><=
br>[ INFO ] Stage: Clean up<br>[ INFO ] Stage:
Pre-termination<=
br>[ INFO ] Stage: Termination<br><div><br></div>The
/root/ovhe-setup=
-answers.conf has been saved from a previous installation (before reinstall=
ing) and only minimally edited (removed some lines with UUIDs etc.).<br><di=
v><br></div>The /etc/pki/libvirt dir is completely missing on both nodes;
l=
ast time I tried the whole setup I do not recall of having such problems, b=
ut maybe something was different then.<br><div><br></div>The
generated /var=
/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log=
has been saved
as:<br><div><br></div>http://pastebin.com/ezAJETB...
<br></div>I hope to be able to progress further to test the whole 2-nodes s=
etup (second node freshly reinstalled too and already up with GlusterFS and=
waiting to be added to oVirt cluster) and datacenter configuration.<br><di=
v><br></div>Many thanks in advance for any
suggestions/help,</div></blockqu=
ote><div><br></div><div>For now, you can
simply:</div><div>mkdir <span=
style=3D"font-family:Helvetica, Arial,
sans-serif;">/etc/pki/libvirt</span=
</div><div><br></div><div>This should be
enough.<br><div><br></div>The wor=
karound works: the
self-hosted-engine installation proceeds now.<br></div><=
div><br></div><div>Thanks for the report!</div><div>--
<br></div><div>Didi<=
br><br>Many thanks for your kind and prompt
assistance,<br>Giuseppe<br><div=
<br></div></div></div></div></div></blockquote><div><br>Thanks
for the rep=
ort. The workaround is probably not enough, depends on what
you</div><div>a=
re trying to do. 'mkdir /etc/pki/libvirt/private' is needed too. Without it=
, the code that</div><div>copies there a key will create a file
'private' i=
nstead of copying it into a directory
'private'.</div><div><br></div><div>F=
ix [1] was merged to all
branches.</div><div><br></div><div>[1] <a hre=
f=3D"http://gerrit.ovirt.org/25747"
target=3D"_blank">http://gerrit.ovirt.o=
rg/25747</a></div><div><br></div><div>Best
regards,</div><div><span style=
=3D"font-size:12pt;">-- </span></div><div>Didi<br><br>Hi
Didi,<br>the =
workaround seemed actually to be enough to make the self-hosted-engine setu=
p go through up to the end without any user-visible error, but it left me w=
ith a non-running Engine VM afterwards (basically it did not restart up aut=
omatically under HA protection).<br><div><br></div>I collected all
logs and=
reported it in a separate message with subject "Self-hosted engine setup o=
k but no engine vm running=E2=80=8F " but got no comments
yet.<br><div><br>=
</div>If I get no suggestions I will try to perform some "corrective action=
s" based on my understanding of the problems at hand, but I did not want to=
"corrupt" the exact state to help in debugging (starting again from scratc=
h with full first node reinstallation is a somewhat lenghty process since I=
have no local repo mirrors).<br><div><br></div>Many thanks
again,<br>Giuse=
ppe<br><div><br></div></div></div></div></div></div><br>___________________=
____________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users</div></div><...
<br><br></div><div><br></div><div>--
<br></div><div><span name=3D"x"></span=
Didi<br><span
name=3D"x"></span><br></div></div></body></html>
------=_Part_5747590_2051761120.1395560787350--
3743
days inactive
3753
days old
6 comments
2 participants
participants (2)
-
Giuseppe Ragusa -
Yedidyah Bar David