[Users] Self-hosted-engine setup error
--_f31905e4-ea0b-4151-8ac2-28be84666cee_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi all=2C while attempting a from-scratch self-hosted-engine installation on CentOS 6= .5 (also freshly reinstalled from scratch) on a physical node (oVirt 3.4.0_= pre + GlusterFS 3.5.0beta4=3B NFS storage for engine VM)=2C the process fai= ls almost immediately with: [root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/ovhe-s= etup-answers.conf [ INFO ] Stage: Initializing Continuing will configure this host for serving as hypervisor and= create a VM where you have to install oVirt Engine afterwards. Are you sure you want to continue? (Yes=2C No)[Yes]: [ INFO ] Generating a temporary VNC password. [ INFO ] Stage: Environment setup Configuration files: ['/root/ovhe-setup-answers.conf'] Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-= setup-20140313010526.log Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6) [ INFO ] Hardware supports virtualization [ INFO ] Bridge ovirtmgmt already created [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup [ INFO ] Generating VDSM certificates [ ERROR ] Failed to execute stage 'Environment setup': [Errno 2] No such fi= le or directory: '/etc/pki/libvirt/clientcert.pem' [ INFO ] Stage: Clean up [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination The /root/ovhe-setup-answers.conf has been saved from a previous installati= on (before reinstalling) and only minimally edited (removed some lines with= UUIDs etc.). The /etc/pki/libvirt dir is completely missing on both nodes=3B last time I= tried the whole setup I do not recall of having such problems=2C but maybe= something was different then. The generated /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-= 20140313010526.log has been saved as: http://pastebin.com/ezAJETBN I hope to be able to progress further to test the whole 2-nodes setup (seco= nd node freshly reinstalled too and already up with GlusterFS and waiting t= o be added to oVirt cluster) and datacenter configuration. Many thanks in advance for any suggestions/help=2C Giuseppe = --_f31905e4-ea0b-4151-8ac2-28be84666cee_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable <html> <head> <style><!-- .hmmessage P { margin:0px=3B padding:0px } body.hmmessage { font-size: 12pt=3B font-family:Calibri } --></style></head> <body class=3D'hmmessage'><div dir=3D'ltr'>Hi all=2C<br>while attempting a = from-scratch self-hosted-engine installation on CentOS 6.5 (also freshly re= installed from scratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5= .0beta4=3B NFS storage for engine VM)=2C the process fails almost immediate= ly with:<br><br>[root@cluster1 ~]# ovirt-hosted-engine-setup --config-appen= d=3D/root/ovhe-setup-answers.conf<br>[ INFO =3B ] Stage: Initializing<b= r> =3B =3B =3B =3B =3B =3B =3B =3B =3B = Continuing will configure this host for serving as hypervisor and create a = VM where you have to install oVirt Engine afterwards.<br> =3B =3B&n= bsp=3B =3B =3B =3B =3B =3B =3B Are you sure you wan= t to continue? (Yes=2C No)[Yes]:<br>[ INFO =3B ] Generating a temporary= VNC password.<br>[ INFO =3B ] Stage: Environment setup<br> =3B&nbs= p=3B =3B =3B =3B =3B =3B =3B =3B Configuration = files: ['/root/ovhe-setup-answers.conf']<br> =3B =3B =3B = =3B =3B =3B =3B =3B =3B Log file: /var/log/ovirt-hosted= -engine-setup/ovirt-hosted-engine-setup-20140313010526.log<br> =3B = =3B =3B =3B =3B =3B =3B =3B =3B Version: otopi-= 1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)<br>[ INFO =3B ] Hardware supports v= irtualization<br>[ INFO =3B ] Bridge ovirtmgmt already created<br>[ INF= O =3B ] Stage: Environment packages setup<br>[ INFO =3B ] Stage: Pr= ograms detection<br>[ INFO =3B ] Stage: Environment setup<br>[ INFO&nbs= p=3B ] Generating VDSM certificates<br>[ ERROR ] Failed to execute stage 'E= nvironment setup': [Errno 2] No such file or directory: '/etc/pki/libvirt/c= lientcert.pem'<br>[ INFO =3B ] Stage: Clean up<br>[ INFO =3B ] Stag= e: Pre-termination<br>[ INFO =3B ] Stage: Termination<br><br>The /root/= ovhe-setup-answers.conf has been saved from a previous installation (before= reinstalling) and only minimally edited (removed some lines with UUIDs etc= .).<br><br>The /etc/pki/libvirt dir is completely missing on both nodes=3B = last time I tried the whole setup I do not recall of having such problems= =2C but maybe something was different then.<br><br>The generated /var/log/o= virt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log has b= een saved as:<br><br>http://pastebin.com/ezAJETBN<br><br>I hope to be able = to progress further to test the whole 2-nodes setup (second node freshly re= installed too and already up with GlusterFS and waiting to be added to oVir= t cluster) and datacenter configuration.<br><br>Many thanks in advance for = any suggestions/help=2C<br>Giuseppe<br><br> </div></body> </html>= --_f31905e4-ea0b-4151-8ac2-28be84666cee_--
------=_Part_19485849_1756403293.1394693210709 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit
From: "Giuseppe Ragusa" <giuseppe.ragusa@hotmail.com> To: users@ovirt.org Sent: Thursday, March 13, 2014 2:38:42 AM Subject: [Users] Self-hosted-engine setup error
Hi all, while attempting a from-scratch self-hosted-engine installation on CentOS 6.5 (also freshly reinstalled from scratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4; NFS storage for engine VM), the process fails almost immediately with:
[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=/root/ovhe-setup-answers.conf [ INFO ] Stage: Initializing Continuing will configure this host for serving as hypervisor and create a VM where you have to install oVirt Engine afterwards. Are you sure you want to continue? (Yes, No)[Yes]: [ INFO ] Generating a temporary VNC password. [ INFO ] Stage: Environment setup Configuration files: ['/root/ovhe-setup-answers.conf'] Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6) [ INFO ] Hardware supports virtualization [ INFO ] Bridge ovirtmgmt already created [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup [ INFO ] Generating VDSM certificates [ ERROR ] Failed to execute stage 'Environment setup': [Errno 2] No such file or directory: '/etc/pki/libvirt/clientcert.pem'
I already got another such report yesterday - seems like a bug in the fix for https://bugzilla.redhat.com/show_bug.cgi?id=1034634 . I hope to push a fix later today.
[ INFO ] Stage: Clean up [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination
The /root/ovhe-setup-answers.conf has been saved from a previous installation (before reinstalling) and only minimally edited (removed some lines with UUIDs etc.).
The /etc/pki/libvirt dir is completely missing on both nodes; last time I tried the whole setup I do not recall of having such problems, but maybe something was different then.
The generated /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log has been saved as:
I hope to be able to progress further to test the whole 2-nodes setup (second node freshly reinstalled too and already up with GlusterFS and waiting to be added to oVirt cluster) and datacenter configuration.
Many thanks in advance for any suggestions/help,
<div>I already got another such report yesterday - seems like a bug in the= fix for <a href=3D"https://bugzilla.redhat.com/show_bug.cgi?id=3D1034= 634" data-mce-href=3D"https://bugzilla.redhat.com/show_bug.cgi?id=3D1034634= ">https://bugzilla.redhat.com/show_bug.cgi?id=3D1034634</a> .</div><di= v>I hope to push a fix later today.</div><div><br></div><blockquote style= =3D"border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#0= 00;font-weight:normal;font-style:normal;text-decoration:none;font-family:He= lvetica,Arial,sans-serif;font-size:12pt;" data-mce-style=3D"border-left: 2p= x solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-wei= ght: normal; font-style: normal; text-decoration: none; font-family: Helvet= ica,Arial,sans-serif; font-size: 12pt;"><div dir=3D"ltr"><br>[ INFO ]= Stage: Clean up<br>[ INFO ] Stage: Pre-termination<br>[ INFO ]= Stage: Termination<br><div><br></div>The /root/ovhe-setup-answers.conf has= been saved from a previous installation (before reinstalling) and only min= imally edited (removed some lines with UUIDs etc.).<br><div><br></div>The /= etc/pki/libvirt dir is completely missing on both nodes; last time I tried =
For now, you can simply: mkdir /etc/pki/libvirt This should be enough. Thanks for the report! -- Didi ------=_Part_19485849_1756403293.1394693210709 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><div></div><blockquote style=3D"borde= r-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-w= eight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,A= rial,sans-serif;font-size:12pt;" data-mce-style=3D"border-left: 2px solid #= 1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: norm= al; font-style: normal; text-decoration: none; font-family: Helvetica,Arial= ,sans-serif; font-size: 12pt;"><b>From: </b>"Giuseppe Ragusa" <giuseppe.= ragusa@hotmail.com><br><b>To: </b>users@ovirt.org<br><b>Sent: </b>Thursd= ay, March 13, 2014 2:38:42 AM<br><b>Subject: </b>[Users] Self-hosted-engine= setup error<br><div><br></div><style><!-- .hmmessage P { margin:0px; padding:0px } body.hmmessage { font-size: 12pt; font-family:Calibri } --></style><div dir=3D"ltr">Hi all,<br>while attempting a from-scratch self= -hosted-engine installation on CentOS 6.5 (also freshly reinstalled from sc= ratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4; NFS stor= age for engine VM), the process fails almost immediately with:<br><div><br>= </div>[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/= ovhe-setup-answers.conf<br>[ INFO ] Stage: Initializing<br> &nbs= p; Continuing will configure this= host for serving as hypervisor and create a VM where you have to install o= Virt Engine afterwards.<br> = Are you sure you want to continue? (Yes, No)[Yes]:<br>[ INFO ]= Generating a temporary VNC password.<br>[ INFO ] Stage: Environment = setup<br> Configurati= on files: ['/root/ovhe-setup-answers.conf']<br> &nbs= p; Log file: /var/log/ovirt-hosted-engine-setup/ovi= rt-hosted-engine-setup-20140313010526.log<br> = Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)= <br>[ INFO ] Hardware supports virtualization<br>[ INFO ] Bridg= e ovirtmgmt already created<br>[ INFO ] Stage: Environment packages s= etup<br>[ INFO ] Stage: Programs detection<br>[ INFO ] Stage: E= nvironment setup<br>[ INFO ] Generating VDSM certificates<br>[ ERROR = ] Failed to execute stage 'Environment setup': [Errno 2] No such file or di= rectory: '/etc/pki/libvirt/clientcert.pem'</div></blockquote><div><br></div= the whole setup I do not recall of having such problems, but maybe somethin= g was different then.<br><div><br></div>The generated /var/log/ovirt-hosted= -engine-setup/ovirt-hosted-engine-setup-20140313010526.log has been saved a= s:<br><div><br></div>http://pastebin.com/ezAJETBN<br><div><br></div>I hope = to be able to progress further to test the whole 2-nodes setup (second node= freshly reinstalled too and already up with GlusterFS and waiting to be ad= ded to oVirt cluster) and datacenter configuration.<br><div><br></div>Many = thanks in advance for any suggestions/help,</div></blockquote><div><br></di= v><div>For now, you can simply:</div><div>mkdir <span style=3D"font-fa= mily: Helvetica, Arial, sans-serif;" data-mce-style=3D"font-family: Helveti= ca, Arial, sans-serif;">/etc/pki/libvirt</span></div><div><br></div><div>Th= is should be enough.</div><div><br></div><div>Thanks for the report!</div><= div>-- <br></div><div><span name=3D"x"></span>Didi<br><span name=3D"x"></sp= an><br></div></div></body></html> ------=_Part_19485849_1756403293.1394693210709--
--_505c5a17-3726-4b19-9312-8472b03ce7cd_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi Didi=2C Date: Thu=2C 13 Mar 2014 02:46:50 -0400 From: didi@redhat.com To: giuseppe.ragusa@hotmail.com CC: users@ovirt.org Subject: Re: [Users] Self-hosted-engine setup error From: "Giuseppe Ragusa" <giuseppe.ragusa@hotmail.com> To: users@ovirt.org Sent: Thursday=2C March 13=2C 2014 2:38:42 AM Subject: [Users] Self-hosted-engine setup error Hi all=2C while attempting a from-scratch self-hosted-engine installation on CentOS 6= .5 (also freshly reinstalled from scratch) on a physical node (oVirt 3.4.0_= pre + GlusterFS 3.5.0beta4=3B NFS storage for engine VM)=2C the process fai= ls almost immediately with: [root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/ovhe-s= etup-answers.conf [ INFO ] Stage: Initializing Continuing will configure this host for serving as hypervisor and= create a VM where you have to install oVirt Engine afterwards. Are you sure you want to continue? (Yes=2C No)[Yes]: [ INFO ] Generating a temporary VNC password. [ INFO ] Stage: Environment setup Configuration files: ['/root/ovhe-setup-answers.conf'] Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-= setup-20140313010526.log Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6) [ INFO ] Hardware supports virtualization [ INFO ] Bridge ovirtmgmt already created [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup [ INFO ] Generating VDSM certificates [ ERROR ] Failed to execute stage 'Environment setup': [Errno 2] No such fi= le or directory: '/etc/pki/libvirt/clientcert.pem' I already got another such report yesterday - seems like a bug in the fix f= or https://bugzilla.redhat.com/show_bug.cgi?id=3D1034634 .I hope to push a = fix later today. I look forward to have the fix pushed/merged in actual packages. [ INFO ] Stage: Clean up [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination The /root/ovhe-setup-answers.conf has been saved from a previous installati= on (before reinstalling) and only minimally edited (removed some lines with= UUIDs etc.). The /etc/pki/libvirt dir is completely missing on both nodes=3B last time I= tried the whole setup I do not recall of having such problems=2C but maybe= something was different then. The generated /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-= 20140313010526.log has been saved as: http://pastebin.com/ezAJETBN I hope to be able to progress further to test the whole 2-nodes setup (seco= nd node freshly reinstalled too and already up with GlusterFS and waiting t= o be added to oVirt cluster) and datacenter configuration. Many thanks in advance for any suggestions/help=2C For now=2C you can simply:mkdir /etc/pki/libvirt This should be enough. The workaround works: the self-hosted-engine installation proceeds now. Thanks for the report!--=20 Didi Many thanks for your kind and prompt assistance=2C Giuseppe = --_505c5a17-3726-4b19-9312-8472b03ce7cd_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable <html> <head> <style><!-- .hmmessage P { margin:0px=3B padding:0px } body.hmmessage { font-size: 12pt=3B font-family:Calibri } --></style></head> <body class=3D'hmmessage'><div dir=3D'ltr'>Hi Didi=2C<br><br><div><hr id=3D= "stopSpelling">Date: Thu=2C 13 Mar 2014 02:46:50 -0400<br>From: didi@redhat= .com<br>To: giuseppe.ragusa@hotmail.com<br>CC: users@ovirt.org<br>Subject: = Re: [Users] Self-hosted-engine setup error<br><br><div style=3D"font-family= :times new roman=2C new york=2C times=2C serif=3Bfont-size:12pt=3Bcolor:#00= 0000=3B"><div></div><blockquote style=3D"border-left:2px solid #1010FF=3Bpa= dding-left:5px=3Bcolor:#000=3Bfont-weight:normal=3Bfont-style:normal=3Btext= -decoration:none=3Bfont-family:Helvetica=2CArial=2Csans-serif=3Bfont-size:1= 2pt=3B" data-mce-style=3D"border-left: 2px solid #1010FF=3B margin-left: 5p= x=3B padding-left: 5px=3B color: #000=3B font-weight: normal=3B font-style:= normal=3B text-decoration: none=3B font-family: Helvetica=2CArial=2Csans-s= erif=3B font-size: 12pt=3B"><b>From: </b>"Giuseppe Ragusa" <=3Bgiuseppe.r= agusa@hotmail.com>=3B<br><b>To: </b>users@ovirt.org<br><b>Sent: </b>Thurs= day=2C March 13=2C 2014 2:38:42 AM<br><b>Subject: </b>[Users] Self-hosted-e= ngine setup error<br><div><br></div><style><!--=0A= .ExternalClass .ecxhmmessage P {=0A= padding:0px=3B=0A= }=0A= =0A= .ExternalClass body.ecxhmmessage {=0A= font-size:12pt=3B=0A= font-family:Calibri=3B=0A= }=0A= =0A= --></style><div dir=3D"ltr">Hi all=2C<br>while attempting a from-scratch se= lf-hosted-engine installation on CentOS 6.5 (also freshly reinstalled from = scratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4=3B NFS = storage for engine VM)=2C the process fails almost immediately with:<br><di= v><br></div>[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D= /root/ovhe-setup-answers.conf<br>[ INFO =3B ] Stage: Initializing<br>&n= bsp=3B =3B =3B =3B =3B =3B =3B =3B =3B Cont= inuing will configure this host for serving as hypervisor and create a VM w= here you have to install oVirt Engine afterwards.<br> =3B =3B = =3B =3B =3B =3B =3B =3B =3B Are you sure you want t= o continue? (Yes=2C No)[Yes]:<br>[ INFO =3B ] Generating a temporary VN= C password.<br>[ INFO =3B ] Stage: Environment setup<br> =3B = =3B =3B =3B =3B =3B =3B =3B =3B Configuration f= iles: ['/root/ovhe-setup-answers.conf']<br> =3B =3B =3B =3B= =3B =3B =3B =3B =3B Log file: /var/log/ovirt-hosted-en= gine-setup/ovirt-hosted-engine-setup-20140313010526.log<br> =3B =3B= =3B =3B =3B =3B =3B =3B =3B Version: otopi-1.2= .0_rc3 (otopi-1.2.0-0.9.rc3.el6)<br>[ INFO =3B ] Hardware supports virt= ualization<br>[ INFO =3B ] Bridge ovirtmgmt already created<br>[ INFO&n= bsp=3B ] Stage: Environment packages setup<br>[ INFO =3B ] Stage: Progr= ams detection<br>[ INFO =3B ] Stage: Environment setup<br>[ INFO = =3B ] Generating VDSM certificates<br>[ ERROR ] Failed to execute stage 'En= vironment setup': [Errno 2] No such file or directory: '/etc/pki/libvirt/cl= ientcert.pem'</div></blockquote><div><br></div><div>I already got another s= uch report yesterday - seems like a bug in the fix for =3B<a href=3D"ht= tps://bugzilla.redhat.com/show_bug.cgi?id=3D1034634" data-mce-href=3D"https= ://bugzilla.redhat.com/show_bug.cgi?id=3D1034634" target=3D"_blank">https:/= /bugzilla.redhat.com/show_bug.cgi?id=3D1034634</a> =3B.</div><div>I hop= e to push a fix later today.<br><br>I look forward to have the fix pushed/m= erged in actual packages.<br></div><div><br></div><blockquote style=3D"bord= er-left:2px solid #1010FF=3Bpadding-left:5px=3Bcolor:#000=3Bfont-weight:nor= mal=3Bfont-style:normal=3Btext-decoration:none=3Bfont-family:Helvetica=2CAr= ial=2Csans-serif=3Bfont-size:12pt=3B" data-mce-style=3D"border-left: 2px so= lid #1010FF=3B margin-left: 5px=3B padding-left: 5px=3B color: #000=3B font= -weight: normal=3B font-style: normal=3B text-decoration: none=3B font-fami= ly: Helvetica=2CArial=2Csans-serif=3B font-size: 12pt=3B"><div dir=3D"ltr">= <br>[ INFO =3B ] Stage: Clean up<br>[ INFO =3B ] Stage: Pre-termina= tion<br>[ INFO =3B ] Stage: Termination<br><div><br></div>The /root/ovh= e-setup-answers.conf has been saved from a previous installation (before re= installing) and only minimally edited (removed some lines with UUIDs etc.).= <br><div><br></div>The /etc/pki/libvirt dir is completely missing on both n= odes=3B last time I tried the whole setup I do not recall of having such pr= oblems=2C but maybe something was different then.<br><div><br></div>The gen= erated /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-2014031= 3010526.log has been saved as:<br><div><br></div>http://pastebin.com/ezAJET= BN<br><div><br></div>I hope to be able to progress further to test the whol= e 2-nodes setup (second node freshly reinstalled too and already up with Gl= usterFS and waiting to be added to oVirt cluster) and datacenter configurat= ion.<br><div><br></div>Many thanks in advance for any suggestions/help=2C</= div></blockquote><div><br></div><div>For now=2C you can simply:</div><div>m= kdir =3B<span style=3D"font-family:Helvetica=2C Arial=2C sans-serif=3B"= data-mce-style=3D"font-family: Helvetica=2C Arial=2C sans-serif=3B">/etc/p= ki/libvirt</span></div><div><br></div><div>This should be enough.<br><br>Th= e workaround works: the self-hosted-engine installation proceeds now.<br></= div><div><br></div><div>Thanks for the report!</div><div>-- <br></div><div>= <span></span>Didi<br><span></span><br>Many thanks for your kind and prompt = assistance=2C<br>Giuseppe<br><br></div></div></div> </div></body=
</html>= --_505c5a17-3726-4b19-9312-8472b03ce7cd_--
------=_Part_269393_882485354.1394961279967 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit
From: "Giuseppe Ragusa" <giuseppe.ragusa@hotmail.com> To: "Yedidyah Bar David" <didi@redhat.com> Cc: users@ovirt.org Sent: Saturday, March 15, 2014 2:15:18 AM Subject: RE: [Users] Self-hosted-engine setup error
Hi Didi,
Date: Thu, 13 Mar 2014 02:46:50 -0400 From: didi@redhat.com To: giuseppe.ragusa@hotmail.com CC: users@ovirt.org Subject: Re: [Users] Self-hosted-engine setup error
From: "Giuseppe Ragusa" <giuseppe.ragusa@hotmail.com>
To: users@ovirt.org
Sent: Thursday, March 13, 2014 2:38:42 AM
Subject: [Users] Self-hosted-engine setup error
Hi all,
while attempting a from-scratch self-hosted-engine installation on CentOS 6.5 (also freshly reinstalled from scratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4; NFS storage for engine VM), the process fails almost immediately with:
[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=/root/ovhe-setup-answers.conf
[ INFO ] Stage: Initializing
Continuing will configure this host for serving as hypervisor and create a VM where you have to install oVirt Engine afterwards.
Are you sure you want to continue? (Yes, No)[Yes]:
[ INFO ] Generating a temporary VNC password.
[ INFO ] Stage: Environment setup
Configuration files: ['/root/ovhe-setup-answers.conf']
Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log
Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)
[ INFO ] Hardware supports virtualization
[ INFO ] Bridge ovirtmgmt already created
[ INFO ] Stage: Environment packages setup
[ INFO ] Stage: Programs detection
[ INFO ] Stage: Environment setup
[ INFO ] Generating VDSM certificates
[ ERROR ] Failed to execute stage 'Environment setup': [Errno 2] No such file or directory: '/etc/pki/libvirt/clientcert.pem'
I already got another such report yesterday - seems like a bug in the fix for https://bugzilla.redhat.com/show_bug.cgi?id=1034634 . I hope to push a fix later today.
I look forward to have the fix pushed/merged in actual packages.
[ INFO ] Stage: Clean up
[ INFO ] Stage: Pre-termination
[ INFO ] Stage: Termination
The /root/ovhe-setup-answers.conf has been saved from a previous installation (before reinstalling) and only minimally edited (removed some lines with UUIDs etc.).
The /etc/pki/libvirt dir is completely missing on both nodes; last time I tried the whole setup I do not recall of having such problems, but maybe something was different then.
The generated /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log has been saved as:
I hope to be able to progress further to test the whole 2-nodes setup (second node freshly reinstalled too and already up with GlusterFS and waiting to be added to oVirt cluster) and datacenter configuration.
Many thanks in advance for any suggestions/help,
For now, you can simply: mkdir /etc/pki/libvirt
This should be enough.
The workaround works: the self-hosted-engine installation proceeds now.
Thanks for the report! -- Didi
Many thanks for your kind and prompt assistance, Giuseppe
<div>I already got another such report yesterday - seems like a bug in the= fix for <a href=3D"https://bugzilla.redhat.com/show_bug.cgi?id=3D1034= 634" target=3D"_blank">https://bugzilla.redhat.com/show_bug.cgi?id=3D103463= 4</a> .</div><div>I hope to push a fix later today.<br><div><br></div>= I look forward to have the fix pushed/merged in actual packages.<br></div><=
</div><div><br></div><div>This should be enough.<br><div><br></div>The wor= karound works: the self-hosted-engine installation proceeds now.<br></div><=
</span>Didi<br><span></span><br>Many thanks for your kind and prompt assis= tance,<br>Giuseppe<br><div><br></div></div></div></div> =09=09 =09 =09=09= </div> </blockquote><div><br>Thanks for the report. The workaround is probably not= enough, depends on what you</div><div>are trying to do. 'mkdir /etc/pki/li= bvirt/private' is needed too. Without it, the code that</div><div>copies th= ere a key will create a file 'private' instead of copying it into a directo= ry 'private'.</div><div><br></div><div>Fix [1] was merged to all branches.<= /div><div><br></div><div>[1] <a href=3D"http://gerrit.ovirt.org/25747"= http://gerrit.ovirt.org/25747</a></div><div><br></div><div>Best regards,</=
Thanks for the report. The workaround is probably not enough, depends on what you are trying to do. 'mkdir /etc/pki/libvirt/private' is needed too. Without it, the code that copies there a key will create a file 'private' instead of copying it into a directory 'private'. Fix [1] was merged to all branches. [1] http://gerrit.ovirt.org/25747 Best regards, -- Didi ------=_Part_269393_882485354.1394961279967 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><div></div><blockquote style=3D"borde= r-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-w= eight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,A= rial,sans-serif;font-size:12pt;"><b>From: </b>"Giuseppe Ragusa" <giusepp= e.ragusa@hotmail.com><br><b>To: </b>"Yedidyah Bar David" <didi@redhat= .com><br><b>Cc: </b>users@ovirt.org<br><b>Sent: </b>Saturday, March 15, = 2014 2:15:18 AM<br><b>Subject: </b>RE: [Users] Self-hosted-engine setup err= or<br><div><br></div> <style><!-- .hmmessage P { margin:0px; padding:0px } body.hmmessage { font-size: 12pt; font-family:Calibri } --></style> <div dir=3D"ltr">Hi Didi,<br><div><br></div><div><hr id=3D"stopSpelling">Da= te: Thu, 13 Mar 2014 02:46:50 -0400<br>From: didi@redhat.com<br>To: giusepp= e.ragusa@hotmail.com<br>CC: users@ovirt.org<br>Subject: Re: [Users] Self-ho= sted-engine setup error<br><div><br></div><div style=3D"font-family:times n= ew roman, new york, times, serif;font-size:12pt;color:#000000;"><div></div>= <blockquote style=3D"border-left:2px solid #1010FF;padding-left:5px;color:#= 000;font-weight:normal;font-style:normal;text-decoration:none;font-family:H= elvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Giuseppe Ragusa" &= lt;giuseppe.ragusa@hotmail.com><br><b>To: </b>users@ovirt.org<br><b>Sent= : </b>Thursday, March 13, 2014 2:38:42 AM<br><b>Subject: </b>[Users] Self-h= osted-engine setup error<br><div><br></div><style><!-- .ExternalClass .ecxhmmessage P { padding:0px; } .ExternalClass body.ecxhmmessage { font-size:12pt; font-family:Calibri; } --></style><div dir=3D"ltr">Hi all,<br>while attempting a from-scratch self= -hosted-engine installation on CentOS 6.5 (also freshly reinstalled from sc= ratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4; NFS stor= age for engine VM), the process fails almost immediately with:<br><div><br>= </div>[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/= ovhe-setup-answers.conf<br>[ INFO ] Stage: Initializing<br> &nbs= p; Continuing will configure this= host for serving as hypervisor and create a VM where you have to install o= Virt Engine afterwards.<br> = Are you sure you want to continue? (Yes, No)[Yes]:<br>[ INFO ]= Generating a temporary VNC password.<br>[ INFO ] Stage: Environment = setup<br> Configurati= on files: ['/root/ovhe-setup-answers.conf']<br> &nbs= p; Log file: /var/log/ovirt-hosted-engine-setup/ovi= rt-hosted-engine-setup-20140313010526.log<br> = Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)= <br>[ INFO ] Hardware supports virtualization<br>[ INFO ] Bridg= e ovirtmgmt already created<br>[ INFO ] Stage: Environment packages s= etup<br>[ INFO ] Stage: Programs detection<br>[ INFO ] Stage: E= nvironment setup<br>[ INFO ] Generating VDSM certificates<br>[ ERROR = ] Failed to execute stage 'Environment setup': [Errno 2] No such file or di= rectory: '/etc/pki/libvirt/clientcert.pem'</div></blockquote><div><br></div= div><br></div><blockquote style=3D"border-left:2px solid #1010FF;padding-le= ft:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none= ;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><div dir=3D"ltr"><= br>[ INFO ] Stage: Clean up<br>[ INFO ] Stage: Pre-termination<= br>[ INFO ] Stage: Termination<br><div><br></div>The /root/ovhe-setup= -answers.conf has been saved from a previous installation (before reinstall= ing) and only minimally edited (removed some lines with UUIDs etc.).<br><di= v><br></div>The /etc/pki/libvirt dir is completely missing on both nodes; l= ast time I tried the whole setup I do not recall of having such problems, b= ut maybe something was different then.<br><div><br></div>The generated /var= /log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log= has been saved as:<br><div><br></div>http://pastebin.com/ezAJETBN<br><div>= <br></div>I hope to be able to progress further to test the whole 2-nodes s= etup (second node freshly reinstalled too and already up with GlusterFS and= waiting to be added to oVirt cluster) and datacenter configuration.<br><di= v><br></div>Many thanks in advance for any suggestions/help,</div></blockqu= ote><div><br></div><div>For now, you can simply:</div><div>mkdir <span= style=3D"font-family:Helvetica, Arial, sans-serif;">/etc/pki/libvirt</span= div><br></div><div>Thanks for the report!</div><div>-- <br></div><div><span= div><div><span style=3D"font-size: 12pt;">-- </span></div><div><span n= ame=3D"x"></span>Didi<br><span name=3D"x"></span><br></div></div></body></h= tml> ------=_Part_269393_882485354.1394961279967--
--_c189dc68-9b60-4630-aa76-ab3facfb40b4_ Content-Type: text/plain; charset="windows-1256" Content-Transfer-Encoding: base64 DQpEYXRlOiBTdW4sIDE2IE1hciAyMDE0IDA1OjE0OjM5IC0wNDAwDQpGcm9tOiBkaWRpQHJlZGhh dC5jb20NClRvOiBnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb20NCkNDOiB1c2Vyc0BvdmlydC5v cmcNClN1YmplY3Q6IFJlOiBbVXNlcnNdIFNlbGYtaG9zdGVkLWVuZ2luZSBzZXR1cCBlcnJvcg0K DQpGcm9tOiAiR2l1c2VwcGUgUmFndXNhIiA8Z2l1c2VwcGUucmFndXNhQGhvdG1haWwuY29tPg0K VG86ICJZZWRpZHlhaCBCYXIgRGF2aWQiIDxkaWRpQHJlZGhhdC5jb20+DQpDYzogdXNlcnNAb3Zp cnQub3JnDQpTZW50OiBTYXR1cmRheSwgTWFyY2ggMTUsIDIwMTQgMjoxNToxOCBBTQ0KU3ViamVj dDogUkU6IFtVc2Vyc10gU2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGVycm9yDQoNCgoKCkhpIERp ZGksDQoNCkRhdGU6IFRodSwgMTMgTWFyIDIwMTQgMDI6NDY6NTAgLTA0MDANCkZyb206IGRpZGlA cmVkaGF0LmNvbQ0KVG86IGdpdXNlcHBlLnJhZ3VzYUBob3RtYWlsLmNvbQ0KQ0M6IHVzZXJzQG92 aXJ0Lm9yZw0KU3ViamVjdDogUmU6IFtVc2Vyc10gU2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGVy cm9yDQoNCkZyb206ICJHaXVzZXBwZSBSYWd1c2EiIDxnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5j b20+DQpUbzogdXNlcnNAb3ZpcnQub3JnDQpTZW50OiBUaHVyc2RheSwgTWFyY2ggMTMsIDIwMTQg MjozODo0MiBBTQ0KU3ViamVjdDogW1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJy b3INCg0KSGkgYWxsLA0Kd2hpbGUgYXR0ZW1wdGluZyBhIGZyb20tc2NyYXRjaCBzZWxmLWhvc3Rl ZC1lbmdpbmUgaW5zdGFsbGF0aW9uIG9uIENlbnRPUyA2LjUgKGFsc28gZnJlc2hseSByZWluc3Rh bGxlZCBmcm9tIHNjcmF0Y2gpIG9uIGEgcGh5c2ljYWwgbm9kZSAob1ZpcnQgMy40LjBfcHJlICsg R2x1c3RlckZTIDMuNS4wYmV0YTQ7IE5GUyBzdG9yYWdlIGZvciBlbmdpbmUgVk0pLCB0aGUgcHJv Y2VzcyBmYWlscyBhbG1vc3QgaW1tZWRpYXRlbHkgd2l0aDoNCg0KW3Jvb3RAY2x1c3RlcjEgfl0j IG92aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAgLS1jb25maWctYXBwZW5kPS9yb290L292aGUtc2V0 dXAtYW5zd2Vycy5jb25mDQpbIElORk8gIF0gU3RhZ2U6IEluaXRpYWxpemluZw0KICAgICAgICAg IENvbnRpbnVpbmcgd2lsbCBjb25maWd1cmUgdGhpcyBob3N0IGZvciBzZXJ2aW5nIGFzIGh5cGVy dmlzb3IgYW5kIGNyZWF0ZSBhIFZNIHdoZXJlIHlvdSBoYXZlIHRvIGluc3RhbGwgb1ZpcnQgRW5n aW5lIGFmdGVyd2FyZHMuDQogICAgICAgICAgQXJlIHlvdSBzdXJlIHlvdSB3YW50IHRvIGNvbnRp bnVlPyAoWWVzLCBObylbWWVzXToNClsgSU5GTyAgXSBHZW5lcmF0aW5nIGEgdGVtcG9yYXJ5IFZO QyBwYXNzd29yZC4NClsgSU5GTyAgXSBTdGFnZTogRW52aXJvbm1lbnQgc2V0dXANCiAgICAgICAg ICBDb25maWd1cmF0aW9uIGZpbGVzOiBbJy9yb290L292aGUtc2V0dXAtYW5zd2Vycy5jb25mJ10N CiAgICAgICAgICBMb2cgZmlsZTogL3Zhci9sb2cvb3ZpcnQtaG9zdGVkLWVuZ2luZS1zZXR1cC9v dmlydC1ob3N0ZWQtZW5naW5lLXNldHVwLTIwMTQwMzEzMDEwNTI2LmxvZw0KICAgICAgICAgIFZl cnNpb246IG90b3BpLTEuMi4wX3JjMyAob3RvcGktMS4yLjAtMC45LnJjMy5lbDYpDQpbIElORk8g IF0gSGFyZHdhcmUgc3VwcG9ydHMgdmlydHVhbGl6YXRpb24NClsgSU5GTyAgXSBCcmlkZ2Ugb3Zp cnRtZ210IGFscmVhZHkgY3JlYXRlZA0KWyBJTkZPICBdIFN0YWdlOiBFbnZpcm9ubWVudCBwYWNr YWdlcyBzZXR1cA0KWyBJTkZPICBdIFN0YWdlOiBQcm9ncmFtcyBkZXRlY3Rpb24NClsgSU5GTyAg XSBTdGFnZTogRW52aXJvbm1lbnQgc2V0dXANClsgSU5GTyAgXSBHZW5lcmF0aW5nIFZEU00gY2Vy dGlmaWNhdGVzDQpbIEVSUk9SIF0gRmFpbGVkIHRvIGV4ZWN1dGUgc3RhZ2UgJ0Vudmlyb25tZW50 IHNldHVwJzogW0Vycm5vIDJdIE5vIHN1Y2ggZmlsZSBvciBkaXJlY3Rvcnk6ICcvZXRjL3BraS9s aWJ2aXJ0L2NsaWVudGNlcnQucGVtJw0KSSBhbHJlYWR5IGdvdCBhbm90aGVyIHN1Y2ggcmVwb3J0 IHllc3RlcmRheSAtIHNlZW1zIGxpa2UgYSBidWcgaW4gdGhlIGZpeCBmb3IgaHR0cHM6Ly9idWd6 aWxsYS5yZWRoYXQuY29tL3Nob3dfYnVnLmNnaT9pZD0xMDM0NjM0IC5JIGhvcGUgdG8gcHVzaCBh IGZpeCBsYXRlciB0b2RheS4NCg0KSSBsb29rIGZvcndhcmQgdG8gaGF2ZSB0aGUgZml4IHB1c2hl ZC9tZXJnZWQgaW4gYWN0dWFsIHBhY2thZ2VzLg0KDQoNClsgSU5GTyAgXSBTdGFnZTogQ2xlYW4g dXANClsgSU5GTyAgXSBTdGFnZTogUHJlLXRlcm1pbmF0aW9uDQpbIElORk8gIF0gU3RhZ2U6IFRl cm1pbmF0aW9uDQoNClRoZSAvcm9vdC9vdmhlLXNldHVwLWFuc3dlcnMuY29uZiBoYXMgYmVlbiBz YXZlZCBmcm9tIGEgcHJldmlvdXMgaW5zdGFsbGF0aW9uIChiZWZvcmUgcmVpbnN0YWxsaW5nKSBh bmQgb25seSBtaW5pbWFsbHkgZWRpdGVkIChyZW1vdmVkIHNvbWUgbGluZXMgd2l0aCBVVUlEcyBl dGMuKS4NCg0KVGhlIC9ldGMvcGtpL2xpYnZpcnQgZGlyIGlzIGNvbXBsZXRlbHkgbWlzc2luZyBv biBib3RoIG5vZGVzOyBsYXN0IHRpbWUgSSB0cmllZCB0aGUgd2hvbGUgc2V0dXAgSSBkbyBub3Qg cmVjYWxsIG9mIGhhdmluZyBzdWNoIHByb2JsZW1zLCBidXQgbWF5YmUgc29tZXRoaW5nIHdhcyBk aWZmZXJlbnQgdGhlbi4NCg0KVGhlIGdlbmVyYXRlZCAvdmFyL2xvZy9vdmlydC1ob3N0ZWQtZW5n aW5lLXNldHVwL292aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAtMjAxNDAzMTMwMTA1MjYubG9nIGhh cyBiZWVuIHNhdmVkIGFzOg0KDQpodHRwOi8vcGFzdGViaW4uY29tL2V6QUpFVEJODQoNCkkgaG9w ZSB0byBiZSBhYmxlIHRvIHByb2dyZXNzIGZ1cnRoZXIgdG8gdGVzdCB0aGUgd2hvbGUgMi1ub2Rl cyBzZXR1cCAoc2Vjb25kIG5vZGUgZnJlc2hseSByZWluc3RhbGxlZCB0b28gYW5kIGFscmVhZHkg dXAgd2l0aCBHbHVzdGVyRlMgYW5kIHdhaXRpbmcgdG8gYmUgYWRkZWQgdG8gb1ZpcnQgY2x1c3Rl cikgYW5kIGRhdGFjZW50ZXIgY29uZmlndXJhdGlvbi4NCg0KTWFueSB0aGFua3MgaW4gYWR2YW5j ZSBmb3IgYW55IHN1Z2dlc3Rpb25zL2hlbHAsDQpGb3Igbm93LCB5b3UgY2FuIHNpbXBseTpta2Rp ciAvZXRjL3BraS9saWJ2aXJ0DQpUaGlzIHNob3VsZCBiZSBlbm91Z2guDQoNClRoZSB3b3JrYXJv dW5kIHdvcmtzOiB0aGUgc2VsZi1ob3N0ZWQtZW5naW5lIGluc3RhbGxhdGlvbiBwcm9jZWVkcyBu b3cuDQoNClRoYW5rcyBmb3IgdGhlIHJlcG9ydCEtLSANCkRpZGkNCg0KTWFueSB0aGFua3MgZm9y IHlvdXIga2luZCBhbmQgcHJvbXB0IGFzc2lzdGFuY2UsDQpHaXVzZXBwZQ0KDQogCQkgCSAgIAkJ ICAKDQpUaGFua3MgZm9yIHRoZSByZXBvcnQuIFRoZSB3b3JrYXJvdW5kIGlzIHByb2JhYmx5IG5v dCBlbm91Z2gsIGRlcGVuZHMgb24gd2hhdCB5b3VhcmUgdHJ5aW5nIHRvIGRvLiAnbWtkaXIgL2V0 Yy9wa2kvbGlidmlydC9wcml2YXRlJyBpcyBuZWVkZWQgdG9vLiBXaXRob3V0IGl0LCB0aGUgY29k ZSB0aGF0Y29waWVzIHRoZXJlIGEga2V5IHdpbGwgY3JlYXRlIGEgZmlsZSAncHJpdmF0ZScgaW5z dGVhZCBvZiBjb3B5aW5nIGl0IGludG8gYSBkaXJlY3RvcnkgJ3ByaXZhdGUnLg0KRml4IFsxXSB3 YXMgbWVyZ2VkIHRvIGFsbCBicmFuY2hlcy4NClsxXSBodHRwOi8vZ2Vycml0Lm92aXJ0Lm9yZy8y NTc0Nw0KQmVzdCByZWdhcmRzLC0tIERpZGkNCg0KSGkgRGlkaSwNCnRoZSB3b3JrYXJvdW5kIHNl ZW1lZCBhY3R1YWxseSB0byBiZSBlbm91Z2ggdG8gbWFrZSB0aGUgc2VsZi1ob3N0ZWQtZW5naW5l IHNldHVwIGdvIHRocm91Z2ggdXAgdG8gdGhlIGVuZCB3aXRob3V0IGFueSB1c2VyLXZpc2libGUg ZXJyb3IsIGJ1dCBpdCBsZWZ0IG1lIHdpdGggYSBub24tcnVubmluZyBFbmdpbmUgVk0gYWZ0ZXJ3 YXJkcyAoYmFzaWNhbGx5IGl0IGRpZCBub3QgcmVzdGFydCB1cCBhdXRvbWF0aWNhbGx5IHVuZGVy IEhBIHByb3RlY3Rpb24pLg0KDQpJIGNvbGxlY3RlZCBhbGwgbG9ncyBhbmQgcmVwb3J0ZWQgaXQg aW4gYSBzZXBhcmF0ZSBtZXNzYWdlIHdpdGggc3ViamVjdCAiU2VsZi1ob3N0ZWQgZW5naW5lIHNl dHVwIG9rIGJ1dCBubyBlbmdpbmUgdm0gcnVubmluZ/4gIiBidXQgZ290IG5vIGNvbW1lbnRzIHll dC4NCg0KSWYgSSBnZXQgbm8gc3VnZ2VzdGlvbnMgSSB3aWxsIHRyeSB0byBwZXJmb3JtIHNvbWUg ImNvcnJlY3RpdmUgYWN0aW9ucyIgYmFzZWQgb24gbXkgdW5kZXJzdGFuZGluZyBvZiB0aGUgcHJv YmxlbXMgYXQgaGFuZCwgYnV0IEkgZGlkIG5vdCB3YW50IHRvICJjb3JydXB0IiB0aGUgZXhhY3Qg c3RhdGUgdG8gaGVscCBpbiBkZWJ1Z2dpbmcgKHN0YXJ0aW5nIGFnYWluIGZyb20gc2NyYXRjaCB3 aXRoIGZ1bGwgZmlyc3Qgbm9kZSByZWluc3RhbGxhdGlvbiBpcyBhIHNvbWV3aGF0IGxlbmdodHkg cHJvY2VzcyBzaW5jZSBJIGhhdmUgbm8gbG9jYWwgcmVwbyBtaXJyb3JzKS4NCg0KTWFueSB0aGFu a3MgYWdhaW4sDQpHaXVzZXBwZQ0KDQoKIAkJIAkgICAJCSAg --_c189dc68-9b60-4630-aa76-ab3facfb40b4_ Content-Type: text/html; charset="windows-1256" Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxzdHlsZT48IS0tDQouaG1tZXNzYWdlIFANCnsNCm1hcmdpbjowcHg7 DQpwYWRkaW5nOjBweA0KfQ0KYm9keS5obW1lc3NhZ2UNCnsNCmZvbnQtc2l6ZTogMTJwdDsNCmZv bnQtZmFtaWx5OkNhbGlicmkNCn0NCi0tPjwvc3R5bGU+PC9oZWFkPg0KPGJvZHkgY2xhc3M9J2ht bWVzc2FnZSc+PGRpdiBkaXI9J2x0cic+PGJyPjxkaXYgZGlyPSJsdHIiPjxkaXY+PGhyIGlkPSJz dG9wU3BlbGxpbmciPkRhdGU6IFN1biwgMTYgTWFyIDIwMTQgMDU6MTQ6MzkgLTA0MDA8YnI+RnJv bTogZGlkaUByZWRoYXQuY29tPGJyPlRvOiBnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb208YnI+ Q0M6IHVzZXJzQG92aXJ0Lm9yZzxicj5TdWJqZWN0OiBSZTogW1VzZXJzXSBTZWxmLWhvc3RlZC1l bmdpbmUgc2V0dXAgZXJyb3I8YnI+PGJyPjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OnRpbWVzIG5l dyByb21hbiwgbmV3IHlvcmssIHRpbWVzLCBzZXJpZjtmb250LXNpemU6MTJwdDtjb2xvcjojMDAw MDAwOyI+PGRpdj48L2Rpdj48YmxvY2txdW90ZSBzdHlsZT0iYm9yZGVyLWxlZnQ6MnB4IHNvbGlk ICMxMDEwRkY7cGFkZGluZy1sZWZ0OjVweDtjb2xvcjojMDAwO2ZvbnQtd2VpZ2h0Om5vcm1hbDtm b250LXN0eWxlOm5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9uZTtmb250LWZhbWlseTpIZWx2ZXRp Y2EsQXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTJwdDsiPjxiPkZyb206IDwvYj4iR2l1c2Vw cGUgUmFndXNhIiAmbHQ7Z2l1c2VwcGUucmFndXNhQGhvdG1haWwuY29tJmd0Ozxicj48Yj5Ubzog PC9iPiJZZWRpZHlhaCBCYXIgRGF2aWQiICZsdDtkaWRpQHJlZGhhdC5jb20mZ3Q7PGJyPjxiPkNj OiA8L2I+dXNlcnNAb3ZpcnQub3JnPGJyPjxiPlNlbnQ6IDwvYj5TYXR1cmRheSwgTWFyY2ggMTUs IDIwMTQgMjoxNToxOCBBTTxicj48Yj5TdWJqZWN0OiA8L2I+UkU6IFtVc2Vyc10gU2VsZi1ob3N0 ZWQtZW5naW5lIHNldHVwIGVycm9yPGJyPjxkaXY+PGJyPjwvZGl2PgoKPHN0eWxlPjwhLS0KLkV4 dGVybmFsQ2xhc3MgLmVjeGhtbWVzc2FnZSBQIHsKcGFkZGluZzowcHg7Cn0KCi5FeHRlcm5hbENs YXNzIGJvZHkuZWN4aG1tZXNzYWdlIHsKZm9udC1zaXplOjEycHQ7CmZvbnQtZmFtaWx5OkNhbGli cmk7Cn0KCi0tPjwvc3R5bGU+CjxkaXYgZGlyPSJsdHIiPkhpIERpZGksPGJyPjxkaXY+PGJyPjwv ZGl2PjxkaXY+PGhyIGlkPSJlY3hzdG9wU3BlbGxpbmciPkRhdGU6IFRodSwgMTMgTWFyIDIwMTQg MDI6NDY6NTAgLTA0MDA8YnI+RnJvbTogZGlkaUByZWRoYXQuY29tPGJyPlRvOiBnaXVzZXBwZS5y YWd1c2FAaG90bWFpbC5jb208YnI+Q0M6IHVzZXJzQG92aXJ0Lm9yZzxicj5TdWJqZWN0OiBSZTog W1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJyb3I8YnI+PGRpdj48YnI+PC9kaXY+ PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6dGltZXMgbmV3IHJvbWFuLCBuZXcgeW9yaywgdGltZXMs IHNlcmlmO2ZvbnQtc2l6ZToxMnB0O2NvbG9yOiMwMDAwMDA7Ij48ZGl2PjwvZGl2PjxibG9ja3F1 b3RlIHN0eWxlPSJib3JkZXItbGVmdDoycHggc29saWQgIzEwMTBGRjtwYWRkaW5nLWxlZnQ6NXB4 O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZvbnQtc3R5bGU6bm9ybWFsO3RleHQtZGVj b3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZldGljYSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQt c2l6ZToxMnB0OyI+PGI+RnJvbTogPC9iPiJHaXVzZXBwZSBSYWd1c2EiICZsdDtnaXVzZXBwZS5y YWd1c2FAaG90bWFpbC5jb20mZ3Q7PGJyPjxiPlRvOiA8L2I+dXNlcnNAb3ZpcnQub3JnPGJyPjxi PlNlbnQ6IDwvYj5UaHVyc2RheSwgTWFyY2ggMTMsIDIwMTQgMjozODo0MiBBTTxicj48Yj5TdWJq ZWN0OiA8L2I+W1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJyb3I8YnI+PGRpdj48 YnI+PC9kaXY+PHN0eWxlPjwhLS0KLkV4dGVybmFsQ2xhc3MgLmVjeGhtbWVzc2FnZSBQIHsKcGFk ZGluZzowcHg7Cn0KCi5FeHRlcm5hbENsYXNzIGJvZHkuZWN4aG1tZXNzYWdlIHsKZm9udC1zaXpl OjEycHQ7CmZvbnQtZmFtaWx5OkNhbGlicmk7Cn0KCgotLT48L3N0eWxlPjxkaXYgZGlyPSJsdHIi PkhpIGFsbCw8YnI+d2hpbGUgYXR0ZW1wdGluZyBhIGZyb20tc2NyYXRjaCBzZWxmLWhvc3RlZC1l bmdpbmUgaW5zdGFsbGF0aW9uIG9uIENlbnRPUyA2LjUgKGFsc28gZnJlc2hseSByZWluc3RhbGxl ZCBmcm9tIHNjcmF0Y2gpIG9uIGEgcGh5c2ljYWwgbm9kZSAob1ZpcnQgMy40LjBfcHJlICsgR2x1 c3RlckZTIDMuNS4wYmV0YTQ7IE5GUyBzdG9yYWdlIGZvciBlbmdpbmUgVk0pLCB0aGUgcHJvY2Vz cyBmYWlscyBhbG1vc3QgaW1tZWRpYXRlbHkgd2l0aDo8YnI+PGRpdj48YnI+PC9kaXY+W3Jvb3RA Y2x1c3RlcjEgfl0jIG92aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAgLS1jb25maWctYXBwZW5kPS9y b290L292aGUtc2V0dXAtYW5zd2Vycy5jb25mPGJyPlsgSU5GTyZuYnNwOyBdIFN0YWdlOiBJbml0 aWFsaXppbmc8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IENvbnRpbnVpbmcgd2lsbCBjb25maWd1cmUgdGhpcyBob3N0IGZvciBzZXJ2aW5n IGFzIGh5cGVydmlzb3IgYW5kIGNyZWF0ZSBhIFZNIHdoZXJlIHlvdSBoYXZlIHRvIGluc3RhbGwg b1ZpcnQgRW5naW5lIGFmdGVyd2FyZHMuPGJyPiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBBcmUgeW91IHN1cmUgeW91IHdhbnQgdG8gY29udGlu dWU/IChZZXMsIE5vKVtZZXNdOjxicj5bIElORk8mbmJzcDsgXSBHZW5lcmF0aW5nIGEgdGVtcG9y YXJ5IFZOQyBwYXNzd29yZC48YnI+WyBJTkZPJm5ic3A7IF0gU3RhZ2U6IEVudmlyb25tZW50IHNl dHVwPGJyPiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyBDb25maWd1cmF0aW9uIGZpbGVzOiBbJy9yb290L292aGUtc2V0dXAtYW5zd2Vycy5jb25m J108YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IExvZyBmaWxlOiAvdmFyL2xvZy9vdmlydC1ob3N0ZWQtZW5naW5lLXNldHVwL292aXJ0LWhv c3RlZC1lbmdpbmUtc2V0dXAtMjAxNDAzMTMwMTA1MjYubG9nPGJyPiZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBWZXJzaW9uOiBvdG9waS0xLjIu MF9yYzMgKG90b3BpLTEuMi4wLTAuOS5yYzMuZWw2KTxicj5bIElORk8mbmJzcDsgXSBIYXJkd2Fy ZSBzdXBwb3J0cyB2aXJ0dWFsaXphdGlvbjxicj5bIElORk8mbmJzcDsgXSBCcmlkZ2Ugb3ZpcnRt Z210IGFscmVhZHkgY3JlYXRlZDxicj5bIElORk8mbmJzcDsgXSBTdGFnZTogRW52aXJvbm1lbnQg cGFja2FnZXMgc2V0dXA8YnI+WyBJTkZPJm5ic3A7IF0gU3RhZ2U6IFByb2dyYW1zIGRldGVjdGlv bjxicj5bIElORk8mbmJzcDsgXSBTdGFnZTogRW52aXJvbm1lbnQgc2V0dXA8YnI+WyBJTkZPJm5i c3A7IF0gR2VuZXJhdGluZyBWRFNNIGNlcnRpZmljYXRlczxicj5bIEVSUk9SIF0gRmFpbGVkIHRv IGV4ZWN1dGUgc3RhZ2UgJ0Vudmlyb25tZW50IHNldHVwJzogW0Vycm5vIDJdIE5vIHN1Y2ggZmls ZSBvciBkaXJlY3Rvcnk6ICcvZXRjL3BraS9saWJ2aXJ0L2NsaWVudGNlcnQucGVtJzwvZGl2Pjwv YmxvY2txdW90ZT48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgYWxyZWFkeSBnb3QgYW5vdGhlciBzdWNo IHJlcG9ydCB5ZXN0ZXJkYXkgLSBzZWVtcyBsaWtlIGEgYnVnIGluIHRoZSBmaXggZm9yJm5ic3A7 PGEgaHJlZj0iaHR0cHM6Ly9idWd6aWxsYS5yZWRoYXQuY29tL3Nob3dfYnVnLmNnaT9pZD0xMDM0 NjM0IiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9idWd6aWxsYS5yZWRoYXQuY29tL3Nob3dfYnVn LmNnaT9pZD0xMDM0NjM0PC9hPiZuYnNwOy48L2Rpdj48ZGl2PkkgaG9wZSB0byBwdXNoIGEgZml4 IGxhdGVyIHRvZGF5Ljxicj48ZGl2Pjxicj48L2Rpdj5JIGxvb2sgZm9yd2FyZCB0byBoYXZlIHRo ZSBmaXggcHVzaGVkL21lcmdlZCBpbiBhY3R1YWwgcGFja2FnZXMuPGJyPjwvZGl2PjxkaXY+PGJy PjwvZGl2PjxibG9ja3F1b3RlIHN0eWxlPSJib3JkZXItbGVmdDoycHggc29saWQgIzEwMTBGRjtw YWRkaW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZvbnQtc3R5bGU6 bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZldGljYSxBcmlhbCxz YW5zLXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGRpdiBkaXI9Imx0ciI+PGJyPlsgSU5GTyZuYnNw OyBdIFN0YWdlOiBDbGVhbiB1cDxicj5bIElORk8mbmJzcDsgXSBTdGFnZTogUHJlLXRlcm1pbmF0 aW9uPGJyPlsgSU5GTyZuYnNwOyBdIFN0YWdlOiBUZXJtaW5hdGlvbjxicj48ZGl2Pjxicj48L2Rp dj5UaGUgL3Jvb3Qvb3ZoZS1zZXR1cC1hbnN3ZXJzLmNvbmYgaGFzIGJlZW4gc2F2ZWQgZnJvbSBh IHByZXZpb3VzIGluc3RhbGxhdGlvbiAoYmVmb3JlIHJlaW5zdGFsbGluZykgYW5kIG9ubHkgbWlu aW1hbGx5IGVkaXRlZCAocmVtb3ZlZCBzb21lIGxpbmVzIHdpdGggVVVJRHMgZXRjLikuPGJyPjxk aXY+PGJyPjwvZGl2PlRoZSAvZXRjL3BraS9saWJ2aXJ0IGRpciBpcyBjb21wbGV0ZWx5IG1pc3Np bmcgb24gYm90aCBub2RlczsgbGFzdCB0aW1lIEkgdHJpZWQgdGhlIHdob2xlIHNldHVwIEkgZG8g bm90IHJlY2FsbCBvZiBoYXZpbmcgc3VjaCBwcm9ibGVtcywgYnV0IG1heWJlIHNvbWV0aGluZyB3 YXMgZGlmZmVyZW50IHRoZW4uPGJyPjxkaXY+PGJyPjwvZGl2PlRoZSBnZW5lcmF0ZWQgL3Zhci9s b2cvb3ZpcnQtaG9zdGVkLWVuZ2luZS1zZXR1cC9vdmlydC1ob3N0ZWQtZW5naW5lLXNldHVwLTIw MTQwMzEzMDEwNTI2LmxvZyBoYXMgYmVlbiBzYXZlZCBhczo8YnI+PGRpdj48YnI+PC9kaXY+aHR0 cDovL3Bhc3RlYmluLmNvbS9lekFKRVRCTjxicj48ZGl2Pjxicj48L2Rpdj5JIGhvcGUgdG8gYmUg YWJsZSB0byBwcm9ncmVzcyBmdXJ0aGVyIHRvIHRlc3QgdGhlIHdob2xlIDItbm9kZXMgc2V0dXAg KHNlY29uZCBub2RlIGZyZXNobHkgcmVpbnN0YWxsZWQgdG9vIGFuZCBhbHJlYWR5IHVwIHdpdGgg R2x1c3RlckZTIGFuZCB3YWl0aW5nIHRvIGJlIGFkZGVkIHRvIG9WaXJ0IGNsdXN0ZXIpIGFuZCBk YXRhY2VudGVyIGNvbmZpZ3VyYXRpb24uPGJyPjxkaXY+PGJyPjwvZGl2Pk1hbnkgdGhhbmtzIGlu IGFkdmFuY2UgZm9yIGFueSBzdWdnZXN0aW9ucy9oZWxwLDwvZGl2PjwvYmxvY2txdW90ZT48ZGl2 Pjxicj48L2Rpdj48ZGl2PkZvciBub3csIHlvdSBjYW4gc2ltcGx5OjwvZGl2PjxkaXY+bWtkaXIm bmJzcDs8c3BhbiBzdHlsZT0iZm9udC1mYW1pbHk6SGVsdmV0aWNhLCBBcmlhbCwgc2Fucy1zZXJp ZjsiPi9ldGMvcGtpL2xpYnZpcnQ8L3NwYW4+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5UaGlz IHNob3VsZCBiZSBlbm91Z2guPGJyPjxkaXY+PGJyPjwvZGl2PlRoZSB3b3JrYXJvdW5kIHdvcmtz OiB0aGUgc2VsZi1ob3N0ZWQtZW5naW5lIGluc3RhbGxhdGlvbiBwcm9jZWVkcyBub3cuPGJyPjwv ZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhhbmtzIGZvciB0aGUgcmVwb3J0ITwvZGl2PjxkaXY+ LS0gPGJyPjwvZGl2PjxkaXY+PHNwYW4+PC9zcGFuPkRpZGk8YnI+PHNwYW4+PC9zcGFuPjxicj5N YW55IHRoYW5rcyBmb3IgeW91ciBraW5kIGFuZCBwcm9tcHQgYXNzaXN0YW5jZSw8YnI+R2l1c2Vw cGU8YnI+PGRpdj48YnI+PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+IAkJIAkgICAJCSAgPC9kaXY+ CjwvYmxvY2txdW90ZT48ZGl2Pjxicj5UaGFua3MgZm9yIHRoZSByZXBvcnQuIFRoZSB3b3JrYXJv dW5kIGlzIHByb2JhYmx5IG5vdCBlbm91Z2gsIGRlcGVuZHMgb24gd2hhdCB5b3U8L2Rpdj48ZGl2 PmFyZSB0cnlpbmcgdG8gZG8uICdta2RpciAvZXRjL3BraS9saWJ2aXJ0L3ByaXZhdGUnIGlzIG5l ZWRlZCB0b28uIFdpdGhvdXQgaXQsIHRoZSBjb2RlIHRoYXQ8L2Rpdj48ZGl2PmNvcGllcyB0aGVy ZSBhIGtleSB3aWxsIGNyZWF0ZSBhIGZpbGUgJ3ByaXZhdGUnIGluc3RlYWQgb2YgY29weWluZyBp dCBpbnRvIGEgZGlyZWN0b3J5ICdwcml2YXRlJy48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PkZp eCBbMV0gd2FzIG1lcmdlZCB0byBhbGwgYnJhbmNoZXMuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRp dj5bMV0mbmJzcDs8YSBocmVmPSJodHRwOi8vZ2Vycml0Lm92aXJ0Lm9yZy8yNTc0NyIgdGFyZ2V0 PSJfYmxhbmsiPmh0dHA6Ly9nZXJyaXQub3ZpcnQub3JnLzI1NzQ3PC9hPjwvZGl2PjxkaXY+PGJy PjwvZGl2PjxkaXY+QmVzdCByZWdhcmRzLDwvZGl2PjxkaXY+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZToxMnB0OyI+LS0mbmJzcDs8L3NwYW4+PC9kaXY+PGRpdj48c3Bhbj48L3NwYW4+RGlkaTxicj48 c3Bhbj48L3NwYW4+PGJyPkhpIERpZGksPGJyPnRoZSB3b3JrYXJvdW5kIHNlZW1lZCBhY3R1YWxs eSB0byBiZSBlbm91Z2ggdG8gbWFrZSB0aGUgc2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGdvIHRo cm91Z2ggdXAgdG8gdGhlIGVuZCB3aXRob3V0IGFueSB1c2VyLXZpc2libGUgZXJyb3IsIGJ1dCBp dCBsZWZ0IG1lIHdpdGggYSBub24tcnVubmluZyBFbmdpbmUgVk0gYWZ0ZXJ3YXJkcyAoYmFzaWNh bGx5IGl0IGRpZCBub3QgcmVzdGFydCB1cCBhdXRvbWF0aWNhbGx5IHVuZGVyIEhBIHByb3RlY3Rp b24pLjxicj48YnI+SSBjb2xsZWN0ZWQgYWxsIGxvZ3MgYW5kIHJlcG9ydGVkIGl0IGluIGEgc2Vw YXJhdGUgbWVzc2FnZSB3aXRoIHN1YmplY3QgIlNlbGYtaG9zdGVkIGVuZ2luZSBzZXR1cCBvayBi dXQgbm8gZW5naW5lIHZtIHJ1bm5pbmf+ICIgYnV0IGdvdCBubyBjb21tZW50cyB5ZXQuPGJyPjxi cj5JZiBJIGdldCBubyBzdWdnZXN0aW9ucyBJIHdpbGwgdHJ5IHRvIHBlcmZvcm0gc29tZSAiY29y cmVjdGl2ZSBhY3Rpb25zIiBiYXNlZCBvbiBteSB1bmRlcnN0YW5kaW5nIG9mIHRoZSBwcm9ibGVt cyBhdCBoYW5kLCBidXQgSSBkaWQgbm90IHdhbnQgdG8gImNvcnJ1cHQiIHRoZSBleGFjdCBzdGF0 ZSB0byBoZWxwIGluIGRlYnVnZ2luZyAoc3RhcnRpbmcgYWdhaW4gZnJvbSBzY3JhdGNoIHdpdGgg ZnVsbCBmaXJzdCBub2RlIHJlaW5zdGFsbGF0aW9uIGlzIGEgc29tZXdoYXQgbGVuZ2h0eSBwcm9j ZXNzIHNpbmNlIEkgaGF2ZSBubyBsb2NhbCByZXBvIG1pcnJvcnMpLjxicj48YnI+TWFueSB0aGFu a3MgYWdhaW4sPGJyPkdpdXNlcHBlPGJyPjxicj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj4KIAkJ IAkgICAJCSAgPC9kaXY+PC9ib2R5Pg0KPC9odG1sPg== --_c189dc68-9b60-4630-aa76-ab3facfb40b4_--
--_8711780c-91f0-4b4d-8c2f-fff1588abc18_ Content-Type: text/plain; charset="windows-1256" Content-Transfer-Encoding: base64 SGkgRGlkaSwNCnNvcnJ5IGZvciB0aGUgZGVsYXkgaW4gcmVwb3J0aW5nIGZpbmFsIHJlc3VsdHMu DQoNCkkgY2FuIGNvbmZpcm0gdGhhdCBzaW1wbHkgY3JlYXRpbmcgL2V0Yy9wa2kvbGlidmlydCBz dWZmaWNlczogdGhlICJwcml2YXRlIiBzdWJkaXIgZ2V0cyBhdXRvbWF0aWNhbGx5IGNvcnJlY3Rs eSBjcmVhdGVkIChhbG9uZyB3aXRoIGFsbCBjZXJ0aWZpY2F0ZXMgZXRjLikgIGFuZCBzZXR1cCBj b21wbGV0ZXMgZmluZS4NCg0KSXQgZGlkIG5vdCBzdGFydCB1cCBiZWNhdXNlIG9mIEJaICMxMDc1 MTI2IChIQSBhZ2VudCBkaWVkKSBidXQgSSBub3RpY2VkIChieSBjaGFuY2UpIHRoYXQgdGhlcmUg aXMgYW4gdXBkYXRlZCAoMTgvMDMvMjAxNCkgd29ya2Fyb3VuZCBhbmQgYWZ0ZXIgbWFudWFsbHkg YXBwbHlpbmcgaXQgKG5vIG9WaXJ0IG5ldyBwYWNrYWdlcyBoYXZlIGJlZW4gcHVibGlzaGVkIHll dCkgdGhlIEVuZ2luZSBWTSBzdGFydGVkIGZpbmUuDQoNCk5vdyBJJ20gYmF0dGxpbmcgd2l0aCBh biAoYXBwYXJlbnRseSkgR2x1c3RlckZTICgzLjUuMGJldGE0KSBidWcgdGhhdCBtYWtlcyB0aGUg KE5GUyBiYXNlZCwgYnV0IEdsdXN0ZXItcHJvdmlkZWQpIEVuZ2luZSBzdG9yYWdlIGRvbWFpbiBz aHV0ZG93biBieSBpdHNlbGYgYWZ0ZXIgYSB3aGlsZSAoY2F1c2luZyBFbmdpbmUgVk0gdG8gZGll KS4NCg0KTWFueSB0aGFua3MgYWdhaW4gZm9yIHlvdXIgc3VwcG9ydCwNCkdpdXNlcHBlDQoNClBT OiB3b3VsZCB5b3Ugc3VnZ2VzdCBhIGNvbXBsZXRlIHJlaW5zdGFsbCB3aXRoIEdsdXN0ZXJGUyAz LjQueCBzdGFibGUgaW5zdGVhZD8gOz4NCg0KUFMyOiBzb3JyeSBmb3IgdG9wLXBvc3RpbmcgKGJ1 dCBIb3RtYWlsIGtlZXBzIGZhaWxpbmcgb24gcHJvcGVyIHF1b3RpbmcuLi4pDQoNCkZyb206IGdp dXNlcHBlLnJhZ3VzYUBob3RtYWlsLmNvbQ0KVG86IGRpZGlAcmVkaGF0LmNvbQ0KRGF0ZTogU3Vu LCAxNiBNYXIgMjAxNCAxNToxNDowNyArMDEwMA0KQ0M6IHVzZXJzQG92aXJ0Lm9yZw0KU3ViamVj dDogUmU6IFtVc2Vyc10gU2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGVycm9yDQoNCgoKCg0KRGF0 ZTogU3VuLCAxNiBNYXIgMjAxNCAwNToxNDozOSAtMDQwMA0KRnJvbTogZGlkaUByZWRoYXQuY29t DQpUbzogZ2l1c2VwcGUucmFndXNhQGhvdG1haWwuY29tDQpDQzogdXNlcnNAb3ZpcnQub3JnDQpT dWJqZWN0OiBSZTogW1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJyb3INCg0KRnJv bTogIkdpdXNlcHBlIFJhZ3VzYSIgPGdpdXNlcHBlLnJhZ3VzYUBob3RtYWlsLmNvbT4NClRvOiAi WWVkaWR5YWggQmFyIERhdmlkIiA8ZGlkaUByZWRoYXQuY29tPg0KQ2M6IHVzZXJzQG92aXJ0Lm9y Zw0KU2VudDogU2F0dXJkYXksIE1hcmNoIDE1LCAyMDE0IDI6MTU6MTggQU0NClN1YmplY3Q6IFJF OiBbVXNlcnNdIFNlbGYtaG9zdGVkLWVuZ2luZSBzZXR1cCBlcnJvcg0KDQoKCgpIaSBEaWRpLA0K DQpEYXRlOiBUaHUsIDEzIE1hciAyMDE0IDAyOjQ2OjUwIC0wNDAwDQpGcm9tOiBkaWRpQHJlZGhh dC5jb20NClRvOiBnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb20NCkNDOiB1c2Vyc0BvdmlydC5v cmcNClN1YmplY3Q6IFJlOiBbVXNlcnNdIFNlbGYtaG9zdGVkLWVuZ2luZSBzZXR1cCBlcnJvcg0K DQpGcm9tOiAiR2l1c2VwcGUgUmFndXNhIiA8Z2l1c2VwcGUucmFndXNhQGhvdG1haWwuY29tPg0K VG86IHVzZXJzQG92aXJ0Lm9yZw0KU2VudDogVGh1cnNkYXksIE1hcmNoIDEzLCAyMDE0IDI6Mzg6 NDIgQU0NClN1YmplY3Q6IFtVc2Vyc10gU2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGVycm9yDQoN CkhpIGFsbCwNCndoaWxlIGF0dGVtcHRpbmcgYSBmcm9tLXNjcmF0Y2ggc2VsZi1ob3N0ZWQtZW5n aW5lIGluc3RhbGxhdGlvbiBvbiBDZW50T1MgNi41IChhbHNvIGZyZXNobHkgcmVpbnN0YWxsZWQg ZnJvbSBzY3JhdGNoKSBvbiBhIHBoeXNpY2FsIG5vZGUgKG9WaXJ0IDMuNC4wX3ByZSArIEdsdXN0 ZXJGUyAzLjUuMGJldGE0OyBORlMgc3RvcmFnZSBmb3IgZW5naW5lIFZNKSwgdGhlIHByb2Nlc3Mg ZmFpbHMgYWxtb3N0IGltbWVkaWF0ZWx5IHdpdGg6DQoNCltyb290QGNsdXN0ZXIxIH5dIyBvdmly dC1ob3N0ZWQtZW5naW5lLXNldHVwIC0tY29uZmlnLWFwcGVuZD0vcm9vdC9vdmhlLXNldHVwLWFu c3dlcnMuY29uZg0KWyBJTkZPICBdIFN0YWdlOiBJbml0aWFsaXppbmcNCiAgICAgICAgICBDb250 aW51aW5nIHdpbGwgY29uZmlndXJlIHRoaXMgaG9zdCBmb3Igc2VydmluZyBhcyBoeXBlcnZpc29y IGFuZCBjcmVhdGUgYSBWTSB3aGVyZSB5b3UgaGF2ZSB0byBpbnN0YWxsIG9WaXJ0IEVuZ2luZSBh ZnRlcndhcmRzLg0KICAgICAgICAgIEFyZSB5b3Ugc3VyZSB5b3Ugd2FudCB0byBjb250aW51ZT8g KFllcywgTm8pW1llc106DQpbIElORk8gIF0gR2VuZXJhdGluZyBhIHRlbXBvcmFyeSBWTkMgcGFz c3dvcmQuDQpbIElORk8gIF0gU3RhZ2U6IEVudmlyb25tZW50IHNldHVwDQogICAgICAgICAgQ29u ZmlndXJhdGlvbiBmaWxlczogWycvcm9vdC9vdmhlLXNldHVwLWFuc3dlcnMuY29uZiddDQogICAg ICAgICAgTG9nIGZpbGU6IC92YXIvbG9nL292aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAvb3ZpcnQt aG9zdGVkLWVuZ2luZS1zZXR1cC0yMDE0MDMxMzAxMDUyNi5sb2cNCiAgICAgICAgICBWZXJzaW9u OiBvdG9waS0xLjIuMF9yYzMgKG90b3BpLTEuMi4wLTAuOS5yYzMuZWw2KQ0KWyBJTkZPICBdIEhh cmR3YXJlIHN1cHBvcnRzIHZpcnR1YWxpemF0aW9uDQpbIElORk8gIF0gQnJpZGdlIG92aXJ0bWdt dCBhbHJlYWR5IGNyZWF0ZWQNClsgSU5GTyAgXSBTdGFnZTogRW52aXJvbm1lbnQgcGFja2FnZXMg c2V0dXANClsgSU5GTyAgXSBTdGFnZTogUHJvZ3JhbXMgZGV0ZWN0aW9uDQpbIElORk8gIF0gU3Rh Z2U6IEVudmlyb25tZW50IHNldHVwDQpbIElORk8gIF0gR2VuZXJhdGluZyBWRFNNIGNlcnRpZmlj YXRlcw0KWyBFUlJPUiBdIEZhaWxlZCB0byBleGVjdXRlIHN0YWdlICdFbnZpcm9ubWVudCBzZXR1 cCc6IFtFcnJubyAyXSBObyBzdWNoIGZpbGUgb3IgZGlyZWN0b3J5OiAnL2V0Yy9wa2kvbGlidmly dC9jbGllbnRjZXJ0LnBlbScNCkkgYWxyZWFkeSBnb3QgYW5vdGhlciBzdWNoIHJlcG9ydCB5ZXN0 ZXJkYXkgLSBzZWVtcyBsaWtlIGEgYnVnIGluIHRoZSBmaXggZm9yIGh0dHBzOi8vYnVnemlsbGEu cmVkaGF0LmNvbS9zaG93X2J1Zy5jZ2k/aWQ9MTAzNDYzNCAuSSBob3BlIHRvIHB1c2ggYSBmaXgg bGF0ZXIgdG9kYXkuDQoNCkkgbG9vayBmb3J3YXJkIHRvIGhhdmUgdGhlIGZpeCBwdXNoZWQvbWVy Z2VkIGluIGFjdHVhbCBwYWNrYWdlcy4NCg0KDQpbIElORk8gIF0gU3RhZ2U6IENsZWFuIHVwDQpb IElORk8gIF0gU3RhZ2U6IFByZS10ZXJtaW5hdGlvbg0KWyBJTkZPICBdIFN0YWdlOiBUZXJtaW5h dGlvbg0KDQpUaGUgL3Jvb3Qvb3ZoZS1zZXR1cC1hbnN3ZXJzLmNvbmYgaGFzIGJlZW4gc2F2ZWQg ZnJvbSBhIHByZXZpb3VzIGluc3RhbGxhdGlvbiAoYmVmb3JlIHJlaW5zdGFsbGluZykgYW5kIG9u bHkgbWluaW1hbGx5IGVkaXRlZCAocmVtb3ZlZCBzb21lIGxpbmVzIHdpdGggVVVJRHMgZXRjLiku DQoNClRoZSAvZXRjL3BraS9saWJ2aXJ0IGRpciBpcyBjb21wbGV0ZWx5IG1pc3Npbmcgb24gYm90 aCBub2RlczsgbGFzdCB0aW1lIEkgdHJpZWQgdGhlIHdob2xlIHNldHVwIEkgZG8gbm90IHJlY2Fs bCBvZiBoYXZpbmcgc3VjaCBwcm9ibGVtcywgYnV0IG1heWJlIHNvbWV0aGluZyB3YXMgZGlmZmVy ZW50IHRoZW4uDQoNClRoZSBnZW5lcmF0ZWQgL3Zhci9sb2cvb3ZpcnQtaG9zdGVkLWVuZ2luZS1z ZXR1cC9vdmlydC1ob3N0ZWQtZW5naW5lLXNldHVwLTIwMTQwMzEzMDEwNTI2LmxvZyBoYXMgYmVl biBzYXZlZCBhczoNCg0KaHR0cDovL3Bhc3RlYmluLmNvbS9lekFKRVRCTg0KDQpJIGhvcGUgdG8g YmUgYWJsZSB0byBwcm9ncmVzcyBmdXJ0aGVyIHRvIHRlc3QgdGhlIHdob2xlIDItbm9kZXMgc2V0 dXAgKHNlY29uZCBub2RlIGZyZXNobHkgcmVpbnN0YWxsZWQgdG9vIGFuZCBhbHJlYWR5IHVwIHdp dGggR2x1c3RlckZTIGFuZCB3YWl0aW5nIHRvIGJlIGFkZGVkIHRvIG9WaXJ0IGNsdXN0ZXIpIGFu ZCBkYXRhY2VudGVyIGNvbmZpZ3VyYXRpb24uDQoNCk1hbnkgdGhhbmtzIGluIGFkdmFuY2UgZm9y IGFueSBzdWdnZXN0aW9ucy9oZWxwLA0KRm9yIG5vdywgeW91IGNhbiBzaW1wbHk6bWtkaXIgL2V0 Yy9wa2kvbGlidmlydA0KVGhpcyBzaG91bGQgYmUgZW5vdWdoLg0KDQpUaGUgd29ya2Fyb3VuZCB3 b3JrczogdGhlIHNlbGYtaG9zdGVkLWVuZ2luZSBpbnN0YWxsYXRpb24gcHJvY2VlZHMgbm93Lg0K DQpUaGFua3MgZm9yIHRoZSByZXBvcnQhLS0gDQpEaWRpDQoNCk1hbnkgdGhhbmtzIGZvciB5b3Vy IGtpbmQgYW5kIHByb21wdCBhc3Npc3RhbmNlLA0KR2l1c2VwcGUNCg0KIAkJIAkgICAJCSAgCg0K VGhhbmtzIGZvciB0aGUgcmVwb3J0LiBUaGUgd29ya2Fyb3VuZCBpcyBwcm9iYWJseSBub3QgZW5v dWdoLCBkZXBlbmRzIG9uIHdoYXQgeW91YXJlIHRyeWluZyB0byBkby4gJ21rZGlyIC9ldGMvcGtp L2xpYnZpcnQvcHJpdmF0ZScgaXMgbmVlZGVkIHRvby4gV2l0aG91dCBpdCwgdGhlIGNvZGUgdGhh dGNvcGllcyB0aGVyZSBhIGtleSB3aWxsIGNyZWF0ZSBhIGZpbGUgJ3ByaXZhdGUnIGluc3RlYWQg b2YgY29weWluZyBpdCBpbnRvIGEgZGlyZWN0b3J5ICdwcml2YXRlJy4NCkZpeCBbMV0gd2FzIG1l cmdlZCB0byBhbGwgYnJhbmNoZXMuDQpbMV0gaHR0cDovL2dlcnJpdC5vdmlydC5vcmcvMjU3NDcN CkJlc3QgcmVnYXJkcywtLSBEaWRpDQoNCkhpIERpZGksDQp0aGUgd29ya2Fyb3VuZCBzZWVtZWQg YWN0dWFsbHkgdG8gYmUgZW5vdWdoIHRvIG1ha2UgdGhlIHNlbGYtaG9zdGVkLWVuZ2luZSBzZXR1 cCBnbyB0aHJvdWdoIHVwIHRvIHRoZSBlbmQgd2l0aG91dCBhbnkgdXNlci12aXNpYmxlIGVycm9y LCBidXQgaXQgbGVmdCBtZSB3aXRoIGEgbm9uLXJ1bm5pbmcgRW5naW5lIFZNIGFmdGVyd2FyZHMg KGJhc2ljYWxseSBpdCBkaWQgbm90IHJlc3RhcnQgdXAgYXV0b21hdGljYWxseSB1bmRlciBIQSBw cm90ZWN0aW9uKS4NCg0KSSBjb2xsZWN0ZWQgYWxsIGxvZ3MgYW5kIHJlcG9ydGVkIGl0IGluIGEg c2VwYXJhdGUgbWVzc2FnZSB3aXRoIHN1YmplY3QgIlNlbGYtaG9zdGVkIGVuZ2luZSBzZXR1cCBv ayBidXQgbm8gZW5naW5lIHZtIHJ1bm5pbmf+ICIgYnV0IGdvdCBubyBjb21tZW50cyB5ZXQuDQoN CklmIEkgZ2V0IG5vIHN1Z2dlc3Rpb25zIEkgd2lsbCB0cnkgdG8gcGVyZm9ybSBzb21lICJjb3Jy ZWN0aXZlIGFjdGlvbnMiIGJhc2VkIG9uIG15IHVuZGVyc3RhbmRpbmcgb2YgdGhlIHByb2JsZW1z IGF0IGhhbmQsIGJ1dCBJIGRpZCBub3Qgd2FudCB0byAiY29ycnVwdCIgdGhlIGV4YWN0IHN0YXRl IHRvIGhlbHAgaW4gZGVidWdnaW5nIChzdGFydGluZyBhZ2FpbiBmcm9tIHNjcmF0Y2ggd2l0aCBm dWxsIGZpcnN0IG5vZGUgcmVpbnN0YWxsYXRpb24gaXMgYSBzb21ld2hhdCBsZW5naHR5IHByb2Nl c3Mgc2luY2UgSSBoYXZlIG5vIGxvY2FsIHJlcG8gbWlycm9ycykuDQoNCk1hbnkgdGhhbmtzIGFn YWluLA0KR2l1c2VwcGUNCg0KCiAJCSAJICAgCQkgIAoNCl9fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fClVzZXJzIG1haWxpbmcgbGlzdApVc2Vyc0BvdmlydC5v cmcKaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIAkJIAkgICAJ CSAg --_8711780c-91f0-4b4d-8c2f-fff1588abc18_ Content-Type: text/html; charset="windows-1256" Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxzdHlsZT48IS0tDQouaG1tZXNzYWdlIFANCnsNCm1hcmdpbjowcHg7 DQpwYWRkaW5nOjBweA0KfQ0KYm9keS5obW1lc3NhZ2UNCnsNCmZvbnQtc2l6ZTogMTJwdDsNCmZv bnQtZmFtaWx5OkNhbGlicmkNCn0NCi0tPjwvc3R5bGU+PC9oZWFkPg0KPGJvZHkgY2xhc3M9J2ht bWVzc2FnZSc+PGRpdiBkaXI9J2x0cic+SGkgRGlkaSw8YnI+c29ycnkgZm9yIHRoZSBkZWxheSBp biByZXBvcnRpbmcgZmluYWwgcmVzdWx0cy48YnI+PGJyPkkgY2FuIGNvbmZpcm0gdGhhdCBzaW1w bHkgY3JlYXRpbmcgL2V0Yy9wa2kvbGlidmlydCBzdWZmaWNlczogdGhlICJwcml2YXRlIiBzdWJk aXIgZ2V0cyBhdXRvbWF0aWNhbGx5IGNvcnJlY3RseSBjcmVhdGVkIChhbG9uZyB3aXRoIGFsbCBj ZXJ0aWZpY2F0ZXMgZXRjLikmbmJzcDsgYW5kIHNldHVwIGNvbXBsZXRlcyBmaW5lLjxicj48YnI+ SXQgZGlkIG5vdCBzdGFydCB1cCBiZWNhdXNlIG9mIEJaICMxMDc1MTI2IChIQSBhZ2VudCBkaWVk KSBidXQgSSBub3RpY2VkIChieSBjaGFuY2UpIHRoYXQgdGhlcmUgaXMgYW4gdXBkYXRlZCAoMTgv MDMvMjAxNCkgd29ya2Fyb3VuZCBhbmQgYWZ0ZXIgbWFudWFsbHkgYXBwbHlpbmcgaXQgKG5vIG9W aXJ0IG5ldyBwYWNrYWdlcyBoYXZlIGJlZW4gcHVibGlzaGVkIHlldCkgdGhlIEVuZ2luZSBWTSBz dGFydGVkIGZpbmUuPGJyPjxicj5Ob3cgSSdtIGJhdHRsaW5nIHdpdGggYW4gKGFwcGFyZW50bHkp IEdsdXN0ZXJGUyAoMy41LjBiZXRhNCkgYnVnIHRoYXQgbWFrZXMgdGhlIChORlMgYmFzZWQsIGJ1 dCBHbHVzdGVyLXByb3ZpZGVkKSBFbmdpbmUgc3RvcmFnZSBkb21haW4gc2h1dGRvd24gYnkgaXRz ZWxmIGFmdGVyIGEgd2hpbGUgKGNhdXNpbmcgRW5naW5lIFZNIHRvIGRpZSkuPGJyPjxicj5NYW55 IHRoYW5rcyBhZ2FpbiBmb3IgeW91ciBzdXBwb3J0LDxicj5HaXVzZXBwZTxicj48YnI+UFM6IHdv dWxkIHlvdSBzdWdnZXN0IGEgY29tcGxldGUgcmVpbnN0YWxsIHdpdGggR2x1c3RlckZTIDMuNC54 IHN0YWJsZSBpbnN0ZWFkPyA7Jmd0Ozxicj48YnI+UFMyOiBzb3JyeSBmb3IgdG9wLXBvc3Rpbmcg KGJ1dCBIb3RtYWlsIGtlZXBzIGZhaWxpbmcgb24gcHJvcGVyIHF1b3RpbmcuLi4pPGJyPjxicj48 ZGl2PjxociBpZD0ic3RvcFNwZWxsaW5nIj5Gcm9tOiBnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5j b208YnI+VG86IGRpZGlAcmVkaGF0LmNvbTxicj5EYXRlOiBTdW4sIDE2IE1hciAyMDE0IDE1OjE0 OjA3ICswMTAwPGJyPkNDOiB1c2Vyc0BvdmlydC5vcmc8YnI+U3ViamVjdDogUmU6IFtVc2Vyc10g U2VsZi1ob3N0ZWQtZW5naW5lIHNldHVwIGVycm9yPGJyPjxicj4KCjxzdHlsZT48IS0tCi5FeHRl cm5hbENsYXNzIC5lY3hobW1lc3NhZ2UgUCB7CnBhZGRpbmc6MHB4Owp9CgouRXh0ZXJuYWxDbGFz cyBib2R5LmVjeGhtbWVzc2FnZSB7CmZvbnQtc2l6ZToxMnB0Owpmb250LWZhbWlseTpDYWxpYnJp Owp9CgotLT48L3N0eWxlPgo8ZGl2IGRpcj0ibHRyIj48YnI+PGRpdiBkaXI9Imx0ciI+PGRpdj48 aHIgaWQ9ImVjeHN0b3BTcGVsbGluZyI+RGF0ZTogU3VuLCAxNiBNYXIgMjAxNCAwNToxNDozOSAt MDQwMDxicj5Gcm9tOiBkaWRpQHJlZGhhdC5jb208YnI+VG86IGdpdXNlcHBlLnJhZ3VzYUBob3Rt YWlsLmNvbTxicj5DQzogdXNlcnNAb3ZpcnQub3JnPGJyPlN1YmplY3Q6IFJlOiBbVXNlcnNdIFNl bGYtaG9zdGVkLWVuZ2luZSBzZXR1cCBlcnJvcjxicj48YnI+PGRpdiBzdHlsZT0iZm9udC1mYW1p bHk6dGltZXMgbmV3IHJvbWFuLCBuZXcgeW9yaywgdGltZXMsIHNlcmlmO2ZvbnQtc2l6ZToxMnB0 O2NvbG9yOiMwMDAwMDA7Ij48ZGl2PjwvZGl2PjxibG9ja3F1b3RlIHN0eWxlPSJib3JkZXItbGVm dDoycHggc29saWQgIzEwMTBGRjtwYWRkaW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13ZWln aHQ6bm9ybWFsO2ZvbnQtc3R5bGU6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFt aWx5OkhlbHZldGljYSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGI+RnJvbTog PC9iPiJHaXVzZXBwZSBSYWd1c2EiICZsdDtnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb20mZ3Q7 PGJyPjxiPlRvOiA8L2I+IlllZGlkeWFoIEJhciBEYXZpZCIgJmx0O2RpZGlAcmVkaGF0LmNvbSZn dDs8YnI+PGI+Q2M6IDwvYj51c2Vyc0BvdmlydC5vcmc8YnI+PGI+U2VudDogPC9iPlNhdHVyZGF5 LCBNYXJjaCAxNSwgMjAxNCAyOjE1OjE4IEFNPGJyPjxiPlN1YmplY3Q6IDwvYj5SRTogW1VzZXJz XSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJyb3I8YnI+PGRpdj48YnI+PC9kaXY+Cgo8c3R5 bGU+PCEtLQouRXh0ZXJuYWxDbGFzcyAuZWN4aG1tZXNzYWdlIFAgewpwYWRkaW5nOjBweDsKfQoK LkV4dGVybmFsQ2xhc3MgYm9keS5lY3hobW1lc3NhZ2Ugewpmb250LXNpemU6MTJwdDsKZm9udC1m YW1pbHk6Q2FsaWJyaTsKfQoKCi0tPjwvc3R5bGU+CjxkaXYgZGlyPSJsdHIiPkhpIERpZGksPGJy PjxkaXY+PGJyPjwvZGl2PjxkaXY+PGhyIGlkPSJlY3hzdG9wU3BlbGxpbmciPkRhdGU6IFRodSwg MTMgTWFyIDIwMTQgMDI6NDY6NTAgLTA0MDA8YnI+RnJvbTogZGlkaUByZWRoYXQuY29tPGJyPlRv OiBnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb208YnI+Q0M6IHVzZXJzQG92aXJ0Lm9yZzxicj5T dWJqZWN0OiBSZTogW1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJyb3I8YnI+PGRp dj48YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6dGltZXMgbmV3IHJvbWFuLCBuZXcg eW9yaywgdGltZXMsIHNlcmlmO2ZvbnQtc2l6ZToxMnB0O2NvbG9yOiMwMDAwMDA7Ij48ZGl2Pjwv ZGl2PjxibG9ja3F1b3RlIHN0eWxlPSJib3JkZXItbGVmdDoycHggc29saWQgIzEwMTBGRjtwYWRk aW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZvbnQtc3R5bGU6bm9y bWFsO3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZldGljYSxBcmlhbCxzYW5z LXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGI+RnJvbTogPC9iPiJHaXVzZXBwZSBSYWd1c2EiICZs dDtnaXVzZXBwZS5yYWd1c2FAaG90bWFpbC5jb20mZ3Q7PGJyPjxiPlRvOiA8L2I+dXNlcnNAb3Zp cnQub3JnPGJyPjxiPlNlbnQ6IDwvYj5UaHVyc2RheSwgTWFyY2ggMTMsIDIwMTQgMjozODo0MiBB TTxicj48Yj5TdWJqZWN0OiA8L2I+W1VzZXJzXSBTZWxmLWhvc3RlZC1lbmdpbmUgc2V0dXAgZXJy b3I8YnI+PGRpdj48YnI+PC9kaXY+PHN0eWxlPjwhLS0KLkV4dGVybmFsQ2xhc3MgLmVjeGhtbWVz c2FnZSBQIHsKcGFkZGluZzowcHg7Cn0KCi5FeHRlcm5hbENsYXNzIGJvZHkuZWN4aG1tZXNzYWdl IHsKZm9udC1zaXplOjEycHQ7CmZvbnQtZmFtaWx5OkNhbGlicmk7Cn0KCgotLT48L3N0eWxlPjxk aXYgZGlyPSJsdHIiPkhpIGFsbCw8YnI+d2hpbGUgYXR0ZW1wdGluZyBhIGZyb20tc2NyYXRjaCBz ZWxmLWhvc3RlZC1lbmdpbmUgaW5zdGFsbGF0aW9uIG9uIENlbnRPUyA2LjUgKGFsc28gZnJlc2hs eSByZWluc3RhbGxlZCBmcm9tIHNjcmF0Y2gpIG9uIGEgcGh5c2ljYWwgbm9kZSAob1ZpcnQgMy40 LjBfcHJlICsgR2x1c3RlckZTIDMuNS4wYmV0YTQ7IE5GUyBzdG9yYWdlIGZvciBlbmdpbmUgVk0p LCB0aGUgcHJvY2VzcyBmYWlscyBhbG1vc3QgaW1tZWRpYXRlbHkgd2l0aDo8YnI+PGRpdj48YnI+ PC9kaXY+W3Jvb3RAY2x1c3RlcjEgfl0jIG92aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAgLS1jb25m aWctYXBwZW5kPS9yb290L292aGUtc2V0dXAtYW5zd2Vycy5jb25mPGJyPlsgSU5GTyZuYnNwOyBd IFN0YWdlOiBJbml0aWFsaXppbmc8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IENvbnRpbnVpbmcgd2lsbCBjb25maWd1cmUgdGhpcyBob3N0 IGZvciBzZXJ2aW5nIGFzIGh5cGVydmlzb3IgYW5kIGNyZWF0ZSBhIFZNIHdoZXJlIHlvdSBoYXZl IHRvIGluc3RhbGwgb1ZpcnQgRW5naW5lIGFmdGVyd2FyZHMuPGJyPiZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBBcmUgeW91IHN1cmUgeW91IHdh bnQgdG8gY29udGludWU/IChZZXMsIE5vKVtZZXNdOjxicj5bIElORk8mbmJzcDsgXSBHZW5lcmF0 aW5nIGEgdGVtcG9yYXJ5IFZOQyBwYXNzd29yZC48YnI+WyBJTkZPJm5ic3A7IF0gU3RhZ2U6IEVu dmlyb25tZW50IHNldHVwPGJyPiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyBDb25maWd1cmF0aW9uIGZpbGVzOiBbJy9yb290L292aGUtc2V0dXAt YW5zd2Vycy5jb25mJ108YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IExvZyBmaWxlOiAvdmFyL2xvZy9vdmlydC1ob3N0ZWQtZW5naW5lLXNl dHVwL292aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAtMjAxNDAzMTMwMTA1MjYubG9nPGJyPiZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBWZXJzaW9u OiBvdG9waS0xLjIuMF9yYzMgKG90b3BpLTEuMi4wLTAuOS5yYzMuZWw2KTxicj5bIElORk8mbmJz cDsgXSBIYXJkd2FyZSBzdXBwb3J0cyB2aXJ0dWFsaXphdGlvbjxicj5bIElORk8mbmJzcDsgXSBC cmlkZ2Ugb3ZpcnRtZ210IGFscmVhZHkgY3JlYXRlZDxicj5bIElORk8mbmJzcDsgXSBTdGFnZTog RW52aXJvbm1lbnQgcGFja2FnZXMgc2V0dXA8YnI+WyBJTkZPJm5ic3A7IF0gU3RhZ2U6IFByb2dy YW1zIGRldGVjdGlvbjxicj5bIElORk8mbmJzcDsgXSBTdGFnZTogRW52aXJvbm1lbnQgc2V0dXA8 YnI+WyBJTkZPJm5ic3A7IF0gR2VuZXJhdGluZyBWRFNNIGNlcnRpZmljYXRlczxicj5bIEVSUk9S IF0gRmFpbGVkIHRvIGV4ZWN1dGUgc3RhZ2UgJ0Vudmlyb25tZW50IHNldHVwJzogW0Vycm5vIDJd IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3Rvcnk6ICcvZXRjL3BraS9saWJ2aXJ0L2NsaWVudGNlcnQu cGVtJzwvZGl2PjwvYmxvY2txdW90ZT48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgYWxyZWFkeSBnb3Qg YW5vdGhlciBzdWNoIHJlcG9ydCB5ZXN0ZXJkYXkgLSBzZWVtcyBsaWtlIGEgYnVnIGluIHRoZSBm aXggZm9yJm5ic3A7PGEgaHJlZj0iaHR0cHM6Ly9idWd6aWxsYS5yZWRoYXQuY29tL3Nob3dfYnVn LmNnaT9pZD0xMDM0NjM0IiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9idWd6aWxsYS5yZWRoYXQu Y29tL3Nob3dfYnVnLmNnaT9pZD0xMDM0NjM0PC9hPiZuYnNwOy48L2Rpdj48ZGl2PkkgaG9wZSB0 byBwdXNoIGEgZml4IGxhdGVyIHRvZGF5Ljxicj48ZGl2Pjxicj48L2Rpdj5JIGxvb2sgZm9yd2Fy ZCB0byBoYXZlIHRoZSBmaXggcHVzaGVkL21lcmdlZCBpbiBhY3R1YWwgcGFja2FnZXMuPGJyPjwv ZGl2PjxkaXY+PGJyPjwvZGl2PjxibG9ja3F1b3RlIHN0eWxlPSJib3JkZXItbGVmdDoycHggc29s aWQgIzEwMTBGRjtwYWRkaW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFs O2ZvbnQtc3R5bGU6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZl dGljYSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGRpdiBkaXI9Imx0ciI+PGJy PlsgSU5GTyZuYnNwOyBdIFN0YWdlOiBDbGVhbiB1cDxicj5bIElORk8mbmJzcDsgXSBTdGFnZTog UHJlLXRlcm1pbmF0aW9uPGJyPlsgSU5GTyZuYnNwOyBdIFN0YWdlOiBUZXJtaW5hdGlvbjxicj48 ZGl2Pjxicj48L2Rpdj5UaGUgL3Jvb3Qvb3ZoZS1zZXR1cC1hbnN3ZXJzLmNvbmYgaGFzIGJlZW4g c2F2ZWQgZnJvbSBhIHByZXZpb3VzIGluc3RhbGxhdGlvbiAoYmVmb3JlIHJlaW5zdGFsbGluZykg YW5kIG9ubHkgbWluaW1hbGx5IGVkaXRlZCAocmVtb3ZlZCBzb21lIGxpbmVzIHdpdGggVVVJRHMg ZXRjLikuPGJyPjxkaXY+PGJyPjwvZGl2PlRoZSAvZXRjL3BraS9saWJ2aXJ0IGRpciBpcyBjb21w bGV0ZWx5IG1pc3Npbmcgb24gYm90aCBub2RlczsgbGFzdCB0aW1lIEkgdHJpZWQgdGhlIHdob2xl IHNldHVwIEkgZG8gbm90IHJlY2FsbCBvZiBoYXZpbmcgc3VjaCBwcm9ibGVtcywgYnV0IG1heWJl IHNvbWV0aGluZyB3YXMgZGlmZmVyZW50IHRoZW4uPGJyPjxkaXY+PGJyPjwvZGl2PlRoZSBnZW5l cmF0ZWQgL3Zhci9sb2cvb3ZpcnQtaG9zdGVkLWVuZ2luZS1zZXR1cC9vdmlydC1ob3N0ZWQtZW5n aW5lLXNldHVwLTIwMTQwMzEzMDEwNTI2LmxvZyBoYXMgYmVlbiBzYXZlZCBhczo8YnI+PGRpdj48 YnI+PC9kaXY+aHR0cDovL3Bhc3RlYmluLmNvbS9lekFKRVRCTjxicj48ZGl2Pjxicj48L2Rpdj5J IGhvcGUgdG8gYmUgYWJsZSB0byBwcm9ncmVzcyBmdXJ0aGVyIHRvIHRlc3QgdGhlIHdob2xlIDIt bm9kZXMgc2V0dXAgKHNlY29uZCBub2RlIGZyZXNobHkgcmVpbnN0YWxsZWQgdG9vIGFuZCBhbHJl YWR5IHVwIHdpdGggR2x1c3RlckZTIGFuZCB3YWl0aW5nIHRvIGJlIGFkZGVkIHRvIG9WaXJ0IGNs dXN0ZXIpIGFuZCBkYXRhY2VudGVyIGNvbmZpZ3VyYXRpb24uPGJyPjxkaXY+PGJyPjwvZGl2Pk1h bnkgdGhhbmtzIGluIGFkdmFuY2UgZm9yIGFueSBzdWdnZXN0aW9ucy9oZWxwLDwvZGl2PjwvYmxv Y2txdW90ZT48ZGl2Pjxicj48L2Rpdj48ZGl2PkZvciBub3csIHlvdSBjYW4gc2ltcGx5OjwvZGl2 PjxkaXY+bWtkaXImbmJzcDs8c3BhbiBzdHlsZT0iZm9udC1mYW1pbHk6SGVsdmV0aWNhLCBBcmlh bCwgc2Fucy1zZXJpZjsiPi9ldGMvcGtpL2xpYnZpcnQ8L3NwYW4+PC9kaXY+PGRpdj48YnI+PC9k aXY+PGRpdj5UaGlzIHNob3VsZCBiZSBlbm91Z2guPGJyPjxkaXY+PGJyPjwvZGl2PlRoZSB3b3Jr YXJvdW5kIHdvcmtzOiB0aGUgc2VsZi1ob3N0ZWQtZW5naW5lIGluc3RhbGxhdGlvbiBwcm9jZWVk cyBub3cuPGJyPjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhhbmtzIGZvciB0aGUgcmVwb3J0 ITwvZGl2PjxkaXY+LS0gPGJyPjwvZGl2PjxkaXY+PHNwYW4+PC9zcGFuPkRpZGk8YnI+PHNwYW4+ PC9zcGFuPjxicj5NYW55IHRoYW5rcyBmb3IgeW91ciBraW5kIGFuZCBwcm9tcHQgYXNzaXN0YW5j ZSw8YnI+R2l1c2VwcGU8YnI+PGRpdj48YnI+PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+IAkJIAkg ICAJCSAgPC9kaXY+CjwvYmxvY2txdW90ZT48ZGl2Pjxicj5UaGFua3MgZm9yIHRoZSByZXBvcnQu IFRoZSB3b3JrYXJvdW5kIGlzIHByb2JhYmx5IG5vdCBlbm91Z2gsIGRlcGVuZHMgb24gd2hhdCB5 b3U8L2Rpdj48ZGl2PmFyZSB0cnlpbmcgdG8gZG8uICdta2RpciAvZXRjL3BraS9saWJ2aXJ0L3By aXZhdGUnIGlzIG5lZWRlZCB0b28uIFdpdGhvdXQgaXQsIHRoZSBjb2RlIHRoYXQ8L2Rpdj48ZGl2 PmNvcGllcyB0aGVyZSBhIGtleSB3aWxsIGNyZWF0ZSBhIGZpbGUgJ3ByaXZhdGUnIGluc3RlYWQg b2YgY29weWluZyBpdCBpbnRvIGEgZGlyZWN0b3J5ICdwcml2YXRlJy48L2Rpdj48ZGl2Pjxicj48 L2Rpdj48ZGl2PkZpeCBbMV0gd2FzIG1lcmdlZCB0byBhbGwgYnJhbmNoZXMuPC9kaXY+PGRpdj48 YnI+PC9kaXY+PGRpdj5bMV0mbmJzcDs8YSBocmVmPSJodHRwOi8vZ2Vycml0Lm92aXJ0Lm9yZy8y NTc0NyIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9nZXJyaXQub3ZpcnQub3JnLzI1NzQ3PC9hPjwv ZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+QmVzdCByZWdhcmRzLDwvZGl2PjxkaXY+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZToxMnB0OyI+LS0mbmJzcDs8L3NwYW4+PC9kaXY+PGRpdj48c3Bhbj48L3Nw YW4+RGlkaTxicj48c3Bhbj48L3NwYW4+PGJyPkhpIERpZGksPGJyPnRoZSB3b3JrYXJvdW5kIHNl ZW1lZCBhY3R1YWxseSB0byBiZSBlbm91Z2ggdG8gbWFrZSB0aGUgc2VsZi1ob3N0ZWQtZW5naW5l IHNldHVwIGdvIHRocm91Z2ggdXAgdG8gdGhlIGVuZCB3aXRob3V0IGFueSB1c2VyLXZpc2libGUg ZXJyb3IsIGJ1dCBpdCBsZWZ0IG1lIHdpdGggYSBub24tcnVubmluZyBFbmdpbmUgVk0gYWZ0ZXJ3 YXJkcyAoYmFzaWNhbGx5IGl0IGRpZCBub3QgcmVzdGFydCB1cCBhdXRvbWF0aWNhbGx5IHVuZGVy IEhBIHByb3RlY3Rpb24pLjxicj48YnI+SSBjb2xsZWN0ZWQgYWxsIGxvZ3MgYW5kIHJlcG9ydGVk IGl0IGluIGEgc2VwYXJhdGUgbWVzc2FnZSB3aXRoIHN1YmplY3QgIlNlbGYtaG9zdGVkIGVuZ2lu ZSBzZXR1cCBvayBidXQgbm8gZW5naW5lIHZtIHJ1bm5pbmf+ICIgYnV0IGdvdCBubyBjb21tZW50 cyB5ZXQuPGJyPjxicj5JZiBJIGdldCBubyBzdWdnZXN0aW9ucyBJIHdpbGwgdHJ5IHRvIHBlcmZv cm0gc29tZSAiY29ycmVjdGl2ZSBhY3Rpb25zIiBiYXNlZCBvbiBteSB1bmRlcnN0YW5kaW5nIG9m IHRoZSBwcm9ibGVtcyBhdCBoYW5kLCBidXQgSSBkaWQgbm90IHdhbnQgdG8gImNvcnJ1cHQiIHRo ZSBleGFjdCBzdGF0ZSB0byBoZWxwIGluIGRlYnVnZ2luZyAoc3RhcnRpbmcgYWdhaW4gZnJvbSBz Y3JhdGNoIHdpdGggZnVsbCBmaXJzdCBub2RlIHJlaW5zdGFsbGF0aW9uIGlzIGEgc29tZXdoYXQg bGVuZ2h0eSBwcm9jZXNzIHNpbmNlIEkgaGF2ZSBubyBsb2NhbCByZXBvIG1pcnJvcnMpLjxicj48 YnI+TWFueSB0aGFua3MgYWdhaW4sPGJyPkdpdXNlcHBlPGJyPjxicj48L2Rpdj48L2Rpdj48L2Rp dj48L2Rpdj4KIAkJIAkgICAJCSAgPC9kaXY+Cjxicj5fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fXwpVc2VycyBtYWlsaW5nIGxpc3QKVXNlcnNAb3ZpcnQub3Jn Cmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VyczwvZGl2PiAJCSAJ ICAgCQkgIDwvZGl2PjwvYm9keT4NCjwvaHRtbD4= --_8711780c-91f0-4b4d-8c2f-fff1588abc18_--
------=_Part_5747590_2051761120.1395560787350 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Giuseppe,=20 ----- Original Message -----
From: "Giuseppe Ragusa" <giuseppe.ragusa@hotmail.com> To: "Yedidyah Bar David" <didi@redhat.com> Cc: users@ovirt.org Sent: Sunday, March 23, 2014 1:34:04 AM Subject: RE: [Users] Self-hosted-engine setup error
Hi Didi, sorry for the delay in reporting final results.
I can confirm that simply creating /etc/pki/libvirt suffices: the "privat= e" subdir gets automatically correctly created (along with all certificates etc.) and setup completes fine.
OK, thanks for reporting...=20
It did not start up because of BZ #1075126 (HA agent died) but I noticed = (by chance) that there is an updated (18/03/2014) workaround and after manual= ly applying it (no oVirt new packages have been published yet) the Engine VM started fine.
Now I'm battling with an (apparently) GlusterFS (3.5.0beta4) bug that mak= es the (NFS based, but Gluster-provided) Engine storage domain shutdown by itself after a while (causing Engine VM to die).
Many thanks again for your support, Giuseppe
PS: would you suggest a complete reinstall with GlusterFS 3.4.x stable instead? ;>
No idea, I have zero experience with glusterfs.=20
PS2: sorry for top-posting (but Hotmail keeps failing on proper quoting..= .)
:-(=20 --=20 Didi=20
From: giuseppe.ragusa@hotmail.com To: didi@redhat.com Date: Sun, 16 Mar 2014 15:14:07 +0100 CC: users@ovirt.org Subject: Re: [Users] Self-hosted-engine setup error
Date: Sun, 16 Mar 2014 05:14:39 -0400 From: didi@redhat.com To: giuseppe.ragusa@hotmail.com CC: users@ovirt.org Subject: Re: [Users] Self-hosted-engine setup error
From: "Giuseppe Ragusa" <giuseppe.ragusa@hotmail.com> =20 To: "Yedidyah Bar David" <didi@redhat.com> =20 Cc: users@ovirt.org =20 Sent: Saturday, March 15, 2014 2:15:18 AM =20 Subject: RE: [Users] Self-hosted-engine setup error =20
Hi Didi, =20
Date: Thu, 13 Mar 2014 02:46:50 -0400 =20 From: didi@redhat.com =20 To: giuseppe.ragusa@hotmail.com =20 CC: users@ovirt.org =20 Subject: Re: [Users] Self-hosted-engine setup error =20
From: "Giuseppe Ragusa" <giuseppe.ragusa@hotmail.com> =20 =20 To: users@ovirt.org =20 =20 Sent: Thursday, March 13, 2014 2:38:42 AM =20 =20 Subject: [Users] Self-hosted-engine setup error =20 =20
Hi all, =20 =20 while attempting a from-scratch self-hosted-engine installation on Ce= ntOS 6.5 (also freshly reinstalled from scratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4; NFS storage for engine VM), the process fails almost immediately with: =20 =20
[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/ovhe-setup-answers.conf =20 =20 [ INFO ] Stage: Initializing =20 =20 Continuing will configure this host for serving as hypervisor and cre= ate a VM where you have to install oVirt Engine afterwards. =20 =20 Are you sure you want to continue? (Yes, No)[Yes]: =20 =20 [ INFO ] Generating a temporary VNC password. =20 =20 [ INFO ] Stage: Environment setup =20 =20 Configuration files: ['/root/ovhe-setup-answers.conf'] =20 =20 Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313= 010526.log =20 =20 Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6) =20 =20 [ INFO ] Hardware supports virtualization =20 =20 [ INFO ] Bridge ovirtmgmt already created =20 =20 [ INFO ] Stage: Environment packages setup =20 =20 [ INFO ] Stage: Programs detection =20 =20 [ INFO ] Stage: Environment setup =20 =20 [ INFO ] Generating VDSM certificates =20 =20 [ ERROR ] Failed to execute stage 'Environment setup': [Errno 2] No s= uch file or directory: '/etc/pki/libvirt/clientcert.pem' =20 =20
I already got another such report yesterday - seems like a bug in the f= ix for https://bugzilla.redhat.com/show_bug.cgi?id=3D1034634 . =20 I hope to push a fix later today. =20
I look forward to have the fix pushed/merged in actual packages. =20
[ INFO ] Stage: Clean up =20 =20 [ INFO ] Stage: Pre-termination =20 =20 [ INFO ] Stage: Termination =20 =20
The /root/ovhe-setup-answers.conf has been saved from a previous installation (before reinstalling) and only minimally edited (removed some lines w= ith UUIDs etc.). =20 =20
The /etc/pki/libvirt dir is completely missing on both nodes; last ti= me I tried the whole setup I do not recall of having such problems, but ma= ybe something was different then. =20 =20
The generated /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313= 010526.log has been saved as: =20 =20
http://pastebin.com/ezAJETBN =20 =20
I hope to be able to progress further to test the whole 2-nodes setup (second node freshly reinstalled too and already up with GlusterFS and waitin= g to be added to oVirt cluster) and datacenter configuration. =20 =20
Many thanks in advance for any suggestions/help, =20 =20
For now, you can simply: =20 mkdir /etc/pki/libvirt =20
This should be enough. =20
The workaround works: the self-hosted-engine installation proceeds now. =20
Thanks for the report! =20 -- =20 Didi =20
Many thanks for your kind and prompt assistance, =20 Giuseppe =20
Thanks for the report. The workaround is probably not enough, depends on = what you are trying to do. 'mkdir /etc/pki/libvirt/private' is needed too. Without= it, the code that copies there a key will create a file 'private' instead of copying it int= o a directory 'private'.
Fix [1] was merged to all branches.
Best regards, -- Didi
Hi Didi, the workaround seemed actually to be enough to make the self-hosted-engin= e setup go through up to the end without any user-visible error, but it lef= t me with a non-running Engine VM afterwards (basically it did not restart = up automatically under HA protection).
I collected all logs and reported it in a separate message with subject "Self-hosted engine setup ok but no engine vm running=E2=80=8F " but got = no comments yet.
If I get no suggestions I will try to perform some "corrective actions" b= ased on my understanding of the problems at hand, but I did not want to "corru= pt" the exact state to help in debugging (starting again from scratch with fu= ll first node reinstallation is a somewhat lenghty process since I have no local repo mirrors).
Many thanks again, Giuseppe
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
<blockquote style=3D"border-left:2px solid #1010FF;margin-left:5px;padding= -left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:n= one;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"G= iuseppe Ragusa" <giuseppe.ragusa@hotmail.com><br><b>To: </b>"Yedidyah= Bar David" <didi@redhat.com><br><b>Cc: </b>users@ovirt.org<br><b>Sen= t: </b>Sunday, March 23, 2014 1:34:04 AM<br><b>Subject: </b>RE: [Users] Sel= f-hosted-engine setup error<br><div><br></div><style><!-- .hmmessage P { margin:0px;
<div>-- </div><div>Didi</div><div><br></div><blockquote style=3D"bord= er-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-= weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,= Arial,sans-serif;font-size:12pt;"><div dir=3D"ltr"><br><div><br></div><div>= <hr id=3D"stopSpelling">From: giuseppe.ragusa@hotmail.com<br>To: didi@redha= t.com<br>Date: Sun, 16 Mar 2014 15:14:07 +0100<br>CC: users@ovirt.org<br>Su= bject: Re: [Users] Self-hosted-engine setup error<br><div><br></div><style>= <!-- .ExternalClass .ecxhmmessage P {
<div>I already got another such report yesterday - seems like a bug in the= fix for <a href=3D"https://bugzilla.redhat.com/show_bug.cgi?id=3D1034= 634" target=3D"_blank">https://bugzilla.redhat.com/show_bug.cgi?id=3D103463= 4</a> .</div><div>I hope to push a fix later today.<br><div><br></div>= I look forward to have the fix pushed/merged in actual packages.<br></div><=
</div><div><br></div><div>This should be enough.<br><div><br></div>The wor= karound works: the self-hosted-engine installation proceeds now.<br></div><=
<br></div></div></div></div></div></blockquote><div><br>Thanks for the rep= ort. The workaround is probably not enough, depends on what you</div><div>a= re trying to do. 'mkdir /etc/pki/libvirt/private' is needed too. Without it= , the code that</div><div>copies there a key will create a file 'private' i= nstead of copying it into a directory 'private'.</div><div><br></div><div>F= ix [1] was merged to all branches.</div><div><br></div><div>[1] <a hre= f=3D"http://gerrit.ovirt.org/25747" target=3D"_blank">http://gerrit.ovirt.o= rg/25747</a></div><div><br></div><div>Best regards,</div><div><span style= =3D"font-size:12pt;">-- </span></div><div>Didi<br><br>Hi Didi,<br>the = workaround seemed actually to be enough to make the self-hosted-engine setu=
--=20 Didi=20 ------=_Part_5747590_2051761120.1395560787350 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><div>Hi <span style=3D"font-fami= ly: Helvetica, Arial, sans-serif;" data-mce-style=3D"font-family: Helvetica= , Arial, sans-serif;">Giuseppe,</span></div><div><br></div><hr id=3D"zwchr"= padding:0px } body.hmmessage { font-size: 12pt; font-family:Calibri } --></style><div dir=3D"ltr">Hi Didi,<br>sorry for the delay in reporting fi= nal results.<br><div><br></div>I can confirm that simply creating /etc/pki/= libvirt suffices: the "private" subdir gets automatically correctly created= (along with all certificates etc.) and setup completes fine.</div></= blockquote><div><br></div><div>OK, thanks for reporting...</div><div><br></= div><blockquote style=3D"border-left:2px solid #1010FF;margin-left:5px;padd= ing-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoratio= n:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><div dir=3D"= ltr"><br><div><br></div>It did not start up because of BZ #1075126 (HA agen= t died) but I noticed (by chance) that there is an updated (18/03/2014) wor= karound and after manually applying it (no oVirt new packages have been pub= lished yet) the Engine VM started fine.<br><div><br></div>Now I'm battling = with an (apparently) GlusterFS (3.5.0beta4) bug that makes the (NFS based, = but Gluster-provided) Engine storage domain shutdown by itself after a whil= e (causing Engine VM to die).<br><div><br></div>Many thanks again for your = support,<br>Giuseppe<br><div><br></div>PS: would you suggest a complete rei= nstall with GlusterFS 3.4.x stable instead? ;></div></blockquote><div><b= r></div><div>No idea, I have zero experience with glusterfs.</div><div><br>= </div><blockquote style=3D"border-left:2px solid #1010FF;margin-left:5px;pa= dding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decorat= ion:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><div dir= =3D"ltr"><br><div><br></div>PS2: sorry for top-posting (but Hotmail keeps f= ailing on proper quoting...)</div></blockquote><div><br></div><div>:-(</div= padding:0px; } .ExternalClass body.ecxhmmessage { font-size:12pt; font-family:Calibri; } --></style><div dir=3D"ltr"><br><div dir=3D"ltr"><div><hr id=3D"ecxstopSpel= ling">Date: Sun, 16 Mar 2014 05:14:39 -0400<br>From: didi@redhat.com<br>To:= giuseppe.ragusa@hotmail.com<br>CC: users@ovirt.org<br>Subject: Re: [Users]= Self-hosted-engine setup error<br><div><br></div><div style=3D"font-family= :times new roman, new york, times, serif;font-size:12pt;color:#000000;"><bl= ockquote style=3D"border-left:2px solid #1010FF;padding-left:5px;color:#000= ;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helv= etica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Giuseppe Ragusa" <= giuseppe.ragusa@hotmail.com><br><b>To: </b>"Yedidyah Bar David" <didi= @redhat.com><br><b>Cc: </b>users@ovirt.org<br><b>Sent: </b>Saturday, Mar= ch 15, 2014 2:15:18 AM<br><b>Subject: </b>RE: [Users] Self-hosted-engine se= tup error<br><div><br></div><style><!-- .ExternalClass .ecxhmmessage P { padding:0px; } .ExternalClass body.ecxhmmessage { font-size:12pt; font-family:Calibri; } --></style><div dir=3D"ltr">Hi Didi,<br><div><br></div><div><hr id=3D"ecxst= opSpelling">Date: Thu, 13 Mar 2014 02:46:50 -0400<br>From: didi@redhat.com<= br>To: giuseppe.ragusa@hotmail.com<br>CC: users@ovirt.org<br>Subject: Re: [= Users] Self-hosted-engine setup error<br><div><br></div><div style=3D"font-= family:times new roman, new york, times, serif;font-size:12pt;color:#000000= ;"><blockquote style=3D"border-left:2px solid #1010FF;padding-left:5px;colo= r:#000;font-weight:normal;font-style:normal;text-decoration:none;font-famil= y:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Giuseppe Ragusa= " <giuseppe.ragusa@hotmail.com><br><b>To: </b>users@ovirt.org<br><b>S= ent: </b>Thursday, March 13, 2014 2:38:42 AM<br><b>Subject: </b>[Users] Sel= f-hosted-engine setup error<br><div><br></div><style><!-- .ExternalClass .ecxhmmessage P { padding:0px; } .ExternalClass body.ecxhmmessage { font-size:12pt; font-family:Calibri; } --></style><div dir=3D"ltr">Hi all,<br>while attempting a from-scratch self= -hosted-engine installation on CentOS 6.5 (also freshly reinstalled from sc= ratch) on a physical node (oVirt 3.4.0_pre + GlusterFS 3.5.0beta4; NFS stor= age for engine VM), the process fails almost immediately with:<br><div><br>= </div>[root@cluster1 ~]# ovirt-hosted-engine-setup --config-append=3D/root/= ovhe-setup-answers.conf<br>[ INFO ] Stage: Initializing<br> &nbs= p; Continuing will configure this= host for serving as hypervisor and create a VM where you have to install o= Virt Engine afterwards.<br> = Are you sure you want to continue? (Yes, No)[Yes]:<br>[ INFO ]= Generating a temporary VNC password.<br>[ INFO ] Stage: Environment = setup<br> Configurati= on files: ['/root/ovhe-setup-answers.conf']<br> &nbs= p; Log file: /var/log/ovirt-hosted-engine-setup/ovi= rt-hosted-engine-setup-20140313010526.log<br> = Version: otopi-1.2.0_rc3 (otopi-1.2.0-0.9.rc3.el6)= <br>[ INFO ] Hardware supports virtualization<br>[ INFO ] Bridg= e ovirtmgmt already created<br>[ INFO ] Stage: Environment packages s= etup<br>[ INFO ] Stage: Programs detection<br>[ INFO ] Stage: E= nvironment setup<br>[ INFO ] Generating VDSM certificates<br>[ ERROR = ] Failed to execute stage 'Environment setup': [Errno 2] No such file or di= rectory: '/etc/pki/libvirt/clientcert.pem'</div></blockquote><div><br></div= div><br></div><blockquote style=3D"border-left:2px solid #1010FF;padding-le= ft:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none= ;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><div dir=3D"ltr"><= br>[ INFO ] Stage: Clean up<br>[ INFO ] Stage: Pre-termination<= br>[ INFO ] Stage: Termination<br><div><br></div>The /root/ovhe-setup= -answers.conf has been saved from a previous installation (before reinstall= ing) and only minimally edited (removed some lines with UUIDs etc.).<br><di= v><br></div>The /etc/pki/libvirt dir is completely missing on both nodes; l= ast time I tried the whole setup I do not recall of having such problems, b= ut maybe something was different then.<br><div><br></div>The generated /var= /log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20140313010526.log= has been saved as:<br><div><br></div>http://pastebin.com/ezAJETBN<br><div>= <br></div>I hope to be able to progress further to test the whole 2-nodes s= etup (second node freshly reinstalled too and already up with GlusterFS and= waiting to be added to oVirt cluster) and datacenter configuration.<br><di= v><br></div>Many thanks in advance for any suggestions/help,</div></blockqu= ote><div><br></div><div>For now, you can simply:</div><div>mkdir <span= style=3D"font-family:Helvetica, Arial, sans-serif;">/etc/pki/libvirt</span= div><br></div><div>Thanks for the report!</div><div>-- <br></div><div>Didi<= br><br>Many thanks for your kind and prompt assistance,<br>Giuseppe<br><div= p go through up to the end without any user-visible error, but it left me w= ith a non-running Engine VM afterwards (basically it did not restart up aut= omatically under HA protection).<br><div><br></div>I collected all logs and= reported it in a separate message with subject "Self-hosted engine setup o= k but no engine vm running=E2=80=8F " but got no comments yet.<br><div><br>= </div>If I get no suggestions I will try to perform some "corrective action= s" based on my understanding of the problems at hand, but I did not want to= "corrupt" the exact state to help in debugging (starting again from scratc= h with full first node reinstallation is a somewhat lenghty process since I= have no local repo mirrors).<br><div><br></div>Many thanks again,<br>Giuse= ppe<br><div><br></div></div></div></div></div></div><br>___________________= ____________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users</div></div></blockquote><div>= <br><br></div><div><br></div><div>-- <br></div><div><span name=3D"x"></span=
Didi<br><span name=3D"x"></span><br></div></div></body></html> ------=_Part_5747590_2051761120.1395560787350--
participants (2)
-
Giuseppe Ragusa -
Yedidyah Bar David