This is a multipart message in MIME format. ------=_NextPart_000_07BF_01D21D07.1029FF10 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi, I am trying to build a x3 HC cluster, with a self hosted engine using gluster. I have successful built the 1st node, however when I attempt to run hosted-engine -deploy on node 2, I get the following error [WARNING] A configuration file must be supplied to deploy Hosted Engine on an additional host. [ ERROR ] 'version' is not stored in the HE configuration image [ ERROR ] Unable to get the answer file from the shared storage [ ERROR ] Failed to execute stage 'Environment customization': Unable to get the answer file from the shared storage [ INFO ] Stage: Clean up [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20161002232505.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed Looking at the failure in the log file.. 2016-10-02 23:25:05 WARNING otopi.plugins.gr_he_common.core.remote_answerfile remote_answerfile._customization:151 A configuration file must be supplied to deploy Hosted Engine on an additional host. 2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.core.remote_answerfile remote_answerfile._fetch_answer_file:61 _fetch_answer_f ile 2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.core.remote_answerfile remote_answerfile._fetch_answer_file:69 fetching from: /rhev/data-center/mnt/glusterSD/dcastor02:engine/0a021563-91b5-4f49-9c6b-fff 45e85a025/images/f055216c-02f9-4cd1-a22c-d6b56a0a8e9b/7 8cb2527-a2e2-489a-9fad-465a72221b37 2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.core.remote_answerfile heconflib._dd_pipe_tar:69 executing: 'sudo -u vdsm dd i f=/rhev/data-center/mnt/glusterSD/dcastor02:engine/0a021563-91b5-4f49-9c6b-f ff45e85a025/images/f055216c-02f9-4cd1-a22c-d6b56a0a8e9b /78cb2527-a2e2-489a-9fad-465a72221b37 bs=4k' 2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.core.remote_answerfile heconflib._dd_pipe_tar:70 executing: 'tar -tvf -' 2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.core.remote_answerfile heconflib._dd_pipe_tar:88 stdout: 2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.core.remote_answerfile heconflib._dd_pipe_tar:89 stderr: 2016-10-02 23:25:05 ERROR otopi.plugins.gr_he_common.core.remote_answerfile heconflib.validateConfImage:111 'version' is not stored in the HE configuration image 2016-10-02 23:25:05 ERROR otopi.plugins.gr_he_common.core.remote_answerfile remote_answerfile._fetch_answer_file:73 Unable to get t he answer file from the shared storage Looking at the detected gluster path - /rhev/data-center/mnt/glusterSD/dcastor02:engine/0a021563-91b5-4f49-9c6b-fff 45e85a025/images/f055216c-02f9-4cd1-a22c-d6b56a0a8e9b/ [root@dcasrv02 ~]# ls -al /rhev/data-center/mnt/glusterSD/dcastor02:engine/0a021563-91b5-4f49-9c6b-fff 45e85a025/images/f055216c-02f9-4cd1-a22c-d6b56a0a8e9b/ total 1049609 drwxr-xr-x. 2 vdsm kvm 4096 Oct 2 04:46 . drwxr-xr-x. 6 vdsm kvm 4096 Oct 2 04:46 .. -rw-rw----. 1 vdsm kvm 1073741824 Oct 2 04:46 78cb2527-a2e2-489a-9fad-465a72221b37 -rw-rw----. 1 vdsm kvm 1048576 Oct 2 04:46 78cb2527-a2e2-489a-9fad-465a72221b37.lease -rw-r--r--. 1 vdsm kvm 294 Oct 2 04:46 78cb2527-a2e2-489a-9fad-465a72221b37.meta 78cb2527-a2e2-489a-9fad-465a72221b37 is a 1 GB file, is this the engine VM ? Copying the answers file form primary (/etc/ovirt-hosted-engine/answers.conf ) to node 2 and rerunning produces the same error : ( (hosted-engine --deploy --config-append=/root/answers.conf ) Also tried on node 3, same issues Happy to provide logs and other debugs Thanks Jason ------=_NextPart_000_07BF_01D21D07.1029FF10 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 15 = (filtered medium)"><style><!-- /* Font Definitions */ @font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4;} @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0cm; margin-bottom:.0001pt; font-size:11.0pt; font-family:"Calibri",sans-serif; mso-fareast-language:EN-US;} a:link, span.MsoHyperlink {mso-style-priority:99; color:#0563C1; text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed {mso-style-priority:99; color:#954F72; text-decoration:underline;} span.EmailStyle17 {mso-style-type:personal-compose; font-family:"Calibri",sans-serif; color:windowtext;} .MsoChpDefault {mso-style-type:export-only; font-family:"Calibri",sans-serif; mso-fareast-language:EN-US;} @page WordSection1 {size:612.0pt 792.0pt; margin:72.0pt 72.0pt 72.0pt 72.0pt;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 9]><xml> <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext=3D"edit"> <o:idmap v:ext=3D"edit" data=3D"1" /> </o:shapelayout></xml><![endif]--></head><body lang=3DEN-GB = link=3D"#0563C1" vlink=3D"#954F72"><div class=3DWordSection1><p = class=3DMsoNormal><span lang=3DEN-US>Hi,<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US><o:p> </o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>I am trying to build a x3 HC = cluster, with a self hosted engine using = gluster.<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>I have successful built the 1<sup>st</sup> node, = however when I attempt to run hosted-engine –deploy on node 2, I = get the following error<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>[WARNING] A configuration file must be supplied to deploy = Hosted Engine on an additional host.<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>[ ERROR ] 'version' is not stored = in the HE configuration image<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>[ ERROR ] Unable to get the answer = file from the shared storage<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>[ ERROR ] Failed to execute stage = 'Environment customization': Unable to get the answer file from the = shared storage<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>[ INFO ] Stage: Clean up<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>[ INFO ] Generating answer = file = '/var/lib/ovirt-hosted-engine-setup/answers/answers-20161002232505.conf'<= o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>[ = INFO ] Stage: Pre-termination<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>[ INFO ] Stage: = Termination<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>[ ERROR ] Hosted Engine deployment failed = <o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>Looking at the failure in the log = file..<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>2016-10-02 23:25:05 WARNING = otopi.plugins.gr_he_common.core.remote_answerfile = remote_answerfile._customization:151 A = configuration<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>file must be supplied to deploy Hosted Engine on an = additional host.<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>2016-10-02 23:25:05 DEBUG = otopi.plugins.gr_he_common.core.remote_answerfile = remote_answerfile._fetch_answer_file:61 = _fetch_answer_f<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>ile<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>2016-10-02 23:25:05 DEBUG = otopi.plugins.gr_he_common.core.remote_answerfile = remote_answerfile._fetch_answer_file:69 fetching = from:<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>/rhev/data-center/mnt/glusterSD/dcastor02:engine/0a021563-91= b5-4f49-9c6b-fff45e85a025/images/f055216c-02f9-4cd1-a22c-d6b56a0a8e9b/7<o= :p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>8cb2527-a2e2-489a-9fad-465a72221b37<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>2016-10-02 23:25:05 DEBUG = otopi.plugins.gr_he_common.core.remote_answerfile = heconflib._dd_pipe_tar:69 executing: 'sudo -u vdsm dd = i<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>f=3D/rhev/data-center/mnt/glusterSD/dcastor02:engine/0a02156= 3-91b5-4f49-9c6b-fff45e85a025/images/f055216c-02f9-4cd1-a22c-d6b56a0a8e9b= <o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>/78cb2527-a2e2-489a-9fad-465a72221b37 = bs=3D4k'<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>2016-10-02 23:25:05 DEBUG = otopi.plugins.gr_he_common.core.remote_answerfile = heconflib._dd_pipe_tar:70 executing: 'tar -tvf = -'<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>2016-10-02 23:25:05 DEBUG = otopi.plugins.gr_he_common.core.remote_answerfile = heconflib._dd_pipe_tar:88 stdout:<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>2016-10-02 23:25:05 DEBUG = otopi.plugins.gr_he_common.core.remote_answerfile = heconflib._dd_pipe_tar:89 stderr:<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>2016-10-02 23:25:05 ERROR = otopi.plugins.gr_he_common.core.remote_answerfile = heconflib.validateConfImage:111 'version' is not = stored<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US> in = the HE configuration image<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>2016-10-02 23:25:05 ERROR = otopi.plugins.gr_he_common.core.remote_answerfile = remote_answerfile._fetch_answer_file:73 Unable to get = t<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>he answer = file from the shared storage<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US><o:p> </o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>Looking at the detected gluster = path - = /rhev/data-center/mnt/glusterSD/dcastor02:engine/0a021563-91b5-4f49-9c6b-= fff45e85a025/images/f055216c-02f9-4cd1-a22c-d6b56a0a8e9b/<o:p></o:p></spa= n></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>[root@dcasrv02 ~]# ls -al = /rhev/data-center/mnt/glusterSD/dcastor02:engine/0a021563-91b5-4f49-9c6b-= fff45e85a025/images/f055216c-02f9-4cd1-a22c-d6b56a0a8e9b/<o:p></o:p></spa= n></p><p class=3DMsoNormal><span lang=3DEN-US>total = 1049609<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>drwxr-xr-x. 2 vdsm kvm = 4096 Oct 2 04:46 .<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>drwxr-xr-x. 6 vdsm kvm = 4096 Oct 2 04:46 ..<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>-rw-rw----. 1 vdsm kvm 1073741824 = Oct 2 04:46 = 78cb2527-a2e2-489a-9fad-465a72221b37<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>-rw-rw----. 1 vdsm = kvm 1048576 Oct 2 04:46 = 78cb2527-a2e2-489a-9fad-465a72221b37.lease<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>-rw-r--r--. 1 vdsm = kvm 294 Oct 2 04:46 = 78cb2527-a2e2-489a-9fad-465a72221b37.meta <o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US><o:p> </o:p></span></p><p = class=3DMsoNormal><span = lang=3DEN-US>78cb2527-a2e2-489a-9fad-465a72221b37 is a 1 GB file, = is this the engine VM ?<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>Copying the answers file form primary = (/etc/ovirt-hosted-engine/answers.conf ) to node 2 and rerunning = produces the same error : (<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>(hosted-engine --deploy = --config-append=3D/root/answers.conf )<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US><o:p> </o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>Also tried on node 3, same issues = <o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>Happy to provide logs and other = debugs<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>Thanks <o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>Jason <o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p></div></body></html> ------=_NextPart_000_07BF_01D21D07.1029FF10--