<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Oct 4, 2016 at 10:51 AM, Simone Tiraboschi <span dir="ltr"><<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span class="gmail-">On Mon, Oct 3, 2016 at 11:56 PM, Jason Jeffrey <span dir="ltr"><<a href="mailto:jason@sudo.co.uk" target="_blank">jason@sudo.co.uk</a>></span> wrote:<br></span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-GB"><div><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Hi,<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Another problem has appeared, after rebooting the primary the VM will not start.<u></u><u></u></span></p><span class="gmail-"><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Appears the symlink is broken between gluster mount ref and vdsm</span></p></span></div></div></blockquote><div><br></div><div>The first host was correctly deployed but it seas that you are facing some issue connecting the storage.</div><div>Can you please attach vdsm logs and /var/log/messages from the first host?</div></div></div></div></blockquote><div><br></div><div>Thanks Jason,</div><div>I suspect that your issue is related to this:</div><div><div>Oct 4 18:24:39 dcasrv01 etc-glusterfs-glusterd.vol[2252]: [2016-10-04 17:24:39.522620] C [MSGID: 106002] [glusterd-server-quorum.c:351:glusterd_do_volume_quorum_action] 0-management: Server quorum lost for volume data. Stopping local bricks.</div><div>Oct 4 18:24:39 dcasrv01 etc-glusterfs-glusterd.vol[2252]: [2016-10-04 17:24:39.523272] C [MSGID: 106002] [glusterd-server-quorum.c:351:glusterd_do_volume_quorum_action] 0-management: Server quorum lost for volume engine. Stopping local bricks.</div></div><div><br></div><div>and for some time your gluster volume has been working.</div><div><br></div><div>But then:</div><div><div>Oct 4 19:02:09 dcasrv01 systemd: Started /usr/bin/mount -t glusterfs -o backup-volfile-servers=dcastor02:dcastor03 dcastor01:engine /rhev/data-center/mnt/glusterSD/dcastor01:engine.</div><div>Oct 4 19:02:09 dcasrv01 systemd: Starting /usr/bin/mount -t glusterfs -o backup-volfile-servers=dcastor02:dcastor03 dcastor01:engine /rhev/data-center/mnt/glusterSD/dcastor01:engine.</div><div>Oct 4 19:02:11 dcasrv01 ovirt-ha-agent: /usr/lib/python2.7/site-packages/yajsonrpc/stomp.py:352: DeprecationWarning: Dispatcher.pending is deprecated. Use Dispatcher.socket.pending instead.</div><div>Oct 4 19:02:11 dcasrv01 ovirt-ha-agent: pending = getattr(dispatcher, 'pending', lambda: 0)</div><div>Oct 4 19:02:11 dcasrv01 ovirt-ha-agent: /usr/lib/python2.7/site-packages/yajsonrpc/stomp.py:352: DeprecationWarning: Dispatcher.pending is deprecated. Use Dispatcher.socket.pending instead.</div><div>Oct 4 19:02:11 dcasrv01 ovirt-ha-agent: pending = getattr(dispatcher, 'pending', lambda: 0)</div><div>Oct 4 19:02:11 dcasrv01 journal: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof</div><div>Oct 4 19:02:11 dcasrv01 journal: ovirt-ha-agent ovirt_hosted_engine_ha.agent.agent.Agent ERROR Error: 'Connection to storage server failed' - trying to restart agent</div><div>Oct 4 19:02:11 dcasrv01 ovirt-ha-agent: ERROR:ovirt_hosted_engine_ha.agent.agent.Agent:Error: 'Connection to storage server failed' - trying to restart agent</div><div>Oct 4 19:02:12 dcasrv01 etc-glusterfs-glusterd.vol[2252]: [2016-10-04 18:02:12.384611] C [MSGID: 106003] [glusterd-server-quorum.c:346:glusterd_do_volume_quorum_action] 0-management: Server quorum regained for volume data. Starting local bricks.</div><div>Oct 4 19:02:12 dcasrv01 etc-glusterfs-glusterd.vol[2252]: [2016-10-04 18:02:12.388981] C [MSGID: 106003] [glusterd-server-quorum.c:346:glusterd_do_volume_quorum_action] 0-management: Server quorum regained for volume engine. Starting local bricks.</div></div><div><br></div><div>And at that point VDSM started complaining that the hosted-engine-storage domain doesn't exist anymore:</div><div><div>Oct 4 19:02:30 dcasrv01 journal: ovirt-ha-agent ovirt_hosted_engine_ha.lib.image.Image ERROR Error fetching volumes list: Storage domain does not exist: (u'bbb70623-194a-46d2-a164-76a4876ecaaf',)</div><div>Oct 4 19:02:30 dcasrv01 ovirt-ha-agent: ERROR:ovirt_hosted_engine_ha.lib.image.Image:Error fetching volumes list: Storage domain does not exist: (u'bbb70623-194a-46d2-a164-76a4876ecaaf',)</div></div><div><br></div><div>I see from the logs that the ovirt-ha-agent is trying to mount the hosted-engine storage domain as:</div><div>/usr/bin/mount -t glusterfs -o backup-volfile-servers=dcastor02:dcastor03 dcastor01:engine /rhev/data-center/mnt/glusterSD/dcastor01:engine.<br></div><div><br></div><div>Pointing to dcastor01, dcastor02 and dcastor03 while your server is dcasrv01.</div><div>But at the same time it seams that also dcasrv01 has local bricks for the same engine volume.</div><div><br></div><div>So, is dcasrv01 just an alias fro dcastor01? if not you probably have some issue with the configuration of your gluster volume.</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><div class="gmail-h5"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-GB"><div><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"> <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">From broker.log<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Thread-169::ERROR::2016-10-04 22:44:16,189::storage_broker::<wbr>138::<a href="http://ovirt_hosted_engine_ha.br">ovirt_hosted_engine_ha.br</a><wbr>oker.storage_broker.StorageBro<wbr>ker::(get_raw_stats_for_<wbr>service_type) Failed to read metadata from /rhev/data-center/mnt/glusterS<wbr>D/dcastor01:engine/bbb70623-<wbr>194a-46d2-a164-76a4876ecaaf/<wbr>ha_agent/hosted-engine.<wbr>metadata<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">[root@dcasrv01 ovirt-hosted-engine-ha]# ls -al /rhev/data-center/mnt/glusterS<wbr>D/dcastor01\:engine/bbb70623-<wbr>194a-46d2-a164-76a4876ecaaf/<wbr>ha_agent/<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">total 9<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">drwxrwx---. 2 vdsm kvm 4096 Oct 3 17:27 .<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">drwxr-xr-x. 5 vdsm kvm 4096 Oct 3 17:17 ..<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">lrwxrwxrwx. 1 vdsm kvm 132 Oct 3 17:27 hosted-engine.lockspace -> /var/run/vdsm/storage/bbb70623<wbr>-194a-46d2-a164-76a4876ecaaf/<wbr>23d81b73-bcb7-4742-abde-<wbr>128522f43d78/11d6a3e1-1817-<wbr>429d-b2e0-9051a3cf41a4<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">lrwxrwxrwx. 1 vdsm kvm 132 Oct 3 17:27 hosted-engine.metadata -> /var/run/vdsm/storage/bbb70623<wbr>-194a-46d2-a164-76a4876ecaaf/<wbr>fd44dbf9-473a-496a-9996-<wbr>c8abe3278390/cee9440c-4eb8-<wbr>453b-bc04-c47e6f9cbc93 <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">[root@dcasrv01 /]# ls -al /var/run/vdsm/storage/bbb70623<wbr>-194a-46d2-a164-76a4876ecaaf/<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">ls: cannot access /var/run/vdsm/storage/bbb70623<wbr>-194a-46d2-a164-76a4876ecaaf/: No such file or directory <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Though file appears to be there <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Gluster is setup as xpool/engine <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">[root@dcasrv01 fd44dbf9-473a-496a-9996-c8abe3<wbr>278390]# pwd<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">/xpool/engine/brick/bbb70623-1<wbr>94a-46d2-a164-76a4876ecaaf/ima<wbr>ges/fd44dbf9-473a-496a-9996-<wbr>c8abe3278390<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">[root@dcasrv01 fd44dbf9-473a-496a-9996-c8abe3<wbr>278390]# ls -al<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">total 2060<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">drwxr-xr-x. 2 vdsm kvm 4096 Oct 3 17:17 .<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">drwxr-xr-x. 6 vdsm kvm 4096 Oct 3 17:17 ..<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">-rw-rw----. 2 vdsm kvm 1028096 Oct 3 20:48 cee9440c-4eb8-453b-bc04-c47e6f<wbr>9cbc93<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">-rw-rw----. 2 vdsm kvm 1048576 Oct 3 17:17 cee9440c-4eb8-453b-bc04-c47e6f<wbr>9cbc93.lease<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">-rw-r--r--. 2 vdsm kvm 283 Oct 3 17:17 cee9440c-4eb8-453b-bc04-c47e6f<wbr>9cbc93.meta <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">[root@dcasrv01 fd44dbf9-473a-496a-9996-c8abe3<wbr>278390]# gluster volume info<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Volume Name: data<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Type: Replicate<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Volume ID: 54fbcafc-fed9-4bce-92ec-fa36cd<wbr>cacbd4<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Status: Started<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Number of Bricks: 1 x (2 + 1) = 3<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Transport-type: tcp<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Bricks:<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick1: dcastor01:/xpool/data/brick<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick2: dcastor03:/xpool/data/brick<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick3: dcastor02:/xpool/data/bricky (arbiter)<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Options Reconfigured:<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.readdir-ahead: on<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.quick-read: off<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.read-ahead: off<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.io-cache: off<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.stat-prefetch: off<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">cluster.eager-lock: enable<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">network.remote-dio: enable<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">cluster.quorum-type: auto<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">cluster.server-quorum-type: server<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">storage.owner-uid: 36<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">storage.owner-gid: 36<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Volume Name: engine<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Type: Replicate<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Volume ID: dd4c692d-03aa-4fc6-9011-a8dad4<wbr>8dad96<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Status: Started<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Number of Bricks: 1 x (2 + 1) = 3<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Transport-type: tcp<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Bricks:<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick1: dcastor01:/xpool/engine/brick<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick2: dcastor02:/xpool/engine/brick<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick3: dcastor03:/xpool/engine/brick (arbiter)<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Options Reconfigured:<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.readdir-ahead: on<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.quick-read: off<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.read-ahead: off<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.io-cache: off<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.stat-prefetch: off<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">cluster.eager-lock: enable<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">network.remote-dio: enable<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">cluster.quorum-type: auto<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">cluster.server-quorum-type: server<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">storage.owner-uid: 36<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">storage.owner-gid: 36<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Volume Name: export<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Type: Replicate<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Volume ID: 23f14730-d264-4cc2-af60-196b94<wbr>3ecaf3<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Status: Started<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Number of Bricks: 1 x (2 + 1) = 3<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Transport-type: tcp<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Bricks:<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick1: dcastor02:/xpool/export/brick<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick2: dcastor03:/xpool/export/brick<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick3: dcastor01:/xpool/export/brick (arbiter)<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Options Reconfigured:<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.readdir-ahead: on<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">storage.owner-uid: 36<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">storage.owner-gid: 36<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Volume Name: iso<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Type: Replicate<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Volume ID: b2d3d7e2-9919-400b-8368-a0443d<wbr>48e82a<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Status: Started<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Number of Bricks: 1 x (2 + 1) = 3<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Transport-type: tcp<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Bricks:<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick1: dcastor01:/xpool/iso/brick<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick2: dcastor02:/xpool/iso/brick<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick3: dcastor03:/xpool/iso/brick (arbiter)<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Options Reconfigured:<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">performance.readdir-ahead: on<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">storage.owner-uid: 36<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">storage.owner-gid: 36 <wbr> <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">[root@dcasrv01 fd44dbf9-473a-496a-9996-c8abe3<wbr>278390]# gluster volume status<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Status of volume: data<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Gluster process <wbr> TCP Port RDMA Port Online Pid<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">------------------------------<wbr>------------------------------<wbr>------------------<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor01:/xpool/data/brick <wbr> 49153 0 Y 3076<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor03:/xpool/data/brick <wbr> 49153 0 Y 3019<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor02:/xpool/data/bricky <wbr> 49153 0 Y 3857<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on localhost 2049 0 Y 3097<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on localhost N/A N/A Y 3088<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on dcastor03 2049 0 Y 3039<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on dcastor03 N/A N/A Y 3114<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on dcasrv02 2049 0 Y 3871<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on dcasrv02 N/A N/A Y 3864<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Task Status of Volume data<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">------------------------------<wbr>------------------------------<wbr>------------------<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">There are no active volume tasks<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Status of volume: engine<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Gluster process <wbr> TCP Port RDMA Port Online Pid<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">------------------------------<wbr>------------------------------<wbr>------------------<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor01:/xpool/engine/brick <wbr> 49152 0 Y 3131<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor02:/xpool/engine/brick <wbr> 49152 0 Y 3852<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor03:/xpool/engine/brick <wbr> 49152 0 Y 2992<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on localhost 2049 0 Y 3097<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on localhost N/A N/A Y 3088<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on dcastor03 2049 0 Y 3039<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on dcastor03 N/A N/A Y 3114<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on dcasrv02 2049 0 Y 3871<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on dcasrv02 N/A N/A Y 3864<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Task Status of Volume engine<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">------------------------------<wbr>------------------------------<wbr>------------------<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">There are no active volume tasks<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Status of volume: export<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Gluster process <wbr> TCP Port RDMA Port Online Pid<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">------------------------------<wbr>------------------------------<wbr>------------------<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor02:/xpool/export/brick <wbr> 49155 0 Y 3872<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor03:/xpool/export/brick <wbr> 49155 0 Y 3147<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor01:/xpool/export/brick <wbr> 49155 0 Y 3150<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on localhost 2049 0 Y 3097<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on localhost N/A N/A Y 3088<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on dcastor03 2049 0 Y 3039<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on dcastor03 N/A N/A Y 3114<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on dcasrv02 2049 0 Y 3871<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on dcasrv02 N/A N/A Y 3864<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Task Status of Volume export<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">------------------------------<wbr>------------------------------<wbr>------------------<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">There are no active volume tasks<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Status of volume: iso<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Gluster process <wbr> TCP Port RDMA Port Online Pid<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">------------------------------<wbr>------------------------------<wbr>------------------<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor01:/xpool/iso/brick <wbr> 49154 0 Y 3152<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor02:/xpool/iso/brick <wbr> 49154 0 Y 3881<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Brick dcastor03:/xpool/iso/brick <wbr> 49154 0 Y 3146<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on localhost 2049 0 Y 3097<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on localhost N/A N/A Y 3088<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on dcastor03 2049 0 Y 3039<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on dcastor03 N/A N/A Y 3114<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">NFS Server on dcasrv02 2049 0 Y 3871<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Self-heal Daemon on dcasrv02 N/A N/A Y 3864<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Task Status of Volume iso<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">------------------------------<wbr>------------------------------<wbr>------------------<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">There are no active volume tasks<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"> <wbr> <wbr> <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Thanks<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Jason<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><div><div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(225,225,225);padding:3pt 0cm 0cm"><p class="MsoNormal"><b><span lang="EN-US" style="font-size:11pt;font-family:calibri,sans-serif">From:</span></b><span lang="EN-US" style="font-size:11pt;font-family:calibri,sans-serif"> <a href="mailto:users-bounces@ovirt.org" target="_blank">users-bounces@ovirt.org</a> [mailto:<a href="mailto:users-bounces@ovirt.org" target="_blank">users-bounces@ovirt.or<wbr>g</a>] <b>On Behalf Of </b>Jason Jeffrey<br><b>Sent:</b> 03 October 2016 18:40<br><b>To:</b> <a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a></span></p><div><div><br><b>Subject:</b> Re: [ovirt-users] 4.0 - 2nd node fails on deploy<u></u><u></u></div></div><p></p></div></div><div><div><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Hi,<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Setup log attached for primary<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Regards<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)">Jason <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><b><span lang="EN-US" style="font-size:11pt;font-family:calibri,sans-serif">From:</span></b><span lang="EN-US" style="font-size:11pt;font-family:calibri,sans-serif"> Simone Tiraboschi [<a href="mailto:stirabos@redhat.com" target="_blank">mailto:stirabos@redhat.com</a>] <br><b>Sent:</b> 03 October 2016 09:27<br><b>To:</b> Jason Jeffrey <<a href="mailto:jason@sudo.co.uk" target="_blank">jason@sudo.co.uk</a>><br><b>Cc:</b> users <<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>><br><b>Subject:</b> Re: [ovirt-users] 4.0 - 2nd node fails on deploy<u></u><u></u></span></p><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal">On Mon, Oct 3, 2016 at 12:45 AM, Jason Jeffrey <<a href="mailto:jason@sudo.co.uk" target="_blank">jason@sudo.co.uk</a>> wrote:<u></u><u></u></p><blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt"><div><div><p class="MsoNormal"><span lang="EN-US">Hi,</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">I am trying to build a x3 HC cluster, with a self hosted engine using gluster.</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">I have successful built the 1<sup>st</sup> node, however when I attempt to run hosted-engine –deploy on node 2, I get the following error</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">[WARNING] A configuration file must be supplied to deploy Hosted Engine on an additional host.</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">[ ERROR ] 'version' is not stored in the HE configuration image</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">[ ERROR ] Unable to get the answer file from the shared storage</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">[ ERROR ] Failed to execute stage 'Environment customization': Unable to get the answer file from the shared storage</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">[ INFO ] Stage: Clean up</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">[ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-<wbr>setup/answers/answers-20161002<wbr>232505.conf'</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">[ INFO ] Stage: Pre-termination</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">[ INFO ] Stage: Termination</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">[ ERROR ] Hosted Engine deployment failed </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">Looking at the failure in the log file..</span><u></u><u></u></p></div></div></blockquote><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Can you please attach hosted-engine-setup logs from the first host?<u></u><u></u></p></div><div><p class="MsoNormal"> <u></u><u></u></p></div><blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt"><div><div><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">2016-10-02 23:25:05 WARNING otopi.plugins.gr_he_common.cor<wbr>e.remote_answerfile remote_answerfile._customizati<wbr>on:151 A configuration</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">file must be supplied to deploy Hosted Engine on an additional host.</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.cor<wbr>e.remote_answerfile remote_answerfile._fetch_answe<wbr>r_file:61 _fetch_answer_f</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">ile</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.cor<wbr>e.remote_answerfile remote_answerfile._fetch_answe<wbr>r_file:69 fetching from:</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">/rhev/data-center/mnt/glusterS<wbr>D/dcastor02:engine/0a021563-<wbr>91b5-4f49-9c6b-fff45e85a025/<wbr>images/f055216c-02f9-4cd1-<wbr>a22c-d6b56a0a8e9b/7</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">8cb2527-a2e2-489a-9fad-465a722<wbr>21b37</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.cor<wbr>e.remote_answerfile heconflib._dd_pipe_tar:69 executing: 'sudo -u vdsm dd i</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">f=/rhev/data-center/mnt/gluste<wbr>rSD/dcastor02:engine/0a021563-<wbr>91b5-4f49-9c6b-fff45e85a025/<wbr>images/f055216c-02f9-4cd1-<wbr>a22c-d6b56a0a8e9b</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">/78cb2527-a2e2-489a-9fad-465a7<wbr>2221b37 bs=4k'</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.cor<wbr>e.remote_answerfile heconflib._dd_pipe_tar:70 executing: 'tar -tvf -'</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.cor<wbr>e.remote_answerfile heconflib._dd_pipe_tar:88 stdout:</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">2016-10-02 23:25:05 DEBUG otopi.plugins.gr_he_common.cor<wbr>e.remote_answerfile heconflib._dd_pipe_tar:89 stderr:</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">2016-10-02 23:25:05 ERROR otopi.plugins.gr_he_common.cor<wbr>e.remote_answerfile heconflib.validateConfImage:11<wbr>1 'version' is not stored</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">in the HE configuration image</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">2016-10-02 23:25:05 ERROR otopi.plugins.gr_he_common.cor<wbr>e.remote_answerfile remote_answerfile._fetch_answe<wbr>r_file:73 Unable to get t</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">he answer file from the shared storage</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">Looking at the detected gluster path - /rhev/data-center/mnt/glusterS<wbr>D/dcastor02:engine/0a021563-<wbr>91b5-4f49-9c6b-fff45e85a025/<wbr>images/f055216c-02f9-4cd1-<wbr>a22c-d6b56a0a8e9b/</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">[root@dcasrv02 ~]# ls -al /rhev/data-center/mnt/glusterS<wbr>D/dcastor02:engine/0a021563-<wbr>91b5-4f49-9c6b-fff45e85a025/<wbr>images/f055216c-02f9-4cd1-<wbr>a22c-d6b56a0a8e9b/</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">total 1049609</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">drwxr-xr-x. 2 vdsm kvm 4096 Oct 2 04:46 .</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">drwxr-xr-x. 6 vdsm kvm 4096 Oct 2 04:46 ..</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">-rw-rw----. 1 vdsm kvm 1073741824 Oct 2 04:46 78cb2527-a2e2-489a-9fad-465a72<wbr>221b37</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">-rw-rw----. 1 vdsm kvm 1048576 Oct 2 04:46 78cb2527-a2e2-489a-9fad-465a72<wbr>221b37.lease</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">-rw-r--r--. 1 vdsm kvm 294 Oct 2 04:46 78cb2527-a2e2-489a-9fad-465a72<wbr>221b37.meta </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">78cb2527-a2e2-489a-9fad-465a72<wbr>221b37 is a 1 GB file, is this the engine VM ?</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">Copying the answers file form primary (/etc/ovirt-hosted-engine/answ<wbr>ers.conf ) to node 2 and rerunning produces the same error : (</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">(hosted-engine --deploy --config-append=/root/answers.<wbr>conf )</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">Also tried on node 3, same issues </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">Happy to provide logs and other debugs</span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US">Thanks </span><u></u><u></u></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)">Jason </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p><p class="MsoNormal"><span lang="EN-US" style="color:rgb(136,136,136)"> </span><span style="color:rgb(136,136,136)"><u></u><u></u></span></p></div></div><p class="MsoNormal" style="margin-bottom:12pt"><br>______________________________<wbr>_________________<br>Users mailing list<br><a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br><a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><u></u><u></u></p></blockquote></div><p class="MsoNormal"><u></u> <u></u></p></div></div></div></div></div></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
<br></blockquote></div></div></div><br></div></div>
</blockquote></div><br></div></div>