<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Dec 1, 2015 at 4:13 PM, Thomas Scofield <span dir="ltr"><<a href="mailto:tscofield@gmail.com" target="_blank">tscofield@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><p dir="ltr">There was an error message on the setup, but everything continued on and the hosted engine was available so I didn't think much of it.</p></blockquote><div>I opened a bug about that:</div><div><a href="https://bugzilla.redhat.com/show_bug.cgi?id=1287159">https://bugzilla.redhat.com/show_bug.cgi?id=1287159</a><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<p dir="ltr">If there is some way of recovering this setup I would like to give that a try, if you can provide some instructions that would be great, thanks.</p></blockquote><div><br></div><div>OK, I recreated the archive from your log file, I'm attaching it.</div><div>Please decompress it in a temporary empty directory and then delete the archive file.</div><div>Check if everything is OK for you and then:</div><div><br></div><div><span style="font-family:monospace,monospace;font-size:12.8px">sdUUID_line=$(grep sdUUID /etc/ovirt-hosted-engine/</span><span style="font-family:monospace,monospace;font-size:12.8px">hosted-engine.conf)</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">sdUUID=${sdUUID_line:7:36}</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">conf_volume_UUID_line=$(grep conf_volume_UUID /etc/ovirt-hosted-engine/</span><span style="font-family:monospace,monospace;font-size:12.8px">hosted-engine.conf)</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">conf_volume_UUID=${conf_</span><span style="font-family:monospace,monospace;font-size:12.8px">volume_UUID_line:17:36}</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">conf_image_UUID_line=$(grep conf_image_UUID /etc/ovirt-hosted-engine/</span><span style="font-family:monospace,monospace;font-size:12.8px">hosted-engine.conf)</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">conf_image_UUID=${conf_image_</span><span style="font-family:monospace,monospace;font-size:12.8px">UUID_line:16:36}</span></div><div><span style="font-family:monospace,monospace;font-size:12.8px">tar -cO * | dd of=</span><span style="font-size:12.8px">/rhev/data-center/mnt/blockSD/</span><span style="font-family:monospace,monospace;font-size:12.8px">$sdUUID/images/$</span><span style="font-family:monospace,monospace;font-size:12.8px">conf_image_UUID/$conf_volume_</span><span style="font-family:monospace,monospace;font-size:12.8px">UUID </span><span style="color:rgb(63,64,66);font-family:monospace,Courier;font-size:14.4px;line-height:1.3em;background-color:rgb(249,249,249)">oflag=direct </span><br></div><div><br></div><div>Let me know.</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div><div>
<div class="gmail_quote">On Dec 1, 2015 9:36 AM, "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Dec 1, 2015 at 3:24 PM, Thomas Scofield <span dir="ltr"><<a href="mailto:tscofield@gmail.com" target="_blank">tscofield@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><p dir="ltr">I did import the lun into the engine. I had the hosted engine running for a few days and I was able to restart it a number of times. It wasn't until I rebooted the physical box that it was running on that I encountered the problem.</p></blockquote><div>hosted-engine-setup probably failed adding the LUN to the engine cause it was already there or something similar; we need engine logs to better understand but the result is that it didn't completed creating the storage volume.<br></div>Probably it's not worth to fix it cause we are going to remove that once we completed the procedure to auto-import the hosted-engine storage domain.<br>didn't you noticed that it failed? wasn't the output clear enough?<br><br>Then the setup generates a temp file under /var/run/ovirt-hosted-engine-ha/vm.conf to use it for the first run and it copies to the shared storage for other hosts and further runs.<br>But it failed for the issue above before being able to copy it to the shared storage.<br><br>Your local /var/run/ovirt-hosted-engine-ha/vm.conf simply survived till you rebooted the host and so you were able to reboot the engine VM. As expected it disappeared once you rebooted.</div><div class="gmail_quote">Probably the agent should validate the conf volume more strictly and fail more clearly in this case so you'd notice it before.</div><div class="gmail_quote">I'll open a bug against that.<br></div></div></div></blockquote></div></div></div></blockquote><div><br></div><div>Done:</div><div><a href="https://bugzilla.redhat.com/show_bug.cgi?id=1287195">https://bugzilla.redhat.com/show_bug.cgi?id=1287195</a><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div><div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><font color="#500050"><span style="font-size:12.8px"><br></span></font></div><div>If you want to manually fix in order to recover your setup I can give you the instruction set to manually create the configuration volume on the shared storage.</div><div>If it was just an evaluation I'd suggest to redeploy it from scratch.</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div><div>
<div class="gmail_quote">On Dec 1, 2015 9:14 AM, "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Dec 1, 2015 at 2:07 PM, Thomas Scofield <span dir="ltr"><<a href="mailto:tscofield@gmail.com" target="_blank">tscofield@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div>Are there different instructions for an iscsi domain? I was able to find the proper path at /rhev/data-center/mnt/blockSD/<span style="font-family:monospace,monospace;font-size:12.8px">$sdUUID/images/$</span><span style="font-family:monospace,monospace;font-size:12.8px">conf_image_UUID/$conf_volume_</span><span style="font-family:monospace,monospace;font-size:12.8px">UUID but the tar command failed<br><br>tar: This does not look like a tar archive<br>tar: Exiting with failure status due to previous errors<br><br></span></div><span style="font-family:monospace,monospace;font-size:12.8px">This was a relatively recent fresh install, the setup log is attached.<br></span></div></blockquote><div><br></div><div>The conf volume is not there cause ovirt-hosted-engine-setup failed before creating it.</div><div><br></div><div>Indeed we have:</div><div><div>2015-11-22 16:30:27 DEBUG otopi.plugins.ovirt_hosted_engine_setup.engine.add_disk add_disk._closeup:153 Connecting to the Engine</div><div>2015-11-22 16:30:27 DEBUG otopi.context context._executeMethod:156 method exception</div><div>Traceback (most recent call last):</div><div> File "/usr/lib/python2.7/site-packages/otopi/context.py", line 146, in _executeMethod</div><div> method['method']()</div><div> File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/ovirt-hosted-engine-setup/engine/add_disk.py", line 182, in _closeup</div><div> lun_list = check_lun_storage.get_logical_unit()</div><div>AttributeError: 'NoneType' object has no attribute 'get_logical_unit'</div><div>2015-11-22 16:30:27 ERROR otopi.context context._executeMethod:165 Failed to execute stage 'Closing up': 'NoneType' object has no attribute 'get_logical_unit'</div></div><div><br></div><div>and:</div><div><div>2015-11-22 16:30:28 DEBUG otopi.context context._executeMethod:142 Stage terminate METHOD otopi.plugins.otopi.dialog.machine.Plugin._terminate</div><div>2015-11-22 16:30:28 DEBUG otopi.context context._executeMethod:148 condition False</div><div>2015-11-22 16:30:28 DEBUG otopi.context context._executeMethod:142 Stage terminate METHOD otopi.plugins.otopi.core.log.Plugin._terminate</div></div><div><br></div><div>Probably you hit a different issue.</div><div>Did you try to take any actions like importing the hosted-engine storage domain LUN on something similar on the engine before continuing with engine setup?</div><div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><span style="font-family:monospace,monospace;font-size:12.8px"></span></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Dec 1, 2015 at 5:54 AM, Simone Tiraboschi <span dir="ltr"><<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span>On Tue, Dec 1, 2015 at 12:55 AM, Thomas Scofield <span dir="ltr"><<a href="mailto:tscofield@gmail.com" target="_blank">tscofield@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr">That file is missing<div><br></div><div><div>[root@ovirt01 vdsm]# ls -l /var/run/ovirt-hosted-engine-ha/vm.conf</div><div>ls: cannot access /var/run/ovirt-hosted-engine-ha/vm.conf: No such file or directory</div><div>[root@ovirt01 vdsm]#</div></div></div></blockquote><div><br></div><div><br></div></span><div>Was it a fresh install or an upgrade from 3.5?</div><div>If you still have it, can you please attach the setup logs?</div><div><br></div><div>Can you please try to manually check vm.conf on the shared storage? This should do the job extracting the files in a local directory.</div><div><span style="font-size:12.8px">(please substitute '192.168.1.115:_Virtual_</span><span style="font-size:12.8px">ext35u36' with the </span><span style="font-size:12.8px">mount point</span><span style="font-size:12.8px"> of </span><span style="font-size:12.8px">hosted-engine storage domain on your system).</span><br></div><div><br></div><div><span style="font-family:monospace,monospace;font-size:12.8px">mntpoint=/rhev/data-center/</span><span style="font-family:monospace,monospace;font-size:12.8px">mnt/192.168.1.115:_Virtual_</span><span style="font-family:monospace,monospace;font-size:12.8px">ext35u36</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">dir=`mktemp -d` && cd $dir</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">sdUUID_line=$(grep sdUUID /etc/ovirt-hosted-engine/</span><span style="font-family:monospace,monospace;font-size:12.8px">hosted-engine.conf)</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">sdUUID=${sdUUID_line:7:36}</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">conf_volume_UUID_line=$(grep conf_volume_UUID /etc/ovirt-hosted-engine/</span><span style="font-family:monospace,monospace;font-size:12.8px">hosted-engine.conf)</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">conf_volume_UUID=${conf_</span><span style="font-family:monospace,monospace;font-size:12.8px">volume_UUID_line:17:36}</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">conf_image_UUID_line=$(grep conf_image_UUID /etc/ovirt-hosted-engine/</span><span style="font-family:monospace,monospace;font-size:12.8px">hosted-engine.conf)</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">conf_image_UUID=${conf_image_</span><span style="font-family:monospace,monospace;font-size:12.8px">UUID_line:16:36}</span><br style="font-family:monospace,monospace;font-size:12.8px"><span style="font-family:monospace,monospace;font-size:12.8px">dd if=$mntpoint/$sdUUID/images/$</span><span style="font-family:monospace,monospace;font-size:12.8px">conf_image_UUID/$conf_volume_</span><span style="font-family:monospace,monospace;font-size:12.8px">UUID 2>/dev/null| tar -xvf -</span><br></div><span><div><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Nov 30, 2015 at 4:04 AM, Simone Tiraboschi <span dir="ltr"><<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><div><div>On Fri, Nov 27, 2015 at 9:48 PM, Thomas Scofield <span dir="ltr"><<a href="mailto:tscofield@gmail.com" target="_blank">tscofield@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><span style="font-size:12.8px">I have recently setup a </span><span style="font-size:12.8px">ovirt</span><span style="font-size:12.8px"> hosted engine on iscsi storage and after a reboot of the system I am unable to start the hosted engine. The agent.log gives errors indicating there is a missing value in the vm.conf file, but the vm.conf file does not appear in the location indicated. There is no error indicated when the agent attempts to reload the vm.conf. Any ideas on how to get the hosted engine up and running?</span><br style="font-size:12.8px"><div style="font-size:12.8px"><br></div><div style="font-size:12.8px"><div>MainThread::INFO::2015-11-26 21:31:13,071::hosted_engine::699::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 1 is acquired (file: /var/run/vdsm/storage/ddf4a26b-61ff-49a4-81db-9f82da35e44b/6ed6d868-aaf3-4b3f-bdf0-a4ad262709ae/1fe5b7fc-eae7-4f07-a2fe-5a082e14c876)</div><div>MainThread::INFO::2015-11-26 21:31:13,072::upgrade::836::ovirt_hosted_engine_ha.lib.upgrade.StorageServer::(upgrade) Host configuration is already up-to-date</div><div>MainThread::INFO::2015-11-26 21:31:13,072::hosted_engine::422::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Reloading vm.conf from the shared storage domain</div><div>MainThread::ERROR::2015-11-26 21:31:13,100::agent::205::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent) Error: ''Configuration value not found: file=/var/run/<span>ovirt</span>-hosted-engine-ha/vm.conf, key=memSize'' - trying to restart agent</div><div>MainThread::WARNING::2015-11-26 21:31:18,105::agent::208::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent) Restarting agent, attempt '9'</div><div>MainThread::ERROR::2015-11-26 21:31:18,106::agent::210::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent) Too many errors occurred, giving up. Please review the log and consider filing a bug.</div><div>MainThread::INFO::2015-11-26 21:31:18,106::agent::143::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Agent shutting down</div></div></div></blockquote><div><br></div></div></div><div>Hi Thomas,</div><div>could you please attach also your <span style="font-size:12.8px">/var/run/</span><span style="font-size:12.8px">ovirt</span><span style="font-size:12.8px">-hosted-</span><span style="font-size:12.8px">engine-ha/vm.conf ?</span></div><span><div> <br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
<br></blockquote></span></div><br></div></div>
</blockquote></div><br></div>
</div></div></blockquote></span></div><br></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div></div>
</blockquote></div>
</div></div></blockquote></div><br></div></div>
</blockquote></div>
</div></div></blockquote></div><br></div></div>