<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Nov 16, 2017 at 7:09 AM, Rudi Ahlers <span dir="ltr"><<a href="mailto:rudiahlers@gmail.com" target="_blank">rudiahlers@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I forgot to add: <div><br></div><div>The file /var/run/ovirt-hosted-<wbr>engine-ha/vm.conf doesn't exist:</div><div><br></div><div><div>[root@virt1 ~]# ll /var/run/ovirt-hosted-engine-<wbr>ha/vm.conf</div><div>ls: cannot access /var/run/ovirt-hosted-engine-<wbr>ha/vm.conf: No such file or directory</div><div>[root@virt1 ~]# ll /var/run/ovirt-hosted-engine-<wbr>ha/</div><div>total 8</div><div>-rw-r--r--. 1 root root 5 Nov 16 08:05 agent.pid</div><div>-rw-r--r--. 1 root root 5 Nov 16 06:45 broker.pid</div><div>srwxr-xr-x. 1 vdsm kvm 0 Nov 16 06:45 broker.socket</div></div><div><br></div><div>I am not sure how to get it (back?) or how to generate it?</div></div></blockquote><div><br></div><div>Hi Rudi,</div><div>we have to understand what happened at setup time.</div><div>Do you still have hosted-engine-setup logs file under /var/log/ovirt-hosted-engine-setup on your first host?</div><div>Could you please share it?</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><br></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Nov 16, 2017 at 7:55 AM, Rudi Ahlers <span dir="ltr"><<a href="mailto:rudiahlers@gmail.com" target="_blank">rudiahlers@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi, <div><br></div><div>I wonder if someone can help. After a system reboot, the Hosted-Agent isn't running. This is on a fresh installaion CentOS Linux release 7.4.1708 running ovirt-release41-4.1.7-1.el7.ce<wbr>ntos.noarch. Gluster is setup on 3 nodes, but hosted-engine is only setup on the 1st node for now. </div><div><br></div><div>[root@virt1 ~]# hosted-engine --console</div><div>Virtual machine does not exist</div><div>The engine VM is not on this host</div><div><br></div><div>[root@virt1 ~]# hosted-engine --vm-status</div><div>The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.</div><div><br></div><div><div><br></div><div>[root@virt1 ~]# ps ax | grep ovirt-ha-agent</div><div>41309 ? Rsl 0:14 /usr/bin/python /usr/share/ovirt-hosted-engine<wbr>-ha/ovirt-ha-agent --no-daemon</div><div>42818 pts/0 S+ 0:00 grep --color=auto ovirt-ha-agent</div></div><div><br></div><div><br></div><div><div>[root@virt1 ~]# mount | grep engine</div><div>/dev/mapper/storage-engine on /storage/engine type xfs (rw,relatime,seclabel,attr2,in<wbr>ode64,sunit=1024,swidth=2048,<wbr>noquota)</div><div>virt1:/engine on /mnt/engine type fuse.glusterfs (rw,relatime,user_id=0,group_i<wbr>d=0,default_permissions,allow_<wbr>other,max_read=131072)</div><div>virt1:/engine on /rhev/data-center/mnt/glusterS<wbr>D/virt1:_engine type fuse.glusterfs (rw,relatime,user_id=0,group_i<wbr>d=0,default_permissions,allow_<wbr>other,max_read=131072)</div></div><div><br></div><div><br></div><div>And then I see this error:</div><div><br></div><div><div>[root@virt1 ~]# systemctl status ovirt-ha-agent -l</div><div>● ovirt-ha-agent.service - oVirt Hosted Engine High Availability Monitoring Agent</div><div> Loaded: loaded (/usr/lib/systemd/system/ovirt<wbr>-ha-agent.service; enabled; vendor preset: disabled)</div><div> Active: active (running) since Thu 2017-11-16 07:44:43 SAST; 4min 23s ago</div><div> Main PID: 41309 (ovirt-ha-agent)</div><div> CGroup: /system.slice/ovirt-ha-agent.s<wbr>ervice</div><div> └─41309 /usr/bin/python /usr/share/ovirt-hosted-engine<wbr>-ha/ovirt-ha-agent --no-daemon</div><div><br></div><div>Nov 16 07:48:30 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs</div><div>Nov 16 07:48:30 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR 'version' is not stored in the HE configuration image</div><div>Nov 16 07:48:39 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs</div><div>Nov 16 07:48:39 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR 'version' is not stored in the HE configuration image</div><div>Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs</div><div>Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR 'version' is not stored in the HE configuration image</div><div>Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.a<wbr>gent.Agent ERROR Traceback (most recent call last):</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>agent/agent.py", line 191, in _run_agent</div><div> return action(he)</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>agent/agent.py", line 64, in action_proper</div><div> return he.start_monitoring()</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>agent/hosted_engine.py", line 423, in start_monitoring</div><div> for old_state, state, delay in self.fsm:</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>lib/fsm/machine.py", line 127, in next</div><div> new_data = self.refresh(self._state.data)</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>agent/state_machine.py", line 123, in refresh</div><div> ] = self.hosted_engine.min_memory_<wbr>threshold</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>agent/hosted_engine.py", line 183, in min_memory_threshold</div><div> return int(self._config.get(config.VM<wbr>, config.MEM_SIZE))</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>env/config.py", line 226, in get</div><div> key</div><div> KeyError: 'Configuration value not found: file=/var/run/ovirt-hosted-eng<wbr>ine-ha/vm.conf, key=memSize'</div><div>Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.a<wbr>gent.Agent ERROR Trying to restart agent</div><div>Nov 16 07:49:01 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs</div><div>Nov 16 07:49:01 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR 'version' is not stored </div></div><div><br></div><div><br></div><div><br></div><div>All the nodes resolve fine, and has been added to /etc/hosts:</div><div><br></div><div><div>[root@virt1 ~]# systemctl status ovirt-ha-agent -l</div><div>● ovirt-ha-agent.service - oVirt Hosted Engine High Availability Monitoring Agent</div><div> Loaded: loaded (/usr/lib/systemd/system/ovirt<wbr>-ha-agent.service; enabled; vendor preset: disabled)</div><div> Active: active (running) since Thu 2017-11-16 07:44:43 SAST; 4min 23s ago</div><div> Main PID: 41309 (ovirt-ha-agent)</div><div> CGroup: /system.slice/ovirt-ha-agent.s<wbr>ervice</div><div> └─41309 /usr/bin/python /usr/share/ovirt-hosted-engine<wbr>-ha/ovirt-ha-agent --no-daemon</div><div><br></div><div>Nov 16 07:48:30 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs</div><div>Nov 16 07:48:30 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR 'version' is not stored in the HE configuration image</div><div>Nov 16 07:48:39 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs</div><div>Nov 16 07:48:39 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR 'version' is not stored in the HE configuration image</div><div>Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs</div><div>Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR 'version' is not stored in the HE configuration image</div><div>Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.a<wbr>gent.Agent ERROR Traceback (most recent call last):</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>agent/agent.py", line 191, in _run_agent</div><div> return action(he)</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>agent/agent.py", line 64, in action_proper</div><div> return he.start_monitoring()</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>agent/hosted_engine.py", line 423, in start_monitoring</div><div> for old_state, state, delay in self.fsm:</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>lib/fsm/machine.py", line 127, in next</div><div> new_data = self.refresh(self._state.data)</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>agent/state_machine.py", line 123, in refresh</div><div> ] = self.hosted_engine.min_memory_<wbr>threshold</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>agent/hosted_engine.py", line 183, in min_memory_threshold</div><div> return int(self._config.get(config.VM<wbr>, config.MEM_SIZE))</div><div> File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_hosted_engine_ha/<wbr>env/config.py", line 226, in get</div><div> key</div><div> KeyError: 'Configuration value not found: file=/var/run/ovirt-hosted-eng<wbr>ine-ha/vm.conf, key=memSize'</div><div>Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.a<wbr>gent.Agent ERROR Trying to restart agent</div><div>Nov 16 07:49:01 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs</div><div>Nov 16 07:49:01 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.h<wbr>osted_engine.HostedEngine.conf<wbr>ig ERROR 'version' is not stored </div></div><span class="m_3968563599401294980HOEnZb"><font color="#888888"><div><br></div><div><br clear="all"><div><br></div>-- <br><div class="m_3968563599401294980m_-619526650742811424gmail_signature">Kind Regards<br>Rudi Ahlers<br>Website: <a href="http://www.rudiahlers.co.za" target="_blank">http://www.rudiahlers.co.za</a><br></div>
</div></font></span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="m_3968563599401294980gmail_signature" data-smartmail="gmail_signature">Kind Regards<br>Rudi Ahlers<br>Website: <a href="http://www.rudiahlers.co.za" target="_blank">http://www.rudiahlers.co.za</a><br></div>
</div>
</div></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><br>
<br></blockquote></div><br></div></div>