<div dir="ltr">Didi,<div><br></div><div>Both source and destination machines (assuming you are referring to the physical host source and virtual host destination of the migration) are running ovirt-engine 3.5.2.1-1. However, the "source" is on CentOS 6.6, whereas the "destination" is on CentOS 7.1. The source is running postgresql(/-server) 8.4.20, Java 1.7.0_79, httpd 2.2.15. Destination is running postgresql(/-server) 9.2.10, Java 1.7.0.79, jboss-httpd 2.4.6. I'm not sure which over package version is relevant.</div><div><br></div><div>The failure occurs after engine-setup, and the web UI doesn't load, and the host reports the engine is not up (I'm not in front of the host, so I don't have the exact language).</div><div><br></div><div>Our current setup has 2 physical hosts, ~15 active VMs. Each host has 64GB RAM. Even with all the VM on one host, the utilization is less than 50%. We have another physical storage server, that provides the NFS storage backend to the hosts and VMs. Prior to attempting the hosted-engine migration, I migrated all the VMs to host #1, where the engine was originally installed. I then removed host #2 from the host list via the UI, and performed hosted-engine --deploy on host #2. A few other quirks I encountered:</div><div><br></div><div>1. I originally wanted to do "hosted-engine --deploy" on host #1, but that it was unsuccessful due to it complaining the storage connection was busy (or something).</div><div>2. I then tried to do "hosted-engine --deploy" on host #2, using the same storage connection path as what I used for host #1 originally. The setup process asked if it was an "additional host", I said no, but later it cannot activate the storage connection.</div><div>3. Lastly I did "hosted-engine --deploy" on host #2, but pointing to a different storage connection path, still on the same storage server. This was successful until the I encountered the failure in question.</div><div><br></div><div>Thanks,</div><div><br></div><div>Haven</div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 26, 2015 at 2:20 AM, Yedidyah Bar David <span dir="ltr"><<a href="mailto:didi@redhat.com" target="_blank">didi@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">----- Original Message -----<br>
> From: "Haoyang Haven Liu" <<a href="mailto:haven.liu@ucla.edu">haven.liu@ucla.edu</a>><br>
> To: <a href="mailto:users@ovirt.org">users@ovirt.org</a><br>
> Sent: Tuesday, May 26, 2015 8:34:00 AM<br>
> Subject: [ovirt-users] hosted engine does not start correctly (CentOS 7.1, overt-engine 3.5.2)<br>
><br>
> Hello,<br>
><br>
> I tried to follow < <a href="http://www.ovirt.org/Migrate_to_Hosted_Engine" target="_blank">http://www.ovirt.org/Migrate_to_Hosted_Engine</a> > to<br>
> migrate an existing ovirt environment. I managed to complete the<br>
> “engine-backup —mode=restore…” step, and the following “engine-setup” step<br>
> appear to have completed. However, the ovirt-engine service was not started<br>
> successfully has errors:<br>
><br>
> [root@ovirt ~]# systemctl status ovirt-engine<br>
> ovirt-engine.service - oVirt Engine<br>
> Loaded: loaded (/usr/lib/systemd/system/ovirt-engine.service; enabled)<br>
> Active: failed (Result: exit-code) since Mon 2015-05-25 22:26:12 PDT; 43s ago<br>
> Main PID: 15931 (code=exited, status=1/FAILURE)<br>
><br>
> May 25 22:26:11 <a href="http://ovirt.polysep.ucla.edu" target="_blank">ovirt.polysep.ucla.edu</a> systemd[1]: Started oVirt Engine.<br>
> May 25 22:26:12 <a href="http://ovirt.polysep.ucla.edu" target="_blank">ovirt.polysep.ucla.edu</a> ovirt-engine.py[15931]: 2015-05-25<br>
> 22:26:12,269 ovirt-engine: ERROR run:532 Error: process termina...code 1<br>
> May 25 22:26:12 <a href="http://ovirt.polysep.ucla.edu" target="_blank">ovirt.polysep.ucla.edu</a> systemd[1]: ovirt-engine.service: main<br>
> process exited, code=exited, status=1/FAILURE<br>
> May 25 22:26:12 <a href="http://ovirt.polysep.ucla.edu" target="_blank">ovirt.polysep.ucla.edu</a> systemd[1]: Unit ovirt-engine.service<br>
> entered failed state.<br>
> Hint: Some lines were ellipsized, use -l to show in full.<br>
><br>
> Additionally, /var/log/ovirt-engine/console.log complains “cannot allocate<br>
> memory”. The VM engine has 4GB of memory, but ovirt-engine engine seems to<br>
> want ~11GB of memory, is that right?<br>
><br>
> [root@ovirt ~]# cat /var/log/ovirt-engine/console.log<br>
> OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x0000000412180000,<br>
> 11250696192, 0) failed; error='Cannot allocate memory' (errno=12)<br>
> #<br>
> # There is insufficient memory for the Java Runtime Environment to continue.<br>
> # Native memory allocation (malloc) failed to allocate 11250696192 bytes for<br>
> committing reserved memory.<br>
> # An error report file with more information is saved as:<br>
> # /tmp/jvm-15974/hs_error.log<br>
> [root@ovirt ~]# free -m<br>
> total used free shared buff/cache available<br>
> Mem: 3791 123 3175 28 492 3428<br>
> Swap: 2559 0 2559<br>
> [root@ovirt ~]#<br>
><br>
> The hs_error.log is attached.<br>
><br>
> Any help is appreciated.<br>
<br>
Can you please compare versions of all installed packages between the source<br>
and destination machines?<br>
<br>
I assume the failure above is right after engine-setup, right? Before continuing<br>
the interaction on hosted-engine side?<br>
<br>
Did you try to restart the engine (systemctl restart ovirt-engine)? Did it fail<br>
the same way?<br>
<br>
How much memory do you have on the source machine? And how much does the engine<br>
actually use there?<br>
<br>
How large is your system (hosts, VMs etc)?<br>
<br>
Best,<br>
<span class="HOEnZb"><font color="#888888">--<br>
Didi<br>
</font></span></blockquote></div><br></div>