<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">After more testing, I can get the engine vm to run manually with ha-agent stopped. It still fails the liveliness check. Here is the repeating error in the engine.log from the engine vm<div class=""><br class=""></div><div class="">ERROR [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool — 46) [] Error in getting DB connection, database is inaccessible: Error retrieving database metadata; nested exception is org.springframework.jdbc.support.MetaDataAccessException: Could not get Connection for extracting meta data; nested exception is org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is java.sql.SQLException: javax.resource.ResourceException: IJ000453: Unable to get managed connection for java:/ENGINEDataSource</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Found a suggestion about trying a test connection to the database and get the following.</div><div class=""><br class=""></div><div class=""><div class="">[root@fai-kvm-engine ~]# psql --host localhost --port 5432 --user engine --password engine</div><div class="">Password for user engine:</div><div class="">psql: could not connect to server: Connection refused</div><div class=""> Is the server running on host "localhost" (::1) and accepting</div><div class=""> TCP/IP connections on port 5432?</div><div class="">could not connect to server: Connection refused</div><div class=""> Is the server running on host "localhost" (127.0.0.1) and accepting</div><div class=""> TCP/IP connections on port 5432?</div><div class="">[root@fai-kvm-engine ~]#</div></div><div class=""><br class=""></div><div class="">and checking that postgresql is running shows </div><div class=""><br class=""></div><div class=""><div class="">[root@fai-kvm-engine ~]# systemctl status postgresql</div><div class="">â— postgresql.service - PostgreSQL database server</div><div class=""> Loaded: loaded (/usr/lib/systemd/system/postgresql.service; enabled; vendor preset: disabled)</div><div class=""> Active: failed (Result: exit-code) since Sat 2017-01-07 20:58:04 UTC; 2s ago</div><div class=""> Process: 23867 ExecStart=/usr/bin/pg_ctl start -D ${PGDATA} -s -o -p ${PGPORT} -w -t 300 (code=exited, status=1/FAILURE)</div><div class=""> Process: 23860 ExecStartPre=/usr/bin/postgresql-check-db-dir ${PGDATA} (code=exited, status=0/SUCCESS)</div><div class=""><br class=""></div><div class="">Jan 07 20:58:03 <a href="http://fai-kvm-engine.ravnalaska.net" class="">fai-kvm-engine.ravnalaska.net</a> systemd[1]: Starting PostgreSQL database server...</div><div class="">Jan 07 20:58:03 <a href="http://fai-kvm-engine.ravnalaska.net" class="">fai-kvm-engine.ravnalaska.net</a> pg_ctl[23867]: pg_ctl: another server might be running; trying to start server anyway</div><div class="">Jan 07 20:58:03 <a href="http://fai-kvm-engine.ravnalaska.net" class="">fai-kvm-engine.ravnalaska.net</a> pg_ctl[23867]: FATAL: pre-existing shared memory block (key 5432001, ID 0) is still in use</div><div class="">Jan 07 20:58:03 <a href="http://fai-kvm-engine.ravnalaska.net" class="">fai-kvm-engine.ravnalaska.net</a> pg_ctl[23867]: HINT: If you're sure there are no old server processes still running, remove the shared memory block or just delete the file "postmaster.pid".</div><div class="">Jan 07 20:58:04 <a href="http://fai-kvm-engine.ravnalaska.net" class="">fai-kvm-engine.ravnalaska.net</a> pg_ctl[23867]: pg_ctl: could not start server</div><div class="">Jan 07 20:58:04 <a href="http://fai-kvm-engine.ravnalaska.net" class="">fai-kvm-engine.ravnalaska.net</a> pg_ctl[23867]: Examine the log output.</div><div class="">Jan 07 20:58:04 <a href="http://fai-kvm-engine.ravnalaska.net" class="">fai-kvm-engine.ravnalaska.net</a> systemd[1]: postgresql.service: control process exited, code=exited status=1</div><div class="">Jan 07 20:58:04 <a href="http://fai-kvm-engine.ravnalaska.net" class="">fai-kvm-engine.ravnalaska.net</a> systemd[1]: Failed to start PostgreSQL database server.</div><div class="">Jan 07 20:58:04 <a href="http://fai-kvm-engine.ravnalaska.net" class="">fai-kvm-engine.ravnalaska.net</a> systemd[1]: Unit postgresql.service entered failed state.</div><div class="">Jan 07 20:58:04 <a href="http://fai-kvm-engine.ravnalaska.net" class="">fai-kvm-engine.ravnalaska.net</a> systemd[1]: postgresql.service failed.</div></div><div class=""><br class=""></div><div class=""><br class=""><div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><font face="Menlo" style="color: rgb(0, 0, 0); font-size: 12px; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><div class="">------------------------------------------------------------------------</div><div class="">Gary Pedretty <a href="mailto:gary@eraalaska.net" class="">gary@ravnalaska.net</a></div><div class="">Systems Manager <a href="http://www.flyravn.com" class="">www.flyravn.com</a></div><div class="">Ravn Alaska /\ 907-450-7251</div><div class="">5245 Airport Industrial Road / \/\ 907-450-7238 fax</div><div class="">Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment</div></font><font face="Monaco" class=""><span style="font-size: 12px;" class="">Serving All of Alaska / \/ /\ \ \/\ “Love your neighbor as</span></font><br style="font-family: Monaco;" class=""><font face="Menlo" style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-size: 12px;" class="">Really loving the record green up date! Summmer!! yourself” Matt 22:39</span></font><div style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: Menlo;" class=""></div><font face="Menlo" style="font-size: 12px;" class=""></font><span style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><font face="Menlo" class=""><div class="">------------------------------------------------------------------------</div></font></span><div style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><font face="Menlo" style="font-size: 12px;" class=""><br class=""></font></div></div><span style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><br class="Apple-interchange-newline"></span></div><span style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><br class="Apple-interchange-newline"></span></div><span style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><br class="Apple-interchange-newline"></span></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"><br class="Apple-interchange-newline">
</div>
<br class=""><div><blockquote type="cite" class=""><div class="">On Jan 6, 2017, at 10:05 PM, Gary Pedretty <<a href="mailto:gary@ravnalaska.net" class="">gary@ravnalaska.net</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">I just tried running the most recent update that came out for Ovirt Hosted Engine setup. This is a glusterized setup with 4 hosts setup as per the Documentation. Each host had the icon showing upgrades available so I started clicking upgrade for each host doing them one at time. 3 of them went into maintenance fine, migrated their VMs and then activated when done. The last one to do was the one actually running the hosted-engine VM. This host also had one other VM. It migrated the other VM just fine, but stalled trying to migrate the hosted-engine. Eventually the web interface became non-responsive and I moved to command line. I have tried everything to get the engine to start up. I have tried putting all the hosts in maintenance so that I could selectively tell it to start the hosted-engine VM on one host specifically, but each fails with the “Failed Liveliness error. I have tried restarting the ha agents, re-initializing the lockspace all with no success. All my VMs are still running fine, I just cannot get the hosted-engine to run. I can if necessary shutdown all the VMs and restart all the hosts, but was trying to avoid that unless I have to.<div class=""><br class=""></div><div class="">Ideas.</div><div class=""><br class=""></div><div class="">Gary</div><div class=""><br class=""></div><div class=""><br class=""><div class="">
<div style="letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><font face="Menlo" style="font-size: 12px; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><div class="">------------------------------------------------------------------------</div><div class="">Gary Pedretty <a href="mailto:gary@eraalaska.net" class="">gary@ravnalaska.net</a></div><div class="">Systems Manager <a href="http://www.flyravn.com/" class="">www.flyravn.com</a></div><div class="">Ravn Alaska /\ 907-450-7251</div><div class="">5245 Airport Industrial Road / \/\ 907-450-7238 fax</div><div class="">Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment</div></font><font face="Monaco" class=""><span style="font-size: 12px;" class="">Serving All of Alaska / \/ /\ \ \/\ “Love your neighbor as</span></font><br style="font-family: Monaco;" class=""><font face="Menlo" style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-size: 12px;" class="">Really loving the record green up date! Summmer!! yourself” Matt 22:39</span></font><div style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: Menlo;" class=""></div><font face="Menlo" style="font-size: 12px;" class=""></font><span style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><font face="Menlo" class=""><div class="">------------------------------------------------------------------------</div></font></span><div style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><font face="Menlo" style="font-size: 12px;" class=""><br class=""></font></div></div><span style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><br class="Apple-interchange-newline"></span></div><span style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><br class="Apple-interchange-newline"></span></div><span style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><br class="Apple-interchange-newline"></span></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"><br class="Apple-interchange-newline">
</div>
<br class=""></div></div>_______________________________________________<br class="">Users mailing list<br class=""><a href="mailto:Users@ovirt.org" class="">Users@ovirt.org</a><br class="">http://lists.ovirt.org/mailman/listinfo/users<br class=""></div></blockquote></div><br class=""></div></body></html>