Re: [Users] problems starting ovirt-engine after upgrade 3.2.0 to 3.2.1

Hi, After upgrading ovirt-engine several weeks ago, I tried to login the admin portal but the page was not loading. So I tried restart the service but it doesn't come up again. I didn't restart the engine after upgrade but I did update and reboot the underlying OS. systemctl status ovirt-engine-dwhd.service ovirt-engine-dwhd.service - LSB: oVirt Engine History ETL Service for Data Warehouse and Reporting Loaded: loaded (/etc/rc.d/init.d/ovirt-engine-dwhd) Active: failed (Result: exit-code) since Mon 2013-04-15 16:34:39 CEST; 11min ago Process: 1030 ExecStop=/etc/rc.d/init.d/ovirt-engine-dwhd stop (code=exited, status=0/SUCCESS) Process: 30063 ExecStart=/etc/rc.d/init.d/ovirt-engine-dwhd start (code=exited, status=1/FAILURE) Main PID: 954 (code=exited, status=232) CGroup: name=systemd:/system/ovirt-engine-dwhd.service Apr 15 16:34:29 ovirt01.netbulae.mgmt systemd[1]: Starting LSB: oVirt Engine History ETL Service for Data Warehouse and Reporting... Apr 15 16:34:29 ovirt01.netbulae.mgmt runuser[30068]: pam_unix(runuser:session): session opened for user root by (uid=0) Apr 15 16:34:29 ovirt01.netbulae.mgmt runuser[30068]: pam_unix(runuser:session): session closed for user root Apr 15 16:34:39 ovirt01.netbulae.mgmt ovirt-engine-dwhd[30063]: Starting ovirt-engine-dwhd: at Mon Apr 15 16:34:29 CEST 2013[FAILED] Apr 15 16:34:39 ovirt01.netbulae.mgmt systemd[1]: ovirt-engine-dwhd.service: control process exited, code=exited status=1 Apr 15 16:34:39 ovirt01.netbulae.mgmt systemd[1]: Failed to start LSB: oVirt Engine History ETL Service for Data Warehouse and Reporting. Apr 15 16:34:39 ovirt01.netbulae.mgmt systemd[1]: Unit ovirt-engine-dwhd.service entered failed state rpm -qa|grep ovirt ovirt-engine-backend-3.2.1-1.fc18.noarch ovirt-host-deploy-java-1.0.1-1.fc18.noarch ovirt-engine-setup-3.2.1-1.fc18.noarch ovirt-engine-userportal-3.2.1-1.fc18.noarch ovirt-engine-restapi-3.2.1-1.fc18.noarch ovirt-iso-uploader-3.2.1-1.fc18.noarch ovirt-engine-cli-3.2.0.11-1.fc18.noarch ovirt-engine-tools-3.2.1-1.fc18.noarch ovirt-engine-genericapi-3.2.1-1.fc18.noarch ovirt-engine-sdk-3.2.0.10-1.fc18.noarch ovirt-engine-webadmin-portal-3.2.1-1.fc18.noarch ovirt-engine-3.2.1-1.fc18.noarch ovirt-engine-dwh-3.2.0-1.fc18.noarch ovirt-image-uploader-3.2.1-1.fc18.noarch ovirt-log-collector-3.2.1-1.fc18.noarch ovirt-release-fedora-5-3.noarch ovirt-host-deploy-1.0.1-1.fc18.noarch ovirt-engine-dbscripts-3.2.1-1.fc18.noarch tail ovirt-engine-dwhd.log 2013-04-15 16:34:29|ETL Service Started 2013-04-15 16:34:30|ETL Service Stopped 2013-04-15 16:34:30|OHuFYx|OHuFYx|OHuFYx|OVIRT_ENGINE_DWH|HistoryETL|Default|5|tDie|tDie_1|oVirt Engine Portal is not available. Please check your ETL configuration.|9704 oVirt Engine Portal is not available. Please check your ETL configuration. cat ovirt-engine-dwh-setup-2013_03_19_13_41_15.log 2013-03-19 13:41:15::DEBUG::ovirt-engine-dwh-setup::225::root:: starting main() 2013-03-19 13:41:15::DEBUG::common_utils::415::root:: found existing pgpass file, fetching DB host value 2013-03-19 13:41:15::DEBUG::common_utils::415::root:: found existing pgpass file, fetching DB port value 2013-03-19 13:41:15::DEBUG::common_utils::415::root:: found existing pgpass file, fetching DB admin value 2013-03-19 13:41:15::DEBUG::common_utils::415::root:: found existing pgpass file, fetching DB admin value 2013-03-19 13:41:15::DEBUG::common_utils::448::root:: getting DB password for postgres 2013-03-19 13:41:15::DEBUG::common_utils::457::root:: found password for username postgres 2013-03-19 13:41:15::DEBUG::common_utils::58::root:: getting vdc option MinimalETLVersion 2013-03-19 13:41:15::DEBUG::common_utils::512::root:: Executing command --> '['/usr/bin/engine-config', '-g', 'MinimalETLVersion', '--cver=general', '-p', '/usr/share/ovirt-engine/conf/engine-config-install.properties']' 2013-03-19 13:41:17::DEBUG::common_utils::551::root:: output = 3.2.0 2013-03-19 13:41:17::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:41:17::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:41:17::DEBUG::common_utils::61::root:: Value of MinimalETLVersion is 3.2.0 2013-03-19 13:41:17::DEBUG::common_utils::512::root:: Executing command --> '['rpm', '-q', '--queryformat', '%{VERSION}-%{RELEASE}', 'ovirt-engine-dwh']' 2013-03-19 13:41:17::DEBUG::common_utils::551::root:: output = 3.2.0-1.fc18 2013-03-19 13:41:17::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:41:17::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:41:17::DEBUG::common_utils::347::root:: setting regex (\d+\.\d+)\.(\d+)\-(\d+) againts 3.2.0-1.fc18 2013-03-19 13:41:17::DEBUG::common_utils::352::root:: found version, 3.2 2013-03-19 13:41:17::DEBUG::common_utils::354::root:: found minorVersion 0 2013-03-19 13:41:17::DEBUG::common_utils::356::root:: found release 1 2013-03-19 13:41:17::DEBUG::common_utils::347::root:: setting regex (\d+\.\d+)\.(\d+)\-(\d+) againts 3.2.0-0 2013-03-19 13:41:17::DEBUG::common_utils::352::root:: found version, 3.2 2013-03-19 13:41:17::DEBUG::common_utils::354::root:: found minorVersion 0 2013-03-19 13:41:17::DEBUG::common_utils::356::root:: found release 0 2013-03-19 13:41:17::DEBUG::common_utils::234::root:: checking ovirt-engine service 2013-03-19 13:41:17::DEBUG::common_utils::222::root:: checking the status of ovirt-engine 2013-03-19 13:41:17::DEBUG::common_utils::512::root:: Executing command --> '['service', 'ovirt-engine', 'status']' 2013-03-19 13:41:17::DEBUG::common_utils::551::root:: output = ovirt-engine.service - oVirt Engine Loaded: loaded (/usr/lib/systemd/system/ovirt-engine.service; enabled) Active: active (running) since Mon 2013-03-18 14:34:20 CET; 23h ago Main PID: 18713 (java) CGroup: name=systemd:/system/ovirt-engine.service └─18713 engine-service -server -XX:+TieredCompilation -Xms1g -Xmx1g -XX:PermSize=256m -XX:MaxPermSize=256m -Djava.net.preferIPv4Stack=true -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.awt.headless=true -Djava.util.logging.manager=org.jboss.logmanager -Dlogging.configuration=file:///var/tmp/ovirt-engine/engine-service-logging.properties -Dorg.jboss.resolver.warning=true -Djboss.modules.system.pkgs=org.jboss.byteman -Djboss.server.default.config=engine-service -Djboss.home.dir=/usr/share/jboss-as -Djboss.server.base.dir=/usr/share/ovirt-engine -Djboss.server.config.dir=/var/tmp/ovirt-engine -Djboss.server.data.dir=/var/lib/ovirt-engine -Djboss.server.log.dir=/var/log/ovirt-engine -Djboss.server.temp.dir=/var/tmp/ovirt-engine -Djboss.controller.temp.dir=/var/tmp/ovirt-engine -jar /usr/share/jboss-as/jboss-modules.jar -mp /usr/share/ovirt-engine/modules:/var/tmp/ovirt-engine/modules -jaxpmodule javax.xml.jaxp-provider org.jboss.as.standalone -c engine-service.xml Mar 18 14:34:20 ovirt01.netbulae.mgmt engine-service[18711]: Started engine process 18713. Mar 18 14:34:20 ovirt01.netbulae.mgmt engine-service[18711]: Starting engine-service: [ OK ] Mar 18 14:34:20 ovirt01.netbulae.mgmt systemd[1]: Started oVirt Engine. 2013-03-19 13:41:17::DEBUG::common_utils::552::root:: stderr = Redirecting to /bin/systemctl status ovirt-engine.service 2013-03-19 13:41:17::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:41:17::DEBUG::common_utils::296::root:: Stopping ovirt-engine-dwhd 2013-03-19 13:41:17::DEBUG::common_utils::512::root:: Executing command --> '['service', 'ovirt-engine-dwhd', 'stop']' 2013-03-19 13:41:17::DEBUG::common_utils::551::root:: output = Stopping ovirt-engine-dwhd (via systemctl): [ OK ] 2013-03-19 13:41:17::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:41:17::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:41:17::DEBUG::decorators::18::root:: running setDbPass 2013-03-19 13:41:17::DEBUG::ovirt-engine-dwh-setup::117::root:: Setting DB pass 2013-03-19 13:41:17::DEBUG::ovirt-engine-dwh-setup::118::root:: editing etl db connectivity file 2013-03-19 13:41:17::DEBUG::ovirt-engine-dwh-setup::159::root:: reading /etc/sysconfig/ovirt-engine 2013-03-19 13:41:17::DEBUG::ovirt-engine-dwh-setup::176::root:: Secure web port is: 443 2013-03-19 13:41:17::DEBUG::ovirt-engine-dwh-setup::180::root:: Host's FQDN: xxx.yyy.zzz 2013-03-19 13:41:17::DEBUG::common_utils::58::root:: getting vdc option TruststoreUrl 2013-03-19 13:41:17::DEBUG::common_utils::512::root:: Executing command --> '['/usr/bin/engine-config', '-g', 'TruststoreUrl', '--cver=general', '-p', '/usr/share/ovirt-engine/conf/engine-config-install.properties']' 2013-03-19 13:41:18::DEBUG::common_utils::551::root:: output = /etc/pki/ovirt-engine/.truststore 2013-03-19 13:41:18::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:41:18::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:41:18::DEBUG::common_utils::61::root:: Value of TruststoreUrl is /etc/pki/ovirt-engine/.truststore 2013-03-19 13:41:18::DEBUG::common_utils::58::root:: getting vdc option TruststorePass 2013-03-19 13:41:18::DEBUG::common_utils::512::root:: Executing command --> '['/usr/bin/engine-config', '-g', 'TruststorePass', '--cver=general', '-p', '/usr/share/ovirt-engine/conf/engine-config-install.properties']' 2013-03-19 13:41:20::DEBUG::common_utils::551::root:: output = mypass 2013-03-19 13:41:20::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:41:20::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:41:20::DEBUG::common_utils::61::root:: Value of TruststorePass is mypass 2013-03-19 13:41:20::DEBUG::common_utils::512::root:: Executing command --> '['rpm', '-q', '--queryformat', '%{VERSION}-%{RELEASE}', 'ovirt-engine-dwh']' 2013-03-19 13:41:20::DEBUG::common_utils::551::root:: output = 3.2.0-1.fc18 2013-03-19 13:41:20::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:41:20::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:41:20::DEBUG::common_utils::347::root:: setting regex (\d+\.\d+)\.(\d+)\-(\d+) againts 3.2.0-1.fc18 2013-03-19 13:41:20::DEBUG::common_utils::352::root:: found version, 3.2 2013-03-19 13:41:20::DEBUG::common_utils::354::root:: found minorVersion 0 2013-03-19 13:41:20::DEBUG::common_utils::356::root:: found release 1 2013-03-19 13:41:20::DEBUG::ovirt-engine-dwh-setup::212::root:: Setting etlVersion 2013-03-19 13:41:20::DEBUG::ovirt-engine-dwh-setup::213::root:: editing etl connectivity file 2013-03-19 13:41:20::DEBUG::ovirt-engine-dwh-setup::43::root:: checking if ovirt_engine_history db already exists 2013-03-19 13:41:20::DEBUG::common_utils::204::root:: running sql query on host: localhost, port: 5432, db: ovirt_engine_history, user: postgres, query: 'select 1'. 2013-03-19 13:41:20::DEBUG::common_utils::512::root:: Executing command --> '['/usr/bin/psql', '--pset=tuples_only=on', '--set', 'ON_ERROR_STOP=1', '--dbname', 'ovirt_engine_history', '--host', 'localhost', '--port', '5432', '--username', 'postgres', '-c', 'select 1']' 2013-03-19 13:41:20::DEBUG::common_utils::551::root:: output = 2013-03-19 13:41:20::DEBUG::common_utils::552::root:: stderr = psql: FATAL: database "ovirt_engine_history" does not exist 2013-03-19 13:41:20::DEBUG::common_utils::553::root:: retcode = 2 2013-03-19 13:41:20::DEBUG::decorators::18::root:: running createDB 2013-03-19 13:41:20::DEBUG::ovirt-engine-dwh-setup::55::root:: installing ovirt_engine_history db 2013-03-19 13:41:20::DEBUG::ovirt-engine-dwh-setup::58::root:: ovirt engine history db creation is logged at /var/log/ovirt-engine/ovirt-history-db-install-2013_03_19_13_41_20.log 2013-03-19 13:41:20::DEBUG::common_utils::512::root:: Executing command --> '['/sbin/ip', 'addr']' 2013-03-19 13:41:20::DEBUG::common_utils::551::root:: output = 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 52:54:00:6b:3d:f1 brd ff:ff:ff:ff:ff:ff inet 10.50.50.201/24 brd 10.50.50.255 scope global eth0 inet6 fe80::5054:ff:fe6b:3df1/64 scope link valid_lft forever preferred_lft forever 2013-03-19 13:41:20::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:41:20::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:41:20::DEBUG::common_utils::487::root:: Found IP Address: xxx.yyy.zzz 2013-03-19 13:41:20::DEBUG::common_utils::512::root:: Executing command --> '['/usr/share/ovirt-engine-dwh/db-scripts/ovirt-engine-history-db-install.sh', '-l', 'ovirt-history-db-install-2013_03_19_13_41_20.log', '-u', 'postgres', '-s', 'localhost', '-p', '5432', '-r', 'local']' 2013-03-19 13:42:09::DEBUG::common_utils::551::root:: output = 2013-03-19 13:42:09::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:42:09::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:42:09::DEBUG::ovirt-engine-dwh-setup::75::root:: Successfully installed ovirt_engine_history DB 2013-03-19 13:42:09::DEBUG::common_utils::222::root:: checking the status of ovirt-engine 2013-03-19 13:42:09::DEBUG::common_utils::512::root:: Executing command --> '['service', 'ovirt-engine', 'status']' 2013-03-19 13:42:09::DEBUG::common_utils::551::root:: output = ovirt-engine.service - oVirt Engine Loaded: loaded (/usr/lib/systemd/system/ovirt-engine.service; enabled) Active: active (running) since Mon 2013-03-18 14:34:20 CET; 23h ago Main PID: 18713 (java) CGroup: name=systemd:/system/ovirt-engine.service └─18713 engine-service -server -XX:+TieredCompilation -Xms1g -Xmx1g -XX:PermSize=256m -XX:MaxPermSize=256m -Djava.net.preferIPv4Stack=true -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.awt.headless=true -Djava.util.logging.manager=org.jboss.logmanager -Dlogging.configuration=file:///var/tmp/ovirt-engine/engine-service-logging.properties -Dorg.jboss.resolver.warning=true -Djboss.modules.system.pkgs=org.jboss.byteman -Djboss.server.default.config=engine-service -Djboss.home.dir=/usr/share/jboss-as -Djboss.server.base.dir=/usr/share/ovirt-engine -Djboss.server.config.dir=/var/tmp/ovirt-engine -Djboss.server.data.dir=/var/lib/ovirt-engine -Djboss.server.log.dir=/var/log/ovirt-engine -Djboss.server.temp.dir=/var/tmp/ovirt-engine -Djboss.controller.temp.dir=/var/tmp/ovirt-engine -jar /usr/share/jboss-as/jboss-modules.jar -mp /usr/share/ovirt-engine/modules:/var/tmp/ovirt-engine/modules -jaxpmodule javax.xml.jaxp-provider org.jboss.as.standalone -c engine-service.xml Mar 18 14:34:20 ovirt01.netbulae.mgmt engine-service[18711]: Started engine process 18713. Mar 18 14:34:20 ovirt01.netbulae.mgmt engine-service[18711]: Starting engine-service: [ OK ] Mar 18 14:34:20 ovirt01.netbulae.mgmt systemd[1]: Started oVirt Engine. 2013-03-19 13:42:09::DEBUG::common_utils::552::root:: stderr = Redirecting to /bin/systemctl status ovirt-engine.service 2013-03-19 13:42:09::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:42:09::DEBUG::decorators::18::root:: running startEngineService 2013-03-19 13:42:09::DEBUG::common_utils::263::root:: Starting ovirt-engine 2013-03-19 13:42:09::DEBUG::common_utils::512::root:: Executing command --> '['service', 'ovirt-engine', 'start']' 2013-03-19 13:42:09::DEBUG::common_utils::551::root:: output = 2013-03-19 13:42:09::DEBUG::common_utils::552::root:: stderr = Redirecting to /bin/systemctl start ovirt-engine.service 2013-03-19 13:42:09::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:42:29::DEBUG::common_utils::512::root:: Executing command --> '['/sbin/chkconfig', 'ovirt-engine-dwhd', 'on']' 2013-03-19 13:42:29::DEBUG::common_utils::551::root:: output = 2013-03-19 13:42:29::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:42:29::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:42:29::DEBUG::common_utils::327::root:: checking the status of ovirt-engine-dwhd 2013-03-19 13:42:29::DEBUG::common_utils::512::root:: Executing command --> '['service', 'ovirt-engine-dwhd', 'status']' 2013-03-19 13:42:29::DEBUG::common_utils::551::root:: output = /etc/init.d/ovirt-engine-dwhd is stopped 2013-03-19 13:42:29::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:42:29::DEBUG::common_utils::553::root:: retcode = 1 2013-03-19 13:42:29::DEBUG::decorators::18::root:: running startEtlService 2013-03-19 13:42:29::DEBUG::common_utils::319::root:: Starting ovirt-engine-dwhd 2013-03-19 13:42:29::DEBUG::common_utils::512::root:: Executing command --> '['service', 'ovirt-engine-dwhd', 'start']' 2013-03-19 13:42:39::DEBUG::common_utils::551::root:: output = Starting ovirt-engine-dwhd (via systemctl): [ OK ] 2013-03-19 13:42:39::DEBUG::common_utils::552::root:: stderr = 2013-03-19 13:42:39::DEBUG::common_utils::553::root:: retcode = 0 2013-03-19 13:42:39::DEBUG::ovirt-engine-dwh-setup::265::root:: main() ended -- Kind regards, Jorick Astrego Netbulae B.V. n Site:http://www.netbulae.eu _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users