Re: [Users] problems starting ovirt-engine after upgrade 3.2.0 to 3.2.1

20 Apr 2013


      On 04/15/2013 05:49 PM, Jorick Astrego wrote:
...
Hi,
After upgrading ovirt-engine several weeks ago, I tried to login the
admin portal but the page was not loading.
So I tried restart the service but it doesn't come up again. I didn't
restart the engine after upgrade but I did update and reboot the
underlying OS.
systemctl status ovirt-engine-dwhd.service
ovirt-engine-dwhd.service - LSB: oVirt Engine History ETL Service
    for Data Warehouse and Reporting
           Loaded: loaded (/etc/rc.d/init.d/ovirt-engine-dwhd)
           Active: failed (Result: exit-code) since Mon 2013-04-15
    16:34:39 CEST; 11min ago
          Process: 1030 ExecStop=/etc/rc.d/init.d/ovirt-engine-dwhd stop
    (code=exited, status=0/SUCCESS)
          Process: 30063 ExecStart=/etc/rc.d/init.d/ovirt-engine-dwhd
    start (code=exited, status=1/FAILURE)
         Main PID: 954 (code=exited, status=232)
           CGroup: name=systemd:/system/ovirt-engine-dwhd.service
    Apr 15 16:34:29 ovirt01.netbulae.mgmt systemd[1]: Starting LSB:
    oVirt Engine History ETL Service for Data Warehouse and Reporting...
    Apr 15 16:34:29 ovirt01.netbulae.mgmt runuser[30068]:
    pam_unix(runuser:session): session opened for user root by (uid=0)
    Apr 15 16:34:29 ovirt01.netbulae.mgmt runuser[30068]:
    pam_unix(runuser:session): session closed for user root
    Apr 15 16:34:39 ovirt01.netbulae.mgmt ovirt-engine-dwhd[30063]:
    Starting ovirt-engine-dwhd: at Mon Apr 15 16:34:29 CEST 2013[FAILED]
    Apr 15 16:34:39 ovirt01.netbulae.mgmt systemd[1]:
    ovirt-engine-dwhd.service: control process exited, code=exited status=1
    Apr 15 16:34:39 ovirt01.netbulae.mgmt systemd[1]: Failed to start
    LSB: oVirt Engine History ETL Service for Data Warehouse and Reporting.
    Apr 15 16:34:39 ovirt01.netbulae.mgmt systemd[1]: Unit
    ovirt-engine-dwhd.service entered failed state
rpm -qa|grep ovirt
ovirt-engine-backend-3.2.1-1.fc18.noarch
    ovirt-host-deploy-java-1.0.1-1.fc18.noarch
    ovirt-engine-setup-3.2.1-1.fc18.noarch
    ovirt-engine-userportal-3.2.1-1.fc18.noarch
    ovirt-engine-restapi-3.2.1-1.fc18.noarch
    ovirt-iso-uploader-3.2.1-1.fc18.noarch
    ovirt-engine-cli-3.2.0.11-1.fc18.noarch
    ovirt-engine-tools-3.2.1-1.fc18.noarch
    ovirt-engine-genericapi-3.2.1-1.fc18.noarch
    ovirt-engine-sdk-3.2.0.10-1.fc18.noarch
    ovirt-engine-webadmin-portal-3.2.1-1.fc18.noarch
    ovirt-engine-3.2.1-1.fc18.noarch
    ovirt-engine-dwh-3.2.0-1.fc18.noarch
    ovirt-image-uploader-3.2.1-1.fc18.noarch
    ovirt-log-collector-3.2.1-1.fc18.noarch
    ovirt-release-fedora-5-3.noarch
    ovirt-host-deploy-1.0.1-1.fc18.noarch
    ovirt-engine-dbscripts-3.2.1-1.fc18.noarch
tail ovirt-engine-dwhd.log
2013-04-15 16:34:29|ETL Service Started
    2013-04-15 16:34:30|ETL Service Stopped
    2013-04-15
    16:34:30|OHuFYx|OHuFYx|OHuFYx|OVIRT_ENGINE_DWH|HistoryETL|Default|5|tDie|tDie_1|oVirt
    Engine Portal is not available. Please check your ETL
    configuration.|9704
    oVirt Engine Portal is not available. Please check your ETL
    configuration.
cat ovirt-engine-dwh-setup-2013_03_19_13_41_15.log
2013-03-19 13:41:15::DEBUG::ovirt-engine-dwh-setup::225::root::
    starting main()
    2013-03-19 13:41:15::DEBUG::common_utils::415::root:: found existing
    pgpass file, fetching DB host value
    2013-03-19 13:41:15::DEBUG::common_utils::415::root:: found existing
    pgpass file, fetching DB port value
    2013-03-19 13:41:15::DEBUG::common_utils::415::root:: found existing
    pgpass file, fetching DB admin value
    2013-03-19 13:41:15::DEBUG::common_utils::415::root:: found existing
    pgpass file, fetching DB admin value
    2013-03-19 13:41:15::DEBUG::common_utils::448::root:: getting DB
    password for postgres
    2013-03-19 13:41:15::DEBUG::common_utils::457::root:: found password
    for username postgres
    2013-03-19 13:41:15::DEBUG::common_utils::58::root:: getting vdc
    option MinimalETLVersion
    2013-03-19 13:41:15::DEBUG::common_utils::512::root:: Executing
    command --> '['/usr/bin/engine-config', '-g', 'MinimalETLVersion',
    '--cver=general', '-p',
    '/usr/share/ovirt-engine/conf/engine-config-install.properties']'
    2013-03-19 13:41:17::DEBUG::common_utils::551::root:: output = 3.2.0
2013-03-19 13:41:17::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:41:17::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:41:17::DEBUG::common_utils::61::root:: Value of
    MinimalETLVersion is 3.2.0
2013-03-19 13:41:17::DEBUG::common_utils::512::root:: Executing
    command --> '['rpm', '-q', '--queryformat', '%{VERSION}-%{RELEASE}',
    'ovirt-engine-dwh']'
    2013-03-19 13:41:17::DEBUG::common_utils::551::root:: output =
    3.2.0-1.fc18
    2013-03-19 13:41:17::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:41:17::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:41:17::DEBUG::common_utils::347::root:: setting regex
    (\d+\.\d+)\.(\d+)\-(\d+) againts 3.2.0-1.fc18
    2013-03-19 13:41:17::DEBUG::common_utils::352::root:: found version, 3.2
    2013-03-19 13:41:17::DEBUG::common_utils::354::root:: found
    minorVersion 0
    2013-03-19 13:41:17::DEBUG::common_utils::356::root:: found release 1
    2013-03-19 13:41:17::DEBUG::common_utils::347::root:: setting regex
    (\d+\.\d+)\.(\d+)\-(\d+) againts 3.2.0-0
    2013-03-19 13:41:17::DEBUG::common_utils::352::root:: found version, 3.2
    2013-03-19 13:41:17::DEBUG::common_utils::354::root:: found
    minorVersion 0
    2013-03-19 13:41:17::DEBUG::common_utils::356::root:: found release 0
    2013-03-19 13:41:17::DEBUG::common_utils::234::root:: checking
    ovirt-engine service
    2013-03-19 13:41:17::DEBUG::common_utils::222::root:: checking the
    status of ovirt-engine
    2013-03-19 13:41:17::DEBUG::common_utils::512::root:: Executing
    command --> '['service', 'ovirt-engine', 'status']'
    2013-03-19 13:41:17::DEBUG::common_utils::551::root:: output =
    ovirt-engine.service - oVirt Engine
           Loaded: loaded (/usr/lib/systemd/system/ovirt-engine.service;
    enabled)
           Active: active (running) since Mon 2013-03-18 14:34:20 CET;
    23h ago
         Main PID: 18713 (java)
           CGroup: name=systemd:/system/ovirt-engine.service
               └─18713 engine-service -server -XX:+TieredCompilation
    -Xms1g -Xmx1g -XX:PermSize=256m -XX:MaxPermSize=256m
    -Djava.net.preferIPv4Stack=true
    -Dsun.rmi.dgc.client.gcInterval=3600000
    -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.awt.headless=true
    -Djava.util.logging.manager=org.jboss.logmanager
    -Dlogging.configuration=file:///var/tmp/ovirt-engine/engine-service-logging.properties
    -Dorg.jboss.resolver.warning=true
    -Djboss.modules.system.pkgs=org.jboss.byteman
    -Djboss.server.default.config=engine-service
    -Djboss.home.dir=/usr/share/jboss-as
    -Djboss.server.base.dir=/usr/share/ovirt-engine
    -Djboss.server.config.dir=/var/tmp/ovirt-engine
    -Djboss.server.data.dir=/var/lib/ovirt-engine
    -Djboss.server.log.dir=/var/log/ovirt-engine
    -Djboss.server.temp.dir=/var/tmp/ovirt-engine
    -Djboss.controller.temp.dir=/var/tmp/ovirt-engine -jar
    /usr/share/jboss-as/jboss-modules.jar -mp
    /usr/share/ovirt-engine/modules:/var/tmp/ovirt-engine/modules
    -jaxpmodule javax.xml.jaxp-provider org.jboss.as.standalone -c
    engine-service.xml
Mar 18 14:34:20 ovirt01.netbulae.mgmt engine-service[18711]: Started
    engine process 18713.
    Mar 18 14:34:20 ovirt01.netbulae.mgmt engine-service[18711]:
    Starting engine-service: [  OK  ]
    Mar 18 14:34:20 ovirt01.netbulae.mgmt systemd[1]: Started oVirt Engine.
2013-03-19 13:41:17::DEBUG::common_utils::552::root:: stderr =
    Redirecting to /bin/systemctl status  ovirt-engine.service
2013-03-19 13:41:17::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:41:17::DEBUG::common_utils::296::root:: Stopping
    ovirt-engine-dwhd
    2013-03-19 13:41:17::DEBUG::common_utils::512::root:: Executing
    command --> '['service', 'ovirt-engine-dwhd', 'stop']'
    2013-03-19 13:41:17::DEBUG::common_utils::551::root:: output =
    Stopping ovirt-engine-dwhd (via systemctl):  [  OK  ]
2013-03-19 13:41:17::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:41:17::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:41:17::DEBUG::decorators::18::root:: running setDbPass
    2013-03-19 13:41:17::DEBUG::ovirt-engine-dwh-setup::117::root::
    Setting DB pass
    2013-03-19 13:41:17::DEBUG::ovirt-engine-dwh-setup::118::root::
    editing etl db connectivity file
    2013-03-19 13:41:17::DEBUG::ovirt-engine-dwh-setup::159::root::
    reading /etc/sysconfig/ovirt-engine
    2013-03-19 13:41:17::DEBUG::ovirt-engine-dwh-setup::176::root::
    Secure web port is: 443
    2013-03-19 13:41:17::DEBUG::ovirt-engine-dwh-setup::180::root::
    Host's FQDN: xxx.yyy.zzz
    2013-03-19 13:41:17::DEBUG::common_utils::58::root:: getting vdc
    option TruststoreUrl
    2013-03-19 13:41:17::DEBUG::common_utils::512::root:: Executing
    command --> '['/usr/bin/engine-config', '-g', 'TruststoreUrl',
    '--cver=general', '-p',
    '/usr/share/ovirt-engine/conf/engine-config-install.properties']'
    2013-03-19 13:41:18::DEBUG::common_utils::551::root:: output =
    /etc/pki/ovirt-engine/.truststore
2013-03-19 13:41:18::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:41:18::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:41:18::DEBUG::common_utils::61::root:: Value of
    TruststoreUrl is /etc/pki/ovirt-engine/.truststore
2013-03-19 13:41:18::DEBUG::common_utils::58::root:: getting vdc
    option TruststorePass
    2013-03-19 13:41:18::DEBUG::common_utils::512::root:: Executing
    command --> '['/usr/bin/engine-config', '-g', 'TruststorePass',
    '--cver=general', '-p',
    '/usr/share/ovirt-engine/conf/engine-config-install.properties']'
    2013-03-19 13:41:20::DEBUG::common_utils::551::root:: output = mypass
2013-03-19 13:41:20::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:41:20::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:41:20::DEBUG::common_utils::61::root:: Value of
    TruststorePass is mypass
2013-03-19 13:41:20::DEBUG::common_utils::512::root:: Executing
    command --> '['rpm', '-q', '--queryformat', '%{VERSION}-%{RELEASE}',
    'ovirt-engine-dwh']'
    2013-03-19 13:41:20::DEBUG::common_utils::551::root:: output =
    3.2.0-1.fc18
    2013-03-19 13:41:20::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:41:20::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:41:20::DEBUG::common_utils::347::root:: setting regex
    (\d+\.\d+)\.(\d+)\-(\d+) againts 3.2.0-1.fc18
    2013-03-19 13:41:20::DEBUG::common_utils::352::root:: found version, 3.2
    2013-03-19 13:41:20::DEBUG::common_utils::354::root:: found
    minorVersion 0
    2013-03-19 13:41:20::DEBUG::common_utils::356::root:: found release 1
    2013-03-19 13:41:20::DEBUG::ovirt-engine-dwh-setup::212::root::
    Setting etlVersion
    2013-03-19 13:41:20::DEBUG::ovirt-engine-dwh-setup::213::root::
    editing etl connectivity file
    2013-03-19 13:41:20::DEBUG::ovirt-engine-dwh-setup::43::root::
    checking if ovirt_engine_history db already exists
    2013-03-19 13:41:20::DEBUG::common_utils::204::root:: running sql
    query on host: localhost, port: 5432, db: ovirt_engine_history,
    user: postgres, query: 'select 1'.
    2013-03-19 13:41:20::DEBUG::common_utils::512::root:: Executing
    command --> '['/usr/bin/psql', '--pset=tuples_only=on', '--set',
    'ON_ERROR_STOP=1', '--dbname', 'ovirt_engine_history', '--host',
    'localhost', '--port', '5432', '--username', 'postgres', '-c',
    'select 1']'
    2013-03-19 13:41:20::DEBUG::common_utils::551::root:: output =
    2013-03-19 13:41:20::DEBUG::common_utils::552::root:: stderr = psql:
    FATAL:  database "ovirt_engine_history" does not exist
2013-03-19 13:41:20::DEBUG::common_utils::553::root:: retcode = 2
    2013-03-19 13:41:20::DEBUG::decorators::18::root:: running createDB
    2013-03-19 13:41:20::DEBUG::ovirt-engine-dwh-setup::55::root::
    installing ovirt_engine_history db
    2013-03-19 13:41:20::DEBUG::ovirt-engine-dwh-setup::58::root:: ovirt
    engine history db creation is logged at
    /var/log/ovirt-engine/ovirt-history-db-install-2013_03_19_13_41_20.log
    2013-03-19 13:41:20::DEBUG::common_utils::512::root:: Executing
    command --> '['/sbin/ip', 'addr']'
    2013-03-19 13:41:20::DEBUG::common_utils::551::root:: output = 1:
    lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
         link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
         inet 127.0.0.1/8 scope host lo
         inet6 ::1/128 scope host
            valid_lft forever preferred_lft forever
    2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
    state UP qlen 1000
         link/ether 52:54:00:6b:3d:f1 brd ff:ff:ff:ff:ff:ff
         inet 10.50.50.201/24 brd 10.50.50.255 scope global eth0
         inet6 fe80::5054:ff:fe6b:3df1/64 scope link
            valid_lft forever preferred_lft forever
2013-03-19 13:41:20::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:41:20::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:41:20::DEBUG::common_utils::487::root:: Found IP
    Address: xxx.yyy.zzz
    2013-03-19 13:41:20::DEBUG::common_utils::512::root:: Executing
    command -->
    '['/usr/share/ovirt-engine-dwh/db-scripts/ovirt-engine-history-db-install.sh',
    '-l', 'ovirt-history-db-install-2013_03_19_13_41_20.log', '-u',
    'postgres', '-s', 'localhost', '-p', '5432', '-r', 'local']'
    2013-03-19 13:42:09::DEBUG::common_utils::551::root:: output =
    2013-03-19 13:42:09::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:42:09::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:42:09::DEBUG::ovirt-engine-dwh-setup::75::root::
    Successfully installed ovirt_engine_history DB
    2013-03-19 13:42:09::DEBUG::common_utils::222::root:: checking the
    status of ovirt-engine
    2013-03-19 13:42:09::DEBUG::common_utils::512::root:: Executing
    command --> '['service', 'ovirt-engine', 'status']'
    2013-03-19 13:42:09::DEBUG::common_utils::551::root:: output =
    ovirt-engine.service - oVirt Engine
           Loaded: loaded (/usr/lib/systemd/system/ovirt-engine.service;
    enabled)
           Active: active (running) since Mon 2013-03-18 14:34:20 CET;
    23h ago
         Main PID: 18713 (java)
           CGroup: name=systemd:/system/ovirt-engine.service
               └─18713 engine-service -server -XX:+TieredCompilation
    -Xms1g -Xmx1g -XX:PermSize=256m -XX:MaxPermSize=256m
    -Djava.net.preferIPv4Stack=true
    -Dsun.rmi.dgc.client.gcInterval=3600000
    -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.awt.headless=true
    -Djava.util.logging.manager=org.jboss.logmanager
    -Dlogging.configuration=file:///var/tmp/ovirt-engine/engine-service-logging.properties
    -Dorg.jboss.resolver.warning=true
    -Djboss.modules.system.pkgs=org.jboss.byteman
    -Djboss.server.default.config=engine-service
    -Djboss.home.dir=/usr/share/jboss-as
    -Djboss.server.base.dir=/usr/share/ovirt-engine
    -Djboss.server.config.dir=/var/tmp/ovirt-engine
    -Djboss.server.data.dir=/var/lib/ovirt-engine
    -Djboss.server.log.dir=/var/log/ovirt-engine
    -Djboss.server.temp.dir=/var/tmp/ovirt-engine
    -Djboss.controller.temp.dir=/var/tmp/ovirt-engine -jar
    /usr/share/jboss-as/jboss-modules.jar -mp
    /usr/share/ovirt-engine/modules:/var/tmp/ovirt-engine/modules
    -jaxpmodule javax.xml.jaxp-provider org.jboss.as.standalone -c
    engine-service.xml
Mar 18 14:34:20 ovirt01.netbulae.mgmt engine-service[18711]: Started
    engine process 18713.
    Mar 18 14:34:20 ovirt01.netbulae.mgmt engine-service[18711]:
    Starting engine-service: [  OK  ]
    Mar 18 14:34:20 ovirt01.netbulae.mgmt systemd[1]: Started oVirt Engine.
2013-03-19 13:42:09::DEBUG::common_utils::552::root:: stderr =
    Redirecting to /bin/systemctl status  ovirt-engine.service
2013-03-19 13:42:09::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:42:09::DEBUG::decorators::18::root:: running
    startEngineService
    2013-03-19 13:42:09::DEBUG::common_utils::263::root:: Starting
    ovirt-engine
    2013-03-19 13:42:09::DEBUG::common_utils::512::root:: Executing
    command --> '['service', 'ovirt-engine', 'start']'
    2013-03-19 13:42:09::DEBUG::common_utils::551::root:: output =
    2013-03-19 13:42:09::DEBUG::common_utils::552::root:: stderr =
    Redirecting to /bin/systemctl start  ovirt-engine.service
2013-03-19 13:42:09::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:42:29::DEBUG::common_utils::512::root:: Executing
    command --> '['/sbin/chkconfig', 'ovirt-engine-dwhd', 'on']'
    2013-03-19 13:42:29::DEBUG::common_utils::551::root:: output =
    2013-03-19 13:42:29::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:42:29::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:42:29::DEBUG::common_utils::327::root:: checking the
    status of ovirt-engine-dwhd
    2013-03-19 13:42:29::DEBUG::common_utils::512::root:: Executing
    command --> '['service', 'ovirt-engine-dwhd', 'status']'
    2013-03-19 13:42:29::DEBUG::common_utils::551::root:: output =
    /etc/init.d/ovirt-engine-dwhd is stopped
2013-03-19 13:42:29::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:42:29::DEBUG::common_utils::553::root:: retcode = 1
    2013-03-19 13:42:29::DEBUG::decorators::18::root:: running
    startEtlService
    2013-03-19 13:42:29::DEBUG::common_utils::319::root:: Starting
    ovirt-engine-dwhd
    2013-03-19 13:42:29::DEBUG::common_utils::512::root:: Executing
    command --> '['service', 'ovirt-engine-dwhd', 'start']'
    2013-03-19 13:42:39::DEBUG::common_utils::551::root:: output =
    Starting ovirt-engine-dwhd (via systemctl):  [  OK  ]
2013-03-19 13:42:39::DEBUG::common_utils::552::root:: stderr =
    2013-03-19 13:42:39::DEBUG::common_utils::553::root:: retcode = 0
    2013-03-19 13:42:39::DEBUG::ovirt-engine-dwh-setup::265::root::
    main() ended
--
Kind regards,
Jorick Astrego
Netbulae B.V.
n
Site:http://www.netbulae.eu
_______________________________________________
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
iiuc, you can't get the engine running, yet you attached the logs of the 
the engine-dwh service, rather than the ovirt-engine service.
please attache ovirt-engine logs.

thanks,
    Itamar

Re: [Users] problems starting ovirt-engine after upgrade 3.2.0 to 3.2.1

Itamar Heim