[ovirt-users] engine upgrade 3.2.2 --> 3.2.3 Database rename failed

Hi guys, I'm trying to upgrade from Dreyou to the official repo, I've installed the official 3.2 repo (I'll do the 3.3 update once this works). I've updated to ovirt-engine-setup.noarch 0:3.2.3-1.el6 and when I run engine upgrade it bombs out when trying to rename my database with the following error... [root@engine01 /]# cat /var/log/ovirt-engine/ovirt-engine-upgrade_2014_05_20_16_34_21.log 2014-05-20 16:34:21::DEBUG::common_utils::804::root:: found existing pgpass file /etc/ovirt-engine/.pgpass, fetching DB host value 2014-05-20 16:34:21::DEBUG::common_utils::804::root:: found existing pgpass file /etc/ovirt-engine/.pgpass, fetching DB port value 2014-05-20 16:34:21::DEBUG::common_utils::804::root:: found existing pgpass file /etc/ovirt-engine/.pgpass, fetching DB user value 2014-05-20 16:34:21::DEBUG::common_utils::332::root:: YUM: VERB: Loaded plugins: refresh-packagekit, versionlock 2014-05-20 16:34:21::INFO::engine-upgrade::969::root:: Info: /etc/ovirt-engine/.pgpass file found. Continue. 2014-05-20 16:34:21::DEBUG::common_utils::804::root:: found existing pgpass file /etc/ovirt-engine/.pgpass, fetching DB admin value 2014-05-20 16:34:21::DEBUG::common_utils::804::root:: found existing pgpass file /etc/ovirt-engine/.pgpass, fetching DB host value 2014-05-20 16:34:21::DEBUG::common_utils::804::root:: found existing pgpass file /etc/ovirt-engine/.pgpass, fetching DB port value 2014-05-20 16:34:21::DEBUG::common_utils::481::root:: running sql query 'SELECT pg_database_size('engine')' on db server: 'localhost'. 2014-05-20 16:34:21::DEBUG::common_utils::434::root:: Executing command --> '/usr/bin/psql -h localhost -p 5432 -U postgres -d postgres -c SELECT pg_database_size('engine')' 2014-05-20 16:34:21::DEBUG::common_utils::472::root:: output = pg_database_size ------------------ 11976708 (1 row) 2014-05-20 16:34:21::DEBUG::common_utils::473::root:: stderr = 2014-05-20 16:34:21::DEBUG::common_utils::474::root:: retcode = 0 2014-05-20 16:34:21::DEBUG::common_utils::1567::root:: Found mount point of '/var/cache/yum' at '/' 2014-05-20 16:34:21::DEBUG::common_utils::663::root:: Checking available space on /var/cache/yum 2014-05-20 16:34:21::DEBUG::common_utils::668::root:: Available space on /var/cache/yum is 172329 2014-05-20 16:34:21::DEBUG::common_utils::1567::root:: Found mount point of '/var/lib/ovirt-engine/backups' at '/' 2014-05-20 16:34:21::DEBUG::common_utils::663::root:: Checking available space on /var/lib/ovirt-engine/backups 2014-05-20 16:34:21::DEBUG::common_utils::668::root:: Available space on /var/lib/ovirt-engine/backups is 172329 2014-05-20 16:34:21::DEBUG::common_utils::1567::root:: Found mount point of '/usr/share' at '/' 2014-05-20 16:34:21::DEBUG::common_utils::663::root:: Checking available space on /usr/share 2014-05-20 16:34:21::DEBUG::common_utils::668::root:: Available space on /usr/share is 172329 2014-05-20 16:34:21::DEBUG::common_utils::1590::root:: Mount points are: {'/': {'required': 1511, 'free': 172329}} 2014-05-20 16:34:21::DEBUG::common_utils::1599::root:: Comparing free space 172329 MB with required 1511 MB 2014-05-20 16:34:21::DEBUG::common_utils::481::root:: running sql query 'SELECT compatibility_version FROM storage_pool;' on db server: 'localhost'. 2014-05-20 16:34:21::DEBUG::common_utils::434::root:: Executing command --> '/usr/bin/psql -h localhost -p 5432 -U engine -d engine -c SELECT compatibility_version FROM storage_pool;' 2014-05-20 16:34:21::DEBUG::common_utils::472::root:: output = compatibility_version ----------------------- 3.2 (1 row) 2014-05-20 16:34:21::DEBUG::common_utils::473::root:: stderr = 2014-05-20 16:34:21::DEBUG::common_utils::474::root:: retcode = 0 2014-05-20 16:34:21::DEBUG::common_utils::481::root:: running sql query 'SELECT compatibility_version FROM vds_groups;' on db server: 'localhost'. 2014-05-20 16:34:21::DEBUG::common_utils::434::root:: Executing command --> '/usr/bin/psql -h localhost -p 5432 -U engine -d engine -c SELECT compatibility_version FROM vds_groups;' 2014-05-20 16:34:21::DEBUG::common_utils::472::root:: output = compatibility_version ----------------------- 3.2 (1 row) 2014-05-20 16:34:21::DEBUG::common_utils::473::root:: stderr = 2014-05-20 16:34:21::DEBUG::common_utils::474::root:: retcode = 0 2014-05-20 16:34:21::DEBUG::engine-upgrade::280::root:: Yum unlock started 2014-05-20 16:34:21::DEBUG::engine-upgrade::292::root:: Yum unlock completed successfully 2014-05-20 16:34:22::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdu5SB03tmp.xml (0%) 2014-05-20 16:34:22::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdu5SB03tmp.xml 3.7 k(100%) 2014-05-20 16:34:30::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdf3Wi70tmp.xml (0%) 2014-05-20 16:34:30::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdf3Wi70tmp.xml 2.9 k(100%) 2014-05-20 16:34:30::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdf3Wi70tmp.xml 2.9 k(100%) 2014-05-20 16:34:31::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdHz6Ctstmp.xml (0%) 2014-05-20 16:34:31::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdHz6Ctstmp.xml 3.4 k(100%) 2014-05-20 16:34:37::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdyHOcNQtmp.xml (0%) 2014-05-20 16:34:37::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdyHOcNQtmp.xml 2.9 k(100%) 2014-05-20 16:34:38::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdTvp5RWtmp.xml (0%) 2014-05-20 16:34:39::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdTvp5RWtmp.xml 2.9 k(100%) 2014-05-20 16:34:40::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdpoFiQgtmp.xml (0%) 2014-05-20 16:34:40::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomdpoFiQgtmp.xml 3.4 k(100%) 2014-05-20 16:34:41::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomddmRA9ttmp.xml (0%) 2014-05-20 16:34:41::DEBUG::common_utils::332::root:: YUM: VERB: Downloading: repomddmRA9ttmp.xml 951 (100%) 2014-05-20 16:34:41::DEBUG::common_utils::332::root:: YUM: VERB: queue package ovirt-engine for update 2014-05-20 16:34:42::DEBUG::common_utils::332::root:: YUM: VERB: package ovirt-engine queued 2014-05-20 16:34:42::DEBUG::common_utils::332::root:: YUM: VERB: Building transaction 2014-05-20 16:34:44::DEBUG::common_utils::332::root:: YUM: VERB: Transaction built 2014-05-20 16:34:44::DEBUG::engine-upgrade::314::root:: Transaction Summary: 2014-05-20 16:34:44::DEBUG::engine-upgrade::318::root:: update - ovirt-engine-3.2.3-1.el6.noarch 2014-05-20 16:34:44::DEBUG::engine-upgrade::318::root:: update - ovirt-engine-backend-3.2.3-1.el6.noarch 2014-05-20 16:34:44::DEBUG::engine-upgrade::318::root:: update - ovirt-engine-dbscripts-3.2.3-1.el6.noarch 2014-05-20 16:34:44::DEBUG::engine-upgrade::318::root:: update - ovirt-engine-genericapi-3.2.3-1.el6.noarch 2014-05-20 16:34:44::DEBUG::engine-upgrade::318::root:: update - ovirt-engine-restapi-3.2.3-1.el6.noarch 2014-05-20 16:34:44::DEBUG::engine-upgrade::318::root:: update - ovirt-engine-tools-3.2.3-1.el6.noarch 2014-05-20 16:34:44::DEBUG::engine-upgrade::318::root:: update - ovirt-engine-userportal-3.2.3-1.el6.noarch 2014-05-20 16:34:44::DEBUG::engine-upgrade::318::root:: update - ovirt-engine-webadmin-portal-3.2.3-1.el6.noarch 2014-05-20 16:34:44::DEBUG::engine-upgrade::329::root:: Yum rollback-avail started 2014-05-20 16:34:44::DEBUG::engine-upgrade::335::root:: Checking package ovirt-engine-3.2.2-1.1.43.el6.noarch 2014-05-20 16:34:44::DEBUG::engine-upgrade::335::root:: Checking package ovirt-engine-backend-3.2.2-1.1.43.el6.noarch 2014-05-20 16:34:45::DEBUG::engine-upgrade::335::root:: Checking package ovirt-engine-dbscripts-3.2.2-1.1.43.el6.noarch 2014-05-20 16:34:45::DEBUG::engine-upgrade::335::root:: Checking package ovirt-engine-genericapi-3.2.2-1.1.43.el6.noarch 2014-05-20 16:34:46::DEBUG::engine-upgrade::335::root:: Checking package ovirt-engine-restapi-3.2.2-1.1.43.el6.noarch 2014-05-20 16:34:46::DEBUG::engine-upgrade::335::root:: Checking package ovirt-engine-tools-3.2.2-1.1.43.el6.noarch 2014-05-20 16:34:47::DEBUG::engine-upgrade::335::root:: Checking package ovirt-engine-userportal-3.2.2-1.1.43.el6.noarch 2014-05-20 16:34:47::DEBUG::engine-upgrade::335::root:: Checking package ovirt-engine-webadmin-portal-3.2.2-1.1.43.el6.noarch 2014-05-20 16:34:48::DEBUG::engine-upgrade::340::root:: Yum rollback-avail completed successfully 2014-05-20 16:34:48::DEBUG::engine-upgrade::1045::root:: related to database package ovirt-engine-backend 2014-05-20 16:34:48::DEBUG::engine-upgrade::1045::root:: related to database package ovirt-engine-dbscripts 2014-05-20 16:34:48::DEBUG::engine-upgrade::200::root:: checking the status of ovirt-engine service 2014-05-20 16:34:48::DEBUG::common_utils::434::root:: Executing command --> '/sbin/service ovirt-engine status' 2014-05-20 16:34:48::DEBUG::common_utils::472::root:: output = The engine is not running. 2014-05-20 16:34:48::DEBUG::common_utils::473::root:: stderr = 2014-05-20 16:34:48::DEBUG::common_utils::474::root:: retcode = 3 2014-05-20 16:34:48::DEBUG::engine-upgrade::595::root:: stopping ovirt-engine service. 2014-05-20 16:34:48::DEBUG::common_utils::434::root:: Executing command --> '/sbin/service ovirt-engine stop' 2014-05-20 16:34:48::DEBUG::common_utils::472::root:: output = Stopping engine-service: [ OK ] 2014-05-20 16:34:48::DEBUG::common_utils::473::root:: stderr = 2014-05-20 16:34:48::DEBUG::common_utils::474::root:: retcode = 0 2014-05-20 16:34:48::DEBUG::common_utils::1289::root:: getting status for engine-notifierd 2014-05-20 16:34:48::DEBUG::common_utils::1298::root:: executing action engine-notifierd on service status 2014-05-20 16:34:48::DEBUG::common_utils::434::root:: Executing command --> '/sbin/service engine-notifierd status' 2014-05-20 16:34:49::DEBUG::common_utils::472::root:: output = /etc/init.d/engine-notifierd is stopped 2014-05-20 16:34:49::DEBUG::common_utils::473::root:: stderr = 2014-05-20 16:34:49::DEBUG::common_utils::474::root:: retcode = 1 2014-05-20 16:34:49::DEBUG::engine-upgrade::840::root:: Checking active system tasks 2014-05-20 16:34:49::DEBUG::common_utils::434::root:: Executing command --> '/usr/bin/psql -U engine -f /usr/share/ovirt-engine/scripts/add_fn_db_get_async_tasks_function.sql -d engine' 2014-05-20 16:34:49::DEBUG::common_utils::472::root:: output = DROP TYPE CREATE TYPE CREATE FUNCTION 2014-05-20 16:34:49::DEBUG::common_utils::473::root:: stderr = psql:/usr/share/ovirt-engine/scripts/add_fn_db_get_async_tasks_function.sql:18: NOTICE: drop cascades to function fn_db_get_async_tasks() 2014-05-20 16:34:49::DEBUG::common_utils::474::root:: retcode = 0 2014-05-20 16:34:49::DEBUG::common_utils::481::root:: running sql query 'select * from fn_db_get_async_tasks();' on db server: 'localhost'. 2014-05-20 16:34:49::DEBUG::common_utils::434::root:: Executing command --> '/usr/bin/psql -h localhost -p 5432 -U engine -d engine -c select * from fn_db_get_async_tasks();' 2014-05-20 16:34:49::DEBUG::common_utils::472::root:: output = dc_id | dc_name | spm_host_id | spm_host_name | task_count -------+---------+-------------+---------------+------------ (0 rows) 2014-05-20 16:34:49::DEBUG::common_utils::473::root:: stderr = 2014-05-20 16:34:49::DEBUG::common_utils::474::root:: retcode = 0 2014-05-20 16:34:49::DEBUG::common_utils::481::root:: running sql query 'select command_type, entity_type from business_entity_snapshot;' on db server: 'localhost'. 2014-05-20 16:34:49::DEBUG::common_utils::434::root:: Executing command --> '/usr/bin/psql -h localhost -p 5432 -U engine -d engine -c select command_type, entity_type from business_entity_snapshot;' 2014-05-20 16:34:49::DEBUG::common_utils::472::root:: output = command_type | entity_type --------------+------------- (0 rows) 2014-05-20 16:34:49::DEBUG::common_utils::473::root:: stderr = 2014-05-20 16:34:49::DEBUG::common_utils::474::root:: retcode = 0 2014-05-20 16:34:49::DEBUG::common_utils::481::root:: running sql query 'copy (select vds_id, vds_name, host_name, vds_unique_id, status from vds) to stdout with csv header;' on db server: 'localhost'. 2014-05-20 16:34:49::DEBUG::common_utils::434::root:: Executing command --> '/usr/bin/psql -h localhost -p 5432 -U engine -d engine -c copy (select vds_id, vds_name, host_name, vds_unique_id, status from vds) to stdout with csv header;' 2014-05-20 16:34:49::DEBUG::common_utils::472::root:: output = vds_id,vds_name,host_name,vds_unique_id,status b108549c-1700-11e2-b936-9f5243b8ce13,node01.ukdm.gov.za,10.251.193.8,4C4C4544-0056-5910-8048-B7C04F43354A,3 322cbee8-16e6-11e2-9d38-6388c61dd004,node02.ukdm.gov.za,10.251.193.9,4C4C4544-0056-5910-8048-C4C04F43354A,3 2014-05-20 16:34:49::DEBUG::common_utils::473::root:: stderr = 2014-05-20 16:34:49::DEBUG::common_utils::474::root:: retcode = 0 2014-05-20 16:34:49::DEBUG::engine-upgrade::358::root:: DB Backup started 2014-05-20 16:34:49::DEBUG::common_utils::434::root:: Executing command --> '/usr/bin/pg_dump -C -E UTF8 --disable-dollar-quoting --disable-triggers -U engine -h localhost -p 5432 --format=p -f /var/lib/ovirt-engine/backups/ovirt-engine_db_backup_2014_05_20_16_34_21.sql engine' 2014-05-20 16:34:51::DEBUG::common_utils::472::root:: output = 2014-05-20 16:34:51::DEBUG::common_utils::473::root:: stderr = 2014-05-20 16:34:51::DEBUG::common_utils::474::root:: retcode = 0 2014-05-20 16:34:51::DEBUG::engine-upgrade::374::root:: DB Backup completed successfully 2014-05-20 16:34:51::DEBUG::common_utils::481::root:: running sql query 'ALTER DATABASE engine RENAME TO engine_2014_05_20_16_34_21' on db server: 'localhost'. 2014-05-20 16:34:51::DEBUG::common_utils::434::root:: Executing command --> '/usr/bin/psql -h localhost -p 5432 -U engine -d template1 -c ALTER DATABASE engine RENAME TO engine_2014_05_20_16_34_21' 2014-05-20 16:34:51::DEBUG::common_utils::472::root:: output = 2014-05-20 16:34:51::DEBUG::common_utils::473::root:: stderr = ERROR: must be owner of database engine 2014-05-20 16:34:51::DEBUG::common_utils::474::root:: retcode = 1 2014-05-20 16:34:51::DEBUG::common_utils::332::root:: YUM: VERB: Performing rollback 2014-05-20 16:34:51::DEBUG::common_utils::1377::root:: Locking rpms in yum-version-lock 2014-05-20 16:34:51::ERROR::engine-upgrade::1159::root:: Traceback (most recent call last): File "/usr/bin/engine-upgrade", line 1152, in <module> main(options) File "/usr/bin/engine-upgrade", line 1079, in main runFunc([[db.rename, DB_NAME_TEMP]], MSG_INFO_RENAME_DB) File "/usr/bin/engine-upgrade", line 621, in runFunc func[0](*func[1:]) File "/usr/bin/engine-upgrade", line 447, in rename utils.execRemoteSqlCommand(SERVER_ADMIN, SERVER_NAME, SERVER_PORT, basedefs.DB_TEMPLATE, query, True, MSG_ERROR_RENAME_DB) File "/usr/share/ovirt-engine/scripts/common_utils.py", line 490, in execRemoteSqlCommand return execCmd(cmdList=cmd, failOnError=failOnError, msg=errMsg, envDict=getPgPassEnv()) File "/usr/share/ovirt-engine/scripts/common_utils.py", line 477, in execCmd raise Exception(msg) Exception: Error: Database rename failed. Check that there are no active connections to the DB and try again. I'm guessing it's probably something simple, but I'm not much of a postgres user, so it's unfortunately a bit beyond me to resolve. Please could someone point me in the right direction. Thank you. Regards Neil Wilson.