[ovirt-users] Can't Install/Upgrade host

Hi guys, I'm trying to upgrade/re-install a host running Centos 6.5, but even after removing the host completely and trying to re-add it, I keep getting a "Certificate enrollment failed" error. The full error below is taken from my engine.log... 2014-05-27 10:38:33,729 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp--127.0.0.1-8702-4) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. 2014-05-27 11:10:49,343 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Error during deploy dialog: java.io.IOException: Unexpected connection termination 2014-05-27 11:10:49,344 ERROR [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-6-thread-31) SSH error running command root@10.251.193.9:'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True': javax.naming.TimeLimitExceededException: SSH session hard timeout host 'root(a)10.251.193.9' 2014-05-27 11:10:49,369 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-31) [26c21342] Timeout during host 10.251.193.9 install: javax.naming.TimeLimitExceededException: SSH session hard timeout host 'root(a)10.251.193.9' 2014-05-27 11:10:49,377 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-6-thread-31) [26c21342] Installation 10.251.193.9: Processing stopped due to timeout 2014-05-27 11:10:49,434 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-6-thread-31) [26c21342] Host installation failed for host 322cbee8-16e6-11e2-9d38-6388c61dd004, node02.blabla.gov.za.: javax.naming.TimeLimitExceededException: SSH session hard timeout host 'root(a)10.251.193.9' 2014-05-27 12:44:36,200 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp--127.0.0.1-8702-1) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. 2014-05-27 13:16:21,679 ERROR [org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign Certificate request failed with exit code 1 2014-05-27 13:16:21,680 ERROR [org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign Certificate request script errors: Error opening Certificate ca.pem 140249235597128:error:0200100D:system library:fopen:Permission denied:bss_file.c:398:fopen('ca.pem','r') 140249235597128:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:400: Error opening CA private key private/ca.pem 140630029801288:error:0200100D:system library:fopen:Permission denied:bss_file.c:398:fopen('private/ca.pem','r') 140630029801288:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:400: 2014-05-27 13:16:21,684 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Error during deploy dialog: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 13:16:21,689 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-21) [1a930dd7] Error during host 10.251.193.9 install: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 13:16:21,694 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-6-thread-21) [1a930dd7] Installation 10.251.193.9: Certificate enrollment failed 2014-05-27 13:16:21,740 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-21) [1a930dd7] Error during host 10.251.193.9 install, prefering first exception: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 13:16:21,744 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-6-thread-21) [1a930dd7] Host installation failed for host 322cbee8-16e6-11e2-9d38-6388c61dd004, node02.blabla.gov.za.: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 14:31:12,192 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp--127.0.0.1-8702-2) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. 2014-05-27 14:32:58,669 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp--127.0.0.1-8702-7) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. 2014-05-27 14:36:33,523 ERROR [org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign Certificate request failed with exit code 1 2014-05-27 14:36:33,524 ERROR [org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign Certificate request script errors: Error opening Certificate ca.pem 140189576382280:error:0200100D:system library:fopen:Permission denied:bss_file.c:398:fopen('ca.pem','r') 140189576382280:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:400: Error opening CA private key private/ca.pem 140632037402440:error:0200100D:system library:fopen:Permission denied:bss_file.c:398:fopen('private/ca.pem','r') 140632037402440:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:400: 2014-05-27 14:36:33,528 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Error during deploy dialog: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 14:36:33,534 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-33) [5537b7c] Error during host 10.251.193.9 install: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 14:36:33,545 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-6-thread-33) [5537b7c] Installation 10.251.193.9: Certificate enrollment failed 2014-05-27 14:36:33,572 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-33) [5537b7c] Error during host 10.251.193.9 install, prefering first exception: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 14:36:33,576 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-6-thread-33) [5537b7c] Host installation failed for host 322cbee8-16e6-11e2-9d38-6388c61dd004, node02.blabla.gov.za.: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 14:40:26,630 ERROR [org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign Certificate request failed with exit code 1 2014-05-27 14:40:26,631 ERROR [org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign Certificate request script errors: Error opening Certificate ca.pem 139666318882632:error:0200100D:system library:fopen:Permission denied:bss_file.c:398:fopen('ca.pem','r') 139666318882632:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:400: Error opening CA private key private/ca.pem 139701081003848:error:0200100D:system library:fopen:Permission denied:bss_file.c:398:fopen('private/ca.pem','r') 139701081003848:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:400: 2014-05-27 14:40:26,633 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Error during deploy dialog: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 14:40:26,637 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-11) [7f68b0e2] Error during host 10.251.193.9 install: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 14:40:26,639 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-6-thread-11) [7f68b0e2] Installation 10.251.193.9: Certificate enrollment failed 2014-05-27 14:40:26,709 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-11) [7f68b0e2] Error during host 10.251.193.9 install, prefering first exception: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 14:40:26,711 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-6-thread-11) [7f68b0e2] Host installation failed for host 322cbee8-16e6-11e2-9d38-6388c61dd004, node02.blabla.gov.za.: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 15:04:24,260 ERROR [org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign Certificate request failed with exit code 1 2014-05-27 15:04:24,261 ERROR [org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign Certificate request script errors: Error opening Certificate ca.pem 140668006123336:error:0200100D:system library:fopen:Permission denied:bss_file.c:398:fopen('ca.pem','r') 140668006123336:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:400: Error opening CA private key private/ca.pem 140106430207816:error:0200100D:system library:fopen:Permission denied:bss_file.c:398:fopen('private/ca.pem','r') 140106430207816:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:400: 2014-05-27 15:04:24,265 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Error during deploy dialog: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 15:04:24,270 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-34) [797b7d7a] Error during host 10.251.193.9 install: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 15:04:24,277 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-6-thread-34) [797b7d7a] Installation 10.251.193.9: Certificate enrollment failed 2014-05-27 15:04:24,348 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-34) [797b7d7a] Error during host 10.251.193.9 install, prefering first exception: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 15:04:24,352 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-6-thread-34) [797b7d7a] Host installation failed for host 322cbee8-16e6-11e2-9d38-6388c61dd004, node02.blabla.gov.za.: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 16:48:49,075 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp--127.0.0.1-8702-4) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. 2014-05-27 17:03:10,817 ERROR [org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign Certificate request failed with exit code 1 2014-05-27 17:03:10,817 ERROR [org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign Certificate request script errors: Error opening Certificate ca.pem 140117678909256:error:0200100D:system library:fopen:Permission denied:bss_file.c:398:fopen('ca.pem','r') 140117678909256:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:400: Error opening CA private key private/ca.pem 140049924028232:error:0200100D:system library:fopen:Permission denied:bss_file.c:398:fopen('private/ca.pem','r') 140049924028232:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:400: 2014-05-27 17:03:10,821 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Error during deploy dialog: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 17:03:10,828 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-18) [2bb26823] Error during host 10.251.193.9 install: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 17:03:10,839 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-6-thread-18) [2bb26823] Installation 10.251.193.9: Certificate enrollment failed 2014-05-27 17:03:10,891 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-18) [2bb26823] Error during host 10.251.193.9 install, prefering first exception: java.lang.RuntimeException: Certificate enrollment failed 2014-05-27 17:03:10,895 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-6-thread-18) [2bb26823] Host installation failed for host d2debdfe-76e7-40cf-a7fd-78a0f50f14d4, node02.blabla.gov.za.: java.lang.RuntimeException: Certificate enrollment failed I've looked around quite a bit and can't seem to find much. Please could someone assist. Thank you. Regards, Neil Wilson.