On Tue, May 30, 2017 at 6:32 PM, Rizwan Qureshi <rqureshi(a)connexin.co.uk>
wrote:
Hello Ovirt Users,
I am new to ovirt.
Hi, welcome ot oVirt community!
Just trying to fix the issue with the engine which seems to be down
and
hence all our VMs which we are very much dependent upon are not working.
Other VMs shouldn't be affected by an unavailability of the engine, they
should keep going if already started.
Tried googling the log snippet but to no avail. Hoping to get some
help
from you guys.
I am completely blank and don’t know whats wrong with it.
We have 3 Dell servers. One for Engine and the other two for nodes. Please
see the log snippet from the engine server agent.log. Please let me know if
more information is needed to debug the issue.
So you have only 1 host dedicated to running hosted engine?
MainThread::INFO::2017-05-30 17:21:51,649::hosted_engine::
612::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_initialize_vdsm) Initializing VDSM
MainThread::INFO::2017-05-30 17:21:53,820::hosted_engine::
639::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_initialize_storage_images) Connecting the storage
MainThread::INFO::2017-05-30 17:21:53,821::storage_server::
219::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Connecting storage server
MainThread::INFO::2017-05-30 17:21:58,134::storage_server::
226::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Connecting storage server
MainThread::INFO::2017-05-30 17:21:58,142::storage_server::
233::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Refreshing the storage domain
MainThread::INFO::2017-05-30 17:21:58,258::hosted_engine::
666::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_initialize_storage_images) Preparing images
MainThread::INFO::2017-05-30 17:21:58,258::image::126::
ovirt_hosted_engine_ha.lib.image.Image::(prepare_images) Preparing images
MainThread::INFO::2017-05-30 17:22:00,637::hosted_engine::
669::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_initialize_storage_images) Reloading vm.conf from the
shared storage domain
MainThread::INFO::2017-05-30 17:22:00,638::config::206::
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
config::(refresh_local_conf_file) Trying to get a fresher copy of vm
configuration from the OVF_STORE
MainThread::INFO::2017-05-30 17:22:02,838::ovf_store::103::
ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found
OVF_STORE: imgUUID:f4d55192-a2c8-4c2b-8e6c-46a49c30967c,
volUUID:0ae2c43f-5883-4354-a33f-e68e21ae3733
MainThread::INFO::2017-05-30 17:22:02,977::ovf_store::103::
ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found
OVF_STORE: imgUUID:4ef3bd37-e48d-44a8-b906-5353de1a32cc,
volUUID:d63b9f36-c5f1-4ddc-9d4a-e01f22023e73
MainThread::INFO::2017-05-30 17:22:03,032::ovf_store::112::
ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
Extracting Engine VM OVF from the OVF_STORE
MainThread::INFO::2017-05-30 17:22:03,033::ovf_store::119::
ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
OVF_STORE volume path: /rhev/data-center/mnt/nas1.le1.uk.cxn-network.net:
_oVirt/4f9e46d7-594e-473c-b0c5-1770c5773a2e/images/4ef3bd37-
e48d-44a8-b906-5353de1a32cc/d63b9f36-c5f1-4ddc-9d4a-e01f22023e73
MainThread::INFO::2017-05-30 17:22:03,044::config::226::
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
config::(refresh_local_conf_file) Found an OVF for HE VM, trying to
convert
MainThread::INFO::2017-05-30 17:22:03,046::config::231::
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
config::(refresh_local_conf_file) Got vm.conf from OVF_STORE
MainThread::INFO::2017-05-30 17:22:03,082::states::672::
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is
0 due to unexpected vm shutdown at Tue May 30 17:18:38 2017
MainThread::INFO::2017-05-30 17:22:03,082::hosted_engine::
461::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Current state EngineUnexpectedlyDown (score: 0)
MainThread::INFO::2017-05-30 17:22:03,082::hosted_engine::
466::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Best remote host
vmhost2.le1.uk.cxn-network.net (id: 2, score: 0)
MainThread::INFO::2017-05-30 17:22:13,135::hosted_engine::
612::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_initialize_vdsm) Initializing VDSM
MainThread::INFO::2017-05-30 17:22:15,305::hosted_engine::
639::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_initialize_storage_images) Connecting the storage
MainThread::INFO::2017-05-30 17:22:15,306::storage_server::
219::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Connecting storage server
MainThread::INFO::2017-05-30 17:22:19,618::storage_server::
226::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Connecting storage server
MainThread::INFO::2017-05-30 17:22:19,626::storage_server::
233::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Refreshing the storage domain
MainThread::INFO::2017-05-30 17:22:19,742::hosted_engine::
666::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_initialize_storage_images) Preparing images
MainThread::INFO::2017-05-30 17:22:19,742::image::126::
ovirt_hosted_engine_ha.lib.image.Image::(prepare_images) Preparing images
MainThread::INFO::2017-05-30 17:22:22,140::hosted_engine::
669::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_initialize_storage_images) Reloading vm.conf from the
shared storage domain
MainThread::INFO::2017-05-30 17:22:22,140::config::206::
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
config::(refresh_local_conf_file) Trying to get a fresher copy of vm
configuration from the OVF_STORE
MainThread::INFO::2017-05-30 17:22:24,333::ovf_store::103::
ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found
OVF_STORE: imgUUID:f4d55192-a2c8-4c2b-8e6c-46a49c30967c,
volUUID:0ae2c43f-5883-4354-a33f-e68e21ae3733
MainThread::INFO::2017-05-30 17:22:24,472::ovf_store::103::
ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found
OVF_STORE: imgUUID:4ef3bd37-e48d-44a8-b906-5353de1a32cc,
volUUID:d63b9f36-c5f1-4ddc-9d4a-e01f22023e73
MainThread::INFO::2017-05-30 17:22:24,519::ovf_store::112::
ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
Extracting Engine VM OVF from the OVF_STORE
MainThread::INFO::2017-05-30 17:22:24,520::ovf_store::119::
ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
OVF_STORE volume path: /rhev/data-center/mnt/nas1.le1.uk.cxn-network.net:
_oVirt/4f9e46d7-594e-473c-b0c5-1770c5773a2e/images/4ef3bd37-
e48d-44a8-b906-5353de1a32cc/d63b9f36-c5f1-4ddc-9d4a-e01f22023e73
MainThread::INFO::2017-05-30 17:22:24,531::config::226::
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
config::(refresh_local_conf_file) Found an OVF for HE VM, trying to
convert
MainThread::INFO::2017-05-30 17:22:24,533::config::231::
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
config::(refresh_local_conf_file) Got vm.conf from OVF_STORE
MainThread::INFO::2017-05-30 17:22:24,568::states::672::
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is
0 due to unexpected vm shutdown at Tue May 30 17:18:39 2017
MainThread::INFO::2017-05-30 17:22:24,568::hosted_engine::
461::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Current state EngineUnexpectedlyDown (score: 0)
MainThread::INFO::2017-05-30 17:22:24,568::hosted_engine::
466::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Best remote host
vmhost2.le1.uk.cxn-network.net (id: 2, score: 0)
Looks like hosted engine has been turned off at Tue May 30 17:18:38 2017
without moving to maintenance before doing it.
Above logs are timed 2017-05-30 17:22:24, so 4 minutes after the shutdown.
The agent should have already restarted it in a few minutes after above
logs.
Next time, if you need to urgently bring it up again you can use:
hosted-engine ---vm-start
as described in
http://www.ovirt.org/documentation/self-hosted/chap-Troubleshooting/
--
Best Regards,
Rizwan Qureshi
VoIP Admin
Ph: 01482xxxxxxx
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
SANDRO BONAZZOLA
ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
Red Hat EMEA <
https://www.redhat.com/>
<
https://red.ht/sig>
TRIED. TESTED. TRUSTED. <
https://redhat.com/trusted>