--_000_LOXP123MB1061BFB286DF89614B1725CCEDF00LOXP123MB1061GBRP_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hello Ovirt Users, I am new to ovirt. Just trying to fix the issue with the engine which seems= to be down and hence all our VMs which we are very much dependent upon are= not working. Tried googling the log snippet but to no avail. Hoping to get= some help from you guys. I am completely blank and don't know whats wrong with it. We have 3 Dell servers. One for Engine and the other two for nodes. Please = see the log snippet from the engine server agent.log. Please let me know if= more information is needed to debug the issue. MainThread::INFO::2017-05-30 17:21:51,649::hosted_engine::612::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm) Initializin= g VDSM MainThread::INFO::2017-05-30 17:21:53,820::hosted_engine::639::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images) C= onnecting the storage MainThread::INFO::2017-05-30 17:21:53,821::storage_server::219::ovirt_hoste= d_engine_ha.lib.storage_server.StorageServer::(connect_storage_server) Conn= ecting storage server MainThread::INFO::2017-05-30 17:21:58,134::storage_server::226::ovirt_hoste= d_engine_ha.lib.storage_server.StorageServer::(connect_storage_server) Conn= ecting storage server MainThread::INFO::2017-05-30 17:21:58,142::storage_server::233::ovirt_hoste= d_engine_ha.lib.storage_server.StorageServer::(connect_storage_server) Refr= eshing the storage domain MainThread::INFO::2017-05-30 17:21:58,258::hosted_engine::666::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images) P= reparing images MainThread::INFO::2017-05-30 17:21:58,258::image::126::ovirt_hosted_engine_= ha.lib.image.Image::(prepare_images) Preparing images MainThread::INFO::2017-05-30 17:22:00,637::hosted_engine::669::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images) R= eloading vm.conf from the shared storage domain MainThread::INFO::2017-05-30 17:22:00,638::config::206::ovirt_hosted_engine= _ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file) Tryi= ng to get a fresher copy of vm configuration from the OVF_STORE MainThread::INFO::2017-05-30 17:22:02,838::ovf_store::103::ovirt_hosted_eng= ine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:f4d55192= -a2c8-4c2b-8e6c-46a49c30967c, volUUID:0ae2c43f-5883-4354-a33f-e68e21ae3733 MainThread::INFO::2017-05-30 17:22:02,977::ovf_store::103::ovirt_hosted_eng= ine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:4ef3bd37= -e48d-44a8-b906-5353de1a32cc, volUUID:d63b9f36-c5f1-4ddc-9d4a-e01f22023e73 MainThread::INFO::2017-05-30 17:22:03,032::ovf_store::112::ovirt_hosted_eng= ine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF) Extracting Engine VM OV= F from the OVF_STORE MainThread::INFO::2017-05-30 17:22:03,033::ovf_store::119::ovirt_hosted_eng= ine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF) OVF_STORE volume path: = /rhev/data-center/mnt/nas1.le1.uk.cxn-network.net:_oVirt/4f9e46d7-594e-473c= -b0c5-1770c5773a2e/images/4ef3bd37-e48d-44a8-b906-5353de1a32cc/d63b9f36-c5f= 1-4ddc-9d4a-e01f22023e73 MainThread::INFO::2017-05-30 17:22:03,044::config::226::ovirt_hosted_engine= _ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file) Foun= d an OVF for HE VM, trying to convert MainThread::INFO::2017-05-30 17:22:03,046::config::231::ovirt_hosted_engine= _ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file) Got = vm.conf from OVF_STORE MainThread::INFO::2017-05-30 17:22:03,082::states::672::ovirt_hosted_engine= _ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to unexpected = vm shutdown at Tue May 30 17:18:38 2017 MainThread::INFO::2017-05-30 17:22:03,082::hosted_engine::461::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current sta= te EngineUnexpectedlyDown (score: 0) MainThread::INFO::2017-05-30 17:22:03,082::hosted_engine::466::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote= host vmhost2.le1.uk.cxn-network.net (id: 2, score: 0) MainThread::INFO::2017-05-30 17:22:13,135::hosted_engine::612::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm) Initializin= g VDSM MainThread::INFO::2017-05-30 17:22:15,305::hosted_engine::639::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images) C= onnecting the storage MainThread::INFO::2017-05-30 17:22:15,306::storage_server::219::ovirt_hoste= d_engine_ha.lib.storage_server.StorageServer::(connect_storage_server) Conn= ecting storage server MainThread::INFO::2017-05-30 17:22:19,618::storage_server::226::ovirt_hoste= d_engine_ha.lib.storage_server.StorageServer::(connect_storage_server) Conn= ecting storage server MainThread::INFO::2017-05-30 17:22:19,626::storage_server::233::ovirt_hoste= d_engine_ha.lib.storage_server.StorageServer::(connect_storage_server) Refr= eshing the storage domain MainThread::INFO::2017-05-30 17:22:19,742::hosted_engine::666::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images) P= reparing images MainThread::INFO::2017-05-30 17:22:19,742::image::126::ovirt_hosted_engine_= ha.lib.image.Image::(prepare_images) Preparing images MainThread::INFO::2017-05-30 17:22:22,140::hosted_engine::669::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images) R= eloading vm.conf from the shared storage domain MainThread::INFO::2017-05-30 17:22:22,140::config::206::ovirt_hosted_engine= _ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file) Tryi= ng to get a fresher copy of vm configuration from the OVF_STORE MainThread::INFO::2017-05-30 17:22:24,333::ovf_store::103::ovirt_hosted_eng= ine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:f4d55192= -a2c8-4c2b-8e6c-46a49c30967c, volUUID:0ae2c43f-5883-4354-a33f-e68e21ae3733 MainThread::INFO::2017-05-30 17:22:24,472::ovf_store::103::ovirt_hosted_eng= ine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:4ef3bd37= -e48d-44a8-b906-5353de1a32cc, volUUID:d63b9f36-c5f1-4ddc-9d4a-e01f22023e73 MainThread::INFO::2017-05-30 17:22:24,519::ovf_store::112::ovirt_hosted_eng= ine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF) Extracting Engine VM OV= F from the OVF_STORE MainThread::INFO::2017-05-30 17:22:24,520::ovf_store::119::ovirt_hosted_eng= ine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF) OVF_STORE volume path: = /rhev/data-center/mnt/nas1.le1.uk.cxn-network.net:_oVirt/4f9e46d7-594e-473c= -b0c5-1770c5773a2e/images/4ef3bd37-e48d-44a8-b906-5353de1a32cc/d63b9f36-c5f= 1-4ddc-9d4a-e01f22023e73 MainThread::INFO::2017-05-30 17:22:24,531::config::226::ovirt_hosted_engine= _ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file) Foun= d an OVF for HE VM, trying to convert MainThread::INFO::2017-05-30 17:22:24,533::config::231::ovirt_hosted_engine= _ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file) Got = vm.conf from OVF_STORE MainThread::INFO::2017-05-30 17:22:24,568::states::672::ovirt_hosted_engine= _ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to unexpected = vm shutdown at Tue May 30 17:18:39 2017 MainThread::INFO::2017-05-30 17:22:24,568::hosted_engine::461::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current sta= te EngineUnexpectedlyDown (score: 0) MainThread::INFO::2017-05-30 17:22:24,568::hosted_engine::466::ovirt_hosted= _engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote= host vmhost2.le1.uk.cxn-network.net (id: 2, score: 0) --_000_LOXP123MB1061BFB286DF89614B1725CCEDF00LOXP123MB1061GBRP_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"<head<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"= <meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)"<style><!-- /* Font Definitions */ @font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4;} @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0in; margin-bottom:.0001pt; font-size:11.0pt; font-family:"Calibri",sans-serif;} a:link, span.MsoHyperlink {mso-style-priority:99; color:#0563C1; text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed {mso-style-priority:99; color:#954F72; text-decoration:underline;} span.EmailStyle17 {mso-style-type:personal-compose; font-family:"Calibri",sans-serif; color:windowtext;} .MsoChpDefault {mso-style-type:export-only; font-family:"Calibri",sans-serif;} @page WordSection1 {size:8.5in 11.0in; margin:1.0in 1.0in 1.0in 1.0in;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 9]><xml<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /</xml><![endif]--><!--[if gte mso 9]><xml<o:shapelayout v:ext=3D"edit"<o:idmap v:ext=3D"edit" data=3D"1" /</o:shapelayout></xml><![endif]--</head<body lang=3D"EN-US" link=3D"#0563C1" vlink=3D"#954F72"<div class=3D"WordSection1"<p class=3D"MsoNormal">Hello Ovirt Users,<o:p></o:p></p<p class=3D"MsoNormal">I am new to ovirt. Just trying to fix the issue with= the engine which seems to be down and hence all our VMs which we are very = much dependent upon are not working. Tried googling the log snippet but to = no avail. Hoping to get some help from you guys.<o:p></o:p></p<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p<p class=3D"MsoNormal"><span lang=3D"EN-GB">I am completely blank and don&#= 8217;t know whats wrong with it.<o:p></o:p></span></p<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p<p class=3D"MsoNormal">We have 3 Dell servers. One for Engine and the other= two for nodes. Please see the log snippet from the engine server agent.log= . Please let me know if more information is needed to debug the issue.<o:p>= </o:p></p<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:21:51,649::hosted_en= gine::612::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initi= alize_vdsm) Initializing VDSM<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:21:53,820::hosted_en= gine::639::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initi= alize_storage_images) Connecting the storage<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:21:53,821::storage_s= erver::219::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(conne= ct_storage_server) Connecting storage server<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:21:58,134::storage_s= erver::226::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(conne= ct_storage_server) Connecting storage server<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:21:58,142::storage_s= erver::233::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(conne= ct_storage_server) Refreshing the storage domain<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:21:58,258::hosted_en= gine::666::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initi= alize_storage_images) Preparing images<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:21:58,258::image::12= 6::ovirt_hosted_engine_ha.lib.image.Image::(prepare_images) Preparing image= s<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:00,637::hosted_en= gine::669::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initi= alize_storage_images) Reloading vm.conf from the shared storage domain<o:p>= </o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:00,638::config::2= 06::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refres= h_local_conf_file) Trying to get a fresher copy of vm configuration from th= e OVF_STORE<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:02,838::ovf_store= ::103::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found OVF_= STORE: imgUUID:f4d55192-a2c8-4c2b-8e6c-46a49c30967c, volUUID:0ae2c43f-5883-= 4354-a33f-e68e21ae3733<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:02,977::ovf_store= ::103::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found OVF_= STORE: imgUUID:4ef3bd37-e48d-44a8-b906-5353de1a32cc, volUUID:d63b9f36-c5f1-= 4ddc-9d4a-e01f22023e73<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:03,032::ovf_store= ::112::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF) = Extracting Engine VM OVF from the OVF_STORE<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:03,033::ovf_store= ::119::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF) = OVF_STORE volume path: /rhev/data-center/mnt/nas1.le1.uk.cxn-network.net:_o= Virt/4f9e46d7-594e-473c-b0c5-1770c5773a2e/images/4ef3bd37-e48d-44a8-b906-53= 53de1a32cc/d63b9f36-c5f1-4ddc-9d4a-e01f22023e73<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:03,044::config::2= 26::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refres= h_local_conf_file) Found an OVF for HE VM, trying to convert<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:03,046::config::2= 31::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refres= h_local_conf_file) Got vm.conf from OVF_STORE<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:03,082::states::6= 72::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score = is 0 due to unexpected vm shutdown at Tue May 30 17:18:38 2017<o:p></o:p></= p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:03,082::hosted_en= gine::461::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_= monitoring) Current state EngineUnexpectedlyDown (score: 0)<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:03,082::hosted_en= gine::466::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_= monitoring) Best remote host vmhost2.le1.uk.cxn-network.net (id: 2, score: = 0)<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:13,135::hosted_en= gine::612::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initi= alize_vdsm) Initializing VDSM<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:15,305::hosted_en= gine::639::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initi= alize_storage_images) Connecting the storage<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:15,306::storage_s= erver::219::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(conne= ct_storage_server) Connecting storage server<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:19,618::storage_s= erver::226::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(conne= ct_storage_server) Connecting storage server<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:19,626::storage_s= erver::233::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(conne= ct_storage_server) Refreshing the storage domain<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:19,742::hosted_en= gine::666::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initi= alize_storage_images) Preparing images<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:19,742::image::12= 6::ovirt_hosted_engine_ha.lib.image.Image::(prepare_images) Preparing image= s<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:22,140::hosted_en= gine::669::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initi= alize_storage_images) Reloading vm.conf from the shared storage domain<o:p>= </o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:22,140::config::2= 06::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refres= h_local_conf_file) Trying to get a fresher copy of vm configuration from th= e OVF_STORE<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:24,333::ovf_store= ::103::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found OVF_= STORE: imgUUID:f4d55192-a2c8-4c2b-8e6c-46a49c30967c, volUUID:0ae2c43f-5883-= 4354-a33f-e68e21ae3733<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:24,472::ovf_store= ::103::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found OVF_= STORE: imgUUID:4ef3bd37-e48d-44a8-b906-5353de1a32cc, volUUID:d63b9f36-c5f1-= 4ddc-9d4a-e01f22023e73<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:24,519::ovf_store= ::112::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF) = Extracting Engine VM OVF from the OVF_STORE<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:24,520::ovf_store= ::119::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF) = OVF_STORE volume path: /rhev/data-center/mnt/nas1.le1.uk.cxn-network.net:_o= Virt/4f9e46d7-594e-473c-b0c5-1770c5773a2e/images/4ef3bd37-e48d-44a8-b906-53= 53de1a32cc/d63b9f36-c5f1-4ddc-9d4a-e01f22023e73<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:24,531::config::2= 26::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refres= h_local_conf_file) Found an OVF for HE VM, trying to convert<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:24,533::config::2= 31::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refres= h_local_conf_file) Got vm.conf from OVF_STORE<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:24,568::states::6= 72::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score = is 0 due to unexpected vm shutdown at Tue May 30 17:18:39 2017<o:p></o:p></= p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:24,568::hosted_en= gine::461::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_= monitoring) Current state EngineUnexpectedlyDown (score: 0)<o:p></o:p></p<p class=3D"MsoNormal">MainThread::INFO::2017-05-30 17:22:24,568::hosted_en= gine::466::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_= monitoring) Best remote host vmhost2.le1.uk.cxn-network.net (id: 2, score: = 0)<o:p></o:p></p<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p</div</body</html --_000_LOXP123MB1061BFB286DF89614B1725CCEDF00LOXP123MB1061GBRP_--