<div>Hi I find some error logs in /var/log/ovirt-hosted-engine-ha/broker.</div><div><br></div><div><div>[root@hosted-engine2 ~]# ll /rhev/data-center/mnt</div><div>total 0</div><div>drwxr-xr-x. 3 vdsm kvm 76 Apr 18 22:28 192.168.122.218:_exports_data</div><div>drwxr-xr-x. 3 vdsm kvm 76 Apr 18 22:12 192.168.122.218:_exports_hosted-engine-test1</div><div>[root@hosted-engine2 ~]# ll /rhev/data-center/mnt/192.168.122.218\:_exports_hosted-engine-test1/</div><div>total 0</div><div>drwxr-xr-x. 5 vdsm kvm 50 Apr 18 22:14 8a734205-65b7-4801-b7f0-d380eb45dbae</div><div>-rwxr-xr-x. 1 vdsm kvm &nbsp;0 Apr 20 09:54 __DIRECT_IO_TEST__</div></div><div><br></div><div>uuid 8a734205-65b7-4801-b7f0-d380eb45dbae is in /rhev/data-center/mnt/192.168.122.218\:_exports_hosted-engine-test1/</div><div>but broker find it in &nbsp;/rhev/data-center/mnt, is it my version is error? my&nbsp;ovirt-hosted-engine-ha version is 2.1.5, vdsm is&nbsp;4.20.5，</div><div>ovirt-engine is 4.2</div><div><br></div><div>MainThread::INFO::2018-04-19 19:26:31,479::listener::41::ovirt_hosted_engine_ha.broker.listener.Listener::(__init__) Initializing SocketServer</div><div>MainThread::INFO::2018-04-19 19:26:31,480::listener::56::ovirt_hosted_engine_ha.broker.listener.Listener::(__init__) SocketServer ready</div><div>Thread-1::INFO::2018-04-19 19:26:31,558::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established</div><div>Thread-1::ERROR::2018-04-19 19:26:31,559::listener::192::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Error handling request, data: 'set-storage-domain FilesystemBackend dom_type=nfs3 sd_uuid=8a734205-65b7-4801-b7f0-d380eb45dbae'</div><div>Traceback (most recent call last):</div><div>&nbsp; File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 166, in handle</div><div>&nbsp; &nbsp; data)</div><div>&nbsp; File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 299, in _dispatch</div><div>&nbsp; &nbsp; .set_storage_domain(client, sd_type, **options)</div><div>&nbsp; File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/storage_broker.py", line 66, in set_storage_domain</div><div>&nbsp; &nbsp; self._backends[client].connect()</div><div>&nbsp; File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/storage_backends.py", line 462, in connect</div><div>&nbsp; &nbsp; self._dom_type)</div><div>&nbsp; File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/storage_backends.py", line 107, in get_domain_path</div><div>&nbsp; &nbsp; " in {1}".format(sd_uuid, parent))</div><div>BackendFailureException: path to storage domain 8a734205-65b7-4801-b7f0-d380eb45dbae not found in /rhev/data-center/mnt</div><div>Thread-1::INFO::2018-04-19 19:26:31,563::listener::186::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed</div><div>Thread-2::INFO::2018-04-19 19:26:44,601::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established</div><div><br></div><div id="origbody"><div style="background: #f2f2f2;">----- 原始邮件 -----<br>发件人：&lt;dhy336@sina.com&gt;<br>收件人："Martin Sivak" &lt;msivak@redhat.com&gt;<br>抄送人：users &lt;users@ovirt.org&gt;<br>主题：[ovirt-users] 回复：Re:  Hosted-engine can not_switch<br>日期：2018年04月20日 09点30分<br></div><br><div>libvirt has not error logs . I only find some error for vdsm.</div><div>vdsm log is:</div><div><div>2018-04-20 09:24:52,610+0800 INFO &nbsp;(jsonrpc/1) [vdsm.api] FINISH getVolumeInfo return={'info': {'status': 'OK', 'domain': '8a734205-65b7-4801-b7f0-d380eb45dbae', 'voltype': 'LEAF', 'description': 'hosted-engine.lockspace', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '611272bd-c2cc-42bc-94e2-9aa52e754c35', 'ctime': '1524032037', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '1048576', 'children': [], 'pool': '', 'capacity': '1048576', 'uuid': u'7037aac6-7c8e-4efd-82f7-ca618c953fe6', 'truesize': '1048576', 'type': 'PREALLOCATED', 'lease': {'owners': [], 'version': None}}} from=::1,48306, task_id=03a7938e-8afb-4b16-b8dd-126c2b1f5d52 (api:52)</div><div>2018-04-20 09:24:52,611+0800 INFO &nbsp;(jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Volume.getInfo succeeded in 0.03 seconds (__init__:630)</div><div>2018-04-20 09:24:54,113+0800 ERROR (periodic/3) [virt.periodic.Operation] &lt;vdsm.virt.sampling.VMBulkstatsMonitor object at 0x1e92f90&gt; operation failed (periodic:215)</div><div>Traceback (most recent call last):</div><div>&nbsp; File "/usr/lib/python2.7/site-packages/vdsm/virt/periodic.py", line 213, in __call__</div><div>&nbsp; &nbsp; self._func()</div><div>&nbsp; File "/usr/lib/python2.7/site-packages/vdsm/virt/sampling.py", line 522, in __call__</div><div>&nbsp; &nbsp; self._send_metrics()</div><div>&nbsp; File "/usr/lib/python2.7/site-packages/vdsm/virt/sampling.py", line 538, in _send_metrics</div><div>&nbsp; &nbsp; vm_sample.interval)</div><div>&nbsp; File "/usr/lib/python2.7/site-packages/vdsm/virt/vmstats.py", line 45, in produce</div><div>&nbsp; &nbsp; networks(vm, stats, first_sample, last_sample, interval)</div><div>&nbsp; File "/usr/lib/python2.7/site-packages/vdsm/virt/vmstats.py", line 322, in networks</div><div>&nbsp; &nbsp; if nic.name.startswith('hostdev'):</div><div>AttributeError: name</div><div>2018-04-20 09:24:54,800+0800 INFO &nbsp;(Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:48308 (protocoldetector:61)</div><div>2018-04-20 09:24:54,810+0800 INFO &nbsp;(Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:48308 (protocoldetector:125)</div><div>2018-04-20 09:24:54,810+0800 INFO &nbsp;(Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:103)</div><div>2018-04-20 09:24:54,818+0800 INFO &nbsp;(JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:132)</div><div>2018-04-20 09:24:55,119+0800 INFO &nbsp;(jsonrpc/6) [api.host] START getHardwareInfo() from=::1,48308 (api:46)</div></div><div><br></div><div id="origbody"><div style="background: #f2f2f2;">----- 原始邮件 -----<br>发件人：Martin Sivak &lt;msivak@redhat.com&gt;<br>收件人：dhy336 &lt;dhy336@sina.com&gt;<br>抄送人：users &lt;users@ovirt.org&gt;<br>主题：Re: [ovirt-users] Hosted-engine can not switch<br>日期：2018年04月19日 20点16分<br></div><br><br>We need more than just this small log snippet. Please check the vdsm<br>and libvirt logs as well.<br>Best regards<br>Martin Sivak<br>On Thu, Apr 19, 2018 at 2:05 PM,  &lt;dhy336@sina.com&gt; wrote:<br>&gt; Hi，<br>&gt;  I deploy three node with hosted engine,  I force shut down  a node which<br>&gt; Host-engine VM is run, But  hosted engine VM in other nodes can not run.<br>&gt;<br>&gt; I find some error in /var/log/ovirt-hosted-engine-ha/agent.log<br>&gt;<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:35,787::hosted_engine::1192::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state)<br>&gt; Cleaning state for non-running VM<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:42,587::hosted_engine::1176::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state)<br>&gt; Vdsm state for VM clean<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:42,589::hosted_engine::1125::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm)<br>&gt; Starting vm using `/usr/sbin/hosted-engine --vm-start`<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:47,599::hosted_engine::1131::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm)<br>&gt; stdout:<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:47,600::hosted_engine::1132::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm)<br>&gt; stderr: Virtual machine does not exist: {'vmId':<br>&gt; u'08bbd680-a8a7-4267-82e7-89f36e87e930'}<br>&gt;<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:47,600::hosted_engine::1144::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm)<br>&gt; Engine VM started on localhost<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:47,609::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)<br>&gt; Trying: notify time=1524139007.61 type=state_transition<br>&gt; detail=EngineStart-EngineStarting hostname='hosted-engine2'<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:47,670::brokerlink::121::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)<br>&gt; Success, was notification of state_transition (EngineStart-EngineStarting)<br>&gt; sent? sent<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:47,670::hosted_engine::604::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm)<br>&gt; Initializing VDSM<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:50,095::hosted_engine::630::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)<br>&gt; Connecting the storage<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:50,096::storage_server::220::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(validate_storage_server)<br>&gt; Validating storage server<br>&gt; MainThread::INFO::2018-04-19<br>&gt; 19:56:52,449::hosted_engine::639::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)<br>&gt; Storage domain reported as valid and reconnect is not forced.<br>&gt;<br>&gt;<br>&gt; _______________________________________________<br>&gt; Users mailing list<br>&gt; Users@ovirt.org<br>&gt; http://lists.ovirt.org/mailman/listinfo/users<br>&gt;<br></div>_______________________________________________<br>Users mailing list<br>Users@ovirt.org<br>http://lists.ovirt.org/mailman/listinfo/users<br></div>