May 2017 - Users - oVirt List Archives

4.0 : hosts connecting/non responsive and data domains inactive
by Alexis HAUSER 11 May '17

11 May '17

------=_Part_11446852_617310615.1494517429918 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable After rebooting the manager VM, hosts are connecting/non responsive and dat= a domains inactive. Here are the engine and vdsmd logs. Any ideas ?=20 Engine logs :=20 2017-05-11 17:28:09,302 WARN [org.ovirt.engine.core.dal.dbbroker.auditlogha= ndling.AuditLogDirector] (DefaultQuartzScheduler5) [55f1aab5] Correlation I= D: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify P= ower Management configuration for Host rhvserv-05.=20 2017-05-11 17:28:09,346 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCom= mand] (DefaultQuartzScheduler5) [48bc69cd] Running command: HandleVdsVersio= nCommand internal: true. Entities affected : ID: 04565f10-9abf-4709-9445-9d= c6ed97e136 Type: VDS=20 2017-05-11 17:28:09,349 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (= org.ovirt.thread.pool-6-thread-27) [639977e4] Host 'rhvserv-05' is not resp= onding.=20 2017-05-11 17:28:09,364 WARN [org.ovirt.engine.core.dal.dbbroker.auditlogha= ndling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-27) [639977e4] Cor= relation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host rhv= serv-05 is not responding. Host cannot be fenced automatically because powe= r management for the host is disabled.=20 2017-05-11 17:28:11,299 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler3) [c0e6a2e] Command 'GetCa= pabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParamete= rsBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916',= vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution= failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connectio= n failed=20 2017-05-11 17:28:11,299 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler3) [c0e6a2e] Failure to refresh host = 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionEx= ception: Connection failed=20 2017-05-11 17:28:11,327 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:12,484 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.Get= HardwareInfoVDSCommand] (DefaultQuartzScheduler3) [c0e6a2e] START, GetHardw= areInfoVDSCommand(HostName =3D rhvserv-05, VdsIdAndVdsVDSCommandParametersB= ase:{runAsync=3D'true', hostId=3D'04565f10-9abf-4709-9445-9dc6ed97e136', vd= s=3D'Host[rhvserv-05,04565f10-9abf-4709-9445-9dc6ed97e136]'}), log id: f807= ece=20 2017-05-11 17:28:12,487 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.Get= HardwareInfoVDSCommand] (DefaultQuartzScheduler3) [c0e6a2e] FINISH, GetHard= wareInfoVDSCommand, log id: f807ece=20 2017-05-11 17:28:12,532 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOr= ClusterChangedCommand] (DefaultQuartzScheduler3) [4e882ea0] Running command= : HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affecte= d : ID: 04565f10-9abf-4709-9445-9dc6ed97e136 Type: VDS=20 2017-05-11 17:28:12,539 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand]= (DefaultQuartzScheduler3) [75f25b35] Running command: InitVdsOnUpCommand i= nternal: true. Entities affected : ID: 58f8df36-019f-02bc-00e7-000000000023= Type: StoragePool=20 2017-05-11 17:28:12,545 INFO [org.ovirt.engine.core.bll.storage.pool.Connec= tHostToStoragePoolServersCommand] (DefaultQuartzScheduler3) [46cc3f58] Runn= ing command: ConnectHostToStoragePoolServersCommand internal: true. Entitie= s affected : ID: 58f8df36-019f-02bc-00e7-000000000023 Type: StoragePool=20 2017-05-11 17:28:12,556 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.Con= nectStorageServerVDSCommand] (DefaultQuartzScheduler3) [46cc3f58] START, Co= nnectStorageServerVDSCommand(HostName =3D rhvserv-05, StorageServerConnecti= onManagementVDSParameters:{runAsync=3D'true', hostId=3D'04565f10-9abf-4709-= 9445-9dc6ed97e136', storagePoolId=3D'58f8df36-019f-02bc-00e7-000000000023',= storageType=3D'ISCSI', connectionList=3D'[StorageServerConnections:{id=3D'= 10c0528b-f08d-4d1d-8c63-8a05fd9d58b9', connection=3D'10.35.21.1', iqn=3D'iq= n.1984-05.com.dell:powervault.md3200i.6782bcb00073e332000000004edde164', vf= sType=3D'null', mountOptions=3D'null', nfsVersion=3D'null', nfsRetrans=3D'n= ull', nfsTimeo=3D'null', iface=3D'null', netIfaceName=3D'null'}]'}), log id= : 1beb27b6=20 2017-05-11 17:28:13,031 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.Con= nectStorageServerVDSCommand] (DefaultQuartzScheduler3) [46cc3f58] FINISH, C= onnectStorageServerVDSCommand, return: {10c0528b-f08d-4d1d-8c63-8a05fd9d58b= 9=3D0}, log id: 1beb27b6=20 2017-05-11 17:28:13,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.Con= nectStorageServerVDSCommand] (DefaultQuartzScheduler3) [46cc3f58] START, Co= nnectStorageServerVDSCommand(HostName =3D rhvserv-05, StorageServerConnecti= onManagementVDSParameters:{runAsync=3D'true', hostId=3D'04565f10-9abf-4709-= 9445-9dc6ed97e136', storagePoolId=3D'58f8df36-019f-02bc-00e7-000000000023',= storageType=3D'NFS', connectionList=3D'[StorageServerConnections:{id=3D'e6= 04d0d2-0810-4c25-b9ed-610f9923cb1a', connection=3D'nfsserv-01:/nfs/export',= iqn=3D'null', vfsType=3D'null', mountOptions=3D'null', nfsVersion=3D'V3', = nfsRetrans=3D'null', nfsTimeo=3D'null', iface=3D'null', netIfaceName=3D'nul= l'}, StorageServerConnections:{id=3D'2c1aba4b-786b-4c76-a02f-d9e09e8afff4',= connection=3D'nfsserv-01:/nfs/iso', iqn=3D'null', vfsType=3D'null', mountO= ptions=3D'null', nfsVersion=3D'V3', nfsRetrans=3D'null', nfsTimeo=3D'null',= iface=3D'null', netIfaceName=3D'null'}]'}), log id: 15c54cd7=20 2017-05-11 17:28:14,301 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:14,304 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler1) [62006eaa] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916'= , vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:14,304 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler1) [62006eaa] Failure to refresh host= 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:14,334 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler7) [1efe65a7] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4'= , vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:14,334 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler7) [1efe65a7] Failure to refresh host= 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:17,308 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:17,336 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:17,340 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilit= iesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParametersBase:= {runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', vds=3D= 'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution failed= : org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection faile= d=20 2017-05-11 17:28:17,340 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhvser= v-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed=20 2017-05-11 17:28:20,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler1) [62006eaa] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916'= , vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:20,315 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler1) [62006eaa] Failure to refresh host= 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:20,343 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:23,316 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:23,325 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilit= iesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:= {runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D= 'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed= : org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection faile= d=20 2017-05-11 17:28:23,325 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhvser= v-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed=20 2017-05-11 17:28:23,348 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler7) [1efe65a7] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4'= , vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:23,348 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler7) [1efe65a7] Failure to refresh host= 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:26,329 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:26,350 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:26,354 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler7) [1efe65a7] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4'= , vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:26,354 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler7) [1efe65a7] Failure to refresh host= 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:29,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilit= iesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:= {runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D= 'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed= : org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection faile= d=20 2017-05-11 17:28:29,335 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhvser= v-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed=20 2017-05-11 17:28:29,356 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:32,337 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:32,340 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler10) [] Command 'GetCapabili= tiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase= :{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds= =3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution fai= led: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection fa= iled=20 2017-05-11 17:28:32,340 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler10) [] Failure to refresh host 'rhvse= rv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionExceptio= n: Connection failed=20 2017-05-11 17:28:32,362 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler9) [4cf3eed0] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4'= , vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:32,362 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler9) [4cf3eed0] Failure to refresh host= 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:35,342 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:35,370 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:38,349 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler7) [1efe65a7] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916'= , vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:38,349 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler7) [1efe65a7] Failure to refresh host= 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:38,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilit= iesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParametersBase:= {runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', vds=3D= 'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution failed= : org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection faile= d=20 2017-05-11 17:28:38,375 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhvser= v-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed=20 2017-05-11 17:28:41,352 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:41,354 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler9) [4cf3eed0] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916'= , vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:41,354 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler9) [4cf3eed0] Failure to refresh host= 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:41,377 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:41,380 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler7) [1efe65a7] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4'= , vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:41,380 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler7) [1efe65a7] Failure to refresh host= 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:44,358 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:44,382 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:47,362 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler1) [62006eaa] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916'= , vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:47,363 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler1) [62006eaa] Failure to refresh host= 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:47,388 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler7) [1efe65a7] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4'= , vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:47,388 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler7) [1efe65a7] Failure to refresh host= 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:50,365 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:50,368 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler5) [48bc69cd] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916'= , vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:50,368 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler5) [48bc69cd] Failure to refresh host= 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:50,390 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:50,394 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler2) [590af365] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4'= , vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:50,394 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler2) [590af365] Failure to refresh host= 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:53,371 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:53,396 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:56,379 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler10) [] Command 'GetCapabili= tiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase= :{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds= =3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution fai= led: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection fa= iled=20 2017-05-11 17:28:56,379 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler10) [] Failure to refresh host 'rhvse= rv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionExceptio= n: Connection failed=20 2017-05-11 17:28:56,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler5) [48bc69cd] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4'= , vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:28:56,403 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler5) [48bc69cd] Failure to refresh host= 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:28:56,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tAllVmStatsVDSCommand] (DefaultQuartzScheduler6) [] Command 'GetAllVmStatsV= DSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParametersBase:{run= Async=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', vds=3D'Hos= t[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution failed: VD= SGenericException: VDSNetworkException: Vds timeout occured=20 2017-05-11 17:28:56,488 INFO [org.ovirt.engine.core.vdsbroker.monitoring.Po= llVmStatsRefresher] (DefaultQuartzScheduler6) [] Failed to fetch vms info f= or host 'rhvserv-04' - skipping VMs monitoring.=20 2017-05-11 17:28:59,382 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:28:59,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler10) [] Command 'GetCapabili= tiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase= :{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds= =3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution fai= led: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection fa= iled=20 2017-05-11 17:28:59,384 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler10) [] Failure to refresh host 'rhvse= rv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionExceptio= n: Connection failed=20 2017-05-11 17:28:59,404 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:28:59,408 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler6) [] Command 'GetCapabilit= iesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParametersBase:= {runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', vds=3D= 'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution failed= : org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection faile= d=20 2017-05-11 17:28:59,408 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler6) [] Failure to refresh host 'rhvser= v-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed=20 2017-05-11 17:29:02,386 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:29:02,409 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:29:02,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tAllVmStatsVDSCommand] (DefaultQuartzScheduler8) [56fb4c82] Command 'GetAll= VmStatsVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersB= ase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vd= s=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution fa= iled: VDSGenericException: VDSNetworkException: Vds timeout occured=20 2017-05-11 17:29:02,490 INFO [org.ovirt.engine.core.vdsbroker.monitoring.Po= llVmStatsRefresher] (DefaultQuartzScheduler8) [56fb4c82] Failed to fetch vm= s info for host 'rhvserv-03' - skipping VMs monitoring.=20 2017-05-11 17:29:05,393 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilit= iesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:= {runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D= 'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed= : org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection faile= d=20 2017-05-11 17:29:05,393 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhvser= v-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed=20 2017-05-11 17:29:05,415 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler10) [] Command 'GetCapabili= tiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParametersBase= :{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', vds= =3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution fai= led: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection fa= iled=20 2017-05-11 17:29:05,415 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler10) [] Failure to refresh host 'rhvse= rv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionExceptio= n: Connection failed=20 2017-05-11 17:29:08,395 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:29:08,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler8) [56fb4c82] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916'= , vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:29:08,398 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler8) [56fb4c82] Failure to refresh host= 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:29:08,417 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:29:08,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler2) [590af365] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4'= , vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:29:08,420 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler2) [590af365] Failure to refresh host= 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:29:11,402 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:29:11,423 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:29:14,409 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilit= iesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:= {runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D= 'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed= : org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection faile= d=20 2017-05-11 17:29:14,409 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhvser= v-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed=20 2017-05-11 17:29:14,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler5) [48bc69cd] Command 'GetC= apabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParamet= ersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4'= , vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' executio= n failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed=20 2017-05-11 17:29:14,430 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler5) [48bc69cd] Failure to refresh host= 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed=20 2017-05-11 17:29:17,411 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 2017-05-11 17:29:17,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler6) [] Command 'GetCapabilit= iesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:= {runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D= 'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed= : org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection faile= d=20 2017-05-11 17:29:17,414 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler6) [] Failure to refresh host 'rhvser= v-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed=20 2017-05-11 17:29:17,432 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.1= 68.93.214=20 2017-05-11 17:29:17,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.Ge= tCapabilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilit= iesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParametersBase:= {runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', vds=3D= 'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution failed= : org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection faile= d=20 2017-05-11 17:29:17,436 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhvser= v-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed=20 2017-05-11 17:29:17,491 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.Reacto= rClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.1= 68.93.213=20 vdsmd logs=20 Thread-113::ERROR::2017-05-11 17:41:33,734::sdc::146::Storage.StorageDomain= Cache::(_findDomain) domain 5b978dda-d1ef-46fe-9996-20aee42cf303 not found= =20 Traceback (most recent call last):=20 File "/usr/share/vdsm/storage/sdc.py", line 144, in _findDomain=20 dom =3D findMethod(sdUUID)=20 File "/usr/share/vdsm/storage/sdc.py", line 174, in _findUnfetchedDomain=20 raise se.StorageDomainDoesNotExist(sdUUID)=20 StorageDomainDoesNotExist: Storage domain does not exist: (u'5b978dda-d1ef-= 46fe-9996-20aee42cf303',)=20 Thread-113::ERROR::2017-05-11 17:41:33,735::monitor::328::Storage.Monitor::= (_setupLoop) Setting up monitor for 5b978dda-d1ef-46fe-9996-20aee42cf303 fa= iled=20 Traceback (most recent call last):=20 File "/usr/share/vdsm/storage/monitor.py", line 325, in _setupLoop=20 self._setupMonitor()=20 File "/usr/share/vdsm/storage/monitor.py", line 348, in _setupMonitor=20 self._produceDomain()=20 File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 405, in wrapper= =20 value =3D meth(self, *a, **kw)=20 File "/usr/share/vdsm/storage/monitor.py", line 366, in _produceDomain=20 self.domain =3D sdCache.produce(self.sdUUID)=20 File "/usr/share/vdsm/storage/sdc.py", line 101, in produce=20 domain.getRealDomain()=20 File "/usr/share/vdsm/storage/sdc.py", line 53, in getRealDomain=20 return self._cache._realProduce(self._sdUUID)=20 File "/usr/share/vdsm/storage/sdc.py", line 125, in _realProduce=20 domain =3D self._findDomain(sdUUID)=20 File "/usr/share/vdsm/storage/sdc.py", line 144, in _findDomain=20 dom =3D findMethod(sdUUID)=20 File "/usr/share/vdsm/storage/sdc.py", line 174, in _findUnfetchedDomain=20 raise se.StorageDomainDoesNotExist(sdUUID)=20 StorageDomainDoesNotExist: Storage domain does not exist: (u'5b978dda-d1ef-= 46fe-9996-20aee42cf303',)=20 Thread-112::DEBUG::2017-05-11 17:41:33,783::lvm::288::Storage.Misc.excCmd::= (cmd) SUCCESS: <err> =3D ''; <rc> =3D 0=20 Thread-112::INFO::2017-05-11 17:41:33,783::sd::604::Storage.StorageDomain::= (_registerResourceNamespaces) Resource namespace edd229cb-b72f-4988-8c10-d8= 3c84ef4a8a_imageNS already registered=20 Thread-112::INFO::2017-05-11 17:41:33,783::sd::612::Storage.StorageDomain::= (_registerResourceNamespaces) Resource namespace edd229cb-b72f-4988-8c10-d8= 3c84ef4a8a_volumeNS already registered=20 Thread-112::INFO::2017-05-11 17:41:33,783::blockSD::846::Storage.StorageDom= ain::(_registerResourceNamespaces) Resource namespace edd229cb-b72f-4988-8c= 10-d83c84ef4a8a_lvmActivationNS already registered=20 Thread-112::DEBUG::2017-05-11 17:41:33,784::lvm::288::Storage.Misc.excCmd::= (cmd) /usr/bin/taskset --cpu-list 0-15 /usr/bin/sudo -n /usr/sbin/lvm vgck = --config ' devices { preferred_names =3D ["^/dev/mapper/"] ignore_suspended= _devices=3D1 write_cache_state=3D0 disable_after_error_count=3D3 filter =3D= [ '\''a|/dev/mapper/36782bcb00073e33200002d3858fa1a81|'\'', '\''r|.*|'\'' = ] } global { locking_type=3D1 prioritise_write_locks=3D1 wait_for_locks=3D1= use_lvmetad=3D0 } backup { retain_min =3D 50 retain_days =3D 0 } ' edd229c= b-b72f-4988-8c10-d83c84ef4a8a (cwd None)=20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,792::lvm::288::Storage.Misc.= excCmd::(cmd) SUCCESS: <err> =3D ''; <rc> =3D 0=20 jsonrpc.Executor/6::INFO::2017-05-11 17:41:33,792::logUtils::52::dispatcher= ::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stat= s': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskf= ree': '498484641792', 'disktotal': '557943095296', 'mdafree': '67102208'}}= =20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::task::1193::Storage.Tas= kManager.Task::(prepare) Task=3D`234cbec4-a422-47c1-a50a-243526aeddc7`::fin= ished: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid':= True, 'diskfree': '498484641792', 'disktotal': '557943095296', 'mdafree': = '67102208'}}=20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::task::597::Storage.Task= Manager.Task::(_updateState) Task=3D`234cbec4-a422-47c1-a50a-243526aeddc7`:= :moving from state preparing -> state finished=20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::resourceManager::952::S= torage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} res= ources {u'Storage.595de2cf-89ba-407b-aae5-d0a7a0656ba1': < ResourceRef 'Sto= rage.595de2cf-89ba-407b-aae5-d0a7a0656ba1', isValid: 'True' obj: 'None'>}= =20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::resourceManager::989::S= torage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}=20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::resourceManager::628::S= torage.ResourceManager::(releaseResource) Trying to release resource 'Stora= ge.595de2cf-89ba-407b-aae5-d0a7a0656ba1'=20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::resourceManager::647::S= torage.ResourceManager::(releaseResource) Released resource 'Storage.595de2= cf-89ba-407b-aae5-d0a7a0656ba1' (0 active users)=20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::resourceManager::653::S= torage.ResourceManager::(releaseResource) Resource 'Storage.595de2cf-89ba-4= 07b-aae5-d0a7a0656ba1' is free, finding out if anyone is waiting for it.=20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::resourceManager::661::S= torage.ResourceManager::(releaseResource) No one is waiting for resource 'S= torage.595de2cf-89ba-407b-aae5-d0a7a0656ba1', Clearing records.=20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::task::995::Storage.Task= Manager.Task::(_decref) Task=3D`234cbec4-a422-47c1-a50a-243526aeddc7`::ref = 0 aborting False=20 jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,794::__init__::555::jsonrpc.= JsonRpcServer::(_handle_request) Return 'StorageDomain.getStats' in bridge = with {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'disk= free': '498484641792', 'disktotal': '557943095296', 'mdafree': '67102208'}= =20 jsonrpc.Executor/6::INFO::2017-05-11 17:41:33,794::__init__::513::jsonrpc.J= sonRpcServer::(_serveRequest) RPC call StorageDomain.getStats succeeded in = 1.05 seconds=20 JsonRpc (StompReactor)::ERROR::2017-05-11 17:41:33,816::betterAsyncore::113= ::vds.dispatcher::(recv) SSL error during reading data: unexpected eof=20 Thread-112::DEBUG::2017-05-11 17:41:33,846::lvm::288::Storage.Misc.excCmd::= (cmd) SUCCESS: <err> =3D ''; <rc> =3D 0=20 Thread-12::DEBUG::2017-05-11 17:41:34,913::check::296::storage.check::(_sta= rt_process) START check '/dev/595de2cf-89ba-407b-aae5-d0a7a0656ba1/metadata= ' cmd=3D['/usr/bin/taskset', '--cpu-list', '0-15', '/usr/bin/dd', 'if=3D/de= v/595de2cf-89ba-407b-aae5-d0a7a0656ba1/metadata', 'of=3D/dev/null', 'bs=3D4= 096', 'count=3D1', 'iflag=3Ddirect'] delay=3D0.00=20 Thread-12::DEBUG::2017-05-11 17:41:34,954::asyncevent::564::storage.asyncev= ent::(reap) Process <cpopen.CPopen object at 0x1b15b90> terminated (count= =3D1)=20 Thread-12::DEBUG::2017-05-11 17:41:34,954::check::327::storage.check::(_che= ck_completed) FINISH check '/dev/595de2cf-89ba-407b-aae5-d0a7a0656ba1/metad= ata' rc=3D0 err=3Dbytearray(b'1+0 records in\n1+0 records out\n4096 bytes (= 4.1 kB) copied, 0.000537649 s, 7.6 MB/s\n') elapsed=3D0.05=20 Reactor thread::INFO::2017-05-11 17:41:35,823::protocoldetector::76::Protoc= olDetector.AcceptorImpl::(handle_accept) Accepted connection from ::1:49348= =20 Reactor thread::DEBUG::2017-05-11 17:41:35,827::protocoldetector::92::Proto= colDetector.Detector::(__init__) Using required_size=3D11=20 Reactor thread::INFO::2017-05-11 17:41:35,828::protocoldetector::128::Proto= colDetector.Detector::(handle_read) Detected protocol stomp from ::1:49348= =20 Reactor thread::INFO::2017-05-11 17:41:35,828::stompreactor::101::Broker.St= ompAdapter::(_cmd_connect) Processing CONNECT request=20 Reactor thread::DEBUG::2017-05-11 17:41:35,829::stompreactor::492::protocol= detector.StompDetector::(handle_socket) Stomp detected from ('::1', 49348)= =20 JsonRpc (StompReactor)::INFO::2017-05-11 17:41:35,829::stompreactor::128::B= roker.StompAdapter::(_cmd_subscribe) Subscribe command received=20 ------=_Part_11446852_617310615.1494517429918 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><div>After rebooting the manager VM, =  hosts are connecting/non responsive and data domains inactive. Here a= re the engine and vdsmd logs. Any ideas ? </div><div> </div><div> = </div><div> </div><div> </div><div>Engine logs : </div><div> <= /div><div> </div><div> </div><div>2017-05-11 17:28:09,302 WARN  = [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (Def= aultQuartzScheduler5) [55f1aab5] Correlation ID: null, Call Stack: null, Cu= stom Event ID: -1, Message: Failed to verify Power Management configuration= for Host rhvserv-05. 2017-05-11 17:28:09,346 INFO  [org.ovirt.engi= ne.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler5) [48bc69cd] R= unning command: HandleVdsVersionCommand internal: true. Entities affected :=   ID: 04565f10-9abf-4709-9445-9dc6ed97e136 Type: VDS 2017-05-11 17:= 28:09,349 WARN  [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovir= t.thread.pool-6-thread-27) [639977e4] Host 'rhvserv-05' is not responding.<= br>2017-05-11 17:28:09,364 WARN  [org.ovirt.engine.core.dal.dbbroker.a= uditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-27) [6399= 77e4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message:= Host rhvserv-05 is not responding. Host cannot be fenced automatically bec= ause power management for the host is disabled. 2017-05-11 17:28:11,299 = ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand]= (DefaultQuartzScheduler3) [c0e6a2e] Command 'GetCapabilitiesVDSCommand(Hos= tName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true= ', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D'Host[rhvserv-03,= 4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed: org.ovirt.vdsm.= jsonrpc.client.ClientConnectionException: Connection failed 2017-05-11 1= 7:28:11,299 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitorin= g] (DefaultQuartzScheduler3) [c0e6a2e] Failure to refresh host 'rhvserv-03'= runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Con= nection failed 2017-05-11 17:28:11,327 INFO  [org.ovirt.vdsm.jsonrp= c.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to rhvse= rv-04.mydomain.com/192.168.93.214 2017-05-11 17:28:12,484 INFO  [or= g.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (Default= QuartzScheduler3) [c0e6a2e] START, GetHardwareInfoVDSCommand(HostName =3D r= hvserv-05, VdsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId= =3D'04565f10-9abf-4709-9445-9dc6ed97e136', vds=3D'Host[rhvserv-05,04565f10-= 9abf-4709-9445-9dc6ed97e136]'}), log id: f807ece 2017-05-11 17:28:12,487= INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCo= mmand] (DefaultQuartzScheduler3) [c0e6a2e] FINISH, GetHardwareInfoVDSComman= d, log id: f807ece 2017-05-11 17:28:12,532 INFO  [org.ovirt.engine.= core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler3= ) [4e882ea0] Running command: HandleVdsCpuFlagsOrClusterChangedCommand inte= rnal: true. Entities affected :  ID: 04565f10-9abf-4709-9445-9dc6ed97e= 136 Type: VDS 2017-05-11 17:28:12,539 INFO  [org.ovirt.engine.core.= bll.InitVdsOnUpCommand] (DefaultQuartzScheduler3) [75f25b35] Running comman= d: InitVdsOnUpCommand internal: true. Entities affected :  ID: 58f8df3= 6-019f-02bc-00e7-000000000023 Type: StoragePool 2017-05-11 17:28:12,545 = INFO  [org.ovirt.engine.core.bll.storage.pool.ConnectHostToStoragePool= ServersCommand] (DefaultQuartzScheduler3) [46cc3f58] Running command: Conne= ctHostToStoragePoolServersCommand internal: true. Entities affected : = ID: 58f8df36-019f-02bc-00e7-000000000023 Type: StoragePool 2017-05-11 1= 7:28:12,556 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectSt= orageServerVDSCommand] (DefaultQuartzScheduler3) [46cc3f58] START, ConnectS= torageServerVDSCommand(HostName =3D rhvserv-05, StorageServerConnectionMana= gementVDSParameters:{runAsync=3D'true', hostId=3D'04565f10-9abf-4709-9445-9= dc6ed97e136', storagePoolId=3D'58f8df36-019f-02bc-00e7-000000000023', stora= geType=3D'ISCSI', connectionList=3D'[StorageServerConnections:{id=3D'10c052= 8b-f08d-4d1d-8c63-8a05fd9d58b9', connection=3D'10.35.21.1', iqn=3D'iqn.1984= -05.com.dell:powervault.md3200i.6782bcb00073e332000000004edde164', vfsType= =3D'null', mountOptions=3D'null', nfsVersion=3D'null', nfsRetrans=3D'null',= nfsTimeo=3D'null', iface=3D'null', netIfaceName=3D'null'}]'}), log id: 1be= b27b6 2017-05-11 17:28:13,031 INFO  [org.ovirt.engine.core.vdsbroke= r.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler3) [46cc= 3f58] FINISH, ConnectStorageServerVDSCommand, return: {10c0528b-f08d-4d1d-8= c63-8a05fd9d58b9=3D0}, log id: 1beb27b6 2017-05-11 17:28:13,032 INFO&nbs= p; [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSComman= d] (DefaultQuartzScheduler3) [46cc3f58] START, ConnectStorageServerVDSComma= nd(HostName =3D rhvserv-05, StorageServerConnectionManagementVDSParameters:= {runAsync=3D'true', hostId=3D'04565f10-9abf-4709-9445-9dc6ed97e136', storag= ePoolId=3D'58f8df36-019f-02bc-00e7-000000000023', storageType=3D'NFS', conn= ectionList=3D'[StorageServerConnections:{id=3D'e604d0d2-0810-4c25-b9ed-610f= 9923cb1a', connection=3D'nfsserv-01:/nfs/export', iqn=3D'null', vfsType=3D'= null', mountOptions=3D'null', nfsVersion=3D'V3', nfsRetrans=3D'null', nfsTi= meo=3D'null', iface=3D'null', netIfaceName=3D'null'}, StorageServerConnecti= ons:{id=3D'2c1aba4b-786b-4c76-a02f-d9e09e8afff4', connection=3D'nfsserv-01:= /nfs/iso', iqn=3D'null', vfsType=3D'null', mountOptions=3D'null', nfsVersio= n=3D'V3', nfsRetrans=3D'null', nfsTimeo=3D'null', iface=3D'null', netIfaceN= ame=3D'null'}]'}), log id: 15c54cd7 2017-05-11 17:28:14,301 INFO  [= org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [= ] Connecting to rhvserv-03.mydomain.com/192.168.93.213 2017-05-11 17:28:= 14,304 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSC= ommand] (DefaultQuartzScheduler1) [62006eaa] Command 'GetCapabilitiesVDSCom= mand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:{runAsync= =3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D'Host[rhv= serv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed: org.ovi= rt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 2017= -05-11 17:28:14,304 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostM= onitoring] (DefaultQuartzScheduler1) [62006eaa] Failure to refresh host 'rh= vserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionExcep= tion: Connection failed 2017-05-11 17:28:14,334 ERROR [org.ovirt.engine.= core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler= 7) [1efe65a7] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-04, V= dsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b= 64a-42bb-a167-43fcedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167= -43fcedd634e4]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientCo= nnectionException: Connection failed 2017-05-11 17:28:14,334 ERROR [org.= ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzSchedu= ler7) [1efe65a7] Failure to refresh host 'rhvserv-04' runtime info: org.ovi= rt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 2017= -05-11 17:28:17,308 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors.Reac= torClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192= .168.93.213 2017-05-11 17:28:17,336 INFO  [org.ovirt.vdsm.jsonrpc.c= lient.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to rhvserv-= 04.mydomain.com/192.168.93.214 2017-05-11 17:28:17,340 ERROR [org.ovirt.= engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzSc= heduler4) [] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-04, Vd= sIdAndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b6= 4a-42bb-a167-43fcedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-= 43fcedd634e4]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientCon= nectionException: Connection failed 2017-05-11 17:28:17,340 ERROR [org.o= virt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzSchedul= er4) [] Failure to refresh host 'rhvserv-04' runtime info: org.ovirt.vdsm.j= sonrpc.client.ClientConnectionException: Connection failed 2017-05-11 17= :28:20,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilities= VDSCommand] (DefaultQuartzScheduler1) [62006eaa] Command 'GetCapabilitiesVD= SCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:{runA= sync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D'Host= [rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed: org= .ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed = 2017-05-11 17:28:20,315 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.H= ostMonitoring] (DefaultQuartzScheduler1) [62006eaa] Failure to refresh host= 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionE= xception: Connection failed 2017-05-11 17:28:20,343 INFO  [org.ovir= t.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connec= ting to rhvserv-04.mydomain.com/192.168.93.214 2017-05-11 17:28:23,316 I= NFO  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp= Reactor) [] Connecting to rhvserv-03.mydomain.com/192.168.93.213 2017-0= 5-11 17:28:23,325 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapab= ilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilitiesVDS= Command(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:{runAs= ync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D'Host[= rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed: org.= ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 2= 017-05-11 17:28:23,325 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.Ho= stMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhvserv= -03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException:= Connection failed 2017-05-11 17:28:23,348 ERROR [org.ovirt.engine.core.= vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler7) [1= efe65a7] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdA= ndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-4= 2bb-a167-43fcedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fc= edd634e4]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientConnect= ionException: Connection failed 2017-05-11 17:28:23,348 ERROR [org.ovirt= .engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler7)= [1efe65a7] Failure to refresh host 'rhvserv-04' runtime info: org.ovirt.vd= sm.jsonrpc.client.ClientConnectionException: Connection failed 2017-05-1= 1 17:28:26,329 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorCl= ient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.168.= 93.213 2017-05-11 17:28:26,350 INFO  [org.ovirt.vdsm.jsonrpc.client= .reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.my= domain.com/192.168.93.214 2017-05-11 17:28:26,354 ERROR [org.ovirt.engin= e.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzSchedul= er7) [1efe65a7] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-04,= VdsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'0d0cd690= -b64a-42bb-a167-43fcedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a1= 67-43fcedd634e4]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.Client= ConnectionException: Connection failed 2017-05-11 17:28:26,354 ERROR [or= g.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzSche= duler7) [1efe65a7] Failure to refresh host 'rhvserv-04' runtime info: org.o= virt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 20= 17-05-11 17:28:29,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetC= apabilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilitie= sVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:{r= unAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D'H= ost[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed: = org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed<= br>2017-05-11 17:28:29,335 ERROR [org.ovirt.engine.core.vdsbroker.monitorin= g.HostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhv= serv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionExcept= ion: Connection failed 2017-05-11 17:28:29,356 INFO  [org.ovirt.vds= m.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting = to rhvserv-04.mydomain.com/192.168.93.214 2017-05-11 17:28:32,337 INFO&n= bsp; [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reac= tor) [] Connecting to rhvserv-03.mydomain.com/192.168.93.213 2017-05-11 = 17:28:32,340 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabiliti= esVDSCommand] (DefaultQuartzScheduler10) [] Command 'GetCapabilitiesVDSComm= and(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:{runAsync= =3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D'Host[rhv= serv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed: org.ovi= rt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 2017= -05-11 17:28:32,340 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostM= onitoring] (DefaultQuartzScheduler10) [] Failure to refresh host 'rhvserv-0= 3' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: C= onnection failed 2017-05-11 17:28:32,362 ERROR [org.ovirt.engine.core.vd= sbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler9) [4cf= 3eed0] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAnd= VdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42b= b-a167-43fcedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fced= d634e4]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectio= nException: Connection failed 2017-05-11 17:28:32,362 ERROR [org.ovirt.e= ngine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler9) [= 4cf3eed0] Failure to refresh host 'rhvserv-04' runtime info: org.ovirt.vdsm= .jsonrpc.client.ClientConnectionException: Connection failed 2017-05-11 = 17:28:35,342 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClie= nt] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.168.93= .213 2017-05-11 17:28:35,370 INFO  [org.ovirt.vdsm.jsonrpc.client.r= eactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydo= main.com/192.168.93.214 2017-05-11 17:28:38,349 ERROR [org.ovirt.engine.= core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler= 7) [1efe65a7] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-03, V= dsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'4036f027-8= e90-49c0-8ca5-3ddb8d586916', vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5= -3ddb8d586916]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientCo= nnectionException: Connection failed 2017-05-11 17:28:38,349 ERROR [org.= ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzSchedu= ler7) [1efe65a7] Failure to refresh host 'rhvserv-03' runtime info: org.ovi= rt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 2017= -05-11 17:28:38,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCap= abilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilitiesV= DSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParametersBase:{run= Async=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', vds=3D'Hos= t[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution failed: or= g.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed<br= >2017-05-11 17:28:38,375 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.= HostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhvse= rv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionExceptio= n: Connection failed 2017-05-11 17:28:41,352 INFO  [org.ovirt.vdsm.= jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to= rhvserv-03.mydomain.com/192.168.93.213 2017-05-11 17:28:41,354 ERROR [o= rg.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (Defaul= tQuartzScheduler9) [4cf3eed0] Command 'GetCapabilitiesVDSCommand(HostName = =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true', hos= tId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D'Host[rhvserv-03,4036f0= 27-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed: org.ovirt.vdsm.jsonrp= c.client.ClientConnectionException: Connection failed 2017-05-11 17:28:4= 1,354 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (De= faultQuartzScheduler9) [4cf3eed0] Failure to refresh host 'rhvserv-03' runt= ime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connecti= on failed 2017-05-11 17:28:41,377 INFO  [org.ovirt.vdsm.jsonrpc.cli= ent.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04= .mydomain.com/192.168.93.214 2017-05-11 17:28:41,380 ERROR [org.ovirt.en= gine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzSche= duler7) [1efe65a7] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-= 04, VdsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'0d0cd= 690-b64a-42bb-a167-43fcedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb= -a167-43fcedd634e4]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.Cli= entConnectionException: Connection failed 2017-05-11 17:28:41,380 ERROR = [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzS= cheduler7) [1efe65a7] Failure to refresh host 'rhvserv-04' runtime info: or= g.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed<br= >2017-05-11 17:28:44,358 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors= .ReactorClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.co= m/192.168.93.213 2017-05-11 17:28:44,382 INFO  [org.ovirt.vdsm.json= rpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to rhv= serv-04.mydomain.com/192.168.93.214 2017-05-11 17:28:47,362 ERROR [org.o= virt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQua= rtzScheduler1) [62006eaa] Command 'GetCapabilitiesVDSCommand(HostName =3D r= hvserv-03, VdsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId= =3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D'Host[rhvserv-03,4036f027-= 8e90-49c0-8ca5-3ddb8d586916]'})' execution failed: org.ovirt.vdsm.jsonrpc.c= lient.ClientConnectionException: Connection failed 2017-05-11 17:28:47,3= 63 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (Defau= ltQuartzScheduler1) [62006eaa] Failure to refresh host 'rhvserv-03' runtime= info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection = failed 2017-05-11 17:28:47,388 ERROR [org.ovirt.engine.core.vdsbroker.vd= sbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler7) [1efe65a7] Com= mand 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSComm= andParametersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43f= cedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})= ' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed 2017-05-11 17:28:47,388 ERROR [org.ovirt.engine.core= .vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler7) [1efe65a7] = Failure to refresh host 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.c= lient.ClientConnectionException: Connection failed 2017-05-11 17:28:50,3= 65 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL S= tomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.168.93.213 20= 17-05-11 17:28:50,368 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetC= apabilitiesVDSCommand] (DefaultQuartzScheduler5) [48bc69cd] Command 'GetCap= abilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParameter= sBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', = vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution = failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection= failed 2017-05-11 17:28:50,368 ERROR [org.ovirt.engine.core.vdsbroker.m= onitoring.HostMonitoring] (DefaultQuartzScheduler5) [48bc69cd] Failure to r= efresh host 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.Client= ConnectionException: Connection failed 2017-05-11 17:28:50,390 INFO&nbsp= ; [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor= ) [] Connecting to rhvserv-04.mydomain.com/192.168.93.214 2017-05-11 17:= 28:50,394 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesV= DSCommand] (DefaultQuartzScheduler2) [590af365] Command 'GetCapabilitiesVDS= Command(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParametersBase:{runAs= ync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', vds=3D'Host[= rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution failed: org.= ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 2= 017-05-11 17:28:50,394 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.Ho= stMonitoring] (DefaultQuartzScheduler2) [590af365] Failure to refresh host = 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionEx= ception: Connection failed 2017-05-11 17:28:53,371 INFO  [org.ovirt= .vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connect= ing to rhvserv-03.mydomain.com/192.168.93.213 2017-05-11 17:28:53,396 IN= FO  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp = Reactor) [] Connecting to rhvserv-04.mydomain.com/192.168.93.214 2017-05= -11 17:28:56,379 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabi= litiesVDSCommand] (DefaultQuartzScheduler10) [] Command 'GetCapabilitiesVDS= Command(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:{runAs= ync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D'Host[= rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed: org.= ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 2= 017-05-11 17:28:56,379 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.Ho= stMonitoring] (DefaultQuartzScheduler10) [] Failure to refresh host 'rhvser= v-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException= : Connection failed 2017-05-11 17:28:56,402 ERROR [org.ovirt.engine.core= .vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler5) [= 48bc69cd] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-04, VdsId= AndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-= 42bb-a167-43fcedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43f= cedd634e4]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientConnec= tionException: Connection failed 2017-05-11 17:28:56,403 ERROR [org.ovir= t.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler5= ) [48bc69cd] Failure to refresh host 'rhvserv-04' runtime info: org.ovirt.v= dsm.jsonrpc.client.ClientConnectionException: Connection failed 2017-05-= 11 17:28:56,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmSt= atsVDSCommand] (DefaultQuartzScheduler6) [] Command 'GetAllVmStatsVDSComman= d(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParametersBase:{runAsync=3D= 'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', vds=3D'Host[rhvser= v-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution failed: VDSGeneric= Exception: VDSNetworkException: Vds timeout occured 2017-05-11 17:28:56,= 488 INFO  [org.ovirt.engine.core.vdsbroker.monitoring.PollVmStatsRefre= sher] (DefaultQuartzScheduler6) [] Failed to fetch vms info for host 'rhvse= rv-04' - skipping VMs monitoring. 2017-05-11 17:28:59,382 INFO  [or= g.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] = Connecting to rhvserv-03.mydomain.com/192.168.93.213 2017-05-11 17:28:59= ,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCom= mand] (DefaultQuartzScheduler10) [] Command 'GetCapabilitiesVDSCommand(Host= Name =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true'= , hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vds=3D'Host[rhvserv-03,4= 036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution failed: org.ovirt.vdsm.j= sonrpc.client.ClientConnectionException: Connection failed 2017-05-11 17= :28:59,384 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring= ] (DefaultQuartzScheduler10) [] Failure to refresh host 'rhvserv-03' runtim= e info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection= failed 2017-05-11 17:28:59,404 INFO  [org.ovirt.vdsm.jsonrpc.clien= t.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.m= ydomain.com/192.168.93.214 2017-05-11 17:28:59,408 ERROR [org.ovirt.engi= ne.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzSchedu= ler6) [] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdA= ndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-4= 2bb-a167-43fcedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fc= edd634e4]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientConnect= ionException: Connection failed 2017-05-11 17:28:59,408 ERROR [org.ovirt= .engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler6)= [] Failure to refresh host 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonr= pc.client.ClientConnectionException: Connection failed 2017-05-11 17:29:= 02,386 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (S= SL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.168.93.213<b= r>2017-05-11 17:29:02,409 INFO  [org.ovirt.vdsm.jsonrpc.client.reactor= s.ReactorClient] (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.c= om/192.168.93.214 2017-05-11 17:29:02,490 ERROR [org.ovirt.engine.core.v= dsbroker.vdsbroker.GetAllVmStatsVDSCommand] (DefaultQuartzScheduler8) [56fb= 4c82] Command 'GetAllVmStatsVDSCommand(HostName =3D rhvserv-03, VdsIdAndVds= VDSCommandParametersBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8= ca5-3ddb8d586916', vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586= 916]'})' execution failed: VDSGenericException: VDSNetworkException: Vds ti= meout occured 2017-05-11 17:29:02,490 INFO  [org.ovirt.engine.core.= vdsbroker.monitoring.PollVmStatsRefresher] (DefaultQuartzScheduler8) [56fb4= c82] Failed to fetch vms info for host 'rhvserv-03' - skipping VMs monitori= ng. 2017-05-11 17:29:05,393 ERROR [org.ovirt.engine.core.vdsbroker.vdsbr= oker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCa= pabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParamete= rsBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916',= vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution= failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connectio= n failed 2017-05-11 17:29:05,393 ERROR [org.ovirt.engine.core.vdsbroker.= monitoring.HostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh = host 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnect= ionException: Connection failed 2017-05-11 17:29:05,415 ERROR [org.ovirt= .engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzS= cheduler10) [] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-04, = VdsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'0d0cd690-= b64a-42bb-a167-43fcedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a16= 7-43fcedd634e4]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientC= onnectionException: Connection failed 2017-05-11 17:29:05,415 ERROR [org= .ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzSched= uler10) [] Failure to refresh host 'rhvserv-04' runtime info: org.ovirt.vds= m.jsonrpc.client.ClientConnectionException: Connection failed 2017-05-11= 17:29:08,395 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorCli= ent] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.com/192.168.9= 3.213 2017-05-11 17:29:08,398 ERROR [org.ovirt.engine.core.vdsbroker.vds= broker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler8) [56fb4c82] Comm= and 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSComma= ndParametersBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb= 8d586916', vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})'= execution failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException:= Connection failed 2017-05-11 17:29:08,398 ERROR [org.ovirt.engine.core.= vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler8) [56fb4c82] F= ailure to refresh host 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.cl= ient.ClientConnectionException: Connection failed 2017-05-11 17:29:08,41= 7 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL St= omp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.168.93.214 201= 7-05-11 17:29:08,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCa= pabilitiesVDSCommand] (DefaultQuartzScheduler2) [590af365] Command 'GetCapa= bilitiesVDSCommand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParameters= Base:{runAsync=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', v= ds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution f= ailed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection = failed 2017-05-11 17:29:08,420 ERROR [org.ovirt.engine.core.vdsbroker.mo= nitoring.HostMonitoring] (DefaultQuartzScheduler2) [590af365] Failure to re= fresh host 'rhvserv-04' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientC= onnectionException: Connection failed 2017-05-11 17:29:11,402 INFO = [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor)= [] Connecting to rhvserv-03.mydomain.com/192.168.93.213 2017-05-11 17:2= 9:11,423 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] = (SSL Stomp Reactor) [] Connecting to rhvserv-04.mydomain.com/192.168.93.214= 2017-05-11 17:29:14,409 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroke= r.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapab= ilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCommandParametersB= ase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3ddb8d586916', vd= s=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'})' execution fa= iled: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection f= ailed 2017-05-11 17:29:14,409 ERROR [org.ovirt.engine.core.vdsbroker.mon= itoring.HostMonitoring] (DefaultQuartzScheduler4) [] Failure to refresh hos= t 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnection= Exception: Connection failed 2017-05-11 17:29:14,430 ERROR [org.ovirt.en= gine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzSche= duler5) [48bc69cd] Command 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-= 04, VdsIdAndVdsVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'0d0cd= 690-b64a-42bb-a167-43fcedd634e4', vds=3D'Host[rhvserv-04,0d0cd690-b64a-42bb= -a167-43fcedd634e4]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.Cli= entConnectionException: Connection failed 2017-05-11 17:29:14,430 ERROR = [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzS= cheduler5) [48bc69cd] Failure to refresh host 'rhvserv-04' runtime info: or= g.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed<br= >2017-05-11 17:29:17,411 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors= .ReactorClient] (SSL Stomp Reactor) [] Connecting to rhvserv-03.mydomain.co= m/192.168.93.213 2017-05-11 17:29:17,414 ERROR [org.ovirt.engine.core.vd= sbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler6) [] C= ommand 'GetCapabilitiesVDSCommand(HostName =3D rhvserv-03, VdsIdAndVdsVDSCo= mmandParametersBase:{runAsync=3D'true', hostId=3D'4036f027-8e90-49c0-8ca5-3= ddb8d586916', vds=3D'Host[rhvserv-03,4036f027-8e90-49c0-8ca5-3ddb8d586916]'= })' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionExcepti= on: Connection failed 2017-05-11 17:29:17,414 ERROR [org.ovirt.engine.co= re.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler6) [] Failur= e to refresh host 'rhvserv-03' runtime info: org.ovirt.vdsm.jsonrpc.client.= ClientConnectionException: Connection failed 2017-05-11 17:29:17,432 INF= O  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp R= eactor) [] Connecting to rhvserv-04.mydomain.com/192.168.93.214 2017-05-= 11 17:29:17,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabil= itiesVDSCommand] (DefaultQuartzScheduler4) [] Command 'GetCapabilitiesVDSCo= mmand(HostName =3D rhvserv-04, VdsIdAndVdsVDSCommandParametersBase:{runAsyn= c=3D'true', hostId=3D'0d0cd690-b64a-42bb-a167-43fcedd634e4', vds=3D'Host[rh= vserv-04,0d0cd690-b64a-42bb-a167-43fcedd634e4]'})' execution failed: org.ov= irt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 201= 7-05-11 17:29:17,436 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.Host= Monitoring] (DefaultQuartzScheduler4) [] Failure to refresh host 'rhvserv-0= 4' runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: C= onnection failed 2017-05-11 17:29:17,491 INFO  [org.ovirt.vdsm.json= rpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to rhv= serv-03.mydomain.com/192.168.93.213</div><div> </div><div> </div><div= >vdsmd logs </div><div> </div><div> </div><div>Thread-113::ERROR::= 2017-05-11 17:41:33,734::sdc::146::Storage.StorageDomainCache::(_findDomain= ) domain 5b978dda-d1ef-46fe-9996-20aee42cf303 not found Traceback (most = recent call last):   File "/usr/share/vdsm/storage/sdc.py", line 14= 4, in _findDomain     dom =3D findMethod(sdUUID) &nbsp= ; File "/usr/share/vdsm/storage/sdc.py", line 174, in _findUnfetchedDomain<= br>    raise se.StorageDomainDoesNotExist(sdUUID) Storage= DomainDoesNotExist: Storage domain does not exist: (u'5b978dda-d1ef-46fe-99= 96-20aee42cf303',) Thread-113::ERROR::2017-05-11 17:41:33,735::monitor::= 328::Storage.Monitor::(_setupLoop) Setting up monitor for 5b978dda-d1ef-46f= e-9996-20aee42cf303 failed Traceback (most recent call last):   = File "/usr/share/vdsm/storage/monitor.py", line 325, in _setupLoop &nbsp= ;   self._setupMonitor()   File "/usr/share/vdsm/storage/= monitor.py", line 348, in _setupMonitor     self._produce= Domain()   File "/usr/lib/python2.7/site-packages/vdsm/utils.py", l= ine 405, in wrapper     value =3D meth(self, *a, **kw)<br= >  File "/usr/share/vdsm/storage/monitor.py", line 366, in _produceDom= ain     self.domain =3D sdCache.produce(self.sdUUID) &= nbsp; File "/usr/share/vdsm/storage/sdc.py", line 101, in produce  =    domain.getRealDomain()   File "/usr/share/vdsm/storage= /sdc.py", line 53, in getRealDomain     return self._cach= e._realProduce(self._sdUUID)   File "/usr/share/vdsm/storage/sdc.py= ", line 125, in _realProduce     domain =3D self._findDom= ain(sdUUID)   File "/usr/share/vdsm/storage/sdc.py", line 144, in _= findDomain     dom =3D findMethod(sdUUID)   File = "/usr/share/vdsm/storage/sdc.py", line 174, in _findUnfetchedDomain &nbs= p;   raise se.StorageDomainDoesNotExist(sdUUID) StorageDomainD= oesNotExist: Storage domain does not exist: (u'5b978dda-d1ef-46fe-9996-20ae= e42cf303',) Thread-112::DEBUG::2017-05-11 17:41:33,783::lvm::288::Storag= e.Misc.excCmd::(cmd) SUCCESS: <err> =3D ''; <rc> =3D 0 Threa= d-112::INFO::2017-05-11 17:41:33,783::sd::604::Storage.StorageDomain::(_reg= isterResourceNamespaces) Resource namespace edd229cb-b72f-4988-8c10-d83c84e= f4a8a_imageNS already registered Thread-112::INFO::2017-05-11 17:41:33,7= 83::sd::612::Storage.StorageDomain::(_registerResourceNamespaces) Resource = namespace edd229cb-b72f-4988-8c10-d83c84ef4a8a_volumeNS already registered<= br>Thread-112::INFO::2017-05-11 17:41:33,783::blockSD::846::Storage.Storage= Domain::(_registerResourceNamespaces) Resource namespace edd229cb-b72f-4988= -8c10-d83c84ef4a8a_lvmActivationNS already registered Thread-112::DEBUG:= :2017-05-11 17:41:33,784::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/tas= kset --cpu-list 0-15 /usr/bin/sudo -n /usr/sbin/lvm vgck --config ' devices= { preferred_names =3D ["^/dev/mapper/"] ignore_suspended_devices=3D1 write= _cache_state=3D0 disable_after_error_count=3D3 filter =3D [ '\''a|/dev/mapp= er/36782bcb00073e33200002d3858fa1a81|'\'', '\''r|.*|'\'' ] }  global {=   locking_type=3D1  prioritise_write_locks=3D1  wait_for_loc= ks=3D1  use_lvmetad=3D0 }  backup {  retain_min =3D 50 = retain_days =3D 0 } ' edd229cb-b72f-4988-8c10-d83c84ef4a8a (cwd None) j= sonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,792::lvm::288::Storage.Misc.e= xcCmd::(cmd) SUCCESS: <err> =3D ''; <rc> =3D 0 jsonrpc.Execu= tor/6::INFO::2017-05-11 17:41:33,792::logUtils::52::dispatcher::(wrapper) R= un and protect: getStorageDomainStats, Return response: {'stats': {'mdasize= ': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '498484= 641792', 'disktotal': '557943095296', 'mdafree': '67102208'}} jsonrpc.Ex= ecutor/6::DEBUG::2017-05-11 17:41:33,793::task::1193::Storage.TaskManager.T= ask::(prepare) Task=3D`234cbec4-a422-47c1-a50a-243526aeddc7`::finished: {'s= tats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'di= skfree': '498484641792', 'disktotal': '557943095296', 'mdafree': '67102208'= }} jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::task::597::Storag= e.TaskManager.Task::(_updateState) Task=3D`234cbec4-a422-47c1-a50a-243526ae= ddc7`::moving from state preparing -> state finished jsonrpc.Executor= /6::DEBUG::2017-05-11 17:41:33,793::resourceManager::952::Storage.ResourceM= anager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storag= e.595de2cf-89ba-407b-aae5-d0a7a0656ba1': < ResourceRef 'Storage.595de2cf= -89ba-407b-aae5-d0a7a0656ba1', isValid: 'True' obj: 'None'>} jsonrpc.= Executor/6::DEBUG::2017-05-11 17:41:33,793::resourceManager::989::Storage.R= esourceManager.Owner::(cancelAll) Owner.cancelAll requests {} jsonrpc.Ex= ecutor/6::DEBUG::2017-05-11 17:41:33,793::resourceManager::628::Storage.Res= ourceManager::(releaseResource) Trying to release resource 'Storage.595de2c= f-89ba-407b-aae5-d0a7a0656ba1' jsonrpc.Executor/6::DEBUG::2017-05-11 17:= 41:33,793::resourceManager::647::Storage.ResourceManager::(releaseResource)= Released resource 'Storage.595de2cf-89ba-407b-aae5-d0a7a0656ba1' (0 active= users) jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::resourceMana= ger::653::Storage.ResourceManager::(releaseResource) Resource 'Storage.595d= e2cf-89ba-407b-aae5-d0a7a0656ba1' is free, finding out if anyone is waiting= for it. jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::resourceMan= ager::661::Storage.ResourceManager::(releaseResource) No one is waiting for= resource 'Storage.595de2cf-89ba-407b-aae5-d0a7a0656ba1', Clearing records.= jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,793::task::995::Storage.= TaskManager.Task::(_decref) Task=3D`234cbec4-a422-47c1-a50a-243526aeddc7`::= ref 0 aborting False jsonrpc.Executor/6::DEBUG::2017-05-11 17:41:33,794:= :__init__::555::jsonrpc.JsonRpcServer::(_handle_request) Return 'StorageDom= ain.getStats' in bridge with {'mdasize': '134217728', 'mdathreshold': True,= 'mdavalid': True, 'diskfree': '498484641792', 'disktotal': '557943095296',= 'mdafree': '67102208'} jsonrpc.Executor/6::INFO::2017-05-11 17:41:33,79= 4::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC call StorageDo= main.getStats succeeded in 1.05 seconds JsonRpc (StompReactor)::ERROR::2= 017-05-11 17:41:33,816::betterAsyncore::113::vds.dispatcher::(recv) SSL err= or during reading data: unexpected eof Thread-112::DEBUG::2017-05-11 17:= 41:33,846::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> =3D ''= ; <rc> =3D 0 Thread-12::DEBUG::2017-05-11 17:41:34,913::check::296= ::storage.check::(_start_process) START check '/dev/595de2cf-89ba-407b-aae5= -d0a7a0656ba1/metadata' cmd=3D['/usr/bin/taskset', '--cpu-list', '0-15', '/= usr/bin/dd', 'if=3D/dev/595de2cf-89ba-407b-aae5-d0a7a0656ba1/metadata', 'of= =3D/dev/null', 'bs=3D4096', 'count=3D1', 'iflag=3Ddirect'] delay=3D0.00 = Thread-12::DEBUG::2017-05-11 17:41:34,954::asyncevent::564::storage.asyncev= ent::(reap) Process <cpopen.CPopen object at 0x1b15b90> terminated (c= ount=3D1) Thread-12::DEBUG::2017-05-11 17:41:34,954::check::327::storage= .check::(_check_completed) FINISH check '/dev/595de2cf-89ba-407b-aae5-d0a7a= 0656ba1/metadata' rc=3D0 err=3Dbytearray(b'1+0 records in\n1+0 records out\= n4096 bytes (4.1 kB) copied, 0.000537649 s, 7.6 MB/s\n') elapsed=3D0.05 = Reactor thread::INFO::2017-05-11 17:41:35,823::protocoldetector::76::Protoc= olDetector.AcceptorImpl::(handle_accept) Accepted connection from ::1:49348= Reactor thread::DEBUG::2017-05-11 17:41:35,827::protocoldetector::92::P= rotocolDetector.Detector::(__init__) Using required_size=3D11 Reactor th= read::INFO::2017-05-11 17:41:35,828::protocoldetector::128::ProtocolDetecto= r.Detector::(handle_read) Detected protocol stomp from ::1:49348 Reactor= thread::INFO::2017-05-11 17:41:35,828::stompreactor::101::Broker.StompAdap= ter::(_cmd_connect) Processing CONNECT request Reactor thread::DEBUG::20= 17-05-11 17:41:35,829::stompreactor::492::protocoldetector.StompDetector::(= handle_socket) Stomp detected from ('::1', 49348) JsonRpc (StompReactor)= ::INFO::2017-05-11 17:41:35,829::stompreactor::128::Broker.StompAdapter::(_= cmd_subscribe) Subscribe command received</div></div></body></html> ------=_Part_11446852_617310615.1494517429918--

3 2

hosted engine unattended install
by Ramachandra Reddy Ankireddypalle 11 May '17

11 May '17

Hi, I am trying to do an unattended install of hosted engine through a script. All the required parameters are being read from answer file and that works fine. Is there a way to provide passwords for the ovirt engine linux box and admin console through answer file. Thanks and Regards, Ram

3 3

help !!
by Brahim Rifahi 11 May '17

11 May '17

# sudo yum install -y ovirt-engine is not found

3 2

install ovirt-engine
by Brahim Rifahi 11 May '17

11 May '17

sudo yum install -y ovirt-engine You do not want to work

3 2

About NFS in cluster and HA
by 张余歌 11 May '17

11 May '17

--_000_CY4PR11MB16715763BED023C8191F455190ED0CY4PR11MB1671namp_ Content-Type: text/plain; charset="gb2312" Content-Transfer-Encoding: base64 TXkgZW52aXJvbm1lbnQ6DQpBIGZvciBFbmdpbmUsTkZTIHNlcnZlcg0KQiBmb3Igbm9kZTENCkMg Zm9yIG5pZGUyDQpPdmlydDMuNi43DQoNCkV2ZXJ5dGhpbmcgaXMgcmVhZHkoTGlrZSBpcG1pKS5C dXQuLi4uLi4NCjEuaG90LW1pZ3JhdGlvbiB3aGl0aW4gQiBhbmQgQw0KSSBmb3VuZCBJdCBpcyBv a2F5LGFmdGVyIG1pZ3JhdGlvbiAsQiBPciBDIFdvdWxkIGNoYW5nZSBJdHMgaG9zdG5hbWUsd2hp Y2ggY2F1c2VkIGZhaWx1cmUgbmV4dCB0aW1lIHRvIG1pZ3JhdGlvbi4oaSBEb24ndCBrbm93IHdo ZXRoZXIgZmlyZXdhbGwgd2lsbCBtYWtlIGEgYWZmZWN0LikNCg0KMi5JZiBpIGNob29zZWQgdG8g bWFpbnRhaW4gdGhlIEIgT3IgQyxpdCB3b3JrZWQgd2VsbC4NCg0KMy5JZiBpIHRyeSB0byBzaHV0 ZG93biBCICAsdGhlIHZtIGNhbm5vdCBzdGFydHVwIG9uIEMgYXV0b21hdGljYWxseSAuYW5kIGFm dGVyIEIgc3RhcnRlZCBCeSBwb3dlciBtYW5hZ2VyICxpIGZvdW5kIEl0IGNhbm5vdCBiZSBtb3Vu dCB0aGUgZGF0YWNlbnRyZSAuDQoNCldoYXQgaXMgd3Jvbmc/DQoNCkJlc3QgcmVnYXJkDQoNCg0K R2V0IE91dGxvb2sgZm9yIEFuZHJvaWQ8aHR0cHM6Ly9ha2EubXMvZ2hlaTM2Pg0KDQo= --_000_CY4PR11MB16715763BED023C8191F455190ED0CY4PR11MB1671namp_ Content-Type: text/html; charset="gb2312" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dgb2312"> </head> <body> My environment: A for Engine,NFS server B for node1 C for nide2 Ovirt3.6.7 Everything is ready(Like ipmi).But...... 1.hot-migration whitin B and C I found It is okay,after migration ,B Or C Would change Its hostname,which = caused failure next time to migration.(i Don't know whether firewall will m= ake a affect.) 2.If i choosed to maintain the B Or C,it worked well. 3.If i try to shutdown B  ,the vm cannot startup on C automatically .a= nd after B started By power manager ,i found It cannot be mount the datacen= tre . What is wrong? Best regard Get <a href=3D"https://aka.ms/ghei36">Outlook for Android</a> </body> </html> --_000_CY4PR11MB16715763BED023C8191F455190ED0CY4PR11MB1671namp_--

1 0

Re: [ovirt-users] unable to set group on volume
by Joel Diaz 11 May '17

11 May '17

I though I would try something different so I removed the key group and value virt when creating the volumes. I was able to create the volumes. I stopped the data volume. I then tried to set the volume group by issuing a "gluster volume data group virt" Still get "unable to open file '/var/lib/gluster/Virt'. Error: No such file or directory. I don't know if I should continue with the setup until I can set this value. Please let me know if I can provide some logs to identify the issue. Thanks for your help, Joel On May 10, 2017 6:57 AM, "Joel Diaz" <mrjoeldiaz(a)gmail.com> wrote: Thanks for the reply. The file is empty. I created the file by issuing a "touch /var/lib/glusterd/groups/virt" The first time I attempted to set the group volume, the error was that the file was missing. I read a bug report that advised to remove and reinstall the gluster package in order to properly recreate the file. Since that did not work, I created it manually. Thank you, Joel On Wed, May 10, 2017 at 2:12 AM, knarra <knarra(a)redhat.com> wrote: > On 05/10/2017 06:37 AM, Joel Diaz wrote: > > Hello ovirt users, > > First off all, thanks for your work. I've been using the software for a > few months and the experience has been great. > > I'm having a hard time trying to set the group on a glusterfs volume > > PLAY [master] ************************************************************ > ****** > > TASK [Sets options for volume] ****************************** > ******************* > failed: [192.168.170.141] (item={u'key': u'group', u'value': u'virt'}) => > {"failed": true, "item": {"key": "group", "value": "virt"}, "msg": > "'/var/lib/glusterd/groups/virt' file format not valid.\n"} > > From this error it looks like the virt file format is not valid? Can you > please paste the contents of this file? > > changed: [192.168.170.141] => (item={u'key': u'storage.owner-uid', > u'value': u'36'}) > changed: [192.168.170.141] => (item={u'key': u'storage.owner-gid', > u'value': u'36'}) > changed: [192.168.170.141] => (item={u'key': u'network.ping-timeout', > u'value': u'30'}) > changed: [192.168.170.141] => (item={u'key': u'performance.strict-o-direct', > u'value': u'on'}) > changed: [192.168.170.141] => (item={u'key': u'network.remote-dio', > u'value': u'off'}) > changed: [192.168.170.141] => (item={u'key': u'cluster.granular-entry-heal', > u'value': u'enable'}) > to retry, use: --limit @/tmp/tmpdTWQ8B/gluster-volume-set.retry > > PLAY RECAP ************************************************************ > ********* > 192.168.170.141 : ok=0 changed=0 unreachable=0 failed=1 > > I've tried to remove remove glusterfs, wiping the glusterfs configurations > and reinstalling the service. > > Any help would be appreciated. > > Thank you, > > Joel > > > _______________________________________________ > Users mailing listUsers@ovirt.orghttp://lists.ovirt.org/mailman/listinfo/users > > >

2 3

Glusterd Service Stopped Working After Delete Volume And Peers ID
by Khalid Jamal 11 May '17

11 May '17

2 1

Current status of ManageIQ to manage oVirt 4.1.1?
by Gianluca Cecchi 11 May '17

11 May '17

Hello, is ManageIQ able to manage oVirt version 4.1.1? >From which version of ManageIQ has been included in case? I see this link abot prblems with 4.x api and such: https://github.com/ManageIQ/manageiq/issues/7573 Thanks, Gianluca

3 7

unhappiness with ovirt engine after upgrading file server handling storage domain
by Jason Keltz 11 May '17

11 May '17

Hi. I recently upgraded my oVirt infrastructure to the latest 4.1.1.8-1.el7.centos, which went smoothly. Thanks oVirt team! This morning, I upgraded my NFS file server which manages the storage domain. I stopped ovirt engine, did a yum update to bring the server from its older CentOS 7.2 release to CentOS 7.3, rebooted it, then restarted engine. At that point, engine was unhappy because our 4 virtualization hosts had a total of 30 VMs all waiting to reconnect to storage. The status of all the VMs went to unknown in engine. It took almost 2 hours before everything was completely normal again. It seems that the hosts were available long before engine updated status. I'm assuming it's better to restart engine when I know that NFS has resumed on all the 30 virtalized hosts. However, it's hard to know when that's happened, without trying to connect manually to all the hosts. Is there a way to warn engine that you're about to mess with the storage domain, and you don't want it to do anything drastic? Sort of like a "maintenance mode" for storage? I would hate for it to start trying to power off hosts via power management or migrate hosts when it just needs to wait a bit... Thanks! Jason.

3 2

Renaming VM needs restart?
by nicolas＠devels.es 11 May '17

11 May '17

--=_c2ba53d929d9e1da449915d6c86f4971 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=UTF-8; format=flowed Hi, We're using oVirt 4.1.1.8-1. I just edited a powered on VM to rename it and a popup was shown stating that a restart is required. Is that new, or is it a bug? I remember not having to do so in prior versions. I'm attaching a snapshot. Thanks. Regards. --=_c2ba53d929d9e1da449915d6c86f4971 Content-Transfer-Encoding: base64 Content-Type: image/png; name="Captura de pantalla de 2017-05-11 09-14-47.png" Content-Disposition: attachment; filename="Captura de pantalla de 2017-05-11 09-14-47.png"; size=12217 iVBORw0KGgoAAAANSUhEUgAAAY0AAAGfCAIAAAAs2xkWAAAAA3NCSVQICAjb4U/gAAAAGXRFWHRT b2Z0d2FyZQBnbm9tZS1zY3JlZW5zaG907wO/PgAAIABJREFUeJzt3X9cU2eeL/DvKeSHSccc7SsS oWtiX0YwdyzpVkakTkPn4oK6t2F2vAvaGcGpO0DvVGhtK96deqmdLTirFbW70K5Wqx2hu50V26nQ K61k2hEddAyd2QCNtwSnQJiMctCGBEI5948TkB8JohZ9bD/vl682OTnnOU+ec/LJc54TzuFeeeWV /v7+Tz/9tLu7mwAAbp8ZM2bMnz9fLpePmR75xRdfNDU1+f3+4PPIyMzMzISEhJkzZ0ZGRt7yegLA N8XAwMClS5caGhoqKysHBgaIqLu7u7GxccGCBXfffffIObnHHntMmoOIfvKTnzz88MOIJwC4lQYG Bn7zm9+89tpr0tPIyMiFCxeOjCouIyODiDQazS9+8QuNRjP8whdffNHS0tLY2FhfX3/lypVbXG8A +Lr61re+tWTJkvj4+NjY2JFh1NPT89xzz/X09BCRQqEwm83DB4BcRkYGz/N79uyRyWREJIpia2vr li1bhjtZAABTJDIycuvWrXPnzuU4jogCgcCTTz4pCAIRzZgx49vf/rY0W8S3v/3t3bt3q1QqIurr 69u7d+++ffsGBwdvY9UB4BticHDwgw8+uHjx4sKFCyMjIyMiIh5++OF3332XiPx+v0ajUSqVRBSx e/fuuLg4Iurr63vxxRd///vf3+aKA8A3jMvl+uMf//jQQw9FRkYqFIqZM2eePXuWiHw+n06nI6K7 Hn74YSISRXH//v3nz5+/zfUFgG+k8+fP79+/XxRFIho+m3flyhWfz0dEd0nPW1tb6+rqbms9AeAb ra6urrW1lYgiIyNTU1OliX/5y1+IiBNFURTFH/3oRxg4B4CvysyZM++5557p06er1Woi8nq9ly9f vnjx4qVLlyZYKjIy8tChQxzHtbe3b9y4kYjUavXcuXMjpSKuEVKqJS++nm8cOcXrOllRtre2rfdm 345s3uN7fr6Mbz/89MZqerTk5TUxwvGfPbnvfOCmiyRn2ZPP2zzBiZolW17NN5FwvOglzz/8YoK1 qOZZUmKc1baO66/B1fdS+M6IxWXRq19+2aolImp/48mN1R4iUsVv3LM5QU1E/fbtuSVnrq8dw6yI iFRLSl7PN9xImZMz1eXDnU+pVN57770xMTGtra1Op7O3t5eIVCoVz/MLFy5sb2///PPPh39YPsbA wIDX67377rtnzpwpTZHL5fPnz7+LiFpaWiZZg36vIAjefiJSG5LWb1kfr/oK3tawAAV6vf393puI KKmctvpGgYiMFtPw78FURss8IhIabP9vYIK1aJZsfPnneStM/E1WIRxtwjwNEZFMG29QT80qer39 /T29N9uGADdEqVTed999gUDg448/vnDhwuXLlwcGBgYGBi5fvnzhwoWPP/44EAjcd9990lm8kKQ4 UigU0tMrV64oFIpIIjp58uTk6tB+sHBjrYdIpn/0xW1rDOpFy02qxq/wa7Wj+vnHq7+CcgJOW6Ng sfDzLCaNrb6HiFQmi0lOJDTWtwU6zodfi1obzRMJX0EdQpPrE2Jk9T0B3mjSTskKeuu3Pl4/JSUD TMK9997r9Xrb2tpCvvrll1+2tbXp9fp777033Fm7kydPPvjgg9LPqYhIFMWIiIhIImpsbLy+ugQ6 zpxsX2OIkfNqGRGp5i3Py1uVEKOmfsFZX7F3r60tQBpLyat5Bo/tsF27zGLSyvs99rd37X7nfC8R yaKXrM3LWmbkSXDabMOpIIu+etznSZpgce2itRvWS4sfP+o0Za2IaT/89MZ3Oq5W0Glr9Fos6nkW o6r+TC+pjElSTNmcgZFr6V2+4+U1MR6bTVhkMcounP6TbnEMEfGWLYfij//s6dqEbdusWs+xnz19 8HxApl/98jarVjj2sycPng9o4lfnr19u0sqJyOux1+4tq2jsmbjVvC6P2qA1xkfLHB79omgiwenh jUNxJdMuWbshy2Lk5UTkbW94u6ys+nwvEalMj+attSYY1ET9Hnv1yBXJtYvWv7jCIjXE3u37zvSM Oi6TTbAJNPGr89YvN2vl1O9x1B4uq6j3jO2CyaKXrF2/xmLSyokEl+3tsr21bUPzyKOtG/csT9DK +9sbKnbvrm4LEKnmPZqXZ02IURNRv8dpO7z7YL2HpGPe9mOHzxtXWIw8edtPVuwoq+0IEJEs2rJ+ w1qLQd3vcdQe8yRlWXjnrh8/X98bpnqaRWvzs1KCjd7ecHRf2TsOHHwyZObMmTExMR9//LH0dOXK le+9997wq8NPP//886VLl166dCnkWFXIOLqLiL744ovrq45Kvygphoj6PUKAtJZntmQlxMjaHXZn j8poyducd/VwUGtZY+6319qcXrnWvCYvJVpGJNOv2pi/zMiT4HJ4+CXWhPAHWWEWL3xGCimHh7dk rYgJsWDAaWv0EslNFpOKSGZIMqmDMRVyLRZ9b7vH4/qjwyENZwkuR+P5CT4BmkV5G60mLbU77HaX V601W9db58mu0Wq9HfZ2Im28kVcZEgxy8rqcQv/VOmzIX2bkAy673dHer45JyMqzRBPJolM2F65J MKgFl9PlkWvN1o3PpAz3xLTL1sTLXA6Xl3jjsrwsU8ij8BBtKNM/unmz1awNuBx2Z6/WtCJ/y+qx 1VeZ1m/JX2bSksfpbPfyBsv6zeuHVyA3rVke7XE4PSSPScjKS4kmkpmynlmTEKP2OOx2pyDXGpet X321QjErVs0TGo6ddPWrY5LWr0/SEJHMtHZznsWg7vc4zwvaFVmWof0gTPU0S/I3rDBpPXabzWZv l8UkrNn4FQ88wE265557Wltbv/zySyJauXLljBkzVq5cKb008umXX37Z2tp6zz33hCwkZBxd158c x6wtKV8VkKl4tZyISKivdgb01kdNchKOlzx/0BlQxee9/EzSIqtJ1eiUFvEcLd5R0RGI9sx7OStG a9TKyBOdYokh8jZs37TjTI9s3tqXf74i7DHQDS8ecNU2epOS1CaLUdXoXRLPE3mlmAoRJ55jW58+ eD5ARNHT/tq8JkZoPFhc5gjI9OGqFfDUVhxtCzQcrT3fq1qypTzfpDHwMgrd1x3mPe8QlsVEL5oX 7TDxRM4zHQHT0Gv9rmNvHDX02t62dQS0KSV71ht4Ay+TyVKsRjl5T25/eveZXlX848+s0npkquG3 4Nz7/PO1HlX8xvLNCWq9nidHiEPWcW0o41esMBC1H966tbojwCdt3pFnsqwwVux2XE1xTfyqJTxR ++HCwnc6KDplQ14SeVXDQ2rC8ZLCfY5A9KM7Xl4TE23Sqqo9wsm3Dwuq88fecfSoTBv2bElSR2uv trXzYMmOWo9snsz082V89DytzBYwLU/SEgnHtz6973xAFZ/38mYpqWTGkNV7+6hRKyfyehwNx2yN nuPx8WrhvBPdKZZMnz7d6Qx+8t97772R2TRjxozu7u7h7pUgCEajMWxB41zfpRHkal76u8B+j9P2 dtlBR69skV5LRPyyLa8vG55Na9TKpNr2tzuFABEJQi8RkUxGJNMaeCLqOOnoIaJA2xmnd4U2zJjy RIs7g4s7hBWWED2yXpdtKKiMHvPVmAq1FlfjdZ7c621rPKlWr1iWtyXPOC9GapNrdaeIAp5GV/8y syHJwmuJ2htcXvPwaz3nzzSq1SnWjS/OMxhjpM+rTCaLNmiJqKPR2UtEvY37tkpdYtk8IiLyOJwC EQW8Qi+RXM7LQtVhfBuqtHqeiGLWbHt9zdBc8mitimj4yFWmNWrlRILD4QkQUUftjudriYhINY+I qL+j0RUgIsEzvF0CHY0nHaoUy/otaw3zDFo5Eclkw1cREjo6BCIK9Hq8RLxMLidSR0erifqdZzoC RNTrbHD1W8xyIlJFh6yerONkQ/uKFTHmNc+Y15DX42w8/vZ5xzUbHW4htVotnd2TSFFlMpmIyOFw jDwG7O3tlX6vMEnXlVPte5/cWOsZNUlGciIiz7FdexuHK+jt6AiQgYiIAuEDYOhDNVFEhF/86oW0 wgREr9Pm8CYlqOOty3u1RN7GWleYwgK9E9RS+hSO/D+RTJuyecd6k5w8zoaGWocxZZlh7HW9Qurv ONNBZkPCMp5IOH++JzCcU8EzE9TvcZxpOHrebLVopYaRjXqHMpUsMOJU3vBJywlTdtybC9bVdXR7 xXAPKuB1heqaDP25ukylot6Rax43p2bRhm3PJPEkuOyNtce1lmUm9chq9feHrguNz9Zw1Qv0HHx+ k9O6Ytmi+HkxvNaYtGazkf9ZsCMMX2933eTyAY+zh4g00eRqbGx0qZKs1pRFhon6FgGP00NE0QkG FRHJtPPmXdcJ+oDHJRCRfolZS0QqkyU+3OK9zlqHl0htStASeRttIT+IRKM/5QGi4VwIBLz9RKSS zhbwMYahXznw8SkmOXkbijc9v2PfUUfvpEKKiAKCMzgARv0ddpd3+AVZtGWZQToG2rp7X61rKAYC HVJbLTFpiEizaMOeQ5X7tqTc5KlCoaPNS0Q83+tsbHR4tCnW5ZZF2lFvIuBxevqJeNMivTQk+OLr hyr3PG4Ku2FVxhVJPJGzbFNhSdnbZyZxxtTb0eElkhuSjCoi0sRbjPIJqyfTW1ZnWRPItn1j7tof bXrDRURaYwwGqBji9XqlKxpIpOM+h8PhcDhGjlURkUql8nq9ocoYKxAIPPXUUzd7SbxAh+2Yc3mW 0Zy/7UVLB28yaeXe/uMT/QQq0FZ73LVijSFpwxY606GNTwo1Dj7h4sdcy9YYzHk79jzao4oJd8hI waBKSFCTdNA3maEMb28vEaktG0qiT5ZtfbutzUsx6oQNW7Y4Kdo83GnyCkI/kdq03JoSLUtaZSIi UsmvfeBHAU+jSzrK9TS09VL08PTeDi+Rljdbl6c4YiyrY0jqwgSctcecK7KM5vw9e1Z5VDExaiJn g0Ogm/p0BpzHa9st1hhL4TatQ4g2G3kSPO+M3mY9jUfrBZNFu+Lne+LbA9oYLZHgqHcFKD5Mmb0e L5Fan7JquazXZE1SExGpQh6IBvU6qk96EpZpkzbv0bf3amOGgzJc9QKqeEuSgRZFR9e3BbQmAxG1 N4T98oHb4PLlyzzPX758mYZCanhManisSno6PNs1yWSy1d/+1s32pyjQUb295HBDu5c3mk3aQHvD G8W76yc8Qx/oeGfH9mNOQW1IssTLHIePtV/fCtuqd+yyubwk12qp7dgbDV6iMAeIvU6bo5+IyOuY XExRj/3ocVc/Ea/l1XJZb2NF2XGXl9QGkyHQsPcN51C5jQf3nXR51Wbr+tUJdMbmIiJtvGES4dHr OtNBRCQ4nKOOnz22sjcaPP3ahDXrV83z2k56iOQxJq0s0FG9fevhhnavXBsTo/Z67EeLt1ffwC/l Rwucf7tk+zGHh7Qms5EXXLayrXvHnuDvbdy7tczmFPr5mBgtCU7b3uJx84ws0nG47LhTkBuXZa21 8M7jzn4irVk/UZMEHAe37z3Z7iV1jLa/8fBhRz9J/dnQ1Qt0VBcXH25oDxgSLJYkk8rjOLa9pLoN B30MuXjx4ty5cyMiIojovffeGzlwPvJpRETE3LlzL168OKlCBweO/Pk7nCiKmZmZU1bzr57GtNwa L/O4Gm31bb2kWlRY/oxZ7tj14631+Gq9k8i0i5YvN1KH84ztTEeANJYXX80zek8WP7m7ERvyzjVv 3rxAIBDud54SvV4vk8kmuDpLZWWlKIqrV68mIhocVFhW33mXQg+oTBZrgppWpSxr9FC0ySQncp6c 6NdOwKIAqRNWWI1E1hS7Q1AbzEaifsdJHMjd2T7//PP77rtPr9d//vnn0g+pRoqIiLj33nvVavVn n302yQIHuYj/rpfd9HHfLdd7Zu/uo/Z2rzzGlGA2xQQ8jmPbd9s8114Q2OI5uXvXcYfHqzaYE8xG rbfdfrRk75lr/KgfGOf3+z/77DOZTLZ06dI5c+ZMnz49MjIyMjJy+vTpc+bMWbp0qUwm++yzz8L9 HfJ4XMRdM6XrutxZx30AwL4bu66LZORxHxcR8djqO/C4DwDYF+7P966X9OfId95xHwB8cyCnAODO gJwCANYhpwCAdZFEVFlZeburAQAQFvpTAMC64O8SzrW4bms1AACIiB6INYyfGDnxywAAt0y4DhOO +wCAXaIo2u125BQAMG3GjBnIKQBgHXIKAFj39copv6v5Ru9lLLhck73SxB1GcLmm7gbPX0fXvxf5 3c3ur+new4iJc8rvqipMN+uUHMdxSkNidukpaQP6T2XzHKcrsDO0cYS6wmSdueCUn4j8Nckcx8WV uia3qOtAZpwurXKSc98U94FEjuMSD7hvbEE+vebqR8hVnshxnC73vX8LW6a7KtdsSCxqvv7t1FwS x3HKtJpRS0rbneM4LrlSWpvfnquTplzvewq3jfw1aRzHxZU0X3eVvwoj96LJ8dtL0wyG7Bp8F0yl CXLK31yeFvf9bUcbyZxqTV3Mt51+46klyYUsZdNI7lNVtp4busqav7nyrZa+r7o+oSkNydZUa7JB eb0L6tIKLEQ9NeWnhj4Qrpry00T6zNwHjeHK9Luqqq51O/kbc+qAXZAqUdf1FRetS85ItabFhb9L 9lS6/r1IsFe+33WL9p5vrvA55a4pKLD1KSxlTa5TNVU1p1xNOxdrNP7muqvHR66awmQDx3HKuPRS Kb6EupL0OOkrV2lILqhx09CXcFxuSXaijuM4pSGtZKhb1nwgO5HnOI43Z5cWmjlOmVnnH5qu4ziO 482ZQ304d11h2tiih/nr0s2bW4jo/eXTDEPdPL+9UiqGN2cfkLoUfldlbqLUP+R4c2a53U/NJebl 7xNRy+YFXHLlyG/F5pI4jtOlZacZlByfVukmd11JWpwyWIGqoXZw1xQmG5QcpzSkl5SmKTkusVIg v73AwHH80PspNHCcMr3OT35X3dH3j9a5/MEekjIxOz1OySkTS5tJOFWaaeY5juN0iUMVvkqXVpCq oL6a0jqpjq6q8kai2NxcM4Up86/XJi55o4uo640l08ylLlepmeO45CqBiMhdbua44Pv128uD6+WU usTcymsdACv0Guo7VWn3E7nqKltIE6sZfi3UDiC1UXDjKePSCkdsuxDbyF331vtHa5oFouZCA8cZ Mktykw1KjuN0w+X5XVUF0jR+dHFhNlzI+a82N6c0JOZWuvzj9qJQLeM/lavjOENmdrKO4/Qpj8av O01Ep9fNVqbX+aUXddnX0R+DSRFFURTF3ze3iqP5TlgVRIrU6m5xPF99loaIKCo1v7g4Z7GCiBaX tYq+E1kaIsXinJ07izNiiSgq55xveObYrLIjR3amaogofmerKPrO5euJSGPJKS7OsWiIiBQZJ3xi 94msKCKKzdhUnJ8aRaRIregUfScyNET6jJ0VR/YXp2qI9DknfCNq1Hlkk0VDRPqs4v313b5qCxER 6a2bdhZnxRKRIvVItyi2li0OTt2Zb9EQkaWis/vc/iypHvk7j7SOLLOpOJaISLE4Kz8nv6Kzdedi abbi4qx4IorddM43VCTprfmb8q3Sjd4XV3QH35wm44RPFEVf0yY9kcJ6wid27l9MRIv3d4rBh0Sx Gfn5+WVNrRWpCiLF4qxgi0ZlnRjT9N3V1mCdRVFs3Rk/1JDhytz93sH8eCKi+JydFee6pSUsR7pF URQ7y+KJyFLRLfrObdITUXxW8U5pxQrrCV/wzStSq0c2SHBT6jOyYon0+ed8nRUWIo01f2j9oXcA sak4XtrQmzZlLVYQKSz7O8Vw28hXnUpEscVNoti0SU9EpM/YeaS6LENP0kpF37lNsVKTF2+y6olo 8c7Re++YDRdyfulta6zFFUcqdmboiaKsRzrH7EUhW8ZXnxNF0tvJz9n0q3d3WqOIKMq6qay6U/Q1 FVtiYy3F50Y1G0zacBANDg5mZGRkZGSsXr36lVdeCZtT3RWLiSgqpz5Ui0v7q7RfBSMkOGd3a1Nr d3dn04myjKjgfh6c2Vo9embpkxwsQ+yutiqknJIe6fPP+URR7K5OVRAtruj0nchQEJE+NWtT2ZET TSHCU9o5pQ+W9BmIypKqdMQytOOLoq+ztbXT191af2RT/NDUEZ+MECUOTZeeBT/mTcWx0ruQgmGo cGnHvq6cGmph6Vl8WevwE4W1ekzbS41Hlv2dvtadscEvhxA5NbzVfPVZUcPtECanRFH0dTa1dvs6 m+orcvRDJU2UU/kV+Xqi2OL6I1YFKVL377cMLRVqB5BaZXhD1x+pqD7X6gu7jcbllFTw0O5S7ZOC Yqhp67Oixm270Rsu9PzBb8koS8amsooT5zp94/ei0C0TzKng2x3V+nDTwuVU2OM+Ja9TEAku4WoP VrDX1I08E8IbdEppViUR+YlIOHWgMNM8Y8bsBWlFNV1EIw7beR0/dmaXm4g3SMMqvCHOIM3od7v6 iNp2PTCN47gZy9/vI3KfclNyaWW+Jart/Te25X3/kQUzdMkl1xwo4+N4JREplUrF0CRXTUl2smHa jLlLsg9McqBWF6cjIvILzW4isn1/Bsdx3ILNLURdzW6/0CwQkc6sIyJSGqT/jzPBRet1ZqkRpeIb 8+ZyHMfNXneaqM/lGnNAo0wsyIwispVXnaosbyGy5KYbJipzAiMq5G+uLMxOnDFt9oIlBVUT3c7o aj0M6clR1HKgtLSuj8yZiVeHkkLuAIJLuLqz8InpmWnm4bG0ENtoDIXOwBORUqlTDpXX3EXU89Yj 0ziOm7bkjS4itz3E6bbghgszP5mLDmxK1XfZ3tqWt/qRB2bziQV1Y4fCJ2gZjcFwewbQvqHC55Q5 M5Gor66kMjhQ4j9VlL78kQVxuVePvZWjPw1+e0nmU281m3fWd/r8p4piiUbue8qxHx3eoCPqapaS T2i2u4Lz6XQKIn1OdVNra2tTfXX1iXN1RWal4DekF9V0djadqNiZE6/oshUVjtuvxr2HMasUqnIz d9ko+0irT3RXpoX7ZIyiUCqD+RqnIyJL2bnW1tamcyeqq+ubKtN4Po4nab8nIn9znWt0iwQDSnCH rWqweJKKjy+ub2ptbW06UV194lxVpmHszObcTD3R6cLskhZSpBakh45F5bi2liYTEfkFPxEF85WI yHUgc90bp3WbTnT6xObSxeHqObqkuEyzglresvVQbPrVmAqzA/AGnqirWfp1hLsyNzO74OroW+iq Tog3RBFprBXSlqiuPlF/qjRxXDGK4VYIPb8g8GmFla2dTfVHyvItmr7TuwqrRn8vTNQy0tct3Crh x9F16aXFi6nPlrcgLjEtPc1sWLKrjRSWosLxu8QwPxH1+f1+t/1AUWmL9DjcvMq47HQ9kS07LbMg Nz0x8/1g54tPLEjXUNuBwpLKmsqS7OXLH0kvafa7a3ITH3kkMb2kzi193kgXN7rTIO05p0pyC8P+ wMDv9/cR+f1+obmmtKimj8gv+P1ESl5D1HKgMLf0VPjoi0vPjieyFRWWV9WUF6YvX56cWyOQLi3X oqCWzenpBYW5aWmvDp38UuoSDUR9RwtzS0oLM7PfuuYpJKmgxpLC0qqaysLs5csfya4cf6Jfac7N jCXqaeshRVpB8jW/0pW8kqirrqigpMatMxgURKeLCkpKS7Izy4f7B/5g07ibq4pKTtPVdJ0Ab840 ExFRVFrayPOMoXYApTk7N57Ilp2cnpubmZb96luVdrqJj7kU1j1Hi0rKa6pKc9OXP5JWNFHfOvT8 wqnC5EceWZJeWOPyS4GmMRj40XvRpFpGWsJeXlBQ3uz3N5ckx8VNoq8P12nMYeFovqaK/NTg2RyN 3pKz/9zwuIeGKEoaQ5IO2KOy6n1iZ3X+YmmQMd6alaqRhpnCzSyKvqb9WfEaIoqy5BRnjRjPOVeW JZVDUYuz9jf5RFEUu0/szIiXJir0w1NHaN0vjWPH5tR3V1uIKFYaXvVVpyqGxj7OlVljFUSk0Fuy MmIpOCjdfSJ/sYaINKn7RzbDuCGazupNwdZQxKYWnxgaoKjOt0QRkSLWmp8TS9L4lCj6moLrirLk lxXHhxufGjGw0X1ipzVeKl5vyT8ScosMDTMNNZUohhifulqm71yxVLfFxU0+sbUi2NyLs3butCiC 41Pd9cWpeiIiTWxqlnVoK0w0PrXpXPB1aVZpcElaf6gdYKjlFMGVSC3nC7eNxoxPScP6Y8YfWyty LHqpvPiMnfVjhivH1T3k/L5zZVmLpYkUNTx1xF7kC9kywT346sBt55EsaTtnVHeP2r3h+oUbn+JE USSicy2uW35dF39zVaWdDObk5Die/PZcwwOvUs45V7n5zu1Ruw8kzl53enFF96lMjF4AXLfhIBKH 7t931113PfTQQ7fz/n3uqoLVb/QoLPkl6brmygNdpLGmX/8PIAHg6+425pQyubSqWCgoPbrrKRuR JtZaXH4gDd0QABiF47jbej9kPrmwyl54O2vwFdNlnxKzb3clAL5GOI6bPXv21+t6CQDwdYScAgDW IacAgHXIKQBgHXIKAFiHnAIA1iGnAIB1yCkAYB1yCgBYh5wCANYxn1PNJWZdWkF2cpxBx/NXr+Qv nCrNTBy6YVeydMk8f00aH5dbkG42GHilLrGgqqY002zQ8Upd8tCdI9w1hUN3Yghx/X8AYNJtyKmq qqoHHnhg7ty5VVVVk5nf3/X+qbhSu8st2Iv85bkldj/5TxVmFrozawRRFLtr0t3bcsulqwj7W6rc 2TUul/tUtnvX93Obs+tcbvepbHdRQZWbqLk0Lf0AX2j3ib7mUkNlevpkb/AHALfTbcipgoICu93u crleeOGFSS2gWJybbVYSkSE52eBudhMpzUV1zVUFZqVfcLtJxyuGr+MelVaQpiNSxiXHKfTpuck8 kTIu2aAU3AI1HyhvNpeUZscpSWlILypJtJdX3p67WQLA9bid10uQLtE3CUrd0OVe+KE7ELjrinKL Kk+7+VizWefuG7ovgXS1/+DjMddw08vLAAAPQElEQVTe9rtd7r7T62Zz64YnRRkEf/C64QDArNvQ nyotLY2Pj9fr9UVFRTdYRHNR5rpTiQfcot/dfKqyMG7U/SLCLsXreE3w7kyiKIrdrU32ENf/BwDW 3IacSk9Pl4770tPTb6wEvyAIpDTolER+d11J4fsT3S9imDIuO1NXV1hY1ewnEk6Vpscl5l7zljUA cPsxf74vFGViUXmOsmTBNE6pMxe60rJi/S7XtRNHaS6pqUxzFZincdyMtHK+qOZAOq4fCsC+23gf BwCAUcbfxyEiImLVqlV3ZH8KAL5RkFMAwDrkFACwDjkFAKxDTgEA65BTAMAuURQ7OzuRUwDANFEU kVMAwDrkFACwDjkFAKxDTgEA65BTAMA65BQAsA45BQCsQ04BAOuQUwDAOuQUALAOOQUArENOAQDr kFMAwDrkFACwDjkFAEy7ePEicgoA2MVx3P3334+cAgCmcRyHnAIApg0ODiKnAIB1yCkAYB1yCgBY h5wCAKbhfjMAcAdATgEA09CfAoA7AHIKAFiHnAIA1iGnAIBpGJ8CgDsAcgoAmIb+FADcAZBTAMA0 9KcA4A6AnAIA1iGnAIB1yCkAYBrGpwDgDoCcAgCmoT8FAHcA5BQAsEsUxU8//RQ5BQBMk8vlyCkA YFpkZCRyCgCYhpwCANYhpwCAdRzHIacAgHXIKQBgHXIKAFiHnAIA1iGnAIB1yCkAYB1yCgBYh5wC ANYhpwCAdcgpAGAdcgoAmIa/mwEApnEcN3v2bOQUALAOOQUArENOAQDrkFMAwDrkFACwDjkFAKxD TgEA65BTAMA65BQAsA45BQCsQ04BAOuQUwDAOuQUALAOOQUArENOAQDrkFMAwDrkFACwDjkFAKxD TgEA65BTAMA65BQAsA45BQCsQ04BAOuQUwDALlEUOzs7kVMAwDRRFJFTAMA65BQAsA45BQCsQ04B AOuQUwDAOuQUALAOOQUArENOAQDrkFMAwDrkFACwDjkFAKxDTgEA65BTAMA65BQAsA45BQBMu3jx InIKANjFcdz999+PnAIApnEch5wCAKYNDg4ipwCAdcgpAGAdcgoAWIecAgCm4X4zAHAHQE4BANPQ nwKAOwByCgBYh5wCANYhpwCAaRifAoA7AHIKAJiG/hQA3AGQUwDANPSnAOAOgJwCANYhpwCAdcgp AGAaxqcA4A6AnAIApqE/BQB3AOQUALBLFMVPP/0UOQUATJPL5cgpAGBaZGQkcgoAmIacAgDWIacA gHUcxyGnAIB1yCkAYB1yCgBYh5wCANYhpwCAdcgpAGAdcgoAWIecAgDWIacAgHXIKQBgHXIKAFiH nAIA1iGnAIBdHMfp9XrkFACwDjkFAKxDTgEA65BTAMA65BQAsA45BQCsQ04BAOuQUwDAOuQUALAO OQUArENOAQDrkFMAwDrkFACwDjkFAKxDTgEAu0RRtNvtyCkAYBfHcfPnz0dOAQDTFAoFcgoAmBYR EYGcAgDWIacAgHXIKQBgHXIKAFiHnAIA1iGnAIB1yCkAYB1yCgBYh5wCANYhpwCAdcgpAGAdcgoA WIecAgDWIacAgHXIKQBgHXIKAFiHnAIA1iGnAIB1yCkAYB1yCgBYh5wCANYhpwCAXbjPKACwjuM4 s9mMnAIA1iGnAIB1yCkAYB1yCgBYh5wCANYhpwCAdcgpAGAdcgoAWIecAgDWIacAgHXIKQBgHXIK AFiHnAIA1iGnAIB1yCkAYB1yCgBYh5wCANYhpwCAdcgpAGCXKIoXLlxATgEAuziOmz17NnIKAFiH nAIA1iGnAIB1yCkAYB1yCgBYh5wCANYhpwCAdcgpAGBa38UW5BQAsEz8rz90IacAgGXcXz+8FDkF AGy76y7kFACwDjkFAExzu7uRUwDAMvFzxx+QUwDAMm5hfBRyCgCYprgnFjkFAKxDTgEA65BTAMA6 5BQAsA45BQCsQ04BAOuQUwDAOuQUALBLFMXOzk7kFACwi+O4OXPmIKcAgHXIKQBgHXIKAFiHnAIA 1iGnAIB1yCkAYB1yCgBYh5wCANYhpwCAdcgpAGAdcgoAWIecAgDWIacAgHXIKQBgHXIKANgliqLd bkdOAQC7OI6bP38+cgoAmKZQKJBTAMC0iIgI5BQAsA45BQCsQ04BAOuQUwDAOuQUALAOOQUArENO AQDrkFMAwDrkFACwDjkFAKxDTgEA65BTAMA65BQAsA45BQCsQ04BAOuQUwDAOuQUALAOOQUArENO AQDrkFMAwDrkFACwDjkFAOzCfUYBgHUcx5nNZuQUALAOOQUArENOAQDrkFMAwDrkFACwDjkFAKxD TgEA65BTAMA65BQAsA45BQCsQ04BAOuQUwDAOuQUALAOOQUArENOAQC7cP0pAGAdx3Hz589HTgEA 0xQKBXIKAJgWERGBnAIA1iGnAIB1yCkAYB1yCgBYh5wCANYhpwCAdcgpAGAdcgoAWIecAgDWIacA gHXIKQBgHXIKAFiHnAIA1iGnAIB1yCkAYB1yCgBYh5wCANYhpwCAdcgpAGAdcgoAWBc5/Ohci+v2 VQMAIKxgTj0Qa7it1QAACAH3GQUA1nEcZzabkVMAwDrkFACwDjkFAKxDTgEA6yKvPQsA3ISzZ89O XeEPPvjgrVzdzRtf4clATgFMobNnzz744IP9/YGpKNzj+cuhQ4d+9KMf3ZrV3bzxFZ4k5BTA1BKJ RHFqSg5V7tSt7uaFrPBkIKcAppgoTlFyhP7YT9nqbh5yCoBVojg4VTl1S1d38264XjjfBzC1RBrq 44z+57btXmuZP0OlVKk0cxf/z+f/vdkffKl5u1mTuMc1NKfvd9uXzZjxnWdt3WNKEAdDH/eFXJ2/ +d+fX/tw3AylSqWcEbfsyUN2IdRsX8m/tn/7zgzLQfe46SErPBnIKYApJ4775/qPv39g+Q7huz+v +X3rZw7bqz/UvJtjtjx/2icFzdU5hdPPp6buoH+sef8XD/NjywnTPxm/Ot8n2y1L/uE3mvWv1rd+ 9llzzT/G/i7HYn2lZfycX9W/0DW50Q4Vcgpgag2KJA6Ko/5dev/5/P97f1ld1QurEoxRs/7q/pQn XvuwYlXXyxv2NovioChKn+nB7t88m5r2pmbbh0efXqQZW0iYo7sQqxt0Hdrw8wt/+9aR0h9+1xg1 SzsnYc3uyrL/ofyk0TUoioOud5599IHoaWr1NHX04rUHm32Dotj8z4lzH332J3/zwAJDdLQh7dn3 3YOiOCi6bf+ckahTq6fNnPs3z77jEgdFsdf1H8/+zYKZ09Rq3QN//8+nLw3Vn8bV9iYOR5FTAFNM HHv84/vDm7X+7zzxt3NGTtR8d+OqOZ+8+ZFLDHZH3O/mJy//V8UL1ZWPz1eEPL6ikIdR41YnCqff blAuffy7mhET5/zwjWPlq+aQ6H7zJ9m/nlVy1nvlysWzJbNqC579jSCKRP4/H2+Y/4vf/tdnn//2 f/v3bdjxiU/sOpS1+hXx8Zo/Xbn4X7vmvJ39k0NdvtP/JzXn+PxtZy9e+dOJp+iV76/7d7dUN6LJ VngSkFMAU0sUx3YrfN1dPco5s+Sjp8tnGTXU0yL4BkWR+v5QnJ5dG7VQ0fDLd1t84zsmwe5JqPGp casTu4Ue0sz5VuhCZq04cKZ2V4pW9HW6BUWUhnq6fKI4KJIi4cerFyoGRfGvli6d0/WpW3T/Zm/D rP/1wrqFmkHFrBXbjtWWpsga973d9d2SF1b+lUKcPv+x4o2zPvqX453D/cFJVXgycL4PYGqJojhm XEahmaXxd7n9oqgYMdXv/rSHNMbpCrGPiGjOj3/1660LG7ITVmVuWvTb0qV8qJIntTrSRGkUPV09 o6f7u9p6NPooJfkb9z2xaf8HTpqzcKFR2dNHQwUoZk0PLqEh8oui0CZQ1Bzt0DTjQg31/PrCn/s+ /sG906+Wa2wRfA+JQxWZRIUnJorihQsX0J8CmGLi2OFkxcLHlio/KnuvbeRE4cy//uqC8e+W6kUi kRQL1zy+VEOalNLX19H+x3Lf7goxVh16wGfc6kRNwpqF/g9e/0gYMbHtP7MTvpN9vEf49RPr9tPT x91X2j45+evipbMUUhnB/44cF58exVPXha7glK7jO7f88s/TZmlm/d2vPYJwRRCuCMKfPvmkunC+ ksYtPlGFJ8Rx3OzZs5FTAFMrxIHYt1Je+qfvfvLEijUvv/uJyy10tnz0Zv7KH/xSk1u+bl5wvHlo Zs1D/3S4YNZ7T/z4X1p6x5UT8vfoIQ64Zn3/n56Y9Z+rf1D45kfNbndny0f7cn7wRMPC51546Ft+ n9+vmK6ZLhfF7sZfFv3S2ef3+YI/IBg5/i2K4qxHfryo619K3mzxDfrc77701M4GUZa07vvK9wpf Ot7pEwfdHxWuSEjZ0tAbrFeI4z6c7wNg0/j+DZE4Z82vfvdOnuaDwr81Gw0LHnq8vGvpjo+Ov7RI c7X7MjSzcuGmQ8ULf1v4w22/84c++3/t1SkTio6/X2L8Q/Fjica4BYtWlV5Y+krtu3lGJc1a+VLR ojPr4mZqdfHr/nPODx6a3nWmy3e1sJH1iVqz780nenY9NHvmrO9sbfvBvtfXzFEsfelXLy/66Gnz rBkzjY9/vPCl/9i5VDm+NzZRhSeDu+GEA4BrOnv27IIF/83v75uKwj2ei7/73W/H/B3y1K3u5o2v cDiiKK5evZqIIiIiVq1ahXF0gKl247/DvmbBt3R1N2/SvaLh/hPHcYTzfQBTTRy8pX8XfItXN0X6 +oJdwunTpxNyCmCqiTc3NDNhybd0dTdv8tW6dOmS9CAyMpKQUwBTTRRv5Hz8ZIu+lau7eZOu2Icf fig90Ol0RMQFAgEpsQBgKhw6dGjqCh8/Jj2lq7t5kxlEHxgYyM7OHhgYIKKVK1fefffd3AcffPC9 731v6qsHADApH3744WuvvUZE99xzT0pKChHd9dprr12+fPl2VwwAgIjo8uXLUkgR0f333y89uIuI nnvuuUCA0Qu/A8A3RyAQeO6556THs2fPnjVrlvT4LiISBOGnP/1pT0/PbasdAHzj9fT0/PSnPxUE gYjUanVCQsLwS3fJIjhpjpycnA8//FAauwIAuGUGBgY+/PDDnJwcqbckk8mWLl06bdq04Rm4gwcP 2my2L774QnoeGRmZmZmZkJAwc+ZMnAcEgKkzMDBw6dKlhoaGysrK4R7S3Xff/dBDD/H8qOvY/H8e 9H5gAIMRxgAAAABJRU5ErkJggg== --=_c2ba53d929d9e1da449915d6c86f4971--

2 1