Re: [ovirt-users] [ovirt-devel] vdsm vds.dispatcher

--Apple-Mail=_BF0F8909-F772-4228-ADA6-BEDEE7C22B79 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 The bug I assumed this was related to is. Bug 1417708 - ovirt-ha-agent should reuse json-rpc connections =20 This is a glusterized 4 host self hosted engine setup. All storage = domains are glusterfs replica 3 volumes on 3 of the 4 hosts that are = part of the cluster. Centos 3.10.0-514.26.2.el7.x86_64 vdsm-4.18.21-1.el7.centos.x86_64 libvirt-2.0.0-10.el7_3.9.x86_64 glusterfs-3.7.20-1.el7.x86_64 qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64 Host and engine are all updated to the latest versions Here are sample of messages log, vdsm,log, supervdsm.log and mom.log messages Aug 28 01:20:11 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:16 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:16 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:19 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:22 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:24 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:37 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:41 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:41 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:44 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:47 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:49 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof vdsm.log Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::bindingxmlrpc::319::vds::(wrapper) client [::1] Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from state init -> state preparing Thread-316519::INFO::2017-08-28 = 01:21:13,242::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone) Thread-316519::INFO::2017-08-28 = 01:21:13,243::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return response: {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, = 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000833501', = 'lastCheck': '1.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '1.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': '1.0', = 'valid': True}, u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, = 'actual': True, 'version': 3, 'acquired': True, 'delay': '0.000513211', = 'lastCheck': '1.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000493711', 'lastCheck': = '1.3', 'valid': True}, u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': = True, 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': '1.1', 'valid': True}} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': '1.1', 'valid': = True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': = True, 'version': 3, 'acquired': False, 'delay': '0.000893509', = 'lastCheck': '1.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': = '1.0', 'valid': True}, u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000513211', 'lastCheck': '1.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.3', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': = '0.000512272', 'lastCheck': '1.1', 'valid': True}} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from state preparing -> state finished Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All) Owner.cancelAll requests {} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::ref 0 aborting False Thread-316519::INFO::2017-08-28 = 01:21:13,243::bindingxmlrpc::331::vds::(wrapper) RPC call = storageRepoGetStats finished (code=3D0) in 0.00 seconds Thread-316519::INFO::2017-08-28 = 01:21:13,246::xmlrpc::91::vds.XMLRPCServer::(_process_requests) Request = handler for ::1:51992 stopped Thread-68::DEBUG::2017-08-28 = 01:21:14,093::fileSD::159::Storage.StorageDomainManifest::(__init__) = Reading domain in path = /rhev/data-center/mnt/glusterSD/glustermount:data2/2bf8f623-1d82-444e-ae16= -d32e5fe4dc9e Thread-68::DEBUG::2017-08-28 = 01:21:14,093::persistent::194::Storage.PersistentDict::(__init__) = Created a persistent dict with FileMetadataRW backend Thread-68::DEBUG::2017-08-28 = 01:21:14,096::persistent::236::Storage.PersistentDict::(refresh) read = lines (FileMetadataRW)=3D['CLASS=3DData', 'DESCRIPTION=3Ddata2', = 'IOOPTIMEOUTSEC=3D10', 'LEASERETRIES=3D3', 'LEASETIMESEC=3D60', = 'LOCKPOLICY=3D', 'LOCKRENEWALINTERVALSEC=3D5', 'MASTER_VERSION=3D10', = 'POOL_DESCRIPTION=3DDefault', = 'POOL_DOMAINS=3Dcf2f4c75-966b-4f69-90a2-d8e7d21fc052:Active,5e39db25-561f-= 490a-81b6-46a7225f02b6:Active,95d4ed8a-9184-4863-84d5-af2bedd690da:Attache= d,3e04b3ad-c46c-4903-a7b2-b9af681318d9:Attached,bd1f0364-0d3a-44fa-842a-5d= 339caac412:Attached,403df7fb-6cff-46e1-8e04-41213fbc0e6e:Active,2bf8f623-1= d82-444e-ae16-d32e5fe4dc9e:Active,6654cb0c-3e57-42ca-b996-3660a3d32a43:Act= ive,88886a7d-f4cc-45a6-901e-89999aa35d78:Attached,feaebec7-aae3-45b5-9684-= 1feedede7bec:Active', 'POOL_SPM_ID=3D-1', 'POOL_SPM_LVER=3D-1', 'POOL_UUID=3D5990e442-0395-0118-005c-0000000003a1', = 'REMOTE_PATH=3Dglustermount:data2', 'ROLE=3DMaster', = 'SDUUID=3D2bf8f623-1d82-444e-ae16-d32e5fe4dc9e', 'TYPE=3DGLUSTERFS', = 'VERSION=3D3', '_SHA_CKSUM=3D65b61dc4f10d80c67c6133ffaee280919458a06a'] Thread-68::DEBUG::2017-08-28 = 01:21:14,105::fileSD::679::Storage.StorageDomain::(imageGarbageCollector) = Removing remnants of deleted images [] Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::604::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_imageNS = already registered Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::612::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_volumeNS = already registered jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,244::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling 'Host.getStats' in bridge with {} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,245::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state init -> = state preparing jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone) jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return response: {u'5e39db25-561f-490a-81b6-46a7225f02b6': = {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': '3.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': = '3.0', 'valid': True}, u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': = True, 'version': 3, 'acquired': True, 'delay': '0.000513211', = 'lastCheck': '1.3', 'valid': True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.1', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': '3.1', 'valid': True}} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': = '3.1', 'valid': True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': = 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '0.000893509', = 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.3', 'valid': True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': = True, 'version': 3, 'acquired': True, 'delay': '0.000493711', = 'lastCheck': '1.1', 'valid': True}, u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': = '3.1', 'valid': True}} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state = preparing -> state finished jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All) Owner.cancelAll requests {} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::ref 0 aborting False Reactor thread::INFO::2017-08-28 = 01:21:15,291::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept) Accepted connection from ::1:51994 Reactor thread::DEBUG::2017-08-28 = 01:21:15,299::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11 Reactor thread::INFO::2017-08-28 = 01:21:15,301::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol stomp from ::1:51994 Reactor thread::INFO::2017-08-28 = 01:21:15,301::stompreactor::101::Broker.StompAdapter::(_cmd_connect) = Processing CONNECT request Reactor thread::DEBUG::2017-08-28 = 01:21:15,301::stompreactor::492::protocoldetector.StompDetector::(handle_s= ocket) Stomp detected from ('::1', 51994) JsonRpc (StompReactor)::INFO::2017-08-28 = 01:21:15,313::stompreactor::128::Broker.StompAdapter::(_cmd_subscribe) = Subscribe command received jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,356::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getStats' in bridge with {'cpuStatistics': {'1': = {'cpuUser': '2.27', 'nodeIndex': 0, 'cpuSys': '1.80', 'cpuIdle': '95.93'}, '0': {'cpuUser': = '0.67', 'nodeIndex': 0, 'cpuSys': '1.13', 'cpuIdle': '98.20'}, '3': = {'cpuUser': '5.67', 'nodeIndex': 0, 'cpuSys': '0.60', 'cpuIdle': = '93.73'}, '2': {'cpuUser': '0.93', 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': '98.54'}, '5': {'cpuUser': '0.87', 'nodeIndex': 0, 'cpuSys': = '1.40', 'cpuIdle': '97.73'}, '4': {'cpuUser': '1.27', 'nodeIndex': 0, = 'cpuSys': '0.53', 'cpuIdle': '98.20'}, '7': {'cpuUser': '0.27', = 'nodeIndex': 0, 'cpuSys': '0.47', 'cpuIdle': '99.26'}, '6': {'cpuUser': '2.07', 'nodeIndex': 0, = 'cpuSys': '0.53', 'cpuIdle': '97.40'}}, 'numaNodeMemFree': {'0': = {'memPercent': 98, 'memFree': '335'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, = 'rxRate': '0.04', 'vmCount': 1, 'memUsed': '41', 'storageDomains': = {u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '3.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '0.000513211', = 'lastCheck': '1.3', 'valid': True}, = u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': '3.1', 'valid': = True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': = True, 'version': 3, 'acquired': True, 'delay': '0.000493711', = 'lastCheck': '1.1', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': = '3.1', 'valid': True}}, 'incomingVmMigrations': 0, 'network': {'enp2s0': {'rxErrors': '0', 'txRate': '0.2', 'rxRate': = '0.1', 'txErrors': '0', 'speed': '1000', 'rxDropped': '18453', 'name': = 'enp2s0', 'tx': '884509425955', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': '134148067121', 'state': 'up'}, 'eno1': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'eno1', 'tx': '54488653089', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '46979728698', 'state': 'up'}, = ';vdsmdummy;': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': = ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '0', 'state': 'down'}, 'enp2s0.4': {'rxErrors': = '0', 'txRate': '0.2', 'rxRate': '0.1', 'txErrors': '0', 'speed': '1000', = 'rxDropped': '0', 'name': 'enp2s0.4', 'tx': '843385870486', 'txDropped': = '0', 'sampleTime': 1503912069.554311, 'rx': '124132253793', 'state': = 'up'}, 'lo': {'rxErrors': '0', 'txRate': '0.3', 'rxRate': '0.3', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'lo', 'tx': = '444179233658', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '444179233658', 'state': 'up'}, 'enp4s0': {'rxErrors': '0', 'txRate': = '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': = '14290', 'name': 'enp4s0', 'tx': '9009494', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '187852658', 'state': 'up'}, 'enp4s0.100': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '0', 'name': 'enp4s0.100', 'tx': = '8798732', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '95777939', 'state': 'up'}, 'enp2s0.2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': = '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': = 'enp2s0.2', 'tx': '1156', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '66329343', 'state': 'up'}, 'enp2s0.3': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'enp2s0.3', 'tx': '1156', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '5930851', 'state': 'up'}, 'vnet0': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'vnet0', 'tx': '97194738', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '8798642', 'state': 'up'}, 'ovirtmgmt': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '2', 'name': 'ovirtmgmt', 'tx': = '52893439231', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '43528048077', 'state': 'up'}, 'ovirt-3': {'rxErrors': '0', 'txRate': = '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': = '2', 'name': 'ovirt-3', 'tx': '578', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '4621679', 'state': 'up'}, 'ovirt-4': {'rxErrors': '0', 'txRate': '0.2', 'rxRate': = '0.1', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': = 'ovirt-4', 'tx': '843385869908', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': '124132039409', 'state': 'up'}, = 'ovirt-2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'ovirt-2', = 'tx': '578', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '19462774', 'state': 'up'}, 'dmz': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '4', 'name': 'dmz', 'tx': = '578', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '31428052', 'state': 'up'}}, 'txDropped': '0', 'cpuUser': '1.75', 'ksmPages': 1250, = 'elapsedTime': '127838.51', 'cpuLoad': '2.39', 'cpuSys': '0.86', 'diskStats': {'/var/log': {'free': '47378'}, = '/var/log/core': {'free': '47378'}, '/var/run/vdsm/': {'free': '7868'}, = '/tmp': {'free': '47378'}}, 'cpuUserVdsmd': '2.13', 'netConfigDirty': = 'False', 'memCommitted': 2113, 'ksmState': False, 'vmMigrating': 0, = 'ksmCpu': 0, 'memAvailable': 9216, 'txRate': '0.06', 'bootTime': = '1503727419', 'haStats': {'active': True, 'configured': True, 'score': 3400, 'localMaintenance': False, = 'globalMaintenance': False}, 'momStatus': 'active', 'rxDropped': = '32751', 'outgoingVmMigrations': 0, 'swapTotal': 7999, 'swapFree': 7842, 'dateTime': '2017-08-28T09:21:15 GMT', = 'anonHugePages': '2280', 'memFree': 9455, 'cpuIdle': '97.39', = 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': '0.87'} jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,357::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getStats succeeded in 0.12 seconds jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,580::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling 'Host.getHardwareInfo' in bridge with {} jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,581::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getHardwareInfo' in bridge with {'systemProductName': '', = 'systemUUID': '20DC6410-4F9F-DF11-9A25-7071BC772964', = 'systemSerialNumber': '', 'systemVersion': '', 'systemManufacturer': ''} jsonrpc.Executor/6::INFO::2017-08-28 = 01:21:15,581::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getHardwareInfo succeeded in 0.00 seconds JsonRpc (StompReactor)::ERROR::2017-08-28 = 01:21:15,583::betterAsyncore::113::vds.dispatcher::(recv) SSL error = during reading data: unexpected eof Reactor thread::INFO::2017-08-28 = 01:21:16,325::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept) Accepted connection from ::1:51996 Reactor thread::DEBUG::2017-08-28 = 01:21:16,332::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11 Reactor thread::INFO::2017-08-28 = 01:21:16,332::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol xml from ::1:51996 Reactor thread::DEBUG::2017-08-28 = 01:21:16,332::bindingxmlrpc::1307::XmlDetector::(handle_socket) xml over = http detected from ('::1', 51996) BindingXMLRPC::INFO::2017-08-28 = 01:21:16,332::xmlrpc::73::vds.XMLRPCServer::(handle_request) Starting = request handler for ::1:51996 supervdsm.log MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,517::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev eno1 classid 0:1388 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:4 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,572::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,573::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:2 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp4s0 classid 0:64 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:3 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,689::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::vsctl::57::root::(commit) Executing commands: = /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list Port = -- list Interface MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list = Port -- list Interface (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,720::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,724::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return network_caps with {'bridges': {'ovirtmgmt': {'ipv6autoconf': = False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'yes', = 'DNS1': '127.0.0.1', 'IPADDR': '10.9.2.61', 'GATEWAY': '10.9.2.1', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': '209.193.4.7', 'DEVICE': = 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': = '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.2.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eno1'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '104', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.7071bc772964', 'bridge_id': '8000.7071bc772964', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '16704', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-4': {'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.9.3.1', = 'dhcpv4': False, 'netmask': '255.255.255.0', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['enp2s0.4'], 'opts': {'multicast_last_member_count': = '2', 'hash_elasticity': '4', 'multicast_query_response_interval': = '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '102', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '8307', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'dmz': {'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['vnet0', 'enp4s0.100'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '103', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.001b212f794d', 'bridge_id': '8000.001b212f794d', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '7181', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-2': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.2'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '2', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '320', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-3': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '1', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '14656', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}}, 'bondings': {}, 'nameservers': ['127.0.0.1', '209.193.4.7', = '209.112.128.2'], 'nics': {'enp2s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '68:05:ca:46:06:af', 'speed': 1000, 'gateway': ''}, 'eno1': = {'ipv6gateway': '::', 'ipv6autoconf': False, 'addr': '', 'cfg': = {'BRIDGE': 'ovirtmgmt', 'IPV6INIT': 'no', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'eno1', 'ONBOOT': = 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, 'netmask': '', = 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': '70:71:bc:77:29:64', = 'speed': 1000, 'gateway': ''}, 'enp4s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '00:1b:21:2f:79:4d', 'speed': 1000, 'gateway': ''}}, 'supportsIPv6': = True, 'vlans': {'enp2s0.4': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-4', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.4', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 4, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp4s0.100': = {'iface': 'enp4s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'dmz', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0.100', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'vlanid': 100, 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': '::', = 'gateway': ''}, 'enp2s0.2': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-2', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.2', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 2, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp2s0.3': = {'iface': 'enp2s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'ovirt-3', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0.3', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 3, 'mtu': '1500', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': = '::', 'gateway': ''}}, 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', = 'ipv6autoconf': False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', = 'DEFROUTE': 'yes', 'DNS1': '127.0.0.1', 'IPADDR': '10.9.2.61', 'GATEWAY': = '10.9.2.1', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': = '255.255.255.0', 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': = '209.193.4.7', 'DEVICE': 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', = 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', = 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': '255.255.255.0', = 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': ['10.9.2.61/24'], 'mtu': = '1500', 'ipv6gateway': '::', 'ports': ['eno1']}, 'ovirt-4': {'iface': = 'ovirt-4', 'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': '10.9.3.1', 'dhcpv4': False, 'netmask': = '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.4']}, 'ovirt-2': {'iface': 'ovirt-2', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', = 'DEVICE': 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': = True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['enp2s0.2']}, 'dmz': = {'iface': 'dmz', 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': = 'legacy', 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': = False, 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['vnet0', 'enp4s0.100']}, 'ovirt-3': {'iface': 'ovirt-3', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': = 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': = 'none', 'STP': 'off', 'DEVICE': 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': = 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': = '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', = 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3']}}} MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::92::SuperVdsm.ServerCallback::(wrapper) = call getHardwareInfo with () {} MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return getHardwareInfo with {'systemProductName': '', 'systemUUID': = '20DC6410-4F9F-DF11-9A25-7 ------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net = <mailto:gary@eraalaska.net> Systems Manager www.flyravn.com = <http://www.flyravn.com/> Ravn Alaska /\ 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving All of Alaska / \/ /\ \ \/\ =E2=80=9CLove your = neighbor as Green, green as far as the eyes can see yourself=E2=80=9D = Matt 22:39 ------------------------------------------------------------------------
On Aug 27, 2017, at 11:24 PM, Yaniv Kaul <ykaul@redhat.com = <mailto:ykaul@redhat.com>> wrote: =20 vdsm vds.dispatcher ERROR SSL error during reading data: unexpected = eof
--Apple-Mail=_BF0F8909-F772-4228-ADA6-BEDEE7C22B79 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div class=3D"" style=3D"font-family: LucidaGrande;">The bug = I assumed this was related to is.</div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><span = style=3D"font-family: LucidaGrande;" class=3D"">Bug = 1417708 - ovirt-ha-agent should reuse json-rpc connections = </span><div class=3D"" style=3D"font-family: LucidaGrande;"><br = class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">This is a glusterized 4 host self hosted engine setup. = All storage domains are glusterfs replica 3 volumes on 3 of the 4 = hosts that are part of the cluster.</div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><div class=3D"">Centos = 3.10.0-514.26.2.el7.x86_64</div></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: = LucidaGrande;">vdsm-4.18.21-1.el7.centos.x86_64</div><div class=3D"" = style=3D"font-family: = LucidaGrande;">libvirt-2.0.0-10.el7_3.9.x86_64</div><div class=3D"" = style=3D"font-family: = LucidaGrande;">glusterfs-3.7.20-1.el7.x86_64</div><div class=3D"" = style=3D"font-family: = LucidaGrande;">qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64</div><div = class=3D"" style=3D"font-family: LucidaGrande;"><br class=3D""></div><div = class=3D"" style=3D"font-family: LucidaGrande;">Host and engine are all = updated to the latest versions</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">Here are sample of messages log, vdsm,log, supervdsm.log = and mom.log</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">messages</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;"><div class=3D"">Aug 28 01:20:11 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:16 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:16 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:19 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:22 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:24 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:37 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:41 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:41 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:44 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:47 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:49 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div></div><div class=3D"" style=3D"font-family: LucidaGrande;"><br = class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">vdsm.log</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;"><div class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::bindingxmlrpc::319::vds::(wrapper) client [::1]</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from = state</div><div class=3D"">init -> state preparing</div><div = class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,242::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone)</div><div = class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,243::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return</div><div class=3D"">response: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': = '1.1', 'valid': True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': = 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': = '0.000893509', 'lastCheck': '1.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version':</div><div class=3D"">3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '1.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.1', 'valid': True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.3', 'valid':</div><div class=3D"">True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay':</div><div = class=3D"">'0.000512272', 'lastCheck': '1.1', 'valid': True}}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code':</div><div class=3D"">0,= 'actual': True, 'version': 0,</div><div class=3D"">'acquired': True, = 'delay': '0.000833501', 'lastCheck': '1.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '1.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '1.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e':</div><div class=3D"">{'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.3', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec':</div><div class=3D"">{'code': = 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': = '0.000512272', 'lastCheck': '1.1', 'valid': True}}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from = state</div><div class=3D"">preparing -> state finished</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All) Owner.cancelAll requests {}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::ref 0 aborting = False</div><div class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,243::bindingxmlrpc::331::vds::(wrapper) RPC call = storageRepoGetStats finished (code=3D0) in 0.00 seconds</div><div = class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,246::xmlrpc::91::vds.XMLRPCServer::(_process_requests) Request = handler for</div><div class=3D"">::1:51992 stopped</div><div = class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,093::fileSD::159::Storage.StorageDomainManifest::(__init__) = Reading domain in</div><div class=3D"">path = /rhev/data-center/mnt/glusterSD/glustermount:data2/2bf8f623-1d82-444e-ae16= -d32e5fe4dc9e</div><div class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,093::persistent::194::Storage.PersistentDict::(__init__) = Created a persistent</div><div class=3D"">dict with FileMetadataRW = backend</div><div class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,096::persistent::236::Storage.PersistentDict::(refresh) read = lines (FileMetadataRW)=3D['CLASS=3DData', 'DESCRIPTION=3Ddata2', = 'IOOPTIMEOUTSEC=3D10', 'LEASERETRIES=3D3', 'LEASETIMESEC=3D60', = 'LOCKPOLICY=3D', 'LOCKRENEWALINTERVALSEC=3D5', 'MASTER_VERSION=3D10', = 'POOL_DESCRIPTION=3DDefault', = 'POOL_DOMAINS=3Dcf2f4c75-966b-4f69-90a2-d8e7d21fc052:Active,5e39db25-561f-= 490a-81b6-46a7225f02b6:Active,95d4ed8a-9184-4863-84d5-af2bedd690da:Attache= d,3e04b3ad-c46c-4903-a7b2-b9af681318d9:Attached,bd1f0364-0d3a-44fa-842a-5d= 339caac412:Attached,403df7fb-6cff-46e1-8e04-41213fbc0e6e:Active,2bf8f623-1= d82-444e-ae16-d32e5fe4dc9e:Active,6654cb0c-3e57-42ca-b996-3660a3d32a43:Act= ive,88886a7d-f4cc-45a6-901e-89999aa35d78:Attached,feaebec7-aae3-45b5-9684-= 1feedede7bec:Active', 'POOL_SPM_ID=3D-1', 'POOL_SPM_LVER=3D-1',</div><div = class=3D"">'POOL_UUID=3D5990e442-0395-0118-005c-0000000003a1', = 'REMOTE_PATH=3Dglustermount:data2', 'ROLE=3DMaster', = 'SDUUID=3D2bf8f623-1d82-444e-ae16-d32e5fe4dc9e', 'TYPE=3DGLUSTERFS', = 'VERSION=3D3', = '_SHA_CKSUM=3D65b61dc4f10d80c67c6133ffaee280919458a06a']</div><div = class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,105::fileSD::679::Storage.StorageDomain::(imageGarbageCollector) = Removing remnants of deleted images []</div><div = class=3D"">Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::604::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_imageNS = already registered</div><div class=3D"">Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::612::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_volumeNS = already registered</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,244::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling</div><div class=3D"">'Host.getStats' in bridge with {}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,245::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state init = -> state preparing</div><div = class=3D"">jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone)</div><div = class=3D"">jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return response: {u'5e39db25-561f-490a-81b6-46a7225f02b6': = {'code': 0, 'actual': True, 'version': 0, 'acquired': True,</div><div = class=3D"">'delay': '0.000833501', 'lastCheck': '3.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False,</div><div class=3D"">'delay': = '0.000893509', 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': = '3.0', 'valid':</div><div class=3D"">True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.3', 'valid': True},</div><div = class=3D"">u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e':</div><div = class=3D"">{'code': 0, 'actual': True, 'version': 3, 'acquired': True, = 'delay': '0.000493711', 'lastCheck': '1.1', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired':</div><div class=3D"">True, 'delay': = '0.000512272', 'lastCheck': '3.1', 'valid': True}}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': = '3.1', 'valid': True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': = 0, 'actual':</div><div class=3D"">True, 'version': 3, 'acquired': False, = 'delay': '0.000893509', 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True,</div><div class=3D"">'delay': = '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.3', 'valid':</div><div class=3D"">True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000493711', 'lastCheck': = '1.1', 'valid': True},</div><div = class=3D"">u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, = 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000512272', = 'lastCheck': '3.1', 'valid': True}}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state = preparing -> state finished</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All)</div><div class=3D"">Owner.cancelAll requests {}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::ref 0 aborting = False</div><div class=3D"">Reactor thread::INFO::2017-08-28 = 01:21:15,291::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept)</div><div class=3D"">Accepted connection from = ::1:51994</div><div class=3D"">Reactor thread::DEBUG::2017-08-28 = 01:21:15,299::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11</div><div class=3D"">Reactor = thread::INFO::2017-08-28 = 01:21:15,301::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol stomp from ::1:51994</div><div class=3D"">Reactor = thread::INFO::2017-08-28 = 01:21:15,301::stompreactor::101::Broker.StompAdapter::(_cmd_connect) = Processing CONNECT request</div><div class=3D"">Reactor = thread::DEBUG::2017-08-28 = 01:21:15,301::stompreactor::492::protocoldetector.StompDetector::(handle_s= ocket) Stomp detected from ('::1', 51994)</div><div class=3D"">JsonRpc = (StompReactor)::INFO::2017-08-28 = 01:21:15,313::stompreactor::128::Broker.StompAdapter::(_cmd_subscribe) = Subscribe command received</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,356::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getStats' in bridge with {'cpuStatistics': {'1': = {'cpuUser': '2.27',</div><div class=3D"">'nodeIndex': 0, 'cpuSys': = '1.80', 'cpuIdle': '95.93'}, '0': {'cpuUser': '0.67', 'nodeIndex': 0, = 'cpuSys': '1.13', 'cpuIdle': '98.20'}, '3': {'cpuUser': '5.67', = 'nodeIndex': 0, 'cpuSys': '0.60', 'cpuIdle': '93.73'},</div><div = class=3D"">'2': {'cpuUser': '0.93', 'nodeIndex': 0, 'cpuSys': = '0.53',</div><div class=3D"">'cpuIdle': '98.54'}, '5': {'cpuUser': = '0.87', 'nodeIndex': 0, 'cpuSys': '1.40', 'cpuIdle': '97.73'}, '4': = {'cpuUser': '1.27', 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': = '98.20'}, '7': {'cpuUser': '0.27', 'nodeIndex': 0, 'cpuSys':</div><div = class=3D"">'0.47', 'cpuIdle': '99.26'}, '6': {'cpuUser': '2.07', = 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': '97.40'}}, = 'numaNodeMemFree': {'0': {'memPercent': 98, 'memFree': '335'}}, = 'memShared': 0,</div><div class=3D"">'haScore': 3400, 'thpState': = 'always', 'ksmMergeAcrossNodes': True, 'rxRate': '0.04', 'vmCount': 1, = 'memUsed': '41', 'storageDomains': = {u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '3.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0,</div><div = class=3D"">'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000513211', 'lastCheck': '1.3', 'valid': True}, = u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0,</div><div class=3D"">'acquired': True, 'delay': = '0.000833501', 'lastCheck': '3.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000493711', 'lastCheck': = '1.1', 'valid': True}, u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': = 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': = '0.000512272', 'lastCheck': '3.1', 'valid': True}}, = 'incomingVmMigrations': 0,</div><div class=3D"">'network': {'enp2s0': = {'rxErrors': '0', 'txRate': '0.2', 'rxRate': '0.1', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '18453', 'name': 'enp2s0', 'tx': = '884509425955', 'txDropped': '0', 'sampleTime':</div><div = class=3D"">1503912069.554311, 'rx': '134148067121', 'state': 'up'}, = 'eno1': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors':</div><div class=3D"">'0', 'speed': '1000',</div><div = class=3D"">'rxDropped': '0', 'name': 'eno1', 'tx': '54488653089', = 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': '46979728698', = 'state': 'up'}, ';vdsmdummy;': {'rxErrors': '0', 'txRate': '0.0', = 'rxRate': '0.0',</div><div class=3D"">'txErrors': '0', 'speed': '1000', = 'rxDropped': '0', 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '0', 'state': 'down'}, = 'enp2s0.4': {'rxErrors': '0', 'txRate': '0.2', 'rxRate': '0.1', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'enp2s0.4', = 'tx': '843385870486', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '124132253793', 'state': 'up'}, 'lo': {'rxErrors': '0', 'txRate': = '0.3', 'rxRate': '0.3', 'txErrors': '0', 'speed': '1000', 'rxDropped': = '0', 'name': 'lo', 'tx': '444179233658', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '444179233658', 'state': 'up'}, 'enp4s0': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '14290', 'name': 'enp4s0',</div><div = class=3D"">'tx': '9009494', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '187852658', 'state': 'up'}, = 'enp4s0.100':</div><div class=3D"">{'rxErrors': '0', 'txRate': '0.0', = 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'enp4s0.100', 'tx': '8798732', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '95777939',</div><div class=3D"">'state': = 'up'}, 'enp2s0.2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'enp2s0.2', = 'tx': '1156', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '66329343', 'state': 'up'},</div><div class=3D"">'enp2s0.3': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '0',</div><div class=3D"">'name': = 'enp2s0.3', 'tx': '1156', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '5930851', 'state': 'up'}, 'vnet0': = {'rxErrors': '0', 'txRate': '0.0',</div><div class=3D"">'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'vnet0', = 'tx': '97194738', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '8798642', 'state': 'up'}, 'ovirtmgmt':</div><div = class=3D"">{'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '2', 'name': 'ovirtmgmt', = 'tx': '52893439231', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '43528048077', 'state': 'up'}, 'ovirt-3': {'rxErrors': '0', = 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', = 'rxDropped': '2', 'name': 'ovirt-3', 'tx': '578', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '4621679',</div><div = class=3D"">'state': 'up'}, 'ovirt-4': {'rxErrors': '0', 'txRate': '0.2', = 'rxRate': '0.1', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'ovirt-4', 'tx': '843385869908', 'txDropped': '0',</div><div = class=3D"">'sampleTime': 1503912069.554311, 'rx': '124132039409', = 'state': 'up'}, 'ovirt-2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': = '0.0',</div><div class=3D"">'txErrors': '0', 'speed': '1000', = 'rxDropped': '0', 'name': 'ovirt-2', 'tx': '578', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '19462774', 'state':</div><div = class=3D"">'up'}, 'dmz': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': = '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '4', 'name': = 'dmz', 'tx': '578', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '31428052',</div><div class=3D"">'state': 'up'}}, 'txDropped': = '0', 'cpuUser': '1.75', 'ksmPages': 1250, 'elapsedTime': '127838.51', = 'cpuLoad':</div><div class=3D"">'2.39', 'cpuSys': '0.86', 'diskStats': = {'/var/log': {'free': '47378'}, '/var/log/core': {'free': '47378'}, = '/var/run/vdsm/': {'free': '7868'}, '/tmp': {'free': '47378'}}, = 'cpuUserVdsmd': '2.13', 'netConfigDirty': 'False', 'memCommitted': 2113, = 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 9216, = 'txRate': '0.06', 'bootTime': '1503727419', 'haStats': = {'active':</div><div class=3D"">True, 'configured': True, 'score': 3400, = 'localMaintenance': False, 'globalMaintenance': False}, 'momStatus': = 'active', 'rxDropped': '32751', 'outgoingVmMigrations': 0, 'swapTotal': = 7999,</div><div class=3D"">'swapFree': 7842, 'dateTime': = '2017-08-28T09:21:15 GMT', 'anonHugePages': '2280', 'memFree': 9455, = 'cpuIdle': '97.39', 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': = '0.87'}</div><div class=3D"">jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,357::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getStats succeeded in 0.12 seconds</div><div = class=3D"">jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,580::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling</div><div class=3D"">'Host.getHardwareInfo' in bridge with = {}</div><div class=3D"">jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,581::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getHardwareInfo' in bridge with {'systemProductName': '', = 'systemUUID': '20DC6410-4F9F-DF11-9A25-7071BC772964', = 'systemSerialNumber': '', 'systemVersion': '', 'systemManufacturer': = ''}</div><div class=3D"">jsonrpc.Executor/6::INFO::2017-08-28 = 01:21:15,581::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getHardwareInfo succeeded in 0.00 seconds</div><div = class=3D"">JsonRpc (StompReactor)::ERROR::2017-08-28 = 01:21:15,583::betterAsyncore::113::vds.dispatcher::(recv) SSL error = during</div><div class=3D"">reading data: unexpected eof</div><div = class=3D"">Reactor thread::INFO::2017-08-28 = 01:21:16,325::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept)</div><div class=3D"">Accepted connection from = ::1:51996</div><div class=3D"">Reactor thread::DEBUG::2017-08-28 = 01:21:16,332::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11</div><div class=3D"">Reactor = thread::INFO::2017-08-28 = 01:21:16,332::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol xml from ::1:51996</div><div class=3D"">Reactor = thread::DEBUG::2017-08-28 = 01:21:16,332::bindingxmlrpc::1307::XmlDetector::(handle_socket) xml over = http detected from ('::1', 51996)</div><div = class=3D"">BindingXMLRPC::INFO::2017-08-28 = 01:21:16,332::xmlrpc::73::vds.XMLRPCServer::(handle_request) Starting = request handler for ::1:51996</div></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;">supervdsm.log</div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,517::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev eno1 classid 0:1388 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:4 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,572::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,573::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:2 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp4s0 classid 0:64 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:3 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,689::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::vsctl::57::root::(commit) Executing commands: = /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list Port = -- list Interface</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list = Port -- list Interface (cwd</div><div class=3D"">None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,720::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,724::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return network_caps with {'bridges': {'ovirtmgmt': {'ipv6autoconf': = False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'yes', = 'DNS1': '127.0.0.1', 'IPADDR': '10.9.2.61', 'GATEWAY': '10.9.2.1', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': '209.193.4.7', 'DEVICE': = 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': = '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.2.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eno1'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '104', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.7071bc772964', 'bridge_id': '8000.7071bc772964', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '16704', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-4': {'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.9.3.1', = 'dhcpv4': False, 'netmask': '255.255.255.0', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['enp2s0.4'], 'opts': {'multicast_last_member_count': = '2', 'hash_elasticity': '4', 'multicast_query_response_interval': = '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '102', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '8307', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'dmz': {'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['vnet0', 'enp4s0.100'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '103', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.001b212f794d', 'bridge_id': '8000.001b212f794d', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '7181', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-2': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.2'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '2', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '320', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-3': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '1', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '14656', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}}, 'bondings': {}, 'nameservers': ['127.0.0.1', '209.193.4.7', = '209.112.128.2'], 'nics': {'enp2s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '68:05:ca:46:06:af', 'speed': 1000, 'gateway': ''}, 'eno1': = {'ipv6gateway': '::', 'ipv6autoconf': False, 'addr': '', 'cfg': = {'BRIDGE': 'ovirtmgmt', 'IPV6INIT': 'no', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'eno1', 'ONBOOT': = 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, 'netmask': '', = 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': '70:71:bc:77:29:64', = 'speed': 1000, 'gateway': ''}, 'enp4s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '00:1b:21:2f:79:4d', 'speed': 1000, 'gateway': ''}}, 'supportsIPv6': = True, 'vlans': {'enp2s0.4': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-4', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.4', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 4, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp4s0.100': = {'iface': 'enp4s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'dmz', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0.100', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'vlanid': 100, 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': '::', = 'gateway': ''}, 'enp2s0.2': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-2', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.2', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 2, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp2s0.3': = {'iface': 'enp2s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'ovirt-3', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0.3', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 3, 'mtu': '1500', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': = '::', 'gateway': ''}}, 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', = 'ipv6autoconf': False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', = 'DEFROUTE':</div><div class=3D"">'yes', 'DNS1': '127.0.0.1', 'IPADDR': = '10.9.2.61', 'GATEWAY': '10.9.2.1', 'DELAY': '0', 'NM_CONTROLLED': 'no', = 'NETMASK': '255.255.255.0', 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': = '209.193.4.7', 'DEVICE': 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', = 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', = 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': '255.255.255.0', = 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': ['10.9.2.61/24'], 'mtu': = '1500', 'ipv6gateway': '::', 'ports': ['eno1']}, 'ovirt-4': {'iface': = 'ovirt-4', 'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [],</div><div = class=3D"">'switch': 'legacy', 'gateway': '10.9.3.1', 'dhcpv4': False, = 'netmask': '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.4']}, 'ovirt-2': {'iface': 'ovirt-2', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', = 'DEVICE': 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': = True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['enp2s0.2']}, 'dmz': = {'iface': 'dmz', 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': = 'legacy', 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': = False, 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['vnet0', 'enp4s0.100']}, 'ovirt-3': {'iface': 'ovirt-3', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': = 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': = 'none', 'STP': 'off', 'DEVICE': 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': = 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': = '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', = 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3']}}}</div><div = class=3D"">MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::92::SuperVdsm.ServerCallback::(wrapper) = call getHardwareInfo with () {}</div><div = class=3D"">MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return getHardwareInfo with {'systemProductName': '', 'systemUUID': = '20DC6410-4F9F-DF11-9A25-7</div></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""><div class=3D""><div = class=3D"" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><font face=3D"Menlo" class=3D"" = style=3D"font-size: 12px;"><div = class=3D"">---------------------------------------------------------------= ---------</div><div class=3D"">Gary Pedretty = = <a = href=3D"mailto:gary@eraalaska.net" = class=3D"">gary@ravnalaska.net</a></div><div class=3D"">Systems Manager = = = <a href=3D"http://www.flyravn.com" = class=3D"">www.flyravn.com</a></div><div class=3D"">Ravn Alaska = = /\ = 907-450-7251</div><div class=3D"">5245 Airport Industrial = Road / \/\ = 907-450-7238 fax</div><div class=3D"">Fairbanks, Alaska = 99709 /\ / \ \ = Second greatest commandment</div></font><font face=3D"Monaco" = class=3D""><span class=3D"" style=3D"font-size: 12px;">Serving All of = Alaska / \/ /\ \ \/\ = =E2=80=9CLove your neighbor as</span></font><br class=3D"" = style=3D"font-family: Monaco;"><font face=3D"Menlo" class=3D""><span = class=3D"" style=3D"font-size: 12px;">Green, green as far as the eyes = can see yourself=E2=80=9D Matt = 22:39</span></font><div class=3D"" style=3D"font-family: = Menlo;"></div><font face=3D"Menlo" class=3D"" style=3D"font-size: = 12px;"></font><span class=3D"" style=3D"font-size: 12px;"><font = face=3D"Menlo" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div></font></span><div class=3D""><font face=3D"Menlo" = class=3D"" style=3D"font-size: 12px;"><br = class=3D""></font></div></div><span class=3D"" style=3D"font-size: = 12px;"><br class=3D"Apple-interchange-newline"></span></div><span = class=3D"" style=3D"font-size: 12px;"><br = class=3D"Apple-interchange-newline"></span></div><span class=3D"" = style=3D"font-size: 12px;"><br = class=3D"Apple-interchange-newline"></span></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"><br = class=3D"Apple-interchange-newline"></div><br class=3D""><blockquote = type=3D"cite" class=3D"">On Aug 27, 2017, at 11:24 PM, Yaniv Kaul <<a = href=3D"mailto:ykaul@redhat.com" class=3D"">ykaul@redhat.com</a>> = wrote:<br class=3D""><br class=3D"">vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof</blockquote></div></body></html>= --Apple-Mail=_BF0F8909-F772-4228-ADA6-BEDEE7C22B79--

On Aug 30, 2017, at 11:34 AM, Gary Pedretty <gary@ravnalaska.net> = wrote: =20 The bug I assumed this was related to is. =20 Bug 1417708 - ovirt-ha-agent should reuse json-rpc connections =20 =20 =20 This is a glusterized 4 host self hosted engine setup. All storage = domains are glusterfs replica 3 volumes on 3 of the 4 hosts that are =
=20 Centos 3.10.0-514.26.2.el7.x86_64 =20 vdsm-4.18.21-1.el7.centos.x86_64 libvirt-2.0.0-10.el7_3.9.x86_64 glusterfs-3.7.20-1.el7.x86_64 qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64 =20 Host and engine are all updated to the latest versions =20 Here are sample of messages log, vdsm,log, supervdsm.log and mom.log =20 messages =20 Aug 28 01:20:11 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:16 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:16 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:19 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:22 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:24 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:37 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:41 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:41 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:44 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:47 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:49 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof =20 vdsm.log =20 Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::bindingxmlrpc::319::vds::(wrapper) client [::1] Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from state init -> state preparing Thread-316519::INFO::2017-08-28 = 01:21:13,242::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone) Thread-316519::INFO::2017-08-28 = 01:21:13,243::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return response: {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, = 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000833501', = 'lastCheck': '1.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '1.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': '1.0', = 'valid': True}, u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, = 'actual': True, 'version': 3, 'acquired': True, 'delay': '0.000513211', = 'lastCheck': '1.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000493711', 'lastCheck': = '1.3', 'valid': True}, u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': = True, 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': '1.1', 'valid': True}} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': '1.1', 'valid': = True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': = True, 'version': 3, 'acquired': False, 'delay': '0.000893509', = 'lastCheck': '1.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': = '1.0', 'valid': True}, u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000513211', 'lastCheck': '1.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.3', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': = '0.000512272', 'lastCheck': '1.1', 'valid': True}} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from state preparing -> state finished Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All) Owner.cancelAll requests {} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::ref 0 aborting False Thread-316519::INFO::2017-08-28 = 01:21:13,243::bindingxmlrpc::331::vds::(wrapper) RPC call = storageRepoGetStats finished (code=3D0) in 0.00 seconds Thread-316519::INFO::2017-08-28 = 01:21:13,246::xmlrpc::91::vds.XMLRPCServer::(_process_requests) Request = handler for ::1:51992 stopped Thread-68::DEBUG::2017-08-28 = 01:21:14,093::fileSD::159::Storage.StorageDomainManifest::(__init__) = Reading domain in path = /rhev/data-center/mnt/glusterSD/glustermount:data2/2bf8f623-1d82-444e-ae16= -d32e5fe4dc9e Thread-68::DEBUG::2017-08-28 = 01:21:14,093::persistent::194::Storage.PersistentDict::(__init__) = Created a persistent dict with FileMetadataRW backend Thread-68::DEBUG::2017-08-28 = 01:21:14,096::persistent::236::Storage.PersistentDict::(refresh) read =
'POOL_UUID=3D5990e442-0395-0118-005c-0000000003a1', = 'REMOTE_PATH=3Dglustermount:data2', 'ROLE=3DMaster', = 'SDUUID=3D2bf8f623-1d82-444e-ae16-d32e5fe4dc9e', 'TYPE=3DGLUSTERFS', = 'VERSION=3D3', '_SHA_CKSUM=3D65b61dc4f10d80c67c6133ffaee280919458a06a'] Thread-68::DEBUG::2017-08-28 = 01:21:14,105::fileSD::679::Storage.StorageDomain::(imageGarbageCollector) = Removing remnants of deleted images [] Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::604::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_imageNS = already registered Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::612::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_volumeNS = already registered jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,244::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling 'Host.getStats' in bridge with {} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,245::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state init -> = state preparing jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone) jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return response: {u'5e39db25-561f-490a-81b6-46a7225f02b6': = {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': '3.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': = '3.0', 'valid': True}, u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': = True, 'version': 3, 'acquired': True, 'delay': '0.000513211', = 'lastCheck': '1.3', 'valid': True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.1', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': '3.1', 'valid': True}} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': = '3.1', 'valid': True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': = 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '0.000893509', = 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.3', 'valid': True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': = True, 'version': 3, 'acquired': True, 'delay': '0.000493711', = 'lastCheck': '1.1', 'valid': True}, u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': = '3.1', 'valid': True}} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state =
--Apple-Mail=_4FF6C45E-BA6F-4D95-B362-6BD30A02360C Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 The latest release 4.1 solved this issue. gary ------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net Systems Manager www.flyravn.com Ravn Alaska /\ 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving Alaska's Interior / \/ /\ \ \/\ "Love your neighbor as White white everywhere, must be winter yourself=E2=80=9D = Matt 22:39 ------------------------------------------------------------------------ part of the cluster. lines (FileMetadataRW)=3D['CLASS=3DData', 'DESCRIPTION=3Ddata2', = 'IOOPTIMEOUTSEC=3D10', 'LEASERETRIES=3D3', 'LEASETIMESEC=3D60', = 'LOCKPOLICY=3D', 'LOCKRENEWALINTERVALSEC=3D5', 'MASTER_VERSION=3D10', = 'POOL_DESCRIPTION=3DDefault', = 'POOL_DOMAINS=3Dcf2f4c75-966b-4f69-90a2-d8e7d21fc052:Active,5e39db25-561f-= 490a-81b6-46a7225f02b6:Active,95d4ed8a-9184-4863-84d5-af2bedd690da:Attache= d,3e04b3ad-c46c-4903-a7b2-b9af681318d9:Attached,bd1f0364-0d3a-44fa-842a-5d= 339caac412:Attached,403df7fb-6cff-46e1-8e04-41213fbc0e6e:Active,2bf8f623-1= d82-444e-ae16-d32e5fe4dc9e:Active,6654cb0c-3e57-42ca-b996-3660a3d32a43:Act= ive,88886a7d-f4cc-45a6-901e-89999aa35d78:Attached,feaebec7-aae3-45b5-9684-= 1feedede7bec:Active', 'POOL_SPM_ID=3D-1', 'POOL_SPM_LVER=3D-1', preparing -> state finished
jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All) Owner.cancelAll requests {} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::ref 0 aborting False Reactor thread::INFO::2017-08-28 = 01:21:15,291::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept) Accepted connection from ::1:51994 Reactor thread::DEBUG::2017-08-28 = 01:21:15,299::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11 Reactor thread::INFO::2017-08-28 = 01:21:15,301::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol stomp from ::1:51994 Reactor thread::INFO::2017-08-28 = 01:21:15,301::stompreactor::101::Broker.StompAdapter::(_cmd_connect) = Processing CONNECT request Reactor thread::DEBUG::2017-08-28 = 01:21:15,301::stompreactor::492::protocoldetector.StompDetector::(handle_s= ocket) Stomp detected from ('::1', 51994) JsonRpc (StompReactor)::INFO::2017-08-28 = 01:21:15,313::stompreactor::128::Broker.StompAdapter::(_cmd_subscribe) = Subscribe command received jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,356::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getStats' in bridge with {'cpuStatistics': {'1': = {'cpuUser': '2.27', 'nodeIndex': 0, 'cpuSys': '1.80', 'cpuIdle': '95.93'}, '0': = {'cpuUser': '0.67', 'nodeIndex': 0, 'cpuSys': '1.13', 'cpuIdle': = '98.20'}, '3': {'cpuUser': '5.67', 'nodeIndex': 0, 'cpuSys': '0.60', = 'cpuIdle': '93.73'}, '2': {'cpuUser': '0.93', 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': '98.54'}, '5': {'cpuUser': '0.87', 'nodeIndex': 0, = 'cpuSys': '1.40', 'cpuIdle': '97.73'}, '4': {'cpuUser': '1.27', = 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': '98.20'}, '7': {'cpuUser': = '0.27', 'nodeIndex': 0, 'cpuSys': '0.47', 'cpuIdle': '99.26'}, '6': {'cpuUser': '2.07', 'nodeIndex': 0, = 'cpuSys': '0.53', 'cpuIdle': '97.40'}}, 'numaNodeMemFree': {'0': = {'memPercent': 98, 'memFree': '335'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, = 'rxRate': '0.04', 'vmCount': 1, 'memUsed': '41', 'storageDomains': = {u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '3.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000513211', 'lastCheck': '1.3', 'valid': True}, = u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': '3.1', 'valid': = True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': = True, 'version': 3, 'acquired': True, 'delay': '0.000493711', = 'lastCheck': '1.1', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': = '3.1', 'valid': True}}, 'incomingVmMigrations': 0, 'network': {'enp2s0': {'rxErrors': '0', 'txRate': '0.2', 'rxRate': = '0.1', 'txErrors': '0', 'speed': '1000', 'rxDropped': '18453', 'name': = 'enp2s0', 'tx': '884509425955', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': '134148067121', 'state': 'up'}, 'eno1': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'eno1', 'tx': '54488653089', 'txDropped': = '0', 'sampleTime': 1503912069.554311, 'rx': '46979728698', 'state': = 'up'}, ';vdsmdummy;': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': = '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': = ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '0', 'state': 'down'}, 'enp2s0.4': {'rxErrors': = '0', 'txRate': '0.2', 'rxRate': '0.1', 'txErrors': '0', 'speed': '1000', = 'rxDropped': '0', 'name': 'enp2s0.4', 'tx': '843385870486', 'txDropped': = '0', 'sampleTime': 1503912069.554311, 'rx': '124132253793', 'state': = 'up'}, 'lo': {'rxErrors': '0', 'txRate': '0.3', 'rxRate': '0.3', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'lo', 'tx': = '444179233658', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '444179233658', 'state': 'up'}, 'enp4s0': {'rxErrors': '0', 'txRate': = '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': = '14290', 'name': 'enp4s0', 'tx': '9009494', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '187852658', 'state': 'up'}, 'enp4s0.100': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '0', 'name': 'enp4s0.100', 'tx': = '8798732', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '95777939', 'state': 'up'}, 'enp2s0.2': {'rxErrors': '0', 'txRate': '0.0', = 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'enp2s0.2', 'tx': '1156', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '66329343', 'state': 'up'}, 'enp2s0.3': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'enp2s0.3', 'tx': '1156', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '5930851', 'state': 'up'}, 'vnet0': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'vnet0', 'tx': '97194738', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '8798642', 'state': 'up'}, 'ovirtmgmt': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '2', 'name': 'ovirtmgmt', 'tx': = '52893439231', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '43528048077', 'state': 'up'}, 'ovirt-3': {'rxErrors': '0', 'txRate': = '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': = '2', 'name': 'ovirt-3', 'tx': '578', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '4621679', 'state': 'up'}, 'ovirt-4': {'rxErrors': '0', 'txRate': '0.2', = 'rxRate': '0.1', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'ovirt-4', 'tx': '843385869908', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': '124132039409', 'state': 'up'}, = 'ovirt-2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'ovirt-2', = 'tx': '578', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '19462774', 'state': 'up'}, 'dmz': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '4', 'name': 'dmz', 'tx': = '578', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '31428052', 'state': 'up'}}, 'txDropped': '0', 'cpuUser': '1.75', 'ksmPages': = 1250, 'elapsedTime': '127838.51', 'cpuLoad': '2.39', 'cpuSys': '0.86', 'diskStats': {'/var/log': {'free': '47378'}, = '/var/log/core': {'free': '47378'}, '/var/run/vdsm/': {'free': '7868'}, = '/tmp': {'free': '47378'}}, 'cpuUserVdsmd': '2.13', 'netConfigDirty': = 'False', 'memCommitted': 2113, 'ksmState': False, 'vmMigrating': 0, = 'ksmCpu': 0, 'memAvailable': 9216, 'txRate': '0.06', 'bootTime': = '1503727419', 'haStats': {'active': True, 'configured': True, 'score': 3400, 'localMaintenance': False, = 'globalMaintenance': False}, 'momStatus': 'active', 'rxDropped': = '32751', 'outgoingVmMigrations': 0, 'swapTotal': 7999, 'swapFree': 7842, 'dateTime': '2017-08-28T09:21:15 GMT', = 'anonHugePages': '2280', 'memFree': 9455, 'cpuIdle': '97.39', = 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': '0.87'} jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,357::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getStats succeeded in 0.12 seconds jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,580::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling 'Host.getHardwareInfo' in bridge with {} jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,581::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getHardwareInfo' in bridge with {'systemProductName': '', = 'systemUUID': '20DC6410-4F9F-DF11-9A25-7071BC772964', = 'systemSerialNumber': '', 'systemVersion': '', 'systemManufacturer': ''} jsonrpc.Executor/6::INFO::2017-08-28 = 01:21:15,581::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getHardwareInfo succeeded in 0.00 seconds JsonRpc (StompReactor)::ERROR::2017-08-28 = 01:21:15,583::betterAsyncore::113::vds.dispatcher::(recv) SSL error = during reading data: unexpected eof Reactor thread::INFO::2017-08-28 = 01:21:16,325::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept) Accepted connection from ::1:51996 Reactor thread::DEBUG::2017-08-28 = 01:21:16,332::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11 Reactor thread::INFO::2017-08-28 = 01:21:16,332::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol xml from ::1:51996 Reactor thread::DEBUG::2017-08-28 = 01:21:16,332::bindingxmlrpc::1307::XmlDetector::(handle_socket) xml over = http detected from ('::1', 51996) BindingXMLRPC::INFO::2017-08-28 = 01:21:16,332::xmlrpc::73::vds.XMLRPCServer::(handle_request) Starting = request handler for ::1:51996 =20 =20 supervdsm.log =20 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,517::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev eno1 classid 0:1388 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:4 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,572::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,573::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:2 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp4s0 classid 0:64 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:3 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,689::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::vsctl::57::root::(commit) Executing commands: = /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list Port = -- list Interface MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list = Port -- list Interface (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,720::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,724::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return network_caps with {'bridges': {'ovirtmgmt': {'ipv6autoconf': = False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'yes', = 'DNS1': '127.0.0.1', 'IPADDR': '10.9.2.61', 'GATEWAY': '10.9.2.1', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': '209.193.4.7', 'DEVICE': = 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': = '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.2.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eno1'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '104', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.7071bc772964', 'bridge_id': '8000.7071bc772964', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '16704', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-4': {'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.9.3.1', = 'dhcpv4': False, 'netmask': '255.255.255.0', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['enp2s0.4'], 'opts': {'multicast_last_member_count': = '2', 'hash_elasticity': '4', 'multicast_query_response_interval': = '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '102', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '8307', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'dmz': {'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['vnet0', 'enp4s0.100'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '103', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.001b212f794d', 'bridge_id': '8000.001b212f794d', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '7181', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-2': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.2'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '2', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '320', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-3': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '1', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '14656', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}}, 'bondings': {}, 'nameservers': ['127.0.0.1', '209.193.4.7', = '209.112.128.2'], 'nics': {'enp2s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '68:05:ca:46:06:af', 'speed': 1000, 'gateway': ''}, 'eno1': = {'ipv6gateway': '::', 'ipv6autoconf': False, 'addr': '', 'cfg': = {'BRIDGE': 'ovirtmgmt', 'IPV6INIT': 'no', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'eno1', 'ONBOOT': = 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, 'netmask': '', = 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': '70:71:bc:77:29:64', = 'speed': 1000, 'gateway': ''}, 'enp4s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '00:1b:21:2f:79:4d', 'speed': 1000, 'gateway': ''}}, 'supportsIPv6': = True, 'vlans': {'enp2s0.4': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-4', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.4', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 4, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp4s0.100': = {'iface': 'enp4s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'dmz', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0.100', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'vlanid': 100, 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': '::', = 'gateway': ''}, 'enp2s0.2': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-2', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.2', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 2, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp2s0.3': = {'iface': 'enp2s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'ovirt-3', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0.3', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 3, 'mtu': '1500', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': = '::', 'gateway': ''}}, 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', = 'ipv6autoconf': False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', = 'DEFROUTE': 'yes', 'DNS1': '127.0.0.1', 'IPADDR': '10.9.2.61', 'GATEWAY': = '10.9.2.1', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': = '255.255.255.0', 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': = '209.193.4.7', 'DEVICE': 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', = 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', = 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': '255.255.255.0', = 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': ['10.9.2.61/24'], 'mtu': = '1500', 'ipv6gateway': '::', 'ports': ['eno1']}, 'ovirt-4': {'iface': = 'ovirt-4', 'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': '10.9.3.1', 'dhcpv4': False, 'netmask': = '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.4']}, 'ovirt-2': {'iface': 'ovirt-2', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', = 'DEVICE': 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': = True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['enp2s0.2']}, 'dmz': = {'iface': 'dmz', 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': = 'legacy', 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': = False, 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['vnet0', 'enp4s0.100']}, 'ovirt-3': {'iface': 'ovirt-3', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': = 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': = 'none', 'STP': 'off', 'DEVICE': 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': = 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': = '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', = 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3']}}} MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::92::SuperVdsm.ServerCallback::(wrapper) = call getHardwareInfo with () {} MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return getHardwareInfo with {'systemProductName': '', 'systemUUID': = '20DC6410-4F9F-DF11-9A25-7 =20 =20 =20 =
Gary Pedretty = gary@ravnalaska.net <mailto:gary@eraalaska.net> Systems Manager = www.flyravn.com <http://www.flyravn.com/> Ravn Alaska /\ = 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 = fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest = commandment Serving All of Alaska / \/ /\ \ \/\ =E2=80=9CLove your = neighbor as Green, green as far as the eyes can see yourself=E2=80=9D = Matt 22:39 =
=20 =20 =20 =20 =20 =20 =20 =20 =20 =20 =20 =20 =20 =20 =20
On Aug 27, 2017, at 11:24 PM, Yaniv Kaul <ykaul@redhat.com = <mailto:ykaul@redhat.com>> wrote: =20 vdsm vds.dispatcher ERROR SSL error during reading data: unexpected = eof
Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
</span></div></span></div></span></div></span></div></span></div></span><= /div></span></div></span></div></span></div></span></div></span></div></sp= an></div></span></div></span></div></span></div></span></div></span></div>= </span></div></span></div></span></div></span></div></span></div></span><s=
</div></span></div></span></div></span></div></span></div></span></div></= span></div></span></div></span></div></span></div></span></div></span></di= v></span></div></span></div></span></div></span></div></span></div></span>= </div></span></div></span></div></span></div></span></div></span></div></s=
--Apple-Mail=_4FF6C45E-BA6F-4D95-B362-6BD30A02360C Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">The latest release 4.1 solved this issue.<div class=3D""><br = class=3D""></div><div class=3D"">gary</div><div class=3D""><br = class=3D""></div><div class=3D""><br class=3D""><div class=3D""> <div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; orphans: = auto; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); font-family: 'Lucida = Grande'; font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-align: -webkit-auto; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"color: rgb(0, 0, 0); = font-family: 'Lucida Grande'; font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: = none; white-space: normal; widows: 2; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); font-family: Helvetica; = font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-align: -webkit-auto; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: 2; text-align: = -webkit-auto; text-indent: 0px; widows: 2; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: 2; text-align: -webkit-auto; = text-indent: 0px; widows: 2; word-wrap: break-word; -webkit-nbsp-mode: = space; -webkit-line-break: after-white-space;" class=3D""><div = style=3D"orphans: 2; text-align: -webkit-auto; text-indent: 0px; widows: = 2; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: 2; text-align: = -webkit-auto; text-indent: 0px; widows: 2; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: 2; text-align: -webkit-auto; = text-indent: 0px; widows: 2; word-wrap: break-word; -webkit-nbsp-mode: = space; -webkit-line-break: after-white-space;" class=3D""><div = style=3D"orphans: 2; text-align: -webkit-auto; text-indent: 0px; widows: = 2; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: 2; text-align: = -webkit-auto; text-indent: 0px; widows: 2; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: 2; text-align: -webkit-auto; = text-indent: 0px; widows: 2; word-wrap: break-word; -webkit-nbsp-mode: = space; -webkit-line-break: after-white-space;" class=3D""><div = style=3D"orphans: 2; text-align: -webkit-auto; text-indent: 0px; widows: = 2; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: 2; text-align: = -webkit-auto; text-indent: 0px; widows: 2; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-indent: 0px; widows: 2; border-spacing: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px; font-size: = 12px;"><div class=3D"AppleMailSignature" = id=3D"2393307F-E696-4D63-8DBB-654DCF9942AA"><div class=3D""><font = face=3D"Monaco" = class=3D"">---------------------------------------------------------------= ---------</font></div><div class=3D""><font face=3D"Monaco" = class=3D"">Gary Pedretty = = <a href=3D"mailto:gary@ravnalaska.net" = class=3D"">gary@ravnalaska.net</a></font></div><div class=3D""><font = face=3D"Monaco" class=3D"">Systems Manager = = <a = href=3D"http://www.flyravn.com" = class=3D"">www.flyravn.com</a></font></div><div class=3D""><font = face=3D"Monaco" class=3D"">Ravn Alaska = /\ = = 907-450-7251</font></div><div class=3D""><font face=3D"Monaco" = class=3D"">5245 Airport Industrial Road / = \/\ 907-450-7238 = fax</font></div><div class=3D""><font face=3D"Monaco" = class=3D"">Fairbanks, Alaska 99709 /\ = / \ \ Second greatest commandment</font></div><div = class=3D""><font face=3D"Monaco" class=3D"">Serving Alaska's Interior = / \/ /\ \ \/\ "Love your = neighbor as</font></div><font face=3D"Menlo" class=3D"" style=3D"orphans: = auto; widows: auto;">White white everywhere, must be winter = yourself=E2=80=9D Matt = 22:39</font><div class=3D"" style=3D"orphans: auto; widows: auto; = font-family: Menlo;"></div><font face=3D"Menlo" class=3D"" = style=3D"orphans: auto; widows: auto;"></font><div style=3D"font-family: = 'Lucida Grande';" class=3D""><span style=3D"font-family: Monaco; = text-align: -webkit-auto;" = class=3D"">---------------------------------------------------------------= ---------</span></div><div class=3D""><br = class=3D""></div></div></span></div></span></div></span></div></span></div= pan class=3D"Apple-style-span" style=3D"font-family: 'Lucida Grande'; = border-collapse: separate; border-spacing: 0px;"><div style=3D"word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><span class=3D"Apple-style-span" = style=3D"border-collapse: separate; color: rgb(0, 0, 0); font-style: = normal; font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: = none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: = 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"font-family: = 'Lucida Grande'; border-collapse: separate; color: rgb(0, 0, 0); = font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-align: -webkit-auto; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-align: -webkit-auto; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-align: -webkit-auto; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-align: -webkit-auto; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-align: -webkit-auto; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-indent: 0px; = text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; = border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-indent: 0px; = text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; = border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-indent: 0px; = text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; = border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-indent: 0px; = text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; = border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-indent: 0px; = text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; = border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-indent: 0px; = text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; = border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-indent: 0px; = text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; = border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-indent: 0px; = text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; = border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-indent: 0px; = text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; = border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; = font-variant-position: normal; font-variant-caps: normal; = font-variant-numeric: normal; font-variant-alternates: normal; = font-variant-east-asian: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-indent: 0px; = text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; = border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; = font-variant-ligatures: normal; font-variant-position: normal; = font-variant-caps: normal; font-variant-numeric: normal; = font-variant-alternates: normal; font-variant-east-asian: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px; font-size: 12px;"><div style=3D"font-family: 'Lucida Grande';" = class=3D""><br class=3D"khtml-block-placeholder"></div><br = class=3D"Apple-interchange-newline"></span><br = class=3D"Apple-interchange-newline"></div></span></div></span></div></span= pan></div></span></div></span></div></div></div></div></div></div></div></= div></div></div></div></div></div></div></div></div></div></div></div> </div> <br class=3D""><div><blockquote type=3D"cite" class=3D""><div = class=3D"">On Aug 30, 2017, at 11:34 AM, Gary Pedretty <<a = href=3D"mailto:gary@ravnalaska.net" class=3D"">gary@ravnalaska.net</a>>= wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><meta= http-equiv=3D"Content-Type" content=3D"text/html charset=3Dutf-8" = class=3D""><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: = space; -webkit-line-break: after-white-space;" class=3D""><div class=3D"" = style=3D"font-family: LucidaGrande;">The bug I assumed this was related = to is.</div><div class=3D"" style=3D"font-family: LucidaGrande;"><br = class=3D""></div><span style=3D"font-family: LucidaGrande;" class=3D"">Bug= 1417708 - ovirt-ha-agent should reuse json-rpc connections = </span><div class=3D"" style=3D"font-family: LucidaGrande;"><br = class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">This is a glusterized 4 host self hosted engine setup. = All storage domains are glusterfs replica 3 volumes on 3 of the 4 = hosts that are part of the cluster.</div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><div class=3D"">Centos = 3.10.0-514.26.2.el7.x86_64</div></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: = LucidaGrande;">vdsm-4.18.21-1.el7.centos.x86_64</div><div class=3D"" = style=3D"font-family: = LucidaGrande;">libvirt-2.0.0-10.el7_3.9.x86_64</div><div class=3D"" = style=3D"font-family: = LucidaGrande;">glusterfs-3.7.20-1.el7.x86_64</div><div class=3D"" = style=3D"font-family: = LucidaGrande;">qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64</div><div = class=3D"" style=3D"font-family: LucidaGrande;"><br class=3D""></div><div = class=3D"" style=3D"font-family: LucidaGrande;">Host and engine are all = updated to the latest versions</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">Here are sample of messages log, vdsm,log, supervdsm.log = and mom.log</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">messages</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;"><div class=3D"">Aug 28 01:20:11 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:16 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:16 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:19 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:22 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:24 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:37 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:41 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:41 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:44 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:47 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:49 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div></div><div class=3D"" style=3D"font-family: LucidaGrande;"><br = class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">vdsm.log</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;"><div class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::bindingxmlrpc::319::vds::(wrapper) client [::1]</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from = state</div><div class=3D"">init -> state preparing</div><div = class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,242::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone)</div><div = class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,243::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return</div><div class=3D"">response: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': = '1.1', 'valid': True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': = 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': = '0.000893509', 'lastCheck': '1.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version':</div><div class=3D"">3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '1.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.1', 'valid': True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.3', 'valid':</div><div class=3D"">True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay':</div><div = class=3D"">'0.000512272', 'lastCheck': '1.1', 'valid': True}}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code':</div><div class=3D"">0,= 'actual': True, 'version': 0,</div><div class=3D"">'acquired': True, = 'delay': '0.000833501', 'lastCheck': '1.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '1.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '1.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e':</div><div class=3D"">{'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.3', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec':</div><div class=3D"">{'code': = 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': = '0.000512272', 'lastCheck': '1.1', 'valid': True}}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from = state</div><div class=3D"">preparing -> state finished</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All) Owner.cancelAll requests {}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::ref 0 aborting = False</div><div class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,243::bindingxmlrpc::331::vds::(wrapper) RPC call = storageRepoGetStats finished (code=3D0) in 0.00 seconds</div><div = class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,246::xmlrpc::91::vds.XMLRPCServer::(_process_requests) Request = handler for</div><div class=3D"">::1:51992 stopped</div><div = class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,093::fileSD::159::Storage.StorageDomainManifest::(__init__) = Reading domain in</div><div class=3D"">path = /rhev/data-center/mnt/glusterSD/glustermount:data2/2bf8f623-1d82-444e-ae16= -d32e5fe4dc9e</div><div class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,093::persistent::194::Storage.PersistentDict::(__init__) = Created a persistent</div><div class=3D"">dict with FileMetadataRW = backend</div><div class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,096::persistent::236::Storage.PersistentDict::(refresh) read = lines (FileMetadataRW)=3D['CLASS=3DData', 'DESCRIPTION=3Ddata2', = 'IOOPTIMEOUTSEC=3D10', 'LEASERETRIES=3D3', 'LEASETIMESEC=3D60', = 'LOCKPOLICY=3D', 'LOCKRENEWALINTERVALSEC=3D5', 'MASTER_VERSION=3D10', = 'POOL_DESCRIPTION=3DDefault', = 'POOL_DOMAINS=3Dcf2f4c75-966b-4f69-90a2-d8e7d21fc052:Active,5e39db25-561f-= 490a-81b6-46a7225f02b6:Active,95d4ed8a-9184-4863-84d5-af2bedd690da:Attache= d,3e04b3ad-c46c-4903-a7b2-b9af681318d9:Attached,bd1f0364-0d3a-44fa-842a-5d= 339caac412:Attached,403df7fb-6cff-46e1-8e04-41213fbc0e6e:Active,2bf8f623-1= d82-444e-ae16-d32e5fe4dc9e:Active,6654cb0c-3e57-42ca-b996-3660a3d32a43:Act= ive,88886a7d-f4cc-45a6-901e-89999aa35d78:Attached,feaebec7-aae3-45b5-9684-= 1feedede7bec:Active', 'POOL_SPM_ID=3D-1', 'POOL_SPM_LVER=3D-1',</div><div = class=3D"">'POOL_UUID=3D5990e442-0395-0118-005c-0000000003a1', = 'REMOTE_PATH=3Dglustermount:data2', 'ROLE=3DMaster', = 'SDUUID=3D2bf8f623-1d82-444e-ae16-d32e5fe4dc9e', 'TYPE=3DGLUSTERFS', = 'VERSION=3D3', = '_SHA_CKSUM=3D65b61dc4f10d80c67c6133ffaee280919458a06a']</div><div = class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,105::fileSD::679::Storage.StorageDomain::(imageGarbageCollector) = Removing remnants of deleted images []</div><div = class=3D"">Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::604::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_imageNS = already registered</div><div class=3D"">Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::612::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_volumeNS = already registered</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,244::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling</div><div class=3D"">'Host.getStats' in bridge with {}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,245::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state init = -> state preparing</div><div = class=3D"">jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone)</div><div = class=3D"">jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return response: {u'5e39db25-561f-490a-81b6-46a7225f02b6': = {'code': 0, 'actual': True, 'version': 0, 'acquired': True,</div><div = class=3D"">'delay': '0.000833501', 'lastCheck': '3.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False,</div><div class=3D"">'delay': = '0.000893509', 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': = '3.0', 'valid':</div><div class=3D"">True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.3', 'valid': True},</div><div = class=3D"">u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e':</div><div = class=3D"">{'code': 0, 'actual': True, 'version': 3, 'acquired': True, = 'delay': '0.000493711', 'lastCheck': '1.1', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired':</div><div class=3D"">True, 'delay': = '0.000512272', 'lastCheck': '3.1', 'valid': True}}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': = '3.1', 'valid': True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': = 0, 'actual':</div><div class=3D"">True, 'version': 3, 'acquired': False, = 'delay': '0.000893509', 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True,</div><div class=3D"">'delay': = '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.3', 'valid':</div><div class=3D"">True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000493711', 'lastCheck': = '1.1', 'valid': True},</div><div = class=3D"">u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, = 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000512272', = 'lastCheck': '3.1', 'valid': True}}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state = preparing -> state finished</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All)</div><div class=3D"">Owner.cancelAll requests {}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::ref 0 aborting = False</div><div class=3D"">Reactor thread::INFO::2017-08-28 = 01:21:15,291::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept)</div><div class=3D"">Accepted connection from = ::1:51994</div><div class=3D"">Reactor thread::DEBUG::2017-08-28 = 01:21:15,299::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11</div><div class=3D"">Reactor = thread::INFO::2017-08-28 = 01:21:15,301::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol stomp from ::1:51994</div><div class=3D"">Reactor = thread::INFO::2017-08-28 = 01:21:15,301::stompreactor::101::Broker.StompAdapter::(_cmd_connect) = Processing CONNECT request</div><div class=3D"">Reactor = thread::DEBUG::2017-08-28 = 01:21:15,301::stompreactor::492::protocoldetector.StompDetector::(handle_s= ocket) Stomp detected from ('::1', 51994)</div><div class=3D"">JsonRpc = (StompReactor)::INFO::2017-08-28 = 01:21:15,313::stompreactor::128::Broker.StompAdapter::(_cmd_subscribe) = Subscribe command received</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,356::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getStats' in bridge with {'cpuStatistics': {'1': = {'cpuUser': '2.27',</div><div class=3D"">'nodeIndex': 0, 'cpuSys': = '1.80', 'cpuIdle': '95.93'}, '0': {'cpuUser': '0.67', 'nodeIndex': 0, = 'cpuSys': '1.13', 'cpuIdle': '98.20'}, '3': {'cpuUser': '5.67', = 'nodeIndex': 0, 'cpuSys': '0.60', 'cpuIdle': '93.73'},</div><div = class=3D"">'2': {'cpuUser': '0.93', 'nodeIndex': 0, 'cpuSys': = '0.53',</div><div class=3D"">'cpuIdle': '98.54'}, '5': {'cpuUser': = '0.87', 'nodeIndex': 0, 'cpuSys': '1.40', 'cpuIdle': '97.73'}, '4': = {'cpuUser': '1.27', 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': = '98.20'}, '7': {'cpuUser': '0.27', 'nodeIndex': 0, 'cpuSys':</div><div = class=3D"">'0.47', 'cpuIdle': '99.26'}, '6': {'cpuUser': '2.07', = 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': '97.40'}}, = 'numaNodeMemFree': {'0': {'memPercent': 98, 'memFree': '335'}}, = 'memShared': 0,</div><div class=3D"">'haScore': 3400, 'thpState': = 'always', 'ksmMergeAcrossNodes': True, 'rxRate': '0.04', 'vmCount': 1, = 'memUsed': '41', 'storageDomains': = {u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '3.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0,</div><div = class=3D"">'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000513211', 'lastCheck': '1.3', 'valid': True}, = u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0,</div><div class=3D"">'acquired': True, 'delay': = '0.000833501', 'lastCheck': '3.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000493711', 'lastCheck': = '1.1', 'valid': True}, u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': = 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': = '0.000512272', 'lastCheck': '3.1', 'valid': True}}, = 'incomingVmMigrations': 0,</div><div class=3D"">'network': {'enp2s0': = {'rxErrors': '0', 'txRate': '0.2', 'rxRate': '0.1', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '18453', 'name': 'enp2s0', 'tx': = '884509425955', 'txDropped': '0', 'sampleTime':</div><div = class=3D"">1503912069.554311, 'rx': '134148067121', 'state': 'up'}, = 'eno1': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors':</div><div class=3D"">'0', 'speed': '1000',</div><div = class=3D"">'rxDropped': '0', 'name': 'eno1', 'tx': '54488653089', = 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': '46979728698', = 'state': 'up'}, ';vdsmdummy;': {'rxErrors': '0', 'txRate': '0.0', = 'rxRate': '0.0',</div><div class=3D"">'txErrors': '0', 'speed': '1000', = 'rxDropped': '0', 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '0', 'state': 'down'}, = 'enp2s0.4': {'rxErrors': '0', 'txRate': '0.2', 'rxRate': '0.1', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'enp2s0.4', = 'tx': '843385870486', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '124132253793', 'state': 'up'}, 'lo': {'rxErrors': '0', 'txRate': = '0.3', 'rxRate': '0.3', 'txErrors': '0', 'speed': '1000', 'rxDropped': = '0', 'name': 'lo', 'tx': '444179233658', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '444179233658', 'state': 'up'}, 'enp4s0': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '14290', 'name': 'enp4s0',</div><div = class=3D"">'tx': '9009494', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '187852658', 'state': 'up'}, = 'enp4s0.100':</div><div class=3D"">{'rxErrors': '0', 'txRate': '0.0', = 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'enp4s0.100', 'tx': '8798732', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '95777939',</div><div class=3D"">'state': = 'up'}, 'enp2s0.2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'enp2s0.2', = 'tx': '1156', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '66329343', 'state': 'up'},</div><div class=3D"">'enp2s0.3': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '0',</div><div class=3D"">'name': = 'enp2s0.3', 'tx': '1156', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '5930851', 'state': 'up'}, 'vnet0': = {'rxErrors': '0', 'txRate': '0.0',</div><div class=3D"">'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'vnet0', = 'tx': '97194738', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '8798642', 'state': 'up'}, 'ovirtmgmt':</div><div = class=3D"">{'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '2', 'name': 'ovirtmgmt', = 'tx': '52893439231', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '43528048077', 'state': 'up'}, 'ovirt-3': {'rxErrors': '0', = 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', = 'rxDropped': '2', 'name': 'ovirt-3', 'tx': '578', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '4621679',</div><div = class=3D"">'state': 'up'}, 'ovirt-4': {'rxErrors': '0', 'txRate': '0.2', = 'rxRate': '0.1', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'ovirt-4', 'tx': '843385869908', 'txDropped': '0',</div><div = class=3D"">'sampleTime': 1503912069.554311, 'rx': '124132039409', = 'state': 'up'}, 'ovirt-2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': = '0.0',</div><div class=3D"">'txErrors': '0', 'speed': '1000', = 'rxDropped': '0', 'name': 'ovirt-2', 'tx': '578', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '19462774', 'state':</div><div = class=3D"">'up'}, 'dmz': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': = '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '4', 'name': = 'dmz', 'tx': '578', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '31428052',</div><div class=3D"">'state': 'up'}}, 'txDropped': = '0', 'cpuUser': '1.75', 'ksmPages': 1250, 'elapsedTime': '127838.51', = 'cpuLoad':</div><div class=3D"">'2.39', 'cpuSys': '0.86', 'diskStats': = {'/var/log': {'free': '47378'}, '/var/log/core': {'free': '47378'}, = '/var/run/vdsm/': {'free': '7868'}, '/tmp': {'free': '47378'}}, = 'cpuUserVdsmd': '2.13', 'netConfigDirty': 'False', 'memCommitted': 2113, = 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 9216, = 'txRate': '0.06', 'bootTime': '1503727419', 'haStats': = {'active':</div><div class=3D"">True, 'configured': True, 'score': 3400, = 'localMaintenance': False, 'globalMaintenance': False}, 'momStatus': = 'active', 'rxDropped': '32751', 'outgoingVmMigrations': 0, 'swapTotal': = 7999,</div><div class=3D"">'swapFree': 7842, 'dateTime': = '2017-08-28T09:21:15 GMT', 'anonHugePages': '2280', 'memFree': 9455, = 'cpuIdle': '97.39', 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': = '0.87'}</div><div class=3D"">jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,357::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getStats succeeded in 0.12 seconds</div><div = class=3D"">jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,580::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling</div><div class=3D"">'Host.getHardwareInfo' in bridge with = {}</div><div class=3D"">jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,581::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getHardwareInfo' in bridge with {'systemProductName': '', = 'systemUUID': '20DC6410-4F9F-DF11-9A25-7071BC772964', = 'systemSerialNumber': '', 'systemVersion': '', 'systemManufacturer': = ''}</div><div class=3D"">jsonrpc.Executor/6::INFO::2017-08-28 = 01:21:15,581::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getHardwareInfo succeeded in 0.00 seconds</div><div = class=3D"">JsonRpc (StompReactor)::ERROR::2017-08-28 = 01:21:15,583::betterAsyncore::113::vds.dispatcher::(recv) SSL error = during</div><div class=3D"">reading data: unexpected eof</div><div = class=3D"">Reactor thread::INFO::2017-08-28 = 01:21:16,325::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept)</div><div class=3D"">Accepted connection from = ::1:51996</div><div class=3D"">Reactor thread::DEBUG::2017-08-28 = 01:21:16,332::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11</div><div class=3D"">Reactor = thread::INFO::2017-08-28 = 01:21:16,332::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol xml from ::1:51996</div><div class=3D"">Reactor = thread::DEBUG::2017-08-28 = 01:21:16,332::bindingxmlrpc::1307::XmlDetector::(handle_socket) xml over = http detected from ('::1', 51996)</div><div = class=3D"">BindingXMLRPC::INFO::2017-08-28 = 01:21:16,332::xmlrpc::73::vds.XMLRPCServer::(handle_request) Starting = request handler for ::1:51996</div></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;">supervdsm.log</div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,517::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev eno1 classid 0:1388 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:4 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,572::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,573::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:2 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp4s0 classid 0:64 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:3 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,689::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::vsctl::57::root::(commit) Executing commands: = /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list Port = -- list Interface</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list = Port -- list Interface (cwd</div><div class=3D"">None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,720::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,724::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return network_caps with {'bridges': {'ovirtmgmt': {'ipv6autoconf': = False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'yes', = 'DNS1': '127.0.0.1', 'IPADDR': '10.9.2.61', 'GATEWAY': '10.9.2.1', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': '209.193.4.7', 'DEVICE': = 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': = '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.2.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eno1'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '104', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.7071bc772964', 'bridge_id': '8000.7071bc772964', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '16704', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-4': {'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.9.3.1', = 'dhcpv4': False, 'netmask': '255.255.255.0', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['enp2s0.4'], 'opts': {'multicast_last_member_count': = '2', 'hash_elasticity': '4', 'multicast_query_response_interval': = '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '102', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '8307', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'dmz': {'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['vnet0', 'enp4s0.100'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '103', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.001b212f794d', 'bridge_id': '8000.001b212f794d', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '7181', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-2': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.2'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '2', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '320', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-3': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '1', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '14656', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}}, 'bondings': {}, 'nameservers': ['127.0.0.1', '209.193.4.7', = '209.112.128.2'], 'nics': {'enp2s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '68:05:ca:46:06:af', 'speed': 1000, 'gateway': ''}, 'eno1': = {'ipv6gateway': '::', 'ipv6autoconf': False, 'addr': '', 'cfg': = {'BRIDGE': 'ovirtmgmt', 'IPV6INIT': 'no', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'eno1', 'ONBOOT': = 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, 'netmask': '', = 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': '70:71:bc:77:29:64', = 'speed': 1000, 'gateway': ''}, 'enp4s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '00:1b:21:2f:79:4d', 'speed': 1000, 'gateway': ''}}, 'supportsIPv6': = True, 'vlans': {'enp2s0.4': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-4', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.4', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 4, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp4s0.100': = {'iface': 'enp4s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'dmz', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0.100', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'vlanid': 100, 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': '::', = 'gateway': ''}, 'enp2s0.2': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-2', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.2', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 2, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp2s0.3': = {'iface': 'enp2s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'ovirt-3', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0.3', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 3, 'mtu': '1500', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': = '::', 'gateway': ''}}, 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', = 'ipv6autoconf': False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', = 'DEFROUTE':</div><div class=3D"">'yes', 'DNS1': '127.0.0.1', 'IPADDR': = '10.9.2.61', 'GATEWAY': '10.9.2.1', 'DELAY': '0', 'NM_CONTROLLED': 'no', = 'NETMASK': '255.255.255.0', 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': = '209.193.4.7', 'DEVICE': 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', = 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', = 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': '255.255.255.0', = 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': ['10.9.2.61/24'], 'mtu': = '1500', 'ipv6gateway': '::', 'ports': ['eno1']}, 'ovirt-4': {'iface': = 'ovirt-4', 'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [],</div><div = class=3D"">'switch': 'legacy', 'gateway': '10.9.3.1', 'dhcpv4': False, = 'netmask': '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.4']}, 'ovirt-2': {'iface': 'ovirt-2', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', = 'DEVICE': 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': = True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['enp2s0.2']}, 'dmz': = {'iface': 'dmz', 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': = 'legacy', 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': = False, 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['vnet0', 'enp4s0.100']}, 'ovirt-3': {'iface': 'ovirt-3', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': = 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': = 'none', 'STP': 'off', 'DEVICE': 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': = 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': = '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', = 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3']}}}</div><div = class=3D"">MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::92::SuperVdsm.ServerCallback::(wrapper) = call getHardwareInfo with () {}</div><div = class=3D"">MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return getHardwareInfo with {'systemProductName': '', 'systemUUID': = '20DC6410-4F9F-DF11-9A25-7</div></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""><div class=3D""><div = class=3D"" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><font face=3D"Menlo" class=3D"" = style=3D"font-size: 12px;"><div = class=3D"">---------------------------------------------------------------= ---------</div><div class=3D"">Gary Pedretty = = <a = href=3D"mailto:gary@eraalaska.net" = class=3D"">gary@ravnalaska.net</a></div><div class=3D"">Systems Manager = = = <a href=3D"http://www.flyravn.com/" = class=3D"">www.flyravn.com</a></div><div class=3D"">Ravn Alaska = = /\ = 907-450-7251</div><div class=3D"">5245 Airport Industrial = Road / \/\ = 907-450-7238 fax</div><div class=3D"">Fairbanks, Alaska = 99709 /\ / \ \ = Second greatest commandment</div></font><font face=3D"Monaco" = class=3D""><span class=3D"" style=3D"font-size: 12px;">Serving All of = Alaska / \/ /\ \ \/\ = =E2=80=9CLove your neighbor as</span></font><br class=3D"" = style=3D"font-family: Monaco;"><font face=3D"Menlo" class=3D""><span = class=3D"" style=3D"font-size: 12px;">Green, green as far as the eyes = can see yourself=E2=80=9D Matt = 22:39</span></font><div class=3D"" style=3D"font-family: = Menlo;"></div><font face=3D"Menlo" class=3D"" style=3D"font-size: = 12px;"></font><span class=3D"" style=3D"font-size: 12px;"><font = face=3D"Menlo" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div></font></span><div class=3D""><font face=3D"Menlo" = class=3D"" style=3D"font-size: 12px;"><br = class=3D""></font></div></div><span class=3D"" style=3D"font-size: = 12px;"><br class=3D"Apple-interchange-newline"></span></div><span = class=3D"" style=3D"font-size: 12px;"><br = class=3D"Apple-interchange-newline"></span></div><span class=3D"" = style=3D"font-size: 12px;"><br = class=3D"Apple-interchange-newline"></span></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"><br = class=3D"Apple-interchange-newline"></div><br class=3D""><blockquote = type=3D"cite" class=3D"">On Aug 27, 2017, at 11:24 PM, Yaniv Kaul <<a = href=3D"mailto:ykaul@redhat.com" class=3D"">ykaul@redhat.com</a>> = wrote:<br class=3D""><br class=3D"">vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected = eof</blockquote></div></div>______________________________________________= _<br class=3D"">Users mailing list<br class=3D""><a = href=3D"mailto:Users@ovirt.org" class=3D"">Users@ovirt.org</a><br = class=3D"">http://lists.ovirt.org/mailman/listinfo/users<br = class=3D""></div></blockquote></div><br class=3D""></div></body></html>= --Apple-Mail=_4FF6C45E-BA6F-4D95-B362-6BD30A02360C--
participants (1)
-
Gary Pedretty