12:43 a.m.
After some troubles with gluster store i was found missing ovf_store file.
I recreated file with dd, but now i get errors in agent.log. What the right
way for recreate OVF_STORE file?
oVirt 4.3.
agent.log:
MainThread::ERROR::2020-07-10
11:34:19,866::agent::145::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent)
Trying to restart agent
MainThread::INFO::2020-07-10
11:34:19,866::agent::89::ovirt_hosted_engine_ha.agent.agent.Agent::(run)
Agent shutting down
MainThread::INFO::2020-07-10
11:34:30,243::agent::67::ovirt_hosted_engine_ha.agent.agent.Agent::(run)
ovirt-hosted-engine-ha agent 2.3.6 started
MainThread::INFO::2020-07-10
11:34:30,305::hosted_engine::234::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname)
Found certificate common
name: sponode1.vdispo.ru
MainThread::INFO::2020-07-10
11:34:30,421::hosted_engine::543::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker)
Initializing ha-bro
ker connection
MainThread::INFO::2020-07-10
11:34:30,423::brokerlink::80::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Starting monitor network, options {
'tcp_t_address': '', 'network_test': 'dns',
'tcp_t_port': '', 'addr':
'10.1.99.1'}
MainThread::INFO::2020-07-10
11:34:30,427::brokerlink::92::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Success, id network
MainThread::INFO::2020-07-10
11:34:30,427::brokerlink::80::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Starting monitor mgmt-bridge, optio
ns {'use_ssl': 'true', 'bridge_name': 'ovirtmgmt',
'address': '0'}
MainThread::INFO::2020-07-10
11:34:30,432::brokerlink::92::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Success, id mgmt-bridge
MainThread::INFO::2020-07-10
11:34:30,432::brokerlink::80::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Starting monitor mem-free, options
{'use_ssl': 'true', 'address': '0'}
MainThread::INFO::2020-07-10
11:34:30,434::brokerlink::92::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Success, id mem-free
MainThread::INFO::2020-07-10
11:34:30,434::brokerlink::80::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Starting monitor cpu-load-no-engine
, options {'use_ssl': 'true', 'vm_uuid':
'141397e0-050a-4e6a-9fe7-9042184ca2a8', 'address': '0'}
MainThread::INFO::2020-07-10
11:34:30,437::brokerlink::92::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Success, id cpu-load-no-engine
MainThread::INFO::2020-07-10
11:34:30,437::brokerlink::80::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Starting monitor engine-health, opt
ions {'use_ssl': 'true', 'vm_uuid':
'141397e0-050a-4e6a-9fe7-9042184ca2a8',
'address': '0'}
MainThread::INFO::2020-07-10
11:34:30,439::brokerlink::92::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Success, id engine-health
MainThread::INFO::2020-07-10
11:34:30,440::brokerlink::80::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Starting monitor storage-domain, op
tions {'sd_uuid': '927801cc-f7fc-40bb-9bb9-92b2b19a5087'}
MainThread::INFO::2020-07-10
11:34:30,441::brokerlink::92::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor)
Success, id storage-domain
MainThread::INFO::2020-07-10
11:34:30,441::hosted_engine::565::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker)
Broker initialized,
all submonitors started
MainThread::INFO::2020-07-10
11:34:30,700::upgrade::979::ovirt_hosted_engine_ha.lib.upgrade.StorageServer::(upgrade_35_36)
Host configuration is already up-to-d
ate
MainThread::INFO::2020-07-10
11:34:30,799::ovf_store::120::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan)
Found OVF_STORE: imgUUID:7a6cb900-03f2-4f3f
-915c-633482b2f28c, volUUID:1beb6ac5-b55c-44dc-8d71-7ea9e85c2909
MainThread::INFO::2020-07-10
11:34:31,353::ovf_store::120::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan)
Found OVF_STORE: imgUUID:7ae16997-0b97-4c1f
-a06b-1a57dcec7445, volUUID:ad3561e2-ae47-41e9-9e5b-c903f2391e67
MainThread::INFO::2020-07-10
11:34:31,844::ovf_store::151::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
OVF_STORE volume path: /var/run/v
dsm/storage/927801cc-f7fc-40bb-9bb9-92b2b19a5087/7ae16997-0b97-4c1f-a06b-1a57dcec7445/ad3561e2-ae47-41e9-9e5b-c903f2391e67
MainThread::ERROR::2020-07-10
11:34:31,861::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid globa
l metadata key: CAP=1073741824
MainThread::ERROR::2020-07-10
11:34:31,861::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid globa
l metadata key: CTIME=1590138019
MainThread::ERROR::2020-07-10
11:34:31,861::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid globa
l metadata key:
DESCRIPTION={"DiskAlias":"he_metadata","DiskDescription":"Hosted-Engine
metadata disk"}
MainThread::ERROR::2020-07-10
11:34:31,861::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid globa
l metadata key: DISKTYPE=HEMD
MainThread::ERROR::2020-07-10
11:34:31,861::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid globa
l metadata key: DOMAIN=927801cc-f7fc-40bb-9bb9-92b2b19a5087
MainThread::ERROR::2020-07-10
11:34:31,861::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid globa
l metadata key: FORMAT=RAW
MainThread::ERROR::2020-07-10
11:34:31,861::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid globa
l metadata key: GEN=0
MainThread::ERROR::2020-07-10
11:34:31,862::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid global metadata key: IMAGE=cdd8e110-ccae-4ff2-9215-18e04227e839
MainThread::ERROR::2020-07-10
11:34:31,862::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid global metadata key: LEGALITY=LEGAL
MainThread::ERROR::2020-07-10
11:34:31,862::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid global metadata key: PUUID=00000000-0000-0000-0000-000000000000
MainThread::ERROR::2020-07-10
11:34:31,862::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid global metadata key: TYPE=PREALLOCATED
MainThread::ERROR::2020-07-10
11:34:31,862::metadata::67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(parse_global_metadata_to_dict)
Invalid global metadata key: VOLTYPE=LEAF
MainThread::ERROR::2020-07-10
11:34:31,862::hosted_engine::452::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Unhandled monitoring loop exception
Traceback (most recent call last):
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
line 449, in start_monitoring
self._monitoring_loop()
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
line 468, in _monitoring_loop
for old_state, state, delay in self.fsm:
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py",
line 127, in next
new_data = self.refresh(self._state.data)
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py",
line 81, in refresh
stats.update(self.hosted_engine.collect_stats())
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
line 760, in collect_stats
data["cluster"] = self.process_global_metadata(all_stats.pop(0))
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
line 830, in process_global_metadata
md = metadata.parse_global_metadata_to_dict(self._log, data)
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/metadata.py",
line 63, in parse_global_metadata_to_dict
k, v = token.split('=')
ValueError: need more than 1 value to unpack
MainThread::ERROR::2020-07-10
11:34:31,864::agent::144::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent)
Traceback (most recent call last):
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
line 131, in _run_agent
return action(he)
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
line 55, in action_proper
return he.start_monitoring()
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
line 456, in start_monitoring
self.publish(stopped)
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
line 355, in publish
blocks = self._generate_local_blocks(state)
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
line 652, in _generate_local_blocks
lm = state.data.stats.local
AttributeError: 'NoneType' object has no attribute 'local'
MainThread::ERROR::2020-07-10
11:34:31,864::agent::145::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent)
Trying to restart agent
MainThread::INFO::2020-07-10
11:34:31,864::agent::89::ovirt_hosted_engine_ha.agent.agent.Agent::(run)
Agent shutting down
virt OS Version:
RHEL - 7 - 7.1908.0.el7.centos
OS Description:
CentOS Linux 7 (Core)
Kernel Version:
3.10.0 - 1127.8.2.el7.x86_64
KVM Version:
2.12.0 - 44.1.el7_8.1
LIBVIRT Version:
libvirt-4.5.0-33.el7_8.1
VDSM Version:
vdsm-4.30.46-1.el7
SPICE Version:
0.14.0 - 9.el7
GlusterFS Version:
glusterfs-7.5-1.el7
CEPH Version:
librbd1-10.2.5-4.el7
Open vSwitch Version:
openvswitch-2.11.0-4.el7
Kernel Features:
PTI: 1, IBRS: 0, RETP: 1, SSBD: 3
VNC Encryption:
Disabled