Ovirt 4.3.3 on Centos7 hosted-engine deployment failure
I've tried running the hosted-engine deployment a few times now. The deployment always fails at the "Wait for the host to be up" line. 2019-06-16 01:07:53,983-0400 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 TASK [ovirt.hosted_engine_setup : Wait for the host to be up] 2019-06-16 01:25:14,424-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:103 {u'invocation': {u'module_args': {u'all_content': False, u'pattern': u'name=master-hv.domain.com', u'fetch_nested': False, u'cluster_version': None, u'nested_attributes': []}}, u'attempts': 120, u'changed': False, u'_ans ible_no_log': False, u'ansible_facts': {u'ovirt_hosts': [{u'comment': u'', u'update_available': False, u'protocol': u'stomp', u'affinity_labels': [], u'hooks': [], u'max_scheduling_memory': 0, u'cluster': {u'ha_reservation': False, u'comment': u'', u'mac_pool': {u'href': u'/ovirt-engine/api/macpools/58ca604b-017d-0374-0220-00000000014 e', u'id': u'58ca604b-017d-0374-0220-00000000014e'}, u'threads_as_cores': False, u'networks': [], u'enabled_features': [], u'href': u'/ovirt-engine/api/clusters/09a406c8-8ff4-11e9-ab0b-00163e2e878e', u'migration': {u'policy': {u'id': u'80554327-0569-496b-bdeb-fcbbf52b827b'}, u'auto_converge': u'inherit', u'bandwidth': {u'assignment_me thod': u'auto'}, u'compressed': u'inherit'}, u'data_center': {u'href': u'/ovirt-engine/api/datacenters/099a67a8-8ff4-11e9-8f2f-00163e2e878e', u'id': u'099a67a8-8ff4-11e9-8f2f-00163e2e878e'}, u'log_max_memory_used_threshold_type': u'percentage', u'id': u'09a406c8-8ff4-11e9-ab0b-00163e2e878e', u'fencing_policy': {u'skip_if_gluster_brick s_up': False, u'skip_if_gluster_quorum_not_met': False, u'skip_if_connectivity_broken': {u'threshold': 50, u'enabled': False}, u'enabled': True, u'skip_if_sd_active': {u'enabled': False}}, u'cpu_profiles': [], u'ballooning_enabled': False, u'gluster_volumes': [], u'gluster_hooks': [], u'version': {u'major': 4, u'minor': 3}, u'ksm': {u 'enabled': True, u'merge_across_nodes': True}, u'tunnel_migration': False, u'firewall_type': u'firewalld', u'description': u'The default server cluster', u'log_max_memory_used_threshold': 95, u'gluster_service': False, u'memory_policy': {u'over_commit': {u'percent': 100}, u'transparent_huge_pages': {u'enabled': True}}, u'network_filte rs': [], u'error_handling': {u'on_error': u'migrate'}, u'scheduling_policy': {u'href': u'/ovirt-engine/api/schedulingpolicies/b4ed2332-a7ac-4d5f-9596-99a439cb2812', u'id': u'b4ed2332-a7ac-4d5f-9596-99a439cb2812'}, u'permissions': [], u'switch_type': u'legacy', u'external_network_providers': [], u'name': u'Default', u'required_rng_sour ces': [u'urandom'], u'affinity_groups': [], u'virt_service': True, u'trusted_service': False, u'cpu': {u'type': u'', u'architecture': u'undefined'}}, u'href': u'/ovirt-engine/api/hosts/fcac60cc-8736-4725-ac0e-d48a91720532', u'spm': {u'priority': 5, u'status': u'none'}, u'id': u'fcac60cc-8736-4725-ac0e-d48a91720532', u'vgpu_placement': u'consolidated', u'external_status': u'ok', u'statistics': [], u'certificate': {u'organization': u'domain.com', u'subject': u'O=domain.com,CN=master-hv.domain.com'}, u'nics': [], u'storage_connection_extensions': [], u'port': 54321, u'hardware_information': {u'supported_rng_sources': []}, u'memory': 0, u'ksm': {u'enabled': False}, u'se_linux': {}, u'type': u'rhel', u'status': u'install_failed', u'tags': [], u'katello_errata': [], u'external_network_provider_configurations': [], u'ssh': {u'port': 22, u'fingerprint': u'SHA256:f5FoZC5NcGAlW8naIc81BhV0U+ly0HTDGGX4L6Rn05k'}, u'address': u'master-hv.domain.com', u'numa_nodes': [], u'device_passthrough': {u'enabled' : False}, u'unmanaged_networks': [], u'permissions': [], u'numa_supported': False, u'power_management': {u'kdump_detection': True, u'enabled': False, u'pm_proxies': [], u'automatic_pm_enabled': True}, u'name': u'master-hv.domain.com', u'devices': [], u'summary': {u'total': 0}, u'auto_numa_status': u'unknown', u'transparent_huge_pages ': {u'enabled': False}, u'network_attachments': [], u'os': {u'custom_kernel_cmdline': u''}, u'cpu': {u'speed': 0.0, u'topology': {}}, u'kdump_status': u'unknown'}]}} 2019-06-16 01:25:14,525-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:107 fatal: [localhost]: FAILED! => {"ansible_facts": {"ovirt_hosts": [{"address": "master-hv.domain.com", "affinity_labels": [], "auto_numa_status": "unknown", "certificate": {"organization": "domain.com", "subject": "O=domain.com,CN=master-hv.domain.com"}, "cluster": {"affinity_groups": [], "ballooning_enabled": false, "comment": "", "cpu": {"architecture": "undefined", "type": ""}, "cpu_profiles": [], "data_center": {"href": "/ovirt-engine/api/datacenters/099a67a8-8ff4-11e9-8f2f-00163e2e878e", "id": "099a67a8-8ff4-11e9-8f2f-00163e2e878e"}, "descript ion": "The default server cluster", "enabled_features": [], "error_handling": {"on_error": "migrate"}, "external_network_providers": [], "fencing_policy": {"enabled": true, "skip_if_connectivity_broken": {"enabled": false, "threshold": 50}, "skip_if_gluster_bricks_up": false, "skip_if_gluster_quorum_not_met": false, "skip_if_sd_active ": {"enabled": false}}, "firewall_type": "firewalld", "gluster_hooks": [], "gluster_service": false, "gluster_volumes": [], "ha_reservation": false, "href": "/ovirt-engine/api/clusters/09a406c8-8ff4-11e9-ab0b-00163e2e878e", "id": "09a406c8-8ff4-11e9-ab0b-00163e2e878e", "ksm": {"enabled": true, "merge_across_nodes": true}, "log_max_mem ory_used_threshold": 95, "log_max_memory_used_threshold_type": "percentage", "mac_pool": {"href": "/ovirt-engine/api/macpools/58ca604b-017d-0374-0220-00000000014e", "id": "58ca604b-017d-0374-0220-00000000014e"}, "memory_policy": {"over_commit": {"percent": 100}, "transparent_huge_pages": {"enabled": true}}, "migration": {"auto_converg e": "inherit", "bandwidth": {"assignment_method": "auto"}, "compressed": "inherit", "policy": {"id": "80554327-0569-496b-bdeb-fcbbf52b827b"}}, "name": "Default", "network_filters": [], "networks": [], "permissions": [], "required_rng_sources": ["urandom"], "scheduling_policy": {"href": "/ovirt-engine/api/schedulingpolicies/b4ed2332-a7 ac-4d5f-9596-99a439cb2812", "id": "b4ed2332-a7ac-4d5f-9596-99a439cb2812"}, "switch_type": "legacy", "threads_as_cores": false, "trusted_service": false, "tunnel_migration": false, "version": {"major": 4, "minor": 3}, "virt_service": true}, "comment": "", "cpu": {"speed": 0.0, "topology": {}}, "device_passthrough": {"enabled": false}, "devices": [], "external_network_provider_configurations": [], "external_status": "ok", "hardware_information": {"supported_rng_sources": []}, "hooks": [], "href": "/ovirt-engine/api/hosts/fcac60cc-8736-4725-ac0e-d48a91720532", "id": "fcac60cc-8736-4725-ac0e-d48a91720532", "katello_errata": [], "kdump_status": "unknown", "ksm": {"enab led": false}, "max_scheduling_memory": 0, "memory": 0, "name": "master-hv.domain.com", "network_attachments": [], "nics": [], "numa_nodes": [], "numa_supported": false, "os": {"custom_kernel_cmdline": ""}, "permissions": [], "port": 54321, "power_management": {"automatic_pm_enabled": true, "enabled": false, "kdump_detection": true, " pm_proxies": []}, "protocol": "stomp", "se_linux": {}, "spm": {"priority": 5, "status": "none"}, "ssh": {"fingerprint": "SHA256:f5FoZC5NcGAlW8naIc81BhV0U+ly0HTDGGX4L6Rn05k", "port": 22}, "statistics": [], "status": "install_failed", "storage_connection_extensions": [], "summary": {"total": 0}, "tags": [], "transparent_huge_pages": {"e nabled": false}, "type": "rhel", "unmanaged_networks": [], "update_available": false, "vgpu_placement": "consolidated"}]}, "attempts": 120, "changed": false} Am I missing something? I've searched and found similar errors in previous version deployments that were found to be related to bugs, but those were said to be corrected in version 4.3.3. I'm kind of stuck at this point. Any help at all would be appreciated.
I'm having the same\similar problem. See thread I've just created: https://lists.ovirt.org/archives/list/users@ovirt.org/thread/J65PSDSA2HR4KOC... After the setup process fails, you should be able to browse to the oVirt webui https://<host>:6900, you'll see your host is in state "unassigned". You'll also be able to browse to your host UI: https://<host>:9090 and access the engine VM console. Does it have an IP on the 192.168 range or your main bridge network range? I've read reports that others have had success within the oVirt webui (https://<host>:6900): Compute – Hosts – Click on your Host and then click the Network Interfaces tab and “Setup Host Networks” button. Add the ovirtmgmt management network to the appropriate interface. But this didn't work for me (errored when trying to save change). Pls report back how you get on.
Yes, my IPs for HV and the hosted-engine are in the 192.168 range. It's strange. I had no interfaces listed when I selected my host. I had to "Activate" the host first. I then received the following error message when trying to add the ovirtmgmt network to my interface: "Error while executing action: master-hv.domain.com: Cannot setup Networks. Network ovirtmgmt is already attached via attachment 72250787-c9c7-4175-8170-d864f0d9fede. A new attachment cannot be used for the same network, please reuse the existing one."
It looks like ovirtmgmt attached to em1 properly, but I have several errors and alerts now VDSM master-hv.domain.com command SetVmTicketVDS failed: General Exception: ("internal error: unable to execute QEMU command 'set_password': Could not set password",) When I look at the hosted-engine VM, there aren't any network interfaces listed. When I try to create one, I get the following error: Error while executing action: external-HostedEngineLocal: Cannot add Interface. This VM is not managed by the engine. I'm not quite sure of the current state of the deployment. It looks like the engine VM was created and is running, but is not managing itself?
Yeh, I'm pretty scoobied too. I'm tried with\without bond, with\without DHCP for the engine IP. I'm trying plain centos now instead of using Node for the host.
Good luck! It's funny. I've been considering starting over with Node since Centos isn't working out for me as the host. I'm to the point now where I'm just wondering if I should cut my losses with oVirt. I was REALLY looking forward to getting this to work properly and learning through the process. :( That being said, please let me know if you hear anything further or happen to figure out what the deal is. I'll try to keep the faith for a bit longer.
Fixed my problem. I had a duplicate DNS IP address in my /etc/resolv.conf. Removing the duplicate and adding the host again worked :-) See further details how I deduced this in thread here: https://lists.ovirt.org/archives/list/users@ovirt.org/thread/J65PSDSA2HR4KOC... Please report back if this also works for you.
Nah, my /etc/resolv.conf just says "#Generated by networkmanager and one line that says "search mydomain.com "
participants (2)
-
dustenwithane＠gmail.com -
me＠brendanh.com