New host deployment failed: Task Configure OVN for oVirt failed to execute.

Hi there, I have been trying to deploy a new host to my cluster and have been having some difficulties with one part of the installation. I've tried to add this host a few different times, and each time I get the same error. Current troubleshooting steps tried: Used three different distros: CentOS 9, oVirt Node 4.5.5, Rocky Linux 9,1 Used two separate machines with different network card configurations. Used both the stable and nightly branches. Workaround tried: Manually configuring the host networks through the "Network Interfaces" tab. Manually activated the host after the install failed - host is set to active state. This workaround seems to work; however, whenever any VMs are migrated to the host, they fail with the error 'Fatal exception'. Here is the error log: 2023-04-24 15:21:11 UTC - TASK [ovirt-provider-ovn-driver : Configure OVN for oVirt] ********************* 2023-04-24 15:21:14 UTC - { "uuid" : "2b0f6916-ce5d-4f94-b153-972c1d7c5c38", "counter" : 423, "stdout" : "fatal: [node.example.org]: FAILED! => {\"changed\": true, \"cmd\": [\"vdsm-tool\", \"ovn-config\", \"10.0.0.2\", \"node.example.org\"], \"delta\": \"0:00:02.351900\", \"end\": \"2023-04-24 11:21:11.968404\", \"msg\": \"non-zero return code\", \"rc\": 1, \"start\": \"2023-04-24 11:21:09.616504\", \"stderr\": \"Traceback (most recent call last):\\n File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 117, in get_network\\n return networks[net_name]\\nKeyError: 'node.example.org'\\n\\nDuring handling of the above exception, another exception occurred:\\n\\nTraceback (most recent call last):\\n File \\\"/usr/bin/vdsm-tool\\\", line 195, in main\\n return tool_command[cmd][\\\"command\\\"](*args)\\n File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 63, in ovn_config\\n ip_address = get_ip_addr(get_network(network_caps(), net_name))\\n File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 119, in get_network\\n raise NetworkNotFoundError(net_name)\\nvdsm.tool.ovn_config.NetworkNotFoundError: node.example.org\", \"stderr_lines\": [\"Traceback (most recent call last):\", \" File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 117, in get_network\", \" return networks[net_name]\", \"KeyError: 'node.example.org'\", \"\", \"During handling of the above exception, another exception occurred:\", \"\", \"Traceback (most recent call last):\", \" File \\\"/usr/bin/vdsm-tool\\\", line 195, in main\", \" return tool_command[cmd][\\\"command\\\"](*args)\", \" File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 63, in ovn_config\", \" ip_address = get_ip_addr(get_network(network_caps(), net_name))\", \" File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 119, in get_network\", \" raise NetworkNotFoundError(net_name)\", \"vdsm.tool.ovn_config.NetworkNotFoundError: node.example.org\"], \"stdout\": \"\", \"stdout_lines\": []}", "start_line" : 416, "end_line" : 417, "runner_ident" : "a36144c0-97bc-4170-8f9e-1c2fbc10b7c3", "event" : "runner_on_failed", "pid" : 91786, "created" : "2023-04-24T15:21:11.993278", "parent_uuid" : "00163e19-a0e7-c330-a021-000000000041", "event_data" : { "playbook" : "ovirt-host-deploy.yml", "playbook_uuid" : "86e8189d-85f0-4040-9615-8eb13e614105", "play" : "all", "play_uuid" : "00163e19-a0e7-c330-a021-000000000002", "play_pattern" : "all", "task" : "Configure OVN for oVirt", "task_uuid" : "00163e19-a0e7-c330-a021-000000000041", "task_action" : "ansible.builtin.command", "task_args" : "", "task_path" : "/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-provider-ovn-driver/tasks/configure.yml:43", "role" : "ovirt-provider-ovn-driver", "host" : "node.example.org", "remote_addr" : "node.example.org", "res" : { "changed" : true, "stdout" : "", "stderr" : "Traceback (most recent call last):\n File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 117, in get_network\n return networks[net_name]\nKeyError: 'node.example.org'\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"/usr/bin/vdsm-tool\", line 195, in main\n return tool_command[cmd][\"command\"](*args)\n File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 63, in ovn_config\n ip_address = get_ip_addr(get_network(network_caps(), net_name))\n File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 119, in get_network\n raise NetworkNotFoundError(net_name)\nvdsm.tool.ovn_config.NetworkNotFoundError: node.example.org", "rc" : 1, "cmd" : [ "vdsm-tool", "ovn-config", "10.0.0.2", "node.example.org" ], "start" : "2023-04-24 11:21:09.616504", "end" : "2023-04-24 11:21:11.968404", "delta" : "0:00:02.351900", "msg" : "non-zero return code", "invocation" : { "module_args" : { "_raw_params" : "vdsm-tool ovn-config 10.0.0.2 node.example.org\n", "_uses_shell" : false, "stdin_add_newline" : true, "strip_empty_ends" : true, "argv" : null, "chdir" : null, "executable" : null, "creates" : null, "removes" : null, "stdin" : null } }, "stdout_lines" : [ ], "stderr_lines" : [ "Traceback (most recent call last):", " File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 117, in get_network", " return networks[net_name]", "KeyError: 'node.example.org'", "", "During handling of the above exception, another exception occurred:", "", "Traceback (most recent call last):", " File \"/usr/bin/vdsm-tool\", line 195, in main", " return tool_command[cmd][\"command\"](*args)", " File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 63, in ovn_config", " ip_address = get_ip_addr(get_network(network_caps(), net_name))", " File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 119, in get_network", " raise NetworkNotFoundError(net_name)", "vdsm.tool.ovn_config.NetworkNotFoundError: node.example.org" ], "_ansible_no_log" : null }, "start" : "2023-04-24T15:21:09.330408", "end" : "2023-04-24T15:21:11.993114", "duration" : 2.662706, "ignore_errors" : null, "event_loop" : null, "uuid" : "2b0f6916-ce5d-4f94-b153-972c1d7c5c38" } } Has anyone been experiencing the same issues? Cheers, Xavier Lauzon
participants (1)
-
Xavier Lauzon