8:54 p.m.
Hi there,
I have been trying to deploy a new host to my cluster and have been having some
difficulties with one part of the installation. I've tried to add this host a few
different times, and each time I get the same error.
Current troubleshooting steps tried:
Used three different distros: CentOS 9, oVirt Node 4.5.5, Rocky Linux 9,1
Used two separate machines with different network card configurations.
Used both the stable and nightly branches.
Workaround tried:
Manually configuring the host networks through the "Network Interfaces" tab.
Manually activated the host after the install failed - host is set to active state.
This workaround seems to work; however, whenever any VMs are migrated to the host, they
fail with the error 'Fatal exception'.
Here is the error log:
2023-04-24 15:21:11 UTC - TASK [ovirt-provider-ovn-driver : Configure OVN for oVirt]
*********************
2023-04-24 15:21:14 UTC - {
"uuid" : "2b0f6916-ce5d-4f94-b153-972c1d7c5c38",
"counter" : 423,
"stdout" : "fatal: [node.example.org]: FAILED! =>
{\"changed\": true, \"cmd\": [\"vdsm-tool\",
\"ovn-config\", \"10.0.0.2\", \"node.example.org\"],
\"delta\": \"0:00:02.351900\", \"end\": \"2023-04-24
11:21:11.968404\", \"msg\": \"non-zero return code\",
\"rc\": 1, \"start\": \"2023-04-24 11:21:09.616504\",
\"stderr\": \"Traceback (most recent call last):\\n File
\\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 117, in
get_network\\n return networks[net_name]\\nKeyError:
'node.example.org'\\n\\nDuring handling of the above exception, another exception
occurred:\\n\\nTraceback (most recent call last):\\n File
\\\"/usr/bin/vdsm-tool\\\", line 195, in main\\n return
tool_command[cmd][\\\"command\\\"](*args)\\n File
\\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 63, in
ovn_config\\n ip_address = get_ip_addr(get_network(network_caps(), net_name))\\n File
\\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 119,
in get_network\\n raise
NetworkNotFoundError(net_name)\\nvdsm.tool.ovn_config.NetworkNotFoundError:
node.example.org\", \"stderr_lines\": [\"Traceback (most recent call
last):\", \" File
\\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 117, in
get_network\", \"
return networks[net_name]\", \"KeyError: 'node.example.org'\",
\"\", \"During handling of the above exception, another exception
occurred:\", \"\", \"Traceback (most recent call last):\",
\" File \\\"/usr/bin/vdsm-tool\\\", line 195, in main\", \"
return tool_command[cmd][\\\"command\\\"](*args)\", \" File
\\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 63, in
ovn_config\", \" ip_address = get_ip_addr(get_network(network_caps(),
net_name))\", \" File
\\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 119, in
get_network\", \" raise NetworkNotFoundError(net_name)\",
\"vdsm.tool.ovn_config.NetworkNotFoundError: node.example.org\"],
\"stdout\": \"\", \"stdout_lines\": []}",
"start_line" : 416,
"end_line" : 417,
"runner_ident" : "a36144c0-97bc-4170-8f9e-1c2fbc10b7c3",
"event" : "runner_on_failed",
"pid" : 91786,
"created" : "2023-04-24T15:21:11.993278",
"parent_uuid" : "00163e19-a0e7-c330-a021-000000000041",
"event_data" : {
"playbook" : "ovirt-host-deploy.yml",
"playbook_uuid" : "86e8189d-85f0-4040-9615-8eb13e614105",
"play" : "all",
"play_uuid" : "00163e19-a0e7-c330-a021-000000000002",
"play_pattern" : "all",
"task" : "Configure OVN for oVirt",
"task_uuid" : "00163e19-a0e7-c330-a021-000000000041",
"task_action" : "ansible.builtin.command",
"task_args" : "",
"task_path" :
"/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-provider-ovn-driver/tasks/configure.yml:43",
"role" : "ovirt-provider-ovn-driver",
"host" : "node.example.org",
"remote_addr" : "node.example.org",
"res" : {
"changed" : true,
"stdout" : "",
"stderr" : "Traceback (most recent call last):\n File
\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 117, in
get_network\n return networks[net_name]\nKeyError: 'node.example.org'\n\nDuring
handling of the above exception, another exception occurred:\n\nTraceback (most recent
call last):\n File \"/usr/bin/vdsm-tool\", line 195, in main\n return
tool_command[cmd][\"command\"](*args)\n File
\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 63, in
ovn_config\n ip_address = get_ip_addr(get_network(network_caps(), net_name))\n File
\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 119, in
get_network\n raise
NetworkNotFoundError(net_name)\nvdsm.tool.ovn_config.NetworkNotFoundError:
node.example.org",
"rc" : 1,
"cmd" : [ "vdsm-tool", "ovn-config",
"10.0.0.2", "node.example.org" ],
"start" : "2023-04-24 11:21:09.616504",
"end" : "2023-04-24 11:21:11.968404",
"delta" : "0:00:02.351900",
"msg" : "non-zero return code",
"invocation" : {
"module_args" : {
"_raw_params" : "vdsm-tool ovn-config 10.0.0.2
node.example.org\n",
"_uses_shell" : false,
"stdin_add_newline" : true,
"strip_empty_ends" : true,
"argv" : null,
"chdir" : null,
"executable" : null,
"creates" : null,
"removes" : null,
"stdin" : null
}
},
"stdout_lines" : [ ],
"stderr_lines" : [ "Traceback (most recent call last):", "
File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 117, in
get_network", " return networks[net_name]", "KeyError:
'node.example.org'", "", "During handling of the above
exception, another exception occurred:", "", "Traceback (most recent
call last):", " File \"/usr/bin/vdsm-tool\", line 195, in main",
" return tool_command[cmd][\"command\"](*args)", " File
\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 63, in
ovn_config", " ip_address = get_ip_addr(get_network(network_caps(),
net_name))", " File
\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 119, in
get_network", " raise NetworkNotFoundError(net_name)",
"vdsm.tool.ovn_config.NetworkNotFoundError: node.example.org" ],
"_ansible_no_log" : null
},
"start" : "2023-04-24T15:21:09.330408",
"end" : "2023-04-24T15:21:11.993114",
"duration" : 2.662706,
"ignore_errors" : null,
"event_loop" : null,
"uuid" : "2b0f6916-ce5d-4f94-b153-972c1d7c5c38"
}
}
Has anyone been experiencing the same issues?
Cheers,
Xavier Lauzon