Updating hosted-engine from 4.4.5 to latest(4.4.9) fail with "DNF name '_get_key_for_package' is not defined"

Hi! I'm having issue updating my nodes, normally I just clicked on them and update each of them without problem. I haven't updated since few months, now I'm unable to. So I checked the doc and saw that I probably should update my engine first so that's what I tried. Info on my setup: 2 nodes hosted-engine is ran as a vm on the same cluster storage is hosted on a NFS share on my qnap. I'm following the doc (https://www.ovirt.org/documentation/upgrade_guide/#updates-between-minor-rel...) Fast recap I've put hosted-engine in global maintenance mode, installed the latest ovirt-release44.rpm on engine, engine-upgrade-check, yum update ovirt\*setup\* and finally ran the engine-setup which did not complete successfully.. Here's the error I get: [....] [ INFO ] DNF Downloaded python3-numexpr-2.7.1-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded perl-encoding-2.22-3.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded libXft-2.3.3-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded libXi-1.7.10-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded mcpp-2.7.2-20.el8.x86_64.rpm SKIPPED Already downloaded [ ERROR ] DNF name '_get_key_for_package' is not defined [ ERROR ] Failed to execute stage 'Package installation': name '_get_key_for_package' is not defined [ INFO ] DNF Performing DNF transaction rollback [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20211126111800-qsadme.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20211126111839-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed I can't find more info in the log specified in the output, I understand there's something wrong with the list of packages the script try to load/update but can't find any bug reports or other people having this issue so I'm running out of idea.. Anybody have a solutions to try fixing this and complete my engine upgrade to 4.4.9? Thanks a lot, have a great day!!

On Sat, Nov 27, 2021 at 2:01 AM <rene.purcell@gmail.com> wrote:
Hi! I'm having issue updating my nodes, normally I just clicked on them and update each of them without problem. I haven't updated since few months, now I'm unable to. So I checked the doc and saw that I probably should update my engine first so that's what I tried.
Info on my setup: 2 nodes hosted-engine is ran as a vm on the same cluster storage is hosted on a NFS share on my qnap.
I'm following the doc (https://www.ovirt.org/documentation/upgrade_guide/#updates-between-minor-rel...) Fast recap I've put hosted-engine in global maintenance mode, installed the latest ovirt-release44.rpm on engine, engine-upgrade-check, yum update ovirt\*setup\* and finally ran the engine-setup which did not complete successfully..
Here's the error I get: [....] [ INFO ] DNF Downloaded python3-numexpr-2.7.1-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded perl-encoding-2.22-3.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded libXft-2.3.3-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded libXi-1.7.10-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded mcpp-2.7.2-20.el8.x86_64.rpm SKIPPED Already downloaded [ ERROR ] DNF name '_get_key_for_package' is not defined [ ERROR ] Failed to execute stage 'Package installation': name '_get_key_for_package' is not defined [ INFO ] DNF Performing DNF transaction rollback [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20211126111800-qsadme.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20211126111839-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed
I can't find more info in the log specified in the output,
Can you please share relevant snippets from there? Perhaps stack traces containing the reference to _get_key_for_package? If unsure, please share the entire log file. Thanks.
I understand there's something wrong with the list of packages the script try to load/update but can't find any bug reports or other people having this issue so I'm running out of idea..
Anybody have a solutions to try fixing this and complete my engine upgrade to 4.4.9?
Please provide also the output of 'rpm -q dnf'. Thanks. Might be related to: https://bugzilla.redhat.com/1344270 Best regards, -- Didi

Hi, thanks a lot for taking time to help, here's the snippet I took from ovirt-engine-setup-20211126111800-qsadme.log, I think it might contain important info: https://pastebin.com/kmKCCX48 I'm not sure I can/should send the complete file on the list so I'm sending it directly to your email in case I missed something in the logfile. Thanks again, have a great day!! On Sun, Nov 28, 2021 at 1:31 AM Yedidyah Bar David <didi@redhat.com> wrote:
On Sat, Nov 27, 2021 at 2:01 AM <rene.purcell@gmail.com> wrote:
Hi! I'm having issue updating my nodes, normally I just clicked on them
and update each of them without problem. I haven't updated since few months, now I'm unable to. So I checked the doc and saw that I probably should update my engine first so that's what I tried.
Info on my setup: 2 nodes hosted-engine is ran as a vm on the same cluster storage is hosted on a NFS share on my qnap.
I'm following the doc (
https://www.ovirt.org/documentation/upgrade_guide/#updates-between-minor-rel...) Fast recap I've put hosted-engine in global maintenance mode, installed the latest ovirt-release44.rpm on engine, engine-upgrade-check, yum update ovirt\*setup\* and finally ran the engine-setup which did not complete successfully..
Here's the error I get: [....] [ INFO ] DNF Downloaded python3-numexpr-2.7.1-1.el8.x86_64.rpm SKIPPED
Already downloaded
[ INFO ] DNF Downloaded perl-encoding-2.22-3.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded libXft-2.3.3-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded libXi-1.7.10-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded mcpp-2.7.2-20.el8.x86_64.rpm SKIPPED Already downloaded [ ERROR ] DNF name '_get_key_for_package' is not defined [ ERROR ] Failed to execute stage 'Package installation': name '_get_key_for_package' is not defined [ INFO ] DNF Performing DNF transaction rollback [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20211126111800-qsadme.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20211126111839-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed
I can't find more info in the log specified in the output,
Can you please share relevant snippets from there? Perhaps stack traces containing the reference to _get_key_for_package? If unsure, please share the entire log file. Thanks.
I understand there's something wrong with the list of packages the script try to load/update but can't find any bug reports or other people having this issue so I'm running out of idea..
Anybody have a solutions to try fixing this and complete my engine upgrade to 4.4.9?
Please provide also the output of 'rpm -q dnf'. Thanks.
Might be related to:
https://bugzilla.redhat.com/1344270
Best regards, -- Didi

Sorry, I forgot about the dnf.. here it is: # rpm -q dnf dnf-4.2.23-4.el8.noarch On Sun, Nov 28, 2021 at 1:31 AM Yedidyah Bar David <didi@redhat.com> wrote:
On Sat, Nov 27, 2021 at 2:01 AM <rene.purcell@gmail.com> wrote:
Hi! I'm having issue updating my nodes, normally I just clicked on them
and update each of them without problem. I haven't updated since few months, now I'm unable to. So I checked the doc and saw that I probably should update my engine first so that's what I tried.
Info on my setup: 2 nodes hosted-engine is ran as a vm on the same cluster storage is hosted on a NFS share on my qnap.
I'm following the doc (
https://www.ovirt.org/documentation/upgrade_guide/#updates-between-minor-rel...) Fast recap I've put hosted-engine in global maintenance mode, installed the latest ovirt-release44.rpm on engine, engine-upgrade-check, yum update ovirt\*setup\* and finally ran the engine-setup which did not complete successfully..
Here's the error I get: [....] [ INFO ] DNF Downloaded python3-numexpr-2.7.1-1.el8.x86_64.rpm SKIPPED
Already downloaded
[ INFO ] DNF Downloaded perl-encoding-2.22-3.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded libXft-2.3.3-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded libXi-1.7.10-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded mcpp-2.7.2-20.el8.x86_64.rpm SKIPPED Already downloaded [ ERROR ] DNF name '_get_key_for_package' is not defined [ ERROR ] Failed to execute stage 'Package installation': name '_get_key_for_package' is not defined [ INFO ] DNF Performing DNF transaction rollback [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20211126111800-qsadme.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20211126111839-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed
I can't find more info in the log specified in the output,
Can you please share relevant snippets from there? Perhaps stack traces containing the reference to _get_key_for_package? If unsure, please share the entire log file. Thanks.
I understand there's something wrong with the list of packages the script try to load/update but can't find any bug reports or other people having this issue so I'm running out of idea..
Anybody have a solutions to try fixing this and complete my engine upgrade to 4.4.9?
Please provide also the output of 'rpm -q dnf'. Thanks.
Might be related to:
https://bugzilla.redhat.com/1344270
Best regards, -- Didi

Allright after reading the bug report you've shared and looking again at the logs I felt you were right on it, so I tried to update dnf to the latest version, put hosted-engine in global maintenance and then rerun engine-setup. It looks like the problem is fixed, thanks a lot again!! [ INFO ] Execution of setup completed successfully After the update: # rpm -q dnf dnf-4.7.0-4.el8.noarch On Sun, Nov 28, 2021 at 10:54 PM Rene Jr Purcell <rene.purcell@gmail.com> wrote:
Sorry, I forgot about the dnf.. here it is:
# rpm -q dnf dnf-4.2.23-4.el8.noarch
On Sun, Nov 28, 2021 at 1:31 AM Yedidyah Bar David <didi@redhat.com> wrote:
On Sat, Nov 27, 2021 at 2:01 AM <rene.purcell@gmail.com> wrote:
Hi! I'm having issue updating my nodes, normally I just clicked on them
and update each of them without problem. I haven't updated since few months, now I'm unable to. So I checked the doc and saw that I probably should update my engine first so that's what I tried.
Info on my setup: 2 nodes hosted-engine is ran as a vm on the same cluster storage is hosted on a NFS share on my qnap.
I'm following the doc (
https://www.ovirt.org/documentation/upgrade_guide/#updates-between-minor-rel...) Fast recap I've put hosted-engine in global maintenance mode, installed the latest ovirt-release44.rpm on engine, engine-upgrade-check, yum update ovirt\*setup\* and finally ran the engine-setup which did not complete successfully..
Here's the error I get: [....] [ INFO ] DNF Downloaded python3-numexpr-2.7.1-1.el8.x86_64.rpm SKIPPED
Already downloaded
[ INFO ] DNF Downloaded perl-encoding-2.22-3.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded libXft-2.3.3-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded libXi-1.7.10-1.el8.x86_64.rpm SKIPPED Already downloaded [ INFO ] DNF Downloaded mcpp-2.7.2-20.el8.x86_64.rpm SKIPPED Already downloaded [ ERROR ] DNF name '_get_key_for_package' is not defined [ ERROR ] Failed to execute stage 'Package installation': name '_get_key_for_package' is not defined [ INFO ] DNF Performing DNF transaction rollback [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20211126111800-qsadme.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20211126111839-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed
I can't find more info in the log specified in the output,
Can you please share relevant snippets from there? Perhaps stack traces containing the reference to _get_key_for_package? If unsure, please share the entire log file. Thanks.
I understand there's something wrong with the list of packages the script try to load/update but can't find any bug reports or other people having this issue so I'm running out of idea..
Anybody have a solutions to try fixing this and complete my engine upgrade to 4.4.9?
Please provide also the output of 'rpm -q dnf'. Thanks.
Might be related to:
https://bugzilla.redhat.com/1344270
Best regards, -- Didi

On Mon, Nov 29, 2021 at 6:06 AM Rene Jr Purcell <rene.purcell@gmail.com> wrote:
Allright after reading the bug report you've shared and looking again at the logs I felt you were right on it, so I tried to update dnf to the latest version, put hosted-engine in global maintenance and then rerun engine-setup. It looks like the problem is fixed, thanks a lot again!!
[ INFO ] Execution of setup completed successfully
After the update: # rpm -q dnf dnf-4.7.0-4.el8.noarch
On Sun, Nov 28, 2021 at 10:54 PM Rene Jr Purcell <rene.purcell@gmail.com> wrote:
Sorry, I forgot about the dnf.. here it is:
# rpm -q dnf dnf-4.2.23-4.el8.noarch
Thanks for the report! Best regards, -- Didi
participants (3)
-
Rene Jr Purcell
-
rene.purcell@gmail.com
-
Yedidyah Bar David