ovirt local storage getConnectedStoragePoolsList empty result problem

hi, ovirt 4.4.10 one host become unresponsive (no known change) host rocky linux 8.6 (upgraded to 8.7 now) + local storage (/vm) host vdsm.log 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList() from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:48) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:54) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:735) any tips howto debug StoragePool? Marek

Il giorno lun 12 dic 2022 alle ore 16:50 marek <cervajs64@gmail.com> ha scritto:
hi,
ovirt 4.4.10
one host become unresponsive (no known change)
host rocky linux 8.6 (upgraded to 8.7 now) + local storage (/vm)
Please note 8.7 support has been introduced in oVirt 4.5.4. Please upgrade as soon as practical.
host vdsm.log
2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList() from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:48) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:54) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:735)
any tips howto debug StoragePool?
Marek
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/B5CFF2SPZEQCUG...
-- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System Red Hat EMEA <https://www.redhat.com/> sbonazzo@redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

additional info # vdsm-client Host getConnectedStoragePools [] 2022-12-12 16:04:12,613+0100 ERROR (jsonrpc/4) [jsonrpc.JsonRpcServer] Internal server error (__init__:354) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/yajsonrpc/__init__.py", line 349, in _handle_request res = method(**params) File "/usr/lib/python3.6/site-packages/vdsm/rpc/Bridge.py", line 180, in _dynamicMethod api = self._get_api_instance(className, argobj) File "/usr/lib/python3.6/site-packages/vdsm/rpc/Bridge.py", line 165, in _get_api_instance return apiObj(*ctorArgs) TypeError: __init__() missing 1 required positional argument: 'UUID' @sandro you mean that ovirt engine (4.4.10 on centos8 stream) vs (ovirt host 4.4.10 on rocky 8.7) can be problem? Dne 12/12/2022 v 17:01 Sandro Bonazzola napsal(a):
Il giorno lun 12 dic 2022 alle ore 16:50 marek <cervajs64@gmail.com> ha scritto:
hi,
ovirt 4.4.10
one host become unresponsive (no known change)
host rocky linux 8.6 (upgraded to 8.7 now) + local storage (/vm)
Please note 8.7 support has been introduced in oVirt 4.5.4. Please upgrade as soon as practical.
host vdsm.log
2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList() from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:48) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:54) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:735)
any tips howto debug StoragePool?
Marek
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/B5CFF2SPZEQCUG...
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System
Red Hat EMEA <https://www.redhat.com/>
sbonazzo@redhat.com
*Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. * *
*

Il giorno lun 12 dic 2022 alle ore 17:12 marek <cervajs64@gmail.com> ha scritto:
additional info
# vdsm-client Host getConnectedStoragePools []
2022-12-12 16:04:12,613+0100 ERROR (jsonrpc/4) [jsonrpc.JsonRpcServer] Internal server error (__init__:354) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/yajsonrpc/__init__.py", line 349, in _handle_request res = method(**params) File "/usr/lib/python3.6/site-packages/vdsm/rpc/Bridge.py", line 180, in _dynamicMethod api = self._get_api_instance(className, argobj) File "/usr/lib/python3.6/site-packages/vdsm/rpc/Bridge.py", line 165, in _get_api_instance return apiObj(*ctorArgs) TypeError: __init__() missing 1 required positional argument: 'UUID'
@sandro
you mean that ovirt engine (4.4.10 on centos8 stream) vs (ovirt host 4.4.10 on rocky 8.7) can be problem?
For the specific issue in the above traceback, no I don't think it's due to 8.7/Stream. Looks like something related to the bridge. @Martin Perina <mperina@redhat.com> ? But in general, if you upgrade to recent CentOS Stream or to EL 8.7 you should upgrade ovirt as well as the underlying OS has some changes which require alignment within ovirt code.
Dne 12/12/2022 v 17:01 Sandro Bonazzola napsal(a):
Il giorno lun 12 dic 2022 alle ore 16:50 marek <cervajs64@gmail.com> ha scritto:
hi,
ovirt 4.4.10
one host become unresponsive (no known change)
host rocky linux 8.6 (upgraded to 8.7 now) + local storage (/vm)
Please note 8.7 support has been introduced in oVirt 4.5.4. Please upgrade as soon as practical.
host vdsm.log
2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList() from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:48) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:54) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:735)
any tips howto debug StoragePool?
Marek
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/B5CFF2SPZEQCUG...
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System
Red Hat EMEA <https://www.redhat.com/>
sbonazzo@redhat.com <https://www.redhat.com/>
*Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. *
-- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System Red Hat EMEA <https://www.redhat.com/> sbonazzo@redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

On Mon, Dec 12, 2022 at 5:36 PM Sandro Bonazzola <sbonazzo@redhat.com> wrote:
Il giorno lun 12 dic 2022 alle ore 17:12 marek <cervajs64@gmail.com> ha scritto:
additional info
# vdsm-client Host getConnectedStoragePools []
2022-12-12 16:04:12,613+0100 ERROR (jsonrpc/4) [jsonrpc.JsonRpcServer] Internal server error (__init__:354) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/yajsonrpc/__init__.py", line 349, in _handle_request res = method(**params) File "/usr/lib/python3.6/site-packages/vdsm/rpc/Bridge.py", line 180, in _dynamicMethod api = self._get_api_instance(className, argobj) File "/usr/lib/python3.6/site-packages/vdsm/rpc/Bridge.py", line 165, in _get_api_instance return apiObj(*ctorArgs) TypeError: __init__() missing 1 required positional argument: 'UUID'
@sandro
you mean that ovirt engine (4.4.10 on centos8 stream) vs (ovirt host 4.4.10 on rocky 8.7) can be problem?
4.4.10 has been tested only on CS8 (around the time when CS8 contained packages for upcoming 8.6 release ) or 8.6. When you have upgraded to the latest 8.7 you should also upgrade o 4.5.4. When using CentOS Stream you should really always use latest engine, we are still trying to react on any breakages comming from stream and fixed them in latest oVirt releases
For the specific issue in the above traceback, no I don't think it's due to 8.7/Stream. Looks like something related to the bridge. @Martin Perina <mperina@redhat.com> ?
Albert, do you know of any fixes around getConnectedStoragePools between 4.4.10 and 4.5.4?
But in general, if you upgrade to recent CentOS Stream or to EL 8.7 you should upgrade ovirt as well as the underlying OS has some changes which require alignment within ovirt code.
Dne 12/12/2022 v 17:01 Sandro Bonazzola napsal(a):
Il giorno lun 12 dic 2022 alle ore 16:50 marek <cervajs64@gmail.com> ha scritto:
hi,
ovirt 4.4.10
one host become unresponsive (no known change)
host rocky linux 8.6 (upgraded to 8.7 now) + local storage (/vm)
Please note 8.7 support has been introduced in oVirt 4.5.4. Please upgrade as soon as practical.
host vdsm.log
2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList() from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:48) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:54) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:735)
any tips howto debug StoragePool?
Marek
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/B5CFF2SPZEQCUG...
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System
Red Hat EMEA <https://www.redhat.com/>
sbonazzo@redhat.com <https://www.redhat.com/>
*Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. *
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System
Red Hat EMEA <https://www.redhat.com/>
sbonazzo@redhat.com <https://www.redhat.com/>
*Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*
-- Martin Perina Manager, Software Engineering Red Hat Czech s.r.o.

On Tue, Dec 13, 2022 at 12:26 PM Martin Perina <mperina@redhat.com> wrote:
On Mon, Dec 12, 2022 at 5:36 PM Sandro Bonazzola <sbonazzo@redhat.com> wrote:
Il giorno lun 12 dic 2022 alle ore 17:12 marek <cervajs64@gmail.com> ha scritto:
additional info
# vdsm-client Host getConnectedStoragePools []
2022-12-12 16:04:12,613+0100 ERROR (jsonrpc/4) [jsonrpc.JsonRpcServer] Internal server error (__init__:354) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/yajsonrpc/__init__.py", line 349, in _handle_request res = method(**params) File "/usr/lib/python3.6/site-packages/vdsm/rpc/Bridge.py", line 180, in _dynamicMethod api = self._get_api_instance(className, argobj) File "/usr/lib/python3.6/site-packages/vdsm/rpc/Bridge.py", line 165, in _get_api_instance return apiObj(*ctorArgs) TypeError: __init__() missing 1 required positional argument: 'UUID'
@sandro
you mean that ovirt engine (4.4.10 on centos8 stream) vs (ovirt host 4.4.10 on rocky 8.7) can be problem?
4.4.10 has been tested only on CS8 (around the time when CS8 contained packages for upcoming 8.6 release ) or 8.6. When you have upgraded to the latest 8.7 you should also upgrade o 4.5.4. When using CentOS Stream you should really always use latest engine, we are still trying to react on any breakages comming from stream and fixed them in latest oVirt releases
For the specific issue in the above traceback, no I don't think it's due to 8.7/Stream. Looks like something related to the bridge. @Martin Perina <mperina@redhat.com> ?
Albert, do you know of any fixes around getConnectedStoragePools between 4.4.10 and 4.5.4?
Not that I can see. Last change around it was removing an optional parameter, back in 4.4.8.
But in general, if you upgrade to recent CentOS Stream or to EL 8.7 you should upgrade ovirt as well as the underlying OS has some changes which require alignment within ovirt code.
Dne 12/12/2022 v 17:01 Sandro Bonazzola napsal(a):
Il giorno lun 12 dic 2022 alle ore 16:50 marek <cervajs64@gmail.com> ha scritto:
hi,
ovirt 4.4.10
one host become unresponsive (no known change)
host rocky linux 8.6 (upgraded to 8.7 now) + local storage (/vm)
Please note 8.7 support has been introduced in oVirt 4.5.4. Please upgrade as soon as practical.
host vdsm.log
2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList() from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:48) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:54) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:735)
any tips howto debug StoragePool?
Marek
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/B5CFF2SPZEQCUG...
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System
Red Hat EMEA <https://www.redhat.com/>
sbonazzo@redhat.com <https://www.redhat.com/>
*Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. *
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System
Red Hat EMEA <https://www.redhat.com/>
sbonazzo@redhat.com <https://www.redhat.com/>
*Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*
-- Martin Perina Manager, Software Engineering Red Hat Czech s.r.o.

it looks like ovirt engine restart solved the problem Dne 12/12/2022 v 17:01 Sandro Bonazzola napsal(a):
Il giorno lun 12 dic 2022 alle ore 16:50 marek <cervajs64@gmail.com> ha scritto:
hi,
ovirt 4.4.10
one host become unresponsive (no known change)
host rocky linux 8.6 (upgraded to 8.7 now) + local storage (/vm)
Please note 8.7 support has been introduced in oVirt 4.5.4. Please upgrade as soon as practical.
host vdsm.log
2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList() from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:48) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=29b1d9a6-b0b4-4050-a4fd-061b34468354 (api:54) 2022-12-12 16:37:59,063+0100 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:735)
any tips howto debug StoragePool?
Marek
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/B5CFF2SPZEQCUG...
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System
Red Hat EMEA <https://www.redhat.com/>
sbonazzo@redhat.com
*Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. * *
*
participants (4)
-
Albert Esteve
-
marek
-
Martin Perina
-
Sandro Bonazzola