any one have any ideas on this?
Why does vdsm say Permission denied when the storage volume is mounted? How can it mount it if it has permission issues?


2024-10-11 09:20:05,875-0700 INFO  (jsonrpc/5) [storage.taskmanager.task] (Task='f5602911-f415-444d-9a70-cbc8ffb1572e') aborting: Task is aborted: 'value=[Errno 13] Permission denied abortedcode=100' (task:1165)

2024-10-11 09:25:06,014-07 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-99) [372b4911] EVENT_ID: VDS_SET_NONOPERATIONAL_DOMAIN(522), Host ovirt5n.j2noc.com cannot access the Storage Domain(s) <UNKNOWN> attached to the Data Center Default. Setting Host state to Non-Operational.


On Thu, Oct 10, 2024 at 8:46 AM Bill James <bill.james@consensus.com> wrote:
basically following these steps: https://www.ovirt.org/download/install_on_rhel.html
How do I know what storage domain it is saying it can't access?
From what I see in engine log its:
2024-10-10 08:40:09,219-07 ERROR [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (EE-ManagedThreadFactory-engine-Thread-14) [
] Could not connect host 'ovirt4n.j2noc.com' to pool 'Default': Error storage pool connection: ("spUUID=16933ed6-28dc-11ef-baff-c4cbe1c7b014, msdUUID=9df6c434-c848-4987-afd2-9fd8458ed78a, masterVersion=1, hostID=4, domainsMap={'9cc85468-53f3-49a9-bf05-359b0d715fd3': 'active', '9df6c434-c848-4987-afd2-9fd8458ed78a': 'active'}",)

9df6c434-c848-4987-afd2-9fd8458ed78a is ovirt1n-gv0 which is already mounted and working fine.
[root@ovirt5n prod vdsm]# df -h |grep gv0
ovirt1n-gl.j2noc.com:/gv0             11T  239G   11T   3% /rhev/data-center/mnt/glusterSD/ovirt1n-gl.j2noc.com:_gv0
[root@ovirt5n prod vdsm]# cd /rhev/data-center/mnt/glusterSD/ovirt1n-gl.j2noc.com:_gv0
[root@ovirt5n prod ovirt1n-gl.j2noc.com:_gv0]# ls -l
total 4
drwxr-xr-x 5 vdsm kvm 4096 Sep 13 11:27 9df6c434-c848-4987-afd2-9fd8458ed78a
[root@ovirt5n prod ovirt1n-gl.j2noc.com:_gv0]# cd 9df6c434-c848-4987-afd2-9fd8458ed78a/images/
[root@ovirt5n prod images]# ls -l
total 48
drwxr-xr-x 2 vdsm kvm 4096 Sep 30 17:33 09393484-e5e8-49cc-bce4-393b01d84ebf
drwxr-xr-x 2 vdsm kvm 4096 Sep 13 14:41 0b761aa1-f61f-422f-acf4-43315745c671
drwxr-xr-x 2 vdsm kvm 4096 Sep 17 11:58 109e1d23-3007-424e-a787-56b5c2631e58
drwxr-xr-x 2 vdsm kvm 4096 Sep 13 15:53 11e7c409-686e-4e71-b9e8-8bb503fc91c0
drwxr-xr-x 2 vdsm kvm 4096 Sep 17 12:00 2e84682f-9351-4401-99fa-e58575567136
drwxr-xr-x 2 vdsm kvm 4096 Sep 13 14:46 8f1cd1ad-9836-4abd-bba8-e569ec38311e
drwxr-xr-x 2 vdsm kvm 4096 Sep 13 14:41 aaceb015-e849-4b40-bb4a-22af2ccb8a9d
drwxr-xr-x 2 vdsm kvm 4096 Sep 13 15:23 ada1430e-ba3d-4b02-85c8-d0ee01f5eb37
drwxr-xr-x 2 vdsm kvm 4096 Sep 17 11:59 b1950739-d63d-41e7-8b5b-c00279b6453b
drwxr-xr-x 2 vdsm kvm 4096 Sep 13 15:26 bb6c8234-23e9-47f4-93e2-5ebf6a028320
drwxr-xr-x 2 vdsm kvm 4096 Sep 30 16:55 c15562ca-a94e-4e8b-a957-81eb0441d9da
drwxr-xr-x 2 vdsm kvm 4096 Sep 30 17:33 cb1ffbda-229a-4393-a10a-b2e67bb80bfc
[root@ovirt5n prod images]#

why does it say it can't access it??



On Thu, Oct 10, 2024 at 5:22 AM Marcos Sungaila <marcos.sungaila@oracle.com> wrote:

Hi Bill,

 

Which steps you ran through on the KVM hosts before trying to add them to the Cluster?

 

Marcos

 

From: Bill James <bill.james@consensus.com>
Sent: Wednesday, October 9, 2024 7:02 PM
To: users <users@ovirt.org>
Subject: [External] : [ovirt-users] cannot access the Storage Domain(s) <UNKNOWN> attached to the Data Center Default.

 

I'm trying to add 3 more nodes to an active cluster. 3 previous nodes are working fine.

I've tried 2 new nodes and they get the same error.

It seems strange to me cause the volume is mounted.

 

[root@ovirt5n prod vdsm]# df -h|grep rhev
10.2.2.230:/vol/ovirt_inside_export  440G   57G  384G  13% /rhev/data-center/mnt/10.2.2.230:_vol_ovirt__inside__export
ovirt1n-gl.j2noc.com:/gv0             11T  239G   11T   3% /rhev/data-center/mnt/glusterSD/ovirt1n-gl.j2noc.com:_gv0

 

engine.log says:

cannot access the Storage Domain(s) <UNKNOWN> attached to the Data Center Default.

 

vdsm.log says:

2024-10-09 14:55:06,726-0700 ERROR (jsonrpc/2) [storage.dispatcher] FINISH connectStoragePool error=[Errno 13] Permission de
nied (dispatcher:70)
Traceback (most recent call last):
 File "/usr/lib/python3.9/site-packages/vdsm/storage/dispatcher.py", line 57, in wrapper
   result = ctask.prepare(func, *args, **kwargs)
 File "/usr/lib/python3.9/site-packages/vdsm/storage/task.py", line 93, in wrapper
   return m(self, *a, **kw)
 File "/usr/lib/python3.9/site-packages/vdsm/storage/task.py", line 1173, in prepare
.....

  File "/usr/lib/python3.9/site-packages/ioprocess/__init__.py", line 479, in _sendCommand
   raise OSError(errcode, errstr)
PermissionError: [Errno 13] Permission denied
2024-10-09 14:55:06,726-0700 INFO  (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call StoragePool.connect failed (error 302) in 2.
09 seconds (__init__:300)

 

OS: Rocky 9

vdsm-4.50.5.1-1.el9.x86_64

 

Any ideas welcome.

 Thanks

 

vdsm.log and engine.log attached.

 

_______________________________________________
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-leave@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/YFWFK2CEKIMACRY3STDBJHFCYBBWXHKY/