On Mon, Feb 10, 2020 at 4:13 PM Jorick Astrego <jorick@netbulae.eu> wrote:


On 2/10/20 1:27 PM, Jorick Astrego wrote:

Hmm, I didn't notice that.

I did a check on the NFS server and I found the "1ed0a635-67ee-4255-aad9-b70822350706" in the exportdom path (/data/exportdom).

This was an old NFS export domain that has been deleted for a while now. I remember finding somewhere an issue with old domains still being active after removal but I cannot find it now.

I unexported the directory on the nfs server and now I have to correct mount and it activates fine.

Thanks!

Still weird that it picks another nfs mount path to mount that has been removed months ago from engine.

This is because vdsm scans for domains by storage i.e. looking up under /rhev/data-center/mnt/* in case of nfs domains [1]
 

It's not listed in the database on engine:

The table lists the valid domains known to engine, removals/additions of storage domains update this table.

If you removed the old nfs domain, but the nfs storage was not available to the time (i.e. not mounted) then storage format could fail silently [2]
and yet this table would still be updated for the SD removal. [3]

Haven't tested this out, and may need to unmount at a very specific moment to achieve this in [2],
but looking around with the kind assistance of +Benny Zlotnik on engine side makes this assumption seem possible.

[1] https://github.com/oVirt/vdsm/blob/821afbbc238ba379c12666922fc1ac80482ee383/lib/vdsm/storage/fileSD.py#L888
[2] https://github.com/oVirt/vdsm/blob/master/lib/vdsm/storage/fileSD.py#L628
[3] https://github.com/oVirt/ovirt-engine/blob/master/backend/manager/modules/bll/src/main/java/org/ovirt/engine/core/bll/storage/domain/RemoveStorageDomainCommand.java#L77

engine=# select * from storage_domain_static ;
                  id                  |               storage                |      storage_name      | storage_domain_type | storage_type | storage_domain_format_type |         _create_date          |         _update_date          | reco
verable | last_time_used_as_master |        storage_description         | storage_comment | wipe_after_delete | warning_low_space_indicator | critical_space_action_blocker | first_metadata_device | vg_metadata_device | discard_after_delet
e | backup | warning_low_confirmed_space_indicator | block_size
--------------------------------------+--------------------------------------+------------------------+---------------------+--------------+----------------------------+-------------------------------+-------------------------------+-----
--------+--------------------------+------------------------------------+-----------------+-------------------+-----------------------------+-------------------------------+-----------------------+--------------------+--------------------
--+--------+---------------------------------------+------------
 782a61af-a520-44c4-8845-74bf92888552 | 640ab34d-aa5d-478b-97be-e3f810558628 | ISO_DOMAIN             |                   2 |            1 | 0                          | 2017-11-16 09:49:49.225478+01 |                               | t  
        |                        0 | ISO_DOMAIN                         |                 | f                 |                             |                               |                       |                    | f                 
  | f      |                                       |        512
 072fbaa1-08f3-4a40-9f34-a5ca22dd1d74 | ceab03af-7220-4d42-8f5c-9b557f5d29af | ovirt-image-repository |                   4 |            8 | 0                          | 2016-10-14 20:40:44.700381+02 | 2018-04-06 14:03:31.201898+02 | t  
        |                        0 | Public Glance repository for oVirt |                 | f                 |                             |                               |                       |                    | f                 
  | f      |                                       |        512
 b30bab9d-9a66-44ce-ad17-2eb4ee858d8f | 40d191b0-b7f8-48f9-bf6f-327275f51fef | ssd-6                  |                   1 |            7 | 4                          | 2017-06-25 12:45:24.52974+02  | 2019-01-24 15:35:57.013832+01 | t  
        |            1498461838176 |                                    |                 | f                 |                          10 |                             5 |                       |                    | f                 
  | f      |                                       |        512
 95b4e5d2-2974-4d5f-91e4-351f75a15435 | f11fed97-513a-4a10-b85c-2afe68f42608 | ssd-3                  |                   1 |            7 | 4                          | 2019-01-10 12:15:55.20347+01  | 2019-01-24 15:35:57.013832+01 | t  
        |                        0 |                                    |                 | f                 |                          10 |                             5 |                       |                    | f                 
  | f      |                                    10 |        512
 f5d2f7c6-093f-46d6-a844-224d92db5ef9 | b8b456f0-27c3-49b9-b5e9-9fa81fb3cdaa | backupnfs              |                   1 |            1 | 4                          | 2018-01-19 13:31:25.899738+01 | 2019-02-14 14:36:22.3171+01   | t  
        |            1530772724454 |                                    |                 | f                 |                          10 |                             5 |                       |                    | f                 
  | f      |                                     0 |        512
 33f1ba00-6a16-4e58-b4c5-94426f1c4482 | 6b6b7899-c82b-4417-b453-0b3b0ac11deb | ssd-4                  |                   1 |            7 | 4                          | 2017-06-25 12:43:49.339884+02 | 2019-02-27 21:30:23.358231+01 | t  
        |            1550151382205 |                                    |                 | f                 |                          10 |                             5 |                       |                    | f                 
  | f      |                                     0 |        512
 09959920-a31b-42c2-a547-e50b73602c96 | b036005a-d44d-4689-a8c3-13e1bbf55af7 | ssd-5                  |                   0 |            7 | 4                          | 2017-06-25 12:44:36.215841+02 | 2019-04-02 12:11:45.468731+02 | t  
        |            1554199905458 |                                    |                 | f                 |                          10 |                             5 |                       |                    | f                 
  | f      |                                     0 |        512
 515166a4-4b2f-402d-bf37-95f3c59635cb | 420c6356-1645-49ed-8d1e-56e45ba60d4a | ssd8                   |                   1 |            7 | 4                          | 2020-01-31 09:49:12.484345+01 | 2020-01-31 09:49:12.933808+01 | t  
        |                        0 |                                    |                 | f                 |                          10 |                             5 |                       |                    | f                 
  | f      |                                    10 |        512
(8 rows)

So there still is something weird going on there.






Met vriendelijke groet, With kind regards,

Jorick Astrego

Netbulae Virtualization Experts
Tel: 053 20 30 270 info@netbulae.eu Staalsteden 4-3A KvK 08198180
Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01