Re: [ovirt-users] Error "Did not connect host to storage domain because connection for connectionId is null" in ovirt 4.1

I have a 4.1 ovirt environment. I cannot reactivate a storage domain (data-master) and I get an error message stating "connection for connectionId 'b3011e5b-552e-4393-a758-ac1e35648ab1' is null". I also cannot delete this storage domain as it's a master domain. 2017-12-11 15:25:10,971-05 INFO [org.ovirt.engine.core.bll. storage.domain.ActivateStorageDomainCommand] (default task-22) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Lock Acquired to object 'EngineLock:{exclusiveLocks='[5662588b-81d2-4da9-b942-8918004770fe=STORAGE]', sharedLocks=''}' 2017-12-11 15:25:10,999-05 INFO [org.ovirt.engine.core.bll. storage.domain.ActivateStorageDomainCommand] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 5662588b-81d2-4da9-b942-8918004770fe Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-12-11 15:25:11,002-05 INFO [org.ovirt.engine.core.bll. storage.domain.ActivateStorageDomainCommand] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Lock freed to object 'EngineLock:{exclusiveLocks='[5662588b-81d2-4da9-b942-8918004770fe=STORAGE]', sharedLocks=''}' 2017-12-11 15:25:11,002-05 INFO [org.ovirt.engine.core.bll. storage.domain.ActivateStorageDomainCommand] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] ActivateStorage Domain. Before Connect all hosts to pool. Time: Mon Dec 11 15:25:11 EST 2017 2017-12-11 15:25:11,015-05 WARN [org.ovirt.engine.core.bll. storage.connection.BaseFsStorageHelper] (org.ovirt.thread.pool-6-thread-43) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Did not connect host 'e6dbdeb8-4e0e-4589-9121-6d3408c6d7b0' to storage domain 'ovirt-lg-1-lun1' because connection for connectionId 'b3011e5b-552e-4393-a758-ac1e35648ab1' is null. 2017-12-11 15:25:11,016-05 ERROR [org.ovirt.engine.core.bll. storage.domain.ActivateStorageDomainCommand] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Cannot connect storage server, aborting Storage Domain activation. 2017-12-11 15:25:11,017-05 INFO [org.ovirt.engine.core.bll. storage.domain.ActivateStorageDomainCommand] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Command [id=0fb1fa9d-4002-4fe0-9af2-d30470d5f146]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: EntityStatusSnapshot:{id='StoragePoolIsoMapId:{ storagePoolId='a0cc9e2c-6bff-4d5b-803c-0cd62292c269', storageId='5662588b-81d2-4da9-b942-8918004770fe'}', status='Maintenance'}. 2017-12-11 15:25:11,023-05 ERROR [org.ovirt.engine.core.dal. dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] EVENT_ID: USER_ACTIVATE_STORAGE_DOMAIN_FAILED(967), Correlation ID: 49dfce30-0e2c-43f8-942d-67a2b56b3ef8, Job ID: 2d766e2a-4b35-4822-9580-4eb9df2d9c33, Call Stack: null, Custom ID: null, Custom Event ID: -1, Message: Failed to activate Storage Domain ovirt-lg-1-lun1 (Data Center ovirt-lg-1) by admin@internal-authz select id,storage,storage_name,_update_date from storage_domain_static; id | storage | storage_name | _update_date --------------------------------------+--------------------- -------------------+------------------------+--------------- ---------------- 072fbaa1-08f3-4a40-9f34-a5ca22dd1d74 | ceab03af-7220-4d42-8f5c-9b557f5d29af | ovirt-image-repository | b66443f4-d949-4fca-9825-8cb98eae9e14 | e462883f-0be1-4b31-acf1-154dd7accbc1 | export | 45807651-8f10-408f-891b-64f1cc577a64 | 452235ea-d8b1-43d1-920f-a16a032e000b | ovirt-lg-1-iso | 2017-01-20 20:01:00.284097+00 a1d803b9-fd0b-477f-a874-53d050d4347b | cd8939df-9cdd-49d3-8dc5-3c06d1836399 | ovirt-lg-1-export | 2017-01-20 20:01:14.70549+00 b67e7442-f032-4b5c-a4fe-10422650a90b | c6272852-3586-4584-8496-d97c4370c798 | ovirt-5-iso | 2017-01-20 20:02:08.668034+00 a561589c-8eb8-4823-9615-92ac4a1ea94e | cacb8801-6826-42cb-9bab-5552175e0329 | ovirt-lg-2-export | 646b331a-b68e-4894-807f-bdc8adae15c9 | a592b780-7bd6-4599-ab7e-12c43cb9279d | ovirt-lg-2-iso | 3ba53a0b-30be-497c-b4df-880e6c6f7567 | 8e5236c9-cbc0-4256-abff-7e984abef65a | master | 2017-12-11 02:12:16.499288+00 3efa5ed5-4e17-4daf-9cc0-6819a9cd7aae | 8d19b66d-1c1c-4976-91d2-8d2565db367a | hosted_storage | 2017-12-11 02:12:16.499288+00 18504f40-fb15-4b1e-8ac3-ec0eabdc5619 | SPA1ZX-n7rh-s14h-wuRC-071z-RShH-wmzmqj | storage-1-lun0 | 2017-12-11 02:12:16.499288+00 730c14db-d4ef-4d0e-9670-419b803fe634 | 7Zxqu3-nVUD-HnN7-w4Xf-TFi7-BKrJ-OzMyRA | storage-3-lun0 | 2017-12-11 02:12:16.499288+00 190bc841-e6b0-45b8-bfbb-7518735d8592 | y7oM6F-Tx0Y-QWxg-gk9R-Xlfm-Mz9A-fOx5RN | storage-2-lun0 | 2017-12-11 02:12:16.499288+00 45114ecf-6af5-4cce-81aa-12779ff007ef | MU3vBR-39KZ-UvuD-R4gg-hw1a-iyNu-D0Igvu | storage-2-lun1 | 2017-12-11 02:12:16.499288+00 0f57345d-e310-4779-a987-2362458debd4 | 60f3afa7-35fb-4ff7-becc-a4a0c9b3884a | ovirt-5-lun2 | 2017-12-11 02:12:36.638249+00 d9d03670-4cfd-42d7-b4b7-834a53c3e0d6 | 677a9e5b-f844-49ee-ad1f-989e168187cf | ovirt-5-lun1 | 2017-12-11 02:12:36.638249+00 5662588b-81d2-4da9-b942-8918004770fe | b3011e5b-552e-4393-a758-ac1e35648ab1 | ovirt-lg-1-lun1 | 2017-12-11 02:12:55.351124+00 07593976-d27b-4ac8-ba19-a77a1f1e5d52 | 677a9e5b-f844-49ee-ad1f-989e168187cf | ovirt-lg-2-lun1 | 2017-12-11 02:13:12.998165+00 ca0e59ed-7c9e-45a0-a77c-143f3ad19dff | 6650a140-ba2b-42b9-bb14-5b331f87b60c | iso | 2017-12-11 15:55:53.891326+00 (18 rows) select id,_update_date from storage_domain_dynamic; id | _update_date --------------------------------------+------------------------------- 072fbaa1-08f3-4a40-9f34-a5ca22dd1d74 | b67e7442-f032-4b5c-a4fe-10422650a90b | 2017-12-11 20:45:50.517595+00 0f57345d-e310-4779-a987-2362458debd4 | 2017-12-11 20:45:50.52089+00 d9d03670-4cfd-42d7-b4b7-834a53c3e0d6 | 2017-12-11 20:45:50.523789+00 b66443f4-d949-4fca-9825-8cb98eae9e14 | 2017-12-11 20:45:50.526227+00 18504f40-fb15-4b1e-8ac3-ec0eabdc5619 | 2017-12-11 20:45:55.743157+00 3ba53a0b-30be-497c-b4df-880e6c6f7567 | 2017-12-11 20:45:55.745959+00 3efa5ed5-4e17-4daf-9cc0-6819a9cd7aae | 2017-12-11 20:45:55.748615+00 ca0e59ed-7c9e-45a0-a77c-143f3ad19dff | 2017-12-11 20:45:55.751164+00 190bc841-e6b0-45b8-bfbb-7518735d8592 | 2017-12-11 20:45:55.753756+00 45114ecf-6af5-4cce-81aa-12779ff007ef | 2017-12-11 20:45:55.756197+00 730c14db-d4ef-4d0e-9670-419b803fe634 | 2017-12-11 20:45:55.75873+00 07593976-d27b-4ac8-ba19-a77a1f1e5d52 | 2017-12-11 20:45:57.472521+00 646b331a-b68e-4894-807f-bdc8adae15c9 | 2017-12-11 20:45:57.475366+00 a561589c-8eb8-4823-9615-92ac4a1ea94e | 2017-12-11 20:45:57.477804+00 5662588b-81d2-4da9-b942-8918004770fe | 2017-12-11 18:56:53.148042+00 45807651-8f10-408f-891b-64f1cc577a64 | 2017-12-11 18:56:08.404201+00 a1d803b9-fd0b-477f-a874-53d050d4347b | 2017-12-11 18:56:18.64931+00 (18 rows) select id,connection from storage_server_connections;

id | connection --------------------------------------+--------------------- ------------------------------- 8e5236c9-cbc0-4256-abff-7e984abef65a | 10.17.77.16:/exports/ovirt-master 8d19b66d-1c1c-4976-91d2-8d2565db367a | 10.17.77.16:/exports/ovirt- hosted_storage 6650a140-ba2b-42b9-bb14-5b331f87b60c | 10.17.77.16:/exports/ovirt-iso e462883f-0be1-4b31-acf1-154dd7accbc1 | 10.17.77.16:/exports/ovirt-export 50b9a77a-8f79-47b3-9a48-b2b25ea72087 | 10.17.77.16 9bfbd44b-7311-4b6e-8c77-c955397c2a66 | 10.17.77.48 d6c3980a-4774-4350-83d1-206e41848b4a | 10.17.77.17 3c39707c-a4d2-4221-9a8f-2a0503533387 | 10.17.77.49 4503e074-10d3-4163-8ada-1826790c437c | 10.17.77.18 93bf0c70-959c-4b1f-93ff-45d920ef7525 | 10.17.77.50 677a9e5b-f844-49ee-ad1f-989e168187cf | /var/ovirt-lun1 c6272852-3586-4584-8496-d97c4370c798 | /var/ovirt-iso 452235ea-d8b1-43d1-920f-a16a032e000b | /var/ovirt-iso cacb8801-6826-42cb-9bab-5552175e0329 | stori-lg.cptaq.local:/mnt/ ovirt-lg-2-export/export a592b780-7bd6-4599-ab7e-12c43cb9279d | /var/ovirt-iso 60f3afa7-35fb-4ff7-becc-a4a0c9b3884a | /var/ovirt-lun2 efd9854f-b348-4aa8-871f-1d408d4dd9b1 | /var/ovirt-lun1 cd8939df-9cdd-49d3-8dc5-3c06d1836399 | /var/ovirt-export 8d9067ac-4eff-4aa8-8d1b-2bd2e268f124 | /var/ovirt-lun1 (19 rows) select * from storage_pool_iso_map; storage_id | storage_pool_id | status --------------------------------------+--------------------- -----------------+-------- 45807651-8f10-408f-891b-64f1cc577a64 | a0cc9e2c-6bff-4d5b-803c-0cd62292c269 | 6 a1d803b9-fd0b-477f-a874-53d050d4347b | a0cc9e2c-6bff-4d5b-803c-0cd62292c269 | 6 b67e7442-f032-4b5c-a4fe-10422650a90b | e15014b4-3968-42f0-8eef-375bd6c1469a | 3 0f57345d-e310-4779-a987-2362458debd4 | e15014b4-3968-42f0-8eef-375bd6c1469a | 3 d9d03670-4cfd-42d7-b4b7-834a53c3e0d6 | e15014b4-3968-42f0-8eef-375bd6c1469a | 3 b66443f4-d949-4fca-9825-8cb98eae9e14 | e15014b4-3968-42f0-8eef-375bd6c1469a | 3 5662588b-81d2-4da9-b942-8918004770fe | a0cc9e2c-6bff-4d5b-803c-0cd62292c269 | 6 18504f40-fb15-4b1e-8ac3-ec0eabdc5619 | 582dc434-0270-017f-0138-00000000006d | 3 3ba53a0b-30be-497c-b4df-880e6c6f7567 | 582dc434-0270-017f-0138-00000000006d | 3 3efa5ed5-4e17-4daf-9cc0-6819a9cd7aae | 582dc434-0270-017f-0138-00000000006d | 3 190bc841-e6b0-45b8-bfbb-7518735d8592 | 582dc434-0270-017f-0138-00000000006d | 3 45114ecf-6af5-4cce-81aa-12779ff007ef | 582dc434-0270-017f-0138-00000000006d | 3 730c14db-d4ef-4d0e-9670-419b803fe634 | 582dc434-0270-017f-0138-00000000006d | 3 07593976-d27b-4ac8-ba19-a77a1f1e5d52 | a5d7157a-4bf4-436c-b444-a76ee5f7bb12 | 3 646b331a-b68e-4894-807f-bdc8adae15c9 | a5d7157a-4bf4-436c-b444-a76ee5f7bb12 | 3 a561589c-8eb8-4823-9615-92ac4a1ea94e | a5d7157a-4bf4-436c-b444-a76ee5f7bb12 | 3 ca0e59ed-7c9e-45a0-a77c-143f3ad19dff | 582dc434-0270-017f-0138-00000000006d | 3 (17 rows) _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users