<html>I have a 4.1 ovirt environment. I cannot reactivate a storage domain (data-master) and I get an error message stating "connection for connectionId 'b3011e5b-552e-4393-a758-ac1e35648ab1' is null". I also cannot delete this storage domain as it's a master domain.<br /><br />2017-12-11 15:25:10,971-05 INFO [org.ovirt.engine.core.bll.storage.domain.ActivateStorageDomainCommand] (default task-22) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Lock Acquired to object 'EngineLock:{exclusiveLocks='[5662588b-81d2-4da9-b942-8918004770fe=STORAGE]', sharedLocks=''}'<br />2017-12-11 15:25:10,999-05 INFO [org.ovirt.engine.core.bll.storage.domain.ActivateStorageDomainCommand] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 5662588b-81d2-4da9-b942-8918004770fe Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN<br />2017-12-11 15:25:11,002-05 INFO [org.ovirt.engine.core.bll.storage.domain.ActivateStorageDomainCommand] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Lock freed to object 'EngineLock:{exclusiveLocks='[5662588b-81d2-4da9-b942-8918004770fe=STORAGE]', sharedLocks=''}'<br />2017-12-11 15:25:11,002-05 INFO [org.ovirt.engine.core.bll.storage.domain.ActivateStorageDomainCommand] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] ActivateStorage Domain. Before Connect all hosts to pool. Time: Mon Dec 11 15:25:11 EST 2017<br />2017-12-11 15:25:11,015-05 WARN [org.ovirt.engine.core.bll.storage.connection.BaseFsStorageHelper] (org.ovirt.thread.pool-6-thread-43) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Did not connect host 'e6dbdeb8-4e0e-4589-9121-6d3408c6d7b0' to storage domain 'ovirt-lg-1-lun1' because connection for connectionId 'b3011e5b-552e-4393-a758-ac1e35648ab1' is null.<br />2017-12-11 15:25:11,016-05 ERROR [org.ovirt.engine.core.bll.storage.domain.ActivateStorageDomainCommand] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Cannot connect storage server, aborting Storage Domain activation.<br />2017-12-11 15:25:11,017-05 INFO [org.ovirt.engine.core.bll.storage.domain.ActivateStorageDomainCommand] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] Command [id=0fb1fa9d-4002-4fe0-9af2-d30470d5f146]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: EntityStatusSnapshot:{id='StoragePoolIsoMapId:{storagePoolId='a0cc9e2c-6bff-4d5b-803c-0cd62292c269', storageId='5662588b-81d2-4da9-b942-8918004770fe'}', status='Maintenance'}.<br />2017-12-11 15:25:11,023-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-50) [49dfce30-0e2c-43f8-942d-67a2b56b3ef8] EVENT_ID: USER_ACTIVATE_STORAGE_DOMAIN_FAILED(967), Correlation ID: 49dfce30-0e2c-43f8-942d-67a2b56b3ef8, Job ID: 2d766e2a-4b35-4822-9580-4eb9df2d9c33, Call Stack: null, Custom ID: null, Custom Event ID: -1, Message: Failed to activate Storage Domain ovirt-lg-1-lun1 (Data Center ovirt-lg-1) by admin@internal-authz<br /><br /><br />select id,storage,storage_name,_update_date from storage_domain_static;<br /> id | storage | storage_name | _update_date <br />--------------------------------------+----------------------------------------+------------------------+-------------------------------<br /> 072fbaa1-08f3-4a40-9f34-a5ca22dd1d74 | ceab03af-7220-4d42-8f5c-9b557f5d29af | ovirt-image-repository |<br /> b66443f4-d949-4fca-9825-8cb98eae9e14 | e462883f-0be1-4b31-acf1-154dd7accbc1 | export |<br /> 45807651-8f10-408f-891b-64f1cc577a64 | 452235ea-d8b1-43d1-920f-a16a032e000b | ovirt-lg-1-iso | 2017-01-20 20:01:00.284097+00<br /> a1d803b9-fd0b-477f-a874-53d050d4347b | cd8939df-9cdd-49d3-8dc5-3c06d1836399 | ovirt-lg-1-export | 2017-01-20 20:01:14.70549+00<br /> b67e7442-f032-4b5c-a4fe-10422650a90b | c6272852-3586-4584-8496-d97c4370c798 | ovirt-5-iso | 2017-01-20 20:02:08.668034+00<br /> a561589c-8eb8-4823-9615-92ac4a1ea94e | cacb8801-6826-42cb-9bab-5552175e0329 | ovirt-lg-2-export |<br /> 646b331a-b68e-4894-807f-bdc8adae15c9 | a592b780-7bd6-4599-ab7e-12c43cb9279d | ovirt-lg-2-iso |<br /> 3ba53a0b-30be-497c-b4df-880e6c6f7567 | 8e5236c9-cbc0-4256-abff-7e984abef65a | master | 2017-12-11 02:12:16.499288+00<br /> 3efa5ed5-4e17-4daf-9cc0-6819a9cd7aae | 8d19b66d-1c1c-4976-91d2-8d2565db367a | hosted_storage | 2017-12-11 02:12:16.499288+00<br /> 18504f40-fb15-4b1e-8ac3-ec0eabdc5619 | SPA1ZX-n7rh-s14h-wuRC-071z-RShH-wmzmqj | storage-1-lun0 | 2017-12-11 02:12:16.499288+00<br /> 730c14db-d4ef-4d0e-9670-419b803fe634 | 7Zxqu3-nVUD-HnN7-w4Xf-TFi7-BKrJ-OzMyRA | storage-3-lun0 | 2017-12-11 02:12:16.499288+00<br /> 190bc841-e6b0-45b8-bfbb-7518735d8592 | y7oM6F-Tx0Y-QWxg-gk9R-Xlfm-Mz9A-fOx5RN | storage-2-lun0 | 2017-12-11 02:12:16.499288+00<br /> 45114ecf-6af5-4cce-81aa-12779ff007ef | MU3vBR-39KZ-UvuD-R4gg-hw1a-iyNu-D0Igvu | storage-2-lun1 | 2017-12-11 02:12:16.499288+00<br /> 0f57345d-e310-4779-a987-2362458debd4 | 60f3afa7-35fb-4ff7-becc-a4a0c9b3884a | ovirt-5-lun2 | 2017-12-11 02:12:36.638249+00<br /> d9d03670-4cfd-42d7-b4b7-834a53c3e0d6 | 677a9e5b-f844-49ee-ad1f-989e168187cf | ovirt-5-lun1 | 2017-12-11 02:12:36.638249+00<br /> <br /> 5662588b-81d2-4da9-b942-8918004770fe | b3011e5b-552e-4393-a758-ac1e35648ab1 | ovirt-lg-1-lun1 | 2017-12-11 02:12:55.351124+00<br /> <br /> 07593976-d27b-4ac8-ba19-a77a1f1e5d52 | 677a9e5b-f844-49ee-ad1f-989e168187cf | ovirt-lg-2-lun1 | 2017-12-11 02:13:12.998165+00<br /> ca0e59ed-7c9e-45a0-a77c-143f3ad19dff | 6650a140-ba2b-42b9-bb14-5b331f87b60c | iso | 2017-12-11 15:55:53.891326+00<br />(18 rows)<br /><br /><br />select id,_update_date from storage_domain_dynamic;<br /> id | _update_date <br />--------------------------------------+-------------------------------<br /> 072fbaa1-08f3-4a40-9f34-a5ca22dd1d74 |<br /> b67e7442-f032-4b5c-a4fe-10422650a90b | 2017-12-11 20:45:50.517595+00<br /> 0f57345d-e310-4779-a987-2362458debd4 | 2017-12-11 20:45:50.52089+00<br /> d9d03670-4cfd-42d7-b4b7-834a53c3e0d6 | 2017-12-11 20:45:50.523789+00<br /> b66443f4-d949-4fca-9825-8cb98eae9e14 | 2017-12-11 20:45:50.526227+00<br /> 18504f40-fb15-4b1e-8ac3-ec0eabdc5619 | 2017-12-11 20:45:55.743157+00<br /> 3ba53a0b-30be-497c-b4df-880e6c6f7567 | 2017-12-11 20:45:55.745959+00<br /> 3efa5ed5-4e17-4daf-9cc0-6819a9cd7aae | 2017-12-11 20:45:55.748615+00<br /> ca0e59ed-7c9e-45a0-a77c-143f3ad19dff | 2017-12-11 20:45:55.751164+00<br /> 190bc841-e6b0-45b8-bfbb-7518735d8592 | 2017-12-11 20:45:55.753756+00<br /> 45114ecf-6af5-4cce-81aa-12779ff007ef | 2017-12-11 20:45:55.756197+00<br /> 730c14db-d4ef-4d0e-9670-419b803fe634 | 2017-12-11 20:45:55.75873+00<br /> 07593976-d27b-4ac8-ba19-a77a1f1e5d52 | 2017-12-11 20:45:57.472521+00<br /> 646b331a-b68e-4894-807f-bdc8adae15c9 | 2017-12-11 20:45:57.475366+00<br /> a561589c-8eb8-4823-9615-92ac4a1ea94e | 2017-12-11 20:45:57.477804+00<br /> <br /> 5662588b-81d2-4da9-b942-8918004770fe | 2017-12-11 18:56:53.148042+00<br /> <br /> 45807651-8f10-408f-891b-64f1cc577a64 | 2017-12-11 18:56:08.404201+00<br /> a1d803b9-fd0b-477f-a874-53d050d4347b | 2017-12-11 18:56:18.64931+00<br />(18 rows)<br /><br /><br />select id,connection from storage_server_connections;<br /> id | connection <br />--------------------------------------+----------------------------------------------------<br /> 8e5236c9-cbc0-4256-abff-7e984abef65a | 10.17.77.16:/exports/ovirt-master<br /> 8d19b66d-1c1c-4976-91d2-8d2565db367a | 10.17.77.16:/exports/ovirt-hosted_storage<br /> 6650a140-ba2b-42b9-bb14-5b331f87b60c | 10.17.77.16:/exports/ovirt-iso<br /> e462883f-0be1-4b31-acf1-154dd7accbc1 | 10.17.77.16:/exports/ovirt-export<br /> 50b9a77a-8f79-47b3-9a48-b2b25ea72087 | 10.17.77.16<br /> 9bfbd44b-7311-4b6e-8c77-c955397c2a66 | 10.17.77.48<br /> d6c3980a-4774-4350-83d1-206e41848b4a | 10.17.77.17<br /> 3c39707c-a4d2-4221-9a8f-2a0503533387 | 10.17.77.49<br /> 4503e074-10d3-4163-8ada-1826790c437c | 10.17.77.18<br /> 93bf0c70-959c-4b1f-93ff-45d920ef7525 | 10.17.77.50<br /> 677a9e5b-f844-49ee-ad1f-989e168187cf | /var/ovirt-lun1<br /> c6272852-3586-4584-8496-d97c4370c798 | /var/ovirt-iso<br /> 452235ea-d8b1-43d1-920f-a16a032e000b | /var/ovirt-iso<br /> cacb8801-6826-42cb-9bab-5552175e0329 | stori-lg.cptaq.local:/mnt/ovirt-lg-2-export/export<br /> a592b780-7bd6-4599-ab7e-12c43cb9279d | /var/ovirt-iso<br /> 60f3afa7-35fb-4ff7-becc-a4a0c9b3884a | /var/ovirt-lun2<br /> <br /> efd9854f-b348-4aa8-871f-1d408d4dd9b1 | /var/ovirt-lun1<br /> <br /> cd8939df-9cdd-49d3-8dc5-3c06d1836399 | /var/ovirt-export<br /> 8d9067ac-4eff-4aa8-8d1b-2bd2e268f124 | /var/ovirt-lun1<br />(19 rows)<br /><br /><br />select * from storage_pool_iso_map;<br /> storage_id | storage_pool_id | status<br />--------------------------------------+--------------------------------------+--------<br /> 45807651-8f10-408f-891b-64f1cc577a64 | a0cc9e2c-6bff-4d5b-803c-0cd62292c269 | 6<br /> a1d803b9-fd0b-477f-a874-53d050d4347b | a0cc9e2c-6bff-4d5b-803c-0cd62292c269 | 6<br /> b67e7442-f032-4b5c-a4fe-10422650a90b | e15014b4-3968-42f0-8eef-375bd6c1469a | 3<br /> 0f57345d-e310-4779-a987-2362458debd4 | e15014b4-3968-42f0-8eef-375bd6c1469a | 3<br /> d9d03670-4cfd-42d7-b4b7-834a53c3e0d6 | e15014b4-3968-42f0-8eef-375bd6c1469a | 3<br /> b66443f4-d949-4fca-9825-8cb98eae9e14 | e15014b4-3968-42f0-8eef-375bd6c1469a | 3<br /> <br /> 5662588b-81d2-4da9-b942-8918004770fe | a0cc9e2c-6bff-4d5b-803c-0cd62292c269 | 6<br /> <br /> 18504f40-fb15-4b1e-8ac3-ec0eabdc5619 | 582dc434-0270-017f-0138-00000000006d | 3<br /> 3ba53a0b-30be-497c-b4df-880e6c6f7567 | 582dc434-0270-017f-0138-00000000006d | 3<br /> 3efa5ed5-4e17-4daf-9cc0-6819a9cd7aae | 582dc434-0270-017f-0138-00000000006d | 3<br /> 190bc841-e6b0-45b8-bfbb-7518735d8592 | 582dc434-0270-017f-0138-00000000006d | 3<br /> 45114ecf-6af5-4cce-81aa-12779ff007ef | 582dc434-0270-017f-0138-00000000006d | 3<br /> 730c14db-d4ef-4d0e-9670-419b803fe634 | 582dc434-0270-017f-0138-00000000006d | 3<br /> 07593976-d27b-4ac8-ba19-a77a1f1e5d52 | a5d7157a-4bf4-436c-b444-a76ee5f7bb12 | 3<br /> 646b331a-b68e-4894-807f-bdc8adae15c9 | a5d7157a-4bf4-436c-b444-a76ee5f7bb12 | 3<br /> a561589c-8eb8-4823-9615-92ac4a1ea94e | a5d7157a-4bf4-436c-b444-a76ee5f7bb12 | 3<br /> ca0e59ed-7c9e-45a0-a77c-143f3ad19dff | 582dc434-0270-017f-0138-00000000006d | 3<br />(17 rows)<br /><br /><br /><br /> </html>