Engine logs:

2019-05-16 10:25:08,015-05 INFO  [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-519) [fcde45c4-3b03-4a85-818a-06be560edee4] Lock Acquired to object 'EngineLock:{exclusiveLocks='[localhost:/test=STORAGE_CONNECTION]', sharedLocks=''}'
2019-05-16 10:25:08,152-05 INFO  [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-519) [fcde45c4-3b03-4a85-818a-06be560edee4] Running command: AddStorageServerConnectionCommand internal: false. Entities affected :  ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN
2019-05-16 10:25:08,153-05 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-519) [fcde45c4-3b03-4a85-818a-06be560edee4] START, ConnectStorageServerVDSCommand(HostName = boneyard, StorageServerConnectionManagementVDSParameters:{hostId='789a1c44-144d-4fb1-a8c1-26f8ddc06420', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='null', connection='10.50.3.12:/test', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.50.3.11:10.50.3.10', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 53674b6e
2019-05-16 10:25:08,430-05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-521) [] Error processing event data
2019-05-16 10:25:08,433-05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-521) [] Error processing event data
2019-05-16 10:25:08,436-05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-521) [] Error processing event data
2019-05-16 10:25:08,438-05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-521) [] Error processing event data
2019-05-16 10:25:08,438-05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-523) [] Error processing event data
2019-05-16 10:25:08,485-05 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-519) [fcde45c4-3b03-4a85-818a-06be560edee4] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 53674b6e
2019-05-16 10:25:08,616-05 INFO  [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-519) [fcde45c4-3b03-4a85-818a-06be560edee4] Lock freed to object 'EngineLock:{exclusiveLocks='[localhost:/test=STORAGE_CONNECTION]', sharedLocks=''}'
2019-05-16 10:25:08,945-05 INFO  [org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand] (default task-519) [6eced2f6-a5bb-4826-a90f-c185534b8d9b] Running command: AddGlusterFsStorageDomainCommand internal: false. Entities affected :  ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN
2019-05-16 10:25:09,031-05 INFO  [org.ovirt.engine.core.bll.profiles.AddDiskProfileCommand] (default task-519) [31d993dd] Running command: AddDiskProfileCommand internal: true. Entities affected :  ID: 4037f461-2b6d-452f-8156-fcdca820a8a1 Type: StorageAction group CREATE_STORAGE_DISK_PROFILE with role type ADMIN
2019-05-16 10:25:09,099-05 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-519) [31d993dd] EVENT_ID: USER_ADDED_DISK_PROFILE(10,120), Disk Profile gTest was successfully added (User: telsin@ohgnetworks-authz).
2019-05-16 10:25:09,165-05 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-519) [31d993dd] START, ConnectStorageServerVDSCommand(HostName = boneyard, StorageServerConnectionManagementVDSParameters:{hostId='789a1c44-144d-4fb1-a8c1-26f8ddc06420', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='d0ab6b05-2486-40f0-9b15-7f150017ec12', connection='10.50.3.12:/test', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.50.3.11:10.50.3.10', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 6a121bce
2019-05-16 10:25:09,181-05 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-519) [31d993dd] FINISH, ConnectStorageServerVDSCommand, return: {d0ab6b05-2486-40f0-9b15-7f150017ec12=0}, log id: 6a121bce
2019-05-16 10:25:09,183-05 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-519) [31d993dd] START, CreateStorageDomainVDSCommand(HostName = boneyard, CreateStorageDomainVDSCommandParameters:{hostId='789a1c44-144d-4fb1-a8c1-26f8ddc06420', storageDomain='StorageDomainStatic:{name='gTest', id='4037f461-2b6d-452f-8156-fcdca820a8a1'}', args='10.50.3.12:/test'}), log id: 65d17f3
2019-05-16 10:25:09,586-05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-519) [31d993dd] Failed in 'CreateStorageDomainVDS' method
2019-05-16 10:25:09,661-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-519) [31d993dd] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM boneyard command CreateStorageDomainVDS failed: Storage Domain target is unsupported: ()
2019-05-16 10:25:09,661-05 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-519) [31d993dd] Command 'org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand' return value 'StatusOnlyReturn [status=Status [code=399, message=Storage Domain target is unsupported: ()]]'
2019-05-16 10:25:09,661-05 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-519) [31d993dd] HostName = boneyard
2019-05-16 10:25:09,661-05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-519) [31d993dd] Command 'CreateStorageDomainVDSCommand(HostName = boneyard, CreateStorageDomainVDSCommandParameters:{hostId='789a1c44-144d-4fb1-a8c1-26f8ddc06420', storageDomain='StorageDomainStatic:{name='gTest', id='4037f461-2b6d-452f-8156-fcdca820a8a1'}', args='10.50.3.12:/test'})' execution failed: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage Domain target is unsupported: (), code = 399
2019-05-16 10:25:09,661-05 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-519) [31d993dd] FINISH, CreateStorageDomainVDSCommand, return: , log id: 65d17f3
2019-05-16 10:25:09,661-05 ERROR [org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand] (default task-519) [31d993dd] Command 'org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage Domain target is unsupported: (), code = 399 (Failed with error StorageDomainTargetUnsupported and code 399)
2019-05-16 10:25:09,663-05 INFO  [org.ovirt.engine.core.bll.CommandCompensator] (default task-519) [31d993dd] Command [id=7a4ab6a0-d3e5-4608-b90a-2a9ca28be485]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.profiles.DiskProfile; snapshot: 3a037e5b-7411-419e-8e08-0b065bd140f9.
2019-05-16 10:25:09,664-05 INFO  [org.ovirt.engine.core.bll.CommandCompensator] (default task-519) [31d993dd] Command [id=7a4ab6a0-d3e5-4608-b90a-2a9ca28be485]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StorageDomainDynamic; snapshot: 4037f461-2b6d-452f-8156-fcdca820a8a1.
2019-05-16 10:25:09,664-05 INFO  [org.ovirt.engine.core.bll.CommandCompensator] (default task-519) [31d993dd] Command [id=7a4ab6a0-d3e5-4608-b90a-2a9ca28be485]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: 4037f461-2b6d-452f-8156-fcdca820a8a1.
2019-05-16 10:25:09,722-05 ERROR [org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand] (default task-519) [31d993dd] Transaction rolled-back for command 'org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand'.
2019-05-16 10:25:09,787-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-519) [31d993dd] EVENT_ID: USER_ADD_STORAGE_DOMAIN_FAILED(957), Failed to add Storage Domain gTest. (User: telsin@ohgnetworks-authz)
2019-05-16 10:25:10,109-05 INFO  [org.ovirt.engine.core.bll.storage.connection.RemoveStorageServerConnectionCommand] (default task-521) [48279229-4c4a-485f-a087-5785f08638ac] Lock Acquired to object 'EngineLock:{exclusiveLocks='[localhost:/test=STORAGE_CONNECTION, d0ab6b05-2486-40f0-9b15-7f150017ec12=STORAGE_CONNECTION]', sharedLocks=''}'
2019-05-16 10:25:10,249-05 INFO  [org.ovirt.engine.core.bll.storage.connection.RemoveStorageServerConnectionCommand] (default task-521) [48279229-4c4a-485f-a087-5785f08638ac] Running command: RemoveStorageServerConnectionCommand internal: false. Entities affected :  ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN
2019-05-16 10:25:10,319-05 INFO  [org.ovirt.engine.core.bll.storage.connection.RemoveStorageServerConnectionCommand] (default task-521) [48279229-4c4a-485f-a087-5785f08638ac] Removing connection 'd0ab6b05-2486-40f0-9b15-7f150017ec12' from database 
2019-05-16 10:25:10,320-05 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (default task-521) [48279229-4c4a-485f-a087-5785f08638ac] START, DisconnectStorageServerVDSCommand(HostName = boneyard, StorageServerConnectionManagementVDSParameters:{hostId='789a1c44-144d-4fb1-a8c1-26f8ddc06420', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='d0ab6b05-2486-40f0-9b15-7f150017ec12', connection='localhost:/test', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.50.3.11:10.50.3.10', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 61e14259
2019-05-16 10:25:10,507-05 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (default task-521) [48279229-4c4a-485f-a087-5785f08638ac] FINISH, DisconnectStorageServerVDSCommand, return: {d0ab6b05-2486-40f0-9b15-7f150017ec12=477}, log id: 61e14259
2019-05-16 10:25:10,576-05 INFO  [org.ovirt.engine.core.bll.storage.connection.RemoveStorageServerConnectionCommand] (default task-521) [48279229-4c4a-485f-a087-5785f08638ac] Lock freed to object 'EngineLock:{exclusiveLocks='[localhost:/test=STORAGE_CONNECTION, d0ab6b05-2486-40f0-9b15-7f150017ec12=STORAGE_CONNECTION]', sharedLocks=''}'


Although something is up with this cluster, it both thinks and doesn’t think it has a gluster network setup:

2019-05-16 10:25:17,317-05 WARN  [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn] (DefaultQuartzScheduler6) [7530dc6d] Could not associate brick 'necropolis-san:/v0/bricks/gv0' of volume 'a81c5451-890f-4066-8841-45d4729e7bbc' with correct network as no gluster network found in cluster '00000002-0002-0002-0002-00000000017a'

networks:

but on the storage network for the default cluster (and editing this, the gluster role is checked but greyed out. migration is similar if looked at this way too):

On May 16, 2019, at 12:19 PM, Gobinda Das <godas@redhat.com> wrote:



On Thu, 16 May 2019, 10:02 p.m. Sandro Bonazzola, <sbonazzo@redhat.com> wrote:


Il giorno gio 16 mag 2019 alle ore 18:29 Strahil <hunter86_bg@yahoo.com> ha scritto:

Hi Sandro,

Thanks for the update.

I have just upgraded to RC1 (using gluster v6 here)  and the issue  I detected in 4.3.3.7 - where gluster Storage domain fails creation - is still present.

What is the error? Can I get error log?
May be engine and vdsm log.

Can you check if the 'dd' command executed during creation has been recently modified ?

I've received update from Darrell  (also gluster v6) , but haven't received an update from anyone who is using gluster v5 -> thus I haven't opened a bug yet.


Thanks for the feedback, I added a few people to the thread, hopefully they can help on this.

 

Best Regards,
Strahil Nikolov

On May 16, 2019 11:21, Sandro Bonazzola <sbonazzo@redhat.com> wrote:
The oVirt Project is pleased to announce the availability of the oVirt 4.3.4 First Release Candidate, as of May 16th, 2019.

This update is a release candidate of the fourth in a series of stabilization updates to the 4.3 series.
This is pre-release software. This pre-release should not to be used inproduction.

This release is available now on x86_64 architecture for:
* Red Hat Enterprise Linux 7.6 or later
* CentOS Linux (or similar) 7.6 or later

This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for:
* Red Hat Enterprise Linux 7.6 or later
* CentOS Linux (or similar) 7.6 or later
* oVirt Node 4.3 (available for x86_64 only)

Experimental tech preview for x86_64 and s390x architectures for Fedora 28 is also included.

See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed.

Notes:
- oVirt Appliance is already available
- oVirt Node is already available[2]

Additional Resources:
* Read more about the oVirt 4.3.4 release highlights:http://www.ovirt.org/release/4.3.4/
* Get more oVirt Project updates on Twitter: https://twitter.com/ovirt
* Check out the latest project news on the oVirt blog:http://www.ovirt.org/blog/


-- 
Sandro Bonazzola

MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV

Red Hat EMEA



-- 
Sandro Bonazzola

MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV

Red Hat EMEA

_______________________________________________
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-leave@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/MZGF4UVYUBWY5PEG2LOYXBFPJ3ISDX7C/