Re: [Users] Storage domain does not exist

From: "Jon Thomas" <jthomas(a)redhat.com&gt; To: users(a)ovirt.org Sent: Wednesday, August 29, 2012 7:08:45 PM Subject: [Users] Storage domain does not exist Hi, I'm doing a fresh 3.1 install. I'm having a problem attaching newly created storage. I followed http://wiki.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues. I seem to be able to create the storage ok. If I create it with the default NFS version option=autonegotiate, I get a 500 error and "storage does not exist" in the logs when trying to attach it. I can verify that subdirectories and files were created. #ls -l /exports/data/*/* /exports/data/8f1e9376-8303-4660-948f-a6704b041e2e/dom_md: total 8 -rw-rw----. 1 vdsm kvm 0 Aug 29 11:50 ids -rw-rw----. 1 vdsm kvm 0 Aug 29 11:50 inbox -rw-rw----. 1 vdsm kvm 512 Aug 29 11:50 leases -rw-r--r--. 1 vdsm kvm 298 Aug 29 11:50 metadata -rw-rw----. 1 vdsm kvm 0 Aug 29 11:50 outbox /exports/data/8f1e9376-8303-4660-948f-a6704b041e2e/images: total 0 Then as a test if I create the storage with the NFS version option=v3, I get an internal ovirt error and a stack. I followed the wiki and have v3 set on the engine node and NFS4_SUPPORT="no" set on the machine exporting the share. Mounting the share and creating/deleting files works fine. any ideas? thx with NFS version option=autonegotiate ====================================== , sharedLocks= ] 2012-08-29 11:52:10,747 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--0.0.0.0-8009-1) [595866b1] Running command: AddStoragePoolWithStoragesCommand internal: true. Entities affected : ID: 872ed943-cda1-4ec6-a4ea-36b97e7eff5a Type: StoragePool 2012-08-29 11:52:10,790 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-1) [2ec11b86] START, ValidateStorageServerConnectionVDSCommand(vdsId = 1c3207f8-f08d-11e1-8379-438e839e5efb, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 4b9fdb5c-d334-4056-a5fb-6946214e9ba1, connection: small.basin.com:/exports/data };]), log id: 721507 2012-08-29 11:52:10,807 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-1) [2ec11b86] FINISH, ValidateStorageServerConnectionVDSCommand, return: {4b9fdb5c-d334-4056-a5fb-6946214e9ba1=0}, log id: 721507 2012-08-29 11:52:10,808 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--0.0.0.0-8009-1) [2ec11b86] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System 2012-08-29 11:52:10,811 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-1) [2ec11b86] START, ConnectStorageServerVDSCommand(vdsId = 1c3207f8-f08d-11e1-8379-438e839e5efb, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 4b9fdb5c-d334-4056-a5fb-6946214e9ba1, connection: small.basin.com:/exports/data };]), log id: 3b13fdd8 2012-08-29 11:52:11,045 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-1) [2ec11b86] FINISH, ConnectStorageServerVDSCommand, return: {4b9fdb5c-d334-4056-a5fb-6946214e9ba1=0}, log id: 3b13fdd8 2012-08-29 11:52:11,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp--0.0.0.0-8009-1) [2ec11b86] START, CreateStoragePoolVDSCommand(vdsId = 1c3207f8-f08d-11e1-8379-438e839e5efb, storagePoolId=872ed943-cda1-4ec6-a4ea-36b97e7eff5a, storageType=NFS, storagePoolName=basindatacenter, masterDomainId=8f1e9376-8303-4660-948f-a6704b041e2e, domainsIdList=[8f1e9376-8303-4660-948f-a6704b041e2e], masterVersion=10), log id: 52930390 2012-08-29 11:53:15,434 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-1) [2ec11b86] Failed in CreateStoragePoolVDS method 2012-08-29 11:53:15,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-1) [2ec11b86] Error code StorageDomainDoesNotExist and error message VDSGenericException: VDSErrorException: Failed to CreateStoragePoolVDS, error = Storage domain does not exist: ('8f1e9376-8303-4660-948f-a6704b041e2e',) 2012-08-29 11:53:15,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-1) [2ec11b86] Command org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand return value Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc mCode 358 mMessage Storage domain does not exist: ('8f1e9376-8303-4660-948f-a6704b041e2e',) with NFS version option=v3 ====================================== , sharedLocks= ] 2012-08-29 11:46:44,542 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-3-thread-49) [330e12ac] Running command: AddStoragePoolWithStoragesCommand internal: false. Entities affected : ID: 872ed943-cda1-4ec6-a4ea-36b97e7eff5a Type: StoragePool 2012-08-29 11:46:44,588 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-49) [5ac343ac] START, ValidateStorageServerConnectionVDSCommand(vdsId = 1c3207f8-f08d-11e1-8379-438e839e5efb, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3d53ea05-f5fb-4eca-a449-c97096f52b84, connection: small.basin.com:/exports/data };]), log id: 33b513cb 2012-08-29 11:46:44,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-49) [5ac343ac] FINISH, ValidateStorageServerConnectionVDSCommand, return: {3d53ea05-f5fb-4eca-a449-c97096f52b84=0}, log id: 33b513cb 2012-08-29 11:46:44,607 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-3-thread-49) [5ac343ac] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System 2012-08-29 11:46:44,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [5ac343ac] START, ConnectStorageServerVDSCommand(vdsId = 1c3207f8-f08d-11e1-8379-438e839e5efb, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3d53ea05-f5fb-4eca-a449-c97096f52b84, connection: small.basin.com:/exports/data };]), log id: 392908fc 2012-08-29 11:46:44,901 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [5ac343ac] FINISH, ConnectStorageServerVDSCommand, return: {3d53ea05-f5fb-4eca-a449-c97096f52b84=477}, log id: 392908fc 2012-08-29 11:46:44,904 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (pool-3-thread-49) [5ac343ac] The connection with details small.basin.com:/exports/data failed because of error code 477 and error message is: 477 2012-08-29 11:46:44,907 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-3-thread-49) [5ac343ac] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. 2012-08-29 11:46:44,907 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (pool-3-thread-49) [5ac343ac] transaction rolled back 2012-08-29 11:46:44,907 ERROR [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-3-thread-49) [5ac343ac] Command org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand throw exception: java.lang.RuntimeException: Could not get JDBC Connection; nested exception is java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error checking for a transaction at org.ovirt.engine.core.vdsbroker.ResourceManager.CreateCommand(ResourceManager.java:372) [engine-vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:410) [engine-vdsbroker.jar:] at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] at org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand.AddStoragePoolInIrs(AddStoragePoolWithStoragesCommand.java:204) [engine-bll.jar:] at org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand.access$700(AddStoragePoolWithStoragesCommand.java:35) [engine-bll.jar:] at org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand $1$2.runInTransaction(AddStoragePoolWithStoragesCommand.java:99) [engine-bll.jar:] at org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand $1$2.runInTransaction(AddStoragePoolWithStoragesCommand.java:79) [engine-bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:144) [engine-utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:109) [engine-utils.jar:] at org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand $1.runInTransaction(AddStoragePoolWithStoragesCommand.java:77) [engine-bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:204) [engine-utils.jar:] at org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand.executeCommand(AddStoragePoolWithStoragesCommand.java:56) [engine-bll.jar:] at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:804) [engine-bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:896) [engine-bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1203) [engine-bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:204) [engine-utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:142) [engine-utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:109) [engine-utils.jar:] at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:911) [engine-bll.jar:] at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:268) [engine-bll.jar:] at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommands(MultipleActionsRunner.java:182) [engine-bll.jar:] at org.ovirt.engine.core.bll.MultipleActionsRunner.RunCommands(MultipleActionsRunner.java:162) [engine-bll.jar:] at org.ovirt.engine.core.bll.MultipleActionsRunner $1.run(MultipleActionsRunner.java:84) [engine-bll.jar:] at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil $InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] at java.util.concurrent.Executors $RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] at java.util.concurrent.ThreadPoolExecutor $Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error checking for a transaction at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:82) [spring-jdbc-2.5.6.SEC02.jar:2.5.6.SEC02] at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:577) [spring-jdbc-2.5.6.SEC02.jar:2.5.6.SEC02] at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:641) [spring-jdbc-2.5.6.SEC02.jar:2.5.6.SEC02] at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:670) [spring-jdbc-2.5.6.SEC02.jar:2.5.6.SEC02] at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:702) [spring-jdbc-2.5.6.SEC02.jar:2.5.6.SEC02] at org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect $PostgresSimpleJdbcCall.executeCallInternal(PostgresDbEngineDialect.java:155) [engine-dal.jar:] at org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect $PostgresSimpleJdbcCall.doExecute(PostgresDbEngineDialect.java:121) [engine-dal.jar:] at org.springframework.jdbc.core.simple.SimpleJdbcCall.execute(SimpleJdbcCall.java:164) [spring-jdbc-2.5.6.SEC02.jar:2.5.6.SEC02] at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeImpl(SimpleJdbcCallsHandler.java:124) [engine-dal.jar:] at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeReadAndReturnMap(SimpleJdbcCallsHandler.java:75) [engine-dal.jar:] at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeReadList(SimpleJdbcCallsHandler.java:66) [engine-dal.jar:] at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeRead(SimpleJdbcCallsHandler.java:58) [engine-dal.jar:] at org.ovirt.engine.core.dao.VdsDAODbFacadeImpl.get(VdsDAODbFacadeImpl.java:36) [engine-dal.jar:] at org.ovirt.engine.core.dao.VdsDAODbFacadeImpl.get(VdsDAODbFacadeImpl.java:31) [engine-dal.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.<init>(VdsBrokerCommand.java:32) [engine-vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand.<init>(CreateStoragePoolVDSCommand.java:12) [engine-vdsbroker.jar:] at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) [rt.jar:1.7.0_03-icedtea] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) [rt.jar:1.7.0_03-icedtea] at java.lang.reflect.Constructor.newInstance(Constructor.java:525) [rt.jar:1.7.0_03-icedtea] at org.ovirt.engine.core.vdsbroker.ResourceManager.CreateCommand(ResourceManager.java:367) [engine-vdsbroker.jar:] ... 29 more Caused by: java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error checking for a transaction at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:137) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:113) [spring-jdbc-2.5.6.SEC02.jar:2.5.6.SEC02] at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:79) [spring-jdbc-2.5.6.SEC02.jar:2.5.6.SEC02] ... 49 more Caused by: javax.resource.ResourceException: IJ000460: Error checking for a transaction at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.getManagedConnection(TxConnectionManagerImpl.java:362) at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:464) at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:129) ... 51 more Caused by: javax.resource.ResourceException: IJ000459: Transaction is not active: tx=TransactionImple < ac, BasicAction: 0:ffffc0a80103:-79e21b9e:503e3094:7cd status: ActionStatus.ABORT_ONLY > at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.getManagedConnection(TxConnectionManagerImpl.java:352) ... 53 more 2012-08-29 11:46:44,924 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-3-thread-49) [5ac343ac] Command [id=28dbd38d-6cd1-44a4-8bf9-160d94cee2b5]: Compensating CHANGED_ENTITY of org.ovirt.engine.core.common.businessentities.storage_pool; snapshot: id=872ed943-cda1-4ec6-a4ea-36b97e7eff5a. 2012-08-29 11:46:44,927 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-3-thread-49) [5ac343ac] Command [id=28dbd38d-6cd1-44a4-8bf9-160d94cee2b5]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: storagePoolId = 872ed943-cda1-4ec6-a4ea-36b97e7eff5a, storageId = 8c353789-4ced-4a11-a4f2-57373c2a262f. 2012-08-29 11:46:44,931 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-3-thread-49) [5ac343ac] Command [id=28dbd38d-6cd1-44a4-8bf9-160d94cee2b5]: Compensating CHANGED_ENTITY of org.ovirt.engine.core.common.businessentities.storage_domain_static; snapshot: id=8c353789-4ced-4a11-a4f2-57373c2a262f. 2012-08-29 11:46:44,942 ERROR [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-3-thread-49) [5ac343ac] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand. 2012-08-29 11:46:44,954 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-3-thread-49) [5ac343ac] Lock freed to object EngineLock [exclusiveLocks= key: 872ed943-cda1-4ec6-a4ea-36b97e7eff5a value: org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand , sharedLocks= ] _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users