[Users] Bug: adding LocalStorage Data Centers

Hi, affected version: oVirt 3.3 (ManagementNode) how to reproduce: setup 2 data centers with local storage, add data master storage domains to these 2 data centers add another data center with local storage, try to add another master storage domain. expected result: the data domain gets created just like the 2 before actual result: ovirt management complains that the data domain already exists, which is not true. This behaviour was introduced with version 3.3, we didn't see this in version 3.2 This is regardless of node versions. I would at first like to know if anybody can reproduce this? If this is the case I would create a bugzilla entry. Regards Sven

Can you attach exact error message? Can you try also https://[your-rhevm-setup]/api/storageconnections and check if the storage you want to add is there? Can you try https://[your-rhevm-setup]/api/storagedomains ? It may be a duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=991470 Kasia On 10/10/2013 02:28 PM, Sven Kieske wrote:
Hi,
affected version: oVirt 3.3 (ManagementNode) how to reproduce:
setup 2 data centers with local storage, add data master storage domains to these 2 data centers
add another data center with local storage, try to add another master storage domain.
expected result: the data domain gets created just like the 2 before
actual result: ovirt management complains that the data domain already exists, which is not true.
This behaviour was introduced with version 3.3, we didn't see this in version 3.2
This is regardless of node versions.
I would at first like to know if anybody can reproduce this?
If this is the case I would create a bugzilla entry.
Regards
Sven _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

Here is the excerpt from engine.log: 2013-10-10 15:06:06,390 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-15) [_WEBADMIN_13422849_Configure_Local_Storage] Lock Acquired to object EngineLock [exclusiveLocks= key: /data/images/rhev value: STORAGE_CONNECTION , sharedLocks= ] 2013-10-10 15:06:06,390 WARN [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-15) [_WEBADMIN_13422849_Configure_Local_Storage] CanDoAction of action AddStorageServerConnection failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__STORAGE__CONNECTION,ACTION_TYPE_FAILED_STORAGE_CONNECTION_ALREADY_EXISTS 2013-10-10 15:06:06,391 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-15) [_WEBADMIN_13422849_Configure_Local_Storage] Lock freed to object EngineLock [exclusiveLocks= key: /data/images/rhev value: STORAGE_CONNECTION , sharedLocks= ] Here is the API-Return of https://[your-rhevm-setup]/api/storagedomains: <storage_domains><storage_domain href="/api/storagedomains/e0c596b4-b751-46c7-8f5d-eaf21aab76a5" id="e0c596b4-b751-46c7-8f5d-eaf21aab76a5"><name>DATA_V3</name><link href="/api/storagedomains/e0c596b4-b751-46c7-8f5d-eaf21aab76a5/permissions" rel="permissions"/><link href="/api/storagedomains/e0c596b4-b751-46c7-8f5d-eaf21aab76a5/disks" rel="disks"/><type>data</type><master>true</master><storage><type>localfs</type><path>/home/DATA</path></storage><available>876173328384</available><used>47244640256</used><committed>32212254720</committed><storage_format>v3</storage_format></storage_domain><storage_domain href="/api/storagedomains/73407366-d658-4a37-ab25-6142b0f4381f" id="73407366-d658-4a37-ab25-6142b0f4381f"><name>DATA_V5</name><link href="/api/storagedomains/73407366-d658-4a37-ab25-6142b0f4381f/permissions" rel="permissions"/><link href="/api/storagedomains/73407366-d658-4a37-ab25-6142b0f4381f/disks" rel="disks"/><type>data</type><master>true</master><storage><type>localfs</type><path>/data/images/rhev</path></storage><available>922344226816</available><used>49392123904</used><committed>0</committed><storage_format>v3</storage_format></storage_domain></storage_domains> These are just our well known Storage Domains "DATA_V3" and "DATA_V5" from our hosts 3 and 5. I tried to add another one for host 4, by putting the host into maintainence mode, and then clicking: "setup local storage" When you click then "ok" in the popup you get the error: "can't add storage connection, connection already exists" The bugzilla entry seems not to fit as this is: a) no NFS Storage Domain b) no Export Storage Domain c) the name of our SD does not contain any spaces d) the bug entry mentions this bug only occurs via api because the webfrontend doesn't allow to create SDs with spaces however how can I check if the postgres db doesn't contain any other storage domains, just to make 110% sure this is not this bug? or does the api call I did via web already show there are no other storage domains left in the db? Thanks for your help so far! On 10.10.2013 15:02, Katarzyna Jachim wrote:
Can you attach exact error message?
Can you try also https://[your-rhevm-setup]/api/storageconnections and check if the storage you want to add is there?
Can you try https://[your-rhevm-setup]/api/storagedomains ?
It may be a duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=991470
Kasia
On 10/10/2013 02:28 PM, Sven Kieske wrote:
Hi,
affected version: oVirt 3.3 (ManagementNode) how to reproduce:
setup 2 data centers with local storage, add data master storage domains to these 2 data centers
add another data center with local storage, try to add another master storage domain.
expected result: the data domain gets created just like the 2 before
actual result: ovirt management complains that the data domain already exists, which is not true.
This behaviour was introduced with version 3.3, we didn't see this in version 3.2
This is regardless of node versions.
I would at first like to know if anybody can reproduce this?
If this is the case I would create a bugzilla entry.
Regards
Sven _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

On 10/10/2013 03:21 PM, Sven Kieske wrote:
Here is the excerpt from engine.log:
2013-10-10 15:06:06,390 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-15) [_WEBADMIN_13422849_Configure_Local_Storage] Lock Acquired to object EngineLock [exclusiveLocks= key: /data/images/rhev value: STORAGE_CONNECTION , sharedLocks= ] 2013-10-10 15:06:06,390 WARN [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-15) [_WEBADMIN_13422849_Configure_Local_Storage] CanDoAction of action AddStorageServerConnection failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__STORAGE__CONNECTION,ACTION_TYPE_FAILED_STORAGE_CONNECTION_ALREADY_EXISTS 2013-10-10 15:06:06,391 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-15) [_WEBADMIN_13422849_Configure_Local_Storage] Lock freed to object EngineLock [exclusiveLocks= key: /data/images/rhev value: STORAGE_CONNECTION , sharedLocks= ] Here is the API-Return of https://[your-rhevm-setup]/api/storagedomains:
<storage_domains><storage_domain href="/api/storagedomains/e0c596b4-b751-46c7-8f5d-eaf21aab76a5" id="e0c596b4-b751-46c7-8f5d-eaf21aab76a5"><name>DATA_V3</name><link href="/api/storagedomains/e0c596b4-b751-46c7-8f5d-eaf21aab76a5/permissions" rel="permissions"/><link href="/api/storagedomains/e0c596b4-b751-46c7-8f5d-eaf21aab76a5/disks" rel="disks"/><type>data</type><master>true</master><storage><type>localfs</type><path>/home/DATA</path></storage><available>876173328384</available><used>47244640256</used><committed>32212254720</committed><storage_format>v3</storage_format></storage_domain><storage_domain href="/api/storagedomains/73407366-d658-4a37-ab25-6142b0f4381f" id="73407366-d658-4a37-ab25-6142b0f4381f"><name>DATA_V5</name><link href="/api/storagedomains/73407366-d658-4a37-ab25-6142b0f4381f/permissions" rel="permissions"/><link href="/api/storagedomains/73407366-d658-4a37-ab25-6142b0f4381f/disks" rel="disks"/><type>data</type><master>true</master><storage><type>localfs</type><path>/data/images/rhev</path></storage><available>922344226816</available><used>49392123904</used><committed>0</committed><storage_format>v3</storage_format></storage_domain></storage_domains>
These are just our well known Storage Domains "DATA_V3" and "DATA_V5"
from our hosts 3 and 5.
https://[your-rhevm-setup]/api/storageconnections (!), please
I tried to add another one for host 4, by putting the host into maintainence mode, and then clicking: "setup local storage" When you click then "ok" in the popup you get the error:
"can't add storage connection, connection already exists"
So it means that you have a storage connection which is not used by any storage domain. One thing is how it was created (I suppose a duplicate of aforementioned bug), the other - how to fix it. Fix: * GET https://[your-rhevm-setup]/api/storageconnections * find id of the problematic connection * DELETE https://[your-rhevm-setup]/api/storageconnections/[id_of_the_connection] Last step perform with cURL or REST Client for Firefox or whatever is your favourite tool for REST API.
The bugzilla entry seems not to fit as this is: a) no NFS Storage Domain
Doesn't matter, it may happen for any non-iSCSI (and maybe non-FC) storage, localfs duplicate here: https://bugzilla.redhat.com/show_bug.cgi?id=1014966
b) no Export Storage Domain
Doesn't matter, I've seen it for data domains as well. Here you have duplicate for ISO: https://bugzilla.redhat.com/show_bug.cgi?id=991739
c) the name of our SD does not contain any spaces
Doesn't matter, the only important thing is if you ever tried to add this domain and the command failed.
d) the bug entry mentions this bug only occurs via api because the webfrontend doesn't allow to create SDs with spaces
however how can I check if the postgres db doesn't contain any other storage domains, just to make 110% sure this is not this bug?
You don't have additional storage domain, you have only additional storage connection. That's why I asked also for output of api/storageconnections Kasia

I'm sorry, I misread the connections for the storage domains.. this is the output of the storageconnections: <storage_connections><storage href="/api/storageconnections/b3eca2aa-5983-404f-af06-c7ca10b9fa23" id="b3eca2aa-5983-404f-af06-c7ca10b9fa23"><type>localfs</type><path>/home/DATA</path></storage><storage href="/api/storageconnections/87dc99f6-98fe-4828-99da-f228958748c0" id="87dc99f6-98fe-4828-99da-f228958748c0"><type>localfs</type><path>/data/images/rhev</path></storage><storage href="/api/storageconnections/84970346-ae22-49cf-8a4c-c1bd27a0b7a4" id="84970346-ae22-49cf-8a4c-c1bd27a0b7a4"><address>managementserver32</address><type>nfs</type><path>/var/lib/exports/export</path></storage><storage href="/api/storageconnections/1179a3b3-8f18-4696-bda8-094b7a2f5c35" id="1179a3b3-8f18-4696-bda8-094b7a2f5c35"><address>managementserver32</address><type>nfs</type><path>/var/lib/exports/iso</path></storage></storage_connections> So this is one export domain, one iso domain and 2 localfs storage domains, I suppose our two working ones. So no sign of this 5th supposed connection? the fun part: the export domain does not show up any more in the mangement, so I tried to delete the connection via curl: curl -X DELETE -H "Accept: application/xml" -u user:password https://192.168.150.50/api/storageconnections/84970346-ae22-49cf-8a4c-c1bd27... --insecure and got as response: <html><head><title>JBoss Web/7.0.13.Final - Error report</title><style><!--H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}HR {color : #525D76;}--></style> </head><body><h1>HTTP Status 405 - </h1><HR size="1" noshade="noshade"><p><b>type</b> Status report</p><p><b>message</b> <u></u></p><p><b>description</b> <u>The specified HTTP method is not allowed for the requested resource ().</u></p><HR size="1" noshade="noshade"><h3>JBoss Web/7.0.13.Final</h3></body></html> so this method does not seem to be allowed? Regards Sven
https://[your-rhevm-setup]/api/storageconnections (!), please
I tried to add another one for host 4, by putting the host into maintainence mode, and then clicking: "setup local storage" When you click then "ok" in the popup you get the error:
"can't add storage connection, connection already exists"
So it means that you have a storage connection which is not used by any storage domain. One thing is how it was created (I suppose a duplicate of aforementioned bug), the other - how to fix it.
Fix: * GET https://[your-rhevm-setup]/api/storageconnections * find id of the problematic connection * DELETE https://[your-rhevm-setup]/api/storageconnections/[id_of_the_connection]
Last step perform with cURL or REST Client for Firefox or whatever is your favourite tool for REST API.
The bugzilla entry seems not to fit as this is: a) no NFS Storage Domain
Doesn't matter, it may happen for any non-iSCSI (and maybe non-FC) storage, localfs duplicate here: https://bugzilla.redhat.com/show_bug.cgi?id=1014966
b) no Export Storage Domain
Doesn't matter, I've seen it for data domains as well. Here you have duplicate for ISO: https://bugzilla.redhat.com/show_bug.cgi?id=991739
c) the name of our SD does not contain any spaces
Doesn't matter, the only important thing is if you ever tried to add this domain and the command failed.
d) the bug entry mentions this bug only occurs via api because the webfrontend doesn't allow to create SDs with spaces
however how can I check if the postgres db doesn't contain any other storage domains, just to make 110% sure this is not this bug?
You don't have additional storage domain, you have only additional storage connection. That's why I asked also for output of api/storageconnections
Kasia

Hi, Sadly, I haven't got any reply. We still can't delete storage connections and we still can't add more than 2 local storage domains on one management node. if we try to delete a storage connection (no matter if via curl or rest-client, or ovirt-shell) we get these errors: "The specified HTTP method is not allowed for the requested resource ()." (See the attached Screenshot) When we try to delete the connection via ovirt-shell, we get: [oVirt shell (connected)]# remove storageconnection 84970346-ae22-49cf-8a4c-c1bd27a0b7a4 error: status: 404 reason: Not Found detail: Entity not found: null But you can show this storage connection, so it exists: [oVirt shell (connected)]# show storageconnection 84970346-ae22-49cf-8a4c-c1bd27a0b7a4 id : 84970346-ae22-49cf-8a4c-c1bd27a0b7a4 address: management32.vrootdev path : /var/lib/exports/export type : nfs Regards Sven

On 10/15/2013 06:24 AM, Sven Kieske wrote:
Hi,
Sadly, I haven't got any reply.
We still can't delete storage connections and we still can't add more than 2 local storage domains on one management node.
please open a bug to track this one.
if we try to delete a storage connection (no matter if via curl or rest-client, or ovirt-shell) we get these errors:
"The specified HTTP method is not allowed for the requested resource ()." (See the attached Screenshot)
When we try to delete the connection via ovirt-shell, we get:
[oVirt shell (connected)]# remove storageconnection 84970346-ae22-49cf-8a4c-c1bd27a0b7a4
I'd retry on 3.3.1 to be released to beta soon hopefully.
error: status: 404 reason: Not Found detail: Entity not found: null
But you can show this storage connection, so it exists:
[oVirt shell (connected)]# show storageconnection 84970346-ae22-49cf-8a4c-c1bd27a0b7a4
id : 84970346-ae22-49cf-8a4c-c1bd27a0b7a4 address: management32.vrootdev path : /var/lib/exports/export type : nfs
Regards
Sven
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

Hi, I created a BZ: https://bugzilla.redhat.com/show_bug.cgi?id=1020160 Regards Sven

Hi Sven, What is the path of the third local storage domain you can't add. Could it be the same as the other existing connections (/home/DATA, /data/images/rhev)? It could be an issue of this bug https://bugzilla.redhat.com/1023739 - - Cannot create same Local SD path on different Hosts Regards, Maor On 10/10/2013 05:14 PM, Sven Kieske wrote:
I'm sorry, I misread the connections for the storage domains..
this is the output of the storageconnections:
<storage_connections><storage href="/api/storageconnections/b3eca2aa-5983-404f-af06-c7ca10b9fa23" id="b3eca2aa-5983-404f-af06-c7ca10b9fa23"><type>localfs</type><path>/home/DATA</path></storage><storage href="/api/storageconnections/87dc99f6-98fe-4828-99da-f228958748c0" id="87dc99f6-98fe-4828-99da-f228958748c0"><type>localfs</type><path>/data/images/rhev</path></storage><storage href="/api/storageconnections/84970346-ae22-49cf-8a4c-c1bd27a0b7a4" id="84970346-ae22-49cf-8a4c-c1bd27a0b7a4"><address>managementserver32</address><type>nfs</type><path>/var/lib/exports/export</path></storage><storage href="/api/storageconnections/1179a3b3-8f18-4696-bda8-094b7a2f5c35" id="1179a3b3-8f18-4696-bda8-094b7a2f5c35"><address>managementserver32</address><type>nfs</type><path>/var/lib/exports/iso</path></storage></storage_connections>
So this is one export domain, one iso domain and 2 localfs storage domains, I suppose our two working ones. So no sign of this 5th supposed connection?
the fun part: the export domain does not show up any more in the mangement, so I tried to delete the connection via curl:
curl -X DELETE -H "Accept: application/xml" -u user:password https://192.168.150.50/api/storageconnections/84970346-ae22-49cf-8a4c-c1bd27... --insecure
and got as response:
<html><head><title>JBoss Web/7.0.13.Final - Error report</title><style><!--H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}HR {color : #525D76;}--></style> </head><body><h1>HTTP Status 405 - </h1><HR size="1" noshade="noshade"><p><b>type</b> Status report</p><p><b>message</b> <u></u></p><p><b>description</b> <u>The specified HTTP method is not allowed for the requested resource ().</u></p><HR size="1" noshade="noshade"><h3>JBoss Web/7.0.13.Final</h3></body></html>
so this method does not seem to be allowed?
Regards Sven
https://[your-rhevm-setup]/api/storageconnections (!), please
I tried to add another one for host 4, by putting the host into maintainence mode, and then clicking: "setup local storage" When you click then "ok" in the popup you get the error:
"can't add storage connection, connection already exists"
So it means that you have a storage connection which is not used by any storage domain. One thing is how it was created (I suppose a duplicate of aforementioned bug), the other - how to fix it.
Fix: * GET https://[your-rhevm-setup]/api/storageconnections * find id of the problematic connection * DELETE https://[your-rhevm-setup]/api/storageconnections/[id_of_the_connection]
Last step perform with cURL or REST Client for Firefox or whatever is your favourite tool for REST API.
The bugzilla entry seems not to fit as this is: a) no NFS Storage Domain
Doesn't matter, it may happen for any non-iSCSI (and maybe non-FC) storage, localfs duplicate here: https://bugzilla.redhat.com/show_bug.cgi?id=1014966
b) no Export Storage Domain
Doesn't matter, I've seen it for data domains as well. Here you have duplicate for ISO: https://bugzilla.redhat.com/show_bug.cgi?id=991739
c) the name of our SD does not contain any spaces
Doesn't matter, the only important thing is if you ever tried to add this domain and the command failed.
d) the bug entry mentions this bug only occurs via api because the webfrontend doesn't allow to create SDs with spaces
however how can I check if the postgres db doesn't contain any other storage domains, just to make 110% sure this is not this bug?
You don't have additional storage domain, you have only additional storage connection. That's why I asked also for output of api/storageconnections
Kasia
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

Hi Maor, thanks for this hint. It definitely could be some kind of an issue of that bug. Iirc we had this error in our logs but I also tried to change the path - same results. I'm also curious about the fact that the first two host have this same path and they work. If I delete one of those I can add another one but the deleted host can't be readded until I delete another one (no matter what node you select). btw: Our storage connection output was ok - one connection per domain - no orphan connections. Fabian Deutsch already assumed that it might have been a bug with a non deleted storage connection. Sadly that wasn't the reason. The sc output posted by Sven was from a later stage of this project where we already had experimented with several export domains. The "local storage bug" occured before that with a fresh installation of oVrit 3.3. Regards Daniel PS: I work with Sven on the same project. On 11.11.2013 18:17, Maor Lipchuk wrote:
Hi Sven, What is the path of the third local storage domain you can't add. Could it be the same as the other existing connections (/home/DATA, /data/images/rhev)?
It could be an issue of this bug https://bugzilla.redhat.com/1023739 - - Cannot create same Local SD path on different Hosts
Regards, Maor
On 10/10/2013 05:14 PM, Sven Kieske wrote:
I'm sorry, I misread the connections for the storage domains..
this is the output of the storageconnections:
<storage_connections><storage href="/api/storageconnections/b3eca2aa-5983-404f-af06-c7ca10b9fa23" id="b3eca2aa-5983-404f-af06-c7ca10b9fa23"><type>localfs</type><path>/home/DATA</path></storage><storage href="/api/storageconnections/87dc99f6-98fe-4828-99da-f228958748c0" id="87dc99f6-98fe-4828-99da-f228958748c0"><type>localfs</type><path>/data/images/rhev</path></storage><storage href="/api/storageconnections/84970346-ae22-49cf-8a4c-c1bd27a0b7a4" id="84970346-ae22-49cf-8a4c-c1bd27a0b7a4"><address>managementserver32</address><type>nfs</type><path>/var/lib/exports/export</path></storage><storage href="/api/storageconnections/1179a3b3-8f18-4696-bda8-094b7a2f5c35" id="1179a3b3-8f18-4696-bda8-094b7a2f5c35"><address>managementserver32</address><type>nfs</type><path>/var/lib/exports/iso</path></storage></storage_connections>
So this is one export domain, one iso domain and 2 localfs storage domains, I suppose our two working ones. So no sign of this 5th supposed connection?
the fun part: the export domain does not show up any more in the mangement, so I tried to delete the connection via curl:
curl -X DELETE -H "Accept: application/xml" -u user:password https://192.168.150.50/api/storageconnections/84970346-ae22-49cf-8a4c-c1bd27... --insecure
and got as response:
<html><head><title>JBoss Web/7.0.13.Final - Error report</title><style><!--H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}HR {color : #525D76;}--></style> </head><body><h1>HTTP Status 405 - </h1><HR size="1" noshade="noshade"><p><b>type</b> Status report</p><p><b>message</b> <u></u></p><p><b>description</b> <u>The specified HTTP method is not allowed for the requested resource ().</u></p><HR size="1" noshade="noshade"><h3>JBoss Web/7.0.13.Final</h3></body></html>
so this method does not seem to be allowed?
Regards Sven
https://[your-rhevm-setup]/api/storageconnections (!), please
I tried to add another one for host 4, by putting the host into maintainence mode, and then clicking: "setup local storage" When you click then "ok" in the popup you get the error:
"can't add storage connection, connection already exists"
So it means that you have a storage connection which is not used by any storage domain. One thing is how it was created (I suppose a duplicate of aforementioned bug), the other - how to fix it.
Fix: * GET https://[your-rhevm-setup]/api/storageconnections * find id of the problematic connection * DELETE https://[your-rhevm-setup]/api/storageconnections/[id_of_the_connection]
Last step perform with cURL or REST Client for Firefox or whatever is your favourite tool for REST API.
The bugzilla entry seems not to fit as this is: a) no NFS Storage Domain
Doesn't matter, it may happen for any non-iSCSI (and maybe non-FC) storage, localfs duplicate here: https://bugzilla.redhat.com/show_bug.cgi?id=1014966
b) no Export Storage Domain
Doesn't matter, I've seen it for data domains as well. Here you have duplicate for ISO: https://bugzilla.redhat.com/show_bug.cgi?id=991739
c) the name of our SD does not contain any spaces
Doesn't matter, the only important thing is if you ever tried to add this domain and the command failed.
d) the bug entry mentions this bug only occurs via api because the webfrontend doesn't allow to create SDs with spaces
however how can I check if the postgres db doesn't contain any other storage domains, just to make 110% sure this is not this bug?
You don't have additional storage domain, you have only additional storage connection. That's why I asked also for output of api/storageconnections
Kasia
_______________________________________________ Users mailing list Users-dEQiMlfYlSzYtjvyW6yDsg@public.gmane.org http://lists.ovirt.org/mailman/listinfo/users

Hi Maor, that's interesting. Honestly, I don't remember the exact paths, but I think we did setup everything "the standard way" :). A colleague of mine tries to reproduce this again, this time with a newer engine version. Will this patchset get included in 3.3.1? We would like to give it a shot, but can't spend the time to build ovirt-engine from scratch with this patch. Maybe someone can provide a nightly build? Am 11.11.2013 18:17, schrieb Maor Lipchuk:
Hi Sven, What is the path of the third local storage domain you can't add. Could it be the same as the other existing connections (/home/DATA, /data/images/rhev)?
It could be an issue of this bug https://bugzilla.redhat.com/1023739 - - Cannot create same Local SD path on different Hosts
Regards, Maor
-- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

Hi, I have some additional information: When we delete one of the 2 functional data centers and then try to add the local storage domain inside the third data center, we succeed. If we then try to add the deleted data center 2 again, now as the third data center, the addition of the local storage domain for _this_ data center fails. Can someone please test, if you can reproduce this? All you need is 4 Hosts and a maximum of 1 hour to set everything up. Thanks Sven

On 10/11/2013 10:24 AM, Sven Kieske wrote:
Hi,
I have some additional information:
When we delete one of the 2 functional data centers and then try to add the local storage domain inside the third data center, we succeed.
If we then try to add the deleted data center 2 again, now as the third data center, the addition of the local storage domain for _this_ data center fails.
Can someone please test, if you can reproduce this? All you need is 4 Hosts and a maximum of 1 hour to set everything up.
Thanks
Sven _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
logs?

Hi, sorry for my late reply. Actually we don't have any logs saved but the bug is reproducible and occurs even within a fresh installation. We're really looking forward to 3.3.1 release because we need a couple of the 3.3 features. Due to the need of local storage we are stuck with engine 3.2.3. Maybe someone can reproduce this and confirm the bug and provide additional logs? Sadly I don't got the time atm :-/ Am 11.10.2013 13:56, schrieb Itamar Heim:
we delete one of the 2 functional data centers and then try to add the local storage domain inside the third data center, we succeed.
If we then try to add the deleted data center 2 again, now as the third data center, the addition
-- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

I created a BZ for this: https://bugzilla.redhat.com/show_bug.cgi?id=1029107 additional info: we were able to reproduce this with a fresh ovirt 3.3 setup, without defect storage connections, so this can not be the storage connection bug. Am 11.11.2013 16:49, schrieb Sven Kieske:
Hi, sorry for my late reply. Actually we don't have any logs saved but the bug is reproducible and occurs even within a fresh installation.
We're really looking forward to 3.3.1 release because we need a couple of the 3.3 features. Due to the need of local storage we are stuck with engine 3.2.3.
Maybe someone can reproduce this and confirm the bug and provide additional logs?
Sadly I don't got the time atm :-/
Am 11.10.2013 13:56, schrieb Itamar Heim:
we delete one of the 2 functional data centers and then try to add the local storage domain inside the third data center, we succeed.
If we then try to add the deleted data center 2 again, now as the third data center, the addition
-- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

Hi, I'm currently setting up a fresh 3.3.1 from ovirt.org beta repo I just wanted to say that maybe more people would test from ovirt.org repo if the download speed could get bumped up somewhat: yum install ovirt-engine ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Total 190 kB/s | 305 MB 27:21 -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

Il 12/11/2013 10:34, Sven Kieske ha scritto:
Hi,
I'm currently setting up a fresh 3.3.1 from ovirt.org beta repo
Hi, may I invite you to add yourself to http://www.ovirt.org/Testing/Ovirt_3.3.1_testing?
I just wanted to say that maybe more people would test from ovirt.org repo if the download speed could get bumped up somewhat:
yum install ovirt-engine ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Total
190 kB/s | 305 MB 27:21
-- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

Hi, done that. We encountered this bug: https://bugzilla.redhat.com/show_bug.cgi?id=1023739 we tested 3.3.1 from the beta ovirt.org repo. Could this bug fix please be included in 3.3.1 release? Am 12.11.2013 11:33, schrieb Sandro Bonazzola:
Il 12/11/2013 10:34, Sven Kieske ha scritto:
Hi,
I'm currently setting up a fresh 3.3.1 from ovirt.org beta repo
Hi, may I invite you to add yourself to http://www.ovirt.org/Testing/Ovirt_3.3.1_testing?
-- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

On 11/12/2013 06:37 AM, Sven Kieske wrote:
Hi,
done that.
We encountered this bug: https://bugzilla.redhat.com/show_bug.cgi?id=1023739
we tested 3.3.1 from the beta ovirt.org repo.
Could this bug fix please be included in 3.3.1 release?
patch isn't small and 3.3.1 has been in beta/frozen for a while now (pending last vdsm issue). so i prefer this to wait to 3.3.2 (already fixed there) which beta should be available once we release 3.3.1.
Am 12.11.2013 11:33, schrieb Sandro Bonazzola:
Il 12/11/2013 10:34, Sven Kieske ha scritto:
Hi,
I'm currently setting up a fresh 3.3.1 from ovirt.org beta repo
Hi, may I invite you to add yourself to http://www.ovirt.org/Testing/Ovirt_3.3.1_testing?

On 11/12/2013 06:50 AM, Itamar Heim wrote:
On 11/12/2013 06:37 AM, Sven Kieske wrote:
Hi,
done that.
We encountered this bug: https://bugzilla.redhat.com/show_bug.cgi?id=1023739
we tested 3.3.1 from the beta ovirt.org repo.
Could this bug fix please be included in 3.3.1 release?
patch isn't small and 3.3.1 has been in beta/frozen for a while now (pending last vdsm issue). so i prefer this to wait to 3.3.2 (already fixed there) which beta should be available once we release 3.3.1.
btw, i assume the workaround is simply using a different path?

Hi, yes it is, but that's not that simple at all, looking at our use case: We want to automate this as much as possible via REST-API and scripts, so we would need to e.g. put an ascending number in the path to avoid this bug, but on the other hand this makes debugging via scripts difficult as each server has it's own path, which must be detected or stored in some way. Until now this is a dev system, but once this goes live I expect it to grow quite fast, so I really don't want such dirty workarounds in my live systems, because let's be honest: you never get rid off them again ;-) So we are really looking forward for this patch! :-)
btw, i assume the workaround is simply using a different path?
-- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

----- Original Message -----
From: "Itamar Heim" <iheim@redhat.com> To: "Sven Kieske" <S.Kieske@mittwald.de>, users@ovirt.org Sent: Tuesday, November 12, 2013 1:50:00 PM Subject: Re: [Users] Bug: adding LocalStorage Data Centers
On 11/12/2013 06:37 AM, Sven Kieske wrote:
Hi,
done that.
We encountered this bug: https://bugzilla.redhat.com/show_bug.cgi?id=1023739
we tested 3.3.1 from the beta ovirt.org repo.
Could this bug fix please be included in 3.3.1 release?
patch isn't small and 3.3.1 has been in beta/frozen for a while now (pending last vdsm issue). so i prefer this to wait to 3.3.2 (already fixed there) which beta should be available once we release 3.3.1. After some reassessment, this patch isn't soooo bad, and was backported to 3.3.1. Keep your eyes open for the upcoming release :-)
Am 12.11.2013 11:33, schrieb Sandro Bonazzola:
Il 12/11/2013 10:34, Sven Kieske ha scritto:
Hi,
I'm currently setting up a fresh 3.3.1 from ovirt.org beta repo
Hi, may I invite you to add yourself to http://www.ovirt.org/Testing/Ovirt_3.3.1_testing?
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
participants (7)
-
Allon Mureinik
-
dlampe
-
Itamar Heim
-
Katarzyna Jachim
-
Maor Lipchuk
-
Sandro Bonazzola
-
Sven Kieske