[Users] disks successfully removed with torage failure message

Hello, 3.3.2 beta on Fedora 19 engine with 2 Fedora 19 hosts and GusterFS

Hi, Are you just reporting? Is there a question in there? In any case - what's the failure message? Please send logs as well. Regards, Vered ----- Original Message -----
From: "Gianluca Cecchi" <gianluca.cecchi@gmail.com> To: "users" <users@ovirt.org> Sent: Thursday, December 12, 2013 3:39:32 PM Subject: [Users] disks successfully removed with torage failure message
Hello, 3.3.2 beta on Fedora 19 engine with 2 Fedora 19 hosts and GusterFS _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

On Thu, Dec 12, 2013 at 2:39 PM, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
Hello, 3.3.2 beta on Fedora 19 engine with 2 Fedora 19 hosts and GusterFS
Sorry for previous incomplete e-mail... I remove a VM and I get VM c8again32 has been removed, but the following disks could not be removed: c8again32_Disk1. These disks will appear in the main disks tab in illegal state, please remove manually when possible. Going into disks section I remove the disk and I get this ambiguous message.... Disk c8again32_Disk1 was successfully removed from domain gvdata with storage failure (User admin@internal). I continue to see the disk inside list and continues to be in illegal state.... What to do... BTW: when I delete the disk I see inside webadmin messages these two lines.... tried several times and they come up as soon as I run the delete disk operation.... 2013-Dec-12, 14:42 Storage Pool Manager runs on Host f18ovn01 (Address: 10.4.4.58). 2013-Dec-12, 14:42 Data Center is being initialized, please wait for initialization to complete. Gianluca

engine.log extract is here: https://drive.google.com/file/d/0BwoPbcrMv8mvT0trWi1USkJYU1k/edit?usp=sharin...

Hןת I'm looking into it now, please send the vdsm log as well, in case I need it too. Thanks, Vered ----- Original Message -----
From: "Gianluca Cecchi" <gianluca.cecchi@gmail.com> To: "users" <users@ovirt.org> Sent: Thursday, December 12, 2013 3:52:18 PM Subject: Re: [Users] disks successfully removed with torage failure message
engine.log extract is here: https://drive.google.com/file/d/0BwoPbcrMv8mvT0trWi1USkJYU1k/edit?usp=sharin... _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

On Thu, 12 Dec 2013 21:39:32 +0800, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
Hello, 3.3.2 beta on Fedora 19 engine with 2 Fedora 19 hosts and GusterFS
Hi, I think I have met the same problem this Monday and I've worked out a solution[1]. Would you please give it a try? I didn't verify whether it's exactly the same because I couldn't download your log due to my bad Internet connection. Does the log look like below: ----- Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 857, in _run return fn(*args, **kargs) File "/usr/share/vdsm/logUtils.py", line 45, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 1529, in deleteImage dom.deleteImage(sdUUID, imgUUID, volsByImg) File "/usr/share/vdsm/storage/fileSD.py", line 342, in deleteImage currImgDir = getImagePath(sdUUID, imgUUID) File "/usr/share/vdsm/storage/fileSD.py", line 97, in getImagePath return os.path.join(getDomPath(sdUUID), 'images', imgUUID) File "/usr/share/vdsm/storage/fileSD.py", line 89, in getDomPath raise se.StorageDomainDoesNotExist(sdUUID) StorageDomainDoesNotExist: Storage domain does not exist: ('74867fea-da26-42ce-b57a-1dda70015fc7',) ----- [1]. http://gerrit.ovirt.org/#/c/22359/ -- regards, hunt

Hi, I've looked at the logs and will have to discuss the issue with some people, which I will only be able to do tomorrow. In the mean time, When the message to manually remove the disks appear, it actually means manually - not through the engine at all, if that helps for now. This means through the DB, which it not recommended and I'd prefer to wait till tomorrow and figure this out. Regards, Vered ----- Original Message -----
From: "huntxu" <mhuntxu@gmail.com> To: users@ovirt.org Sent: Friday, December 13, 2013 5:59:37 AM Subject: Re: [Users] disks successfully removed with torage failure message
On Thu, 12 Dec 2013 21:39:32 +0800, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
Hello, 3.3.2 beta on Fedora 19 engine with 2 Fedora 19 hosts and GusterFS
Hi, I think I have met the same problem this Monday and I've worked out a solution[1]. Would you please give it a try?
I didn't verify whether it's exactly the same because I couldn't download your log due to my bad Internet connection.
Does the log look like below:
----- Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 857, in _run return fn(*args, **kargs) File "/usr/share/vdsm/logUtils.py", line 45, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 1529, in deleteImage dom.deleteImage(sdUUID, imgUUID, volsByImg) File "/usr/share/vdsm/storage/fileSD.py", line 342, in deleteImage currImgDir = getImagePath(sdUUID, imgUUID) File "/usr/share/vdsm/storage/fileSD.py", line 97, in getImagePath return os.path.join(getDomPath(sdUUID), 'images', imgUUID) File "/usr/share/vdsm/storage/fileSD.py", line 89, in getDomPath raise se.StorageDomainDoesNotExist(sdUUID) StorageDomainDoesNotExist: Storage domain does not exist: ('74867fea-da26-42ce-b57a-1dda70015fc7',) -----
[1]. http://gerrit.ovirt.org/#/c/22359/
-- regards, hunt _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

Not sure if this info would be helpful but I had this happen on my CentOS w/ gluster install too. Logs are long gone unfortunately. On Sat, Dec 14, 2013 at 7:41 PM, Vered Volansky <vered@redhat.com> wrote:
Hi,
I've looked at the logs and will have to discuss the issue with some people, which I will only be able to do tomorrow. In the mean time, When the message to manually remove the disks appear, it actually means manually - not through the engine at all, if that helps for now. This means through the DB, which it not recommended and I'd prefer to wait till tomorrow and figure this out.
Regards, Vered
----- Original Message -----
From: "huntxu" <mhuntxu@gmail.com> To: users@ovirt.org Sent: Friday, December 13, 2013 5:59:37 AM Subject: Re: [Users] disks successfully removed with torage failure message
On Thu, 12 Dec 2013 21:39:32 +0800, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
Hello, 3.3.2 beta on Fedora 19 engine with 2 Fedora 19 hosts and GusterFS
Hi, I think I have met the same problem this Monday and I've worked out a solution[1]. Would you please give it a try?
I didn't verify whether it's exactly the same because I couldn't download your log due to my bad Internet connection.
Does the log look like below:
----- Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 857, in _run return fn(*args, **kargs) File "/usr/share/vdsm/logUtils.py", line 45, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 1529, in deleteImage dom.deleteImage(sdUUID, imgUUID, volsByImg) File "/usr/share/vdsm/storage/fileSD.py", line 342, in deleteImage currImgDir = getImagePath(sdUUID, imgUUID) File "/usr/share/vdsm/storage/fileSD.py", line 97, in getImagePath return os.path.join(getDomPath(sdUUID), 'images', imgUUID) File "/usr/share/vdsm/storage/fileSD.py", line 89, in getDomPath raise se.StorageDomainDoesNotExist(sdUUID) StorageDomainDoesNotExist: Storage domain does not exist: ('74867fea-da26-42ce-b57a-1dda70015fc7',) -----
[1]. http://gerrit.ovirt.org/#/c/22359/
-- regards, hunt _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

On Dec 14, 2013 9:41 AM, "Vered Volansky" <vered@redhat.com> wrote:
Hi,
I've looked at the logs and will have to discuss the issue with some
people, which I will only be able to do tomorrow.
In the mean time, When the message to manually remove the disks appear, it actually means manually - not through the engine at all, if that helps for now. This means through the DB, which it not recommended and I'd prefer to wait till tomorrow and figure this out.
Regards, Vered
OK. Let me know when you have something for me to try. I'm going to analyze the other user suggestion too.... Gianluca

Gianluca, Huntxu It looks like huntxu's solution is the way to go. I'd appreciate it if any of you will open a bug on this issue and inform the list. If there's anything else regarding this issue please ask. Thanks, Vered ----- Original Message -----
From: "Gianluca Cecchi" <gianluca.cecchi@gmail.com> To: "Vered Volansky" <vered@redhat.com> Cc: "users" <users@ovirt.org>, "huntxu" <mhuntxu@gmail.com> Sent: Saturday, December 14, 2013 11:10:35 AM Subject: Re: [Users] disks successfully removed with torage failure message
On Dec 14, 2013 9:41 AM, "Vered Volansky" <vered@redhat.com> wrote:
Hi,
I've looked at the logs and will have to discuss the issue with some
people, which I will only be able to do tomorrow.
In the mean time, When the message to manually remove the disks appear, it actually means manually - not through the engine at all, if that helps for now. This means through the DB, which it not recommended and I'd prefer to wait till tomorrow and figure this out.
Regards, Vered
OK. Let me know when you have something for me to try. I'm going to analyze the other user suggestion too....
Gianluca
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

On Mon, Dec 16, 2013 at 10:52 AM, Vered Volansky wrote:
Gianluca, Huntxu
It looks like huntxu's solution is the way to go. I'd appreciate it if any of you will open a bug on this issue and inform the list.
If there's anything else regarding this issue please ask.
Thanks, Vered
----- Original Message -----
From: "Gianluca Cecchi" To: "Vered Volansky" Cc: "users" , "huntxu" Sent: Saturday, December 14, 2013 11:10:35 AM Subject: Re: [Users] disks successfully removed with torage failure message
On Dec 14, 2013 9:41 AM, "Vered Volansky" wrote:
Hi,
I've looked at the logs and will have to discuss the issue with some
people, which I will only be able to do tomorrow.
In the mean time, When the message to manually remove the disks appear, it actually means manually - not through the engine at all, if that helps for now. This means through the DB, which it not recommended and I'd prefer to wait till tomorrow and figure this out.
Regards, Vered
OK. Let me know when you have something for me to try. I'm going to analyze the other user suggestion too....
Gianluca
Hello, to resume this thread and confirm as resolved in 3.3.3 RC. I had 3 disks in Illegal state since 3.3.2 beta and that I was unable to delete. It seems it was already fixed in beta1 but I didn't test there. I think it is related to this bug in QA https://bugzilla.redhat.com/show_bug.cgi?id=1046600 Just to confirm that indeed I was able to delete and so confirm for 3.3.3 RC Thanks, Gianluca
participants (4)
-
Andrew Lau
-
Gianluca Cecchi
-
huntxu
-
Vered Volansky