1:05 a.m.
--_000_BY1PR09MB0824E7FF50EC2611720F4D14F5000BY1PR09MB0824namp_
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
I just noticed this in the Alerts tab: Detected deletion of volume test1 on=
cluster 8000-1, and deleted it from engine DB.
Yet, It still shows in the web UI?
________________________________
From: Precht, Andrew
Sent: Tuesday, April 11, 2017 2:39:31 PM
To: knarra; Sandro Bonazzola; Sahina Bose; Tal Nisan; Allon Mureinik; Nir S=
offer
Cc: users
Subject: Re: [ovirt-users] I=92m having trouble deleting a test gluster vol=
ume
The plot thickens=85
I put all hosts in the cluster into maintenance mode, with the Stop Gluster=
service checkbox checked. I then deleted the /var/lib/glusterd/vols/test1 =
directory on all hosts. I then took the host that the test1 volume was on o=
ut of maintenance mode. Then I tried to remove the test1 volume from within=
the web UI. With no luck, I got the message: Could not delete Gluster Volu=
me test1 on cluster 8000-1.
I went back and checked all host for the test1 directory, it is not on any =
host. Yet I still can=92t remove it=85
Any suggestions?
________________________________
From: Precht, Andrew
Sent: Tuesday, April 11, 2017 1:15:22 PM
To: knarra; Sandro Bonazzola; Sahina Bose; Tal Nisan; Allon Mureinik; Nir S=
offer
Cc: users
Subject: Re: [ovirt-users] I=92m having trouble deleting a test gluster vol=
ume
Here is an update=85
I checked the /var/log/glusterfs/etc-glusterfs-glusterd.vol.log on the node=
that had the trouble volume (test1). I didn=92t see any errors. So, I ran =
a tail -f on the log as I tried to remove the volume using the web UI. here=
is what was appended:
[2017-04-11 19:48:40.756360] I [MSGID: 106487] [glusterd-handler.c:1474:__g=
lusterd_handle_cli_list_friends] 0-glusterd: Received cli list req
[2017-04-11 19:48:42.238840] I [MSGID: 106488] [glusterd-handler.c:1537:__g=
lusterd_handle_cli_get_volume] 0-management: Received get vol req
The message "I [MSGID: 106487] [glusterd-handler.c:1474:__glusterd_handle_c=
li_list_friends] 0-glusterd: Received cli list req" repeated 6 times betwee=
n [2017-04-11 19:48:40.756360] and [2017-04-11 19:49:32.596536]
The message "I [MSGID: 106488] [glusterd-handler.c:1537:__glusterd_handle_c=
li_get_volume] 0-management: Received get vol req" repeated 20 times betwee=
n [2017-04-11 19:48:42.238840] and [2017-04-11 19:49:34.082179]
[2017-04-11 19:51:41.556077] I [MSGID: 106487] [glusterd-handler.c:1474:__g=
lusterd_handle_cli_list_friends] 0-glusterd: Received cli list req
I=92m seeing that the timestamps on these log entries do not match the time=
on the node.
The next steps
I stopped the glusterd service on the node with volume test1
I deleted it with: rm -rf /var/lib/glusterd/vols/test1
I started the glusterd service.
After starting the gluster service back up, the directory /var/lib/glusterd=
/vols/test1 reappears.
I=92m guessing syncing with the other nodes?
Is this because I have the Volume Option: auth allow *
Do I need to remove the directory /var/lib/glusterd/vols/test1 on all nodes=
in the cluster individually?
thanks
________________________________
From: knarra <knarra(a)redhat.com Sent: Tuesday, April 11, 2017
11:51:18 AM
To: Precht, Andrew; Sandro Bonazzola; Sahina Bose; Tal Nisan; Allon Mureini=
k; Nir Soffer
Cc: users
Subject: Re: [ovirt-users] I=92m having trouble deleting a test gluster vol=
ume
On 04/11/2017 11:28 PM, Precht, Andrew wrote:
Hi all,
The node is oVirt Node 4.1.1 with glusterfs-3.8.10-1.el7.
On the node I can not find /var/log/glusterfs/glusterd.log However, there i=
s a /var/log/glusterfs/glustershd.log
can you check if /var/log/glusterfs/etc-glusterfs-glusterd.vol.log exists? =
if yes, can you check if there is any error present in that file ?
What happens if I follow the four steps outlined here to remove the volume =
from the node BUT, I do have another volume present in the cluster. It too =
is a test volume. Neither one has any data on them. So, data loss is not an=
issue.
Running those four steps will remove the volume from your cluster . If the =
volumes what you have are test volumes you could just follow the steps outl=
ined to delete them (since you are not able to delete from UI) and bring ba=
ck the cluster into a normal state.
________________________________
From: knarra <knarra@redhat.com><mailto:knarra@redhat.com Sent: Tuesday, April 11, 2017 10:32:27 AM
To: Sandro Bonazzola; Precht, Andrew; Sahina Bose; Tal Nisan; Allon Mureini=
k; Nir Soffer
Cc: users
Subject: Re: [ovirt-users] I=92m having trouble deleting a test gluster vol=
ume
On 04/11/2017 10:44 PM, Sandro Bonazzola wrote:
Adding some people
Il 11/Apr/2017 19:06, "Precht, Andrew"
<Andrew.Precht@sjlibrary.org<mailto:=
Andrew.Precht(a)sjlibrary.org>> ha scritto:
Hi Ovirt users,
I=92m a newbie to oVirt and I=92m having trouble deleting a test gluster vo=
lume. The nodes are 4.1.1 and the engine is 4.1.0
When I try to remove the test volume, I click Remove, the dialog box prompt=
ing to confirm the deletion pops up and after I click OK, the dialog box ch=
anges to show a little spinning wheel and then it disappears. In the end th=
e volume is still there.
with the latest version of glusterfs & ovirt we do not see any issue with d=
eleting a volume. Can you please check /var/log/glusterfs/glusterd.log file=
if there is any error present?
The test volume was distributed with two host members. One of the hosts I w=
as able to remove from the volume by removing the host form the cluster. Wh=
en I try to remove the remaining host in the volume, even with the =93Force=
Remove=94 box ticked, I get this response: Cannot remove Host. Server havi=
ng Gluster volume.
What to try next?
since you have already removed the volume from one host in the cluster and =
you still see it on another host you can do the following to remove the vol=
ume from another host.
1) Login to the host where the volume is present.
2) cd to /var/lib/glusterd/vols
3) rm -rf <vol_name 4) Restart glusterd on that host.
And before doing the above make sure that you do not have any other volume =
present in the cluster.
Above steps should not be run on a production system as you might loose the=
volume and data.
Now removing the host from UI should succed.
P.S. I=92ve tried to join this user group several times in the past, with n=
o response.
Is it possible for me to join this group?
Regards,
Andrew
_______________________________________________
Users mailing list
Users@ovirt.org<mailto:Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--_000_BY1PR09MB0824E7FF50EC2611720F4D14F5000BY1PR09MB0824namp_
Content-Type: text/html; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
<html <head <meta http-equiv=3D"Content-Type"
content=3D"text/html; charset=3DWindows-1=
252" </head <body bgcolor=3D"#FFFFFF"
text=3D"#000000" <style
type=3D"text/css" style=3D"display:none;"><!-- P
{margin-top:0;margi=
n-bottom:0;} --></style <div
id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font=
-family:Calibri,Arial,Helvetica,sans-serif;" dir=3D"ltr" <p>I just <span>noticed </span>this
in the Alerts tab: <span>Dete=
cted deletion of volume test1 on cluster 8000-1, and deleted it from engine=
DB.</span></p <p><span>Yet, It still
shows in the web UI?</span></p
</div <hr
style=3D"display:inline-block;width:98%" tabindex=3D"-1" <div id=3D"divRplyFwdMsg"
dir=3D"ltr"><font face=3D"Calibri, sans-serif" st=
yle=3D"font-size:11pt" color=3D"#000000"><b>From:</b>
Precht, Andrew<br <b>Sent:</b> Tuesday,
April 11, 2017 2:39:31 PM<br <b>To:</b> knarra;
Sandro Bonazzola; Sahina Bose; Tal Nisan; Allon Mureinik=
; Nir Soffer<br <b>Cc:</b>
users<br <b>Subject:</b> Re:
[ovirt-users] I=92m having trouble deleting a test glus=
ter volume</font <div> </div </div
<div><style type=3D"text/css"
style=3D"display:none;"><!-- P {margin-top:0;=
margin-bottom:0;} --></style <div
id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font=
-family:Calibri,Arial,Helvetica,sans-serif;" dir=3D"ltr" <p></p
<div>The plot thickens=85</div
<div>I put all hosts in the cluster into maintenance mode, with the Stop Gl=
uster service checkbox checked. I then deleted the /var/lib/glusterd/vols/t=
est1 directory on all hosts. I then took the host that the test1 volume was=
on out of maintenance mode. Then
I tried to remove the test1 volume from within the web UI. With no luck, I=
got the message: Could not delete Gluster Volume test1 on cluster 8000-1.<=
/div <div><br
</div <div>I went back and checked
all host for the test1 directory, it is not on=
any host. Yet I still can=92t remove it=85</div
<div><br </div <div>Any suggestions?</div <br <p></p </div <hr
style=3D"display:inline-block;width:98%" tabindex=3D"-1" <div id=3D"divRplyFwdMsg"
dir=3D"ltr"><font face=3D"Calibri, sans-serif" st=
yle=3D"font-size:11pt" color=3D"#000000"><b>From:</b>
Precht, Andrew<br <b>Sent:</b> Tuesday,
April 11, 2017 1:15:22 PM<br <b>To:</b> knarra;
Sandro Bonazzola; Sahina Bose; Tal Nisan; Allon Mureinik=
; Nir Soffer<br <b>Cc:</b>
users<br <b>Subject:</b> Re:
[ovirt-users] I=92m having trouble deleting a test glus=
ter volume</font <div> </div </div
<div><style type=3D"text/css"
style=3D"display:none;"><!-- P {margin-top:0;=
margin-bottom:0;} --></style <div
id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font=
-family:Calibri,Arial,Helvetica,sans-serif;" dir=3D"ltr" <p></p
<div>Here is an update=85</div
<div><br </div <div>I checked the
/var/log/glusterfs/etc-glusterfs-glusterd.vol.log on the=
node that had the trouble volume (test1). I didn=92t see any errors. So, I=
ran a tail -f on the log as I tried to remove the volume using the web UI.=
here is what was appended:</div
<div><br </div <div>[2017-04-11 19:48:40.756360] I [MSGID: 106487]
[glusterd-handler.c:147=
4:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req</di=
v <div>[2017-04-11 19:48:42.238840] I [MSGID: 106488]
[glusterd-handler.c:153=
7:__glusterd_handle_cli_get_volume] 0-management: Received get vol req</div=
<div>The message "I [MSGID: 106487]
[glusterd-handler.c:1474:__gluster=
d_handle_cli_list_friends] 0-glusterd: Received cli list req" repeated=
6 times between [2017-04-11 19:48:40.756360] and [2017-04-11 19:49:32.5965=
36]</div <div>The message "I
[MSGID: 106488] [glusterd-handler.c:1537:__gluster=
d_handle_cli_get_volume] 0-management: Received get vol req" repeated =
20 times between [2017-04-11 19:48:42.238840] and [2017-04-11 19:49:34.0821=
79]</div <div>[2017-04-11
19:51:41.556077] I [MSGID: 106487] [glusterd-handler.c:147=
4:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req</di=
v <div><br
</div <div>I=92m seeing that the
timestamps on these log entries do not match the=
time on the node.</div <div><br </div
<div>The next steps</div
<div>I stopped the glusterd service on the node with volume test1</div <div>I deleted it with: rm -rf
/var/lib/glusterd/vols/test1</div
<div>I started the glusterd service.</div
<div><br </div <div>After starting the gluster service back up, the
directory /var/lib/glu=
sterd/vols/test1 reappears.</div
<div>I=92m guessing syncing with the other nodes?</div <div>Is this because I have the Volume Option: auth allow
*</div <div>Do I need to remove the
directory /var/lib/glusterd/vols/test1 on all =
nodes in the cluster individually?</div
<div><br </div <div>thanks</div
<br <p></p </div <hr
style=3D"display:inline-block;width:98%" tabindex=3D"-1" <div id=3D"divRplyFwdMsg"
dir=3D"ltr"><font face=3D"Calibri, sans-serif" st=
yle=3D"font-size:11pt" color=3D"#000000"><b>From:</b>
knarra <knarra@red=
hat.com><br <b>Sent:</b> Tuesday,
April 11, 2017 11:51:18 AM<br <b>To:</b> Precht,
Andrew; Sandro Bonazzola; Sahina Bose; Tal Nisan; Allon =
Mureinik; Nir Soffer<br <b>Cc:</b>
users<br <b>Subject:</b> Re:
[ovirt-users] I=92m having trouble deleting a test glus=
ter volume</font <div> </div </div
<div <div
class=3D"moz-cite-prefix">On 04/11/2017 11:28 PM, Precht, Andrew wrote=
:<br </div
<blockquote
cite=3D"mid:BY1PR09MB08246AC41807C7DFFE7A3308F5000@BY1PR09MB082=
4.namprd09.prod.outlook.com" type=3D"cite" <style
type=3D"text/css" style=3D"display:none;"><!-- P
{margin-top:0;margi=
n-bottom:0;} --></style <div
id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font=
-family:Calibri,Arial,Helvetica,sans-serif;" dir=3D"ltr" <div>Hi all,</div
<div>The node is oVirt Node 4.1.1 with
glusterfs-3.8.10-1.el7. </div
<div>On the node I can not find /var/log/glusterfs/glusterd.log However, th=
ere is a /var/log/glusterfs/glustershd.log
<br </div
</div </blockquote can you check if
/var/log/glusterfs/etc-glusterfs-glusterd.vol.log exists? =
if yes, can you check if there is any error present in that file ?<span sty=
le=3D"color: rgb(84, 84, 84); font-family: arial,
sans-serif; font-size: small; font-style: normal;
font-variant-ligatures: normal; font-variant-caps: normal;
font-weight: normal; letter-spacing: normal; orphans: 2;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(255, 255,
255); display: inline !important; float: none;"></span <blockquote
cite=3D"mid:BY1PR09MB08246AC41807C7DFFE7A3308F5000@BY1PR09MB082=
4.namprd09.prod.outlook.com" type=3D"cite" <div
id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font=
-family:Calibri,Arial,Helvetica,sans-serif;" dir=3D"ltr" <div><br
</div <div>What happens if I follow
the four steps outlined here to remove the vo=
lume from the node
<u>BUT</u>, I do have another volume present in the cluster. It too is a te=
st volume. Neither one has any data on them. So, data loss is not an issue.=
</div </div </blockquote Running
those four steps will remove the volume from your cluster . If the =
volumes what you have are test volumes you could just follow the steps outl=
ined to delete them (since you are not able to delete from UI) and bring ba=
ck the cluster into a normal state.<br
<blockquote
cite=3D"mid:BY1PR09MB08246AC41807C7DFFE7A3308F5000@BY1PR09MB082=
4.namprd09.prod.outlook.com" type=3D"cite" <div
id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font=
-family:Calibri,Arial,Helvetica,sans-serif;" dir=3D"ltr" <br </div <hr style=3D"display:inline-block;width:98%"
tabindex=3D"-1" <div
id=3D"divRplyFwdMsg" dir=3D"ltr"><font
style=3D"font-size:11pt" color=
=3D"#000000" face=3D"Calibri, sans-serif"><b>From:</b>
knarra
<a class=3D"moz-txt-link-rfc2396E"
href=3D"mailto:knarra@redhat.com"><kn=
arra(a)redhat.com&gt;</a><br
<b>Sent:</b> Tuesday, April 11, 2017 10:32:27 AM<br <b>To:</b> Sandro Bonazzola; Precht, Andrew; Sahina
Bose; Tal Nisan; Allon =
Mureinik; Nir Soffer<br <b>Cc:</b>
users<br <b>Subject:</b> Re:
[ovirt-users] I=92m having trouble deleting a test glus=
ter volume</font <div> </div </div
<div <div
class=3D"moz-cite-prefix">On 04/11/2017 10:44 PM, Sandro Bonazzola wro=
te:<br </div <blockquote
cite=3D"mid:CAPQRNTk8iieOFrM0GHeCjkozBSxoA3WoLaOr+EAAHgY_oA=
bkkQ(a)mail.gmail.com" type=3D"cite" <div
dir=3D"auto">Adding some people</div <div
class=3D"gmail_extra"><br <div
class=3D"gmail_quote">Il 11/Apr/2017 19:06, "Precht,
Andrew"=
<<a moz-do-not-send=3D"true"
href=3D"mailto:Andrew.Precht@sjlibrary.org=
">Andrew.Precht(a)sjlibrary.org</a>&gt; ha scritto:<br
type=3D"attribution" <blockquote
class=3D"gmail_quote" style=3D"margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex" <div dir=3D"ltr" <div
id=3D"m_7567123270890452842divtagdefaultwrapper" style=3D"font-size:12=
pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif" dir=3D"ltr=
" <div>Hi Ovirt users,</div
<div>I=92m a newbie to oVirt and I=92m having trouble deleting a test glust=
er volume. The nodes are 4.1.1 and the engine is 4.1.0</div <div><br
</div <div>When I try to remove the
test volume, I click Remove, the dialog box p=
rompting to confirm the deletion pops up and after I click OK, the dialog b=
ox changes to show a little spinning wheel and then it disappears. In the e=
nd the volume is still there.</div
</div </div </blockquote
</div </div </blockquote with the
latest version of glusterfs & ovirt we do not see any issue wi=
th deleting a volume. Can you please check /var/log/glusterfs/glusterd.log =
file if there is any error present?
<br <br <br
<blockquote
cite=3D"mid:CAPQRNTk8iieOFrM0GHeCjkozBSxoA3WoLaOr+EAAHgY_oA=
bkkQ(a)mail.gmail.com" type=3D"cite" <div
class=3D"gmail_extra" <div
class=3D"gmail_quote" <blockquote
class=3D"gmail_quote" style=3D"margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex" <div dir=3D"ltr" <div
id=3D"m_7567123270890452842divtagdefaultwrapper" style=3D"font-size:12=
pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif" dir=3D"ltr=
" The test volume was distributed with two host members. One of
the hosts I w=
as able to remove from the volume by removing the host form the cluster. Wh=
en I try to remove the remaining host in the volume, even with the =93Force=
Remove=94 box ticked, I get this response:
Cannot remove Host. Server having Gluster volume.
<div><br </div <div>What to try next?</div </div
</div </blockquote </div
</div </blockquote since you have already removed the volume from one host in the
cluster and =
you still see it on another host you can do the following to remove the vol=
ume from another host.<br <br 1) Login
to the host where the volume is present.<br 2) cd to
/var/lib/glusterd/vols<br 3) rm -rf
<vol_name><br 4) Restart glusterd on
that host.<br <br And
before doing the above make sure that you do not have any other volume =
present in the cluster.<br <br Above
steps should not be run on a production system as you might loose the=
volume and data.
<br <br Now removing the host from UI should
succed.<br <br
<blockquote
cite=3D"mid:CAPQRNTk8iieOFrM0GHeCjkozBSxoA3WoLaOr+EAAHgY_oA=
bkkQ(a)mail.gmail.com" type=3D"cite" <div
class=3D"gmail_extra" <div
class=3D"gmail_quote" <blockquote
class=3D"gmail_quote" style=3D"margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex" <div dir=3D"ltr" <div
id=3D"m_7567123270890452842divtagdefaultwrapper" style=3D"font-size:12=
pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif" dir=3D"ltr=
" <div><br
</div <div>P.S. I=92ve tried to join
this user group several times in the past, w=
ith no response.</div <div>Is it possible for me to
join this group?</div <div><br </div
<div>Regards,</div <div>Andrew</div <br </div </div
</blockquote </div </div
<br <fieldset
class=3D"mimeAttachmentHeader"></fieldset> <br <pre
wrap=3D"">_______________________________________________
Users mailing list
<a moz-do-not-send=3D"true" class=3D"moz-txt-link-abbreviated"
href=3D"mail=
to:Users@ovirt.org">Users@ovirt.org</a <a
moz-do-not-send=3D"true" class=3D"moz-txt-link-freetext"
href=3D"http://=
lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/ma...
info/users</a </pre </blockquote
<p><br </p
</div </blockquote <p><br
</p </div </div
</div </body </html
--_000_BY1PR09MB0824E7FF50EC2611720F4D14F5000BY1PR09MB0824namp_--