12:47 p.m.
oVirt engine shows one of the gluster servers having an issue. I did a
graceful shutdown of all three nodes over weekend as I have to move around
some power connections in prep for UPS.
Came back up.. but....
[image: image.png]
And this is reflected in 2 bricks online (should be three for each volume)
[image: image.png]
Command line shows gluster should be happy.
[root@thor engine]# gluster peer status
Number of Peers: 2
Hostname: odinst.penguinpages.local
Uuid: 83c772aa-33cd-430f-9614-30a99534d10e
State: Peer in Cluster (Connected)
Hostname: medusast.penguinpages.local
Uuid: 977b2c1d-36a8-4852-b953-f75850ac5031
State: Peer in Cluster (Connected)
[root@thor engine]#
# All bricks showing online
[root@thor engine]# gluster volume status
Status of volume: data
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick thorst.penguinpages.local:/gluster_br
icks/data/data 49152 0 Y
11001
Brick odinst.penguinpages.local:/gluster_br
icks/data/data 49152 0 Y
2970
Brick medusast.penguinpages.local:/gluster_
bricks/data/data 49152 0 Y
2646
Self-heal Daemon on localhost N/A N/A Y
50560
Self-heal Daemon on odinst.penguinpages.loc
al N/A N/A Y
3004
Self-heal Daemon on medusast.penguinpages.l
ocal N/A N/A Y
2475
Task Status of Volume data
------------------------------------------------------------------------------
There are no active volume tasks
Status of volume: engine
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick thorst.penguinpages.local:/gluster_br
icks/engine/engine 49153 0 Y
11012
Brick odinst.penguinpages.local:/gluster_br
icks/engine/engine 49153 0 Y
2982
Brick medusast.penguinpages.local:/gluster_
bricks/engine/engine 49153 0 Y
2657
Self-heal Daemon on localhost N/A N/A Y
50560
Self-heal Daemon on odinst.penguinpages.loc
al N/A N/A Y
3004
Self-heal Daemon on medusast.penguinpages.l
ocal N/A N/A Y
2475
Task Status of Volume engine
------------------------------------------------------------------------------
There are no active volume tasks
Status of volume: iso
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick thorst.penguinpages.local:/gluster_br
icks/iso/iso 49156 49157 Y
151426
Brick odinst.penguinpages.local:/gluster_br
icks/iso/iso 49156 49157 Y
69225
Brick medusast.penguinpages.local:/gluster_
bricks/iso/iso 49156 49157 Y
45018
Self-heal Daemon on localhost N/A N/A Y
50560
Self-heal Daemon on odinst.penguinpages.loc
al N/A N/A Y
3004
Self-heal Daemon on medusast.penguinpages.l
ocal N/A N/A Y
2475
Task Status of Volume iso
------------------------------------------------------------------------------
There are no active volume tasks
Status of volume: vmstore
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick thorst.penguinpages.local:/gluster_br
icks/vmstore/vmstore 49154 0 Y
11023
Brick odinst.penguinpages.local:/gluster_br
icks/vmstore/vmstore 49154 0 Y
2993
Brick medusast.penguinpages.local:/gluster_
bricks/vmstore/vmstore 49154 0 Y
2668
Self-heal Daemon on localhost N/A N/A Y
50560
Self-heal Daemon on medusast.penguinpages.l
ocal N/A N/A Y
2475
Self-heal Daemon on odinst.penguinpages.loc
al N/A N/A Y
3004
Task Status of Volume vmstore
------------------------------------------------------------------------------
There are no active volume tasks
[root@thor engine]# gluster volume heal
data engine iso vmstore
[root@thor engine]# gluster volume heal data info
Brick thorst.penguinpages.local:/gluster_bricks/data/data
Status: Connected
Number of entries: 0
Brick odinst.penguinpages.local:/gluster_bricks/data/data
Status: Connected
Number of entries: 0
Brick medusast.penguinpages.local:/gluster_bricks/data/data
Status: Connected
Number of entries: 0
[root@thor engine]# gluster volume heal engine
Launching heal operation to perform index self heal on volume engine has
been successful
Use heal info commands to check status.
[root@thor engine]# gluster volume heal engine info
Brick thorst.penguinpages.local:/gluster_bricks/engine/engine
Status: Connected
Number of entries: 0
Brick odinst.penguinpages.local:/gluster_bricks/engine/engine
Status: Connected
Number of entries: 0
Brick medusast.penguinpages.local:/gluster_bricks/engine/engine
Status: Connected
Number of entries: 0
[root@thor engine]# gluster volume heal vmwatore info
Volume vmwatore does not exist
Volume heal failed.
[root@thor engine]#
So not sure what to do with oVirt Engine to make it happy again.
--
p <jeremey.wise(a)gmail.com>enguinpages
