<div dir="ltr">Hi,<div><br></div><div>Sorry for follow up again, but, checking the ovirt interface I've found that ovirt report the "engine" volume as an "arbiter" configuration and the "data" volume as full replicated volume. Check these screenshots:</div><div><br></div><div><a href="https://drive.google.com/drive/folders/0ByUV7xQtP1gCTE8tUTFfVmR5aDQ?usp=sharing">https://drive.google.com/drive/folders/0ByUV7xQtP1gCTE8tUTFfVmR5aDQ?usp=sharing</a><br></div><div><br></div><div>But the "gluster volume info" command report that all 2 volume are full replicated:</div><div><br></div><div><br></div><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px"><div><div><i>Volume Name: data</i></div></div><div><div><i>Type: Replicate</i></div></div><div><div><i>Volume ID: c7a5dfc9-3e72-4ea1-843e-c8275d4a7c2d</i></div></div><div><div><i>Status: Started</i></div></div><div><div><i>Snapshot Count: 0</i></div></div><div><div><i>Number of Bricks: 1 x 3 = 3</i></div></div><div><div><i>Transport-type: tcp</i></div></div><div><div><i>Bricks:</i></div></div><div><div><i>Brick1: gdnode01:/gluster/data/brick</i></div></div><div><div><i>Brick2: gdnode02:/gluster/data/brick</i></div></div><div><div><i>Brick3: gdnode04:/gluster/data/brick</i></div></div><div><div><i>Options Reconfigured:</i></div></div><div><div><i>nfs.disable: on</i></div></div><div><div><i>performance.readdir-ahead: on</i></div></div><div><div><i>transport.address-family: inet</i></div></div><div><div><i>storage.owner-uid: 36</i></div></div><div><div><i>performance.quick-read: off</i></div></div><div><div><i>performance.read-ahead: off</i></div></div><div><div><i>performance.io-cache: off</i></div></div><div><div><i>performance.stat-prefetch: off</i></div></div><div><div><i>performance.low-prio-threads: 32</i></div></div><div><div><i>network.remote-dio: enable</i></div></div><div><div><i>cluster.eager-lock: enable</i></div></div><div><div><i>cluster.quorum-type: auto</i></div></div><div><div><i>cluster.server-quorum-type: server</i></div></div><div><div><i>cluster.data-self-heal-algorithm: full</i></div></div><div><div><i>cluster.locking-scheme: granular</i></div></div><div><div><i>cluster.shd-max-threads: 8</i></div></div><div><div><i>cluster.shd-wait-qlength: 10000</i></div></div><div><div><i>features.shard: on</i></div></div><div><div><i>user.cifs: off</i></div></div><div><div><i>storage.owner-gid: 36</i></div></div><div><div><i>features.shard-block-size: 512MB</i></div></div><div><div><i>network.ping-timeout: 30</i></div></div><div><div><i>performance.strict-o-direct: on</i></div></div><div><div><i>cluster.granular-entry-heal: on</i></div></div><div><div><i>auth.allow: *</i></div></div><div><div><i>server.allow-insecure: on</i></div></div></blockquote><div><br></div><div><br></div><div><br></div><div><br></div><div><blockquote style="color:rgb(0,0,0);font-size:12.8px;margin:0px 0px 0px 40px;border:none;padding:0px"><div class="gmail_extra"><div class="gmail_quote"><i>Volume Name: engine</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Type: Replicate</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Volume ID: d19c19e3-910d-437b-8ba7-<wbr>4f2a23d17515</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Status: Started</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Snapshot Count: 0</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Number of Bricks: 1 x 3 = 3</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Transport-type: tcp</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Bricks:</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Brick1: gdnode01:/gluster/engine/brick</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Brick2: gdnode02:/gluster/engine/brick</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Brick3: gdnode04:/gluster/engine/brick</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>Options Reconfigured:</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>nfs.disable: on</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>performance.readdir-ahead: on</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>transport.address-family: inet</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>storage.owner-uid: 36</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>performance.quick-read: off</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>performance.read-ahead: off</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>performance.io-cache: off</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>performance.stat-prefetch: off</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>performance.low-prio-threads: 32</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>network.remote-dio: off</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>cluster.eager-lock: enable</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>cluster.quorum-type: auto</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>cluster.server-quorum-type: server</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>cluster.data-self-heal-<wbr>algorithm: full</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>cluster.locking-scheme: granular</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>cluster.shd-max-threads: 8</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>cluster.shd-wait-qlength: 10000</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>features.shard: on</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>user.cifs: off</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>storage.owner-gid: 36</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>features.shard-block-size: 512MB</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>network.ping-timeout: 30</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>performance.strict-o-direct: on</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>cluster.granular-entry-heal: on</i></div></div><div class="gmail_extra"><div class="gmail_quote"><i>auth.allow: *</i></div></div></blockquote><div class="gmail_extra" style="color:rgb(0,0,0);font-size:12.8px"><div class="gmail_quote"> server.allow-insecure: on</div></div></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">2017-07-21 19:13 GMT+02:00 yayo (j) <span dir="ltr"><<a href="mailto:jaganz@gmail.com" target="_blank">jaganz@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><span class="">2017-07-20 14:48 GMT+02:00 Ravishankar N <span dir="ltr"><<a href="mailto:ravishankar@redhat.com" target="_blank">ravishankar@redhat.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div bgcolor="#FFFFFF"><span class="m_7510525959629396992gmail-">
<p><br></p></span>
But it does say something. All these gfids of completed heals in
the log below are the for the ones that you have given the getfattr
output of. So what is likely happening is there is an intermittent
connection problem between your mount and the brick process, leading
to pending heals again after the heal gets completed, which is why
the numbers are varying each time. You would need to check why that
is the case.<br>
Hope this helps,<br>
Ravi<div><div class="m_7510525959629396992gmail-h5"><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div><br>
</div>
</div>
</div>
<blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px">
<div class="gmail_extra">
<div class="gmail_quote">
<div>
<div><i>[2017-07-20 09:58:46.573079] I [MSGID: 108026]
[afr-self-heal-common.c:1254:a<wbr>fr_log_selfheal]
0-engine-replicate-0: Completed data selfheal on
e6dfd556-340b-4b76-b47b-7b6f5b<wbr>d74327.
sources=[0] 1 sinks=2</i></div>
</div>
</div>
</div>
<div class="gmail_extra">
<div class="gmail_quote">
<div>
<div><i>[2017-07-20 09:59:22.995003] I [MSGID: 108026]
[afr-self-heal-metadata.c:51:_<wbr>_afr_selfheal_metadata_do]
0-engine-replicate-0: performing metadata selfheal
on f05b9742-2771-484a-85fc-5b6974<wbr>bcef81</i></div>
</div>
</div>
</div>
<div class="gmail_extra">
<div class="gmail_quote">
<div>
<div><i>[2017-07-20 09:59:22.999372] I [MSGID: 108026]
[afr-self-heal-common.c:1254:a<wbr>fr_log_selfheal]
0-engine-replicate-0: Completed metadata selfheal on
f05b9742-2771-484a-85fc-5b6974<wbr>bcef81.
sources=[0] 1 sinks=2</i></div></div></div></div></blockquote></div></blockquote></div></div></div></blockquote><div><br></div><div><br></div></span><div>Hi,</div><div><br></div><div>following your suggestion, I've checked the "peer" status and I found that there is too many name for the hosts, I don't know if this can be the problem or part of it:</div><div><br></div></div></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div class="gmail_extra"><div class="gmail_quote"><div><div><i><b>gluster peer status on NODE01:</b></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Number of Peers: 2</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Hostname: dnode02.localdomain.local</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Uuid: 7c0ebfa3-5676-4d3f-9bfa-<wbr>7fff6afea0dd</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>State: Peer in Cluster (Connected)</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Other names:</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>192.168.10.52</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>dnode02.localdomain.local</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>10.10.20.90</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>10.10.10.20</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><b><i>gluster peer status on </i><i>NODE02:</i></b></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Number of Peers: 2</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Hostname: dnode01.localdomain.local</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Uuid: a568bd60-b3e4-4432-a9bc-<wbr>996c52eaaa12</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>State: Peer in Cluster (Connected)</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Other names:</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>gdnode01</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>10.10.10.10</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Hostname: gdnode04</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Uuid: ce6e0f6b-12cf-4e40-8f01-<wbr>d1609dfc5828</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>State: Peer in Cluster (Connected)</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Other names:</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>192.168.10.54</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>10.10.10.40</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><b><br></b></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><b><i>gluster peer status on </i><i>NODE04:</i></b></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Number of Peers: 2</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Hostname: dnode02.neridom.dom</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Uuid: 7c0ebfa3-5676-4d3f-9bfa-<wbr>7fff6afea0dd</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>State: Peer in Cluster (Connected)</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Other names:</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>10.10.20.90</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>gdnode02</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>192.168.10.52</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>10.10.10.20</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Hostname: dnode01.localdomain.local</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Uuid: a568bd60-b3e4-4432-a9bc-<wbr>996c52eaaa12</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>State: Peer in Cluster (Connected)</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>Other names:</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>gdnode01</i></div></div></div></div><div class="gmail_extra"><div class="gmail_quote"><div><div><i>10.10.10.10</i></div></div></div></div></blockquote><div class="gmail_extra"><div class="gmail_quote"><div><div><i><br></i></div><div><i><br></i></div><div>All these ip are pingable and hosts resolvible across all 3 nodes but, only the 10.10.10.0 network is the decidated network for gluster (rosolved using gdnode* host names) ... You think that remove other entries can fix the problem? So, sorry, but, how can I remove other entries? </div><div><br></div></div><div>And, what about the selinux? </div><div><br></div><div>Thank you</div><div><br></div><div><br></div></div>
</div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature">Linux User: 369739 <a href="http://counter.li.org" target="_blank">http://counter.li.org</a></div>
</div>