<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Solved:<div class=""><br class=""></div><div class="">Changing the second storage domain to a glusterfs Distributed Replicate with sharding turned on, works great. Thanks for the solution.</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Gary</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><font face="Menlo" style="color: rgb(0, 0, 0); font-size: 12px; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><div class="">------------------------------------------------------------------------</div><div class="">Gary Pedretty <a href="mailto:gary@eraalaska.net" class="">gary@ravnalaska.net</a></div><div class="">Systems Manager <a href="http://www.flyravn.com" class="">www.flyravn.com</a></div><div class="">Ravn Alaska /\ 907-450-7251</div><div class="">5245 Airport Industrial Road / \/\ 907-450-7238 fax</div><div class="">Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment</div></font><font face="Monaco" class=""><span style="font-size: 12px;" class="">Serving All of Alaska / \/ /\ \ \/\ “Love your neighbor as</span></font><br style="font-family: Monaco;" class=""><font face="Menlo" style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-size: 12px;" class="">Really loving the record green up date! Summmer!! yourself” Matt 22:39</span></font><div style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: Menlo;" class=""></div><font face="Menlo" style="font-size: 12px;" class=""></font><span style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><font face="Menlo" class=""><div class="">------------------------------------------------------------------------</div></font></span><div style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><font face="Menlo" style="font-size: 12px;" class=""><br class=""></font></div></div><span style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><br class="Apple-interchange-newline"></span></div><span style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><br class="Apple-interchange-newline"></span></div><span style="color: rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><br class="Apple-interchange-newline"></span></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"><br class="Apple-interchange-newline">
</div>
<br class=""><div><blockquote type="cite" class=""><div class="">On Nov 7, 2016, at 2:10 AM, Sahina Bose <<a href="mailto:sabose@redhat.com" class="">sabose@redhat.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><br class=""><div class="gmail_extra"><br class=""><div class="gmail_quote">On Mon, Nov 7, 2016 at 3:27 PM, Gary Pedretty <span dir="ltr" class=""><<a href="mailto:gary@ravnalaska.net" target="_blank" class="">gary@ravnalaska.net</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word" class=""><div class="">[root@fai-kvm-1-gfs admin]# gluster volume status data2</div><div class="">Status of volume: data2</div><div class="">Gluster process TCP Port RDMA Port Online Pid</div><div class="">------------------------------<wbr class="">------------------------------<wbr class="">------------------</div><div class="">Brick <a href="http://fai-kvm-1-vmn.ravnalaska.net/" target="_blank" class="">fai-kvm-1-vmn.ravnalaska.net</a>:/<wbr class="">kvm2/gl</div><div class="">uster/data2/brick 49156 0 Y 3484</div><div class="">Brick <a href="http://fai-kvm-2-vmn.ravnalaska.net/" target="_blank" class="">fai-kvm-2-vmn.ravnalaska.net</a>:/<wbr class="">kvm2/gl</div><div class="">uster/data2/brick 49156 0 Y 34791</div><div class="">Brick <a href="http://fai-kvm-3-vmn.ravnalaska.net/" target="_blank" class="">fai-kvm-3-vmn.ravnalaska.net</a>:/<wbr class="">kvm2/gl</div><div class="">uster/data2/brick 49156 0 Y 177340</div><div class="">Brick <a href="http://fai-kvm-4-vmn.ravnalaska.net/" target="_blank" class="">fai-kvm-4-vmn.ravnalaska.net</a>:/<wbr class="">kvm2/gl</div><div class="">uster/data2/brick 49152 0 Y 146038</div><div class="">NFS Server on localhost 2049 0 Y 40844</div><div class="">Self-heal Daemon on localhost N/A N/A Y 40865</div><div class="">NFS Server on <a href="http://fai-kvm-2-gfs.ravnalaska.net/" target="_blank" class="">fai-kvm-2-gfs.ravnalaska.net</a> 2049 0 Y 99905</div><div class="">Self-heal Daemon on fai-kvm-2-gfs.ravnalask</div><div class=""><a href="http://a.net/" target="_blank" class="">a.net</a> N/A N/A Y 99915</div><div class="">NFS Server on <a href="http://fai-kvm-4-gfs.ravnalaska.net/" target="_blank" class="">fai-kvm-4-gfs.ravnalaska.net</a> 2049 0 Y 176305</div><div class="">Self-heal Daemon on fai-kvm-4-gfs.ravnalask</div><div class=""><a href="http://a.net/" target="_blank" class="">a.net</a> N/A N/A Y 176326</div><div class="">NFS Server on <a href="http://fai-kvm-3-gfs.ravnalaska.net/" target="_blank" class="">fai-kvm-3-gfs.ravnalaska.net</a> 2049 0 Y 226271</div><div class="">Self-heal Daemon on fai-kvm-3-gfs.ravnalask</div><div class=""><a href="http://a.net/" target="_blank" class="">a.net</a> N/A N/A Y 226287</div><div class=""><br class=""></div><div class="">Task Status of Volume data2</div><div class="">------------------------------<wbr class="">------------------------------<wbr class="">------------------</div><div class="">There are no active volume tasks</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><div class="">[root@fai-kvm-1-gfs admin]# gluster volume info data2</div><div class=""><br class=""></div><div class="">Volume Name: data2</div><div class="">Type: Striped-Replicate</div><div class="">Volume ID: 20f85c9a-541b-4df4-9dba-<wbr class="">44c5179bbfb0</div><div class="">Status: Started</div><div class="">Number of Bricks: 1 x 2 x 2 = 4</div><div class="">Transport-type: tcp</div><div class="">Bricks:</div><div class="">Brick1: <a href="http://fai-kvm-1-vmn.ravnalaska.net/" target="_blank" class="">fai-kvm-1-vmn.ravnalaska.net</a>:/<wbr class="">kvm2/gluster/data2/brick</div><div class="">Brick2: <a href="http://fai-kvm-2-vmn.ravnalaska.net/" target="_blank" class="">fai-kvm-2-vmn.ravnalaska.net</a>:/<wbr class="">kvm2/gluster/data2/brick</div><div class="">Brick3: <a href="http://fai-kvm-3-vmn.ravnalaska.net/" target="_blank" class="">fai-kvm-3-vmn.ravnalaska.net</a>:/<wbr class="">kvm2/gluster/data2/brick</div><div class="">Brick4: <a href="http://fai-kvm-4-vmn.ravnalaska.net/" target="_blank" class="">fai-kvm-4-vmn.ravnalaska.net</a>:/<wbr class="">kvm2/gluster/data2/brick</div><div class="">Options Reconfigured:</div><div class="">performance.readdir-ahead: on</div><div class="">performance.quick-read: off</div><div class="">performance.read-ahead: off</div><div class=""><a href="http://performance.io/" target="_blank" class="">performance.io</a>-cache: off</div><div class="">performance.stat-prefetch: off</div><div class="">cluster.eager-lock: enable</div><div class="">network.remote-dio: enable</div><div class="">cluster.quorum-type: auto</div><div class="">cluster.server-quorum-type: server</div><div class="">storage.owner-uid: 36</div><div class="">storage.owner-gid: 36</div></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">See attached file for the mount log.</div></div></blockquote><div class=""><br class=""><br class=""></div><div class="">Striped-Replicate is no longer supported in GlusterFS upstream. Instead, you should be using a Distribute-Replicate with sharding enabled. Also when using a gluster volume as storage domain, it is recommended to use replica 3.<br class=""><br class=""></div><div class="">From the mount logs, there is no indication as to why the volume is unmounted frequently. Could you try again with a replica 3 volume that has sharding enabled?<br class=""> <br class=""></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="word-wrap:break-word" class=""><span class="HOEnZb"><font color="#888888" class=""><div class=""><br class=""></div><div class="">Gary</div><div class=""><br class=""></div><div class=""></div></font></span></div><br class=""><div style="word-wrap:break-word" class=""><div class=""></div><div class="">
<div style="letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; word-wrap: break-word;" class=""><div style="letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; word-wrap: break-word;" class=""><div style="text-align:start;text-indent:0px;word-wrap:break-word" class=""><div style="text-align:start;text-indent:0px;word-wrap:break-word" class=""><div style="text-align:start;text-indent:0px;word-wrap:break-word" class=""><div style="text-align:start;text-indent:0px;word-wrap:break-word" class=""><div style="text-align:start;text-indent:0px;word-wrap:break-word" class=""><div style="text-align:start;text-indent:0px;word-wrap:break-word" class=""><div style="text-align:start;text-indent:0px;word-wrap:break-word" class=""><font style="font-size: 12px; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px;" face="Menlo" class=""><div class="">------------------------------<wbr class="">------------------------------<wbr class="">------------</div><div class="">Gary Pedretty <a href="mailto:gary@eraalaska.net" target="_blank" class="">gary@ravnalaska.net</a></div><div class="">Systems Manager <a href="http://www.flyravn.com/" target="_blank" class="">www.flyravn.com</a></div><div class="">Ravn Alaska /\ 907-450-7251</div><div class="">5245 Airport Industrial Road / \/\ 907-450-7238 fax</div><div class="">Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment</div></font><font face="Monaco" class=""><span style="font-size:12px" class="">Serving All of Alaska / \/ /\ \ \/\ “Love your neighbor as</span></font><br style="font-family:Monaco" class=""><font style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px;" face="Menlo" class=""><span style="font-size:12px" class="">Really loving the record green up date! Summmer!! yourself” Matt 22:39</span></font><div style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; font-family: Menlo;" class=""></div><font style="font-size:12px" face="Menlo" class=""></font><span style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; font-size: 12px;" class=""><font face="Menlo" class=""><div class="">------------------------------<wbr class="">------------------------------<wbr class="">------------</div></font></span><div style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px;" class=""><font style="font-size:12px" face="Menlo" class=""><br class=""></font></div></div><span style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; font-size: 12px;" class=""><br class="m_8434586956379529661Apple-interchange-newline"></span></div><span style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; font-size: 12px;" class=""><br class="m_8434586956379529661Apple-interchange-newline"></span></div><span style="letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; font-size: 12px;" class=""><br class="m_8434586956379529661Apple-interchange-newline"></span></div><br class="m_8434586956379529661Apple-interchange-newline"></div><br class="m_8434586956379529661Apple-interchange-newline"></div><br class="m_8434586956379529661Apple-interchange-newline"></div><br class="m_8434586956379529661Apple-interchange-newline"></div><br class="m_8434586956379529661Apple-interchange-newline"></div><br class="m_8434586956379529661Apple-interchange-newline"><br class="m_8434586956379529661Apple-interchange-newline">
</div>
<br class=""><div class=""><blockquote type="cite" class=""><div class="">On Nov 6, 2016, at 9:50 PM, Sahina Bose <<a href="mailto:sabose@redhat.com" target="_blank" class="">sabose@redhat.com</a>> wrote:</div><br class="m_8434586956379529661Apple-interchange-newline"><div class=""><span style="font-family:LucidaGrande;font-size:13px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important" class="">However your volume configuration seems suspect -"stripe 2 replica 2". Can you provide gluster volume info of your second storage domain gluster volume? The mount logs of the volume (under /var/log/glusterfs/rhev-<wbr class="">datacenter..<volname>.log) from the host where the volume is being mounted will also help.</span><br style="font-family:LucidaGrande;font-size:13px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" class=""><span style="font-family:LucidaGrande;font-size:13px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important" class=""> </span></div></blockquote></div><br class=""></div><br class=""></blockquote></div><br class=""></div></div>
</div></blockquote></div><br class=""></div></body></html>