<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Hi<div class=""><br class=""></div><div class=""><blockquote type="cite" class=""><div text="#000000" bgcolor="#FFFFFF" class="">It is not removed. Can you try 'gluster volume set volname cluster.eager-lock enable`?</div></blockquote><div class=""><br class=""></div>This works. BTW by default this setting is “on”. What’s the difference between “on” and “enable”?</div><div class=""><br class=""></div><div class="">Thanks for the clarification.</div><div class=""><br class=""></div><div class="">Regards,</div><div class=""><br class=""></div><div class="">Roderick</div><div class=""><br class=""><div><blockquote type="cite" class=""><div class="">On 06 Apr 2016, at 10:56 AM, Ravishankar N <<a href="mailto:ravishankar@redhat.com" class="">ravishankar@redhat.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class="">
<meta content="text/html; charset=windows-1252" http-equiv="Content-Type" class="">
<div text="#000000" bgcolor="#FFFFFF" class="">
<div class="moz-cite-prefix">On 04/06/2016 02:08 PM, Roderick Mooi
wrote:<br class="">
</div>
<blockquote cite="mid:90A2411F-0F73-437D-899B-6098A5C7A1B6@csir.co.za" type="cite" class="">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252" class="">
Hi Ravi and colleagues
<div class=""><br class="">
</div>
<div class="">(apologies for hijacking this thread but I’m not
sure where else to report this (and it is related).)
<div class=""><br class="">
</div>
<div class="">With gluster 3.7.10, running</div>
<div class="">#gluster volume set <volname> group virt</div>
<div class="">fails with:</div>
<div class="">volume set: failed: option : eager-lock does not
exist</div>
<div class="">Did you mean eager-lock?</div>
<div class=""><br class="">
</div>
<div class="">I had to remove the eager-lock setting from
/var/lib/glusterd/groups/virt to get this to work. It seems
like setting eager-lock has been removed from latest gluster.
Is this correct? Either way, is there anything else I should
do?</div>
</div>
</blockquote>
<br class="">
It is not removed. Can you try 'gluster volume set volname
cluster.eager-lock enable`?<br class="">
I think the disperse (EC) translator introduced a
`disperse.eager-lock` which is why you would need to mention entire
volume option name to avoid ambiguity.<br class="">
We probably need to fix the virt profile setting to include the
entire name. By the way 'gluster volume set help` should give you
the list of all options.<br class="">
<br class="">
-Ravi<br class="">
<br class="">
<blockquote cite="mid:90A2411F-0F73-437D-899B-6098A5C7A1B6@csir.co.za" type="cite" class="">
<div class="">
<div class=""><br class="">
</div>
<div class="">Cheers,</div>
<div class=""><br class="">
</div>
<div class="">Roderick<br class="">
<div class=""><br class="">
<div class="">
<blockquote type="cite" class="">
<div class="">On 12 Feb 2016, at 6:18 AM, Ravishankar N
<<a moz-do-not-send="true" href="mailto:ravishankar@redhat.com" class="">ravishankar@redhat.com</a>>
wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<meta content="text/html; charset=windows-1252" http-equiv="Content-Type" class="">
<div text="#000000" bgcolor="#FFFFFF" class="">
<div class="moz-cite-prefix">Hi Bill,<br class="">
Can you enable virt-profile setting for your
volume and see if that helps? You need to enable
this optimization when you create the volume using
ovrit, or use the following command for an
existing volume:<br class="">
<tt class=""><br class="">
#gluster volume set <volname> group virt</tt><br class="">
<br class="">
-Ravi<br class="">
<br class="">
<br class="">
On 02/12/2016 05:22 AM, Bill James wrote:<br class="">
</div>
<blockquote cite="mid:56BD1EB9.5000802@j2.com" type="cite" class="">
<meta content="text/html; charset=windows-1252" http-equiv="Content-Type" class="">
My apologies, I'm showing how much of a noob I am.<br class="">
Ignore last direct to gluster numbers, as that
wasn't really glusterfs.<br class="">
<br class="">
<br class="">
[root@ovirt2 test ~]# mount -t glusterfs <a moz-do-not-send="true" href="http://ovirt2-ks.test.j2noc.com/" class="">ovirt2-ks.test.j2noc.com</a>:/gv1
/mnt/tmp/<br class="">
[root@ovirt2 test ~]# time dd if=/dev/zero
of=/mnt/tmp/testfile2 bs=1M count=1000
oflag=direct<br class="">
1048576000 bytes (1.0 GB) copied, 65.8596 s, 15.9
MB/s<br class="">
<br class="">
That's more how I expected, it is pointing to
glusterfs performance.<br class="">
<br class="">
<br class="">
<br class="">
<div class="moz-cite-prefix">On 02/11/2016 03:27
PM, Bill James wrote:<br class="">
</div>
<blockquote cite="mid:56BD18D7.8080909@j2.com" type="cite" class="">
<meta http-equiv="Content-Type" content="text/html; charset=windows-1252" class="">
don't know if it helps, but I ran a few more
tests, all from the same hardware node.<br class="">
<br class="">
The VM:<br class="">
[root@billjov1 ~]# time dd if=/dev/zero
of=/root/testfile bs=1M count=1000 oflag=direct<br class="">
1048576000 bytes (1.0 GB) copied, 62.5535 s,
16.8 MB/s<br class="">
<br class="">
Writing directly to gluster volume:<br class="">
[root@ovirt2 test ~]# time dd if=/dev/zero
of=/gluster-store/brick1/gv1/testfile bs=1M
count=1000 oflag=direct<br class="">
1048576000 bytes (1.0 GB) copied, 9.92048 s, 106
MB/s<br class="">
<br class="">
<br class="">
Writing to NFS volume:<br class="">
[root@ovirt2 test ~]# time dd if=/dev/zero
of=/mnt/storage/qa/testfile bs=1M count=1000
oflag=direct<br class="">
1048576000 bytes (1.0 GB) copied, 10.5776 s,
99.1 MB/s<br class="">
<br class="">
NFS & Gluster are using the same interface.
Tests were not run at same time.<br class="">
<br class="">
This would suggest my problem isn't glusterfs,
but the VM performance.<br class="">
<br class="">
<br class="">
<br class="">
<div class="moz-cite-prefix">On 02/11/2016 03:13
PM, Bill James wrote:<br class="">
</div>
<blockquote cite="mid:56BD1589.8090506@j2.com" type="cite" class="">xml attached. <br class="">
<br class="">
<br class="">
On 02/11/2016 12:28 PM, Nir Soffer wrote: <br class="">
<blockquote type="cite" class="">On Thu, Feb
11, 2016 at 8:27 PM, Bill James <a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:bill.james@j2.com"></a><a class="moz-txt-link-rfc2396E" href="mailto:bill.james@j2.com"><bill.james@j2.com></a>
wrote: <br class="">
<blockquote type="cite" class="">thank you
for the reply. <br class="">
<br class="">
We setup gluster using the names
associated with NIC 2 IP. <br class="">
Brick1: <a moz-do-not-send="true" href="http://ovirt1-ks.test.j2noc.com/" class="">ovirt1-ks.test.j2noc.com</a>:/gluster-store/brick1/gv1
<br class="">
Brick2: <a moz-do-not-send="true" href="http://ovirt2-ks.test.j2noc.com/" class="">ovirt2-ks.test.j2noc.com</a>:/gluster-store/brick1/gv1
<br class="">
Brick3: <a moz-do-not-send="true" href="http://ovirt3-ks.test.j2noc.com/" class="">ovirt3-ks.test.j2noc.com</a>:/gluster-store/brick1/gv1
<br class="">
<br class="">
That's NIC 2's IP. <br class="">
Using 'iftop -i eno2 -L 5 -t' : <br class="">
<br class="">
dd if=/dev/zero of=/root/testfile bs=1M
count=1000 oflag=direct <br class="">
1048576000 bytes (1.0 GB) copied, 68.0714
s, 15.4 MB/s <br class="">
</blockquote>
Can you share the xml of this vm? You can
find it in vdsm log, <br class="">
at the time you start the vm. <br class="">
<br class="">
Or you can do (on the host): <br class="">
<br class="">
# virsh <br class="">
virsh # list <br class="">
(username: vdsm@ovirt password: shibboleth)
<br class="">
virsh # dumpxml vm-id <br class="">
<br class="">
<blockquote type="cite" class="">Peak rate
(sent/received/total):
281Mb 5.36Mb <br class="">
282Mb <br class="">
Cumulative
(sent/received/total):
1.96GB 14.6MB <br class="">
1.97GB <br class="">
<br class="">
gluster volume info gv1: <br class="">
Options Reconfigured: <br class="">
performance.write-behind-window-size:
4MB <br class="">
performance.readdir-ahead: on <br class="">
performance.cache-size: 1GB <br class="">
performance.write-behind: off <br class="">
<br class="">
performance.write-behind: off didn't help.
<br class="">
Neither did any other changes I've tried.
<br class="">
<br class="">
<br class="">
There is no VM traffic on this VM right
now except my test. <br class="">
<br class="">
<br class="">
<br class="">
On 02/10/2016 11:55 PM, Nir Soffer wrote:
<br class="">
<blockquote type="cite" class="">On Thu,
Feb 11, 2016 at 2:42 AM, Ravishankar N <a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:ravishankar@redhat.com"></a><a class="moz-txt-link-rfc2396E" href="mailto:ravishankar@redhat.com"><ravishankar@redhat.com></a>
<br class="">
wrote: <br class="">
<blockquote type="cite" class="">+gluster-users
<br class="">
<br class="">
Does disabling
'performance.write-behind' give a
better throughput? <br class="">
<br class="">
<br class="">
<br class="">
On 02/10/2016 11:06 PM, Bill James
wrote: <br class="">
<blockquote type="cite" class="">I'm
setting up a ovirt cluster using
glusterfs and noticing not stellar <br class="">
performance. <br class="">
Maybe my setup could use some
adjustments? <br class="">
<br class="">
3 hardware nodes running centos7.2,
glusterfs 3.7.6.1, ovirt 3.6.2.6-1.
<br class="">
Each node has 8 spindles configured
in 1 array which is split using LVM
<br class="">
with one logical volume for system
and one for gluster. <br class="">
They each have 4 NICs, <br class="">
NIC1 = ovirtmgmt <br class="">
NIC2 = gluster (1GbE) <br class="">
</blockquote>
</blockquote>
How do you ensure that gluster trafic is
using this nic? <br class="">
<br class="">
<blockquote type="cite" class="">
<blockquote type="cite" class="">
NIC3 = VM traffic <br class="">
</blockquote>
</blockquote>
How do you ensure that vm trafic is
using this nic? <br class="">
<br class="">
<blockquote type="cite" class="">
<blockquote type="cite" class="">I
tried with default glusterfs
settings <br class="">
</blockquote>
</blockquote>
And did you find any difference? <br class="">
<br class="">
<blockquote type="cite" class="">
<blockquote type="cite" class="">and
also with: <br class="">
performance.cache-size: 1GB <br class="">
performance.readdir-ahead: on <br class="">
performance.write-behind-window-size:
4MB <br class="">
<br class="">
[root@ovirt3 test scripts]# gluster
volume info gv1 <br class="">
<br class="">
Volume Name: gv1 <br class="">
Type: Replicate <br class="">
Volume ID:
71afc35b-09d7-4384-ab22-57d032a0f1a2
<br class="">
Status: Started <br class="">
Number of Bricks: 1 x 3 = 3 <br class="">
Transport-type: tcp <br class="">
Bricks: <br class="">
Brick1: <a moz-do-not-send="true" href="http://ovirt1-ks.test.j2noc.com/" class="">ovirt1-ks.test.j2noc.com</a>:/gluster-store/brick1/gv1
<br class="">
Brick2: <a moz-do-not-send="true" href="http://ovirt2-ks.test.j2noc.com/" class="">ovirt2-ks.test.j2noc.com</a>:/gluster-store/brick1/gv1
<br class="">
Brick3: <a moz-do-not-send="true" href="http://ovirt3-ks.test.j2noc.com/" class="">ovirt3-ks.test.j2noc.com</a>:/gluster-store/brick1/gv1
<br class="">
Options Reconfigured: <br class="">
performance.cache-size: 1GB <br class="">
performance.readdir-ahead: on <br class="">
performance.write-behind-window-size:
4MB <br class="">
<br class="">
<br class="">
Using simple dd test on VM in ovirt:
<br class="">
dd if=/dev/zero
of=/root/testfile bs=1G count=1
oflag=direct <br class="">
</blockquote>
</blockquote>
block size of 1G?! <br class="">
<br class="">
Try 1M (our default for storage
operations) <br class="">
<br class="">
<blockquote type="cite" class="">
<blockquote type="cite" class="">
1073741824 bytes (1.1 GB) copied,
65.9337 s, 16.3 MB/s <br class="">
<br class="">
Another VM not in ovirt using nfs: <br class="">
dd if=/dev/zero
of=/root/testfile bs=1G count=1
oflag=direct <br class="">
1073741824 bytes (1.1 GB)
copied, 27.0079 s, 39.8 MB/s <br class="">
<br class="">
<br class="">
Is that expected or is there a
better way to set it up to get
better <br class="">
performance? <br class="">
</blockquote>
</blockquote>
Adding Niels for advice. <br class="">
<br class="">
<blockquote type="cite" class="">
<blockquote type="cite" class="">This
email, its contents and .... <br class="">
</blockquote>
</blockquote>
Please avoid this, this is a public
mailing list, everything you write <br class="">
here is public. <br class="">
<br class="">
Nir <br class="">
</blockquote>
I'll have to look into how to remove this
sig for this mailing list.... <br class="">
<br class="">
Cloud Services for Business <a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="http://www.j2.com/"></a><a class="moz-txt-link-abbreviated" href="http://www.j2.com/">www.j2.com</a>
<br class="">
j2 | eFax | eVoice | FuseMail | Campaigner
| KeepItSafe | Onebox <br class="">
<br class="">
<br class="">
This email, its contents and attachments
contain information from j2 Global, <br class="">
Inc. and/or its affiliates which may be
privileged, confidential or <br class="">
otherwise protected from disclosure. The
information is intended to be for <br class="">
the addressee(s) only. If you are not an
addressee, any disclosure, copy, <br class="">
distribution, or use of the contents of
this message is prohibited. If you <br class="">
have received this email in error please
notify the sender by reply e-mail <br class="">
and delete the original message and any
copies. (c) 2015 j2 Global, Inc. All <br class="">
rights reserved. eFax, eVoice, Campaigner,
FuseMail, KeepItSafe, and Onebox <br class="">
are registered trademarks of j2 Global,
Inc. and its affiliates. <br class="">
</blockquote>
</blockquote>
<br class="">
<br class="">
<fieldset class="mimeAttachmentHeader"></fieldset>
<br class="">
<pre class="" wrap="">_______________________________________________
Users mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br class=""><p class=""><a moz-do-not-send="true" href="http://www.j2.com/?utm_source=j2global&utm_medium=xsell-referral&utm_campaign=employeeemail" class=""><span style="color:windowtext;
text-decoration:none" class=""><img moz-do-not-send="true" src="http://home.j2.com/j2_Global_Cloud_Services/j2_Global_Email_Footer.jpg" alt="www.j2.com" class="" height="46" width="391" border="0"></span></a></p><p class=""><span style="font-size:8.0pt;font-family:"Arial","sans-serif";color:gray" class="">This email, its contents and
attachments contain information from <a moz-do-not-send="true" href="http://www.j2.com/?utm_source=j2global&utm_medium=xsell-referral&utm_campaign=employemail" class="">j2 Global, Inc</a>. and/or its
affiliates which may be privileged,
confidential or otherwise protected from
disclosure. The information is intended to
be for the addressee(s) only. If you are not
an addressee, any disclosure, copy,
distribution, or use of the contents of this
message is prohibited. If you have received
this email in error please notify the sender
by reply e-mail and delete the original
message and any copies. © 2015 <a moz-do-not-send="true" href="http://www.j2.com/" class="">j2
Global, Inc</a>. All rights reserved. <a moz-do-not-send="true" href="http://www.efax.com/" class="">eFax
®</a>, <a moz-do-not-send="true" href="http://www.evoice.com/" class="">eVoice
®</a>, <a moz-do-not-send="true" href="http://www.campaigner.com/" class="">Campaigner
®</a>, <a moz-do-not-send="true" href="http://www.fusemail.com/" class="">FuseMail
®</a>, <a moz-do-not-send="true" href="http://www.keepitsafe.com/" class="">KeepItSafe
®</a> and <a moz-do-not-send="true" href="http://www.onebox.com/" class="">Onebox
®</a> are r egistered trademarks of <a moz-do-not-send="true" href="http://www.j2.com/" class="">j2
Global, Inc</a>. and its affiliates.</span></p>
<br class="">
<fieldset class="mimeAttachmentHeader"></fieldset>
<br class="">
<pre class="" wrap="">_______________________________________________
Users mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br class=""><p class=""><a moz-do-not-send="true" href="http://www.j2.com/?utm_source=j2global&utm_medium=xsell-referral&utm_campaign=employeeemail" class=""><span style="color:windowtext;
text-decoration:none" class=""><img moz-do-not-send="true" src="http://home.j2.com/j2_Global_Cloud_Services/j2_Global_Email_Footer.jpg" alt="www.j2.com" class="" height="46" width="391" border="0"></span></a></p><p class=""><span style="font-size:8.0pt;font-family:"Arial","sans-serif";color:gray" class="">This email, its contents and
attachments contain information from <a moz-do-not-send="true" href="http://www.j2.com/?utm_source=j2global&utm_medium=xsell-referral&utm_campaign=employemail" class="">j2 Global, Inc</a>. and/or its
affiliates which may be privileged,
confidential or otherwise protected from
disclosure. The information is intended to be
for the addressee(s) only. If you are not an
addressee, any disclosure, copy, distribution,
or use of the contents of this message is
prohibited. If you have received this email in
error please notify the sender by reply e-mail
and delete the original message and any
copies. © 2015 <a moz-do-not-send="true" href="http://www.j2.com/" class="">j2
Global, Inc</a>. All rights reserved. <a moz-do-not-send="true" href="http://www.efax.com/" class="">eFax ®</a>,
<a moz-do-not-send="true" href="http://www.evoice.com/" class="">eVoice
®</a>, <a moz-do-not-send="true" href="http://www.campaigner.com/" class="">Campaigner
®</a>, <a moz-do-not-send="true" href="http://www.fusemail.com/" class="">FuseMail
®</a>, <a moz-do-not-send="true" href="http://www.keepitsafe.com/" class="">KeepItSafe
®</a> and <a moz-do-not-send="true" href="http://www.onebox.com/" class="">Onebox
®</a> are r egistered trademarks of <a moz-do-not-send="true" href="http://www.j2.com/" class="">j2
Global, Inc</a>. and its affiliates.</span></p>
<br class="">
<fieldset class="mimeAttachmentHeader"></fieldset>
<br class="">
<pre class="" wrap="">_______________________________________________
Users mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br class="">
<br class="">
<font class="" face="Verdana,Arial,Helvetica,Trebuchet MS" size="1">
<br class="">
-- <br class="">
This message is subject to the CSIR's copyright
terms and conditions, e-mail legal notice, and
implemented Open Document Format (ODF) standard.
<br class="">
The full disclaimer details can be found at <a moz-do-not-send="true" href="http://www.csir.co.za/disclaimer.html" class=""></a><a class="moz-txt-link-freetext" href="http://www.csir.co.za/disclaimer.html">http://www.csir.co.za/disclaimer.html</a>.
<p class="">
<br class="">
This message has been scanned for viruses and
dangerous content by <a moz-do-not-send="true" href="http://www.mailscanner.info/" class=""><b class="">MailScanner</b></a>, <br class="">
and is believed to be clean.
</p>
</font><p class=""><font class="" face="Verdana,Arial,Helvetica,Trebuchet MS" size="1">
<br class="">
Please consider the environment before printing
this email.
</font>
</p>
</div>
_______________________________________________<br class="">
Users mailing list<br class="">
<a moz-do-not-send="true" href="mailto:Users@ovirt.org" class="">Users@ovirt.org</a><br class="">
<a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a><br class="">
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
</div>
<font face="Verdana,Arial,Helvetica,Trebuchet MS" size="1" class="">
<br class="">
-- <br class="">
This message is subject to the CSIR's copyright terms and
conditions, e-mail legal notice, and implemented Open Document
Format (ODF) standard.
<br class="">
The full disclaimer details can be found at <a moz-do-not-send="true" href="http://www.csir.co.za/disclaimer.html" class=""></a><a class="moz-txt-link-freetext" href="http://www.csir.co.za/disclaimer.html">http://www.csir.co.za/disclaimer.html</a>.
<p class="">
<br class="">
This message has been scanned for viruses and dangerous
content by <a moz-do-not-send="true" href="http://www.mailscanner.info/" class=""><b class="">MailScanner</b></a>,
<br class="">
and is believed to be clean.
</p>
</font><p class=""><font face="Verdana,Arial,Helvetica,Trebuchet MS" size="1" class="">
<br class="">
Please consider the environment before printing this email.
</font>
</p>
</blockquote>
<br class="">
<br class="">
</div>
_______________________________________________<br class="">Users mailing list<br class=""><a href="mailto:Users@ovirt.org" class="">Users@ovirt.org</a><br class="">http://lists.ovirt.org/mailman/listinfo/users<br class=""></div></blockquote></div><br class=""></div><font face="Verdana,Arial,Helvetica,Trebuchet MS" size="1">
<br />--
<br />This message is subject to the CSIR's copyright terms and conditions, e-mail legal notice, and implemented Open Document Format (ODF) standard.
<br />The full disclaimer details can be found at <a href="http://www.csir.co.za/disclaimer.html">http://www.csir.co.za/disclaimer.html</a>.
<p>
<br />This message has been scanned for viruses and dangerous content by <a href="http://www.mailscanner.info/"><b>MailScanner</b></a>,
<br />and is believed to be clean.
<p>
<br />Please consider the environment before printing this email.
</font>
</body></html>