<div dir="ltr"><div>It's FC/FcoE.</div><div><br></div><div>This is with configuration suggested by emc/redhat</div><div><br></div><div>360060160a62134002818778f949de411 dm-5 DGC,VRAID</div><div>size=11T features='2 queue_if_no_path retain_attached_hw_handler' hwhandler='1 alua' wp=rw</div><div>|-+- policy='round-robin 0' prio=50 status=active</div><div>| |- 1:0:1:2 sdr 65:16 active ready running</div><div>| `- 2:0:1:2 sdy 65:128 active ready running</div><div>`-+- policy='round-robin 0' prio=10 status=enabled</div><div> |- 1:0:0:2 sdd 8:48 active ready running</div><div> `- 2:0:0:2 sdk 8:160 active ready running</div><div>360060160a6213400e622de69949de411 dm-2 DGC,VRAID</div><div>size=6.0T features='2 queue_if_no_path retain_attached_hw_handler' hwhandler='1 alua' wp=rw</div><div>|-+- policy='round-robin 0' prio=50 status=active</div><div>| |- 1:0:1:0 sdp 8:240 active ready running</div><div>| `- 2:0:1:0 sdw 65:96 active ready running</div><div>`-+- policy='round-robin 0' prio=10 status=enabled</div><div> |- 1:0:0:0 sdb 8:16 active ready running</div><div> `- 2:0:0:0 sdi 8:128 active ready running</div><div>360060160a6213400cce46e40949de411 dm-4 DGC,VRAID</div><div>size=560G features='2 queue_if_no_path retain_attached_hw_handler' hwhandler='1 alua' wp=rw</div><div>|-+- policy='round-robin 0' prio=50 status=active</div><div>| |- 1:0:1:3 sds 65:32 active ready running</div><div>| `- 2:0:1:3 sdz 65:144 active ready running</div><div>`-+- policy='round-robin 0' prio=10 status=enabled</div><div> |- 1:0:0:3 sde 8:64 active ready running</div><div> `- 2:0:0:3 sdl 8:176 active ready running</div><div>360060160a6213400c4b39e80949de411 dm-3 DGC,VRAID</div><div>size=500G features='2 queue_if_no_path retain_attached_hw_handler' hwhandler='1 alua' wp=rw</div><div>|-+- policy='round-robin 0' prio=50 status=active</div><div>| |- 1:0:1:1 sdq 65:0 active ready running</div><div>| `- 2:0:1:1 sdx 65:112 active ready running</div><div>`-+- policy='round-robin 0' prio=10 status=enabled</div><div> |- 1:0:0:1 sdc 8:32 active ready running</div><div> `- 2:0:0:1 sdj 8:144 active ready running</div><div>360060160a6213400fa2d31acbbfce511 dm-8 DGC,RAID 5</div><div>size=5.4T features='2 queue_if_no_path retain_attached_hw_handler' hwhandler='1 alua' wp=rw</div><div>|-+- policy='round-robin 0' prio=50 status=active</div><div>| |- 1:0:0:6 sdh 8:112 active ready running</div><div>| `- 2:0:0:6 sdo 8:224 active ready running</div><div>`-+- policy='round-robin 0' prio=10 status=enabled</div><div> |- 1:0:1:6 sdv 65:80 active ready running</div><div> `- 2:0:1:6 sdac 65:192 active ready running</div><div>360060160a621340040652b7582f5e511 dm-7 DGC,RAID 5</div><div>size=3.6T features='2 queue_if_no_path retain_attached_hw_handler' hwhandler='1 alua' wp=rw</div><div>|-+- policy='round-robin 0' prio=50 status=active</div><div>| |- 1:0:0:4 sdf 8:80 active ready running</div><div>| `- 2:0:0:4 sdm 8:192 active ready running</div><div>`-+- policy='round-robin 0' prio=10 status=enabled</div><div> |- 1:0:1:4 sdt 65:48 active ready running</div><div> `- 2:0:1:4 sdaa 65:160 active ready running</div><div>360060160a621340064b1034cbbfce511 dm-6 DGC,RAID 5</div><div>size=1.0T features='2 queue_if_no_path retain_attached_hw_handler' hwhandler='1 alua' wp=rw</div><div>|-+- policy='round-robin 0' prio=50 status=active</div><div>| |- 1:0:1:5 sdu 65:64 active ready running</div><div>| `- 2:0:1:5 sdab 65:176 active ready running</div><div>`-+- policy='round-robin 0' prio=10 status=enabled</div><div> |- 1:0:0:5 sdg 8:96 active ready running</div><div> `- 2:0:0:5 sdn 8:208 active ready running</div><div><br></div><div><br></div><div>This is with ovirt default conf:</div><div><br></div><div>360060160a6213400848e60af82f5e511 dm-3 DGC ,RAID 5 </div><div>size=3.6T features='1 retain_attached_hw_handler' hwhandler='1 alua' wp=rw</div><div>|-+- policy='service-time 0' prio=50 status=active</div><div>| |- 12:0:0:4 sdj 8:144 active ready running</div><div>| `- 13:0:1:4 sdd 8:48 active ready running</div><div>`-+- policy='service-time 0' prio=10 status=enabled</div><div> |- 12:0:1:4 sdf 8:80 active ready running</div><div> `- 13:0:0:4 sdh 8:112 active ready running</div><div>360060160a6213400005e425b6b10e611 dm-2 DGC ,RAID 10 </div><div>size=4.2T features='1 retain_attached_hw_handler' hwhandler='1 alua' wp=rw</div><div>|-+- policy='service-time 0' prio=50 status=active</div><div>| |- 12:0:1:0 sde 8:64 active ready running</div><div>| `- 13:0:0:0 sdg 8:96 active ready running</div><div>`-+- policy='service-time 0' prio=10 status=enabled</div><div> |- 13:0:1:0 sdc 8:32 active ready running</div><div> `- 12:0:0:0 sdi 8:128 active ready running</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">2017-05-13 18:50 GMT+02:00 Juan Pablo <span dir="ltr"><<a href="mailto:pablo.localhost@gmail.com" target="_blank">pablo.localhost@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>can you please give the output of: <br></div>multipath -ll<br></div>and <br>iscsiadm -m session -P3<span class="HOEnZb"><font color="#888888"><br><br></font></span></div><span class="HOEnZb"><font color="#888888">JP<br></font></span></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">2017-05-13 6:48 GMT-03:00 Stefano Bovina <span dir="ltr"><<a href="mailto:bovy89@gmail.com" target="_blank">bovy89@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hi,</div><div><br></div><div>2.6.32-696.1.1.el6.x86_64</div><div>3.10.0-514.10.2.el7.x86_64</div><div><br></div><div>I tried ioping test from different group of servers using multipath, members of different storage group (different lun, different raid ecc), and everyone report latency.</div><div>I tried the same test (ioping) on a server with powerpath instead of multipath, with a dedicated raid group and ioping don't report latency.</div><div><br></div></div><div class="m_2336082899849814563HOEnZb"><div class="m_2336082899849814563h5"><div class="gmail_extra"><br><div class="gmail_quote">2017-05-13 2:00 GMT+02:00 Juan Pablo <span dir="ltr"><<a href="mailto:pablo.localhost@gmail.com" target="_blank">pablo.localhost@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">sorry to jump in, but what kernel version are you using? had similar issue with kernel 4.10/4.11<br><br></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_2336082899849814563m_9029057160057710074h5">2017-05-12 16:36 GMT-03:00 Stefano Bovina <span dir="ltr"><<a href="mailto:bovy89@gmail.com" target="_blank">bovy89@gmail.com</a>></span>:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="m_2336082899849814563m_9029057160057710074h5"><div dir="ltr"><div>Hi,</div><div>a little update:</div><div><br></div><div>The command multipath -ll hung when executed on the host while the problem occur (nothing logged in /var/log/messages or dmesg).</div><div><br></div><div>I tested latency with ioping:</div><div>ioping /dev/6a386652-629d-4045-835b-2<wbr>1d2f5c104aa/metadata</div><div><br></div><div>Usually it return "time=15.6 ms", sometimes return "time=19 s" (yes, seconds)</div><div><br></div><div>Systems are up to date and I tried both path_checker (emc_clariion and directio), without results.</div><div>(<a href="https://access.redhat.com/solutions/139193" target="_blank">https://access.redhat.com/sol<wbr>utions/139193</a>, it refers to the Rev A31 of EMC document; last is A42 and suggest emc_clariion).</div><div><br></div><div>Any idea or suggestion?</div><div><br></div><div>Thanks,</div><div><br></div><div>Stefano</div></div><div class="m_2336082899849814563m_9029057160057710074m_987934392473321730HOEnZb"><div class="m_2336082899849814563m_9029057160057710074m_987934392473321730h5"><div class="gmail_extra"><br><div class="gmail_quote">2017-05-08 11:56 GMT+02:00 Yaniv Kaul <span dir="ltr"><<a href="mailto:ykaul@redhat.com" target="_blank">ykaul@redhat.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span>On Mon, May 8, 2017 at 11:50 AM, Stefano Bovina <span dir="ltr"><<a href="mailto:bovy89@gmail.com" target="_blank">bovy89@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Yes,</div><div>this configuration is the one suggested by EMC for EL7.</div></div></blockquote><div><br></div></span><div><a href="https://access.redhat.com/solutions/139193" target="_blank">https://access.redhat.com/solu<wbr>tions/139193</a> suggest that for alua, the patch checker needs to be different.</div><div><br></div><div>Anyway, it is very likely that you have storage issues - they need to be resolved first and I believe they have little to do with oVirt at the moment.</div><span class="m_2336082899849814563m_9029057160057710074m_987934392473321730m_1816318593379325784HOEnZb"><font color="#888888"><div>Y.</div></font></span><span><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><br></div><div>By the way,</div><div>"The parameters rr_min_io vs. rr_min_io_rq mean the same thing but are used for device-mapper-multipath on differing kernel versions." and rr_min_io_rq default value is 1, rr_min_io default value is 1000, so it should be fine.</div><div><br></div></div><div class="m_2336082899849814563m_9029057160057710074m_987934392473321730m_1816318593379325784m_1682821682399857149gmail-HOEnZb"><div class="m_2336082899849814563m_9029057160057710074m_987934392473321730m_1816318593379325784m_1682821682399857149gmail-h5"><div class="gmail_extra"><br><div class="gmail_quote">2017-05-08 9:39 GMT+02:00 Yaniv Kaul <span dir="ltr"><<a href="mailto:ykaul@redhat.com" target="_blank">ykaul@redhat.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><br><div class="gmail_quote">On Sun, May 7, 2017 at 1:27 PM, Stefano Bovina <span dir="ltr"><<a href="mailto:bovy89@gmail.com" target="_blank">bovy89@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Sense data are 0x0/0x0/0x0</blockquote></div><br>Interesting - first time I'm seeing 0/0/0. The 1st is usually 0x2 (see [1]), and then the rest [2], [3] make sense.</div><div class="gmail_extra"><br></div><div class="gmail_extra">A google search found another user with Clarion with the exact same error[4], so I'm leaning toward misconfiguration of multipathing/clarion here.</div><div class="gmail_extra"><br></div><div class="gmail_extra">Is your multipathing configuration working well for you?</div><div class="gmail_extra">Are you sure it's a EL7 configuration? For example, I believe you should have rr_min_io_rq and not rr_min_io .</div><div class="gmail_extra">Y.</div><div class="gmail_extra"><br></div><div class="gmail_extra">[1] <a href="http://www.t10.org/lists/2status.htm" target="_blank">http://www.t10.org/lists/2<wbr>status.htm</a></div><div class="gmail_extra">[2] <a href="http://www.t10.org/lists/2sensekey.htm" target="_blank">http://www.t10.org/lists/2<wbr>sensekey.htm</a></div><div class="gmail_extra">[3] <a href="http://www.t10.org/lists/asc-num.htm" target="_blank">http://www.t10.org/lists/a<wbr>sc-num.htm</a></div><div class="gmail_extra">[4] <a href="http://www.linuxquestions.org/questions/centos-111/multipath-problems-4175544908/" target="_blank">http://www.linuxquestions.<wbr>org/questions/centos-111/multi<wbr>path-problems-4175544908/</a></div></div>
</blockquote></div><br></div>
</div></div></blockquote></span></div><br></div></div>
</blockquote></div><br></div>
</div></div><br></div></div><span>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
<br></span></blockquote></div><br></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>