<div dir="ltr"><div><div><div>Hi,<br></div>After changing the code, you need to restart the VDSM service to take effect.<br><br></div>Regards,<br></div>Fred<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Dec 5, 2016 at 10:28 AM, 胡茂荣 <span dir="ltr"><<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><br></div><div><u></u><div> Thanks for Yaniv Kaul , change code need build vdsm source code , and if only change /usr/share/vdsm/storage/<wbr>devicemapper.py will not really take effect .</div><div> </div><div> could this problem as a bug , and correct it to ovirt vdsm source code ? </div><div> </div><div style="font:Verdana normal 14px;color:#000"><div style="FONT-SIZE:12px;FONT-FAMILY:Arial Narrow;padding:2px 0 2px 0">------------------ Original --<wbr>----------------</div><div style="FONT-SIZE:12px;background:#efefef;padding:8px"><div id="m_-3966782059830213987menu_sender"><b>From: </b> "Yaniv Kaul"<<a href="mailto:ykaul@redhat.com" target="_blank">ykaul@redhat.com</a>>;</div><div><b>Date: </b> Sun, Dec 4, 2016 07:07 PM</div><div><b>To: </b> "胡茂荣"<<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a><wbr>>; </div><div><b>Cc: </b> "胡晓宇"<<a href="mailto:samuel.xhu@horebdata.cn" target="_blank">samuel.xhu@horebdata.cn</a><wbr>>; "users"<<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>>; "Sahina Bose"<<a href="mailto:sabose@redhat.com" target="_blank">sabose@redhat.com</a>>; "Jeff Nelson"<<a href="mailto:jenelson@redhat.com" target="_blank">jenelson@redhat.com</a>>; </div><div><div class="h5"><div><b>Subject: </b> Re: [ovirt-users] can not use iscsi storage type onovirtandGlusterfshyper-<wbr>converged environment</div></div></div></div><div><div class="h5"><div> </div><div dir="auto"><div><br><div class="gmail_extra"><br><div class="gmail_quote">On Dec 2, 2016 11:53 AM, "胡茂荣" <<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a>> wrote:<br type="attribution"><blockquote class="m_-3966782059830213987quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div> I find <span style="line-height:1.5">supervdsm used "</span><span style="line-height:1.5"> </span><span style="line-height:1.5">/usr/sbin/dmsetup status</span><span style="line-height:1.5">" :</span></div><div><span style="line-height:1.5"><br></span></div><div><div>MainProcess|jsonrpc.Executor/2<wbr>::DEBUG::2016-12-02 17:12:16,372::supervdsmServer:<wbr>:92::SuperVdsm.ServerCallback:<wbr>:(wrapper) call getPathsStatus with () {}</div><div>MainProcess|jsonrpc.Executor/2<wbr>::DEBUG::2016-12-02 17:12:16,373::devicemapper::15<wbr>4::Storage.Misc.excCmd::(_getP<wbr>athsStatus) /usr/bin/taskset --cpu-list 0-7 <span style="background-color:rgb(255,255,0)">/usr/sbin/dmsetup status (cwd None)</span></div><div>MainProcess|jsonrpc.Executor/2<wbr>::DEBUG::2016-12-02 17:12:16,377::devicemapper::15<wbr>4::Storage.Misc.excCmd::(_getP<wbr>athsStatus) SUCCESS: <err> = ''; <rc> = 0</div><div>MainProcess|jsonrpc.Executor/2<wbr>::ERROR::2016-12-02 17:12:16,378::supervdsmServer:<wbr>:96::SuperVdsm.ServerCallback:<wbr>:(wrapper) <span style="background-color:rgb(255,0,0)">Error in getPathsStatus</span></div></div><div><br></div><div>problem :</div><div>how can I change <span style="line-height:1.5">Storage.Misc.excCmd _getPathsStatus " /usr/bin/taskset --cpu-list 0-7 /usr/sbin/dmsetup status" to :</span></div><div><span style="line-height:1.5"><br></span></div><div><span style="line-height:1.5"> </span><span style="line-height:1.5;background-color:rgb(255,255,0)"> </span><span style="line-height:1.5">/usr/bin/taskset --cpu-list 0-7 /usr/sbin/dmsetup status --target multipah </span></div><div><u></u><div><span style="line-height:1.5"><br></span></div><div><span style="line-height:1.5"> I think add iscsi type storage , if supervdsm scan mulitpah will solve my problem .(my environment have other dm devices, use "dmsetup status" will show them, and vdsm get dm path status will occur error )</span></div><div><span style="line-height:1.5"><br></span></div><div><span style="line-height:1.5">==============================<wbr>==============================<wbr>====================</span></div><div><span style="line-height:1.5">so I changed some as follow :</span></div><div><span style="line-height:1.5"> （1）</span></div><div><span style="line-height:1.5"> I define </span><span style="line-height:1.5">EXT_DMSETUP_STATUS in </span><span style="line-height:1.5">/usr/lib/python2.7/site-packa<wbr>ges/vdsm/constants.py : </span></div><div><br></div><div><div>/usr/lib/python2.7/site-packag<wbr>es/vdsm/constants.py:EXT_<wbr>DMSETUP = '/usr/sbin/dmsetup'</div><div>/usr/lib/python2.7/site-packag<wbr>es/vdsm/constants.py:<span style="background-color:rgb(255,255,0)">EXT_<wbr>DMSETUP_STATUS = "/usr/sbin/dmsetup status --target multipath"</span></div><div><br></div><div> (2)</div><div><div style="line-height:1.5"> /usr/share/vdsm/storage/devic<wbr>emapper.py add :</div><div style="line-height:1.5">from vdsm.constants import EXT_DMSETUP_STATUS</div><div style="line-height:1.5"><br></div><div style="line-height:1.5">and changed <span style="line-height:1.5">getPathsStatus cmd </span><span style="line-height:1.5"> to " </span><span style="line-height:1.5">EXT_DMSETUP_STATUS</span><span style="line-height:1.5">" :</span></div><div style="line-height:1.5"><span style="line-height:1.5"><br></span></div><div><div>def _getPathsStatus():</div><div> cmd = [EXT_DMSETUP_STATUS] ##### before : cmd=[<span style="line-height:1.5">EXT_DMSETUP,"status"</span><span style="line-height:1.5">]</span></div></div></div></div></div></blockquote></div></div></div><div dir="auto"><br></div><div dir="auto">Why not change this to:</div><div dir="auto">cmd = [EXT_DMSETUP, "status", "--target", "multipath"] </div><div dir="auto"><br></div><div dir="auto">Y. </div><div dir="auto"><br></div><div dir="auto"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="m_-3966782059830213987quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div><div style="line-height:1.5"><div class="m_-3966782059830213987quoted-text"><div> rc, out, err = misc.execCmd(cmd)</div></div><div>==============================<wbr>==============================<wbr>===========================</div><div><br></div></div></div></div><div style="line-height:1.5"> but log in supervdsm log also not change . Please help me ，how to change code to let supervdsm exec <span style="line-height:1.5;background-color:rgb(255,255,0)">"/usr/sbin/dmsetup status --target multipath" in function </span><span style="line-height:1.5;background-color:rgb(255,255,0)">getPathsStatus（） 。</span></div><div style="line-height:1.5"><span style="line-height:1.5;background-color:rgb(255,255,0)"><br></span></div><div><span style="line-height:1.5"><br></span></div><div><span style="line-height:1.5"><br></span></div><div> </div><div style="font:Verdana normal 14px;color:#000"><div style="FONT-SIZE:12px;FONT-FAMILY:Arial Narrow;padding:2px 0 2px 0">------------------ Original --<wbr>----------------</div><div style="FONT-SIZE:12px;background:#efefef;padding:8px"><div id="m_-3966782059830213987m_242775738493852978menu_sender"><b>From: </b> "胡茂荣"<<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a><wbr>>;</div><div><b>Date: </b> Fri, Nov 25, 2016 05:44 PM</div><div class="m_-3966782059830213987elided-text"><div><b>To: </b> "Sahina Bose"<<a href="mailto:sabose@redhat.com" target="_blank">sabose@redhat.com</a>>; </div><div><b>Cc: </b> "Maor Lipchuk"<<a href="mailto:mlipchuk@redhat.com" target="_blank">mlipchuk@redhat.com</a>>; "Jeff Nelson"<<a href="mailto:jenelson@redhat.com" target="_blank">jenelson@redhat.com</a>>; "users"<<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>>; </div><div><b>Subject: </b> Re: [ovirt-users] can not use iscsi storage type on ovirtandGlusterfshyper-converg<wbr>ed environment</div></div></div><div class="m_-3966782059830213987elided-text"><div> </div><div><br></div><div><p class="MsoNormal" style="line-height:21px"><span style="line-height:1.5">==============================<wbr>=====---</span></p><p class="MsoNormal" style="line-height:21px"><span style="line-height:1.5"> </span><span style="line-height:1.5" lang="EN-US"> ###</span><span style="line-height:1.5">vdsm or supervdsm log report :</span></p><p class="MsoNormal" style="line-height:21px"><span lang="EN-US"> </span><span style="line-height:1.5">MainProcess|jsonrpc.Executor/7<wbr>::ERROR::2016-11-01 11:07:00,178::supervdsmServer:<wbr>:96:<span style="background-color:rgb(255,255,0)">:SuperVdsm.ServerCallback:<wbr>:(wrapper) Error in getPathsStatus</span></span></p><p class="MsoNormal" style="line-height:21px"><span lang="EN-US">MainProcess|jsonrpc.Executor/4<wbr>::ERROR::2016-11-01 11:07:20,964::supervdsmServer:<wbr>:96::SuperVdsm.ServerCallback:<wbr>:(wrapper) Error in getPathsStatus</span></p></div><div><div> ============================ some code info ------------></div><div>[root@horeba storage]# pwd</div><div>/usr/share/vdsm/storage</div><div><br></div><div><div>[root@horeba storage]# grep "getPathsStatus" -R ./</div><div>./devicemapper.py:def _getPathsStatus():</div><div>./devicemapper.py:def getPathsStatus():</div><div>./devicemapper.py: return getProxy().getPathsStatus()</div><div>./multipath.py: pathStatuses = devicemapper.getPathsStatus()</div></div><div><br></div><div><div>def _getPathsStatus():</div><div> cmd = [EXT_DMSETUP, "status"]</div><div> rc, out, err = misc.execCmd(cmd)</div><div> if rc != 0:</div><div> raise Exception("Could not get device statuses")</div><div><br></div><div> res = {}</div><div> for statusLine in out:</div><div> try:</div><div> <span style="background-color:rgb(255,255,0)"> devName, statusLine = statusLine.split(":", 1)</span></div><div> except ValueError:</div><div> if len(out) == 1:</div><div> # return an empty dict when status output is: No devices found</div><div> return res</div><div> else:</div><div> raise</div><div><br></div><div> for m in PATH_STATUS_RE.finditer(status<wbr>Line):</div><div> devNum, status = m.groups()</div><div> <span style="background-color:rgb(255,255,0)"> physdevName = findDev(*[int(i) for i in devNum.split(":")])</span></div><div><span style="background-color:rgb(255,255,0)"> res[physdevName] = {"A": "active", "F": "failed"}[status]</span></div><div><br></div><div> return res</div><div><div style="line-height:21px">def getPathsStatus():</div><div style="line-height:21px"> return getProxy().getPathsStatus()</div></div><div>==============================<wbr>===============</div><div><span style="line-height:1.5"> and flashcache dm device will error when use </span><span style="line-height:1.5">getPathsStatus() function . could change code not check flashcache dm device ?</span></div></div><div><span style="line-height:1.5">==============================<wbr>==========dmsetup info -----------></span></div><div><div>[root@horebc ~]# dmsetup status</div><div>flash_sdb: 0 976771072 flashcache stats: </div><div> reads(1388761), writes(15548965)</div><div> read hits(1235671), read hit percent(88)</div><div> write hits(6539144) write hit percent(42)</div><div> dirty write hits(21372) dirty write hit percent(0)</div><div> replacement(147711), write replacement(524881)</div><div> write invalidates(0), read invalidates(1)</div><div> pending enqueues(810), pending inval(810)</div><div> metadata dirties(15196370), metadata cleans(15196322)</div><div> metadata batch(30087377) metadata ssd writes(305315)</div><div> cleanings(15196322) fallow cleanings(48187)</div><div> no room(337139) front merge(716153) back merge(14391395)</div><div> force_clean_block(0)</div><div> disk reads(153093), disk writes(15530535) ssd reads(16431974) ssd writes(15672221)</div><div> uncached reads(3714), uncached writes(334235), uncached IO requeue(0)</div><div> disk read errors(0), disk write errors(0) ssd read errors(0) ssd write errors(0)</div><div> uncached sequential reads(0), uncached sequential writes(0)</div><div> pid_adds(0), pid_dels(0), pid_drops(0) pid_expiry(0)</div><div> lru hot blocks(12158976), lru warm blocks(12158976)</div><div> lru promotions(0), lru demotions(0)</div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-metadata: 0 1048576 linear </div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-leases: 0 4194304 linear </div><div>23137643634356633: 0 <a value="+12147483648">2147483648</a> multipath 2 0 0 0 1 1 A 0 1 2 8:128 A 0 0 1 </div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-master: 0 2097152 linear </div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-inbox: 0 262144 linear </div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-outbox: 0 262144 linear </div><div><br></div><div><div>[root@horebc ~]# dmsetup info -C</div><div>Name Maj Min Stat Open Targ Event UUID </div><div>flash_sdb 253 0 L--w 1 1 0 </div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-metadata 253 4 L--w 0 1 0 LVM-zSZKhQXbs2Ms5ceM2Wlt3p46Bg<wbr>sS8gGIGwifAPyYj9GmjFzCmJkIf9vF<wbr>FFHn9n7V</div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-leases 253 6 L--w 0 1 0 LVM-zSZKhQXbs2Ms5ceM2Wlt3p46Bg<wbr>sS8gGIVSCllWEYYKziY1bSeiTL0dAK<wbr>Ad27JqDT</div><div>23137643634356633 253 3 L--w 6 1 0 mpath-23137643634356633 </div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-master 253 9 L--w 0 1 0 LVM-zSZKhQXbs2Ms5ceM2Wlt3p46Bg<wbr>sS8gGIiEnFZklRhZfFZ4YRdYWFImKW<wbr>sUGr5pHg</div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-inbox 253 8 L--w 0 1 0 LVM-zSZKhQXbs2Ms5ceM2Wlt3p46Bg<wbr>sS8gGILobNK8KRD4SzDWyg50aG7jGd<wbr>cNAi3KNw</div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-outbox 253 5 L--w 0 1 0 LVM-zSZKhQXbs2Ms5ceM2Wlt3p46Bg<wbr>sS8gGIAvbT8CLegbVL802bG3QgLtH7<wbr>I7llmS6R</div><div>flash_sdf 253 2 L--w 1 1 0 </div><div>dedbd337--ca66--43ff--b78c--4e<wbr>9347682a9c-ids 253 7 L--w 1 1 0 LVM-zSZKhQXbs2Ms5ceM2Wlt3p46Bg<wbr>sS8gGIIkeaFaWvxa9wbHy7WrfiXNsP<wbr>4F2J3gg0</div><div>flash_sdd 253 1 L--w 1 1 0 </div></div><div style="line-height:1.5"><br></div></div><div style="line-height:1.5">==============================<wbr>==============================<wbr>========</div><div style="line-height:1.5">and flashcache dm have no UUID ，I think it can export it before checking .</div><div><br></div><div><span style="line-height:1.5"><br></span></div><div><span style="line-height:1.5">humaorong </span></div><div><span style="line-height:1.5"> 2016-11-25</span></div><div><span style="line-height:1.5"><br></span></div><div><span style="line-height:1.5"> </span></div><div> </div><div style="font:Verdana normal 14px;color:#000"><div style="FONT-SIZE:12px;FONT-FAMILY:Arial Narrow;padding:2px 0 2px 0">------------------ Original ------------------</div><div style="FONT-SIZE:12px;background:#efefef;padding:8px"><div id="m_-3966782059830213987m_242775738493852978menu_sender"><b>From: </b> "胡茂荣"<<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a><wbr>>;</div><div><b>Date: </b> Fri, Nov 25, 2016 01:18 PM</div><div><b>To: </b> "Sahina Bose"<<a href="mailto:sabose@redhat.com" target="_blank">sabose@redhat.com</a>>; </div><div><b>Cc: </b> "Maor Lipchuk"<<a href="mailto:mlipchuk@redhat.com" target="_blank">mlipchuk@redhat.com</a>>; "Jeff Nelson"<<a href="mailto:jenelson@redhat.com" target="_blank">jenelson@redhat.com</a>>; "users"<<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>>; </div><div><b>Subject: </b> Re: [ovirt-users] can not use iscsi storage type on ovirtandGlusterfshyper-converg<wbr>ed environment</div></div><div> </div><div> </div><div> I find this problem more info : </div><div> <span style="line-height:1.5"> I use flashcache on ovirt hosts , have dm device in /dev/mapper/ :</span></div><div><br></div><div><div>[root@horeba init.d]# dmsetup info -C <span style="line-height:1.5">（and I set them in multipath blacklist ）</span></div><div>Name Maj Min Stat Open Targ Event UUID </div><div>flash_sdb 253 0 L--w 0 1 0 </div><div>flash_sdf 253 2 L--w 0 1 0 </div><div>flash_sdd 253 1 L--w 0 1 0 </div><div>[root@horeba init.d]# multipath -l </div><div>[root@horeba init.d]# </div><div> </div><div>[root@horeba init.d]# ll /dev/mapper/</div><div>total 0</div><div>crw------- 1 root root 10, 236 Nov 25 10:09 control</div><div>lrwxrwxrwx 1 root root 7 Nov 25 12:51 flash_sdb -> ../dm-0</div><div>lrwxrwxrwx 1 root root 7 Nov 25 12:51 flash_sdd -> ../dm-1</div><div>lrwxrwxrwx 1 root root 7 Nov 25 12:51 flash_sdf -> ../dm-2</div></div><div> </div><div> on this condition , ovirt UI add <span style="line-height:1.5"> </span><span style="line-height:1.5">iscsi type storage</span><span style="line-height:1.5"> will fail .</span></div><div><br></div><div> If I delete the flashcache device /dev/mapper/flash_* , ovirt UI add iscsi type storage have no problem . </div><div> </div><div> I need flashcache for using ssd cache on my environment , how can I use iscsi type storage on this environment , please help me , Thanks！</div><div><div> </div><div> </div><div style="font:Verdana normal 14px;color:#000"><div style="FONT-SIZE:12px;FONT-FAMILY:Arial Narrow;padding:2px 0 2px 0">------------------ Original ------------------</div><div style="FONT-SIZE:12px;background:#efefef;padding:8px"><div id="m_-3966782059830213987m_242775738493852978menu_sender"><b>From: </b> "Sahina Bose"<<a href="mailto:sabose@redhat.com" target="_blank">sabose@redhat.com</a>>;</div><div><b>Date: </b> Thu, Nov 3, 2016 05:54 PM</div><div><b>To: </b> "胡茂荣"<<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a><wbr>>; </div><div><b>Cc: </b> "Maor Lipchuk"<<a href="mailto:mlipchuk@redhat.com" target="_blank">mlipchuk@redhat.com</a>>; "Jeff Nelson"<<a href="mailto:jenelson@redhat.com" target="_blank">jenelson@redhat.com</a>>; "users"<<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>>; </div><div><b>Subject: </b> Re: [ovirt-users] can not use iscsi storage type on ovirtandGlusterfshyper-converg<wbr>ed environment</div></div><div> </div><div dir="ltr"><div>A wild guess, not sure if it is related - can you check if multipathd service is enabled. If you set up your oVirt-Gluster hyperconverged environment via gdeploy, multipathd service is disabled and the /etc/multipath.conf is edited to blacklist all devices - this was to fix <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1303940" target="_blank">https://bugzilla.redhat.com/sh<wbr>ow_bug.cgi?id=1303940</a><br><br></div>Since you mention you're unable to add iscsi storage only in this environment, thought it's worth checking.<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Nov 3, 2016 at 6:40 AM, 胡茂荣 <span dir="ltr"><<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><span style="line-height:1.5"><br></span></div><div><span style="line-height:1.5"> my </span><span style="line-height:1.5"> </span><span style="line-height:1.5">environment rpm are :</span></div><div><u></u><div> [root@horeba ~]# rpm -q vdsm</div><div>vdsm-4.18.13-1.el7.centos.x86_<wbr>64</div><div><br></div><div><div>[root@horeba ~]# rpm -aq | grep ovirt</div><div>ovirt-vmconsole-host-1.0.4-1.e<wbr>l7.centos.noarch</div><div>ovirt-imageio-common-0.4.0-1.e<wbr>l7.noarch</div><div>ovirt-hosted-engine-setup-2.0.<wbr>2.2-1.el7.centos.noarch</div><div>ovirt-imageio-daemon-0.4.0-1.e<wbr>l7.noarch</div><div>ovirt-engine-appliance-4.0-201<wbr>60928.1.el7.centos.noarch</div><div>ovirt-vmconsole-1.0.4-1.el7.ce<wbr>ntos.noarch</div><div>ovirt-host-deploy-1.5.2-1.el7.<wbr>centos.noarch</div><div>ovirt-hosted-engine-ha-2.0.4-1<wbr>.el7.centos.noarch</div><div>ovirt-release40-4.0.4-1.noarch</div><div>ovirt-setup-lib-1.0.2-1.el7.ce<wbr>ntos.noarch</div><div>ovirt-engine-sdk-python-3.6.9.<wbr>1-1.el7.centos.noarch</div></div><div><br></div><div> and I test if not on '<span style="line-height:1.5"> </span><span style="line-height:1.5">ovirt and Glusterfs hyper-converged environment </span><span style="line-height:1.5">' , ovirt WEB UI add </span>iscsi storage work ok .</div><div><br></div><div> </div><div style="font:Verdana normal 14px;color:#000"><div style="FONT-SIZE:12px;FONT-FAMILY:Arial Narrow;padding:2px 0 2px 0">------------------ Original ------------------</div><div style="FONT-SIZE:12px;background:#efefef;padding:8px"><div id="m_-3966782059830213987m_242775738493852978m_7048953968785441569menu_sender"><b>From: </b> "Maor Lipchuk"<<a href="mailto:mlipchuk@redhat.com" target="_blank">mlipchuk@redhat.com</a>>;</div><div><b>Date: </b> Wed, Nov 2, 2016 07:37 PM</div><div><b>To: </b> "胡茂荣"<<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a><wbr>>; </div><div><b>Cc: </b> "users"<<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>>; "Jeff Nelson"<<a href="mailto:jenelson@redhat.com" target="_blank">jenelson@redhat.com</a>>; "Nir Soffer"<<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>>; </div><div><div class="m_-3966782059830213987m_242775738493852978h5"><div><b>Subject: </b> Re: [ovirt-users] can not use iscsi storage type on ovirtandGlusterfs hyper-converged environment</div></div></div></div><div><div class="m_-3966782059830213987m_242775738493852978h5"><div> </div><div dir="ltr">Thanks for the logs,<div><br></div><div>What kind of VDSM version are you using? </div><div> "<span style="color:rgb(0,0,0);white-space:pre-wrap">rpm -q vdsm"</span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap">There seems to be a similar issue which was reported recently in the VDSM area</span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap"> (see </span><font color="#000000"><span style="white-space:pre-wrap"><a href="https://bugzilla.redhat.com/show_bug.cgi?id=1197292" target="_blank">https://bugzilla.redhat.com/sh<wbr>ow_bug.cgi?id=1197292</a>)</span></font></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap">It should be fixed in later versions of VDSM </span><span style="color:rgb(0,0,0);white-space:pre-wrap">vdsm-4.16.12-2.el7ev.x86_64</span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap">Adding also Nir and Jeff to the thread, if they have any insights</span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap"><br></span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap">Regards,</span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap">Maor</span></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Nov 2, 2016 at 4:11 AM, 胡茂荣 <span dir="ltr"><<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><br></div><div><u></u><div> Hi <span style="line-height:1.5">Maor:</span></div><div><span style="line-height:1.5"> vdsm/supervdsm/engine log on attachment . I mkfs.xfs the lun block device and mount to /mnt , dd write ,dmesg not report error ,dd result is ok :</span></div><div><span style="line-height:1.5"> </span></div><div><div>/dev/sdi 50G 33M 50G 1% /mnt<span style="line-height:1.5"> </span></div><div><span style="line-height:1.5"><br></span></div><div>[root@horebc mnt]# for i in `seq 3`; do dd if=/dev/zero of=./file bs=1G count=1 oflag=direct ; done</div><div>1+0 records in</div><div>1+0 records out</div><div>1073741824 bytes (1.1 GB) copied, 13.3232 s, 80.6 MB/s</div><div>1+0 records in</div><div>1+0 records out</div><div>1073741824 bytes (1.1 GB) copied, 9.89988 s, 108 MB/s</div><div>1+0 records in</div><div>1+0 records out</div><div>1073741824 bytes (1.1 GB) copied, 14.0143 s, 76.6 MB/s </div><div> </div><div> my envirnment have three network segments (hosts have 3 network segments ) :</div><div> engine and glusterfs mount : 192.168.11.X/24 </div><div> glusterfs brick : 192.168.10.x/24</div><div> iscsi : <a href="http://192.168.1.0/24" target="_blank">192.168.1.0/24</a> </div><div><br></div><div style="line-height:1.5"> and I add <a href="http://192.168.1.0/24" target="_blank">192.168.1.0/24</a> to engine vm , ovirt web UI report the same error .</div></div><div style="line-height:1.5"><br></div><div style="line-height:1.5"> humaorong </div><div style="line-height:1.5"> 2016-11-2</div><div style="line-height:1.5"><br></div><div style="font:Verdana normal 14px;color:#000"><div style="FONT-SIZE:12px;FONT-FAMILY:Arial Narrow;padding:2px 0 2px 0">------------------ Original ------------------</div><div style="FONT-SIZE:12px;background:#efefef;padding:8px"><div id="m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279menu_sender"><b>From: </b> "Maor Lipchuk"<<a href="mailto:mlipchuk@redhat.com" target="_blank">mlipchuk@redhat.com</a>>;</div><div><b>Date: </b> Tue, Nov 1, 2016 08:14 PM</div><div><b>To: </b> "胡茂荣"<<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a><wbr>>; </div><div><b>Cc: </b> "users"<<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>>; </div><div><b>Subject: </b> Re: [ovirt-users] can not use iscsi storage type on ovirt andGlusterfs hyper-converged environment</div></div><div><div class="m_-3966782059830213987m_242775738493852978m_7048953968785441569h5"><div> </div><div dir="ltr"><h3 class="m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-iw"><span name="胡茂荣" class="m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-gD" style="font-size:12.8px;font-weight:normal">Hi 胡茂荣</span></h3><h3 class="m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-iw"><span style="font-weight:normal">Can u please also add the VDSM and engine logs.</span></h3><div><span style="font-weight:normal">If you try discover and connect to those luns directly from your Host does it work?</span></div><div><span style="font-weight:normal"><br></span></div><div><span style="font-weight:normal">Regards,</span></div><div><span style="font-weight:normal">Maor</span></div><table class="m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-cf m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-gJ" style="font-size:12.8px" cellpadding="0"><tbody><tr class="m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-acZ"><td class="m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-gF m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-gK" style="width:453.125px"><table class="m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-cf m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-ix" style="width:453.333px" cellpadding="0"><tbody><tr><td><h3 class="m_-3966782059830213987m_242775738493852978m_7048953968785441569m_-8948992772911632279gmail-iw"><br></h3></td></tr></tbody></table></td></tr></tbody></table></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Nov 1, 2016 at 6:12 AM, 胡茂荣 <span dir="ltr"><<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><u></u><u></u></div><div><br></div><div><br></div><div><span> on ovirt and Glusterfs hyper-converged environment , can not use iscsi storage type , UI report error: "</span><span style="line-height:1.5">Could not retrieve LUNs, please check your storage." , vdsm report :"</span><span style="line-height:1.5">VDSM hosted_engine_3 command failed: Error
block device action: ()</span><span style="line-height:1.5">" .</span></div><div><span style="line-height:1.5"> but this block device alse login on centos 7 host :</span></div><div><span style="line-height:1.5">==============================<wbr>==============================<wbr>=</span></div><div><p class="MsoNormal"><span lang="EN-US">## lsscsi </span></p>
<p class="MsoNormal"><span lang="EN-US">[7:0:0:0]
disk SCST_BIO
DEVFOR_OVIRT_rbd 221 /dev/sdi</span></p><p class="MsoNormal"><span lang="EN-US"> ## dmesg :</span></p><p class="MsoNormal"><span lang="EN-US"></span></p><p class="MsoNormal"><span lang="EN-US">[684521.131186] sd 7:0:0:0: [sdi] Attached
SCSI disk</span></p><p class="MsoNormal"><span style="line-height:1.5">==============================<wbr>=====---</span></p><p class="MsoNormal"><span style="line-height:1.5"> </span><span style="line-height:1.5" lang="EN-US"> ###</span><span style="line-height:1.5">vdsm or supervdsm log report :</span></p><p class="MsoNormal"><span lang="EN-US"> </span><span style="line-height:1.5">MainProcess|jsonrpc.Executor/7<wbr>::ERROR::2016-11-01
11:07:00,178::supervdsmServer:<wbr>:96:<span style="background-color:rgb(255,255,0)">:SuperVdsm.ServerCallback:<wbr>:(wrapper) Error in
getPathsStatus</span></span></p>
<p class="MsoNormal"><span lang="EN-US">MainProcess|jsonrpc.Executor/4<wbr>::ERROR::2016-11-01
11:07:20,964::supervdsmServer:<wbr>:96::SuperVdsm.ServerCallback:<wbr>:(wrapper) Error in
getPathsStatus</span></p><p class="MsoNormal"><span lang="EN-US"> </span><span style="line-height:1.5">jsonrpc.Executor/4::DEBUG::20<wbr>16-11-01
11:07:04,251::iscsi::434::Stor<wbr>age.ISCSI::(rescan) Performing SCSI scan, this
will take up to 30 seconds</span></p>
<p class="MsoNormal"><span lang="EN-US">jsonrpc.Executor/5::INFO::2016<wbr>-11-01
11:07:19,413::iscsi::567::Stor<wbr>age.ISCSI::(setRpFilterIfNeede<wbr>d) <span style="background:yellow">iSCSI iface.net_ifacename not provided.
Skipping.</span></span></p><p class="MsoNormal"><span style="line-height:1.5">11:09:15,753::iscsiadm::119::S<wbr>torage.Misc.excCmd::(_runCmd)
/usr/bin/taskset --cpu-list 0-7 /usr/bin/sudo -n /usr/sbin/iscsiadm -m session
-R (</span><span style="line-height:1.5;background:yellow">cwd None</span><span style="line-height:1.5">)</span></p><p class="MsoNormal"><span style="line-height:1.5">==============================<wbr>========</span></p><p class="MsoNormal"><span style="line-height:1.5"> the other info please t</span><span style="line-height:1.5">he attachment "bug-info.doc".</span></p><p class="MsoNormal"><span lang="EN-US"> this prolem on ovirt3.6 and 4.X </span><span> </span><span>ovirt and Glusterfs hyper-converged environment </span><span style="line-height:1.5" lang="EN-US">. how can I use </span><span>iscsi storage type on </span><span>ovirt and Glusterfs hyper-converged environment .Please help me !</span></p><p class="MsoNormal"><span> humaorong</span></p><p class="MsoNormal"><font face="lucida Grande, Verdana"> 2016-11-1</font></p><p class="MsoNormal"><span><br></span></p><p class="MsoNormal"><span lang="EN-US"><br></span></p>
<p class="MsoNormal"><br></p>
<p class="MsoNormal"><span lang="EN-US"> </span></p></div><div><span style="line-height:1.5"> </span></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
<br></blockquote></div><br></div>
</div></div></div><u></u></div></blockquote></div><br></div>
</div></div></div><u></u></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
<br></blockquote></div><br></div>
</div></div></div></div></div></div><u></u></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
<br></blockquote></div><br></div></div></div>
</div></div></div><u></u></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><br>
<br></blockquote></div><br></div>