<div> </div><div> I find this problem more info : </div><div> <span style="line-height: 1.5;"> I use flashcache on ovirt hosts , have dm device in /dev/mapper/ :</span></div><div><br></div><div><div>[root@horeba init.d]# dmsetup info -C <span style="line-height: 1.5;">（and I set them in multipath blacklist ）</span></div><div>Name Maj Min Stat Open Targ Event UUID </div><div>flash_sdb 253 0 L--w 0 1 0 </div><div>flash_sdf 253 2 L--w 0 1 0 </div><div>flash_sdd 253 1 L--w 0 1 0 </div><div>[root@horeba init.d]# multipath -l </div><div>[root@horeba init.d]# </div><div> </div><div>[root@horeba init.d]# ll /dev/mapper/</div><div>total 0</div><div>crw------- 1 root root 10, 236 Nov 25 10:09 control</div><div>lrwxrwxrwx 1 root root 7 Nov 25 12:51 flash_sdb -> ../dm-0</div><div>lrwxrwxrwx 1 root root 7 Nov 25 12:51 flash_sdd -> ../dm-1</div><div>lrwxrwxrwx 1 root root 7 Nov 25 12:51 flash_sdf -> ../dm-2</div></div><div> </div><div> on this condition , ovirt UI add <span style="line-height: 1.5;"> </span><span style="line-height: 1.5;">iscsi type storage</span><span style="line-height: 1.5;"> will fail .</span></div><div><br></div><div> If I delete the flashcache device /dev/mapper/flash_* , ovirt UI add iscsi type storage have no problem . </div><div> </div><div> I need flashcache for using ssd cache on my environment , how can I use iscsi type storage on this environment , please help me , Thanks！</div><div><includetail><div> </div><div> </div><div style="font:Verdana normal 14px;color:#000;"><div style="FONT-SIZE: 12px;FONT-FAMILY: Arial Narrow;padding:2px 0 2px 0;">------------------ Original ------------------</div><div style="FONT-SIZE: 12px;background:#efefef;padding:8px;"><div id="menu_sender"><b>From: </b> "Sahina Bose"<sabose@redhat.com>;</div><div><b>Date: </b> Thu, Nov 3, 2016 05:54 PM</div><div><b>To: </b> "胡茂荣"<maorong.hu@horebdata.cn>; <wbr></div><div><b>Cc: </b> "Maor Lipchuk"<mlipchuk@redhat.com>; "Jeff Nelson"<jenelson@redhat.com>; "users"<users@ovirt.org>; <wbr></div><div><b>Subject: </b> Re: [ovirt-users] can not use iscsi storage type on ovirtandGlusterfshyper-converged environment</div></div><div> </div><div dir="ltr"><div>A wild guess, not sure if it is related - can you check if multipathd service is enabled. If you set up your oVirt-Gluster hyperconverged environment via gdeploy, multipathd service is disabled and the /etc/multipath.conf is edited to blacklist all devices - this was to fix <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1303940">https://bugzilla.redhat.com/show_bug.cgi?id=1303940</a><br><br></div>Since you mention you're unable to add iscsi storage only in this environment, thought it's worth checking.<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Nov 3, 2016 at 6:40 AM, 胡茂荣 <span dir="ltr"><<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><span style="line-height:1.5"><br></span></div><div><span style="line-height:1.5"> my </span><span style="line-height:1.5"> </span><span style="line-height:1.5">environment rpm are :</span></div><div><u></u><div> [root@horeba ~]# rpm -q vdsm</div><div>vdsm-4.18.13-1.el7.centos.x86_<wbr>64</div><div><br></div><div><div>[root@horeba ~]# rpm -aq | grep ovirt</div><div>ovirt-vmconsole-host-1.0.4-1.<wbr>el7.centos.noarch</div><div>ovirt-imageio-common-0.4.0-1.<wbr>el7.noarch</div><div>ovirt-hosted-engine-setup-2.0.<wbr>2.2-1.el7.centos.noarch</div><div>ovirt-imageio-daemon-0.4.0-1.<wbr>el7.noarch</div><div>ovirt-engine-appliance-4.0-<wbr>20160928.1.el7.centos.noarch</div><div>ovirt-vmconsole-1.0.4-1.el7.<wbr>centos.noarch</div><div>ovirt-host-deploy-1.5.2-1.el7.<wbr>centos.noarch</div><div>ovirt-hosted-engine-ha-2.0.4-<wbr>1.el7.centos.noarch</div><div>ovirt-release40-4.0.4-1.noarch</div><div>ovirt-setup-lib-1.0.2-1.el7.<wbr>centos.noarch</div><div>ovirt-engine-sdk-python-3.6.9.<wbr>1-1.el7.centos.noarch</div></div><div><br></div><div> and I test if not on '<span style="line-height:1.5"> </span><span style="line-height:1.5">ovirt and Glusterfs hyper-converged environment </span><span style="line-height:1.5">' , ovirt WEB UI add </span>iscsi storage work ok .</div><div><br></div><div> </div><div style="font:Verdana normal 14px;color:#000"><div style="FONT-SIZE:12px;FONT-FAMILY:Arial Narrow;padding:2px 0 2px 0">------------------ Original --<wbr>----------------</div><div style="FONT-SIZE:12px;background:#efefef;padding:8px"><div id="m_7048953968785441569menu_sender"><b>From: </b> "Maor Lipchuk"<<a href="mailto:mlipchuk@redhat.com" target="_blank">mlipchuk@redhat.com</a>>;</div><div><b>Date: </b> Wed, Nov 2, 2016 07:37 PM</div><div><b>To: </b> "胡茂荣"<<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a><wbr>>; </div><div><b>Cc: </b> "users"<<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>>; "Jeff Nelson"<<a href="mailto:jenelson@redhat.com" target="_blank">jenelson@redhat.com</a>>; "Nir Soffer"<<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>>; </div><div><div class="h5"><div><b>Subject: </b> Re: [ovirt-users] can not use iscsi storage type on ovirtandGlusterfs hyper-converged environment</div></div></div></div><div><div class="h5"><div> </div><div dir="ltr">Thanks for the logs,<div><br></div><div>What kind of VDSM version are you using? </div><div> "<span style="color:rgb(0,0,0);white-space:pre-wrap">rpm -q vdsm"</span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap">There seems to be a similar issue which was reported recently in the VDSM area</span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap"> (see </span><font color="#000000"><span style="white-space:pre-wrap"><a href="https://bugzilla.redhat.com/show_bug.cgi?id=1197292" target="_blank">https://bugzilla.redhat.com/<wbr>show_bug.cgi?id=1197292</a>)</span></font></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap">It should be fixed in later versions of VDSM </span><span style="color:rgb(0,0,0);white-space:pre-wrap">vdsm-4.16.12-2.el7ev.x86_64</span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap">Adding also Nir and Jeff to the thread, if they have any insights</span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap"><br></span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap">Regards,</span></div><div><span style="color:rgb(0,0,0);white-space:pre-wrap">Maor</span></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Nov 2, 2016 at 4:11 AM, 胡茂荣 <span dir="ltr"><<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><br></div><div><u></u><div> Hi <span style="line-height:1.5">Maor:</span></div><div><span style="line-height:1.5"> vdsm/supervdsm/engine log on attachment . I mkfs.xfs the lun block device and mount to /mnt , dd write ,dmesg not report error ,dd result is ok :</span></div><div><span style="line-height:1.5"> </span></div><div><div>/dev/sdi 50G 33M 50G 1% /mnt<span style="line-height:1.5"> </span></div><div><span style="line-height:1.5"><br></span></div><div>[root@horebc mnt]# for i in `seq 3`; do dd if=/dev/zero of=./file bs=1G count=1 oflag=direct ; done</div><div>1+0 records in</div><div>1+0 records out</div><div>1073741824 bytes (1.1 GB) copied, 13.3232 s, 80.6 MB/s</div><div>1+0 records in</div><div>1+0 records out</div><div>1073741824 bytes (1.1 GB) copied, 9.89988 s, 108 MB/s</div><div>1+0 records in</div><div>1+0 records out</div><div>1073741824 bytes (1.1 GB) copied, 14.0143 s, 76.6 MB/s </div><div> </div><div> my envirnment have three network segments (hosts have 3 network segments ) :</div><div> engine and glusterfs mount : 192.168.11.X/24 </div><div> glusterfs brick : 192.168.10.x/24</div><div> iscsi : <a href="http://192.168.1.0/24" target="_blank">192.168.1.0/24</a> </div><div><br></div><div style="line-height:1.5"> and I add <a href="http://192.168.1.0/24" target="_blank">192.168.1.0/24</a> to engine vm , ovirt web UI report the same error .</div></div><div style="line-height:1.5"><br></div><div style="line-height:1.5"> humaorong </div><div style="line-height:1.5"> 2016-11-2</div><div style="line-height:1.5"><br></div><div style="font:Verdana normal 14px;color:#000"><div style="FONT-SIZE:12px;FONT-FAMILY:Arial Narrow;padding:2px 0 2px 0">------------------ Original --<wbr>----------------</div><div style="FONT-SIZE:12px;background:#efefef;padding:8px"><div id="m_7048953968785441569m_-8948992772911632279menu_sender"><b>From: </b> "Maor Lipchuk"<<a href="mailto:mlipchuk@redhat.com" target="_blank">mlipchuk@redhat.com</a>>;</div><div><b>Date: </b> Tue, Nov 1, 2016 08:14 PM</div><div><b>To: </b> "胡茂荣"<<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a><wbr>>; </div><div><b>Cc: </b> "users"<<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>>; </div><div><b>Subject: </b> Re: [ovirt-users] can not use iscsi storage type on ovirt andGlusterfs hyper-converged environment</div></div><div><div class="m_7048953968785441569h5"><div> </div><div dir="ltr"><h3 class="m_7048953968785441569m_-8948992772911632279gmail-iw"><span name="胡茂荣" class="m_7048953968785441569m_-8948992772911632279gmail-gD" style="font-size:12.8px;font-weight:normal">Hi 胡茂荣</span></h3><h3 class="m_7048953968785441569m_-8948992772911632279gmail-iw"><span style="font-weight:normal">Can u please also add the VDSM and engine logs.</span></h3><div><span style="font-weight:normal">If you try discover and connect to those luns directly from your Host does it work?</span></div><div><span style="font-weight:normal"><br></span></div><div><span style="font-weight:normal">Regards,</span></div><div><span style="font-weight:normal">Maor</span></div><table class="m_7048953968785441569m_-8948992772911632279gmail-cf m_7048953968785441569m_-8948992772911632279gmail-gJ" style="font-size:12.8px" cellpadding="0"><tbody><tr class="m_7048953968785441569m_-8948992772911632279gmail-acZ"><td class="m_7048953968785441569m_-8948992772911632279gmail-gF m_7048953968785441569m_-8948992772911632279gmail-gK" style="width:453.125px"><table class="m_7048953968785441569m_-8948992772911632279gmail-cf m_7048953968785441569m_-8948992772911632279gmail-ix" style="width:453.333px" cellpadding="0"><tbody><tr><td><h3 class="m_7048953968785441569m_-8948992772911632279gmail-iw"><br></h3></td></tr></tbody></table></td></tr></tbody></table></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Nov 1, 2016 at 6:12 AM, 胡茂荣 <span dir="ltr"><<a href="mailto:maorong.hu@horebdata.cn" target="_blank">maorong.hu@horebdata.cn</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><u></u><u></u></div><div><br></div><div><br></div><div><span> on ovirt and Glusterfs hyper-converged environment , can not use iscsi storage type , UI report error: "</span><span style="line-height:1.5">Could not retrieve LUNs, please check your storage." , vdsm report :"</span><span style="line-height:1.5">VDSM hosted_engine_3 command failed: Error
block device action: ()</span><span style="line-height:1.5">" .</span></div><div><span style="line-height:1.5"> but this block device alse login on centos 7 host :</span></div><div><span style="line-height:1.5">==============================<wbr>==============================<wbr>=</span></div><div><p class="MsoNormal"><span lang="EN-US">## lsscsi </span></p>
<p class="MsoNormal"><span lang="EN-US">[7:0:0:0]
disk SCST_BIO
DEVFOR_OVIRT_rbd 221 /dev/sdi</span></p><p class="MsoNormal"><span lang="EN-US"> ## dmesg :</span></p><p class="MsoNormal"><span lang="EN-US"></span></p><p class="MsoNormal"><span lang="EN-US">[684521.131186] sd 7:0:0:0: [sdi] Attached
SCSI disk</span></p><p class="MsoNormal"><span style="line-height:1.5">==============================<wbr>=====---</span></p><p class="MsoNormal"><span style="line-height:1.5"> </span><span style="line-height:1.5" lang="EN-US"> ###</span><span style="line-height:1.5">vdsm or supervdsm log report :</span></p><p class="MsoNormal"><span lang="EN-US"> </span><span style="line-height:1.5">MainProcess|jsonrpc.Executor<wbr>/7::ERROR::2016-11-01
11:07:00,178::supervdsmServer:<wbr>:96:<span style="background-color:rgb(255,255,0)">:SuperVdsm.ServerCallback:<wbr>:(wrapper) Error in
getPathsStatus</span></span></p>
<p class="MsoNormal"><span lang="EN-US">MainProcess|jsonrpc.Executor/4<wbr>::ERROR::2016-11-01
11:07:20,964::supervdsmServer:<wbr>:96::SuperVdsm.ServerCallback:<wbr>:(wrapper) Error in
getPathsStatus</span></p><p class="MsoNormal"><span lang="EN-US"> </span><span style="line-height:1.5">jsonrpc.Executor/4::DEBUG::20<wbr>16-11-01
11:07:04,251::iscsi::434::Stor<wbr>age.ISCSI::(rescan) Performing SCSI scan, this
will take up to 30 seconds</span></p>
<p class="MsoNormal"><span lang="EN-US">jsonrpc.Executor/5::INFO::2016<wbr>-11-01
11:07:19,413::iscsi::567::Stor<wbr>age.ISCSI::(setRpFilterIfNeede<wbr>d) <span style="background:yellow">iSCSI iface.net_ifacename not provided.
Skipping.</span></span></p><p class="MsoNormal"><span style="line-height:1.5">11:09:15,753::iscsiadm::119::S<wbr>torage.Misc.excCmd::(_runCmd)
/usr/bin/taskset --cpu-list 0-7 /usr/bin/sudo -n /usr/sbin/iscsiadm -m session
-R (</span><span style="line-height:1.5;background:yellow">cwd None</span><span style="line-height:1.5">)</span></p><p class="MsoNormal"><span style="line-height:1.5">==============================<wbr>========</span></p><p class="MsoNormal"><span style="line-height:1.5"> the other info please t</span><span style="line-height:1.5">he attachment "bug-info.doc".</span></p><p class="MsoNormal"><span lang="EN-US"> this prolem on ovirt3.6 and 4.X </span><span> </span><span>ovirt and Glusterfs hyper-converged environment </span><span style="line-height:1.5" lang="EN-US">. how can I use </span><span>iscsi storage type on </span><span>ovirt and Glusterfs hyper-converged environment .Please help me !</span></p><p class="MsoNormal"><span> humaorong</span></p><p class="MsoNormal"><font face="lucida Grande, Verdana"> 2016-11-1</font></p><p class="MsoNormal"><span><br></span></p><p class="MsoNormal"><span lang="EN-US"><br></span></p>
<p class="MsoNormal"><br></p>
<p class="MsoNormal"><span lang="EN-US"> </span></p></div><div><span style="line-height:1.5"> </span></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
<br></blockquote></div><br></div>
</div></div></div><u></u></div></blockquote></div><br></div>
</div></div></div><u></u></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><br>
<br></blockquote></div><br></div>
</div><!--<![endif]--></includetail></div>