<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Thu, Jul 13, 2017 at 6:23 PM, Gianluca Cecchi <span dir="ltr"><<a href="mailto:gianluca.cecchi@gmail.com" target="_blank">gianluca.cecchi@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hello,<div>I have cleanly removed an iSCSI domain from oVirt. There is another one (connecting to another storage array) that is the master domain. </div><div>But I see that oVirt hosts still maintain the iscsi session to the LUN.</div><div>So I want to clean from os point of view before removing the LUN itself from storage.</div><div><br></div><div>At the moment I still see the multipath lun on both hosts</div><div><br></div><div><div>[root@ov301 network-scripts]# multipath -l</div><div>. . .</div><div>364817197b5dfd0e5538d959702249<wbr>b1c dm-2 EQLOGIC ,100E-00 </div><div>size=4.0T features='0' hwhandler='0' wp=rw</div><div>`-+- policy='round-robin 0' prio=0 status=active</div><div> |- 9:0:0:0 sde 8:64 active undef running</div><div> `- 10:0:0:0 sdf 8:80 active undef running</div></div><div><br></div><div>and </div><div><div>[root@ov301 network-scripts]# iscsiadm -m session</div><div>tcp: [1] <a href="http://10.10.100.9:3260" target="_blank">10.10.100.9:3260</a>,1 iqn.2001-05.com.equallogic:4-<wbr>771816-e5d0dfb59-<wbr>1c9b240297958d53-ovsd3910 (non-flash)</div><div>tcp: [2] <a href="http://10.10.100.9:3260" target="_blank">10.10.100.9:3260</a>,1 iqn.2001-05.com.equallogic:4-<wbr>771816-e5d0dfb59-<wbr>1c9b240297958d53-ovsd3910 (non-flash)</div></div><div>. . .</div><div><br></div><div>Do I have to clean the multipath paths and multipath device and then iSCSI logout, or is it sufficient to iSCSI logout and the multipath device and its path will be cleanly removed from OS point of view?</div><div><br></div><div>I would like not to have multipath device in stale condition.</div><div><br></div><div>Thanks</div><span class="gmail-HOEnZb"><font color="#888888"><div>Gianluca</div></font></span></div>
</blockquote></div><br><br>I have not understood why, if I destroy a storage domain, still oVirt maintains its LVM structures....<br><br>Anyway, these were the step done at host side before removal of the LUN at storage array level<br><br></div><div class="gmail_extra">Pick up the VG of which the lun is still a PV for..<br></div><div class="gmail_extra"><br>vgchange -an 5ed04196-87f1-480e-9fee-9dd450a3b53b<br>--> actually all lvs were already inactive<br><br>vgremove 5ed04196-87f1-480e-9fee-9dd450a3b53b<br>Do you really want to remove volume group "5ed04196-87f1-480e-9fee-9dd450a3b53b" containing 22 logical volumes? [y/n]: y<br> Logical volume "metadata" successfully removed<br> Logical volume "outbox" successfully removed<br> Logical volume "xleases" successfully removed<br> Logical volume "leases" successfully removed<br> Logical volume "ids" successfully removed<br> Logical volume "inbox" successfully removed<br> Logical volume "master" successfully removed<br> Logical volume "bc141d0d-b648-409b-a862-9b6d950517a5" successfully removed<br> Logical volume "31255d83-ca67-4f47-a001-c734c498d176" successfully removed<br> Logical volume "607dbf59-7d4d-4fc3-ae5f-e8824bf82648" successfully removed<br> Logical volume "dfbf5787-36a4-4685-bf3a-43a55e9cd4a6" successfully removed<br> Logical volume "400ea884-3876-4a21-9ec6-b0b8ac706cee" successfully removed<br> Logical volume "1919f6e6-86cd-4a13-9a21-ce52b9f62e35" successfully removed<br> Logical volume "a3ea679b-95c0-475d-80c5-8dc4d86bd87f" successfully removed<br> Logical volume "32f433c8-a991-4cfc-9a0b-7f44422815b7" successfully removed<br> Logical volume "7f867f59-c977-47cf-b280-a2a0fef8b95b" successfully removed<br> Logical volume "6e2005f2-3ff5-42fa-867e-e7812c6726e4" successfully removed<br> Logical volume "42344cf4-8f9c-464d-ab0f-d62beb15d359" successfully removed<br> Logical volume "293e169e-53ed-4d60-b22a-65835f5b0d29" successfully removed<br> Logical volume "e86752c4-de73-4733-b561-2afb31bcc2d3" successfully removed<br> Logical volume "79350ec5-eea5-458b-a3ee-ba394d2cda27" successfully removed<br> Logical volume "77824fce-4f95-49e3-b732-f791151dd15c" successfully removed<br> Volume group "5ed04196-87f1-480e-9fee-9dd450a3b53b" successfully removed<br><br>pvremove /dev/mapper/364817197b5dfd0e5538d959702249b1c<br><br>multipath -f 364817197b5dfd0e5538d959702249b1c<br><br>iscsiadm -m session -r 1 -u<br>Logging out of session [sid: 1, target: iqn.2001-05.com.equallogic:4-771816-e5d0dfb59-1c9b240297958d53-ovsd3910, portal: 10.10.100.9,3260]<br>Logout of [sid: 1, target: iqn.2001-05.com.equallogic:4-771816-e5d0dfb59-1c9b240297958d53-ovsd3910, portal: 10.10.100.9,3260] successful.<br><br>iscsiadm -m session -r 2 -u<br>Logging out of session [sid: 2, target: iqn.2001-05.com.equallogic:4-771816-e5d0dfb59-1c9b240297958d53-ovsd3910, portal: 10.10.100.9,3260]<br>Logout of [sid: 2, target: iqn.2001-05.com.equallogic:4-771816-e5d0dfb59-1c9b240297958d53-ovsd3910, portal: 10.10.100.9,3260] successful.<br><br></div><div class="gmail_extra">done.<br></div><div class="gmail_extra"><br>NOTE: on one node I missed the LVM clean before logging out of the iSCSI session<br>this resulted in impossibility to have a clean status because the multipath device resulted as without paths but still used (by LVM)<br>and the command <br>multipath -f<br>failed.<br>Also vgs and lvs commands threw out many errors and many errors in messages too<br><br>These were the commands to clean the situation also on that node.<br><br>dmsetup remove 5ed04196-87f1-480e-9fee-9dd450a3b53b/master<br>dmsetup remove 5ed04196-87f1-480e-9fee-9dd450a3b53b/inbox<br>dmsetup remove 5ed04196-87f1-480e-9fee-9dd450a3b53b/xleases<br>dmsetup remove 5ed04196-87f1-480e-9fee-9dd450a3b53b/leases<br>dmsetup remove 5ed04196-87f1-480e-9fee-9dd450a3b53b/outbox<br>dmsetup remove 5ed04196-87f1-480e-9fee-9dd450a3b53b/ids<br>dmsetup remove 5ed04196-87f1-480e-9fee-9dd450a3b53b/metadata<br><br>multipath -f 364817197b5dfd0e5538d959702249b1c<br><br></div><div class="gmail_extra">Gianluca<br></div></div>