<div dir="ltr"><div><div>Ok I found the conflict. The ip rule list does not have any record on IB0 interface, all other networks are updated correctly but not IB one.<br></div>Probably this is not a good idea to have an ISCSI storage devices with the same interface as VM network. <br></div><div>the network update operation trying to put interface up and down in that point all iscsi devices going to IO/failure this stops to update IB interface data.<br><br></div><div>Maybe one need to put whole cluster to maintenance mode in order to change Storage dependent network setup? <br></div><div><br>this is the main trouble which prevents to fix/change any network setup on IB0 interface.<br>tail -f /var/log/vdsm/vdsm.log<br>Traceback (most recent call last):<br> File "/usr/share/vdsm/storage/hsm.py", line 2430, in connectStorageServer<br> conObj.connect()<br> File "/usr/share/vdsm/storage/storageServer.py", line 367, in connect<br> iscsi.addIscsiNode(self._iface, self._target, self._cred)<br> File "/usr/share/vdsm/storage/iscsi.py", line 164, in addIscsiNode<br> iscsiadm.node_login(<a href="http://iface.name">iface.name</a>, portalStr, target.iqn)<br> File "/usr/share/vdsm/storage/iscsiadm.py", line 295, in node_login<br> raise IscsiNodeError(rc, out, err)<br>IscsiNodeError: (8, ['Logging in to [iface: default, target: iqn.2003-01.org.linux-iscsi.data01.x8664:sn.f5c9b017e103, portal: 10.10.10.31,3260] (multiple)'], ['iscsiadm: Could not login to [iface: default, target: iqn.2003-01.org.linux-iscsi.data01.x8664:sn.f5c9b017e103, portal: 10.10.10.31,3260].', 'iscsiadm: initiator reported error (8 - connection timed out)', 'iscsiadm: Could not log into all portals'])<br><br></div>PS<br>"save network configuration" is always checked.<br><br><div><br><div><br></div></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr"><pre cols="72"><span><pre cols="72">***********************************************************</pre></span> Dr. Arman Khalatyan eScience -SuperComputing
Leibniz-Institut für Astrophysik Potsdam (AIP)
An der Sternwarte 16, 14482 Potsdam, Germany <br><span><pre cols="72">***********************************************************<br></pre></span></pre>
</div></div></div>
<br><div class="gmail_quote">On Tue, Dec 30, 2014 at 7:05 AM, Moti Asayag <span dir="ltr"><<a href="mailto:masayag@redhat.com" target="_blank">masayag@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class=""><br>
<br>
----- Original Message -----<br>
> From: "Arman Khalatyan" <<a href="mailto:arm2arm@gmail.com">arm2arm@gmail.com</a>><br>
</span><span class="">> To: "Moti Asayag" <<a href="mailto:masayag@redhat.com">masayag@redhat.com</a>><br>
> Cc: "users" <<a href="mailto:users@ovirt.org">users@ovirt.org</a>><br>
> Sent: Monday, December 29, 2014 3:59:46 PM<br>
> Subject: Re: [ovirt-users] Unable to reinstall hosts after network removal.<br>
><br>
> My setup has 3 networks: 1xIB,1x10Gbit+1Gbit for ovirt-management.<br>
> The ovirt network does not have any trouble, it is always there.<br>
> I was trying to rename or remove my IB network which was used for VM<br>
> migrations.<br>
> I was using web-GUI, which was removing IB0 network w/o problem. After<br>
> removal the hosts where ok.<br>
<br>
</span>Have you checked the option of "save network configuration" in the setup networks<br>
dialog (iirc should have been checked by default) ?<br>
<br>
Could you also attach the /var/log/ovirt-engine/engine.log from the engine server<br>
and /var/log/vdsm/vdsm.log and /var/log/vdsm/supervdsm.log from the node so<br>
we can see which request was sent to vdsm and its result ?<br>
<div class="HOEnZb"><div class="h5"><br>
> Then I put them to maintenance mode. To refresh<br>
> iptables rules I did reinstall. then reinstall was failing with message<br>
> that IB0 not attached to any interface. But IB0 interface is not possible<br>
> to attach it is already deleted and not visible in any network dialog.<br>
> After creating interface with the same name everything is online now.<br>
> My current interface list is following:<br>
> virsh -r net-list<br>
> Name State Autostart Persistent<br>
> --------------------------------------------------<br>
> ;vdsmdummy; active no no<br>
> vdsm-cls10G active yes yes<br>
> vdsm-IB0 active yes yes<br>
> vdsm-ovirtmgmt active yes yes<br>
><br>
> On this host the IB0 is not atached to any interface, I wondered, if it<br>
> should show up in the net list?<br>
><br>
> I think the GUI does not rename/remove the interface from the DB. Some<br>
> constrain keeps still IB0 in DB.<br>
><br>
><br>
><br>
> ***********************************************************<br>
><br>
> Dr. Arman Khalatyan eScience -SuperComputing Leibniz-Institut für<br>
> Astrophysik Potsdam (AIP) An der Sternwarte 16, 14482 Potsdam, Germany<br>
><br>
> ***********************************************************<br>
><br>
><br>
> On Sun, Dec 28, 2014 at 10:31 AM, Moti Asayag <<a href="mailto:masayag@redhat.com">masayag@redhat.com</a>> wrote:<br>
><br>
> ><br>
> ><br>
> > ----- Original Message -----<br>
> > > From: "Arman Khalatyan" <<a href="mailto:arm2arm@gmail.com">arm2arm@gmail.com</a>><br>
> > > To: "users" <<a href="mailto:users@ovirt.org">users@ovirt.org</a>><br>
> > > Sent: Wednesday, December 24, 2014 1:22:43 PM<br>
> > > Subject: [ovirt-users] Unable to reinstall hosts after network removal.<br>
> > ><br>
> > > Hello,<br>
> > > I have a little trouble with ovirt 3.5 on CentOS6.6:<br>
> > > I was removing all networks from all hosts.<br>
> ><br>
> > Did you use the setup networks dialog from the UI in order to remove those<br>
> > networks ?<br>
> > Or have you removed those networks from the host directly (where you<br>
> > should used the:<br>
> > 1. virsh net-destroy 'the-network-name'<br>
> > 2. virsh net-undefine 'the-network-name'<br>
> > )<br>
> ><br>
> > can you report the output of 'virsh -r net-list' ?<br>
> ><br>
> > > Then after removing network from data center the hosts went to unusable.<br>
> ><br>
> > What was the host's status prior to removing its networks ? Was it up ?<br>
> ><br>
> > > Every time after reinstall the host claims that the network is not<br>
> > > configured, but it s already removed from network tab in DC.<br>
> ><br>
> > What is the missing network name ? Is it 'ovirtmgmt' ?<br>
> ><br>
> > > Where from it gets the old configuration? the old interfaces also<br>
> > restored<br>
> > > every time on the reinstalled hosts.<br>
> ><br>
> > The hosts via vdsm reports their network configuration via the<br>
> > 'getCapabilities' verb<br>
> > of vdsm. You can try running it on the host:<br>
> ><br>
> > vdsClient -s 0 getVdsCaps<br>
> ><br>
> > and examine the nics / neworks / bridges / vlans / bonds elements.<br>
> ><br>
> > > Which DB table is in charge of dc-networks?<br>
> > ><br>
> ><br>
> > The retrieved information from vdsm is reported to 'vds_interace' table.<br>
> > The dc networks are stored in 'networks' table and networks attached to<br>
> > clusters are stored in network_cluster table.<br>
> ><br>
> > I wouldn't recommend on deleting entries from the tables directly. There<br>
> > are<br>
> > certain constraints which shouldn't be violated, i.e. the management<br>
> > network<br>
> > 'ovirtmgnt' is blocked for removal from the engine.<br>
> ><br>
> > > Thanks,<br>
> > > Arman.<br>
> > ><br>
> > ><br>
> > > ***********************************************************<br>
> > > Dr. Arman Khalatyan eScience -SuperComputing Leibniz-Institut für<br>
> > Astrophysik<br>
> > > Potsdam (AIP) An der Sternwarte 16, 14482 Potsdam, Germany<br>
> > > ***********************************************************<br>
> > ><br>
> > > _______________________________________________<br>
> > > Users mailing list<br>
> > > <a href="mailto:Users@ovirt.org">Users@ovirt.org</a><br>
> > > <a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
> > ><br>
> ><br>
><br>
</div></div></blockquote></div><br></div>