<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:black;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-AU" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">Hi Nir,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">Thanks for your help. I’m going to start up another thread as to not pollute what this thread was initially about.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">I’ll test your patch, and I suspect it’s the gluster version that is causing the problem as I did update the host.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">When I create the thread I’ll make sure to include everyone already present (It might be a week or so, as my time Is limited atm)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">Cheers<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US">David<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Nir Soffer [mailto:nsoffer@redhat.com]
<br>
<b>Sent:</b> Thursday, March 03, 2016 17:59<br>
<b>To:</b> Dan Kenigsberg <danken@redhat.com>; Sahina Bose <sabose@redhat.com>; Ala Hino <ahino@redhat.com><br>
<b>Cc:</b> David LeVene <David.LeVene@blackboard.com>; users@ovirt.org<br>
<b>Subject:</b> Re: [ovirt-users] 3.6 looses network on reboot<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Thu, Mar 3, 2016 at 9:06 AM, Dan Kenigsberg <<a href="mailto:danken@redhat.com">danken@redhat.com</a>> wrote:<br>
><br>
> On Thu, Mar 03, 2016 at 12:54:25AM +0000, David LeVene wrote:<br>
> ><br>
> > Can you check our patches? They should resolve the problem we saw in the<br>
> > log: <a href="https://gerrit.ovirt.org/#/c/54237">https://gerrit.ovirt.org/#/c/54237</a> (based on oVirt-3.6.3)<br>
> ><br>
> > -- I've manually applied the patch to the node that I was testing on<br>
> > and the networking comes on-line correctly - now I'm encountering a<br>
> > gluster issue with cannot find master domain.<br>
><br>
> You are most welcome to share your logs (preferably on a different<br>
> thread, to avoid confusion)<br>
><br>
> ><br>
> > Without the fixes, as a workaround, I would suggest (if possible) to disable IPv6 on your host boot line and check if all works out for you.<br>
> > -- Ok, but as I can manually apply the patch its good now. Do you know<br>
> > what version are we hoping to have this put into as I won't perform an<br>
> > ovirt/vdsm update until its part of the upstream RPM's<br>
><br>
> The fix has been proposed to ovirt-3.6.4. I'll make sure it's accepted.<br>
><br>
> ><br>
> > Do you need IPv6 connectivity? If so, you'll need to use a vdsm hook or another interface that is not controlled by oVirt.<br>
> > -- Ideally I'd prefer not to have it, but the way our network has been<br>
> > configured some hosts are IPv6 only, so at a min the guests need it..<br>
> > the hypervisors not so much.<br>
><br>
> May I tap to what your IPv6 experience? (only if you feel confortable sharing<br>
> this publically). What does these IPv6-only servers do? What does the guest do<br>
> with them?<br>
><br>
> ><br>
> > -- I've now hit an issue with it not starting up the master storage<br>
> > gluster domain - as it’s a separate issue I'll review the mailing<br>
> > lists & create a new item if its related.. I've attached the<br>
> > supervdsm.log incase you can save me some time and point me in the<br>
> > right direction!<br>
><br>
> All I see is this<br>
><br>
> MainProcess|jsonrpc.Executor/4::ERROR::2016-03-03 11:15:04,699::supervdsmServer::118::SuperVdsm.ServerCallback::(wrapper) Error in wrapper<br>
> Traceback (most recent call last):<br>
> File "/usr/share/vdsm/supervdsmServer", line 116, in wrapper<br>
> res = func(*args, **kwargs)<br>
> File "/usr/share/vdsm/supervdsmServer", line 531, in wrapper<br>
> return func(*args, **kwargs)<br>
> File "/usr/share/vdsm/gluster/cli.py", line 496, in volumeInfo<br>
> xmltree = _execGlusterXml(command)<br>
> File "/usr/share/vdsm/gluster/cli.py", line 108, in _execGlusterXml<br>
> raise ge.GlusterCmdExecFailedException(rc, out, err)<br>
> GlusterCmdExecFailedException: Command execution failed<br>
> return code: 2<br>
<br>
<br>
We have this logs before the exception:<br>
<br>
MainProcess|jsonrpc.Executor/3::DEBUG::2016-03-03 11:02:42,945::utils::669::root::(execCmd) /usr/bin/taskset --cpu-list 0-39 /usr/sbin/gluster --mode=script volume info --re<br>
mote-host=ovirtmount.test.lab data --xml (cwd None)<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">The command looks correct<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><br>
MainProcess|jsonrpc.Executor/3::DEBUG::2016-03-03 11:02:43,024::utils::687::root::(execCmd) FAILED: <err> = '\n'; <rc> = 2<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">gluster command line failed in an unhelpful way.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">(Adding Sahina)<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">David, can you try to run this command manually on this host? maybe there is some<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">--verbose flag revealing more info?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">You may also try a simpler command:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"> gluster volume info --remote-host=ovirtmount.test.lab data<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Another issue you should check - gluster version on the hosts and on the gluster nodes *must*<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">match - otherwise you should expect failures accessing gluster server.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">We have this patch for handling such errors gracefully - can you test it?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><a href="https://gerrit.ovirt.org/53785">https://gerrit.ovirt.org/53785</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">(Adding Ala)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Nir<o:p></o:p></p>
</div>
</div>
</div>
This email and any attachments may contain confidential and proprietary information of Blackboard that is for the sole use of the intended recipient. If you are not the intended recipient, disclosure, copying, re-distribution or other use of any of this information
is strictly prohibited. Please immediately notify the sender and delete this transmission if you received this email in error.
</body>
</html>