3:47 a.m.
Hello Team,
I updated one of my host on my cluster and after it finish and try to
activate the host it quickly claimed that the host was unresponsive and
it fenced the host... Now every time I try to activate the host it
clames that is unresponsive and proceeds to fence it... This was not
happening before the update....
The host is reachable with no problems nor issues...
Any ideas?
Centos 7.4 x86_64 host.
Attached is the vdsm log
engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
9:42 a.m.
can you please provide some logs to the issue?
/var/log/ovirt-engine/engine.log from engine machine and
/var/log/vdsm/vdsm.log from the affected host would be great start.
thank you
On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes <ffuentes(a)darktcp.net>
wrote:
Hello Team,
I updated one of my host on my cluster and after it finish and try to
activate the host it quickly claimed that the host was unresponsive and
it fenced the host... Now every time I try to activate the host it
clames that is unresponsive and proceeds to fence it... This was not
happening before the update....
The host is reachable with no problems nor issues...
Any ideas?
Centos 7.4 x86_64 host.
Attached is the vdsm log
engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
6:03 p.m.
Thanks for your reply.
As requested I got this from the messages log:
https://pastebin.com/t0HRhvT9
This one is from the host engine:
https://pastebin.com/8vji6MGs
And this one is from the host vdsm:
https://pastebin.com/GgnqRvTE
The funny part is that right when I did the update it seems that vdsm
died and there is no log after the update.
On the messages lo you can see the errors and the attempts of me trying
to restart manually but it dies.
Any ideas?
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
can you please provide some logs to the issue?
/var/log/ovirt-engine/engine.log from engine machine and
/var/log/vdsm/vdsm.log from the affected host would be great start.>
thank you
On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes
<ffuentes(a)darktcp.net> wrote:>> Hello Team,
>
> I updated one of my host on my cluster and after it finish and
> try to>> activate the host it quickly claimed that the host was
> unresponsive and>> it fenced the host... Now every time I try to activate the
host it
> clames that is unresponsive and proceeds to fence it... This was not>>
happening before the update....
> The host is reachable with no problems nor issues...
>
> Any ideas?
>
> Centos 7.4 x86_64 host.
> Attached is the vdsm log
>
> engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
>
> Regards,
>
> --
> Fernando Fuentes ffuentes(a)txweather.org http://www.txweather.org>>
_______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
6:48 p.m.
Team,
I went to the log and capture the messages from when the host did the
update all the way down to the failure.
https://pastebin.com/AwP1gh5g
I hope that helps narrowing down the issue....
Ideas, thoughts, and comments are welcome!
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:
Thanks for your reply.
As requested I got this from the messages log:
https://pastebin.com/t0HRhvT9
This one is from the host engine:
https://pastebin.com/8vji6MGs
And this one is from the host vdsm:
https://pastebin.com/GgnqRvTE
The funny part is that right when I did the update it seems that vdsm
died and there is no log after the update.>
On the messages lo you can see the errors and the attempts of me
trying to restart manually but it dies.>
Any ideas?
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
> can you please provide some logs to the issue?
> /var/log/ovirt-engine/engine.log from engine machine and
> /var/log/vdsm/vdsm.log from the affected host would be great start.>>
> thank you
>
> On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes
> <ffuentes(a)darktcp.net> wrote:>>> Hello Team,
>>
>> I updated one of my host on my cluster and after it finish and
>> try to>>> activate the host it quickly claimed that the host was
>> unresponsive and>>> it fenced the host... Now every time I try to
activate the host it
>> clames that is unresponsive and proceeds to fence it... This was not>>>
happening before the update....
>> The host is reachable with no problems nor issues...
>>
>> Any ideas?
>>
>> Centos 7.4 x86_64 host.
>> Attached is the vdsm log
>>
>> engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
>>
>> Regards,
>>
>> --
>> Fernando Fuentes ffuentes(a)txweather.org http://www.txweather.org>>>
_______________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
_________________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
7 p.m.
This is a multi-part message in MIME format.
--------------F056D64369AF5E2F70CB62E9
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
this suggests that libvirt is down.
can you please check libvirtd service status and get the log for it?
Thanks,
Dafna
On 10/13/2017 04:48 PM, Fernando Fuentes wrote:
Team,
I went to the log and capture the messages from when the host did the
update all the way down to the failure.
https://pastebin.com/AwP1gh5g
I hope that helps narrowing down the issue....
Ideas, thoughts, and comments are welcome!
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:
> Thanks for your reply.
>
> As requested I got this from the messages log:
>
> https://pastebin.com/t0HRhvT9
>
> This one is from the host engine:
>
> https://pastebin.com/8vji6MGs
>
> And this one is from the host vdsm:
>
> https://pastebin.com/GgnqRvTE
>
> The funny part is that right when I did the update it seems that vdsm
> died and there is no log after the update.
>
> On the messages lo you can see the errors and the attempts of me
> trying to restart manually but it dies.
>
> Any ideas?
>
>
> --
> Fernando Fuentes
> ffuentes(a)txweather.org
> http://www.txweather.org
>
>
>
> On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
>> can you please provide some logs to the issue?
>> /var/log/ovirt-engine/engine.log from engine machine and
>> /var/log/vdsm/vdsm.log from the affected host would be great start.
>>
>> thank you
>>
>> On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes
>> <ffuentes(a)darktcp.net <mailto:ffuentes@darktcp.net>> wrote:
>>
>> Hello Team,
>>
>> I updated one of my host on my cluster and after it finish and
>> try to
>> activate the host it quickly claimed that the host was
>> unresponsive and
>> it fenced the host... Now every time I try to activate the host it
>> clames that is unresponsive and proceeds to fence it... This was not
>> happening before the update....
>> The host is reachable with no problems nor issues...
>>
>> Any ideas?
>>
>> Centos 7.4 x86_64 host.
>> Attached is the vdsm log
>>
>> engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
>>
>> Regards,
>>
>> --
>> Fernando Fuentes
>> ffuentes(a)txweather.org <mailto:ffuentes@txweather.org>
>> http://www.txweather.org
>> _______________________________________________
>> Users mailing list
>> Users(a)ovirt.org <mailto:Users@ovirt.org>
>> http://lists.ovirt.org/mailman/listinfo/users
>> <http://lists.ovirt.org/mailman/listinfo/users>
>>
>
> _________________________________________________
> Users mailing list
> Users(a)ovirt.org <mailto:Users@ovirt.org>
> http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--------------F056D64369AF5E2F70CB62E9
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">this suggests that libvirt is down.
<br>
can you please check libvirtd service status and get the log for
it? <br>
<br>
<br>
Thanks, <br>
Dafna<br>
<br>
On 10/13/2017 04:48 PM, Fernando Fuentes wrote:<br>
</div>
<blockquote type="cite"
cite="mid:1507909694.513284.1137876136.1040F0F8@webmail.messagingengine.com">
<title></title>
<div>Team,<br>
</div>
<div><br>
</div>
<div>I went to the log and capture the messages from when the host
did the update all the way down to the failure.<br>
</div>
<div><br>
</div>
<div><a href="https://pastebin.com/AwP1gh5g"
moz-do-not-send="true">https://pastebin.com/AwP1gh5g</a&g...
</div>
<div><br>
</div>
<div><br>
</div>
<div>I hope that helps narrowing down the issue....<br>
</div>
<div>Ideas, thoughts, and comments are welcome!<br>
</div>
<div><br>
</div>
<div>Regards,</div>
<div><br>
</div>
<div id="sig20414817">
<div class="signature">--<br>
</div>
<div class="signature">Fernando Fuentes<br>
</div>
<div class="signature"><a
class="moz-txt-link-abbreviated"
href="mailto:ffuentes@txweather.org">ffuentes@txweather.org</a><br>
</div>
<div class="signature"><a
class="moz-txt-link-freetext"
href="http://www.txweather.org">http://www.txweather.org</a><br>
</div>
<div class="signature"><br>
</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:<br>
</div>
<blockquote type="cite">
<div>Thanks for your reply.<br>
</div>
<div><br>
</div>
<div>As requested I got this from the messages log:<br>
</div>
<div><br>
</div>
<div><a href="https://pastebin.com/t0HRhvT9"
moz-do-not-send="true">https://pastebin.com/t0HRhvT9</a&g...
</div>
<div><br>
</div>
<div>This one is from the host engine:<br>
</div>
<div><br>
</div>
<div><a href="https://pastebin.com/8vji6MGs"
moz-do-not-send="true">https://pastebin.com/8vji6MGs</a&g...
</div>
<div><br>
</div>
<div>And this one is from the host vdsm:<br>
</div>
<div><br>
</div>
<div><a href="https://pastebin.com/GgnqRvTE"
moz-do-not-send="true">https://pastebin.com/GgnqRvTE</a&g...
</div>
<div><br>
</div>
<div>The funny part is that right when I did the update it seems
that vdsm died and there is no log after the update.<br>
</div>
<div><br>
</div>
<div>On the messages lo you can see the errors and the attempts
of me trying to restart manually but it dies.<br>
</div>
<div><br>
</div>
<div>Any ideas?<br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div>--<br>
</div>
<div>Fernando Fuentes<br>
</div>
<div><a class="moz-txt-link-abbreviated"
href="mailto:ffuentes@txweather.org">ffuentes@txweather.org</a><br>
</div>
<div><a class="moz-txt-link-freetext"
href="http://www.txweather.org">http://www.txweather.org</a><br>
</div>
<div><br>
</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>
<div>can you please provide some logs to the issue? <br>
</div>
<div>/var/log/ovirt-engine/engine.log from engine machine
and /var/log/vdsm/vdsm.log from the affected host would
be great start.<br>
</div>
</div>
<div><br>
</div>
<div>thank you<br>
</div>
</div>
<div>
<div><br>
</div>
<div>
<div>On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes <span
dir="ltr"><<a
href="mailto:ffuentes@darktcp.net"
moz-do-not-send="true">ffuentes(a)darktcp.net</a>&gt;</span>
wrote:<br>
</div>
<blockquote
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,
204, 204);padding-left:1ex;">
<div>Hello Team,<br>
</div>
<div><br>
</div>
<div>I updated one of my host on my cluster and after it
finish and try to<br>
</div>
<div>activate the host it quickly claimed that the host
was unresponsive and<br>
</div>
<div>it fenced the host... Now every time I try to
activate the host it<br>
</div>
<div>clames that is unresponsive and proceeds to fence
it... This was not<br>
</div>
<div>happening before the update....<br>
</div>
<div>The host is reachable with no problems nor
issues...<br>
</div>
<div><br>
</div>
<div>Any ideas?<br>
</div>
<div><br>
</div>
<div>Centos 7.4 x86_64 host.<br>
</div>
<div>Attached is the vdsm log<br>
</div>
<div><br>
</div>
<div>engine is oVirt Engine Version:
4.0.2.6-1.el7.centos<br>
</div>
<div><br>
</div>
<div>Regards,<br>
</div>
<div><span><span class="colour"
style="color:rgb(136,
136, 136)"><br>
--<br>
Fernando Fuentes<br>
<a href="mailto:ffuentes@txweather.org"
moz-do-not-send="true">ffuentes(a)txweather.org</a><br>
<a href="http://www.txweather.org"
moz-do-not-send="true">http://www.txweather.org</a></span></span></div>
<div>______________________________<wbr>_________________<br>
</div>
<div>Users mailing list<br>
</div>
<div><a href="mailto:Users@ovirt.org"
moz-do-not-send="true">Users(a)ovirt.org</a><br>
</div>
<div><a
href="http://lists.ovirt.org/mailman/listinfo/users"
moz-do-not-send="true">http://lists.ovirt.org/<wbr>mai...
</div>
<div><br>
</div>
</blockquote>
</div>
</div>
</blockquote>
<div><br>
</div>
<div><u>_______________________________________________</u><br>
</div>
<div>Users mailing list<br>
</div>
<div><a href="mailto:Users@ovirt.org"
moz-do-not-send="true">Users(a)ovirt.org</a><br>
</div>
<div><a href="http://lists.ovirt.org/mailman/listinfo/users"
moz-do-not-send="true">http://lists.ovirt.org/mailman/listin...
</div>
</blockquote>
<div><br>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a class="moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
</pre>
</blockquote>
<p><br>
</p>
</body>
</html>
--------------F056D64369AF5E2F70CB62E9--
7:30 p.m.
You where right.
I was able to start it manually but its still doing the same thing after
I try to activate the server it fenced the server and send a reboot...
Here is the status:
https://pastebin.com/xbXX8UBX
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:00 AM, Dafna Ron wrote:
this suggests that libvirt is down.
can you please check libvirtd service status and get the log for it?>
Thanks,
Dafna
On 10/13/2017 04:48 PM, Fernando Fuentes wrote:
> Team,
>
> I went to the log and capture the messages from when the host did the
> update all the way down to the failure.>>
> https://pastebin.com/AwP1gh5g
>
>
> I hope that helps narrowing down the issue....
> Ideas, thoughts, and comments are welcome!
>
> Regards,
>
> --
> Fernando Fuentes
> ffuentes(a)txweather.org
> http://www.txweather.org
>
>
>
> On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:
>> Thanks for your reply.
>>
>> As requested I got this from the messages log:
>>
>> https://pastebin.com/t0HRhvT9
>>
>> This one is from the host engine:
>>
>> https://pastebin.com/8vji6MGs
>>
>> And this one is from the host vdsm:
>>
>> https://pastebin.com/GgnqRvTE
>>
>> The funny part is that right when I did the update it seems that
>> vdsm died and there is no log after the update.>>>
>> On the messages lo you can see the errors and the attempts of me
>> trying to restart manually but it dies.>>>
>> Any ideas?
>>
>>
>> --
>> Fernando Fuentes
>> ffuentes(a)txweather.org
>> http://www.txweather.org
>>
>>
>>
>> On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
>>> can you please provide some logs to the issue?
>>> /var/log/ovirt-engine/engine.log from engine machine and
>>> /var/log/vdsm/vdsm.log from the affected host would be great
start.>>>>
>>> thank you
>>>
>>> On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes
>>> <ffuentes(a)darktcp.net> wrote:>>>>> Hello Team,
>>>>
>>>> I updated one of my host on my cluster and after it finish and
>>>> try to>>>>> activate the host it quickly claimed that the
host was
>>>> unresponsive and>>>>> it fenced the host... Now every time
I try to activate the host it>>>>> clames that is unresponsive and proceeds
to fence it... This
>>>> was not>>>>> happening before the update....
>>>> The host is reachable with no problems nor issues...
>>>>
>>>> Any ideas?
>>>>
>>>> Centos 7.4 x86_64 host.
>>>> Attached is the vdsm log
>>>>
>>>> engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
>>>>
>>>> Regards,
>>>>
>>>> --
>>>> Fernando Fuentes ffuentes(a)txweather.org
http://www.txweather.org>>>>>
_______________________________________________
>>>> Users mailing list
>>>> Users(a)ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>
>>
>> _________________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>
>
>
> _______________________________________________ Users mailing list
> Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users
>>
7:42 p.m.
I am getting this all over the logs:
https://pastebin.com/5Ua5u2ZA
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:30 AM, Fernando Fuentes wrote:
You where right.
I was able to start it manually but its still doing the same thing
after I try to activate the server it fenced the server and send a
reboot... Here is the status:>
https://pastebin.com/xbXX8UBX
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:00 AM, Dafna Ron wrote:
> this suggests that libvirt is down.
> can you please check libvirtd service status and get the log for it?>>
>
> Thanks,
> Dafna
>
> On 10/13/2017 04:48 PM, Fernando Fuentes wrote:
>> Team,
>>
>> I went to the log and capture the messages from when the host did
>> the update all the way down to the failure.>>>
>> https://pastebin.com/AwP1gh5g
>>
>>
>> I hope that helps narrowing down the issue....
>> Ideas, thoughts, and comments are welcome!
>>
>> Regards,
>>
>> --
>> Fernando Fuentes
>> ffuentes(a)txweather.org
>> http://www.txweather.org
>>
>>
>>
>> On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:
>>> Thanks for your reply.
>>>
>>> As requested I got this from the messages log:
>>>
>>> https://pastebin.com/t0HRhvT9
>>>
>>> This one is from the host engine:
>>>
>>> https://pastebin.com/8vji6MGs
>>>
>>> And this one is from the host vdsm:
>>>
>>> https://pastebin.com/GgnqRvTE
>>>
>>> The funny part is that right when I did the update it seems that
>>> vdsm died and there is no log after the update.>>>>
>>> On the messages lo you can see the errors and the attempts of me
>>> trying to restart manually but it dies.>>>>
>>> Any ideas?
>>>
>>>
>>> --
>>> Fernando Fuentes
>>> ffuentes(a)txweather.org
>>> http://www.txweather.org
>>>
>>>
>>>
>>> On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
>>>> can you please provide some logs to the issue?
>>>> /var/log/ovirt-engine/engine.log from engine machine and
>>>> /var/log/vdsm/vdsm.log from the affected host would be great
>>>> start.>>>>>
>>>> thank you
>>>>
>>>> On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes
>>>> <ffuentes(a)darktcp.net> wrote:>>>>>> Hello Team,
>>>>>
>>>>> I updated one of my host on my cluster and after it finish and
>>>>> try to>>>>>> activate the host it quickly claimed
that the host was
>>>>> unresponsive and>>>>>> it fenced the host... Now
every time I try to activate the
>>>>> host it>>>>>> clames that is unresponsive and
proceeds to fence it... This was
>>>>> not>>>>>> happening before the update....
>>>>> The host is reachable with no problems nor issues...
>>>>>
>>>>> Any ideas?
>>>>>
>>>>> Centos 7.4 x86_64 host.
>>>>> Attached is the vdsm log
>>>>>
>>>>> engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
>>>>>
>>>>> Regards,
>>>>>
>>>>> --
>>>>> Fernando Fuentes ffuentes(a)txweather.org
http://www.txweather.org>>>>>>
_______________________________________________
>>>>> Users mailing list
>>>>> Users(a)ovirt.org
>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>
>>>
>>> _________________________________________________
>>> Users mailing list
>>> Users(a)ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/users
>>
>>
>>
>> _______________________________________________ Users mailing list
>> Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users
>>>>
_________________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
7:47 p.m.
Team,
I think I am hitting this bug:
https://gerrit.ovirt.org/#/c/76934/
With that fix libvirtd starts but ovirt still wont bring it online.
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:42 AM, Fernando Fuentes wrote:
I am getting this all over the logs:
https://pastebin.com/5Ua5u2ZA
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:30 AM, Fernando Fuentes wrote:
> You where right.
> I was able to start it manually but its still doing the same thing
> after I try to activate the server it fenced the server and send a
> reboot... Here is the status:>>
> https://pastebin.com/xbXX8UBX
>
>
>
> --
> Fernando Fuentes
> ffuentes(a)txweather.org
> http://www.txweather.org
>
>
>
> On Fri, Oct 13, 2017, at 11:00 AM, Dafna Ron wrote:
>> this suggests that libvirt is down.
>> can you please check libvirtd service status and get the log for it?>>>
>>
>> Thanks,
>> Dafna
>>
>> On 10/13/2017 04:48 PM, Fernando Fuentes wrote:
>>> Team,
>>>
>>> I went to the log and capture the messages from when the host did
>>> the update all the way down to the failure.>>>>
>>> https://pastebin.com/AwP1gh5g
>>>
>>>
>>> I hope that helps narrowing down the issue....
>>> Ideas, thoughts, and comments are welcome!
>>>
>>> Regards,
>>>
>>> --
>>> Fernando Fuentes
>>> ffuentes(a)txweather.org
>>> http://www.txweather.org
>>>
>>>
>>>
>>> On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:
>>>> Thanks for your reply.
>>>>
>>>> As requested I got this from the messages log:
>>>>
>>>> https://pastebin.com/t0HRhvT9
>>>>
>>>> This one is from the host engine:
>>>>
>>>> https://pastebin.com/8vji6MGs
>>>>
>>>> And this one is from the host vdsm:
>>>>
>>>> https://pastebin.com/GgnqRvTE
>>>>
>>>> The funny part is that right when I did the update it seems that
>>>> vdsm died and there is no log after the update.>>>>>
>>>> On the messages lo you can see the errors and the attempts of me
>>>> trying to restart manually but it dies.>>>>>
>>>> Any ideas?
>>>>
>>>>
>>>> --
>>>> Fernando Fuentes
>>>> ffuentes(a)txweather.org
>>>> http://www.txweather.org
>>>>
>>>>
>>>>
>>>> On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
>>>>> can you please provide some logs to the issue?
>>>>> /var/log/ovirt-engine/engine.log from engine machine and
>>>>> /var/log/vdsm/vdsm.log from the affected host would be great
>>>>> start.>>>>>>
>>>>> thank you
>>>>>
>>>>> On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes
>>>>> <ffuentes(a)darktcp.net> wrote:>>>>>>> Hello
Team,
>>>>>>
>>>>>> I updated one of my host on my cluster and after it finish and
>>>>>> try to>>>>>>> activate the host it quickly
claimed that the host was
>>>>>> unresponsive and>>>>>>> it fenced the
host... Now every time I try to activate the host
>>>>>> it>>>>>>> clames that is unresponsive and
proceeds to fence it... This was
>>>>>> not>>>>>>> happening before the update....
>>>>>> The host is reachable with no problems nor issues...
>>>>>>
>>>>>> Any ideas?
>>>>>>
>>>>>> Centos 7.4 x86_64 host.
>>>>>> Attached is the vdsm log
>>>>>>
>>>>>> engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
>>>>>>
>>>>>> Regards,
>>>>>>
>>>>>> --
>>>>>> Fernando Fuentes ffuentes(a)txweather.org
>>>>>> http://www.txweather.org>>>>>>>
_______________________________________________
>>>>>> Users mailing list
>>>>>> Users(a)ovirt.org
>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>
>>>>
>>>> _________________________________________________
>>>> Users mailing list
>>>> Users(a)ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>
>>>
>>>
>>> _______________________________________________ Users mailing list
>>> Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users
>>>>>>
>
> _________________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
_________________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
5:21 p.m.
Any ideas team?
:(
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:47 AM, Fernando Fuentes wrote:
Team,
I think I am hitting this bug:
https://gerrit.ovirt.org/#/c/76934/
With that fix libvirtd starts but ovirt still wont bring it online.
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:42 AM, Fernando Fuentes wrote:
> I am getting this all over the logs:
>
> https://pastebin.com/5Ua5u2ZA
>
> --
> Fernando Fuentes
> ffuentes(a)txweather.org
> http://www.txweather.org
>
>
>
> On Fri, Oct 13, 2017, at 11:30 AM, Fernando Fuentes wrote:
>> You where right.
>> I was able to start it manually but its still doing the same thing
>> after I try to activate the server it fenced the server and send a
>> reboot... Here is the status:>>>
>> https://pastebin.com/xbXX8UBX
>>
>>
>>
>> --
>> Fernando Fuentes
>> ffuentes(a)txweather.org
>> http://www.txweather.org
>>
>>
>>
>> On Fri, Oct 13, 2017, at 11:00 AM, Dafna Ron wrote:
>>> this suggests that libvirt is down.
>>> can you please check libvirtd service status and get the log
>>> for it?>>>>
>>>
>>> Thanks,
>>> Dafna
>>>
>>> On 10/13/2017 04:48 PM, Fernando Fuentes wrote:
>>>> Team,
>>>>
>>>> I went to the log and capture the messages from when the host did
>>>> the update all the way down to the failure.>>>>>
>>>> https://pastebin.com/AwP1gh5g
>>>>
>>>>
>>>> I hope that helps narrowing down the issue....
>>>> Ideas, thoughts, and comments are welcome!
>>>>
>>>> Regards,
>>>>
>>>> --
>>>> Fernando Fuentes
>>>> ffuentes(a)txweather.org
>>>> http://www.txweather.org
>>>>
>>>>
>>>>
>>>> On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:
>>>>> Thanks for your reply.
>>>>>
>>>>> As requested I got this from the messages log:
>>>>>
>>>>> https://pastebin.com/t0HRhvT9
>>>>>
>>>>> This one is from the host engine:
>>>>>
>>>>> https://pastebin.com/8vji6MGs
>>>>>
>>>>> And this one is from the host vdsm:
>>>>>
>>>>> https://pastebin.com/GgnqRvTE
>>>>>
>>>>> The funny part is that right when I did the update it seems that
>>>>> vdsm died and there is no log after the
update.>>>>>>
>>>>> On the messages lo you can see the errors and the attempts of me
>>>>> trying to restart manually but it dies.>>>>>>
>>>>> Any ideas?
>>>>>
>>>>>
>>>>> --
>>>>> Fernando Fuentes
>>>>> ffuentes(a)txweather.org
>>>>> http://www.txweather.org
>>>>>
>>>>>
>>>>>
>>>>> On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
>>>>>> can you please provide some logs to the issue?
>>>>>> /var/log/ovirt-engine/engine.log from engine machine and
>>>>>> /var/log/vdsm/vdsm.log from the affected host would be great
>>>>>> start.>>>>>>>
>>>>>> thank you
>>>>>>
>>>>>> On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes
>>>>>> <ffuentes(a)darktcp.net>
wrote:>>>>>>>> Hello Team,
>>>>>>>
>>>>>>> I updated one of my host on my cluster and after it finish
and
>>>>>>> try to>>>>>>>> activate the host it
quickly claimed that the host was
>>>>>>> unresponsive and>>>>>>>> it fenced
the host... Now every time I try to activate the host
>>>>>>> it>>>>>>>> clames that is
unresponsive and proceeds to fence it... This
>>>>>>> was not>>>>>>>> happening before the
update....
>>>>>>> The host is reachable with no problems nor issues...
>>>>>>>
>>>>>>> Any ideas?
>>>>>>>
>>>>>>> Centos 7.4 x86_64 host.
>>>>>>> Attached is the vdsm log
>>>>>>>
>>>>>>> engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
>>>>>>>
>>>>>>> Regards,
>>>>>>>
>>>>>>> --
>>>>>>> Fernando Fuentes ffuentes(a)txweather.org
>>>>>>> http://www.txweather.org>>>>>>>>
_______________________________________________
>>>>>>> Users mailing list
>>>>>>> Users(a)ovirt.org
>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>
>>>>>
>>>>> _________________________________________________
>>>>> Users mailing list
>>>>> Users(a)ovirt.org
>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>
>>>>
>>>>
>>>> _______________________________________________ Users mailing list
>>>> Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>
>>
>> _________________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>
> _________________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
_________________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
6 p.m.
On Mon, Oct 16, 2017 at 5:21 PM, Fernando Fuentes <ffuentes(a)darktcp.net>
wrote:
Any ideas team?
:(
I suspect if you've applied the workaround for libvirt authentication
change and things still don't work, we'll need to see the relevant logs to
further understand the issue.
Y.
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:47 AM, Fernando Fuentes wrote:
Team,
I think I am hitting this bug:
https://gerrit.ovirt.org/#/c/76934/
With that fix libvirtd starts but ovirt still wont bring it online.
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:42 AM, Fernando Fuentes wrote:
I am getting this all over the logs:
https://pastebin.com/5Ua5u2ZA
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:30 AM, Fernando Fuentes wrote:
You where right.
I was able to start it manually but its still doing the same thing after I
try to activate the server it fenced the server and send a reboot... Here
is the status:
https://pastebin.com/xbXX8UBX
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:00 AM, Dafna Ron wrote:
this suggests that libvirt is down.
can you please check libvirtd service status and get the log for it?
Thanks,
Dafna
On 10/13/2017 04:48 PM, Fernando Fuentes wrote:
Team,
I went to the log and capture the messages from when the host did the
update all the way down to the failure.
https://pastebin.com/AwP1gh5g
I hope that helps narrowing down the issue....
Ideas, thoughts, and comments are welcome!
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:
Thanks for your reply.
As requested I got this from the messages log:
https://pastebin.com/t0HRhvT9
This one is from the host engine:
https://pastebin.com/8vji6MGs
And this one is from the host vdsm:
https://pastebin.com/GgnqRvTE
The funny part is that right when I did the update it seems that vdsm died
and there is no log after the update.
On the messages lo you can see the errors and the attempts of me trying to
restart manually but it dies.
Any ideas?
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
can you please provide some logs to the issue?
/var/log/ovirt-engine/engine.log from engine machine and
/var/log/vdsm/vdsm.log from the affected host would be great start.
thank you
On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes <ffuentes(a)darktcp.net>
wrote:
Hello Team,
I updated one of my host on my cluster and after it finish and try to
activate the host it quickly claimed that the host was unresponsive and
it fenced the host... Now every time I try to activate the host it
clames that is unresponsive and proceeds to fence it... This was not
happening before the update....
The host is reachable with no problems nor issues...
Any ideas?
Centos 7.4 x86_64 host.
Attached is the vdsm log
engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
*_______________________________________________*
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________
Users mailing listUsers@ovirt.orghttp://lists.ovirt.org/mailman/listinfo/users
*_______________________________________________*
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
*_______________________________________________*
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
*_______________________________________________*
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
10:03 p.m.
Thats right.
I am going to collect the data and report back.
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Mon, Oct 16, 2017, at 10:00 AM, Yaniv Kaul wrote:
On Mon, Oct 16, 2017 at 5:21 PM, Fernando Fuentes
<ffuentes(a)darktcp.net> wrote:>> __
> Any ideas team?
> :(
I suspect if you've applied the workaround for libvirt authentication
change and things still don't work, we'll need to see the relevant
logs to further understand the issue.> Y.
>
>
>
>
> --
> Fernando Fuentes
> ffuentes(a)txweather.org
> http://www.txweather.org
>
>
>
>
> On Fri, Oct 13, 2017, at 11:47 AM, Fernando Fuentes wrote:
>> Team,
>>
>> I think I am hitting this bug:
>>
>> https://gerrit.ovirt.org/#/c/76934/
>>
>> With that fix libvirtd starts but ovirt still wont bring it online.>>>
>> --
>> Fernando Fuentes
>> ffuentes(a)txweather.org
>> http://www.txweather.org
>>
>>
>>
>> On Fri, Oct 13, 2017, at 11:42 AM, Fernando Fuentes wrote:
>>> I am getting this all over the logs:
>>>
>>> https://pastebin.com/5Ua5u2ZA
>>>
>>> --
>>> Fernando Fuentes
>>> ffuentes(a)txweather.org
>>> http://www.txweather.org
>>>
>>>
>>>
>>> On Fri, Oct 13, 2017, at 11:30 AM, Fernando Fuentes wrote:
>>>> You where right.
>>>> I was able to start it manually but its still doing the same thing
>>>> after I try to activate the server it fenced the server and send a
>>>> reboot... Here is the status:>>>>>
>>>> https://pastebin.com/xbXX8UBX
>>>>
>>>>
>>>>
>>>> --
>>>> Fernando Fuentes
>>>> ffuentes(a)txweather.org
>>>> http://www.txweather.org
>>>>
>>>>
>>>>
>>>> On Fri, Oct 13, 2017, at 11:00 AM, Dafna Ron wrote:
>>>>> this suggests that libvirt is down.
>>>>> can you please check libvirtd service status and get the log for
>>>>> it?>>>>>>
>>>>>
>>>>> Thanks,
>>>>> Dafna
>>>>>
>>>>> On 10/13/2017 04:48 PM, Fernando Fuentes wrote:
>>>>>> Team,
>>>>>>
>>>>>> I went to the log and capture the messages from when the host
>>>>>> did the update all the way down to the
failure.>>>>>>>
>>>>>> https://pastebin.com/AwP1gh5g
>>>>>>
>>>>>>
>>>>>> I hope that helps narrowing down the issue....
>>>>>> Ideas, thoughts, and comments are welcome!
>>>>>>
>>>>>> Regards,
>>>>>>
>>>>>> --
>>>>>> Fernando Fuentes
>>>>>> ffuentes(a)txweather.org
>>>>>> http://www.txweather.org
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:
>>>>>>> Thanks for your reply.
>>>>>>>
>>>>>>> As requested I got this from the messages log:
>>>>>>>
>>>>>>> https://pastebin.com/t0HRhvT9
>>>>>>>
>>>>>>> This one is from the host engine:
>>>>>>>
>>>>>>> https://pastebin.com/8vji6MGs
>>>>>>>
>>>>>>> And this one is from the host vdsm:
>>>>>>>
>>>>>>> https://pastebin.com/GgnqRvTE
>>>>>>>
>>>>>>> The funny part is that right when I did the update it seems
>>>>>>> that vdsm died and there is no log after the
update.>>>>>>>>
>>>>>>> On the messages lo you can see the errors and the attempts
of
>>>>>>> me trying to restart manually but it
dies.>>>>>>>>
>>>>>>> Any ideas?
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Fernando Fuentes
>>>>>>> ffuentes(a)txweather.org
>>>>>>> http://www.txweather.org
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
>>>>>>>> can you please provide some logs to the issue?
>>>>>>>> /var/log/ovirt-engine/engine.log from engine machine and
>>>>>>>> /var/log/vdsm/vdsm.log from the affected host would be
great
>>>>>>>> start.>>>>>>>>>
>>>>>>>> thank you
>>>>>>>>
>>>>>>>> On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes
>>>>>>>> <ffuentes(a)darktcp.net>
wrote:>>>>>>>>>> Hello Team,
>>>>>>>>>
>>>>>>>>> I updated one of my host on my cluster and after it
finish
>>>>>>>>> and try to>>>>>>>>>>
activate the host it quickly claimed that the host was
>>>>>>>>> unresponsive
and>>>>>>>>>> it fenced the host... Now every time I try to
activate the
>>>>>>>>> host it>>>>>>>>>>
clames that is unresponsive and proceeds to fence it... This
>>>>>>>>> was not>>>>>>>>>>
happening before the update....
>>>>>>>>> The host is reachable with no problems nor issues...
>>>>>>>>>
>>>>>>>>> Any ideas?
>>>>>>>>>
>>>>>>>>> Centos 7.4 x86_64 host.
>>>>>>>>> Attached is the vdsm log
>>>>>>>>>
>>>>>>>>> engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Fernando Fuentes ffuentes(a)txweather.org
>>>>>>>>>
http://www.txweather.org>>>>>>>>>>
_______________________________________________
>>>>>>>>> Users mailing list
>>>>>>>>> Users(a)ovirt.org
>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>>
>>>>>>>
>>>>>>> _________________________________________________
>>>>>>> Users mailing list
>>>>>>> Users(a)ovirt.org
>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________ Users mailing
>>>>>> list Users(a)ovirt.org
>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>>>>>
>>>>
>>>> _________________________________________________
>>>> Users mailing list
>>>> Users(a)ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>
>>> _________________________________________________
>>> Users mailing list
>>> Users(a)ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/users
>>
>> _________________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
8:09 a.m.
Ok I have not collected data yet...
I figure I upgraded my engine to the latest revision of the 4.0 branch
and I did... It actually fix nothing... No matter what I do the hosts
continue to experience the same issue.... Is this a known problem in the
4.0 branch with CentOS7?
I will collect data as soon as I get a chance...
On another note... I was able to bring online a host using the ovirt 4.0
node image, I experience other issues though... I cant seem to migrate
VM's out from the node.... I can migrate VM's in but not out... As if
the node is not compatible with the rest of the hosts which run Centos 7
x86_64... Is this hunch correct? can ovirt node work along side with
Centos7 hosts?
Thoughts and ideas?
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Mon, Oct 16, 2017, at 02:03 PM, Fernando Fuentes wrote:
Thats right.
I am going to collect the data and report back.
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Mon, Oct 16, 2017, at 10:00 AM, Yaniv Kaul wrote:
>
>
> On Mon, Oct 16, 2017 at 5:21 PM, Fernando Fuentes
> <ffuentes(a)darktcp.net> wrote:>>> __
>> Any ideas team?
>> :(
>
> I suspect if you've applied the workaround for libvirt authentication
> change and things still don't work, we'll need to see the relevant
> logs to further understand the issue.>> Y.
>
>>
>>
>>
>>
>> --
>> Fernando Fuentes
>> ffuentes(a)txweather.org
>> http://www.txweather.org
>>
>>
>>
>>
>> On Fri, Oct 13, 2017, at 11:47 AM, Fernando Fuentes wrote:
>>> Team,
>>>
>>> I think I am hitting this bug:
>>>
>>> https://gerrit.ovirt.org/#/c/76934/
>>>
>>> With that fix libvirtd starts but ovirt still wont bring it
online.>>>>
>>> --
>>> Fernando Fuentes
>>> ffuentes(a)txweather.org
>>> http://www.txweather.org
>>>
>>>
>>>
>>> On Fri, Oct 13, 2017, at 11:42 AM, Fernando Fuentes wrote:
>>>> I am getting this all over the logs:
>>>>
>>>> https://pastebin.com/5Ua5u2ZA
>>>>
>>>> --
>>>> Fernando Fuentes
>>>> ffuentes(a)txweather.org
>>>> http://www.txweather.org
>>>>
>>>>
>>>>
>>>> On Fri, Oct 13, 2017, at 11:30 AM, Fernando Fuentes wrote:
>>>>> You where right.
>>>>> I was able to start it manually but its still doing the same
>>>>> thing after I try to activate the server it fenced the server and
>>>>> send a reboot... Here is the status:>>>>>>
>>>>> https://pastebin.com/xbXX8UBX
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Fernando Fuentes
>>>>> ffuentes(a)txweather.org
>>>>> http://www.txweather.org
>>>>>
>>>>>
>>>>>
>>>>> On Fri, Oct 13, 2017, at 11:00 AM, Dafna Ron wrote:
>>>>>> this suggests that libvirt is down.
>>>>>> can you please check libvirtd service status and get the log for
>>>>>> it?>>>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>> Dafna
>>>>>>
>>>>>> On 10/13/2017 04:48 PM, Fernando Fuentes wrote:
>>>>>>> Team,
>>>>>>>
>>>>>>> I went to the log and capture the messages from when the
host
>>>>>>> did the update all the way down to the
failure.>>>>>>>>
>>>>>>> https://pastebin.com/AwP1gh5g
>>>>>>>
>>>>>>>
>>>>>>> I hope that helps narrowing down the issue....
>>>>>>> Ideas, thoughts, and comments are welcome!
>>>>>>>
>>>>>>> Regards,
>>>>>>>
>>>>>>> --
>>>>>>> Fernando Fuentes
>>>>>>> ffuentes(a)txweather.org
>>>>>>> http://www.txweather.org
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:
>>>>>>>> Thanks for your reply.
>>>>>>>>
>>>>>>>> As requested I got this from the messages log:
>>>>>>>>
>>>>>>>> https://pastebin.com/t0HRhvT9
>>>>>>>>
>>>>>>>> This one is from the host engine:
>>>>>>>>
>>>>>>>> https://pastebin.com/8vji6MGs
>>>>>>>>
>>>>>>>> And this one is from the host vdsm:
>>>>>>>>
>>>>>>>> https://pastebin.com/GgnqRvTE
>>>>>>>>
>>>>>>>> The funny part is that right when I did the update it
seems
>>>>>>>> that vdsm died and there is no log after the
update.>>>>>>>>>
>>>>>>>> On the messages lo you can see the errors and the
attempts of
>>>>>>>> me trying to restart manually but it
dies.>>>>>>>>>
>>>>>>>> Any ideas?
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Fernando Fuentes
>>>>>>>> ffuentes(a)txweather.org
>>>>>>>> http://www.txweather.org
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
>>>>>>>>> can you please provide some logs to the issue?
>>>>>>>>> /var/log/ovirt-engine/engine.log from engine machine
and
>>>>>>>>> /var/log/vdsm/vdsm.log from the affected host would
be great
>>>>>>>>> start.>>>>>>>>>>
>>>>>>>>> thank you
>>>>>>>>>
>>>>>>>>> On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes
>>>>>>>>> <ffuentes(a)darktcp.net>
wrote:>>>>>>>>>>> Hello Team,
>>>>>>>>>>
>>>>>>>>>> I updated one of my host on my cluster and after
it finish
>>>>>>>>>> and try
to>>>>>>>>>>> activate the host it quickly claimed that
the host was
>>>>>>>>>> unresponsive
and>>>>>>>>>>> it fenced the host... Now every time I try
to activate the
>>>>>>>>>> host
it>>>>>>>>>>> clames that is unresponsive and proceeds to
fence it... This
>>>>>>>>>> was
not>>>>>>>>>>> happening before the update....
>>>>>>>>>> The host is reachable with no problems nor
issues...
>>>>>>>>>>
>>>>>>>>>> Any ideas?
>>>>>>>>>>
>>>>>>>>>> Centos 7.4 x86_64 host.
>>>>>>>>>> Attached is the vdsm log
>>>>>>>>>>
>>>>>>>>>> engine is oVirt Engine Version:
4.0.2.6-1.el7.centos
>>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Fernando Fuentes ffuentes(a)txweather.org
>>>>>>>>>>
http://www.txweather.org>>>>>>>>>>>
_______________________________________________
>>>>>>>>>> Users mailing list
>>>>>>>>>> Users(a)ovirt.org
>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>>>
>>>>>>>>
>>>>>>>> _________________________________________________
>>>>>>>> Users mailing list
>>>>>>>> Users(a)ovirt.org
>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________ Users
mailing
>>>>>>> list Users(a)ovirt.org
>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>>>>>>>
>>>>>
>>>>> _________________________________________________
>>>>> Users mailing list
>>>>> Users(a)ovirt.org
>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>
>>>> _________________________________________________
>>>> Users mailing list
>>>> Users(a)ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>
>>> _________________________________________________
>>> Users mailing list
>>> Users(a)ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/users
>>
>> _______________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
_________________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
9:52 a.m.
On Wed, Oct 18, 2017 at 8:09 AM, Fernando Fuentes <ffuentes(a)darktcp.net>
wrote:
Ok I have not collected data yet...
I figure I upgraded my engine to the latest revision of the 4.0 branch and
I did... It actually fix nothing... No matter what I do the hosts continue
to experience the same issue.... Is this a known problem in the 4.0 branch
with CentOS7?
The latest revision of 4.x is 4.1.6. There's no '4.0 branch' really, once
4.1 was released, and I warmly advise you to upgrade to latest 4.1.
I will collect data as soon as I get a chance...
On another note... I was able to bring online a host using the ovirt 4.0
node image, I experience other issues though... I cant seem to migrate VM's
out from the node.... I can migrate VM's in but not out... As if the node
is not compatible with the rest of the hosts which run Centos 7 x86_64...
Is this hunch correct? can ovirt node work along side with Centos7 hosts?
A separate email thread is preferred, but I assume you have connectivity
issues on that node, DNS or routing issues.
Yes, a node can work alongside a regular host.
Y.
Thoughts and ideas?
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Mon, Oct 16, 2017, at 02:03 PM, Fernando Fuentes wrote:
Thats right.
I am going to collect the data and report back.
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Mon, Oct 16, 2017, at 10:00 AM, Yaniv Kaul wrote:
On Mon, Oct 16, 2017 at 5:21 PM, Fernando Fuentes <ffuentes(a)darktcp.net>
wrote:
Any ideas team?
:(
I suspect if you've applied the workaround for libvirt authentication
change and things still don't work, we'll need to see the relevant logs to
further understand the issue.
Y.
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:47 AM, Fernando Fuentes wrote:
Team,
I think I am hitting this bug:
https://gerrit.ovirt.org/#/c/76934/
With that fix libvirtd starts but ovirt still wont bring it online.
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:42 AM, Fernando Fuentes wrote:
I am getting this all over the logs:
https://pastebin.com/5Ua5u2ZA
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:30 AM, Fernando Fuentes wrote:
You where right.
I was able to start it manually but its still doing the same thing after I
try to activate the server it fenced the server and send a reboot... Here
is the status:
https://pastebin.com/xbXX8UBX
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 11:00 AM, Dafna Ron wrote:
this suggests that libvirt is down.
can you please check libvirtd service status and get the log for it?
Thanks,
Dafna
On 10/13/2017 04:48 PM, Fernando Fuentes wrote:
Team,
I went to the log and capture the messages from when the host did the
update all the way down to the failure.
https://pastebin.com/AwP1gh5g
I hope that helps narrowing down the issue....
Ideas, thoughts, and comments are welcome!
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes wrote:
Thanks for your reply.
As requested I got this from the messages log:
https://pastebin.com/t0HRhvT9
This one is from the host engine:
https://pastebin.com/8vji6MGs
And this one is from the host vdsm:
https://pastebin.com/GgnqRvTE
The funny part is that right when I did the update it seems that vdsm died
and there is no log after the update.
On the messages lo you can see the errors and the attempts of me trying to
restart manually but it dies.
Any ideas?
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek wrote:
can you please provide some logs to the issue?
/var/log/ovirt-engine/engine.log from engine machine and
/var/log/vdsm/vdsm.log from the affected host would be great start.
thank you
On Fri, Oct 13, 2017 at 2:47 AM, Fernando Fuentes <ffuentes(a)darktcp.net>
wrote:
Hello Team,
I updated one of my host on my cluster and after it finish and try to
activate the host it quickly claimed that the host was unresponsive and
it fenced the host... Now every time I try to activate the host it
clames that is unresponsive and proceeds to fence it... This was not
happening before the update....
The host is reachable with no problems nor issues...
Any ideas?
Centos 7.4 x86_64 host.
Attached is the vdsm log
engine is oVirt Engine Version: 4.0.2.6-1.el7.centos
Regards,
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
*_______________________________________________*
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________
Users mailing listUsers@ovirt.orghttp://lists.ovirt.org/mailman/listinfo/users
*_______________________________________________*
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
*_______________________________________________*
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
*_______________________________________________*
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
*_______________________________________________*
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
3:18 p.m.
Yaniv,
Thanks for your reply. I understand and I will upgrade... I am just
stuck on 4.0.x for a few more days and figured I can solve this issue
but it is obvious something is really wrong with this "old" version.
--
Fernando Fuentes
ffuentes(a)txweather.org
http://www.txweather.org
On Wed, Oct 18, 2017, at 01:52 AM, Yaniv Kaul wrote:
On Wed, Oct 18, 2017 at 8:09 AM, Fernando Fuentes
<ffuentes(a)darktcp.net> wrote:>> __
> Ok I have not collected data yet...
> I figure I upgraded my engine to the latest revision of the 4.0
> branch and I did... It actually fix nothing... No matter what I do
> the hosts continue to experience the same issue.... Is this a known
> problem in the 4.0 branch with CentOS7?>
The latest revision of 4.x is 4.1.6. There's no '4.0 branch'
really, once 4.1 was released, and I warmly advise you to upgrade
to latest 4.1.>
>
>
> I will collect data as soon as I get a chance...
>
> On another note... I was able to bring online a host using the ovirt
> 4.0 node image, I experience other issues though... I cant seem to
> migrate VM's out from the node.... I can migrate VM's in but not
> out... As if the node is not compatible with the rest of the hosts
> which run Centos 7 x86_64... Is this hunch correct? can ovirt node
> work along side with Centos7 hosts?>
A separate email thread is preferred, but I assume you have
connectivity issues on that node, DNS or routing issues.>
Yes, a node can work alongside a regular host.
Y.
>
>
> Thoughts and ideas?
>
>
> Regards,
>
> --
> Fernando Fuentes
> ffuentes(a)txweather.org
> http://www.txweather.org
>
>
>
>
> On Mon, Oct 16, 2017, at 02:03 PM, Fernando Fuentes wrote:
>> Thats right.
>> I am going to collect the data and report back.
>>
>> Regards,
>>
>>
>> --
>> Fernando Fuentes
>> ffuentes(a)txweather.org
>> http://www.txweather.org
>>
>>
>>
>> On Mon, Oct 16, 2017, at 10:00 AM, Yaniv Kaul wrote:
>>>
>>>
>>> On Mon, Oct 16, 2017 at 5:21 PM, Fernando Fuentes
>>> <ffuentes(a)darktcp.net> wrote:>>>>> __
>>>> Any ideas team?
>>>> :(
>>>
>>> I suspect if you've applied the workaround for libvirt
>>> authentication change and things still don't work, we'll need to
>>> see the relevant logs to further understand the issue.>>>> Y.
>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Fernando Fuentes
>>>> ffuentes(a)txweather.org
>>>> http://www.txweather.org
>>>>
>>>>
>>>>
>>>>
>>>> On Fri, Oct 13, 2017, at 11:47 AM, Fernando Fuentes wrote:
>>>>> Team,
>>>>>
>>>>> I think I am hitting this bug:
>>>>>
>>>>> https://gerrit.ovirt.org/#/c/76934/
>>>>>
>>>>> With that fix libvirtd starts but ovirt still wont bring it
>>>>> online.>>>>>>
>>>>> --
>>>>> Fernando Fuentes
>>>>> ffuentes(a)txweather.org
>>>>> http://www.txweather.org
>>>>>
>>>>>
>>>>>
>>>>> On Fri, Oct 13, 2017, at 11:42 AM, Fernando Fuentes wrote:
>>>>>> I am getting this all over the logs:
>>>>>>
>>>>>> https://pastebin.com/5Ua5u2ZA
>>>>>>
>>>>>> --
>>>>>> Fernando Fuentes
>>>>>> ffuentes(a)txweather.org
>>>>>> http://www.txweather.org
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Fri, Oct 13, 2017, at 11:30 AM, Fernando Fuentes wrote:
>>>>>>> You where right.
>>>>>>> I was able to start it manually but its still doing the same
>>>>>>> thing after I try to activate the server it fenced the
server
>>>>>>> and send a reboot... Here is the
status:>>>>>>>>
>>>>>>> https://pastebin.com/xbXX8UBX
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Fernando Fuentes
>>>>>>> ffuentes(a)txweather.org
>>>>>>> http://www.txweather.org
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Oct 13, 2017, at 11:00 AM, Dafna Ron wrote:
>>>>>>>> this suggests that libvirt is down.
>>>>>>>> can you please check libvirtd service status and get the
log
>>>>>>>> for it?>>>>>>>>>
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Dafna
>>>>>>>>
>>>>>>>> On 10/13/2017 04:48 PM, Fernando Fuentes wrote:
>>>>>>>>> Team,
>>>>>>>>>
>>>>>>>>> I went to the log and capture the messages from when
the host
>>>>>>>>> did the update all the way down to the
failure.>>>>>>>>>>
>>>>>>>>> https://pastebin.com/AwP1gh5g
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> I hope that helps narrowing down the issue....
>>>>>>>>> Ideas, thoughts, and comments are welcome!
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Fernando Fuentes
>>>>>>>>> ffuentes(a)txweather.org
>>>>>>>>> http://www.txweather.org
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Fri, Oct 13, 2017, at 10:03 AM, Fernando Fuentes
wrote:
>>>>>>>>>> Thanks for your reply.
>>>>>>>>>>
>>>>>>>>>> As requested I got this from the messages log:
>>>>>>>>>>
>>>>>>>>>> https://pastebin.com/t0HRhvT9
>>>>>>>>>>
>>>>>>>>>> This one is from the host engine:
>>>>>>>>>>
>>>>>>>>>> https://pastebin.com/8vji6MGs
>>>>>>>>>>
>>>>>>>>>> And this one is from the host vdsm:
>>>>>>>>>>
>>>>>>>>>> https://pastebin.com/GgnqRvTE
>>>>>>>>>>
>>>>>>>>>> The funny part is that right when I did the
update it seems
>>>>>>>>>> that vdsm died and there is no log after the
update.>>>>>>>>>>>
>>>>>>>>>> On the messages lo you can see the errors and the
attempts
>>>>>>>>>> of me trying to restart manually but it
dies.>>>>>>>>>>>
>>>>>>>>>> Any ideas?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Fernando Fuentes
>>>>>>>>>> ffuentes(a)txweather.org
>>>>>>>>>> http://www.txweather.org
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Fri, Oct 13, 2017, at 01:42 AM, Tomas Jelinek
wrote:
>>>>>>>>>>> can you please provide some logs to the
issue?
>>>>>>>>>>> /var/log/ovirt-engine/engine.log from engine
machine and
>>>>>>>>>>> /var/log/vdsm/vdsm.log from the affected host
would be
>>>>>>>>>>> great
start.>>>>>>>>>>>>
>>>>>>>>>>> thank you
>>>>>>>>>>>
>>>>>>>>>>> On Fri, Oct 13, 2017 at 2:47 AM, Fernando
Fuentes
>>>>>>>>>>> <ffuentes(a)darktcp.net>
wrote:>>>>>>>>>>>>> Hello Team,
>>>>>>>>>>>>
>>>>>>>>>>>> I updated one of my host on my cluster
and after it finish
>>>>>>>>>>>> and try
to>>>>>>>>>>>>> activate the host it quickly
claimed that the host was
>>>>>>>>>>>> unresponsive
and>>>>>>>>>>>>> it fenced the host... Now every
time I try to activate the
>>>>>>>>>>>> host
it>>>>>>>>>>>>> clames that is unresponsive and
proceeds to fence it...
>>>>>>>>>>>> This was
not>>>>>>>>>>>>> happening before the update....
>>>>>>>>>>>> The host is reachable with no problems
nor issues...
>>>>>>>>>>>>
>>>>>>>>>>>> Any ideas?
>>>>>>>>>>>>
>>>>>>>>>>>> Centos 7.4 x86_64 host.
>>>>>>>>>>>> Attached is the vdsm log
>>>>>>>>>>>>
>>>>>>>>>>>> engine is oVirt Engine Version:
4.0.2.6-1.el7.centos
>>>>>>>>>>>>
>>>>>>>>>>>> Regards,
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Fernando Fuentes ffuentes(a)txweather.org
>>>>>>>>>>>>
http://www.txweather.org>>>>>>>>>>>>>
_______________________________________________
>>>>>>>>>>>> Users mailing list
>>>>>>>>>>>> Users(a)ovirt.org
>>>>>>>>>>>>
http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
_________________________________________________
>>>>>>>>>> Users mailing list
>>>>>>>>>> Users(a)ovirt.org
>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> _______________________________________________ Users
mailing
>>>>>>>>> list Users(a)ovirt.org
>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>>>>>>>>>>>
>>>>>>>
>>>>>>> _________________________________________________
>>>>>>> Users mailing list
>>>>>>> Users(a)ovirt.org
>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>
>>>>>> _________________________________________________
>>>>>> Users mailing list
>>>>>> Users(a)ovirt.org
>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>
>>>>> _________________________________________________
>>>>> Users mailing list
>>>>> Users(a)ovirt.org
>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users(a)ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>
>>
>> _________________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
2592
days inactive
2597
days old
13 comments
4 participants
participants (4)
-
Dafna Ron -
Fernando Fuentes -
Tomas Jelinek -
Yaniv Kaul