<div dir="ltr">Hi,<div><br></div><div>I am afraid we do not have logs that would go that deep into the stack. DNS resolution issues will definitely affect both the notification system (if not using localhost smtp) and the engine status checks (because we use the fqdn).</div><div><br></div><div>Best regards</div><div><br></div><div>Martin</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Dec 13, 2017 at 3:15 PM, Luca 'remix_tj' Lorenzetto <span dir="ltr"><<a href="mailto:lorenzetto.luca@gmail.com" target="_blank">lorenzetto.luca@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello,<div><br></div><div>Today i started troubleshooting more in depth on dns requests and exactly while i was looking at tcpdump an event of EngineUp -> EngineBadHealth happened.</div><div><br></div><div>Looking at the dns requests i see this:</div><div><br></div><div>[...]</div><div><div>14:30:35.909201 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>55654 > dns.company.it.53: 34102+ A? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:30:35.909215 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>55654 > dns.company.it.53: 6242+ AAAA? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:30:40.914285 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>55654 > dns.company.it.53: 34102+ A? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:30:40.914316 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>55654 > dns.company.it.53: 6242+ AAAA? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:30:45.918306 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>54885 > dns.company.it.53: 60263+ A? <a href="http://engine01.intranet.company.it.intranet.company.it" target="_blank">engine01.intranet.company.it.<wbr>intranet.company.it</a>. (74)</div><div>14:30:45.918329 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>54885 > dns.company.it.53: 18681+ AAAA? <a href="http://engine01.intranet.company.it.intranet.company.it" target="_blank">engine01.intranet.company.it.<wbr>intranet.company.it</a>. (74)</div><div>14:30:50.920376 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>54885 > dns.company.it.53: 60263+ A? <a href="http://engine01.intranet.company.it.intranet.company.it" target="_blank">engine01.intranet.company.it.<wbr>intranet.company.it</a>. (74)</div><div>14:30:50.920411 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>54885 > dns.company.it.53: 18681+ AAAA? <a href="http://engine01.intranet.company.it.intranet.company.it" target="_blank">engine01.intranet.company.it.<wbr>intranet.company.it</a>. (74)</div><div>14:30:56.044242 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>58319 > dns.company.it.53: 28413+ A? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:30:56.044267 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>58319 > dns.company.it.53: 29680+ AAAA? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:31:01.049761 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>58319 > dns.company.it.53: 28413+ A? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:31:01.049777 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>58319 > dns.company.it.53: 29680+ AAAA? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:31:06.052635 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>58093 > dns.company.it.53: 24807+ A? <a href="http://engine01.intranet.company.it.intranet.company.it" target="_blank">engine01.intranet.company.it.<wbr>intranet.company.it</a>. (74)</div><div>14:31:06.052649 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>58093 > dns.company.it.53: 53745+ AAAA? <a href="http://engine01.intranet.company.it.intranet.company.it" target="_blank">engine01.intranet.company.it.<wbr>intranet.company.it</a>. (74)</div><div>14:31:11.057724 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>58093 > dns.company.it.53: 24807+ A? <a href="http://engine01.intranet.company.it.intranet.company.it" target="_blank">engine01.intranet.company.it.<wbr>intranet.company.it</a>. (74)</div><div>14:31:11.057745 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>58093 > dns.company.it.53: 53745+ AAAA? <a href="http://engine01.intranet.company.it.intranet.company.it" target="_blank">engine01.intranet.company.it.<wbr>intranet.company.it</a>. (74)</div><div>14:31:16.175204 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>44950 > dns.company.it.53: 63680+ A? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:31:16.175225 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>44950 > dns.company.it.53: 15726+ AAAA? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:31:19.670746 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>54689 > dns.company.it.53: 40999+ A? <a href="http://kvmsvilca01.intranet.company.it" target="_blank">kvmsvilca01.intranet.company.<wbr>it</a>. (49)</div><div>14:31:21.180295 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>44950 > dns.company.it.53: 63680+ A? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:31:21.180337 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>44950 > dns.company.it.53: 15726+ AAAA? <a href="http://engine01.intranet.company.it" target="_blank">engine01.intranet.company.it</a>. (54)</div><div>14:31:23.771959 IP <a href="http://kvmhost01.intranet.company.it">kvmhost01.intranet.company.it</a>.<wbr>53741 > dns.company.it.53: 1707+ A? <a href="http://internalmx.intranet.company.it" target="_blank">internalmx.intranet.company.it</a><wbr>. (48)</div></div><div>[...]</div><div><br></div><div>The last dns requests has success and gets the MX address and immediately after i get the email reporting the status change.</div><div><br></div><div>This is clearly an issue with name resolution, but that's not clear to me from the broker.log file. The only message about it that i get is:</div><div><br></div><div><div>Thread-16::DEBUG::2017-12-13 14:31:23,657::monitor::126::<wbr>ovirt_hosted_engine_ha.broker.<wbr>monitor.Monitor::(get_value) Submonitor engine-health id 139653</div><div>412040592 current value: {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "up"}</div><div>Thread-16::DEBUG::2017-12-13 14:31:23,657::listener::170::<wbr>ovirt_hosted_engine_ha.broker.<wbr>listener.ConnectionHandler::(<wbr>handle) Response: success {"reaso</div><div>n": "failed liveliness check", "health": "bad", "vm": "up", "detail": "up"}</div></div><div><br></div><div><br></div><div>But around that messages i get no signals of error on dns queries or similar. Do i need to check on other log files?</div><span class="HOEnZb"><font color="#888888"><div><br></div><div>Luca</div><div><br></div></font></span><div class="gmail_extra"><span class=""><br><div class="gmail_quote">On Mon, Dec 11, 2017 at 3:34 PM, Luca 'remix_tj' Lorenzetto <span dir="ltr"><<a href="mailto:lorenzetto.luca@gmail.com" target="_blank">lorenzetto.luca@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Martin, Hi all,<div><br></div><div>*some minutes* has passed and i've the piece of log i'm looking at.</div><div><br></div><div><br><div class="gmail_chip gmail_drive_chip" style="width:396px;height:18px;max-height:18px;background-color:rgb(245,245,245);padding:5px;color:rgb(34,34,34);font-family:arial;font-style:normal;font-weight:bold;font-size:13px;border:1px solid rgb(221,221,221);line-height:1"><a href="https://drive.google.com/file/d/1wlWZPuhgtJRBWt4xUZC-Jis8vLWM1jYD/view?usp=drive_web" style="display:inline-block;overflow:hidden;text-overflow:ellipsis;white-space:nowrap;text-decoration:none;padding:1px 0px;border:none;width:100%" target="_blank"><img style="vertical-align:bottom;border:none" src="https://ssl.gstatic.com/docs/doclist/images/icon_10_generic_list.png"> <span dir="ltr" style="color:rgb(17,85,204);text-decoration:none;vertical-align:bottom">broker.log-upbadup</span></a></div><br></div><div><br></div></div></blockquote><div><br></div><div> </div></div><div><br></div></span><span class="">-- <br><div class="m_2627815932095133212gmail_signature">"E' assurdo impiegare gli uomini di intelligenza eccellente per fare<br>calcoli che potrebbero essere affidati a chiunque se si usassero delle<br>macchine"<br>Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716)<br><br>"Internet è la più grande biblioteca del mondo.<br>Ma il problema è che i libri sono tutti sparsi sul pavimento"<br>John Allen Paulos, Matematico (1945-vivente)<br> <br>Luca 'remix_tj' Lorenzetto, <a href="http://www.remixtj.net" target="_blank">http://www.remixtj.net</a> , <<a href="mailto:lorenzetto.luca@gmail.com" target="_blank">lorenzetto.luca@gmail.com</a>></div>
</span></div></div>
</blockquote></div><br></div>