<div dir="ltr">Hello,<div><br></div><div>Today i started troubleshooting more in depth on dns requests and exactly while i was looking at tcpdump an event of EngineUp -> EngineBadHealth happened.</div><div><br></div><div>Looking at the dns requests i see this:</div><div><br></div><div>[...]</div><div><div>14:30:35.909201 IP kvmhost01.intranet.company.it.55654 > dns.company.it.53: 34102+ A? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:30:35.909215 IP kvmhost01.intranet.company.it.55654 > dns.company.it.53: 6242+ AAAA? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:30:40.914285 IP kvmhost01.intranet.company.it.55654 > dns.company.it.53: 34102+ A? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:30:40.914316 IP kvmhost01.intranet.company.it.55654 > dns.company.it.53: 6242+ AAAA? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:30:45.918306 IP kvmhost01.intranet.company.it.54885 > dns.company.it.53: 60263+ A? <a href="http://engine01.intranet.company.it.intranet.company.it">engine01.intranet.company.it.intranet.company.it</a>. (74)</div><div>14:30:45.918329 IP kvmhost01.intranet.company.it.54885 > dns.company.it.53: 18681+ AAAA? <a href="http://engine01.intranet.company.it.intranet.company.it">engine01.intranet.company.it.intranet.company.it</a>. (74)</div><div>14:30:50.920376 IP kvmhost01.intranet.company.it.54885 > dns.company.it.53: 60263+ A? <a href="http://engine01.intranet.company.it.intranet.company.it">engine01.intranet.company.it.intranet.company.it</a>. (74)</div><div>14:30:50.920411 IP kvmhost01.intranet.company.it.54885 > dns.company.it.53: 18681+ AAAA? <a href="http://engine01.intranet.company.it.intranet.company.it">engine01.intranet.company.it.intranet.company.it</a>. (74)</div><div>14:30:56.044242 IP kvmhost01.intranet.company.it.58319 > dns.company.it.53: 28413+ A? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:30:56.044267 IP kvmhost01.intranet.company.it.58319 > dns.company.it.53: 29680+ AAAA? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:31:01.049761 IP kvmhost01.intranet.company.it.58319 > dns.company.it.53: 28413+ A? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:31:01.049777 IP kvmhost01.intranet.company.it.58319 > dns.company.it.53: 29680+ AAAA? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:31:06.052635 IP kvmhost01.intranet.company.it.58093 > dns.company.it.53: 24807+ A? <a href="http://engine01.intranet.company.it.intranet.company.it">engine01.intranet.company.it.intranet.company.it</a>. (74)</div><div>14:31:06.052649 IP kvmhost01.intranet.company.it.58093 > dns.company.it.53: 53745+ AAAA? <a href="http://engine01.intranet.company.it.intranet.company.it">engine01.intranet.company.it.intranet.company.it</a>. (74)</div><div>14:31:11.057724 IP kvmhost01.intranet.company.it.58093 > dns.company.it.53: 24807+ A? <a href="http://engine01.intranet.company.it.intranet.company.it">engine01.intranet.company.it.intranet.company.it</a>. (74)</div><div>14:31:11.057745 IP kvmhost01.intranet.company.it.58093 > dns.company.it.53: 53745+ AAAA? <a href="http://engine01.intranet.company.it.intranet.company.it">engine01.intranet.company.it.intranet.company.it</a>. (74)</div><div>14:31:16.175204 IP kvmhost01.intranet.company.it.44950 > dns.company.it.53: 63680+ A? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:31:16.175225 IP kvmhost01.intranet.company.it.44950 > dns.company.it.53: 15726+ AAAA? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:31:19.670746 IP kvmhost01.intranet.company.it.54689 > dns.company.it.53: 40999+ A? <a href="http://kvmsvilca01.intranet.company.it">kvmsvilca01.intranet.company.it</a>. (49)</div><div>14:31:21.180295 IP kvmhost01.intranet.company.it.44950 > dns.company.it.53: 63680+ A? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:31:21.180337 IP kvmhost01.intranet.company.it.44950 > dns.company.it.53: 15726+ AAAA? <a href="http://engine01.intranet.company.it">engine01.intranet.company.it</a>. (54)</div><div>14:31:23.771959 IP kvmhost01.intranet.company.it.53741 > dns.company.it.53: 1707+ A? <a href="http://internalmx.intranet.company.it">internalmx.intranet.company.it</a>. (48)</div></div><div>[...]</div><div><br></div><div>The last dns requests has success and gets the MX address and immediately after i get the email reporting the status change.</div><div><br></div><div>This is clearly an issue with name resolution, but that's not clear to me from the broker.log file. The only message about it that i get is:</div><div><br></div><div><div>Thread-16::DEBUG::2017-12-13 14:31:23,657::monitor::126::ovirt_hosted_engine_ha.broker.monitor.Monitor::(get_value) Submonitor engine-health id 139653</div><div>412040592 current value: {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "up"}</div><div>Thread-16::DEBUG::2017-12-13 14:31:23,657::listener::170::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Response: success {"reaso</div><div>n": "failed liveliness check", "health": "bad", "vm": "up", "detail": "up"}</div></div><div><br></div><div><br></div><div>But around that messages i get no signals of error on dns queries or similar. Do i need to check on other log files?</div><div><br></div><div>Luca</div><div><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Dec 11, 2017 at 3:34 PM, Luca 'remix_tj' Lorenzetto <span dir="ltr"><<a href="mailto:lorenzetto.luca@gmail.com" target="_blank">lorenzetto.luca@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Martin, Hi all,<div><br></div><div>*some minutes* has passed and i've the piece of log i'm looking at.</div><div><br></div><div><br><div class="gmail_chip gmail_drive_chip" style="width:396px;height:18px;max-height:18px;background-color:rgb(245,245,245);padding:5px;color:rgb(34,34,34);font-family:arial;font-style:normal;font-weight:bold;font-size:13px;border:1px solid rgb(221,221,221);line-height:1"><a href="https://drive.google.com/file/d/1wlWZPuhgtJRBWt4xUZC-Jis8vLWM1jYD/view?usp=drive_web" style="display:inline-block;overflow:hidden;text-overflow:ellipsis;white-space:nowrap;text-decoration:none;padding:1px 0px;border:none;width:100%" target="_blank"><img style="vertical-align: bottom; border: none;" src="https://ssl.gstatic.com/docs/doclist/images/icon_10_generic_list.png"> <span dir="ltr" style="color:rgb(17,85,204);text-decoration:none;vertical-align:bottom">broker.log-upbadup</span></a></div><br></div><div><br></div></div></blockquote><div><br></div><div> </div></div><div><br></div>-- <br><div class="gmail_signature">"E' assurdo impiegare gli uomini di intelligenza eccellente per fare<br>calcoli che potrebbero essere affidati a chiunque se si usassero delle<br>macchine"<br>Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716)<br><br>"Internet è la più grande biblioteca del mondo.<br>Ma il problema è che i libri sono tutti sparsi sul pavimento"<br>John Allen Paulos, Matematico (1945-vivente)<br> <br>Luca 'remix_tj' Lorenzetto, <a href="http://www.remixtj.net" target="_blank">http://www.remixtj.net</a> , <<a href="mailto:lorenzetto.luca@gmail.com" target="_blank">lorenzetto.luca@gmail.com</a>></div>
</div></div>