<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html;
      charset=windows-1252">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <p>Hi,</p>
    <p>Thanks a lot for having a look.<br>
    </p>
    <p>HA VMs were migrated, non HA vms were turned off, syslogs were
      not saying anything useful, dmesg reported graceful reboot.</p>
    <p>What errors are indicating? may be there is a useful hint to
      proceed in investigation?</p>
    <p>Thanks in advance again</p>
    <p>Cheers</p>
    <p>Erekle<br>
    </p>
    <br>
    <div class="moz-cite-prefix">On 02/23/2018 06:15 PM, Mahdi Adnan
      wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:DM5PR01MB2506CA22D55C58A5210C6EA6FFCC0@DM5PR01MB2506.prod.exchangelabs.com">
      <meta http-equiv="Content-Type" content="text/html;
        charset=windows-1252">
      <style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
      <div style="font-family: Calibri, Helvetica, sans-serif;
        font-size: 12pt; color: rgb(0, 0, 0); background-color: rgba(0,
        0, 0, 0);">
        Hi,</div>
      <div style="font-family: Calibri, Helvetica, sans-serif;
        font-size: 12pt; color: rgb(0, 0, 0); background-color: rgba(0,
        0, 0, 0);">
        <br>
      </div>
      <div style="font-family: Calibri, Helvetica, sans-serif;
        font-size: 12pt; color: rgb(0, 0, 0); background-color: rgba(0,
        0, 0, 0);">
        The log does't indicate HV reboot, and i see lots of errors in
        the logs.</div>
      <div style="font-family: Calibri, Helvetica, sans-serif;
        font-size: 12pt; color: rgb(0, 0, 0); background-color: rgba(0,
        0, 0, 0);">
        During the reboot, what happened to the VM inside of the HV ?
        migrated ? paused ? what about the system's logs ? does it
        indicate a graceful shutdown ?</div>
      <div style="font-family: Calibri, Helvetica, sans-serif;
        font-size: 12pt; color: rgb(0, 0, 0);">
        <br>
      </div>
      <div id="signature"><br>
        <div class="ecxmoz-signature">-- <br>
          <br>
          <font color="#3366ff"><font color="#000000">Respectfully<b><br>
              </b><b>Mahdi A. Mahdi</b></font></font><font
            color="#3366ff"><br>
            <br>
          </font></div>
      </div>
      <hr style="display:inline-block;width:98%" tabindex="-1">
      <div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt"
          face="Calibri, sans-serif" color="#000000"><b>From:</b> Erekle
          Magradze <a class="moz-txt-link-rfc2396E" href="mailto:erekle.magradze@recogizer.de">&lt;erekle.magradze@recogizer.de&gt;</a><br>
          <b>Sent:</b> Friday, February 23, 2018 2:48 PM<br>
          <b>To:</b> Mahdi Adnan; <a class="moz-txt-link-abbreviated" href="mailto:users@ovirt.org">users@ovirt.org</a><br>
          <b>Subject:</b> Re: [ovirt-users] rebooting hypervisors from
          time to time</font>
        <div> </div>
      </div>
      <div style="background-color:#FFFFFF">
        <p>Thanks for the reply,</p>
        <p>I've attached all the logs from yesterday, reboot has
          happened during the day but this is not the first time and
          this is not the only one hypervisor.</p>
        <p>Kind Regards</p>
        <p>Erekle</p>
        <br>
        <div class="x_moz-cite-prefix">On 02/23/2018 09:00 AM, Mahdi
          Adnan wrote:<br>
        </div>
        <blockquote type="cite">
          <style type="text/css" style="display:none">
<!--
p
        {margin-top:0;
        margin-bottom:0}
-->
</style>
          <div style="font-family:Calibri,Helvetica,sans-serif;
            font-size:12pt; color:rgb(0,0,0);
            background-color:rgba(0,0,0,0)">
            Hi,</div>
          <div style="font-family:Calibri,Helvetica,sans-serif;
            font-size:12pt; color:rgb(0,0,0);
            background-color:rgba(0,0,0,0)">
            <br>
          </div>
          <div style="font-family:Calibri,Helvetica,sans-serif;
            font-size:12pt; color:rgb(0,0,0);
            background-color:rgba(0,0,0,0)">
            Can you post the VDSM and Engine logs ?</div>
          <div style="font-family:Calibri,Helvetica,sans-serif;
            font-size:12pt; color:rgb(0,0,0)">
            <br>
          </div>
          <div id="x_signature"><br>
            <div class="x_ecxmoz-signature">-- <br>
              <br>
              <font color="#3366ff"><font color="#000000">Respectfully<b><br>
                  </b><b>Mahdi A. Mahdi</b></font></font><font
                color="#3366ff"><br>
                <br>
              </font></div>
          </div>
          <hr tabindex="-1" style="display:inline-block; width:98%">
          <div id="x_divRplyFwdMsg" dir="ltr"><font
              style="font-size:11pt" face="Calibri, sans-serif"
              color="#000000"><b>From:</b>
              <a class="x_moz-txt-link-abbreviated"
                href="mailto:users-bounces@ovirt.org"
                moz-do-not-send="true">users-bounces@ovirt.org</a>
              <a class="x_moz-txt-link-rfc2396E"
                href="mailto:users-bounces@ovirt.org"
                moz-do-not-send="true">&lt;users-bounces@ovirt.org&gt;</a>
              on behalf of Erekle Magradze
              <a class="x_moz-txt-link-rfc2396E"
                href="mailto:erekle.magradze@recogizer.de"
                moz-do-not-send="true">&lt;erekle.magradze@recogizer.de&gt;</a><br>
              <b>Sent:</b> Thursday, February 22, 2018 11:48 PM<br>
              <b>To:</b> <a class="x_moz-txt-link-abbreviated"
                href="mailto:users@ovirt.org" moz-do-not-send="true">users@ovirt.org</a><br>
              <b>Subject:</b> Re: [ovirt-users] rebooting hypervisors
              from time to time</font>
            <div> </div>
          </div>
          <div class="x_BodyFragment"><font size="2"><span
                style="font-size:11pt">
                <div class="x_PlainText">Dear all,<br>
                  <br>
                  It would be great if someone will share any experience
                  regarding the <br>
                  similar case, would be great to have a hint where to
                  start investigation.<br>
                  <br>
                  Thanks again<br>
                  <br>
                  Cheers<br>
                  <br>
                  Erekle<br>
                  <br>
                  <br>
                  On 02/22/2018 05:05 PM, Erekle Magradze wrote:<br>
                  &gt; Hello there,<br>
                  &gt;<br>
                  &gt; I am facing the following problem from time to
                  time one of the <br>
                  &gt; hypervisor (there are 3 of them)s is rebooting, I
                  am using <br>
                  &gt; ovirt-release42-4.2.1-1.el7.centos.noarch and
                  glsuter as a storage <br>
                  &gt; backend (glusterfs-3.12.5-2.el7.x86_64).<br>
                  &gt;<br>
                  &gt; I am suspecting gluster because of the e.g.
                  message bellow from one of <br>
                  &gt; the volumes,<br>
                  &gt;<br>
                  &gt; Could you please help and suggest to which
                  direction should <br>
                  &gt; investigation go?<br>
                  &gt;<br>
                  &gt; Thanks in advance<br>
                  &gt;<br>
                  &gt; Cheers<br>
                  &gt;<br>
                  &gt; Erekle<br>
                  &gt;<br>
                  &gt;<br>
                  &gt; [2018-02-22 15:36:10.011687] and [2018-02-22
                  15:37:10.955013]<br>
                  &gt; [2018-02-22 15:41:10.198701] I [MSGID: 109063] <br>
                  &gt; [dht-layout.c:716:dht_layout_normalize]
                  0-virtimages-dht: Found <br>
                  &gt; anomalies in (null) (gfid =
                  00000000-0000-0000-0000-000000000000). <br>
                  &gt; Holes=1 overlaps=0<br>
                  &gt; [2018-02-22 15:41:10.198704] I [MSGID: 109063] <br>
                  &gt; [dht-layout.c:716:dht_layout_normalize]
                  0-virtimages-dht: Found <br>
                  &gt; anomalies in (null) (gfid =
                  00000000-0000-0000-0000-000000000000). <br>
                  &gt; Holes=1 overlaps=0<br>
                  &gt; [2018-02-22 15:42:11.293608] I [MSGID: 109063] <br>
                  &gt; [dht-layout.c:716:dht_layout_normalize]
                  0-virtimages-dht: Found <br>
                  &gt; anomalies in (null) (gfid =
                  00000000-0000-0000-0000-000000000000). <br>
                  &gt; Holes=1 overlaps=0<br>
                  &gt; [2018-02-22 15:53:16.245720] I [MSGID: 100030] <br>
                  &gt; [glusterfsd.c:2524:main] 0-/usr/sbin/glusterfs:
                  Started running <br>
                  &gt; /usr/sbin/glusterfs version 3.12.5 (args:
                  /usr/sbin/glusterfs <br>
                  &gt; --volfile-server=10.0.0.21 --volfi<br>
                  &gt; le-server=10.0.0.22 --volfile-server=10.0.0.23 <br>
                  &gt; --volfile-id=/virtimages <br>
                  &gt;
                  /rhev/data-center/mnt/glusterSD/10.0.0.21:_virtimages)<br>
                  &gt; [2018-02-22 15:53:16.263712] W [MSGID: 101002] <br>
                  &gt; [options.c:995:xl_opt_validate] 0-glusterfs:
                  option 'address-family' <br>
                  &gt; is deprecated, preferred is
                  'transport.address-family', continuing <br>
                  &gt; with correction<br>
                  &gt; [2018-02-22 15:53:16.269595] I [MSGID: 101190] <br>
                  &gt; [event-epoll.c:613:event_dispatch_epoll_worker]
                  0-epoll: Started <br>
                  &gt; thread with index 1<br>
                  &gt; [2018-02-22 15:53:16.273483] I [MSGID: 101190] <br>
                  &gt; [event-epoll.c:613:event_dispatch_epoll_worker]
                  0-epoll: Started <br>
                  &gt; thread with index 2<br>
                  &gt; [2018-02-22 15:53:16.273594] W [MSGID: 101174] <br>
                  &gt; [graph.c:363:_log_if_unknown_option]
                  0-virtimages-readdir-ahead: <br>
                  &gt; option 'parallel-readdir' is not recognized<br>
                  &gt; [2018-02-22 15:53:16.273703] I [MSGID: 114020]
                  [client.c:2360:notify] <br>
                  &gt; 0-virtimages-client-0: parent translators are
                  ready, attempting <br>
                  &gt; connect on transport<br>
                  &gt; [2018-02-22 15:53:16.276455] I [MSGID: 114020]
                  [client.c:2360:notify] <br>
                  &gt; 0-virtimages-client-1: parent translators are
                  ready, attempting <br>
                  &gt; connect on transport<br>
                  &gt; [2018-02-22 15:53:16.276683] I
                  [rpc-clnt.c:1986:rpc_clnt_reconfig] <br>
                  &gt; 0-virtimages-client-0: changing port to 49152
                  (from 0)<br>
                  &gt; [2018-02-22 15:53:16.279191] I [MSGID: 114020]
                  [client.c:2360:notify] <br>
                  &gt; 0-virtimages-client-2: parent translators are
                  ready, attempting <br>
                  &gt; connect on transport<br>
                  &gt; [2018-02-22 15:53:16.282126] I [MSGID: 114057] <br>
                  &gt;
                  [client-handshake.c:1478:select_server_supported_programs]
                  <br>
                  &gt; 0-virtimages-client-0: Using Program GlusterFS
                  3.3, Num (1298437), <br>
                  &gt; Version (330)<br>
                  &gt; [2018-02-22 15:53:16.282573] I [MSGID: 114046] <br>
                  &gt; [client-handshake.c:1231:client_setvolume_cbk]
                  0-virtimages-client-0: <br>
                  &gt; Connected to virtimages-client-0, attached to
                  remote volume <br>
                  &gt; '/mnt/virtimages/virtimgs'.<br>
                  &gt; [2018-02-22 15:53:16.282584] I [MSGID: 114047] <br>
                  &gt; [client-handshake.c:1242:client_setvolume_cbk]
                  0-virtimages-client-0: <br>
                  &gt; Server and Client lk-version numbers are not
                  same, reopening the fds<br>
                  &gt; [2018-02-22 15:53:16.282665] I [MSGID: 108005] <br>
                  &gt; [afr-common.c:4929:__afr_handle_child_up_event] <br>
                  &gt; 0-virtimages-replicate-0: Subvolume
                  'virtimages-client-0' came back <br>
                  &gt; up; going online.<br>
                  &gt; [2018-02-22 15:53:16.282877] I
                  [rpc-clnt.c:1986:rpc_clnt_reconfig] <br>
                  &gt; 0-virtimages-client-1: changing port to 49152
                  (from 0)<br>
                  &gt; [2018-02-22 15:53:16.282934] I [MSGID: 114035] <br>
                  &gt;
                  [client-handshake.c:202:client_set_lk_version_cbk] <br>
                  &gt; 0-virtimages-client-0: Server lk version = 1<br>
                  &gt;<br>
                  &gt; _______________________________________________<br>
                  &gt; Users mailing list<br>
                  &gt; <a class="x_moz-txt-link-abbreviated"
                    href="mailto:Users@ovirt.org" moz-do-not-send="true">Users@ovirt.org</a><br>
                  &gt; <a
                    href="http://lists.ovirt.org/mailman/listinfo/users"
                    moz-do-not-send="true">http://lists.ovirt.org/mailman/listinfo/users</a><br>
                  <br>
                  -- <br>
                  Recogizer Group GmbH<br>
                  <br>
                  Dr.rer.nat. Erekle Magradze<br>
                  Lead Big Data Engineering &amp; DevOps<br>
                  Rheinwerkallee 2, 53227 Bonn<br>
                  Tel: +49 228 29974555<br>
                  <br>
                  E-Mail <a class="x_moz-txt-link-abbreviated"
                    href="mailto:erekle.magradze@recogizer.de"
                    moz-do-not-send="true">
                    erekle.magradze@recogizer.de</a><br>
                  recogizer.com<br>
                  <br>
-----------------------------------------------------------------<br>
                  <br>
                  Recogizer Group GmbH<br>
                  Geschäftsführer: Oliver Habisch, Carsten Kreutze<br>
                  Handelsregister: Amtsgericht Bonn HRB 20724<br>
                  Sitz der Gesellschaft: Bonn; USt-ID-Nr.: DE294195993<br>
                  Diese E-Mail enthält vertrauliche und/oder rechtlich
                  geschützte Informationen. Wenn Sie nicht der richtige
                  Adressat sind oder diese E-Mail irrtümlich erhalten
                  haben, informieren Sie bitte sofort den Absender und
                  löschen Sie diese Mail. Das unerlaubte Kopieren sowie
                  die unbefugte Weitergabe dieser Mail und der darin
                  enthaltenen Informationen ist nicht gestattet.<br>
                  <br>
                  _______________________________________________<br>
                  Users mailing list<br>
                  <a class="x_moz-txt-link-abbreviated"
                    href="mailto:Users@ovirt.org" moz-do-not-send="true">Users@ovirt.org</a><br>
                  <a
                    href="http://lists.ovirt.org/mailman/listinfo/users"
                    moz-do-not-send="true">http://lists.ovirt.org/mailman/listinfo/users</a><br>
                </div>
              </span></font></div>
        </blockquote>
        <br>
      </div>
    </blockquote>
    <br>
  </body>
</html>