<div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">Hello all</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">during weekend, I've re-tried to deploy my 4.2_rc lab.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">Everything was fine, apart the fact host 2 and 3 weren't imported. I had to add them to the cluster manually, with the NEW function.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">After this Gluster volumes were added fine to the environment.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small"> </div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">Next engine deploy on nodes 2 and 3, ended with ok status.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">Tring to migrate HE from host 1 to host 2 was fine, the same from host 2 to host 3.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">After these two attempts, no way to migrate HE back to any host.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">Tried Maintenance mode set to global, reboot the HE and now I'm in the same condition reported below, not anymore able to boot the HE.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">Here's hosted-engine --vm-status:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div class="gmail_default"><div class="gmail_default"><font face="arial, helvetica, sans-serif">!! Cluster is in GLOBAL MAINTENANCE mode !!</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">--== Host 1 status ==--</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">conf_on_shared_storage : True</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Status up-to-date : True</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Hostname : <a href="http://aps-te61-mng.example.com">aps-te61-mng.example.com</a></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Host ID : 1</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Score : 3400</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">stopped : False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Local maintenance : False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">crc32 : 7dfc420b</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">local_conf_timestamp : 181953</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Host timestamp : 181952</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Extra metadata (valid at timestamp):</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> metadata_parse_version=1</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> metadata_feature_version=1</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> timestamp=181952 (Mon Dec 11 09:21:46 2017)</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> host-id=1</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> score=3400</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> vm_conf_refresh_time=181953 (Mon Dec 11 09:21:47 2017)</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> conf_on_shared_storage=True</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> maintenance=False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> state=GlobalMaintenance</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> stopped=False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">--== Host 2 status ==--</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">conf_on_shared_storage : True</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Status up-to-date : True</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Hostname : <a href="http://aps-te64-mng.example.com">aps-te64-mng.example.com</a></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Host ID : 2</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Score : 3400</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">stopped : False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Local maintenance : False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">crc32 : 67c7dd1d</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">local_conf_timestamp : 181946</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Host timestamp : 181946</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Extra metadata (valid at timestamp):</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> metadata_parse_version=1</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> metadata_feature_version=1</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> timestamp=181946 (Mon Dec 11 09:21:49 2017)</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> host-id=2</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> score=3400</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> vm_conf_refresh_time=181946 (Mon Dec 11 09:21:49 2017)</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> conf_on_shared_storage=True</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> maintenance=False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> state=GlobalMaintenance</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> stopped=False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">--== Host 3 status ==--</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">conf_on_shared_storage : True</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Status up-to-date : True</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Hostname : <a href="http://aps-te68-mng.example.com">aps-te68-mng.example.com</a></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Host ID : 3</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Engine status : {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Score : 3400</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">stopped : False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Local maintenance : False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">crc32 : 4daea041</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">local_conf_timestamp : 181078</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Host timestamp : 181078</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">Extra metadata (valid at timestamp):</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> metadata_parse_version=1</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> metadata_feature_version=1</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> timestamp=181078 (Mon Dec 11 09:21:53 2017)</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> host-id=3</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> score=3400</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> vm_conf_refresh_time=181078 (Mon Dec 11 09:21:53 2017)</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> conf_on_shared_storage=True</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> maintenance=False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> state=GlobalMaintenance</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"> stopped=False</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">!! Cluster is in GLOBAL MAINTENANCE mode !!</font></div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">(it is in global maintenance to avoid messages to be sent to admin mailbox).</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Engine image is available on all three hosts, gluster is working fine:</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Volume Name: engine</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Type: Replicate</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Volume ID: 95355a0b-1f45-4329-95c7-604682e812d0</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Status: Started</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Snapshot Count: 0</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Number of Bricks: 1 x 3 = 3</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Transport-type: tcp</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Bricks:</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Brick1: aps-te61-mng.example.com:/gluster_bricks/engine/engine</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Brick2: aps-te64-mng.example.com:/gluster_bricks/engine/engine</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Brick3: aps-te68-mng.example.com:/gluster_bricks/engine/engine</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Options Reconfigured:</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">nfs.disable: on</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">transport.address-family: inet</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">performance.quick-read: off</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">performance.read-ahead: off</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">performance.io-cache: off</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">performance.low-prio-threads: 32</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">network.remote-dio: off</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">cluster.eager-lock: enable</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">cluster.quorum-type: auto</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">cluster.server-quorum-type: server</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">cluster.data-self-heal-algorithm: full</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">cluster.locking-scheme: granular</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">cluster.shd-max-threads: 8</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">cluster.shd-wait-qlength: 10000</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">features.shard: on</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">user.cifs: off</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">storage.owner-uid: 36</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">storage.owner-gid: 36</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">network.ping-timeout: 30</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">performance.strict-o-direct: on</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">cluster.granular-entry-heal: enable</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">features.shard-block-size: 64MB</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Engine qemu image seems to be ok:</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div><div><font face="arial, helvetica, sans-serif">[root@aps-te68-mng 9998de26-8a5c-4495-b450-c8dfc1e016da]# l</font></div><div><font face="arial, helvetica, sans-serif">total 2660796</font></div><div><font face="arial, helvetica, sans-serif">-rw-rw----. 1 vdsm kvm 53687091200 Dec 8 17:22 35ac0f88-e97d-4710-a385-127c751a3190</font></div><div><font face="arial, helvetica, sans-serif">-rw-rw----. 1 vdsm kvm 1048576 Dec 11 09:04 35ac0f88-e97d-4710-a385-127c751a3190.lease</font></div><div><font face="arial, helvetica, sans-serif">-rw-r--r--. 1 vdsm kvm 285 Dec 8 11:19 35ac0f88-e97d-4710-a385-127c751a3190.meta</font></div><div><font face="arial, helvetica, sans-serif">[root@aps-te68-mng 9998de26-8a5c-4495-b450-c8dfc1e016da]# qemu-img info 35ac0f88-e97d-4710-a385-127c751a3190</font></div><div><font face="arial, helvetica, sans-serif">image: 35ac0f88-e97d-4710-a385-127c751a3190</font></div><div><font face="arial, helvetica, sans-serif">file format: raw</font></div><div><font face="arial, helvetica, sans-serif">virtual size: 50G (53687091200 bytes)</font></div><div><font face="arial, helvetica, sans-serif">disk size: 2.5G</font></div><div><font face="arial, helvetica, sans-serif">[root@aps-te68-mng 9998de26-8a5c-4495-b450-c8dfc1e016da]#</font></div></div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Attached agent and broker logs from the last host where HE startup was attempted. Only last two hours.</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Any hint to perform further investigation ?</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Thanks in advance.</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Environment: 3 HPE Proliant BL680cG7, OS on mirrored volume 1, gluster on mirrored volume 2, 1 TB for each server.</div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Multiple network adapters (6), configured only one.</div><div style="font-family:arial,helvetica,sans-serif">I've used last ovirt-node-ng iso image : ovirt-node-ng-installer-ovirt-4.2-pre-2017120512.iso and <span style="font-family:Arial,sans-serif">ovirt-hosted-engine-setup-2.2.1-0.0.master.20171206123553.git94f4c9e.el7.centos.noarch to work around HE static ip address not masked correctly.</span></div><div style="font-family:arial,helvetica,sans-serif"><span style="font-family:Arial,sans-serif"><br></span></div><div style="font-family:arial,helvetica,sans-serif"><div class="gmail_default" style="display:inline"></div><span style="font-family:arial,sans-serif">-- </span><br style="font-family:arial,sans-serif"><div class="gmail_signature" style="font-family:arial,sans-serif"><div dir="ltr"><div dir="ltr"><font size="4">Roberto</font></div></div></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">2017-12-07 12:44 GMT+01:00 Roberto Nunin <span dir="ltr"><<a href="mailto:robnunin@gmail.com" target="_blank">robnunin@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div style="font-family:arial,helvetica,sans-serif;font-size:small">Hi</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">after successfully deployed fresh 4.2_rc with ovirt node, I'm facing with a blocking problem.</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">hosted-engine won't boot. Reaching the console via vnc hook, I can see that it is at initial boot screen, but for any OS release available, I receive:</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><img src="cid:ii_16030c0cdd3492b4" alt="Immagine incorporata 1" width="558" height="314" style="margin-right: 0px;"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">then</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><img src="cid:ii_16030c1395d63507" alt="Immagine incorporata 2" width="558" height="93" style="margin-right: 0px;"><br></div><div><br></div><div><div style="font-family:arial,helvetica,sans-serif;font-size:small">googling around, I'm not able to find suggestions. Any hints ?</div><div style="font-family:arial,helvetica,sans-serif;font-size:small"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:small">Thanks</div><span class="gmail-HOEnZb"><font color="#888888"><br></font></span></div><span class="gmail-HOEnZb"><font color="#888888">-- <br><div class="gmail-m_-2634866436921860170gmail_signature"><div dir="ltr"><div dir="ltr"><font size="4">Roberto<br><br></font><span><font size="4"><br><br></font></span></div></div></div>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small;display:inline"></div><div class="gmail_signature"><div dir="ltr"><div dir="ltr"><font size="4"><br></font><span><font size="4"><br><br></font></span></div></div></div>
</div></div>