<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.E-MailFormatvorlage17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="DE" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hello Sahina,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">First of all, sorry for the late reply, but I got distracted by other things and left off on vacation.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">The problem vanished after a complete shutdown of the whole datacenter (due to hardware maintenance).<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Sincerely<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">André-Sebastian Liebe<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Von:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Sahina Bose [mailto:sabose@redhat.com]
<br>
<b>Gesendet:</b> Montag, 23. Januar 2017 08:15<br>
<b>An:</b> Liebe, André-Sebastian<br>
<b>Cc:</b> users@ovirt.org<br>
<b>Betreff:</b> Re: [ovirt-users] hosted-storage import fails on hyperconverged glusterFS<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Fri, Jan 20, 2017 at 3:01 PM, Liebe, André-Sebastian <<a href="mailto:andre.liebe@gematik.de" target="_blank">andre.liebe@gematik.de</a>> wrote:<o:p></o:p></p>
<p class="MsoNormal">Hello List,<br>
<br>
I run into trouble after moving our hosted engine from nfs to hyperconverged glusterFS by backup/restore[1] procedure. The engine logs it can't import and activate the hosted-storage although I can see the storage.<br>
Any Hints how to fix this?<br>
<br>
- I created the ha-replica-3 gluster volume prior to hosted-engine-setup using the hosts short name.<br>
- Then ran hosted-engine-setup to install an new hosted engine (by installing centOS7 and ovirt-engine amnually)<br>
- inside the new hosted-engine I restored the last successfull backup (wich was in running state)<br>
- then I connected to the engine-database and removed the old hosted-engine by hand (as part of this patch would do:
<a href="https://gerrit.ovirt.org/#/c/64966/" target="_blank">https://gerrit.ovirt.org/#/c/64966/</a>) and all known hosts (after marking all vms as down, where I got ETL error messages later on for this)<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Did you also clean up the old HE storage domain? The error further down indicates that engine has a reference to the HE storage domain.<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal">- then I finished up the engine installation by running the engine-setup inside the hosted_engine<br>
- and finally completed the hosted-engine-setup<br>
<br>
<br>
The new hosted engine came up successfully with all prior known storage and after enabling glusterFS, the cluster this HA-host is part of, I could see it in the volumes and storage tab. After adding the remaining two hosts, the volume was marked as active.<br>
<br>
But here's the the error message I get repeadately since then:<br>
> 2017-01-19 08:49:36,652 WARN [org.ovirt.engine.core.bll.storage.domain.ImportHostedEngineStorageDomainCommand] (org.ovirt.thread.pool-6-thread-10) [3b955ecd] Validation of action 'ImportHostedEngineStorageDomain' failed for user SYSTEM. Reasons: VAR__ACTION__ADD,VAR__TYPE__STORAGE__DOMAIN,ACTION_TYPE_FAILED_STORAGE_DOMAIN_ALREADY_EXIST<br>
<br>
<br>
There are also some repeating messages about this ha-replica-3 volume, because I used the hosts short name on volume creation, which I can't change afaik without a complete cluster shutdown.<br>
> 2017-01-19 08:48:03,134 INFO [org.ovirt.engine.core.bll.AddUnmanagedVmsCommand] (DefaultQuartzScheduler3) [7471d7de] Running command: AddUnmanagedVmsCommand internal: true.<br>
> 2017-01-19 08:48:03,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler3) [7471d7de] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='f62c7d04-9c95-453f-92d5-6dabf9da874a',
vds='Host[,f62c7d04-9c95-453f-92d5-6dabf9da874a]', vmIds='[dfea96e8-e94a-407e-af46-3019fd3f2991]'}), log id: 2d0941f9<br>
> 2017-01-19 08:48:03,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler3) [7471d7de] FINISH, FullListVDSCommand, return: [{guestFQDN=, emulatedMachine=pc, pid=0, guestDiskMapping={}, devices=[Ljava.lang.Object;@4181d938,
cpuType=Haswell-noTSX, smp=2, vmType=kvm, memSize=8192, vmName=HostedEngine, username=, exitMessage=XML error: maximum vcpus count must be an integer, vmId=dfea96e8-e94a-407e-af46-3019fd3f2991, displayIp=0, displayPort=-1, guestIPs=, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir,
exitCode=1, nicModel=rtl8139,pv, exitReason=1, status=Down, maxVCpus=None, clientIp=, statusTime=6675071780, display=vnc, displaySecurePort=-1}], log id: 2d0941f9<br>
> 2017-01-19 08:48:03,163 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerObjectsBuilder] (DefaultQuartzScheduler3) [7471d7de] null architecture type, replacing with x86_64, %s<br>
> 2017-01-19 08:48:17,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler3) [7471d7de] START, GlusterServersListVDSCommand(HostName = lvh2, VdsIdVDSCommandParametersBase:{runAsync='true', hostId='23297fc2-db12-4778-a5ff-b74d6fc9554b'}),
log id: 57d029dc<br>
> 2017-01-19 08:48:18,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler3) [7471d7de] FINISH, GlusterServersListVDSCommand, return: [<a href="http://172.31.1.22/24:CONNECTED" target="_blank">172.31.1.22/24:CONNECTED</a>,
lvh3.lab.gematik.de:CONNECTED, lvh4.lab.gematik.de:CONNECTED], log id: 57d029dc<br>
> 2017-01-19 08:48:18,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler3) [7471d7de] START, GlusterVolumesListVDSCommand(HostName = lvh2, GlusterVolumesListVDSParameters:{runAsync='true', hostId='23297fc2-db12-4778-a5ff-b74d6fc9554b'}),
log id: 5cd11a39<br>
> 2017-01-19 08:48:18,282 WARN [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc] (DefaultQuartzScheduler3) [7471d7de] Could not associate brick 'lvh2:/data/gluster/0/brick' of volume '7dc6410d-8f2a-406c-812a-8235fa6f721c' with correct
network as no gluster network found in cluster '57ff41c2-0297-039d-039c-000000000362'<br>
> 2017-01-19 08:48:18,284 WARN [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc] (DefaultQuartzScheduler3) [7471d7de] Could not associate brick 'lvh3:/data/gluster/0/brick' of volume '7dc6410d-8f2a-406c-812a-8235fa6f721c' with correct
network as no gluster network found in cluster '57ff41c2-0297-039d-039c-000000000362'<br>
> 2017-01-19 08:48:18,285 WARN [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc] (DefaultQuartzScheduler3) [7471d7de] Could not associate brick 'lvh4:/data/gluster/0/brick' of volume '7dc6410d-8f2a-406c-812a-8235fa6f721c' with correct
network as no gluster network found in cluster '57ff41c2-0297-039d-039c-000000000362'<o:p></o:p></p>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">To get rid of these errors, the VM running engine needs to be able to resolve the short names to the correct interface (associated with gluster network)<br>
<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal" style="margin-bottom:12.0pt">> 2017-01-19 08:48:18,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler3) [7471d7de] FINISH, GlusterVolumesListVDSCommand, return: {7dc6410d-8f2a-406c-812a-8235fa6f721c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2459e231,
000391cc-9946-47b3-82c9-af17da69d182=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42990505}, log id: 5cd11a39<br>
<br>
<br>
[1] <a href="http://www.ovirt.org/documentation/admin-guide/hosted-engine-backup-and-restore" target="_blank">
http://www.ovirt.org/documentation/admin-guide/hosted-engine-backup-and-restore</a> seems to be moved to
<a href="http://www.ovirt.org/documentation/self-hosted/chap-Backing_up_and_Restoring_an_EL-Based_Self-Hosted_Environment/#creating-a-new-self-hosted-engine-environment-to-be-used-as-the-restored-environment" target="_blank">
http://www.ovirt.org/documentation/self-hosted/chap-Backing_up_and_Restoring_an_EL-Based_Self-Hosted_Environment/#creating-a-new-self-hosted-engine-environment-to-be-used-as-the-restored-environment</a><br>
<br>
sincerely,<br>
André-Sebastian Liebe<br>
<br>
Technik / Innovation<br>
Telefon: +49 30 40041-197<br>
Telefax: +49 30 40041-111<br>
<br>
gematik- Gesellschaft für Telematikanwendungen der Gesundheitskarte mbH<br>
Friedrichstraße 136, 10117 Berlin<br>
Amtsgericht Berlin-Charlottenburg HRB 96351 B<br>
Geschäftsführer: Alexander Beyer<br>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</body>
</html>