This is a multi-part message in MIME format.
--------------3BAABD5D5931B607E7102F5F
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
On 09/05/2017 09:02 AM, Arsène Gschwind wrote:
On 09/04/2017 07:59 PM, Simone Tiraboschi wrote:
>
> On Mon, Sep 4, 2017 at 7:32 PM, Arsène Gschwind
> <arsene.gschwind(a)unibas.ch <mailto:arsene.gschwind@unibas.ch>> wrote:
>
>
>
> On 09/04/2017 06:32 PM, Simone Tiraboschi wrote:
>>
>>
>> On Mon, Sep 4, 2017 at 6:24 PM, Arsène Gschwind
>> <arsene.gschwind(a)unibas.ch <mailto:arsene.gschwind@unibas.ch>>
>> wrote:
>>
>>
>>
>> On 09/04/2017 02:51 PM, Simone Tiraboschi wrote:
>>>
>>>
>>> On Mon, Sep 4, 2017 at 2:21 PM, Arsène Gschwind
>>> <arsene.gschwind(a)unibas.ch
>>> <mailto:arsene.gschwind@unibas.ch>> wrote:
>>>
>>>
>>>
>>> On 09/04/2017 02:01 PM, Simone Tiraboschi wrote:
>>>>
>>>>
>>>> On Mon, Sep 4, 2017 at 1:55 PM, Arsène Gschwind
>>>> <arsene.gschwind(a)unibas.ch
>>>> <mailto:arsene.gschwind@unibas.ch>> wrote:
>>>>
>>>>
>>>>
>>>> On 09/04/2017 01:52 PM, Simone Tiraboschi wrote:
>>>>>
>>>>>
>>>>> On Mon, Sep 4, 2017 at 12:23 PM, Arsène Gschwind
>>>>> <arsene.gschwind(a)unibas.ch
>>>>> <mailto:arsene.gschwind@unibas.ch>> wrote:
>>>>>
>>>>> Hi Simone,
>>>>>
>>>>>
>>>>> On 09/04/2017 11:14 AM, Simone Tiraboschi wrote:
>>>>>>
>>>>>>
>>>>>> On Mon, Sep 4, 2017 at 10:56 AM, Arsène
>>>>>> Gschwind <arsene.gschwind(a)unibas.ch
>>>>>> <mailto:arsene.gschwind@unibas.ch>>
wrote:
>>>>>>
>>>>>> Hi Didi,
>>>>>>
>>>>>>
>>>>>> On 09/04/2017 10:15 AM, Yedidyah Bar
>>>>>> David wrote:
>>>>>>> On Mon, Sep 4, 2017 at 10:16 AM,
Arsène Gschwind
>>>>>>> <arsene.gschwind(a)unibas.ch>
>>>>>>>
<mailto:arsene.gschwind@unibas.ch> wrote:
>>>>>>>> Hi all,
>>>>>>>>
>>>>>>>> A while ago I had some problem
with hosted-engine network which wasn't set
>>>>>>>> correctly at deploy time, so I
finally decided to redeploy the hosted engine
>>>>>>>> in the hope the network will be
set correctly this time. I've followed this
>>>>>>>> procedure:
>>>>>>>>
>>>>>>>> Stop all VMs
>>>>>>>> Full backup of HE DB and export
to safe place
>>>>>>>> Cleanup HE storage
followinghttps://access.redhat.com/solutions/2121581
>>>>>>>>
<
https://access.redhat.com/solutions/2121581>
>>>>>>>> Reboot Hosts
>>>>>>>> Re-deploy HE until DB recovery
>>>>>>>> Recover DB adding the following
param:
>>>>>>>> --he-remove-storage-vm
Removes the hosted-engine storage
>>>>>>>> domain, all its entities and the
hosted-engine VM during restore.
>>>>>>>> --he-remove-hosts
Removes all the hosted-engine hosts
>>>>>>>> during restore.
>>>>>>>>
>>>>>>>> Finalize HE deployment.
>>>>>>>>
>>>>>>>> Everything did run without errors
and I'm able to access Web UI.
>>>>>>>>
>>>>>>>> But now I don't see my HE VM
and its respective Storage Domain, the logs
>>>>>>>> says it isn't able to import
it. I see all other SD and I'm able to manage
>>>>>>>> my VMs as before.
>>>>>>>>
>>>>>>>> Please find attached engine.log
>>>>>>> I think this is your problem:
>>>>>>>
>>>>>>> 2017-09-04 03:26:14,272+02 INFO
>>>>>>>
[org.ovirt.engine.core.bll.storage.domain.AddExistingBlockStorageDomainCommand]
>>>>>>> (org.ovirt.thread.pool-6-thread-24)
[2383eaa0] There are existing luns
>>>>>>> in the system which are part of VG
id
>>>>>>>
'vvIoS2-fZTZ-99Ox-Ltzq-pr8U-SL2z-wbTU8g'
>>>>>> I don't see a VG with this ID, here
the
>>>>>> IDs I see on the hosts:
>>>>>>
>>>>>> VG #PV #LV #SN Attr VSize VFree
>>>>>> 6b62cc06-fc44-4c38-af6d-bfd9cbe73246 1
>>>>>> 10 0 wz--n- 99.62g 14.50g
>>>>>> b0414c06-d984-4001-a998-fd9a2e79fb83 2
>>>>>> 70 0 wz--n- 10.00t 2.31t
>>>>>> b2e30961-7cff-4cca-83d6-bee3a4f890ee 2
>>>>>> 47 0 wz--n- 5.27t 2.50t
>>>>>>
>>>>>>
>>>>>>
>>>>>> Could you please repeat the command on host
>>>>>> adm-kvmh70 ?
>>>>>>
>>>>>> 2017-09-04 09:04:18,163+02 INFO
>>>>>> [org.ovirt.engine.core.bll.st
>>>>>>
<
http://org.ovirt.engine.core.bll.st>orage.domain.ImportHostedEngineSto...]
>>>>>> (org.ovirt.thread.pool-6-thread-34)
>>>>>> [247a3718] Running command:
>>>>>> ImportHostedEngineStorageDomainCommand
>>>>>> internal: true.
>>>>>> 2017-09-04 09:04:18,189+02 INFO
>>>>>>
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand]
>>>>>> (org.ovirt.thread.pool-6-thread-34)
>>>>>> [7d2e6cb2] START,
>>>>>> GetVGInfoVDSCommand(HostName = adm-kvmh70,
>>>>>>
GetVGInfoVDSCommandParameters:{runAsync='true',
>>>>>>
hostId='acbacabb-6c4a-43fd-a1e2-2d7ff2f6f98b',
>>>>>>
VGID='vvIoS2-fZTZ-99Ox-Ltzq-pr8U-SL2z-wbTU8g'}),
>>>>>> log id: 6693b98a
>>>>>> 2017-09-04 09:04:18,232+02 INFO
>>>>>>
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand]
>>>>>> (org.ovirt.thread.pool-6-thread-34)
>>>>>> [7d2e6cb2] FINISH, GetVGInfoVDSCommand,
>>>>>> return:
[LUNs:{id='repl_HostedEngine',
>>>>>>
physicalVolumeId='kYN8Jj-FBDw-MhxI-XcoZ-w1zH-eQL8-IRIgzO',
>>>>>>
volumeGroupId='vvIoS2-fZTZ-99Ox-Ltzq-pr8U-SL2z-wbTU8g',
>>>>>> serial='SHITACHI_OPEN-V_50488888',
>>>>>> lunMapping='4',
vendorId='HITACHI',
>>>>>> productId='OPEN-V',
lunConnections='[]',
>>>>>> deviceSize='100', pvSize='0',
peCount='797',
>>>>>> peAllocatedCount='681',
>>>>>> vendorName='HITACHI',
>>>>>> pathsDictionary='[sdf=true, sdu=true,
>>>>>> sdk=true, sdp=true]',
>>>>>> pathsCapacity='[sdf=100, sdu=100,
sdk=100,
>>>>>> sdp=100]', lunType='FCP',
status='null',
>>>>>> diskId='null',
diskAlias='null',
>>>>>>
storageDomainId='6b62cc06-fc44-4c38-af6d-bfd9cbe73246',
>>>>>> storageDomainName='null',
>>>>>> discardMaxSize='268435456',
>>>>>> discardZeroesData='true'}], log id:
6693b98a
>>>>>> 2017-09-04 09:04:18,245+02 INFO
>>>>>> [org.ovirt.engine.core.bll.st
>>>>>>
<
http://org.ovirt.engine.core.bll.st>orage.domain.AddExistingBlockStora...]
>>>>>> (org.ovirt.thread.pool-6-thread-34)
>>>>>> [7d2e6cb2] There are existing luns in the
>>>>>> system which are part of VG id
>>>>>>
'vvIoS2-fZTZ-99Ox-Ltzq-pr8U-SL2z-wbTU8g'
>>>>>> 2017-09-04 09:04:18,245+02 WARN
>>>>>> [org.ovirt.engine.core.bll.st
>>>>>>
<
http://org.ovirt.engine.core.bll.st>orage.domain.AddExistingBlockStora...]
>>>>>> (org.ovirt.thread.pool-6-thread-34)
>>>>>> [7d2e6cb2] Validation of action
>>>>>> 'AddExistingBlockStorageDomain'
failed for
>>>>>> user SYSTEM. Reasons:
>>>>>>
VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__ADD,ACTION_TYPE_FAILED_IMPORT_STORAGE_DOMAIN_EXTERNAL_LUN_DISK_EXIST
>>>>> I don't know which command you are talking
>>>>> about, I didn't run any command since it
>>>>> tries to import the SD automatically.
>>>>>
>>>>>
>>>>> Sorry, can you please run vgdisplay on adm-kvmh70 ?
>>>> No problem! here the result:
>>>>
>>>> [root@adm-kvmh70 ~]# vgs
>>>> VG #PV #LV #SN Attr VSize VFree
>>>> 6b62cc06-fc44-4c38-af6d-bfd9cbe73246 1 10 0
>>>> wz--n- 99.62g 14.50g
>>>> b0414c06-d984-4001-a998-fd9a2e79fb83 2 70 0
>>>> wz--n- 10.00t 2.31t
>>>> b2e30961-7cff-4cca-83d6-bee3a4f890ee 2 47 0
>>>> wz--n- 5.27t 2.50t
>>>> vg_adm-kvmh70 1 3 0 wz--n- 277.90g
>>>> 218.68g
>>>>
>>>>
>>>> OK, and
>>>> vgdisplay 6b62cc06-fc44-4c38-af6d-bfd9cbe73246
>>> [root@adm-kvmh70 ~]# vgdisplay
>>> 6b62cc06-fc44-4c38-af6d-bfd9cbe73246
>>> --- Volume group ---
>>> VG Name 6b62cc06-fc44-4c38-af6d-bfd9cbe73246
>>> System ID
>>> Format lvm2
>>> Metadata Areas 2
>>> Metadata Sequence No 23
>>> VG Access read/write
>>> VG Status resizable
>>> MAX LV 0
>>> Cur LV 10
>>> Open LV 3
>>> Max PV 0
>>> Cur PV 1
>>> Act PV 1
>>> VG Size 99.62 GiB
>>> PE Size 128.00 MiB
>>> Total PE 797
>>> Alloc PE / Size 681 / 85.12 GiB
>>> Free PE / Size 116 / 14.50 GiB
>>> VG UUID vvIoS2-fZTZ-99Ox-Ltzq-pr8U-SL2z-wbTU8g
>>>
>>>
>>> OK, vvIoS2-fZTZ-99Ox-Ltzq-pr8U-SL2z-wbTU8g is the uuid of
>>> the VG that engine says that it includes the LUN used by
>>> the hosted-engine SD as detected by the engine.
>>> Its name is 6b62cc06-fc44-4c38-af6d-bfd9cbe73246 which is
>>> also the uuid of that storage domain.
>>>
>>> Now we need to understand what's there.
>>>
>>> Could you please check if an SD with uuid
>>> 6b62cc06-fc44-4c38-af6d-bfd9cbe73246 is visible in the engine?
>> The visible SD in the engine
>>
>> [oVirt shell (connected)]# list storagedomains
>>
>> id : 072fbaa1-08f3-4a40-9f34-a5ca22dd1d74
>> name : ovirt-image-repository
>> description: Public Glance repository for oVirt
>>
>> id : b2e30961-7cff-4cca-83d6-bee3a4f890ee
>> name : xxxxxxxxxxx
>>
>> id : b0414c06-d984-4001-a998-fd9a2e79fb83
>> name : xxxxxxxxxxx
>> description: xxxxxxxxxxx
>>
>> id : 71fa1c61-4a68-469f-9a56-835190d32075
>> name : xxxxxxxxxxx
>>
>> id : 9817e64b-fdd9-4d4c-91ee-f3482bb0cc56
>> name : xxxxxxxxxxxx
>> description: xxxxxxxxxxxx
>>
>>> Is adm-kvmh70 involved in hosted-engine? did you redeployed it?
>> Yes adm-kvmh70 should be a host hosting HE and yes as
>> written before I did redeploy HE because of a network
>> interface problem. I did cleanup the lun using the RedHat
>> guide, redeploy HE and restore the DB using the mentioned
>> parameter to remove HE information.
>>
>>
>> Could you please set adm-kvmh70 to maintenance mode from the
>> engine and then reactivate it or better reboot it while in
>> maintenance mode?
>> I suspect that 6b62cc06-fc44-4c38-af6d-bfd9cbe73246 is just a
>> left over of the previous hosted-engine storage domain kept open
>> on the host.
> I did reboot adm-kvmh70 while in maintenance mode and also reboot
> the engine but it didn't change anything. The import failure is
> still there...
> I've noticed a ovirt-ha-agent error:
>
> ovirt-ha-agent
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config
> ERROR Unable to identify the OVF_STORE volume, falling back to
> initial vm.conf. Please ensure you already added your first data
> domain for regular VMs
>
> Could that be related?
>
>
> This is just a side effects of that: the OVF_STORE disk is going to
> be created by the engine once it correctly imported the hosted-engine
> storage domain.
>
> Could you please share again your up-to-date engine.log?
>
> Thanks
>
Please find the latest engine log attached.
Thanks
When analyzing the log I do see some warning about existing LUNs which
are not part of the VG, does this means the LUNs are existing in the DB?
If yes would it be possible to remove them from the engine DB?
Thanks for your help,
Arsene
>>
>>>
>>> In the past did you tried to manually import the
>>> hosted-engine SD or something similar?
>> No, before the "redeployment" the HE SD was auto imported
>> successfully.
>>
>> Thanks a lot
>>
>>
>>
>>>
>>> thanks
>>
>>>
>>> Thanks
>>>
>>>> ?
>>>>
>>>>
>>>>>
>>>>> Thanks,
>>>>> Arsene
>>>>>
>>>>>>
>>>>>>
>>>>>>>> Thanks for any help to resolve
that issue.
>>>>>>> I guess you can try to remove this
disk/lun from the engine and let it retry.
>>>>>> Could let me know how to remove that lun
>>>>>> from the engine?
>>>>>>> If the only disk is of the
hosted-engine, I guess it should have been
>>>>>>> removed by
'--he-remove-storage-vm' - if so, please open a bug
>>>>>>> describing your flow in detail.
Thanks.
>>>>>> It seems that this option didn't
remove
>>>>>> the he storage information and that this
>>>>>> VG is still the old one.
>>>>>>
>>>>>> Many thanks for your help
>>>>>> Rgds,
>>>>>> Arsene
>>>>>>> Best,
>>>>>>>
>>>>>>>> Arsène
>>>>>>>>
>>>>>>>> --
>>>>>>>>
>>>>>>>> Arsène Gschwind
>>>>>>>> Fa. Sapify AG im Auftrag der
Universität Basel
>>>>>>>> IT Services
>>>>>>>> Klingelbergstr. 70 | CH-4056
Basel | Switzerland
>>>>>>>> Tel.+41 79 449 25 63
>>>>>>>>
<tel:+41%2079%20449%2025%2063> |http://its.unibas.ch
>>>>>>>>
ITS-ServiceDesk:support-its@unibas.ch
>>>>>>>>
<mailto:support-its@unibas.ch> |+41 61 267 14 11
>>>>>>>>
<tel:+41%2061%20267%2014%2011>
>>>>>>>>
>>>>>>>>
>>>>>>>>
_______________________________________________
>>>>>>>> Users mailing list
>>>>>>>> Users(a)ovirt.org
<mailto:Users@ovirt.org>
>>>>>>>>
http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>
<
http://lists.ovirt.org/mailman/listinfo/users>
>>>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> *Arsène Gschwind*
>>>>>> Fa. Sapify AG im Auftrag der Universität
>>>>>> Basel
>>>>>> IT Services
>>>>>> Klingelbergstr. 70 | CH-4056 Basel |
>>>>>> Switzerland
>>>>>> Tel. +41 79 449 25 63
>>>>>> <tel:+41%2079%20449%2025%2063> |
>>>>>>
http://its.unibas.ch
<
http://its.unibas.ch/>
>>>>>> ITS-ServiceDesk: support-its(a)unibas.ch
>>>>>> <mailto:support-its@unibas.ch> |
+41 61
>>>>>> 267 14 11
<tel:+41%2061%20267%2014%2011>
>>>>>>
>>>>>>
>>>>>>
_______________________________________________
>>>>>> Users mailing list
>>>>>> Users(a)ovirt.org
<mailto:Users@ovirt.org>
>>>>>>
http://lists.ovirt.org/mailman/listinfo/users
>>>>>>
<
http://lists.ovirt.org/mailman/listinfo/users>
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> *Arsène Gschwind*
>>>>> Fa. Sapify AG im Auftrag der Universität Basel
>>>>> IT Services
>>>>> Klingelbergstr. 70 | CH-4056 Basel |
>>>>> Switzerland
>>>>> Tel. +41 79 449 25 63
>>>>> <tel:+41%2079%20449%2025%2063> |
>>>>>
http://its.unibas.ch
<
http://its.unibas.ch/>
>>>>> ITS-ServiceDesk: support-its(a)unibas.ch
>>>>> <mailto:support-its@unibas.ch> | +41 61
267
>>>>> 14 11 <tel:+41%2061%20267%2014%2011>
>>>>>
>>>>>
>>>>
>>>> --
>>>>
>>>> *Arsène Gschwind*
>>>> Fa. Sapify AG im Auftrag der Universität Basel
>>>> IT Services
>>>> Klingelbergstr. 70 | CH-4056 Basel | Switzerland
>>>> Tel. +41 79 449 25 63
>>>> <tel:+41%2079%20449%2025%2063> |
>>>>
http://its.unibas.ch <
http://its.unibas.ch/>
>>>> ITS-ServiceDesk: support-its(a)unibas.ch
>>>> <mailto:support-its@unibas.ch> | +41 61 267 14 11
>>>> <tel:+41%2061%20267%2014%2011>
>>>>
>>>>
>>>
>>> --
>>>
>>> *Arsène Gschwind*
>>> Fa. Sapify AG im Auftrag der Universität Basel
>>> IT Services
>>> Klingelbergstr. 70 | CH-4056 Basel | Switzerland
>>> Tel. +41 79 449 25 63 <tel:+41%2079%20449%2025%2063> |
>>>
http://its.unibas.ch <
http://its.unibas.ch/>
>>> ITS-ServiceDesk: support-its(a)unibas.ch
>>> <mailto:support-its@unibas.ch> | +41 61 267 14 11
>>> <tel:+41%2061%20267%2014%2011>
>>>
>>>
>>
>> --
>>
>> *Arsène Gschwind*
>> Fa. Sapify AG im Auftrag der Universität Basel
>> IT Services
>> Klingelbergstr. 70 | CH-4056 Basel | Switzerland
>> Tel. +41 79 449 25 63 <tel:+41%2079%20449%2025%2063> |
>>
http://its.unibas.ch <
http://its.unibas.ch/>
>> ITS-ServiceDesk: support-its(a)unibas.ch
>> <mailto:support-its@unibas.ch> | +41 61 267 14 11
>> <tel:+41%2061%20267%2014%2011>
>>
>>
>
> --
>
> *Arsène Gschwind*
> Fa. Sapify AG im Auftrag der Universität Basel
> IT Services
> Klingelbergstr. 70 | CH-4056 Basel | Switzerland
> Tel. +41 79 449 25 63 <tel:+41%2079%20449%2025%2063> |
>
http://its.unibas.ch <
http://its.unibas.ch/>
> ITS-ServiceDesk: support-its(a)unibas.ch
> <mailto:support-its@unibas.ch> | +41 61 267 14 11
> <tel:+41%2061%20267%2014%2011>
>
>
--
*Arsène Gschwind*
Fa. Sapify AG im Auftrag der Universität Basel
IT Services
Klingelbergstr. 70 | CH-4056 Basel | Switzerland
Tel. +41 79 449 25 63 |
http://its.unibas.ch <
http://its.unibas.ch/>
ITS-ServiceDesk: support-its(a)unibas.ch | +41 61 267 14 11
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
*Arsène Gschwind*
Fa. Sapify AG im Auftrag der Universität Basel
IT Services
Klingelbergstr. 70 | CH-4056 Basel | Switzerland
Tel. +41 79 449 25 63 |
http://its.unibas.ch <
http://its.unibas.ch/>
ITS-ServiceDesk: support-its(a)unibas.ch | +41 61 267 14 11
--------------3BAABD5D5931B607E7102F5F
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p><br>
</p>
<br>
<div class="moz-cite-prefix">On 09/05/2017 09:02 AM, Arsène Gschwind
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:29773dd0-6381-5c51-5574-86e6c3654918@unibas.ch">
<meta http-equiv="Content-Type" content="text/html;
charset=utf-8">
<p><br>
</p>
<br>
<div class="moz-cite-prefix">On 09/04/2017 07:59 PM, Simone
Tiraboschi wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAN8-ONpazCTkxAWBTVoiPR4n=eA=7iWZtPsMMjyrTSj-aKEJuA@mail.gmail.com">
<div dir="ltr">
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Sep 4, 2017 at 7:32 PM,
Arsène Gschwind <span dir="ltr"><<a
href="mailto:arsene.gschwind@unibas.ch"
target="_blank"
moz-do-not-send="true">arsene.gschwind(a)unibas.ch</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div>
<div class="h5">
<p><br>
</p>
<br>
<div
class="m_2878385123114692158moz-cite-prefix">On
09/04/2017 06:32 PM, Simone Tiraboschi wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Sep 4, 2017
at 6:24 PM, Arsène Gschwind <span
dir="ltr"><<a
href="mailto:arsene.gschwind@unibas.ch"
target="_blank"
moz-do-not-send="true">arsene.gschwind(a)unibas.ch</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div bgcolor="#FFFFFF">
<div>
<div
class="m_2878385123114692158gmail-h5">
<p><br>
</p>
<br>
<div
class="m_2878385123114692158gmail-m_2344898123266615019moz-cite-prefix">On
09/04/2017 02:51 PM, Simone
Tiraboschi wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr"><br>
<div
class="gmail_extra"><br>
<div class="gmail_quote">On
Mon, Sep 4, 2017 at 2:21
PM, Arsène Gschwind <span
dir="ltr"><<a
href="mailto:arsene.gschwind@unibas.ch"
target="_blank"
moz-do-not-send="true">arsene.gschwind(a)unibas.ch</a>&gt;</span>
wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0px 0px
0px
0.8ex;border-left:1px
solid
rgb(204,204,204);padding-left:1ex">
<div bgcolor="#FFFFFF">
<div>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-h5">
<p><br>
</p>
<br>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465moz-cite-prefix">On
09/04/2017 02:01
PM, Simone
Tiraboschi
wrote:<br>
</div>
<blockquote
type="cite">
<div
dir="ltr"><br>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">On
Mon, Sep 4,
2017 at 1:55
PM, Arsène
Gschwind <span
dir="ltr"><<a
href="mailto:arsene.gschwind@unibas.ch" target="_blank"
moz-do-not-send="true">arsene.gschwind(a)unibas.ch</a>&gt;</span>
wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0px 0px 0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div
bgcolor="#FFFFFF">
<div>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-h5">
<p><br>
</p>
<br>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948moz-cite-prefix">On
09/04/2017
01:52 PM,
Simone
Tiraboschi
wrote:<br>
</div>
<blockquote
type="cite">
<div
dir="ltr"><br>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">On
Mon, Sep 4,
2017 at 12:23
PM, Arsène
Gschwind <span
dir="ltr"><<a
href="mailto:arsene.gschwind@unibas.ch" target="_blank"
moz-do-not-send="true">arsene.gschwind(a)unibas.ch</a>&gt;</span>
wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0px 0px 0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div
bgcolor="#FFFFFF">
<p>Hi Simone,</p>
<div>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-h5">
<br>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079moz-cite-prefix">On
09/04/2017
11:14 AM,
Simone
Tiraboschi
wrote:<br>
</div>
<blockquote
type="cite">
<div
dir="ltr"><br>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">On
Mon, Sep 4,
2017 at 10:56
AM, Arsène
Gschwind <span
dir="ltr"><<a
href="mailto:arsene.gschwind@unibas.ch" target="_blank"
moz-do-not-send="true">arsene.gschwind(a)unibas.ch</a>&gt;</span>
wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0px 0px 0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div
bgcolor="#FFFFFF">
<p>Hi Didi,<br>
</p>
<div>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-h5">
<br>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-m_-1388566559526568039moz-cite-prefix">On
09/04/2017
10:15 AM,
Yedidyah Bar
David wrote:<br>
</div>
<blockquote
type="cite">
<pre>On Mon, Sep 4, 2017
at 10:16 AM, Arsène Gschwind
<a
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-m_-1388566559526568039moz-txt-link-rfc2396E"
href="mailto:arsene.gschwind@unibas.ch" target="_blank"
moz-do-not-send="true">&lt;arsene.gschwind(a)unibas.ch&gt;</a>
wrote:
</pre>
<blockquote
type="cite">
<pre>Hi all,
A while ago I had some problem with hosted-engine network which wasn't set
correctly at deploy time, so I finally decided to redeploy the hosted engine
in the hope the network will be set correctly this time. I've followed this
procedure:
Stop all VMs
Full backup of HE DB and export to safe place
Cleanup HE storage following <a
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-m_-1388566559526568039moz-txt-link-freetext"
href="https://access.redhat.com/solutions/2121581" target="_blank"
moz-do-not-send="true">https://access.redhat.com/solu<wbr...
Reboot Hosts
Re-deploy HE until DB recovery
Recover DB adding the following param:
--he-remove-storage-vm Removes the hosted-engine storage
domain, all its entities and the hosted-engine VM during restore.
--he-remove-hosts Removes all the hosted-engine hosts
during restore.
Finalize HE deployment.
Everything did run without errors and I'm able to access Web UI.
But now I don't see my HE VM and its respective Storage Domain, the logs
says it isn't able to import it. I see all other SD and I'm able to manage
my VMs as before.
Please find attached engine.log
</pre>
</blockquote>
<pre>I think this is your
problem:
2017-09-04 03:26:14,272+02 INFO
[org.ovirt.engine.core.bll.sto<wbr>rage.domain.AddExistingBlockSt<wbr>orageDomainCommand]
(org.ovirt.thread.pool-6-threa<wbr>d-24) [2383eaa0] There are existing luns
in the system which are part of VG id
'vvIoS2-fZTZ-99Ox-Ltzq-pr8U-SL<wbr>2z-wbTU8g'</pre>
</blockquote>
</div>
</div>
I don't see a
VG with this
ID, here the
IDs I see on
the hosts:<br>
<br>
<tt>
VG <wbr>
#PV #LV #SN
Attr VSize
VFree
</tt><tt><br>
</tt><tt>
6b62cc06-fc44-4c38-af6d-bfd9cb<wbr>e73246
1 10 0
wz--n- 99.62g
14.50g</tt><tt><br>
</tt><tt>
b0414c06-d984-4001-a998-fd9a2e<wbr>79fb83
2 70 0
wz--n- 10.00t
2.31t</tt><tt><br>
</tt><tt>
b2e30961-7cff-4cca-83d6-bee3a4<wbr>f890ee
2 47 0
wz--n- 5.27t
2.50t</tt></div>
</blockquote>
<div><br>
</div>
<div><br>
</div>
<div>Could you
please repeat
the command on
host
adm-kvmh70 ?</div>
<div><br>
</div>
<div>
<div>2017-09-04
09:04:18,163+02 INFO [<a href="http://org.ovirt.engine.core.bll.st"
target="_blank"
moz-do-not-send="true">org.ovirt.engine.core.bll.st</a><wbr>orage.domain.ImportHostedEngin<wbr>eStorageDomainCommand]
(org.ovirt.thread.pool-6-threa<wbr>d-34) [247a3718] Running command:
ImportHostedEngineStorageDomai<wbr>nCommand
internal:
true.</div>
<div>2017-09-04
09:04:18,189+02 INFO
[org.ovirt.engine.core.vdsbro<wbr>ker.vdsbroker.GetVGInfoVDSComm<wbr>and]
(org.ovirt.thread.pool-6-threa<wbr>d-34) [7d2e6cb2] START,
GetVGInfoVDSCommand(HostName
= adm-kvmh70,
GetVGInfoVDSCommandParameters:<wbr>{runAsync='true',
hostId='acbacabb-6c4a-43fd-a1e<wbr>2-2d7ff2f6f98b',
VGID='vvIoS2-fZTZ-99Ox-Ltzq-pr<wbr>8U-SL2z-wbTU8g'}),
log id:
6693b98a</div>
<div>2017-09-04
09:04:18,232+02 INFO
[org.ovirt.engine.core.vdsbro<wbr>ker.vdsbroker.GetVGInfoVDSComm<wbr>and]
(org.ovirt.thread.pool-6-threa<wbr>d-34) [7d2e6cb2] FINISH,
GetVGInfoVDSCommand,
return:
[LUNs:{id='repl_HostedEngine',
physicalVolumeId='kYN8Jj-FBDw-<wbr>MhxI-XcoZ-w1zH-eQL8-IRIgzO',
volumeGroupId='vvIoS2-fZTZ-99O<wbr>x-Ltzq-pr8U-SL2z-wbTU8g',
serial='SHITACHI_OPEN-V_504888<wbr>88', lunMapping='4',
vendorId='HITACHI',
productId='OPEN-V', lunConnections='[]', deviceSize='100',
pvSize='0',
peCount='797',
peAllocatedCount='681', vendorName='HITACHI',
pathsDictionary='[sdf=true,
sdu=true,
sdk=true,
sdp=true]',
pathsCapacity='[sdf=100,
sdu=100,
sdk=100,
sdp=100]',
lunType='FCP',
status='null',
diskId='null',
diskAlias='null',
storageDomainId='6b62cc06-fc44<wbr>-4c38-af6d-bfd9cbe73246',
storageDomainName='null', discardMaxSize='268435456',
discardZeroesData='true'}],
log id:
6693b98a</div>
<div>2017-09-04
09:04:18,245+02 INFO [<a href="http://org.ovirt.engine.core.bll.st"
target="_blank"
moz-do-not-send="true">org.ovirt.engine.core.bll.st</a><wbr>orage.domain.AddExistingBlockS<wbr>torageDomainCommand]
(org.ovirt.thread.pool-6-threa<wbr>d-34) [7d2e6cb2] There are existing
luns in the
system which
are part of VG
id
'vvIoS2-fZTZ-99Ox-Ltzq-pr8U-SL<wbr>2z-wbTU8g'</div>
<div>2017-09-04
09:04:18,245+02 WARN [<a href="http://org.ovirt.engine.core.bll.st"
target="_blank"
moz-do-not-send="true">org.ovirt.engine.core.bll.st</a><wbr>orage.domain.AddExistingBlockS<wbr>torageDomainCommand]
(org.ovirt.thread.pool-6-threa<wbr>d-34) [7d2e6cb2] Validation of action
'AddExistingBlockStorageDomain<wbr>' failed for user SYSTEM. Reasons:
VAR__TYPE__STORAGE__DOMAIN,VAR<wbr>__ACTION__ADD,ACTION_TYPE_FAIL<wbr>ED_IMPORT_STORAGE_DOMAIN_EXTER<wbr>NAL_LUN_DISK_EXIST</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
I don't know
which command
you are
talking about,
I didn't run
any command
since it tries
to import the
SD
automatically.<br>
</div>
</blockquote>
<div><br>
</div>
<div>Sorry,
can you please
run vgdisplay
on adm-kvmh70
?</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
No problem!
here the
result:<br>
<br>
<tt>[root@adm-kvmh70
~]# vgs</tt><span
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-"><tt><br>
</tt><tt>
VG <wbr>
#PV #LV #SN
Attr VSize
VFree
</tt><tt><br>
</tt><tt>
6b62cc06-fc44-4c38-af6d-bfd9cb<wbr>e73246
1 10 0
wz--n-
99.62g
14.50g</tt><tt><br>
</tt><tt>
b0414c06-d984-4001-a998-fd9a2e<wbr>79fb83
2 70 0
wz--n-
10.00t
2.31t</tt><tt><br>
</tt><tt>
b2e30961-7cff-4cca-83d6-bee3a4<wbr>f890ee
2 47 0
wz--n-
5.27t
2.50t</tt><tt><br>
</tt></span><tt>
vg_adm-kvmh70 <wbr> 1 3 0 wz--n- 277.90g
218.68g</tt>
<div>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-h5"><tt><br>
</tt></div>
</div>
</div>
</blockquote>
<div><br>
</div>
<div>OK, and </div>
<div>
vgdisplay
6b62cc06-fc44-4c38-af6d-bfd9cb<wbr>e73246</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
<tt>[root@adm-kvmh70
~]# vgdisplay
6b62cc06-fc44-4c38-af6d-bfd9cb<wbr>e73246</tt><tt><br>
</tt><tt> --- Volume
group
---</tt><tt><br>
</tt><tt> VG
Name
6b62cc06-fc44-4c38-af6d-bfd9cb<wbr>e73246</tt><tt><br>
</tt><tt> System
ID
</tt><tt><br>
</tt><tt>
Format
lvm2</tt><tt><br>
</tt><tt> Metadata
Areas
2</tt><tt><br>
</tt><tt> Metadata
Sequence No
23</tt><tt><br>
</tt><tt> VG
Access
read/write</tt><tt><br>
</tt><tt> VG
Status
resizable</tt><tt><br>
</tt><tt> MAX
LV
0</tt><tt><br>
</tt><tt> Cur
LV
10</tt><tt><br>
</tt><tt> Open
LV
3</tt><tt><br>
</tt><tt> Max
PV
0</tt><tt><br>
</tt><tt> Cur
PV
1</tt><tt><br>
</tt><tt> Act
PV
1</tt><tt><br>
</tt><tt> VG
Size
99.62
GiB</tt><tt><br>
</tt><tt> PE
Size
128.00
MiB</tt><tt><br>
</tt><tt> Total
PE
797</tt><tt><br>
</tt><tt> Alloc PE /
Size 681 /
85.12
GiB</tt><tt><br>
</tt><tt> Free PE /
Size 116 /
14.50
GiB</tt><tt><br>
</tt><tt> VG
UUID
vvIoS2-fZTZ-99Ox-Ltzq-pr8U-SL2<wbr>z-wbTU8g<br>
</tt></div>
</blockquote>
<div><br>
</div>
<div>OK, vvIoS2-fZTZ-99Ox-Ltzq-pr8U<wbr>-SL2z-wbTU8g
is the uuid of the VG
that engine says that it
includes the LUN used by
the hosted-engine SD as
detected by the engine.</div>
<div>Its name
is 6b62cc06-fc44-4c38-af6d-bfd<wbr>9cbe73246
which is also the uuid
of that storage domain.</div>
<div><br>
</div>
<div>Now we need to
understand what's there.</div>
<div><br>
</div>
<div>Could you please
check if an SD with uuid
6b62cc06-fc44-4c38-af6d-bfd9cb<wbr>e73246 is visible in the engine?</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
The visible SD in the engine<br>
<tt><br>
[oVirt shell (connected)]# list
storagedomains </tt><tt><br>
</tt><tt><br>
</tt><tt>id :
072fbaa1-08f3-4a40-9f34-a5ca22<wbr>dd1d74</tt><tt><br>
</tt><tt>name :
ovirt-image-repository</tt><tt><br>
</tt><tt>description: Public Glance
repository for oVirt</tt><tt><br>
</tt><tt><br>
</tt><tt>id :
b2e30961-7cff-4cca-83d6-bee3a4<wbr>f890ee</tt><tt><br>
</tt><tt>name :
xxxxxxxxxxx</tt><tt><br>
</tt><tt><br>
</tt><tt>id :
b0414c06-d984-4001-a998-fd9a2e<wbr>79fb83</tt><tt><br>
</tt><tt>name :
xxxxxxxxxxx</tt><tt><br>
</tt><tt>description:
xxxxxxxxxxx</tt><tt><br>
</tt><tt><br>
</tt><tt>id :
71fa1c61-4a68-469f-9a56-835190<wbr>d32075</tt><tt><br>
</tt><tt>name :
xxxxxxxxxxx</tt><tt><br>
</tt><tt><br>
</tt><tt>id :
9817e64b-fdd9-4d4c-91ee-f3482b<wbr>b0cc56</tt><tt><br>
</tt><tt>name :
xxxxxxxxxxxx</tt><tt><br>
</tt><tt>description:
xxxxxxxxxxxx</tt><span
class="m_2878385123114692158gmail-"><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>Is adm-kvmh70 involved
in hosted-engine? did you
redeployed it?</div>
</div>
</div>
</div>
</blockquote>
</span> Yes adm-kvmh70 should be a
host hosting HE and yes as written
before I did redeploy HE because of a
network interface problem. I did
cleanup the lun using the RedHat
guide, redeploy HE and restore the DB
using the mentioned parameter to
remove HE information.</div>
</blockquote>
<div><br>
</div>
<div>Could you please set adm-kvmh70 to
maintenance mode from the engine and
then reactivate it or better reboot it
while in maintenance mode?</div>
<div>I suspect
that 6b62cc06-fc44-4c38-af6d-<wbr>bfd9cbe73246
is just a left over of the previous
hosted-engine storage domain kept open
on the host. <br>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
I did reboot adm-kvmh70 while in maintenance mode and
also reboot the engine but it didn't change anything.
The import failure is still there...<br>
I've noticed a ovirt-ha-agent error:<br>
<tt><br>
ovirt-ha-agent
ovirt_hosted_engine_ha.agent.<wbr>hosted_engine.HostedEngine.<wbr>config
ERROR Unable to identify the OVF_STORE volume,
falling back to initial vm.conf. Please ensure you
already added your first data domain for regular VMs<br>
<br>
</tt>Could that be related?<br>
</div>
</blockquote>
<div><br>
</div>
<div>This is just a side effects of that: the OVF_STORE
disk is going to be created by the engine once it
correctly imported the hosted-engine storage domain.</div>
<div><br>
</div>
<div>Could you please share again your up-to-date
engine.log?</div>
<div> </div>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"> Thanks
<div>
<div class="h5"><br>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
Please find the latest engine log attached.<br>
<br>
Thanks<br>
</blockquote>
When analyzing the log I do see some warning about existing LUNs
which are not part of the VG, does this means the LUNs are existing
in the DB?<br>
If yes would it be possible to remove them from the engine DB?<br>
<br>
Thanks for your help,<br>
Arsene<br>
<br>
<blockquote type="cite"
cite="mid:29773dd0-6381-5c51-5574-86e6c3654918@unibas.ch">
<blockquote type="cite"
cite="mid:CAN8-ONpazCTkxAWBTVoiPR4n=eA=7iWZtPsMMjyrTSj-aKEJuA@mail.gmail.com">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div>
<div class="h5">
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div> </div>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div bgcolor="#FFFFFF"><span
class="m_2878385123114692158gmail-"><br>
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div><br>
</div>
<div>In the past did you
tried to manually import
the hosted-engine SD or
something similar?</div>
</div>
</div>
</div>
</blockquote>
</span> No, before the "redeployment"
the HE SD was auto imported
successfully.<br>
<br>
Thanks a lot
<div>
<div
class="m_2878385123114692158gmail-h5"><br>
<br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div><br>
</div>
<div>thanks</div>
</div>
</div>
</div>
</blockquote>
<br>
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div> </div>
<blockquote
class="gmail_quote"
style="margin:0px 0px
0px
0.8ex;border-left:1px
solid
rgb(204,204,204);padding-left:1ex">
<div
bgcolor="#FFFFFF"><tt>
<br>
Thanks<br>
</tt>
<div>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-h5"><br>
<blockquote
type="cite">
<div dir="ltr">
<div
class="gmail_extra">
<div
class="gmail_quote">
<div>?</div>
<div> </div>
<blockquote
class="gmail_quote"
style="margin:0px 0px 0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div
bgcolor="#FFFFFF">
<div>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-h5"><tt>
</tt><br>
<blockquote
type="cite">
<div dir="ltr">
<div
class="gmail_extra">
<div
class="gmail_quote">
<div> </div>
<blockquote
class="gmail_quote"
style="margin:0px 0px 0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div
bgcolor="#FFFFFF">
<br>
Thanks,<br>
Arsene
<div>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-h5"><br>
<blockquote
type="cite">
<div dir="ltr">
<div
class="gmail_extra">
<div
class="gmail_quote">
<div> </div>
<blockquote
class="gmail_quote"
style="margin:0px 0px 0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div
bgcolor="#FFFFFF"><span
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-"><tt><br>
</tt><br>
<blockquote
type="cite">
<blockquote
type="cite">
<pre>Thanks for any help
to resolve that issue.
</pre>
</blockquote>
<pre>I guess you can try
to remove this disk/lun from the engine and let it retry.</pre>
</blockquote>
</span> Could
let me know
how to remove
that lun from
the engine?<span
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-"><br>
<blockquote
type="cite">
<pre>If the only disk is
of the hosted-engine, I guess it should have been
removed by '--he-remove-storage-vm' - if so, please open a bug
describing your flow in detail. Thanks.</pre>
</blockquote>
</span> It
seems that
this option
didn't remove
the he storage
information
and that this
VG is still
the old one.<br>
<br>
Many thanks
for your help<br>
Rgds,<br>
Arsene<span
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-"><br>
<blockquote
type="cite">
<pre>Best,
</pre>
<blockquote
type="cite">
<pre>Arsène
--
Arsène Gschwind
Fa. Sapify AG im Auftrag der Universität Basel
IT Services
Klingelbergstr. 70 | CH-4056 Basel | Switzerland
Tel. <a href="tel:+41%2079%20449%2025%2063" value="+41794492563"
target="_blank" moz-do-not-send="true">+41 79 449 25 63</a>
| <a
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-m_-1388566559526568039moz-txt-link-freetext"
href="http://its.unibas.ch" target="_blank"
moz-do-not-send="true">http://its.unibas.ch</a>
ITS-ServiceDesk: <a
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-m_-1388566559526568039moz-txt-link-abbreviated"
href="mailto:support-its@unibas.ch" target="_blank"
moz-do-not-send="true">support-its(a)unibas.ch</a> | <a
href="tel:+41%2061%20267%2014%2011" value="+41612671411"
target="_blank" moz-do-not-send="true">+41 61 267 14 11</a>
______________________________<wbr>_________________
Users mailing list
<a
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-m_-1388566559526568039moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org" target="_blank"
moz-do-not-send="true">Users(a)ovirt.org</a>
<a
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-m_-1388566559526568039moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank"
moz-do-not-send="true">http://lists.ovirt.org/mailman<wbr...
</pre>
</blockquote>
</blockquote>
<br>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-m_-1388566559526568039moz-signature">--
<br>
<p
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-m_-1388566559526568039western"
style="margin-bottom:0in;line-height:150%"> <font
color="#000000"><font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> <b>Arsène Gschwind</b>
</font> </font>
<font
color="#000000">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> </font> </font>
</font> <font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> </font> </font>
<font face="Tahoma,
serif"> </font>
<font
color="#000000">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> <br>
</font> </font>
</font> <font
color="#7f7f7f"> <font face="Tahoma, serif"> <font
style="font-size:8pt"
size="1"> Fa.
Sapify AG im
Auftrag der
Universität
Basel<br>
IT Services<br>
Klingelbergstr. 70 | CH-4056 Basel | Switzerland<br>
Tel. <a
href="tel:+41%2079%20449%2025%2063"
value="+41794492563" target="_blank"
moz-do-not-send="true">+41 79 449
25 63</a> |
</font> </font>
</font> <a
href="http://its.unibas.ch/"
target="_blank" moz-do-not-send="true"> <font face="Tahoma,
serif"> <font
style="font-size:8pt" size="1">
http://its.unibas.ch </font>
</font> </a><br>
<font
color="#7f7f7f">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> ITS-ServiceDesk: <a
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079gmail-m_-1388566559526568039moz-txt-link-abbreviated"
href="mailto:support-its@unibas.ch" target="_blank"
moz-do-not-send="true">support-its(a)unibas.ch</a>
| <a
href="tel:+41%2061%20267%2014%2011"
value="+41612671411" target="_blank"
moz-do-not-send="true">+41 61 267
14 11</a> </font>
</font> </font>
</font></p>
<font
color="#000000">
</font></div>
</span></div>
<br>
______________________________<wbr>_________________<br>
Users mailing
list<br>
<a
href="mailto:Users@ovirt.org"
target="_blank"
moz-do-not-send="true">Users(a)ovirt.org</a><br>
<a
href="http://lists.ovirt.org/mailman/listinfo/users"
rel="noreferrer" target="_blank"
moz-do-not-send="true">http://lists.ovirt.org/mailman<wbr...
<br>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<br>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079moz-signature">--
<br>
<p
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079western"
style="margin-bottom:0in;line-height:150%"> <font
color="#000000"><font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> <b>Arsène Gschwind</b>
</font> </font>
<font
color="#000000">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> </font> </font>
</font> <font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> </font> </font>
<font face="Tahoma,
serif"> </font>
<font
color="#000000">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> <br>
</font> </font>
</font> <font
color="#7f7f7f"> <font face="Tahoma, serif"> <font
style="font-size:8pt"
size="1"> Fa.
Sapify AG im
Auftrag der
Universität
Basel<br>
IT Services<br>
Klingelbergstr. 70 | CH-4056 Basel | Switzerland<br>
Tel. <a
href="tel:+41%2079%20449%2025%2063"
value="+41794492563" target="_blank"
moz-do-not-send="true">+41 79 449
25 63</a> |
</font> </font>
</font> <a
href="http://its.unibas.ch/"
target="_blank" moz-do-not-send="true"> <font face="Tahoma,
serif"> <font
style="font-size:8pt" size="1">
http://its.unibas.ch </font>
</font> </a><br>
<font
color="#7f7f7f">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> ITS-ServiceDesk: <a
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948gmail-m_-6999624817399485079moz-txt-link-abbreviated"
href="mailto:support-its@unibas.ch" target="_blank"
moz-do-not-send="true">support-its(a)unibas.ch</a>
| <a
href="tel:+41%2061%20267%2014%2011"
value="+41612671411" target="_blank"
moz-do-not-send="true">+41 61 267
14 11</a> </font>
</font> </font>
</font></p>
<font
color="#000000">
</font></div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<br>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948moz-signature">--
<br>
<p
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948western"
style="margin-bottom:0in;line-height:150%"> <font
color="#000000"><font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> <b>Arsène Gschwind</b>
</font> </font>
<font
color="#000000">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> </font> </font>
</font> <font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> </font> </font>
<font face="Tahoma,
serif"> </font>
<font
color="#000000">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> <br>
</font> </font>
</font> <font
color="#7f7f7f"> <font face="Tahoma, serif"> <font
style="font-size:8pt"
size="1"> Fa.
Sapify AG im
Auftrag der
Universität
Basel<br>
IT Services<br>
Klingelbergstr. 70 | CH-4056 Basel | Switzerland<br>
Tel. <a
href="tel:+41%2079%20449%2025%2063"
value="+41794492563" target="_blank"
moz-do-not-send="true">+41 79 449
25 63</a> |
</font> </font>
</font> <a
href="http://its.unibas.ch/"
target="_blank" moz-do-not-send="true"> <font face="Tahoma,
serif"> <font
style="font-size:8pt" size="1">
http://its.unibas.ch </font>
</font> </a><br>
<font
color="#7f7f7f">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> ITS-ServiceDesk: <a
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465gmail-m_-5209736991554863948moz-txt-link-abbreviated"
href="mailto:support-its@unibas.ch" target="_blank"
moz-do-not-send="true">support-its(a)unibas.ch</a>
| <a
href="tel:+41%2061%20267%2014%2011"
value="+41612671411" target="_blank"
moz-do-not-send="true">+41 61 267
14 11</a> </font>
</font> </font>
</font></p>
<font
color="#000000">
</font></div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<br>
<div
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465moz-signature">--
<br>
<p
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465western"
style="margin-bottom:0in;line-height:150%"> <font
color="#000000"><font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> <b>Arsène Gschwind</b>
</font> </font>
<font
color="#000000">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> </font> </font>
</font> <font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> </font> </font>
<font face="Tahoma,
serif"> </font>
<font
color="#000000">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> <br>
</font> </font>
</font> <font
color="#7f7f7f"> <font face="Tahoma, serif"> <font
style="font-size:8pt"
size="1"> Fa.
Sapify AG im
Auftrag der
Universität
Basel<br>
IT Services<br>
Klingelbergstr. 70 | CH-4056 Basel | Switzerland<br>
Tel. <a
href="tel:+41%2079%20449%2025%2063"
value="+41794492563" target="_blank"
moz-do-not-send="true">+41 79 449
25 63</a> |
</font> </font>
</font> <a
href="http://its.unibas.ch/"
target="_blank" moz-do-not-send="true"> <font face="Tahoma,
serif"> <font
style="font-size:8pt" size="1">
http://its.unibas.ch </font>
</font> </a><br>
<font
color="#7f7f7f">
<font
face="Tahoma,
serif"> <font
style="font-size:8pt" size="1"> ITS-ServiceDesk: <a
class="m_2878385123114692158gmail-m_2344898123266615019gmail-m_1688827238525709465moz-txt-link-abbreviated"
href="mailto:support-its@unibas.ch" target="_blank"
moz-do-not-send="true">support-its(a)unibas.ch</a>
| <a
href="tel:+41%2061%20267%2014%2011"
value="+41612671411" target="_blank"
moz-do-not-send="true">+41 61 267
14 11</a> </font>
</font> </font>
</font></p>
<font
color="#000000">
</font></div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<br>
<div
class="m_2878385123114692158gmail-m_2344898123266615019moz-signature">--
<br>
<p
class="m_2878385123114692158gmail-m_2344898123266615019western"
style="margin-bottom:0in;line-height:150%"> <font
color="#000000"><font
face="Tahoma, serif"> <font
style="font-size:8pt"
size="1"> <b>Arsène
Gschwind</b> </font>
</font> <font
color="#000000"> <font
face="Tahoma, serif">
<font
style="font-size:8pt"
size="1"> </font>
</font>
</font> <font face="Tahoma,
serif"> <font
style="font-size:8pt"
size="1"> </font>
</font>
<font face="Tahoma, serif">
</font> <font
color="#000000"> <font
face="Tahoma, serif">
<font
style="font-size:8pt"
size="1"> <br>
</font> </font> </font>
<font color="#7f7f7f">
<font
face="Tahoma, serif">
<font
style="font-size:8pt"
size="1"> Fa. Sapify
AG im Auftrag der
Universität Basel<br>
IT Services<br>
Klingelbergstr. 70 |
CH-4056 Basel |
Switzerland<br>
Tel. <a
href="tel:+41%2079%20449%2025%2063"
value="+41794492563"
target="_blank"
moz-do-not-send="true">+41
79 449 25 63</a> |
</font> </font> </font>
<a
href="http://its.unibas.ch/"
target="_blank"
moz-do-not-send="true">
<font
face="Tahoma, serif">
<font
style="font-size:8pt"
size="1">
http://its.unibas.ch </font>
</font> </a><br>
<font color="#7f7f7f">
<font
face="Tahoma, serif">
<font
style="font-size:8pt"
size="1">
ITS-ServiceDesk: <a
class="m_2878385123114692158gmail-m_2344898123266615019moz-txt-link-abbreviated"
href="mailto:support-its@unibas.ch" target="_blank"
moz-do-not-send="true">support-its(a)unibas.ch</a>
| <a
href="tel:+41%2061%20267%2014%2011"
value="+41612671411"
target="_blank"
moz-do-not-send="true">+41
61 267 14 11</a> </font>
</font> </font>
</font></p>
<font color="#000000">
</font></div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<br>
<div class="m_2878385123114692158moz-signature">--
<br>
<p class="m_2878385123114692158western"
style="margin-bottom:0in;line-height:150%">
<font
color="#000000"><font face="Tahoma,
serif">
<font style="font-size:8pt"
size="1"> <b>Arsène
Gschwind</b> </font> </font> <font
color="#000000"> <font face="Tahoma,
serif"> <font style="font-size:8pt"
size="1"> </font> </font>
</font>
<font face="Tahoma, serif"> <font
style="font-size:8pt" size="1">
</font>
</font> <font face="Tahoma, serif">
</font>
<font color="#000000"> <font
face="Tahoma,
serif"> <font style="font-size:8pt"
size="1"> <br>
</font> </font> </font> <font
color="#7f7f7f"> <font face="Tahoma,
serif"> <font style="font-size:8pt"
size="1"> Fa. Sapify AG im Auftrag der
Universität Basel<br>
IT Services<br>
Klingelbergstr. 70 | CH-4056 Basel
| Switzerland<br>
Tel. <a
href="tel:+41%2079%20449%2025%2063"
value="+41794492563"
target="_blank"
moz-do-not-send="true">+41 79 449 25
63</a> | </font> </font>
</font>
<a href="http://its.unibas.ch/"
target="_blank"
moz-do-not-send="true"> <font
face="Tahoma, serif"> <font
style="font-size:8pt" size="1">
http://its.unibas.ch </font> </font>
</a><br>
<font color="#7f7f7f"> <font
face="Tahoma,
serif"> <font style="font-size:8pt"
size="1"> ITS-ServiceDesk: <a
class="m_2878385123114692158moz-txt-link-abbreviated"
href="mailto:support-its@unibas.ch"
target="_blank"
moz-do-not-send="true">support-its(a)unibas.ch</a>
| <a
href="tel:+41%2061%20267%2014%2011"
value="+41612671411"
target="_blank"
moz-do-not-send="true">+41 61 267 14
11</a> </font> </font> </font>
</font></p>
<font color="#000000"> </font></div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<p class="western" style="margin-bottom: 0in; line-height:
150%">
<font color="#000000"><font face="Tahoma,
serif"> <font
style="font-size: 8pt" size="1"> <b>Arsène
Gschwind</b>
</font> </font> <font color="#000000"> <font
face="Tahoma, serif"> <font style="font-size:
8pt"
size="1"> </font> </font> </font>
<font
face="Tahoma, serif"> <font style="font-size:
8pt"
size="1"> </font> </font> <font
face="Tahoma, serif">
</font> <font color="#000000"> <font
face="Tahoma, serif">
<font style="font-size: 8pt" size="1">
<br>
</font> </font> </font> <font
color="#7f7f7f"> <font
face="Tahoma, serif"> <font style="font-size:
8pt"
size="1"> Fa. Sapify AG im Auftrag der Universität
Basel<br>
IT Services<br>
Klingelbergstr. 70 | CH-4056 Basel | Switzerland<br>
Tel. +41 79 449 25 63 | </font> </font> </font>
<a
href="http://its.unibas.ch/" moz-do-not-send="true">
<font
face="Tahoma, serif"> <font style="font-size:
8pt"
size="1">
http://its.unibas.ch </font> </font>
</a><br>
<font color="#7f7f7f"> <font face="Tahoma,
serif"> <font
style="font-size: 8pt" size="1"> ITS-ServiceDesk:
<a
class="moz-txt-link-abbreviated"
href="mailto:support-its@unibas.ch"
moz-do-not-send="true">support-its(a)unibas.ch</a> |
+41 61 267 14 11 </font> </font> </font>
</font></p>
<font color="#000000"> </font></div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a class="moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
</pre>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<p class="western" style="margin-bottom: 0in; line-height:
150%">
<font color="#000000"><font face="Tahoma, serif">
<font
style="font-size: 8pt" size="1"> <b>Arsène
Gschwind</b> </font>
</font>
<font color="#000000"> <font face="Tahoma,
serif"> <font
style="font-size: 8pt" size="1"> </font>
</font>
</font>
<font face="Tahoma, serif"> <font style="font-size:
8pt"
size="1"> </font>
</font>
<font face="Tahoma, serif">
</font>
<font color="#000000"> <font face="Tahoma,
serif"> <font
style="font-size: 8pt" size="1"> <br>
</font> </font>
</font>
<font color="#7f7f7f"> <font face="Tahoma,
serif"> <font
style="font-size: 8pt" size="1"> Fa. Sapify AG im
Auftrag der Universität Basel<br>
IT Services<br>
Klingelbergstr. 70 | CH-4056 Basel | Switzerland<br>
Tel. +41 79 449 25 63 | </font> </font>
</font>
<a href="http://its.unibas.ch/"> <font face="Tahoma,
serif">
<font style="font-size: 8pt" size="1">
http://its.unibas.ch </font> </font>
</a><br>
<font color="#7f7f7f"> <font face="Tahoma,
serif"> <font
style="font-size: 8pt" size="1"> ITS-ServiceDesk:
<a class="moz-txt-link-abbreviated"
href="mailto:support-its@unibas.ch">support-its@unibas.ch</a> | +41 61
267 14 11 </font> </font>
</font>
</font></p>
<font color="#000000">
</font></div>
</body>
</html>
--------------3BAABD5D5931B607E7102F5F--