[ovirt-users] Moving Hosted Engine NFS storage domain
Simone Tiraboschi
stirabos at redhat.com
Fri Jun 3 08:56:31 EDT 2016
On Fri, Jun 3, 2016 at 1:46 PM, Beard Lionel (BOSTON-STORAGE)
<lbeard at cls.fr> wrote:
> Hi,
>
> Ok, after updating the DB, it is now fine:
> # update storage_server_connections set connection='<NEW NFS EXPORT>' where id='<HOSTED_STORAGE_ID>';
Nice to hear
> But (because there is always a 'but'), I still have an issue when I reboot host where Hosted VM runs, I have to do a:
> # hosted-engine --clean-metadata
> In order to have Hosted VM starts.
> Else, the error I have is:
> sanlock[1268]: 2016-06-03 11:45:15+0000 5973 [1273]: r3 cmd_acquire 2,8,3274 invalid lockspace found -1 failed 0 name ab7ce50d-238a-4f4f-a36e-8d06e276ae4b
> libvirtd[2586]: Failed to acquire lock: No space left on device
I suspect that this is a side effect of this bug:
https://bugzilla.redhat.com/1322849
Under certain circumstances we could have a mismatch between the host
id as saw by ha-agent and the spm_id used by the engine.
Can you please execute this query
SELECT vds_spm_id_map.vds_spm_id, vds.vds_name FROM vds_spm_id_map,
vds WHERE vds_spm_id_map.vds_id = vds.vds_id;
to check the spm_id of your host in the DB comparing its output with
the output of
grep host_id /etc/ovirt-hosted-engine/hosted-engine.conf
run on each involved host?
If you find any mismatching id you have to change
/etc/ovirt-hosted-engine/hosted-engine.conf to reflect the engine
spm_id and reboot the host.
> Regards,
> Lionel BEARD
> 05.61.39.39.19
>
>> -----Message d'origine-----
>> De : Simone Tiraboschi [mailto:stirabos at redhat.com]
>> Envoyé : vendredi 3 juin 2016 10:26
>> À : Beard Lionel (BOSTON-STORAGE) <lbeard at cls.fr>
>> Cc : users <users at ovirt.org>
>> Objet : Re: [ovirt-users] Moving Hosted Engine NFS storage domain
>>
>> On Thu, Jun 2, 2016 at 5:33 PM, Beard Lionel (BOSTON-STORAGE)
>> <lbeard at cls.fr> wrote:
>> > Hi,
>> >
>> >
>> >
>> > I have tried these steps :
>> >
>> > - Stop Hosted VM
>> >
>> > - # vdsClient -s localhost forcedDetachStorageDomain
>> > <hosted_storage domain>
>> >
>> > - Domain is now detached
>> >
>> > - # hosted-storage –clean-metadata
>> >
>> > - # hosted-storage –vm-start
>> >
>> >
>> >
>> > But, hosted domain path is still the old one.
>> >
>> > If I run :
>> >
>> > # vdsClient -s localhost getStorageDomainsList <hosted_storage domain>
>> >
>> > The path is correct !!
>> >
>> >
>> >
>> > So I don’t know where the wrong path is stored.
>>
>> If the engine imported the hosted-engine storage domain in the past, that
>> storage domain is in the engine DB with the wrong path.
>> If you bring down everything and reboot your hosts, ovirt-ha-agent will
>> mount the hosted-engine-storage domain with the new path under hosted-
>> engine.conf.
>> At this point ovirt-ha-agent can start the engine VM. When the engine will
>> come up it will try to mount all the storage domain in the datacenter as for
>> regular hosts. This will mean that it will try to remount also the hosted-engine
>> storage domain (cause the domain uuid is the same!) from the old path since
>> it's still configured like that in the engine DB.
>>
>> > I think the only way is to reinstall Hosted VM from scratch.
>>
>> You can try to manually force a new path in the DB.
>>
>> > @ Staniforth Paul, your procedure is not working L
>> >
>> >
>> >
>> > Regards,
>> >
>> > Lionel BEARD
>> >
>> >
>> >
>> > De : Beard Lionel (BOSTON-STORAGE)
>> > Envoyé : mercredi 1 juin 2016 22:26
>> > À : 'Roy Golan' <rgolan at redhat.com>
>> > Cc : Roman Mohr <rmohr at redhat.com>; users <users at ovirt.org> Objet :
>> > RE: [ovirt-users] Moving Hosted Engine NFS storage domain
>> >
>> >
>> >
>> > Hi,
>> >
>> >
>> >
>> > Path is neither shared not mounted anymore on previous NFS server, but
>> > storage domain is still up and cannot be removed…
>> >
>> >
>> >
>> > Is there a possibility to remove it from command line ?
>> >
>> >
>> >
>> > Regards,
>> >
>> > Lionel BEARD
>> >
>> >
>> >
>> > De : Roy Golan [mailto:rgolan at redhat.com] Envoyé : mercredi 1 juin
>> > 2016 20:57 À : Beard Lionel (BOSTON-STORAGE) <lbeard at cls.fr> Cc :
>> > Roman Mohr <rmohr at redhat.com>; users <users at ovirt.org>
>> >
>> >
>> > Objet : Re: [ovirt-users] Moving Hosted Engine NFS storage domain
>> >
>> >
>> >
>> >
>> > On Jun 1, 2016 7:19 PM, "Beard Lionel (BOSTON-STORAGE)"
>> > <lbeard at cls.fr>
>> > wrote:
>> >>
>> >> Hi,
>> >>
>> >> I am not able to do that, "Remove" button is greyed.
>> >> And it is not possible to place it into maintenance mode because
>> >> hosted VM is running on it...
>> >>
>> >> Any clue?
>> >>
>> >
>> > You must create a situation where vdsm would fail to monitor that domain.
>> > I.e stop sharing that path or block it and then the status will allow
>> > you to force remove
>> >
>> >> Thanks.
>> >>
>> >> Regards,
>> >> Lionel BEARD
>> >>
>> >> > -----Message d'origine-----
>> >> > De : Roman Mohr [mailto:rmohr at redhat.com] Envoyé : mercredi 1 juin
>> >> > 2016 14:43 À : Beard Lionel (BOSTON-STORAGE) <lbeard at cls.fr> Cc :
>> >> > Staniforth, Paul <P.Staniforth at leedsbeckett.ac.uk>; users at ovirt.org
>> >> > Objet : Re: [ovirt-users] Moving Hosted Engine NFS storage domain
>> >> >
>> >> > On Wed, Jun 1, 2016 at 2:40 PM, Beard Lionel (BOSTON-STORAGE)
>> >> > <lbeard at cls.fr> wrote:
>> >> > > Hi,
>> >> > >
>> >> > >
>> >> > >
>> >> > > I have followed these steps :
>> >> > >
>> >> > >
>> >> > >
>> >> > > - Stop supervdsmd + vdsmd + ovirt-ha-agent + ovirt-ha-broker
>> >> > >
>> >> > > - Modify config file
>> >> > >
>> >> > > - Copy files (cp better handles sparse files than rsync)
>> >> > >
>> >> > > - Umount old hosted-engine path
>> >> > >
>> >> > > - Restart services
>> >> > >
>> >> > > - Hosted VM doesn’t start => hosted-engine –clean-metadata. I
>> >> > > get
>> >> > > an error at the end, but now I am able to start Hosted VM :
>> >> > >
>> >> > > o
>> >> >
>> ERROR:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Metad
>> >> > ata
>> >> > > for current host missing.
>> >> > >
>> >> > >
>> >> > >
>> >> > > I can connect to oVirt interface, everything seems to be working
>> >> > > fine, but the Hosted storage domain has an incorrect path, it is
>> >> > > still pointing to old one… I think this information is not
>> >> > > correctly reported by web interface, because this path doesn’t
>> >> > > exist anymore, and
>> >> > hosted VM is working !
>> >> > >
>> >> > > Does anyone knows how to fix that ?
>> >> >
>> >> > You have to do a "force remove" in the UI (without clicking the
>> >> > destroy
>> >> > checkbox) of that storage. Then it should be reimported automatically.
>> >> >
>> >> > >
>> >> > >
>> >> > >
>> >> > > Regards,
>> >> > >
>> >> > > Lionel BEARD
>> >> > >
>> >> > >
>> >> > >
>> >> > > De : Beard Lionel (BOSTON-STORAGE) Envoyé : mercredi 1 juin 2016
>> >> > > 10:37 À : 'Staniforth, Paul' <P.Staniforth at leedsbeckett.ac.uk>;
>> >> > > users at ovirt.org Objet : RE: Moving Hosted Engine NFS storage
>> >> > > domain
>> >> > >
>> >> > >
>> >> > >
>> >> > > Hi,
>> >> > >
>> >> > >
>> >> > >
>> >> > > I’m trying to move Hosted storage from one NFS server to another.
>> >> > >
>> >> > > As this is not a production environment, so I gave a try with no
>> >> > > success, with a plan similar to yours.
>> >> > >
>> >> > >
>> >> > >
>> >> > > But I don’t like to stay on a failure, so I will give a second
>> >> > > chance by following your plan J
>> >> > >
>> >> > >
>> >> > >
>> >> > > Regards,
>> >> > >
>> >> > > Lionel BEARD
>> >> > >
>> >> > >
>> >> > >
>> >> > > De : users-bounces at ovirt.org [mailto:users-bounces at ovirt.org] De
>> >> > > la part de Staniforth, Paul Envoyé : mardi 31 mai 2016 13:33 À :
>> >> > > users at ovirt.org Objet : [ovirt-users] Moving Hosted Engine NFS
>> >> > > storage domain
>> >> > >
>> >> > >
>> >> > >
>> >> > > Hello,
>> >> > >
>> >> > > we would like to move our NFS storage used for the
>> >> > > HostedEngine.
>> >> > >
>> >> > >
>> >> > >
>> >> > > Plan would be
>> >> > >
>> >> > > enable global maintenance
>> >> > > shut-down HostedEngine VM
>> >> > > edit /etc/ovirt-hosted-engine/hosted-engine.conf on hosts
>> >> > >
>> >> > > storage=newnfs:/newnfsvolume
>> >> > >
>> >> > > copy storage domain from old to new nfs server start HostedEngine
>> >> > > VM run engine-setup on HostedEngine VM disable global
>> maintenance
>> >> > >
>> >> > > Has anyone had any experience doing this?
>> >> > >
>> >> > > Have I missed any steps out
>> >> > >
>> >> > > we are currently running oVirt 3.6.2
>> >> > >
>> >> > >
>> >> > >
>> >> > > Thanks,
>> >> > >
>> >> > > Paul S.
>> >> > >
>> >> > > To view the terms under which this email is distributed, please
>> >> > > go
>> >> > > to:-
>> >> > > http://disclaimer.leedsbeckett.ac.uk/disclaimer/disclaimer.html
>> >> > >
>> >> > >
>> >> > >
>> >> > > Cliquez ici si ce message est indésirable (pourriel).
>> >> > >
>> >> > > ________________________________
>> >> > >
>> >> > > Ce message et toutes les pièces jointes (ci-après le "message")
>> >> > > sont établis à l'intention exclusive de ses destinataires et sont
>> >> > > confidentiels. Si vous recevez ce message par erreur ou s'il ne
>> >> > > vous est pas destiné, merci de le détruire ainsi que toute copie
>> >> > > de votre système et d'en avertir immédiatement l'expéditeur.
>> >> > > Toute lecture non autorisée, toute utilisation de ce message qui
>> >> > > n'est pas conforme à sa destination, toute diffusion ou toute
>> >> > > publication, totale ou partielle, est interdite. L'Internet ne
>> >> > > permettant pas d'assurer l'intégrité de ce message électronique
>> >> > > susceptible d'altération, l’expéditeur (et ses filiales)
>> >> > > décline(nt) toute responsabilité au titre de ce message dans
>> >> > > l'hypothèse où il aurait été modifié ou falsifié.
>> >> > >
>> >> > > This message and any attachments (the "message") is intended
>> >> > > solely for the intended recipient(s) and is confidential. If you
>> >> > > receive this message in error, or are not the intended
>> >> > > recipient(s), please delete it and any copies from your systems and
>> immediately notify the sender.
>> >> > > Any unauthorized view, use that does not comply with its purpose,
>> >> > > dissemination or disclosure, either whole or partial, is prohibited.
>> >> > > Since the internet cannot guarantee the integrity of this message
>> >> > > which may not be reliable, the sender (and its
>> >> > > subsidiaries) shall not be liable for the message if modified or
>> >> > > falsified.
>> >> > >
>> >> > >
>> >> > > _______________________________________________
>> >> > > Users mailing list
>> >> > > Users at ovirt.org
>> >> > > http://lists.ovirt.org/mailman/listinfo/users
>> >> > >
>> >> >
>> >> >
>> >> > Cliquez sur l'url suivante
>> >> > https://www.mailcontrol.com/sr/MZbqvYs5QwJvpeaetUwhCQ==>
>> >> > D7TB62Cn6PKcION4iTgzmN8g8n3FFQ!imaKNoOdFPhlMob8Srs06FQ==
>> >> > si ce message est indésirable (pourriel).
>> >> ________________________________
>> >>
>> >> Ce message et toutes les pièces jointes (ci-après le "message") sont
>> >> établis à l'intention exclusive de ses destinataires et sont confidentiels.
>> >> Si vous recevez ce message par erreur ou s'il ne vous est pas
>> >> destiné, merci de le détruire ainsi que toute copie de votre système
>> >> et d'en avertir immédiatement l'expéditeur. Toute lecture non
>> >> autorisée, toute utilisation de ce message qui n'est pas conforme à
>> >> sa destination, toute diffusion ou toute publication, totale ou
>> >> partielle, est interdite. L'Internet ne permettant pas d'assurer
>> >> l'intégrité de ce message électronique susceptible d'altération,
>> >> l’expéditeur (et ses filiales) décline(nt) toute responsabilité au
>> >> titre de ce message dans l'hypothèse où il aurait été modifié ou falsifié.
>> >>
>> >> This message and any attachments (the "message") is intended solely
>> >> for the intended recipient(s) and is confidential. If you receive
>> >> this message in error, or are not the intended recipient(s), please
>> >> delete it and any copies from your systems and immediately notify the
>> >> sender. Any unauthorized view, use that does not comply with its
>> >> purpose, dissemination or disclosure, either whole or partial, is
>> >> prohibited. Since the internet cannot guarantee the integrity of this
>> >> message which may not be reliable, the sender (and its subsidiaries)
>> >> shall not be liable for the message if modified or falsified.
>> >> _______________________________________________
>> >> Users mailing list
>> >> Users at ovirt.org
>> >> http://lists.ovirt.org/mailman/listinfo/users
>> >
>> > ________________________________
>> >
>> > Ce message et toutes les pièces jointes (ci-après le "message") sont
>> > établis à l'intention exclusive de ses destinataires et sont
>> > confidentiels. Si vous recevez ce message par erreur ou s'il ne vous
>> > est pas destiné, merci de le détruire ainsi que toute copie de votre
>> > système et d'en avertir immédiatement l'expéditeur. Toute lecture non
>> > autorisée, toute utilisation de ce message qui n'est pas conforme à sa
>> > destination, toute diffusion ou toute publication, totale ou
>> > partielle, est interdite. L'Internet ne permettant pas d'assurer
>> > l'intégrité de ce message électronique susceptible d'altération,
>> > l’expéditeur (et ses filiales) décline(nt) toute responsabilité au
>> > titre de ce message dans l'hypothèse où il aurait été modifié ou falsifié.
>> >
>> > This message and any attachments (the "message") is intended solely
>> > for the intended recipient(s) and is confidential. If you receive this
>> > message in error, or are not the intended recipient(s), please delete
>> > it and any copies from your systems and immediately notify the sender.
>> > Any unauthorized view, use that does not comply with its purpose,
>> > dissemination or disclosure, either whole or partial, is prohibited.
>> > Since the internet cannot guarantee the integrity of this message
>> > which may not be reliable, the sender (and its
>> > subsidiaries) shall not be liable for the message if modified or falsified.
>> >
>> >
>> > _______________________________________________
>> > Users mailing list
>> > Users at ovirt.org
>> > http://lists.ovirt.org/mailman/listinfo/users
>> >
>>
>>
>> Cliquez sur l'url suivante
>> https://www.mailcontrol.com/sr/leFyNe+9!13GX2PQPOmvUpFBc4ZD8M8Uv
>> x5sVcXf6fcpuUS7rj3i6KO+fzlt347ardR1V8kkCS2zR1Lppn2zgQ==
>> si ce message est indésirable (pourriel).
> ________________________________
>
> Ce message et toutes les pièces jointes (ci-après le "message") sont établis à l'intention exclusive de ses destinataires et sont confidentiels. Si vous recevez ce message par erreur ou s'il ne vous est pas destiné, merci de le détruire ainsi que toute copie de votre système et d'en avertir immédiatement l'expéditeur. Toute lecture non autorisée, toute utilisation de ce message qui n'est pas conforme à sa destination, toute diffusion ou toute publication, totale ou partielle, est interdite. L'Internet ne permettant pas d'assurer l'intégrité de ce message électronique susceptible d'altération, l’expéditeur (et ses filiales) décline(nt) toute responsabilité au titre de ce message dans l'hypothèse où il aurait été modifié ou falsifié.
>
> This message and any attachments (the "message") is intended solely for the intended recipient(s) and is confidential. If you receive this message in error, or are not the intended recipient(s), please delete it and any copies from your systems and immediately notify the sender. Any unauthorized view, use that does not comply with its purpose, dissemination or disclosure, either whole or partial, is prohibited. Since the internet cannot guarantee the integrity of this message which may not be reliable, the sender (and its subsidiaries) shall not be liable for the message if modified or falsified.
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
More information about the Users
mailing list