VMs HA with cinder volumes
Hi all, I’ve a setup that uses Ceph through ovirt for VM storage. I tested out VM HA and all works well when IPMI is reachable. When it’s not reachable because of network or power failure VM states switch to unknown and it’s not restarted to other nodes. Is it a specific setup that I’ve missed? Thank you Regards Matteo
On Mon, Feb 20, 2017 at 12:54 PM, Matteo Dacrema <mdacrema@enter.eu> wrote:
Hi all,
I’ve a setup that uses Ceph through ovirt for VM storage. I tested out VM HA and all works well when IPMI is reachable. When it’s not reachable because of network or power failure VM states switch to unknown and it’s not restarted to other nodes.
Is it a specific setup that I’ve missed?
Hi Matteo, When power management is not available, we cannot do failover to other host. In 4.1 you can use a VM lease for your HA VM, enabling failover without power management. Note that the lease cannot be on Ceph storage domain, you will have to add other type of storage for the leases, since we don't support leases on ceph yet. Please check the vm-leases feature page for more info: https://www.ovirt.org/develop/release-management/features/storage/vm-leases/ Nir
Thank you Regards Matteo
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--Apple-Mail=_19A8F4CE-4244-4497-ADD3-F2A2958C1CAC Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi Nir, thank you. So, can I use a Ceph backed VM with a lease on gluster? Also if I detach network from the node hosting the VMs it will not = migrated to another host. Regards Matteo
Il giorno 20 feb 2017, alle ore 21:58, Nir Soffer <nsoffer@redhat.com> = ha scritto: =20 On Mon, Feb 20, 2017 at 12:54 PM, Matteo Dacrema <mdacrema@enter.eu = <mailto:mdacrema@enter.eu>> wrote: Hi all, =20 I=E2=80=99ve a setup that uses Ceph through ovirt for VM storage. I tested out VM HA and all works well when IPMI is reachable. When it=E2=80=99s not reachable because of network or power failure VM = states switch to unknown and it=E2=80=99s not restarted to other nodes. =20 Is it a specific setup that I=E2=80=99ve missed? =20 Hi Matteo, =20 When power management is not available, we cannot do failover to other = host. =20 In 4.1 you can use a VM lease for your HA VM, enabling failover = without power management. =20 Note that the lease cannot be on Ceph storage domain, you will have to = add other type of storage for the leases, since we don't support leases on = ceph yet. =20 Please check the vm-leases feature page for more info: = https://www.ovirt.org/develop/release-management/features/storage/vm-lease= s/ = <https://www.ovirt.org/develop/release-management/features/storage/vm-leas= es/> =20 Nir =20 =20 Thank you Regards Matteo =20 _______________________________________________ Users mailing list Users@ovirt.org <mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users = <http://lists.ovirt.org/mailman/listinfo/users> =20 =20 --=20 Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato = non infetto.=20 Clicca qui per segnalarlo come spam. = <http://mx01.enter.it/cgi-bin/learn-msg.cgi?id=3D39FE040254.AAC11>=20 Clicca qui per metterlo in blacklist = <http://mx01.enter.it/cgi-bin/learn-msg.cgi?blacklist=3D1&id=3D39FE040254.= AAC11>
--Apple-Mail=_19A8F4CE-4244-4497-ADD3-F2A2958C1CAC Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">Hi Nir,<div class=3D""><br class=3D""></div><div = class=3D"">thank you.</div><div class=3D"">So, can I use a Ceph backed = VM with a lease on gluster?</div><div class=3D""><br class=3D""></div><div= class=3D"">Also if I detach network from the node hosting the VMs it = will not migrated to another host.</div><div class=3D""><br = class=3D""></div><div class=3D""><br class=3D""></div><div = class=3D"">Regards</div><div class=3D"">Matteo</div><div class=3D""><div = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div id=3D"signature_old" class=3D""><div = id=3D"x230f9618d8214c5" class=3D""><div class=3D"WordSection1" = style=3D"page: WordSection1;"><div style=3D"font-family: 'Times New = Roman', serif; font-size: 12pt; margin: 0cm 0cm 0.0001pt;" = class=3D""><font face=3D"Calibri" style=3D"font-size: 11pt;" = class=3D""><br class=3D""></font></div><div style=3D"font-family: 'Times = New Roman', serif; font-size: 12pt; margin: 0cm 0cm 0.0001pt;" = class=3D""><div class=3D"" style=3D"font-family: Helvetica; font-size: = 12px;"><br = class=3D""></div></div></div></div></div></div></div></div></div></div></d= iv></div> </div> <br class=3D""><div><blockquote type=3D"cite" class=3D""><div = class=3D"">Il giorno 20 feb 2017, alle ore 21:58, Nir Soffer <<a = href=3D"mailto:nsoffer@redhat.com" class=3D"">nsoffer@redhat.com</a>> = ha scritto:</div><br class=3D"Apple-interchange-newline"><div = class=3D""><div dir=3D"ltr" class=3D""><div class=3D"gmail_extra"><div = class=3D"gmail_quote">On Mon, Feb 20, 2017 at 12:54 PM, Matteo Dacrema = <span dir=3D"ltr" class=3D""><<a href=3D"mailto:mdacrema@enter.eu" = target=3D"_blank" class=3D"">mdacrema@enter.eu</a>></span> wrote:<br = class=3D""><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px = 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi = all,<br class=3D""> <br class=3D""> I=E2=80=99ve a setup that uses Ceph through ovirt for VM storage.<br = class=3D""> I tested out VM HA and all works well when IPMI is reachable.<br = class=3D""> When it=E2=80=99s not reachable because of network or power failure VM = states switch to unknown and it=E2=80=99s not restarted to other = nodes.<br class=3D""> <br class=3D""> Is it a specific setup that I=E2=80=99ve missed?<br = class=3D""></blockquote><div class=3D""><br class=3D""></div><div = class=3D"">Hi Matteo,</div><div class=3D""><br class=3D""></div><div = class=3D"">When power management is not available, we cannot do failover = to other host.</div><div class=3D""><br class=3D""></div><div = class=3D"">In 4.1 you can use a VM lease for your HA VM, enabling = failover without power</div><div class=3D"">management.</div><div = class=3D""><br class=3D""></div><div class=3D"">Note that the lease = cannot be on Ceph storage domain, you will have to add</div><div = class=3D"">other type of storage for the leases, since we don't support = leases on ceph yet.</div><div class=3D""><br class=3D""></div><div = class=3D"">Please check the vm-leases feature page for more = info:</div><div class=3D""><a = href=3D"https://www.ovirt.org/develop/release-management/features/storage/= vm-leases/" = class=3D"">https://www.ovirt.org/develop/release-management/features/stora= ge/vm-leases/</a><br class=3D""></div><div class=3D""><br = class=3D""></div><div class=3D"">Nir</div><div = class=3D""> </div><blockquote class=3D"gmail_quote" = style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid = rgb(204,204,204);padding-left:1ex"> <br class=3D""> Thank you<br class=3D""> Regards<br class=3D""> Matteo<br class=3D""> <br class=3D""> ______________________________<wbr class=3D"">_________________<br = class=3D""> Users mailing list<br class=3D""> <a href=3D"mailto:Users@ovirt.org" class=3D"">Users@ovirt.org</a><br = class=3D""> <a href=3D"http://lists.ovirt.org/mailman/listinfo/users" = rel=3D"noreferrer" target=3D"_blank" = class=3D"">http://lists.ovirt.org/<wbr = class=3D"">mailman/listinfo/users</a><br class=3D""> </blockquote></div><br class=3D""></div></div> <br class=3D"">-- <br class=3D""><font color=3D"#999999" face=3D"Arial, Helvetica, = sans-serif" size=3D"1" class=3D""> Questo messaggio e' stato analizzato = con Libra ESVA ed e' risultato non infetto. <br class=3D""><a = href=3D"http://mx01.enter.it/cgi-bin/learn-msg.cgi?id=3D39FE040254.AAC11" = class=3D"">Clicca qui per segnalarlo come spam.</a></font> <font color=3D"#999999" face=3D"Arial, Helvetica, sans-serif" size=3D"1" = class=3D""><br class=3D""><a = href=3D"http://mx01.enter.it/cgi-bin/learn-msg.cgi?blacklist=3D1&id=3D= 39FE040254.AAC11" class=3D"">Clicca qui per metterlo in = blacklist</a></font> </div></blockquote></div><br class=3D""></div></body></html>= --Apple-Mail=_19A8F4CE-4244-4497-ADD3-F2A2958C1CAC--
On Tue, Feb 21, 2017 at 3:20 PM, Matteo Dacrema <mdacrema@enter.eu> wrote:
Hi Nir,
thank you. So, can I use a Ceph backed VM with a lease on gluster?
Should work.
Also if I detach network from the node hosting the VMs it will not migrated to another host.
If you have a lease, detaching the network used to access the leases will cause sanlock to terminate the vm and expire the lease. In this case the system should start the vm on another host. Note that if you have multiple networks, and the network used by the vm disks is different from the network used to access the leases, all this may not work in a useful way. Either the leases will not be accessible while the vm disks are accessible, leading to killing a good working vm, or the vm disk are not accessible, pausing the vm, but since the leases are still accessible, the vm will not release the lease and the system will not be able to start the vm elsewhere. Maybe you can expose some of the ceph storage using cephfs for the leases? This will make it more likely that the leases storage domain will fail when there is some issue with your ceph cluster. Another option is to expose ceph block device using iscsi, and use this iscsi storage domain for the leases. But note that this makes your iscsi gateway host a single point on failure. Nir
Il giorno 21 feb 2017, alle ore 18:26, Nir Soffer <nsoffer@redhat.com> = ha scritto: =20 On Tue, Feb 21, 2017 at 3:20 PM, Matteo Dacrema <mdacrema@enter.eu> = wrote:
Hi Nir, =20 thank you. So, can I use a Ceph backed VM with a lease on gluster? =20 Should work. =20 Also if I detach network from the node hosting the VMs it will not = migrated to another host. =20 If you have a lease, detaching the network used to access the leases = will cause sanlock to terminate the vm and expire the lease. In this case =
system should start the vm on another host. =20 Note that if you have multiple networks, and the network used by the = vm disks is different from the network used to access the leases, all =
not work in a useful way. =20 Either the leases will not be accessible while the vm disks are = accessible, leading to killing a good working vm, or the vm disk are not = accessible, pausing the vm, but since the leases are still accessible, the vm will = not release the lease and the system will not be able to start the vm = elsewhere. =20 Maybe you can expose some of the ceph storage using cephfs for the = leases? This will make it more likely that the leases storage domain will fail when there is some issue with your ceph cluster. =20 Another option is to expose ceph block device using iscsi, and use =
--Apple-Mail=_72C64DCD-D499-4420-9B77-C510AEDD3447 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Ok, it works. Thank you very much Nir. Matteo the this may this iscsi
storage domain for the leases. But note that this makes your iscsi = gateway host a single point on failure. =20 Nir _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users =20 -- Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato = non infetto. Seguire il link qui sotto per segnalarlo come spam:=20 http://mx01.enter.it/cgi-bin/learn-msg.cgi?id=3DD2CE14011D.A4808 =20 =20
--Apple-Mail=_72C64DCD-D499-4420-9B77-C510AEDD3447 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dus-ascii"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">Ok, it works.<div class=3D""><br class=3D""></div><div = class=3D"">Thank you very much Nir.</div><div class=3D""><br = class=3D""></div><div class=3D"">Matteo<br class=3D""><div class=3D""> <div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; orphans: = auto; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"font-family: Calibri; font-size: 15px;" = class=3D""><br class=3D""></div><div id=3D"signature_old" class=3D""><div = id=3D"x230f9618d8214c5" class=3D""><div class=3D"WordSection1" = style=3D"page: WordSection1;"><div style=3D"font-family: 'Times New = Roman', serif; font-size: 12pt; margin: 0cm 0cm 0.0001pt;" = class=3D""><font face=3D"Calibri" style=3D"font-size: 11pt;" = class=3D""><br class=3D""></font></div><div style=3D"font-family: 'Times = New Roman', serif; font-size: 12pt; margin: 0cm 0cm 0.0001pt;" = class=3D""><div class=3D"" style=3D"font-family: Helvetica; font-size: = 12px;"><br = class=3D""></div></div></div></div></div></div></div></div></div></div></d= iv></div></div><div style=3D""><blockquote type=3D"cite" class=3D""><div = class=3D"">Il giorno 21 feb 2017, alle ore 18:26, Nir Soffer <<a = href=3D"mailto:nsoffer@redhat.com" class=3D"">nsoffer@redhat.com</a>> = ha scritto:</div><br class=3D"Apple-interchange-newline"><div = class=3D""><div class=3D"">On Tue, Feb 21, 2017 at 3:20 PM, Matteo = Dacrema <<a href=3D"mailto:mdacrema@enter.eu" = class=3D"">mdacrema@enter.eu</a>> wrote:<br class=3D""><blockquote = type=3D"cite" class=3D"">Hi Nir,<br class=3D""><br class=3D"">thank = you.<br class=3D"">So, can I use a Ceph backed VM with a lease on = gluster?<br class=3D""></blockquote><br class=3D"">Should work.<br = class=3D""><br class=3D""><blockquote type=3D"cite" class=3D"">Also if I = detach network from the node hosting the VMs it will not migrated<br = class=3D"">to another host.<br class=3D""></blockquote><br class=3D"">If = you have a lease, detaching the network used to access the leases = will<br class=3D"">cause sanlock to terminate the vm and expire the = lease. In this case the<br class=3D"">system should start the vm on = another host.<br class=3D""><br class=3D"">Note that if you have = multiple networks, and the network used by the vm<br class=3D"">disks is = different from the network used to access the leases, all this may<br = class=3D"">not work in a useful way.<br class=3D""><br class=3D"">Either = the leases will not be accessible while the vm disks are accessible,<br = class=3D"">leading to killing a good working vm, or the vm disk are not = accessible,<br class=3D"">pausing the vm, but since the leases are still = accessible, the vm will not<br class=3D"">release the lease and the = system will not be able to start the vm elsewhere.<br class=3D""><br = class=3D"">Maybe you can expose some of the ceph storage using cephfs = for the leases?<br class=3D"">This will make it more likely that the = leases storage domain will fail<br class=3D"">when there<br class=3D"">is = some issue with your ceph cluster.<br class=3D""><br class=3D"">Another = option is to expose ceph block device using iscsi, and use this iscsi<br = class=3D"">storage domain for the leases. But note that this makes your = iscsi gateway<br class=3D"">host a single point on failure.<br = class=3D""><br class=3D"">Nir<br = class=3D"">_______________________________________________<br = class=3D"">Users mailing list<br class=3D""><a = href=3D"mailto:Users@ovirt.org" class=3D"">Users@ovirt.org</a><br = class=3D"">http://lists.ovirt.org/mailman/listinfo/users<br class=3D""><br= class=3D"">--<br class=3D"">Questo messaggio e' stato analizzato con = Libra ESVA ed e' risultato non infetto.<br class=3D"">Seguire il link = qui sotto per segnalarlo come spam: <br = class=3D"">http://mx01.enter.it/cgi-bin/learn-msg.cgi?id=3DD2CE14011D.A480= 8<br class=3D""><br class=3D""><br = class=3D""></div></div></blockquote></div><br = class=3D""></div></body></html>= --Apple-Mail=_72C64DCD-D499-4420-9B77-C510AEDD3447--
participants (2)
-
Matteo Dacrema -
Nir Soffer