11:54 a.m.
Hi all,
I’ve a setup that uses Ceph through ovirt for VM storage.
I tested out VM HA and all works well when IPMI is reachable.
When it’s not reachable because of network or power failure VM states switch to unknown
and it’s not restarted to other nodes.
Is it a specific setup that I’ve missed?
Thank you
Regards
Matteo
9:58 p.m.
On Mon, Feb 20, 2017 at 12:54 PM, Matteo Dacrema <mdacrema(a)enter.eu> wrote:
Hi Matteo,
When power management is not available, we cannot do failover to other host.
In 4.1 you can use a VM lease for your HA VM, enabling failover without
power
management.
Note that the lease cannot be on Ceph storage domain, you will have to add
other type of storage for the leases, since we don't support leases on ceph
yet.
Please check the vm-leases feature page for more info:
https://www.ovirt.org/develop/release-management/features/storage/vm-leases/
Nir
2:20 p.m.
--Apple-Mail=_19A8F4CE-4244-4497-ADD3-F2A2958C1CAC
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8
Hi Nir,
thank you.
So, can I use a Ceph backed VM with a lease on gluster?
Also if I detach network from the node hosting the VMs it will not =
migrated to another host.
Regards
Matteo
Il giorno 20 feb 2017, alle ore 21:58, Nir Soffer
<nsoffer(a)redhat.com> =
ha scritto:
=20
On Mon, Feb 20, 2017 at 12:54 PM, Matteo Dacrema <mdacrema(a)enter.eu =
<mailto:mdacrema@enter.eu>> wrote:
states
switch to unknown and it=E2=80=99s not restarted to other nodes.
host.
=20
In 4.1 you can use a VM lease for your HA VM, enabling failover =
without power
management.
=20
Note that the lease cannot be on Ceph storage domain, you will have to =
add
other type of storage for the leases, since we don't support
leases on =
ceph yet.
=20
Please check the vm-leases feature page for more info:
=
https://www.ovirt.org/develop/release-management/features/storage/vm-lease=
s/ =
<https://www.ovirt.org/develop/release-management/features/storage/vm-leas=
es/>
<http://lists.ovirt.org/mailman/listinfo/users>
non
infetto.=20
Clicca qui per segnalarlo come spam. =
<http://mx01.enter.it/cgi-bin/learn-msg.cgi?id=3D39FE040254.AAC11>=20
Clicca qui per metterlo in blacklist =
<http://mx01.enter.it/cgi-bin/learn-msg.cgi?blacklist=3D1&id=3D39FE040...
AAC11>
--Apple-Mail=_19A8F4CE-4244-4497-ADD3-F2A2958C1CAC
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=utf-8
<html><head><meta http-equiv=3D"Content-Type"
content=3D"text/html =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D"">Hi Nir,<div class=3D""><br
class=3D""></div><div =
class=3D"">thank you.</div><div class=3D"">So, can I
use a Ceph backed =
VM with a lease on gluster?</div><div class=3D""><br
class=3D""></div><div=
class=3D"">Also if I detach network from the node hosting the VMs it =
will not migrated to another host.</div><div class=3D""><br =
class=3D""></div><div class=3D""><br
class=3D""></div><div =
class=3D"">Regards</div><div
class=3D"">Matteo</div><div class=3D""><div =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div id=3D"signature_old"
class=3D""><div =
id=3D"x230f9618d8214c5" class=3D""><div
class=3D"WordSection1" =
style=3D"page: WordSection1;"><div style=3D"font-family: 'Times
New =
Roman', serif; font-size: 12pt; margin: 0cm 0cm 0.0001pt;" =
class=3D""><font face=3D"Calibri" style=3D"font-size:
11pt;" =
class=3D""><br class=3D""></font></div><div
style=3D"font-family: 'Times =
New Roman', serif; font-size: 12pt; margin: 0cm 0cm 0.0001pt;" =
class=3D""><div class=3D"" style=3D"font-family: Helvetica;
font-size: =
12px;"><br =
class=3D""></div></div></div></div></div></div></div></div></div></div></d=
iv></div>
</div>
<br class=3D""><div><blockquote type=3D"cite"
class=3D""><div =
class=3D"">Il giorno 20 feb 2017, alle ore 21:58, Nir Soffer <<a =
href=3D"mailto:nsoffer@redhat.com"
class=3D"">nsoffer(a)redhat.com</a>&gt; =
ha scritto:</div><br class=3D"Apple-interchange-newline"><div =
class=3D""><div dir=3D"ltr" class=3D""><div
class=3D"gmail_extra"><div =
class=3D"gmail_quote">On Mon, Feb 20, 2017 at 12:54 PM, Matteo Dacrema =
<span dir=3D"ltr" class=3D""><<a
href=3D"mailto:mdacrema@enter.eu" =
target=3D"_blank"
class=3D"">mdacrema(a)enter.eu</a>&gt;</span> wrote:<br =
class=3D""><blockquote class=3D"gmail_quote"
style=3D"margin:0px 0px 0px =
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi =
all,<br class=3D"">
<br class=3D"">
I=E2=80=99ve a setup that uses Ceph through ovirt for VM storage.<br =
class=3D"">
I tested out VM HA and all works well when IPMI is reachable.<br =
class=3D"">
When it=E2=80=99s not reachable because of network or power failure VM =
states switch to unknown and it=E2=80=99s not restarted to other =
nodes.<br class=3D"">
<br class=3D"">
Is it a specific setup that I=E2=80=99ve missed?<br =
class=3D""></blockquote><div class=3D""><br
class=3D""></div><div =
class=3D"">Hi Matteo,</div><div class=3D""><br
class=3D""></div><div =
class=3D"">When power management is not available, we cannot do failover =
to other host.</div><div class=3D""><br
class=3D""></div><div =
class=3D"">In 4.1 you can use a VM lease for your HA VM, enabling =
failover without power</div><div
class=3D"">management.</div><div =
class=3D""><br class=3D""></div><div
class=3D"">Note that the lease =
cannot be on Ceph storage domain, you will have to add</div><div =
class=3D"">other type of storage for the leases, since we don't support
=
leases on ceph yet.</div><div class=3D""><br
class=3D""></div><div =
class=3D"">Please check the vm-leases feature page for more =
info:</div><div class=3D""><a =
href=3D"https://www.ovirt.org/develop/release-management/features/st...
vm-leases/" =
class=3D"">https://www.ovirt.org/develop/release-management/...
ge/vm-leases/</a><br class=3D""></div><div
class=3D""><br =
class=3D""></div><div class=3D"">Nir</div><div
=
class=3D""> </div><blockquote
class=3D"gmail_quote" =
style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid =
rgb(204,204,204);padding-left:1ex">
<br class=3D"">
Thank you<br class=3D"">
Regards<br class=3D"">
Matteo<br class=3D"">
<br class=3D"">
______________________________<wbr class=3D"">_________________<br =
class=3D"">
Users mailing list<br class=3D"">
<a href=3D"mailto:Users@ovirt.org"
class=3D"">Users(a)ovirt.org</a><br =
class=3D"">
<a href=3D"http://lists.ovirt.org/mailman/listinfo/users" =
rel=3D"noreferrer" target=3D"_blank" =
class=3D"">http://lists.ovirt.org/<wbr =
class=3D"">mailman/listinfo/users</a><br class=3D"">
</blockquote></div><br class=3D""></div></div>
<br class=3D"">--
<br class=3D""><font color=3D"#999999" face=3D"Arial,
Helvetica, =
sans-serif" size=3D"1" class=3D""> Questo messaggio e'
stato analizzato =
con Libra ESVA ed e' risultato non infetto.
<br class=3D""><a =
href=3D"http://mx01.enter.it/cgi-bin/learn-msg.cgi?id=3D39FE040254.AAC11" =
class=3D"">Clicca qui per segnalarlo come spam.</a></font>
<font color=3D"#999999" face=3D"Arial, Helvetica, sans-serif"
size=3D"1" =
class=3D""><br class=3D""><a =
href=3D"http://mx01.enter.it/cgi-bin/learn-msg.cgi?blacklist=3D1&id=3D=
39FE040254.AAC11" class=3D"">Clicca qui per metterlo in =
blacklist</a></font>
</div></blockquote></div><br
class=3D""></div></body></html>=
--Apple-Mail=_19A8F4CE-4244-4497-ADD3-F2A2958C1CAC--
6:26 p.m.
On Tue, Feb 21, 2017 at 3:20 PM, Matteo Dacrema <mdacrema(a)enter.eu> wrote:
Should work.
Also if I detach network from the node hosting the VMs it will not
migrated
to another host.
If you have a lease, detaching the network used to access the leases will
cause sanlock to terminate the vm and expire the lease. In this case the
system should start the vm on another host.
Note that if you have multiple networks, and the network used by the vm
disks is different from the network used to access the leases, all this may
not work in a useful way.
Either the leases will not be accessible while the vm disks are accessible,
leading to killing a good working vm, or the vm disk are not accessible,
pausing the vm, but since the leases are still accessible, the vm will not
release the lease and the system will not be able to start the vm elsewhere.
Maybe you can expose some of the ceph storage using cephfs for the leases?
This will make it more likely that the leases storage domain will fail
when there
is some issue with your ceph cluster.
Another option is to expose ceph block device using iscsi, and use this iscsi
storage domain for the leases. But note that this makes your iscsi gateway
host a single point on failure.
Nir
11:20 a.m.
--Apple-Mail=_72C64DCD-D499-4420-9B77-C510AEDD3447
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=us-ascii
Ok, it works.
Thank you very much Nir.
Matteo
Il giorno 21 feb 2017, alle ore 18:26, Nir Soffer
<nsoffer(a)redhat.com> =
ha scritto:
=20
On Tue, Feb 21, 2017 at 3:20 PM, Matteo Dacrema <mdacrema(a)enter.eu> =
wrote:
migrated
> to another host.
=20
If you have a lease, detaching the network used to access the leases =
will
cause sanlock to terminate the vm and expire the lease. In this case
=
the
system should start the vm on another host.
=20
Note that if you have multiple networks, and the network used by the =
vm
disks is different from the network used to access the leases, all =
this may
not work in a useful way.
=20
Either the leases will not be accessible while the vm disks are =
accessible,
leading to killing a good working vm, or the vm disk are not =
accessible,
pausing the vm, but since the leases are still accessible, the vm
will =
not
release the lease and the system will not be able to start the vm =
elsewhere.
=20
Maybe you can expose some of the ceph storage using cephfs for the =
leases?
this iscsi
storage domain for the leases. But note that this makes your iscsi =
gateway
non
infetto.
--Apple-Mail=_72C64DCD-D499-4420-9B77-C510AEDD3447
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=us-ascii
<html><head><meta http-equiv=3D"Content-Type"
content=3D"text/html =
charset=3Dus-ascii"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D"">Ok, it works.<div class=3D""><br
class=3D""></div><div =
class=3D"">Thank you very much Nir.</div><div
class=3D""><br =
class=3D""></div><div class=3D"">Matteo<br
class=3D""><div class=3D"">
<div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; orphans: =
auto; text-align: start; text-indent: 0px; text-transform: none; =
white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal;
=
orphans: auto; text-align: start; text-indent: 0px; text-transform: =
none; white-space: normal; widows: auto; word-spacing: 0px; =
-webkit-text-stroke-width: 0px; word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"font-family: Calibri; font-size: 15px;"
=
class=3D""><br class=3D""></div><div
id=3D"signature_old" class=3D""><div =
id=3D"x230f9618d8214c5" class=3D""><div
class=3D"WordSection1" =
style=3D"page: WordSection1;"><div style=3D"font-family: 'Times
New =
Roman', serif; font-size: 12pt; margin: 0cm 0cm 0.0001pt;" =
class=3D""><font face=3D"Calibri" style=3D"font-size:
11pt;" =
class=3D""><br class=3D""></font></div><div
style=3D"font-family: 'Times =
New Roman', serif; font-size: 12pt; margin: 0cm 0cm 0.0001pt;" =
class=3D""><div class=3D"" style=3D"font-family: Helvetica;
font-size: =
12px;"><br =
class=3D""></div></div></div></div></div></div></div></div></div></div></d=
iv></div></div><div style=3D""><blockquote
type=3D"cite" class=3D""><div =
class=3D"">Il giorno 21 feb 2017, alle ore 18:26, Nir Soffer <<a =
href=3D"mailto:nsoffer@redhat.com"
class=3D"">nsoffer(a)redhat.com</a>&gt; =
ha scritto:</div><br class=3D"Apple-interchange-newline"><div =
class=3D""><div class=3D"">On Tue, Feb 21, 2017 at 3:20 PM,
Matteo =
Dacrema <<a href=3D"mailto:mdacrema@enter.eu" =
class=3D"">mdacrema(a)enter.eu</a>&gt; wrote:<br
class=3D""><blockquote =
type=3D"cite" class=3D"">Hi Nir,<br
class=3D""><br class=3D"">thank =
you.<br class=3D"">So, can I use a Ceph backed VM with a lease on =
gluster?<br class=3D""></blockquote><br
class=3D"">Should work.<br =
class=3D""><br class=3D""><blockquote
type=3D"cite" class=3D"">Also if I =
detach network from the node hosting the VMs it will not migrated<br =
class=3D"">to another host.<br
class=3D""></blockquote><br class=3D"">If =
you have a lease, detaching the network used to access the leases =
will<br class=3D"">cause sanlock to terminate the vm and expire the =
lease. In this case the<br class=3D"">system should start the vm on =
another host.<br class=3D""><br class=3D"">Note that if
you have =
multiple networks, and the network used by the vm<br class=3D"">disks is
=
different from the network used to access the leases, all this may<br =
class=3D"">not work in a useful way.<br class=3D""><br
class=3D"">Either =
the leases will not be accessible while the vm disks are accessible,<br =
class=3D"">leading to killing a good working vm, or the vm disk are not =
accessible,<br class=3D"">pausing the vm, but since the leases are still
=
accessible, the vm will not<br class=3D"">release the lease and the =
system will not be able to start the vm elsewhere.<br class=3D""><br =
class=3D"">Maybe you can expose some of the ceph storage using cephfs =
for the leases?<br class=3D"">This will make it more likely that the =
leases storage domain will fail<br class=3D"">when there<br
class=3D"">is =
some issue with your ceph cluster.<br class=3D""><br
class=3D"">Another =
option is to expose ceph block device using iscsi, and use this iscsi<br =
class=3D"">storage domain for the leases. But note that this makes your =
iscsi gateway<br class=3D"">host a single point on failure.<br =
class=3D""><br class=3D"">Nir<br =
class=3D"">_______________________________________________<br =
class=3D"">Users mailing list<br class=3D""><a =
href=3D"mailto:Users@ovirt.org"
class=3D"">Users(a)ovirt.org</a><br =
class=3D"">http://lists.ovirt.org/mailman/listinfo/users<br
class=3D""><br=
class=3D"">--<br class=3D"">Questo messaggio e' stato
analizzato con =
Libra ESVA ed e' risultato non infetto.<br class=3D"">Seguire il link
=
qui sotto per segnalarlo come spam: <br =
class=3D"">http://mx01.enter.it/cgi-bin/learn-msg.cgi?id=3DD2CE14011D.A480=
8<br class=3D""><br class=3D""><br =
class=3D""></div></div></blockquote></div><br =
class=3D""></div></body></html>=
--Apple-Mail=_72C64DCD-D499-4420-9B77-C510AEDD3447--
3029
days inactive
3032
days old
4 comments
2 participants
participants (2)
-
Matteo Dacrema -
Nir Soffer