Removing *250GB Disk from Gluster SD - Error
by Sven Achtelik
--_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4ECBSOCRATESasl_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Hi All,
I was trying to remove a ~250GB Disk from a Gluster SD and the engine has =
gone crazy. The Storage latency went up dramatically, which caused a change=
of the spm and everything to get unresponsive for about 10-30 seconds. How=
do I remove such a big disk in a way that this doesn't happen again ? I an=
yone running gluster on with a caching option ? The Bricks are on a raid 5+=
0 and should be pretty fast. Are there any values that can be tuned in the =
Engine - maybe for the acceptance of a little more storage latency ?
Thank you,
Sven
--_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4ECBSOCRATESasl_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV=3D"Content-Type" CONTENT=
=3D"text/html; charset=3Dus-ascii"><meta name=3DGenerator content=3D"Micros=
oft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.E-MailFormatvorlage17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DDE link=3D"#0563C1" v=
link=3D"#954F72"><div class=3DWordSection1><p class=3DMsoNormal>Hi All, <o:=
p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>=
<span lang=3DEN-US>I was trying to remove a ~250GB Disk from a Gluste=
r SD and the engine has gone crazy. The Storage latency went up dramaticall=
y, which caused a change of the spm and everything to get unresponsive for =
about 10-30 seconds. How do I remove such a big disk in a way that this doe=
sn’t happen again ? I anyone running gluster on with a caching option=
? The Bricks are on a raid 5+0 and should be pretty fast. Are there any va=
lues that can be tuned in the Engine – maybe for the acceptance of a =
little more storage latency ? <o:p></o:p></span></p><p class=3DMsoNormal><s=
pan lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span lan=
g=3DEN-US>Thank you, <o:p></o:p></span></p><p class=3DMsoNormal><span lang=
=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span lang=3DEN-U=
S>Sven<o:p></o:p></span></p><p class=3DMsoNormal><o:p> </o:p></p></div=
></body></html>=
--_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4ECBSOCRATESasl_--
7 years
Internet access for oVirt Nodes?
by Matthias Leopold
hi,
do hypervisors, that are running oVirt Node (not standard CentOS/RHEL),
need internet access for updates or can they be in a private, non routed
network (and updates happen via engine)? it seems the latter is the
case, but i want to be sure
thx
matthias
7 years
Re: [ovirt-users] can i Extend volume from replica 2 to replica 3 with arbiter
by Ravishankar N
This is a multi-part message in MIME format.
--------------0CEFB242D3E16A95E29AC6A4
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
> ---------- Forwarded message ----------
> From: *Khalid Jamal* <khalid.jamal(a)earthlinktele.com
> <mailto:khalid.jamal@earthlinktele.com>>
> Date: Sat, May 13, 2017 at 10:51 PM
> Subject: [ovirt-users] can i Extend volume from replica 2 to replica 3
> with arbiter
> To: users(a)ovirt.org <mailto:users@ovirt.org>
>
>
> Dear Team
>
> i need you advice for convert our volume replica 2 to replica 3 with
> arbiter but important thing it's production environments , i try to
> convert the same name of volume in replica 2 to convert is to the
> replica 3 to avoid losing vm's or any data that's what i do it :
>
>
> # gluster volume create gfs1 replica 3 arbiter 1 s1:/export/sdb1/br1
> s2:/export/sdb1/br1 s3:/export/sdb1/br1 s1:/export/sdc1/br1
> s2:/export/sdc1/br1 s3:/export/sdc1/br1 s4:/export/sdb1/br1
> s5:/export/sdb1/br1 s6:/export/sdb1/br1 s4:/export/sdc1/br1
> s5:/export/sdc1/br1 s6:/export/sdc1/br1
>
> that's the result :
>
>
> volume create: gfs1: failed: Volume gfs1 already exists
>
>
If you are converting an existing replica 2 to arbiter, you would need
to use the `add-brick` command. The syntax is given here:
https://review.gluster.org/#/c/14126/8//COMMIT_MSG
Hope that helps,
Ravi
>
> i try to change the name but without any success what shall i do.
>
>
> best regards
>
>
>
> Eng khalid jamal
> System Admin@IT Department
> Earthlink Telecom
>
> Email: khalid.jamal(a)earthlinktele.com
> <mailto:khalid.jamal@earthlinktele.com>
> No: 3355
> skype: engkhalid21986
> NO : 07704268321
>
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org <mailto:Users@ovirt.org>
> http://lists.ovirt.org/mailman/listinfo/users
> <http://lists.ovirt.org/mailman/listinfo/users>
>
>
--------------0CEFB242D3E16A95E29AC6A4
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 7bit
<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<br>
<blockquote
cite="mid:CACjzOvcGHqfYQiAy4XR+vVCtHa=SM=-gXatrnaY2nN9NGunSsw@mail.gmail.com"
type="cite">
<div dir="ltr">
<div>
<div class="gmail_quote">---------- Forwarded message
----------<br>
From: <b class="gmail_sendername">Khalid Jamal</b> <span
dir="ltr"><<a moz-do-not-send="true"
href="mailto:khalid.jamal@earthlinktele.com">khalid.jamal(a)earthlinktele.com</a>></span><br>
Date: Sat, May 13, 2017 at 10:51 PM<br>
Subject: [ovirt-users] can i Extend volume from replica 2 to
replica 3 with arbiter<br>
To: <a moz-do-not-send="true" href="mailto:users@ovirt.org">users(a)ovirt.org</a><br>
<br>
<br>
<div>
<p>Dear Team</p>
<p>i need you advice for convert our volume replica 2 to
replica 3 with arbiter but important thing it's
production environments , i try to convert the same name
of volume in replica 2 to convert is to the replica 3 to
avoid losing vm's or any data that's what i do it :</p>
<p><br>
</p>
<p><span style="color:rgb(0,0,255)"># gluster volume
create gfs1 replica 3 arbiter 1 s1:/export/sdb1/br1
s2:/export/sdb1/br1 s3:/export/sdb1/br1
s1:/export/sdc1/br1 s2:/export/sdc1/br1
s3:/export/sdc1/br1 s4:/export/sdb1/br1
s5:/export/sdb1/br1 s6:/export/sdb1/br1
s4:/export/sdc1/br1 s5:/export/sdc1/br1
s6:/export/sdc1/br1</span></p>
<p>that's the result :</p>
<p><br>
</p>
<p><span style="color:rgb(255,0,0)">volume create: gfs1:
failed: Volume gfs1 already exists</span></p>
<p><span style="color:rgb(255,0,0)"><br>
</span></p>
</div>
</div>
</div>
</div>
</blockquote>
If you are converting an existing replica 2 to arbiter, you would
need to use the `add-brick` command. The syntax is given here:
<a class="moz-txt-link-freetext" href="https://review.gluster.org/#/c/14126/8//COMMIT_MSG">https://review.gluster.org/#/c/14126/8//COMMIT_MSG</a><br>
Hope that helps,<br>
Ravi<br>
<blockquote
cite="mid:CACjzOvcGHqfYQiAy4XR+vVCtHa=SM=-gXatrnaY2nN9NGunSsw@mail.gmail.com"
type="cite">
<div dir="ltr">
<div>
<div class="gmail_quote">
<div>
<p><span style="color:rgb(0,0,0)">i try to change the name
but without any success what shall i do.</span></p>
<p><br>
</p>
<p>best regards</p>
<p><br>
</p>
<p><br>
</p>
<p>Eng khalid jamal<br>
System Admin@IT Department<br>
Earthlink Telecom</p>
<div class="m_-3760168994860256500io-ox-signature">
<p>Email: <a moz-do-not-send="true"
href="mailto:khalid.jamal@earthlinktele.com"
target="_blank">khalid.jamal(a)earthlinktele.com</a><br>
No: 3355<br>
skype: engkhalid21986<br>
NO : 07704268321</p>
</div>
</div>
<br>
______________________________<wbr>_________________<br>
Users mailing list<br>
<a moz-do-not-send="true" href="mailto:Users@ovirt.org">Users(a)ovirt.org</a><br>
<a moz-do-not-send="true"
href="http://lists.ovirt.org/mailman/listinfo/users"
rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><br>
<br>
</div>
<br>
</div>
</div>
</blockquote>
<p><br>
</p>
</body>
</html>
--------------0CEFB242D3E16A95E29AC6A4--
7 years
Maintenance mode for storage?
by Troels Arvin
Hello,
I would like to make use of the new ovirt feature where a LUN may be
removed from a storage domain, provided there's enough free space on the
remaining LUNs in the domain.
It seems the storage domain needs to be put in maintenance mode before
this may be accomplished. But what's the consequence of putting a storage
domain in maintenance mode? Can guests using the domain keep running
while the storage domain is in maintenance mode? Does something stop
working while a storage domain is in maintenance mode?
--
Regards,
Troels Arvin
7 years
Engine deploy tab is missing when restoring from db-backup?
by gflwqs gflwqs
Hi list,
I have restored my 4.1 engine.
After i have restored the engine the engine deploy tab is missing?
And since it is not possible anymore to deploy thru command line i am not
able to deploy new hosts?
- Does anybody know a workaround to deploy new hosts?
- Is this a bug or am i doing something wrong when restoring?
This is how i restored:
[root@ovirt-engine ~]# engine-backup --mode=restore --file=backup.tar
--log=restore.log --provision-db --provision-dwh-db --restore-permissions
Thanks!
Christian
7 years
problem while updating oVirt from 3.6 to 4.0
by Nelson Lameiras
------=_Part_37643342_929927371.1494519067933
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Hello,=20
Not sure if I should post here, or on the dev mailling list.=20
I had a serious problem when upgrading an oVirt cluster from 3.6 to 4.0 (be=
fore updating to 4.1)=20
The error on engine-setup log was :=20
"schema.sh: FATAL: Cannot execute sql command: --file=3D/usr/share/ovirt-en=
gine/dbscripts/upgrade/04_00_0930_disallow_boot_protocol_to_be_null.sql"=20
After long hours of debuguing and analysing I found out the problem. On dat=
abase, some entries on table network_attachements had a NULL value which we=
re incompatible with the sql file above.=20
I'm guessing this is an "exotic situation" which shouldn't exist... in theo=
ry ;)=20
Anyway, I'm fairly sure that the solution for this problem would be to patc=
h the following file 'ovirt-engine/packaging/dbscripts/upgrade/04_00_0910_d=
o_not_allow_null_boot_protocol.sql'=20
by adding the following line " update network_attachments set boot_protocol=
=3D ' NONE ' where boot_protocol is null ;"=20
If a dev want to discuss it further, I'll be happy to explain my thoughts o=
n this matter.=20
cordialement, regards,=20
=09Nelson LAMEIRAS=20
Ing=C3=A9nieur Syst=C3=A8mes et R=C3=A9seaux / Systems and Networks enginee=
r=20
Tel: +33 5 32 09 09 70=20
nelson.lameiras(a)lyra-network.com=20
www.lyra-network.com | www.payzen.eu=20
=09
=09
=09
Lyra Network, 109 rue de l'innovation, 31670 Lab=C3=A8ge, FRANCE=20
------=_Part_37643342_929927371.1494519067933
Content-Type: multipart/related;
boundary="----=_Part_37643343_1124091921.1494519067933"
------=_Part_37643343_1124091921.1494519067933
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable
<html><body><div style=3D"font-family: arial, helvetica, sans-serif; font-s=
ize: 12pt; color: #000000"><div>Hello,<br></div><div><br data-mce-bogus=3D"=
1"></div><div>Not sure if I should post here, or on the dev mailling list.<=
br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div><div>I ha=
d a serious problem when upgrading an oVirt cluster from 3.6 to 4.0 (before=
updating to 4.1)<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"=
1"></div><div>The error on engine-setup log was : <br data-mce-bogus=3D"1">=
</div><div>"schema.sh: FATAL: Cannot execute sql command: --file=3D/usr/sha=
re/ovirt-engine/dbscripts/upgrade/04_00_0930_disallow_boot_protocol_to_be_n=
ull.sql"<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div>=
<div>After long hours of debuguing and analysing I found out the problem. O=
n database, some entries on table network_attachements had a NULL value whi=
ch were incompatible with the sql file above.<br data-mce-bogus=3D"1"></div=
><div>I'm guessing this is an "exotic situation" which shouldn't exist... i=
n theory ;)<br data-mce-bogus=3D"1"></div><div><br></div><div>Anyway, I'm f=
airly sure that the solution for this problem would be to patch the followi=
ng file 'ovirt-engine/packaging/dbscripts/upgrade/04_00_0910_do_not_allow_n=
ull_boot_protocol.sql' </div><div>by adding the following line "<span class=
=3D"pl-k">update</span> network_attachments <span class=3D"pl-k">set</span>=
boot_protocol<span class=3D"pl-k">=3D</span><span class=3D"pl-s"><span cla=
ss=3D"pl-pds">'</span>NONE<span class=3D"pl-pds">'</span></span> <span clas=
s=3D"pl-k">where</span> boot_protocol is <span class=3D"pl-k">null</span>;"=
<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div><div>If =
a dev want to discuss it further, I'll be happy to explain my thoughts on t=
his matter. <br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></=
div><div data-marker=3D"__SIG_PRE__"><div>cordialement, regards,</div><div>=
<br data-mce-bogus=3D"1"></div><table style=3D"margin: 0px; table-layout: f=
ixed; border: none; width: 345pt; padding: 0px;" data-mce-style=3D"margin: =
0px; table-layout: fixed; border: none; width: 345pt; padding: 0px;" width=
=3D"460" cellspacing=3D"0" cellpadding=3D"0" border=3D"0"><tbody><tr><td st=
yle=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2=
b3c7a; line-height: 16px; width: 86.25pt; text-align: left;" data-mce-style=
=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3c=
7a; line-height: 16px; width: 86.25pt; text-align: left;" width=3D"115" val=
ign=3D"top"><a href=3D"https://www.lyra-network.com/" style=3D"border: none=
; text-decoration: none; width: 100%; display: block; clear: both;" data-mc=
e-href=3D"https://www.lyra-network.com/" data-mce-style=3D"border: none; te=
xt-decoration: none; width: 100%; display: block; clear: both;"><img src=3D=
"cid:1db6da5091d14a0982ffcf8c4fef8a46b32a3417@zimbra" alt=3D"" data-mce-src=
=3D"/home/admin(a)lyra-network.com/corporate-documents/element-signature_logo=
_lyra_115x94.jpg" doc=3D"corporate-documents/element-signature_logo_lyra_11=
5x94.jpg" height=3D"94" width=3D"115" border=3D"0"></a><br data-mce-bogus=
=3D"1"></td><td style=3D"margin: 0; font-size: 11px; font-family: Arial,san=
s-serif; color: #2b3c7a; line-height: 16px; width: 258.75pt;" data-mce-styl=
e=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3=
c7a; line-height: 16px; width: 258.75pt;" width=3D"345" valign=3D"top"><tab=
le style=3D"margin: 0; width: 258.75pt; table-layout: fixed; border: none;"=
data-mce-style=3D"margin: 0; width: 258.75pt; table-layout: fixed; border:=
none;" width=3D"345" cellspacing=3D"0" cellpadding=3D"0" border=3D"0"><tbo=
dy><tr><td style=3D"font-size: 16px; font-family: Arial,sans-serif; color: =
#2b3c7a; line-height: 18px; font-weight: bold;" data-mce-style=3D"font-size=
: 16px; font-family: Arial,sans-serif; color: #2b3c7a; line-height: 18px; f=
ont-weight: bold;">Nelson LAMEIRAS</td></tr><tr><td style=3D"font-family: A=
rial,sans-serif; color: #2b3c7a; font-size: 11px; line-height: 16px;" data-=
mce-style=3D"font-family: Arial,sans-serif; color: #2b3c7a; font-size: 11px=
; line-height: 16px;">Ing=C3=A9nieur Syst=C3=A8mes et R=C3=A9seaux<span sty=
le=3D"font-family: Arial,sans-serif; color: #337ab7; font-size: 11px;" data=
-mce-style=3D"font-family: Arial,sans-serif; color: #337ab7; font-size: 11p=
x;"> / Systems and Networks engineer</span></td></tr><tr><td style=3D"line-=
height: 16px; font-family: 'Arial',sans-serif; color: #2b3c7a; font-size: 1=
1px;" data-mce-style=3D"line-height: 16px; font-family: 'Arial',sans-serif;=
color: #2b3c7a; font-size: 11px;"><span style=3D"font-family: Arial,sans-s=
erif; color: #2b3c7a; font-size: 11px;" data-mce-style=3D"font-family: Aria=
l,sans-serif; color: #2b3c7a; font-size: 11px;">Tel: +33 5 32 09 09 70</spa=
n></td></tr><tr><td style=3D"line-height: 16px; font-family: 'Arial',sans-s=
erif; color: #2b3c7a; font-size: 11px;" data-mce-style=3D"line-height: 16px=
; font-family: 'Arial',sans-serif; color: #2b3c7a; font-size: 11px;"><a hre=
f=3D"mailto:nelson.lameiras@lyra-network.com" style=3D"font-size: 11px; fon=
t-family: Arial,sans-serif; line-height: 16px; text-decoration: none;" data=
-mce-href=3D"mailto:nelson.lameiras@lyra-network.com" data-mce-style=3D"fon=
t-size: 11px; font-family: Arial,sans-serif; line-height: 16px; text-decora=
tion: none;">nelson.lameiras(a)lyra-network.com</a><br data-mce-bogus=3D"1"><=
/td></tr><tr><td style=3D"line-height: 16px; font-family: 'Arial',sans-seri=
f; color: #2b3c7a; font-size: 11px;" data-mce-style=3D"line-height: 16px; f=
ont-family: 'Arial',sans-serif; color: #2b3c7a; font-size: 11px;"><a href=
=3D"https://www.lyra-network.com/" style=3D"font-size: 11px; font-family: A=
rial,sans-serif; line-height: 16px; border: none; text-decoration: none;" d=
ata-mce-href=3D"https://www.lyra-network.com/" data-mce-style=3D"font-size:=
11px; font-family: Arial,sans-serif; line-height: 16px; border: none; text=
-decoration: none;">www.lyra-network.com</a> <a href=3D"https://payzen.eu" =
style=3D"font-size: 11px; font-family: Arial,sans-serif; line-height: 16px;=
border: none; text-decoration: none;" data-mce-href=3D"https://payzen.eu" =
data-mce-style=3D"font-size: 11px; font-family: Arial,sans-serif; line-heig=
ht: 16px; border: none; text-decoration: none;"> | www.payzen.eu</a><br dat=
a-mce-bogus=3D"1"></td></tr></tbody></table></td></tr></tbody></table><tabl=
e style=3D"margin: 0; table-layout: fixed; border: none; width: 345pt;" dat=
a-mce-style=3D"margin: 0; table-layout: fixed; border: none; width: 345pt;"=
width=3D"460" cellspacing=3D"0" cellpadding=3D"0"><tbody><tr><td style=3D"=
margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3c7a; =
line-height: 16px; width: 24pt; text-align: left;" data-mce-style=3D"margin=
: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3c7a; line-h=
eight: 16px; width: 24pt; text-align: left;" width=3D"32" valign=3D"top"><a=
href=3D"https://www.youtube.com/channel/UCrVl1CO_Jlu3KbiRH-tQ_vA" style=3D=
"border: none; text-decoration: none; margin: 0; float: left; display: inli=
ne-block; width: 32px;" data-mce-href=3D"https://www.youtube.com/channel/UC=
rVl1CO_Jlu3KbiRH-tQ_vA" data-mce-style=3D"border: none; text-decoration: no=
ne; margin: 0; float: left; display: inline-block; width: 32px;"><img src=
=3D"cid:99ac6520e8e3715f40f650ce0d5f88a03a9bd713@zimbra" alt=3D"" data-mce-=
src=3D"/home/admin(a)lyra-network.com/corporate-documents/element-signature_l=
ogo_YouTube_32x28.jpg" doc=3D"corporate-documents/element-signature_logo_Yo=
uTube_32x28.jpg" height=3D"28" width=3D"32" border=3D"0"></a><br data-mce-b=
ogus=3D"1"></td><td style=3D"margin: 0; font-size: 11px; font-family: Arial=
,sans-serif; color: #2b3c7a; line-height: 16px; width: 30.75pt; text-align:=
left;" data-mce-style=3D"margin: 0; font-size: 11px; font-family: Arial,sa=
ns-serif; color: #2b3c7a; line-height: 16px; width: 30.75pt; text-align: le=
ft;" width=3D"41" valign=3D"top"><a href=3D"https://www.linkedin.com/compan=
y/lyra-network_2" style=3D"border: none; text-decoration: none; margin: 0; =
float: left; display: inline-block; width: 41px;" data-mce-href=3D"https://=
www.linkedin.com/company/lyra-network_2" data-mce-style=3D"border: none; te=
xt-decoration: none; margin: 0; float: left; display: inline-block; width: =
41px;"><img src=3D"cid:a70d2dafceb98e64513f5a16b7d3ea0ab5a0f1f5@zimbra" dat=
a-mce-src=3D"/home/admin(a)lyra-network.com/corporate-documents/element-signa=
ture_logo_LinkedIn_41x28.jpg" doc=3D"corporate-documents/element-signature_=
logo_LinkedIn_41x28.jpg" height=3D"28" width=3D"41" border=3D"0"></a><br da=
ta-mce-bogus=3D"1"></td><td style=3D"margin: 0; font-size: 11px; font-famil=
y: Arial,sans-serif; color: #2b3c7a; line-height: 16px; width: 31.5pt; text=
-align: left;" data-mce-style=3D"margin: 0; font-size: 11px; font-family: A=
rial,sans-serif; color: #2b3c7a; line-height: 16px; width: 31.5pt; text-ali=
gn: left;" width=3D"42" valign=3D"top"><a href=3D"https://twitter.com/LyraN=
etwork" style=3D"border: none; text-decoration: none; margin: 0; float: lef=
t; display: inline-block; width: 42px;" data-mce-href=3D"https://twitter.co=
m/LyraNetwork" data-mce-style=3D"border: none; text-decoration: none; margi=
n: 0; float: left; display: inline-block; width: 42px;"><img src=3D"cid:a99=
4fe545de6341d6b369e33bbb18605bbbcef66@zimbra" alt=3D"" data-mce-src=3D"/hom=
e/admin(a)lyra-network.com/corporate-documents/element-signature_logo_Twitter=
_42x28.jpg" doc=3D"corporate-documents/element-signature_logo_Twitter_42x28=
.jpg" height=3D"28" width=3D"42" border=3D"0"></a><br data-mce-bogus=3D"1">=
</td><td style=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif=
; color: #2b3c7a; line-height: 16px; width: 258.75pt; text-align: left;" da=
ta-mce-style=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; =
color: #2b3c7a; line-height: 16px; width: 258.75pt; text-align: left;" widt=
h=3D"345" valign=3D"top"><a href=3D"https://payzen.eu" style=3D"border: non=
e; text-decoration: none; margin: 0; float: left; display: inline-block; wi=
dth: 61px;" data-mce-href=3D"https://payzen.eu" data-mce-style=3D"border: n=
one; text-decoration: none; margin: 0; float: left; display: inline-block; =
width: 61px;"><img src=3D"cid:86ad24eaa2a146e1b7ee93db04f055468345dc13@zimb=
ra" alt=3D"" data-mce-src=3D"/home/admin(a)lyra-network.com/corporate-documen=
ts/element-signature_payzen_61x28.jpg" doc=3D"corporate-documents/element-s=
ignature_payzen_61x28.jpg" height=3D"28" width=3D"61" border=3D"0"></a><br =
data-mce-bogus=3D"1"></td></tr></tbody></table><table style=3D"margin: 0; t=
able-layout: fixed; border: none; width: 345pt;" data-mce-style=3D"margin: =
0; table-layout: fixed; border: none; width: 345pt;" width=3D"460" cellspac=
ing=3D"0" cellpadding=3D"0"><tbody><tr><td><hr style=3D"background: #293b79=
none repeat scroll 0% 0%; width: 100%; height: 4px; color: #293b79; margin=
: 0px;" data-mce-style=3D"background: #293b79 none repeat scroll 0% 0%; wid=
th: 100%; height: 4px; color: #293b79; margin: 0px;"></td></tr></tbody></ta=
ble><table style=3D"margin: 0; table-layout: fixed; border: none; width: 34=
5pt;" data-mce-style=3D"margin: 0; table-layout: fixed; border: none; width=
: 345pt;" width=3D"460" cellspacing=3D"0" cellpadding=3D"0"><tbody><tr><td =
style=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: =
#2b3c7a; line-height: 16px; width: 30.75pt; text-align: left;" data-mce-sty=
le=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b=
3c7a; line-height: 16px; width: 30.75pt; text-align: left;"><div>Lyra Netwo=
rk, 109 rue de l'innovation, 31670 Lab=C3=A8ge, FRANCE</div></td></tr></tbo=
dy></table><div><br></div></div></div></body></html>
------=_Part_37643343_1124091921.1494519067933
Content-Type: image/jpeg; name=element-signature_logo_lyra_115x94.jpg
Content-Disposition: attachment;
filename=element-signature_logo_lyra_115x94.jpg
Content-Transfer-Encoding: base64
Content-ID: <1db6da5091d14a0982ffcf8c4fef8a46b32a3417@zimbra>
/9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov
L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl
aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4
OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6
MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5
OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht
bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i
aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w
PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9
InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1
bWVudElEPSJ4bXAuZGlkOkU1QUU4Nzk1OEExMzExRTZBNTFCRjVENEYyNDYxNTQ1IiB4bXBNTTpJ
bnN0YW5jZUlEPSJ4bXAuaWlkOkU1QUU4Nzk0OEExMzExRTZBNTFCRjVENEYyNDYxNTQ1IiB4bXA6
Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N
OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1
LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4
YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG
PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE
BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f
Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f
Hx8fHx8fHx8fHx8fH//AABEIAF4AcwMBEQACEQEDEQH/xACdAAEBAAIDAQEAAAAAAAAAAAAACAUH
AgMGBAEBAQADAQEAAAAAAAAAAAAAAAACBAUBAxAAAAUDAgAHDQcCBwAAAAAAAAECAwQRBQYSByFR
E7RWFzcxQSKS0nOT03RVlQgYYXEyQiMUFYEzsVJicmODOBEAAgECAwcEAgIDAAAAAAAAAAECEQNR
EwQhgbESMlIzMUGhFHEVwQUiQzT/2gAMAwEAAhEDEQA/AKpAE9b/AGQZdF3FtNpsd4l29M2DHSll
iS6w0bzsp5slqJCiLvERnTuENTRQg7bckntK15vmojj1WfMP0rc+Jy/JD7Fjt+EMueJ6bbnBN4bR
lkWdkt+XPtDaHSfjKnSHyUpTZkg+TcLSdFGRjyv3rUo0iqP8EoQkntZ7fcOy5VdrXGYxuccGW2+S
3nCecYq3oUWnU2RmfhGXAPPSXLcJNzVVT8kNVbnKKUHRmppW1/zBOSXVtZS4lpSjNtP8nLKhfcSR
alqdPXp+ERhauKKTe38nX1WfMP0qc+Jy/JHPsWO34RPLniOqz5h+lTnxOX5IfYsdvwhlzxHVZ8w/
Spz4nL8kPsWO34Qy54jqs+YfpU58Tl+SH2LHb8IZc8R1WfMP0qc+Jy/JD7Fjt+EMueJ2bCX3MH9y
LxZr7eJdxKBCkoW0/JdfaJ5mUy2a0EszL/MRHTuGGshDLTiqVf8AAst81GUGMssgAAAAE5b89s+L
+zwefPDV0fhlv4FW71oo0ZRaAAAAAAAAAAAAACdtj+3DLfNXDn7I1dX4Y7uBWtdbKJGUWQAAAACc
t+e2fF/Z4PPnhq6Pwy38Crd60UaMotAAAAAAAAAAAAABO2x/bhlvmrhz9kaur8Md3ArWutlEjKLI
AAAABOW/PbPi/s8Hnzw1dH4Zb+BVu9aKNGUWjAKzrGk5cnEjkq/nVo5RMbk3NOnkzd/uU0fgKvdH
rky5eb2I86rQz48iQAAAAAAAAABO2x/bhlvmrhz9kaur8Md3ArWutlEjKLIAAAABOW/PbPi/s8Hn
zw1dH4Zb+BVu9aKNGUWjSD//AKkj+xnzJQ0V/wA2/wDkr/7D3e7GX5DiOMfzlniMTEMPIRORIJfg
tOeCladCk/nNJH94raa1GcuVnpck4qqOrJdz4dr2yazKOhDjkxhlUGMszop98i/TOlD/AE/CNX+0
x23p27nIJXKRqeeyjdnLMd27sGSzLdEO4Xd4uWifqkhDDiFut0qrUSzQlNa9wz7g9bemjK44puiI
yuNRTOzGs53hud+gvzsYjwMVnqNfLuqUTrEck69bitZmStPc1NJIz4hy5ZtKLpKskIzk36bDHRt2
9yMsuMw9v8ejybNBc5M5s5Rp5Uy4aEZuMJSai4dPCZFStBN6a3BLne1nMyT6Uffgu8GQ5DnysXuN
mbtZx461TG1ms3kyGiLWRHXToMz8Hg7nfMQvaWMYcydTsLjcqG2BSPYnbY/twy3zVw5+yNXV+GO7
gVrXWyiRlFkAAAAAnLfntnxf2eDz54auj8Mt/Aq3etFGjKLROmdZbAxL5g/5yey6/GjREJW2wSTc
M3YpoKms0F3VcY1bNpzscqKs5UnU9pad4cG3Fefw1UWXFO7x3mULkpaJJnoM6JNC10WREak/aXGK
8tLO1/ns2HorilsNTYzar/kOQWTa+5tmmBjk+W9cKGqimkrJS68RcCkoV/yC7clGMXcXrJI8Yptq
OBsj5oEpTiNmSRESSuKSJJFwUJlzgoKv9f1P8Hrf9Db1wh/vbVJh6tH7lhbOvi5RBpr/AEqKMXR1
PZrYaC2x3Jgbawp+IZjBkwpkWS480603rSslkRU7qTOuiqFlUlEfepw6WosO61ODK9ufLsZ27f36
RkG/8q9OwXbe3PgKciMPp0uHHS22hpxRf60o1f4VC9DlsUrWjEHWdSghllknbY/twy3zVw5+yNXV
+GO7gVrXWyiRlFkAAAAAnLfntnxf2eDz54auj8Mt/Aq3etFGjKLRxU00o6qQlR8ZkRhUGMyO7W7H
7FOvUpCSZgMrfMqERqNJeCgj41qokvtMTtxcpJL3OSdFU1n8vFimPwbrnF18O55DIXybhlw8ihZm
s08RLdqVOJJC5rZqqgvSJ42V7v3MpM3dTBnyWbtBQmHFnXFpLzdXOWjW9tWo2irwPpd0pWhVPBPU
R0qILTVWx+y+STuYmQj7sxHH1Kctb7NuahnMflKW2akk3J/bvGlojqtpv8ZuJP8ACR8Ag9M8dtTu
YdErdfEJTCZKrY/L5JSySbrbCdKmicdWRLeWlJK/bs8skq+ElSacJ8HVppr3OZiP2RuxFK4W5xi3
LK2T5D8NmY8baHHnWySSeTSa6to1K8JTumn3gtM6PbtQzDYYqnqTtsf24Zb5q4c/ZGrq/DHdwK1r
rZRIyiyAAAAATlvz2z4v7PB588NXR+GW/gVbvWijRlFoADGZHjVmyO2Ltd4YOTAcUlbjJLcbJRoO
qam2pCuA+GlROFxwdV6nJRT2M+q226DbLfHt8BkmIcRtLMdlNaJQgqEVTqZ/eYjKTbqwlQ5Hb4Bp
Uk4zRpUpa1FoTQ1uEaVqPg7qiUZGffDmYodSbNZ0toaTBjk02hbTaCaQSUtu/wBxCSpQkr/MXfHe
d4iiP12z2h5k2XYMdxlSkuKbW0hSTW2kkIUZGVKpSkiI+8RApPEURydtltdQpDsRlxCtepKm0mR8
qdXKkZfn/NxjnMxQ+kcOk7bH9uGW+auHP2Rq6vwx3cCta62USMosgAAAAE5b89s+L+zwefPDV0fh
lv4FW71oo0ZRaAAAAAAAAAAAAACdtj+3DLfNXDn7I1dX4Y7uBWtdbKJGUWQAAAACb9/3mWN4cbff
WTTLUWEt1xX4UpTNeNSj+wiGtolW1LfwKt7qRuTrY226RwfSkKH1rnaz3zI4jrZ226RwfSkH1rna
xmRxHWztt0jg+lIPrXO1jMjiOtnbbpHB9KQfWudrGZHEdbO23SOD6Ug+tc7WMyOJ+o3W24WtKE5F
CUpR0SknCqZmH1rnazjuxW2pnbTfbPeGnHbXMamNtK0OLaVqJKjKtDELlqUNklQ7C5GfS6mOu+f4
XZpy4F0vMWHMbJKlsOrJKyJRVTUvtIdjZnJVSOuaXqfF1sbbdI4PpSEvrXO1nMyOJp7YiQxJ3oyi
RHcS9Hejz3GXUcKVoVOZNKi+wyOovaxUsx3cDwtdbKNGUWgAAAADX+4GzGPZveWbtcpsuO+xGTFS
iObRINCFrcIz1oWdaun3xas6qVtUSR5ztKTqeZ+lrCvely8Zj1Q9f2M8EQyEPpawr3pcvGY9UH7G
eCGQh9LWFe9Ll4zHqg/YzwQyEPpawr3pcvGY9UH7GeCGQh9LWFe9Ll4zHqg/YzwQyEc2flfwxl5t
1NzuJqbUSiI1MUqX/UOr+xmn6I5LTRaaxNg4XhNuxOHIiwX3n0SXCdWb5pMyMk6eDSlPEPDU6mV5
pteg0+nVpNI8zm+xeNZfkDt7nzprEl5Dbam2FNEgibTpKmttR97jErWslCNEkTlaUnUwP0tYV70u
XjMeqHp+xngiOQj023+zGPYReXrtbZsuQ+/GVFUiQbRoJC1ocMy0IQdatF3x5XtVK4qNInC0oups
AVT0AAAAAAAAAAAAAAAAAAAAAAAAAAAAD//Z
------=_Part_37643343_1124091921.1494519067933
Content-Type: image/jpeg; name=element-signature_logo_YouTube_32x28.jpg
Content-Disposition: attachment;
filename=element-signature_logo_YouTube_32x28.jpg
Content-Transfer-Encoding: base64
Content-ID: <99ac6520e8e3715f40f650ce0d5f88a03a9bd713@zimbra>
/9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov
L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl
aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4
OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6
MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5
OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht
bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i
aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w
PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9
InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1
bWVudElEPSJ4bXAuZGlkOjQ1REY5Njk1OEExNzExRTY5OUVDOTI1QTU3QzAwNzI0IiB4bXBNTTpJ
bnN0YW5jZUlEPSJ4bXAuaWlkOjQ1REY5Njk0OEExNzExRTY5OUVDOTI1QTU3QzAwNzI0IiB4bXA6
Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N
OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1
LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4
YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG
PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE
BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f
Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f
Hx8fHx8fHx8fHx8fH//AABEIABwAIAMBEQACEQEDEQH/xAB5AAADAQEAAAAAAAAAAAAAAAAABwgF
BgEAAgMBAAAAAAAAAAAAAAAAAAQCAwUBEAABBAECBAUFAAAAAAAAAAABAgMEBQARBiESEwcxUdIU
CEEik1UYEQACAQMCBQUAAAAAAAAAAAAAAQIRAwQhMVFhEiITQaHBYhX/2gAMAwEAAhEDEQA/AKpw
AnD5Hbg3JA35XxKqxmxUPVrJEaI862FuqkPp4IbI5lHQDNXBhFwbaW4tebqcMIvfYjURtz6eesv1
YzWz9fYh38zR7eX2+mu5lHV3VhaNOe8aTJgTHnweVXEBba1cQRkb8IeNtJbHYN9WpW+YY2T53inQ
4HfzZk6a4lmHGaiOSHl8EoT7mSOZR+gBIzUxU3Yklz+Be4+9DRl30N3dMOxjbyro9EzHW3MqupHc
L7qlaoX1SsFvlHl44moPpa6XXiW113FPuu3qrT5I7dfrJLUxllMRl15hQWjqBbiuXmTqCQlQx23F
rHdSqTrNFFZlDAou7vZa43xuSNaw7CPFZZhIiKbeSsqKkOuuE/aCNNHcexspW40a9Sm5bcmcH/J1
5+0rvxOenGf0o8GQ8DN7ZXxzv9vbpqrhy0huMQJCHlstocBKU+ITqANcru50ZRao9SUbLTqPvMwv
DAAwAMAP/9k=
------=_Part_37643343_1124091921.1494519067933
Content-Type: image/jpeg; name=element-signature_logo_LinkedIn_41x28.jpg
Content-Disposition: attachment;
filename=element-signature_logo_LinkedIn_41x28.jpg
Content-Transfer-Encoding: base64
Content-ID: <a70d2dafceb98e64513f5a16b7d3ea0ab5a0f1f5@zimbra>
/9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov
L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl
aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4
OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6
MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5
OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht
bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i
aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w
PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9
InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1
bWVudElEPSJ4bXAuZGlkOjY2MEYzRTFGOEExNzExRTY5QzI5OUNGQkY1MzM2MUQ1IiB4bXBNTTpJ
bnN0YW5jZUlEPSJ4bXAuaWlkOjY2MEYzRTFFOEExNzExRTY5QzI5OUNGQkY1MzM2MUQ1IiB4bXA6
Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N
OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1
LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4
YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG
PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE
BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f
Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f
Hx8fHx8fHx8fHx8fH//AABEIABwAKQMBEQACEQEDEQH/xAB2AAEBAQEAAAAAAAAAAAAAAAAABggH
AQEAAwEAAAAAAAAAAAAAAAAAAwQFAhAAAQMEAgICAgMBAAAAAAAAAQIDBAARBQYhEjEHMghBE1Fh
IhcRAAICAQIDCQAAAAAAAAAAAAABAgMREgQxkTIhQVGhscETMxX/2gAMAwEAAhEDEQA/ANU0Bl33
zsuzQfZcmHj8tMiMKaihDLMl1psKcQkXslSUjk8mtjZ1xdeWkVbW9RDZ/ZN8wOXkYnI7LKMuL1Lq
o+RddaIWkLHVwLAPCuf4NWYVwksqPkcNtd5V+ldr2ef7MwkaZmJsqK6p/uy9JdcbUBGcULpUog8i
9Q7uuKreEjquT1GsKxC2KAUBk37B2/6y72t1tB7X8dbIvf8Aq3mtvZfVzKlvUWWw7Dr+Dfy8rCt4
d153Z8ew0FNx3kohuxmUyFtAfFPyBUOBz+arwhKWE89L9SRtLmTuns4xj7LLaxYaGNE6SYojlJZ6
rhLUf19f89eyj4qa1t7ft449ziPWairGLQoBQHFvZ/onObht0jNxclFjMPNtNpZdS4Vj9aAk36gj
mtDb7yMIaWiGdTbySSfqnsKbdctAFh1Fm3Bwfx8fFT/ox8GcfAyk9dfX7OapuGNzj+SiPRoJcKmG
kuBRDjS2x1uAPK71DfvYzg444nUKmnk7lWcTigFAKAUAoBQCgP/Z
------=_Part_37643343_1124091921.1494519067933
Content-Type: image/jpeg; name=element-signature_logo_Twitter_42x28.jpg
Content-Disposition: attachment;
filename=element-signature_logo_Twitter_42x28.jpg
Content-Transfer-Encoding: base64
Content-ID: <a994fe545de6341d6b369e33bbb18605bbbcef66@zimbra>
/9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov
L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl
aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4
OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6
MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5
OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht
bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i
aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w
PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9
InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1
bWVudElEPSJ4bXAuZGlkOjdDMkI3MjMyOEExNzExRTY5MDUyRTk1NEIyREUwNjVCIiB4bXBNTTpJ
bnN0YW5jZUlEPSJ4bXAuaWlkOjdDMkI3MjMxOEExNzExRTY5MDUyRTk1NEIyREUwNjVCIiB4bXA6
Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N
OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1
LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4
YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG
PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE
BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f
Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f
Hx8fHx8fHx8fHx8fH//AABEIABwAKgMBEQACEQEDEQH/xAB3AAEBAQEBAAAAAAAAAAAAAAAABwUI
BgEBAAMBAQAAAAAAAAAAAAAAAAMEBQIBEAABAwIEBwEBAQAAAAAAAAABAgMEAAUREhMGITFBFBUH
CIEiFhEAAgIBAgQHAAAAAAAAAAAAAAERAgMxBCHBEgVBUWGBQhMV/9oADAMBAAIRAxEAPwDC9g7u
3dH33uJiNeri2wxcJQQ01JfCUNodVwCUqwSlI/AK3sGKropS0Kd7OWZMXcPsyZDdnQ7he5UFhQQ/
LZelOMoURiEqWlRAOFdumNOGqyeTYtPzFfL1df8ASm5XCTP0ey0e5eceyZu4zZc5VhjlGOFZ/cKJ
dMKNeRNhbclzrOJxQCgOSW7o5a/oKXMRFXNT5iYw/EaAUtbL61tOBKTwXglWOXrW30zgj0RUmLlb
9p3rZ/r/ANd3GxWJtm3XC8B1EO2RsEqDkng88pAP8JSnEk8ugqlt6Xy5Fa3FImyNVUI8z8nJCU7o
SOSRAA/O5qbuXx9+Rxg8ToGsssCgFAc/7q+b9xXrc11u7V3iNN3CW/JbQUuhaUuuFYBIHMA9K08e
+rWqUPgivbC25MofK25Qoq81DKjwKlJeUT+kE13+jXyZ59DKX6a9WXPYfmO+msTPJdtp6AWMuhq4
5swHPVFVN1uFkiFoS46dJSqqEgoBQCgFAKAUAoBQH//Z
------=_Part_37643343_1124091921.1494519067933
Content-Type: image/jpeg; name=element-signature_payzen_61x28.jpg
Content-Disposition: attachment; filename=element-signature_payzen_61x28.jpg
Content-Transfer-Encoding: base64
Content-ID: <86ad24eaa2a146e1b7ee93db04f055468345dc13@zimbra>
/9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov
L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl
aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4
OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6
MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5
OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht
bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i
aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w
PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9
InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1
bWVudElEPSJ4bXAuZGlkOkU1NjczQjM2OEEzNDExRTZCOEJBQ0Y4Mzg3RTEzODkyIiB4bXBNTTpJ
bnN0YW5jZUlEPSJ4bXAuaWlkOkU1NjczQjM1OEEzNDExRTZCOEJBQ0Y4Mzg3RTEzODkyIiB4bXA6
Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N
OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1
LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4
YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG
PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE
BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f
Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f
Hx8fHx8fHx8fHx8fH//AABEIABwAPQMBEQACEQEDEQH/xABvAAABBAMAAAAAAAAAAAAAAAAAAQUG
BwIDBAEBAAAAAAAAAAAAAAAAAAAAABAAAQQABAQEAgsBAAAAAAAAAQIDBAUAERIGITETFEEiFQfS
I1FhcYGhMlIkRMQWhhEBAAAAAAAAAAAAAAAAAAAAAP/aAAwDAQACEQMRAD8AvqZ7q7OhzZMSS9IQ
Yjy2JT/avqZbW2rSvU6lBSACOeeAljLzTzSHmVhxpxIW24k5pUlQzBBHgRgM8BBJ9fKuvcGwr3La
wgxIlfGeaagyVsJ1uOOBRUBmOSRgI0bnZgfQwdx7qDrroYZSVzBrcJ0hKM2xq+7AWBU7PTXTEShc
2svRx6MuWp5o5gjigj68BombFRKmPyTfXTPXWpzoszloaRqOelCQPKkeAwEP6lp6f6V6vYaP9Z6b
3fcr7ntuhno6vPnxwGyohb2ntbpr6Y17NdKt7Bp5+YHlPJLitKyltI0KGk+XPANVgzV1Eyyqbe3s
IMmnhsMbVaYcebDraY+XVbQ15XXFOghQVnkMBkbjcVPTUs6M5IkPbnpWa1hKlrWG7QZBp0hROnUh
xRUfHTgJDWuwtsbptVTpC1xaqhgJfkuFTji9DjoKiTmpSlq/HAcO2d11d/cuXUySJG4C0+NvbfCH
CmK2hClHUop0GQ6E+dWfAeUYBi2lY2E+zgW7twhVlHDk+7AkzFO9u2lRdjORFIEZrTmAkA+GYwDl
TwLJhjZFouxsF3NzN6r7Lj7imExHUOSHWi0TpyCdORIzzwHT/J/7n+vgLVAA5YBChBUlRSCpOelR
HEZ88sA2WG3YVhb1lnJW4VVJcXFjAgM9VxOjqKTlmVJTnp48M8Ax2+3N3J3TJu6KVAbRKisxnWpr
brh+SpasxoKf14BBD91hxE2kB+nt5Px4AEL3VGoiZSAr4qyjyOP2+fAL2nuvw/e0vDl8iT8eAbv8
Lur0vPvYXrPrfrfU6bvb59Lp6NOev83HngLBwBgDAGAMAYAwBgP/2Q==
------=_Part_37643343_1124091921.1494519067933--
------=_Part_37643342_929927371.1494519067933--
7 years
High latency on storage domains and sanlock renewal error
by Stefano Bovina
Hi, the engine logs show high latency on storage domains: "Storage domain
<xxxx> experienced a high latency of 19.2814 seconds from ...... This may
cause performance and functional issues."
Looking at host logs, I found also these locking errors:
2017-05-02 20:52:13+0200 33883 [10098]: s1 renewal error -202 delta_length
10 last_success 33853
2017-05-02 20:52:19+0200 33889 [10098]: 6a386652 aio collect 0
0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe9fb000 result 1048576:0 other free
2017-05-02 21:08:51+0200 34880 [10098]: 6a386652 aio timeout 0
0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe4f2000 ioto 10 to_count 24
2017-05-02 21:08:51+0200 34880 [10098]: s1 delta_renew read rv -202 offset
0 /dev/6a386652-629d-4045-835b-21d2f5c104aa/ids
2017-05-02 21:08:51+0200 34880 [10098]: s1 renewal error -202 delta_length
10 last_success 34850
2017-05-02 21:08:53+0200 34883 [10098]: 6a386652 aio collect 0
0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe4f2000 result 1048576:0 other free
2017-05-02 21:30:40+0200 36189 [10098]: 6a386652 aio timeout 0
0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe9fb000 ioto 10 to_count 25
2017-05-02 21:30:40+0200 36189 [10098]: s1 delta_renew read rv -202 offset
0 /dev/6a386652-629d-4045-835b-21d2f5c104aa/ids
2017-05-02 21:30:40+0200 36189 [10098]: s1 renewal error -202 delta_length
10 last_success 36159
2017-05-02 21:30:45+0200 36195 [10098]: 6a386652 aio collect 0
0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe9fb000 result 1048576:0 other free
and this vdsm errors too:
Thread-22::ERROR::2017-05-02 21:53:48,147::sdc::137::
Storage.StorageDomainCache::(_findDomain) looking for unfetched domain
f8f21d6c-2425-45c4-aded-4cb9b53ebd96
Thread-22::ERROR::2017-05-02 21:53:48,148::sdc::154::
Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain
f8f21d6c-2425-45c4-aded-4cb9b53ebd96
Engine instead is showing this errors:
2017-05-02 21:40:38,089 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand]
(DefaultQuartzScheduler_Worker-96) Command SpmStatusVDSCommand(HostName = <
myhost.example.com>, HostId = dcc0275a-b011-4e33-bb95-366ffb0697b3,
storagePoolId = 715d1ba2-eabe-48db-9aea-c28c30359808) execution failed.
Exception: VDSErrorException: VDSGenericException: VDSErrorException:
Failed to SpmStatusVDS, error = (-202, 'Sanlock resource read failure',
'Sanlock exception'), code = 100
2017-05-02 21:41:08,431 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand]
(DefaultQuartzScheduler_Worker-53) [6e0d5ebf] Failed in SpmStatusVDS method
2017-05-02 21:41:08,443 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand]
(DefaultQuartzScheduler_Worker-53) [6e0d5ebf] Command
SpmStatusVDSCommand(HostName = <myhost.example.com>, HostId =
7991933e-5f30-48cd-88bf-b0b525613384, storagePoolId =
4bd73239-22d0-4c44-ab8c-17adcd580309) execution failed. Exception:
VDSErrorException: VDSGenericException: VDSErrorException: Failed to
SpmStatusVDS, error = (-202, 'Sanlock resource read failure', 'Sanlock
exception'), code = 100
2017-05-02 21:41:31,975 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand]
(DefaultQuartzScheduler_Worker-61) [2a54a1b2] Failed in SpmStatusVDS method
2017-05-02 21:41:31,987 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand]
(DefaultQuartzScheduler_Worker-61) [2a54a1b2] Command
SpmStatusVDSCommand(HostName = <myhost.example.com>, HostId =
dcc0275a-b011-4e33-bb95-366ffb0697b3, storagePoolId =
715d1ba2-eabe-48db-9aea-c28c30359808) execution failed. Exception:
VDSErrorException: VDSGenericException: VDSErrorException: Failed to
SpmStatusVDS, error = (-202, 'Sanlock resource read failure', 'Sanlock
exception'), code = 100
I'm using Fibre Channel or FCoE connectivity; storage array technical
support has analyzed it (also switch and OS configurations), but nothing
has been found.
Any advice?
Thanks
Installation info:
ovirt-release35-006-1.noarch
libgovirt-0.3.3-1.el7_2.1.x86_64
vdsm-4.16.30-0.el7.centos.x86_64
vdsm-xmlrpc-4.16.30-0.el7.centos.noarch
vdsm-yajsonrpc-4.16.30-0.el7.centos.noarch
vdsm-jsonrpc-4.16.30-0.el7.centos.noarch
vdsm-python-zombiereaper-4.16.30-0.el7.centos.noarch
vdsm-python-4.16.30-0.el7.centos.noarch
vdsm-cli-4.16.30-0.el7.centos.noarch
qemu-kvm-ev-2.3.0-29.1.el7.x86_64
qemu-kvm-common-ev-2.3.0-29.1.el7.x86_64
qemu-kvm-tools-ev-2.3.0-29.1.el7.x86_64
libvirt-client-1.2.17-13.el7_2.3.x86_64
libvirt-daemon-driver-storage-1.2.17-13.el7_2.3.x86_64
libvirt-python-1.2.17-2.el7.x86_64
libvirt-daemon-driver-nwfilter-1.2.17-13.el7_2.3.x86_64
libvirt-daemon-driver-nodedev-1.2.17-13.el7_2.3.x86_64
libvirt-lock-sanlock-1.2.17-13.el7_2.3.x86_64
libvirt-glib-0.1.9-1.el7.x86_64
libvirt-daemon-driver-network-1.2.17-13.el7_2.3.x86_64
libvirt-daemon-driver-lxc-1.2.17-13.el7_2.3.x86_64
libvirt-daemon-driver-interface-1.2.17-13.el7_2.3.x86_64
libvirt-1.2.17-13.el7_2.3.x86_64
libvirt-daemon-1.2.17-13.el7_2.3.x86_64
libvirt-daemon-config-network-1.2.17-13.el7_2.3.x86_64
libvirt-daemon-driver-secret-1.2.17-13.el7_2.3.x86_64
libvirt-daemon-config-nwfilter-1.2.17-13.el7_2.3.x86_64
libvirt-daemon-kvm-1.2.17-13.el7_2.3.x86_64
libvirt-daemon-driver-qemu-1.2.17-13.el7_2.3.x86_64
------- vdsm.log (high latency)
Thread-21::DEBUG::2017-05-02 18:02:23,646::fileSD::261::
Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1
records out\n331 bytes (331 B) copied, 0.000285529 s, 1.2 MB/s\n'; <rc> = 0
Thread-18::DEBUG::2017-05-02 18:02:24,335::blockSD::596::
Storage.Misc.excCmd::(getReadDelay) /bin/dd
if=/dev/2c501858-bf8d-49a5-a42b-bca341b47827/metadata
iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
Thread-18::DEBUG::2017-05-02 18:02:24,343::blockSD::596::
Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0
records out\n4096 bytes (4.1 kB) copied, 0.000489782 s, 8.4 MB/s\n'; <rc> =
0
Thread-19::DEBUG::2017-05-02 18:02:24,635::blockSD::596::
Storage.Misc.excCmd::(getReadDelay) /bin/dd
if=/dev/c5dc09c4-cd79-42d2-a5af-89953076f79e/metadata
iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
Thread-19::DEBUG::2017-05-02 18:02:24,643::blockSD::596::
Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0
records out\n4096 bytes (4.1 kB) copied, 0.000558622 s, 7.3 MB/s\n'; <rc> =
0
Thread-22::DEBUG::2017-05-02 18:02:24,722::blockSD::596::
Storage.Misc.excCmd::(getReadDelay) /bin/dd
if=/dev/f8f21d6c-2425-45c4-aded-4cb9b53ebd96/metadata
iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
Thread-22::DEBUG::2017-05-02 18:02:24,729::blockSD::596::
Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0
records out\n4096 bytes (4.1 kB) copied, 0.000632576 s, 6.5 MB/s\n'; <rc> =
0
JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:25,056::stompReactor::
98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame
command='SEND'>
JsonRpcServer::DEBUG::2017-05-02 18:02:25,057::__init__::506::
jsonrpc.JsonRpcServer::(serve_requests) Waiting for request
Thread-9372::DEBUG::2017-05-02 18:02:25,060::stompReactor::
163::yajsonrpc.StompServer::(send) Sending response
Thread-20::DEBUG::2017-05-02 18:02:25,895::blockSD::596::
Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0
records out\n4096 bytes (4.1 kB) copied, 19.2814 s, 0.2 kB/s\n'; <rc> = 0
JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:28,075::stompReactor::
98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame
command='SEND'>
JsonRpcServer::DEBUG::2017-05-02 18:02:28,076::__init__::506::
jsonrpc.JsonRpcServer::(serve_requests) Waiting for request
Thread-9373::DEBUG::2017-05-02 18:02:28,078::stompReactor::
163::yajsonrpc.StompServer::(send) Sending response
JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:31,094::stompReactor::
98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame
command='SEND'>
JsonRpcServer::DEBUG::2017-05-02 18:02:31,095::__init__::506::
jsonrpc.JsonRpcServer::(serve_requests) Waiting for request
Thread-9374::DEBUG::2017-05-02 18:02:31,097::stompReactor::
163::yajsonrpc.StompServer::(send) Sending response
Thread-21::DEBUG::2017-05-02 18:02:33,652::fileSD::261::
Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/<myho
st.example.com>:_ISO/f105bdc6-efdc-445c-b49e-aa38c91c2569/dom_md/metadata
iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
Thread-21::DEBUG::2017-05-02 18:02:33,660::fileSD::261::
Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1
records out\n331 bytes (331 B) copied, 0.000246594 s, 1.3 MB/s\n'; <rc> = 0
JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:34,112::stompReactor::
98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame
command='SEND'>
JsonRpcServer::DEBUG::2017-05-02 18:02:34,114::__init__::506::
jsonrpc.JsonRpcServer::(serve_requests) Waiting for request
Thread-9375::DEBUG::2017-05-02 18:02:34,117::task::595::
Storage.TaskManager.Task::(_updateState)
Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::moving
from state init -> state preparing
Thread-9375::INFO::2017-05-02 18:02:34,117::logUtils::44::dispatcher::(wrapper)
Run and protect: repoStats(options=None)
Thread-9375::INFO::2017-05-02 18:02:34,118::logUtils::47::dispatcher::(wrapper)
Run and protect: repoStats, Return response:
{'2c501858-bf8d-49a5-a42b-bca341b47827':
{'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489782',
'lastCheck': '9.8', 'valid': True}, 'f8f21d6c-2425-45c4-aded-4cb9b53ebd96':
{'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632576',
'lastCheck': '9.4', 'valid': True}, '6a386652-629d-4045-835b-21d2f5c104aa':
{'code': 0, 'version': 3, 'acquired': True, 'delay': '19.2814',
'lastCheck': '8.2', 'valid': True}, 'f105bdc6-efdc-445c-b49e-aa38c91c2569':
{'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246594',
'lastCheck': '0.5', 'valid': True}, 'c5dc09c4-cd79-42d2-a5af-89953076f79e':
{'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558622',
'lastCheck': '9.5', 'valid': True}}
Thread-9375::DEBUG::2017-05-02 18:02:34,118::task::1191::
Storage.TaskManager.Task::(prepare)
Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::finished:
{'2c501858-bf8d-49a5-a42b-bca341b47827': {'code': 0, 'version': 3,
'acquired': True, 'delay': '0.000489782', 'lastCheck': '9.8', 'valid':
True}, 'f8f21d6c-2425-45c4-aded-4cb9b53ebd96': {'code': 0, 'version': 3,
'acquired': True, 'delay': '0.000632576', 'lastCheck': '9.4', 'valid':
True}, '6a386652-629d-4045-835b-21d2f5c104aa': {'code': 0, 'version': 3,
'acquired': True, 'delay': '19.2814', 'lastCheck': '8.2', 'valid': True},
'f105bdc6-efdc-445c-b49e-aa38c91c2569': {'code': 0, 'version': 0,
'acquired': True, 'delay': '0.000246594', 'lastCheck': '0.5', 'valid':
True}, 'c5dc09c4-cd79-42d2-a5af-89953076f79e': {'code': 0, 'version': 3,
'acquired': True, 'delay': '0.000558622', 'lastCheck': '9.5', 'valid':
True}}
Thread-9375::DEBUG::2017-05-02 18:02:34,119::task::595::
Storage.TaskManager.Task::(_updateState)
Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::moving
from state preparing -> state finished
Thread-9375::DEBUG::2017-05-02 18:02:34,119::resourceManager:
:940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests
{} resources {}
Thread-9375::DEBUG::2017-05-02 18:02:34,119::resourceManager:
:977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-9375::DEBUG::2017-05-02 18:02:34,119::task::993::
Storage.TaskManager.Task::(_decref)
Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::ref
0 aborting False
Thread-9375::DEBUG::2017-05-02 18:02:34,122::stompReactor::
163::yajsonrpc.StompServer::(send) Sending response
JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:34,128::stompReactor::
98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame
command='SEND'>
JsonRpcServer::DEBUG::2017-05-02 18:02:34,129::__init__::506::
jsonrpc.JsonRpcServer::(serve_requests) Waiting for request
Thread-9376::DEBUG::2017-05-02 18:02:34,132::stompReactor::
163::yajsonrpc.StompServer::(send) Sending response
7 years
User story
by Johannes Spanier
Hi oVirt community.
I did a short series for tweets @jospanier judging my first time user
experience with several virtualization platforms and was asked by Sandro
Bonazzola to elaborate a bit further than what fits into 140 chars.
I had a specific use case: The small-ish learning lab with only 2-3
nodes and it needs to be free. I also wanted live migration to stay
flexible with my hosts.
I currently use my lab for to run ~10 virtual CSR1000V routers on free
ESXi in addition to some real router hardware. I want to expand the lab
to be able to explore some other technologies as well like network
automation, SDN, infrastructure as code and the likes.
The lineup for the PoC was oVirt, ESXi, Openstack and Proxmox VE.
I my tweets I was referring to a) the install procedure and b) the
operational experience.
Here is what I found. These findings are highly subjective and
debatable. I am aware of that.
Both ESXi and Proxmox VE is trivial to install. You grab the ISO image,
use a tool like Rufus to make an bootable USB stick or use iLO virtual
CD functionality and off you go. Both installers do not ask many
questions and just do their job. After installation ESXi is all ready to
run. Just open the WebGui and start deploying your first node. With
Proxmox VE you get a TUI wizard guiding you though the last steps. After
that the WebGui is ready and you can deploy your first VM immediately.
I found oVirt a bit more involved to install. You have to install the
Engine on one node and then register the other hosts with it. While that
process is easy to handle it is a bit more work. A big thing for me was
that at first glance there did no seem to be a "single node" install. My
fist impression was that I needed a minimum of two servers. Of course
later I learned about the Hosted Engine and the All-In-One install.
Do not get me wrong. First time oVirt installation is still easy to
handle on a quiet afternoon.
Openstack installation compared to that is a PITA nightmare. I tried
both RDO (TripleO) and Fuel for setup but gave up after two days for
both, confused about what I actually need to do for a start. Got some
nodes running with Fuel but was not satisfied. I then followed the
Openstack manual Install Guide. I have a day job, so it took me about 5
days to get through the whole procedure, but a least I understood what
was going on and what I needed to do.
So that was my "first day" experience with those.
Now for the "second day" i.e. operation.
ESXi and Proxmox VE are both very simple to understand. You usually do
not need a manual to find you way around. Deploying a VM is a breeze.
oVirt is pretty simple to understand too. But you have to wrap your head
around the Data Center principle underpinning everything. Its just a bit
more complicated. On one or two occasions while playing around it was
unclear at first why my datacenter was offline and I had to consult the
manual for that. One can immediately feel that multi-tenancy is a big
benefit of oVirt that is not so obvious in ESXi and Proxmox. But it
comes with the price of added complexity.
The new WebGui in the ESXi 6.5 I used is sloooow but some functions are
not available with the vSphere Client Tool any more.
Proxmox and oVirt WebGui are very responsive and "feel" way better. The
Openstack WebGui is also quite nice.
If you want to build a private multi-teneant scale-out cloud OpenStack
is probably your best horse in the stable. But for my purpose it was
just overkill. The process of deploying a simple VM was the most work
from all four tools.
Wrap-up
For the specific use-case (see above) Proxmox VE was the best fit for
me, closely followed by oVirt due to the more involved installation.
ESXi comes in lagging in third place as it does not offer live migration
in the free version and due to the poor WebGui experience I got. Also
you have to pay big bucks to get the same functionality as in the other
three. Openstack is placed at a distant fourth place for this use case.
Hope that was interesting. Do reach out to me on twitter if you have any
further questions or suggestions.
Regards
Johannes
7 years
