May 2017 - Users - oVirt List Archives

Removing *250GB Disk from Gluster SD - Error
by Sven Achtelik 15 May '17

15 May '17

--_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4ECBSOCRATESasl_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi All, I was trying to remove a ~250GB Disk from a Gluster SD and the engine has = gone crazy. The Storage latency went up dramatically, which caused a change= of the spm and everything to get unresponsive for about 10-30 seconds. How= do I remove such a big disk in a way that this doesn't happen again ? I an= yone running gluster on with a caching option ? The Bricks are on a raid 5+= 0 and should be pretty fast. Are there any values that can be tuned in the = Engine - maybe for the acceptance of a little more storage latency ? Thank you, Sven --_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4ECBSOCRATESasl_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV=3D"Content-Type" CONTENT= =3D"text/html; charset=3Dus-ascii"><meta name=3DGenerator content=3D"Micros= oft Word 15 (filtered medium)"><style></style></head><body lang=3DDE link=3D"#0563C1" v= link=3D"#954F72"><div class=3DWordSection1><p class=3DMsoNormal>Hi All, <o:= p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>= <span lang=3DEN-US>I was trying to remove a  ~250GB Disk from a Gluste= r SD and the engine has gone crazy. The Storage latency went up dramaticall= y, which caused a change of the spm and everything to get unresponsive for = about 10-30 seconds. How do I remove such a big disk in a way that this doe= sn’t happen again ? I anyone running gluster on with a caching option= ? The Bricks are on a raid 5+0 and should be pretty fast. Are there any va= lues that can be tuned in the Engine – maybe for the acceptance of a = little more storage latency ? <o:p></o:p></span></p><p class=3DMsoNormal><s= pan lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span lan= g=3DEN-US>Thank you, <o:p></o:p></span></p><p class=3DMsoNormal><span lang= =3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span lang=3DEN-U= S>Sven<o:p></o:p></span></p><p class=3DMsoNormal><o:p> </o:p></p></div= ></body></html>= --_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4ECBSOCRATESasl_--

1 0

Internet access for oVirt Nodes?
by Matthias Leopold 15 May '17

15 May '17

hi, do hypervisors, that are running oVirt Node (not standard CentOS/RHEL), need internet access for updates or can they be in a private, non routed network (and updates happen via engine)? it seems the latter is the case, but i want to be sure thx matthias

2 1

Re: [ovirt-users] can i Extend volume from replica 2 to replica 3 with arbiter
by Ravishankar N 15 May '17

15 May '17

This is a multi-part message in MIME format. --------------0CEFB242D3E16A95E29AC6A4 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit > ---------- Forwarded message ---------- > From: *Khalid Jamal* <khalid.jamal(a)earthlinktele.com > <mailto:khalid.jamal@earthlinktele.com>> > Date: Sat, May 13, 2017 at 10:51 PM > Subject: [ovirt-users] can i Extend volume from replica 2 to replica 3 > with arbiter > To: users(a)ovirt.org <mailto:users@ovirt.org> > > > Dear Team > > i need you advice for convert our volume replica 2 to replica 3 with > arbiter but important thing it's production environments , i try to > convert the same name of volume in replica 2 to convert is to the > replica 3 to avoid losing vm's or any data that's what i do it : > > > # gluster volume create gfs1 replica 3 arbiter 1 s1:/export/sdb1/br1 > s2:/export/sdb1/br1 s3:/export/sdb1/br1 s1:/export/sdc1/br1 > s2:/export/sdc1/br1 s3:/export/sdc1/br1 s4:/export/sdb1/br1 > s5:/export/sdb1/br1 s6:/export/sdb1/br1 s4:/export/sdc1/br1 > s5:/export/sdc1/br1 s6:/export/sdc1/br1 > > that's the result : > > > volume create: gfs1: failed: Volume gfs1 already exists > > If you are converting an existing replica 2 to arbiter, you would need to use the `add-brick` command. The syntax is given here: https://review.gluster.org/#/c/14126/8//COMMIT_MSG Hope that helps, Ravi > > i try to change the name but without any success what shall i do. > > > best regards > > > > Eng khalid jamal > System Admin@IT Department > Earthlink Telecom > > Email: khalid.jamal(a)earthlinktele.com > <mailto:khalid.jamal@earthlinktele.com> > No: 3355 > skype: engkhalid21986 > NO : 07704268321 > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org <mailto:Users@ovirt.org> > http://lists.ovirt.org/mailman/listinfo/users > <http://lists.ovirt.org/mailman/listinfo/users> > > --------------0CEFB242D3E16A95E29AC6A4 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <br> <blockquote cite="mid:CACjzOvcGHqfYQiAy4XR+vVCtHa=SM=-gXatrnaY2nN9NGunSsw@mail.gmail.com" type="cite"> <div dir="ltr"> <div> <div class="gmail_quote">---------- Forwarded message ----------<br> From: <b class="gmail_sendername">Khalid Jamal</b> <span dir="ltr"><<a moz-do-not-send="true" href="mailto:khalid.jamal@earthlinktele.com">khalid.jamal(a)earthlinktele.com</a>></span><br> Date: Sat, May 13, 2017 at 10:51 PM<br> Subject: [ovirt-users] can i Extend volume from replica 2 to replica 3 with arbiter<br> To: <a moz-do-not-send="true" href="mailto:users@ovirt.org">users(a)ovirt.org</a><br> <br> <br> <div> <p>Dear Team</p> <p>i need you advice for convert our volume replica 2 to replica 3 with arbiter but important thing it's production environments , i try to convert the same name of volume in replica 2 to convert is to the replica 3 to avoid losing vm's or any data that's what i do it :</p> <p><br> </p> <p><span style="color:rgb(0,0,255)"># gluster volume create gfs1 replica 3 arbiter 1 s1:/export/sdb1/br1 s2:/export/sdb1/br1 s3:/export/sdb1/br1 s1:/export/sdc1/br1 s2:/export/sdc1/br1 s3:/export/sdc1/br1 s4:/export/sdb1/br1 s5:/export/sdb1/br1 s6:/export/sdb1/br1 s4:/export/sdc1/br1 s5:/export/sdc1/br1 s6:/export/sdc1/br1</span></p> <p>that's the result :</p> <p><br> </p> <p><span style="color:rgb(255,0,0)">volume create: gfs1: failed: Volume gfs1 already exists</span></p> <p><span style="color:rgb(255,0,0)"><br> </span></p> </div> </div> </div> </div> </blockquote> If you are converting an existing replica 2 to arbiter, you would need to use the `add-brick` command. The syntax is given here: <a class="moz-txt-link-freetext" href="https://review.gluster.org/#/c/14126/8//COMMIT_MSG">https://review.gluster.org/#/c/14126/8//COMMIT_MSG</a><br> Hope that helps,<br> Ravi<br> <blockquote cite="mid:CACjzOvcGHqfYQiAy4XR+vVCtHa=SM=-gXatrnaY2nN9NGunSsw@mail.gmail.com" type="cite"> <div dir="ltr"> <div> <div class="gmail_quote"> <div> <p><span style="color:rgb(0,0,0)">i try to change the name but without any success what shall i do.</span></p> <p><br> </p> <p>best regards</p> <p><br> </p> <p><br> </p> <p>Eng khalid jamal<br> System Admin@IT Department<br> Earthlink Telecom</p> <div class="m_-3760168994860256500io-ox-signature"> <p>Email: <a moz-do-not-send="true" href="mailto:khalid.jamal@earthlinktele.com" target="_blank">khalid.jamal(a)earthlinktele.com</a><br> No: 3355<br> skype: engkhalid21986<br> NO : 07704268321</p> </div> </div> <br> ______________________________<wbr>_________________<br> Users mailing list<br> <a moz-do-not-send="true" href="mailto:Users@ovirt.org">Users(a)ovirt.org</a><br> <a moz-do-not-send="true" href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><br> <br> </div> <br> </div> </div> </blockquote> <p><br> </p> </body> </html> --------------0CEFB242D3E16A95E29AC6A4--

1 0

Maintenance mode for storage?
by Troels Arvin 14 May '17

14 May '17

Hello, I would like to make use of the new ovirt feature where a LUN may be removed from a storage domain, provided there's enough free space on the remaining LUNs in the domain. It seems the storage domain needs to be put in maintenance mode before this may be accomplished. But what's the consequence of putting a storage domain in maintenance mode? Can guests using the domain keep running while the storage domain is in maintenance mode? Does something stop working while a storage domain is in maintenance mode? -- Regards, Troels Arvin

3 3

Engine deploy tab is missing when restoring from db-backup?
by gflwqs gflwqs 14 May '17

14 May '17

Hi list, I have restored my 4.1 engine. After i have restored the engine the engine deploy tab is missing? And since it is not possible anymore to deploy thru command line i am not able to deploy new hosts? - Does anybody know a workaround to deploy new hosts? - Is this a bug or am i doing something wrong when restoring? This is how i restored: [root@ovirt-engine ~]# engine-backup --mode=restore --file=backup.tar --log=restore.log --provision-db --provision-dwh-db --restore-permissions Thanks! Christian

2 1

The number of LVs on the domain VPLEX_DATA_DOMAIN exceeded 300, you are approaching the limit where performance may degrade.
by Rogério Ceni Coelho 14 May '17

14 May '17

Hi oVirt Admins, I have two data domains using FC SAN, with 150 VMs. Each VM have 3 or 4 disks. A few time ago i saw the above message on Events. What can i do ? What are the alternatives ? What can i do ? The number of LVs on the domain VPLEX_DATA_DOMAIN exceeded 300, you are approaching the limit where performance may degrade.

2 1

problem while updating oVirt from 3.6 to 4.0
by Nelson Lameiras 14 May '17

14 May '17

------=_Part_37643342_929927371.1494519067933 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello,=20 Not sure if I should post here, or on the dev mailling list.=20 I had a serious problem when upgrading an oVirt cluster from 3.6 to 4.0 (be= fore updating to 4.1)=20 The error on engine-setup log was :=20 "schema.sh: FATAL: Cannot execute sql command: --file=3D/usr/share/ovirt-en= gine/dbscripts/upgrade/04_00_0930_disallow_boot_protocol_to_be_null.sql"=20 After long hours of debuguing and analysing I found out the problem. On dat= abase, some entries on table network_attachements had a NULL value which we= re incompatible with the sql file above.=20 I'm guessing this is an "exotic situation" which shouldn't exist... in theo= ry ;)=20 Anyway, I'm fairly sure that the solution for this problem would be to patc= h the following file 'ovirt-engine/packaging/dbscripts/upgrade/04_00_0910_d= o_not_allow_null_boot_protocol.sql'=20 by adding the following line " update network_attachments set boot_protocol= =3D ' NONE ' where boot_protocol is null ;"=20 If a dev want to discuss it further, I'll be happy to explain my thoughts o= n this matter.=20 cordialement, regards,=20 =09Nelson LAMEIRAS=20 Ing=C3=A9nieur Syst=C3=A8mes et R=C3=A9seaux / Systems and Networks enginee= r=20 Tel: +33 5 32 09 09 70=20 nelson.lameiras(a)lyra-network.com=20 www.lyra-network.com | www.payzen.eu=20 =09 =09 =09 Lyra Network, 109 rue de l'innovation, 31670 Lab=C3=A8ge, FRANCE=20 ------=_Part_37643342_929927371.1494519067933 Content-Type: multipart/related; boundary="----=_Part_37643343_1124091921.1494519067933" ------=_Part_37643343_1124091921.1494519067933 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: arial, helvetica, sans-serif; font-s= ize: 12pt; color: #000000"><div>Hello,<br></div><div><br data-mce-bogus=3D"= 1"></div><div>Not sure if I should post here, or on the dev mailling list.<= br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div><div>I ha= d a serious problem when upgrading an oVirt cluster from 3.6 to 4.0 (before= updating to 4.1)<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"= 1"></div><div>The error on engine-setup log was : <br data-mce-bogus=3D"1">= </div><div>"schema.sh: FATAL: Cannot execute sql command: --file=3D/usr/sha= re/ovirt-engine/dbscripts/upgrade/04_00_0930_disallow_boot_protocol_to_be_n= ull.sql"<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div>= <div>After long hours of debuguing and analysing I found out the problem. O= n database, some entries on table network_attachements had a NULL value whi= ch were incompatible with the sql file above.<br data-mce-bogus=3D"1"></div= ><div>I'm guessing this is an "exotic situation" which shouldn't exist... i= n theory ;)<br data-mce-bogus=3D"1"></div><div><br></div><div>Anyway, I'm f= airly sure that the solution for this problem would be to patch the followi= ng file 'ovirt-engine/packaging/dbscripts/upgrade/04_00_0910_do_not_allow_n= ull_boot_protocol.sql' </div><div>by adding the following line "<span class= =3D"pl-k">update</span> network_attachments <span class=3D"pl-k">set</span>= boot_protocol<span class=3D"pl-k">=3D</span><span class=3D"pl-s"><span cla= ss=3D"pl-pds">'</span>NONE<span class=3D"pl-pds">'</span></span> <span clas= s=3D"pl-k">where</span> boot_protocol is <span class=3D"pl-k">null</span>;"= <br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div><div>If = a dev want to discuss it further, I'll be happy to explain my thoughts on t= his matter. <br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></= div><div data-marker=3D"__SIG_PRE__"><div>cordialement, regards,</div><div>= <br data-mce-bogus=3D"1"></div><table style=3D"margin: 0px; table-layout: f= ixed; border: none; width: 345pt; padding: 0px;" data-mce-style=3D"margin: = 0px; table-layout: fixed; border: none; width: 345pt; padding: 0px;" width= =3D"460" cellspacing=3D"0" cellpadding=3D"0" border=3D"0"><tbody><tr><td st= yle=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2= b3c7a; line-height: 16px; width: 86.25pt; text-align: left;" data-mce-style= =3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3c= 7a; line-height: 16px; width: 86.25pt; text-align: left;" width=3D"115" val= ign=3D"top"><a href=3D"https://www.lyra-network.com/" style=3D"border: none= ; text-decoration: none; width: 100%; display: block; clear: both;" data-mc= e-href=3D"https://www.lyra-network.com/" data-mce-style=3D"border: none; te= xt-decoration: none; width: 100%; display: block; clear: both;"><img src=3D= "cid:1db6da5091d14a0982ffcf8c4fef8a46b32a3417@zimbra" alt=3D"" data-mce-src= =3D"/home/admin(a)lyra-network.com/corporate-documents/element-signature_logo= _lyra_115x94.jpg" doc=3D"corporate-documents/element-signature_logo_lyra_11= 5x94.jpg" height=3D"94" width=3D"115" border=3D"0"></a><br data-mce-bogus= =3D"1"></td><td style=3D"margin: 0; font-size: 11px; font-family: Arial,san= s-serif; color: #2b3c7a; line-height: 16px; width: 258.75pt;" data-mce-styl= e=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3= c7a; line-height: 16px; width: 258.75pt;" width=3D"345" valign=3D"top"><tab= le style=3D"margin: 0; width: 258.75pt; table-layout: fixed; border: none;"= data-mce-style=3D"margin: 0; width: 258.75pt; table-layout: fixed; border:= none;" width=3D"345" cellspacing=3D"0" cellpadding=3D"0" border=3D"0"><tbo= dy><tr><td style=3D"font-size: 16px; font-family: Arial,sans-serif; color: = #2b3c7a; line-height: 18px; font-weight: bold;" data-mce-style=3D"font-size= : 16px; font-family: Arial,sans-serif; color: #2b3c7a; line-height: 18px; f= ont-weight: bold;">Nelson LAMEIRAS</td></tr><tr><td style=3D"font-family: A= rial,sans-serif; color: #2b3c7a; font-size: 11px; line-height: 16px;" data-= mce-style=3D"font-family: Arial,sans-serif; color: #2b3c7a; font-size: 11px= ; line-height: 16px;">Ing=C3=A9nieur Syst=C3=A8mes et R=C3=A9seaux<span sty= le=3D"font-family: Arial,sans-serif; color: #337ab7; font-size: 11px;" data= -mce-style=3D"font-family: Arial,sans-serif; color: #337ab7; font-size: 11p= x;"> / Systems and Networks engineer</span></td></tr><tr><td style=3D"line-= height: 16px; font-family: 'Arial',sans-serif; color: #2b3c7a; font-size: 1= 1px;" data-mce-style=3D"line-height: 16px; font-family: 'Arial',sans-serif;= color: #2b3c7a; font-size: 11px;"><span style=3D"font-family: Arial,sans-s= erif; color: #2b3c7a; font-size: 11px;" data-mce-style=3D"font-family: Aria= l,sans-serif; color: #2b3c7a; font-size: 11px;">Tel: +33 5 32 09 09 70</spa= n></td></tr><tr><td style=3D"line-height: 16px; font-family: 'Arial',sans-s= erif; color: #2b3c7a; font-size: 11px;" data-mce-style=3D"line-height: 16px= ; font-family: 'Arial',sans-serif; color: #2b3c7a; font-size: 11px;"><a hre= f=3D"mailto:nelson.lameiras@lyra-network.com" style=3D"font-size: 11px; fon= t-family: Arial,sans-serif; line-height: 16px; text-decoration: none;" data= -mce-href=3D"mailto:nelson.lameiras@lyra-network.com" data-mce-style=3D"fon= t-size: 11px; font-family: Arial,sans-serif; line-height: 16px; text-decora= tion: none;">nelson.lameiras(a)lyra-network.com</a><br data-mce-bogus=3D"1"><= /td></tr><tr><td style=3D"line-height: 16px; font-family: 'Arial',sans-seri= f; color: #2b3c7a; font-size: 11px;" data-mce-style=3D"line-height: 16px; f= ont-family: 'Arial',sans-serif; color: #2b3c7a; font-size: 11px;"><a href= =3D"https://www.lyra-network.com/" style=3D"font-size: 11px; font-family: A= rial,sans-serif; line-height: 16px; border: none; text-decoration: none;" d= ata-mce-href=3D"https://www.lyra-network.com/" data-mce-style=3D"font-size:= 11px; font-family: Arial,sans-serif; line-height: 16px; border: none; text= -decoration: none;">www.lyra-network.com</a> <a href=3D"https://payzen.eu" = style=3D"font-size: 11px; font-family: Arial,sans-serif; line-height: 16px;= border: none; text-decoration: none;" data-mce-href=3D"https://payzen.eu" = data-mce-style=3D"font-size: 11px; font-family: Arial,sans-serif; line-heig= ht: 16px; border: none; text-decoration: none;"> | www.payzen.eu</a><br dat= a-mce-bogus=3D"1"></td></tr></tbody></table></td></tr></tbody></table><tabl= e style=3D"margin: 0; table-layout: fixed; border: none; width: 345pt;" dat= a-mce-style=3D"margin: 0; table-layout: fixed; border: none; width: 345pt;"= width=3D"460" cellspacing=3D"0" cellpadding=3D"0"><tbody><tr><td style=3D"= margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3c7a; = line-height: 16px; width: 24pt; text-align: left;" data-mce-style=3D"margin= : 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3c7a; line-h= eight: 16px; width: 24pt; text-align: left;" width=3D"32" valign=3D"top"><a= href=3D"https://www.youtube.com/channel/UCrVl1CO_Jlu3KbiRH-tQ_vA" style=3D= "border: none; text-decoration: none; margin: 0; float: left; display: inli= ne-block; width: 32px;" data-mce-href=3D"https://www.youtube.com/channel/UC= rVl1CO_Jlu3KbiRH-tQ_vA" data-mce-style=3D"border: none; text-decoration: no= ne; margin: 0; float: left; display: inline-block; width: 32px;"><img src= =3D"cid:99ac6520e8e3715f40f650ce0d5f88a03a9bd713@zimbra" alt=3D"" data-mce-= src=3D"/home/admin(a)lyra-network.com/corporate-documents/element-signature_l= ogo_YouTube_32x28.jpg" doc=3D"corporate-documents/element-signature_logo_Yo= uTube_32x28.jpg" height=3D"28" width=3D"32" border=3D"0"></a><br data-mce-b= ogus=3D"1"></td><td style=3D"margin: 0; font-size: 11px; font-family: Arial= ,sans-serif; color: #2b3c7a; line-height: 16px; width: 30.75pt; text-align:= left;" data-mce-style=3D"margin: 0; font-size: 11px; font-family: Arial,sa= ns-serif; color: #2b3c7a; line-height: 16px; width: 30.75pt; text-align: le= ft;" width=3D"41" valign=3D"top"><a href=3D"https://www.linkedin.com/compan= y/lyra-network_2" style=3D"border: none; text-decoration: none; margin: 0; = float: left; display: inline-block; width: 41px;" data-mce-href=3D"https://= www.linkedin.com/company/lyra-network_2" data-mce-style=3D"border: none; te= xt-decoration: none; margin: 0; float: left; display: inline-block; width: = 41px;"><img src=3D"cid:a70d2dafceb98e64513f5a16b7d3ea0ab5a0f1f5@zimbra" dat= a-mce-src=3D"/home/admin(a)lyra-network.com/corporate-documents/element-signa= ture_logo_LinkedIn_41x28.jpg" doc=3D"corporate-documents/element-signature_= logo_LinkedIn_41x28.jpg" height=3D"28" width=3D"41" border=3D"0"></a><br da= ta-mce-bogus=3D"1"></td><td style=3D"margin: 0; font-size: 11px; font-famil= y: Arial,sans-serif; color: #2b3c7a; line-height: 16px; width: 31.5pt; text= -align: left;" data-mce-style=3D"margin: 0; font-size: 11px; font-family: A= rial,sans-serif; color: #2b3c7a; line-height: 16px; width: 31.5pt; text-ali= gn: left;" width=3D"42" valign=3D"top"><a href=3D"https://twitter.com/LyraN= etwork" style=3D"border: none; text-decoration: none; margin: 0; float: lef= t; display: inline-block; width: 42px;" data-mce-href=3D"https://twitter.co= m/LyraNetwork" data-mce-style=3D"border: none; text-decoration: none; margi= n: 0; float: left; display: inline-block; width: 42px;"><img src=3D"cid:a99= 4fe545de6341d6b369e33bbb18605bbbcef66@zimbra" alt=3D"" data-mce-src=3D"/hom= e/admin@lyra-network.com/corporate-documents/element-signature_logo_Twitter= _42x28.jpg" doc=3D"corporate-documents/element-signature_logo_Twitter_42x28= .jpg" height=3D"28" width=3D"42" border=3D"0"></a><br data-mce-bogus=3D"1">= </td><td style=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif= ; color: #2b3c7a; line-height: 16px; width: 258.75pt; text-align: left;" da= ta-mce-style=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; = color: #2b3c7a; line-height: 16px; width: 258.75pt; text-align: left;" widt= h=3D"345" valign=3D"top"><a href=3D"https://payzen.eu" style=3D"border: non= e; text-decoration: none; margin: 0; float: left; display: inline-block; wi= dth: 61px;" data-mce-href=3D"https://payzen.eu" data-mce-style=3D"border: n= one; text-decoration: none; margin: 0; float: left; display: inline-block; = width: 61px;"><img src=3D"cid:86ad24eaa2a146e1b7ee93db04f055468345dc13@zimb= ra" alt=3D"" data-mce-src=3D"/home/admin(a)lyra-network.com/corporate-documen= ts/element-signature_payzen_61x28.jpg" doc=3D"corporate-documents/element-s= ignature_payzen_61x28.jpg" height=3D"28" width=3D"61" border=3D"0"></a><br = data-mce-bogus=3D"1"></td></tr></tbody></table><table style=3D"margin: 0; t= able-layout: fixed; border: none; width: 345pt;" data-mce-style=3D"margin: = 0; table-layout: fixed; border: none; width: 345pt;" width=3D"460" cellspac= ing=3D"0" cellpadding=3D"0"><tbody><tr><td><hr style=3D"background: #293b79= none repeat scroll 0% 0%; width: 100%; height: 4px; color: #293b79; margin= : 0px;" data-mce-style=3D"background: #293b79 none repeat scroll 0% 0%; wid= th: 100%; height: 4px; color: #293b79; margin: 0px;"></td></tr></tbody></ta= ble><table style=3D"margin: 0; table-layout: fixed; border: none; width: 34= 5pt;" data-mce-style=3D"margin: 0; table-layout: fixed; border: none; width= : 345pt;" width=3D"460" cellspacing=3D"0" cellpadding=3D"0"><tbody><tr><td = style=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: = #2b3c7a; line-height: 16px; width: 30.75pt; text-align: left;" data-mce-sty= le=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b= 3c7a; line-height: 16px; width: 30.75pt; text-align: left;"><div>Lyra Netwo= rk, 109 rue de l'innovation, 31670 Lab=C3=A8ge, FRANCE</div></td></tr></tbo= dy></table><div><br></div></div></div></body></html> ------=_Part_37643343_1124091921.1494519067933 Content-Type: image/jpeg; name=element-signature_logo_lyra_115x94.jpg Content-Disposition: attachment; filename=element-signature_logo_lyra_115x94.jpg Content-Transfer-Encoding: base64 Content-ID: <1db6da5091d14a0982ffcf8c4fef8a46b32a3417@zimbra> /9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4 OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6 MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5 OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9 InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1 bWVudElEPSJ4bXAuZGlkOkU1QUU4Nzk1OEExMzExRTZBNTFCRjVENEYyNDYxNTQ1IiB4bXBNTTpJ bnN0YW5jZUlEPSJ4bXAuaWlkOkU1QUU4Nzk0OEExMzExRTZBNTFCRjVENEYyNDYxNTQ1IiB4bXA6 Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1 LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4 YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f Hx8fHx8fHx8fHx8fH//AABEIAF4AcwMBEQACEQEDEQH/xACdAAEBAAIDAQEAAAAAAAAAAAAACAUH AgMGBAEBAQADAQEAAAAAAAAAAAAAAAACBAUBAxAAAAUDAgAHDQcCBwAAAAAAAAECAwQRBQYSByFR E7RWFzcxQSKS0nOT03RVlQgYYXEyQiMUFYEzsVJicmODOBEAAgECAwcEAgIDAAAAAAAAAAECEQNR EwQhgbESMlIzMUGhFHEVwQUiQzT/2gAMAwEAAhEDEQA/AKpAE9b/AGQZdF3FtNpsd4l29M2DHSll iS6w0bzsp5slqJCiLvERnTuENTRQg7bckntK15vmojj1WfMP0rc+Jy/JD7Fjt+EMueJ6bbnBN4bR lkWdkt+XPtDaHSfjKnSHyUpTZkg+TcLSdFGRjyv3rUo0iqP8EoQkntZ7fcOy5VdrXGYxuccGW2+S 3nCecYq3oUWnU2RmfhGXAPPSXLcJNzVVT8kNVbnKKUHRmppW1/zBOSXVtZS4lpSjNtP8nLKhfcSR alqdPXp+ERhauKKTe38nX1WfMP0qc+Jy/JHPsWO34RPLniOqz5h+lTnxOX5IfYsdvwhlzxHVZ8w/ Spz4nL8kPsWO34Qy54jqs+YfpU58Tl+SH2LHb8IZc8R1WfMP0qc+Jy/JD7Fjt+EMueJ2bCX3MH9y LxZr7eJdxKBCkoW0/JdfaJ5mUy2a0EszL/MRHTuGGshDLTiqVf8AAst81GUGMssgAAAAE5b89s+L +zwefPDV0fhlv4FW71oo0ZRaAAAAAAAAAAAAACdtj+3DLfNXDn7I1dX4Y7uBWtdbKJGUWQAAAACc t+e2fF/Z4PPnhq6Pwy38Crd60UaMotAAAAAAAAAAAAABO2x/bhlvmrhz9kaur8Md3ArWutlEjKLI AAAABOW/PbPi/s8Hnzw1dH4Zb+BVu9aKNGUWjAKzrGk5cnEjkq/nVo5RMbk3NOnkzd/uU0fgKvdH rky5eb2I86rQz48iQAAAAAAAAABO2x/bhlvmrhz9kaur8Md3ArWutlEjKLIAAAABOW/PbPi/s8Hn zw1dH4Zb+BVu9aKNGUWjSD//AKkj+xnzJQ0V/wA2/wDkr/7D3e7GX5DiOMfzlniMTEMPIRORIJfg tOeCladCk/nNJH94raa1GcuVnpck4qqOrJdz4dr2yazKOhDjkxhlUGMszop98i/TOlD/AE/CNX+0 x23p27nIJXKRqeeyjdnLMd27sGSzLdEO4Xd4uWifqkhDDiFut0qrUSzQlNa9wz7g9bemjK44puiI yuNRTOzGs53hud+gvzsYjwMVnqNfLuqUTrEck69bitZmStPc1NJIz4hy5ZtKLpKskIzk36bDHRt2 9yMsuMw9v8ejybNBc5M5s5Rp5Uy4aEZuMJSai4dPCZFStBN6a3BLne1nMyT6Uffgu8GQ5DnysXuN mbtZx461TG1ms3kyGiLWRHXToMz8Hg7nfMQvaWMYcydTsLjcqG2BSPYnbY/twy3zVw5+yNXV+GO7 gVrXWyiRlFkAAAAAnLfntnxf2eDz54auj8Mt/Aq3etFGjKLROmdZbAxL5g/5yey6/GjREJW2wSTc M3YpoKms0F3VcY1bNpzscqKs5UnU9pad4cG3Fefw1UWXFO7x3mULkpaJJnoM6JNC10WREak/aXGK 8tLO1/ns2HorilsNTYzar/kOQWTa+5tmmBjk+W9cKGqimkrJS68RcCkoV/yC7clGMXcXrJI8Yptq OBsj5oEpTiNmSRESSuKSJJFwUJlzgoKv9f1P8Hrf9Db1wh/vbVJh6tH7lhbOvi5RBpr/AEqKMXR1 PZrYaC2x3Jgbawp+IZjBkwpkWS480603rSslkRU7qTOuiqFlUlEfepw6WosO61ODK9ufLsZ27f36 RkG/8q9OwXbe3PgKciMPp0uHHS22hpxRf60o1f4VC9DlsUrWjEHWdSghllknbY/twy3zVw5+yNXV +GO7gVrXWyiRlFkAAAAAnLfntnxf2eDz54auj8Mt/Aq3etFGjKLRxU00o6qQlR8ZkRhUGMyO7W7H 7FOvUpCSZgMrfMqERqNJeCgj41qokvtMTtxcpJL3OSdFU1n8vFimPwbrnF18O55DIXybhlw8ihZm s08RLdqVOJJC5rZqqgvSJ42V7v3MpM3dTBnyWbtBQmHFnXFpLzdXOWjW9tWo2irwPpd0pWhVPBPU R0qILTVWx+y+STuYmQj7sxHH1Kctb7NuahnMflKW2akk3J/bvGlojqtpv8ZuJP8ACR8Ag9M8dtTu YdErdfEJTCZKrY/L5JSySbrbCdKmicdWRLeWlJK/bs8skq+ElSacJ8HVppr3OZiP2RuxFK4W5xi3 LK2T5D8NmY8baHHnWySSeTSa6to1K8JTumn3gtM6PbtQzDYYqnqTtsf24Zb5q4c/ZGrq/DHdwK1r rZRIyiyAAAAATlvz2z4v7PB588NXR+GW/gVbvWijRlFoADGZHjVmyO2Ltd4YOTAcUlbjJLcbJRoO qam2pCuA+GlROFxwdV6nJRT2M+q226DbLfHt8BkmIcRtLMdlNaJQgqEVTqZ/eYjKTbqwlQ5Hb4Bp Uk4zRpUpa1FoTQ1uEaVqPg7qiUZGffDmYodSbNZ0toaTBjk02hbTaCaQSUtu/wBxCSpQkr/MXfHe d4iiP12z2h5k2XYMdxlSkuKbW0hSTW2kkIUZGVKpSkiI+8RApPEURydtltdQpDsRlxCtepKm0mR8 qdXKkZfn/NxjnMxQ+kcOk7bH9uGW+auHP2Rq6vwx3cCta62USMosgAAAAE5b89s+L+zwefPDV0fh lv4FW71oo0ZRaAAAAAAAAAAAAACdtj+3DLfNXDn7I1dX4Y7uBWtdbKJGUWQAAAACb9/3mWN4cbff WTTLUWEt1xX4UpTNeNSj+wiGtolW1LfwKt7qRuTrY226RwfSkKH1rnaz3zI4jrZ226RwfSkH1rna xmRxHWztt0jg+lIPrXO1jMjiOtnbbpHB9KQfWudrGZHEdbO23SOD6Ug+tc7WMyOJ+o3W24WtKE5F CUpR0SknCqZmH1rnazjuxW2pnbTfbPeGnHbXMamNtK0OLaVqJKjKtDELlqUNklQ7C5GfS6mOu+f4 XZpy4F0vMWHMbJKlsOrJKyJRVTUvtIdjZnJVSOuaXqfF1sbbdI4PpSEvrXO1nMyOJp7YiQxJ3oyi RHcS9Hejz3GXUcKVoVOZNKi+wyOovaxUsx3cDwtdbKNGUWgAAAADX+4GzGPZveWbtcpsuO+xGTFS iObRINCFrcIz1oWdaun3xas6qVtUSR5ztKTqeZ+lrCvely8Zj1Q9f2M8EQyEPpawr3pcvGY9UH7G eCGQh9LWFe9Ll4zHqg/YzwQyEPpawr3pcvGY9UH7GeCGQh9LWFe9Ll4zHqg/YzwQyEc2flfwxl5t 1NzuJqbUSiI1MUqX/UOr+xmn6I5LTRaaxNg4XhNuxOHIiwX3n0SXCdWb5pMyMk6eDSlPEPDU6mV5 pteg0+nVpNI8zm+xeNZfkDt7nzprEl5Dbam2FNEgibTpKmttR97jErWslCNEkTlaUnUwP0tYV70u XjMeqHp+xngiOQj023+zGPYReXrtbZsuQ+/GVFUiQbRoJC1ocMy0IQdatF3x5XtVK4qNInC0oups AVT0AAAAAAAAAAAAAAAAAAAAAAAAAAAAD//Z ------=_Part_37643343_1124091921.1494519067933 Content-Type: image/jpeg; name=element-signature_logo_YouTube_32x28.jpg Content-Disposition: attachment; filename=element-signature_logo_YouTube_32x28.jpg Content-Transfer-Encoding: base64 Content-ID: <99ac6520e8e3715f40f650ce0d5f88a03a9bd713@zimbra> /9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4 OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6 MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5 OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9 InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1 bWVudElEPSJ4bXAuZGlkOjQ1REY5Njk1OEExNzExRTY5OUVDOTI1QTU3QzAwNzI0IiB4bXBNTTpJ bnN0YW5jZUlEPSJ4bXAuaWlkOjQ1REY5Njk0OEExNzExRTY5OUVDOTI1QTU3QzAwNzI0IiB4bXA6 Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1 LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4 YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f Hx8fHx8fHx8fHx8fH//AABEIABwAIAMBEQACEQEDEQH/xAB5AAADAQEAAAAAAAAAAAAAAAAABwgF BgEAAgMBAAAAAAAAAAAAAAAAAAQCAwUBEAABBAECBAUFAAAAAAAAAAABAgMEBQARBiESEwcxUdIU CEEik1UYEQACAQMCBQUAAAAAAAAAAAAAAQIRAwQhMVFhEiITQaHBYhX/2gAMAwEAAhEDEQA/AKpw AnD5Hbg3JA35XxKqxmxUPVrJEaI862FuqkPp4IbI5lHQDNXBhFwbaW4tebqcMIvfYjURtz6eesv1 YzWz9fYh38zR7eX2+mu5lHV3VhaNOe8aTJgTHnweVXEBba1cQRkb8IeNtJbHYN9WpW+YY2T53inQ 4HfzZk6a4lmHGaiOSHl8EoT7mSOZR+gBIzUxU3Yklz+Be4+9DRl30N3dMOxjbyro9EzHW3MqupHc L7qlaoX1SsFvlHl44moPpa6XXiW113FPuu3qrT5I7dfrJLUxllMRl15hQWjqBbiuXmTqCQlQx23F rHdSqTrNFFZlDAou7vZa43xuSNaw7CPFZZhIiKbeSsqKkOuuE/aCNNHcexspW40a9Sm5bcmcH/J1 5+0rvxOenGf0o8GQ8DN7ZXxzv9vbpqrhy0huMQJCHlstocBKU+ITqANcru50ZRao9SUbLTqPvMwv DAAwAMAP/9k= ------=_Part_37643343_1124091921.1494519067933 Content-Type: image/jpeg; name=element-signature_logo_LinkedIn_41x28.jpg Content-Disposition: attachment; filename=element-signature_logo_LinkedIn_41x28.jpg Content-Transfer-Encoding: base64 Content-ID: <a70d2dafceb98e64513f5a16b7d3ea0ab5a0f1f5@zimbra> /9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4 OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6 MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5 OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9 InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1 bWVudElEPSJ4bXAuZGlkOjY2MEYzRTFGOEExNzExRTY5QzI5OUNGQkY1MzM2MUQ1IiB4bXBNTTpJ bnN0YW5jZUlEPSJ4bXAuaWlkOjY2MEYzRTFFOEExNzExRTY5QzI5OUNGQkY1MzM2MUQ1IiB4bXA6 Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1 LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4 YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f Hx8fHx8fHx8fHx8fH//AABEIABwAKQMBEQACEQEDEQH/xAB2AAEBAQEAAAAAAAAAAAAAAAAABggH AQEAAwEAAAAAAAAAAAAAAAAAAwQFAhAAAQMEAgICAgMBAAAAAAAAAQIDBAARBQYhEjEHMghBE1Fh IhcRAAICAQIDCQAAAAAAAAAAAAABAgMREgQxkTIhQVGhscETMxX/2gAMAwEAAhEDEQA/ANU0Bl33 zsuzQfZcmHj8tMiMKaihDLMl1psKcQkXslSUjk8mtjZ1xdeWkVbW9RDZ/ZN8wOXkYnI7LKMuL1Lq o+RddaIWkLHVwLAPCuf4NWYVwksqPkcNtd5V+ldr2ef7MwkaZmJsqK6p/uy9JdcbUBGcULpUog8i 9Q7uuKreEjquT1GsKxC2KAUBk37B2/6y72t1tB7X8dbIvf8Aq3mtvZfVzKlvUWWw7Dr+Dfy8rCt4 d153Z8ew0FNx3kohuxmUyFtAfFPyBUOBz+arwhKWE89L9SRtLmTuns4xj7LLaxYaGNE6SYojlJZ6 rhLUf19f89eyj4qa1t7ft449ziPWairGLQoBQHFvZ/onObht0jNxclFjMPNtNpZdS4Vj9aAk36gj mtDb7yMIaWiGdTbySSfqnsKbdctAFh1Fm3Bwfx8fFT/ox8GcfAyk9dfX7OapuGNzj+SiPRoJcKmG kuBRDjS2x1uAPK71DfvYzg444nUKmnk7lWcTigFAKAUAoBQCgP/Z ------=_Part_37643343_1124091921.1494519067933 Content-Type: image/jpeg; name=element-signature_logo_Twitter_42x28.jpg Content-Disposition: attachment; filename=element-signature_logo_Twitter_42x28.jpg Content-Transfer-Encoding: base64 Content-ID: <a994fe545de6341d6b369e33bbb18605bbbcef66@zimbra> /9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4 OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6 MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5 OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9 InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1 bWVudElEPSJ4bXAuZGlkOjdDMkI3MjMyOEExNzExRTY5MDUyRTk1NEIyREUwNjVCIiB4bXBNTTpJ bnN0YW5jZUlEPSJ4bXAuaWlkOjdDMkI3MjMxOEExNzExRTY5MDUyRTk1NEIyREUwNjVCIiB4bXA6 Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1 LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4 YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f Hx8fHx8fHx8fHx8fH//AABEIABwAKgMBEQACEQEDEQH/xAB3AAEBAQEBAAAAAAAAAAAAAAAABwUI BgEBAAMBAQAAAAAAAAAAAAAAAAMEBQIBEAABAwIEBwEBAQAAAAAAAAABAgMEAAUREhMGITFBFBUH CIEiFhEAAgIBAgQHAAAAAAAAAAAAAAERAgMxBCHBEgVBUWGBQhMV/9oADAMBAAIRAxEAPwDC9g7u 3dH33uJiNeri2wxcJQQ01JfCUNodVwCUqwSlI/AK3sGKropS0Kd7OWZMXcPsyZDdnQ7he5UFhQQ/ LZelOMoURiEqWlRAOFdumNOGqyeTYtPzFfL1df8ASm5XCTP0ey0e5eceyZu4zZc5VhjlGOFZ/cKJ dMKNeRNhbclzrOJxQCgOSW7o5a/oKXMRFXNT5iYw/EaAUtbL61tOBKTwXglWOXrW30zgj0RUmLlb 9p3rZ/r/ANd3GxWJtm3XC8B1EO2RsEqDkng88pAP8JSnEk8ugqlt6Xy5Fa3FImyNVUI8z8nJCU7o SOSRAA/O5qbuXx9+Rxg8ToGsssCgFAc/7q+b9xXrc11u7V3iNN3CW/JbQUuhaUuuFYBIHMA9K08e +rWqUPgivbC25MofK25Qoq81DKjwKlJeUT+kE13+jXyZ59DKX6a9WXPYfmO+msTPJdtp6AWMuhq4 5swHPVFVN1uFkiFoS46dJSqqEgoBQCgFAKAUAoBQH//Z ------=_Part_37643343_1124091921.1494519067933 Content-Type: image/jpeg; name=element-signature_payzen_61x28.jpg Content-Disposition: attachment; filename=element-signature_payzen_61x28.jpg Content-Transfer-Encoding: base64 Content-ID: <86ad24eaa2a146e1b7ee93db04f055468345dc13@zimbra> /9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4 OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6 MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5 OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9 InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1 bWVudElEPSJ4bXAuZGlkOkU1NjczQjM2OEEzNDExRTZCOEJBQ0Y4Mzg3RTEzODkyIiB4bXBNTTpJ bnN0YW5jZUlEPSJ4bXAuaWlkOkU1NjczQjM1OEEzNDExRTZCOEJBQ0Y4Mzg3RTEzODkyIiB4bXA6 Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1 LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4 YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f Hx8fHx8fHx8fHx8fH//AABEIABwAPQMBEQACEQEDEQH/xABvAAABBAMAAAAAAAAAAAAAAAAAAQUG BwIDBAEBAAAAAAAAAAAAAAAAAAAAABAAAQQABAQEAgsBAAAAAAAAAQIDBAUAERIGITETFEEiFQfS I1FhcYGhMlIkRMQWhhEBAAAAAAAAAAAAAAAAAAAAAP/aAAwDAQACEQMRAD8AvqZ7q7OhzZMSS9IQ Yjy2JT/avqZbW2rSvU6lBSACOeeAljLzTzSHmVhxpxIW24k5pUlQzBBHgRgM8BBJ9fKuvcGwr3La wgxIlfGeaagyVsJ1uOOBRUBmOSRgI0bnZgfQwdx7qDrroYZSVzBrcJ0hKM2xq+7AWBU7PTXTEShc 2svRx6MuWp5o5gjigj68BombFRKmPyTfXTPXWpzoszloaRqOelCQPKkeAwEP6lp6f6V6vYaP9Z6b 3fcr7ntuhno6vPnxwGyohb2ntbpr6Y17NdKt7Bp5+YHlPJLitKyltI0KGk+XPANVgzV1Eyyqbe3s IMmnhsMbVaYcebDraY+XVbQ15XXFOghQVnkMBkbjcVPTUs6M5IkPbnpWa1hKlrWG7QZBp0hROnUh xRUfHTgJDWuwtsbptVTpC1xaqhgJfkuFTji9DjoKiTmpSlq/HAcO2d11d/cuXUySJG4C0+NvbfCH CmK2hClHUop0GQ6E+dWfAeUYBi2lY2E+zgW7twhVlHDk+7AkzFO9u2lRdjORFIEZrTmAkA+GYwDl TwLJhjZFouxsF3NzN6r7Lj7imExHUOSHWi0TpyCdORIzzwHT/J/7n+vgLVAA5YBChBUlRSCpOelR HEZ88sA2WG3YVhb1lnJW4VVJcXFjAgM9VxOjqKTlmVJTnp48M8Ax2+3N3J3TJu6KVAbRKisxnWpr brh+SpasxoKf14BBD91hxE2kB+nt5Px4AEL3VGoiZSAr4qyjyOP2+fAL2nuvw/e0vDl8iT8eAbv8 Lur0vPvYXrPrfrfU6bvb59Lp6NOev83HngLBwBgDAGAMAYAwBgP/2Q== ------=_Part_37643343_1124091921.1494519067933-- ------=_Part_37643342_929927371.1494519067933--

2 1

High latency on storage domains and sanlock renewal error
by Stefano Bovina 13 May '17

13 May '17

Hi, the engine logs show high latency on storage domains: "Storage domain <xxxx> experienced a high latency of 19.2814 seconds from ...... This may cause performance and functional issues." Looking at host logs, I found also these locking errors: 2017-05-02 20:52:13+0200 33883 [10098]: s1 renewal error -202 delta_length 10 last_success 33853 2017-05-02 20:52:19+0200 33889 [10098]: 6a386652 aio collect 0 0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe9fb000 result 1048576:0 other free 2017-05-02 21:08:51+0200 34880 [10098]: 6a386652 aio timeout 0 0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe4f2000 ioto 10 to_count 24 2017-05-02 21:08:51+0200 34880 [10098]: s1 delta_renew read rv -202 offset 0 /dev/6a386652-629d-4045-835b-21d2f5c104aa/ids 2017-05-02 21:08:51+0200 34880 [10098]: s1 renewal error -202 delta_length 10 last_success 34850 2017-05-02 21:08:53+0200 34883 [10098]: 6a386652 aio collect 0 0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe4f2000 result 1048576:0 other free 2017-05-02 21:30:40+0200 36189 [10098]: 6a386652 aio timeout 0 0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe9fb000 ioto 10 to_count 25 2017-05-02 21:30:40+0200 36189 [10098]: s1 delta_renew read rv -202 offset 0 /dev/6a386652-629d-4045-835b-21d2f5c104aa/ids 2017-05-02 21:30:40+0200 36189 [10098]: s1 renewal error -202 delta_length 10 last_success 36159 2017-05-02 21:30:45+0200 36195 [10098]: 6a386652 aio collect 0 0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe9fb000 result 1048576:0 other free and this vdsm errors too: Thread-22::ERROR::2017-05-02 21:53:48,147::sdc::137:: Storage.StorageDomainCache::(_findDomain) looking for unfetched domain f8f21d6c-2425-45c4-aded-4cb9b53ebd96 Thread-22::ERROR::2017-05-02 21:53:48,148::sdc::154:: Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain f8f21d6c-2425-45c4-aded-4cb9b53ebd96 Engine instead is showing this errors: 2017-05-02 21:40:38,089 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-96) Command SpmStatusVDSCommand(HostName = < myhost.example.com>, HostId = dcc0275a-b011-4e33-bb95-366ffb0697b3, storagePoolId = 715d1ba2-eabe-48db-9aea-c28c30359808) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SpmStatusVDS, error = (-202, 'Sanlock resource read failure', 'Sanlock exception'), code = 100 2017-05-02 21:41:08,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-53) [6e0d5ebf] Failed in SpmStatusVDS method 2017-05-02 21:41:08,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-53) [6e0d5ebf] Command SpmStatusVDSCommand(HostName = <myhost.example.com>, HostId = 7991933e-5f30-48cd-88bf-b0b525613384, storagePoolId = 4bd73239-22d0-4c44-ab8c-17adcd580309) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SpmStatusVDS, error = (-202, 'Sanlock resource read failure', 'Sanlock exception'), code = 100 2017-05-02 21:41:31,975 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-61) [2a54a1b2] Failed in SpmStatusVDS method 2017-05-02 21:41:31,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-61) [2a54a1b2] Command SpmStatusVDSCommand(HostName = <myhost.example.com>, HostId = dcc0275a-b011-4e33-bb95-366ffb0697b3, storagePoolId = 715d1ba2-eabe-48db-9aea-c28c30359808) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SpmStatusVDS, error = (-202, 'Sanlock resource read failure', 'Sanlock exception'), code = 100 I'm using Fibre Channel or FCoE connectivity; storage array technical support has analyzed it (also switch and OS configurations), but nothing has been found. Any advice? Thanks Installation info: ovirt-release35-006-1.noarch libgovirt-0.3.3-1.el7_2.1.x86_64 vdsm-4.16.30-0.el7.centos.x86_64 vdsm-xmlrpc-4.16.30-0.el7.centos.noarch vdsm-yajsonrpc-4.16.30-0.el7.centos.noarch vdsm-jsonrpc-4.16.30-0.el7.centos.noarch vdsm-python-zombiereaper-4.16.30-0.el7.centos.noarch vdsm-python-4.16.30-0.el7.centos.noarch vdsm-cli-4.16.30-0.el7.centos.noarch qemu-kvm-ev-2.3.0-29.1.el7.x86_64 qemu-kvm-common-ev-2.3.0-29.1.el7.x86_64 qemu-kvm-tools-ev-2.3.0-29.1.el7.x86_64 libvirt-client-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-storage-1.2.17-13.el7_2.3.x86_64 libvirt-python-1.2.17-2.el7.x86_64 libvirt-daemon-driver-nwfilter-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-nodedev-1.2.17-13.el7_2.3.x86_64 libvirt-lock-sanlock-1.2.17-13.el7_2.3.x86_64 libvirt-glib-0.1.9-1.el7.x86_64 libvirt-daemon-driver-network-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-lxc-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-interface-1.2.17-13.el7_2.3.x86_64 libvirt-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-config-network-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-secret-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-config-nwfilter-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-kvm-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-qemu-1.2.17-13.el7_2.3.x86_64 ------- vdsm.log (high latency) Thread-21::DEBUG::2017-05-02 18:02:23,646::fileSD::261:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n331 bytes (331 B) copied, 0.000285529 s, 1.2 MB/s\n'; <rc> = 0 Thread-18::DEBUG::2017-05-02 18:02:24,335::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/2c501858-bf8d-49a5-a42b-bca341b47827/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-18::DEBUG::2017-05-02 18:02:24,343::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000489782 s, 8.4 MB/s\n'; <rc> = 0 Thread-19::DEBUG::2017-05-02 18:02:24,635::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c5dc09c4-cd79-42d2-a5af-89953076f79e/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-19::DEBUG::2017-05-02 18:02:24,643::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558622 s, 7.3 MB/s\n'; <rc> = 0 Thread-22::DEBUG::2017-05-02 18:02:24,722::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/f8f21d6c-2425-45c4-aded-4cb9b53ebd96/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-22::DEBUG::2017-05-02 18:02:24,729::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632576 s, 6.5 MB/s\n'; <rc> = 0 JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:25,056::stompReactor:: 98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2017-05-02 18:02:25,057::__init__::506:: jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-9372::DEBUG::2017-05-02 18:02:25,060::stompReactor:: 163::yajsonrpc.StompServer::(send) Sending response Thread-20::DEBUG::2017-05-02 18:02:25,895::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 19.2814 s, 0.2 kB/s\n'; <rc> = 0 JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:28,075::stompReactor:: 98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2017-05-02 18:02:28,076::__init__::506:: jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-9373::DEBUG::2017-05-02 18:02:28,078::stompReactor:: 163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:31,094::stompReactor:: 98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2017-05-02 18:02:31,095::__init__::506:: jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-9374::DEBUG::2017-05-02 18:02:31,097::stompReactor:: 163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2017-05-02 18:02:33,652::fileSD::261:: Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/<myho st.example.com>:_ISO/f105bdc6-efdc-445c-b49e-aa38c91c2569/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-21::DEBUG::2017-05-02 18:02:33,660::fileSD::261:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n331 bytes (331 B) copied, 0.000246594 s, 1.3 MB/s\n'; <rc> = 0 JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:34,112::stompReactor:: 98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2017-05-02 18:02:34,114::__init__::506:: jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-9375::DEBUG::2017-05-02 18:02:34,117::task::595:: Storage.TaskManager.Task::(_updateState) Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::moving from state init -> state preparing Thread-9375::INFO::2017-05-02 18:02:34,117::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-9375::INFO::2017-05-02 18:02:34,118::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c501858-bf8d-49a5-a42b-bca341b47827': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489782', 'lastCheck': '9.8', 'valid': True}, 'f8f21d6c-2425-45c4-aded-4cb9b53ebd96': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632576', 'lastCheck': '9.4', 'valid': True}, '6a386652-629d-4045-835b-21d2f5c104aa': {'code': 0, 'version': 3, 'acquired': True, 'delay': '19.2814', 'lastCheck': '8.2', 'valid': True}, 'f105bdc6-efdc-445c-b49e-aa38c91c2569': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246594', 'lastCheck': '0.5', 'valid': True}, 'c5dc09c4-cd79-42d2-a5af-89953076f79e': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558622', 'lastCheck': '9.5', 'valid': True}} Thread-9375::DEBUG::2017-05-02 18:02:34,118::task::1191:: Storage.TaskManager.Task::(prepare) Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::finished: {'2c501858-bf8d-49a5-a42b-bca341b47827': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489782', 'lastCheck': '9.8', 'valid': True}, 'f8f21d6c-2425-45c4-aded-4cb9b53ebd96': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632576', 'lastCheck': '9.4', 'valid': True}, '6a386652-629d-4045-835b-21d2f5c104aa': {'code': 0, 'version': 3, 'acquired': True, 'delay': '19.2814', 'lastCheck': '8.2', 'valid': True}, 'f105bdc6-efdc-445c-b49e-aa38c91c2569': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246594', 'lastCheck': '0.5', 'valid': True}, 'c5dc09c4-cd79-42d2-a5af-89953076f79e': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558622', 'lastCheck': '9.5', 'valid': True}} Thread-9375::DEBUG::2017-05-02 18:02:34,119::task::595:: Storage.TaskManager.Task::(_updateState) Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::moving from state preparing -> state finished Thread-9375::DEBUG::2017-05-02 18:02:34,119::resourceManager: :940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-9375::DEBUG::2017-05-02 18:02:34,119::resourceManager: :977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-9375::DEBUG::2017-05-02 18:02:34,119::task::993:: Storage.TaskManager.Task::(_decref) Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::ref 0 aborting False Thread-9375::DEBUG::2017-05-02 18:02:34,122::stompReactor:: 163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:34,128::stompReactor:: 98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2017-05-02 18:02:34,129::__init__::506:: jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-9376::DEBUG::2017-05-02 18:02:34,132::stompReactor:: 163::yajsonrpc.StompServer::(send) Sending response

3 10

User story
by Johannes Spanier 13 May '17

13 May '17

Hi oVirt community. I did a short series for tweets @jospanier judging my first time user experience with several virtualization platforms and was asked by Sandro Bonazzola to elaborate a bit further than what fits into 140 chars. I had a specific use case: The small-ish learning lab with only 2-3 nodes and it needs to be free. I also wanted live migration to stay flexible with my hosts. I currently use my lab for to run ~10 virtual CSR1000V routers on free ESXi in addition to some real router hardware. I want to expand the lab to be able to explore some other technologies as well like network automation, SDN, infrastructure as code and the likes. The lineup for the PoC was oVirt, ESXi, Openstack and Proxmox VE. I my tweets I was referring to a) the install procedure and b) the operational experience. Here is what I found. These findings are highly subjective and debatable. I am aware of that. Both ESXi and Proxmox VE is trivial to install. You grab the ISO image, use a tool like Rufus to make an bootable USB stick or use iLO virtual CD functionality and off you go. Both installers do not ask many questions and just do their job. After installation ESXi is all ready to run. Just open the WebGui and start deploying your first node. With Proxmox VE you get a TUI wizard guiding you though the last steps. After that the WebGui is ready and you can deploy your first VM immediately. I found oVirt a bit more involved to install. You have to install the Engine on one node and then register the other hosts with it. While that process is easy to handle it is a bit more work. A big thing for me was that at first glance there did no seem to be a "single node" install. My fist impression was that I needed a minimum of two servers. Of course later I learned about the Hosted Engine and the All-In-One install. Do not get me wrong. First time oVirt installation is still easy to handle on a quiet afternoon. Openstack installation compared to that is a PITA nightmare. I tried both RDO (TripleO) and Fuel for setup but gave up after two days for both, confused about what I actually need to do for a start. Got some nodes running with Fuel but was not satisfied. I then followed the Openstack manual Install Guide. I have a day job, so it took me about 5 days to get through the whole procedure, but a least I understood what was going on and what I needed to do. So that was my "first day" experience with those. Now for the "second day" i.e. operation. ESXi and Proxmox VE are both very simple to understand. You usually do not need a manual to find you way around. Deploying a VM is a breeze. oVirt is pretty simple to understand too. But you have to wrap your head around the Data Center principle underpinning everything. Its just a bit more complicated. On one or two occasions while playing around it was unclear at first why my datacenter was offline and I had to consult the manual for that. One can immediately feel that multi-tenancy is a big benefit of oVirt that is not so obvious in ESXi and Proxmox. But it comes with the price of added complexity. The new WebGui in the ESXi 6.5 I used is sloooow but some functions are not available with the vSphere Client Tool any more. Proxmox and oVirt WebGui are very responsive and "feel" way better. The Openstack WebGui is also quite nice. If you want to build a private multi-teneant scale-out cloud OpenStack is probably your best horse in the stable. But for my purpose it was just overkill. The process of deploying a simple VM was the most work from all four tools. Wrap-up For the specific use-case (see above) Proxmox VE was the best fit for me, closely followed by oVirt due to the more involved installation. ESXi comes in lagging in third place as it does not offer live migration in the free version and due to the poor WebGui experience I got. Also you have to pay big bucks to get the same functionality as in the other three. Openstack is placed at a distant fourth place for this use case. Hope that was interesting. Do reach out to me on twitter if you have any further questions or suggestions. Regards Johannes

2 1

can i Extend volume from replica 2 to replica 3 with arbiter
by Khalid Jamal 13 May '17

13 May '17

1 0