- Users - oVirt List Archives

Access userportal
by Demeter Tibor 13 Jan '15

13 Jan '15

------=_Part_14402522_1210550966.1421170227181 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi, I would like to make a public redirect to ovirt userportal like https://foo.domain.com that redirect me to my ovirt userportal that running on internal network, with not public ip address (172.16.0.1), but I don't want to create access for administrator portal. Also, I would like to add a commercial SSL certification for this site. Could me help somebody how can I do it? Thanks in advance! Regards, Tibor Demeter ------=_Part_14402522_1210550966.1421170227181 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html><body><div style="font-family: times new roman, new york, times, serif; font-size: 12pt; color: #000000"><div>Hi,</div><div><br></div><div>I would like to make a public redirect to ovirt userportal like https://foo.domain.com that redirect me to my ovirt userportal that running on internal network, with not public ip address (172.16.0.1), but I don't want to create access for administrator portal.</div><div>Also, I would like to add a commercial SSL certification for this site. </div><div></div><div><br></div><div>Could me help somebody how can I do it? </div><div><br></div><div>Thanks in advance!</div><div><br></div><div>Regards,</div><div><br></div><div>Tibor Demeter</div><div><br></div></div></body></html> ------=_Part_14402522_1210550966.1421170227181--

2 1

hosted-engine-lockspace broken symlinks
by Will K 13 Jan '15

13 Jan '15

------=_Part_248632_1897277808.1421125514852 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi, still working on this hosted-engine setup. =C2=A0When deploy hosted-engine = on the 2nd node, hosted-engine.lockspace and hosted-engine.metadata cannot = be found. 1) =C2=A0Node1 is up with hosted engine installed on a GlusterFS volume. = =C2=A0When try to deploy hosted engine on node2, =C2=A0I specified storage = path to be nfs available on "ovirtmount.xyz.com". =C2=A0ovirtmount is just = an entry in the host file pointing to node1 as in the "Up and Running with = oVirt 3.5". The deploy process mounted the ifs export under=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0/rhev/data-center/mnt/ovirtmount.xyz.com:_engine/9d2142eb-f414-46f1-895a= -95099aeb7f69/ha_agent I fond symlinks point to /rhev/data-center/mnt/<IP>:_engine/.... =C2=A0 ins= tead of "ovirtmount"=C2=A0 =C2=A0 hosted-engine-lockspace=C2=A0 =C2=A0 =C2=A0 hosted-engine-metadata If I re-run deploy again using IP for the NFS export, the symlinks will loo= k good and go forward with the process. 2) Then something killed the VM at this point. Sure it was running.[ INFO = =C2=A0] Configuring VDSM[ INFO =C2=A0] Starting vdsmd[ INFO =C2=A0] Waiting= for VDSM hardware info[ INFO =C2=A0] Waiting for VDSM hardware info[ INFO = =C2=A0] Connected to Storage Domain[ INFO =C2=A0] Configuring VM[ INFO =C2= =A0] Updating hosted-engine configuration[ INFO =C2=A0] Stage: Transaction = commit[ INFO =C2=A0] Stage: Closing up[ ERROR ] Failed to execute stage 'Cl= osing up': <urlopen error [Errno 113] No route to host>[ INFO =C2=A0] Stage= : Clean up[ INFO =C2=A0] Generating answer file '/etc/ovirt-hosted-engine/a= nswers.conf'[ INFO =C2=A0] Answer file '/etc/ovirt-hosted-engine/answers.co= nf' has been updated[ INFO =C2=A0] Stage: Pre-termination[ INFO =C2=A0] Sta= ge: Termination Will ------=_Part_248632_1897277808.1421125514852 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"color:#000; background-color:#fff; font-family:He= lveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;fo= nt-size:16px"><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr">Hi,</= div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr"><br></div><div = id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr">still working on this ho= sted-engine setup.  When deploy hosted-engine on the 2nd node, hosted-= engine.lockspace and hosted-engine.metadata cannot be found.</div><div id= =3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr"><br></div><div id=3D"yui_3= _16_0_1_1421121684947_4392" dir=3D"ltr">1)  Node1 is up with hosted en= gine installed on a GlusterFS volume.  When try to deploy hosted engin= e on node2,  I specified storage path to be nfs available on "ovirtmou= nt.xyz.com".  ovirtmount is just an entry in the host file pointing to= node1 as in the "Up and Running with oVirt 3.5".</div><div id=3D"yui_3_16_= 0_1_1421121684947_4392" dir=3D"ltr"><br></div><div id=3D"yui_3_16_0_1_14211= 21684947_4392" dir=3D"ltr">The deploy process mounted the ifs export under&= nbsp;</div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class=3D= "" style=3D"">    /rhev/data-center/mnt/ovirtmount.xyz.= com:_engine/9d2142eb-f414-46f1-895a-95099aeb7f69/ha_agent</div><div id=3D"y= ui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" style=3D""><br class= =3D"" style=3D""></div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"l= tr" class=3D"" style=3D"">I fond symlinks point to /rhev/data-center/mnt/&l= t;IP>:_engine/....   instead of "ovirtmount"</div><div id=3D"yui_3_= 16_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" style=3D"">    = hosted-engine-lockspace <br></div><div id=3D"yui_3_16_0_1_142112168494= 7_4392" dir=3D"ltr" class=3D"" style=3D"">    hosted-engine-metad= ata<br></div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class= =3D"" style=3D""><br></div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir= =3D"ltr" class=3D"" style=3D"">If I re-run deploy again using IP for the NF= S export, the symlinks will look good and go forward with the process.</div= ><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" style= =3D""><br></div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" cla= ss=3D"" style=3D"">2) Then something killed the VM at this point. Sure it w= as running.</div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" cl= ass=3D"" style=3D"">[ INFO  ] Configuring VDSM</div><div id=3D"yui_3_1= 6_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" style=3D"">[ INFO  ] = Starting vdsmd</div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr"= class=3D"" style=3D"">[ INFO  ] Waiting for VDSM hardware info</div><= div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" style=3D"= ">[ INFO  ] Waiting for VDSM hardware info</div><div id=3D"yui_3_16_0_= 1_1421121684947_4392" dir=3D"ltr" class=3D"" style=3D"">[ INFO  ] Conn= ected to Storage Domain</div><div id=3D"yui_3_16_0_1_1421121684947_4392" di= r=3D"ltr" class=3D"" style=3D"">[ INFO  ] Configuring VM</div><div id= =3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" style=3D"">[ IN= FO  ] Updating hosted-engine configuration</div><div id=3D"yui_3_16_0_= 1_1421121684947_4392" dir=3D"ltr" class=3D"" style=3D"">[ INFO  ] Stag= e: Transaction commit</div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir= =3D"ltr" class=3D"" style=3D"">[ INFO  ] Stage: Closing up</div><div i= d=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" style=3D"">[ E= RROR ] Failed to execute stage 'Closing up': <urlopen error [Errno 113] = No route to host></div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir= =3D"ltr" class=3D"" style=3D"">[ INFO  ] Stage: Clean up</div><div id= =3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" style=3D"">[ IN= FO  ] Generating answer file '/etc/ovirt-hosted-engine/answers.conf'</= div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" styl= e=3D"">[ INFO  ] Answer file '/etc/ovirt-hosted-engine/answers.conf' h= as been updated</div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr= " class=3D"" style=3D"">[ INFO  ] Stage: Pre-termination</div><div id= =3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" style=3D"">[ IN= FO  ] Stage: Termination</div><div class=3D"" style=3D"" id=3D"yui_3_1= 6_0_1_1421121684947_4743"><br class=3D"" style=3D""></div><div class=3D"" s= tyle=3D"" id=3D"yui_3_16_0_1_1421121684947_4721"><br class=3D"" style=3D"">= </div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" class=3D"" st= yle=3D"">Will</div><div id=3D"yui_3_16_0_1_1421121684947_4392" dir=3D"ltr" = class=3D"" style=3D""><br></div></div></body></html> ------=_Part_248632_1897277808.1421125514852--

2 2

GlusterFS Centos 7 unable to mount NFS on gluster members
by Donny Davis 13 Jan '15

13 Jan '15

This is a multipart message in MIME format. ------=_NextPart_000_0007_01D02EA2.D9347DE0 Content-Type: text/plain; charset="koi8-r" Content-Transfer-Encoding: 7bit Here is a quick rundown of the system, and the problem. All hosts on centOS 7 fully up to date GlusterFS is running on 6 servers, 3x2 distribute/replicate. CTDB is running on all hosts I am unable to mount via nfs the exported volume on any of the gluster server members. I am able to mount, read, write, umount from any server that is not a gluster member. Topology - all are hostnames that are resolvable Gluster Members Node1 Node2 Node3 Node4 Node5 Node6 CTDB Virtual IP/Hostname SharedNFS Test Machine Test1 Gluster Volumes Engine Data I am trying to bring up hosted-engine using nfs using the gluster members I run hosted-engine -deploy Nfsv3 Host:/path sharednfs:/engine Error while mounting specified storage path: mount.nfs: an incorrect mount option was specified Ok well lets try that without using the hosted-engine script Mount -v -t nfs -o vers=3 sharednfs:/engine /tmp mount.nfs: timeout set for Mon Jan 12 22:00:08 2015 mount.nfs: trying text-based options 'vers=3,lock=Flase,addr=192.168.0.240 mount.nfs: prog 100003, trying vers=3, prot=6 mount.nfs: trying 192.168.0.240 prog 100003 vers 3 prot TCP port 2049 mount.nfs: prog 100005, trying vers=3, prot=17 mount.nfs: portmap query retrying: RPC: Program not registered mount.nfs: prog 100005, trying vers=3, prot=6 mount.nfs: trying 192.168.0.240 prog 100005 vers 3 prot TCP port 38465 mount.nfs: mount(2): Invalid argument mount.nfs: an incorrect mount option was specified [root@node4 ~]# systemctl status rpcbind rpcbind.service - RPC bind service Loaded: loaded (/usr/lib/systemd/system/rpcbind.service; enabled) Active: active (running) since Mon 2015-01-12 20:01:13 EST; 1h 57min ago Process: 1349 ExecStart=/sbin/rpcbind -w ${RPCBIND_ARGS} (code=exited, status=0/SUCCESS) Main PID: 1353 (rpcbind) CGroup: /system.slice/rpcbind.service L-1353 /sbin/rpcbind -w Jan 12 20:01:13 node4 systemd[1]: Starting RPC bind service... Jan 12 20:01:13 node4 systemd[1]: Started RPC bind service. Jan 12 21:19:22 node4 systemd[1]: Started RPC bind service. Ummm: this makes no sense:. [root@test1 ~]# mount -v -o vers=3 -t nfs 192.168.0.240:/engine /tmp mount.nfs: timeout set for Mon Jan 12 20:02:58 2015 mount.nfs: trying text-based options 'vers=3,addr=192.168.0.240 mount.nfs: prog 100003, trying vers=3, prot=6 mount.nfs: trying 192.168.0.240 prog 100003 vers 3 prot TCP port 2049 mount.nfs: prog 100005, trying vers=3, prot=17 mount.nfs: portmap query retrying: RPC: Program not registered mount.nfs: prog 100005, trying vers=3, prot=6 mount.nfs: trying 192.168.0.240 prog 100005 vers 3 prot TCP port 38465 192.168.0.240:/engine on /tmp type nfs (rw,vers=3) On the test machine mounts the nfs share with no problems. I have confirmed this does not work on a single machine that is part of the gluster. And any other machine is able to mount the exact same share, with the exact same parameters: on the exact same OS:. I am at a loss Donny D ------=_NextPart_000_0007_01D02EA2.D9347DE0 Content-Type: text/html; charset="koi8-r" Content-Transfer-Encoding: quoted-printable <META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; = charset=3Dkoi8-r"> <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta name=3DGenerator = content=3D"Microsoft Word 14 (filtered medium)"><style></style></head><body lang=3DEN-US link=3Dblue = vlink=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal>Here is a = quick rundown of the system, and the problem.<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>All hosts on = centOS 7 fully up to date<o:p></o:p></p><p class=3DMsoNormal>GlusterFS = is running on 6 servers, 3x2 distribute/replicate. <o:p></o:p></p><p = class=3DMsoNormal>CTDB is running on all hosts<o:p></o:p></p><p = class=3DMsoNormal>I am unable to mount via nfs the exported volume on = any of the gluster server members.<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>I am able to = mount, read, write, umount from any server that is not a gluster member. = <o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal>Topology – all are hostnames that are resolvable = <o:p></o:p></p><p class=3DMsoNormal>Gluster Members<o:p></o:p></p><p = class=3DMsoNormal>Node1<o:p></o:p></p><p = class=3DMsoNormal>Node2<o:p></o:p></p><p = class=3DMsoNormal>Node3<o:p></o:p></p><p = class=3DMsoNormal>Node4<o:p></o:p></p><p = class=3DMsoNormal>Node5<o:p></o:p></p><p = class=3DMsoNormal>Node6<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>CTDB Virtual = IP/Hostname<o:p></o:p></p><p = class=3DMsoNormal>SharedNFS<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Test = Machine<o:p></o:p></p><p class=3DMsoNormal>Test1<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Gluster = Volumes<o:p></o:p></p><p class=3DMsoNormal>Engine<o:p></o:p></p><p = class=3DMsoNormal>Data<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>I am trying = to bring up hosted-engine using nfs using the gluster = members<o:p></o:p></p><p class=3DMsoNormal>I run hosted-engine = –deploy<o:p></o:p></p><p class=3DMsoNormal>Nfsv3<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Host:/path = sharednfs:/engine<o:p></o:p></p><p class=3DMsoNormal>Error while = mounting specified storage path: mount.nfs: an incorrect mount option = was specified<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal>Ok well lets try that without using the hosted-engine = script<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal>Mount –v –t nfs –o vers=3D3 = sharednfs:/engine /tmp<o:p></o:p></p><p class=3DMsoNormal>mount.nfs: = timeout set for Mon Jan 12 22:00:08 2015<o:p></o:p></p><p = class=3DMsoNormal>mount.nfs: trying text-based options = 'vers=3D3,lock=3DFlase,addr=3D192.168.0.240<o:p></o:p></p><p = class=3DMsoNormal>mount.nfs: prog 100003, trying vers=3D3, = prot=3D6<o:p></o:p></p><p class=3DMsoNormal>mount.nfs: trying = 192.168.0.240 prog 100003 vers 3 prot TCP port 2049<o:p></o:p></p><p = class=3DMsoNormal>mount.nfs: prog 100005, trying vers=3D3, = prot=3D17<o:p></o:p></p><p class=3DMsoNormal>mount.nfs: portmap query = retrying: RPC: Program not registered<o:p></o:p></p><p = class=3DMsoNormal>mount.nfs: prog 100005, trying vers=3D3, = prot=3D6<o:p></o:p></p><p class=3DMsoNormal>mount.nfs: trying = 192.168.0.240 prog 100005 vers 3 prot TCP port 38465<o:p></o:p></p><p = class=3DMsoNormal>mount.nfs: mount(2): Invalid argument<o:p></o:p></p><p = class=3DMsoNormal>mount.nfs: an incorrect mount option was = specified<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>[root@node4 = ~]# systemctl status rpcbind<o:p></o:p></p><p = class=3DMsoNormal>rpcbind.service - RPC bind service<o:p></o:p></p><p = class=3DMsoNormal>=9A=9A Loaded: loaded = (/usr/lib/systemd/system/rpcbind.service; enabled)<o:p></o:p></p><p = class=3DMsoNormal>=9A=9A Active: active (running) since Mon 2015-01-12 = 20:01:13 EST; 1h 57min ago<o:p></o:p></p><p class=3DMsoNormal>=9A = Process: 1349 ExecStart=3D/sbin/rpcbind -w ${RPCBIND_ARGS} = (code=3Dexited, status=3D0/SUCCESS)<o:p></o:p></p><p class=3DMsoNormal> = Main PID: 1353 (rpcbind)<o:p></o:p></p><p class=3DMsoNormal>=9A=9A = CGroup: /system.slice/rpcbind.service<o:p></o:p></p><p = class=3DMsoNormal>=9A=9A=9A=9A=9A=9A=9A=9A=9A=9A └─1353 = /sbin/rpcbind -w<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Jan 12 = 20:01:13 node4 systemd[1]: Starting RPC bind service...<o:p></o:p></p><p = class=3DMsoNormal>Jan 12 20:01:13 node4 systemd[1]: Started RPC bind = service.<o:p></o:p></p><p class=3DMsoNormal>Jan 12 21:19:22 node4 = systemd[1]: Started RPC bind service.<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Ummm… = this makes no sense…. <o:p></o:p></p><p = class=3DMsoNormal>[root@test1 ~]# mount -v -o vers=3D3 -t nfs = 192.168.0.240:/engine /tmp<o:p></o:p></p><p class=3DMsoNormal>mount.nfs: = timeout set for Mon Jan 12 20:02:58 2015<o:p></o:p></p><p = class=3DMsoNormal>mount.nfs: trying text-based options = 'vers=3D3,addr=3D192.168.0.240<o:p></o:p></p><p = class=3DMsoNormal>mount.nfs: prog 100003, trying vers=3D3, = prot=3D6<o:p></o:p></p><p class=3DMsoNormal>mount.nfs: trying = 192.168.0.240 prog 100003 vers 3 prot TCP port 2049<o:p></o:p></p><p = class=3DMsoNormal>mount.nfs: prog 100005, trying vers=3D3, = prot=3D17<o:p></o:p></p><p class=3DMsoNormal>mount.nfs: portmap query = retrying: RPC: Program not registered<o:p></o:p></p><p = class=3DMsoNormal>mount.nfs: prog 100005, trying vers=3D3, = prot=3D6<o:p></o:p></p><p class=3DMsoNormal>mount.nfs: trying = 192.168.0.240 prog 100005 vers 3 prot TCP port 38465<o:p></o:p></p><p = class=3DMsoNormal>192.168.0.240:/engine on /tmp type nfs = (rw,vers=3D3)<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>On the test = machine mounts the nfs share with no problems. I have confirmed this = does not work on a single machine that is part of the gluster. =9AAnd = any other machine is able to mount the exact same share, with the exact = same parameters… on the exact same OS….<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>I am at a = loss<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal>Donny D<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p></div></body></html> ------=_NextPart_000_0007_01D02EA2.D9347DE0--

2 2

fixed by reboot - Stucked VM Migration and now only run once
by Kurt Woitschach 13 Jan '15

13 Jan '15

This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --loHd0jldbOSfxn0f5CQhmAbevw6948fUs Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Thank You! Reboot of the engine fixed the problem. Greets Kurt On 28.12.2014 18:00, users-request(a)ovirt.org wrote: > ---------------------------------------------------------------------- >=20 > Message: 1 > Date: Sun, 28 Dec 2014 08:02:31 -0500 (EST) > From: Arik Hadas <ahadas(a)redhat.com> > To: Kurt Woitschach <kurt.woitschach-mueller(a)tngtech.com> > Cc: Oved Ourfali <ovedo(a)redhat.com>, users(a)ovirt.org > Subject: Re: [ovirt-users] Stucked VM Migration and now only run once > Message-ID: > <334493801.1660696.1419771751996.JavaMail.zimbra(a)redhat.com> > Content-Type: text/plain; charset=3Dutf-8 >=20 > You wrote that reboot didn't help, is it the host that you rebooted? Be= cause engine restart will release the migration's lock and you'll be able= to run the VM normally for sure. >=20 > Since you managed to run the VM using run-once while it was locked, I g= uess you're using ovirt 3.3.1/3.3.2/3.3.3/3.3.4 right? > We fixed several flows in which the migration's lock was not released s= ince then, so I suggest to upgrade the system. > If it happens with any other version, please provide the logs Oved ment= ioned and specify which version of engine you're using. >=20 > Thanks, > Arik >=20 > ----- Original Message ----- >> > Can you provide the engine and host logs? >> > Also, please specify when the migration happened, and in addition wh= en did >> > you try to run the VM. >> > It will help understand the flow in the logs. >> >=20 >> > Thanks, >> > Oved >> >=20 >> > ----- Original Message ----- >>> > > From: "Kurt Woitschach" <kurt.woitschach-mueller(a)tngtech.com> >>> > > To: users(a)ovirt.org >>> > > Sent: Saturday, December 27, 2014 9:22:35 PM >>> > > Subject: [ovirt-users] Stucked VM Migration and now only run once= >>> > >=20 >>> > > Hi all, >>> > >=20 >>> > > we have a Problem with a VM that can only be started in run-once = mode. >>> > >=20 >>> > > After a temporary network disconnect on the hosting node, the vm = (and >>> > > some others) was down. When I tried to start regularly, it showed= a >>> > > currently beeing migrated status. >>> > > I only could start it with run-once. >>> > >=20 >>> > > Reboot didn't make a change. >>> > >=20 >>> > > Any ideas? >>> > >=20 >>> > >=20 >>> > > Greets >>> > > Kurt >>> > >=20 >>> > > -- >>> > >=20 >>> > >=20 >>> > > Kurt Woitschach-M?ller kurt.woitschach-mueller(a)tngtech.com * >>> > > +49-1743180076 >>> > > TNG Technology Consulting GmbH, Betastr. 13a, 85774 Unterf?hring >>> > > Gesch?ftsf?hrer: Henrik Klagges, Gerhard M?ller, Christoph Stock >>> > > Sitz: Unterf?hring * Amtsgericht M?nchen * HRB 135082 >>> > >=20 >>> > >=20 >>> > >=20 >>> > > _______________________________________________ >>> > > Users mailing list >>> > > Users(a)ovirt.org >>> > > http://lists.ovirt.org/mailman/listinfo/users >>> > >=20 >> >=20 --=20 Kurt Woitschach-M=FCller kurt.woitschach-mueller(a)tngtech.com * +49-1743180076 TNG Technology Consulting GmbH, Betastr. 13a, 85774 Unterf=F6hring Gesch=E4ftsf=FChrer: Henrik Klagges, Gerhard M=FCller, Christoph Stock Sitz: Unterf=F6hring * Amtsgericht M=FCnchen * HRB 135082 --loHd0jldbOSfxn0f5CQhmAbevw6948fUs Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJUtPoAAAoJEO13zDeMkkLQhLcIANExQcsi3uYXobizQ7rQOM+G dr4xJ9EUoLThcoudDIpkC+IgduNdU1s/wtfIHGYL19xC54r0YsdV1V8w7DG+3Lpo 5sl2nNdmStmvvnGHdH58Gl5788hfvDL4S6YtciRWyqJ14lFmXsxSkcclX7mKF7Y7 igu2GRJyF/eQdH08YaMoywwmSHNlq9ZDMaG82m9/twp1Bcous6JVT+BsHeBocLvR 6tIqycQXZcaAiEZa9kDdAjtKYDAnWRUrPtVVk0fQufwzK2KJ8to41obnH6bpPmcY +1aZKmrdcdte+lspa/2tSl3rqK1gObb+oIKcNqEZiNoF5gbplsSrlEWMBdmOHXs= =tCDh -----END PGP SIGNATURE----- --loHd0jldbOSfxn0f5CQhmAbevw6948fUs--

1 0

about Ovirt - KVM - Ubuntu
by Carlos Laurent 13 Jan '15

13 Jan '15

Hi, I have questions about ovirt, my english is not good,I do not know if there are some mail list in spanish. I need install ovirt in ubuntu server, it is posible to do? I read is in experimental. I try install but there areproblems with Python libraries. Is posible Ovirt server read guest machines in KVM ubuntu server? or I need install Ovirt and migrade one to one machines. Thank you very much for the answers. Carlos Laurent Costa Rica,NUMAR

4 3

I have a question about the spice client.
by jaemin baek 13 Jan '15

13 Jan '15

hi, i'm korean I have a question about the spice client. My spice client connect to VDI ----> Windows 7 VDI input key ---> Korea keyboard(103/106 key) + hangul key ---> windows 7 IME *but...* input key ---> Korea keyboard(103/106 key) + hangul key --> hangul key exchanged ---> Alt key *Why??* linux spice client Hangul key OK. but windows spice client Hangul key ---> Alt key... Hangul key scancode = 0x38 Alt key scancode = 0x38 *WHY??* Help me Thank you.

2 1

Re: [ovirt-users] rename ovirt-engine
by Koen Vanoppen 13 Jan '15

13 Jan '15

No, it was a accident :-). I'll mark this as solved as I will wait for the new release of ovirt. Thanks for your help. If I'll find more bugs, I will definitely let the mailing list know :-) 2015-01-13 8:51 GMT+01:00 Yedidyah Bar David <didi(a)redhat.com>: > ----- Original Message ----- > > From: "Koen Vanoppen" <vanoppen.koen(a)gmail.com> > > To: "Yedidyah Bar David" <didi(a)redhat.com> > > Sent: Tuesday, January 13, 2015 8:02:03 AM > > Subject: Re: [ovirt-users] rename ovirt-engine > > > > Ok, thanks. We'll wait then :-) > > Note that we are aware of other issues, still without open bugs or > any work done to fix them. Please see [1]. Not sure we'll do anything > about these, as they are non-fatal and are solvable by running > engine-setup. > So if you really care, it will help if you can try the nightly 3.5-snapshot > [2] on a test copy of your engine and report if you find issues. Thanks! > > Only now realized you didn't Cc the list. Not sure it was intentional. > Replying only to you anyway... > > [1] https://bugzilla.redhat.com/show_bug.cgi?id=1170229#c1 > [2] http://www.ovirt.org/Install_nightly_snapshot > -- > Didi >

2 3

deploy failed with "Engine health status page is not yet reachable."
by Will K 13 Jan '15

13 Jan '15

------=_Part_837218_289043532.1421052865744 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi list, I've been trying to setup hosted-engine on 2 nodes for a few times.=C2=A0 T= he latest failure which I can't figure out is the "Engine health status pag= e is not yet reachable." I'm running CentOS 6.6 fully patched before setting up 3.5.=C2=A0 Sure I ru= n screen, I also need to setup three vars to get around a proxy server, htt= p_proxy, https_proxy, no_proxy. `hosted-engine --deploy` went fine until the last steps.=C2=A0 After `engin= e setup is completed`, I picked (1) Continue setup.=C2=A0=C2=A0 It says 'Wa= iting for VM to shutdown`.=C2=A0 Once the VM is up again, I waited for a co= uple of minutes, then pick (1) again, it gives me "Engine health status page is not yet reachable." At this point, I can ssh to the VM, I can also access and login the web GUI= . Any suggestion? Will ------=_Part_837218_289043532.1421052865744 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"color:#000; background-color:#fff; font-family:He= lveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;fo= nt-size:16px"><div id=3D"yui_3_16_0_1_1421052212899_7054">Hi list,</div><di= v id=3D"yui_3_16_0_1_1421052212899_7053"><br></div><div id=3D"yui_3_16_0_1_= 1421052212899_7026" dir=3D"ltr">I've been trying to setup hosted-engine on = 2 nodes for a few times.  The latest failure which I can't figure out = is the "Engine health status page is not yet reachable."</div><div id=3D"yu= i_3_16_0_1_1421052212899_7052" dir=3D"ltr"><br></div><div id=3D"yui_3_16_0_= 1_1421052212899_7025" dir=3D"ltr">I'm running CentOS 6.6 fully patched befo= re setting up 3.5.  Sure I run screen, I also need to setup three vars= to get around a proxy server, http_proxy, https_proxy, no_proxy.</div><div= id=3D"yui_3_16_0_1_1421052212899_7007" dir=3D"ltr"><br></div><div id=3D"yu= i_3_16_0_1_1421052212899_7024" dir=3D"ltr">`hosted-engine --deploy` went fi= ne until the last steps.  After `engine setup is completed`, I picked = (1) Continue setup.   It says 'Waiting for VM to shutdown`. = Once the VM is up again, I waited for a couple of minutes, then pick (1) a= gain, it gives me</div><div id=3D"yui_3_16_0_1_1421052212899_7050" dir=3D"l= tr"><br></div><div id=3D"yui_3_16_0_1_1421052212899_7051" dir=3D"ltr">"Engi= ne health status page is not yet reachable."</div><div id=3D"yui_3_16_0_1_1= 421052212899_7064" dir=3D"ltr"><br></div><div id=3D"yui_3_16_0_1_1421052212= 899_7086" dir=3D"ltr">At this point, I can ssh to the VM, I can also access= and login the web GUI.</div><div id=3D"yui_3_16_0_1_1421052212899_7065" di= r=3D"ltr"><br></div><div id=3D"yui_3_16_0_1_1421052212899_7085" dir=3D"ltr"= >Any suggestion?</div><div id=3D"yui_3_16_0_1_1421052212899_7066" dir=3D"lt= r"><br></div><div id=3D"yui_3_16_0_1_1421052212899_7088" dir=3D"ltr">Will<b= r></div><div id=3D"yui_3_16_0_1_1421052212899_6998" dir=3D"ltr"><br></div><= div id=3D"yui_3_16_0_1_1421052212899_6703"><br></div></div></body></html> ------=_Part_837218_289043532.1421052865744--

2 3

New Vdsm Build for oVirt 3.5
by ybronhei 13 Jan '15

13 Jan '15

Hey all, Vdsm-4.16.10 is just released for ovirt-3.5 (Async release). f20 - http://koji.fedoraproject.org/koji/taskinfo?taskID=8495492 epel6 - http://koji.fedoraproject.org/koji/taskinfo?taskID=8556522 epel7 - http://koji.fedoraproject.org/koji/taskinfo?taskID=8479594 f21 - http://koji.fedoraproject.org/koji/taskinfo?taskID=8494079 f22 - http://koji.fedoraproject.org/koji/taskinfo?taskID=8494059 Enjoy. Please give karma if tested, for good and bad Regards -- Yaniv Bronhaim.

3 2

Re: [ovirt-users] Setting Base DN for LDAP authentication
by jdeloro＠web.de 13 Jan '15

13 Jan '15

Hello Alon, > All over? :) traveling into the past. This e-mail comes from Mailmans moderator queue. It was sent before I was registered. And after being registered I was unable to cancel the e-mail, because Mailman always told me the token was unknown. The problem is solved to my complete satisfaction. Kind regards Jannick

1 0

Setting Base DN for LDAP authentication
by jdeloro＠web.de 12 Jan '15

12 Jan '15

Hello, I'm trying to configure LDAP authentication with oVirt 3.5 and ovirt-engine-extension-aaa-ldap. I chose the simple bind transport example. But the given examples are missing the explicit specification of a base dn. Could you please advise me how this can be done? My curent configuration: [jd@om01 ovirt-engine]$ cat aaa/company-ldap.properties include = <openldap.properties> vars.server = ldap.company.de vars.user = cn=system,dc=company,dc=de vars.password = password pool.default.serverset.single.server = ${global:vars.server} pool.default.auth.simple.bindDN = ${global:vars.user} pool.default.auth.simple.password = ${global:vars.password} [jd@om01 ovirt-engine]$ cat company-ldap-authn.properties ovirt.engine.extension.name = company-ldap-authn ovirt.engine.extension.bindings.method = jbossmodule ovirt.engine.extension.binding.jbossmodule.module = org.ovirt.engine-extensions.aaa.ldap ovirt.engine.extension.binding.jbossmodule.class = org.ovirt.engineextensions.aaa.ldap.AuthnExtension ovirt.engine.extension.provides = org.ovirt.engine.api.extensions.aaa.Authn ovirt.engine.aaa.authn.profile.name = company-ldap ovirt.engine.aaa.authn.authz.plugin = company-ldap-authz config.profile.file.1 = /etc/ovirt-engine/aaa/company-ldap.properties [jd@om01 ovirt-engine]$ cat company-ldap-authz.properties ovirt.engine.extension.name = company-ldap-authz ovirt.engine.extension.bindings.method = jbossmodule ovirt.engine.extension.binding.jbossmodule.module = org.ovirt.engine-extensions.aaa.ldap ovirt.engine.extension.binding.jbossmodule.class = org.ovirt.engineextensions.aaa.ldap.AuthzExtension ovirt.engine.extension.provides = org.ovirt.engine.api.extensions.aaa.Authz config.profile.file.1 = /etc/ovirt-engine/aaa/company-ldap.properties [jd@om01 ovirt-engine]$ ldapsearch -H ldap://ldap.company.de -D cn=system,dc=company,dc=de -W -b dc=company,dc=de cn=jdeloro # extended LDIF # # LDAPv3 # base <dc=company,dc=de> with scope subtree # filter: cn=jdeloro # requesting: ALL # # jdeloro, users, admins, company.de dn: cn=jdeloro,ou=users,ou=admins,dc=company,dc=de [... and many more lines ...] I could not use namingContexts from RootDSE cause this results in base dn dc=de instead of dc=company,dc=de. Kind regards Jannick

3 7

rename ovirt-engine
by Koen Vanoppen 12 Jan '15

12 Jan '15

Dear all, A while ago we migrated our engine to a new host with a new name. But now, we come to realistion that our certificate is still using the old name of the host. I tried to run the ovirt-engine-rename script, but after typed the new hostname I get this output: [ INFO ] The following files will be updated: /etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf /etc/ovirt-engine/imageuploader.conf.d/10-engine-setup.conf /etc/ovirt-engine/isouploader.conf.d/10-engine-setup.conf /etc/ovirt-engine/logcollector.conf.d/10-engine-setup.conf /etc/pki/ovirt-engine/cert.conf /etc/pki/ovirt-engine/cert.template /etc/pki/ovirt-engine/certs/apache.cer /etc/pki/ovirt-engine/keys/apache.key.nopass /etc/pki/ovirt-engine/keys/apache.p12 [ INFO ] Stage: Transaction setup [ INFO ] Stopping engine service [ INFO ] Stopping ovirt-fence-kdump-listener service [ INFO ] Stopping websocket-proxy service [ INFO ] Stage: Misc configuration [ INFO ] Stage: Package installation [ INFO ] Stage: Misc configuration [ ERROR ] Failed to execute stage 'Misc configuration': invalid literal for int() with base 10: 'None' [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-rename-20150112135225-wfbear.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20150112135247-rename.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of rename failed >From the log file: 2015-01-12 13:52:46 DEBUG otopi.plugins.otopi.services.rhel plugin.executeRaw:785 execute: ('/sbin/service', 'ovirt-websocket-proxy', 'stop'), executable='None', cwd='None', env=None 2015-01-12 13:52:47 DEBUG otopi.plugins.otopi.services.rhel plugin.executeRaw:803 execute-result: ('/sbin/service', 'ovirt-websocket-proxy', 'stop'), rc=0 2015-01-12 13:52:47 DEBUG otopi.plugins.otopi.services.rhel plugin.execute:861 execute-output: ('/sbin/service', 'ovirt-websocket-proxy', 'stop') stdout: Stopping oVirt Engine websockets proxy: [ OK ] 2015-01-12 13:52:47 DEBUG otopi.plugins.otopi.services.rhel plugin.execute:866 execute-output: ('/sbin/service', 'ovirt-websocket-proxy', 'stop') stderr: 2015-01-12 13:52:47 INFO otopi.context context.runSequence:417 Stage: Misc configuration 2015-01-12 13:52:47 DEBUG otopi.context context.runSequence:421 STAGE early_misc 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage early_misc METHOD otopi.plugins.otopi.network.firewalld.Plugin._early_misc 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:144 condition False 2015-01-12 13:52:47 INFO otopi.context context.runSequence:417 Stage: Package installation 2015-01-12 13:52:47 DEBUG otopi.context context.runSequence:421 STAGE packages 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage packages METHOD otopi.plugins.otopi.network.iptables.Plugin._packages 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:144 condition False 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage packages METHOD otopi.plugins.otopi.packagers.yumpackager.Plugin._packages 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:144 condition False 2015-01-12 13:52:47 INFO otopi.context context.runSequence:417 Stage: Misc configuration 2015-01-12 13:52:47 DEBUG otopi.context context.runSequence:421 STAGE misc 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage misc METHOD otopi.plugins.otopi.system.command.Plugin._misc 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage misc METHOD otopi.plugins.otopi.network.firewalld.Plugin._misc 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:144 condition False 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage misc METHOD otopi.plugins.otopi.network.iptables.Plugin._store_iptables 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:144 condition False 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage misc METHOD otopi.plugins.otopi.network.ssh.Plugin._append_key 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:144 condition False 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage misc METHOD otopi.plugins.otopi.system.clock.Plugin._set_clock 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:144 condition False 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage misc METHOD otopi.plugins.ovirt_engine_common.ovirt_engine.db.pgpass.Plugin._misc 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:490 ENVIRONMENT DUMP - BEGIN 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:500 ENV OVESETUP_DB/pgPassFile=str:'/tmp/tmpHWoEfz' 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:504 ENVIRONMENT DUMP - END 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage misc METHOD otopi.plugins.ovirt_engine_rename.ovirt-engine.database.Plugin._connection 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:490 ENVIRONMENT DUMP - BEGIN 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:500 ENV OVESETUP_DB/connection=connection:'<connection object at 0x2977e50; dsn: 'dbname=engine host=localhost port=5432 user=engine password=xxxxxxxx sslmode=allow', closed: 0>' 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:500 ENV OVESETUP_DB/statement=Statement:'<ovirt_engine_setup.engine_common.database.Statement object at 0x2ab0850>' 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:504 ENVIRONMENT DUMP - END 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:138 Stage misc METHOD otopi.plugins.ovirt_engine_rename.ovirt-engine.database.Plugin._misc 2015-01-12 13:52:47 DEBUG otopi.ovirt_engine_setup.engine_common.database database.execute:164 Database: 'None', Statement: ' select version, option_value from vdc_options where option_name = %(name)s ', args: {'name': 'RedirectServletReportsPage'} 2015-01-12 13:52:47 DEBUG otopi.ovirt_engine_setup.engine_common.database database.execute:214 Result: [{'version': 'general', 'option_value': '//ovirtmgmt01prod.brusselsairport.aero:None/ovirt-engine-reports'}] 2015-01-12 13:52:47 DEBUG otopi.context context._executeMethod:152 method exception Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/otopi/context.py", line 142, in _executeMethod method['method']() File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-rename/ovirt-engine/database.py", line 176, in _misc ulist[1] = newfqdn + ":" + str(u.port) File "/usr/lib64/python2.6/urlparse.py", line 105, in port return int(port, 10) ValueError: invalid literal for int() with base 10: 'None' 2015-01-12 13:52:47 ERROR otopi.context context._executeMethod:161 Failed to execute stage 'Misc configuration': invalid literal for int() with base 10: 'None' 2015-01-12 13:52:47 DEBUG otopi.transaction transaction.abort:131 aborting 'Database Transaction' 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:490 ENVIRONMENT DUMP - BEGIN 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:500 ENV BASE/error=bool:'True' 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:500 ENV BASE/exceptionInfo=list:'[(<type 'exceptions.ValueError'>, ValueError("invalid literal for int() with base 10: 'None'",), <traceback object at 0x2ae7ea8>)]' 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:500 ENV OVESETUP_DB/connection=NoneType:'None' 2015-01-12 13:52:47 DEBUG otopi.context context.dumpEnvironment:504 ENVIRONMENT DUMP - END 2015-01-12 13:52:47 INFO otopi.context context.runSequence:417 Stage: Clean up 2015-01-12 13:52:47 DEBUG otopi.context context.runSequence:421 STAGE cleanup Any ideas? Kind regards, Koen

2 2

Alerts
by Koen Vanoppen 12 Jan '15

12 Jan '15

Hi All, We recently had a major crash on our ovirt environment due a strange bug (has been reported in the meanwhile). But now we are left we a bunch of aerts (+100) that are still standing there... Is there a way I can flush them manually from command line or so? Because the right click+clear all, doesn't seem to work that good... :-). Kind regards, Koen

3 4

Issues with vm start up
by Shanil S 12 Jan '15

12 Jan '15

Hi All, I am using the ovirt version 3.5 and having some issues with the vm startup with cloud-init using api in run-once mode..... Below is the steps i follow :- 1. Create the VM by API from precreated Template.. 2. Start the VM in run-once mode and push the cloud-init data from API.. 3. VM stuck and from console it display the following :- Booting from DVD/CD.. ... Boot failed : could not read from CDROM (code 004) I am using the following xml for this operation :- <action> <vm> <os> <boot dev='cdrom'/> </os> <initialization> <cloud_init> <host> <address>test</address> </host> <network_configuration> <nics> <nic> <interface>virtIO</interface> <name>eth0</name> <boot_protocol>static</boot_protocol> <mac address=''/> <network> <ip address='' netmask='' gateway=''/> </network> <on_boot>true</on_boot><vnic_profile id='' /> </nic> <nic> <interface>virtIO</interface> <name>eth1</name> <boot_protocol>static</boot_protocol> <mac address=''/> <network> <ip address='' netmask='255.255.255.0' gateway=''/> </network> <on_boot>true</on_boot><vnic_profile id='' /> </nic> </nics> </network_configuration> <files> <file> <name>/ignored</name><content><![CDATA[#cloud-config disable-ec2-metadata: true disable_root: false ssh_pwauth: true ssh_deletekeys: true chpasswd: { expire: False } users: - name: root primary-group: root passwd: 8W7RQ5Bh lock-passwd: false runcmd: - sed -i '/nameserver/d' /etc/resolv.conf - echo 'nameserver 8.8.8.8' >> /etc/resolv.conf - echo 'nameserver 8.8.4.4' >> /etc/resolv.conf - echo 'root:8W7RQ5Bh' | chpasswd - yum -y update - yum -y install rdate - rdate -s stdtime.gov.hk]]></content> <type>plaintext</type> </file> </files> </cloud_init><custom_script><![CDATA[#cloud-config disable-ec2-metadata: true disable_root: false ssh_pwauth: true ssh_deletekeys: true chpasswd: { expire: False } users: - name: root primary-group: root passwd: 8W7RQ5Bh lock-passwd: false runcmd: - sed -i '/nameserver/d' /etc/resolv.conf - echo 'nameserver 8.8.8.8' >> /etc/resolv.conf - echo 'nameserver 8.8.4.4' >> /etc/resolv.conf - echo 'root:8W7RQ5Bh' | chpasswd - yum -y update - yum -y install rdate - rdate -s stdtime.gov.hk]]></custom_script> </initialization> </vm> </action> I am also attaching the screen shot to this. -- Regards Shanil

5 11

Backup and Restore of VMs
by Soeren Malchow 12 Jan '15

12 Jan '15

--_000_687766E0007010429FBFF98CA70824887896D9mcexch01mcongroup_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Dear all, ovirt: 3.5 gluster: 3.6.1 OS: CentOS 7 (except ovirt hosted engine =3D centos 6.6) i spent quite a while researching backup and restore for VMs right now, so = far I have come up with this as a start for us - API calls to create schedule snapshots of virtual machines This is or short term storage and to guard against accidential deletion wit= hin the VM but not for storage corruption - Since we are using a gluster backend, gluster snapshots I wasn't able so far to really test it since the LV needs to be thin provis= ioned and we did not do that in the setup For the API calls we have the problem that we can not find any existing scr= ipts or something like that to do those snapshots (and i/we are not develop= ers enough to do that). As an additional information, we have a ZFS based storage with deduplicatio= n that we use for other backup purposes which does a great job especially b= ecause of the deduplication (we can storage generations of backups without = problems), this storage can be NFS exported and used as backup repository. Are there any backup and restore procedure you guys are using for backup an= d restore that works for you and can you point me into the right direction = ? I am a little bit list right now and would appreciate any help. Regards Soeren --_000_687766E0007010429FBFF98CA70824887896D9mcexch01mcongroup_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"= > <meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang=3D"DE" link=3D"#0563C1" vlink=3D"#954F72"> <div class=3D"WordSection1"> <p class=3D"MsoNormal">Dear all,<o:p></o:p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">ovirt: 3.5<o:p></o:p></span></p= > <p class=3D"MsoNormal"><span lang=3D"EN-US">gluster: 3.6.1<o:p></o:p></span= ></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">OS: CentOS 7 (except ovirt host= ed engine =3D centos 6.6)<o:p></o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">i spent quite a while researchi= ng backup and restore for VMs right now, so far I have come up with this as= a start for us<o:p></o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p> <p class=3D"MsoListParagraph" style=3D"text-indent:-.25in;mso-list:l0 level= 1 lfo1"><![if !supportLists]><span lang=3D"EN-US"><span style=3D"mso-list:I= gnore">-<span style=3D"font:7.0pt "Times New Roman"">  =         </span></span></span><![endif]><span lang=3D"EN-US">API calls to create sch= edule snapshots of virtual machines<br> This is or short term storage and to guard against accidential deletion wit= hin the VM but not for storage corruption<br> <br> <o:p></o:p></span></p> <p class=3D"MsoListParagraph" style=3D"text-indent:-.25in;mso-list:l0 level= 1 lfo1"><![if !supportLists]><span lang=3D"EN-US"><span style=3D"mso-list:I= gnore">-<span style=3D"font:7.0pt "Times New Roman"">  =         </span></span></span><![endif]><span lang=3D"EN-US">Since we are using a gl= uster backend, gluster snapshots<br> I wasn’t able so far to really test it since the LV needs to be thin = provisioned and we did not do that in the setup<o:p></o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">For the API calls we have the p= roblem that we can not find any existing scripts or something like that to = do those snapshots (and i/we are not developers enough to do that).<o:p></o= :p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">As an additional information, w= e have a ZFS based storage with deduplication that we use for other backup = purposes which does a great job especially because of the deduplication (we= can storage generations of backups without problems), this storage can be NFS exported and used as backup rep= ository.<o:p></o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">Are there any backup and restor= e procedure you guys are using for backup and restore that works for you an= d can you point me into the right direction ?<o:p></o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">I am a little bit list right no= w and would appreciate any help.<o:p></o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">Regards<o:p></o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">Soeren<o:p></o:p></span></p> </div> </body> </html> --_000_687766E0007010429FBFF98CA70824887896D9mcexch01mcongroup_--

6 9

Re: [ovirt-users] Can't remove a storage domain related to a broken hardware
by Olivier Navas 12 Jan '15

12 Jan '15

------=_Part_1573992_482995922.1421055717805 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi !=20 I finally solved my problem by removing information related to broken stora= ge in the engine database.=20 I post below the sql queries I executed in postgres (with engine stopped wh= ile executing them) in order to remove storage domain. Maybe it can be usef= ul for somebody else in the same situation.=20 Connect to database=20 # su - postgres=20 # psql engine=20 identify broken storage=20 engine=3D# select id, storage_name from storage_domain_static;=20 id | storage_name=20 --------------------------------------+------------------------=20 34c95a44-db7f-4d0f-ba13-5f06a7feefe7 | my-broken-storage-domain=20 identify ovf disks on this storage=20 engine=3D# select storage_domain_id, ovf_disk_id from storage_domains_ovf_i= nfo where storage_domain_id =3D '34c95a44-db7f-4d0f-ba13-5f06a7feefe7';=20 storage_domain_id | ovf_disk_id=20 --------------------------------------+------------------------------------= --=20 34c95a44-db7f-4d0f-ba13-5f06a7feefe7 | 033f8fba-5145-47e8-b3b5-32a34a39ad11= =20 34c95a44-db7f-4d0f-ba13-5f06a7feefe7 | 2d9a6a40-1dd0-4180-b7c7-3829a443c825= =20 engine=3D# delete from storage_domain_dynamic where id =3D '34c95a44-db7f-4= d0f-ba13-5f06a7feefe7';=20 engine=3D# delete from storage_domain_static where id =3D '34c95a44-db7f-4d= 0f-ba13-5f06a7feefe7';=20 engine=3D# delete from base_disks where disk_id =3D '033f8fba-5145-47e8-b3b= 5-32a34a39ad11';=20 engine=3D# delete from base_disks where disk_id =3D '2d9a6a40-1dd0-4180-b7c= 7-3829a443c825';=20 engine=3D# delete from storage_domains_ovf_info where storage_domain_id =3D= '34c95a44-db7f-4d0f-ba13-5f06a7feefe7';=20 engine=3D# delete from storage_pool_iso_map where storage_id =3D '34c95a44-= db7f-4d0f-ba13-5f06a7feefe7';=20 identify and delete luns and connections related to storage (i did not take= notes of results of these ones, but it was easy to find the good lines). A= lso, i noticed that lun_storage_server_connection_map only contained inform= ation about iscsi storage, not fiber channel.=20 engine=3D# select * from luns;=20 engine=3D# delete from luns where physical_volume_id =3D 'IqOdm6-BWuT-9YBW-= uvM1-q41E-a3Cz-zPnWHq';=20 engine=3D# delete from lun_storage_server_connection_map where storage_serv= er_connection=3D'1b9f3167-3236-431e-93c2-ab5ee18eba04';=20 engine=3D# delete from lun_storage_server_connection_map where storage_serv= er_connection=3D'ea5971f8-e1a0-42e3-826d-b95e9031ce53';=20 engine=3D# delete from storage_server_connections where id=3D'1b9f3167-3236= -431e-93c2-ab5ee18eba04';=20 engine=3D# delete from storage_server_connections where id=3D'ea5971f8-e1a0= -42e3-826d-b95e9031ce53';=20 delete remaining disk(s) ; I had 1 virtual disk on this storage=20 engine=3D# delete from base_disks where disk_id=3D'03d651eb-14a9-4dca-8c87-= 605f101a5e0c';=20 engine=3D# delete from permissions where object_id=3D'03d651eb-14a9-4dca-8c= 87-605f101a5e0c';=20 Then started engine and all is fine now.=20 ----- Mail original -----=20 > De: "Amit Aviram" <aaviram(a)redhat.com>=20 > =C3=80: "Olivier Navas" <olivier.navas(a)sdis33.fr>=20 > Envoy=C3=A9: Mardi 6 Janvier 2015 17:24:19=20 > Objet: Re: [ovirt-users] Can't remove a storage domain related to a broke= n hardware=20 >=20 >=20 >=20 > ----- Original Message -----=20 > From: "Olivier Navas" <olivier.navas(a)sdis33.fr>=20 > Hi, can you please add the engine log?=20 >=20 > To: users(a)ovirt.org=20 > Sent: Tuesday, January 6, 2015 11:28:42 AM=20 > Subject: [ovirt-users] Can't remove a storage domain related to a broken= =20 > hardware=20 >=20 >=20 > Hello Ovirt users !=20 >=20 > I experienced an hardware failure on a ISCSI storage making it unrecovera= ble,=20 > and I would like to remove it from storage domains.=20 >=20 > There was 1 disk on this storage domain, and this disk isn't attached to = any=20 > VM anymore, but I still can't detach this storage domain from cluster.=20 >=20 > The storage domain is in "inactive" status and if I try to "detach" it fr= om=20 > data center, ovirt tries to activate it. Obviously it can't activate it= =20 > since hardware is broken, and it fails after several minutes with the eve= nt=20 > "Failed to detach Storage Domain my_storage_domain to Data Center Default= .=20 > (User: admin)". I can post my engine.log if useful.=20 >=20 > I need a way to force removal of this storage domain. Any trick would be= =20 > greatly appreciated.=20 >=20 > Perhaps does Ovirt miss some sort of "force detach, i know what i'm doing= "=20 > button ?=20 >=20 > I am running an Ovirt 3.5 cluster (engine with CentOS 6.6, 4 nodes with= =20 > CentOS 7) with FC and ISCSI storage domains.=20 >=20 > Thanks for your help.=20 >=20 >=20 >=20 >=20 > Ce courriel et tous les fichiers attach=C3=A9s qu'il contient sont confid= entiels=20 > et destin=C3=A9s exclusivement =C3=A0 la personne =C3=A0 laquelle ils son= t adress=C3=A9s. Si=20 > vous avez re=C3=A7u ce courriel par erreur, merci de le retourner =C3=A0 = son=20 > exp=C3=A9diteur et de le d=C3=A9truire. Il est rappel=C3=A9 que tout mess= age =C3=A9lectronique=20 > est susceptible d'alteration au cours de son acheminement sur internet.= =20 > Seuls les documents officiels du SDIS sont de nature =C3=A0 engager sa=20 > responsabilit=C3=A9. Les id=C3=A9es ou opinions pr=C3=A9sent=C3=A9es dans= ce courriel sont=20 > celles de son auteur et ne repr=C3=A9sentent pas n=C3=A9cessairement cell= es du SDIS de=20 > la Gironde.=20 >=20 > _______________________________________________=20 > Users mailing list=20 > Users(a)ovirt.org=20 > http://lists.ovirt.org/mailman/listinfo/users=20 >=20 =0A--=0ACe courriel et tous les fichiers attach=C3=A9s qu'il contient sont = confidentiels et destin=C3=A9s exclusivement =C3=A0 la personne =C3=A0 laque= lle ils sont adress=C3=A9s. Si vous avez re=C3=A7u ce courriel par erreur, m= erci de le retourner =C3=A0 son exp=C3=A9diteur et de le d=C3=A9truire. Il e= st rappel=C3=A9 que tout message =C3=A9lectronique est susceptible d'alterat= ion au cours de son acheminement sur internet. Seuls les documents officiels= du SDIS sont de nature =C3=A0 engager sa responsabilit=C3=A9. Les id=C3=A9e= s ou opinions pr=C3=A9sent=C3=A9es dans ce courriel sont celles de son auteu= r et ne repr=C3=A9sentent pas n=C3=A9cessairement celles du SDIS de la Giron= de.=0A ------=_Part_1573992_482995922.1421055717805 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><div><br>Hi !<br></div><div><br></div= ><div>I finally solved my problem by removing information related to broken= storage in the engine database.<br></div><div><br></div><div>I post below = the sql queries I executed in postgres (with engine stopped while executing= them) in order to remove storage domain. Maybe it can be useful for somebo= dy else in the same situation.<br></div><div><br></div><div><br>Connect to = database<br></div><div><br></div><div># su - postgres<br># psql engine<br><= /div><div><br></div><div><br>identify broken storage <br></div><div><br></d= iv><div>engine=3D# select id, storage_name from storage_domain_static;<br>&= nbsp;                 id &nbsp= ;                |     &n= bsp;storage_name      <br>----------------------------------= ----+------------------------<br> 34c95a44-db7f-4d0f-ba13-5f06a7feefe7= | my-broken-storage-domain<br></div><div><br></div><div><br></div><div><br= ></div><div>identify ovf disks on this storage<br></div><div><br></div><div= >engine=3D# select storage_domain_id, ovf_disk_id from  storage_domain= s_ovf_info where storage_domain_id =3D '34c95a44-db7f-4d0f-ba13-5f06a7feefe= 7';<br>          storage_domain_id   &nb= sp;       |             ovf_di= sk_id              <br>-----------------= ---------------------+--------------------------------------<br> 34c95= a44-db7f-4d0f-ba13-5f06a7feefe7 | 033f8fba-5145-47e8-b3b5-32a34a39ad11<br>&= nbsp;34c95a44-db7f-4d0f-ba13-5f06a7feefe7 | 2d9a6a40-1dd0-4180-b7c7-3829a44= 3c825<br></div><div><br></div><div><br>engine=3D# delete from storage_domai= n_dynamic where id =3D '34c95a44-db7f-4d0f-ba13-5f06a7feefe7';<br>engine=3D= # delete from storage_domain_static where id =3D '34c95a44-db7f-4d0f-ba13-5= f06a7feefe7';<br>engine=3D# delete from base_disks where disk_id =3D '033f8= fba-5145-47e8-b3b5-32a34a39ad11';<br>engine=3D# delete from base_disks wher= e disk_id =3D '2d9a6a40-1dd0-4180-b7c7-3829a443c825';<br>engine=3D# delete = from storage_domains_ovf_info  where storage_domain_id =3D '34c95a44-d= b7f-4d0f-ba13-5f06a7feefe7';<br>engine=3D# delete from storage_pool_iso_map=  where storage_id =3D '34c95a44-db7f-4d0f-ba13-5f06a7feefe7';<br></di= v><div><br></div><div><br>identify and delete luns and connections related = to storage (i did not take notes of results of these ones, but it was easy = to find the good lines). Also, i noticed that lun_storage_server_connection= _map only contained information about iscsi storage, not fiber channel.<br>= </div><div><br></div><div>engine=3D# select * from luns;<br></div><div><br>= </div><div>engine=3D# delete from luns where physical_volume_id =3D 'IqOdm6= -BWuT-9YBW-uvM1-q41E-a3Cz-zPnWHq';<br>engine=3D# delete from lun_storage_se= rver_connection_map where storage_server_connection=3D'1b9f3167-3236-431e-9= 3c2-ab5ee18eba04';<br>engine=3D# delete from lun_storage_server_connection_= map where storage_server_connection=3D'ea5971f8-e1a0-42e3-826d-b95e9031ce53= ';<br>engine=3D# delete from storage_server_connections where id=3D'1b9f316= 7-3236-431e-93c2-ab5ee18eba04';<br>engine=3D# delete from storage_server_co= nnections where id=3D'ea5971f8-e1a0-42e3-826d-b95e9031ce53';<br></div><div>= <br></div><div><br>delete remaining disk(s) ; I had 1 virtual disk on this = storage<br></div><div><br></div><div>engine=3D# delete from base_disks wher= e disk_id=3D'03d651eb-14a9-4dca-8c87-605f101a5e0c';<br>engine=3D# delete fr= om permissions where object_id=3D'03d651eb-14a9-4dca-8c87-605f101a5e0c';<br= ></div><div><br></div><div><br>Then started engine and all is fine now.<br>= </div><div><br></div><div><br></div><div><br></div><div>----- Mail original= -----<br>> De: "Amit Aviram" <aaviram(a)redhat.com><br>> =C3=80:= "Olivier Navas" <olivier.navas(a)sdis33.fr><br>> Envoy=C3=A9: Mardi= 6 Janvier 2015 17:24:19<br>> Objet: Re: [ovirt-users] Can't remove a st= orage domain related to a broken       &= nbsp;hardware<br>> <br>> <br>> <br>> ----- Original Message ---= --<br>> From: "Olivier Navas" <olivier.navas(a)sdis33.fr><br>> Hi= , can you please add the engine log?<br>> <br>> To: users(a)ovirt.org<b= r>> Sent: Tuesday, January 6, 2015 11:28:42 AM<br>> Subject: [ovirt-u= sers] Can't remove a storage domain related to a broken<br>>  &nbsp= ;      hardware<br>> <br>> <br>> Hel= lo Ovirt users !<br>> <br>> I experienced an hardware failure on a IS= CSI storage making it unrecoverable,<br>> and I would like to remove it = from storage domains.<br>> <br>> There was 1 disk on this storage dom= ain, and this disk isn't attached to any<br>> VM anymore, but I still ca= n't detach this storage domain from cluster.<br>> <br>> The storage d= omain is in "inactive" status and if I try to "detach" it from<br>> data= center, ovirt tries to activate it. Obviously it can't activate it<br>>= since hardware is broken, and it fails after several minutes with the even= t<br>> "Failed to detach Storage Domain my_storage_domain to Data Center= Default.<br>> (User: admin)". I can post my engine.log if useful.<br>&g= t; <br>> I need a way to force removal of this storage domain. Any trick= would be<br>> greatly appreciated.<br>> <br>> Perhaps does Ovirt = miss some sort of "force detach, i know what i'm doing"<br>> button ?<br= >> <br>> I am running an Ovirt 3.5 cluster (engine with CentOS 6.6, 4= nodes with<br>> CentOS 7) with FC and ISCSI storage domains.<br>> <b= r>> Thanks for your help.<br>> <br>> <br>> <br>> <br>> Ce= courriel et tous les fichiers attach=C3=A9s qu'il contient sont confidenti= els<br>> et destin=C3=A9s exclusivement =C3=A0 la personne =C3=A0 laquel= le ils sont adress=C3=A9s. Si<br>> vous avez re=C3=A7u ce courriel par e= rreur, merci de le retourner =C3=A0 son<br>> exp=C3=A9diteur et de le d= =C3=A9truire. Il est rappel=C3=A9 que tout message =C3=A9lectronique<br>&gt= ; est susceptible d'alteration au cours de son acheminement sur internet.<b= r>> Seuls les documents officiels du SDIS sont de nature =C3=A0 engager = sa<br>> responsabilit=C3=A9. Les id=C3=A9es ou opinions pr=C3=A9sent=C3= =A9es dans ce courriel sont<br>> celles de son auteur et ne repr=C3=A9se= ntent pas n=C3=A9cessairement celles du SDIS de<br>> la Gironde.<br>>= <br>> _______________________________________________<br>> Users mai= ling list<br>> Users(a)ovirt.org<br>> http://lists.ovirt.org/mailman/li= stinfo/users<br>> <br></div></div> <br>= =0A<hr><font size=3D"-2"><em>=0ACe courriel et tous les fichiers attach=C3= =A9s qu'il contient sont confidentiels et destin=C3=A9s exclusivement =C3=A0= la personne =C3=A0 laquelle ils sont adress=C3=A9s. Si vous avez re=C3=A7u = ce courriel par erreur, merci de le retourner =C3=A0 son exp=C3=A9diteur et = de le d=C3=A9truire. Il est rappel=C3=A9 que tout message =C3=A9lectronique = est susceptible d'alteration au cours de son acheminement sur internet. Seul= s les documents officiels du SDIS sont de nature =C3=A0 engager sa responsab= ilit=C3=A9. Les id=C3=A9es ou opinions pr=C3=A9sent=C3=A9es dans ce courriel= sont celles de son auteur et ne repr=C3=A9sentent pas n=C3=A9cessairement c= elles du SDIS de la Gironde.=0A</font></em>=0A <br>= </body></html> ------=_Part_1573992_482995922.1421055717805--

1 0

Can't migrate/remove VM
by Johan Kooijman 12 Jan '15

12 Jan '15

Hi all, Been playing with an ovirt test setup for the last couple of days. Created some vm's, started to throw them around on the cluster, but now I'm stuck. The VM's are running, but when I try to stop them, I get errors like this: https://plakbord.cloud.nl/p/zvAEVPFeBBJSBeGspKNxJsqF When trying to migrate a VM, the node throws this error: https://plakbord.cloud.nl/p/4Syi9A7tEd8L3A2pQg6boVB6 Any clue on what's happening? -- Met vriendelijke groeten / With kind regards, Johan Kooijman

1 2

Failed to find host Host in gluster peer list from Host
by Punit Dambiwal 12 Jan '15

12 Jan '15

Hi, I am facing one strange issue in the ovirt with glusterfs ......i want to reactivate onw of my host node....but it's failed with the following error :- Gluster command [gluster peer status cpu04.zne01.hkg1.ovt.com] failed on server cpu04. Engine Logs :- http://ur1.ca/jczdp

3 6

Re: [ovirt-users] VM failover with ovirt3.5
by cong yue 11 Jan '15

11 Jan '15

The vdsm.log just after I turned the host where HE VM is to local. In the log, there is some part like --- GuestMonitor-HostedEngine::DEBUG::2014-12-30 13:01:03,988::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`0d3adb5c-0960-483c-9d73-5e256a519f2f`::Domain Metadata is not set GuestMonitor-HostedEngine::DEBUG::2014-12-30 13:01:03,989::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`0d3adb5c-0960-483c-9d73-5e256a519f2f`::Domain Metadata is not set GuestMonitor-HostedEngine::DEBUG::2014-12-30 13:01:03,990::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`0d3adb5c-0960-483c-9d73-5e256a519f2f`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2014-12-30 13:01:04,675::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2014-12-30 13:01:04,676::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-1806995::DEBUG::2014-12-30 13:01:04,677::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2014-12-30 13:01:04,678::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2014-12-30 13:01:04,679::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-1806996::DEBUG::2014-12-30 13:01:04,681::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`0d3adb5c-0960-483c-9d73-5e256a519f2f`::Domain Metadata is not set --- I this with some wrong? Thanks, Cong > From: Artyom Lukianov <alukiano(a)redhat.com> > Date: 2014年12月29日 23:13:45 GMT-8 > To: "Yue, Cong" <Cong_Yue(a)alliedtelesis.com> > Cc: Simone Tiraboschi <stirabos(a)redhat.com>, "users(a)ovirt.org" > <users(a)ovirt.org> > Subject: Re: [ovirt-users] VM failover with ovirt3.5 > > HE vm migrated only by ovirt-ha-agent and not by engine, but FatalError it's > more interesting, can you provide vdsm.log for this one please. > > ----- Original Message ----- > From: "Cong Yue" <Cong_Yue(a)alliedtelesis.com> > To: "Artyom Lukianov" <alukiano(a)redhat.com> > Cc: "Simone Tiraboschi" <stirabos(a)redhat.com>, users(a)ovirt.org > Sent: Monday, December 29, 2014 8:29:04 PM > Subject: Re: [ovirt-users] VM failover with ovirt3.5 > > I disabled local maintenance mode for all hosts, and then only set the host > where HE VM is there to local maintenance mode. The logs are as follows. > During the migration of HE VM , it shows some fatal error happen. By the > way, also HE VM can not work with live migration. Instead, other VMs can do > live migration. > > --- > [root@compute2-3 ~]# hosted-engine --set-maintenance --mode=local > You have new mail in /var/spool/mail/root > [root@compute2-3 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log > MainThread::INFO::2014-12-29 > 13:16:12,435::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.92 (id: 3, score: 2400) > MainThread::INFO::2014-12-29 > 13:16:22,711::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-29 > 13:16:22,711::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.92 (id: 3, score: 2400) > MainThread::INFO::2014-12-29 > 13:16:32,978::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-29 > 13:16:32,978::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-29 > 13:16:43,272::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-29 > 13:16:43,272::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-29 > 13:16:53,316::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) > Engine vm running on localhost > MainThread::INFO::2014-12-29 > 13:16:53,562::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-29 > 13:16:53,562::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-29 > 13:17:03,600::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-29 > 13:17:03,611::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) > Trying: notify time=1419877023.61 type=state_transition > detail=EngineUp-LocalMaintenanceMigrateVm hostname='compute2-3' > MainThread::INFO::2014-12-29 > 13:17:03,672::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) > Success, was notification of state_transition > (EngineUp-LocalMaintenanceMigrateVm) sent? sent > MainThread::INFO::2014-12-29 > 13:17:03,911::states::208::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) > Score is 0 due to local maintenance mode > MainThread::INFO::2014-12-29 > 13:17:03,912::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenanceMigrateVm (score: 0) > MainThread::INFO::2014-12-29 > 13:17:03,912::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-29 > 13:17:03,960::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) > Trying: notify time=1419877023.96 type=state_transition > detail=LocalMaintenanceMigrateVm-EngineMigratingAway > hostname='compute2-3' > MainThread::INFO::2014-12-29 > 13:17:03,980::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) > Success, was notification of state_transition > (LocalMaintenanceMigrateVm-EngineMigratingAway) sent? sent > MainThread::INFO::2014-12-29 > 13:17:04,218::states::66::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_penalize_memory) > Penalizing score by 400 due to low free memory > MainThread::INFO::2014-12-29 > 13:17:04,218::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineMigratingAway (score: 2000) > MainThread::INFO::2014-12-29 > 13:17:04,219::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::ERROR::2014-12-29 > 13:17:14,251::hosted_engine::867::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_monitor_migration) > Failed to migrate > Traceback (most recent call last): > File > "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", > line 863, in _monitor_migration > vm_id, > File > "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/vds_client.py", > line 85, in run_vds_client_cmd > response['status']['message']) > DetailedError: Error 12 from migrateStatus: Fatal error during migration > MainThread::INFO::2014-12-29 > 13:17:14,262::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) > Trying: notify time=1419877034.26 type=state_transition > detail=EngineMigratingAway-ReinitializeFSM hostname='compute2-3' > MainThread::INFO::2014-12-29 > 13:17:14,263::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) > Success, was notification of state_transition > (EngineMigratingAway-ReinitializeFSM) sent? ignored > MainThread::INFO::2014-12-29 > 13:17:14,496::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state ReinitializeFSM (score: 0) > MainThread::INFO::2014-12-29 > 13:17:14,496::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-29 > 13:17:24,536::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-29 > 13:17:24,547::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) > Trying: notify time=1419877044.55 type=state_transition > detail=ReinitializeFSM-LocalMaintenance hostname='compute2-3' > MainThread::INFO::2014-12-29 > 13:17:24,574::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) > Success, was notification of state_transition > (ReinitializeFSM-LocalMaintenance) sent? sent > MainThread::INFO::2014-12-29 > 13:17:24,812::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenance (score: 0) > MainThread::INFO::2014-12-29 > 13:17:24,812::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-29 > 13:17:34,851::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-29 > 13:17:35,095::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenance (score: 0) > MainThread::INFO::2014-12-29 > 13:17:35,095::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-29 > 13:17:45,130::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-29 > 13:17:45,368::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenance (score: 0) > MainThread::INFO::2014-12-29 > 13:17:45,368::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > ^C > [root@compute2-3 ~]# > > > [root@compute2-3 ~]# hosted-engine --vm-status > > > --== Host 1 status ==-- > > Status up-to-date : True > Hostname : 10.0.0.94 > Host ID : 1 > Engine status : {"health": "good", "vm": "up", > "detail": "up"} > Score : 0 > Local maintenance : True > Host timestamp : 1014956<tel:1014956> > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=1014956<tel:1014956> (Mon Dec 29 13:20:19 2014) > host-id=1 > score=0 > maintenance=True > state=LocalMaintenance > > > --== Host 2 status ==-- > > Status up-to-date : True > Hostname : 10.0.0.93 > Host ID : 2 > Engine status : {"reason": "vm not running on > this host", "health": "bad", "vm": "down", "detail": "unknown"} > Score : 2400 > Local maintenance : False > Host timestamp : 866019 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=866019 (Mon Dec 29 10:19:45 2014) > host-id=2 > score=2400 > maintenance=False > state=EngineDown > > > --== Host 3 status ==-- > > Status up-to-date : True > Hostname : 10.0.0.92 > Host ID : 3 > Engine status : {"reason": "vm not running on > this host", "health": "bad", "vm": "down", "detail": "unknown"} > Score : 2400 > Local maintenance : False > Host timestamp : 860493 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=860493 (Mon Dec 29 10:20:35 2014) > host-id=3 > score=2400 > maintenance=False > state=EngineDown > [root@compute2-3 ~]# > --- > Thanks, > Cong > > > > On 2014/12/29, at 8:43, "Artyom Lukianov" > <alukiano(a)redhat.com<mailto:alukiano@redhat.com>> wrote: > > I see that HE vm run on host with ip 10.0.0.94, and two another hosts in > "Local Maintenance" state, so vm will not migrate to any of them, can you > try disable local maintenance on all hosts in HE environment and after > enable "local maintenance" on host where HE vm run, and provide also output > of hosted-engine --vm-status. > Failover works in next way: > 1) if host where run HE vm have score less by 800 that some other host in HE > environment, HE vm will migrate on host with best score > 2) if something happen to vm(kernel panic, crash of service...), agent will > restart HE vm on another host in HE environment with positive score > 3) if put to local maintenance host with HE vm, vm will migrate to another > host with positive score > Thanks. > > ----- Original Message ----- > From: "Cong Yue" > <Cong_Yue(a)alliedtelesis.com<mailto:Cong_Yue@alliedtelesis.com>> > To: "Artyom Lukianov" <alukiano(a)redhat.com<mailto:alukiano@redhat.com>> > Cc: "Simone Tiraboschi" <stirabos(a)redhat.com<mailto:stirabos@redhat.com>>, > users(a)ovirt.org<mailto:users@ovirt.org> > Sent: Monday, December 29, 2014 6:30:42 PM > Subject: Re: [ovirt-users] VM failover with ovirt3.5 > > Thanks and the --vm-status log is as follows: > [root@compute2-2 ~]# hosted-engine --vm-status > > > --== Host 1 status ==-- > > Status up-to-date : True > Hostname : 10.0.0.94 > Host ID : 1 > Engine status : {"health": "good", "vm": "up", > "detail": "up"} > Score : 2400 > Local maintenance : False > Host timestamp : 1008087 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=1008087<tel:1008087> (Mon Dec 29 11:25:51 2014) > host-id=1 > score=2400 > maintenance=False > state=EngineUp > > > --== Host 2 status ==-- > > Status up-to-date : True > Hostname : 10.0.0.93 > Host ID : 2 > Engine status : {"reason": "vm not running on > this host", "health": "bad", "vm": "down", "detail": "unknown"} > Score : 0 > Local maintenance : True > Host timestamp : 859142 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=859142 (Mon Dec 29 08:25:08 2014) > host-id=2 > score=0 > maintenance=True > state=LocalMaintenance > > > --== Host 3 status ==-- > > Status up-to-date : True > Hostname : 10.0.0.92 > Host ID : 3 > Engine status : {"reason": "vm not running on > this host", "health": "bad", "vm": "down", "detail": "unknown"} > Score : 0 > Local maintenance : True > Host timestamp : 853615 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=853615 (Mon Dec 29 08:25:57 2014) > host-id=3 > score=0 > maintenance=True > state=LocalMaintenance > You have new mail in /var/spool/mail/root > [root@compute2-2 ~]# > > Could you please explain how VM failover works inside ovirt? Is there any > other debug option I can enable to check the problem? > > Thanks, > Cong > > > On 2014/12/29, at 1:39, "Artyom Lukianov" > <alukiano(a)redhat.com<mailto:alukiano@redhat.com><mailto:alukiano@redhat.com>> > wrote: > > Can you also provide output of hosted-engine --vm-status please, previous > time it was useful, because I do not see something unusual. > Thanks > > ----- Original Message ----- > From: "Cong Yue" > <Cong_Yue(a)alliedtelesis.com<mailto:Cong_Yue@alliedtelesis.com><mailto:Cong_Yue@alliedtelesis.com>> > To: "Artyom Lukianov" > <alukiano(a)redhat.com<mailto:alukiano@redhat.com><mailto:alukiano@redhat.com>> > Cc: "Simone Tiraboschi" > <stirabos(a)redhat.com<mailto:stirabos@redhat.com><mailto:stirabos@redhat.com>>, > users(a)ovirt.org<mailto:users@ovirt.org><mailto:users@ovirt.org> > Sent: Monday, December 29, 2014 7:15:24 AM > Subject: Re: [ovirt-users] VM failover with ovirt3.5 > > Also I change the maintenance mode to local in another host. But also the VM > in this host can not be migrated. The logs are as follows. > > [root@compute2-2 ~]# hosted-engine --set-maintenance --mode=local > [root@compute2-2 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log > MainThread::INFO::2014-12-28 > 21:09:04,184::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-28 > 21:09:14,603::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-28 > 21:09:14,603::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-28 > 21:09:24,903::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-28 > 21:09:24,904::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-28 > 21:09:35,026::states::437::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) > Engine vm is running on host 10.0.0.94 (id 1) > MainThread::INFO::2014-12-28 > 21:09:35,236::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-28 > 21:09:35,236::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-28 > 21:09:45,604::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-28 > 21:09:45,604::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-28 > 21:09:55,691::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-28 > 21:09:55,701::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) > Trying: notify time=1419829795.7 type=state_transition > detail=EngineDown-LocalMaintenance hostname='compute2-2' > MainThread::INFO::2014-12-28 > 21:09:55,761::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) > Success, was notification of state_transition > (EngineDown-LocalMaintenance) sent? sent > MainThread::INFO::2014-12-28 > 21:09:55,990::states::208::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) > Score is 0 due to local maintenance mode > MainThread::INFO::2014-12-28 > 21:09:55,990::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenance (score: 0) > MainThread::INFO::2014-12-28 > 21:09:55,991::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > ^C > You have new mail in /var/spool/mail/root > [root@compute2-2 ~]# ps -ef | grep qemu > root 18420 2777 0 21:10<x-apple-data-detectors://39> pts/0 > 00:00:00<x-apple-data-detectors://40> grep --color=auto qemu > qemu 29809 1 0 Dec19 ? 01:17:20 /usr/libexec/qemu-kvm > -name testvm2-2 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Nehalem > -m 500 -realtime mlock=off -smp > 1,maxcpus=16,sockets=16,cores=1,threads=1 -uuid > c31e97d0-135e-42da-9954-162b5228dce3 -smbios > type=1,manufacturer=oVirt,product=oVirt > Node,version=7-0.1406.el7.centos.2.5,serial=4C4C4544-0059-3610-8033-B4C04F395931,uuid=c31e97d0-135e-42da-9954-162b5228dce3 > -no-user-config -nodefaults -chardev > socket,id=charmonitor,path=/var/lib/libvirt/qemu/testvm2-2.monitor,server,nowait > -mon chardev=charmonitor,id=monitor,mode=control -rtc > base=2014-12-19T20:17:17<x-apple-data-detectors://42>,driftfix=slew > -no-kvm-pit-reinjection > -no-hpet -no-shutdown -boot strict=on -device > piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device > virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device > virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 > -drive if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial= > -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 > -drive > file=/rhev/data-center/00000002-0002-0002-0002-0000000001e4/1dc71096-27c4-4256-b2ac-bd7265525c69/images/5cbeb8c9-4f04-48d0-a5eb-78c49187c550/a0570e8c-9867-4ec4-818f-11e102fc4f9b,if=none,id=drive-virtio-disk0,format=qcow2,serial=5cbeb8c9-4f04-48d0-a5eb-78c49187c550,cache=none,werror=stop,rerror=stop,aio=threads > -device > virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 > -netdev tap,fd=28,id=hostnet0,vhost=on,vhostfd=29 -device > virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:db:94:00,bus=pci.0,addr=0x3 > -chardev > socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/c31e97d0-135e-42da-9954-162b5228dce3.com.redhat.rhevm.vdsm,server,nowait > -device > virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm > -chardev > socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/c31e97d0-135e-42da-9954-162b5228dce3.org.qemu.guest_agent.0,server,nowait > -device > virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 > -chardev spicevmc,id=charchannel2,name=vdagent -device > virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0 > -spice > tls-port=5901,addr=10.0.0.93,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on > -k en-us -vga qxl -global qxl-vga.ram_size=67108864<tel:67108864> -global > qxl-vga.vram_size=33554432<tel:33554432> -incoming tcp:[::]:49152 -device > virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x7 > [root@compute2-2 ~]# > > Thanks, > Cong > > > On 2014/12/28, at 20:53, "Yue, Cong" > <Cong_Yue(a)alliedtelesis.com<mailto:Cong_Yue@alliedtelesis.com><mailto:Cong_Yue@alliedtelesis.com><mailto:Cong_Yue@alliedtelesis.com>> > wrote: > > I checked it again and confirmed there is one guest VM is running on the top > of this host. The log is as follows: > > [root@compute2-1 vdsm]# ps -ef | grep qemu > qemu 2983 846 0 Dec19 ? 00:00:00<x-apple-data-detectors://0> > [supervdsmServer] <defunct> > root 5489 3053 0 20:49<x-apple-data-detectors://1> pts/0 > 00:00:00<x-apple-data-detectors://2> grep --color=auto qemu > qemu 26128 1 0 Dec19 ? 01:09:19 /usr/libexec/qemu-kvm > -name testvm2 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Nehalem -m > 500 -realtime mlock=off -smp 1,maxcpus=16,sockets=16,cores=1,threads=1 > -uuid e46bca87-4df5-4287-844b-90a26fccef33 -smbios > type=1,manufacturer=oVirt,product=oVirt > Node,version=7-0.1406.el7.centos.2.5,serial=4C4C4544-0030-3310-8059-B8C04F585231,uuid=e46bca87-4df5-4287-844b-90a26fccef33 > -no-user-config -nodefaults -chardev > socket,id=charmonitor,path=/var/lib/libvirt/qemu/testvm2.monitor,server,nowait > -mon chardev=charmonitor,id=monitor,mode=control -rtc > base=2014-12-19T20:18:01<x-apple-data-detectors://4>,driftfix=slew > -no-kvm-pit-reinjection > -no-hpet -no-shutdown -boot strict=on -device > piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device > virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device > virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 > -drive if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial= > -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 > -drive > file=/rhev/data-center/00000002-0002-0002-0002-0000000001e4/1dc71096-27c4-4256-b2ac-bd7265525c69/images/b4b5426b-95e3-41af-b286-da245891cdaf/0f688d49-97e3-4f1d-84d4-ac1432d903b3,if=none,id=drive-virtio-disk0,format=qcow2,serial=b4b5426b-95e3-41af-b286-da245891cdaf,cache=none,werror=stop,rerror=stop,aio=threads > -device > virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 > -netdev tap,fd=26,id=hostnet0,vhost=on,vhostfd=27 -device > virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:db:94:01,bus=pci.0,addr=0x3 > -chardev > socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/e46bca87-4df5-4287-844b-90a26fccef33.com.redhat.rhevm.vdsm,server,nowait > -device > virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm > -chardev > socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/e46bca87-4df5-4287-844b-90a26fccef33.org.qemu.guest_agent.0,server,nowait > -device > virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 > -chardev spicevmc,id=charchannel2,name=vdagent -device > virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0 > -spice > tls-port=5900,addr=10.0.0.92,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on > -k en-us -vga qxl -global qxl-vga.ram_size=67108864<tel:67108864> -global > qxl-vga.vram_size=33554432<tel:33554432> -incoming tcp:[::]:49152 -device > virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x7 > [root@compute2-1 vdsm]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log > MainThread::INFO::2014-12-28 > 20:49:27,315::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-28 > 20:49:27,646::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenance (score: 0) > MainThread::INFO::2014-12-28 > 20:49:27,646::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-28 > 20:49:37,732::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-28 > 20:49:37,961::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenance (score: 0) > MainThread::INFO::2014-12-28 > 20:49:37,961::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-28 > 20:49:48,048::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-28 > 20:49:48,319::states::208::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) > Score is 0 due to local maintenance mode > MainThread::INFO::2014-12-28 > 20:49:48,319::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenance (score: 0) > MainThread::INFO::2014-12-28 > 20:49:48,319::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > > Thanks, > Cong > > > On 2014/12/28, at 3:46, "Artyom Lukianov" > <alukiano(a)redhat.com<mailto:alukiano@redhat.com><mailto:alukiano@redhat.com><mailto:alukiano@redhat.com>> > wrote: > > I see that you set local maintenance on host3 that do not have engine vm on > it, so it nothing to migrate from this host. > If you set local maintenance on host1, vm must migrate to another host with > positive score. > Thanks > > ----- Original Message ----- > From: "Cong Yue" > <Cong_Yue(a)alliedtelesis.com<mailto:Cong_Yue@alliedtelesis.com><mailto:Cong_Yue@alliedtelesis.com><mailto:Cong_Yue@alliedtelesis.com>> > To: "Simone Tiraboschi" > <stirabos(a)redhat.com<mailto:stirabos@redhat.com><mailto:stirabos@redhat.com><mailto:stirabos@redhat.com>> > Cc: > users(a)ovirt.org<mailto:users@ovirt.org><mailto:users@ovirt.org><mailto:users@ovirt.org> > Sent: Saturday, December 27, 2014 6:58:32 PM > Subject: Re: [ovirt-users] VM failover with ovirt3.5 > > Hi > > I had a try with "hosted-engine --set-maintence --mode=local" on > compute2-1, which is host 3 in my cluster. From the log, it shows > maintence mode is dectected, but migration does not happen. > > The logs are as follows. Is there any other config I need to check? > > [root@compute2-1 vdsm]# hosted-engine --vm-status > > > --== Host 1 status ==- > > Status up-to-date : True > Hostname : 10.0.0.94 > Host ID : 1 > Engine status : {"health": "good", "vm": "up", > "detail": "up"} > Score : 2400 > Local maintenance : False > Host timestamp : 836296 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=836296 (Sat Dec 27 11:42:39 2014) > host-id=1 > score=2400 > maintenance=False > state=EngineUp > > > --== Host 2 status ==-- > > Status up-to-date : True > Hostname : 10.0.0.93 > Host ID : 2 > Engine status : {"reason": "vm not running on > this host", "health": "bad", "vm": "down", "detail": "unknown"} > Score : 2400 > Local maintenance : False > Host timestamp : 687358 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=687358 (Sat Dec 27 08:42:04 2014) > host-id=2 > score=2400 > maintenance=False > state=EngineDown > > > --== Host 3 status ==-- > > Status up-to-date : True > Hostname : 10.0.0.92 > Host ID : 3 > Engine status : {"reason": "vm not running on > this host", "health": "bad", "vm": "down", "detail": "unknown"} > Score : 0 > Local maintenance : True > Host timestamp : 681827 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=681827 (Sat Dec 27 08:42:40 2014) > host-id=3 > score=0 > maintenance=True > state=LocalMaintenance > [root@compute2-1 vdsm]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log > MainThread::INFO::2014-12-27 > 08:42:41,109::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-27 > 08:42:51,198::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-27 > 08:42:51,420::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenance (score: 0) > MainThread::INFO::2014-12-27 > 08:42:51,420::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-27 > 08:43:01,507::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-27 > 08:43:01,773::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenance (score: 0) > MainThread::INFO::2014-12-27 > 08:43:01,773::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-27 > 08:43:11,859::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) > Local maintenance detected > MainThread::INFO::2014-12-27 > 08:43:12,072::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state LocalMaintenance (score: 0) > MainThread::INFO::2014-12-27 > 08:43:12,072::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > > > > [root@compute2-3 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log > MainThread::INFO::2014-12-27 > 11:36:28,855::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-27 > 11:36:39,130::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-27 > 11:36:39,130::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-27 > 11:36:49,449::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-27 > 11:36:49,449::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-27 > 11:36:59,739::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-27 > 11:36:59,739::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-27 > 11:37:09,779::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) > Engine vm running on localhost > MainThread::INFO::2014-12-27 > 11:37:10,026::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-27 > 11:37:10,026::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-27 > 11:37:20,331::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-27 > 11:37:20,331::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > > > [root@compute2-2 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log > MainThread::INFO::2014-12-27 > 08:36:12,462::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-27 > 08:36:22,797::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-27 > 08:36:22,798::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-27 > 08:36:32,876::states::437::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) > Engine vm is running on host 10.0.0.94 (id 1) > MainThread::INFO::2014-12-27 > 08:36:33,169::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-27 > 08:36:33,169::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-27 > 08:36:43,567::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-27 > 08:36:43,567::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-27 > 08:36:53,858::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-27 > 08:36:53,858::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-27 > 08:37:04,028::state_machine::160::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) > Global metadata: {'maintenance': False} > MainThread::INFO::2014-12-27 > 08:37:04,028::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) > Host 10.0.0.94 (id 1): {'extra': > 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=835987 > (Sat Dec 27 11:37:30 > 2014)\nhost-id=1\nscore=2400\nmaintenance=False\nstate=EngineUp\n', > 'hostname': '10.0.0.94', 'alive': True, 'host-id': 1, 'engine-status': > {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'score': 2400, > 'maintenance': False, 'host-ts': 835987} > MainThread::INFO::2014-12-27 > 08:37:04,028::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) > Host 10.0.0.92 (id 3): {'extra': > 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=681528 > (Sat Dec 27 08:37:41 > 2014)\nhost-id=3\nscore=0\nmaintenance=True\nstate=LocalMaintenance\n', > 'hostname': '10.0.0.92', 'alive': True, 'host-id': 3, 'engine-status': > {'reason': 'vm not running on this host', 'health': 'bad', 'vm': > 'down', 'detail': 'unknown'}, 'score': 0, 'maintenance': True, > 'host-ts': 681528} > MainThread::INFO::2014-12-27 > 08:37:04,028::state_machine::168::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) > Local (id 2): {'engine-health': {'reason': 'vm not running on this > host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': > True, 'mem-free': 15300.0, 'maintenance': False, 'cpu-load': 0.0215, > 'gateway': True} > MainThread::INFO::2014-12-27 > 08:37:04,265::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-27 > 08:37:04,265::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > > Thanks, > Cong > > On 2014/12/22, at 5:29, "Simone Tiraboschi" > <stirabos(a)redhat.com<mailto:stirabos@redhat.com><mailto:stirabos@redhat.com><mailto:stirabos@redhat.com>> > wrote: > > > > ----- Original Message ----- > From: "Cong Yue" > <Cong_Yue(a)alliedtelesis.com<mailto:Cong_Yue@alliedtelesis.com><mailto:Cong_Yue@alliedtelesis.com><mailto:Cong_Yue@alliedtelesis.com>> > To: "Simone Tiraboschi" > <stirabos(a)redhat.com<mailto:stirabos@redhat.com><mailto:stirabos@redhat.com><mailto:stirabos@redhat.com>> > Cc: > users(a)ovirt.org<mailto:users@ovirt.org><mailto:users@ovirt.org><mailto:users@ovirt.org> > Sent: Friday, December 19, 2014 7:22:10 PM > Subject: RE: [ovirt-users] VM failover with ovirt3.5 > > Thanks for the information. This is the log for my three ovirt nodes. > From the output of hosted-engine --vm-status, it shows the engine state for > my 2nd and 3rd ovirt node is DOWN. > Is this the reason why VM failover not work in my environment? > > No, they looks ok: you can run the engine VM on single host at a time. > > How can I make > also engine works for my 2nd and 3rd ovit nodes? > > If you put the host 1 in local maintenance mode ( hosted-engine > --set-maintenance --mode=local ) the VM should migrate to host 2; if you > reactivate host 1 ( hosted-engine --set-maintenance --mode=none ) and put > host 2 in local maintenance mode the VM should migrate again. > > Can you please try that and post the logs if something is going bad? > > > -- > --== Host 1 status ==-- > > Status up-to-date : True > Hostname : 10.0.0.94 > Host ID : 1 > Engine status : {"health": "good", "vm": "up", > "detail": "up"} > Score : 2400 > Local maintenance : False > Host timestamp : 150475 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=150475 (Fri Dec 19 13:12:18 2014) > host-id=1 > score=2400 > maintenance=False > state=EngineUp > > > --== Host 2 status ==-- > > Status up-to-date : True > Hostname : 10.0.0.93 > Host ID : 2 > Engine status : {"reason": "vm not running on > this host", "health": "bad", "vm": "down", "detail": "unknown"} > Score : 2400 > Local maintenance : False > Host timestamp : 1572 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=1572 (Fri Dec 19 10:12:18 2014) > host-id=2 > score=2400 > maintenance=False > state=EngineDown > > > --== Host 3 status ==-- > > Status up-to-date : False > Hostname : 10.0.0.92 > Host ID : 3 > Engine status : unknown stale-data > Score : 2400 > Local maintenance : False > Host timestamp : 987 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=987 (Fri Dec 19 10:09:58 2014) > host-id=3 > score=2400 > maintenance=False > state=EngineDown > > -- > And the /var/log/ovirt-hosted-engine-ha/agent.log for three ovirt nodes are > as follows: > -- > 10.0.0.94(hosted-engine-1) > --- > MainThread::INFO::2014-12-19 > 13:09:33,716::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:09:33,716::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:09:44,017::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:09:44,017::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:09:54,303::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:09:54,303::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:10:04,342::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) > Engine vm running on localhost > MainThread::INFO::2014-12-19 > 13:10:04,617::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:10:04,617::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:10:14,657::state_machine::160::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) > Global metadata: {'maintenance': False} > MainThread::INFO::2014-12-19 > 13:10:14,657::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) > Host 10.0.0.93 (id 2): {'extra': > 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1448 > (Fri Dec 19 10:10:14 > 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineDown\n', > 'hostname': '10.0.0.93', 'alive': True, 'host-id': 2, 'engine-status': > {'reason': 'vm not running on this host', 'health': 'bad', 'vm': > 'down', 'detail': 'unknown'}, 'score': 2400, 'maintenance': False, > 'host-ts': 1448} > MainThread::INFO::2014-12-19 > 13:10:14,657::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) > Host 10.0.0.92 (id 3): {'extra': > 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=987 > (Fri Dec 19 10:09:58 > 2014)\nhost-id=3\nscore=2400\nmaintenance=False\nstate=EngineDown\n', > 'hostname': '10.0.0.92', 'alive': True, 'host-id': 3, 'engine-status': > {'reason': 'vm not running on this host', 'health': 'bad', 'vm': > 'down', 'detail': 'unknown'}, 'score': 2400, 'maintenance': False, > 'host-ts': 987} > MainThread::INFO::2014-12-19 > 13:10:14,658::state_machine::168::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) > Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up', > 'detail': 'up'}, 'bridge': True, 'mem-free': 1079.0, 'maintenance': > False, 'cpu-load': 0.0269, 'gateway': True} > MainThread::INFO::2014-12-19 > 13:10:14,904::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:10:14,904::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:10:25,210::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:10:25,210::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:10:35,499::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:10:35,499::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:10:45,784::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:10:45,785::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:10:56,070::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:10:56,070::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:11:06,109::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) > Engine vm running on localhost > MainThread::INFO::2014-12-19 > 13:11:06,359::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:11:06,359::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:11:16,658::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:11:16,658::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:11:26,991::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:11:26,991::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > MainThread::INFO::2014-12-19 > 13:11:37,341::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineUp (score: 2400) > MainThread::INFO::2014-12-19 > 13:11:37,341::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.93 (id: 2, score: 2400) > ---- > > 10.0.0.93 (hosted-engine-2) > MainThread::INFO::2014-12-19 > 10:12:18,339::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-19 > 10:12:18,339::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-19 > 10:12:28,651::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-19 > 10:12:28,652::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-19 > 10:12:39,010::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-19 > 10:12:39,010::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-19 > 10:12:49,338::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-19 > 10:12:49,338::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-19 > 10:12:59,642::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-19 > 10:12:59,642::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > MainThread::INFO::2014-12-19 > 10:13:10,010::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Current state EngineDown (score: 2400) > MainThread::INFO::2014-12-19 > 10:13:10,010::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) > Best remote host 10.0.0.94 (id: 1, score: 2400) > > > 10.0.0.92(hosted-engine-3) > same as 10.0.0.93 > -- > > -----Original Message----- > From: Simone Tiraboschi [mailto:stirabos@redhat.com] > Sent: Friday, December 19, 2014 12:28 AM > To: Yue, Cong > Cc: > users(a)ovirt.org<mailto:users@ovirt.org><mailto:users@ovirt.org><mailto:users@ovirt.org> > Subject: Re: [ovirt-users] VM failover with ovirt3.5 > > > > ----- Original Message ----- > From: "Cong Yue" > <Cong_Yue(a)alliedtelesis.com<mailto:Cong_Yue@alliedtelesis.com><mailto:Cong_Yue@alliedtelesis.com><mailto:Cong_Yue@alliedtelesis.com>> > To: > users(a)ovirt.org<mailto:users@ovirt.org><mailto:users@ovirt.org><mailto:users@ovirt.org> > Sent: Friday, December 19, 2014 2:14:33 AM > Subject: [ovirt-users] VM failover with ovirt3.5 > > > > Hi > > > > In my environment, I have 3 ovirt nodes as one cluster. And on top of > host-1, there is one vm to host ovirt engine. > > Also I have one external storage for the cluster to use as data domain > of engine and data. > > I confirmed live migration works well in my environment. > > But it seems very buggy for VM failover if I try to force to shut down > one ovirt node. Sometimes the VM in the node which is shutdown can > migrate to other host, but it take more than several minutes. > > Sometimes, it can not migrate at all. Sometimes, only when the host is > back, the VM is beginning to move. > > Can you please check or share the logs under > /var/log/ovirt-hosted-engine-ha/ > ? > > Is there some documentation to explain how VM failover is working? And > is there some bugs reported related with this? > > http://www.ovirt.org/Features/Self_Hosted_Engine#Agent_State_Diagram > > Thanks in advance, > > Cong > > > > > This e-mail message is for the sole use of the intended recipient(s) > and may contain confidential and privileged information. Any > unauthorized review, use, disclosure or distribution is prohibited. If > you are not the intended recipient, please contact the sender by reply > e-mail and destroy all copies of the original message. If you are the > intended recipient, please be advised that the content of this message > is subject to access, review and disclosure by the sender's e-mail System > Administrator. > > _______________________________________________ > Users mailing list > Users(a)ovirt.org<mailto:Users@ovirt.org><mailto:Users@ovirt.org><mailto:Users@ovirt.org> > http://lists.ovirt.org/mailman/listinfo/users > > This e-mail message is for the sole use of the intended recipient(s) and may > contain confidential and privileged information. Any unauthorized review, > use, disclosure or distribution is prohibited. If you are not the intended > recipient, please contact the sender by reply e-mail and destroy all copies > of the original message. If you are the intended recipient, please be > advised that the content of this message is subject to access, review and > disclosure by the sender's e-mail System Administrator. > > > This e-mail message is for the sole use of the intended recipient(s) and may > contain confidential and privileged information. Any unauthorized review, > use, disclosure or distribution is prohibited. If you are not the intended > recipient, please contact the sender by reply e-mail and destroy all copies > of the original message. If you are the intended recipient, please be > advised that the content of this message is subject to access, review and > disclosure by the sender's e-mail System Administrator. > _______________________________________________ > Users mailing list > Users(a)ovirt.org<mailto:Users@ovirt.org><mailto:Users@ovirt.org><mailto:Users@ovirt.org> > http://lists.ovirt.org/mailman/listinfo/users > > ________________________________ > This e-mail message is for the sole use of the intended recipient(s) and may > contain confidential and privileged information. Any unauthorized review, > use, disclosure or distribution is prohibited. If you are not the intended > recipient, please contact the sender by reply e-mail and destroy all copies > of the original message. If you are the intended recipient, please be > advised that the content of this message is subject to access, review and > disclosure by the sender's e-mail System Administrator. > > ________________________________ > This e-mail message is for the sole use of the intended recipient(s) and may > contain confidential and privileged information. Any unauthorized review, > use, disclosure or distribution is prohibited. If you are not the intended > recipient, please contact the sender by reply e-mail and destroy all copies > of the original message. If you are the intended recipient, please be > advised that the content of this message is subject to access, review and > disclosure by the sender's e-mail System Administrator. > > ________________________________ > This e-mail message is for the sole use of the intended recipient(s) and may > contain confidential and privileged information. Any unauthorized review, > use, disclosure or distribution is prohibited. If you are not the intended > recipient, please contact the sender by reply e-mail and destroy all copies > of the original message. If you are the intended recipient, please be > advised that the content of this message is subject to access, review and > disclosure by the sender's e-mail System Administrator. > > > ________________________________ > This e-mail message is for the sole use of the intended recipient(s) and may > contain confidential and privileged information. Any unauthorized review, > use, disclosure or distribution is prohibited. If you are not the intended > recipient, please contact the sender by reply e-mail and destroy all copies > of the original message. If you are the intended recipient, please be > advised that the content of this message is subject to access, review and > disclosure by the sender's e-mail System Administrator.

4 11

Recovering from an aborted hosted-engine --deploy
by Michael Schefczyk 11 Jan '15

11 Jan '15

Dear All, after a failing hosted-engine --deploy, I am trying to recover the system based on the following description: http://lists.ovirt.org/pipermail/users/2014-May/024423.html Whatever I do, however, I receive the following message during the next hosted-engine --deploy: [ ERROR ] Failed to execute stage 'Environment setup': Failed to reconfigure libvirt for VDSM Is there a way to initiate such reconfiguration without completely installing the server from scratch?? Thank you very much for any efforts, Michael

2 1

Community ads on StackOverflow, 1st half 2015
by Brian Proffitt 10 Jan '15

10 Jan '15

We have a new community ad set to go for the next StackOverflow campaign for the first half of the year. Allon Mureinik has posted it at: http://meta.stackoverflow.com/a/283016/2422776 Now we just need some upvotes there to have the ad approved. The current threshold is +6. If you are a member of the StackOverflow network, we could use the support! Thanks! BKP -- Brian Proffitt Community Liaison oVirt Open Source and Standards, Red Hat - http://community.redhat.com Phone: +1 574 383 9BKP IRC: bkp @ OFTC

2 1

Problems starting VM
by Jeremy Utley 09 Jan '15

09 Jan '15

Hello everyone! We have been working on our testing OVirt cluster today again, for the first time in a few weeks, and all of the sudden a new problem has cropped up. VM's that I created weeks ago and had working properly are now no longer starting. When we try to start one of them, we get this error in the engine console: VM CentOS1 is down with error. Exit message: Bad volume specification {'index': 0, 'iface': 'virtio', 'type': 'disk', 'format': 'raw', 'bootOrder': '1', 'volumeID': 'a737621e-6e66-4cd9-9014-67f7aaa184fb', 'apparentsize': '53687091200', 'imageID': '702440a9-cd53-4300-8369-28123e8a095e', 'specParams': {}, 'readonly': 'false', 'domainID': 'fa2f828c-f98a-4a17-99fb-1ec1f46d018c', 'reqsize': '0', 'deviceId': '702440a9-cd53-4300-8369-28123e8a095e', 'truesize': '53687091200', 'poolID': 'a0781e2b-6242-4043-86c2-cd6694688ed2', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}. Looking at the VDSM log files, I think I've found what's actually triggering this up, but I honestly do not know how to decipher it - here's the message: Thread-418::ERROR::2015-01-09 15:59:57,874::task::863::Storage.TaskManager.Task::(_setError) Task=`11a740b7-4391-47ab-8575-919bd1e0c3fb`::Unexpected error Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 870, in _run return fn(*args, **kargs) File "/usr/share/vdsm/logUtils.py", line 49, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 3242, in prepareImage leafInfo = dom.produceVolume(imgUUID, leafUUID).getVmVolumeInfo() File "/usr/share/vdsm/storage/glusterVolume.py", line 35, in getVmVolumeInfo volTrans = VOLUME_TRANS_MAP[volInfo[volname]['transportType'][0]] KeyError: u'_gf-os' This is Ovirt 3.5, with a 2-node gluster as the storage domain (no ovirt stuff running there) , and 5 virtualization nodes, all machines running CentOS 6.6 installs. We also have the patched RPMs that *should* enable libgfapi access to gluster, but I can't confirm those are working properly. The gluster filesystem is mounted on the virtualization node: gf-os01-ib:/gf-os on /rhev/data-center/mnt/glusterSD/gf-os01-ib:_gf-os type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072) Anyone got any ideas? More logs available upon request.

1 0

Problems after upgrade to 3.5
by Alexandr Krivulya 09 Jan '15

09 Jan '15

This is a multi-part message in MIME format. --------------080707060003080807040003 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hello! Recently I have upgraded my installation to 3.5. Everything works fine except of two things: 1. I cannot use REST API any more - "Internal server error 500" with java exception. May be I missing something? 2. Cannot import VM from Export domain to Local Storage - "VM already exists" error, but there are no any vms or disks on local storage. --------------080707060003080807040003 Content-Type: multipart/related; boundary="------------050805050704010707040600" --------------050805050704010707040600 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> Hello!<br> Recently I have upgraded my installation to 3.5. Everything works fine except of two things:<br> <br> 1. I cannot use REST API any more - "Internal server error 500" with java exception. May be I missing something?<br> 2. Cannot import VM from Export domain to Local Storage - "VM already exists" error, but there are no any vms or disks on local storage.<br> <br> <img src="cid:part1.02090405.00060307@shurik.kiev.ua" alt=""><br> </body> </html> --------------050805050704010707040600 Content-Type: image/png; name="dfdiaadb.png" Content-Transfer-Encoding: base64 Content-ID: <part1.02090405.00060307(a)shurik.kiev.ua> Content-Disposition: inline; filename="dfdiaadb.png" iVBORw0KGgoAAAANSUhEUgAAA94AAAI6CAIAAABerQdcAAAAA3NCSVQICAjb4U/gAAAACXBI WXMAAA7EAAAOxAGVKw4bAAAgAElEQVR4nOzdfVRUd57v+2/xEKJoklaBBlqxDSQDw9gxhKMB +iHtTTcgZUzOXI12zkpGQ5F1yLSQtpl7bLuH22PnTtN2kO5wVyjUm6yVgHpmEkOpcLqX1/Qc JDocYrdh9CrESAyUBUoexAeiWPePXQ+7qnYVxWNt4P1as9ZU7Yff/u696fCpn9/aGB5//PGb N2+KiIiEh4d/5zvfSUlJmTNnTnh4uAAAAAAYb0NDQwMDAx0dHf/2b/82NDSkLLx1+7bh29/+ tvImNzf3r//6r0nkAAAAwOQYGhr6j//4j6amJuWt4dvf/nZ0dPRzzz0XHR2tLLLb7YODg59+ +unHH3985swZ15w6AAAAgFG7++67U1NTv/nNb37jG9+IiooyGAzK8mvXrr3++uvXrl0z5Obm FhUVRUREiIjdbrfZbG+++eadO3dCWjYAAAAwnYWFhT3zzDNxcXFKQL99+3ZNTY1h3759s2fP FpGvvvrqyJEjH374YajrBAAAAGaEv/mbv1m5cuVdd90lItevXw9z5fJ9+/aRywEAAIBJ8+GH H+7bt++rr74SkdmzZ4eJiN1uP3LkiNVqDXVtAAAAwMxitVqPHDlit9tFJExEbDYb8+UAAABA SHz44Yc2m01Ewux2+5tvvhnqegAAAICZ680337Tb7RE3b97keSwAAADAuJg7d+7cuXNnzZo1 a9YsEblx48aNGzeuXr169erVAHvduXPn5s2bEd3d3ZNVJwAAADBtRUZGLliwYP78+Tab7fPP Px8cHBSRqKio6OjopKSkK1euXL58+datW/527+7uDk9KSrp8+XLAo6Q9WfZ3q7NjPzv2//WN 9wkMK+3JspwwrwPHfvf54nX/m2dBSo2pER0fRP9guGq1xhxRRZrjO6rKzs5Ojej4oOtaoKUj oAygeTrjc19iv/t88bqHAxU3/BYAAAAzXWRk5Ne//vVbt251dXVdu3bt1q1bdrvdbrffunXr +vXrly9fnjVr1n333Xfjxo0AHSthH3/88WQWPSJpT5YVpPgu7j3T0S8iKQ+mubd8MEVE+jvO 9MrpdyoqKireOT2yMcdLf3+/zEtJjXW8jU1NmTdhxxrmTIOTlr18nnS0/KnX/ya9f2rpkHnL s9P8bwIAADDDLViwYHBwsLe3VzN537lzp7e3d3BwcMGCBf5G+PjjjyNu3rw5gmMqwbbjxIn5 y5fPE5GOgxXvXP7u88+53pwWkdjvPv/c8nkdBw9KgSMFO9eIuFYrr/tPvL7LkQqVxf0dHZLi GWdTCsrKHlQPIL1nOvqXL5+X8mCanD4t4kzmSsB0lHiw4p3Tw4952VGqY/S0J8sKUlw1eaR4 VaUBXbnSPy9l3gKRXhGRBfPmiffh/Q6rvjAeV8xzpWe1Hmca1DVXr4j9blaKSMfZ0xrbqTY8 fbajICUl67uxp4O5BAAAADPM3Llz58+ff/q0I1NlZma2tra61rreXr58OS0tbWBgQLPv/ObN m2GjOXjKcmd8SykoK3vO/eZJ1cRqSoE7gKYUPP9dZSI57Un39iIyb/lzZeqdZJ4jxPZ3dPT7 L8Axbz4/Rhk0Nma+qAOml+DG9Jb2pMfs+rzlq78b63djt/6zHf2uCf20B1NErvSrj+pvWI9Q LJJSUOZ5Md0rPS+zB89r7tzM65qnFJQ574Yyqd/ff9m5oXo71V2T02c7RP2vAQAAAHCbO3eu zWZT5sszMzPnzJmTmZmprFK/vXPnjs1mmzt3rr9xIkZ19I6DFe+cdobJjoMV75xWZnDnx8Q6 povFPSGc9mRZQcq85dlpf3rn8nezUlRrlFVes7GqSV31tLAn57x5auyfenuVgOk3mQcaM0DU PP1OhWtA5RRcc+EBXe674vjQ0BsbM1+k4+wZyVo+3LCOzhdHXcp1cf2jgLgumXLNPS6zB8dm 6ruhTIy7Z+djv/v8c8uXZ6f96Z3TsmDePEcbkIjzE472Pw9c7u8XCfIKAAAAzDCzZs36/PPP ldetra3qOD5nzpyBgQHXJPq1a9fi4+P9jTOqaK6k4N6+KyLzHG+U6OaxkbN/+fSxE1kpjjw5 b556jXOVKvH1nzgWVO90759aOpYXpKSkxv5JhkvmwY6pZRSt6afPdhQUuArr79D6jq3PsEpI dhaqzu8i4o7Pjmvuj3MzpQFFNbLMW/5c2XLVlso/OMTMV++tDO7e0vczkf/PBAAAADPYrFmz lOexKJR0vnDhQhG5ePGiurllcHBQeaiiptHNmqu4uiEmmxI/U1LTJGXemNK3Nq8Gk5G43N8v KfMWKI3mJ870SmqQw/qflb7SF1QgDnIzf06/83rM8+rOmbLnYxxT6MN8JgAAAMDYjTma++Xq U0nLXj5PlNiozK27O1iUVaNM90o2X16wXJQAPIZSldYRpfVD4ejCVreRBD2c0m3z4JOS4ijM Hc39Duu4Mo4eFsfXV0+8vutPYzgt9ciabSq+7Ty9f9pV4TikZxNPrOcEOwAAANxu3LgRFRV1 /fp15a3S0HLx4kURUTpbXBPnUVFRN27c8DfOxEVzzx4Kx7S20obi2V0R+Ml9Wk9ocXC1bbi6 pYPmGlOZDE4pKCsr8NjAu7ljRHr7roikpKSIdPT1eiRgv8M6m+dVhSjXZcxfvHS0/ngeUknq XlPhGp9AvNqExjgrDwAAMD3duHEjOjpaieZKLnf1l7v6zpW30dHRAaL5qJ7QEpSOgwc7HC9V U7an36l4/YT7iSX9J14P8GDu08ecmzqfxeK1/myHyAiTudeYp99xVamu2GNF/4nXXz/R7/kg 9WEOohSm0QDvd9jeP+2qUB2+/8TrY3xgufqY6pHVt8PzwSu9f9qlvjceNSi98KFqXgIAANC1 q1evxsXFhYWFiUhra6v6e5/qt2FhYXFxcZpPTlQYvv3tb493bbGeDwuHjqU9WVaQMvyt8nzg OwAAALzEx8cPDQ319gYKS7GxseHh4Var1d8GEzdrjqng9NmOIP45IO3BlOEbjwAAAGawy5cv R0VFxcbGKnPnXsLCwmJjY6Oioi5fDtSFQDSf4U4fO9EvKVmB/pxS7HezUibgGTgAAADTyK1b ty5duhQeHp6WlhYTEzN79uzw8PDw8PDZs2fHxMSkpaWFh4dfunTp1q1bAQaZiIYWAAAAYIaa O3fu3LlzZ82apTy//MaNGzdu3Lh69WqAFnOXCXxCCwAAADDTBJnCNdHQAgAAAOgC0RwAAADQ BaI5AAAAoAsGi8US6hoAAAAAMGsOAAAA6EOEiJzv5k/JAAAAAKG0JDE2wvUqtKUAAAAAM5Yy V05DCwAAAKALRHMAAABAF4jmAAAAgC4QzQEAAABdIJoDAAAAuhAR6gKA6aa+vj7UJQBBWb9+ fahLAAB4IJoD44/Eg0m2a9euke4SHR09EZUAAMaCaA4A08HGjRuD33jPnj0TVwkAYNSI5gAw TQwODgazWVRU1ERXAgAYHT/RvO/IjpcPdqsWJBZs3bIyJsBA7XWlu1uD2M7jELbcyg3pw23k riNz0zCbT7SRX5bRHmXYKwMAAIDpJsCsuToIt9eVvrxDAsTQ9lOto42p/pNoe93LBxM2VW5J d21XWrepckN6SMPriC7LqMSs3FI5nuMBmCHsdnuoSwAAjEmQD09M37Aps/vgH9v9re+z9UhC 3DhPH7efak0seNwVv2NWPluQ2HrKbw0hMNxlAYBJZA9OqMsEAPgVdK95+tJMabL1SXqMuLpX HFPIzjaP3aWtmZsqN4hzpXO9xyS394R3e51j3x6fSfe4uMTug39sX+na1jGd7LOLu88k0b3k DVuCtLZ2Z26q3JDe7lOSqPbKLCjoOeisyfPURnRZfMtQznZZQc9B5UCbKh+3OQ/qHN63Ntcl 8tx7QppnMOGsDWWm2qRyS3GGemlbtbG8q9Bckfi2sbxJcj1XWxvKTLVncr338Vh/cZ2/tSJt 1cbjK/yvHoW2auO+heaK1fFKaSKirtm9MLXQXLE6XnNPrWHdO3rt3FZtLG9Sb+k7sOcAftaP A7+HcNcYkksx3A8BAGBqCv5roHFxid02m0hM35Edu2VTZaWSIXcc2bpl5Zat4gzc7XVKQE9X QmfTkcfTVwYaNn3D1oIe7e6UmJVbNtlKd5cqwdUdlb12UbW9tNeVvlwXpyzvblWKFGmv2+1T Uox7r74jO15ulUwREY1TGy4Luy6LnzJEWk/K1srKGGmvK91d2lOwtbIypu/IjpedZfjW5jG+ em/1xxRMFfGr1+XWlh9vK85Qhai2402phebV8dImIiJNHqvb3q6V1NTRH9Ha3SWyYvT7+2ir Lpdyy+p4aas2NeeYLRXxIm3VxrIGc4WysDap3FKRIdJWbTRVJ6riYlt1eZOkFvoZ1VjeVaiM 5nhvMl50pVyPaOszsONMW5sDfIIZF34OYW0oK+8qNFtWx4tYG8qM1WIpzpjcS7G6orzaWN3m WdqdO3fG68wBACEx8r8G2nfqZHfm0nQRkZiVuZndJ0/1qVenb6h0ReilmWMtL31DpWJTZuvu 0tLS0jqf5pE+W4846pH0pZnSY3PUkxgX578kVbNMzMrczKBOLSC/ZUhmrpLv4+ISna9jli5T Av3wlytx2VLX3piaMp4qTG063uZeYG3Y15Sak+kIW6mFhblN+xqszrVtx5tyc3KCG7qt2ljd 0FBmNBqNRmN1m7LIVHtGmsqNZQ1W1fqyBqtIW7XRocx5PI0RvFgb9nUVPpWhVOYqO2Fh6pmL PaJ8EMhdocTDjBW50tXtPpPqfQvLC7U/ZLRVlzfllqunkDOKzV7Xyc1rYEddZY4zNRqr27zO 1Oo8JfeZ+lnodTk9NvA8hPrYrc1nctc5io/PzFHqnuxLkfFUYdc+7TORDVo0twQA6Erws+Y2 W7cr7LY6p7JFJLHAa0OPx5j4rB2l9A2VlRtck83+6nLNYceJqHvffUrqs/UoGzn3EpvjdcBT 0+A8vGYZwbSfDHO5xr2DH5MvPjMntdY9Ma7kugp3EstckVu7r9W6enW8KMl8hVm6aoMcvKlZ zBZLvLRVG8urV1iKM4rNhV3OVoc293qxNpSVS7nFkiGinvTWGMFjfGtrs+SUxouIZBRbMtxL z6TmJHidXNvxJkkqV07M2lC2b2FpRUJrs1bV1u6u1MJSr6no+NUVFu2TbDvelJpjjvfe2iyu po62aveZSlu10Tl7bW0oc8xeq6a03QvVJWldH/UhAurqtkrGZF+K+MwcMb3dttpdnauP/K23 3vrRj36k3vGtt96iyxwA9C/oaN5+qlUSNsWI9IlGH7ZrdrnvyI6XTy7bWrnF0ZLe5D1O8Nrr SneLx4Fili5LPOhM3k4eMdgjIAcoKSYuQbWFzeZ+IOIIH9DouiwyXBmaxvFyQcfiM3NSa/c1 PJWxOl6k7e3aM7nlHlEsY0VuuZLNrQ37ugpLi6V1X7BjO+exM1bkyvEA65UPBM7Duo443AjW 1uYzSevUodjR/JxbblHmeeNXr8s1lhubRCTV0eIhYm2obM4prYgX7Tld6bl4RhZ6Dymiat44 U2syuj+epBaai4drJXfN6CvtQsqpxq9el2s83lacIVoL1Q3+fq+PBp8bKqk5obgU8YlJ0txt lQzngmvXrrk2NJvNJpPJ9Vq9as6cOdrFAABCLciGlva63c4GkJily1zPSek7ssOrxcRm63ZO 9LbXOb/eGBOXII5d+k6dVD8X3Mnd/uGW/nhBYuvuHUdUsf+Ng+J6ZItzF9XgSlD2nmbWLCl9 qevRKn1Hmpx1Bjy1YS7LcGVo0qwN00/86nW5Z5pbreLIjU95TZJmPFUotW+3KVPUmcNlUA9J iUFvnrrQ/Yk0YaGruyLgCD0Xz6h3E5GMYovFYrGsOK40ebRVG8ul3GKxWCyWUqk0ljVYHWk0 +K9lOoa0lOeqii00W9zWXTRpt9tosHZ3yZlak7M3pbxJurqtmgu9dvRzfbTEr64oT3IMd3yF o+4QXApXX5GD15NYampqRKSmpoYntADAVBFg1lzd2iGZrseLS8zKLZvqSktLRZSnhnjMMac/ XpD4srJjYsGmgsTdNptIjHtpYkFBpqt5xDHe0mWJBw++XGrznq+OWbmlMq6u9OXSg44FrmeU eOySvmFrwY6X/dTjvyT3XpmZmSJxccOd2jCXZbgyNGnWFsx0O6YaxzRspuxryl1n8UlqSltI w8IupXnEzwTrGJ252CPiOLTnXG1QrA1lpuYc5zcSM1bkyr5uq1W6xDXZHL96XW7tvtY2aT5z 5oxqptdkbPZ6XknGitzyco9WjMAynipMNXnNcwfi881Na4PGQi8juz4ZxRZLsWPsstScp+Kt raG/FL6x+7XXXiOLA8AU4ieax6zcUhngwSrpGyorPb5S5P4rOZ57rtRaujLgLsMcSWsX3wE8 /mqPdkmqxe11ra55Jz8HHL5SzbXqOjRfa9amXql5RpiCMp4q3Ff59tui6ppQi8/MSa2trU0t NI9ozjx4ng3vro7lnmF2c07LxrvSprsnPjXHHB/fkySu1g5Hh3XG6gqLsxPE2lBWKaW+TwzM KC7PNZYbRZ2Wrd1d4icPe7abBHGmrq5552MqNReqyvJzffx8SHJMkBdniFgbKmslxxwv8Ykh uRQe/6jBE1oAYKoL/mug04ujyXvLyhh1vzgwceIzc6S2Vpz9zj6rV6/LrT2+Yhwezq1EU2NT brlF/QjF+NUV5oYyo7FcZATPAY/PzEl1dTNnFJu7y5xTwI5m8/hiS3m1UbUw6NnfYotlRbXR aHQtSVU9P9CrwVpSC80VwT4j0fEFUcfIzlPVXOi1V9DXJ6PYXOgazNl2nzHpl8LnmwBMkAPA VGewWCznu3uXJMaGupLJpnoyCn/MB+Opvr5+/fr1oa5i3Pib7EXIqW/Nrl27Nm7c+MknnwSz 46JFi/bs2RMdHT2dflABYKpTAvlMnTUftmcHCD2fvwQpMqLZ2HERv3pdknEEvdCYLG1v1yZp fG8BADCVzdxoDuie+5uGIS6j/Lj7MejQBcdj2L0+L9FrDgBTHdEcwHBUf2wI+qD9R4kWL148 6ZUAAMYT0RwApoM9e/aEugQAwFgRzYHxV19fH+oSMLNER0eHugQAwDggmgPjjKdeAACA0QkL dQEAAAAARIjmAAAAgE4QzQEAAABdIJoDAAAAukA0BwAAAHSBaA4AAADoAtEcAAAA0AWeaw6M M/7eEKYKnsEPAHpDNAfGH4kHk2zXrl0j3YU/IAoAOkQ0B4DpYOPGjcFvvGfPnomrBAAwakRz AJgmBgcHg9ksKipqoisBAIxOwGjed2THywe7ldeZmyo3pDsX2nIdbwAAAACMD//RvL2udLds qqx05fHSuk2jDOSkeQCYeHa7PdQlAADGxN/DE9vrdrdmbnKF6ZiVzxYktjYd6ZusugAAI2QP TqjLBAD45Seat59qlcyl6lnumJVbKresjFEt6Tuyo7Su3fd1e12pw44jfSLSXvfywW5p3e14 q95CtfuOurodqiXAtGFtKDNWt/lf31YdcPUoTcSobdXGsgbrOA8KAABc/De0JMbFjWbA9rrd PQVbK1fGiLTXlb5xZOmWlRu2FvS4G1r6juxwNMr0Hdnx8o4jW5XA393q6p4BZhJrd5fIilBX gWnhzp07oS4BADAmE/GElm6bTSRGJH2DRtTuO3WyOzM3XUQkZmVu5sGmU30rV4qM+qMAMHW0 VRuPLyzsqq09IyK55ZbiDGmrNtWeESk3dhWaKxLfdq5PLTRXrO6pNpY3iYhIaqG5YnW89ggj LsF7TI+lrsXWhjJT7Rnx2RRTwoYNG3wX1tXVTX4lAIAR8R/NnQF7hNI3VG6qKy0tFRHVY108 te4ubXW+TixwvEiIG/nBgKmmqVnMFku8tFUby6tXWIozis2FXaaL6yzFGSJt7vVibSgrl3KL JUPE0UniiMc+IwR/cO0x26qNHktN1YmWFcdNtUnllooMZVH5222rR/wpAJPP1Uf+1ltv/ehH P1Kveuutt+gyBwD98xPN05dmyu5T7RvS3cHa8cSWDcPPbadvqKzc4NijbqlGOPdJ7Hy7FDNF ak5mvIhIxopcOR5gvbW1+UzuOmcazliRW76v1bp6dRAj+Kc9ZuLxptRCs2tpscUiIpKh/L/R HQihcu3aNddrs9lsMplcr9Wr5syZM9mVAQCC4+8JLemPFyS27nZ9cbPvyI7drYkFj3t8MTQu QVpPtYsoXSquDd1f91TrsSkLY5YuS3Ts5fHlUWBGSEoMujEkdWGC63XCwtRRjBDsmNpDWhvK jEaj0ejqdYHueT2JpaamRkRqamp4QgsATBV+G1piVm6pjKsrfbn0oPJeozcl/fGCxJd3l7aK JBYUZIrNsdsmm3OvxIKtW9JFieMHD75cattUuSE9ZuUWV8eLcwMAPs5c7BFxZOaei2dk4YSN 2dVtlQyPdN5WbSzvKlRaa6St2sis+dTgG7tfe+01sjgATCEBvwbq7EzxELNyS6Xq5Urn8pUB 9vLYUGML1ZgARCQ+Mye19nhbcYbSAX68KTXHHC/SM/5jxq/ILXf3klsbykzNOeU5XZK7Tvnm p7VhX5Mk8QiZKYEntADAVDcRT2gBELz4zJzU2nJjU265RZ1/41dXmBvKjMZykdE+IqWp3Ohu RUktNFes1hwzo9hSXm00GlXbxUtirtGxd2phYa7U7mt4KmP1KM8Qk4YJcgCY6gwWi+V8d++S xNhQVwJME/X19evXrw91FZhZdu3atXHjxk8++SSYjRctWrRnz57o6Gh+UAFAP5RAzqw5MKWp HknuNponngMAgJAjmgNTWkaxxVIc6iKgE/SaA8BURzQHgGli8eLFoS4BADAmRHMAmA727NkT 6hIAAGNFNAfGX319fahLwMwSHR0d6hIAAOOAaA6MM556AQAARics1AUAAAAAECGaAwAAADpB NAcAAAB0gWgOAAAA6ALRHAAAANAFojkAAACgC0RzAAAAQBd4rjkwzvh7Q5gqeAY/AOgN0RwY fyQeTLJdu3aNdBf+gCgA6BDRHACmg40bNwa/8Z49eyauEgDAqBHNAWCaGBwcDGazqKioia4E ADA6AaN535EdLx/sVl5nbqrckO690CGxYOuWlTHKKluuYzvXCJ5LAo8QhPa60t2tqpo0DwEA AABMNf6jeXtd6W7ZVFnpyuOldc507s7pzi1f3iFbt6wcwXH9jDB8Om8/1TqCHA8AM4fdbg91 CQCAMfH38MT2ut2tmZtc6Tlm5bMFia1NR/q0tk1/vCCx22YbQxXBj9Bn65GEOHI5APiwByfU ZQIA/PIza95+qlUyN6l7RGJWbqlcKSKimc7HS9+RHW/YEqS1tdvVrKK0viQWbN2yUhxvd5e2 ZhYU9Bz07WNxdbt4zsoDIWRtKDNdXGcpzvCzvq3aeHyF/9WjNBGjtlUb9y00V6yOH89BAQCA i/8/OZQYFxfkGO1/PNiduXQsQVg9Qner5FZWVm5Il/a6lw8mbKqsrKys3JRw8OW69piVW7YW JErmpsrKDUt9R+k7smO3bKqsrKzcWtCze4f2FD+gM9burlCXgOniTnBCXSYAwK/RPaGldXdp q+ptYsHWLSNM5gFGcH4m6LP1SGausjR9aaY02fok0FH6Tp3sdmwfszI382DTqb6VtKRDT9qq jccXFnbV1p4RkdxyS3GGtFWbas+IlBu7Cs0ViW8716cWmitW91Qby5tERCS10DFXrTHCiEvw HtNjqWuxtaHMVHtGfDbFlLBhwwbfhXV1dZNfCQBgRPxH826bTcRPsh17u0iAEZyt5DZbt3vm Pi5OaUYfZiZfnfgTC8ZUITARmprFbLHES1u1sbx6haU4o9hc2OXsd2lzrxdrQ1m5lFssGSIi bdXGsgZHPPYZIfiDa4/ZVm30WGqqTrSsOG6qTSq3VGQoi8rfbls93h03mACuPvK33nrrRz/6 kXrVW2+9RZc5AOifn2ievjRTdp9q35Du8RSV3bKpckOAcBwTlyAnbX2S7kr0HvF6hJxpPGYE A9FiDp1LzcmMFxHJWJErxwOst7Y2n8ld50zDGStyy/e1WlevDmIE/7THTDzelFpodi0ttlhE RDKU/ze6AyFUrl275nptNptNJpPrtXrVnDlzJrsyAEBw/PWapz9ekNjq7tfuO7Jjd2tiwePD xN70pZndB99wNXm31+1uTVy2dJRNJTFxCdJ6ql0Z6VTrsA9miVm6LNG5fd+RHaV17aM7LjCB khKDbgxJXZjgep2wMHUUIwQ7pvaQ1oYyo9FoNLp6XaB7Xk9iqampEZGamhqe0AIAU4XfhpaY lVsq4+pKXy49qLwPbj46fUPlJtVOY3sCefqGrQU7Xi4tdY403OFjVm7ZVFca/PaArp252CPi yMw9F8/Iwgkbs6vbKhke6byt2ljeVai01khbtZFZ86nBN3a/9tprZHEAmEICfg00fUNlpc93 iWJWbqkc8U7BjuC1yvXERt8NfF8Ed3BgSojPzEmtPd5WnKF0gB9vSs0xx4v0jP+Y8Styy929 5NaGMlNzTnlOl+SuU775aW3Y1yRJK8Z6QpgMPH0FAKa60T2hBcB4ic/MSa0tNzblllvU+Td+ dYW5ocxoLBcZ7SNSmsqN7laU1EJzxWrNMTOKLeXVRqNRtV28JOYaHXunFhbmSu2+hqcyVo/y DDFpmCAHgKnOYLFYznf3LkmMDXUlwDRRX1+/fv36UFeBmWXXrl0bN2785JNPgtl40aJFe/bs iY6O5gcVAPRDCeTMmgNTmuqR5G6jeeI5AAAIOaI5MKVlFFssxaEuAjpBrzkATHVEcwCYJhYv XhzqEgAAY0I0B4DpYM+ePaEuAQAwVkRzYPzV19eHugTMLNHR0aEuAQAwDojmwDjjqRcAAGB0 wkJdAAAAAAARojkAAACgE0RzAAAAQBeI5gAAAIAuEM0BAAAAXSCaAwAAALpANAcAAAB0gWgO AAAA6ALRHB3JxSAAACAASURBVAAAANAFojkAAACgC0RzAAAAQBeI5gAAAIAuEM0BAAAAXSCa AwAAALpANAcAAAB0gWgOAAAA6EJEqAsAEEpXrlzp7u622Wxffvnl4OBgqMsBAIRMVFTUPffc ExcXl5iYOH/+/FCXM0MRzYEZymazffDBB1euXAl1IQAAXbhx48aNGzdsNtupU6fmz5//8MMP x8XFhbqoGYdoDsw4N2/efP/997u7u0NdCABAp65cufLHP/4xMTHx0Ucfvfvuu0NdzgxCNAdm ls8+++y99967du2a8jYiIuLpp5/OzMycN29eRAT/QQCAmev27dv9/f2tra179+69ffu2iHR3 dzc2Nn7ve9/72te+FurqZgqDxWI53927JDE21JUAmHCfffbZH/7wh1u3bilvTSbTd77zHRI5 AEDt9u3b//Zv/2Y2m5W3kZGRP/jBD0jnE00J5PxKBmaKGzduHD16VMnl9957b0VFxb333qus stvt165dO3v27F/+8peWlpaBgYGQVgoAmDxz5szJysr61re+9eCDD0ZHRxsMhoiIiO9///sZ GRllZWVffPHFrVu3jh49mpeXN2vWrFAXO/0xaw7MFEePHlX6y++7777f//73kZGRImK32z/+ +OOf//znQ0NDoS4QABBi4eHh//RP//TNb37TYDCIyK1bt/7+7//+888/F5HExMTHHnss1AVO Z0og57nmwIxgs9lc3/usqKhQcvnNmzdramq2bt1KLgcAiMjQ0NDWrVtrampu3rwpIpGRkRUV Fcoq5Um7Ia1uRiCaAzPCBx98oLwwmUz33HOPiNy8eXP79u3vvfdeKMsCAOjPe++9t337diWd 33PPPSaTSVnu+lWCiUM0B6a/gYEB5fnlERER3/nOd0TEbre//vrrnZ2doS4NAKBHnZ2dr7/+ ut1uFxHXAwOuXLnCl5EmGtEcmP4uXLigvPjhD3+o/Of1448/Zr4cABDAe++99/HHH4tIRETE D3/4Q2Wh6xcKJgjRHJj+rFar8uL73/++iNjt9p///OchrQgAMAX8/Oc/VybOlV8fovqFggnC wxOB6c/1IPN58+aJyMDAAN/7BIAZZd68efPnz587d+6cOXNEZGBg4OrVq1euXOnv7w+w19DQ 0MDAwNy5c5VfH6L6hYIJQjQHpr8vvvhCeREVFSUi586dC2k5AIDJExUVtXDhwoSEhAsXLths tuvXr4vI7Nmz77vvvvT09J6enosXLw4ODvrb/dy5cxkZGcqvD1H9QsEEIZoD05/yz5Eiojyn 9tixY8PtkfOTvS9mSuurT/+2eYJr0zz28hP+DqwU5tDz7j+8VN81poMlrX/l108kOAZ7O+HX rrMO9goErBYAQiwqKmrJkiXXr18/duyY+t9Lv/zyyy+//LK7u/sb3/jGkiVLzp8/7y+dHzt2 LCMjQ/n1IapfKJgg9JoDM85f/vKXUJfgl0f09l3nuTLhiV/v/UnOmA73t08kiLS++vTTT3uF /ObfPv3000Hkcr/VAoAOLFy48Pr1611dXZp9jENDQ11dXdevX1+4cKG/EfT8K2NaYtYcmHGu Xbs2gq0d08fvvpv4xBMJItL66tO/veica3bOKiuTz62vviovOrKqx3yze27aY6pbWdzT2iqZ mQnqY2a+uHfvcq8J66T1T2Wqd3eMmfnU+qRmZbyAR/Gtzb155ot79z717j+8dNH3tJ1FqMfW 2t27WgAIvXnz5iUkJLj+pXTVqlWHDh1yrXW9/fTTT7Ozs/v7+zX7zkf2KwNjxqw5gCBkPuEM ppkv7t37a/cb9ax15ovuOeTMF19ZnyQiIjk/cW8vGlPdCY5c3tPa2uO/gKSszASRnnernJPb XfVV7/ZI66uOBD7cUTxrG9lcuzqXi0jmi2OcqweASTF//vwLFy4o8+WrVq362te+tmrVKmWV +u3Q0NCFCxfmz58fylrhRDQHEIzWV59++ul/eLfH/ebVVhGRxIVJ7o163v2Hp592rkp44m9z 1JPdT7tXZT61Psl77Kdf+u1vX3IM2vqqTy/JwoQEkZ7WFlXXSVf9S86tgjiKY5276q569eEC NK0rnwocVTqGXp7juTtT5gD0Z+7cuZ9//rny+tChQ5999pkSx5Vc/tlnn7km0T///PO5c+eG rlK4Ec0BBKH1RLOIdF3sdr+52OM9yd36tiPfNv/Luz2iBOCFCQnqNY5VCQnutsaed/9lzLk2 iKM4Un3zidZRDe6qMqgmdADQgTlz5ijPY1Eo6TwtLS0tLU2dy0Xk+vXrykMVEXJEcwAj1NNz cfiNxtvFnh6RhMws1Tx40vpXgu8s6b44tke5qGM+AAAThGgOYLy4OkiUB59I98Uux9y6u7dE WTXydK9M2Cc8sdk5UNL6zU8kOFvax+somhyDL89xHPeVvXv3vuLRkQMAejQwMDB79mzXW6WP 5fTp06dPn1b3nYvI7NmzBwYGQlEjvPGEFgDjJuGJX+99wvnG0QJS/3brEy9meqxRdZ5o03rm SfNvX12+13sg11CjOUqwulpae554IiHzxb17X9Qamie0ANCnq1ev3nfffV9++aU4c7mrj8X1 NVDl7X333Xf16tUQlwsRYdYcwPhpffVVZyO36uGFzb91fX3UsSZAinV0qYvX90udAz39qrpT XD3UiI4yQu5vfDrHdgwdqFoACLUrV64sXrw4PDxcnI3mrv5y9dvw8PDFixdfuXIllLXCyWCx WM539y5JjA11JQAmSl1d3Z07d0Skvr7eYDA8/fTT430E57PDmToGAD1JTk6+detWV1egf0NM SkqKjIzs7Oz0t8HevXvtdvv69etFJCwsbMOGDeNfKESUQM6sOQAAwPR08eLF2bNnJyUlKXPn XsLDw5OSkmbPnn3xYgi+3g9NRHMAAIDpaXBw8Pz585GRkdnZ2YsWLbrnnnsiIiIiIiLuueee RYsWZWdnR0ZGnj9/fnBwMNSVwoGvgQIYu676l56uD3URAABfg4ODnZ2d/f398+fPT05OVp5f PjAwcPXq1fb29v7+/lAXCA9EcwAAgGmuv7+fFD4l0NACAAAA6ALRHAAAANAFojkAAACgC/Sa AzPO3r17Q10CAADQwKw5AAAAoAvMmgMz0cmzF0JdAgBgClj24OJQlzCzaEfz0tLSSa4DwMR5 6KGHfP8OHP+1BQAE5juPc+vWLVLieKmsrPRd6HfW/Cc/2Xr3vfdOZD0AJskfLP9y586dUFcB AJjyIiMjf/bLX4e6iungV7/4B83lgRpaZkXcNTHFePjsSt/X5sdMwoEQDNftmBL3ZWpVCwDA NBA4H/KrObBhLwtfAwUAAAB0gWgOAAAA6ALRHAAAANAFojkwM3VVZRsMRY1eSxuLDIaiRums yvZdNzqaQ3VWZRsMPodvLNJYOOrxx1D/OJ6+zg86sWU0FhmyqzrHZywHnVwlAJgwRHNgZkra vM0k5gNe4fiAWUxr8iR58zF7TZ7XHuOcirKysjwP33jAnJWVNS5ja9Y/XrtPSDpsLEopaRnn MaejENwaAJhURHNgpspb453Nncl8UqSvXZvVfs49p9p4wGxau3Zyjq0rnVXZBkN+u8k0Ph9L AABTGdEcmLG8s3njAXPWzp/miWr2sbMqO7uoKNtgMBgMKSUtYs5XWhTU05Pq10pPimK46csH Vq2V/Yec2bzxgNm0ZpVqteZQjk4Yn+GdGzsWqus3FFU5d1J1V7hG16oy0O7K9LbqOjiuj2t7 z0P5LUB9IbZ12O3HfprmU0NwF9J9oVQHdd01z2vnPVSA++V1appXTHN394YH3AtUO/mZ2vYe v7Mq2/MyGrKrOv38sCmbed4azSsDALpHNAdmLs9s3njAnLV2VbL3Ri1m2Wa32+32jp1ZYjps P7bZZxOnxqJ8s+mw3W632w+bxLx9mDyUrMrmjQfMHvP1mkM1FqWUpB92FNOe78p35vwDa5Qt zfm+oc+8X95Q1raU/KZRRKSzKjtfDjuHGSa2ee2eV+N1HRzXpyZPXd7h9JIUd3k+BXhehrw8 nyvq70x9NRblt+/scB70Wee5OKrq2OnqGuo8tF+UD16BL7KK+9Q0r5ife+Rc2JHWbhYRkbyf 7lT1LnUe2t/i808zGuMnbz7mumCNvymRnR2eP3m+J+51a/xcGQDQN6I5MIOpQ5OfZC6SlZYS 7HA1dmcjcN4a0/Dbu7O5dzLXHMo9q+/Vc+xcmpKm1RPiPCvXWlU4TN68zdTinrrX4rO7zwaO 69N5rt3VDpS3xiSubp1hR/Dh90w1tZzuUA5ao/rcpFSVvGqt4wZ3Htov3rd32PvlOjXNKzbM PUrevM2x0F2Fv2SufUfyajp2tucXFRXlt+98Q+MToeaJj2gDANAdvUVz6x9+uf75jcr/bfuD zf+GtkPbN65//ZTqxQQ7tcdR2Pb/YZ2QA9gObQ9+cNuh7XtOTkgZ2rTuy2Rd+ZGxHdq+cf3z ysU5ZR7mpwiq0OQ3mUv6A8GHGncbRr45uMPL/kOdvslca6jOc+1+hglcoeZac36wdQ57+s4N Ok63uD/FpKRlOXPhiC6giAQ6U195NfbDku/ZC6I6aPIqpaNfK5nLsPdLXbnWFQv2Hnl+QvCa uw8wviRv3mYym82mbb7B2t+JB78BgElyas/65zeaVXnh5OuO39QnX1eihTPS2P7Htuc3em08 srwx+rQ22cnKL11Fc+sffvnSfnmm/Hf1lZX1P3tC9v+3bYcDXtjb1+TGLY8XE+WU+XfN9//n X9T/7In7L+yrPvjJRB3nzk25fnPYrax/qHnzgsj16xNVhvfh/N+XCb/yo9PcesJ5cQYH5Kuh kBajb47Q1Fm1XTP/jEhnVXbK/rVKC4H9cBCz5iLJD6S37D/UeK7da2pea6jkB9LHVJ4HRyOG 3W63j9eEqjqNe+b0kRrhmebVOK+TRj9P8uZt6fsPNWol85HdL58rNpJ7lLx5m8l8oNHfJwTN 8UUcTSmH/bX0BDzxoDYAMBmWPvKYyNET78tt5f2p1maRR1OXXb0uIrJo4f3S1fPxdRGx/uXE R4uT7heRG184NxaRuFXbauvXJgWRN0af1iY5WQUSEeoCVE5Z9l+4/6ltq+4Vib5X5j6x3fxD uTYoXw3JXf9hfn7nUWWrnJL655b6GWDP+t81i4jI4md+9YtVcbZD2//bm9/Ieay5+aiILF73 yrYfxouI7X9s+9m+j7xHOzX8IW4PSWKBsyrroYqfvSk5j0nz0QsiklO2a+OysdYgIh9U//jd j0Q1oE9h1j/88qX9F0QuVPz44jO/+sdV4m+o8eLvvqh/fH2vnu3Q9v+mcX2Cuc5jt2jhJ6f+ IhnRqgID3hdZ/Mzab7y5v1lEdY8mp9TQS161Nqtk+7NZLaZtQTyapf1cp+QlKxGs5EBjTV6e dB7a3yLpIiIdp1skfVuyiNJxLFk7hx8wb40pPz+/JWtnh0de0xwqb40pP/83jZtr8ly58Njm EZ+w45SV4qWzKjvl9LYRP2nReR08hnVfE2k8YJb0w8kio2tw1jxTzUAbeK1jsPT8/BLvKywj uV+aV2y4e9RZtd0s4hwzb40p/0BVWrusfcO3VO070lmVnd++s6MmL3nVzuyU7CqPs/R74s5b E8SVATBJlmbmyNGuXuutW/ERkXLqfx0VeSw9TSIiRUTk4UdXvNvde0eS5FLPhcceXvPJhS7P 3ZVf2SX1z8X5iRaeVGnNeviXL70tz/zqF6vi5OTrGyuac8p2bVzmk8G8k1Wcn1QzTGwYJzqa NbdZPxGRIbtEzXKUFXa3zL1X7rp8aPvOo4v/9pXKyvrKwsead67f3aa1/ynz7z595pev1lcW PiYX3v/383JHRESab2X+/tX6ysLHLux7adf/ErEdqt330eKnXqmsrC9cLs3/euiTWyK2Q9t3 Hs0prnceYtuhTz0HX5qZIx+9+6v1//WNk46qwkRELtzKfOnV+m1P3C/N/2q5MLYaRETkk4T/ /Lvf1f/MNaDN99zjf/CLV55aJLK8rLJk1ezzfoea8Pvi+tnRKNKxxvv6DHudx0nCw49aPzx5 y3UpAt6Xnz1xv1x48/0Fr/zfryqfsy3/fnPyStWB5M3bTC0tvv2/vhuuWpvVUpKi9Abk/XRn ltKC8KysdUy4upcZtqcd3qmaQw4gb43J3Y3tXqo5lNJ7bDAYDIaUkvTDo05dyZuPOVsdUvav 7RhhLve4Dh5Fu8tTIqX/MYb7YzxBn2ny5mOH00tSAh40b41JNFtCgr9fWldsuHvk/sFwVmEu KUnX/qcZjfEbi1JKxNFinrx5m6lF9cVafyeuvjXBXBkAk2TZwzly8YMPbEMiYr30qcijmWki kUo0l4SvJ31y2SZ3bD2fLk6MtWsP4fpXeu9ooead1uIzlt/v+L1v6/lUmaq/4BucvJOVvwAQ KDaMHz3Nmvth+/P7F+QxU3Z8eJTMfjQzp/Zo16fWG3E+2y017Yo79H++uP6iiIhcssntxSIi K5Yuuy0yV9mx23rjWw//p8Vv7n/7pdK3Jaek/rVkuTGoHEIuVK9vdg7Wc1G+ipe7wl2jL3tu T316zfrXmiueb75/7f+1/QciIrLo618fEln8zUUin8iQfPXXpl3zRlnDHdeAYfJN54CfntQ6 96USESZiEImUuUu0hoqc1I9cfae0iozTuD6fnnz/wjDXeZzErsrv3XakZ5Hj7VLTrhi/9+Wb 31wk8lFCTPztMJl9t4h8YuuWns7JKlUP8mrs9hqPJcmbj9k9XzjfbNZ8s1ljmWxW9lSP4DO+ 4+i+yzWH8l7sPZRv2Zprtc9Za0zt3dVFeJ5dkOWJ5NXYvZNi8nBD+RPg9vk/msYxvO6XxiAa hxnmHm1WnUJKWlagp+Z7j6/+uVCtzfP8yfG6h54lBbzJACbT0kcek+b3P+xZtSj6g3+/cP9T zyyTSFcG/Xpswkcf9smdL7svfCNzgWGYobyj11DAtPbD/5yzr+KSTXq+eP/C4meeSZOI2drB yZWsrne8f8E3ACwWCRgbbt8/bpFaR9E8Ln6RyNFLvSKLNdbaRe662/HaIGK/471B3x+3/fJf ZO2v6n96wfzj2qMiMuTsMHb8i4my41D8D35R/72Bk2/8uKJ55/pmeezHe0xxIiL3P/Gz7d9b 4B5w6I6IZw57pKj+tf9y8v95seL949bv/SfHwnBVCu7947by/aOsYek1jQG1z92jc1prKI3r N3qB74vfIp03yOd0hr/O4+KvH17U5OwyC+K+3P/1WDGoyrhjn7xSgZmg89D+4JqmAExHSzNz 5OgHH1qXRb1/YfGjz8yXqCj3yvRlj5lPnvxW2NGch0z2nn8ddjDfpKTmkdYKlj2cI787dSjB 9tHih4vnh0tUZDDByScAXHW88BsbhsYtIeiooUWWGtculhNNhy7dEXF8S3fbH2wS99Cji+Vo 03tWEeWrA/dnpGv09PRaPxJZdO9s6f/Co+3/eNOhPseOkhgbL72Htm9cX3Hs64V76n9f+JjI J10fyfyHHl0sH33Qbo2aI9ePbystNX98r8yKdA/i+nJxxNUem4hB5LZW30hvz+hruK0xnsR+ a7hztwU71Oj5uS8uMUuDukHO0wl0nce17MxvdDk6yfzdFy/q/6lPaqnAsFR/gUhlivwlnc6q bKUxh6YSYOZSelosTSc+Wvzww/PDJUIdZGMTF1tbT356f9x8CR9DwNVMa0sfeUxOvPnOhfsf TosPj5Cw4YJT3HCZ0CXwJ4RR09GsuUj8D37xyu3yl35Z9KaIiNz/v5dvf/Ru+WrOqm1/3/38 71964V0RkZzi+u8skAifr9D+9Q+fWXzszdrSo5LzWI581NVrlYUiIisSun9ZtF5EFv/tK2vT xDB7VeHa93+276Xn94my8HsL5I7zEP/1XeW4pm9+IbfvdV+dpRvLsporfrfR0fu/7Xvx8oXG CaTnPbO4ebQ1aH4pOFbr3CPjv/4NkeaKUuszv/pHraHG76ObiPi9L66C44K6QerT8Xedx9Wy h3OkuVnE/30JZFJLBYYTfH+LDk3p4gGMk6WPPCbNR4/L/U/+l/jwCM+54diEb1x4s1keW7ZA wsaQdzXSmjgm7JsXPpo6XyIiReI0g5NHstIIAKMvasQMFovlfHfvksRY9dLS0tKf/GTr1+bH TEIFn13p8zrQVwMy6Ow3iJrjbCG6JVedaS9itsyKFBmS6wNimC2zwjxeDIlIpETcEvsXh14p f/PrhfU/+pZjkjs8SukKkjs35dqgYzTXQvUh3MdVcT/KJ1yi50jYkFwfEFF2vyVXr0vUHLlL xlCD5oDhWucucvu63LjlqEQ0T2dUXLcjqPviugWRfm9Q4NPRvM5jrVZVlXKVNO5LlMyO9C5e KUa5L+Neami9+07dnTt3RKS+vt5gMIjIybMXlj24OMRlAQD0zfXLwm63r1+/XkTCwsKeeHJD gF0CBAnXb1X1r9QbX4g9Smbf7UhZs+6VsJtybVBmqafDPCOfRrRQ8U5rcvL1jRWfPPFK6cr4 6DmOjwSaOVCdrMJ8A4BP5tGIDUFwXZZtW0srKyvVq5RArsdJwLvmyF2+SyNl7r2eS8JltnOJ 7wsREdcXZiNl7myPXcPulrm++dX3EJ5m+S9Ave/oa/AzoGZhEbNlruuN5umMN4374q/gwGuH u85jpTqu+irN9jmoZnke92WiSwUAYObQ+q3qClfulBUwIAUKHl7juJ9V/dgL3/OYqtfMgR7J KuhUox0px0CP0XzcxK3aVrvq+sCMrwEAAGDmifvhdvN3HRPkd038JOa4mNbRXDw/4szkGgAA AGaecZ/Vnmh6ekILAAAAMIMRzQEAAABdIJoDAAAAukA0BwAAAHSBaA4AAADoAtEcAAAA0AWi OQAAAKALRHMAAABAF4jmAAAAgC4QzQEAAABdiPC34u57771x+6tJqGDSDoRguG7HlLgvU6ta AACmgcC/cPnVHNiwl8VvNF8w964JqAcAAABTGBFxQtHQAgAAAOgC0RwAAADQBaI5AAAAoAtE cwAAAEAX/H4NNCROnDgRzGbLly+f6Eqgxn0BAACYBPqK5iKSnp7utcTgpLz+85//HIq6Zjru CwAAwETTe0OLEv6uXLly8eJFJQVCD7gvAAAA406n0dzudOfOHRH5/PPPr1275pqjRahwX2ao zqpsQ1FjqKsAAGC8PPsr47O/Moa6Cg06jeYu4eHhV69evX379qxZs4iA+qHv+9JWbSxrsAZa Xd02Accc/0GnMtI8AECvnv2V8bmfvZT8o7k6TOe66zV3hTyDwWC328PCwq5cuRIWFrZgwQKd 5b+ZZUrdl4xiS4b/tdbuLpEV43m8tmpjeZNI7rgOCgAAJoCSy09d++9ffHYj1LVo0N2seVhY WFhY2FdfffXFF19EREQMDAzcunUrKirq3nvvDXVpM9qUui+uWfO2amN1Q0OZ0Wg0Gh2T2m3V ptoz0lRuLGuwqtaXNVhF2qqNDq5Jd40RfA9WLuWW8lyfxT6DabE6B3eP73FMj6NaG8oCjzZi jUXOb/NmV3X6LtWc9tZa21mVbVAvbSxKKWkRc75z2MYijwMAABASrlx+89r1UNeiTXfRXEQM BkNfX19vb+/g4ODly5cNBsOCBQtCXRSm6H1papZSi8ViKc9tKq9uE8koNhemSm65pWJ1vGp9 xWppKCuXcoti3UWTKwJ7j+Alo9hiKfaapHfEdUV5Uq3JX69LW7WpOcesbGcu7Cp3HtR5TIu5 MLXpuHPntrdrpbBUqXtcNBblt+/ssNvtdvvh9JJnlezcWZWdL4ftdru9Y2d7vneg1lzbWJRS kn7Y7lxa1Ch5NR07s8R02H5sc7KISF6N8xUAAJPihRdeeOGFF9RL1Lm8r/uLvsO33/iZJVTl +aO7aB4WFmYwGBITEw0Gw4ULF7766qvIyEhdTs3OLFP2vqTmZMaLiGSsyA243trafCZ3hTNi Z6zIPdPcag1qBF9tx5tSC59yjaWR3Z0SFqaeqa1U8nj86grn5wXXMSU+M8eVzduON7mWj5uW 0x0iosrOnYf2t5jW5ImIJG/eZmrZf0idzTXXNh4wZ+38aZ4oS4/Za/LGt0YAAEbohRdemFNk W/faOlc6nxK5XHQYzUXEYDCEh4d/7WtfU966upn193XDmWVq3pekxKCzbOrCBNfrhIWpoxhh xIeNX11hLpRak2/vimsLZza3Nuxryl03jlPmIpJXYz8s+b7tKWbnsnyzxl7eazvPtY9nUQAA jIdVy34sIko6f+GFF5Rc/mXf53rO5aLPr4EaDIaIiIj4+Hi73W4wGJQsqOPwNyPMhPty5mKP iCP69lw8IwvHMFZXt1Uygk3nltUiorTBlC00VyR6rs/MSa093vbUwuYzuesCfLt1lPJq7PYa EWksMuQXrXFMeJsOe818ezS1+Kx9wPvPUQEAEHLNF2rviblPRNa9tk5E/r33ja+uf/XFZzf0 nMtFh7Pm6qiXkJCQkJAQYGNMmml/X9SdI2PtHclYkXum9m3nWAG+u+m5KmFhqtZse/zqdblN +yqbxd0jM046q7J9v5yZvGptlvlAo2sDz2+Caq7NW2NqKflNo++Y7ef45icAIBRee+217n++ 58u+z0Xk1LX/PlVyuehw1rytjYdD69E0ui/xmTmpteXGptxyi/pph/GrK8wNZUZjuYhIaqG5 IkDviONrnv46yCWj2FJebTQ6npXqf7D41RXlF40mY617wwwRnyudsSK3vKmrsHSc28wlefOx w6cNKYYSEZGsnR3H8pxLixwfxVwLPfbxWZtX07EzO8Xx6c102L45WURWrc0qKUkxnD5sr8mT xiLD9rQOvgkKAJg0r7322gsvvCD/x+fK2ymRy0XEYLFYznf3LkmMVS8tLS2trKwMVU0Axldd XZ3yB1zr6+uVXH3y7IVlDy4OcVkAAH1z/bKw2+3r168XkbCwsA0bNoS4rJFQvg8qInrL5b5h WwnkWLXhBAAAIABJREFUups1B6Yjx18l8pQbYOIdAACMnTJ3fmNht65yeQBEc2ASZBRbLMWh LgIAgBnotddeC3UJI6C7r4ECAAAAMxPRHAAAANAFojkAAACgC0RzAAAAQBcCfQ306sC1SasD AAAA+kc+nFCBovncOdGTVgcAAAD0j3w4oWhoAQAAAHSBaA4AAADoAtEcAAAA0AWiOQAAAKAL RHMAAABAF4jmAAAAgC4QzQEAAABdIJoDAAAAukA0BwAAAHSBaA4AAADoAtEcAAAA0AWiOQAA AKALRHMAAABAF4jmAAAAgC4QzQEAAABdIJoDAAAAukA0BwAAAHSBaA4AAADoAtEcAAAA0AWi OQAAAKALRHMAAABAF4jmAAAAgC4QzQEAAABdIJoDAAAAuhAR6gIA6MjQ0NCH7e0dHR1Wq1VE 4uPjU1JS/iY9PTw8PNSlAQAw/TFrDsBhYGCgfu/e3t7eZQ899HfPPfd3zz237KGHent76/fu HRgY8LNTY5HBU1HjSI/bWZWt7NVYpLl3Y5Ehu6pzpKOOgJ/jAgAw2YjmAEREhoaG3jlwYHFS 0iMZj/T1f/k/j7f9z+NtVz6/+sgjjyxOSnrnwIGhoSE/u5oO2106drbnjzbndp5r11yeV2M/ tjl5VEOO6bgAAEw2ojkAEZEP29vj4uIeePCvWlpP3hj8av78+QsWLBgauvOXD8/8VWpqXFzc h+3BBNjkzccOm8zbHZPc7il117R3Y5GhqKoqWz3DnvxAelZaSmNRSkmLmPN9Z8ids+adVdnZ VZ2OMYsaRZlvH2Zw7TLcG2ZnZ/s7LgAAk41oDkBE5NzZs/cvWdJ5vis6es49c++5KzJyzuxZ cbELYubPs9ls9y9Zcu7s2eBGSknLajndIdJZlZ0vzgn1badTXNHXvF/esNvt9sMmc35Ro4jk 1RzbnJxX07EzS0yHA86Qt5SkHFjjnJw3GJ6VN+z2jp1SkuLK4eaS09uc0/fOQK9ZhqOKY8eO BXFcAAAmBdEcgIjIJZstNjb2sy++uPeeuXdHRc6NvvveObPmRs+KWTDv9u2h2NjYSzbbiAbs PLS/xbQmz/Eub42pZf8hJRRnrV2V7Fg24jJNh2vyRCR51dosydr5xuZkkeTN20zSfs6R+7N2 /jRPRFnasv9Qp98ynFUAAKAfPKEFgFtUZOTsWVGzou6adfddd911l8FgsNslOnr20NBQWNiI P8lnpaW4XqekZTlfpj8wPplYcxz3QtcR/ZQBAIDuMGsOQEQkNja2r69vwfyv3bl9S8nlkZGR kZGRdvuduXPm9Pf3L1iwIKiBVNPULac7XIs7TrdMTOF+uY4Y2jIAAAge0RyAiMiDDzzw0fnz CxMTbt68cXNw0GAwiMjt27eHhoZmz5790fnzDz7wQBDDdFY9WyI7f5qn9JyYDzhbwBsPmCen g8T5FdTOqu3mrLWrkkNUBgAAo0E0ByAisnTp0kuXLp05c/r+JUsMBsPAwLVr168PDd25++67 //KXv1y6dGnp0qV+djXnu59qnrJ/bYfj+5TJm491pG13LN+e1jHs1yyTV63NMueP5snoKqa1 8qzBYDCklKQfPqa0og9XxrgcFwCAcUCvOQARkfDw8CfXrHnnwIEbN29+c/Hi+Ph4Ebl06dL5 jz++dOnSk2vW+PmDoHk1dnuNv0GTNx+zb/bZPk/rtZ/NPTbbfMyu3lRzTHnAdxDfcT2P7Oe4 AABMNqI5AIc5c+ZsWL/+1KlTJ//8Z8vBgyKSmJCQkpLy/cce85PLAQDAeCKaA3ALDw9ftmzZ smXLQl0IAAAzEdEcwLTh3SEDAMDUwtdAAQAAAF0gmgMAAAC6QDQHAAAAdIFoDgAAAOgC0RwA AADQBaI5AAAAoAtEcwAAAEAXiOYAAACALhDNAQAAAF0gmgMAAAC6QDQHAAAAdIFoDgAAAOgC 0RwAAADQBaI5AAAAoAtEcwAAAEAXiOYAAACALhDNAQAAAF0gmgMAAAC6QDQHAAAAdIFoDgAA AOgC0RwAAADQBaI5AAAAoAtEcwAAAEAXiOYAAACALhDNAQAAAF0gmgMAAAC6QDQHMAadVdmG osaJPEJj0QQfQBqLDNlVneM+5gRXDQCYjojmAPSs81x7qEsAAGCyEM0BjIfOquzsqs7GIoPB YFAmjDursg0Gg3tCurHIUFSlLDOoppQdu6i2dG+YnZ2dUtIi5nyNae1O51DqY6gX+pm1dh9P Y1DfYvyV7T6SahTn7tlV50ZxCQEAIJoDGCctJSkH1tjt9o6d7fkGg+FZecNu79gpJSmuQGsu Ob3N7tgiu6pTpLMqO18O2xXbTqc4Y655v7xht9uPHTvWsTNLTIftxzYnexyrsSilJN2x42FT S8lvGpWF+9d2KAtdh/DazeA+3uF0VWnivxhnNfbDJnO+soPq8B1r96c4P4rkt+/sUHYuMY// 9QUATH9EcwDjxXS4Jk9EkletzZKsnW9sThZJ3rzNJO3nHBk3a+dP80SUpS37D3V2HtrfYlqT 59g9b42pZf+hThGRrLWrkrWO4JJXY7fX5Ln2U16kpGW1lDyrBOrkzcd88rw0HjA7S/AaQ0T8 FuOqxnUg9TjJm7eZzAcald23KUfM++nOrGAuGAAAnojmACZC+gMa2dq9MCXNkV2z0lJcq10L g+PqKcl3TFEnbz7WsVNKUgJ1tGjW5eSnGO99Os+1S4vrMIZ8s+PDh3v35AfSR3ImAAAoiOYA QqDjdIvyouV0h+/C4TUWOTpmlEYT1/Lkzcec7Soms0ZHi3sGX8sIijE5O1/sdrvdMT/v3p0v rwIARoVoDmDSmLcrWbmzars5a+2q5ORVa7PMB5yT240HzMM2sjh0nmsXZ/dIZ9V2Zda8sypb 9Z3MlLQsn+nuvDXOtnTf7SX4YpJXrc1ydp0rnxKyqzqTV63Ncp3fof1Bf8gAAMCNaA5g0pjW yrMGg8GQUpJ++JjSin6sI227ozFke1qHT3e4IwZ7d6ckb95mMucruz0ra01i3l7Vmbz52OF0 V59Jyv61HapOckVejf2w5Ku2UB9w+GLUWyrfdTUYDPntOzuObU4W1eGflbUmP7sCABCAwWKx nO/uXZIYq15aWlpaWVkZqpoAjK+6uro7d+6ISH19vcFgEJGTZy8se3Dx5FbRWGQ4sMbuk5YB AHrl+mVht9vXr18vImFhYRs2bAhxWdOCb9hWAjmz5gAAAIAuEM0BAAAAXYgIdQEAZoi8GjvN LAAABMKsOQAAAKALRHMAAABAF2hoAeA2NDT0YXt7R0eH1WoVkfj4+JSUlL9JTw8PDw91aQAA TH/MmgNwGBgYqN+7t7e3d9lDD/3dc8/93XPPLXvood7e3vq9ewcGBiapiMYig4v77wE1Fnk9 2Hx8jqTx10J1T7lAXlejsyrbZ6HWMvcA3ld4pDVojjvu9yhUgj+XUfwUTcQPnmvMYQd3nVrg LTursnV+O0N7GSfUCP6nNJ3+VwcXojkAEZGhoaF3DhxYnJT0SMYjH3/a+/s3/vX3b/xrV0/v I488sjgp6Z0DB4aGhia6hs6qbEO+HLY7HE4vSZnA3495NXb/f1RI79x/tlREpPE3JZKV5blF 56H9snOnyfkHSh0LJ/UKQ5NOfvB0UsaoTfX6x0XnufZQl4AJQDQHICLyYXt7XFzcAw/+1a79 B//+n2v/55/Pvvv/vv/8P/7+jX85/FepqXFxcR+2T/QvgcbflMhO1V/wzKs5bGop+Y0rgzqn e11hUpkX9lzYWGQoqnIuL/LZ11BUVZXtNTEW/C4e1WrupVFSZ1V2dlWnY7SiRvdGqjHduwWT lLO8InfjAbNp7Vqfi9mS/sDmNZ5XcJgr7FuO1z9dOJac87gMXgvdFya7qlP71NTja146910I end/RvFD4nGCnle1yGcsrZWudZoHGuMPnp+7E5jGqbknhoe5np1aN1Nzy2FvfTD/W/C+jJ1V 2R4H66zKNmRXdYbiMmqdftD/HQhiS49L6vOfO98fsMailJIWMeerr5T/u4Opg2gOQETk3Nmz 9y9Z8uf2s7X/+sf/Wmz6x3/+VUbpjwckYudblvMXuu5fsuTc2bMTW0HjAXPW2lUe02B5NXbX nw815x9YY7fb7a4w2ViUUpLumAD2SJjm/fKGstCc7/z1n9++s8Nut9s70vaXtPgeexS7aO3l r6SWkpQDa+z/f3v3HxVlnfd//D380sw2SwQ97prYoDcalT9P4ZFWFDZE9xgZm3VaqL0DXX8w do5tlnsjuxrbejaHzBS6K71rs0WlzvqDFQo3/Urfr2m2i8kqI7beW4GQoal7SuX6/nHNDNfM XPMDZJgLeD7OnM7MZ67r83lfF5O8+PC5LhSl3npslslkypYtilJvFUu8Y2mBc7f6rLL4AL6r ZszNrSnb7ch/75Xmzs3wPJnW5emSvtya5Ezxfs6wc1+9o9CckJXHLaXqlrqN7SfmYL5Z79Aq 8uLLsurV/uutx2ZNLbZ5adQ9M/pbetGpD4nLsWj70vzGYc8dFpcvlK14avubK4+3/zLCYyAX Hf/geT0i73wfmu/zWZFnUt9Wv5h+z7zvL734+39B5zSa87dYk9p/S1Sx1iLWLW7T5d1yGr0e fsD/Dkip5fjKAD72ovPPnd4HLL2k3pokuXuUg/nmjv1/AWMjmgMQEWlsaoqJifk/R48N7Bem 3H7bK//7+b7Pr4XPWvT9xfM1n56IiYlpbGoKehF3jPb+C+ok6/J0EZH0ublqgzZVOhtFRBzx 09Fo211Wk7tS/WZuzt9idVv50clddPbyXlLunpJ0ETFnZCVJkhoszPkrc+XYSVt7jFYHW5nr ulhFX7ozm9uKVx9z7O1gK17tCOHm/JXabODrDDv71jkK7QlJX24/H7qN2hOjf2jxY5NqLNlq cDDnH1SXJeg2Br57R47FpUSfB+hCW4zHzzS23WU1uXOdb2p+cvL4kLjo+AfP6xF55efQvJ/P Y6vV5U+OlkDOvO8vvYjv/xf0T6M5I8uZzXV+vJTuOY3eDz/wfwccZ8Scv1I9NO99uv1z5/0D 5rc89DxEcwDtIsMjGhsbX6r854GjF1svy7+/V0Skf7+oa9euhYUF/5+LYye9T/Tohkrnr3Bn lXrfsv54TdLYeJ8Dd2KXDpXkay/byWNSY4l3/CZ6VqnP0+CQvtwqlrUVYttdJu5Rxba7rKa9 y1mlIs6J80C69nIU7SfEPPoOn41+Ds2cf7DeKs5mdTpVr7EDu3fwWHS/dr6PxctOeruLxI91 hkHfPwx17oPn9zPmvTbPQ/N+Pmsky6qd6+/ImQ/sU+3zq9B+Gp3Z3Fa8utQRuX31E5TT6PXw O/NPk/3QOtKnlw+Y3/LQ8xDNAYiIxMTENDc3J09OjBo46Ov3Nn7z5eVvz15u27ux38BBKfdO OHfuXHR0dHAr0JkJciwr1VWRZ/91uPp7X+8dx49Nqjle36FaOrFLh0pyl+u8MlNRVwP430WN K8U6ybxiraXGpcN6a1KNZW1FoGfYy1G0nxDNtWe6jf4PzZx/0LEwJLfU8at33cbAd9fVka+I /2Px+YON9gNTf1x/CZRf/j94nfqM+Tk0L+czd2V+/nJrknYhTuBnXjr1qfZyGu3Z3HXq2Icg ncZADz+Azts/IQGfUv8fsA59dWBgRHMAIiJjRo8+1dBwxxjzc/857wfK9zf8+bc/+PNvbzV9 v25F3rCY6FMNDWNGjw5yCenL25dfi4jYirMtNXpzZOq7J4+J401b8Wof817mjCznemtbcbaX hePXu0uHSvIYa5bmqrIAL0ozZ2QllVos7sncVrxau/BCxL5eoHR1sS2gM6x7FC4nZHdZjfdG v4fm+tNA/NgkuWO0Wbcx8N29naNOfkj0jkXSXS6pdfuZRrvmwtuqi0D4/eB14jPm+9D8nE91 pfdqx1WdAZ/5zn2qvZ5Gc/7K3NLV2WXivnbLRz9dfBoDP3zvnbfXpK44C7xPvx+wDn11YHBE cwAiInfeeWdjY2Nd3fGfzUnbtXHVi8/lW1c9Vb1lberUSX/7298aGxvvvPPOYNdgzj+o7JFZ jl+Cx5dl1Xtco6jZeGVuqX3bbMnKFdfbBLr1u+cO9Te98cezvCwcv+5dOlSS21j2a+JMJtOs Y9b6g/lmzxtT6A8n7sG6Yq2lxjMWpi+3JtVYsoslgDOsfxSaE5ItWbnOyj0b/R2aZid7CSXp otsY+O7eTlfnPiT6xyLpJZpzF1+WVa+dBzbnH6wfu9r+5uqx9Z1d6evvg9eZz5jPQ/NyPrUb bLGKJX5qsfjb0r1fnU91AIfv5TSmz82tqfH4DVEAh9xVp9HviQqg89wsyTaZTKZ4yx17Duab O9CnlzOj/gRkMuVVdKArGJ5p586dDV+cHTU8Rtu6bNmydevWhaomAF3r7bffbmtrE5GtW7ea TCYROXri8/FjRrptdvHixXffe2/o0KFxI0cOGzZMRBobGxtOn25sbHxg7tyBAwd2e+HBUJHX 4eTUiV26gq146trRB/kGG6BeeLpC9MHrbQxyGivyTO/N9T7XYFjObxaKosyfP19EwsLCHnnk kRCX1St4hm01kDNrDsBu4MCBj8yfHz148NFPPy199dXSV189cuRI9ODBj8yf37NzufZP+wW4 1qATu3QxW3F2WVZAv72H9J7TFfoPXq/AaURPFhHqAgAYSHh4+Pjx48ePHx/qQrpUesme90zx JouIiOTuUQKYPuvELl3MnH/wYHeP2YP1ltMV+g9er8BpRE9GNAfQ+6WXKEpJ0HcBrh8fvC5h vNOYXqL0/N/qoFuwoAUAAAAwBKI5AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEMgmgMAAACG QDQHAAAADIFoDgAAABgC0RwAAAAwBKI5AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEMgmgMA AACGQDQHAAAADIFoDgAAABgC0RwAAAAwBKI5AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEMg mgMAAACGQDQHAAAADIFoDgAAABgC0RwAAAAwBKI5AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAA AEMgmgMAAACGQDQHAAAADIFoDgAAABgC0RwAAAAwhIhQFwAAQC9XWFgY6hKAgBQUFIS6hL6O aA4AQNCReGB8/AxpBCxoAQAAAAyBaA4AAAAYAtEcQJCd2fLopEmPbjnj2rJqvzG7BQAgdIjm ALrDifWvByM0B6lbAABCgmgOoBvMXrKkvkQ7w23obgEACA2iOYDuEJddlFapO8O9f9UklboW RbMq5cyWRx2tsn+V6+IVf906e3V2rPa8ZcujzsYzmuf6xfgYGQCArkc0B9A9RmTnyVPuS8HP bHn0KXnx8OHDh8uX1D/16JYzMmJ62phd1ftFRD4/LWPG1J8+IyJnTtePSZs+ItBu9696atfs Fw8fPnz48IuzZVf7xPquSilSW3c9NWmFFB0+fLh8yRj7Bp7FiIgkrzr8x2y9kQEA6GpEcwDd JfkJ9+UnZ/ZVnpidkiwiMiI7b/aJyn1qNq8/fUZkf3V9Wl6anP5c3S4+zks+9uxWklcdPrwq WX2aMlvzxuw8NWWPjBvjeD5ietqYE45B3IsBAKA78SeHAHSbEdlFaY++vj/7CW3jrqcm7XI8 H7NEREbExZ8o2XdmutTHx62Ki3+qev+qlNOO0Bxot2e2PJq5/oS224B4FAMAQDcimgPoRiOy 82TSqn3a0Dv7RccEt0Nyyuynqvftq5e4IklOmV1yeovsmp2yKvBuz2x5NLMyrfzwH0eIyP5V k0oCrs+zGAAAug8LWgB0q+QnltSvd8xnaxaWa6//TE6ZXV9ZKWnTR4iMjJPKyvoxcSM70O3n p0+Iff3L/lVP7fK1n4aXYgAA6DZEcwDda0R20ZIx7S/++KI8NWnSpEmTMivTyh0z1iPj5IR9 cfmIuPgTJ0T/ElBv3SY/sWTMLrXXkrgXl6hLyQOpTK8Y7tACAOg2LGgBEGQjsv942KMh2/kq edXhw6t0dsnWvN/Rbl1HyD7ssYO35zrFJK86zBIXAED3YNYcAAAAMASiOQAAAGAIRHMAAADA EIjmAAAAgCFwGSgAAEFXWFgY6hIA9ABEcwAAgqugoCDUJQDoGVjQAgAAABgC0RwAAAAwBKI5 AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEMgmgMAAACGQDQHAAAADIFoDgAAABgC0RwAAAAw BKI5AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEMgmgMAAACGQDQHAAAADIFoDgAAABgC0RwA AAAwBKI5AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEMgmgMAAACGQDQHAAAADIFoDgAAABgC 0RwAAAAwBKI5AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEMgmgMAAACGQDQHAAAADIFoDgAA ABgC0RwAAAAwBKI5AAAAYAhEcwAAAMAQiOYAAACAIUSEugAARrTOag1ks2UWS7ArAQCg7yCa A9CX++STvjcoffXV7qkEAIA+gmgOwKvKfQfdWkwmU2RkeL/IiHunTPS1p614arylJnePUpLe 8WEr8kyrx9YfzDcHtOl7czs1iPtYHRgUAIAgIZoD8OVHP/yh83lkRHhkZERUZPiXX37pey/b 7jKxWnMtq4uXpwcz7NpOHhOZG7z+AQDoVlwGCsC/sDBTv6jI/v2j+veL7BcVGRkR7nPzirWW mjtG58/NrbGsrXA25pnyiounmkwmk8mUV+GjUWUrnmoyTS22aV9rXopIRV68pUZKZzmaK/JM dq7bufTocwsAAEKKaA7Al7CwsMjIiH5RkTf0j7yhX2T/fpFRkRFRUZG+9ql4rzTJujxd0pdb k0pXazJwqeX4SkVRlHrrsVnObKzbKCLm/IN7NNnetrusJnelyxR8ekm9NUly9ygH881iK546 S/YoqpXH4z2yd0VevOUO+wZ7XH5oAADAIIjmALyKiAjv3y9yQP+ogQP633TjDTcOuKF/v36R kZH9+9/gfSdb8erSpKwMs4iY81e6ZOAk6/J0cbSX7bZ5b1Slz80Ve7a37S6ryZ3rfU256/vp c927EkkvUZyL0tPn5gZ4CgAA6EZEcwBeRanR/IaoATf069evX1RUVGRkZGRkZP/+/b3uY9td ViM1lnh13cisUpH2ifM7RjsmvePHJjl20G20S19uTaqxrK1QF68v9321Z9LYeOdzz67U4hxL WmaV+uwKAICQIJoD8CoiIjwqMiIyIiI8PDw8PDwsLEz9b2Sk1yvIK9ZaanId60rUdSpJOotH 6o/XeO6r02jOX5krpaunZltEnYj3oeZ4va+uKvJMpmzZ4ljR4rsvAABCgWgOwKuoyIioyIiI iAg1kYeFhZlMprCwsMgIL9HcVry6NMl1dtserott0j5/rlnz4qWxXfpya1JNTY3OOy7MGVlJ pe85fgKoeM+jK9vJY+JYq24rXs2sOQDAgIjmALzq3y+qubnl3LlvWs+fv/DttxcvXbp0+fKl S5fDw/WjecVai06GVlelZK8+JrlZkm0ymUzxljv2OO8grtuoYc7IShK3C0C175XOMpnyKsSc f7B+7Gr7/Vd07lBuzl+ZWzpLfTtbsnLF5QJVAACMgPuaA/BqbMJ/dGj79BJF0Wk25x9U8qUi z/Te6PyDSr772x6N6SWKZt5dvTWLl2XmZu2+Zr3eXasrcb7KV7c0O8ZyHRQAgFAgmgPQV/rq q6EuQcRPMgcAoFchmgPQscxiCXUJIhV5plmlIrl7mM8GAPQNRHMA3UN3xYjPZSSuK1AAAOj1 uAwUAAAAMASiOQAAAGAIRHMAAADAEIjmAAAAgCEQzQEAAABDIJoDAAAAhkA0BwAAAAyBaA4A AAAYAtEcAAAAMASiOQAAAGAIRHMAAADAEIjmAAAAgCEQzQEAAABDIJoDAAAAhkA0BwAAAAyB aA4AAAAYAtEcAAAAMASiOQAAAGAIRHMAAADAEIjmAAAAgCEQzQEAAABDIJoDAAAAhhAR6gIA AOjlCgsLQ10CEJCCgoJQl9DXEc0BAAg6i8US6hIAP6xWa6hLAAtaAAAAAGMgmgMAAACGwIIW AN2g5cCmDdVNjleJWQWZCT62risvLKsViU1Jiamurg1sn6CoKy/8cMiiBdOi/TZ2VsuBTRua 7+uSQ+vCrtp5HmzLgU0bqmPcvxp15YVlklWQ3LJpQ3WT+xdL/XqG5CsIAD0M0RxA0NWVb6iO ySpYoAazlgObNhSW+8hpdXW1sSmLFkyLrisvVJ8EPFJQ4mlXjxuqIrtG9LT7EqvL6uoyE7Th u65WErMSRA6IxMbG1rq8XVdXGxsb26TXGQDAFQtaAARbXV1tbEqyM6lFT5uXEltbV+dt85aW sxITHa15AkNJSEgU169fXV2tJDqyeMy4cbFnW1q0byaOG9e9JfZAVZZBTmkbG0JdDoBQYdYc QLANGRLbVL2/bppzmjh62gL19lza+WP1+aIhH26obhIpK7QvZCkrrE1MSTlb3XxfQeaQA5s2 VIt9Hr1F+0JVV27f96x2myYRES+z7/alMyKiWTLjbExMTPTcUtvYmXFdN3btXLPmo308/d8v aJYI6WzhWUDLgU0bmselnK2ubnItS28gXwcrajbXzpurv+Zo/9krYZxsr2uZpg5QV1ebmLBI zlZ7nElNFV26SKjnadiYNmHF2G2trakiIlJlGTQhTT6pXDgqxHUBCAFmzQEEW/S0BVmJtWWF qnKv0+X2bRelxEpiVkFBgeOJNtJnJTZV768Tkbr9brlcRBIy7buozfZ1NAUFBQVZMdUbPAeu Ky+rTbRvkCi1Hx5ocWlcNORsrceWmsbOjeu2sYjUltUlqDXUlqkbtxzYVCbqcClnyzYdaHEf UTPEopSzZW5DeCug9jOZpw5kP4n6A/k+WBH3efO6utrYcQmaL0R0wjj5rK7F8Waiy9KX8rKh yHP3AAAVJklEQVSzKYsctW23H1pCZkGfzeUiVS+tkKJPrKmO16nWbTmHVrxUpb5p8ZhLr7IM smzcmKa2WqpEpGFjmstce8PGNKbegR6KaA6gGyRkFhQUOOKn/4Duq6NFKWfLysvLy86mzPMd 5lpazjpXWSQkJIp2kUV7VZntG4iIy+qb6Gn3+Wrs/LhuHF0PGRJr76HusyZ7D9HT7ktscsRc J+0SoehpC9wmzb0W4AjQvgcK5GATktvXJHkkc202d0/mIiJNzc1qJ306j7er2r15ygM/cZkh T7W2tlpTRRo2pj0k21pVy09McMbtzStOLG9tbW39pOj4Q2kbG0YtrNSkeWnY++6hnOVMugM9 EgtaAHSnhMyCgsyWA5s2fHggOWFaZ3qInnZfYmFZbWJWgZ9U19zcFDtkiP3FkCGxTc3NIm77 uNw5JjZFjbUyRNy20mu8rnFd6K6nr3Uu6VEL60A9ugUMCXSgwA42OmFcbHVdXWZCQl1dbey4 RdEeb8v2upZp0XW1iQmZIu0/WiRkFmSVO/42JjdtsRtr1o3RasR2zKanZuQ8tHZvw8KFIjKl aGmqiMiohctzVqzd27BwYWpGjjy0duPS1IWjXHcD0LMQzQEEmf2+epoMFp0wLrbakRc73l3Z 2ZSslM/Kyut85zqXVOwSV+1aDmza8Nm4RQUL1FUohR+KSHR0jGdPuo2dHzcgvlKrn3o6VoDH QIEdrD2bJ7d8WJt4n+dPSdHRMU0f1tWNOxs7JNn9vYTMgoJMUT8Y5QmEcxE5bmuQVN10PmXM 7c7nt4+Z4njanuWdjalLi6ZMWPFS1cKltnelaBPJHOihWNACIMgSklNia7ULplsObK+WlOQE NWPa10W01H0WwO31Wg5sKjubMm9awrR5+ouwRZzrNzSdS11dreeccXNzk6OxrtxxNWhCgmYh 9oe+Gjs9rnZjXdEJ45zLRVoObPJc/aOpR1oObCp0PREBFeB9oIAO1r7vh9udK2L0SiyrFrel Lp7VIjUj59C7e10WhrevFT904pSz9dSJQ557tzeOWrg8RzavTVuwQtzWxwDoQZg1BxBs0dMW FESXF24odNyko/3OHAnJKbEbygrVvy+UKM2+O6or31AtKYumRYvj9tobyqNdZl2jE8bFVldv KGzOKshMSMhclLJpg7p2IjZl0QL3BNk+uMSmZKXEljU3i0S37xWbkpIon6mb6jVqD7Ej42o3 1p/Pjp62wLnqQ68H0Q4hiVkF06JdF434LsDPQP4O1rnvfYnVZbWJ9+l3n5CQKLVn3ZK5RE9b kNXs+Ci019a379CSurRo7YQJFnOr/UrQho0LVhzK2VY5alTDA1NW7K6ypqaK2NekfzJK5JTI ZnXpijRsXGtvtHc0ZcKKQ1OKNpHMgR7LtHPnzoYvzo4a7vIbzGXLlq1bty5UNQHoWm+//XZb W5uIbN261WQyicjRE5+PHzMyxGUBfUZhYaHFYvG1RZVl0EOb7c+nFLXfObFhY9qEFYdcWqss g3aPKTq+YsUhEcnZ1tp+bxdp2Jg24cRybQvQAVartaCgQNvi/GahKMr8+fNFJCws7JFHHglJ eb2MZ9hWAzmz5gAAhFqqtbXVqtM+amFl60LPZrNuMxeAAj0fa80BAOgOmj/46WSp6rr+G/a+ eygng2QO9GjMmgMA0B28TIx3Bft6mJxtrSRzoGcjmgMA0IOkWj3zt7f1MAB6GqI5AABBZ7US nQH4RzQHACC43O56AQDecBkoAAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEMgmgMAAACGQDQH AAAADIFoDgAAABgC0RwAAAAwBKI5AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEMgmgMAAACG QDQHAAAADIFoDgAAABgC0RwAAAAwBKI5AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEMgmgMA AACGQDQHAAAADIFoDgAAABgC0RwAAAAwBKI5AAAAYAgRoS4AQGgcPfF5qEsAAAAuiOZAXzR+ zMhQlwAAANyxoAUAAAAwBKI5AAAAYAhEcwAAAMAQiOYAAACAIRDNAQAAAEPgDi0AAKBvOXLk SPA6nzhxYncOd508q0VoEc0BAEAfcuTIkYkTJ37//ZVgdN7c3PLmm28+9thj3TPcdfKsFiFH NAcAAH2LIqIowelZr9/gDXeddKtFaBHNAQBAH6MoQQrL+mE3aMNdJ6K5ARHNAQBAH6MobcGK 5t063HUyZFF9HXdoAQAAfYsijplst4dtfcqA/gPsj0WVLu2al44tF+9170Fp01/Q4n+4xX/R 36ZLHp71e68WoUU0BwAAfY7i+ahcPODO5WPf/felS/++dOnfl96VuTdOf/mU/V2XXU69nHLn jsy//3t9mkcnXiaivQz3j1+pY1069vvjcwcs2auzWRc99Gtg2tx4iOYAAKBvaVNEaVNcH7aX i157ovzySzMdLTPX//0Fefo/159qUxRFaRPnlnuX3Lnjgb9V/zJO8ehEP+rqDbd3yQOvPVG+ PtX+ctQvS34/5fXfvWzT6/P6Hy71+6kWoUU0BwAAfYzisbajoWLHoSdmp7o0xt2fOeVQeUWD M8IqiuxdctNcpfyDX47SXzsiuktEPIer+vPr4jrcqEUffOvotmrxwJsG2B9L9yqiKA0vp9y0 eMMrKWpjyis2R9kvpzi2XFLl7G3vEnvj4kqXS1ADqxYhRTQHAAB9i6J4zB/X/+PQlDFxbo0j zePk//6j3r4mu63t1IYZD7yRU148w/v8tOitNfccrk3EczjHhPrSzNcf337xwvmLF7Y/IW8U bbCpBby+o61UbTz0K+tedcu7nh6nbnn0hc8yl+xtU5S2UxtmPCDbL144f/Fo0bHMGS/b2pz1 B1QtQotoDgAA+hZFj94b9gXZiiIix36feuczY18oOp4585VTuj04u+nscKpUa+u31pmKoijK zNk57QVMeeAncYqiKKPGTBFFFEWp3PnGlBeWqlvG/bKqtThVUZRTFeWHHs+YqSiKMmrhMzmH dvzllLq7ojdct51yBIpoDgAA+hjF44LI2/9jyqF/2HSunpwy5nb1yaGxy79ttf5y4aYXZMWT rzToX22pv37bczgR0RvO/mh4JXXQTTcPuunmQZmb7R2IyDjzKJdrOk/ZPhP9Kz7fmKeze8DV IqSI5gAAoG9RFI+lHSPT5k5+Y3elS2PDK7/bPDnzJyPV+eXHZ6nrWEYu3PS8rJiwtNLLBZcB DTcjI0fchttrGXSTpVJRTm1InbBj7pEL35y78M257TnOuXUR5xDq87jbx4miiEcBijxedk7d /cI3595fMNJ1d3/VIrSI5gAAoG/Rm8UetXB5zuasHyx739Hy/tIJz8rzmxbGeWwct6Dk+clv ZC2r9HKXwkCGS136/JTNWTM3nlZfntr4k3mbJxctnanIqX98LGPNcYqIUrVs3ma1A93HzIyc j595SS349Ia0W2duPK1I3E8emPzGnvbGpVV+7qkIY+GvgQIAgL6lrU3vzoEzrF9/nfHU4Jtv sb/O+dPXlTNFaXOEWEVR2uxvxeVtLHp30rxbZNvXL6Zq+9Cdh9Yd7ra8yq9vtwyeePOz6uvs bV+/mCqK0jZj6ZrJE7Ju3Swik9dsWzP5oRM2pe12TQHtxcz8w+Gi+yfZC87+U2veSKVNicv7 yzbHUUxZc7hyhv0qUG39vqpFaBHNgd7PZDKpTxRFcT4HgD7MEVfdzfxD8zd/cL5yBurbFlQ0 uy7Nvm1BRfMCEXHvRz/sehkuZV1L87r2jezbxOXt+SbP2Zr7jYiiiKaA29yeL9CM4nkUitKm V7+vanUPwL4l30SCjWgO9H4333zzuXPnROS777674YYbQl0OAISY0hZ4KO15wwXDd999pz65 +eabQ1tJr8dac6D3i4yMVJ+oAR0A+ji9xd9d89CfMw/acMGoVpfz24fzGwqChGgO9H7Dhg1T n1RXV4e2EgAwAs/7mnTVQzfuBm+4YFSry/ntw/kNBUHCghag9xs5cuSnn34qInv37p0/f35E BP/jA+i7Jk6c+Oabbwav/8cee6w7h7tObtXqunr16t69e9XnI0eODG5BfR7foYHeb+DAgYMH D/7666+vXr26f//+lJSUUFcEAKEUSB7tucN1uf3791+9elVEBg8ePHDgwFCX08uxoAXoEyZM mKA+KS0tvXDhQmiLAQD0FBcuXCgtLVWfO7+VIHiI5kCfEBsbO3z4cPX5008/feXKldDWAwAw vitXrjz99NPq8+HDh8fGxoa2nr6AaA70Fffcc8+AAQNEpLW1dfHixefPnw91RQAA4zp//vzi xYtbW1tFZMCAAffcc09He5gzZ063/bfXMO3cubPhi7OjhsdoW5ctW7Zu3Tpv+wDoob755pvK ykrnlHlubm5ycjJXhQIAtNQLk5zrWCIjI9PS0m655Rbfe6FDPMO2Gsj5lgz0IbfccktaWtpf //rXS5cuiUhpaenrr7/+8MMPT548+dZbbyWjA0BfdvXq1XPnzn388cfvvPOOet2niNx4440/ /vGPO5fL58yZs3Pnzi6tMWSjdBu+EwN9yy233JKenv7RRx998cUXInL16tW33nrrrbfeCnVd AADDGT58+L333tu/f//O7d49ibk35XJhrTnQB/Xv33/69OmpqamDBw8OdS0AACMaPHhwamrq 9OnTO53LpbtWgfeyteb2WfOGL866veHZAqB3MY25c+LFby+cazn7bWvr5cuXrnLbFgDowyIi IwcMuPGmQYNujY4ZeNMPLl293jRYvOm1bsiT3TNKMOiWHSEibteAqnQbAfQ6MSLmUNcAAOiF WGvum27YZkELAAAAuh5rzTuBaA4AAICux1rzTiCaAwAAoOsxa94JRHMAAAB0PWbNO4FoDgAA gK7HrHkn8CeHAAAA0PXmzJmzY8e7Dz74QPCGUPvXpnObzRa84a6T2ez/lmhEcwAAAHS9nTt3 qnc2vHr1ajD6P3/+gmcuN5vNQRruOp0/f2Hfvn3Tp0/3vRkLWgAAAND11FXgioiiBOshHmvN gzrc9Vfrl9dZ82XLll3PFwMAAAB9mdlsttlsoigSWCrtOEUdxZlaFy1aFMzhrpMiAQRs/Wi+ bt26rq8HAAAAfYZzPjtIYVmdh7bZbM41LepCc2Nmc7VavxmbBS0AAADoeu2rwHWXd3y569kH Mx+0PzYedWnXvHRsuekT9x4URRHdO7T4HW7TJ0FctuJZv6Zav7gMFAAAAF1PM2vu4eimeWuq Up/bsWa84+W8Zx9f/3zGMHHuYt/rq93PLTmYtH5HxjCPfhxrzd3SuZfh5LntO8aLiDTufm7R gyUrt+eN7+SBBUDxLCOwqXxmzQEAAND11MTcpjOz/NWubVWpz+7IvdvRcveC9TnyxvpdXymi XjDp2PJoyZKD965/ftZQvRlqzShOesMdLVlTlfrsgrvtL4fOWvz46Kptu74Kzry5S/3u1frF rDkAAAC6nn3WXPGYQW48UnMydd54l8ahE5NGb6450piRYW9QRI6WPLRGnt2eMdRLrG1TxHPW 3HO4o/+vSlKf1Q43NGPNtgz7ZkdLHnq+yt4+87lteeOlcfdzS/6VlHNm8+YTIjI6Z/0adTK/ cfdzS944qW74rHPO/WjJQ2veFxFJfXabdh7eo+a2gMI5s+YAAADoempiVhRFaXN9fPmvk6OH x7o1xgwbISf+9aWitCkiorR9teu5Ne/PeDb3Lo/dnQ/RWWuuM5wi4jmc/fFJyfNVM1dsK/vT trIVqfL+tl32AqpqlMVq48nNf/5E3XLJGyPULYtzzjxf8kmbohYpK7aV/WlbcfY/n39u15dt zvr1q/WLaA4AAICu51hrrnheEikiorfkwxFg/7nj10u2/Cgn+3+fX7mn0fvSEe0oTgEPp4ii jH/ynW1P3iWKIspdk2eo+4uIjL53wlBFEWXo8NGiiCLK0UPvj86Zo24Zm/Hbd3LvVkRpPPLR yZmT7xJFkaHp82acrPmkURyDsaAFAAAAhqH+NVCdexkO++Hok//6SiTWfY/RP7Rf63nyR5nb fnO3SJN8lL9+z4Q16R6biuN2hO53aNENwfrDiYhI0+7/yt980lFAtj2ajxgW296PItL41RmR H4rOOpX3ix5+X9x317kMNLAbtDBrDgAAgCCw/zVQz4siY8bfE//+x0ddGpv2bP8g/t4JMeos 98xJd6lbzlr0c9mSX+J5L0Ln7Qjd/xqo53B3TZ4hbsN98urDD716VJHGXb/Or7nHWvbO1rJ3 tq6Y4ZhyVzRz7+rz2KEjdGfdFZn5q63q7mXvbF2dHuO+u1u1fhHNAQAA0PXsa83tM8jax9BZ mTM+eCHr1U8dLZ+W5P+P/HzRrFiXSWdFRIlNX/Tz+Pdf+O+jHp0o2lGc9Ia7+6c/H/3BCyv3 NKkvv9rzX0UfxGf/9G5FvvpXvfxoWKwiohz976IP7EOL6xCKiCJ3T55Rv+XPasFNu389f+We JkViJ9wb//7h9saSox71u1XrFwtaAAAA0PUcs+ZKm+eE8V1Pvv325Nce+dnD9tczfvX2b+4S pa09Dytt9rdi7/9l9kfLih6WZ97+xd2uvejcoUV3uCH3/+btYa8+YvnZ/9hHe+btX9wtitJ2 108fi89/Yf4HIhL/2DOPxf/ui6+UtqGaAtqLuesX67ILltkLnvGrd+6PUdqU2PsLn3EcxejH 1v3mLvtVoNr6Xar1y6TzJ5QAAACA6zZnzpzt23d8/92VYHR+4cKFBQtztVHWZrP96EcjgjTc dbpw4cLJ+n9Mnz7d92YsaAEAAEDXc641D9JDO4pT8Ibrkmr9IpoDAACg6znms3UXXnfBQ3EZ xSlYw3VJtX4RzQEAAND12mfNgzMTrS7e1pk1D/0Uuddq/WKtOQAAAILi+++vPvjgA8Hrf8eO d6OiXG5qsm/fvuANd538LjQXojkAAACCwe3eKT16lG4Tdvny5VDXAAAAgN7G/tdAHWtOgvTf 3pTLL1++bLr//vvz8vIiIrjBOQAAABAaV69eLSkpCR82bNjf//73cePGRUVFhbokAAAAoM+5 dOnSa6+9dunSpfDbbrvtypUrH3/88U033RQdHR0Wxj1bAAAAgO5w7dq1Y8eObd269cqVKyJi mjp1qjOOh4eHJycnx8fHDxw4MDw8PKR1AgAAAL3TtWvXLl68WF9fv3///mvXrqmNbW1tpokT J/br148gDgAAAITKtWvXvvvuu/8PcFn0+mKrc68AAAAASUVORK5CYII= --------------050805050704010707040600-- --------------080707060003080807040003--

3 4

Status libgfapi support in oVirt
by Joop 09 Jan '15

09 Jan '15

I have been trying to use libgfapi glusterfs support in oVirt but can't get it to work. After talks on IRC it seems I should apply a patch (http://gerrit.ovirt.org/33768) to enable libgf BUT I can't get it to work. Systems used: - hosts Centos7 or Fedora20 (so upto date qemu/libvirt/oVirt(3.5)) - glusterfs-3.6.1 - vdsm-4.16.0-524.gitbc618a4.el7.x86_64 (snapshot master 14-nov) - vdsm-4.16.7-1.gitdb83943.el7.x86_64 (official ovirt-3.5 vdsm, seems newer than master snapshot?? ) Just adding the patch to vdsm-4.16.7-1.gitdb83943.el7.x86_64 doesn't work, vdsm doesn't start anymore due to an error in virt/vm.py. Q1: what is de exact status of libgf and oVirt. Q2: how do I test that patch? Joop

7 18

Override hostname novnc
by Johan Kooijman 09 Jan '15

09 Jan '15

Hey all, Is there a way to override the host parameter that novnc uses in it's URL? It now tries to use it's internal hostname (private LAN), while we also like to connect over the internet: https://ovirt.domain.com/ovirt-engine/services/novnc-main.html?host=engine.… -- Met vriendelijke groeten / With kind regards, Johan Kooijman

3 2