- Users - oVirt List Archives

Re: [ovirt-users] importing iscsi storage domain
by Elad Ben Aharon 19 Feb '15

19 Feb '15

------=_Part_9372914_326988970.1423648670110 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Steven - can you please attach engine.log also? (/var/log/ovirt-engine/engi= ne.log)=20 Adding Maor and Liron from DEV.=20 Maor, Liron, can you take a look?=20 In vdsm.log I see the following:=20 Thread-77065::WARNING::2015-02-10 09:43:49,917::resourceManager::591::Stora= ge.ResourceManager::(registerResource) Resource factory failed to create re= source '2e94bbac-1648-49db-8605-ce574d2bc240_imageNS.952af113-8219-43a4-92a= 9-bfe913ec8b69'. Canceling request.=20 Traceback (most recent call last):=20 File "/usr/share/vdsm/storage/resourceManager.py", line 587, in registerRes= ource=20 obj =3D namespaceObj.factory.createResource(name, lockType)=20 File "/usr/share/vdsm/storage/resourceFactories.py", line 193, in createRes= ource=20 lockType)=20 File "/usr/share/vdsm/storage/resourceFactories.py", line 119, in __getReso= urceCandidatesList=20 repoPath =3D os.path.join(self.storage_repository, dom.getPools()[0])=20 IndexError: list index out of range=20 Thread-77065::DEBUG::2015-02-10 09:43:49,918::resourceManager::210::Storage= .ResourceManager.Request::(cancel) ResName=3D`2e94bbac-1648-49db-8605-ce574= d2bc240_imageNS.952af113-8219-43a4-92a9-bfe913ec8b69`ReqID=3D`10e68fbb-ac50= -461f-92ac-d8c43060ed43`::Canceled request=20 Thread-77065::WARNING::2015-02-10 09:43:49,918::resourceManager::203::Stora= ge.ResourceManager.Request::(cancel) ResName=3D`2e94bbac-1648-49db-8605-ce5= 74d2bc240_imageNS.952af113-8219-43a4-92a9-bfe913ec8b69`ReqID=3D`10e68fbb-ac= 50-461f-92ac-d8c43060ed43`::Tried to cancel a processed request=20 Thread-77065::ERROR::2015-02-10 09:43:49,918::task::866::Storage.TaskManage= r.Task::(_setError) Task=3D`6e023655-23ad-42cd-9b7e-6c5e5e3b08b9`::Unexpect= ed error=20 Traceback (most recent call last):=20 File "/usr/share/vdsm/storage/task.py", line 873, in _run=20 return fn(*args, **kargs)=20 File "/usr/share/vdsm/logUtils.py", line 45, in wrapper=20 res =3D f(*args, **kwargs)=20 File "/usr/share/vdsm/storage/hsm.py", line 1285, in setVolumeDescription= =20 pool.setVolumeDescription(sdUUID, imgUUID, volUUID, description)=20 File "/usr/share/vdsm/storage/securable.py", line 77, in wrapper=20 return method(self, *args, **kwargs)=20 File "/usr/share/vdsm/storage/sp.py", line 1884, in setVolumeDescription=20 rm.LockType.exclusive):=20 File "/usr/share/vdsm/storage/resourceManager.py", line 523, in acquireReso= urce=20 raise se.ResourceAcqusitionFailed()=20 ResourceAcqusitionFailed: Could not acquire resource. Probably resource fac= tory threw an exception.: ()=20 ----- Original Message ----- From: "Steven M. Bellistri" <SBellistri(a)ldirx.com>=20 To: "Elad Ben Aharon" <ebenahar(a)redhat.com>=20 Sent: Tuesday, 10 February, 2015 6:35:32 PM=20 Subject: RE: [ovirt-users] importing iscsi storage domain=20 Another issue, when I failback the 2 storage domains, the 2 nd SD is not wo= rking. The vm that has the DB drives will not boot after I failover (I chec= ked the virtio-scsi setting and it was checked), but I was getting an error= in the manager saying that: Failed to update OVF disks 952af113-8219-43a4-= 92a9-bfe913ec8b69, OVF data isn't updated on those OVF stores (Data Center = Default, Storage Domain iSCSI_2). So then I tried putting the SD2 into main= tenance mode and then reactivating it, but it would not active or would it = detach. I had to destroy the SD. The weird thing is that I had no problems = with the 1 st SD. I am sending the vdsm.log file from the host in the PR si= te.=20 From: Elad Ben Aharon [mailto:ebenahar@redhat.com]=20 Sent: Monday, February 9, 2015 1:26 AM=20 To: Steven M. Bellistri=20 Cc: Aharon Canan; users(a)ovirt.org=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 The import domain operation consists of several stages which their executio= n time can vary.=20 It would be almost impossible to estimate how long it will take. But, since= the whole import operation, along with the VMs registration in the new env= ironment, doesn't involve any long time operations, like disks creation, it= shouldn't take more than a few minutes.=20 ----- Original Message ----- From: "Steven M. Bellistri" <SBellistri(a)ldirx.com>=20 To: "Elad Ben Aharon" <ebenahar(a)redhat.com>=20 Cc: "Aharon Canan" <acanan(a)redhat.com>, users(a)ovirt.org=20 Sent: Thursday, 5 February, 2015 5:41:11 PM=20 Subject: RE: [ovirt-users] importing iscsi storage domain=20 I put the storage domain in maintenance mode, then changed the time from 60= minutes to 5min, then after I failed the storage over I was able to import = the domain. Thanks so much for the help. I just have one more question, is = there anyway to calculate how long it will take to import a domain, because= our production environment is about 5.5TB with about 40vm=E2=80=99s?=20 thanks=20 From: Elad Ben Aharon [mailto:ebenahar@redhat.com]=20 Sent: Thursday, February 5, 2015 1:49 AM=20 To: Steven M. Bellistri=20 Cc: Aharon Canan; users(a)ovirt.org=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 If you can't see the VMs under 'VM Import' subtab under the imported storag= e domain, it means that you won't be able to recover those VMs (because the= ir configuration files weren't uploaded to the domain).=20 For the next time, you can decrease the time interval of the OVFs upload as= explained below in the thread.=20 Regarding the upgrade, it is possible to upgrade from 3.4 to 3.5 and once y= ou'll upgrade the setup and the DC compatibility version to 3.5, the OVFs o= f the VMs will be uploaded to the storage domains where the VMs's disks are= located on. (again, every 60 minutes by default).=20 Elad Ben Aharon=20 RHEV-QE storage=20 From: "Steven M. Bellistri" < SBellistri(a)ldirx.com >=20 To: "Elad Ben Aharon" < ebenahar(a)redhat.com >=20 Cc: "Aharon Canan" < acanan(a)redhat.com >, users(a)ovirt.org=20 Sent: Wednesday, 4 February, 2015 5:44:37 PM=20 Subject: RE: [ovirt-users] importing iscsi storage domain=20 No, I did not wait 60 minutes before I tried to failover. Do, I need to sta= rt over, or can I just failback and wait the hour for the ovfs to upload? I= do have a question, is this feature possible for an environment that was u= pgraded from 3.4 to 3.5? My production environment is 3.4, the 3.5 environm= ent is a clean test environment, but if I cant upgrade to 3.5 from 3.4 then= this will not be a good DR option for me.=20 thanks=20 From: Elad Ben Aharon [ mailto:ebenahar@redhat.com ]=20 Sent: Wednesday, February 4, 2015 8:56 AM=20 To: Steven M. Bellistri=20 Cc: Aharon Canan; users(a)ovirt.org=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 Hi Steven,=20 In order to import the VMs from the imported storage domain, the VMs config= uration files (which are called OVFs) have to be uploaded first before the = domain is detached from the setup. This is being done by engine in a time i= nterval of 60 minutes (it's configurable using rhevm-config --set OvfUpdate= InMinutes=3D<value> and restart ovirt-engine service). From 3.5.1, the OVFs= are uploaded once you move the storage domain to maintenance. did you do s= o in the original RHEV environment? What was the version of this environmen= t?=20 If you didn't deactivate the domain in the first environment and then tried= to attach it to the DR environment, the existence of the VMs in the domain= depends on the OVFs upload that was supposed to be done by the first engin= e, which is being done every 60 minutes as explained, so if you've created = those VMs and immediately destroyed the setup, those VMs probably won't be = available for you in the DR environment.=20 Elad Ben Aharon=20 RHEV-QE storage=20 From: "Steven M. Bellistri" < SBellistri(a)LDIRx.com >=20 To: "Aharon Canan" < acanan(a)redhat.com >=20 Cc: users(a)ovirt.org=20 Sent: Tuesday, 3 February, 2015 6:16:01 PM=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 version 3.5.1=20 From: Aharon Canan [ mailto:acanan@redhat.com ]=20 Sent: Tuesday, February 3, 2015 6:22 AM=20 To: Steven M. Bellistri=20 Cc: users(a)ovirt.org=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 What version are you using?=20 Regards,=20 __________________________________________________=20 Aharon Canan=20 int phone - 8272036=20 ext phone - +97297692036=20 email - acanan(a)redhat.com=20 From: "Steven M. Bellistri" < SBellistri(a)ldirx.com >=20 To: "Aharon Canan" < acanan(a)redhat.com >=20 Cc: users(a)ovirt.org=20 Sent: Monday, February 2, 2015 8:12:00 PM=20 Subject: RE: [ovirt-users] importing iscsi storage domain=20 Thank you for the response.=20 I went thru the steps 1-9, and when I get to step 10 there is no import vms= or import templates sub-tabs. I am including the vdsm.log from the host. A= lso, when I do a lvs on the host, I can see the disks that reside in the im= ported SD, one is 30gb and the other is 40gb. The storage domain I am impor= ting is called iSCSI.=20 From: Aharon Canan [ mailto:acanan@redhat.com ]=20 Sent: Sunday, February 1, 2015 9:55 AM=20 To: Steven M. Bellistri=20 Cc: users(a)ovirt.org=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 Hi=20 Please check below link for info, ovirt version should be 3.5=20 http://www.ovirt.org/Features/ImportStorageDomain=20 please be aware to step 10 under " Work flow for Import block Storage Domai= n - UI flow "=20 In case it is not working, please add exact steps and engine/vdsm logs so w= e will be able to check=20 Regards,=20 __________________________________________________=20 Aharon Canan=20 int phone - 8272036=20 ext phone - +97297692036=20 email - acanan(a)redhat.com=20 <blockquote> From: "Steven M. Bellistri" < SBellistri(a)LDIRx.com >=20 To: " users(a)ovirt.org " < users(a)ovirt.org >=20 Sent: Friday, January 30, 2015 12:18:54 AM=20 Subject: [ovirt-users] importing iscsi storage domain=20 I am trying to test failing over to a DR site using the storage domain impo= rt. The DR site shows that it imported the iscsi storage domain, and activa= tes it in the datacenter, but none of the vm=E2=80=99s or anything shows up= . What am I missing.=20 thanks=20 Steven Bellistri=20 This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 _______________________________________________=20 Users mailing list=20 Users(a)ovirt.org=20 http://lists.ovirt.org/mailman/listinfo/users=20 This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 </blockquote> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 _______________________________________________=20 Users mailing list=20 Users(a)ovirt.org=20 http://lists.ovirt.org/mailman/listinfo/users=20 This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 ------=_Part_9372914_326988970.1423648670110 Content-Type: multipart/related; boundary="----=_Part_9372915_292966117.1423648670110" ------=_Part_9372915_292966117.1423648670110 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><div><div>Steven - can you please att= ach engine.log also? (/var/log/ovirt-engine/engine.log)<br></div></div><div= ><br></div><div>Adding Maor and Liron from DEV. </div><div><br>Maor, L= iron, can you take a look? <br></div><div><br></div><div>In vdsm.log I see = the following:<br></div><div><br></div><div>Thread-77065::WARNING::2015-02-= 10 09:43:49,917::resourceManager::591::Storage.ResourceManager::(registerRe= source) Resource factory failed to create resource '2e94bbac-1648-49db-8605= -ce574d2bc240_imageNS.952af113-8219-43a4-92a9-bfe913ec8b69'. Canceling requ= est.<br>Traceback (most recent call last):<br>  File "/usr/share/vdsm/= storage/resourceManager.py", line 587, in registerResource<br>  &= nbsp; obj =3D namespaceObj.factory.createResource(name, lockType)<br> = File "/usr/share/vdsm/storage/resourceFactories.py", line 193, in createRe= source<br>    lockType)<br>  File "/usr/share/vdsm/stor= age/resourceFactories.py", line 119, in __getResourceCandidatesList<br>&nbs= p;   repoPath =3D os.path.join(self.storage_repository, dom.getPo= ols()[0])<br>IndexError: list index out of range<br>Thread-77065::DEBUG::20= 15-02-10 09:43:49,918::resourceManager::210::Storage.ResourceManager.Reques= t::(cancel) ResName=3D`2e94bbac-1648-49db-8605-ce574d2bc240_imageNS.952af11= 3-8219-43a4-92a9-bfe913ec8b69`ReqID=3D`10e68fbb-ac50-461f-92ac-d8c43060ed43= `::Canceled request<br>Thread-77065::WARNING::2015-02-10 09:43:49,918::reso= urceManager::203::Storage.ResourceManager.Request::(cancel) ResName=3D`2e94= bbac-1648-49db-8605-ce574d2bc240_imageNS.952af113-8219-43a4-92a9-bfe913ec8b= 69`ReqID=3D`10e68fbb-ac50-461f-92ac-d8c43060ed43`::Tried to cancel a proces= sed request<br>Thread-77065::ERROR::2015-02-10 09:43:49,918::task::866::Sto= rage.TaskManager.Task::(_setError) Task=3D`6e023655-23ad-42cd-9b7e-6c5e5e3b= 08b9`::Unexpected error<br>Traceback (most recent call last):<br>  Fil= e "/usr/share/vdsm/storage/task.py", line 873, in _run<br>  &nbsp= ; return fn(*args, **kargs)<br>  File "/usr/share/vdsm/logUtils.py", l= ine 45, in wrapper<br>    res =3D f(*args, **kwargs)<br>&nbs= p; File "/usr/share/vdsm/storage/hsm.py", line 1285, in setVolumeDescriptio= n<br>    pool.setVolumeDescription(sdUUID, imgUUID, volUUID,= description)<br>  File "/usr/share/vdsm/storage/securable.py", line 7= 7, in wrapper<br>    return method(self, *args, **kwargs)<br= >  File "/usr/share/vdsm/storage/sp.py", line 1884, in setVolumeDescri= ption<br>    rm.LockType.exclusive):<br>  File "/usr/sh= are/vdsm/storage/resourceManager.py", line 523, in acquireResource<br>&nbsp= ;   raise se.ResourceAcqusitionFailed()<br>ResourceAcqusitionFail= ed: Could not acquire resource. Probably resource factory threw an exceptio= n.: ()</div><div><br></div><div><br></div><hr id=3D"zwchr"><div style=3D"co= lor:#000;font-weight:normal;font-style:normal;text-decoration:none;font-fam= ily:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Steven M. Bel= listri" <SBellistri(a)ldirx.com><br><b>To: </b>"Elad Ben Aharon" <eb= enahar(a)redhat.com><br><b>Sent: </b>Tuesday, 10 February, 2015 6:35:32 PM= <br><b>Subject: </b>RE: [ovirt-users] importing iscsi storage domain<br><di= v><br></div> <style></style> <div class=3D"WordSection1"> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">Another issue, when I = failback the 2 storage domains, the 2<sup>nd</sup> SD is not working. = The vm that has the DB drives will not boot after I failover (I checked th= e virtio-scsi setting and it was checked), but I was getting an error in the manager saying that: Failed to update OV= F disks 952af113-8219-43a4-92a9-bfe913ec8b69, OVF data isn't updated on tho= se OVF stores (Data Center Default, Storage Domain iSCSI_2).   So= then I tried putting the SD2 into maintenance mode and then reactivating it, but it would not active or would it detach.=   I had to destroy the SD.  The weird thing is that I had no prob= lems with the 1<sup>st</sup> SD.  I am sending the vdsm.log file from = the host in the PR site.</span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span></p> <div> <div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in"> <p class=3D"MsoNormal"><b>From:</b> Elad Ben Aharon [mailto:ebenahar@redhat= .com] <br> <b>Sent:</b> Monday, February 9, 2015 1:26 AM<br> <b>To:</b> Steven M. Bellistri<br> <b>Cc:</b> Aharon Canan; users(a)ovirt.org<br> <b>Subject:</b> Re: [ovirt-users] importing iscsi storage domain</p> </div> </div> <p class=3D"MsoNormal"> </p> <div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">The import domain operat= ion consists of several stages which their execution time can vary.</span><= span style=3D"font-size:12.0pt;color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">It would be almost impos= sible to estimate how long it will take. But, since the whole import operat= ion, along with the VMs registration in the new environment, doesn't involv= e any long time operations, like disks creation, it shouldn't take more than a few minutes.</span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div class=3D"MsoNormal" style=3D"text-align:center" align=3D"center"><span= style=3D"color:black"> <hr id=3D"zwchr" size=3D"2" width=3D"100%" align=3D"center"> </span></div> <div> <p class=3D"MsoNormal"><b><span style=3D"font-family:"Helvetica",= sans-serif;color:black">From: </span></b><span style=3D"font-family:"Helvetica",sans-serif;colo= r:black">"Steven M. Bellistri" <SBellistri(a)ldirx.com><br> <b>To: </b>"Elad Ben Aharon" <ebenahar(a)redhat.com><br> <b>Cc: </b>"Aharon Canan" <acanan(a)redhat.com>, users(a)ovirt.org<br> <b>Sent: </b>Thursday, 5 February, 2015 5:41:11 PM<br> <b>Subject: </b>RE: [ovirt-users] importing iscsi storage domain</span></p> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Helvetica",san= s-serif;color:black"> </span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">I put the storage doma= in in maintenance mode, then changed the time from 60minutes to 5min, then = after I failed the storage over I was able to import the domain.  Than= ks so much for the help.  I just have one more question, is there anyway to calculate how long it will take to impor= t a domain, because our production environment is about 5.5TB with about 40= vm=E2=80=99s?</span><span style=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">thanks</span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <div> <div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in"> <p class=3D"MsoNormal"><b><span style=3D"color:black">From:</span></b><span= style=3D"color:black"> Elad Ben Aharon [mailto:ebenahar@redhat.com] <br> <b>Sent:</b> Thursday, February 5, 2015 1:49 AM<br> <b>To:</b> Steven M. Bellistri<br> <b>Cc:</b> Aharon Canan; users(a)ovirt.org<br> <b>Subject:</b> Re: [ovirt-users] importing iscsi storage domain</span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">If you can't see the VMs= under 'VM Import' subtab under the imported storage domain, it means that = you won't be able to recover those VMs (because their configuration files w= eren't uploaded to the domain). </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">For the next time, you c= an decrease the time interval of the OVFs upload as explained below in the = thread. <br> <br> <br> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">Regarding the upgrade, i= t is possible to upgrade from 3.4 to 3.5 and once you'll upgrade the setup = and the DC compatibility version to 3.5, the OVFs of the VMs will be upload= ed to the storage domains where the VMs's disks are located on. (again, every 60 minutes by default).<br> <br> <br> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"><br> <br> <br> </span></p> </div> <div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:black"><br>   <br> Elad Ben Aharon<br> RHEV-QE storage</span></p> <div> <p class=3D"MsoNormal"><span style=3D"color:black"><img id=3D"_x0000_i1025"= src=3D"cid:image001.jpg@01D0451B.AEA225C0" height=3D"68" width=3D"150"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">    </spa= n></p> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div class=3D"MsoNormal" style=3D"text-align:center" align=3D"center"><span= style=3D"color:black"> <hr size=3D"2" width=3D"100%" align=3D"center"> </span></div> <div> <p class=3D"MsoNormal"><b><span style=3D"font-family:"Helvetica",= sans-serif;color:black">From: </span></b><span style=3D"font-family:"Helvetica",sans-serif;colo= r:black">"Steven M. Bellistri" <<a href=3D"mailto:SBellistri@ldirx.com" = target=3D"_blank">SBellistri(a)ldirx.com</a>><br> <b>To: </b>"Elad Ben Aharon" <<a href=3D"mailto:ebenahar@redhat.com" tar= get=3D"_blank">ebenahar(a)redhat.com</a>><br> <b>Cc: </b>"Aharon Canan" <<a href=3D"mailto:acanan@redhat.com" target= =3D"_blank">acanan(a)redhat.com</a>>, <a href=3D"mailto:users@ovirt.org" target=3D"_blank">users(a)ovirt.org</a><br= > <b>Sent: </b>Wednesday, 4 February, 2015 5:44:37 PM<br> <b>Subject: </b>RE: [ovirt-users] importing iscsi storage domain</span><spa= n style=3D"color:black"></span></p> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Helvetica",san= s-serif;color:black"> </span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">No, I did not wait 60 = minutes before I tried to failover.  Do, I need to start over, or can = I just failback and wait the hour for the ovfs to upload?  I do have a= question, is this feature possible for an environment that was upgraded from 3.4 to 3.5?  My production environment is 3.4,= the 3.5 environment is a clean test environment, but if I cant upgrade to = 3.5 from 3.4 then this will not be a good DR option for me.  </span><span style=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">thanks</span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <div> <div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in"> <p class=3D"MsoNormal"><b><span style=3D"color:black">From:</span></b><span= style=3D"color:black"> Elad Ben Aharon [<a href=3D"mailto:ebenahar@redhat.= com" target=3D"_blank">mailto:ebenahar@redhat.com</a>] <br> <b>Sent:</b> Wednesday, February 4, 2015 8:56 AM<br> <b>To:</b> Steven M. Bellistri<br> <b>Cc:</b> Aharon Canan; <a href=3D"mailto:users@ovirt.org" target=3D"_blan= k">users(a)ovirt.org</a><br> <b>Subject:</b> Re: [ovirt-users] importing iscsi storage domain</span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">Hi Steven,</span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">In order to import the V= Ms from the imported storage domain, the VMs configuration files (which are= called OVFs) have to be uploaded first before the domain is detached from = the setup. This is being done by engine in a time interval of 60 minutes (it's configurable using rhevm-config --s= et OvfUpdateInMinutes=3D<value> and restart ovirt-engine service). Fr= om 3.5.1, the OVFs are uploaded once you move the storage domain to mainten= ance.  did you do so in the original RHEV environment? What was the version of this environment?</span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">If you didn't deactivate= the domain in the first environment and then tried to attach it to the DR = environment, the existence of the VMs in the domain depends on the OVFs upl= oad that was supposed to be done by the first engine, which is being done every 60 minutes as explained, so if= you've created those VMs and immediately destroyed the setup, those VMs pr= obably won't be available for you in the DR environment.</span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:black"><br>   <br> Elad Ben Aharon<br> RHEV-QE storage</span></p> <div> <p class=3D"MsoNormal"><span style=3D"color:black"><img id=3D"_x0000_i1027"= src=3D"cid:image001.jpg@01D0451B.AEA225C0" height=3D"68" width=3D"150" bor= der=3D"0"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">    </spa= n></p> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div class=3D"MsoNormal" style=3D"text-align:center" align=3D"center"><span= style=3D"color:black"> <hr size=3D"2" width=3D"100%" align=3D"center"> </span></div> <div> <p class=3D"MsoNormal"><b><span style=3D"font-family:"Helvetica",= sans-serif;color:black">From: </span></b><span style=3D"font-family:"Helvetica",sans-serif;colo= r:black">"Steven M. Bellistri" <<a href=3D"mailto:SBellistri@LDIRx.com" = target=3D"_blank">SBellistri(a)LDIRx.com</a>><br> <b>To: </b>"Aharon Canan" <<a href=3D"mailto:acanan@redhat.com" target= =3D"_blank">acanan(a)redhat.com</a>><br> <b>Cc: </b><a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@ovirt= .org</a><br> <b>Sent: </b>Tuesday, 3 February, 2015 6:16:01 PM<br> <b>Subject: </b>Re: [ovirt-users] importing iscsi storage domain</span><spa= n style=3D"color:black"></span></p> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Helvetica",san= s-serif;color:black"> </span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">version 3.5.1</span><s= pan style=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <div> <div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in"> <p class=3D"MsoNormal"><b><span style=3D"color:black">From:</span></b><span= style=3D"color:black"> Aharon Canan [<a href=3D"mailto:acanan@redhat.com" = target=3D"_blank">mailto:acanan@redhat.com</a>] <br> <b>Sent:</b> Tuesday, February 3, 2015 6:22 AM<br> <b>To:</b> Steven M. Bellistri<br> <b>Cc:</b> <a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@ovirt= .org</a><br> <b>Subject:</b> Re: [ovirt-users] importing iscsi storage domain</span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">What version are you using?</span><span styl= e=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">Regards, <br> __________________________________________________<br> </span><strong><span style=3D"font-size:10.0pt;font-family:"Comic Sans= MS";color:#3366FF">Aharon Canan</span></strong><span style=3D"font-si= ze:10.0pt;font-family:"Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= int phone - 8272036</span><span style=3D"font-size:10.0pt;font-family:&quot= ;Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= ext phone - +97297692036</span><span style=3D"font-size:10.0pt;font-family:= "Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= email - <a href=3D"mailto:acanan@redhat.com" target=3D"_blank"> acanan(a)redhat.com</a></span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div class=3D"MsoNormal" style=3D"text-align:center" align=3D"center"><span= style=3D"color:black"> <hr size=3D"2" width=3D"100%" align=3D"center"> </span></div> <blockquote style=3D"border:none;border-left:solid #1010FF 1.5pt;padding:0i= n 0in 0in 4.0pt;margin-left:3.75pt;margin-top:5.0pt;margin-bottom:5.0pt"> <p class=3D"MsoNormal"><b><span style=3D"font-family:"Helvetica",= sans-serif;color:black">From: </span></b><span style=3D"font-family:"Helvetica",sans-serif;colo= r:black">"Steven M. Bellistri" <<a href=3D"mailto:SBellistri@ldirx.com" = target=3D"_blank">SBellistri(a)ldirx.com</a>><br> <b>To: </b>"Aharon Canan" <<a href=3D"mailto:acanan@redhat.com" target= =3D"_blank">acanan(a)redhat.com</a>><br> <b>Cc: </b><a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@ovirt= .org</a><br> <b>Sent: </b>Monday, February 2, 2015 8:12:00 PM<br> <b>Subject: </b>RE: [ovirt-users] importing iscsi storage domain</span><spa= n style=3D"color:black"></span></p> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Helvetica",san= s-serif;color:black"> </span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">Thank you for the resp= onse.</span><span style=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">I went thru the steps = 1-9, and when I get to step 10 there is no import vms or import templates s= ub-tabs.  I am including the vdsm.log from the host.  Also, when = I do a lvs on the host, I can see the disks that reside in the imported SD, one is 30gb and the other is 40gb.  The st= orage domain I am importing is called iSCSI.</span><span style=3D"color:bla= ck"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <div> <div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in"> <p class=3D"MsoNormal"><b><span style=3D"color:black">From:</span></b><span= style=3D"color:black"> Aharon Canan [<a href=3D"mailto:acanan@redhat.com" = target=3D"_blank">mailto:acanan@redhat.com</a>] <br> <b>Sent:</b> Sunday, February 1, 2015 9:55 AM<br> <b>To:</b> Steven M. Bellistri<br> <b>Cc:</b> <a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@ovirt= .org</a><br> <b>Subject:</b> Re: [ovirt-users] importing iscsi storage domain</span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">Hi</span><span style=3D"color:black"></span>= </p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">Please check below link for info, ovirt vers= ion should be 3.5</span><span style=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"><a href=3D"http://www.ovirt.org/Features/Imp= ortStorageDomain" target=3D"_blank">http://www.ovirt.org/Features/ImportSto= rageDomain</a></span><span style=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">please be aware to step 10 under "<span clas= s=3D"mw-headline">Work flow for Import block Storage Domain - UI flow</span= >"</span><span style=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">In case it is not working, please add exact = steps and engine/vdsm logs so we will be able to check </span><span style=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">Regards, <br> __________________________________________________<br> </span><strong><span style=3D"font-size:10.0pt;font-family:"Comic Sans= MS";color:#3366FF">Aharon Canan</span></strong><span style=3D"font-si= ze:10.0pt;font-family:"Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= int phone - 8272036</span><span style=3D"font-size:10.0pt;font-family:&quot= ;Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= ext phone - +97297692036</span><span style=3D"font-size:10.0pt;font-family:= "Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= email - <a href=3D"mailto:acanan@redhat.com" target=3D"_blank"> acanan(a)redhat.com</a></span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div class=3D"MsoNormal" style=3D"text-align:center" align=3D"center"><span= style=3D"color:black"> <hr size=3D"2" width=3D"100%" align=3D"center"> </span></div> <blockquote style=3D"border:none;border-left:solid #1010FF 1.5pt;padding:0i= n 0in 0in 4.0pt;margin-left:3.75pt;margin-top:5.0pt;margin-bottom:5.0pt"> <p class=3D"MsoNormal"><b><span style=3D"font-family:"Helvetica",= sans-serif;color:black">From: </span></b><span style=3D"font-family:"Helvetica",sans-serif;colo= r:black">"Steven M. Bellistri" <<a href=3D"mailto:SBellistri@LDIRx.com" = target=3D"_blank">SBellistri(a)LDIRx.com</a>><br> <b>To: </b>"<a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@ovir= t.org</a>" <<a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@o= virt.org</a>><br> <b>Sent: </b>Friday, January 30, 2015 12:18:54 AM<br> <b>Subject: </b>[ovirt-users] importing iscsi storage domain</span><span st= yle=3D"color:black"></span></p> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Helvetica",san= s-serif;color:black"> </span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:black">I am trying to test fail= ing over to a DR site using the storage domain import.  The DR site sh= ows that it imported the iscsi storage domain, and activates it in the data= center, but none of the vm=E2=80=99s or anything shows up.  What am I missing.</span></p> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <p class=3D"MsoNormal"><span style=3D"color:black">thanks</span></p> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <p class=3D"MsoNormal"><span style=3D"color:black">Steven Bellistri</span><= /p> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"He= lvetica",sans-serif;color:black"><br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delivering this message to the intended = recipient, you are hereby notified that any review, dissemination, distribu= tion, printing or copying of this email message and/or any attachments is s= trictly prohibited. If you have received this transmission in error, please notify the sender immediately = at 1-866-516-3121 and permanently delete this email and any attachments. <br> _______________________________________________<br> Users mailing list<br> <a href=3D"mailto:Users@ovirt.org" target=3D"_blank">Users(a)ovirt.org</a><br= > <a href=3D"http://lists.ovirt.org/mailman/listinfo/users" target=3D"_blank"= >http://lists.ovirt.org/mailman/listinfo/users</a></span><span style=3D"col= or:black"></span></p> </blockquote> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"He= lvetica",sans-serif;color:black"><br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delivering this message to the intended = recipient, you are hereby notified that any review, dissemination, distribu= tion, printing or copying of this email message and/or any attachments is s= trictly prohibited. If you have received this transmission in error, please notify the sender immediately = at 1-866-516-3121 and permanently delete this email and any attachments. </span><span style=3D"color:black"></span></p> </blockquote> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"He= lvetica",sans-serif;color:black"><br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delivering this message to the intended = recipient, you are hereby notified that any review, dissemination, distribu= tion, printing or copying of this email message and/or any attachments is s= trictly prohibited. If you have received this transmission in error, please notify the sender immediately = at 1-866-516-3121 and permanently delete this email and any attachments. <br> _______________________________________________<br> Users mailing list<br> <a href=3D"mailto:Users@ovirt.org" target=3D"_blank">Users(a)ovirt.org</a><br= > <a href=3D"http://lists.ovirt.org/mailman/listinfo/users" target=3D"_blank"= >http://lists.ovirt.org/mailman/listinfo/users</a></span><span style=3D"col= or:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"Ti= mes New Roman",serif;color:black"> </span><span style=3D"color:bl= ack"></span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"He= lvetica",sans-serif;color:black"><br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delivering this message to the intended = recipient, you are hereby notified that any review, dissemination, distribu= tion, printing or copying of this email message and/or any attachments is s= trictly prohibited. If you have received this transmission in error, please notify the sender immediately = at 1-866-516-3121 and permanently delete this email and any attachments.</s= pan><span style=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"Ti= mes New Roman",serif;color:black"> </span><span style=3D"color:bl= ack"></span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"He= lvetica",sans-serif;color:black"><br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delivering this message to the intended = recipient, you are hereby notified that any review, dissemination, distribu= tion, printing or copying of this email message and/or any attachments is s= trictly prohibited. If you have received this transmission in error, please notify the sender immediately = at 1-866-516-3121 and permanently delete this email and any attachments.</s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"Ti= mes New Roman",serif;color:black"> </span></p> </div> </div> </div> <br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments. </div><div><br></div></div></body></html> ------=_Part_9372915_292966117.1423648670110 Content-Type: image/jpeg; name=image001.jpg Content-Disposition: attachment; filename=image001.jpg Content-Transfer-Encoding: base64 Content-Description: image001.jpg Content-ID: <image001.jpg(a)01D0451B.AEA225C0> /9j/4AAQSkZJRgABAQEASABIAAD/4gxYSUNDX1BST0ZJTEUAAQEAAAxITGlubwIQAABtbnRyUkdC IFhZWiAHzgACAAkABgAxAABhY3NwTVNGVAAAAABJRUMgc1JHQgAAAAAAAAAAAAAAAAAA9tYAAQAA AADTLUhQICAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABFj cHJ0AAABUAAAADNkZXNjAAABhAAAAGx3dHB0AAAB8AAAABRia3B0AAACBAAAABRyWFlaAAACGAAA ABRnWFlaAAACLAAAABRiWFlaAAACQAAAABRkbW5kAAACVAAAAHBkbWRkAAACxAAAAIh2dWVkAAAD TAAAAIZ2aWV3AAAD1AAAACRsdW1pAAAD+AAAABRtZWFzAAAEDAAAACR0ZWNoAAAEMAAAAAxyVFJD AAAEPAAACAxnVFJDAAAEPAAACAxiVFJDAAAEPAAACAx0ZXh0AAAAAENvcHlyaWdodCAoYykgMTk5 OCBIZXdsZXR0LVBhY2thcmQgQ29tcGFueQAAZGVzYwAAAAAAAAASc1JHQiBJRUM2MTk2Ni0yLjEA AAAAAAAAAAAAABJzUkdCIElFQzYxOTY2LTIuMQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAWFlaIAAAAAAAAPNRAAEAAAABFsxYWVogAAAAAAAAAAAAAAAA AAAAAFhZWiAAAAAAAABvogAAOPUAAAOQWFlaIAAAAAAAAGKZAAC3hQAAGNpYWVogAAAAAAAAJKAA AA+EAAC2z2Rlc2MAAAAAAAAAFklFQyBodHRwOi8vd3d3LmllYy5jaAAAAAAAAAAAAAAAFklFQyBo dHRwOi8vd3d3LmllYy5jaAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAABkZXNjAAAAAAAAAC5JRUMgNjE5NjYtMi4xIERlZmF1bHQgUkdCIGNvbG91ciBzcGFjZSAt IHNSR0IAAAAAAAAAAAAAAC5JRUMgNjE5NjYtMi4xIERlZmF1bHQgUkdCIGNvbG91ciBzcGFjZSAt IHNSR0IAAAAAAAAAAAAAAAAAAAAAAAAAAAAAZGVzYwAAAAAAAAAsUmVmZXJlbmNlIFZpZXdpbmcg Q29uZGl0aW9uIGluIElFQzYxOTY2LTIuMQAAAAAAAAAAAAAALFJlZmVyZW5jZSBWaWV3aW5nIENv bmRpdGlvbiBpbiBJRUM2MTk2Ni0yLjEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHZpZXcAAAAA ABOk/gAUXy4AEM8UAAPtzAAEEwsAA1yeAAAAAVhZWiAAAAAAAEwJVgBQAAAAVx/nbWVhcwAAAAAA AAABAAAAAAAAAAAAAAAAAAAAAAAAAo8AAAACc2lnIAAAAABDUlQgY3VydgAAAAAAAAQAAAAABQAK AA8AFAAZAB4AIwAoAC0AMgA3ADsAQABFAEoATwBUAFkAXgBjAGgAbQByAHcAfACBAIYAiwCQAJUA mgCfAKQAqQCuALIAtwC8AMEAxgDLANAA1QDbAOAA5QDrAPAA9gD7AQEBBwENARMBGQEfASUBKwEy ATgBPgFFAUwBUgFZAWABZwFuAXUBfAGDAYsBkgGaAaEBqQGxAbkBwQHJAdEB2QHhAekB8gH6AgMC DAIUAh0CJgIvAjgCQQJLAlQCXQJnAnECegKEAo4CmAKiAqwCtgLBAssC1QLgAusC9QMAAwsDFgMh Ay0DOANDA08DWgNmA3IDfgOKA5YDogOuA7oDxwPTA+AD7AP5BAYEEwQgBC0EOwRIBFUEYwRxBH4E jASaBKgEtgTEBNME4QTwBP4FDQUcBSsFOgVJBVgFZwV3BYYFlgWmBbUFxQXVBeUF9gYGBhYGJwY3 BkgGWQZqBnsGjAadBq8GwAbRBuMG9QcHBxkHKwc9B08HYQd0B4YHmQesB78H0gflB/gICwgfCDII RghaCG4IggiWCKoIvgjSCOcI+wkQCSUJOglPCWQJeQmPCaQJugnPCeUJ+woRCicKPQpUCmoKgQqY Cq4KxQrcCvMLCwsiCzkLUQtpC4ALmAuwC8gL4Qv5DBIMKgxDDFwMdQyODKcMwAzZDPMNDQ0mDUAN Wg10DY4NqQ3DDd4N+A4TDi4OSQ5kDn8Omw62DtIO7g8JDyUPQQ9eD3oPlg+zD88P7BAJECYQQxBh EH4QmxC5ENcQ9RETETERTxFtEYwRqhHJEegSBxImEkUSZBKEEqMSwxLjEwMTIxNDE2MTgxOkE8UT 5RQGFCcUSRRqFIsUrRTOFPAVEhU0FVYVeBWbFb0V4BYDFiYWSRZsFo8WshbWFvoXHRdBF2UXiReu F9IX9xgbGEAYZRiKGK8Y1Rj6GSAZRRlrGZEZtxndGgQaKhpRGncanhrFGuwbFBs7G2MbihuyG9oc AhwqHFIcexyjHMwc9R0eHUcdcB2ZHcMd7B4WHkAeah6UHr4e6R8THz4faR+UH78f6iAVIEEgbCCY IMQg8CEcIUghdSGhIc4h+yInIlUigiKvIt0jCiM4I2YjlCPCI/AkHyRNJHwkqyTaJQklOCVoJZcl xyX3JicmVyaHJrcm6CcYJ0kneierJ9woDSg/KHEooijUKQYpOClrKZ0p0CoCKjUqaCqbKs8rAis2 K2krnSvRLAUsOSxuLKIs1y0MLUEtdi2rLeEuFi5MLoIuty7uLyQvWi+RL8cv/jA1MGwwpDDbMRIx SjGCMbox8jIqMmMymzLUMw0zRjN/M7gz8TQrNGU0njTYNRM1TTWHNcI1/TY3NnI2rjbpNyQ3YDec N9c4FDhQOIw4yDkFOUI5fzm8Ofk6Njp0OrI67zstO2s7qjvoPCc8ZTykPOM9Ij1hPaE94D4gPmA+ oD7gPyE/YT+iP+JAI0BkQKZA50EpQWpBrEHuQjBCckK1QvdDOkN9Q8BEA0RHRIpEzkUSRVVFmkXe RiJGZ0arRvBHNUd7R8BIBUhLSJFI10kdSWNJqUnwSjdKfUrESwxLU0uaS+JMKkxyTLpNAk1KTZNN 3E4lTm5Ot08AT0lPk0/dUCdQcVC7UQZRUFGbUeZSMVJ8UsdTE1NfU6pT9lRCVI9U21UoVXVVwlYP VlxWqVb3V0RXklfgWC9YfVjLWRpZaVm4WgdaVlqmWvVbRVuVW+VcNVyGXNZdJ114XcleGl5sXr1f D19hX7NgBWBXYKpg/GFPYaJh9WJJYpxi8GNDY5dj62RAZJRk6WU9ZZJl52Y9ZpJm6Gc9Z5Nn6Wg/ aJZo7GlDaZpp8WpIap9q92tPa6dr/2xXbK9tCG1gbbluEm5rbsRvHm94b9FwK3CGcOBxOnGVcfBy S3KmcwFzXXO4dBR0cHTMdSh1hXXhdj52m3b4d1Z3s3gReG54zHkqeYl553pGeqV7BHtje8J8IXyB fOF9QX2hfgF+Yn7CfyN/hH/lgEeAqIEKgWuBzYIwgpKC9INXg7qEHYSAhOOFR4Wrhg6GcobXhzuH n4gEiGmIzokziZmJ/opkisqLMIuWi/yMY4zKjTGNmI3/jmaOzo82j56QBpBukNaRP5GokhGSepLj k02TtpQglIqU9JVflcmWNJaflwqXdZfgmEyYuJkkmZCZ/JpomtWbQpuvnByciZz3nWSd0p5Anq6f HZ+Ln/qgaaDYoUehtqImopajBqN2o+akVqTHpTilqaYapoum/adup+CoUqjEqTepqaocqo+rAqt1 q+msXKzQrUStuK4trqGvFq+LsACwdbDqsWCx1rJLssKzOLOutCW0nLUTtYq2AbZ5tvC3aLfguFm4 0blKucK6O7q1uy67p7whvJu9Fb2Pvgq+hL7/v3q/9cBwwOzBZ8Hjwl/C28NYw9TEUcTOxUvFyMZG xsPHQce/yD3IvMk6ybnKOMq3yzbLtsw1zLXNNc21zjbOts83z7jQOdC60TzRvtI/0sHTRNPG1EnU y9VO1dHWVdbY11zX4Nhk2OjZbNnx2nba+9uA3AXcit0Q3ZbeHN6i3ynfr+A24L3hROHM4lPi2+Nj 4+vkc+T85YTmDeaW5x/nqegy6LzpRunQ6lvq5etw6/vshu0R7ZzuKO6070DvzPBY8OXxcvH/8ozz GfOn9DT0wvVQ9d72bfb794r4Gfio+Tj5x/pX+uf7d/wH/Jj9Kf26/kv+3P9t////4QCMRXhpZgAA TU0AKgAAAAgABQESAAMAAAABAAEAAAEaAAUAAAABAAAASgEbAAUAAAABAAAAUgEoAAMAAAABAAIA AIdpAAQAAAABAAAAWgAAAAAAAABIAAAAAQAAAEgAAAABAAOgAQADAAAAAQABAACgAgAEAAAAAQAA AJagAwAEAAAAAQAAAEQAAAAA/9sAQwABAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEB AQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEB/9sAQwEBAQEBAQEBAQEBAQEBAQEBAQEBAQEB AQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEB/8AAEQgARACWAwEiAAIR AQMRAf/EAB8AAAEFAQEBAQEBAAAAAAAAAAABAgMEBQYHCAkKC//EALUQAAIBAwMCBAMFBQQEAAAB fQECAwAEEQUSITFBBhNRYQcicRQygZGhCCNCscEVUtHwJDNicoIJChYXGBkaJSYnKCkqNDU2Nzg5 OkNERUZHSElKU1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6g4SFhoeIiYqSk5SVlpeYmZqio6Slpqeo qaqys7S1tre4ubrCw8TFxsfIycrS09TV1tfY2drh4uPk5ebn6Onq8fLz9PX29/j5+v/EAB8BAAMB AQEBAQEBAQEAAAAAAAABAgMEBQYHCAkKC//EALURAAIBAgQEAwQHBQQEAAECdwABAgMRBAUhMQYS QVEHYXETIjKBCBRCkaGxwQkjM1LwFWJy0QoWJDThJfEXGBkaJicoKSo1Njc4OTpDREVGR0hJSlNU VVZXWFlaY2RlZmdoaWpzdHV2d3h5eoKDhIWGh4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5 usLDxMXGx8jJytLT1NXW19jZ2uLj5OXm5+jp6vLz9PX29/j5+v/aAAwDAQACEQMRAD8A/v4ooooA KK+T/wBrX9ub9kr9hbwH/wALH/aw+PHgD4LeGp47s6OninVTJ4k8VXNlaz3k+neC/BmlxX/i7xnq ogtpWXTfDWi6ndtj/Viv58Pil/weC/8ABNXwNry6R4O+FH7YPxZsMTlvEvh/4WeEvBejsIfJ2tb2 /wAVviD4H12bzzK/lI2kxSgQsZY4y0e8bS3f3jSlLZN+ib3P6v6K/nn/AGYP+Dn3/gkv+0hd6Lo2 t/GDxV+zN4h1uEPBZ/tQeDZ/hr4chuhFFJLYXfxPtL3xB8KrK6iMpQLfeM7VLjypZbZ5oUMlf0Fa bqenazp9lq2kX9lqul6lawX2nalp11BfWF/ZXUazW15ZXtrJLbXdrcROksFxbyyQyxsro7KQaHdb 7+ZKaklKLUk1dNO6a7prRrzL1FFFAwooooAKKKKACiiigAooooAKKKKACiiigAr8jf8Agsv/AMFT vA//AASr/ZTvvinc2+leJvjb8Q7zUPBH7Pnw71SS6Fj4h8axaTc6rqXifxOLANfwfD/4e6RBJ4i8 XT2my71HZpvhXSpRrviPSkk/XEnAJ9AT+XNf5fH/AAc2/tPab8ev+CxOr/Bfx9d6ovwh/Zj8H+CP gtomnXd1BD4bm8X+JvDejfGPx7rDi2m+0pb6nrPiz4a6DrVxcG2ZpPCGn2xjFgtxNc8uOxSwOCxe NlSrV44TDV8S6OHh7TEVlQpyqOlQp3j7StU5eWnDmjzTaV1e57vC+RVOKeJeH+GqOPy3KqvEGd5X ktPM85xTwWUZdPNMbQwSx+aYxU6zwuX4R1vrGNxCpVXRw9OpUVObjyv8KfG37Q/xx/b2/am1z4z/ ALRnjbxZ8VfGviK01bVfEmqaxdta6pqPh/Q47m503wXoljBcx6V4L8GrqOrx2mleBPDLad4Y060f 7PeDWdTkvdf1D0rwv4P+C3jc2c1r8Gb3R2aFmkl1jwRd6LZWt1GiGezuZZylpeTwSs0AdFurSSaO RElfaRWt4x+FNzo9vpPiH4I6d4W8JeLdEnnkaOPTba0s/Euk3dv5dzo+o3MSHzoXZYbqATl45JYk 2z20nlXUXEaV+0L420LW9L0H4sfDa58MpeXtpptx4itpLqLTbee8mit4r2T7RHc6Z/Z4lk3XDW+v TyW6HISYKSf50z3Psz43jPM+Gq1eM6GD9lHK6OfvLM0wVSlUxTxGInlcakaWZU8VSnhnSqYerOov ZvDyUpWhH/Zjwp8J+BfouVcPwP434DKa2HzbiKnmVXj3MfCKlxzwHxRhcwwmQUsnyrC8d18FXx/B OKyPHYfO6eYYTOMDh8HUjjY5thqlGipYirb8ffAEXnh/xne6K+iWmrxWq3XhGDRNBh0e5SztInfU /Duv3dpcQW/iKw1uANbx293YRwWcjKzLeISlfq3/AMEB/wDgvn8S/wDgn78UfC/7P/x68Sa/44/Y r8e+ItM0vXNE1XUvt7fs8Pq7Q2h+K/w1Go3QfQfBGgyeVqHxV+F+kSHw6fDr6v448GaPousaDrOm eJ/k4EHByGXrkchl65GPvAjkY4bt1r84fiN+zr4r8Ox6x8R9KGn6lZW+qax4hvfCnlNFqGn6FNql 3eGxkcSTWWrQjTJXi1S1iWB1tpbi3iF6keybv8K/EDmljMr4jzOlB1sRgo5VPEONK9arTlQqYaPJ BQhGX1ejUc6jhB4irVnUnKviff8Ak/p7/REVGjw3x34L8D4/Ewy/KOJ6/H2GyhV8c6eX4DG4fNMJ nVV4jE1MRiK1P+18xwiw2FWIrwyjAYKhhMNRyrJZLDf7idhf2Wq2Nnqem3dtf6fqFrb31hfWc0dz Z3tldwpcWt3aXELPFcW1zBJHPBNE7RyxSI6MVYGrdfgl/wAG1P7SfiD9pD/gkp8A28Ya/H4m8XfA vVvHX7OGra2DdGfUdJ+E/iG4034f3N613eX88l83w0u/CEd5O91J9quInuQsayrGv7AftCftH/A7 9lH4Xa18a/2i/iV4d+Enwq8O3mi6frnjnxXLdQaHpd54i1W20TRILua0truWNtS1a8tdPtiYSjXN xFGzKXFf0Mf47b6nttFfHPhr/goH+xr40/aE8K/sqeD/ANoHwH4p/aD8ZeAF+KOj/C7w/dX2r+I4 PAsvh3TvFtprviBbKyls/Cn9oeG9W07WtN03xPdaVq9/p17b3VrYSRyqT4b+0B/wWX/4Jgfsu/FK 7+C3xy/bQ+DPgr4oaTqMGleJPB/9tXfiHU/B9/cW0d3HaeMz4ZsdYtvCd2LaaGea016eyureKeCS 4gjSeJnAP04pGYKrMxCqoLMxIAAAySSSAABySTgdSa4TwD8Ufhx8U/h94d+LHw28d+EvHfwy8W6D B4o8M+P/AAn4g0zXfB+u+HbiA3MWtaZ4h0+5n0y607yVd5LqO4McPlyrMY2ikC/mXqX/AAWi/wCC VvxC8T+J/gH4M/bp/Z98Q/E7V9I8R+HtG0iw8ZwvouueIJdK1G1g0TRPGkkMfgvV9Turlfs9lbWG v3DX9y8VrZG4uZoonAP1tWRHVXRlZGVXV1IKsrAFWVgSrKQQQykg560+v4Rf+CEP7Tf7QfgX/g35 /wCClfxg8M/FfxvffFH4B+OvFx+D+ueLNT1n4ny+AL3w3+zZ8A9XstC0LQPGV5rsSaLZ+J9Q1i5k 8E2cdvpX27UNStLKws2udif12eM/+Cg/7G3wz8TXfg34h/tC+A/DOsaLr+keDfFOrahLqv8Awgng 7xtrMmkWuneD/HXxNtdLn+G3gTxZqF9ruj2ln4a8W+K9G1m4u9X0u1isjPf2scoB9nUV5h8V/jV8 J/gZ4M/4WF8XviF4V+HngxtW0Hw/ba/4o1e206z1LxD4q1G30jwv4c0ZWZrjXPEnibVru10zw54f 0iG+1jXdRuYLLSrO7uZo4287+D37X37OPx517xR4T+F/xQ0vW/GngvRLHxP4p8B6xpPibwR8QtE8 LardX9jpfiu88AePNE8NeMR4T1S+0rUrDTfFEWiSaFqF/YXtlaX81zbTRIAfSdFfmR8Mf+Cpv7Nf j/48fHz4SXXxB8FaTovwt1j4P6H4H8SQ3/iS9vPiFffErwmmualv01/DNvDo39i61c2vhy0hS6vT fSrLeTTWyyxwp+m9ABRRRQA1+Vb/AHT/ACNf5IH/AAcV/Bf4laj/AMFs/wBqrwBo3hPXtb8WfEjx /wCC/G3w90HQtC1zxLr/AI40Txv8C/hXBYSeGPDfhjTdc8Q635GpeCfE2kXkdlpU5jutPkWRRBLH K/8Arg1mNo2kNqQ1h9M09tVVFiXUzY2h1BYwGRY1vjCbsIFdlCibaFYgAAnIHW/VO6fW61T9b6n+ bB/wT2/4Ie/Gr9o3/gnd8Q/ip8Kvixf63+2H8KPjN4g8A+IP2KPjH4Yt/hJc+CdD8PanYxWHhLxV 4m8WaVL8Tvhx8RPF/gbULT4q+D5PFmljwTLpWo6J4VuPDmn28154ktvy8+PGlat+zH8avG37O37R miy/Bv4s+AdWuNM13wp48utPtLOaBHzp+v8Ah/xDLJFonijwl4htGi1Twz4o0x1sdZ0yaOQxWOpQ ajpOm/61Ol/Br4U6J8U/FHxv0b4e+EtK+L3jfwvoXgrxl8R9O0SysvGHizwr4Yurq88N6H4l1u3j ju9dsfD9xfXraKmpvcvpa3l1FZPDDcTI+H8UvgF8IfivNa+IfGnwh+D3j7xx4c0++j8D+Ivid8N/ DvjiTw5qEkTyWTQzalaHVodNS/EM97ZaZqVhLcRq6wXFvMyzL+fcQ+GXC3EVWeKq4arl2OnJznjc sqQw86s27uVejOnVw1SUpNynU9jGvOTvKsz+v/B36cPj34OYHDZFgM8wHGXCmFpwoYfhrjnC184w 2Cw0EoxoZZmWHxmAzrBUqdOMKWGwrzGvlmFpQjCjl6Wh/kan4kfDMIX/AOFnfDLYozgfELwaW2hc /LCNa804HARYy5PyqhOBXzx8af2j/CFl4a1vw34K1EeIvEOr2N1pX23T45H0zSReRNbzzG7ePy72 /WKR0trG2E2Lhla7aKNWr/UD/bRvvCX7KH7FPxY8efFb9nb9l7xH+1V49ufEXw+/Zg+Hf7O/wjGp eIvjJ+0b4s8Can4b+Fll4M0zXfCGreLJPHWorY6p4r8Qm103XLb4a/D3RdaudS17xHonhTVPEt7/ ACA/Av8A4M7v26/iP8M/CnxG+Ifxg/Z5+BPjfV/D/h3VdP8Ahr4m0/4j+LPGHhN10TTGtLXxvceH Lmw8IaV4vtLhHn1zQ9Li8YaPYaqJbV9c1+IzXEvz2VeC/DuXY/D42tjsxzBYarCvDDV3h6dGdSnO M6ftvZUVOpBSV5QU4Rnop80HKMv2Ljz9pn4ycY8KZxwxlvC3BfCU87wGJyzFZ3lcc4xmZ4fB42hU w+L/ALO+v5jUwuExNWlUlThiZ4fE1MPGUp4d0sRGliKf9GH/AAaOfD/VPBv/AASkutdvWDad8R/2 pPjz4p8OOs808Uuj6JqWjfDuWeEyfu/KfW/BerIrwErKUaR/3pevbv8Ag6NtoLz/AII1/tAWl1GJ ba6+Jn7LdtcRHBEsE/7SXwzimjIYMpDxsykMGXnkGv0z/Yp+EvhP9j74W/CX9hT4eeEfFH/CCfs7 fBbwf4b0r4k6nDYR2vjLU9PtreLxBrGpx6fZWNtH4g8T61dX/iTULi2iS2vNRvtRWG2thbMi+af8 Fcf2GvGn/BRj9hz4jfsp+APHXhX4ceJ/Gvi34R+JLHxZ4z0zWNZ8PWCfDX4oeFviFc297pugz2uq XP8AaUPh1tOiW2urUpJciRriILur9i/H11fzfU/zeSSSSSSWiSVkl0SS0SXRI/Ej9iP9lP4E/sM/ 8EK7z/gp58L/AIeaX4s/b0vf+Cc/xA/acuv2nPiI194t+Kx8beMfgbfeIbfR7bxNfXMl9p3gnwnp 40rw/pPhzT3trFtI0G0uL0TajJdX8v5T/wDBGbxj+0t4P/4J96hpvgT/AIIPf8PDvDn7SfiX4w3v xp/ap8XfG/4O215+0Tc3njbxX4T1nTte0b4iad4k8U2Nn4bt7S68KX1pf6lG+q67a654smtodY12 /ubj+2/9kL9lCL4DfsG/AP8AYv8Aild+HviVafDL9m3wZ+z748u7Oyu4fDPjjT9C8EQeCvEDxafq GLyLSdfskuAbW6PnpBcmN2LLuP4UfCP/AIItf8FRP+Ce/iTxx4L/AOCXX/BSj4d+BP2TPFfiO98R eGvgB+0n8F5fiGPhteaqbE3c2j67bTaiuo38cVktlPqek2/g+LxFAF1bxZo2veNrjVvGGqAH4g69 4I/4KDf8E6/+Den/AIKP/CD41/CD4p/ADwz8RP2tvh1ofwe8A+MvFug+LtW074C/tAa5oMHxb+G2 j694d8S+LpBouttpmoeEdc1H7Ta6tr1z4y13X/sVjq+vXjxf0TfsVf8ABJD/AIJ2eIv+CM/wt8B+ JvgP8GviZD8cv2TPDPxP+I3xjk8LaPJ428VeO/G/wyt/Fk3j7w548CyeIvCyeHdRntv+FdWfh/V7 LTPA2h6NoujaDBa6dp0UI+3IP+CfHxd/aS/4J7/Ff9jP/gpj+0Np37S3jn4wal4pv9T+Mfwz+Huk /CmfwEbnXLLxT8Mpfh/opXUrCHV/g34k0+w1Hwjrl/Y+ZfjTbFdds7+Y39xf/kr+zj/wRK/4K3/C j4Yf8MQeL/8AgrLoif8ABPtlfw/qWifDD4STaB8e5/hjqB1AeJvhp4C8XeIZ9bu/hFofi5L65iuo tK8XeI7LwdZ38uk+BLTSNEtbPS4gD8mf+CMouZ/+DaT/AILJG3uLjTL+/wDEfxKlTULYul3aahqf 7JH7O0zatatG9u0Vyt3ctqNqYZIBDMYzBJEqIy/3o6R8EfhTbfBRPgIPAnhuf4QXvgW68A6n4Bvd LtL/AMOax4U1vSJtN13S9b029int9aTX4L29fXptUS7uNaur69vNUlurm7uJZPwN/Yy/4Ia/FP8A ZQ/4Jp/8FBv2B4/jN8M9avP2tfGvjzXvhd4qg0bxnNofw88P+Jvh14F+HWg6L4wt7y6g1rX5tB03 wPZS3NxpV1ZtqBlkSOWzLK0X9JdtE0MEMTEFo4ooyRnBKRqhIzzglSRnnHWgD8df2Sv2jdC/Z2/4 J3fsD+F/Fdj8TP2gPi54w8Oaf8CPgR4F0S20rxL8XPjB4q+Fnh/xqlvdXmu+I9Q8PeEPDv8AYfw1 +Hep+IvHfxL8c+IvCvhPRra0nN7rA1bWdG0nVPO/j94z/afl/wCCgf8AwSY8Y/Eb4CfB/wCDWkeI v2gP2hvg9L4r8NfHO9+KPxZ1Pwd4t/Y3+O/xG1T4XeItFHwS8JeHtN8Fa74n+EXgfx5rM+i/ErXR b+L/AIc+DYY9L1CEnV7T2u3/AGEPjp4A+Gf7EGs/Cf4kfDWP9oL9i3WfiiRY+LtL8RSfB74yeAPj JY+IdJ8ffDrWb+xhuPGHgK7uEuvCPiXwz8QdG0rX7/w74l8IRWl94c8R+GNa1rSb3e8WfsoftXfH j9pD9jP9pL4zfEn4VeCNO/ZR+MPjjx5afs8/DNPE3ivwdq+mePPgL8U/hDqPibWPih4l0Lwx4m8U fE7SLnx1p8fhSO38KeDvAmgeErrx7p+qaR4t8Sa54a8S+EgDuv2Zif8Ahu//AIKYZJP/ABP/ANkb v0z+z3aZ+me/+TX6JV+fmqfA/wDaa+Gv7W/xK+OnwJvfgl4t+Gv7RWg/A7R/i34H+KeqeM/BXijw H4m+EQ8U+H9Q+I/gHxF4R8LeNLTxz/wlvw+1vQNCl8BeJLLwhBpOteCtN1W18Xva6/qtpZ/V3hb/ AIW5/wALF8fHxafDH/CtnXTB8Po9LhkXXImjjC6idWuHupTcm4ctJKJLWzW1lWOGzN1C7ygA9Voo ooAKKKKACiiigDgtY+F3w+8QePvCHxS1zwlo2sfED4f6X4j0fwN4p1O2+3an4PsfF6WUPin/AIRl rl5INEvPENrp9nYavqenQ2+p3+mQLplxePp5a2bvaKKADHOefzP8ulFFFABRRRQAUUUUAFFFFABR RRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQB/9k= ------=_Part_9372915_292966117.1423648670110-- ------=_Part_9372914_326988970.1423648670110--

4 6

oVirt 3.6.0 release schedule update
by Sandro Bonazzola 19 Feb '15

19 Feb '15

Hi, here is the proposed schedule for oVirt 3.6.0. These are tentative planning dates and may change: 2015-04-22 - Feature Submission Closed 2015-05-06 - Alpha Release 2015-05-12 - Alpha Release Test Day 2015-06-16 - Feature freeze - Stable branch 2015-07-15 - Beta Release 2015-07-20 - Beta Release Test Day 2015-08-03 - String Freeze 2015-08-19 - Release Candidate 2015-08-24 - Release Candidate Test Day 2015-09-16 - Release Release management page has been updated accordingly: http://www.ovirt.org/OVirt_3.6_Release_Management oVirt Google Calendar has been updated accordingly: ICAL: https://www.google.com/calendar/ical/ppqtk46u9cglj7l987ruo2l0f8%40group.cal… XML: https://www.google.com/calendar/feeds/ppqtk46u9cglj7l987ruo2l0f8%40group.ca… HTML: https://www.google.com/calendar/embed?src=ppqtk46u9cglj7l987ruo2l0f8%40grou… Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 2

SELinux is preventing /usr/sbin/glusterfsd from write access on the sock_file
by Nathanaël Blanchet 19 Feb '15

19 Feb '15

On freshly installed el7 hosts, selinux prevents gluster from running. Setting selinux to permissive or building the relative .pp module resolves the issue. Does otopi configure selinux for gluster when installing?

2 1

Ovirt 3.5.1, Windows 2008 hangs
by wodel youchi 19 Feb '15

19 Feb '15

------=_Part_3325810_102070030.1423671665987 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Hi, I've a two nodes hosted-engine ovirt 3.5used storage is NFS4 for the: engine, vms, iso and export I have many Linux VMs and one Windows 2008 VM. The windows 2008 VMs is acting as a second AD, it's the second time in a month where the VM hangs and the cpu usage is 100%.I have this problem only with this VM only. I tried to look into vdsm logs, but no luck so far, all I found isGuestMonitor-Win2k8x64-AD2::DEBUG::2015-02-11 12:01:02,158::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`ce0bcb92-90e8-45a7-9b9f-cfed10e920d6`::Domain Metadata is not set Is there a log file where I can follow the behaviour of the VM, because for now I have no clue about what is causing this problem. any advice? PS: is there a good solution to gather and analyze all the logs from ovirt's hypervisors and engine, storage...etc? thanks in advance. ------=_Part_3325810_102070030.1423671665987 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"color:#000; background-color:#fff; font-family:He= lveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;fo= nt-size:16px"><div id=3D"yui_3_16_0_1_1423652121743_87447">Hi,</div><div id= =3D"yui_3_16_0_1_1423652121743_87448"><br></div><div id=3D"yui_3_16_0_1_142= 3652121743_82672" dir=3D"ltr">I've a two nodes hosted-engine ovirt 3.5</div= ><div id=3D"yui_3_16_0_1_1423652121743_82673" dir=3D"ltr">used storage is N= FS4 for the: engine, vms, iso and export</div><div id=3D"yui_3_16_0_1_14236= 52121743_87449" dir=3D"ltr"><br></div><div id=3D"yui_3_16_0_1_1423652121743= _87446" dir=3D"ltr">I have many Linux VMs and one Windows 2008 VM.<br></div= ><div id=3D"yui_3_16_0_1_1423652121743_87445" dir=3D"ltr">The windows 2008 = VMs is acting as a second AD, it's the second time in a month where the VM = hangs and the cpu usage is 100%.</div><div dir=3D"ltr">I have this problem = only with this VM only.<br></div><div id=3D"yui_3_16_0_1_1423652121743_8744= 4" dir=3D"ltr"><br></div><div id=3D"yui_3_16_0_1_1423652121743_87443" dir= =3D"ltr">I tried to look into vdsm logs, but no luck so far, all I found is= </div><div dir=3D"ltr">GuestMonitor-Win2k8x64-AD2::DEBUG::2015-02-11 12:01:= 02,158::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=3D`ce0bcb92-90e8-45a7-9b= 9f-cfed10e920d6`::Domain Metadata is not set<br></div><div dir=3D"ltr"><br>= </div><div dir=3D"ltr">Is there a log file where I can follow the behaviour= of the VM, because for now I have no clue about what is causing this probl= em.</div><div id=3D"yui_3_16_0_1_1423652121743_87455" dir=3D"ltr"><br></div= ><div id=3D"yui_3_16_0_1_1423652121743_87466" dir=3D"ltr">any advice?</div>= <div id=3D"yui_3_16_0_1_1423652121743_87454" dir=3D"ltr"><br></div><div id= =3D"yui_3_16_0_1_1423652121743_87467" dir=3D"ltr">PS: is there a good solut= ion to gather and analyze all the logs from ovirt's hypervisors and engine,= storage...etc?<br></div><div id=3D"yui_3_16_0_1_1423652121743_87451" dir= =3D"ltr"><br></div><div id=3D"yui_3_16_0_1_1423652121743_87450" dir=3D"ltr"= >thanks in advance.</div><div id=3D"yui_3_16_0_1_1423652121743_82653"><br><= /div></div></body></html> ------=_Part_3325810_102070030.1423671665987--

4 6

messages from journal in centos7 hosts
by Vadq 19 Feb '15

19 Feb '15

Hi, ovirt 3.5.1, engine on centos7 + storage type iscsi( using LIO™ on one of the vdsm host) + four hosts on centos7 After installation of vdsm at all cenos7 hosts in cluster in /var/log/messages every few seconds have such record Feb 19 16:47:08 kvm05 journal: metadata not found: Requested metadata element is not present Feb 19 16:47:19 kvm05 journal: metadata not found: Requested metadata element is not present Feb 19 16:47:23 kvm05 journal: metadata not found: Requested metadata element is not present Feb 19 16:47:34 kvm05 journal: metadata not found: Requested metadata element is not present Feb 19 16:47:38 kvm05 journal: metadata not found: Requested metadata element is not present is it possible to fix this without disabling systemd-journald? -- Thanks, Vadim

1 0

RHEV 3.5 problem with connecting rhev-m to nodes
by Jakub Bittner 19 Feb '15

19 Feb '15

Hello, after restart we had problem with manager to connect to nodes. All nodes are down and not reachable. When I try to remove and readd to engine it fails too. 10 days ago we changed SSL certs of rhev-m apache to IPA's generated. We have this in logs: 2015-02-19 11:41:33,491 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.io.EOFException: SSL peer shut down incorrectly at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:648) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:494) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) [:1.7.0_75] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_75] at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_75] at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] Caused by: java.io.EOFException: SSL peer shut down incorrectly at sun.security.ssl.InputRecord.read(InputRecord.java:482) [jsse.jar:1.7.0_75] at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:934) [jsse.jar:1.7.0_75] at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1332) [jsse.jar:1.7.0_75] at sun.security.ssl.SSLSocketImpl.writeRecord(SSLSocketImpl.java:709) [jsse.jar:1.7.0_75] at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:122) [jsse.jar:1.7.0_75] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) [rt.jar:1.7.0_75] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) [rt.jar:1.7.0_75] at java.io.FilterOutputStream.flush(FilterOutputStream.java:140) [rt.jar:1.7.0_75] at java.io.FilterOutputStream.flush(FilterOutputStream.java:140) [rt.jar:1.7.0_75] at org.apache.xmlrpc.client.XmlRpcCommonsTransport$1$1.close(XmlRpcCommonsTransport.java:204) [xmlrpc-client.jar:3.1.3] at org.apache.xmlrpc.client.XmlRpcHttpTransport$ByteArrayReqWriter.write(XmlRpcHttpTransport.java:55) [xmlrpc-client.jar:3.1.3] at org.apache.xmlrpc.client.XmlRpcCommonsTransport$1.writeRequest(XmlRpcCommonsTransport.java:214) [xmlrpc-client.jar:3.1.3] at org.apache.commons.httpclient.methods.EntityEnclosingMethod.writeRequestBody(EntityEnclosingMethod.java:499) [commons-httpclient.jar:] at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:2114) [commons-httpclient.jar:] at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1096) [commons-httpclient.jar:] at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) [commons-httpclient.jar:] at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) [commons-httpclient.jar:] at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) [commons-httpclient.jar:] at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) [commons-httpclient.jar:] at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] at com.sun.proxy.$Proxy97.getVdsCapabilities(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_75] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_75] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_75] at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_75] at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:255) [vdsbroker.jar:] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_75] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_75] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_75] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_75] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_75] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_75] 2015-02-19 11:41:33,506 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-30) Failed to refresh VDS , vds = 3c9f5126-8c0e-4037-ab61-29de6d02d487 : nodep01.example.com, VDS Network Error, continuing.

3 3

movirt -> ovirt 3.5.1 -> server error 500
by Markus Stockhausen 19 Feb '15

19 Feb '15

This is a multi-part message in MIME format. ------=_NextPartTM-000-01931aef-0e79-4067-9583-6cee81c33885 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi,=0A= =0A= just installed movirt on my mobile. Upon connection it breaks with the atta= ched error in the 3.5.1 engine server logs. =0A= =0A= Something I'm missing?=0A= =0A= Markus=0A= =0A= 2015-02-19 12:21:19,757 ERROR [org.apache.catalina.core.ContainerBase.[jbos= s.web].[default-host].[/ovirt-engine/api]] (ajp--127.0.0.1-8702-11) Standar= dWrapper.Throwable: java.lang.RuntimeException: java.lang.RuntimeException:= Unable to instantiate MessageBodyWriter=0A= at org.jboss.resteasy.plugins.providers.RegisterBuiltin.register(Re= gisterBuiltin.java:35) [resteasy-jaxrs-2.3.2.Final.jar:]=0A= at org.jboss.resteasy.spi.ResteasyDeployment.start(ResteasyDeployme= nt.java:211) [resteasy-jaxrs-2.3.2.Final.jar:]=0A= at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispat= cher.init(ServletContainerDispatcher.java:67) [resteasy-jaxrs-2.3.2.Final.j= ar:]=0A= at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.= init(HttpServletDispatcher.java:36) [resteasy-jaxrs-2.3.2.Final.jar:]=0A= at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWra= pper.java:1202) [jbossweb-7.0.13.Final.jar:]=0A= at org.apache.catalina.core.StandardWrapper.allocate(StandardWrappe= r.java:952) [jbossweb-7.0.13.Final.jar:]=0A= at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWra= pperValve.java:188) [jbossweb-7.0.13.Final.jar:]=0A= at org.apache.catalina.core.StandardContextValve.invoke(StandardCon= textValve.java:161) [jbossweb-7.0.13.Final.jar:]=0A= at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Authe= nticatorBase.java:489) [jbossweb-7.0.13.Final.jar:]=0A= at org.jboss.as.web.security.SecurityContextAssociationValve.invoke= (SecurityContextAssociationValve.java:153) [jboss-as-web-7.1.1.Final.jar:7.= 1.1.Final]=0A= at org.apache.catalina.core.StandardHostValve.invoke(StandardHostVa= lve.java:155) [jbossweb-7.0.13.Final.jar:]=0A= at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportVa= lve.java:102) [jbossweb-7.0.13.Final.jar:]=0A= at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466)= [jbossweb-7.0.13.Final.jar:]=0A= at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngi= neValve.java:109) [jbossweb-7.0.13.Final.jar:]=0A= at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapte= r.java:368) [jbossweb-7.0.13.Final.jar:]=0A= at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:505= ) [jbossweb-7.0.13.Final.jar:]=0A= at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(A= jpProtocol.java:445) [jbossweb-7.0.13.Final.jar:]=0A= at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.ja= va:930) [jbossweb-7.0.13.Final.jar:]=0A= at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_55]=0A= Caused by: java.lang.RuntimeException: Unable to instantiate MessageBodyWri= ter=0A= at org.jboss.resteasy.spi.ResteasyProviderFactory.registerProvider(= ResteasyProviderFactory.java:772) [resteasy-jaxrs-2.3.2.Final.jar:]=0A= at org.jboss.resteasy.plugins.providers.RegisterBuiltin.registerPro= viders(RegisterBuiltin.java:70) [resteasy-jaxrs-2.3.2.Final.jar:]=0A= at org.jboss.resteasy.plugins.providers.RegisterBuiltin.register(Re= gisterBuiltin.java:31) [resteasy-jaxrs-2.3.2.Final.jar:]=0A= ... 18 more=0A= Caused by: java.lang.RuntimeException: Failed to construct public org.ovirt= .engine.api.pdf.FOPMessageBodyWriter()=0A= at org.jboss.resteasy.core.ConstructorInjectorImpl.construct(Constr= uctorInjectorImpl.java:144) [resteasy-jaxrs-2.3.2.Final.jar:]=0A= at org.jboss.resteasy.spi.ResteasyProviderFactory.getProviderInstan= ce(ResteasyProviderFactory.java:1039) [resteasy-jaxrs-2.3.2.Final.jar:]=0A= at org.jboss.resteasy.spi.ResteasyProviderFactory.addMessageBodyWri= ter(ResteasyProviderFactory.java:519) [resteasy-jaxrs-2.3.2.Final.jar:]=0A= at org.jboss.resteasy.spi.ResteasyProviderFactory.registerProvider(= ResteasyProviderFactory.java:768) [resteasy-jaxrs-2.3.2.Final.jar:]=0A= ... 20 more=0A= Caused by: java.lang.NoClassDefFoundError: org/apache/fop/apps/FopFactory= =0A= ------=_NextPartTM-000-01931aef-0e79-4067-9583-6cee81c33885 Content-Type: text/plain; name="InterScan_Disclaimer.txt" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="InterScan_Disclaimer.txt" **************************************************************************** Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail ist nicht gestattet. Über das Internet versandte E-Mails können unter fremden Namen erstellt oder manipuliert werden. Deshalb ist diese als E-Mail verschickte Nachricht keine rechtsverbindliche Willenserklärung. Collogia Unternehmensberatung AG Ubierring 11 D-50678 Köln Vorstand: Kadir Akin Dr. Michael Höhnerbach Vorsitzender des Aufsichtsrates: Hans Kristian Langva Registergericht: Amtsgericht Köln Registernummer: HRB 52 497 This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. e-mails sent over the internet may have been written under a wrong name or been manipulated. That is why this message sent as an e-mail is not a legally binding declaration of intention. Collogia Unternehmensberatung AG Ubierring 11 D-50678 Köln executive board: Kadir Akin Dr. Michael Höhnerbach President of the supervisory board: Hans Kristian Langva Registry office: district court Cologne Register number: HRB 52 497 **************************************************************************** ------=_NextPartTM-000-01931aef-0e79-4067-9583-6cee81c33885--

3 4

Poor iSCSI Performance
by John Florian 19 Feb '15

19 Feb '15

This is a multi-part message in MIME format. --------------070002020309040609070902 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi all, I've been trying to resolve a storage performance issue but have had no luck in identifying the exact cause. I have my storage domain on iSCSI and I can get the expected performance (limited by the Gbit Ethernet) when running bonnie++ on: * a regular physical machine configured with the iSCSI initiator connected to a dedicated iSCSI test target -- thus oVirt and VM technology are completely out of the picture * my oVirt host with the initiator connected to that same dedicated target -- thus I have an iSCSI connection on the oVirt host but I'm not using the iSCSI connection provided by oVirt's storage domain * a VM (hosted by oVirt) with the initiator (inside the VM) connected to that target -- thus bypassing oVirt's storage domain and the virtual disk it provides this VM However, if I just use a regular virtual disk via oVirt's storage domain the performance is much worse. I've tried both VirtIO and VirtIO-SCSI and have found no appreciable difference. Here's a typical example of the poor performance I get (as tested with bonnie++) with the normal virtual disk setup: # bonnie++ -d . -r 2048 -u root:root <snip> Version 1.96 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP narvi-f21.double 4G 806 91 18507 1 15675 1 3174 56 33175 1 176.4 3 Latency 15533us 8142ms 2440ms 262ms 1289ms 780ms Version 1.96 ------Sequential Create------ --------Random Create-------- narvi-f21.doubledog -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 13641 24 +++++ +++ 22702 17 18919 31 +++++ +++ +++++ +++ Latency 27724us 247us 292us 71us 30us 172us For comparison, here's what I see if I run the same test, same VM, same host but this time the file system is mounted from a device obtained using iscsi-initiator-utils within the VM, i.e., the 3rd bullet config above: bonnie++ -d . -r 2048 -u root:root <snip> Version 1.96 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP narvi-f21.double 4G 2051 89 103877 4 36286 3 4803 88 88166 4 163.6 3 Latency 7724us 191ms 396ms 48734us 73004us 1645ms Version 1.96 ------Sequential Create------ --------Random Create-------- narvi-f21.doubledog -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 6531 18 +++++ +++ 16388 20 5924 15 +++++ +++ 17906 23 Latency 15623us 64us 92us 1281us 14us 256us My host is Fedora 20 running oVirt 3.5 (hosted-engine). VM is running Fedora Server 21. Tonight I tried updating the host with the Fedora virt preview repo and I didn't see any significant change in the performance. Where should I look next? --------------070002020309040609070902 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> Hi all,<br> <br> I've been trying to resolve a storage performance issue but have had no luck in identifying the exact cause. I have my storage domain on iSCSI and I can get the expected performance (limited by the Gbit Ethernet) when running bonnie++ on:<br> <ul> <li>a regular physical machine configured with the iSCSI initiator connected to a dedicated iSCSI test target -- thus oVirt and VM technology are completely out of the picture<br> </li> <li>my oVirt host with the initiator connected to that same dedicated target -- thus I have an iSCSI connection on the oVirt host but I'm not using the iSCSI connection provided by oVirt's storage domain<br> </li> <li>a VM (hosted by oVirt) with the initiator (inside the VM) connected to that target -- thus bypassing oVirt's storage domain and the virtual disk it provides this VM</li> </ul> <p>However, if I just use a regular virtual disk via oVirt's storage domain the performance is much worse. I've tried both VirtIO and VirtIO-SCSI and have found no appreciable difference.<br> </p> <p>Here's a typical example of the poor performance I get (as tested with bonnie++) with the normal virtual disk setup:<br> </p> <p><tt># bonnie++ -d . -r 2048 -u root:root<br> <snip><br> Version 1.96 ------Sequential Output------ --Sequential Input- --Random-</tt><tt><br> </tt><tt>Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--</tt><tt><br> </tt><tt>Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP</tt><tt><br> </tt><tt>narvi-f21.double 4G 806 91 18507 1 15675 1 3174 56 33175 1 176.4 3</tt><tt><br> </tt><tt>Latency 15533us 8142ms 2440ms 262ms 1289ms 780ms</tt><tt><br> </tt><tt>Version 1.96 ------Sequential Create------ --------Random Create--------</tt><tt><br> </tt><tt>narvi-f21.doubledog -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--</tt><tt><br> </tt><tt> files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP</tt><tt><br> </tt><tt> 16 13641 24 +++++ +++ 22702 17 18919 31 +++++ +++ +++++ +++</tt><tt><br> </tt><tt>Latency 27724us 247us 292us 71us 30us 172us</tt><br> <br> </p> <p>For comparison, here's what I see if I run the same test, same VM, same host but this time the file system is mounted from a device obtained using iscsi-initiator-utils within the VM, i.e., the 3rd bullet config above:<br> </p> <p><tt>bonnie++ -d . -r 2048 -u root:root</tt><tt><br> </tt><tt><snip></tt><tt><br> </tt><tt>Version 1.96 ------Sequential Output------ --Sequential Input- --Random-</tt><tt><br> </tt><tt>Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--</tt><tt><br> </tt><tt>Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP</tt><tt><br> </tt><tt>narvi-f21.double 4G 2051 89 103877 4 36286 3 4803 88 88166 4 163.6 3</tt><tt><br> </tt><tt>Latency 7724us 191ms 396ms 48734us 73004us 1645ms</tt><tt><br> </tt><tt>Version 1.96 ------Sequential Create------ --------Random Create--------</tt><tt><br> </tt><tt>narvi-f21.doubledog -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--</tt><tt><br> </tt><tt> files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP</tt><tt><br> </tt><tt> 16 6531 18 +++++ +++ 16388 20 5924 15 +++++ +++ 17906 23</tt><tt><br> </tt><tt>Latency 15623us 64us 92us 1281us 14us 256us</tt><br> </p> <p>My host is Fedora 20 running oVirt 3.5 (hosted-engine). VM is running Fedora Server 21. Tonight I tried updating the host with the Fedora virt preview repo and I didn't see any significant change in the performance. Where should I look next?<br> </p> <p><br> </p> </body> </html> --------------070002020309040609070902--

2 1

How long do your migrations last?
by Nicolas Ecarnot 19 Feb '15

19 Feb '15

Hello list, Our storage domains are iSCSI on dedicated network, and when migrating VMs, the duration varies according to the size of the vDisks. The smallest VMs are migrated in about 20 seconds, while the biggest one may take more than 5 or 10 minutes. The average duration is 90 seconds. Questions : 1- Though I may have understood that the task of migration was made by the SPM, I don't know what it actually does? (which bytes goes where) 2- Do our times sound OK, or does it look like improvable? 3- What bottleneck should I investigate? I'm thinking about the dedicated hardware NICs setup of the hosts, the SAN, the MTU has already been setup at 9000... Any ideas welcomed. -- Nicolas Ecarnot

4 3

Where do you run oVirt?
by Sandro Bonazzola 18 Feb '15

18 Feb '15

Hi, As we continue developing oVirt 3.6 and future releases of oVirt, the development and integration team are seeking input from users on how oVirt is being run and on what platforms. We would appreciate you help by taking this quick survey! https://docs.google.com/forms/d/1u-YccuNRza4_WmS5VMdy0mEkXuKxt4lzrALKKcnEMB… Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 2