[ovirt-users] importing iscsi storage domain

Nir Soffer nsoffer at redhat.com
Wed Feb 18 11:08:51 UTC 2015


----- Original Message -----
> From: "Nir Soffer" <nsoffer at redhat.com>
> To: "Steven M. Bellistri" <SBellistri at ldirx.com>
> Cc: users at ovirt.org
> Sent: Wednesday, February 18, 2015 10:22:31 AM
> Subject: Re: [ovirt-users] importing iscsi storage domain
> 
> ----- Original Message -----
> > From: "Steven M. Bellistri" <SBellistri at ldirx.com>
> > To: "Maor Lipchuk" <mlipchuk at redhat.com>, "Liron Aravot"
> > <laravot at redhat.com>, "Nir Soffer" <nsoffer at redhat.com>
> > Cc: "Elad Ben Aharon" <ebenahar at redhat.com>, users at ovirt.org
> > Sent: Monday, February 16, 2015 5:56:13 PM
> > Subject: RE: [ovirt-users] importing iscsi storage domain
> > 
> > Here is the vdsm log.
> > 
> > -----Original Message-----
> > From: Maor Lipchuk [mailto:mlipchuk at redhat.com]
> > Sent: Sunday, February 15, 2015 6:54 AM
> > To: Steven M. Bellistri; Liron Aravot; Nir Soffer
> > Cc: Elad Ben Aharon; users at ovirt.org
> > Subject: Re: [ovirt-users] importing iscsi storage domain
> > 
> > Hi Steven,
> > 
> > I suspect this is somehow related to sanlock based on the error
> > ResourceAcqusitionFailed, Can u please attach the VDSM logs as well.
> > Liron, Nir do you have any insights about this?
> 
> This error in vdsm log:
> 
> Thread-76941::ERROR::2015-02-10
> 09:41:01,427::task::866::Storage.TaskManager.Task::(_setError)
> Task=`92d9d1e3-0099-46ab-ba5b-4c574dbe81a9`::Unexpected error
> Traceback (most recent call last):
>   File "/usr/share/vdsm/storage/task.py", line 873, in _run
>     return fn(*args, **kargs)
>   File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>     res = f(*args, **kwargs)
>   File "/usr/share/vdsm/storage/hsm.py", line 3214, in prepareImage
>     runImgPath = dom.linkBCImage(imgPath, imgUUID)
>   File "/usr/share/vdsm/storage/blockSD.py", line 1044, in linkBCImage
>     dst = self.getLinkBCImagePath(imgUUID)
>   File "/usr/share/vdsm/storage/sd.py", line 671, in getLinkBCImagePath
>     return image.Image(self._getRepoPath()) \
>   File "/usr/share/vdsm/storage/sd.py", line 668, in _getRepoPath
>     return os.path.join(self.storage_repository, self.getPools()[0])
> IndexError: list index out of range
> 
> Means that the domain is not part of any pool:
> (self.getPools() returns empty list, hence IndexError)
> 
> According to the logs, the domain is part of the pool and the host
> is connected to the pool.
> 
> Steven can you reproduce this? How can we reproduce this issue?
> 
> One thing worth checking is trying to disable jsonrpc (in the host advanced
> options). Can you reproduce this when jsonrpc is disabled?

I would like to see the domain metadata - it is stored in the metadata lv or
in the vg tags.

Please attach the output of these commands:

dd if=/dev/2e94bbac-1648-49db-8605-ce574d2bc240/metadata bs=2048 count=1 > domain-metadata-lv

vgs --noheadings -o tags 2e94bbac-1648-49db-8605-ce574d2bc240 > domain-metadata-tags

Thanks,
Nir
 
> > ----- Original Message -----
> > > From: "Steven M. Bellistri" <SBellistri at ldirx.com>
> > > To: "Elad Ben Aharon" <ebenahar at redhat.com>, "Maor Lipchuk"
> > > <mlipchuk at redhat.com>, "Liron Aravot"
> > > <laravot at redhat.com>
> > > Cc: users at ovirt.org
> > > Sent: Wednesday, February 11, 2015 7:07:00 PM
> > > Subject: RE: [ovirt-users] importing iscsi storage domain
> > > 
> > > yes, no problem.  I am including the logs from yesterday and today.
> > > 
> > > From: Elad Ben Aharon [mailto:ebenahar at redhat.com]
> > > Sent: Wednesday, February 11, 2015 3:58 AM
> > > To: Steven M. Bellistri; Maor Lipchuk; Liron Aravot
> > > Cc: users at ovirt.org
> > > Subject: Re: [ovirt-users] importing iscsi storage domain
> > > 
> > > Steven - can you please attach engine.log also?
> > > (/var/log/ovirt-engine/engine.log)
> > > 
> > > Adding Maor and Liron from DEV.
> > > 
> > > Maor, Liron, can you take a look?
> > > 
> > > In vdsm.log I see the following:
> > > 
> > > Thread-77065::WARNING::2015-02-10
> > > 09:43:49,917::resourceManager::591::Storage.ResourceManager::(register
> > > Resource) Resource factory failed to create resource
> > > '2e94bbac-1648-49db-8605-ce574d2bc240_imageNS.952af113-8219-43a4-92a9-bfe913ec8b69'.
> > > Canceling request.
> > > Traceback (most recent call last):
> > >   File "/usr/share/vdsm/storage/resourceManager.py", line 587, in
> > >   registerResource
> > >     obj = namespaceObj.factory.createResource(name, lockType)
> > >   File "/usr/share/vdsm/storage/resourceFactories.py", line 193, in
> > >   createResource
> > >     lockType)
> > >   File "/usr/share/vdsm/storage/resourceFactories.py", line 119, in
> > >   __getResourceCandidatesList
> > >     repoPath = os.path.join(self.storage_repository,
> > > dom.getPools()[0])
> > > IndexError: list index out of range
> > > Thread-77065::DEBUG::2015-02-10
> > > 09:43:49,918::resourceManager::210::Storage.ResourceManager.Request::(
> > > cancel)
> > > ResName=`2e94bbac-1648-49db-8605-ce574d2bc240_imageNS.952af113-8219-43
> > > a4-92a9-bfe913ec8b69`ReqID=`10e68fbb-ac50-461f-92ac-d8c43060ed43`::Can
> > > celed
> > > request
> > > Thread-77065::WARNING::2015-02-10
> > > 09:43:49,918::resourceManager::203::Storage.ResourceManager.Request::(
> > > cancel)
> > > ResName=`2e94bbac-1648-49db-8605-ce574d2bc240_imageNS.952af113-8219-43
> > > a4-92a9-bfe913ec8b69`ReqID=`10e68fbb-ac50-461f-92ac-d8c43060ed43`::Tri
> > > ed
> > > to cancel a processed request
> > > Thread-77065::ERROR::2015-02-10
> > > 09:43:49,918::task::866::Storage.TaskManager.Task::(_setError)
> > > Task=`6e023655-23ad-42cd-9b7e-6c5e5e3b08b9`::Unexpected error
> > > Traceback (most recent call last):
> > >   File "/usr/share/vdsm/storage/task.py", line 873, in _run
> > >     return fn(*args, **kargs)
> > >   File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
> > >     res = f(*args, **kwargs)
> > >   File "/usr/share/vdsm/storage/hsm.py", line 1285, in
> > >   setVolumeDescription
> > >     pool.setVolumeDescription(sdUUID, imgUUID, volUUID, description)
> > >   File "/usr/share/vdsm/storage/securable.py", line 77, in wrapper
> > >     return method(self, *args, **kwargs)
> > >   File "/usr/share/vdsm/storage/sp.py", line 1884, in
> > >   setVolumeDescription
> > >     rm.LockType.exclusive):
> > >   File "/usr/share/vdsm/storage/resourceManager.py", line 523, in
> > >   acquireResource
> > >     raise se.ResourceAcqusitionFailed()
> > > ResourceAcqusitionFailed: Could not acquire resource. Probably
> > > resource factory threw an exception.: ()
> > > 
> > > 
> > > ________________________________
> > > From: "Steven M. Bellistri"
> > > <SBellistri at ldirx.com<mailto:SBellistri at ldirx.com>>
> > > To: "Elad Ben Aharon"
> > > <ebenahar at redhat.com<mailto:ebenahar at redhat.com>>
> > > Sent: Tuesday, 10 February, 2015 6:35:32 PM
> > > Subject: RE: [ovirt-users] importing iscsi storage domain
> > > 
> > > Another issue, when I failback the 2 storage domains, the 2nd SD is
> > > not working.  The vm that has the DB drives will not boot after I
> > > failover (I checked the virtio-scsi setting and it was checked), but I
> > > was getting an error in the manager saying that: Failed to update OVF
> > > disks 952af113-8219-43a4-92a9-bfe913ec8b69, OVF data isn't updated on
> > > those
> > > OVF
> > > stores (Data Center Default, Storage Domain iSCSI_2).   So then I tried
> > > putting the SD2 into maintenance mode and then reactivating it, but it
> > > would not active or would it detach.  I had to destroy the SD.  The
> > > weird thing is that I had no problems with the 1st SD.  I am sending
> > > the vdsm.log file from the host in the PR site.
> > > 
> > > From: Elad Ben Aharon [mailto:ebenahar at redhat.com]
> > > Sent: Monday, February 9, 2015 1:26 AM
> > > To: Steven M. Bellistri
> > > Cc: Aharon Canan; users at ovirt.org<mailto:users at ovirt.org>
> > > Subject: Re: [ovirt-users] importing iscsi storage domain
> > > 
> > > The import domain operation consists of several stages which their
> > > execution time can vary.
> > > It would be almost impossible to estimate how long it will take. But,
> > > since the whole import operation, along with the VMs registration in
> > > the new environment, doesn't involve any long time operations, like
> > > disks creation, it shouldn't take more than a few minutes.
> > > 
> > > 
> > > ________________________________
> > > From: "Steven M. Bellistri"
> > > <SBellistri at ldirx.com<mailto:SBellistri at ldirx.com>>
> > > To: "Elad Ben Aharon"
> > > <ebenahar at redhat.com<mailto:ebenahar at redhat.com>>
> > > Cc: "Aharon Canan" <acanan at redhat.com<mailto:acanan at redhat.com>>,
> > > users at ovirt.org<mailto:users at ovirt.org>
> > > Sent: Thursday, 5 February, 2015 5:41:11 PM
> > > Subject: RE: [ovirt-users] importing iscsi storage domain
> > > 
> > > I put the storage domain in maintenance mode, then changed the time
> > > from 60minutes to 5min, then after I failed the storage over I was
> > > able to import the domain.  Thanks so much for the help.  I just have
> > > one more question, is there anyway to calculate how long it will take
> > > to import a domain, because our production environment is about 5.5TB
> > > with
> > > about 40vm’s?
> > > 
> > > thanks
> > > 
> > > From: Elad Ben Aharon [mailto:ebenahar at redhat.com]
> > > Sent: Thursday, February 5, 2015 1:49 AM
> > > To: Steven M. Bellistri
> > > Cc: Aharon Canan; users at ovirt.org<mailto:users at ovirt.org>
> > > Subject: Re: [ovirt-users] importing iscsi storage domain
> > > 
> > > If you can't see the VMs under 'VM Import' subtab under the imported
> > > storage domain, it means that you won't be able to recover those VMs
> > > (because their configuration files weren't uploaded to the domain).
> > > For the next time, you can decrease the time interval of the OVFs
> > > upload as explained below in the thread.
> > > 
> > > Regarding the upgrade, it is possible to upgrade from 3.4 to 3.5 and
> > > once you'll upgrade the setup and the DC compatibility version to 3.5,
> > > the OVFs of the VMs will be uploaded to the storage domains where the
> > > VMs's disks are located on. (again, every 60 minutes by default).
> > > 
> > > 
> > > 
> > > 
> > > 
> > > 
> > > Elad Ben Aharon
> > > RHEV-QE storage
> > > [cid:image001.jpg at 01D045EA.B12E26C0]
> > > 
> > > 
> > > 
> > > ________________________________
> > > From: "Steven M. Bellistri"
> > > <SBellistri at ldirx.com<mailto:SBellistri at ldirx.com>>
> > > To: "Elad Ben Aharon"
> > > <ebenahar at redhat.com<mailto:ebenahar at redhat.com>>
> > > Cc: "Aharon Canan" <acanan at redhat.com<mailto:acanan at redhat.com>>,
> > > users at ovirt.org<mailto:users at ovirt.org>
> > > Sent: Wednesday, 4 February, 2015 5:44:37 PM
> > > Subject: RE: [ovirt-users] importing iscsi storage domain
> > > 
> > > No, I did not wait 60 minutes before I tried to failover.  Do, I need
> > > to start over, or can I just failback and wait the hour for the ovfs to
> > > upload?
> > > I do have a question, is this feature possible for an environment that
> > > was upgraded from 3.4 to 3.5?  My production environment is 3.4, the
> > > 3.5 environment is a clean test environment, but if I cant upgrade to
> > > 3.5 from
> > > 3.4 then this will not be a good DR option for me.
> > > 
> > > thanks
> > > 
> > > From: Elad Ben Aharon [mailto:ebenahar at redhat.com]
> > > Sent: Wednesday, February 4, 2015 8:56 AM
> > > To: Steven M. Bellistri
> > > Cc: Aharon Canan; users at ovirt.org<mailto:users at ovirt.org>
> > > Subject: Re: [ovirt-users] importing iscsi storage domain
> > > 
> > > Hi Steven,
> > > 
> > > In order to import the VMs from the imported storage domain, the VMs
> > > configuration files (which are called OVFs) have to be uploaded first
> > > before the domain is detached from the setup. This is being done by
> > > engine in a time interval of 60 minutes (it's configurable using
> > > rhevm-config --set OvfUpdateInMinutes=<value> and restart ovirt-engine
> > > service). From 3.5.1, the OVFs are uploaded once you move the storage
> > > domain to maintenance.  did you do so in the original RHEV
> > > environment? What was the version of this environment?
> > > If you didn't deactivate the domain in the first environment and then
> > > tried to attach it to the DR environment, the existence of the VMs in
> > > the domain depends on the OVFs upload that was supposed to be done by
> > > the first engine, which is being done every 60 minutes as explained,
> > > so if you've created those VMs and immediately destroyed the setup,
> > > those VMs probably won't be available for you in the DR environment.
> > > 
> > > 
> > > 
> > > 
> > > 
> > > 
> > > Elad Ben Aharon
> > > RHEV-QE storage
> > > [cid:image001.jpg at 01D045EA.B12E26C0]
> > > 
> > > 
> > > 
> > > ________________________________
> > > From: "Steven M. Bellistri"
> > > <SBellistri at LDIRx.com<mailto:SBellistri at LDIRx.com>>
> > > To: "Aharon Canan" <acanan at redhat.com<mailto:acanan at redhat.com>>
> > > Cc: users at ovirt.org<mailto:users at ovirt.org>
> > > Sent: Tuesday, 3 February, 2015 6:16:01 PM
> > > Subject: Re: [ovirt-users] importing iscsi storage domain
> > > 
> > > version 3.5.1
> > > 
> > > From: Aharon Canan [mailto:acanan at redhat.com]
> > > Sent: Tuesday, February 3, 2015 6:22 AM
> > > To: Steven M. Bellistri
> > > Cc: users at ovirt.org<mailto:users at ovirt.org>
> > > Subject: Re: [ovirt-users] importing iscsi storage domain
> > > 
> > > What version are you using?
> > > 
> > > 
> > > 
> > > Regards,
> > > __________________________________________________
> > > Aharon Canan
> > > int phone - 8272036
> > > ext phone - +97297692036
> > > email - acanan at redhat.com<mailto:acanan at redhat.com>
> > > 
> > > ________________________________
> > > From: "Steven M. Bellistri"
> > > <SBellistri at ldirx.com<mailto:SBellistri at ldirx.com>>
> > > To: "Aharon Canan" <acanan at redhat.com<mailto:acanan at redhat.com>>
> > > Cc: users at ovirt.org<mailto:users at ovirt.org>
> > > Sent: Monday, February 2, 2015 8:12:00 PM
> > > Subject: RE: [ovirt-users] importing iscsi storage domain
> > > 
> > > Thank you for the response.
> > > 
> > > I went thru the steps 1-9, and when I get to step 10 there is no
> > > import vms or import templates sub-tabs.  I am including the vdsm.log
> > > from
> > > the host.
> > > Also, when I do a lvs on the host, I can see the disks that reside in
> > > the imported SD, one is 30gb and the other is 40gb.  The storage
> > > domain I am importing is called iSCSI.
> > > 
> > > 
> > > From: Aharon Canan [mailto:acanan at redhat.com]
> > > Sent: Sunday, February 1, 2015 9:55 AM
> > > To: Steven M. Bellistri
> > > Cc: users at ovirt.org<mailto:users at ovirt.org>
> > > Subject: Re: [ovirt-users] importing iscsi storage domain
> > > 
> > > Hi
> > > 
> > > Please check below link for info, ovirt version should be 3.5
> > > http://www.ovirt.org/Features/ImportStorageDomain
> > > 
> > > please be aware to step 10 under "Work flow for Import block Storage
> > > Domain - UI flow"
> > > 
> > > In case it is not working, please add exact steps and engine/vdsm logs
> > > so we will be able to check
> > > 
> > > 
> > > 
> > > Regards,
> > > __________________________________________________
> > > Aharon Canan
> > > int phone - 8272036
> > > ext phone - +97297692036
> > > email - acanan at redhat.com<mailto:acanan at redhat.com>
> > > 
> > > ________________________________
> > > From: "Steven M. Bellistri"
> > > <SBellistri at LDIRx.com<mailto:SBellistri at LDIRx.com>>
> > > To: "users at ovirt.org<mailto:users at ovirt.org>"
> > > <users at ovirt.org<mailto:users at ovirt.org>>
> > > Sent: Friday, January 30, 2015 12:18:54 AM
> > > Subject: [ovirt-users] importing iscsi storage domain
> > > 
> > > I am trying to test failing over to a DR site using the storage domain
> > > import.  The DR site shows that it imported the iscsi storage domain,
> > > and activates it in the datacenter, but none of the vm’s or anything
> > > shows
> > > up.
> > > What am I missing.
> > > 
> > > thanks
> > > 
> > > Steven Bellistri
> > > 
> > > This email and its attachments may contain privileged and confidential
> > > information and/or protected health information (PHI) intended solely
> > > for the use of LDI Integrated Pharmacy Services and the recipient(s)
> > > named above. If you are not the recipient, or the employee or agent
> > > responsible for delivering this message to the intended recipient, you
> > > are hereby notified that any review, dissemination, distribution,
> > > printing or copying of this email message and/or any attachments is
> > > strictly prohibited. If you have received this transmission in error,
> > > please notify the sender immediately at 1-866-516-3121 and permanently
> > > delete this email and any attachments.
> > > _______________________________________________
> > > Users mailing list
> > > Users at ovirt.org<mailto:Users at ovirt.org>
> > > http://lists.ovirt.org/mailman/listinfo/users
> > > 
> > > 
> > > This email and its attachments may contain privileged and confidential
> > > information and/or protected health information (PHI) intended solely
> > > for the use of LDI Integrated Pharmacy Services and the recipient(s)
> > > named above. If you are not the recipient, or the employee or agent
> > > responsible for delivering this message to the intended recipient, you
> > > are hereby notified that any review, dissemination, distribution,
> > > printing or copying of this email message and/or any attachments is
> > > strictly prohibited. If you have received this transmission in error,
> > > please notify the sender immediately at 1-866-516-3121 and permanently
> > > delete this email and any attachments.
> > > 
> > > 
> > > This email and its attachments may contain privileged and confidential
> > > information and/or protected health information (PHI) intended solely
> > > for the use of LDI Integrated Pharmacy Services and the recipient(s)
> > > named above. If you are not the recipient, or the employee or agent
> > > responsible for delivering this message to the intended recipient, you
> > > are hereby notified that any review, dissemination, distribution,
> > > printing or copying of this email message and/or any attachments is
> > > strictly prohibited. If you have received this transmission in error,
> > > please notify the sender immediately at 1-866-516-3121 and permanently
> > > delete this email and any attachments.
> > > _______________________________________________
> > > Users mailing list
> > > Users at ovirt.org<mailto:Users at ovirt.org>
> > > http://lists.ovirt.org/mailman/listinfo/users
> > > 
> > > 
> > > This email and its attachments may contain privileged and confidential
> > > information and/or protected health information (PHI) intended solely
> > > for the use of LDI Integrated Pharmacy Services and the recipient(s)
> > > named above. If you are not the recipient, or the employee or agent
> > > responsible for delivering this message to the intended recipient, you
> > > are hereby notified that any review, dissemination, distribution,
> > > printing or copying of this email message and/or any attachments is
> > > strictly prohibited. If you have received this transmission in error,
> > > please notify the sender immediately at 1-866-516-3121 and permanently
> > > delete this email and any attachments.
> > > 
> > > 
> > > This email and its attachments may contain privileged and confidential
> > > information and/or protected health information (PHI) intended solely
> > > for the use of LDI Integrated Pharmacy Services and the recipient(s)
> > > named above. If you are not the recipient, or the employee or agent
> > > responsible for delivering this message to the intended recipient, you
> > > are hereby notified that any review, dissemination, distribution,
> > > printing or copying of this email message and/or any attachments is
> > > strictly prohibited. If you have received this transmission in error,
> > > please notify the sender immediately at 1-866-516-3121 and permanently
> > > delete this email and any attachments.
> > > 
> > > 
> > > This email and its attachments may contain privileged and confidential
> > > information and/or protected health information (PHI) intended solely
> > > for the use of LDI Integrated Pharmacy Services and the recipient(s)
> > > named above. If you are not the recipient, or the employee or agent
> > > responsible for delivering this message to the intended recipient, you
> > > are hereby notified that any review, dissemination, distribution,
> > > printing or copying of this email message and/or any attachments is
> > > strictly prohibited. If you have received this transmission in error,
> > > please notify the sender immediately at 1-866-516-3121 and permanently
> > > delete this email and any attachments.
> > > 
> > > 
> > > 
> > > This email and its attachments may contain privileged and confidential
> > > information and/or protected health information (PHI) intended solely
> > > for the use of LDI Integrated Pharmacy Services and the recipient(s)
> > > named above. If you are not the recipient, or the employee or agent
> > > responsible for delivering this message to the intended recipient, you
> > > are hereby notified that any review, dissemination, distribution,
> > > printing or copying of this email message and/or any attachments is
> > > strictly prohibited. If you have received this transmission in error,
> > > please notify the sender immediately at 1-866-516-3121 and permanently
> > > delete this email and any attachments.
> > 
> > 
> > This email and its attachments may contain privileged and confidential
> > information and/or protected health information (PHI) intended solely for
> > the use of LDI Integrated Pharmacy Services and the recipient(s) named
> > above. If you are not the recipient, or the employee or agent responsible
> > for delivering this message to the intended recipient, you are hereby
> > notified that any review, dissemination, distribution, printing or copying
> > of this email message and/or any attachments is strictly prohibited. If you
> > have received this transmission in error, please notify the sender
> > immediately at 1-866-516-3121 and permanently delete this email and any
> > attachments.
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>



More information about the Users mailing list