Re: [ovirt-users] importing iscsi storage domain

19 Feb 2015

      I am going to open a case with red hat support since rhev 3.5 has been released.  I was using ovirt 3.5 for testing, until rhev 3.5 was released.  I appreciate all the help with all my questions and issues.

thanks  

-----Original Message-----
From: Nir Soffer [mailto:nsoffer@redhat.com] 
Sent: Wednesday, February 18, 2015 2:23 AM
To: Steven M. Bellistri
Cc: Maor Lipchuk; Liron Aravot; Elad Ben Aharon; users@ovirt.org
Subject: Re: [ovirt-users] importing iscsi storage domain

----- Original Message -----
...
From: "Steven M. Bellistri" <SBellistri@ldirx.com>
To: "Maor Lipchuk" <mlipchuk@redhat.com>, "Liron Aravot" 
<laravot@redhat.com>, "Nir Soffer" <nsoffer@redhat.com>
Cc: "Elad Ben Aharon" <ebenahar@redhat.com>, users@ovirt.org
Sent: Monday, February 16, 2015 5:56:13 PM
Subject: RE: [ovirt-users] importing iscsi storage domain
Here is the vdsm log.
-----Original Message-----
From: Maor Lipchuk [mailto:mlipchuk@redhat.com]
Sent: Sunday, February 15, 2015 6:54 AM
To: Steven M. Bellistri; Liron Aravot; Nir Soffer
Cc: Elad Ben Aharon; users@ovirt.org
Subject: Re: [ovirt-users] importing iscsi storage domain
Hi Steven,
I suspect this is somehow related to sanlock based on the error 
ResourceAcqusitionFailed, Can u please attach the VDSM logs as well.
Liron, Nir do you have any insights about this?
This error in vdsm log:

Thread-76941::ERROR::2015-02-10 09:41:01,427::task::866::Storage.TaskManager.Task::(_setError) Task=`92d9d1e3-0099-46ab-ba5b-4c574dbe81a9`::Unexpected error Traceback (most recent call last):
  File "/usr/share/vdsm/storage/task.py", line 873, in _run
    return fn(*args, **kargs)
  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
    res = f(*args, **kwargs)
  File "/usr/share/vdsm/storage/hsm.py", line 3214, in prepareImage
    runImgPath = dom.linkBCImage(imgPath, imgUUID)
  File "/usr/share/vdsm/storage/blockSD.py", line 1044, in linkBCImage
    dst = self.getLinkBCImagePath(imgUUID)
  File "/usr/share/vdsm/storage/sd.py", line 671, in getLinkBCImagePath
    return image.Image(self._getRepoPath()) \
  File "/usr/share/vdsm/storage/sd.py", line 668, in _getRepoPath
    return os.path.join(self.storage_repository, self.getPools()[0])
IndexError: list index out of range

Means that the domain is not part of any pool:
(self.getPools() returns empty list, hence IndexError)

According to the logs, the domain is part of the pool and the host is connected to the pool.

Steven can you reproduce this? How can we reproduce this issue?

One thing worth checking is trying to disable jsonrpc (in the host advanced options). Can you reproduce this when jsonrpc is disabled?

Nir
...
----- Original Message -----
...
From: "Steven M. Bellistri" <SBellistri@ldirx.com>
To: "Elad Ben Aharon" <ebenahar@redhat.com>, "Maor Lipchuk"
<mlipchuk@redhat.com>, "Liron Aravot"
<laravot@redhat.com>
Cc: users@ovirt.org
Sent: Wednesday, February 11, 2015 7:07:00 PM
Subject: RE: [ovirt-users] importing iscsi storage domain
yes, no problem.  I am including the logs from yesterday and today.
From: Elad Ben Aharon [mailto:ebenahar@redhat.com]
Sent: Wednesday, February 11, 2015 3:58 AM
To: Steven M. Bellistri; Maor Lipchuk; Liron Aravot
Cc: users@ovirt.org
Subject: Re: [ovirt-users] importing iscsi storage domain
Steven - can you please attach engine.log also?
(/var/log/ovirt-engine/engine.log)
Adding Maor and Liron from DEV.
Maor, Liron, can you take a look?
In vdsm.log I see the following:
Thread-77065::WARNING::2015-02-10
09:43:49,917::resourceManager::591::Storage.ResourceManager::(regist
er
Resource) Resource factory failed to create resource 
'2e94bbac-1648-49db-8605-ce574d2bc240_imageNS.952af113-8219-43a4-92a9-bfe913ec8b69'.
Canceling request.
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/resourceManager.py", line 587, in
  registerResource
    obj = namespaceObj.factory.createResource(name, lockType)
  File "/usr/share/vdsm/storage/resourceFactories.py", line 193, in
  createResource
    lockType)
  File "/usr/share/vdsm/storage/resourceFactories.py", line 119, in
  __getResourceCandidatesList
    repoPath = os.path.join(self.storage_repository,
dom.getPools()[0])
IndexError: list index out of range
Thread-77065::DEBUG::2015-02-10
09:43:49,918::resourceManager::210::Storage.ResourceManager.Request:
:(
cancel)
ResName=`2e94bbac-1648-49db-8605-ce574d2bc240_imageNS.952af113-8219-
43 
a4-92a9-bfe913ec8b69`ReqID=`10e68fbb-ac50-461f-92ac-d8c43060ed43`::C
an
celed
request
Thread-77065::WARNING::2015-02-10
09:43:49,918::resourceManager::203::Storage.ResourceManager.Request:
:(
cancel)
ResName=`2e94bbac-1648-49db-8605-ce574d2bc240_imageNS.952af113-8219-
43 
a4-92a9-bfe913ec8b69`ReqID=`10e68fbb-ac50-461f-92ac-d8c43060ed43`::T
ri
ed
to cancel a processed request
Thread-77065::ERROR::2015-02-10
09:43:49,918::task::866::Storage.TaskManager.Task::(_setError)
Task=`6e023655-23ad-42cd-9b7e-6c5e5e3b08b9`::Unexpected error 
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/task.py", line 873, in _run
    return fn(*args, **kargs)
  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
    res = f(*args, **kwargs)
  File "/usr/share/vdsm/storage/hsm.py", line 1285, in setVolumeDescription
    pool.setVolumeDescription(sdUUID, imgUUID, volUUID, description)
  File "/usr/share/vdsm/storage/securable.py", line 77, in wrapper
    return method(self, *args, **kwargs)
  File "/usr/share/vdsm/storage/sp.py", line 1884, in setVolumeDescription
    rm.LockType.exclusive):
  File "/usr/share/vdsm/storage/resourceManager.py", line 523, in
  acquireResource
    raise se.ResourceAcqusitionFailed()
ResourceAcqusitionFailed: Could not acquire resource. Probably 
resource factory threw an exception.: ()
________________________________
From: "Steven M. Bellistri"
<SBellistri@ldirx.com<mailto:SBellistri@ldirx.com>>
To: "Elad Ben Aharon"
<ebenahar@redhat.com<mailto:ebenahar@redhat.com>>
Sent: Tuesday, 10 February, 2015 6:35:32 PM
Subject: RE: [ovirt-users] importing iscsi storage domain
Another issue, when I failback the 2 storage domains, the 2nd SD is 
not working.  The vm that has the DB drives will not boot after I 
failover (I checked the virtio-scsi setting and it was checked), but 
I was getting an error in the manager saying that: Failed to update 
OVF disks 952af113-8219-43a4-92a9-bfe913ec8b69, OVF data isn't 
updated on those OVF
stores (Data Center Default, Storage Domain iSCSI_2).   So then I tried
putting the SD2 into maintenance mode and then reactivating it, but 
it would not active or would it detach.  I had to destroy the SD.  
The weird thing is that I had no problems with the 1st SD.  I am 
sending the vdsm.log file from the host in the PR site.
From: Elad Ben Aharon [mailto:ebenahar@redhat.com]
Sent: Monday, February 9, 2015 1:26 AM
To: Steven M. Bellistri
Cc: Aharon Canan; users@ovirt.org<mailto:users@ovirt.org>
Subject: Re: [ovirt-users] importing iscsi storage domain
The import domain operation consists of several stages which their 
execution time can vary.
It would be almost impossible to estimate how long it will take. 
But, since the whole import operation, along with the VMs 
registration in the new environment, doesn't involve any long time 
operations, like disks creation, it shouldn't take more than a few minutes.
________________________________
From: "Steven M. Bellistri"
<SBellistri@ldirx.com<mailto:SBellistri@ldirx.com>>
To: "Elad Ben Aharon"
<ebenahar@redhat.com<mailto:ebenahar@redhat.com>>
Cc: "Aharon Canan" <acanan@redhat.com<mailto:acanan@redhat.com>>,
users@ovirt.org<mailto:users@ovirt.org>
Sent: Thursday, 5 February, 2015 5:41:11 PM
Subject: RE: [ovirt-users] importing iscsi storage domain
I put the storage domain in maintenance mode, then changed the time 
from 60minutes to 5min, then after I failed the storage over I was 
able to import the domain.  Thanks so much for the help.  I just 
have one more question, is there anyway to calculate how long it 
will take to import a domain, because our production environment is 
about 5.5TB with about 40vm’s?
thanks
From: Elad Ben Aharon [mailto:ebenahar@redhat.com]
Sent: Thursday, February 5, 2015 1:49 AM
To: Steven M. Bellistri
Cc: Aharon Canan; users@ovirt.org<mailto:users@ovirt.org>
Subject: Re: [ovirt-users] importing iscsi storage domain
If you can't see the VMs under 'VM Import' subtab under the imported 
storage domain, it means that you won't be able to recover those VMs 
(because their configuration files weren't uploaded to the domain).
For the next time, you can decrease the time interval of the OVFs 
upload as explained below in the thread.
Regarding the upgrade, it is possible to upgrade from 3.4 to 3.5 and 
once you'll upgrade the setup and the DC compatibility version to 
3.5, the OVFs of the VMs will be uploaded to the storage domains 
where the VMs's disks are located on. (again, every 60 minutes by default).
Elad Ben Aharon
RHEV-QE storage
[cid:image001.jpg@01D045EA.B12E26C0]
________________________________
From: "Steven M. Bellistri"
<SBellistri@ldirx.com<mailto:SBellistri@ldirx.com>>
To: "Elad Ben Aharon"
<ebenahar@redhat.com<mailto:ebenahar@redhat.com>>
Cc: "Aharon Canan" <acanan@redhat.com<mailto:acanan@redhat.com>>,
users@ovirt.org<mailto:users@ovirt.org>
Sent: Wednesday, 4 February, 2015 5:44:37 PM
Subject: RE: [ovirt-users] importing iscsi storage domain
No, I did not wait 60 minutes before I tried to failover.  Do, I 
need to start over, or can I just failback and wait the hour for the 
ovfs to upload?
I do have a question, is this feature possible for an environment 
that was upgraded from 3.4 to 3.5?  My production environment is 
3.4, the
3.5 environment is a clean test environment, but if I cant upgrade 
to
3.5 from
3.4 then this will not be a good DR option for me.
thanks
From: Elad Ben Aharon [mailto:ebenahar@redhat.com]
Sent: Wednesday, February 4, 2015 8:56 AM
To: Steven M. Bellistri
Cc: Aharon Canan; users@ovirt.org<mailto:users@ovirt.org>
Subject: Re: [ovirt-users] importing iscsi storage domain
Hi Steven,
In order to import the VMs from the imported storage domain, the VMs 
configuration files (which are called OVFs) have to be uploaded 
first before the domain is detached from the setup. This is being 
done by engine in a time interval of 60 minutes (it's configurable 
using rhevm-config --set OvfUpdateInMinutes=<value> and restart 
ovirt-engine service). From 3.5.1, the OVFs are uploaded once you 
move the storage domain to maintenance.  did you do so in the 
original RHEV environment? What was the version of this environment?
If you didn't deactivate the domain in the first environment and 
then tried to attach it to the DR environment, the existence of the 
VMs in the domain depends on the OVFs upload that was supposed to be 
done by the first engine, which is being done every 60 minutes as 
explained, so if you've created those VMs and immediately destroyed 
the setup, those VMs probably won't be available for you in the DR environment.
Elad Ben Aharon
RHEV-QE storage
[cid:image001.jpg@01D045EA.B12E26C0]
________________________________
From: "Steven M. Bellistri"
<SBellistri@LDIRx.com<mailto:SBellistri@LDIRx.com>>
To: "Aharon Canan" <acanan@redhat.com<mailto:acanan@redhat.com>>
Cc: users@ovirt.org<mailto:users@ovirt.org>
Sent: Tuesday, 3 February, 2015 6:16:01 PM
Subject: Re: [ovirt-users] importing iscsi storage domain
version 3.5.1
From: Aharon Canan [mailto:acanan@redhat.com]
Sent: Tuesday, February 3, 2015 6:22 AM
To: Steven M. Bellistri
Cc: users@ovirt.org<mailto:users@ovirt.org>
Subject: Re: [ovirt-users] importing iscsi storage domain
What version are you using?
Regards,
__________________________________________________
Aharon Canan
int phone - 8272036
ext phone - +97297692036
email - acanan@redhat.com<mailto:acanan@redhat.com>
________________________________
From: "Steven M. Bellistri"
<SBellistri@ldirx.com<mailto:SBellistri@ldirx.com>>
To: "Aharon Canan" <acanan@redhat.com<mailto:acanan@redhat.com>>
Cc: users@ovirt.org<mailto:users@ovirt.org>
Sent: Monday, February 2, 2015 8:12:00 PM
Subject: RE: [ovirt-users] importing iscsi storage domain
Thank you for the response.
I went thru the steps 1-9, and when I get to step 10 there is no 
import vms or import templates sub-tabs.  I am including the 
vdsm.log from the host.
Also, when I do a lvs on the host, I can see the disks that reside 
in the imported SD, one is 30gb and the other is 40gb.  The storage 
domain I am importing is called iSCSI.
From: Aharon Canan [mailto:acanan@redhat.com]
Sent: Sunday, February 1, 2015 9:55 AM
To: Steven M. Bellistri
Cc: users@ovirt.org<mailto:users@ovirt.org>
Subject: Re: [ovirt-users] importing iscsi storage domain
Hi
Please check below link for info, ovirt version should be 3.5 
http://www.ovirt.org/Features/ImportStorageDomain
please be aware to step 10 under "Work flow for Import block Storage 
Domain - UI flow"
In case it is not working, please add exact steps and engine/vdsm 
logs so we will be able to check
Regards,
__________________________________________________
Aharon Canan
int phone - 8272036
ext phone - +97297692036
email - acanan@redhat.com<mailto:acanan@redhat.com>
________________________________
From: "Steven M. Bellistri"
<SBellistri@LDIRx.com<mailto:SBellistri@LDIRx.com>>
To: "users@ovirt.org<mailto:users@ovirt.org>"
<users@ovirt.org<mailto:users@ovirt.org>>
Sent: Friday, January 30, 2015 12:18:54 AM
Subject: [ovirt-users] importing iscsi storage domain
I am trying to test failing over to a DR site using the storage 
domain import.  The DR site shows that it imported the iscsi storage 
domain, and activates it in the datacenter, but none of the vm’s or 
anything shows up.
What am I missing.
thanks
Steven Bellistri
This email and its attachments may contain privileged and 
confidential information and/or protected health information (PHI) 
intended solely for the use of LDI Integrated Pharmacy Services and 
the recipient(s) named above. If you are not the recipient, or the 
employee or agent responsible for delivering this message to the 
intended recipient, you are hereby notified that any review, 
dissemination, distribution, printing or copying of this email 
message and/or any attachments is strictly prohibited. If you have 
received this transmission in error, please notify the sender 
immediately at 1-866-516-3121 and permanently delete this email and any attachments.
_______________________________________________
Users mailing list
Users@ovirt.org<mailto:Users@ovirt.org>
http://lists.ovirt.org/mailman/listinfo/users
This email and its attachments may contain privileged and 
confidential information and/or protected health information (PHI) 
intended solely for the use of LDI Integrated Pharmacy Services and 
the recipient(s) named above. If you are not the recipient, or the 
employee or agent responsible for delivering this message to the 
intended recipient, you are hereby notified that any review, 
dissemination, distribution, printing or copying of this email 
message and/or any attachments is strictly prohibited. If you have 
received this transmission in error, please notify the sender 
immediately at 1-866-516-3121 and permanently delete this email and any attachments.
This email and its attachments may contain privileged and 
confidential information and/or protected health information (PHI) 
intended solely for the use of LDI Integrated Pharmacy Services and 
the recipient(s) named above. If you are not the recipient, or the 
employee or agent responsible for delivering this message to the 
intended recipient, you are hereby notified that any review, 
dissemination, distribution, printing or copying of this email 
message and/or any attachments is strictly prohibited. If you have 
received this transmission in error, please notify the sender 
immediately at 1-866-516-3121 and permanently delete this email and any attachments.
_______________________________________________
Users mailing list
Users@ovirt.org<mailto:Users@ovirt.org>
http://lists.ovirt.org/mailman/listinfo/users
This email and its attachments may contain privileged and 
confidential information and/or protected health information (PHI) 
intended solely for the use of LDI Integrated Pharmacy Services and 
the recipient(s) named above. If you are not the recipient, or the 
employee or agent responsible for delivering this message to the 
intended recipient, you are hereby notified that any review, 
dissemination, distribution, printing or copying of this email 
message and/or any attachments is strictly prohibited. If you have 
received this transmission in error, please notify the sender 
immediately at 1-866-516-3121 and permanently delete this email and any attachments.
This email and its attachments may contain privileged and 
confidential information and/or protected health information (PHI) 
intended solely for the use of LDI Integrated Pharmacy Services and 
the recipient(s) named above. If you are not the recipient, or the 
employee or agent responsible for delivering this message to the 
intended recipient, you are hereby notified that any review, 
dissemination, distribution, printing or copying of this email 
message and/or any attachments is strictly prohibited. If you have 
received this transmission in error, please notify the sender 
immediately at 1-866-516-3121 and permanently delete this email and any attachments.
This email and its attachments may contain privileged and 
confidential information and/or protected health information (PHI) 
intended solely for the use of LDI Integrated Pharmacy Services and 
the recipient(s) named above. If you are not the recipient, or the 
employee or agent responsible for delivering this message to the 
intended recipient, you are hereby notified that any review, 
dissemination, distribution, printing or copying of this email 
message and/or any attachments is strictly prohibited. If you have 
received this transmission in error, please notify the sender 
immediately at 1-866-516-3121 and permanently delete this email and any attachments.
This email and its attachments may contain privileged and 
confidential information and/or protected health information (PHI) 
intended solely for the use of LDI Integrated Pharmacy Services and 
the recipient(s) named above. If you are not the recipient, or the 
employee or agent responsible for delivering this message to the 
intended recipient, you are hereby notified that any review, 
dissemination, distribution, printing or copying of this email 
message and/or any attachments is strictly prohibited. If you have 
received this transmission in error, please notify the sender 
immediately at 1-866-516-3121 and permanently delete this email and any attachments.
This email and its attachments may contain privileged and confidential 
information and/or protected health information (PHI) intended solely 
for the use of LDI Integrated Pharmacy Services and the recipient(s) 
named above. If you are not the recipient, or the employee or agent 
responsible for delivering this message to the intended recipient, you 
are hereby notified that any review, dissemination, distribution, 
printing or copying of this email message and/or any attachments is 
strictly prohibited. If you have received this transmission in error, 
please notify the sender immediately at 1-866-516-3121 and permanently 
delete this email and any attachments.
This email and its attachments may contain privileged and confidential information and/or protected health information (PHI) intended solely for the use of LDI Integrated Pharmacy Services and the recipient(s) named above. If you are not the recipient, or the employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any review, dissemination, distribution, printing or copying of this email message and/or any attachments is strictly prohibited. If you have received this transmission in error, please notify the sender immediately at 1-866-516-3121 and permanently delete this email and any attachments.