[ovirt-users] Storage issues

[DONALD DAVIS]

The issues is with machine that have already been imported once. 
I started cloudspin with a two drive consumer NAS, and it was slow and crappy so I migrated all of the machines that were on that drive to the gluster, which went off with few issues. 

A couple days ago the gluster that held the engine went into split brain hell, and crashed corrupting the engine. 

I rebuilt the engine, and the machine that were created on the gluster had no problems importing, it’s the machines that had already been imported once that have the issue. 

There is nothing in the vdsm logs related to this, it never makes it past the engine.  Here is the error.

2015-02-07 08:46:21,445 INFO  [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = node3.cloudspin.me, HostId = 1d81be66-49b7-41a6-81ca-1c8dd55dcf3c), log id: 46f08f27
2015-02-07 08:46:21,487 INFO  [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {a823009f-aa52-4b4b-b2bf-093ece3e8f02=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity at d475d4ca, e8ca5fa4-37ca-4cd9-a87b-e7c20243e021=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity at b3d17fb9, af67b75f-c8e1-44ec-aa42-69aed9bd9226=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity at 55088de0}, log id: 46f08f27
2015-02-07 08:46:26,499 INFO  [org.ovirt.engine.core.bll.ImportVmFromConfigurationCommand] (ajp--127.0.0.1-8702-7) [e4169ff] Lock Acquired to object EngineLock [exclusiveLocks= key: aks-test1 value: VM_NAME
, sharedLocks= key: e4c0cf2d-61ed-4cbf-9c43-81e9a565755f value: REMOTE_VM
]
2015-02-07 08:46:26,516 INFO  [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = node3.cloudspin.me, HostId = 1d81be66-49b7-41a6-81ca-1c8dd55dcf3c), log id: 22aa4324

>>>>>HERE IS THE ERROR<<<<<<<<<
2015-02-07 08:46:26,562 WARN  [org.ovirt.engine.core.bll.ImportVmFromConfigurationCommand] (ajp--127.0.0.1-8702-7) [e4169ff] CanDoAction of action ImportVmFromConfiguration failed for user donny at cloudspin. Reasons: VAR__ACTION__IMPORT,VAR__TYPE__VM,ACTION_TYPE_FAILED_STORAGE_DOMAIN_NOT_EXIST
2015-02-07 08:46:26,570 INFO  [org.ovirt.engine.core.bll.ImportVmFromConfigurationCommand] (ajp--127.0.0.1-8702-7) [e4169ff] Lock freed to object EngineLock [exclusiveLocks= key: aks-test1 value: VM_NAME
, sharedLocks= key: e4c0cf2d-61ed-4cbf-9c43-81e9a565755f value: REMOTE_VM
]
2015-02-07 08:46:26,596 INFO  [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {a823009f-aa52-4b4b-b2bf-093ece3e8f02=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity at 3cecea52, e8ca5fa4-37ca-4cd9-a87b-e7c20243e021=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity at bdea2c2c, af67b75f-c8e1-44ec-aa42-69aed9bd9226=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity at 4f63b2b3}, log id: 22aa4324



Thank you for your assistance 

Donny D

-----Original Message-----
From: Maor Lipchuk [mailto:mlipchuk at redhat.com] 
Sent: Saturday, February 7, 2015 4:08 AM
To: DONALD DAVIS
Cc: Allon Mureinik
Subject: Re: Storage issues

Hi Donald, can you please share your engine and vdsm logs.
Have you done any move operation with the disks? That was the bug that was solved in 3.5.1


Thakns,
Maor



----- Original Message -----
> From: "Allon Mureinik" <amureini at redhat.com>
> To: "DONALD DAVIS" <donny at 5dindustries.com>
> Cc: "Maor Lipchuk" <mlipchuk at redhat.com>
> Sent: Friday, February 6, 2015 7:16:47 PM
> Subject: Re: Storage issues
> 
> Hi Donald,
> 
> What version are you using (oVirt 3.5.0 presumably)?
> 
> Maor - isn't this a bug we solved in 3.5.1?
> 
> -Allon
> ----- Original Message -----
> 
> > From: "DONALD DAVIS" <donny at 5dindustries.com>
> > To: amureini at redhat.com
> > Sent: Friday, February 6, 2015 6:53:27 PM
> > Subject: Storage issues
> 
> > Hi,
> 
> > I need some help getting my users vm’s imported back into the system 
> > after the failure yesterday. I reattached the storage and half of 
> > the vm’s imported without issue. The other half of the vms give this 
> > error
> 
> > Error while executing action: Cannot import VM. Storage Domain 
> > doesn't exist
> 
> > Funny part is, I only had one storage domain… and I imported it back 
> > into the engine… I’m confused.
> 
> > Donny Davis
> 
> > cloudspin.me
>