[Users] Storage domain issue iSCSI

Wed Dec 5 10:29:15 EST 2012

Simon,
I need to see the logs at the same time from both engine and vdsm,
they are a few days apart.
Can you get me the right logs?
thanks.

----- Original Message -----
> From: "Simon Donnellan" <f at baconwho.re>
> To: "Yeela Kaplan" <ykaplan at redhat.com>
> Cc: users at ovirt.org
> Sent: Tuesday, December 4, 2012 12:02:08 AM
> Subject: Re: [Users] Storage domain issue iSCSI
> 
> Hi Yeela,
> 
> Attached are the engine logs.
> 
> Kind Regards
> 
> Simon
> 
> 
> 
> 
> On Sun, Dec 2, 2012 at 4:46 PM, Yeela Kaplan < ykaplan at redhat.com >
> wrote:
> 
> 
> Just a clarification, the UUID of the pool is
> f1b40ecc-b6a9-44e7-92cb-0fdf445e3175
> and the UUID of the msd it is looking for is
> 68d8b0e2-c348-4cfe-a896-08c62d491dfb (according to the logs you sent
> me).
> The problem really is in the msd version (Thanks Shu) but I need more
> details in order to solve the issue,
> can you also attach the engine logs?
> thanks.
> 
> 
> ----- Original Message -----
> > From: "Simon Donnellan" < f at baconwho.re >
> 
> 
> > To: "Shu Ming" < shuming at linux.vnet.ibm.com >
> > Cc: "Yeela Kaplan" < ykaplan at redhat.com >, users at ovirt.org
> > Sent: Sunday, December 2, 2012 5:55:00 PM
> > Subject: Re: [Users] Storage domain issue iSCSI
> > 
> > Hi Yeela, Shu,
> > 
> > Many thanks for your replies.
> > 
> > I'm aware of the one type rule, the two NFS shares you noticed are
> > the ISO share and an export store. (I'm unable to find a way to
> > create these as iSCSI type)
> > 
> > The UUID of the master iSCSI domain is f1b40ecc-b6a9-44e7-
> > 92cb-0fdf445e3175
> > 
> > it's name in the gui is "512gb2"
> > 
> > I too believe there is a meta data corruption, is there any way to
> > get my systems back up and running?
> > 
> > Kind Regards
> > 
> > Simon
> > 
> > 
> > 
> > 
> > On Sun, Dec 2, 2012 at 3:13 PM, Shu Ming <
> > shuming at linux.vnet.ibm.com
> > > wrote:
> > 
> > 
> > 
> > 
> > I think the error is clear. Engine was expecting a master storage
> > domain metadata format version 3, while the master storage metadata
> > gave version 4. I am wondering if the master storage domain
> > metadata
> > was corrupted during the power off.
> > 
> > See: the error came from.
> > Thread-54::ERROR::2012-11-29
> > 20:06:02,491::sp::1532::Storage.StoragePool::(getMasterDomain)
> > Requested master domain 68d8b0e2-c348-4cfe-a896-08c62d491dfb does
> > not have expected version 3 it is version 4
> > 
> > See: 'MASTER_VERSION=4' below:
> > 
> > Thread-49::DEBUG::2012-11-29
> > 20:05:58,337::persistentDict::234::Storage.PersistentDict::(refresh)
> > read lines (VGTagMetadataRW)=['VERSION=2',
> > u'PV0=pv:36001405c2f5e9d2d3be7d41a8db27dd6,uuid:b62d1B-zFVl-LKrH-fekH-vprs-znOZ-IF6jJy,pestart:0,pecount:4093,mapoffset:0',
> > 'TYPE=ISCSI', 'LOGBLKSIZE=512',
> > 'SDUUID=68d8b0e2-c348-4cfe-a896-08c62d491dfb', 'LEASERETRIES=3',
> > 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512',
> > 'VGUUID=q7sGQ7-1G03-s9mh-dIyx-NSmo-P0zk-23c3Ad',
> > 'DESCRIPTION=512gb2', 'CLASS=Data',
> > 'POOL_UUID=f1b40ecc-b6a9-44e7-92cb-0fdf445e3175',
> > 'IOOPTIMEOUTSEC=10', 'LEASETIMESEC=60', 'MASTER_VERSION=4' ,
> > 'ROLE=Master', 'POOL_DESCRIPTION=UB1',
> > u'POOL_DOMAINS=afec8026-ccac-4366-bb4b-2150d8731e4c:Active,c2b01420-fc73-4ccc-a560-3e1c5aa28a9f:Active,45fa93a8-1761-4522-bafb-c5d3ab45f731:Attached,68d8b0e2-c348-4cfe-a896-08c62d491dfb:Active',
> > 'POOL_SPM_LVER=541',
> > '_SHA_CKSUM=d54ce32f30c8040449f2a91ccc6e115e35894a5e',
> > 'POOL_SPM_ID=-1']
> > 
> > 
> > 2012-11-30 4:08, Simon Donnellan:
> > 
> > 
> > 
> > 
> > Hi Yeela,
> > 
> > Thanks for the reply, I've attached a vdsm.log file containing an
> > attempt to activate the host, then activate the iSCSI storage
> > domain.
> > 
> > Thanks
> > 
> > Simon
> > 
> > 
> > 
> > 
> > On Thu, Nov 29, 2012 at 6:03 PM, Yeela Kaplan < ykaplan at redhat.com
> > >
> > wrote:
> > 
> > 
> > Hi Simon,
> > We could use some more information in order to understand the
> > problem,
> > could you please attach the vdsm logs?
> > Thanks,
> > Yeela
> > 
> > 
> > 
> > ----- Original Message -----
> > > From: "Simon Donnellan" < f at baconwho.re >
> > > To: users at ovirt.org
> > > Sent: Thursday, November 29, 2012 7:35:18 PM
> > > Subject: [Users] Storage domain issue iSCSI
> > > 
> > > 
> > > Hi Everyone,
> > > 
> > > I'm having an issue following a power cut, none of my 3 nodes
> > > (All
> > > Fedora 17 / oVirt 3.1) are able to attach the master Domain.
> > > 
> > > in /var/log/messages I see the following on each node:
> > > 
> > > Nov 29 17:15:41 hades vdsm Storage.StoragePool ERROR Requested
> > > master
> > > domain 68d8b0e2-c348-4cfe-a896-08c62d491dfb does not have
> > > expected
> > > version 3 it is version 4
> > > Nov 29 17:15:41 hades vdsm TaskManager.Task ERROR
> > > Task=`f06fd1bb-46d1-47d7-80ca-c2e01becdc51`::Unexpected error
> > > Nov 29 17:15:41 hades vdsm Storage.Dispatcher.Protect ERROR
> > > {'status': {'message': "Wrong Master domain or its version:
> > > 'SD=68d8b0e2-c348-4cfe-a896-08c62d491dfb,
> > > pool=f1b40ecc-b6a9-44e7-92cb-0fdf445e3175'", 'code': 324}}
> > > 
> > > I've tried reboots/restarts/node re-installs
> > > 
> > > I can see the PV and the iSCSI sessions fine from the shell.
> > > 
> > > As this is the master, none of my nodes will start.
> > > 
> > > Any help would be great.
> > > 
> > > Kind Regards
> > > 
> > > Simon
> > > 
> > > _______________________________________________
> > > Users mailing list
> > > Users at ovirt.org
> > > http://lists.ovirt.org/mailman/listinfo/users
> > > 
> > 
> > 
> > 
> > _______________________________________________
> > Users mailing list Users at ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/users
> > 
> > --
> > ---
> > 舒明 Shu Ming
> > Open Virtualization Engineerning; CSTL, IBM Corp.
> > Tel: 86-10-82451626 Tieline: 9051626 E-mail: shuming at cn.ibm.com or
> > shuming at linux.vnet.ibm.com Address: 3/F Ring Building, ZhongGuanCun
> > Software Park, Haidian District, Beijing 100193, PRC
> > 
> 
> 