Re: [Users] Storage domain issue iSCSI

From: "Simon Donnellan" <f(a)baconwho.re&gt; To: "Yeela Kaplan" <ykaplan(a)redhat.com&gt; Cc: users(a)ovirt.org Sent: Tuesday, December 4, 2012 12:02:08 AM Subject: Re: [Users] Storage domain issue iSCSI Hi Yeela, Attached are the engine logs. Kind Regards Simon On Sun, Dec 2, 2012 at 4:46 PM, Yeela Kaplan < ykaplan(a)redhat.com > wrote: Just a clarification, the UUID of the pool is f1b40ecc-b6a9-44e7-92cb-0fdf445e3175 and the UUID of the msd it is looking for is 68d8b0e2-c348-4cfe-a896-08c62d491dfb (according to the logs you sent me). The problem really is in the msd version (Thanks Shu) but I need more details in order to solve the issue, can you also attach the engine logs? thanks. ----- Original Message ----- > From: "Simon Donnellan" < f(a)baconwho.re > > To: "Shu Ming" < shuming(a)linux.vnet.ibm.com > > Cc: "Yeela Kaplan" < ykaplan(a)redhat.com >, users(a)ovirt.org > Sent: Sunday, December 2, 2012 5:55:00 PM > Subject: Re: [Users] Storage domain issue iSCSI > > Hi Yeela, Shu, > > Many thanks for your replies. > > I'm aware of the one type rule, the two NFS shares you noticed are > the ISO share and an export store. (I'm unable to find a way to > create these as iSCSI type) > > The UUID of the master iSCSI domain is f1b40ecc-b6a9-44e7- > 92cb-0fdf445e3175 > > it's name in the gui is "512gb2" > > I too believe there is a meta data corruption, is there any way to > get my systems back up and running? > > Kind Regards > > Simon > > > > > On Sun, Dec 2, 2012 at 3:13 PM, Shu Ming < > shuming(a)linux.vnet.ibm.com > > wrote: > > > > > I think the error is clear. Engine was expecting a master storage > domain metadata format version 3, while the master storage metadata > gave version 4. I am wondering if the master storage domain > metadata > was corrupted during the power off. > > See: the error came from. > Thread-54::ERROR::2012-11-29 > 20:06:02,491::sp::1532::Storage.StoragePool::(getMasterDomain) > Requested master domain 68d8b0e2-c348-4cfe-a896-08c62d491dfb does > not have expected version 3 it is version 4 > > See: 'MASTER_VERSION=4' below: > > Thread-49::DEBUG::2012-11-29 > 20:05:58,337::persistentDict::234::Storage.PersistentDict::(refresh) > read lines (VGTagMetadataRW)=['VERSION=2', > u'PV0=pv:36001405c2f5e9d2d3be7d41a8db27dd6,uuid:b62d1B-zFVl-LKrH-fekH-vprs-znOZ-IF6jJy,pestart:0,pecount:4093,mapoffset:0', > 'TYPE=ISCSI', 'LOGBLKSIZE=512', > 'SDUUID=68d8b0e2-c348-4cfe-a896-08c62d491dfb', 'LEASERETRIES=3', > 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', > 'VGUUID=q7sGQ7-1G03-s9mh-dIyx-NSmo-P0zk-23c3Ad', > 'DESCRIPTION=512gb2', 'CLASS=Data', > 'POOL_UUID=f1b40ecc-b6a9-44e7-92cb-0fdf445e3175', > 'IOOPTIMEOUTSEC=10', 'LEASETIMESEC=60', 'MASTER_VERSION=4' , > 'ROLE=Master', 'POOL_DESCRIPTION=UB1', > u'POOL_DOMAINS=afec8026-ccac-4366-bb4b-2150d8731e4c:Active,c2b01420-fc73-4ccc-a560-3e1c5aa28a9f:Active,45fa93a8-1761-4522-bafb-c5d3ab45f731:Attached,68d8b0e2-c348-4cfe-a896-08c62d491dfb:Active', > 'POOL_SPM_LVER=541', > '_SHA_CKSUM=d54ce32f30c8040449f2a91ccc6e115e35894a5e', > 'POOL_SPM_ID=-1'] > > > 2012-11-30 4:08, Simon Donnellan: > > > > > Hi Yeela, > > Thanks for the reply, I've attached a vdsm.log file containing an > attempt to activate the host, then activate the iSCSI storage > domain. > > Thanks > > Simon > > > > > On Thu, Nov 29, 2012 at 6:03 PM, Yeela Kaplan < ykaplan(a)redhat.com > > > wrote: > > > Hi Simon, > We could use some more information in order to understand the > problem, > could you please attach the vdsm logs? > Thanks, > Yeela > > > > ----- Original Message ----- > > From: "Simon Donnellan" < f(a)baconwho.re > > > To: users(a)ovirt.org > > Sent: Thursday, November 29, 2012 7:35:18 PM > > Subject: [Users] Storage domain issue iSCSI > > > > > > Hi Everyone, > > > > I'm having an issue following a power cut, none of my 3 nodes > > (All > > Fedora 17 / oVirt 3.1) are able to attach the master Domain. > > > > in /var/log/messages I see the following on each node: > > > > Nov 29 17:15:41 hades vdsm Storage.StoragePool ERROR Requested > > master > > domain 68d8b0e2-c348-4cfe-a896-08c62d491dfb does not have > > expected > > version 3 it is version 4 > > Nov 29 17:15:41 hades vdsm TaskManager.Task ERROR > > Task=`f06fd1bb-46d1-47d7-80ca-c2e01becdc51`::Unexpected error > > Nov 29 17:15:41 hades vdsm Storage.Dispatcher.Protect ERROR > > {'status': {'message': "Wrong Master domain or its version: > > 'SD=68d8b0e2-c348-4cfe-a896-08c62d491dfb, > > pool=f1b40ecc-b6a9-44e7-92cb-0fdf445e3175'", 'code': 324}} > > > > I've tried reboots/restarts/node re-installs > > > > I can see the PV and the iSCSI sessions fine from the shell. > > > > As this is the master, none of my nodes will start. > > > > Any help would be great. > > > > Kind Regards > > > > Simon > > > > _______________________________________________ > > Users mailing list > > Users(a)ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users > > > > > > _______________________________________________ > Users mailing list Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > -- > --- > 舒明 Shu Ming > Open Virtualization Engineerning; CSTL, IBM Corp. > Tel: 86-10-82451626 Tieline: 9051626 E-mail: shuming(a)cn.ibm.com or > shuming(a)linux.vnet.ibm.com Address: 3/F Ring Building, ZhongGuanCun > Software Park, Haidian District, Beijing 100193, PRC >