- Users - oVirt List Archives

Re: [Users] VLANs and oVirt 3.1
by jplorier＠gmail.com 23 Jul '13

23 Jul '13

Hi, maybe you have pvid of the bond in the 494 vlan (in the switch) and so the traffic you get is untagged. When you manually mark the network to be tagged, you'll discard the untagged packets Regards Juan Pablo Lorier

1 0

[Users] VLANs and oVirt 3.1
by Jason Keltz 23 Jul '13

23 Jul '13

In my test setup for oVirt 3.1, I have 3 switches -- two basic ones with no VLAN support for mgmt, and storage, and a building switch with VLAN support. The network operations team has configured a trunk with 2 dual 1 Gb links on the building switch. If I configure the two network interfaces in oVirt with binding mode 4, and assign a logical network to the link without specifying a VLAN, it works fine. I'm told the default untagged VLAN is 494 (which is what I want). On the other hand, if I simply hard-code VLAN 494 in the logical network setup, it doesn't work - I get no network traffic. I'm told that the switch is setup correctly, and the problem is on my side. How can I debug? Thanks, Jason.

2 2

[Users] VLANs and oVirt 3.1
by Jason Keltz 23 Jul '13

23 Jul '13

I'm experimenting with VLANs in my oVirt test setup with 3.1. My ovirtmgmt, and storage network are each on a basic switch with no VLANs. On the other hand, my public network has several VLANs available to me. The network operations team created a trunk for me with 2 x 1 GbT ports, aggregated with LACP, and passed it on with all VLANs. In oVirt, if I bind the two network interfaces, and, and assign one IP to the bind (mode 4) without specifying a VLAN, everything works fine (untagged VLANS are assigned ID 494 which is what I want). On the other hand, if I specify VLAN 494 in the logical network setup (or any of the other VLANs), it fails. I don't see any traffic. Network operations says that all VLANs are passed on the trunk. How can I debug? Jason.

1 0

[Users] New UI plugin: UI-VDSM-Hooks
by Daniel Erez 23 Jul '13

23 Jul '13

Hi, I've created a new UI plugin that allows invocation of VDSM commands directly from the WebAdmin (using CGI scripts and vdsClient). You can read all about it in my blog: http://derezvir.blogspot.co.il/ Thanks, Daniel

6 9

[Users] [ANN] ovirt nigthly rpms for fedora19 available for download
by Eyal Edri 23 Jul '13

23 Jul '13

Fyi, fedora19 rpm for ovirt projects are now available on http://resources.ovirt.org/releases/nightly/rpm/Fedora/19. Eyal.

1 0

[Users] Node installation dialog
by Jakub Bittner 23 Jul '13

23 Jul '13

Hello, I have problems with installing ovirt node (2.6.1). I think, it fails during grub install. The only ERROR in ovirt.log is "Root partition not found". I booted to live-cd and running from it fine, but I want to try to run installation, but I dont know which command to run to install. Do anybody know? Thank you, Jakub Bittner

2 8

[Users] missing node iso
by Jason Keltz 23 Jul '13

23 Jul '13

Should http://resources.ovirt.org/releases/stable/iso/ be empty!? Jason.

3 4

Re: [Users] Can't remove disks anymore
by Hans-Joachim 23 Jul '13

23 Jul '13

--========GMXBoundary173901374564629287839 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit Hi, there are 2 nodes up and running. But on both, the iSCSI "storage" 95d9d760-18ea-4d9e-a785-02c32a36a781 contains only the "directories" metadata leases ids inbox outbox master So for me, it looks like the 'disks' exists only in the database. Hans-Joachim ----- Original Message ----- From: Ayal Baron Sent: 07/22/13 09:50 AM To: Hans-Joachim Subject: Re: [Users] Can't remove disks anymore Hi Hans, ----- Original Message ----- > Hello, > > I tried to move a disk from on iSCSI to an other and back again. > Finally I ended with 2 disks of the same name in a storage. > One is in stauts ok, the other in status locked. I tried to put the locked > into status ok, and tried > to delete it (even tried to destroy the storage completely) but without > success. > > Please fine enclosed the log for removing a disk from storage > > 2013-07-18 10:48:54,612 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] > (pool-3-thread-48) [3df2582b] Running command: RemoveDiskCommand internal: > false. Entities affected : ID: 44976dd1-ad7e-4350-b70e-4d92abddd6f5 Type: > Disk > 2013-07-18 10:48:54,640 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] > (pool-3-thread-48) [1208a48e] Running command: RemoveImageCommand internal: > true. Entities affected : ID: 95d9d760-18ea-4d9e-a785-02c32a36a781 Type: > Storage > 2013-07-18 10:48:54,795 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] > (pool-3-thread-48) [1208a48e] Lock freed to object EngineLock > [exclusiveLocks= key: 44976dd1-ad7e-4350-b70e-4d92abddd6f5 value: DISK > , sharedLocks= key: f5453fad-ad60-4422-b099-baf65bb4fdf1 value: VM > ] > > > 2013-07-18 10:50:55,287 ERROR > [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] > (pool-3-thread-48) [1208a48e] Failed in DeleteImageGroupVDS method > 2013-07-18 10:50:55,289 ERROR > [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] > (pool-3-thread-48) [1208a48e] Error code ResourceTimeout and error message > IRSGenericException: IRSErrorException: Failed to DeleteImageGroupVDS, error > = Resource timeout: () > 2013-07-18 10:50:55,325 ERROR > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] > (pool-3-thread-48) [1208a48e] IrsBroker::Failed::DeleteImageGroupVDS due to: > IRSErrorException: IRSGenericException: IRSErrorException: Failed to > DeleteImageGroupVDS, error = Resource timeout: () > > 2013-07-18 10:50:55,482 ERROR > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] > (pool-3-thread-48) [1208a48e] IRS failover failed - cant allocate vds server The message above means that engine cannot communicate with the hypervisor (vdsm). How many hosts do you have? Are your hypervisors in maintenance mode? > 2013-07-18 10:50:55,483 INFO > [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] > (pool-3-thread-48) [1208a48e] FINISH, DeleteImageGroupVDSCommand, log id: > 66c00992 > 2013-07-18 10:50:55,485 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] > (pool-3-thread-48) [1208a48e] Command > org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With > error message VdcBLLException: > org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: > IRSGenericException: IRSErrorException: Failed to DeleteImageGroupVDS, error > = Resource timeout: () > > I'm afraid that, if I delete the entry in the database table images, I'll run > in much bigger troubles. > > Hans-Joachim > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > --========GMXBoundary173901374564629287839 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable <div><sp= an style=3D"font-family:Verdana">Hi, <b= r />there are 2 nodes up and running. But on both, the iSCSI "storage"= 95d9d760-18ea-4d9e-a785-02c32a36a781 contains only the "directories"<= /span> =C2=A0metadata leases = ids inbox outbox= = <span= style=3D"font-family:Verdana">master= &n= bsp; So for me, it looks like the 'disks' exists only in the database.<= /span>   Hans-Joachim   <blockquote = style=3D"border-left: 1px solid #CCC; padding-left: 5px; margin-left: 5px; = margin-bottom: 0px; margin-top: 0px; margin-right: 0px;" type=3D"cite">----- Original Message -----</sp= an>= From: Ayal Baron<sp= an style=3D"font-size:12px">Sent: 07/22/13 09:50 AM= To: Hans-Joachim</sp= an>Subject= : Re: [Users] Can't remove disks anymore<sp= an style=3D"font-family:Verdana"> </spa= n><div><div><pre style=3D"white-space: pre-wrap; word-wrap: break-wo= rd; font-size:11;pre">Hi Hans,=20 ----- Original Message -----=20 > Hello,=20 >=20 > I tried to move a disk from on iSCSI to an other and back again.=20 > Finally I ended with 2 disks of the same name in a storage.=20 > One is in stauts ok, the other in status locked. I tried to put the lo= cked=20 > into status ok, and tried=20 > to delete it (even tried to destroy the storage completely) but withou= t=20 > success.=20 >=20 > Please fine enclosed the log for removing a disk from storage=20 >=20 > 2013-07-18 10:48:54,612 INFO [org.ovirt.engine.core.bll.RemoveDiskComm= and]=20 > (pool-3-thread-48) [3df2582b] Running command: RemoveDiskCommand inter= nal:=20 > false. Entities affected : ID: 44976dd1-ad7e-4350-b70e-4d92abddd6f5 Ty= pe:=20 > Disk=20 > 2013-07-18 10:48:54,640 INFO [org.ovirt.engine.core.bll.RemoveImageCom= mand]=20 > (pool-3-thread-48) [1208a48e] Running command: RemoveImageCommand inte= rnal:=20 > true. Entities affected : ID: 95d9d760-18ea-4d9e-a785-02c32a36a781 Typ= e:=20 > Storage=20 > 2013-07-18 10:48:54,795 INFO [org.ovirt.engine.core.bll.RemoveImageCom= mand]=20 > (pool-3-thread-48) [1208a48e] Lock freed to object EngineLock=20 > [exclusiveLocks=3D key: 44976dd1-ad7e-4350-b70e-4d92abddd6f5 value: DI= SK=20 > , sharedLocks=3D key: f5453fad-ad60-4422-b099-baf65bb4fdf1 value: VM= =20 > ]=20 >=20 >=20 > 2013-07-18 10:50:55,287 ERROR=20 > [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase]=20 > (pool-3-thread-48) [1208a48e] Failed in DeleteImageGroupVDS method=20 > 2013-07-18 10:50:55,289 ERROR=20 > [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase]=20 > (pool-3-thread-48) [1208a48e] Error code ResourceTimeout and error mes= sage=20 > IRSGenericException: IRSErrorException: Failed to DeleteImageGroupVDS,= error=20 > =3D Resource timeout: ()=20 > 2013-07-18 10:50:55,325 ERROR=20 > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]=20 > (pool-3-thread-48) [1208a48e] IrsBroker::Failed::DeleteImageGroupVDS d= ue to:=20 > IRSErrorException: IRSGenericException: IRSErrorException: Failed to= =20 > DeleteImageGroupVDS, error =3D Resource timeout: ()=20 >=20 > 2013-07-18 10:50:55,482 ERROR=20 > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]=20 > (pool-3-thread-48) [1208a48e] IRS failover failed - cant allocate vds = server=20 The message above means that engine cannot communicate with the hypervisor = (vdsm).=20 How many hosts do you have?=20 Are your hypervisors in maintenance mode?=20 > 2013-07-18 10:50:55,483 INFO=20 > [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand]= =20 > (pool-3-thread-48) [1208a48e] FINISH, DeleteImageGroupVDSCommand, log = id:=20 > 66c00992=20 > 2013-07-18 10:50:55,485 ERROR [org.ovirt.engine.core.bll.RemoveImageCo= mmand]=20 > (pool-3-thread-48) [1208a48e] Command=20 > org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. = With=20 > error message VdcBLLException:=20 > org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException:=20 > IRSGenericException: IRSErrorException: Failed to DeleteImageGroupVDS,= error=20 > =3D Resource timeout: ()=20 >=20 > I'm afraid that, if I delete the entry in the database table images, I= 'll run=20 > in much bigger troubles.=20 >=20 > Hans-Joachim=20 >=20 > _______________________________________________=20 > Users mailing list=20 > Users(a)ovirt.org=20 > http://lists.ovirt.org/mailman/listinfo/users=20 ></pre></div></div><sp= an style=3D"font-size:12px"> </blockquote> </div></span= > --========GMXBoundary173901374564629287839--

1 0

[Users] oVirt 3.3 Test day [suggested 1 day delay]
by Moran Goldboim 23 Jul '13

23 Jul '13

continuing the tradition of coordinating oVirt test days, i would like to postpone this in a day to make sure we are ready for it. -few features are missing test page (owners are cc'ed) [1] -features aren't updated on release table -general test day infra should be better arrange -several features delivery are still pending. -basic tests on both distros making sure delivery isn't DOA owners, please update features/status/test pages on oVirt 3.3 release page [1] - if N/A please mark it as such. [1] http://www.ovirt.org/index.php?title=OVirt_3.3_release-management

3 3

[Users] ::VolumeGroupReplaceTagError::
by Daniele Pavia 22 Jul '13

22 Jul '13

Hello everybody, I've been experimenting a bit with Fedora 19 + vdsm and I'm getting this funny /VolumeGroupReplaceTagError/. I've got a 3.2 engine running with two hosts, a Fed18 and a Fed19, both sporting vdsm-4.10.3-17. I can run VMs on both hostss but I can't migrate them and, worst of them all, the engine can't elect the Fe19 host as SPM - it just keeps trying and trying to no avail. What's even weirder is that the Fed19's vdsm keeps complaining about not being able to find the storage, even when VMs are up and running on the very same host. Both hosts are accessing the same LUN via fibre channel. here is an excerpt from the offending vdsm running a VM: 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,078::misc::84::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360060160f4d03100dc456812fdb3e211%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a646d974-19be-4a8d-bf68-a3974d46a823' (cwd None) 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,115::misc::84::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,117::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,117::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:mpathb,uuid:TMIy2w-1GR2-DW93-SETn-AhJG-yXfA-mHYwWW,pestart:0,pecount:4093,mapoffset:0', 'VERSION=3', 'LOGBLKSIZE=512', 'DESCRIPTION=provisioning1', 'LEASERETRIES=3', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'SDUUID=a646d974-19be-4a8d-bf68-a3974d46a823', 'CLASS=Data', 'TYPE=FCP', 'VGUUID=bqt7AY-kDVm-rZnW-IMI6-83Zy-5Go2-HvNY6Y', 'IOOPTIMEOUTSEC=10', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c923d5bb-ea08-44ea-937d-10eea4485ae2', 'ROLE=Master', 'POOL_DESCRIPTION=AreaProvisioning', u'POOL_DOMAINS=a646d974-19be-4a8d-bf68-a3974d46a823:Active,53b27dc5-fa49-4257-962d-b475e160d7b3:Active', 'POOL_SPM_LVER=18', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7d5585b7b7adeabd4cb193ea6f3e5af06bd8f64c'] 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,118::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,118::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,119::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=provisioning1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=AreaProvisioning', u'POOL_DOMAINS=a646d974-19be-4a8d-bf68-a3974d46a823:Active,53b27dc5-fa49-4257-962d-b475e160d7b3:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=19', 'POOL_UUID=c923d5bb-ea08-44ea-937d-10eea4485ae2', u'PV0=pv:mpathb,uuid:TMIy2w-1GR2-DW93-SETn-AhJG-yXfA-mHYwWW,pestart:0,pecount:4093,mapoffset:0', 'ROLE=Master', 'SDUUID=a646d974-19be-4a8d-bf68-a3974d46a823', 'TYPE=FCP', 'VERSION=3', 'VGUUID=bqt7AY-kDVm-rZnW-IMI6-83Zy-5Go2-HvNY6Y', '_SHA_CKSUM=79a6a0705dc0011d7f44f24b5c639f5d8baae074'] 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,119::lvm::483::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,119::lvm::485::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,120::lvm::493::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,120::lvm::505::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,120::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,121::misc::84::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360060160f4d03100dc456812fdb3e211%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a646d974-19be-4a8d-bf68-a3974d46a823' (cwd None) 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,157::misc::84::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,159::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,160::blockSD::300::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_SPM_ID=1, MDT__SHA_CKSUM=79a6a0705dc0011d7f44f24b5c639f5d8baae074, MDT_POOL_SPM_LVER=19 removing=MDT_POOL_SPM_ID=-1, MDT__SHA_CKSUM=7d5585b7b7adeabd4cb193ea6f3e5af06bd8f64c, MDT_POOL_SPM_LVER=18 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,161::misc::84::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360060160f4d03100dc456812fdb3e211%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_SPM_LVER=18 --deltag MDT_POOL_SPM_ID=-1 --deltag MDT__SHA_CKSUM=7d5585b7b7adeabd4cb193ea6f3e5af06bd8f64c --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=79a6a0705dc0011d7f44f24b5c639f5d8baae074 --addtag MDT_POOL_SPM_LVER=19 a646d974-19be-4a8d-bf68-a3974d46a823' (cwd None) 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,200::misc::84::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' /dev/mapper/360060160f4d03100dc456812fdb3e211: lseek 18446744073575333888 failed: Invalid argument\n'; <rc> = 5 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,204::lvm::483::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,204::lvm::485::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::WARNING::2013-07-18 11:01:07,205::persistentDict::178::Storage.PersistentDict::(transaction) Error in transaction, rolling back changes Traceback (most recent call last): File "/usr/share/vdsm/storage/persistentDict.py", line 174, in transaction self.flush(self._metadata) File "/usr/share/vdsm/storage/persistentDict.py", line 300, in flush self._metaRW.writelines(lines) File "/usr/share/vdsm/storage/blockSD.py", line 301, in writelines lvm.changeVGTags(self._vgName, delTags=toRemove, addTags=toAdd) File "/usr/share/vdsm/storage/lvm.py", line 1219, in changeVGTags (vgName, ", ".join(delTags), ", ".join(addTags), err[-1])) VolumeGroupReplaceTagError: Replace Volume Group tag error: ('vg:a646d974-19be-4a8d-bf68-a3974d46a823 del:MDT_POOL_SPM_LVER=18, MDT_POOL_SPM_ID=-1, MDT__SHA_CKSUM=7d5585b7b7adeabd4cb193ea6f3e5af06bd8f64c add:MDT_POOL_SPM_ID=1, MDT__SHA_CKSUM=79a6a0705dc0011d7f44f24b5c639f5d8baae074, MDT_POOL_SPM_LVER=19 ( /dev/mapper/360060160f4d03100dc456812fdb3e211: lseek 18446744073575333888 failed: Invalid argument)',) 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,206::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=provisioning1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=AreaProvisioning', u'POOL_DOMAINS=a646d974-19be-4a8d-bf68-a3974d46a823:Active,53b27dc5-fa49-4257-962d-b475e160d7b3:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=18', 'POOL_UUID=c923d5bb-ea08-44ea-937d-10eea4485ae2', u'PV0=pv:mpathb,uuid:TMIy2w-1GR2-DW93-SETn-AhJG-yXfA-mHYwWW,pestart:0,pecount:4093,mapoffset:0', 'ROLE=Master', 'SDUUID=a646d974-19be-4a8d-bf68-a3974d46a823', 'TYPE=FCP', 'VERSION=3', 'VGUUID=bqt7AY-kDVm-rZnW-IMI6-83Zy-5Go2-HvNY6Y', '_SHA_CKSUM=7d5585b7b7adeabd4cb193ea6f3e5af06bd8f64c'] 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,206::lvm::483::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,206::lvm::485::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,207::lvm::493::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,207::lvm::505::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,207::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,208::misc::84::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360060160f4d03100dc456812fdb3e211%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free a646d974-19be-4a8d-bf68-a3974d46a823' (cwd None) 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,244::misc::84::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 9b238eef-380f-4fd4-aca1-465f675b7656::DEBUG::2013-07-18 11:01:07,246::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex 9b238eef-380f-4fd4-aca1-465f675b7656::ERROR::2013-07-18 11:01:07,247::sp::314::Storage.StoragePool::(startSpm) Unexpected error Traceback (most recent call last): File "/usr/share/vdsm/storage/sp.py", line 268, in startSpm PMDK_SPM_ID: self.id}, __securityOverride=True) File "/usr/share/vdsm/storage/securable.py", line 68, in wrapper return f(self, *args, **kwargs) File "/usr/share/vdsm/storage/sp.py", line 1478, in setMetaParams self._metadata.update(params) File "/usr/share/vdsm/storage/persistentDict.py", line 121, in update self._dict.update(metadata) File "/usr/share/vdsm/storage/persistentDict.py", line 214, in update self._metadata.update(metadata) File "/usr/lib64/python2.7/contextlib.py", line 24, in __exit__ self.gen.next() File "/usr/share/vdsm/storage/persistentDict.py", line 174, in transaction self.flush(self._metadata) File "/usr/share/vdsm/storage/persistentDict.py", line 300, in flush self._metaRW.writelines(lines) File "/usr/share/vdsm/storage/blockSD.py", line 301, in writelines lvm.changeVGTags(self._vgName, delTags=toRemove, addTags=toAdd) File "/usr/share/vdsm/storage/lvm.py", line 1219, in changeVGTags (vgName, ", ".join(delTags), ", ".join(addTags), err[-1])) VolumeGroupReplaceTagError: Replace Volume Group tag error: ('vg:a646d974-19be-4a8d-bf68-a3974d46a823 del:MDT_POOL_SPM_LVER=18, MDT_POOL_SPM_ID=-1, MDT__SHA_CKSUM=7d5585b7b7adeabd4cb193ea6f3e5af06bd8f64c add:MDT_POOL_SPM_ID=1, MDT__SHA_CKSUM=79a6a0705dc0011d7f44f24b5c639f5d8baae074, MDT_POOL_SPM_LVER=19 ( /dev/mapper/360060160f4d03100dc456812fdb3e211: lseek 18446744073575333888 failed: Invalid argument)',) meanwhile, on the engine side of the thing (same behaviour at a different time of the day): 2013-07-18 15:19:18,736 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-10) [1cdd7d6f] START, HSMClearTaskVDSCommand(HostName = heidi, HostId = 7c0f1d65-750e-458c-95ac-90846d4755bf, taskId=4879a4ab-41fc-4991-a93b-7407a21701e0), log id: bff1ad1 2013-07-18 15:19:18,745 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-10) [1cdd7d6f] FINISH, HSMClearTaskVDSCommand, log id: bff1ad1 2013-07-18 15:19:18,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-10) [1cdd7d6f] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1939957e, log id: 72518013 2013-07-18 15:19:18,749 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-10) [13859022] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: c923d5bb-ea08-44ea-937d-10eea4485ae2 Type: StoragePool 2013-07-18 15:19:18,783 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-10) [13859022] No string for SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC type. Use default Log 2013-07-18 15:19:18,790 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-10) [13859022] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed 2013-07-18 15:19:28,893 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-5) [19567f5a] hostFromVds::selectedVds - heidi, spmStatus Free, storage pool AreaProvisioning 2013-07-18 15:19:28,899 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-5) [19567f5a] starting spm on vds heidi, storage pool AreaProvisioning, prevId -1, LVER 18 2013-07-18 15:19:28,925 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-5) [19567f5a] START, SpmStartVDSCommand(HostName = heidi, HostId = 7c0f1d65-750e-458c-95ac-90846d4755bf, storagePoolId = c923d5bb-ea08-44ea-937d-10eea4485ae2, prevId=-1, prevLVER=18, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1101aacc 2013-07-18 15:19:28,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-5) [19567f5a] spmStart polling started: taskId = 03d8ee8f-cf3d-42c5-be4a-a9136f5e9fa1 2013-07-18 15:19:29,974 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (DefaultQuartzScheduler_Worker-5) [19567f5a] Failed in HSMGetTaskStatusVDS method 2013-07-18 15:19:29,976 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (DefaultQuartzScheduler_Worker-5) [19567f5a] Error code VolumeGroupReplaceTagError and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Replace Volume Group tag error 2013-07-18 15:19:29,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-5) [19567f5a] spmStart polling ended: taskId = 03d8ee8f-cf3d-42c5-be4a-a9136f5e9fa1 task status = finished 2013-07-18 15:19:29,978 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-5) [19567f5a] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Replace Volume Group tag error 2013-07-18 15:19:29,985 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-5) [19567f5a] spmStart polling ended, spm status: Free 2013-07-18 15:19:30,010 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-5) [19567f5a] START, HSMClearTaskVDSCommand(HostName = heidi, HostId = 7c0f1d65-750e-458c-95ac-90846d4755bf, taskId=03d8ee8f-cf3d-42c5-be4a-a9136f5e9fa1), log id: 115a9661 2013-07-18 15:19:30,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-5) [19567f5a] FINISH, HSMClearTaskVDSCommand, log id: 115a9661 2013-07-18 15:19:30,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-5) [19567f5a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5246c32d, log id: 1101aacc 2013-07-18 15:19:30,022 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-5) [23b7e98e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: c923d5bb-ea08-44ea-937d-10eea4485ae2 Type: StoragePool 2013-07-18 15:19:30,054 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) [23b7e98e] No string for SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC type. Use default Log 2013-07-18 15:19:30,061 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-5) [23b7e98e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed the whole vdsm log is attached. Got any clues? Thanks, Daniele Pavia Engineering I.I. R&D Labs

3 4