[Users] storage domain reactivate not working
Rene Rosenberger
r.rosenberger at netbiscuits.com
Fri Mar 30 07:39:03 UTC 2012
Hi,
since i have no data yet on the storage domain i want to delete it and create a new one. The problem is that I cant remove it. When I go to system -> default -> force remove I get this error:
Error: Cannot remove Data Center with active Storage Domains.
-Please deactivate all domains before removing the Data Center.
How can I remove it?
I think the problem I had with recovering storage domain was related to an problem with the NAS itself.
Regards, rene
Von: users-bounces at ovirt.org [mailto:users-bounces at ovirt.org] Im Auftrag von Rene Rosenberger
Gesendet: Freitag, 30. März 2012 07:57
An: rvaknin at redhat.com; Saggi Mizrahi
Cc: users at ovirt.org
Betreff: Re: [Users] storage domain reactivate not working
Hi,
this is the complete vdsm.log after a reboot:
MainThread::INFO::2012-03-30 07:52:33,989::vdsm::70::vds::(run) I am the actual vdsm 4.9-0
MainThread::DEBUG::2012-03-30 07:52:35,253::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage'
MainThread::DEBUG::2012-03-30 07:52:35,268::threadPool::45::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0
MainThread::DEBUG::2012-03-30 07:52:35,309::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/master` is not mounted, skipping
MainThread::DEBUG::2012-03-30 07:52:35,764::multipath::85::Storage.Misc.excCmd::(isEnabled) '/usr/bin/sudo -n /bin/cat /etc/multipath.conf' (cwd None)
MainThread::DEBUG::2012-03-30 07:52:35,958::multipath::85::Storage.Misc.excCmd::(isEnabled) SUCCESS: <err> = ''; <rc> = 0
MainThread::DEBUG::2012-03-30 07:52:35,959::multipath::101::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
MainThread::DEBUG::2012-03-30 07:52:35,959::hsm::334::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None)
MainThread::DEBUG::2012-03-30 07:52:36,694::hsm::334::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
MainThread::DEBUG::2012-03-30 07:52:36,700::lvm::316::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
MainThread::DEBUG::2012-03-30 07:52:36,722::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
MainThread::DEBUG::2012-03-30 07:52:36,910::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
MainThread::DEBUG::2012-03-30 07:52:36,913::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
MainThread::DEBUG::2012-03-30 07:52:36,915::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
MainThread::DEBUG::2012-03-30 07:52:36,919::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None)
MainThread::DEBUG::2012-03-30 07:52:37,147::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
MainThread::DEBUG::2012-03-30 07:52:37,149::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
MainThread::DEBUG::2012-03-30 07:52:37,150::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None)
MainThread::DEBUG::2012-03-30 07:52:37,901::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-12::DEBUG::2012-03-30 07:52:37,937::misc::1022::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
MainThread::INFO::2012-03-30 07:52:37,943::dispatcher::118::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
Thread-12::DEBUG::2012-03-30 07:52:37,945::misc::1024::SamplingMethod::(__call__) Got in to sampling method
Thread-12::DEBUG::2012-03-30 07:52:37,951::misc::1022::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
Thread-12::DEBUG::2012-03-30 07:52:37,952::misc::1024::SamplingMethod::(__call__) Got in to sampling method
Thread-12::DEBUG::2012-03-30 07:52:37,953::iscsiadm::48::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
MainThread::DEBUG::2012-03-30 07:52:37,988::utils::602::Storage.Misc.excCmd::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None)
Thread-12::DEBUG::2012-03-30 07:52:38,077::iscsiadm::48::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
Thread-12::DEBUG::2012-03-30 07:52:38,080::misc::1032::SamplingMethod::(__call__) Returning last result
Thread-12::DEBUG::2012-03-30 07:52:38,082::supervdsm::83::SuperVdsmProxy::(_killSupervdsm) Could not kill old Super Vdsm [Errno 2] No such file or directory: '/var/run/vdsm/svdsm.pid'
Thread-12::DEBUG::2012-03-30 07:52:38,084::supervdsm::71::SuperVdsmProxy::(_launchSupervdsm) Launching Super Vdsm
Thread-12::DEBUG::2012-03-30 07:52:38,087::supervdsm::74::Storage.Misc.excCmd::(_launchSupervdsm) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.pyc 0515dfee-9666-4a32-8194-db318d34b792 2783' (cwd None)
MainThread::DEBUG::2012-03-30 07:52:38,201::utils::602::Storage.Misc.excCmd::(execCmd) SUCCESS: <err> = ''; <rc> = 0
MainThread::INFO::2012-03-30 07:52:38,208::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds.
VM Channels Listener::INFO::2012-03-30 07:52:38,214::vmChannels::127::vds::(run) Starting VM channels listener thread.
MainThread::DEBUG::2012-03-30 07:52:39,087::supervdsmServer::201::SuperVdsm.Server::(main) Making sure I'm root
MainThread::DEBUG::2012-03-30 07:52:39,091::supervdsmServer::205::SuperVdsm.Server::(main) Parsing cmd args
MainThread::DEBUG::2012-03-30 07:52:39,093::supervdsmServer::208::SuperVdsm.Server::(main) Creating PID file
MainThread::DEBUG::2012-03-30 07:52:39,095::supervdsmServer::212::SuperVdsm.Server::(main) Cleaning old socket
MainThread::DEBUG::2012-03-30 07:52:39,096::supervdsmServer::216::SuperVdsm.Server::(main) Setting up keep alive thread
MainThread::DEBUG::2012-03-30 07:52:39,099::supervdsmServer::221::SuperVdsm.Server::(main) Creating remote object manager
MainThread::DEBUG::2012-03-30 07:52:39,104::supervdsmServer::232::SuperVdsm.Server::(main) Started serving super vdsm object
Thread-12::DEBUG::2012-03-30 07:52:40,118::supervdsm::92::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
Thread-14::DEBUG::2012-03-30 07:52:40,179::BindingXMLRPC::869::vds::(wrapper) client [192.168.100.10]::call getCapabilities with () {} flowID [2adac353]
Thread-12::DEBUG::2012-03-30 07:52:40,368::supervdsm::64::SuperVdsmProxy::(__init__) Connected to Super Vdsm
Thread-14::DEBUG::2012-03-30 07:52:41,125::utils::602::Storage.Misc.excCmd::(execCmd) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" qemu-kvm' (cwd None)
Thread-14::DEBUG::2012-03-30 07:52:41,272::utils::602::Storage.Misc.excCmd::(execCmd) SUCCESS: <err> = ''; <rc> = 0
Thread-14::DEBUG::2012-03-30 07:52:41,290::utils::602::Storage.Misc.excCmd::(execCmd) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" qemu-img' (cwd None)
Thread-14::DEBUG::2012-03-30 07:52:41,476::utils::602::Storage.Misc.excCmd::(execCmd) SUCCESS: <err> = ''; <rc> = 0
Thread-14::DEBUG::2012-03-30 07:52:41,480::utils::602::Storage.Misc.excCmd::(execCmd) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" vdsm' (cwd None)
Thread-14::DEBUG::2012-03-30 07:52:41,598::utils::602::Storage.Misc.excCmd::(execCmd) SUCCESS: <err> = ''; <rc> = 0
Thread-14::DEBUG::2012-03-30 07:52:41,607::utils::602::Storage.Misc.excCmd::(execCmd) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" spice-server' (cwd None)
Thread-14::DEBUG::2012-03-30 07:52:41,743::utils::602::Storage.Misc.excCmd::(execCmd) SUCCESS: <err> = ''; <rc> = 0
Thread-14::DEBUG::2012-03-30 07:52:41,747::utils::602::Storage.Misc.excCmd::(execCmd) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" libvirt' (cwd None)
Thread-12::DEBUG::2012-03-30 07:52:41,798::multipath::71::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None)
Thread-14::DEBUG::2012-03-30 07:52:41,893::utils::602::Storage.Misc.excCmd::(execCmd) SUCCESS: <err> = ''; <rc> = 0
Thread-12::DEBUG::2012-03-30 07:52:42,342::multipath::71::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
Thread-12::DEBUG::2012-03-30 07:52:42,348::lvm::457::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-12::DEBUG::2012-03-30 07:52:42,353::lvm::459::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-12::DEBUG::2012-03-30 07:52:42,357::lvm::469::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-12::DEBUG::2012-03-30 07:52:42,362::lvm::471::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-12::DEBUG::2012-03-30 07:52:42,365::lvm::490::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-12::DEBUG::2012-03-30 07:52:42,368::lvm::492::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-12::DEBUG::2012-03-30 07:52:42,373::misc::1032::SamplingMethod::(__call__) Returning last result
Thread-12::DEBUG::2012-03-30 07:52:42,378::hsm::358::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
Thread-12::DEBUG::2012-03-30 07:52:42,391::hsm::390::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
Thread-12::DEBUG::2012-03-30 07:52:42,393::hsm::391::Storage.HSM::(__cleanStorageRepository) Mount list: []
Thread-12::DEBUG::2012-03-30 07:52:42,395::hsm::393::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
Thread-12::DEBUG::2012-03-30 07:52:42,484::hsm::436::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
Thread-14::DEBUG::2012-03-30 07:52:42,676::BindingXMLRPC::875::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:be9b9fb3727b'}], 'FC': []}, 'packages2': {'kernel': {'release': '220.el6.x86_64', 'buildtime': 1323197302.0, 'version': '2.6.32'}, 'spice-server': {'release': '5.el6', 'buildtime': '1323304307', 'version': '0.8.2'}, 'vdsm': {'release': '0.10.git1ed0857.el6', 'buildtime': '1331796129', 'version': '4.9.6'}, 'qemu-kvm': {'release': '2.209.el6_2.4', 'buildtime': '1327354003', 'version': '0.12.1.2'}, 'libvirt': {'release': '23.el6_2.7', 'buildtime': '1332767822', 'version': '0.9.4'}, 'qemu-img': {'release': '2.209.el6_2.4', 'buildtime': '1327354003', 'version': '0.12.1.2'}}, 'cpuModel': 'AMD Opteron(TM) Processor 6212', 'hooks': {'before_vm_migrate_destination': {'50_vhostmd': {'md5': '2aa9ac48ef07de3c94e3428975e9df1a'}}, 'after_vm_destroy': {'50_vhostmd': {'md5': '47f8d385859e4c3c96113d8ff446b261'}}, 'before_vm_dehibernate': {'50_vhostmd': {'md5': '2aa9ac48ef07de3c94e3428975e9df1a'}}, 'before_vm_start': {'50_vhostmd': {'md5': '2aa9ac48ef07de3c94e3428975e9df1a'}, '10_simpleqemu': {'md5': '2c88a35172c02f2125fafe39c1c95fa9'}}}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'addr': '192.168.200.200', 'cfg': {'IPADDR': '192.168.200.200', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', 'BOOTPROTO': 'static', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'GATEWAY': '192.168.200.2'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': 'True', 'gateway': '192.168.200.2', 'ports': ['em1']}}, 'uuid': '4C4C4544-0052-4710-8037-B4C04F39354A_00:10:18:C8:B6:30', 'lastClientIface': 'ovirtmgmt', 'nics': {'em2': {'hwaddr': 'D0:67:E5:FA:E9:D1', 'netmask': '', 'speed': 0, 'addr': '', 'mtu': '1500'}, 'em4': {'hwaddr': 'D0:67:E5:FA:E9:D5', 'netmask': '', 'speed': 0, 'addr': '', 'mtu': '1500'}, 'p2p2': {'hwaddr': '00:10:18:C8:B6:32', 'netmask': '', 'speed': 0, 'addr': '', 'mtu': '1500'}, 'em3': {'hwaddr': 'D0:67:E5:FA:E9:D3', 'netmask': '', 'speed': 0, 'addr': '', 'mtu': '1500'}, 'p2p1': {'hwaddr': '00:10:18:C8:B6:30', 'netmask': '', 'speed': 0, 'addr': '', 'mtu': '1500'}, 'em1': {'hwaddr': 'D0:67:E5:FA:E9:CF', 'netmask': '', 'speed': 1000, 'addr': '', 'mtu': '1500'}}, 'software_revision': '0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ht,syscall,nx,mmxext,fxsr_opt,pdpe1gb,rdtscp,lm,constant_tsc,rep_good,nonstop_tsc,extd_apicid,amd_dcm,aperfmperf,pni,pclmulqdq,monitor,ssse3,cx16,sse4_1,sse4_2,popcnt,aes,xsave,avx,lahf_lm,cmp_legacy,svm,extapic,cr8_legacy,abm,sse4a,misalignsse,3dnowprefetch,osvw,ibs,xop,skinit,wdt,lwp,fma4,nodeid_msr,topoext,perfctr_core,cpb,npt,lbrv,svm_lock,nrip_save,tsc_scale,vmcb_clean,flushbyasid,decodeassists,pausefilter,pfthreshold,model_Opteron_G1,model_Opteron_G2,model_Opteron_G3', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:be9b9fb3727b', 'memSize': '64528', 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.9', 'cpuSpeed': '2600.054', 'cpuSockets': '2', 'vlans': {}, 'cpuCores': '8', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.2.0', u'pc', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '2.el6.centos.7', 'version': '6', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}}
Thread-16::DEBUG::2012-03-30 07:52:42,834::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-16::DEBUG::2012-03-30 07:52:42,837::task::588::TaskManager.Task::(_updateState) Task=`229e8361-3717-4f1e-a40e-fcbc96e55c9e`::moving from state init -> state preparing
Thread-16::INFO::2012-03-30 07:52:42,840::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', conList=[{'connection': '192.168.200.32:/nfsexport', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '57d6595f-1109-49f9-a7f3-f8fe255c34bd', 'port': ''}], options=None)
Thread-16::DEBUG::2012-03-30 07:52:42,847::mount::117::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6 192.168.200.32:/nfsexport /rhev/data-center/mnt/192.168.200.32:_nfsexport' (cwd None)
Thread-16::DEBUG::2012-03-30 07:52:43,449::lvm::457::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-16::DEBUG::2012-03-30 07:52:43,452::lvm::459::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-16::DEBUG::2012-03-30 07:52:43,454::lvm::469::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-16::DEBUG::2012-03-30 07:52:43,456::lvm::471::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-16::DEBUG::2012-03-30 07:52:43,458::lvm::490::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-16::DEBUG::2012-03-30 07:52:43,460::lvm::492::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-16::INFO::2012-03-30 07:52:43,462::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '57d6595f-1109-49f9-a7f3-f8fe255c34bd'}]}
Thread-16::DEBUG::2012-03-30 07:52:43,464::task::1172::TaskManager.Task::(prepare) Task=`229e8361-3717-4f1e-a40e-fcbc96e55c9e`::finished: {'statuslist': [{'status': 0, 'id': '57d6595f-1109-49f9-a7f3-f8fe255c34bd'}]}
Thread-16::DEBUG::2012-03-30 07:52:43,466::task::588::TaskManager.Task::(_updateState) Task=`229e8361-3717-4f1e-a40e-fcbc96e55c9e`::moving from state preparing -> state finished
Thread-16::DEBUG::2012-03-30 07:52:43,467::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-16::DEBUG::2012-03-30 07:52:43,469::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-16::DEBUG::2012-03-30 07:52:43,471::task::978::TaskManager.Task::(_decref) Task=`229e8361-3717-4f1e-a40e-fcbc96e55c9e`::ref 0 aborting False
Thread-17::DEBUG::2012-03-30 07:52:43,499::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-17::DEBUG::2012-03-30 07:52:43,500::task::588::TaskManager.Task::(_updateState) Task=`03040603-99dc-4719-b19d-19561e7edf1f`::moving from state init -> state preparing
Thread-17::INFO::2012-03-30 07:52:43,500::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', hostID=1, scsiKey='13080edc-77ea-11e1-b6a4-525400c49d2a', msdUUID='8ed25a57-f53a-4cf0-bb92-781f3ce36a48', masterVersion=1, options=None)
Thread-17::DEBUG::2012-03-30 07:52:43,501::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`77d44fa7-67b3-47df-ad64-e0822d109ffb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '839' at '_connectStoragePool'
Thread-17::DEBUG::2012-03-30 07:52:43,501::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'exclusive'
Thread-17::DEBUG::2012-03-30 07:52:43,501::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'exclusive' (1 active user)
Thread-17::DEBUG::2012-03-30 07:52:43,502::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`77d44fa7-67b3-47df-ad64-e0822d109ffb`::Granted request
Thread-17::INFO::2012-03-30 07:52:43,502::sp::625::Storage.StoragePool::(connect) Connect host #1 to the storage pool 13080edc-77ea-11e1-b6a4-525400c49d2a with master domain: 8ed25a57-f53a-4cf0-bb92-781f3ce36a48 (ver = 1)
Thread-17::DEBUG::2012-03-30 07:52:43,503::lvm::457::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:43,503::lvm::459::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:43,503::lvm::469::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:43,504::lvm::471::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:43,504::lvm::490::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:43,504::lvm::492::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:43,504::misc::1022::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
Thread-17::DEBUG::2012-03-30 07:52:43,505::misc::1024::SamplingMethod::(__call__) Got in to sampling method
Thread-17::DEBUG::2012-03-30 07:52:43,505::misc::1022::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
Thread-17::DEBUG::2012-03-30 07:52:43,505::misc::1024::SamplingMethod::(__call__) Got in to sampling method
Thread-17::DEBUG::2012-03-30 07:52:43,506::iscsiadm::48::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:43,572::iscsiadm::48::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:43,575::misc::1032::SamplingMethod::(__call__) Returning last result
Thread-17::DEBUG::2012-03-30 07:52:44,968::multipath::71::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:45,162::multipath::71::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:45,166::lvm::457::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:45,168::lvm::459::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:45,170::lvm::469::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:45,172::lvm::471::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:45,174::lvm::490::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:45,176::lvm::492::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:45,178::misc::1032::SamplingMethod::(__call__) Returning last result
Thread-17::DEBUG::2012-03-30 07:52:45,180::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:45,187::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:46,024::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:46,033::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:46,036::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with LvMetadataRW backend
Thread-17::DEBUG::2012-03-30 07:52:46,040::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 8ed25a57-f53a-4cf0-bb92-781f3ce36a48/metadata' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:47,001::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:47,005::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:47,007::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:47,009::blockSD::177::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/metadata count=1' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:47,047::blockSD::177::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000862673 s, 2.4 MB/s\n'; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:47,050::misc::318::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000862673 s, 2.4 MB/s'], size: 2048
Thread-17::DEBUG::2012-03-30 07:52:47,052::persistentDict::216::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
Thread-17::WARNING::2012-03-30 07:52:47,054::persistentDict::238::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is
Thread-17::DEBUG::2012-03-30 07:52:47,055::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with VGTagMetadataRW backend
Thread-17::DEBUG::2012-03-30 07:52:47,058::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:47,060::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:47,062::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:47,064::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:47,066::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:47,069::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:47,821::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:47,830::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:47,833::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=3', u'_SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c']
Thread-17::DEBUG::2012-03-30 07:52:47,838::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 8ed25a57-f53a-4cf0-bb92-781f3ce36a48/ids' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:48,723::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:48,726::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:48,728::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:48,732::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 8ed25a57-f53a-4cf0-bb92-781f3ce36a48/leases' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:49,623::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:49,626::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:49,629::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:49,633::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 8ed25a57-f53a-4cf0-bb92-781f3ce36a48/inbox 8ed25a57-f53a-4cf0-bb92-781f3ce36a48/outbox 8ed25a57-f53a-4cf0-bb92-781f3ce36a48/master' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:50,615::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:50,618::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:50,621::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:50,624::lvm::316::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:50,627::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:51,384::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:51,388::lvm::339::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:51,392::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '8ed25a57-f53a-4cf0-bb92-781f3ce36a48_imageNS'
Thread-17::DEBUG::2012-03-30 07:52:51,395::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '8ed25a57-f53a-4cf0-bb92-781f3ce36a48_volumeNS'
Thread-17::DEBUG::2012-03-30 07:52:51,397::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '8ed25a57-f53a-4cf0-bb92-781f3ce36a48_lvmActivationNS'
Thread-17::DEBUG::2012-03-30 07:52:51,400::sp::1459::Storage.StoragePool::(getMasterDomain) Master domain 8ed25a57-f53a-4cf0-bb92-781f3ce36a48 verified, version 1
Thread-17::DEBUG::2012-03-30 07:52:51,401::misc::1022::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
Thread-17::DEBUG::2012-03-30 07:52:51,403::misc::1024::SamplingMethod::(__call__) Got in to sampling method
Thread-17::DEBUG::2012-03-30 07:52:51,407::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:51,409::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:51,411::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:51,413::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:51,415::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:51,418::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:52,151::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:52,160::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:52,163::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=3', u'_SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c']
Thread-17::DEBUG::2012-03-30 07:52:52,167::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:52,171::lvm::284::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free bb13e29f-0e5a-4f79-8bf2-f235a0dbd515' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:52,934::lvm::284::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "bb13e29f-0e5a-4f79-8bf2-f235a0dbd515" not found\n'; <rc> = 5
Thread-17::WARNING::2012-03-30 07:52:52,942::lvm::353::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "bb13e29f-0e5a-4f79-8bf2-f235a0dbd515" not found']
Thread-17::DEBUG::2012-03-30 07:52:52,944::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:54,034::fileSD::101::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.200.32:_nfsexport/bb13e29f-0e5a-4f79-8bf2-f235a0dbd515
Thread-17::DEBUG::2012-03-30 07:52:54,038::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with FileMetadataRW backend
Thread-17::DEBUG::2012-03-30 07:52:54,049::persistentDict::216::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=NFS-EXPORT', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', 'REMOTE_PATH=192.168.200.32:/nfsexport', 'ROLE=Regular', 'SDUUID=bb13e29f-0e5a-4f79-8bf2-f235a0dbd515', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8c2ad68482314ea3bc45cc5424ce41fb386b9671']
Thread-17::DEBUG::2012-03-30 07:52:54,061::fileSD::324::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
Thread-17::DEBUG::2012-03-30 07:52:54,064::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515_imageNS'
Thread-17::DEBUG::2012-03-30 07:52:54,066::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515_volumeNS'
Thread-17::DEBUG::2012-03-30 07:52:54,070::sp::1489::Storage.StoragePool::(updateMonitoringThreads) sp `13080edc-77ea-11e1-b6a4-525400c49d2a` started monitoring domain `bb13e29f-0e5a-4f79-8bf2-f235a0dbd515`
Thread-17::DEBUG::2012-03-30 07:52:54,079::sp::1489::Storage.StoragePool::(updateMonitoringThreads) sp `13080edc-77ea-11e1-b6a4-525400c49d2a` started monitoring domain `8ed25a57-f53a-4cf0-bb92-781f3ce36a48`
Thread-21::DEBUG::2012-03-30 07:52:54,083::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:54,087::misc::1032::SamplingMethod::(__call__) Returning last result
Thread-17::DEBUG::2012-03-30 07:52:54,109::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-17::DEBUG::2012-03-30 07:52:54,117::lvm::284::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free bb13e29f-0e5a-4f79-8bf2-f235a0dbd515' (cwd None)
Thread-21::DEBUG::2012-03-30 07:52:54,831::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:54,865::lvm::284::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "bb13e29f-0e5a-4f79-8bf2-f235a0dbd515" not found\n'; <rc> = 5
Thread-17::WARNING::2012-03-30 07:52:54,872::lvm::353::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "bb13e29f-0e5a-4f79-8bf2-f235a0dbd515" not found']
Thread-17::DEBUG::2012-03-30 07:52:54,874::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-17::INFO::2012-03-30 07:52:54,882::sp::1062::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.200.32:_nfsexport/bb13e29f-0e5a-4f79-8bf2-f235a0dbd515 to /rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/bb13e29f-0e5a-4f79-8bf2-f235a0dbd515
Thread-17::INFO::2012-03-30 07:52:54,890::sp::1062::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/8ed25a57-f53a-4cf0-bb92-781f3ce36a48 to /rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/8ed25a57-f53a-4cf0-bb92-781f3ce36a48
Thread-17::INFO::2012-03-30 07:52:54,892::sp::1062::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/8ed25a57-f53a-4cf0-bb92-781f3ce36a48 to /rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd
Thread-17::DEBUG::2012-03-30 07:52:54,896::threadPool::45::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0
Thread-17::DEBUG::2012-03-30 07:52:54,906::storage_mailbox::250::Storage.Misc.excCmd::(_initMailbox) '/bin/dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:54,953::storage_mailbox::250::Storage.Misc.excCmd::(_initMailbox) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00579266 s, 707 kB/s\n'; <rc> = 0
Thread-17::INFO::2012-03-30 07:52:54,957::storage_mailbox::340::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8']
Thread-17::DEBUG::2012-03-30 07:52:54,959::storage_mailbox::344::Storage.Misc.excCmd::(_sendMail) '/bin/dd of=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None)
Thread-17::DEBUG::2012-03-30 07:52:56,001::storage_mailbox::344::Storage.Misc.excCmd::(_sendMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00143 s, 4.1 kB/s\n'; <rc> = 0
Thread-17::DEBUG::2012-03-30 07:52:56,006::storage_mailbox::181::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 13080edc-77ea-11e1-b6a4-525400c49d2a
Thread-17::DEBUG::2012-03-30 07:52:56,009::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-17::DEBUG::2012-03-30 07:52:56,012::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-17::DEBUG::2012-03-30 07:52:56,013::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-17::DEBUG::2012-03-30 07:52:56,015::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-17::INFO::2012-03-30 07:52:56,017::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
Thread-17::DEBUG::2012-03-30 07:52:56,019::task::1172::TaskManager.Task::(prepare) Task=`03040603-99dc-4719-b19d-19561e7edf1f`::finished: True
Thread-17::DEBUG::2012-03-30 07:52:56,021::task::588::TaskManager.Task::(_updateState) Task=`03040603-99dc-4719-b19d-19561e7edf1f`::moving from state preparing -> state finished
Thread-17::DEBUG::2012-03-30 07:52:56,023::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-17::DEBUG::2012-03-30 07:52:56,024::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-17::DEBUG::2012-03-30 07:52:56,026::task::978::TaskManager.Task::(_decref) Task=`03040603-99dc-4719-b19d-19561e7edf1f`::ref 0 aborting False
Thread-30::DEBUG::2012-03-30 07:53:00,104::task::588::TaskManager.Task::(_updateState) Task=`b42013fd-70f7-431d-83de-43da039d5c04`::moving from state init -> state preparing
Thread-30::INFO::2012-03-30 07:53:00,107::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-30::INFO::2012-03-30 07:53:00,109::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00184392929077', 'lastCheck': 1333086774.841877, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00457787513733', 'lastCheck': 1333086774.1130149, 'code': 0, 'valid': True}}
Thread-30::DEBUG::2012-03-30 07:53:00,110::task::1172::TaskManager.Task::(prepare) Task=`b42013fd-70f7-431d-83de-43da039d5c04`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00184392929077', 'lastCheck': 1333086774.841877, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00457787513733', 'lastCheck': 1333086774.1130149, 'code': 0, 'valid': True}}
Thread-30::DEBUG::2012-03-30 07:53:00,112::task::588::TaskManager.Task::(_updateState) Task=`b42013fd-70f7-431d-83de-43da039d5c04`::moving from state preparing -> state finished
Thread-30::DEBUG::2012-03-30 07:53:00,114::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-30::DEBUG::2012-03-30 07:53:00,115::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-30::DEBUG::2012-03-30 07:53:00,117::task::978::TaskManager.Task::(_decref) Task=`b42013fd-70f7-431d-83de-43da039d5c04`::ref 0 aborting False
Thread-33::DEBUG::2012-03-30 07:53:03,352::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-33::DEBUG::2012-03-30 07:53:03,375::task::588::TaskManager.Task::(_updateState) Task=`85eff313-3578-49cc-a34a-05acb432d943`::moving from state init -> state preparing
Thread-33::INFO::2012-03-30 07:53:03,412::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-33::DEBUG::2012-03-30 07:53:03,415::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-33::DEBUG::2012-03-30 07:53:03,417::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-33::DEBUG::2012-03-30 07:53:03,419::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-33::DEBUG::2012-03-30 07:53:03,421::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-33::DEBUG::2012-03-30 07:53:03,423::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-33::DEBUG::2012-03-30 07:53:03,426::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\<file:///\\%22a%25360014052dd702d2defc8d459adba02dc%25\>", \\"r%.*%\\<file:///\\%22r%25.*%25\>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-33::DEBUG::2012-03-30 07:53:04,177::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-33::DEBUG::2012-03-30 07:53:04,192::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-33::DEBUG::2012-03-30 07:53:04,196::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=3', u'_SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c']
Thread-33::INFO::2012-03-30 07:53:04,200::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 3}}
Thread-33::DEBUG::2012-03-30 07:53:04,202::task::1172::TaskManager.Task::(prepare) Task=`85eff313-3578-49cc-a34a-05acb432d943`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 3}}
Thread-33::DEBUG::2012-03-30 07:53:04,204::task::588::TaskManager.Task::(_updateState) Task=`85eff313-3578-49cc-a34a-05acb432d943`::moving from state preparing -> state finished
Thread-33::DEBUG::2012-03-30 07:53:04,205::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-33::DEBUG::2012-03-30 07:53:04,207::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-33::DEBUG::2012-03-30 07:53:04,208::task::978::TaskManager.Task::(_decref) Task=`85eff313-3578-49cc-a34a-05acb432d943`::ref 0 aborting False
Thread-35::DEBUG::2012-03-30 07:53:04,225::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-35::DEBUG::2012-03-30 07:53:04,229::task::588::TaskManager.Task::(_updateState) Task=`1114ebfd-2aae-4528-bf86-61ea96b07bf2`::moving from state init -> state preparing
Thread-35::INFO::2012-03-30 07:53:04,232::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
Thread-35::DEBUG::2012-03-30 07:53:04,234::taskManager::103::TaskManager::(getAllTasksStatuses) Entry.
Thread-35::DEBUG::2012-03-30 07:53:04,236::taskManager::112::TaskManager::(getAllTasksStatuses) Return: {}
Thread-35::INFO::2012-03-30 07:53:04,237::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}}
Thread-35::DEBUG::2012-03-30 07:53:04,240::task::1172::TaskManager.Task::(prepare) Task=`1114ebfd-2aae-4528-bf86-61ea96b07bf2`::finished: {'allTasksStatus': {}}
Thread-35::DEBUG::2012-03-30 07:53:04,242::task::588::TaskManager.Task::(_updateState) Task=`1114ebfd-2aae-4528-bf86-61ea96b07bf2`::moving from state preparing -> state finished
Thread-35::DEBUG::2012-03-30 07:53:04,244::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-35::DEBUG::2012-03-30 07:53:04,245::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-35::DEBUG::2012-03-30 07:53:04,247::task::978::TaskManager.Task::(_decref) Task=`1114ebfd-2aae-4528-bf86-61ea96b07bf2`::ref 0 aborting False
Thread-36::DEBUG::2012-03-30 07:53:04,262::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-36::DEBUG::2012-03-30 07:53:04,265::task::588::TaskManager.Task::(_updateState) Task=`19af41be-95a4-4f44-ba4d-aeffe7629d88`::moving from state init -> state preparing
Thread-36::INFO::2012-03-30 07:53:04,267::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-36::DEBUG::2012-03-30 07:53:04,270::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-36::DEBUG::2012-03-30 07:53:04,272::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-36::DEBUG::2012-03-30 07:53:04,273::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-36::DEBUG::2012-03-30 07:53:04,275::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-36::DEBUG::2012-03-30 07:53:04,277::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-36::DEBUG::2012-03-30 07:53:04,281::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-21::DEBUG::2012-03-30 07:53:04,844::lvm::349::OperationMutex::(_reloadvgs) Got the operational mutex
Thread-21::DEBUG::2012-03-30 07:53:04,848::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-36::DEBUG::2012-03-30 07:53:05,019::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-36::DEBUG::2012-03-30 07:53:05,029::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=3', u'_SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c']
Thread-36::INFO::2012-03-30 07:53:05,032::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 3}}
Thread-36::DEBUG::2012-03-30 07:53:05,034::task::1172::TaskManager.Task::(prepare) Task=`19af41be-95a4-4f44-ba4d-aeffe7629d88`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 3}}
Thread-36::DEBUG::2012-03-30 07:53:05,036::task::588::TaskManager.Task::(_updateState) Task=`19af41be-95a4-4f44-ba4d-aeffe7629d88`::moving from state preparing -> state finished
Thread-36::DEBUG::2012-03-30 07:53:05,038::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-36::DEBUG::2012-03-30 07:53:05,039::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-36::DEBUG::2012-03-30 07:53:05,041::task::978::TaskManager.Task::(_decref) Task=`19af41be-95a4-4f44-ba4d-aeffe7629d88`::ref 0 aborting False
Thread-37::DEBUG::2012-03-30 07:53:05,052::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-37::DEBUG::2012-03-30 07:53:05,056::task::588::TaskManager.Task::(_updateState) Task=`dc5f7d4e-8ebc-459d-b4a3-182344a8a28e`::moving from state init -> state preparing
Thread-37::INFO::2012-03-30 07:53:05,057::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-37::DEBUG::2012-03-30 07:53:05,060::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting...
Thread-21::DEBUG::2012-03-30 07:53:05,588::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-21::DEBUG::2012-03-30 07:53:05,596::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-37::DEBUG::2012-03-30 07:53:05,599::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-37::DEBUG::2012-03-30 07:53:05,602::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-37::DEBUG::2012-03-30 07:53:05,604::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-37::DEBUG::2012-03-30 07:53:05,606::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-37::DEBUG::2012-03-30 07:53:05,608::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-37::DEBUG::2012-03-30 07:53:05,612::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-37::DEBUG::2012-03-30 07:53:06,353::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
Thread-37::DEBUG::2012-03-30 07:53:06,362::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-37::DEBUG::2012-03-30 07:53:06,365::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=3', u'_SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c']
Thread-37::INFO::2012-03-30 07:53:06,368::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 3}}
Thread-37::DEBUG::2012-03-30 07:53:06,371::task::1172::TaskManager.Task::(prepare) Task=`dc5f7d4e-8ebc-459d-b4a3-182344a8a28e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 3}}
Thread-37::DEBUG::2012-03-30 07:53:06,377::task::588::TaskManager.Task::(_updateState) Task=`dc5f7d4e-8ebc-459d-b4a3-182344a8a28e`::moving from state preparing -> state finished
Thread-37::DEBUG::2012-03-30 07:53:06,379::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-37::DEBUG::2012-03-30 07:53:06,380::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-37::DEBUG::2012-03-30 07:53:06,382::task::978::TaskManager.Task::(_decref) Task=`dc5f7d4e-8ebc-459d-b4a3-182344a8a28e`::ref 0 aborting False
Thread-39::DEBUG::2012-03-30 07:53:06,410::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-39::DEBUG::2012-03-30 07:53:06,413::task::588::TaskManager.Task::(_updateState) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::moving from state init -> state preparing
Thread-39::INFO::2012-03-30 07:53:06,415::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', prevID=1, prevLVER='3', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='2', options=None)
Thread-39::DEBUG::2012-03-30 07:53:06,418::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`6a90c1f3-ed1d-42c9-925f-1d1f30c4d813`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '492' at 'spmStart'
Thread-39::DEBUG::2012-03-30 07:53:06,420::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'exclusive'
Thread-39::DEBUG::2012-03-30 07:53:06,422::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'exclusive' (1 active user)
Thread-39::DEBUG::2012-03-30 07:53:06,424::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`6a90c1f3-ed1d-42c9-925f-1d1f30c4d813`::Granted request
Thread-39::DEBUG::2012-03-30 07:53:06,427::task::817::TaskManager.Task::(resourceAcquired) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (exclusive)
Thread-39::DEBUG::2012-03-30 07:53:06,428::task::978::TaskManager.Task::(_decref) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::ref 1 aborting False
Thread-39::INFO::2012-03-30 07:53:06,430::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None
Thread-39::DEBUG::2012-03-30 07:53:06,432::task::1167::TaskManager.Task::(prepare) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::Prepare: 1 jobs exist, move to acquiring
Thread-39::DEBUG::2012-03-30 07:53:06,433::task::588::TaskManager.Task::(_updateState) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::moving from state preparing -> state acquiring
Thread-39::DEBUG::2012-03-30 07:53:06,435::task::588::TaskManager.Task::(_updateState) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::moving from state acquiring -> state queued
Thread-39::DEBUG::2012-03-30 07:53:06,436::taskManager::48::TaskManager::(_queueTask) queueing task: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-39::DEBUG::2012-03-30 07:53:06,438::taskManager::54::TaskManager::(_queueTask) task queued: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-1::DEBUG::2012-03-30 07:53:06,439::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1
Thread-39::DEBUG::2012-03-30 07:53:06,441::task::1169::TaskManager.Task::(prepare) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::returning
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,443::threadPool::212::Misc.ThreadPool.WorkerThread::(run) Task: c92d6dc3-c62d-4a15-8b87-2996029958b3 running: <bound method Task.commit of <storage.task.Task instance at 0x7ffdcc29b6c8>> with: None
Thread-39::DEBUG::2012-03-30 07:53:06,445::task::978::TaskManager.Task::(_decref) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::ref 0 aborting False
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,446::task::1181::TaskManager.Task::(commit) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::Commiting task: c92d6dc3-c62d-4a15-8b87-2996029958b3
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,450::task::588::TaskManager.Task::(_updateState) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::moving from state queued -> state running
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,452::task::892::TaskManager.Task::(_runJobs) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7ffdcc153510>> (args: (1, '3', 'false', 250, 2) kwargs: {})
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,454::task::317::TaskManager.Task::(run) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7ffdcc153510>> (args: (1, '3', 'false', 250, 2) kwargs: {}) callback None
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,456::misc::1022::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,457::misc::1024::SamplingMethod::(__call__) Got in to sampling method
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,459::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,461::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,463::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,465::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,467::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:06,471::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,211::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,220::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,223::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=3', u'_SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c']
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,227::misc::1032::SamplingMethod::(__call__) Returning last result
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,229::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,231::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,233::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,235::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,237::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,240::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-40::DEBUG::2012-03-30 07:53:07,463::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-40::DEBUG::2012-03-30 07:53:07,468::task::588::TaskManager.Task::(_updateState) Task=`4e791758-c80f-4dc9-ab9b-f18d98b4807a`::moving from state init -> state preparing
Thread-40::INFO::2012-03-30 07:53:07,470::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-40::DEBUG::2012-03-30 07:53:07,471::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-40::DEBUG::2012-03-30 07:53:07,473::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-40::INFO::2012-03-30 07:53:07,475::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-40::DEBUG::2012-03-30 07:53:07,476::task::1172::TaskManager.Task::(prepare) Task=`4e791758-c80f-4dc9-ab9b-f18d98b4807a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-40::DEBUG::2012-03-30 07:53:07,478::task::588::TaskManager.Task::(_updateState) Task=`4e791758-c80f-4dc9-ab9b-f18d98b4807a`::moving from state preparing -> state finished
Thread-40::DEBUG::2012-03-30 07:53:07,480::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-40::DEBUG::2012-03-30 07:53:07,481::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-40::DEBUG::2012-03-30 07:53:07,483::task::978::TaskManager.Task::(_decref) Task=`4e791758-c80f-4dc9-ab9b-f18d98b4807a`::ref 0 aborting False
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,976::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,984::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,987::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=3', u'_SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c']
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,991::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,993::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,995::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,997::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:07,999::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,002::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-42::DEBUG::2012-03-30 07:53:08,496::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-42::DEBUG::2012-03-30 07:53:08,501::task::588::TaskManager.Task::(_updateState) Task=`0479ee0d-7ad4-4924-9525-930e7e82fd09`::moving from state init -> state preparing
Thread-42::INFO::2012-03-30 07:53:08,530::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-42::DEBUG::2012-03-30 07:53:08,532::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-42::DEBUG::2012-03-30 07:53:08,533::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-42::INFO::2012-03-30 07:53:08,535::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-42::DEBUG::2012-03-30 07:53:08,537::task::1172::TaskManager.Task::(prepare) Task=`0479ee0d-7ad4-4924-9525-930e7e82fd09`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-42::DEBUG::2012-03-30 07:53:08,538::task::588::TaskManager.Task::(_updateState) Task=`0479ee0d-7ad4-4924-9525-930e7e82fd09`::moving from state preparing -> state finished
Thread-42::DEBUG::2012-03-30 07:53:08,540::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-42::DEBUG::2012-03-30 07:53:08,542::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-42::DEBUG::2012-03-30 07:53:08,543::task::978::TaskManager.Task::(_decref) Task=`0479ee0d-7ad4-4924-9525-930e7e82fd09`::ref 0 aborting False
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,743::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,751::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,754::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=3', u'_SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c']
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,759::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,761::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,763::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,765::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,767::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with LvMetadataRW backend
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,769::blockSD::177::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/metadata count=1' (cwd None)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,808::blockSD::177::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000762324 s, 2.7 MB/s\n'; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,811::misc::318::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000762324 s, 2.7 MB/s'], size: 2048
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,812::persistentDict::216::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
c92d6dc3-c62d-4a15-8b87-2996029958b3::WARNING::2012-03-30 07:53:08,814::persistentDict::238::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,816::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with VGTagMetadataRW backend
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,818::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,820::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,822::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,824::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,826::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:08,830::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-43::DEBUG::2012-03-30 07:53:09,559::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-43::DEBUG::2012-03-30 07:53:09,564::task::588::TaskManager.Task::(_updateState) Task=`a3b45750-bc42-46c4-8f1d-94ce51c10f42`::moving from state init -> state preparing
Thread-43::INFO::2012-03-30 07:53:09,566::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-43::DEBUG::2012-03-30 07:53:09,567::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-43::DEBUG::2012-03-30 07:53:09,569::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-43::INFO::2012-03-30 07:53:09,570::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-43::DEBUG::2012-03-30 07:53:09,572::task::1172::TaskManager.Task::(prepare) Task=`a3b45750-bc42-46c4-8f1d-94ce51c10f42`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-43::DEBUG::2012-03-30 07:53:09,574::task::588::TaskManager.Task::(_updateState) Task=`a3b45750-bc42-46c4-8f1d-94ce51c10f42`::moving from state preparing -> state finished
Thread-43::DEBUG::2012-03-30 07:53:09,575::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-43::DEBUG::2012-03-30 07:53:09,577::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-43::DEBUG::2012-03-30 07:53:09,579::task::978::TaskManager.Task::(_decref) Task=`a3b45750-bc42-46c4-8f1d-94ce51c10f42`::ref 0 aborting False
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:09,585::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:09,594::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:09,597::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=3', u'_SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c']
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:09,601::safelease::85::ClusterLock::(acquire) Acquiring cluster lock for domain 8ed25a57-f53a-4cf0-bb92-781f3ce36a48
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:09,604::safelease::94::Storage.Misc.excCmd::(acquire) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c1 -n0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 8ed25a57-f53a-4cf0-bb92-781f3ce36a48 1 5 /dev/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/leases 60000 10000 3"' (cwd /usr/libexec/vdsm)
Thread-44::DEBUG::2012-03-30 07:53:10,242::task::588::TaskManager.Task::(_updateState) Task=`ad6b8fbe-c046-4357-b0b8-61e3de800e98`::moving from state init -> state preparing
Thread-44::INFO::2012-03-30 07:53:10,245::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-44::INFO::2012-03-30 07:53:10,247::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00114417076111', 'lastCheck': 1333086786.37588, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00341296195984', 'lastCheck': 1333086784.127619, 'code': 0, 'valid': True}}
Thread-44::DEBUG::2012-03-30 07:53:10,249::task::1172::TaskManager.Task::(prepare) Task=`ad6b8fbe-c046-4357-b0b8-61e3de800e98`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00114417076111', 'lastCheck': 1333086786.37588, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00341296195984', 'lastCheck': 1333086784.127619, 'code': 0, 'valid': True}}
Thread-44::DEBUG::2012-03-30 07:53:10,251::task::588::TaskManager.Task::(_updateState) Task=`ad6b8fbe-c046-4357-b0b8-61e3de800e98`::moving from state preparing -> state finished
Thread-44::DEBUG::2012-03-30 07:53:10,253::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-44::DEBUG::2012-03-30 07:53:10,254::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-44::DEBUG::2012-03-30 07:53:10,256::task::978::TaskManager.Task::(_decref) Task=`ad6b8fbe-c046-4357-b0b8-61e3de800e98`::ref 0 aborting False
Thread-46::DEBUG::2012-03-30 07:53:10,595::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-46::DEBUG::2012-03-30 07:53:10,598::task::588::TaskManager.Task::(_updateState) Task=`e6ad9ab1-c1a6-4685-80ed-aa41f1f837db`::moving from state init -> state preparing
Thread-46::INFO::2012-03-30 07:53:10,599::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-46::DEBUG::2012-03-30 07:53:10,601::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-46::DEBUG::2012-03-30 07:53:10,603::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-46::INFO::2012-03-30 07:53:10,604::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-46::DEBUG::2012-03-30 07:53:10,606::task::1172::TaskManager.Task::(prepare) Task=`e6ad9ab1-c1a6-4685-80ed-aa41f1f837db`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-46::DEBUG::2012-03-30 07:53:10,608::task::588::TaskManager.Task::(_updateState) Task=`e6ad9ab1-c1a6-4685-80ed-aa41f1f837db`::moving from state preparing -> state finished
Thread-46::DEBUG::2012-03-30 07:53:10,609::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-46::DEBUG::2012-03-30 07:53:10,611::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-46::DEBUG::2012-03-30 07:53:10,612::task::978::TaskManager.Task::(_decref) Task=`e6ad9ab1-c1a6-4685-80ed-aa41f1f837db`::ref 0 aborting False
Thread-47::DEBUG::2012-03-30 07:53:11,624::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-47::DEBUG::2012-03-30 07:53:11,627::task::588::TaskManager.Task::(_updateState) Task=`afcc9be8-3e43-4b82-abe1-fc65ba5b6981`::moving from state init -> state preparing
Thread-47::INFO::2012-03-30 07:53:11,628::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-47::DEBUG::2012-03-30 07:53:11,630::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-47::DEBUG::2012-03-30 07:53:11,632::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-47::INFO::2012-03-30 07:53:11,633::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-47::DEBUG::2012-03-30 07:53:11,635::task::1172::TaskManager.Task::(prepare) Task=`afcc9be8-3e43-4b82-abe1-fc65ba5b6981`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-47::DEBUG::2012-03-30 07:53:11,637::task::588::TaskManager.Task::(_updateState) Task=`afcc9be8-3e43-4b82-abe1-fc65ba5b6981`::moving from state preparing -> state finished
Thread-47::DEBUG::2012-03-30 07:53:11,638::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-47::DEBUG::2012-03-30 07:53:11,640::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-47::DEBUG::2012-03-30 07:53:11,642::task::978::TaskManager.Task::(_decref) Task=`afcc9be8-3e43-4b82-abe1-fc65ba5b6981`::ref 0 aborting False
Thread-49::DEBUG::2012-03-30 07:53:12,655::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-49::DEBUG::2012-03-30 07:53:12,658::task::588::TaskManager.Task::(_updateState) Task=`cc490a3f-82c5-4135-90ca-c2ed8eb25c5a`::moving from state init -> state preparing
Thread-49::INFO::2012-03-30 07:53:12,660::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-49::DEBUG::2012-03-30 07:53:12,661::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-49::DEBUG::2012-03-30 07:53:12,663::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-49::INFO::2012-03-30 07:53:12,664::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-49::DEBUG::2012-03-30 07:53:12,666::task::1172::TaskManager.Task::(prepare) Task=`cc490a3f-82c5-4135-90ca-c2ed8eb25c5a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-49::DEBUG::2012-03-30 07:53:12,668::task::588::TaskManager.Task::(_updateState) Task=`cc490a3f-82c5-4135-90ca-c2ed8eb25c5a`::moving from state preparing -> state finished
Thread-49::DEBUG::2012-03-30 07:53:12,669::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-49::DEBUG::2012-03-30 07:53:12,671::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-49::DEBUG::2012-03-30 07:53:12,672::task::978::TaskManager.Task::(_decref) Task=`cc490a3f-82c5-4135-90ca-c2ed8eb25c5a`::ref 0 aborting False
Thread-50::DEBUG::2012-03-30 07:53:13,686::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-50::DEBUG::2012-03-30 07:53:13,689::task::588::TaskManager.Task::(_updateState) Task=`1cb73fb9-e098-45c8-be44-8ae47ec395ff`::moving from state init -> state preparing
Thread-50::INFO::2012-03-30 07:53:13,739::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-50::DEBUG::2012-03-30 07:53:13,740::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-50::DEBUG::2012-03-30 07:53:13,742::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-50::INFO::2012-03-30 07:53:13,744::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-50::DEBUG::2012-03-30 07:53:13,745::task::1172::TaskManager.Task::(prepare) Task=`1cb73fb9-e098-45c8-be44-8ae47ec395ff`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-50::DEBUG::2012-03-30 07:53:13,747::task::588::TaskManager.Task::(_updateState) Task=`1cb73fb9-e098-45c8-be44-8ae47ec395ff`::moving from state preparing -> state finished
Thread-50::DEBUG::2012-03-30 07:53:13,748::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-50::DEBUG::2012-03-30 07:53:13,750::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-50::DEBUG::2012-03-30 07:53:13,752::task::978::TaskManager.Task::(_decref) Task=`1cb73fb9-e098-45c8-be44-8ae47ec395ff`::ref 0 aborting False
Thread-52::DEBUG::2012-03-30 07:53:14,763::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-52::DEBUG::2012-03-30 07:53:14,766::task::588::TaskManager.Task::(_updateState) Task=`778089c9-9a2a-4cdc-8959-abeab1cc86db`::moving from state init -> state preparing
Thread-52::INFO::2012-03-30 07:53:14,768::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-52::DEBUG::2012-03-30 07:53:14,770::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-52::DEBUG::2012-03-30 07:53:14,771::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-52::INFO::2012-03-30 07:53:14,773::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-52::DEBUG::2012-03-30 07:53:14,774::task::1172::TaskManager.Task::(prepare) Task=`778089c9-9a2a-4cdc-8959-abeab1cc86db`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-52::DEBUG::2012-03-30 07:53:14,776::task::588::TaskManager.Task::(_updateState) Task=`778089c9-9a2a-4cdc-8959-abeab1cc86db`::moving from state preparing -> state finished
Thread-52::DEBUG::2012-03-30 07:53:14,777::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-52::DEBUG::2012-03-30 07:53:14,779::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-52::DEBUG::2012-03-30 07:53:14,781::task::978::TaskManager.Task::(_decref) Task=`778089c9-9a2a-4cdc-8959-abeab1cc86db`::ref 0 aborting False
Thread-53::DEBUG::2012-03-30 07:53:15,797::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-53::DEBUG::2012-03-30 07:53:15,800::task::588::TaskManager.Task::(_updateState) Task=`5f4fbc8b-cf75-45f7-8801-02927772b2af`::moving from state init -> state preparing
Thread-53::INFO::2012-03-30 07:53:15,802::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-53::DEBUG::2012-03-30 07:53:15,803::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-53::DEBUG::2012-03-30 07:53:15,805::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-53::INFO::2012-03-30 07:53:15,807::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-53::DEBUG::2012-03-30 07:53:15,808::task::1172::TaskManager.Task::(prepare) Task=`5f4fbc8b-cf75-45f7-8801-02927772b2af`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-53::DEBUG::2012-03-30 07:53:15,810::task::588::TaskManager.Task::(_updateState) Task=`5f4fbc8b-cf75-45f7-8801-02927772b2af`::moving from state preparing -> state finished
Thread-53::DEBUG::2012-03-30 07:53:15,811::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-53::DEBUG::2012-03-30 07:53:15,813::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-53::DEBUG::2012-03-30 07:53:15,814::task::978::TaskManager.Task::(_decref) Task=`5f4fbc8b-cf75-45f7-8801-02927772b2af`::ref 0 aborting False
Thread-55::DEBUG::2012-03-30 07:53:16,826::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-55::DEBUG::2012-03-30 07:53:16,829::task::588::TaskManager.Task::(_updateState) Task=`9d11bd47-57fd-4013-a9c8-b6b698478805`::moving from state init -> state preparing
Thread-55::INFO::2012-03-30 07:53:16,831::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-55::DEBUG::2012-03-30 07:53:16,832::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-55::DEBUG::2012-03-30 07:53:16,834::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-55::INFO::2012-03-30 07:53:16,835::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-55::DEBUG::2012-03-30 07:53:16,837::task::1172::TaskManager.Task::(prepare) Task=`9d11bd47-57fd-4013-a9c8-b6b698478805`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-55::DEBUG::2012-03-30 07:53:16,839::task::588::TaskManager.Task::(_updateState) Task=`9d11bd47-57fd-4013-a9c8-b6b698478805`::moving from state preparing -> state finished
Thread-55::DEBUG::2012-03-30 07:53:16,840::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-55::DEBUG::2012-03-30 07:53:16,842::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-55::DEBUG::2012-03-30 07:53:16,843::task::978::TaskManager.Task::(_decref) Task=`9d11bd47-57fd-4013-a9c8-b6b698478805`::ref 0 aborting False
Thread-56::DEBUG::2012-03-30 07:53:17,855::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-56::DEBUG::2012-03-30 07:53:17,858::task::588::TaskManager.Task::(_updateState) Task=`a8c56ca7-f1c0-457f-808d-b6f518289859`::moving from state init -> state preparing
Thread-56::INFO::2012-03-30 07:53:17,860::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-56::DEBUG::2012-03-30 07:53:17,861::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-56::DEBUG::2012-03-30 07:53:17,862::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-56::INFO::2012-03-30 07:53:17,864::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-56::DEBUG::2012-03-30 07:53:17,866::task::1172::TaskManager.Task::(prepare) Task=`a8c56ca7-f1c0-457f-808d-b6f518289859`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-56::DEBUG::2012-03-30 07:53:17,867::task::588::TaskManager.Task::(_updateState) Task=`a8c56ca7-f1c0-457f-808d-b6f518289859`::moving from state preparing -> state finished
Thread-56::DEBUG::2012-03-30 07:53:17,869::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-56::DEBUG::2012-03-30 07:53:17,871::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-56::DEBUG::2012-03-30 07:53:17,872::task::978::TaskManager.Task::(_decref) Task=`a8c56ca7-f1c0-457f-808d-b6f518289859`::ref 0 aborting False
Thread-58::DEBUG::2012-03-30 07:53:18,884::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-58::DEBUG::2012-03-30 07:53:18,886::task::588::TaskManager.Task::(_updateState) Task=`d9a5dc27-edd5-4f83-a6f1-229f882b5455`::moving from state init -> state preparing
Thread-58::INFO::2012-03-30 07:53:18,888::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-58::DEBUG::2012-03-30 07:53:18,890::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-58::DEBUG::2012-03-30 07:53:18,891::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-58::INFO::2012-03-30 07:53:18,893::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-58::DEBUG::2012-03-30 07:53:18,894::task::1172::TaskManager.Task::(prepare) Task=`d9a5dc27-edd5-4f83-a6f1-229f882b5455`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-58::DEBUG::2012-03-30 07:53:18,896::task::588::TaskManager.Task::(_updateState) Task=`d9a5dc27-edd5-4f83-a6f1-229f882b5455`::moving from state preparing -> state finished
Thread-58::DEBUG::2012-03-30 07:53:18,898::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-58::DEBUG::2012-03-30 07:53:18,899::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-58::DEBUG::2012-03-30 07:53:18,901::task::978::TaskManager.Task::(_decref) Task=`d9a5dc27-edd5-4f83-a6f1-229f882b5455`::ref 0 aborting False
Thread-59::DEBUG::2012-03-30 07:53:19,913::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-59::DEBUG::2012-03-30 07:53:19,916::task::588::TaskManager.Task::(_updateState) Task=`cb4c28c3-8631-4ea4-8a1b-b607589c0438`::moving from state init -> state preparing
Thread-59::INFO::2012-03-30 07:53:19,917::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-59::DEBUG::2012-03-30 07:53:19,919::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-59::DEBUG::2012-03-30 07:53:19,920::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-59::INFO::2012-03-30 07:53:19,922::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-59::DEBUG::2012-03-30 07:53:19,924::task::1172::TaskManager.Task::(prepare) Task=`cb4c28c3-8631-4ea4-8a1b-b607589c0438`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-59::DEBUG::2012-03-30 07:53:19,925::task::588::TaskManager.Task::(_updateState) Task=`cb4c28c3-8631-4ea4-8a1b-b607589c0438`::moving from state preparing -> state finished
Thread-59::DEBUG::2012-03-30 07:53:19,927::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-59::DEBUG::2012-03-30 07:53:19,928::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-59::DEBUG::2012-03-30 07:53:19,930::task::978::TaskManager.Task::(_decref) Task=`cb4c28c3-8631-4ea4-8a1b-b607589c0438`::ref 0 aborting False
Thread-60::DEBUG::2012-03-30 07:53:20,358::task::588::TaskManager.Task::(_updateState) Task=`c4849bca-96c3-4386-8a40-56e4fd2cee7d`::moving from state init -> state preparing
Thread-60::INFO::2012-03-30 07:53:20,360::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-60::INFO::2012-03-30 07:53:20,362::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00125598907471', 'lastCheck': 1333086796.3833549, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00261187553406', 'lastCheck': 1333086794.139993, 'code': 0, 'valid': True}}
Thread-60::DEBUG::2012-03-30 07:53:20,364::task::1172::TaskManager.Task::(prepare) Task=`c4849bca-96c3-4386-8a40-56e4fd2cee7d`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00125598907471', 'lastCheck': 1333086796.3833549, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00261187553406', 'lastCheck': 1333086794.139993, 'code': 0, 'valid': True}}
Thread-60::DEBUG::2012-03-30 07:53:20,366::task::588::TaskManager.Task::(_updateState) Task=`c4849bca-96c3-4386-8a40-56e4fd2cee7d`::moving from state preparing -> state finished
Thread-60::DEBUG::2012-03-30 07:53:20,368::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-60::DEBUG::2012-03-30 07:53:20,370::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-60::DEBUG::2012-03-30 07:53:20,372::task::978::TaskManager.Task::(_decref) Task=`c4849bca-96c3-4386-8a40-56e4fd2cee7d`::ref 0 aborting False
Thread-62::DEBUG::2012-03-30 07:53:20,942::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-62::DEBUG::2012-03-30 07:53:20,945::task::588::TaskManager.Task::(_updateState) Task=`46988f2d-bb7d-4b46-858a-cf2bc7363cd4`::moving from state init -> state preparing
Thread-62::INFO::2012-03-30 07:53:20,946::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-62::DEBUG::2012-03-30 07:53:20,948::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-62::DEBUG::2012-03-30 07:53:20,949::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-62::INFO::2012-03-30 07:53:20,951::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-62::DEBUG::2012-03-30 07:53:20,953::task::1172::TaskManager.Task::(prepare) Task=`46988f2d-bb7d-4b46-858a-cf2bc7363cd4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-62::DEBUG::2012-03-30 07:53:20,954::task::588::TaskManager.Task::(_updateState) Task=`46988f2d-bb7d-4b46-858a-cf2bc7363cd4`::moving from state preparing -> state finished
Thread-62::DEBUG::2012-03-30 07:53:20,956::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-62::DEBUG::2012-03-30 07:53:20,957::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-62::DEBUG::2012-03-30 07:53:20,959::task::978::TaskManager.Task::(_decref) Task=`46988f2d-bb7d-4b46-858a-cf2bc7363cd4`::ref 0 aborting False
Thread-63::DEBUG::2012-03-30 07:53:21,970::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-63::DEBUG::2012-03-30 07:53:21,973::task::588::TaskManager.Task::(_updateState) Task=`9efed0cf-54ea-4eca-a27f-00dca80403cb`::moving from state init -> state preparing
Thread-63::INFO::2012-03-30 07:53:21,975::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-63::DEBUG::2012-03-30 07:53:21,977::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-63::DEBUG::2012-03-30 07:53:21,978::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-63::INFO::2012-03-30 07:53:21,980::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-63::DEBUG::2012-03-30 07:53:21,981::task::1172::TaskManager.Task::(prepare) Task=`9efed0cf-54ea-4eca-a27f-00dca80403cb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-63::DEBUG::2012-03-30 07:53:21,983::task::588::TaskManager.Task::(_updateState) Task=`9efed0cf-54ea-4eca-a27f-00dca80403cb`::moving from state preparing -> state finished
Thread-63::DEBUG::2012-03-30 07:53:21,984::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-63::DEBUG::2012-03-30 07:53:21,986::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-63::DEBUG::2012-03-30 07:53:21,988::task::978::TaskManager.Task::(_decref) Task=`9efed0cf-54ea-4eca-a27f-00dca80403cb`::ref 0 aborting False
Thread-65::DEBUG::2012-03-30 07:53:23,010::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-65::DEBUG::2012-03-30 07:53:23,013::task::588::TaskManager.Task::(_updateState) Task=`978147bc-997e-4e4a-8f89-f274a1bd32de`::moving from state init -> state preparing
Thread-65::INFO::2012-03-30 07:53:23,015::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-65::DEBUG::2012-03-30 07:53:23,017::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-65::DEBUG::2012-03-30 07:53:23,018::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-65::INFO::2012-03-30 07:53:23,020::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-65::DEBUG::2012-03-30 07:53:23,021::task::1172::TaskManager.Task::(prepare) Task=`978147bc-997e-4e4a-8f89-f274a1bd32de`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-65::DEBUG::2012-03-30 07:53:23,023::task::588::TaskManager.Task::(_updateState) Task=`978147bc-997e-4e4a-8f89-f274a1bd32de`::moving from state preparing -> state finished
Thread-65::DEBUG::2012-03-30 07:53:23,025::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-65::DEBUG::2012-03-30 07:53:23,026::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-65::DEBUG::2012-03-30 07:53:23,028::task::978::TaskManager.Task::(_decref) Task=`978147bc-997e-4e4a-8f89-f274a1bd32de`::ref 0 aborting False
Thread-66::DEBUG::2012-03-30 07:53:24,040::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-66::DEBUG::2012-03-30 07:53:24,042::task::588::TaskManager.Task::(_updateState) Task=`1fb604a8-0753-4834-8e1d-a13ad5df77b1`::moving from state init -> state preparing
Thread-66::INFO::2012-03-30 07:53:24,068::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-66::DEBUG::2012-03-30 07:53:24,069::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-66::DEBUG::2012-03-30 07:53:24,071::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-66::INFO::2012-03-30 07:53:24,073::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-66::DEBUG::2012-03-30 07:53:24,074::task::1172::TaskManager.Task::(prepare) Task=`1fb604a8-0753-4834-8e1d-a13ad5df77b1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-66::DEBUG::2012-03-30 07:53:24,076::task::588::TaskManager.Task::(_updateState) Task=`1fb604a8-0753-4834-8e1d-a13ad5df77b1`::moving from state preparing -> state finished
Thread-66::DEBUG::2012-03-30 07:53:24,077::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-66::DEBUG::2012-03-30 07:53:24,079::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-66::DEBUG::2012-03-30 07:53:24,081::task::978::TaskManager.Task::(_decref) Task=`1fb604a8-0753-4834-8e1d-a13ad5df77b1`::ref 0 aborting False
Thread-68::DEBUG::2012-03-30 07:53:25,093::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-68::DEBUG::2012-03-30 07:53:25,096::task::588::TaskManager.Task::(_updateState) Task=`4a4b24d7-d377-4e66-b88a-bd8bee5df689`::moving from state init -> state preparing
Thread-68::INFO::2012-03-30 07:53:25,098::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-68::DEBUG::2012-03-30 07:53:25,099::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-68::DEBUG::2012-03-30 07:53:25,101::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-68::INFO::2012-03-30 07:53:25,102::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-68::DEBUG::2012-03-30 07:53:25,104::task::1172::TaskManager.Task::(prepare) Task=`4a4b24d7-d377-4e66-b88a-bd8bee5df689`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-68::DEBUG::2012-03-30 07:53:25,106::task::588::TaskManager.Task::(_updateState) Task=`4a4b24d7-d377-4e66-b88a-bd8bee5df689`::moving from state preparing -> state finished
Thread-68::DEBUG::2012-03-30 07:53:25,107::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-68::DEBUG::2012-03-30 07:53:25,109::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-68::DEBUG::2012-03-30 07:53:25,110::task::978::TaskManager.Task::(_decref) Task=`4a4b24d7-d377-4e66-b88a-bd8bee5df689`::ref 0 aborting False
Thread-69::DEBUG::2012-03-30 07:53:26,123::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-69::DEBUG::2012-03-30 07:53:26,125::task::588::TaskManager.Task::(_updateState) Task=`adb14541-a17f-4549-a484-dc8d09c39bc9`::moving from state init -> state preparing
Thread-69::INFO::2012-03-30 07:53:26,127::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-69::DEBUG::2012-03-30 07:53:26,129::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-69::DEBUG::2012-03-30 07:53:26,130::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-69::INFO::2012-03-30 07:53:26,132::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-69::DEBUG::2012-03-30 07:53:26,133::task::1172::TaskManager.Task::(prepare) Task=`adb14541-a17f-4549-a484-dc8d09c39bc9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-69::DEBUG::2012-03-30 07:53:26,135::task::588::TaskManager.Task::(_updateState) Task=`adb14541-a17f-4549-a484-dc8d09c39bc9`::moving from state preparing -> state finished
Thread-69::DEBUG::2012-03-30 07:53:26,136::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-69::DEBUG::2012-03-30 07:53:26,138::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-69::DEBUG::2012-03-30 07:53:26,140::task::978::TaskManager.Task::(_decref) Task=`adb14541-a17f-4549-a484-dc8d09c39bc9`::ref 0 aborting False
Thread-71::DEBUG::2012-03-30 07:53:27,151::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-71::DEBUG::2012-03-30 07:53:27,168::task::588::TaskManager.Task::(_updateState) Task=`8ff8b01a-87f0-4b1f-84dc-7f96a3d65400`::moving from state init -> state preparing
Thread-71::INFO::2012-03-30 07:53:27,170::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-71::DEBUG::2012-03-30 07:53:27,171::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-71::DEBUG::2012-03-30 07:53:27,173::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-71::INFO::2012-03-30 07:53:27,175::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-71::DEBUG::2012-03-30 07:53:27,176::task::1172::TaskManager.Task::(prepare) Task=`8ff8b01a-87f0-4b1f-84dc-7f96a3d65400`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-71::DEBUG::2012-03-30 07:53:27,178::task::588::TaskManager.Task::(_updateState) Task=`8ff8b01a-87f0-4b1f-84dc-7f96a3d65400`::moving from state preparing -> state finished
Thread-71::DEBUG::2012-03-30 07:53:27,179::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-71::DEBUG::2012-03-30 07:53:27,181::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-71::DEBUG::2012-03-30 07:53:27,182::task::978::TaskManager.Task::(_decref) Task=`8ff8b01a-87f0-4b1f-84dc-7f96a3d65400`::ref 0 aborting False
Thread-72::DEBUG::2012-03-30 07:53:28,194::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-72::DEBUG::2012-03-30 07:53:28,197::task::588::TaskManager.Task::(_updateState) Task=`4cdec782-3436-4c77-ae46-86324bfcfb15`::moving from state init -> state preparing
Thread-72::INFO::2012-03-30 07:53:28,199::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-72::DEBUG::2012-03-30 07:53:28,200::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-72::DEBUG::2012-03-30 07:53:28,202::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-72::INFO::2012-03-30 07:53:28,203::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-72::DEBUG::2012-03-30 07:53:28,205::task::1172::TaskManager.Task::(prepare) Task=`4cdec782-3436-4c77-ae46-86324bfcfb15`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-72::DEBUG::2012-03-30 07:53:28,207::task::588::TaskManager.Task::(_updateState) Task=`4cdec782-3436-4c77-ae46-86324bfcfb15`::moving from state preparing -> state finished
Thread-72::DEBUG::2012-03-30 07:53:28,208::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-72::DEBUG::2012-03-30 07:53:28,229::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-72::DEBUG::2012-03-30 07:53:28,231::task::978::TaskManager.Task::(_decref) Task=`4cdec782-3436-4c77-ae46-86324bfcfb15`::ref 0 aborting False
Thread-74::DEBUG::2012-03-30 07:53:29,245::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-74::DEBUG::2012-03-30 07:53:29,248::task::588::TaskManager.Task::(_updateState) Task=`8390c78a-43db-4e47-8f3e-315c21efd89b`::moving from state init -> state preparing
Thread-74::INFO::2012-03-30 07:53:29,268::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-74::DEBUG::2012-03-30 07:53:29,270::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-74::DEBUG::2012-03-30 07:53:29,271::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-74::INFO::2012-03-30 07:53:29,273::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-74::DEBUG::2012-03-30 07:53:29,275::task::1172::TaskManager.Task::(prepare) Task=`8390c78a-43db-4e47-8f3e-315c21efd89b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-74::DEBUG::2012-03-30 07:53:29,276::task::588::TaskManager.Task::(_updateState) Task=`8390c78a-43db-4e47-8f3e-315c21efd89b`::moving from state preparing -> state finished
Thread-74::DEBUG::2012-03-30 07:53:29,278::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-74::DEBUG::2012-03-30 07:53:29,279::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-74::DEBUG::2012-03-30 07:53:29,281::task::978::TaskManager.Task::(_decref) Task=`8390c78a-43db-4e47-8f3e-315c21efd89b`::ref 0 aborting False
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:29,899::safelease::94::Storage.Misc.excCmd::(acquire) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:29,902::safelease::98::ClusterLock::(acquire) Clustered lock acquired successfully
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:29,904::sp::260::Storage.StoragePool::(startSpm) spm lock acquired successfully
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:29,906::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:29,908::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:29,910::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:29,912::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:29,914::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:29,917::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-75::DEBUG::2012-03-30 07:53:30,295::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-75::DEBUG::2012-03-30 07:53:30,299::task::588::TaskManager.Task::(_updateState) Task=`e63b4ecc-0394-4b3b-af26-70dc9f45202b`::moving from state init -> state preparing
Thread-75::INFO::2012-03-30 07:53:30,301::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-75::DEBUG::2012-03-30 07:53:30,303::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-75::DEBUG::2012-03-30 07:53:30,305::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-75::INFO::2012-03-30 07:53:30,306::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-75::DEBUG::2012-03-30 07:53:30,308::task::1172::TaskManager.Task::(prepare) Task=`e63b4ecc-0394-4b3b-af26-70dc9f45202b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-75::DEBUG::2012-03-30 07:53:30,310::task::588::TaskManager.Task::(_updateState) Task=`e63b4ecc-0394-4b3b-af26-70dc9f45202b`::moving from state preparing -> state finished
Thread-75::DEBUG::2012-03-30 07:53:30,311::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-75::DEBUG::2012-03-30 07:53:30,313::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-75::DEBUG::2012-03-30 07:53:30,314::task::978::TaskManager.Task::(_decref) Task=`e63b4ecc-0394-4b3b-af26-70dc9f45202b`::ref 0 aborting False
Thread-76::DEBUG::2012-03-30 07:53:30,476::task::588::TaskManager.Task::(_updateState) Task=`7f55b665-fc8c-4512-8eec-41615f6984b3`::moving from state init -> state preparing
Thread-76::INFO::2012-03-30 07:53:30,478::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-76::INFO::2012-03-30 07:53:30,480::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00120401382446', 'lastCheck': 1333086806.390048, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00470185279846', 'lastCheck': 1333086804.1541719, 'code': 0, 'valid': True}}
Thread-76::DEBUG::2012-03-30 07:53:30,482::task::1172::TaskManager.Task::(prepare) Task=`7f55b665-fc8c-4512-8eec-41615f6984b3`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00120401382446', 'lastCheck': 1333086806.390048, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00470185279846', 'lastCheck': 1333086804.1541719, 'code': 0, 'valid': True}}
Thread-76::DEBUG::2012-03-30 07:53:30,484::task::588::TaskManager.Task::(_updateState) Task=`7f55b665-fc8c-4512-8eec-41615f6984b3`::moving from state preparing -> state finished
Thread-76::DEBUG::2012-03-30 07:53:30,485::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-76::DEBUG::2012-03-30 07:53:30,487::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-76::DEBUG::2012-03-30 07:53:30,489::task::978::TaskManager.Task::(_decref) Task=`7f55b665-fc8c-4512-8eec-41615f6984b3`::ref 0 aborting False
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,690::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,698::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,701::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=3', u'_SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c']
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,703::persistentDict::152::Storage.PersistentDict::(transaction) Starting transaction
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,706::persistentDict::158::Storage.PersistentDict::(transaction) Flushing changes
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,708::persistentDict::277::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=[u'CLASS=Data', u'DESCRIPTION=DMZ-NAS-01', u'IOOPTIMEOUTSEC=10', u'LEASERETRIES=3', u'LEASETIMESEC=60', u'LOCKPOLICY=', u'LOCKRENEWALINTERVALSEC=5', u'LOGBLKSIZE=512', u'MASTER_VERSION=1', u'PHYBLKSIZE=512', u'POOL_DESCRIPTION=Default', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=4', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'ROLE=Master', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'TYPE=ISCSI', u'VERSION=2', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', '_SHA_CKSUM=51eda422952b853b9cbcc34c2994ed160c9b6965']
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,710::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,712::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,714::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,716::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,718::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:30,721::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-78::DEBUG::2012-03-30 07:53:31,330::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-78::DEBUG::2012-03-30 07:53:31,334::task::588::TaskManager.Task::(_updateState) Task=`42062c9d-9671-4030-88d3-d9a75b5358a2`::moving from state init -> state preparing
Thread-78::INFO::2012-03-30 07:53:31,336::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-78::DEBUG::2012-03-30 07:53:31,338::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-78::DEBUG::2012-03-30 07:53:31,339::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-78::INFO::2012-03-30 07:53:31,341::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-78::DEBUG::2012-03-30 07:53:31,343::task::1172::TaskManager.Task::(prepare) Task=`42062c9d-9671-4030-88d3-d9a75b5358a2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-78::DEBUG::2012-03-30 07:53:31,344::task::588::TaskManager.Task::(_updateState) Task=`42062c9d-9671-4030-88d3-d9a75b5358a2`::moving from state preparing -> state finished
Thread-78::DEBUG::2012-03-30 07:53:31,346::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-78::DEBUG::2012-03-30 07:53:31,347::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-78::DEBUG::2012-03-30 07:53:31,349::task::978::TaskManager.Task::(_decref) Task=`42062c9d-9671-4030-88d3-d9a75b5358a2`::ref 0 aborting False
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:31,489::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:31,498::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:31,501::blockSD::158::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=51eda422952b853b9cbcc34c2994ed160c9b6965, MDT_POOL_SPM_LVER=4 removing=MDT_POOL_SPM_LVER=3, MDT__SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:31,505::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_SPM_LVER=3 --deltag MDT__SHA_CKSUM=691ccf15c338798b06fc4901de70e19a9ffbfd4c --addtag MDT_POOL_SPM_LVER=4 --addtag MDT__SHA_CKSUM=51eda422952b853b9cbcc34c2994ed160c9b6965 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-79::DEBUG::2012-03-30 07:53:32,365::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-79::DEBUG::2012-03-30 07:53:32,369::task::588::TaskManager.Task::(_updateState) Task=`704c0690-7682-4204-8c65-9eb13cb8b1b2`::moving from state init -> state preparing
Thread-79::INFO::2012-03-30 07:53:32,371::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-79::DEBUG::2012-03-30 07:53:32,372::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-79::DEBUG::2012-03-30 07:53:32,374::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-79::INFO::2012-03-30 07:53:32,376::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-79::DEBUG::2012-03-30 07:53:32,377::task::1172::TaskManager.Task::(prepare) Task=`704c0690-7682-4204-8c65-9eb13cb8b1b2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-79::DEBUG::2012-03-30 07:53:32,379::task::588::TaskManager.Task::(_updateState) Task=`704c0690-7682-4204-8c65-9eb13cb8b1b2`::moving from state preparing -> state finished
Thread-79::DEBUG::2012-03-30 07:53:32,381::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-79::DEBUG::2012-03-30 07:53:32,383::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-79::DEBUG::2012-03-30 07:53:32,384::task::978::TaskManager.Task::(_decref) Task=`704c0690-7682-4204-8c65-9eb13cb8b1b2`::ref 0 aborting False
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,396::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,399::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,401::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,403::persistentDict::160::Storage.PersistentDict::(transaction) Finished transaction
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,406::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`63cbef1c-ccd2-492e-b1f5-d7a2ed5cc595`::Request was made in '/usr/share/vdsm/storage/sp.py' line '402' at '_upgradePool'
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,408::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'exclusive'
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,410::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'exclusive' (1 active user)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,411::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`63cbef1c-ccd2-492e-b1f5-d7a2ed5cc595`::Granted request
c92d6dc3-c62d-4a15-8b87-2996029958b3::INFO::2012-03-30 07:53:32,414::sp::407::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `8ed25a57-f53a-4cf0-bb92-781f3ce36a48`
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,417::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8ed25a57-f53a-4cf0-bb92-781f3ce36a48`ReqID=`812088fd-cf1d-4746-a1f9-cea4e7b98e94`::Request was made in '/usr/share/vdsm/storage/sp.py' line '408' at '_upgradePool'
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,419::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8ed25a57-f53a-4cf0-bb92-781f3ce36a48' for lock type 'exclusive'
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,421::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8ed25a57-f53a-4cf0-bb92-781f3ce36a48' is free. Now locking as 'exclusive' (1 active user)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,422::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8ed25a57-f53a-4cf0-bb92-781f3ce36a48`ReqID=`812088fd-cf1d-4746-a1f9-cea4e7b98e94`::Granted request
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,425::lvm::464::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,427::lvm::466::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,429::lvm::475::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,431::lvm::487::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,433::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:32,436::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,184::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,193::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,196::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:360014057fda80efdcae4d414eda829d7,uuid:A6Qoj6-xizS-7K5Z-7Wb5-PASF-YMZU-qRj1ur,pestart:0,pecount:15997,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'LOGBLKSIZE=512', u'SDUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'VGUUID=LUMOEV-59iz-gOZR-Jy9S-OeM0-cAwz-8nVdyn', u'PHYBLKSIZE=512', u'DESCRIPTION=DMZ-NAS-01', u'CLASS=Data', u'IOOPTIMEOUTSEC=10', u'LEASETIMESEC=60', u'POOL_DESCRIPTION=Default', u'ROLE=Master', u'POOL_UUID=13080edc-77ea-11e1-b6a4-525400c49d2a', u'MASTER_VERSION=1', u'POOL_SPM_ID=1', u'POOL_DOMAINS=93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', u'POOL_SPM_LVER=4', u'_SHA_CKSUM=51eda422952b853b9cbcc34c2994ed160c9b6965']
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,199::blockSD::650::Storage.StorageDomain::(upgrade) Trying to upgrade domain `8ed25a57-f53a-4cf0-bb92-781f3ce36a48` from version 2 to version 2
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,200::blockSD::656::Storage.StorageDomain::(upgrade) No need to upgrade domain `8ed25a57-f53a-4cf0-bb92-781f3ce36a48`, leaving unchanged
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,202::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8ed25a57-f53a-4cf0-bb92-781f3ce36a48'
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,204::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (0 active users)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,206::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8ed25a57-f53a-4cf0-bb92-781f3ce36a48' is free, finding out if anyone is waiting for it.
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,207::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8ed25a57-f53a-4cf0-bb92-781f3ce36a48', Clearing records.
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,209::sp::411::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,211::sp::418::Storage.StoragePool::(_upgradePool) Registering with state change event
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,213::sp::420::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads
Thread-81::DEBUG::2012-03-30 07:53:33,215::sp::164::Storage.StoragePool::(_upgradePoolDomain) Preparing to upgrade domain bb13e29f-0e5a-4f79-8bf2-f235a0dbd515
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,217::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-81::DEBUG::2012-03-30 07:53:33,221::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_bb13e29f-0e5a-4f79-8bf2-f235a0dbd515`ReqID=`24694c2a-82b8-4275-b7e3-713099b4c68d`::Request was made in '/usr/share/vdsm/storage/sp.py' line '173' at '_upgradePoolDomain'
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,223::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-81::DEBUG::2012-03-30 07:53:33,225::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_bb13e29f-0e5a-4f79-8bf2-f235a0dbd515' for lock type 'exclusive'
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,226::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,229::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-81::DEBUG::2012-03-30 07:53:33,231::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_bb13e29f-0e5a-4f79-8bf2-f235a0dbd515' is free. Now locking as 'exclusive' (1 active user)
Thread-81::DEBUG::2012-03-30 07:53:33,234::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_bb13e29f-0e5a-4f79-8bf2-f235a0dbd515`ReqID=`24694c2a-82b8-4275-b7e3-713099b4c68d`::Granted request
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,237::blockSD::832::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/fsck -p /dev/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/master' (cwd None)
Thread-81::DEBUG::2012-03-30 07:53:33,242::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.bb13e29f-0e5a-4f79-8bf2-f235a0dbd515`ReqID=`eaf7744c-fadd-4b36-9cb2-b41b4f721480`::Request was made in '/usr/share/vdsm/storage/sp.py' line '174' at '_upgradePoolDomain'
Thread-81::DEBUG::2012-03-30 07:53:33,255::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.bb13e29f-0e5a-4f79-8bf2-f235a0dbd515' for lock type 'exclusive'
Thread-81::DEBUG::2012-03-30 07:53:33,261::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.bb13e29f-0e5a-4f79-8bf2-f235a0dbd515' is free. Now locking as 'exclusive' (1 active user)
Thread-81::DEBUG::2012-03-30 07:53:33,263::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.bb13e29f-0e5a-4f79-8bf2-f235a0dbd515`ReqID=`eaf7744c-fadd-4b36-9cb2-b41b4f721480`::Granted request
Thread-81::DEBUG::2012-03-30 07:53:33,268::sp::182::Storage.StoragePool::(_upgradePoolDomain) Domain `bb13e29f-0e5a-4f79-8bf2-f235a0dbd515` is not a data domain it is an 3 domain, not upgrading
Thread-81::DEBUG::2012-03-30 07:53:33,269::sp::197::Storage.StoragePool::(_upgradePoolDomain) All domains are upgraded, unregistering from state change event
Thread-81::DEBUG::2012-03-30 07:53:33,272::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.bb13e29f-0e5a-4f79-8bf2-f235a0dbd515'
Thread-81::DEBUG::2012-03-30 07:53:33,274::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.bb13e29f-0e5a-4f79-8bf2-f235a0dbd515' (0 active users)
Thread-81::DEBUG::2012-03-30 07:53:33,275::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.bb13e29f-0e5a-4f79-8bf2-f235a0dbd515' is free, finding out if anyone is waiting for it.
Thread-81::DEBUG::2012-03-30 07:53:33,277::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.bb13e29f-0e5a-4f79-8bf2-f235a0dbd515', Clearing records.
Thread-81::DEBUG::2012-03-30 07:53:33,282::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_bb13e29f-0e5a-4f79-8bf2-f235a0dbd515'
Thread-81::DEBUG::2012-03-30 07:53:33,284::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_bb13e29f-0e5a-4f79-8bf2-f235a0dbd515' (0 active users)
Thread-81::DEBUG::2012-03-30 07:53:33,286::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_bb13e29f-0e5a-4f79-8bf2-f235a0dbd515' is free, finding out if anyone is waiting for it.
Thread-81::DEBUG::2012-03-30 07:53:33,288::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_bb13e29f-0e5a-4f79-8bf2-f235a0dbd515', Clearing records.
Thread-82::DEBUG::2012-03-30 07:53:33,403::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-82::DEBUG::2012-03-30 07:53:33,406::task::588::TaskManager.Task::(_updateState) Task=`3f637589-64cc-40dd-a2cf-47cb4a96f2f8`::moving from state init -> state preparing
Thread-82::INFO::2012-03-30 07:53:33,408::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-82::DEBUG::2012-03-30 07:53:33,410::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-82::DEBUG::2012-03-30 07:53:33,411::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-82::INFO::2012-03-30 07:53:33,413::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-82::DEBUG::2012-03-30 07:53:33,415::task::1172::TaskManager.Task::(prepare) Task=`3f637589-64cc-40dd-a2cf-47cb4a96f2f8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-82::DEBUG::2012-03-30 07:53:33,416::task::588::TaskManager.Task::(_updateState) Task=`3f637589-64cc-40dd-a2cf-47cb4a96f2f8`::moving from state preparing -> state finished
Thread-82::DEBUG::2012-03-30 07:53:33,418::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-82::DEBUG::2012-03-30 07:53:33,420::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-82::DEBUG::2012-03-30 07:53:33,421::task::978::TaskManager.Task::(_decref) Task=`3f637589-64cc-40dd-a2cf-47cb4a96f2f8`::ref 0 aborting False
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,494::blockSD::832::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,497::blockSD::857::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/master' (cwd None)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,595::blockSD::857::Storage.Misc.excCmd::(mountMaster) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,599::mount::117::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/master /rhev/data-center/mnt/blockSD/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/master' (cwd None)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:33,915::blockSD::868::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/master' (cwd None)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,007::blockSD::868::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,059::threadPool::45::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,076::storage_mailbox::503::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1']
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,079::storage_mailbox::505::Storage.Misc.excCmd::(__init__) 'dd of=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,325::storage_mailbox::505::Storage.Misc.excCmd::(__init__) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.200589 s, 5.1 MB/s\n'; <rc> = 0
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,328::storage_mailbox::510::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 13080edc-77ea-11e1-b6a4-525400c49d2a
Dummy-88::DEBUG::2012-03-30 07:53:34,329::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,333::sp::309::Storage.StoragePool::(startSpm) ended.
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,336::task::588::TaskManager.Task::(_updateState) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::moving from state running -> state finished
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,349::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,353::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,357::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,360::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,362::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,363::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,366::task::900::TaskManager.Task::(_runJobs) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::Task.run: exit - success: result
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,368::task::978::TaskManager.Task::(_decref) Task=`c92d6dc3-c62d-4a15-8b87-2996029958b3`::ref 0 aborting False
c92d6dc3-c62d-4a15-8b87-2996029958b3::DEBUG::2012-03-30 07:53:34,369::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0
Thread-89::DEBUG::2012-03-30 07:53:34,438::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-89::DEBUG::2012-03-30 07:53:34,443::task::588::TaskManager.Task::(_updateState) Task=`8ab62760-c2eb-4472-8bbb-9c0bcc37048d`::moving from state init -> state preparing
Thread-89::INFO::2012-03-30 07:53:34,446::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-89::DEBUG::2012-03-30 07:53:34,448::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-89::DEBUG::2012-03-30 07:53:34,450::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}
Thread-89::INFO::2012-03-30 07:53:34,453::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-89::DEBUG::2012-03-30 07:53:34,455::task::1172::TaskManager.Task::(prepare) Task=`8ab62760-c2eb-4472-8bbb-9c0bcc37048d`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c92d6dc3-c62d-4a15-8b87-2996029958b3'}}
Thread-89::DEBUG::2012-03-30 07:53:34,457::task::588::TaskManager.Task::(_updateState) Task=`8ab62760-c2eb-4472-8bbb-9c0bcc37048d`::moving from state preparing -> state finished
Thread-89::DEBUG::2012-03-30 07:53:34,460::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-89::DEBUG::2012-03-30 07:53:34,462::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-89::DEBUG::2012-03-30 07:53:34,465::task::978::TaskManager.Task::(_decref) Task=`8ab62760-c2eb-4472-8bbb-9c0bcc37048d`::ref 0 aborting False
Thread-90::DEBUG::2012-03-30 07:53:34,478::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-90::DEBUG::2012-03-30 07:53:34,482::task::588::TaskManager.Task::(_updateState) Task=`785c4e2d-2ad7-4555-a965-b892e2dc09f5`::moving from state init -> state preparing
Thread-90::INFO::2012-03-30 07:53:34,484::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-90::INFO::2012-03-30 07:53:34,487::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-90::DEBUG::2012-03-30 07:53:34,489::task::1172::TaskManager.Task::(prepare) Task=`785c4e2d-2ad7-4555-a965-b892e2dc09f5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-90::DEBUG::2012-03-30 07:53:34,492::task::588::TaskManager.Task::(_updateState) Task=`785c4e2d-2ad7-4555-a965-b892e2dc09f5`::moving from state preparing -> state finished
Thread-90::DEBUG::2012-03-30 07:53:34,494::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-90::DEBUG::2012-03-30 07:53:34,496::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-90::DEBUG::2012-03-30 07:53:34,499::task::978::TaskManager.Task::(_decref) Task=`785c4e2d-2ad7-4555-a965-b892e2dc09f5`::ref 0 aborting False
Thread-91::DEBUG::2012-03-30 07:53:34,514::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-91::DEBUG::2012-03-30 07:53:34,518::task::588::TaskManager.Task::(_updateState) Task=`ad422abb-b9ac-46e8-8307-d245899c31ba`::moving from state init -> state preparing
Thread-91::INFO::2012-03-30 07:53:34,521::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='c92d6dc3-c62d-4a15-8b87-2996029958b3', spUUID=None, options=None)
Thread-91::DEBUG::2012-03-30 07:53:34,524::taskManager::161::TaskManager::(clearTask) Entry. taskID: c92d6dc3-c62d-4a15-8b87-2996029958b3
Thread-91::DEBUG::2012-03-30 07:53:34,525::taskManager::166::TaskManager::(clearTask) Return.
Thread-91::INFO::2012-03-30 07:53:34,527::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
Thread-91::DEBUG::2012-03-30 07:53:34,530::task::1172::TaskManager.Task::(prepare) Task=`ad422abb-b9ac-46e8-8307-d245899c31ba`::finished: None
Thread-91::DEBUG::2012-03-30 07:53:34,532::task::588::TaskManager.Task::(_updateState) Task=`ad422abb-b9ac-46e8-8307-d245899c31ba`::moving from state preparing -> state finished
Thread-91::DEBUG::2012-03-30 07:53:34,534::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-91::DEBUG::2012-03-30 07:53:34,536::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-91::DEBUG::2012-03-30 07:53:34,538::task::978::TaskManager.Task::(_decref) Task=`ad422abb-b9ac-46e8-8307-d245899c31ba`::ref 0 aborting False
Thread-93::DEBUG::2012-03-30 07:53:34,615::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-93::DEBUG::2012-03-30 07:53:34,618::task::588::TaskManager.Task::(_updateState) Task=`d1fdf7fb-1f25-4dd4-849a-3071e2a4834f`::moving from state init -> state preparing
Thread-93::INFO::2012-03-30 07:53:34,621::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-93::DEBUG::2012-03-30 07:53:34,625::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`970aa47d-599c-44ff-bda2-1fa398910aee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-93::DEBUG::2012-03-30 07:53:34,628::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-93::DEBUG::2012-03-30 07:53:34,631::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-93::DEBUG::2012-03-30 07:53:34,633::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`970aa47d-599c-44ff-bda2-1fa398910aee`::Granted request
Thread-93::DEBUG::2012-03-30 07:53:34,637::task::817::TaskManager.Task::(resourceAcquired) Task=`d1fdf7fb-1f25-4dd4-849a-3071e2a4834f`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-93::DEBUG::2012-03-30 07:53:34,639::task::978::TaskManager.Task::(_decref) Task=`d1fdf7fb-1f25-4dd4-849a-3071e2a4834f`::ref 1 aborting False
Thread-93::INFO::2012-03-30 07:53:34,647::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-93::DEBUG::2012-03-30 07:53:34,649::task::1172::TaskManager.Task::(prepare) Task=`d1fdf7fb-1f25-4dd4-849a-3071e2a4834f`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-93::DEBUG::2012-03-30 07:53:34,652::task::588::TaskManager.Task::(_updateState) Task=`d1fdf7fb-1f25-4dd4-849a-3071e2a4834f`::moving from state preparing -> state finished
Thread-93::DEBUG::2012-03-30 07:53:34,655::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-93::DEBUG::2012-03-30 07:53:34,657::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-93::DEBUG::2012-03-30 07:53:34,660::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-93::DEBUG::2012-03-30 07:53:34,664::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-93::DEBUG::2012-03-30 07:53:34,666::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-93::DEBUG::2012-03-30 07:53:34,668::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-93::DEBUG::2012-03-30 07:53:34,671::task::978::TaskManager.Task::(_decref) Task=`d1fdf7fb-1f25-4dd4-849a-3071e2a4834f`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:53:34,947::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.349643 s, 2.9 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:53:36,992::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:53:37,430::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.175688 s, 5.8 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:53:39,476::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:53:39,916::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.179498 s, 5.7 MB/s\n'; <rc> = 0
Thread-96::DEBUG::2012-03-30 07:53:40,630::task::588::TaskManager.Task::(_updateState) Task=`98a77cdd-1c34-4319-900e-cd435b226a7d`::moving from state init -> state preparing
Thread-96::INFO::2012-03-30 07:53:40,632::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-96::INFO::2012-03-30 07:53:40,634::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00111508369446', 'lastCheck': 1333086816.4004719, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00303602218628', 'lastCheck': 1333086814.172421, 'code': 0, 'valid': True}}
Thread-96::DEBUG::2012-03-30 07:53:40,636::task::1172::TaskManager.Task::(prepare) Task=`98a77cdd-1c34-4319-900e-cd435b226a7d`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00111508369446', 'lastCheck': 1333086816.4004719, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00303602218628', 'lastCheck': 1333086814.172421, 'code': 0, 'valid': True}}
Thread-96::DEBUG::2012-03-30 07:53:40,638::task::588::TaskManager.Task::(_updateState) Task=`98a77cdd-1c34-4319-900e-cd435b226a7d`::moving from state preparing -> state finished
Thread-96::DEBUG::2012-03-30 07:53:40,639::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-96::DEBUG::2012-03-30 07:53:40,641::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-96::DEBUG::2012-03-30 07:53:40,644::task::978::TaskManager.Task::(_decref) Task=`98a77cdd-1c34-4319-900e-cd435b226a7d`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:53:41,963::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:53:42,427::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.205673 s, 5.0 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:53:44,475::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Thread-99::DEBUG::2012-03-30 07:53:44,717::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-99::DEBUG::2012-03-30 07:53:44,725::task::588::TaskManager.Task::(_updateState) Task=`d5b0a49c-1c3f-43af-987a-64d8f211e1be`::moving from state init -> state preparing
Thread-99::INFO::2012-03-30 07:53:44,731::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-99::INFO::2012-03-30 07:53:44,737::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-99::DEBUG::2012-03-30 07:53:44,740::task::1172::TaskManager.Task::(prepare) Task=`d5b0a49c-1c3f-43af-987a-64d8f211e1be`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-99::DEBUG::2012-03-30 07:53:44,743::task::588::TaskManager.Task::(_updateState) Task=`d5b0a49c-1c3f-43af-987a-64d8f211e1be`::moving from state preparing -> state finished
Thread-99::DEBUG::2012-03-30 07:53:44,748::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-99::DEBUG::2012-03-30 07:53:44,751::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-99::DEBUG::2012-03-30 07:53:44,754::task::978::TaskManager.Task::(_decref) Task=`d5b0a49c-1c3f-43af-987a-64d8f211e1be`::ref 0 aborting False
Thread-101::DEBUG::2012-03-30 07:53:44,774::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-101::DEBUG::2012-03-30 07:53:44,780::task::588::TaskManager.Task::(_updateState) Task=`f9f30262-4635-4404-b2f0-8e8526ede0cc`::moving from state init -> state preparing
Thread-101::INFO::2012-03-30 07:53:44,786::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-101::DEBUG::2012-03-30 07:53:44,791::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`657e8c91-7a0f-43c9-841f-41cb00002152`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-101::DEBUG::2012-03-30 07:53:44,794::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-101::DEBUG::2012-03-30 07:53:44,799::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-101::DEBUG::2012-03-30 07:53:44,802::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`657e8c91-7a0f-43c9-841f-41cb00002152`::Granted request
Thread-101::DEBUG::2012-03-30 07:53:44,808::task::817::TaskManager.Task::(resourceAcquired) Task=`f9f30262-4635-4404-b2f0-8e8526ede0cc`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-101::DEBUG::2012-03-30 07:53:44,810::task::978::TaskManager.Task::(_decref) Task=`f9f30262-4635-4404-b2f0-8e8526ede0cc`::ref 1 aborting False
Thread-101::INFO::2012-03-30 07:53:44,820::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-101::DEBUG::2012-03-30 07:53:44,822::task::1172::TaskManager.Task::(prepare) Task=`f9f30262-4635-4404-b2f0-8e8526ede0cc`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-101::DEBUG::2012-03-30 07:53:44,826::task::588::TaskManager.Task::(_updateState) Task=`f9f30262-4635-4404-b2f0-8e8526ede0cc`::moving from state preparing -> state finished
Thread-101::DEBUG::2012-03-30 07:53:44,828::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-101::DEBUG::2012-03-30 07:53:44,832::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-101::DEBUG::2012-03-30 07:53:44,837::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-101::DEBUG::2012-03-30 07:53:44,843::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-101::DEBUG::2012-03-30 07:53:44,845::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-101::DEBUG::2012-03-30 07:53:44,849::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-101::DEBUG::2012-03-30 07:53:44,852::task::978::TaskManager.Task::(_decref) Task=`f9f30262-4635-4404-b2f0-8e8526ede0cc`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:53:45,038::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.181118 s, 5.7 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:53:47,084::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:53:47,523::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.177823 s, 5.8 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:53:49,570::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:53:50,005::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.174787 s, 5.9 MB/s\n'; <rc> = 0
Thread-104::DEBUG::2012-03-30 07:53:50,784::task::588::TaskManager.Task::(_updateState) Task=`9d13b8bc-295a-46e5-9c52-73361d6de701`::moving from state init -> state preparing
Thread-104::INFO::2012-03-30 07:53:50,787::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-104::INFO::2012-03-30 07:53:50,789::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00143218040466', 'lastCheck': 1333086826.4132521, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.0027220249176', 'lastCheck': 1333086824.18524, 'code': 0, 'valid': True}}
Thread-104::DEBUG::2012-03-30 07:53:50,791::task::1172::TaskManager.Task::(prepare) Task=`9d13b8bc-295a-46e5-9c52-73361d6de701`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00143218040466', 'lastCheck': 1333086826.4132521, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.0027220249176', 'lastCheck': 1333086824.18524, 'code': 0, 'valid': True}}
Thread-104::DEBUG::2012-03-30 07:53:50,793::task::588::TaskManager.Task::(_updateState) Task=`9d13b8bc-295a-46e5-9c52-73361d6de701`::moving from state preparing -> state finished
Thread-104::DEBUG::2012-03-30 07:53:50,794::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-104::DEBUG::2012-03-30 07:53:50,796::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-104::DEBUG::2012-03-30 07:53:50,799::task::978::TaskManager.Task::(_decref) Task=`9d13b8bc-295a-46e5-9c52-73361d6de701`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:53:52,052::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:53:52,484::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.173624 s, 5.9 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:53:54,534::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Thread-108::DEBUG::2012-03-30 07:53:54,910::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-108::DEBUG::2012-03-30 07:53:54,921::task::588::TaskManager.Task::(_updateState) Task=`3bc6c854-04f5-489b-b3a1-60f5ce0a95a6`::moving from state init -> state preparing
Thread-108::INFO::2012-03-30 07:53:54,929::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-108::INFO::2012-03-30 07:53:54,933::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-108::DEBUG::2012-03-30 07:53:54,935::task::1172::TaskManager.Task::(prepare) Task=`3bc6c854-04f5-489b-b3a1-60f5ce0a95a6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-108::DEBUG::2012-03-30 07:53:54,938::task::588::TaskManager.Task::(_updateState) Task=`3bc6c854-04f5-489b-b3a1-60f5ce0a95a6`::moving from state preparing -> state finished
Thread-108::DEBUG::2012-03-30 07:53:54,941::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-108::DEBUG::2012-03-30 07:53:54,943::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-108::DEBUG::2012-03-30 07:53:54,946::task::978::TaskManager.Task::(_decref) Task=`3bc6c854-04f5-489b-b3a1-60f5ce0a95a6`::ref 0 aborting False
Thread-109::DEBUG::2012-03-30 07:53:54,982::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-109::DEBUG::2012-03-30 07:53:54,990::task::588::TaskManager.Task::(_updateState) Task=`b11100f6-52e6-49cc-94d1-7928dace43ea`::moving from state init -> state preparing
Thread-109::INFO::2012-03-30 07:53:54,992::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-109::DEBUG::2012-03-30 07:53:55,000::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`65f8ed14-a72b-4de8-b5e8-dd458be0adba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-109::DEBUG::2012-03-30 07:53:55,003::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-109::DEBUG::2012-03-30 07:53:55,007::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-109::DEBUG::2012-03-30 07:53:55,010::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`65f8ed14-a72b-4de8-b5e8-dd458be0adba`::Granted request
Thread-109::DEBUG::2012-03-30 07:53:55,050::task::817::TaskManager.Task::(resourceAcquired) Task=`b11100f6-52e6-49cc-94d1-7928dace43ea`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-109::DEBUG::2012-03-30 07:53:55,053::task::978::TaskManager.Task::(_decref) Task=`b11100f6-52e6-49cc-94d1-7928dace43ea`::ref 1 aborting False
Thread-109::INFO::2012-03-30 07:53:55,061::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-109::DEBUG::2012-03-30 07:53:55,072::task::1172::TaskManager.Task::(prepare) Task=`b11100f6-52e6-49cc-94d1-7928dace43ea`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Dummy-88::DEBUG::2012-03-30 07:53:55,073::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.17222 s, 5.9 MB/s\n'; <rc> = 0
Thread-109::DEBUG::2012-03-30 07:53:55,076::task::588::TaskManager.Task::(_updateState) Task=`b11100f6-52e6-49cc-94d1-7928dace43ea`::moving from state preparing -> state finished
Thread-109::DEBUG::2012-03-30 07:53:55,099::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-109::DEBUG::2012-03-30 07:53:55,143::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-109::DEBUG::2012-03-30 07:53:55,145::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-109::DEBUG::2012-03-30 07:53:55,147::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-109::DEBUG::2012-03-30 07:53:55,149::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-109::DEBUG::2012-03-30 07:53:55,150::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-109::DEBUG::2012-03-30 07:53:55,152::task::978::TaskManager.Task::(_decref) Task=`b11100f6-52e6-49cc-94d1-7928dace43ea`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:53:57,146::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:53:57,577::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.172626 s, 5.9 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:53:59,624::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:00,057::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.172702 s, 5.9 MB/s\n'; <rc> = 0
Thread-112::DEBUG::2012-03-30 07:54:00,946::task::588::TaskManager.Task::(_updateState) Task=`f4048d27-e953-4b9d-8678-47ead8f90ab4`::moving from state init -> state preparing
Thread-112::INFO::2012-03-30 07:54:00,948::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-112::INFO::2012-03-30 07:54:00,951::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00112295150757', 'lastCheck': 1333086836.4236341, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00287699699402', 'lastCheck': 1333086834.1979091, 'code': 0, 'valid': True}}
Thread-112::DEBUG::2012-03-30 07:54:00,952::task::1172::TaskManager.Task::(prepare) Task=`f4048d27-e953-4b9d-8678-47ead8f90ab4`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00112295150757', 'lastCheck': 1333086836.4236341, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00287699699402', 'lastCheck': 1333086834.1979091, 'code': 0, 'valid': True}}
Thread-112::DEBUG::2012-03-30 07:54:00,954::task::588::TaskManager.Task::(_updateState) Task=`f4048d27-e953-4b9d-8678-47ead8f90ab4`::moving from state preparing -> state finished
Thread-112::DEBUG::2012-03-30 07:54:00,956::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-112::DEBUG::2012-03-30 07:54:00,957::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-112::DEBUG::2012-03-30 07:54:00,959::task::978::TaskManager.Task::(_decref) Task=`f4048d27-e953-4b9d-8678-47ead8f90ab4`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:02,103::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:02,538::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.177599 s, 5.8 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:04,585::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:05,025::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.177625 s, 5.8 MB/s\n'; <rc> = 0
Thread-116::DEBUG::2012-03-30 07:54:05,186::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-116::DEBUG::2012-03-30 07:54:05,190::task::588::TaskManager.Task::(_updateState) Task=`4e19f3c0-55ce-4900-ae22-906dde7b2101`::moving from state init -> state preparing
Thread-116::INFO::2012-03-30 07:54:05,192::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-116::INFO::2012-03-30 07:54:05,194::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-116::DEBUG::2012-03-30 07:54:05,196::task::1172::TaskManager.Task::(prepare) Task=`4e19f3c0-55ce-4900-ae22-906dde7b2101`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-116::DEBUG::2012-03-30 07:54:05,197::task::588::TaskManager.Task::(_updateState) Task=`4e19f3c0-55ce-4900-ae22-906dde7b2101`::moving from state preparing -> state finished
Thread-116::DEBUG::2012-03-30 07:54:05,199::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-116::DEBUG::2012-03-30 07:54:05,200::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-116::DEBUG::2012-03-30 07:54:05,202::task::978::TaskManager.Task::(_decref) Task=`4e19f3c0-55ce-4900-ae22-906dde7b2101`::ref 0 aborting False
Thread-117::DEBUG::2012-03-30 07:54:05,212::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-117::DEBUG::2012-03-30 07:54:05,215::task::588::TaskManager.Task::(_updateState) Task=`d1a03d80-460e-4543-9b48-5678cd6ef82a`::moving from state init -> state preparing
Thread-117::INFO::2012-03-30 07:54:05,216::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-117::DEBUG::2012-03-30 07:54:05,220::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`32db0500-3992-4a90-a73a-edf3d01b7342`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-117::DEBUG::2012-03-30 07:54:05,221::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-117::DEBUG::2012-03-30 07:54:05,224::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-117::DEBUG::2012-03-30 07:54:05,225::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`32db0500-3992-4a90-a73a-edf3d01b7342`::Granted request
Thread-117::DEBUG::2012-03-30 07:54:05,228::task::817::TaskManager.Task::(resourceAcquired) Task=`d1a03d80-460e-4543-9b48-5678cd6ef82a`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-117::DEBUG::2012-03-30 07:54:05,230::task::978::TaskManager.Task::(_decref) Task=`d1a03d80-460e-4543-9b48-5678cd6ef82a`::ref 1 aborting False
Thread-117::INFO::2012-03-30 07:54:05,235::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-117::DEBUG::2012-03-30 07:54:05,237::task::1172::TaskManager.Task::(prepare) Task=`d1a03d80-460e-4543-9b48-5678cd6ef82a`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-117::DEBUG::2012-03-30 07:54:05,239::task::588::TaskManager.Task::(_updateState) Task=`d1a03d80-460e-4543-9b48-5678cd6ef82a`::moving from state preparing -> state finished
Thread-117::DEBUG::2012-03-30 07:54:05,240::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-117::DEBUG::2012-03-30 07:54:05,242::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-117::DEBUG::2012-03-30 07:54:05,244::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-117::DEBUG::2012-03-30 07:54:05,246::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-117::DEBUG::2012-03-30 07:54:05,248::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-117::DEBUG::2012-03-30 07:54:05,249::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-117::DEBUG::2012-03-30 07:54:05,251::task::978::TaskManager.Task::(_decref) Task=`d1a03d80-460e-4543-9b48-5678cd6ef82a`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:07,092::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:07,524::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.172796 s, 5.9 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:09,569::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:10,011::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178175 s, 5.7 MB/s\n'; <rc> = 0
Thread-120::DEBUG::2012-03-30 07:54:11,147::task::588::TaskManager.Task::(_updateState) Task=`9480848c-6191-46fb-9b68-4c44140b29ce`::moving from state init -> state preparing
Thread-120::INFO::2012-03-30 07:54:11,150::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-120::INFO::2012-03-30 07:54:11,152::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00133490562439', 'lastCheck': 1333086846.4343221, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.0026581287384', 'lastCheck': 1333086844.2106249, 'code': 0, 'valid': True}}
Thread-120::DEBUG::2012-03-30 07:54:11,154::task::1172::TaskManager.Task::(prepare) Task=`9480848c-6191-46fb-9b68-4c44140b29ce`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00133490562439', 'lastCheck': 1333086846.4343221, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.0026581287384', 'lastCheck': 1333086844.2106249, 'code': 0, 'valid': True}}
Thread-120::DEBUG::2012-03-30 07:54:11,157::task::588::TaskManager.Task::(_updateState) Task=`9480848c-6191-46fb-9b68-4c44140b29ce`::moving from state preparing -> state finished
Thread-120::DEBUG::2012-03-30 07:54:11,159::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-120::DEBUG::2012-03-30 07:54:11,161::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-120::DEBUG::2012-03-30 07:54:11,163::task::978::TaskManager.Task::(_decref) Task=`9480848c-6191-46fb-9b68-4c44140b29ce`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:12,058::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:12,495::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178726 s, 5.7 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:14,543::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:14,984::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.179748 s, 5.7 MB/s\n'; <rc> = 0
Thread-124::DEBUG::2012-03-30 07:54:15,282::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-124::DEBUG::2012-03-30 07:54:15,286::task::588::TaskManager.Task::(_updateState) Task=`e7682d4f-57a5-44b0-9c13-0a8b0bf43732`::moving from state init -> state preparing
Thread-124::INFO::2012-03-30 07:54:15,288::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-124::INFO::2012-03-30 07:54:15,290::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-124::DEBUG::2012-03-30 07:54:15,292::task::1172::TaskManager.Task::(prepare) Task=`e7682d4f-57a5-44b0-9c13-0a8b0bf43732`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-124::DEBUG::2012-03-30 07:54:15,294::task::588::TaskManager.Task::(_updateState) Task=`e7682d4f-57a5-44b0-9c13-0a8b0bf43732`::moving from state preparing -> state finished
Thread-124::DEBUG::2012-03-30 07:54:15,296::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-124::DEBUG::2012-03-30 07:54:15,297::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-124::DEBUG::2012-03-30 07:54:15,299::task::978::TaskManager.Task::(_decref) Task=`e7682d4f-57a5-44b0-9c13-0a8b0bf43732`::ref 0 aborting False
Thread-125::DEBUG::2012-03-30 07:54:15,309::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-125::DEBUG::2012-03-30 07:54:15,312::task::588::TaskManager.Task::(_updateState) Task=`461f5d4b-efe2-4420-9a2a-07dffeeb800e`::moving from state init -> state preparing
Thread-125::INFO::2012-03-30 07:54:15,314::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-125::DEBUG::2012-03-30 07:54:15,317::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`2c5a41b0-ea17-48ec-9d6f-4781a580160f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-125::DEBUG::2012-03-30 07:54:15,319::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-125::DEBUG::2012-03-30 07:54:15,321::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-125::DEBUG::2012-03-30 07:54:15,323::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`2c5a41b0-ea17-48ec-9d6f-4781a580160f`::Granted request
Thread-125::DEBUG::2012-03-30 07:54:15,325::task::817::TaskManager.Task::(resourceAcquired) Task=`461f5d4b-efe2-4420-9a2a-07dffeeb800e`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-125::DEBUG::2012-03-30 07:54:15,327::task::978::TaskManager.Task::(_decref) Task=`461f5d4b-efe2-4420-9a2a-07dffeeb800e`::ref 1 aborting False
Thread-125::INFO::2012-03-30 07:54:15,333::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-125::DEBUG::2012-03-30 07:54:15,334::task::1172::TaskManager.Task::(prepare) Task=`461f5d4b-efe2-4420-9a2a-07dffeeb800e`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-125::DEBUG::2012-03-30 07:54:15,336::task::588::TaskManager.Task::(_updateState) Task=`461f5d4b-efe2-4420-9a2a-07dffeeb800e`::moving from state preparing -> state finished
Thread-125::DEBUG::2012-03-30 07:54:15,338::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-125::DEBUG::2012-03-30 07:54:15,340::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-125::DEBUG::2012-03-30 07:54:15,342::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-125::DEBUG::2012-03-30 07:54:15,343::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-125::DEBUG::2012-03-30 07:54:15,345::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-125::DEBUG::2012-03-30 07:54:15,346::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-125::DEBUG::2012-03-30 07:54:15,348::task::978::TaskManager.Task::(_decref) Task=`461f5d4b-efe2-4420-9a2a-07dffeeb800e`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:17,032::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:17,506::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.184251 s, 5.6 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:19,554::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:20,028::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.18578 s, 5.5 MB/s\n'; <rc> = 0
Thread-128::DEBUG::2012-03-30 07:54:21,329::task::588::TaskManager.Task::(_updateState) Task=`e8340ac2-7147-4b53-bf4a-f320ed072a61`::moving from state init -> state preparing
Thread-128::INFO::2012-03-30 07:54:21,365::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-128::INFO::2012-03-30 07:54:21,398::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00117301940918', 'lastCheck': 1333086856.4446239, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00258016586304', 'lastCheck': 1333086854.2231359, 'code': 0, 'valid': True}}
Thread-128::DEBUG::2012-03-30 07:54:21,400::task::1172::TaskManager.Task::(prepare) Task=`e8340ac2-7147-4b53-bf4a-f320ed072a61`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00117301940918', 'lastCheck': 1333086856.4446239, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00258016586304', 'lastCheck': 1333086854.2231359, 'code': 0, 'valid': True}}
Thread-128::DEBUG::2012-03-30 07:54:21,402::task::588::TaskManager.Task::(_updateState) Task=`e8340ac2-7147-4b53-bf4a-f320ed072a61`::moving from state preparing -> state finished
Thread-128::DEBUG::2012-03-30 07:54:21,404::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-128::DEBUG::2012-03-30 07:54:21,405::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-128::DEBUG::2012-03-30 07:54:21,407::task::978::TaskManager.Task::(_decref) Task=`e8340ac2-7147-4b53-bf4a-f320ed072a61`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:22,095::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:22,530::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.172888 s, 5.9 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:24,576::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:25,034::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.174014 s, 5.9 MB/s\n'; <rc> = 0
Thread-131::DEBUG::2012-03-30 07:54:25,384::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-131::DEBUG::2012-03-30 07:54:25,388::task::588::TaskManager.Task::(_updateState) Task=`0d84a510-f7ea-4652-96b9-53e25d99b720`::moving from state init -> state preparing
Thread-131::INFO::2012-03-30 07:54:25,390::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-131::INFO::2012-03-30 07:54:25,394::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-131::DEBUG::2012-03-30 07:54:25,396::task::1172::TaskManager.Task::(prepare) Task=`0d84a510-f7ea-4652-96b9-53e25d99b720`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-131::DEBUG::2012-03-30 07:54:25,398::task::588::TaskManager.Task::(_updateState) Task=`0d84a510-f7ea-4652-96b9-53e25d99b720`::moving from state preparing -> state finished
Thread-131::DEBUG::2012-03-30 07:54:25,400::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-131::DEBUG::2012-03-30 07:54:25,402::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-131::DEBUG::2012-03-30 07:54:25,404::task::978::TaskManager.Task::(_decref) Task=`0d84a510-f7ea-4652-96b9-53e25d99b720`::ref 0 aborting False
Thread-132::DEBUG::2012-03-30 07:54:25,416::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-132::DEBUG::2012-03-30 07:54:25,419::task::588::TaskManager.Task::(_updateState) Task=`2b2a51b1-5f1d-49e4-bf6f-de9823a406ea`::moving from state init -> state preparing
Thread-132::INFO::2012-03-30 07:54:25,421::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-132::DEBUG::2012-03-30 07:54:25,426::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`f8231ddb-5ac7-4d01-b4dc-1185542eac05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-132::DEBUG::2012-03-30 07:54:25,428::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-132::DEBUG::2012-03-30 07:54:25,431::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-132::DEBUG::2012-03-30 07:54:25,433::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`f8231ddb-5ac7-4d01-b4dc-1185542eac05`::Granted request
Thread-132::DEBUG::2012-03-30 07:54:25,436::task::817::TaskManager.Task::(resourceAcquired) Task=`2b2a51b1-5f1d-49e4-bf6f-de9823a406ea`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-132::DEBUG::2012-03-30 07:54:25,438::task::978::TaskManager.Task::(_decref) Task=`2b2a51b1-5f1d-49e4-bf6f-de9823a406ea`::ref 1 aborting False
Thread-132::INFO::2012-03-30 07:54:25,445::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-132::DEBUG::2012-03-30 07:54:25,448::task::1172::TaskManager.Task::(prepare) Task=`2b2a51b1-5f1d-49e4-bf6f-de9823a406ea`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-132::DEBUG::2012-03-30 07:54:25,451::task::588::TaskManager.Task::(_updateState) Task=`2b2a51b1-5f1d-49e4-bf6f-de9823a406ea`::moving from state preparing -> state finished
Thread-132::DEBUG::2012-03-30 07:54:25,453::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-132::DEBUG::2012-03-30 07:54:25,455::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-132::DEBUG::2012-03-30 07:54:25,457::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-132::DEBUG::2012-03-30 07:54:25,458::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-132::DEBUG::2012-03-30 07:54:25,460::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-132::DEBUG::2012-03-30 07:54:25,461::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-132::DEBUG::2012-03-30 07:54:25,463::task::978::TaskManager.Task::(_decref) Task=`2b2a51b1-5f1d-49e4-bf6f-de9823a406ea`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:27,100::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:27,590::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178315 s, 5.7 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:29,635::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:30,076::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178942 s, 5.7 MB/s\n'; <rc> = 0
Thread-136::DEBUG::2012-03-30 07:54:31,521::task::588::TaskManager.Task::(_updateState) Task=`b5228f5d-ceee-4961-97cc-80e958b75372`::moving from state init -> state preparing
Thread-136::INFO::2012-03-30 07:54:31,537::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-136::INFO::2012-03-30 07:54:31,540::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00188493728638', 'lastCheck': 1333086866.4579439, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00440502166748', 'lastCheck': 1333086864.2443011, 'code': 0, 'valid': True}}
Thread-136::DEBUG::2012-03-30 07:54:31,542::task::1172::TaskManager.Task::(prepare) Task=`b5228f5d-ceee-4961-97cc-80e958b75372`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00188493728638', 'lastCheck': 1333086866.4579439, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00440502166748', 'lastCheck': 1333086864.2443011, 'code': 0, 'valid': True}}
Thread-136::DEBUG::2012-03-30 07:54:31,543::task::588::TaskManager.Task::(_updateState) Task=`b5228f5d-ceee-4961-97cc-80e958b75372`::moving from state preparing -> state finished
Thread-136::DEBUG::2012-03-30 07:54:31,545::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-136::DEBUG::2012-03-30 07:54:31,547::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-136::DEBUG::2012-03-30 07:54:31,548::task::978::TaskManager.Task::(_decref) Task=`b5228f5d-ceee-4961-97cc-80e958b75372`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:32,125::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:32,561::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178339 s, 5.7 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:34,608::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:35,044::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178693 s, 5.7 MB/s\n'; <rc> = 0
Thread-139::DEBUG::2012-03-30 07:54:35,505::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-139::DEBUG::2012-03-30 07:54:35,509::task::588::TaskManager.Task::(_updateState) Task=`d304ef9a-5ef3-4b22-aa20-9ccdccff68ea`::moving from state init -> state preparing
Thread-139::INFO::2012-03-30 07:54:35,511::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-139::INFO::2012-03-30 07:54:35,514::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-139::DEBUG::2012-03-30 07:54:35,515::task::1172::TaskManager.Task::(prepare) Task=`d304ef9a-5ef3-4b22-aa20-9ccdccff68ea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-139::DEBUG::2012-03-30 07:54:35,517::task::588::TaskManager.Task::(_updateState) Task=`d304ef9a-5ef3-4b22-aa20-9ccdccff68ea`::moving from state preparing -> state finished
Thread-139::DEBUG::2012-03-30 07:54:35,519::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-139::DEBUG::2012-03-30 07:54:35,520::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-139::DEBUG::2012-03-30 07:54:35,522::task::978::TaskManager.Task::(_decref) Task=`d304ef9a-5ef3-4b22-aa20-9ccdccff68ea`::ref 0 aborting False
Thread-140::DEBUG::2012-03-30 07:54:35,533::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-140::DEBUG::2012-03-30 07:54:35,535::task::588::TaskManager.Task::(_updateState) Task=`0d179567-3796-430c-ac54-bbe4e65f58a4`::moving from state init -> state preparing
Thread-140::INFO::2012-03-30 07:54:35,537::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-140::DEBUG::2012-03-30 07:54:35,541::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`bdd9ce80-d79e-4a80-860e-c284a5b9634d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-140::DEBUG::2012-03-30 07:54:35,542::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-140::DEBUG::2012-03-30 07:54:35,545::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-140::DEBUG::2012-03-30 07:54:35,546::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`bdd9ce80-d79e-4a80-860e-c284a5b9634d`::Granted request
Thread-140::DEBUG::2012-03-30 07:54:35,549::task::817::TaskManager.Task::(resourceAcquired) Task=`0d179567-3796-430c-ac54-bbe4e65f58a4`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-140::DEBUG::2012-03-30 07:54:35,551::task::978::TaskManager.Task::(_decref) Task=`0d179567-3796-430c-ac54-bbe4e65f58a4`::ref 1 aborting False
Thread-140::INFO::2012-03-30 07:54:35,556::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-140::DEBUG::2012-03-30 07:54:35,558::task::1172::TaskManager.Task::(prepare) Task=`0d179567-3796-430c-ac54-bbe4e65f58a4`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-140::DEBUG::2012-03-30 07:54:35,560::task::588::TaskManager.Task::(_updateState) Task=`0d179567-3796-430c-ac54-bbe4e65f58a4`::moving from state preparing -> state finished
Thread-140::DEBUG::2012-03-30 07:54:35,562::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-140::DEBUG::2012-03-30 07:54:35,563::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-140::DEBUG::2012-03-30 07:54:35,565::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-140::DEBUG::2012-03-30 07:54:35,567::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-140::DEBUG::2012-03-30 07:54:35,569::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-140::DEBUG::2012-03-30 07:54:35,570::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-140::DEBUG::2012-03-30 07:54:35,572::task::978::TaskManager.Task::(_decref) Task=`0d179567-3796-430c-ac54-bbe4e65f58a4`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:37,091::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:37,522::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.173505 s, 5.9 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:39,569::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:40,040::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.208036 s, 4.9 MB/s\n'; <rc> = 0
Thread-144::DEBUG::2012-03-30 07:54:41,673::task::588::TaskManager.Task::(_updateState) Task=`aef35629-2fb5-456e-8ac2-b48a09473474`::moving from state init -> state preparing
Thread-144::INFO::2012-03-30 07:54:41,675::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-144::INFO::2012-03-30 07:54:41,678::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.0012640953064', 'lastCheck': 1333086876.468688, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00420022010803', 'lastCheck': 1333086874.280731, 'code': 0, 'valid': True}}
Thread-144::DEBUG::2012-03-30 07:54:41,679::task::1172::TaskManager.Task::(prepare) Task=`aef35629-2fb5-456e-8ac2-b48a09473474`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.0012640953064', 'lastCheck': 1333086876.468688, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00420022010803', 'lastCheck': 1333086874.280731, 'code': 0, 'valid': True}}
Thread-144::DEBUG::2012-03-30 07:54:41,681::task::588::TaskManager.Task::(_updateState) Task=`aef35629-2fb5-456e-8ac2-b48a09473474`::moving from state preparing -> state finished
Thread-144::DEBUG::2012-03-30 07:54:41,683::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-144::DEBUG::2012-03-30 07:54:41,684::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-144::DEBUG::2012-03-30 07:54:41,686::task::978::TaskManager.Task::(_decref) Task=`aef35629-2fb5-456e-8ac2-b48a09473474`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:42,088::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:42,519::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.172462 s, 5.9 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:44,564::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:45,005::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.179424 s, 5.7 MB/s\n'; <rc> = 0
Thread-147::DEBUG::2012-03-30 07:54:45,607::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-147::DEBUG::2012-03-30 07:54:45,611::task::588::TaskManager.Task::(_updateState) Task=`71378844-bfc0-4143-94a0-a0f25db9070b`::moving from state init -> state preparing
Thread-147::INFO::2012-03-30 07:54:45,613::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-147::INFO::2012-03-30 07:54:45,615::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-147::DEBUG::2012-03-30 07:54:45,617::task::1172::TaskManager.Task::(prepare) Task=`71378844-bfc0-4143-94a0-a0f25db9070b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-147::DEBUG::2012-03-30 07:54:45,618::task::588::TaskManager.Task::(_updateState) Task=`71378844-bfc0-4143-94a0-a0f25db9070b`::moving from state preparing -> state finished
Thread-147::DEBUG::2012-03-30 07:54:45,620::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-147::DEBUG::2012-03-30 07:54:45,621::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-147::DEBUG::2012-03-30 07:54:45,623::task::978::TaskManager.Task::(_decref) Task=`71378844-bfc0-4143-94a0-a0f25db9070b`::ref 0 aborting False
Thread-148::DEBUG::2012-03-30 07:54:45,634::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-148::DEBUG::2012-03-30 07:54:45,637::task::588::TaskManager.Task::(_updateState) Task=`ff57e4a9-70e3-4e1c-8359-eaa72de55991`::moving from state init -> state preparing
Thread-148::INFO::2012-03-30 07:54:45,639::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-148::DEBUG::2012-03-30 07:54:45,642::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`a2e68e92-e0a2-4c90-88e1-3f37eda32203`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-148::DEBUG::2012-03-30 07:54:45,644::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-148::DEBUG::2012-03-30 07:54:45,646::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-148::DEBUG::2012-03-30 07:54:45,648::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`a2e68e92-e0a2-4c90-88e1-3f37eda32203`::Granted request
Thread-148::DEBUG::2012-03-30 07:54:45,650::task::817::TaskManager.Task::(resourceAcquired) Task=`ff57e4a9-70e3-4e1c-8359-eaa72de55991`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-148::DEBUG::2012-03-30 07:54:45,652::task::978::TaskManager.Task::(_decref) Task=`ff57e4a9-70e3-4e1c-8359-eaa72de55991`::ref 1 aborting False
Thread-148::INFO::2012-03-30 07:54:45,658::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-148::DEBUG::2012-03-30 07:54:45,659::task::1172::TaskManager.Task::(prepare) Task=`ff57e4a9-70e3-4e1c-8359-eaa72de55991`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-148::DEBUG::2012-03-30 07:54:45,661::task::588::TaskManager.Task::(_updateState) Task=`ff57e4a9-70e3-4e1c-8359-eaa72de55991`::moving from state preparing -> state finished
Thread-148::DEBUG::2012-03-30 07:54:45,663::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-148::DEBUG::2012-03-30 07:54:45,665::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-148::DEBUG::2012-03-30 07:54:45,667::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-148::DEBUG::2012-03-30 07:54:45,668::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-148::DEBUG::2012-03-30 07:54:45,670::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-148::DEBUG::2012-03-30 07:54:45,671::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-148::DEBUG::2012-03-30 07:54:45,673::task::978::TaskManager.Task::(_decref) Task=`ff57e4a9-70e3-4e1c-8359-eaa72de55991`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:47,052::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:47,481::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.171772 s, 6.0 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:49,526::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:50,011::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178449 s, 5.7 MB/s\n'; <rc> = 0
Thread-152::DEBUG::2012-03-30 07:54:51,825::task::588::TaskManager.Task::(_updateState) Task=`4e6ca951-490a-4163-97a9-dbc2d5d3fff5`::moving from state init -> state preparing
Thread-152::INFO::2012-03-30 07:54:51,828::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-152::INFO::2012-03-30 07:54:51,830::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00125813484192', 'lastCheck': 1333086886.479111, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00271105766296', 'lastCheck': 1333086884.293309, 'code': 0, 'valid': True}}
Thread-152::DEBUG::2012-03-30 07:54:51,831::task::1172::TaskManager.Task::(prepare) Task=`4e6ca951-490a-4163-97a9-dbc2d5d3fff5`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00125813484192', 'lastCheck': 1333086886.479111, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00271105766296', 'lastCheck': 1333086884.293309, 'code': 0, 'valid': True}}
Thread-152::DEBUG::2012-03-30 07:54:51,833::task::588::TaskManager.Task::(_updateState) Task=`4e6ca951-490a-4163-97a9-dbc2d5d3fff5`::moving from state preparing -> state finished
Thread-152::DEBUG::2012-03-30 07:54:51,835::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-152::DEBUG::2012-03-30 07:54:51,837::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-152::DEBUG::2012-03-30 07:54:51,838::task::978::TaskManager.Task::(_decref) Task=`4e6ca951-490a-4163-97a9-dbc2d5d3fff5`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:52,061::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:52,497::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.175598 s, 5.8 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:54,554::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:54,997::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.17918 s, 5.7 MB/s\n'; <rc> = 0
Thread-155::DEBUG::2012-03-30 07:54:55,708::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-155::DEBUG::2012-03-30 07:54:55,712::task::588::TaskManager.Task::(_updateState) Task=`fd8a1a5d-dbc5-4479-8fc8-d8278dff0f85`::moving from state init -> state preparing
Thread-155::INFO::2012-03-30 07:54:55,714::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-155::INFO::2012-03-30 07:54:55,716::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-155::DEBUG::2012-03-30 07:54:55,718::task::1172::TaskManager.Task::(prepare) Task=`fd8a1a5d-dbc5-4479-8fc8-d8278dff0f85`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-155::DEBUG::2012-03-30 07:54:55,719::task::588::TaskManager.Task::(_updateState) Task=`fd8a1a5d-dbc5-4479-8fc8-d8278dff0f85`::moving from state preparing -> state finished
Thread-155::DEBUG::2012-03-30 07:54:55,721::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-155::DEBUG::2012-03-30 07:54:55,723::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-155::DEBUG::2012-03-30 07:54:55,724::task::978::TaskManager.Task::(_decref) Task=`fd8a1a5d-dbc5-4479-8fc8-d8278dff0f85`::ref 0 aborting False
Thread-156::DEBUG::2012-03-30 07:54:55,735::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-156::DEBUG::2012-03-30 07:54:55,737::task::588::TaskManager.Task::(_updateState) Task=`bf8e5aa9-0875-44dc-99a0-77f532fbb0c5`::moving from state init -> state preparing
Thread-156::INFO::2012-03-30 07:54:55,739::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-156::DEBUG::2012-03-30 07:54:55,742::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`5f9b0e22-5f32-45f5-915a-4dc3541959e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-156::DEBUG::2012-03-30 07:54:55,744::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-156::DEBUG::2012-03-30 07:54:55,746::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-156::DEBUG::2012-03-30 07:54:55,748::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`5f9b0e22-5f32-45f5-915a-4dc3541959e0`::Granted request
Thread-156::DEBUG::2012-03-30 07:54:55,751::task::817::TaskManager.Task::(resourceAcquired) Task=`bf8e5aa9-0875-44dc-99a0-77f532fbb0c5`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-156::DEBUG::2012-03-30 07:54:55,752::task::978::TaskManager.Task::(_decref) Task=`bf8e5aa9-0875-44dc-99a0-77f532fbb0c5`::ref 1 aborting False
Thread-156::INFO::2012-03-30 07:54:55,758::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-156::DEBUG::2012-03-30 07:54:55,760::task::1172::TaskManager.Task::(prepare) Task=`bf8e5aa9-0875-44dc-99a0-77f532fbb0c5`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-156::DEBUG::2012-03-30 07:54:55,762::task::588::TaskManager.Task::(_updateState) Task=`bf8e5aa9-0875-44dc-99a0-77f532fbb0c5`::moving from state preparing -> state finished
Thread-156::DEBUG::2012-03-30 07:54:55,763::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-156::DEBUG::2012-03-30 07:54:55,765::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-156::DEBUG::2012-03-30 07:54:55,767::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-156::DEBUG::2012-03-30 07:54:55,769::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-156::DEBUG::2012-03-30 07:54:55,770::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-156::DEBUG::2012-03-30 07:54:55,772::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-156::DEBUG::2012-03-30 07:54:55,774::task::978::TaskManager.Task::(_decref) Task=`bf8e5aa9-0875-44dc-99a0-77f532fbb0c5`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:54:57,044::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:54:57,479::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.176289 s, 5.8 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:54:59,525::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:00,005::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.186995 s, 5.5 MB/s\n'; <rc> = 0
Thread-160::DEBUG::2012-03-30 07:55:01,985::task::588::TaskManager.Task::(_updateState) Task=`01960f7e-37ad-41fc-83bc-a8284e17a7a7`::moving from state init -> state preparing
Thread-160::INFO::2012-03-30 07:55:02,016::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-160::INFO::2012-03-30 07:55:02,019::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00136804580688', 'lastCheck': 1333086896.489784, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00374794006348', 'lastCheck': 1333086894.309644, 'code': 0, 'valid': True}}
Thread-160::DEBUG::2012-03-30 07:55:02,020::task::1172::TaskManager.Task::(prepare) Task=`01960f7e-37ad-41fc-83bc-a8284e17a7a7`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00136804580688', 'lastCheck': 1333086896.489784, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00374794006348', 'lastCheck': 1333086894.309644, 'code': 0, 'valid': True}}
Thread-160::DEBUG::2012-03-30 07:55:02,022::task::588::TaskManager.Task::(_updateState) Task=`01960f7e-37ad-41fc-83bc-a8284e17a7a7`::moving from state preparing -> state finished
Thread-160::DEBUG::2012-03-30 07:55:02,024::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-160::DEBUG::2012-03-30 07:55:02,025::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-160::DEBUG::2012-03-30 07:55:02,027::task::978::TaskManager.Task::(_decref) Task=`01960f7e-37ad-41fc-83bc-a8284e17a7a7`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:02,066::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:02,492::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.16928 s, 6.0 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:04,537::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:04,964::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.168784 s, 6.1 MB/s\n'; <rc> = 0
Thread-163::DEBUG::2012-03-30 07:55:05,808::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-163::DEBUG::2012-03-30 07:55:05,812::task::588::TaskManager.Task::(_updateState) Task=`b7d85af6-0e02-431f-b848-020b40f2dbd5`::moving from state init -> state preparing
Thread-163::INFO::2012-03-30 07:55:05,814::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-163::INFO::2012-03-30 07:55:05,816::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-163::DEBUG::2012-03-30 07:55:05,818::task::1172::TaskManager.Task::(prepare) Task=`b7d85af6-0e02-431f-b848-020b40f2dbd5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-163::DEBUG::2012-03-30 07:55:05,819::task::588::TaskManager.Task::(_updateState) Task=`b7d85af6-0e02-431f-b848-020b40f2dbd5`::moving from state preparing -> state finished
Thread-163::DEBUG::2012-03-30 07:55:05,821::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-163::DEBUG::2012-03-30 07:55:05,823::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-163::DEBUG::2012-03-30 07:55:05,824::task::978::TaskManager.Task::(_decref) Task=`b7d85af6-0e02-431f-b848-020b40f2dbd5`::ref 0 aborting False
Thread-164::DEBUG::2012-03-30 07:55:05,838::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-164::DEBUG::2012-03-30 07:55:05,841::task::588::TaskManager.Task::(_updateState) Task=`80967832-5d72-417b-b13d-f76ed262a193`::moving from state init -> state preparing
Thread-164::INFO::2012-03-30 07:55:05,842::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-164::DEBUG::2012-03-30 07:55:05,846::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`2355e33b-1202-4800-b593-09cdc980080d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-164::DEBUG::2012-03-30 07:55:05,847::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-164::DEBUG::2012-03-30 07:55:05,850::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-164::DEBUG::2012-03-30 07:55:05,851::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`2355e33b-1202-4800-b593-09cdc980080d`::Granted request
Thread-164::DEBUG::2012-03-30 07:55:05,854::task::817::TaskManager.Task::(resourceAcquired) Task=`80967832-5d72-417b-b13d-f76ed262a193`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-164::DEBUG::2012-03-30 07:55:05,856::task::978::TaskManager.Task::(_decref) Task=`80967832-5d72-417b-b13d-f76ed262a193`::ref 1 aborting False
Thread-164::INFO::2012-03-30 07:55:05,862::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-164::DEBUG::2012-03-30 07:55:05,863::task::1172::TaskManager.Task::(prepare) Task=`80967832-5d72-417b-b13d-f76ed262a193`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-164::DEBUG::2012-03-30 07:55:05,865::task::588::TaskManager.Task::(_updateState) Task=`80967832-5d72-417b-b13d-f76ed262a193`::moving from state preparing -> state finished
Thread-164::DEBUG::2012-03-30 07:55:05,867::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-164::DEBUG::2012-03-30 07:55:05,869::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-164::DEBUG::2012-03-30 07:55:05,871::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-164::DEBUG::2012-03-30 07:55:05,873::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-164::DEBUG::2012-03-30 07:55:05,874::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-164::DEBUG::2012-03-30 07:55:05,876::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-164::DEBUG::2012-03-30 07:55:05,878::task::978::TaskManager.Task::(_decref) Task=`80967832-5d72-417b-b13d-f76ed262a193`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:07,010::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:07,444::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.175775 s, 5.8 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:09,491::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:09,918::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.169415 s, 6.0 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:11,972::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Thread-168::DEBUG::2012-03-30 07:55:12,153::task::588::TaskManager.Task::(_updateState) Task=`b0753440-20b4-4cbd-be3f-d0f26ab50a3b`::moving from state init -> state preparing
Thread-168::INFO::2012-03-30 07:55:12,157::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-168::INFO::2012-03-30 07:55:12,196::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00106501579285', 'lastCheck': 1333086906.5024731, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00256681442261', 'lastCheck': 1333086904.3220379, 'code': 0, 'valid': True}}
Thread-168::DEBUG::2012-03-30 07:55:12,198::task::1172::TaskManager.Task::(prepare) Task=`b0753440-20b4-4cbd-be3f-d0f26ab50a3b`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00106501579285', 'lastCheck': 1333086906.5024731, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00256681442261', 'lastCheck': 1333086904.3220379, 'code': 0, 'valid': True}}
Thread-168::DEBUG::2012-03-30 07:55:12,201::task::588::TaskManager.Task::(_updateState) Task=`b0753440-20b4-4cbd-be3f-d0f26ab50a3b`::moving from state preparing -> state finished
Thread-168::DEBUG::2012-03-30 07:55:12,203::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-168::DEBUG::2012-03-30 07:55:12,206::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-168::DEBUG::2012-03-30 07:55:12,209::task::978::TaskManager.Task::(_decref) Task=`b0753440-20b4-4cbd-be3f-d0f26ab50a3b`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:12,474::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.247654 s, 4.1 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:14,520::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:14,958::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.179044 s, 5.7 MB/s\n'; <rc> = 0
Thread-171::DEBUG::2012-03-30 07:55:15,917::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-171::DEBUG::2012-03-30 07:55:15,921::task::588::TaskManager.Task::(_updateState) Task=`c1d1aaa8-13fb-4cb0-83fc-b167bd6a2672`::moving from state init -> state preparing
Thread-171::INFO::2012-03-30 07:55:15,923::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-171::INFO::2012-03-30 07:55:15,925::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-171::DEBUG::2012-03-30 07:55:15,927::task::1172::TaskManager.Task::(prepare) Task=`c1d1aaa8-13fb-4cb0-83fc-b167bd6a2672`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-171::DEBUG::2012-03-30 07:55:15,929::task::588::TaskManager.Task::(_updateState) Task=`c1d1aaa8-13fb-4cb0-83fc-b167bd6a2672`::moving from state preparing -> state finished
Thread-171::DEBUG::2012-03-30 07:55:15,930::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-171::DEBUG::2012-03-30 07:55:15,932::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-171::DEBUG::2012-03-30 07:55:15,933::task::978::TaskManager.Task::(_decref) Task=`c1d1aaa8-13fb-4cb0-83fc-b167bd6a2672`::ref 0 aborting False
Thread-172::DEBUG::2012-03-30 07:55:15,944::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-172::DEBUG::2012-03-30 07:55:15,947::task::588::TaskManager.Task::(_updateState) Task=`668d9a08-eabb-4d84-a45e-ce9a7e082d60`::moving from state init -> state preparing
Thread-172::INFO::2012-03-30 07:55:15,948::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-172::DEBUG::2012-03-30 07:55:15,952::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`32f2e4a7-cab8-4416-b515-3152b3b911c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-172::DEBUG::2012-03-30 07:55:15,954::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-172::DEBUG::2012-03-30 07:55:15,956::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-172::DEBUG::2012-03-30 07:55:15,957::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`32f2e4a7-cab8-4416-b515-3152b3b911c1`::Granted request
Thread-172::DEBUG::2012-03-30 07:55:15,960::task::817::TaskManager.Task::(resourceAcquired) Task=`668d9a08-eabb-4d84-a45e-ce9a7e082d60`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-172::DEBUG::2012-03-30 07:55:15,962::task::978::TaskManager.Task::(_decref) Task=`668d9a08-eabb-4d84-a45e-ce9a7e082d60`::ref 1 aborting False
Thread-172::INFO::2012-03-30 07:55:15,968::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-172::DEBUG::2012-03-30 07:55:15,969::task::1172::TaskManager.Task::(prepare) Task=`668d9a08-eabb-4d84-a45e-ce9a7e082d60`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-172::DEBUG::2012-03-30 07:55:15,973::task::588::TaskManager.Task::(_updateState) Task=`668d9a08-eabb-4d84-a45e-ce9a7e082d60`::moving from state preparing -> state finished
Thread-172::DEBUG::2012-03-30 07:55:15,974::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-172::DEBUG::2012-03-30 07:55:15,976::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-172::DEBUG::2012-03-30 07:55:15,978::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-172::DEBUG::2012-03-30 07:55:15,980::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-172::DEBUG::2012-03-30 07:55:15,982::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-172::DEBUG::2012-03-30 07:55:15,983::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-172::DEBUG::2012-03-30 07:55:15,985::task::978::TaskManager.Task::(_decref) Task=`668d9a08-eabb-4d84-a45e-ce9a7e082d60`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:17,003::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:17,435::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.175119 s, 5.8 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:19,481::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:19,910::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.174942 s, 5.9 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:21,958::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Thread-176::DEBUG::2012-03-30 07:55:22,327::task::588::TaskManager.Task::(_updateState) Task=`d1253ab5-a5ad-4d7b-bc26-81a99936a167`::moving from state init -> state preparing
Thread-176::INFO::2012-03-30 07:55:22,332::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-176::INFO::2012-03-30 07:55:22,364::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00212287902832', 'lastCheck': 1333086916.513664, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00259709358215', 'lastCheck': 1333086914.3347001, 'code': 0, 'valid': True}}
Thread-176::DEBUG::2012-03-30 07:55:22,368::task::1172::TaskManager.Task::(prepare) Task=`d1253ab5-a5ad-4d7b-bc26-81a99936a167`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00212287902832', 'lastCheck': 1333086916.513664, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00259709358215', 'lastCheck': 1333086914.3347001, 'code': 0, 'valid': True}}
Thread-176::DEBUG::2012-03-30 07:55:22,370::task::588::TaskManager.Task::(_updateState) Task=`d1253ab5-a5ad-4d7b-bc26-81a99936a167`::moving from state preparing -> state finished
Thread-176::DEBUG::2012-03-30 07:55:22,373::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-176::DEBUG::2012-03-30 07:55:22,376::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-176::DEBUG::2012-03-30 07:55:22,379::task::978::TaskManager.Task::(_decref) Task=`d1253ab5-a5ad-4d7b-bc26-81a99936a167`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:22,472::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.173825 s, 5.9 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:24,520::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:24,943::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.168777 s, 6.1 MB/s\n'; <rc> = 0
Thread-179::DEBUG::2012-03-30 07:55:26,023::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-179::DEBUG::2012-03-30 07:55:26,027::task::588::TaskManager.Task::(_updateState) Task=`ffb7f4eb-7327-4b01-ba02-f70a54cb7307`::moving from state init -> state preparing
Thread-179::INFO::2012-03-30 07:55:26,029::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-179::INFO::2012-03-30 07:55:26,031::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-179::DEBUG::2012-03-30 07:55:26,033::task::1172::TaskManager.Task::(prepare) Task=`ffb7f4eb-7327-4b01-ba02-f70a54cb7307`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-179::DEBUG::2012-03-30 07:55:26,034::task::588::TaskManager.Task::(_updateState) Task=`ffb7f4eb-7327-4b01-ba02-f70a54cb7307`::moving from state preparing -> state finished
Thread-179::DEBUG::2012-03-30 07:55:26,036::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-179::DEBUG::2012-03-30 07:55:26,037::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-179::DEBUG::2012-03-30 07:55:26,039::task::978::TaskManager.Task::(_decref) Task=`ffb7f4eb-7327-4b01-ba02-f70a54cb7307`::ref 0 aborting False
Thread-180::DEBUG::2012-03-30 07:55:26,049::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-180::DEBUG::2012-03-30 07:55:26,052::task::588::TaskManager.Task::(_updateState) Task=`90c13316-22de-4d40-a9c6-1545c1381e1b`::moving from state init -> state preparing
Thread-180::INFO::2012-03-30 07:55:26,054::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-180::DEBUG::2012-03-30 07:55:26,057::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`86d45d86-972f-44b4-b2c9-a807bcfb0380`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-180::DEBUG::2012-03-30 07:55:26,059::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-180::DEBUG::2012-03-30 07:55:26,061::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-180::DEBUG::2012-03-30 07:55:26,063::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`86d45d86-972f-44b4-b2c9-a807bcfb0380`::Granted request
Thread-180::DEBUG::2012-03-30 07:55:26,065::task::817::TaskManager.Task::(resourceAcquired) Task=`90c13316-22de-4d40-a9c6-1545c1381e1b`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-180::DEBUG::2012-03-30 07:55:26,067::task::978::TaskManager.Task::(_decref) Task=`90c13316-22de-4d40-a9c6-1545c1381e1b`::ref 1 aborting False
Thread-180::INFO::2012-03-30 07:55:26,073::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-180::DEBUG::2012-03-30 07:55:26,075::task::1172::TaskManager.Task::(prepare) Task=`90c13316-22de-4d40-a9c6-1545c1381e1b`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-180::DEBUG::2012-03-30 07:55:26,077::task::588::TaskManager.Task::(_updateState) Task=`90c13316-22de-4d40-a9c6-1545c1381e1b`::moving from state preparing -> state finished
Thread-180::DEBUG::2012-03-30 07:55:26,079::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-180::DEBUG::2012-03-30 07:55:26,080::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-180::DEBUG::2012-03-30 07:55:26,082::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-180::DEBUG::2012-03-30 07:55:26,084::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-180::DEBUG::2012-03-30 07:55:26,086::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-180::DEBUG::2012-03-30 07:55:26,087::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-180::DEBUG::2012-03-30 07:55:26,089::task::978::TaskManager.Task::(_decref) Task=`90c13316-22de-4d40-a9c6-1545c1381e1b`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:27,000::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:27,430::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.169987 s, 6.0 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:29,481::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:29,916::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.175893 s, 5.8 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:31,963::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:32,390::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170453 s, 6.0 MB/s\n'; <rc> = 0
Thread-184::DEBUG::2012-03-30 07:55:32,493::task::588::TaskManager.Task::(_updateState) Task=`cc8a29b6-bbad-4642-8b34-d20e673ceabb`::moving from state init -> state preparing
Thread-184::INFO::2012-03-30 07:55:32,496::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-184::INFO::2012-03-30 07:55:32,529::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00105094909668', 'lastCheck': 1333086926.5238349, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00271487236023', 'lastCheck': 1333086924.3472919, 'code': 0, 'valid': True}}
Thread-184::DEBUG::2012-03-30 07:55:32,531::task::1172::TaskManager.Task::(prepare) Task=`cc8a29b6-bbad-4642-8b34-d20e673ceabb`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00105094909668', 'lastCheck': 1333086926.5238349, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00271487236023', 'lastCheck': 1333086924.3472919, 'code': 0, 'valid': True}}
Thread-184::DEBUG::2012-03-30 07:55:32,533::task::588::TaskManager.Task::(_updateState) Task=`cc8a29b6-bbad-4642-8b34-d20e673ceabb`::moving from state preparing -> state finished
Thread-184::DEBUG::2012-03-30 07:55:32,534::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-184::DEBUG::2012-03-30 07:55:32,536::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-184::DEBUG::2012-03-30 07:55:32,538::task::978::TaskManager.Task::(_decref) Task=`cc8a29b6-bbad-4642-8b34-d20e673ceabb`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:34,436::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:34,911::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.217432 s, 4.7 MB/s\n'; <rc> = 0
Thread-187::DEBUG::2012-03-30 07:55:36,127::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-187::DEBUG::2012-03-30 07:55:36,130::task::588::TaskManager.Task::(_updateState) Task=`b0a316e0-cc9b-4c9a-9ca3-26534334afad`::moving from state init -> state preparing
Thread-187::INFO::2012-03-30 07:55:36,133::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-187::INFO::2012-03-30 07:55:36,135::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-187::DEBUG::2012-03-30 07:55:36,136::task::1172::TaskManager.Task::(prepare) Task=`b0a316e0-cc9b-4c9a-9ca3-26534334afad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-187::DEBUG::2012-03-30 07:55:36,138::task::588::TaskManager.Task::(_updateState) Task=`b0a316e0-cc9b-4c9a-9ca3-26534334afad`::moving from state preparing -> state finished
Thread-187::DEBUG::2012-03-30 07:55:36,140::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-187::DEBUG::2012-03-30 07:55:36,141::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-187::DEBUG::2012-03-30 07:55:36,143::task::978::TaskManager.Task::(_decref) Task=`b0a316e0-cc9b-4c9a-9ca3-26534334afad`::ref 0 aborting False
Thread-188::DEBUG::2012-03-30 07:55:36,153::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-188::DEBUG::2012-03-30 07:55:36,156::task::588::TaskManager.Task::(_updateState) Task=`e420b283-1d54-4131-b4f1-d815c5964e2a`::moving from state init -> state preparing
Thread-188::INFO::2012-03-30 07:55:36,158::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-188::DEBUG::2012-03-30 07:55:36,161::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`368b0874-bac8-4772-8934-bfd5a0f21619`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-188::DEBUG::2012-03-30 07:55:36,163::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-188::DEBUG::2012-03-30 07:55:36,165::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-188::DEBUG::2012-03-30 07:55:36,167::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`368b0874-bac8-4772-8934-bfd5a0f21619`::Granted request
Thread-188::DEBUG::2012-03-30 07:55:36,169::task::817::TaskManager.Task::(resourceAcquired) Task=`e420b283-1d54-4131-b4f1-d815c5964e2a`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-188::DEBUG::2012-03-30 07:55:36,171::task::978::TaskManager.Task::(_decref) Task=`e420b283-1d54-4131-b4f1-d815c5964e2a`::ref 1 aborting False
Thread-188::INFO::2012-03-30 07:55:36,177::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-188::DEBUG::2012-03-30 07:55:36,178::task::1172::TaskManager.Task::(prepare) Task=`e420b283-1d54-4131-b4f1-d815c5964e2a`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-188::DEBUG::2012-03-30 07:55:36,180::task::588::TaskManager.Task::(_updateState) Task=`e420b283-1d54-4131-b4f1-d815c5964e2a`::moving from state preparing -> state finished
Thread-188::DEBUG::2012-03-30 07:55:36,182::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-188::DEBUG::2012-03-30 07:55:36,184::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-188::DEBUG::2012-03-30 07:55:36,186::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-188::DEBUG::2012-03-30 07:55:36,188::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-188::DEBUG::2012-03-30 07:55:36,189::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-188::DEBUG::2012-03-30 07:55:36,191::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-188::DEBUG::2012-03-30 07:55:36,193::task::978::TaskManager.Task::(_decref) Task=`e420b283-1d54-4131-b4f1-d815c5964e2a`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:36,961::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:37,392::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.173608 s, 5.9 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:39,444::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:39,874::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.175702 s, 5.8 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:41,922::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:42,354::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.175177 s, 5.8 MB/s\n'; <rc> = 0
Thread-192::DEBUG::2012-03-30 07:55:42,686::task::588::TaskManager.Task::(_updateState) Task=`b9cee330-9064-49c6-82a5-b07e612ad4ea`::moving from state init -> state preparing
Thread-192::INFO::2012-03-30 07:55:42,689::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-192::INFO::2012-03-30 07:55:42,691::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00156092643738', 'lastCheck': 1333086936.534759, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00291299819946', 'lastCheck': 1333086934.3601761, 'code': 0, 'valid': True}}
Thread-192::DEBUG::2012-03-30 07:55:42,693::task::1172::TaskManager.Task::(prepare) Task=`b9cee330-9064-49c6-82a5-b07e612ad4ea`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00156092643738', 'lastCheck': 1333086936.534759, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00291299819946', 'lastCheck': 1333086934.3601761, 'code': 0, 'valid': True}}
Thread-192::DEBUG::2012-03-30 07:55:42,695::task::588::TaskManager.Task::(_updateState) Task=`b9cee330-9064-49c6-82a5-b07e612ad4ea`::moving from state preparing -> state finished
Thread-192::DEBUG::2012-03-30 07:55:42,696::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-192::DEBUG::2012-03-30 07:55:42,698::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-192::DEBUG::2012-03-30 07:55:42,700::task::978::TaskManager.Task::(_decref) Task=`b9cee330-9064-49c6-82a5-b07e612ad4ea`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:44,400::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:44,884::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170175 s, 6.0 MB/s\n'; <rc> = 0
Thread-195::DEBUG::2012-03-30 07:55:46,232::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-195::DEBUG::2012-03-30 07:55:46,236::task::588::TaskManager.Task::(_updateState) Task=`0b9eff23-4e1f-4eda-88c4-b725aaa8ca18`::moving from state init -> state preparing
Thread-195::INFO::2012-03-30 07:55:46,238::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-195::INFO::2012-03-30 07:55:46,241::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-195::DEBUG::2012-03-30 07:55:46,242::task::1172::TaskManager.Task::(prepare) Task=`0b9eff23-4e1f-4eda-88c4-b725aaa8ca18`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-195::DEBUG::2012-03-30 07:55:46,244::task::588::TaskManager.Task::(_updateState) Task=`0b9eff23-4e1f-4eda-88c4-b725aaa8ca18`::moving from state preparing -> state finished
Thread-195::DEBUG::2012-03-30 07:55:46,246::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-195::DEBUG::2012-03-30 07:55:46,247::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-195::DEBUG::2012-03-30 07:55:46,249::task::978::TaskManager.Task::(_decref) Task=`0b9eff23-4e1f-4eda-88c4-b725aaa8ca18`::ref 0 aborting False
Thread-196::DEBUG::2012-03-30 07:55:46,259::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-196::DEBUG::2012-03-30 07:55:46,262::task::588::TaskManager.Task::(_updateState) Task=`0fed6281-3444-43ff-8732-216cccb2377b`::moving from state init -> state preparing
Thread-196::INFO::2012-03-30 07:55:46,263::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-196::DEBUG::2012-03-30 07:55:46,267::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`ca514b25-64f8-4aba-b9cb-ebd7cc328034`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-196::DEBUG::2012-03-30 07:55:46,269::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-196::DEBUG::2012-03-30 07:55:46,271::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-196::DEBUG::2012-03-30 07:55:46,273::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`ca514b25-64f8-4aba-b9cb-ebd7cc328034`::Granted request
Thread-196::DEBUG::2012-03-30 07:55:46,275::task::817::TaskManager.Task::(resourceAcquired) Task=`0fed6281-3444-43ff-8732-216cccb2377b`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-196::DEBUG::2012-03-30 07:55:46,277::task::978::TaskManager.Task::(_decref) Task=`0fed6281-3444-43ff-8732-216cccb2377b`::ref 1 aborting False
Thread-196::INFO::2012-03-30 07:55:46,283::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-196::DEBUG::2012-03-30 07:55:46,284::task::1172::TaskManager.Task::(prepare) Task=`0fed6281-3444-43ff-8732-216cccb2377b`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-196::DEBUG::2012-03-30 07:55:46,286::task::588::TaskManager.Task::(_updateState) Task=`0fed6281-3444-43ff-8732-216cccb2377b`::moving from state preparing -> state finished
Thread-196::DEBUG::2012-03-30 07:55:46,288::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-196::DEBUG::2012-03-30 07:55:46,289::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-196::DEBUG::2012-03-30 07:55:46,292::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-196::DEBUG::2012-03-30 07:55:46,293::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-196::DEBUG::2012-03-30 07:55:46,295::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-196::DEBUG::2012-03-30 07:55:46,296::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-196::DEBUG::2012-03-30 07:55:46,298::task::978::TaskManager.Task::(_decref) Task=`0fed6281-3444-43ff-8732-216cccb2377b`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:46,931::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:47,356::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.168786 s, 6.1 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:49,404::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:49,851::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.169517 s, 6.0 MB/s\n'; <rc> = 0
Dummy-88::DEBUG::2012-03-30 07:55:51,897::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:52,328::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170713 s, 6.0 MB/s\n'; <rc> = 0
Thread-200::DEBUG::2012-03-30 07:55:52,839::task::588::TaskManager.Task::(_updateState) Task=`d93e4393-00b9-4fd6-a5b2-d43172b841f4`::moving from state init -> state preparing
Thread-200::INFO::2012-03-30 07:55:52,856::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-200::INFO::2012-03-30 07:55:52,858::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00106310844421', 'lastCheck': 1333086946.5449231, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00292491912842', 'lastCheck': 1333086944.37288, 'code': 0, 'valid': True}}
Thread-200::DEBUG::2012-03-30 07:55:52,879::task::1172::TaskManager.Task::(prepare) Task=`d93e4393-00b9-4fd6-a5b2-d43172b841f4`::finished: {'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'delay': '0.00106310844421', 'lastCheck': 1333086946.5449231, 'code': 0, 'valid': True}, 'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'delay': '0.00292491912842', 'lastCheck': 1333086944.37288, 'code': 0, 'valid': True}}
Thread-200::DEBUG::2012-03-30 07:55:52,881::task::588::TaskManager.Task::(_updateState) Task=`d93e4393-00b9-4fd6-a5b2-d43172b841f4`::moving from state preparing -> state finished
Thread-200::DEBUG::2012-03-30 07:55:52,883::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-200::DEBUG::2012-03-30 07:55:52,885::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-200::DEBUG::2012-03-30 07:55:52,886::task::978::TaskManager.Task::(_decref) Task=`d93e4393-00b9-4fd6-a5b2-d43172b841f4`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:54,374::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:54,817::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.180263 s, 5.7 MB/s\n'; <rc> = 0
Thread-203::DEBUG::2012-03-30 07:55:56,337::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-203::DEBUG::2012-03-30 07:55:56,340::task::588::TaskManager.Task::(_updateState) Task=`0fff9a80-72e2-40e5-942c-2fe12a7e5ade`::moving from state init -> state preparing
Thread-203::INFO::2012-03-30 07:55:56,342::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-203::INFO::2012-03-30 07:55:56,345::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-203::DEBUG::2012-03-30 07:55:56,346::task::1172::TaskManager.Task::(prepare) Task=`0fff9a80-72e2-40e5-942c-2fe12a7e5ade`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}}
Thread-203::DEBUG::2012-03-30 07:55:56,348::task::588::TaskManager.Task::(_updateState) Task=`0fff9a80-72e2-40e5-942c-2fe12a7e5ade`::moving from state preparing -> state finished
Thread-203::DEBUG::2012-03-30 07:55:56,349::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-203::DEBUG::2012-03-30 07:55:56,351::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-203::DEBUG::2012-03-30 07:55:56,353::task::978::TaskManager.Task::(_decref) Task=`0fff9a80-72e2-40e5-942c-2fe12a7e5ade`::ref 0 aborting False
Thread-204::DEBUG::2012-03-30 07:55:56,363::BindingXMLRPC::167::vds::(wrapper) [192.168.100.10]
Thread-204::DEBUG::2012-03-30 07:55:56,365::task::588::TaskManager.Task::(_updateState) Task=`da37abf3-0321-41d6-bb97-663d80d17d16`::moving from state init -> state preparing
Thread-204::INFO::2012-03-30 07:55:56,367::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='13080edc-77ea-11e1-b6a4-525400c49d2a', options=None)
Thread-204::DEBUG::2012-03-30 07:55:56,370::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`6bd830d8-d148-4b5e-b68b-e86edfb1b7a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2037' at 'getStoragePoolInfo'
Thread-204::DEBUG::2012-03-30 07:55:56,372::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' for lock type 'shared'
Thread-204::DEBUG::2012-03-30 07:55:56,374::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free. Now locking as 'shared' (1 active user)
Thread-204::DEBUG::2012-03-30 07:55:56,376::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.13080edc-77ea-11e1-b6a4-525400c49d2a`ReqID=`6bd830d8-d148-4b5e-b68b-e86edfb1b7a9`::Granted request
Thread-204::DEBUG::2012-03-30 07:55:56,379::task::817::TaskManager.Task::(resourceAcquired) Task=`da37abf3-0321-41d6-bb97-663d80d17d16`::_resourcesAcquired: Storage.13080edc-77ea-11e1-b6a4-525400c49d2a (shared)
Thread-204::DEBUG::2012-03-30 07:55:56,380::task::978::TaskManager.Task::(_decref) Task=`da37abf3-0321-41d6-bb97-663d80d17d16`::ref 1 aborting False
Thread-204::INFO::2012-03-30 07:55:56,386::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-204::DEBUG::2012-03-30 07:55:56,387::task::1172::TaskManager.Task::(prepare) Task=`da37abf3-0321-41d6-bb97-663d80d17d16`::finished: {'info': {'spm_id': 1, 'master_uuid': '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 'name': 'Default', 'version': '2', 'domains': u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0:Attached,bb13e29f-0e5a-4f79-8bf2-f235a0dbd515:Active,8ed25a57-f53a-4cf0-bb92-781f3ce36a48:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 4}, 'dominfo': {u'93e2079e-ef3b-452f-af71-5b3e7eb32ba0': {'status': u'Attached'}, u'8ed25a57-f53a-4cf0-bb92-781f3ce36a48': {'status': u'Active', 'diskfree': '2142920245248', 'alerts': [], 'disktotal': '2147080994816'}, u'bb13e29f-0e5a-4f79-8bf2-f235a0dbd515': {'status': u'Active', 'diskfree': '5266929221632', 'alerts': [], 'disktotal': '5902284816384'}}}
Thread-204::DEBUG::2012-03-30 07:55:56,389::task::588::TaskManager.Task::(_updateState) Task=`da37abf3-0321-41d6-bb97-663d80d17d16`::moving from state preparing -> state finished
Thread-204::DEBUG::2012-03-30 07:55:56,391::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a': < ResourceRef 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', isValid: 'True' obj: 'None'>}
Thread-204::DEBUG::2012-03-30 07:55:56,393::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-204::DEBUG::2012-03-30 07:55:56,395::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-204::DEBUG::2012-03-30 07:55:56,397::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-204::DEBUG::2012-03-30 07:55:56,398::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-204::DEBUG::2012-03-30 07:55:56,400::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-204::DEBUG::2012-03-30 07:55:56,402::task::978::TaskManager.Task::(_decref) Task=`da37abf3-0321-41d6-bb97-663d80d17d16`::ref 0 aborting False
Dummy-88::DEBUG::2012-03-30 07:55:56,891::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/13080edc-77ea-11e1-b6a4-525400c49d2a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
Dummy-88::DEBUG::2012-03-30 07:55:57,320::storage_mailbox::640::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.174354 s, 5.9 MB/s\n'; <rc> = 0
Von: Rami Vaknin [mailto:rvaknin at redhat.com]
Gesendet: Donnerstag, 29. März 2012 17:57
An: Saggi Mizrahi; Rene Rosenberger
Cc: users at ovirt.org
Betreff: Fwd: AW: [Users] storage domain reactivate not working
Rene, VDSM can't read the storage domain's metadata, the problem is that vdsm tries to read the metadata using 'dd' command which applies to the old version of storage domains as in the new format the metadata is saved as vg tags. Are you using storage domain version lower that V2? Can you attach the full log?
Saggi, any thoughts on that?
-------- Original Message --------
Subject:
AW: [Users] storage domain reactivate not working
Date:
Thu, 29 Mar 2012 06:33:27 -0400
From:
Rene Rosenberger <r.rosenberger at netbiscuits.com><mailto:r.rosenberger at netbiscuits.com>
To:
rvaknin at redhat.com<mailto:rvaknin at redhat.com> <rvaknin at redhat.com><mailto:rvaknin at redhat.com>, users at ovirt.org<mailto:users at ovirt.org> <users at ovirt.org><mailto:users at ovirt.org>
Hi,
not sure if the logs i posted is waht you need. The thing ist hat the iscsi target is connected but in web gui it is locked. Can I unlock it?
Regards, rene
Von: Rene Rosenberger
Gesendet: Donnerstag, 29. März 2012 12:00
An: Rene Rosenberger; rvaknin at redhat.com<mailto:rvaknin at redhat.com>; users at ovirt.org<mailto:users at ovirt.org>
Betreff: AW: [Users] storage domain reactivate not working
Hi,
This is the roor message:
Thread-5448::DEBUG::2012-03-29 11:57:46,310::misc::1032::SamplingMethod::(__call__) Returning last result
Thread-5448::DEBUG::2012-03-29 11:57:46,313::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-5448::DEBUG::2012-03-29 11:57:46,322::lvm::284::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360014052dd702d2defc8d459adba02dc|360014057fda80efdcae4d414eda829d7%\\<file:///\\%5C%5C%22a%25360014052dd702d2defc8d459adba02dc%7C360014057fda80efdcae4d414eda829d7%25%5C>", \\"r%.*%\\<file:///\\%5C%5C%22r%25.*%25%5C>" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8ed25a57-f53a-4cf0-bb92-781f3ce36a48' (cwd None)
Thread-5448::DEBUG::2012-03-29 11:57:47,096::lvm::284::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' /dev/mapper/360014057fda80efdcae4d414eda829d7: read failed after 0 of 4096 at 2147483582464: Input/output error\n /dev/mapper/360014057fda80efdcae4d414eda829d7: read failed after 0 of 4096 at 2147483639808: Input/output error\n /dev/mapper/360014057fda80efdcae4d414eda829d7: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/360014057fda80efdcae4d414eda829d7 was disabled\n'; <rc> = 0
Thread-5448::DEBUG::2012-03-29 11:57:47,105::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-5448::DEBUG::2012-03-29 11:57:47,107::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with LvMetadataRW backend
Thread-5448::DEBUG::2012-03-29 11:57:47,110::blockSD::177::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/metadata count=1' (cwd None)
Thread-5448::DEBUG::2012-03-29 11:57:47,155::blockSD::177::Storage.Misc.excCmd::(readlines) FAILED: <err> = "/bin/dd: reading `/dev/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/metadata': Input/output error\n0+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.000525019 s, 0.0 kB/s\n"; <rc> = 1
Thread-5448::ERROR::2012-03-29 11:57:47,158::sdc::113::Storage.StorageDomainCache::(_findDomain) Error while looking for domain `8ed25a57-f53a-4cf0-bb92-781f3ce36a48`
Traceback (most recent call last):
File "/usr/share/vdsm/storage/sdc.py", line 109, in _findDomain
return mod.findDomain(sdUUID)
File "/usr/share/vdsm/storage/blockSD.py", line 1051, in findDomain
return BlockStorageDomain(BlockStorageDomain.findDomainPath(sdUUID))
File "/usr/share/vdsm/storage/blockSD.py", line 241, in __init__
metadata = selectMetadata(sdUUID)
File "/usr/share/vdsm/storage/blockSD.py", line 210, in selectMetadata
if len(mdProvider) > 0:
File "/usr/share/vdsm/storage/persistentDict.py", line 51, in __len__
return len(self.keys())
File "/usr/share/vdsm/storage/persistentDict.py", line 95, in keys
return list(self.__iter__())
File "/usr/share/vdsm/storage/persistentDict.py", line 92, in __iter__
return ifilter(lambda k: k in self._validatorDict, self._dict.__iter__())
File "/usr/share/vdsm/storage/persistentDict.py", line 209, in __iter__
with self._accessWrapper():
File "/usr/lib64/python2.6/contextlib.py", line 16, in __enter__
return self.gen.next()
File "/usr/share/vdsm/storage/persistentDict.py", line 137, in _accessWrapper
self.refresh()
File "/usr/share/vdsm/storage/persistentDict.py", line 214, in refresh
lines = self._metaRW.readlines()
File "/usr/share/vdsm/storage/blockSD.py", line 177, in readlines
m = misc.readblockSUDO(self.metavol, self._offset, self._size)
File "/usr/share/vdsm/storage/misc.py", line 307, in readblockSUDO
raise se.MiscBlockReadException(name, offset, size)
MiscBlockReadException: Internal block device read failure: 'name=/dev/8ed25a57-f53a-4cf0-bb92-781f3ce36a48/metadata, offset=0, size=2048'
Thread-5448::DEBUG::2012-03-29 11:57:47,177::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a'
Thread-5448::DEBUG::2012-03-29 11:57:47,180::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' (0 active users)
Thread-5448::DEBUG::2012-03-29 11:57:47,181::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a' is free, finding out if anyone is waiting for it.
Thread-5448::DEBUG::2012-03-29 11:57:47,183::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.13080edc-77ea-11e1-b6a4-525400c49d2a', Clearing records.
Thread-5448::ERROR::2012-03-29 11:57:47,185::task::853::TaskManager.Task::(_setError) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::Unexpected error
Traceback (most recent call last):
File "/usr/share/vdsm/storage/task.py", line 861, in _run
return fn(*args, **kargs)
File "/usr/share/vdsm/logUtils.py", line 38, in wrapper
res = f(*args, **kwargs)
File "/usr/share/vdsm/storage/hsm.py", line 813, in connectStoragePool
return self._connectStoragePool(spUUID, hostID, scsiKey, msdUUID, masterVersion, options)
File "/usr/share/vdsm/storage/hsm.py", line 855, in _connectStoragePool
res = pool.connect(hostID, scsiKey, msdUUID, masterVersion)
File "/usr/share/vdsm/storage/sp.py", line 641, in connect
self.__rebuild(msdUUID=msdUUID, masterVersion=masterVersion)
File "/usr/share/vdsm/storage/sp.py", line 1107, in __rebuild
self.masterDomain = self.getMasterDomain(msdUUID=msdUUID, masterVersion=masterVersion)
File "/usr/share/vdsm/storage/sp.py", line 1442, in getMasterDomain
raise se.StoragePoolMasterNotFound(self.spUUID, msdUUID)
StoragePoolMasterNotFound: Cannot find master domain: 'spUUID=13080edc-77ea-11e1-b6a4-525400c49d2a, msdUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48'
Thread-5448::DEBUG::2012-03-29 11:57:47,188::task::872::TaskManager.Task::(_run) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::Task._run: 838b7ca3-9f79-4c87-a2f0-12cad48cc127 ('13080edc-77ea-11e1-b6a4-525400c49d2a', 1, '13080edc-77ea-11e1-b6a4-525400c49d2a', '8ed25a57-f53a-4cf0-bb92-781f3ce36a48', 1) {} failed - stopping task
Thread-5448::DEBUG::2012-03-29 11:57:47,190::task::1199::TaskManager.Task::(stop) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::stopping in state preparing (force False)
Thread-5448::DEBUG::2012-03-29 11:57:47,192::task::978::TaskManager.Task::(_decref) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::ref 1 aborting True
Thread-5448::INFO::2012-03-29 11:57:47,193::task::1157::TaskManager.Task::(prepare) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::aborting: Task is aborted: 'Cannot find master domain' - code 304
Thread-5448::DEBUG::2012-03-29 11:57:47,195::task::1162::TaskManager.Task::(prepare) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::Prepare: aborted: Cannot find master domain
Thread-5448::DEBUG::2012-03-29 11:57:47,197::task::978::TaskManager.Task::(_decref) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::ref 0 aborting True
Thread-5448::DEBUG::2012-03-29 11:57:47,198::task::913::TaskManager.Task::(_doAbort) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::Task._doAbort: force False
Thread-5448::DEBUG::2012-03-29 11:57:47,200::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-5448::DEBUG::2012-03-29 11:57:47,201::task::588::TaskManager.Task::(_updateState) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::moving from state preparing -> state aborting
Thread-5448::DEBUG::2012-03-29 11:57:47,203::task::537::TaskManager.Task::(__state_aborting) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::_aborting: recover policy none
Thread-5448::DEBUG::2012-03-29 11:57:47,205::task::588::TaskManager.Task::(_updateState) Task=`838b7ca3-9f79-4c87-a2f0-12cad48cc127`::moving from state aborting -> state failed
Thread-5448::DEBUG::2012-03-29 11:57:47,206::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-5448::DEBUG::2012-03-29 11:57:47,208::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-5448::ERROR::2012-03-29 11:57:47,209::dispatcher::89::Storage.Dispatcher.Protect::(run) {'status': {'message': "Cannot find master domain: 'spUUID=13080edc-77ea-11e1-b6a4-525400c49d2a, msdUUID=8ed25a57-f53a-4cf0-bb92-781f3ce36a48'", 'code': 304}}
Thread-5453::DEBUG::2012-03-29 11:57:48,736::task::588::TaskManager.Task::(_updateState) Task=`b801beea-93db-44e7-ba71-5d1eca7eecae`::moving from state init -> state preparing
Thread-5453::INFO::2012-03-29 11:57:48,739::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)
Thread-5453::INFO::2012-03-29 11:57:48,740::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
Thread-5453::DEBUG::2012-03-29 11:57:48,742::task::1172::TaskManager.Task::(prepare) Task=`b801beea-93db-44e7-ba71-5d1eca7eecae`::finished: {}
Thread-5453::DEBUG::2012-03-29 11:57:48,743::task::588::TaskManager.Task::(_updateState) Task=`b801beea-93db-44e7-ba71-5d1eca7eecae`::moving from state preparing -> state finished
Thread-5453::DEBUG::2012-03-29 11:57:48,745::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-5453::DEBUG::2012-03-29 11:57:48,746::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-5453::DEBUG::2012-03-29 11:57:48,748::task::978::TaskManager.Task::(_decref) Task=`b801beea-93db-44e7-ba71-5d1eca7eecae`::ref 0 aborting False
Regards, rene
Von: users-bounces at ovirt.org<mailto:users-bounces at ovirt.org> [mailto:users-bounces at ovirt.org] Im Auftrag von Rene Rosenberger
Gesendet: Donnerstag, 29. März 2012 11:47
An: rvaknin at redhat.com<mailto:rvaknin at redhat.com>; users at ovirt.org<mailto:users at ovirt.org>
Betreff: Re: [Users] storage domain reactivate not working
Hi,
i did:
[root at KVM-DMZ-04 vdsm]# iscsiadm -m node -T iqn.2004-04.com.qnap:ts-419uplus:iscsi.dmznas01.c2b74d -u
Logging out of session [sid: 2, target: iqn.2004-04.com.qnap:ts-419uplus:iscsi.dmznas01.c2b74d, portal: 192.168.xxx.xxx,3260]
Logout of [sid: 2, target: iqn.2004-04.com.qnap:ts-419uplus:iscsi.dmznas01.c2b74d, portal: 192.168.xxx.xxx,3260] successful.
[root at KVM-DMZ-04 vdsm]# iscsiadm -m node -T iqn.2004-04.com.qnap:ts-419uplus:iscsi.dmznas01.c2b74d -l
Logging in to [iface: default, target: iqn.2004-04.com.qnap:ts-419uplus:iscsi.dmznas01.c2b74d, portal: 192.168.xxx.xxx,3260] (multiple)
Login to [iface: default, target: iqn.2004-04.com.qnap:ts-419uplus:iscsi.dmznas01.c2b74d, portal: 192.168.xxx.xxx,3260] successful.
But the data center is locked in webinterface. System -> default -> storage -> DMZ-NAS-01 -> Data Center = locked
Regards, rene
Von: Rami Vaknin [mailto:rvaknin at redhat.com]
Gesendet: Donnerstag, 29. März 2012 11:32
An: Rene Rosenberger; users at ovirt.org<mailto:users at ovirt.org>
Betreff: Re: [Users] storage domain reactivate not working
On 03/29/2012 11:28 AM, Rene Rosenberger wrote:
Hi,
i have rebootet my iscsi device without mainenance mode. Now it is inactive. When I want to reactivate it again it fails. What can I do?
Depends why it fails, vdsm log can help.
You can check whether or not you're connected from the hosts to the iscsi target or reconnect using:
iscsiadm -m discoverydb --discover -t st -p your_iscsi_server_fqdn
iscsiadm -m node -T your_target_name -l
Than try to activate it.
Regards, rene
_______________________________________________
Users mailing list
Users at ovirt.org<mailto:Users at ovirt.org>
http://lists.ovirt.org/mailman/listinfo/users
--
Thanks,
Rami Vaknin, QE @ Red Hat, TLV, IL.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20120330/c231eb6c/attachment.html>
More information about the Users
mailing list