MainThread::INFO::2012-10-15 09:03:16,107::vdsm::71::vds::(run) I am the actual vdsm 4.9-0 MainThread::DEBUG::2012-10-15 09:03:18,752::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace 'Storage' MainThread::DEBUG::2012-10-15 09:03:18,755::threadPool::45::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 MainThread::DEBUG::2012-10-15 09:03:19,005::multipath::85::Storage.Misc.excCmd::(isEnabled) '/usr/bin/sudo -n /bin/cat /etc/multipath.conf' (cwd None) MainThread::DEBUG::2012-10-15 09:03:19,215::multipath::85::Storage.Misc.excCmd::(isEnabled) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:19,217::multipath::109::Storage.Multipath::(isEnabled) multipath Defaulting to False MainThread::DEBUG::2012-10-15 09:03:19,218::misc::487::Storage.Misc::(rotateFiles) dir: /etc, prefixName: multipath.conf, versions: 5 MainThread::DEBUG::2012-10-15 09:03:19,221::misc::508::Storage.Misc::(rotateFiles) versions found: [0] MainThread::DEBUG::2012-10-15 09:03:19,222::multipath::118::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /bin/cp /etc/multipath.conf /etc/multipath.conf.1' (cwd None) MainThread::DEBUG::2012-10-15 09:03:19,322::multipath::118::Storage.Misc.excCmd::(setupMultipath) FAILED: = 'sudo: unable to mkdir /var/db/sudo/vdsm: Read-only file system\nsudo: sorry, a password is required to run sudo\n'; = 1 MainThread::DEBUG::2012-10-15 09:03:19,327::multipath::118::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /usr/sbin/persist /etc/multipath.conf.1' (cwd None) MainThread::DEBUG::2012-10-15 09:03:19,409::multipath::118::Storage.Misc.excCmd::(setupMultipath) FAILED: = 'sudo: unable to mkdir /var/db/sudo/vdsm: Read-only file system\nsudo: sorry, a password is required to run sudo\n'; = 1 MainThread::DEBUG::2012-10-15 09:03:19,414::multipath::123::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /bin/cp /tmp/tmpg2h7yk /etc/multipath.conf' (cwd None) MainThread::DEBUG::2012-10-15 09:03:19,501::multipath::123::Storage.Misc.excCmd::(setupMultipath) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:19,504::multipath::128::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /usr/sbin/persist /etc/multipath.conf' (cwd None) MainThread::DEBUG::2012-10-15 09:03:19,600::multipath::128::Storage.Misc.excCmd::(setupMultipath) FAILED: = 'sudo: unable to mkdir /var/db/sudo/vdsm: Read-only file system\nsudo: sorry, a password is required to run sudo\n'; = 1 MainThread::DEBUG::2012-10-15 09:03:19,604::multipath::131::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None) MainThread::DEBUG::2012-10-15 09:03:19,760::multipath::131::Storage.Misc.excCmd::(setupMultipath) FAILED: = ''; = 1 MainThread::DEBUG::2012-10-15 09:03:19,763::multipath::134::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /sbin/service multipathd restart' (cwd None) MainThread::DEBUG::2012-10-15 09:03:21,201::multipath::134::Storage.Misc.excCmd::(setupMultipath) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:21,205::hsm::248::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) MainThread::DEBUG::2012-10-15 09:03:21,497::hsm::248::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:21,500::lvm::319::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex MainThread::DEBUG::2012-10-15 09:03:21,511::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) MainThread::DEBUG::2012-10-15 09:03:21,915::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:21,919::lvm::342::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex MainThread::DEBUG::2012-10-15 09:03:21,921::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex MainThread::DEBUG::2012-10-15 09:03:21,923::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) MainThread::DEBUG::2012-10-15 09:03:22,324::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:22,332::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex MainThread::DEBUG::2012-10-15 09:03:22,335::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) MainThread::INFO::2012-10-15 09:03:28,247::vdsm::71::vds::(run) I am the actual vdsm 4.9-0 MainThread::DEBUG::2012-10-15 09:03:29,560::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace 'Storage' MainThread::DEBUG::2012-10-15 09:03:29,566::threadPool::45::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 MainThread::DEBUG::2012-10-15 09:03:29,759::multipath::85::Storage.Misc.excCmd::(isEnabled) '/usr/bin/sudo -n /bin/cat /etc/multipath.conf' (cwd None) MainThread::DEBUG::2012-10-15 09:03:29,846::multipath::85::Storage.Misc.excCmd::(isEnabled) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:29,848::multipath::101::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving MainThread::DEBUG::2012-10-15 09:03:29,850::hsm::248::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) MainThread::DEBUG::2012-10-15 09:03:30,129::hsm::248::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:30,132::lvm::319::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex MainThread::DEBUG::2012-10-15 09:03:30,143::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) MainThread::DEBUG::2012-10-15 09:03:30,513::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:30,516::lvm::342::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex MainThread::DEBUG::2012-10-15 09:03:30,518::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex MainThread::DEBUG::2012-10-15 09:03:30,521::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) MainThread::DEBUG::2012-10-15 09:03:30,887::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:30,896::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex MainThread::DEBUG::2012-10-15 09:03:30,899::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) MainThread::DEBUG::2012-10-15 09:03:31,260::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-11::DEBUG::2012-10-15 09:03:31,283::misc::1017::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) MainThread::INFO::2012-10-15 09:03:31,291::dispatcher::121::Storage.Dispatcher::(__init__) Starting StorageDispatcher... Thread-11::DEBUG::2012-10-15 09:03:31,293::misc::1019::SamplingMethod::(__call__) Got in to sampling method Thread-11::DEBUG::2012-10-15 09:03:31,299::misc::1017::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) Thread-11::DEBUG::2012-10-15 09:03:31,302::misc::1019::SamplingMethod::(__call__) Got in to sampling method Thread-11::DEBUG::2012-10-15 09:03:31,305::iscsi::389::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) MainThread::DEBUG::2012-10-15 09:03:31,347::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) Thread-11::DEBUG::2012-10-15 09:03:31,393::iscsi::389::Storage.Misc.excCmd::(rescan) FAILED: = 'iscsiadm: No session found.\n'; = 21 Thread-11::DEBUG::2012-10-15 09:03:31,397::misc::1027::SamplingMethod::(__call__) Returning last result Thread-11::DEBUG::2012-10-15 09:03:31,399::supervdsm::83::SuperVdsmProxy::(_killSupervdsm) Could not kill old Super Vdsm [Errno 2] No such file or directory: '/var/run/vdsm/svdsm.pid' Thread-11::DEBUG::2012-10-15 09:03:31,402::supervdsm::71::SuperVdsmProxy::(_launchSupervdsm) Launching Super Vdsm Thread-11::DEBUG::2012-10-15 09:03:31,404::supervdsm::74::Storage.Misc.excCmd::(_launchSupervdsm) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.pyc dd88f67a-a444-4a34-829c-1411c7619974 4391' (cwd None) MainThread::DEBUG::2012-10-15 09:03:31,494::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 MainThread::DEBUG::2012-10-15 09:03:32,344::supervdsmServer::170::SuperVdsm.Server::(main) Making sure I'm root MainThread::DEBUG::2012-10-15 09:03:32,351::supervdsmServer::174::SuperVdsm.Server::(main) Parsing cmd args MainThread::DEBUG::2012-10-15 09:03:32,352::supervdsmServer::177::SuperVdsm.Server::(main) Creating PID file MainThread::DEBUG::2012-10-15 09:03:32,353::supervdsmServer::181::SuperVdsm.Server::(main) Cleaning old socket MainThread::DEBUG::2012-10-15 09:03:32,355::supervdsmServer::185::SuperVdsm.Server::(main) Setting up keep alive thread MainThread::DEBUG::2012-10-15 09:03:32,358::supervdsmServer::190::SuperVdsm.Server::(main) Creating remote object manager MainThread::DEBUG::2012-10-15 09:03:32,363::supervdsmServer::201::SuperVdsm.Server::(main) Started serving super vdsm object Thread-11::DEBUG::2012-10-15 09:03:33,442::supervdsm::92::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm Thread-11::DEBUG::2012-10-15 09:03:33,468::supervdsm::64::SuperVdsmProxy::(__init__) Connected to Super Vdsm Thread-13::DEBUG::2012-10-15 09:03:34,022::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVdsCapabilities with () {} Thread-11::DEBUG::2012-10-15 09:03:34,874::multipath::71::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) Thread-11::DEBUG::2012-10-15 09:03:34,992::multipath::71::Storage.Misc.excCmd::(rescan) SUCCESS: = ''; = 0 Thread-11::DEBUG::2012-10-15 09:03:34,996::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-11::DEBUG::2012-10-15 09:03:34,997::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-11::DEBUG::2012-10-15 09:03:34,999::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-11::DEBUG::2012-10-15 09:03:35,001::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-11::DEBUG::2012-10-15 09:03:35,002::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-11::DEBUG::2012-10-15 09:03:35,004::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-11::DEBUG::2012-10-15 09:03:35,005::misc::1027::SamplingMethod::(__call__) Returning last result Thread-11::DEBUG::2012-10-15 09:03:35,007::hsm::272::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' Thread-11::DEBUG::2012-10-15 09:03:35,043::hsm::304::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] Thread-11::DEBUG::2012-10-15 09:03:35,045::hsm::305::Storage.HSM::(__cleanStorageRepository) Mount list: ['/rhev/data-center'] Thread-11::DEBUG::2012-10-15 09:03:35,046::hsm::307::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers Thread-11::DEBUG::2012-10-15 09:03:35,047::hsm::350::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' Thread-13::DEBUG::2012-10-15 09:03:35,571::utils::595::Storage.Misc.excCmd::(execCmd) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" qemu-kvm' (cwd None) Thread-13::DEBUG::2012-10-15 09:03:35,793::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-13::DEBUG::2012-10-15 09:03:35,796::utils::595::Storage.Misc.excCmd::(execCmd) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" qemu-img' (cwd None) Thread-13::DEBUG::2012-10-15 09:03:35,938::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-13::DEBUG::2012-10-15 09:03:35,941::utils::595::Storage.Misc.excCmd::(execCmd) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" vdsm' (cwd None) Thread-13::DEBUG::2012-10-15 09:03:36,078::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-13::DEBUG::2012-10-15 09:03:36,081::utils::595::Storage.Misc.excCmd::(execCmd) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" spice-server' (cwd None) Thread-13::DEBUG::2012-10-15 09:03:36,221::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-13::DEBUG::2012-10-15 09:03:36,224::utils::595::Storage.Misc.excCmd::(execCmd) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" libvirt' (cwd None) Thread-13::DEBUG::2012-10-15 09:03:36,392::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-13::DEBUG::2012-10-15 09:03:37,446::clientIF::81::vds::(wrapper) return getVdsCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:f59cc12c7d7'}], 'FC': []}, 'packages2': {'kernel': {'release': '4.fc16.x86_64', 'buildtime': 1332266740.0, 'version': '3.3.0'}, 'spice-server': {'release': '1.fc16', 'buildtime': '1327339129', 'version': '0.10.1'}, 'vdsm': {'release': '0.fc16', 'buildtime': '1328473568', 'version': '4.9.3.3'}, 'qemu-kvm': {'release': '4.fc16', 'buildtime': '1327954752', 'version': '0.15.1'}, 'libvirt': {'release': '5.fc16', 'buildtime': '1330876988', 'version': '0.9.6'}, 'qemu-img': {'release': '4.fc16', 'buildtime': '1327954752', 'version': '0.15.1'}}, 'cpuModel': 'AMD Opteron(TM) Processor 6212', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'VLAN_1': {'addr': '', 'cfg': {'DELAY': '0', 'NM_CONTROLLED': 'no', 'STP': 'no', 'DEVICE': 'VLAN_1', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ports': ['bond4.1'], 'netmask': '', 'stp': 'off', 'gateway': '0.0.0.0'}, 'VLAN_250': {'addr': '', 'cfg': {'DELAY': '0', 'NM_CONTROLLED': 'no', 'STP': 'no', 'DEVICE': 'VLAN_250', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ports': ['bond4.250'], 'netmask': '', 'stp': 'off', 'gateway': '0.0.0.0'}, 'ovirtmgmt': {'addr': '172.16.101.102', 'cfg': {'IPV6FORWARDING': 'no', 'IPV6INIT': 'no', 'IPADDR': '172.16.101.102', 'GATEWAY': '172.16.101.1', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', 'BOOTPROTO': 'static', 'DEVICE': 'ovirtmgmt', 'PEERNTP': 'yes', 'IPV6_AUTOCONF': 'no', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ports': ['eth0'], 'netmask': '255.255.255.0', 'stp': 'off', 'gateway': '172.16.101.1'}, 'VLAN_200': {'addr': '', 'cfg': {'DELAY': '0', 'NM_CONTROLLED': 'no', 'STP': 'no', 'DEVICE': 'VLAN_200', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ports': ['bond4.200'], 'netmask': '', 'stp': 'off', 'gateway': '0.0.0.0'}, 'VLAN_241': {'addr': '', 'cfg': {'DELAY': '0', 'NM_CONTROLLED': 'no', 'STP': 'no', 'DEVICE': 'VLAN_241', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ports': ['bond4.241'], 'netmask': '', 'stp': 'off', 'gateway': '0.0.0.0'}, 'VLAN_242': {'addr': '', 'cfg': {'DELAY': '0', 'NM_CONTROLLED': 'no', 'STP': 'no', 'DEVICE': 'VLAN_242', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ports': ['bond4.242'], 'netmask': '', 'stp': 'off', 'gateway': '0.0.0.0'}, 'iscsi_vl804': {'addr': '172.16.104.102', 'cfg': {'IPADDR': '172.16.104.102', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', 'STP': 'no', 'DEVICE': 'iscsi_vl804', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ports': ['eth3'], 'netmask': '255.255.255.0', 'stp': 'off', 'gateway': '0.0.0.0'}, 'iscsi_vl803': {'addr': '172.16.103.102', 'cfg': {'IPADDR': '172.16.103.102', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', 'STP': 'no', 'DEVICE': 'iscsi_vl803', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ports': ['eth2'], 'netmask': '255.255.255.0', 'stp': 'off', 'gateway': '0.0.0.0'}, 'iscsi_vl802': {'addr': '172.16.102.102', 'cfg': {'IPADDR': '172.16.102.102', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', 'STP': 'no', 'DEVICE': 'iscsi_vl802', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ports': ['eth1'], 'netmask': '255.255.255.0', 'stp': 'off', 'gateway': '0.0.0.0'}, 'VLAN_90': {'addr': '', 'cfg': {'DELAY': '0', 'NM_CONTROLLED': 'no', 'STP': 'no', 'DEVICE': 'VLAN_90', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ports': ['bond4.90'], 'netmask': '', 'stp': 'off', 'gateway': '0.0.0.0'}}, 'uuid': '4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10', 'nics': {'eth5': {'hwaddr': '00:10:18:DA:34:10', 'netmask': '', 'speed': 1000, 'addr': '', 'permhwaddr': '00:10:18:DA:34:12'}, 'eth4': {'hwaddr': '00:10:18:DA:34:10', 'netmask': '', 'speed': 1000, 'addr': '', 'permhwaddr': '00:10:18:DA:34:10'}, 'eth3': {'hwaddr': 'D0:67:E5:FE:0D:42', 'netmask': '', 'speed': 1000, 'addr': ''}, 'eth2': {'hwaddr': 'D0:67:E5:FE:0D:40', 'netmask': '', 'speed': 1000, 'addr': ''}, 'eth1': {'hwaddr': 'D0:67:E5:FE:0D:3E', 'netmask': '', 'speed': 1000, 'addr': ''}, 'eth0': {'hwaddr': 'D0:67:E5:FE:0D:3C', 'netmask': '', 'speed': 1000, 'addr': ''}}, 'software_revision': '0', 'management_ip': '', 'clusterLevels': ['3.0'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ht,syscall,nx,mmxext,fxsr_opt,pdpe1gb,rdtscp,lm,constant_tsc,rep_good,nopl,nonstop_tsc,extd_apicid,amd_dcm,aperfmperf,pni,pclmulqdq,monitor,ssse3,cx16,sse4_1,sse4_2,popcnt,aes,xsave,avx,lahf_lm,cmp_legacy,svm,extapic,cr8_legacy,abm,sse4a,misalignsse,3dnowprefetch,osvw,ibs,xop,skinit,wdt,lwp,fma4,nodeid_msr,topoext,perfctr_core,arat,cpb,npt,lbrv,svm_lock,nrip_save,tsc_scale,vmcb_clean,flushbyasid,decodeassists,pausefilter,pfthreshold,model_486,model_pentium,model_pentium2,model_pentium3,model_pentiumpro,model_qemu32,model_coreduo,model_qemu64,model_core2duo,model_n270,model_Conroe,model_Penryn,model_Nehalem,model_Westmere,model_Opteron_G1,model_Opteron_G2,model_Opteron_G3', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:f59cc12c7d7', 'memSize': '128787', 'reservedMem': '321', 'bondings': {'bond4': {'hwaddr': '00:10:18:DA:34:10', 'cfg': {'DEVICE': 'bond4', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'ONBOOT': 'yes', 'BONDING_OPTS': 'mode=4'}, 'netmask': '', 'addr': '', 'slaves': ['eth4', 'eth5']}, 'bond0': {'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'netmask': '', 'addr': '', 'slaves': []}, 'bond1': {'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'netmask': '', 'addr': '', 'slaves': []}, 'bond2': {'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'netmask': '', 'addr': '', 'slaves': []}, 'bond3': {'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'netmask': '', 'addr': '', 'slaves': []}}, 'software_version': '4.9', 'cpuSpeed': '2600.239', 'cpuSockets': '2', 'vlans': {'bond4.250': {'netmask': '', 'iface': 'bond4', 'addr': ''}, 'bond4.241': {'netmask': '', 'iface': 'bond4', 'addr': ''}, 'bond4.242': {'netmask': '', 'iface': 'bond4', 'addr': ''}, 'bond4.200': {'netmask': '', 'iface': 'bond4', 'addr': ''}, 'bond4.1': {'netmask': '', 'iface': 'bond4', 'addr': ''}, 'bond4.90': {'netmask': '', 'iface': 'bond4', 'addr': ''}}, 'cpuCores': '16', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'version_name': 'Snow Man', 'emulatedMachines': [u'pc-0.14', u'pc', u'fedora-13', u'pc-0.13', u'pc-0.12', u'pc-0.11', u'pc-0.10', u'isapc', u'pc-0.14', u'pc', u'fedora-13', u'pc-0.13', u'pc-0.12', u'pc-0.11', u'pc-0.10', u'isapc'], 'operatingSystem': {'release': '1', 'version': '16', 'name': 'oVirt Node'}}} Thread-15::DEBUG::2012-10-15 09:03:37,616::clientIF::261::Storage.Dispatcher.Protect::(wrapper) [172.16.101.90] Thread-15::DEBUG::2012-10-15 09:03:37,619::task::588::TaskManager.Task::(_updateState) Task=`b6e2cc35-75c9-41aa-8b7c-d2679dbf7ef5`::moving from state init -> state preparing Thread-15::INFO::2012-10-15 09:03:37,621::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', conList=[{'connection': '172.16.101.10', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '1', 'user': '', 'password': '******', 'id': '49b4ce2c-9ae2-4388-af87-52986bf68927', 'port': '3260'}, {'connection': '172.16.102.11', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '2', 'user': '', 'password': '******', 'id': '508d3596-3e38-404b-94fa-42eafd2e6966', 'port': '3260'}, {'connection': '172.16.101.11', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '2', 'user': '', 'password': '******', 'id': 'c5955f21-17a9-4bcf-a3f9-2d451c400cd9', 'port': '3260'}, {'connection': '172.16.103.11', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '2', 'user': '', 'password': '******', 'id': 'a849b8a7-bdd2-43e5-9156-8b8050285ec5', 'port': '3260'}, {'connection': '172.16.103.10', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '1', 'user': '', 'password': '******', 'id': '697c5212-1ea6-4a34-b77c-a6c6a5316864', 'port': '3260'}, {'connection': '172.16.104.10', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '1', 'user': '', 'password': '******', 'id': '8c3c3390-625f-47b5-9d8f-c20a251973ae', 'port': '3260'}, {'connection': '172.16.104.11', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '2', 'user': '', 'password': '******', 'id': '26c4463e-48e0-4a10-951f-b03d5d918019', 'port': '3260'}, {'connection': '172.16.102.10', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '1', 'user': '', 'password': '******', 'id': 'd761c624-ff54-43aa-bfca-fcf47e737a78', 'port': '3260'}], options=None) Thread-15::INFO::2012-10-15 09:03:37,624::storage_connection::188::Storage.ServerConnection::(validate) Request to validate ISCSI storage server Thread-15::INFO::2012-10-15 09:03:37,626::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '49b4ce2c-9ae2-4388-af87-52986bf68927'}, {'status': 0, 'id': '508d3596-3e38-404b-94fa-42eafd2e6966'}, {'status': 0, 'id': 'c5955f21-17a9-4bcf-a3f9-2d451c400cd9'}, {'status': 0, 'id': 'a849b8a7-bdd2-43e5-9156-8b8050285ec5'}, {'status': 0, 'id': '697c5212-1ea6-4a34-b77c-a6c6a5316864'}, {'status': 0, 'id': '8c3c3390-625f-47b5-9d8f-c20a251973ae'}, {'status': 0, 'id': '26c4463e-48e0-4a10-951f-b03d5d918019'}, {'status': 0, 'id': 'd761c624-ff54-43aa-bfca-fcf47e737a78'}]} Thread-15::DEBUG::2012-10-15 09:03:37,627::task::1174::TaskManager.Task::(prepare) Task=`b6e2cc35-75c9-41aa-8b7c-d2679dbf7ef5`::finished: {'statuslist': [{'status': 0, 'id': '49b4ce2c-9ae2-4388-af87-52986bf68927'}, {'status': 0, 'id': '508d3596-3e38-404b-94fa-42eafd2e6966'}, {'status': 0, 'id': 'c5955f21-17a9-4bcf-a3f9-2d451c400cd9'}, {'status': 0, 'id': 'a849b8a7-bdd2-43e5-9156-8b8050285ec5'}, {'status': 0, 'id': '697c5212-1ea6-4a34-b77c-a6c6a5316864'}, {'status': 0, 'id': '8c3c3390-625f-47b5-9d8f-c20a251973ae'}, {'status': 0, 'id': '26c4463e-48e0-4a10-951f-b03d5d918019'}, {'status': 0, 'id': 'd761c624-ff54-43aa-bfca-fcf47e737a78'}]} Thread-15::DEBUG::2012-10-15 09:03:37,629::task::588::TaskManager.Task::(_updateState) Task=`b6e2cc35-75c9-41aa-8b7c-d2679dbf7ef5`::moving from state preparing -> state finished Thread-15::DEBUG::2012-10-15 09:03:37,630::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-15::DEBUG::2012-10-15 09:03:37,631::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-15::DEBUG::2012-10-15 09:03:37,632::task::980::TaskManager.Task::(_decref) Task=`b6e2cc35-75c9-41aa-8b7c-d2679dbf7ef5`::ref 0 aborting False Thread-16::DEBUG::2012-10-15 09:03:37,656::clientIF::261::Storage.Dispatcher.Protect::(wrapper) [172.16.101.90] Thread-16::DEBUG::2012-10-15 09:03:37,659::task::588::TaskManager.Task::(_updateState) Task=`dfde871d-6927-4ca1-aab0-7f003ea660c2`::moving from state init -> state preparing Thread-16::INFO::2012-10-15 09:03:37,660::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', conList=[{'connection': '172.16.101.95:/DE-SD-NFS-ISO', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '0232df92-be0d-4b2f-b715-e179cc17b40e', 'port': ''}], options=None) Thread-16::INFO::2012-10-15 09:03:37,662::storage_connection::188::Storage.ServerConnection::(validate) Request to validate NFS storage server Thread-16::DEBUG::2012-10-15 09:03:37,666::mount::111::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6 172.16.101.95:/DE-SD-NFS-ISO /tmp/tmpWwpf19' (cwd None) Thread-16::DEBUG::2012-10-15 09:03:38,915::mount::111::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount /tmp/tmpWwpf19' (cwd None) Thread-16::INFO::2012-10-15 09:03:39,597::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '0232df92-be0d-4b2f-b715-e179cc17b40e'}]} Thread-16::DEBUG::2012-10-15 09:03:39,600::task::1174::TaskManager.Task::(prepare) Task=`dfde871d-6927-4ca1-aab0-7f003ea660c2`::finished: {'statuslist': [{'status': 0, 'id': '0232df92-be0d-4b2f-b715-e179cc17b40e'}]} Thread-16::DEBUG::2012-10-15 09:03:39,601::task::588::TaskManager.Task::(_updateState) Task=`dfde871d-6927-4ca1-aab0-7f003ea660c2`::moving from state preparing -> state finished Thread-16::DEBUG::2012-10-15 09:03:39,603::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-16::DEBUG::2012-10-15 09:03:39,604::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-16::DEBUG::2012-10-15 09:03:39,605::task::980::TaskManager.Task::(_decref) Task=`dfde871d-6927-4ca1-aab0-7f003ea660c2`::ref 0 aborting False Thread-18::DEBUG::2012-10-15 09:03:39,633::clientIF::261::Storage.Dispatcher.Protect::(wrapper) [172.16.101.90] Thread-18::DEBUG::2012-10-15 09:03:39,636::task::588::TaskManager.Task::(_updateState) Task=`3674370b-4b12-440b-9798-0f16f49c1dcd`::moving from state init -> state preparing Thread-18::INFO::2012-10-15 09:03:39,637::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', conList=[{'connection': '172.16.101.95:/DE-SD-Export-NFS', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'a6c18efd-71c7-4224-ad9a-d344958e0075', 'port': ''}], options=None) Thread-18::INFO::2012-10-15 09:03:39,639::storage_connection::188::Storage.ServerConnection::(validate) Request to validate NFS storage server Thread-18::DEBUG::2012-10-15 09:03:39,642::mount::111::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6 172.16.101.95:/DE-SD-Export-NFS /tmp/tmpTXU1gr' (cwd None) Thread-18::DEBUG::2012-10-15 09:03:39,816::mount::111::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount /tmp/tmpTXU1gr' (cwd None) Thread-18::INFO::2012-10-15 09:03:40,172::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'a6c18efd-71c7-4224-ad9a-d344958e0075'}]} Thread-18::DEBUG::2012-10-15 09:03:40,175::task::1174::TaskManager.Task::(prepare) Task=`3674370b-4b12-440b-9798-0f16f49c1dcd`::finished: {'statuslist': [{'status': 0, 'id': 'a6c18efd-71c7-4224-ad9a-d344958e0075'}]} Thread-18::DEBUG::2012-10-15 09:03:40,176::task::588::TaskManager.Task::(_updateState) Task=`3674370b-4b12-440b-9798-0f16f49c1dcd`::moving from state preparing -> state finished Thread-18::DEBUG::2012-10-15 09:03:40,177::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-18::DEBUG::2012-10-15 09:03:40,179::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-18::DEBUG::2012-10-15 09:03:40,180::task::980::TaskManager.Task::(_decref) Task=`3674370b-4b12-440b-9798-0f16f49c1dcd`::ref 0 aborting False Thread-19::DEBUG::2012-10-15 09:03:40,216::clientIF::261::Storage.Dispatcher.Protect::(wrapper) [172.16.101.90] Thread-19::DEBUG::2012-10-15 09:03:40,218::task::588::TaskManager.Task::(_updateState) Task=`0af8f46d-4c7a-419c-a574-233670afb700`::moving from state init -> state preparing Thread-19::INFO::2012-10-15 09:03:40,220::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', conList=[{'connection': '172.16.101.10', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '1', 'user': '', 'password': '******', 'id': '49b4ce2c-9ae2-4388-af87-52986bf68927', 'port': '3260'}, {'connection': '172.16.102.11', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '2', 'user': '', 'password': '******', 'id': '508d3596-3e38-404b-94fa-42eafd2e6966', 'port': '3260'}, {'connection': '172.16.101.11', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '2', 'user': '', 'password': '******', 'id': 'c5955f21-17a9-4bcf-a3f9-2d451c400cd9', 'port': '3260'}, {'connection': '172.16.103.11', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '2', 'user': '', 'password': '******', 'id': 'a849b8a7-bdd2-43e5-9156-8b8050285ec5', 'port': '3260'}, {'connection': '172.16.103.10', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '1', 'user': '', 'password': '******', 'id': '697c5212-1ea6-4a34-b77c-a6c6a5316864', 'port': '3260'}, {'connection': '172.16.104.10', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '1', 'user': '', 'password': '******', 'id': '8c3c3390-625f-47b5-9d8f-c20a251973ae', 'port': '3260'}, {'connection': '172.16.104.11', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '2', 'user': '', 'password': '******', 'id': '26c4463e-48e0-4a10-951f-b03d5d918019', 'port': '3260'}, {'connection': '172.16.102.10', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a', 'portal': '1', 'user': '', 'password': '******', 'id': 'd761c624-ff54-43aa-bfca-fcf47e737a78', 'port': '3260'}], options=None) Thread-19::INFO::2012-10-15 09:03:40,222::storage_connection::146::Storage.ServerConnection::(connect) Request to connect ISCSI storage server Thread-19::DEBUG::2012-10-15 09:03:40,224::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -p 172.16.101.10:3260 --discover' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:40,526::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:40,530::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m node -p 172.16.101.10:3260 -o update -n node.startup -v manual' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:40,627::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:40,630::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a -l -p 172.16.101.10:3260' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:41,299::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:41,302::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -p 172.16.102.11:3260 --discover' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:41,614::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:41,621::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m node -p 172.16.102.11:3260 -o update -n node.startup -v manual' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:41,725::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:41,728::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a -l -p 172.16.102.11:3260' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:42,408::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:42,412::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -p 172.16.101.11:3260 --discover' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:42,732::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:42,736::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m node -p 172.16.101.11:3260 -o update -n node.startup -v manual' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:42,834::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:42,837::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a -l -p 172.16.101.11:3260' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:43,539::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:43,548::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -p 172.16.103.11:3260 --discover' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:43,858::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:43,861::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m node -p 172.16.103.11:3260 -o update -n node.startup -v manual' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:43,959::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:43,962::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a -l -p 172.16.103.11:3260' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:44,668::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:44,673::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -p 172.16.103.10:3260 --discover' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:44,992::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:44,995::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m node -p 172.16.103.10:3260 -o update -n node.startup -v manual' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:45,092::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:45,096::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a -l -p 172.16.103.10:3260' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:45,817::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:45,821::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -p 172.16.104.10:3260 --discover' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:46,159::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:46,162::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m node -p 172.16.104.10:3260 -o update -n node.startup -v manual' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:46,266::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:46,269::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a -l -p 172.16.104.10:3260' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:47,027::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:47,033::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -p 172.16.104.11:3260 --discover' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:47,369::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:47,373::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m node -p 172.16.104.11:3260 -o update -n node.startup -v manual' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:47,467::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:47,471::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a -l -p 172.16.104.11:3260' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:48,209::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:48,212::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -p 172.16.102.10:3260 --discover' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:48,520::iscsi::148::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:48,524::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) '/usr/bin/sudo -n /sbin/iscsiadm -m node -p 172.16.102.10:3260 -o update -n node.startup -v manual' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:48,618::iscsi::149::Storage.Misc.excCmd::(addiSCSIPortal) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:48,621::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3200i.6d4ae520008546a7000000004f8cbb6a -l -p 172.16.102.10:3260' (cwd None) Thread-19::DEBUG::2012-10-15 09:03:49,370::iscsi::254::Storage.Misc.excCmd::(addiSCSINode) SUCCESS: = ''; = 0 Thread-19::DEBUG::2012-10-15 09:03:49,374::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-19::DEBUG::2012-10-15 09:03:49,376::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-19::DEBUG::2012-10-15 09:03:49,378::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-19::DEBUG::2012-10-15 09:03:49,379::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-19::DEBUG::2012-10-15 09:03:49,381::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-19::DEBUG::2012-10-15 09:03:49,382::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-19::INFO::2012-10-15 09:03:49,384::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '49b4ce2c-9ae2-4388-af87-52986bf68927'}, {'status': 0, 'id': '508d3596-3e38-404b-94fa-42eafd2e6966'}, {'status': 0, 'id': 'c5955f21-17a9-4bcf-a3f9-2d451c400cd9'}, {'status': 0, 'id': 'a849b8a7-bdd2-43e5-9156-8b8050285ec5'}, {'status': 0, 'id': '697c5212-1ea6-4a34-b77c-a6c6a5316864'}, {'status': 0, 'id': '8c3c3390-625f-47b5-9d8f-c20a251973ae'}, {'status': 0, 'id': '26c4463e-48e0-4a10-951f-b03d5d918019'}, {'status': 0, 'id': 'd761c624-ff54-43aa-bfca-fcf47e737a78'}]} Thread-19::DEBUG::2012-10-15 09:03:49,386::task::1174::TaskManager.Task::(prepare) Task=`0af8f46d-4c7a-419c-a574-233670afb700`::finished: {'statuslist': [{'status': 0, 'id': '49b4ce2c-9ae2-4388-af87-52986bf68927'}, {'status': 0, 'id': '508d3596-3e38-404b-94fa-42eafd2e6966'}, {'status': 0, 'id': 'c5955f21-17a9-4bcf-a3f9-2d451c400cd9'}, {'status': 0, 'id': 'a849b8a7-bdd2-43e5-9156-8b8050285ec5'}, {'status': 0, 'id': '697c5212-1ea6-4a34-b77c-a6c6a5316864'}, {'status': 0, 'id': '8c3c3390-625f-47b5-9d8f-c20a251973ae'}, {'status': 0, 'id': '26c4463e-48e0-4a10-951f-b03d5d918019'}, {'status': 0, 'id': 'd761c624-ff54-43aa-bfca-fcf47e737a78'}]} Thread-19::DEBUG::2012-10-15 09:03:49,387::task::588::TaskManager.Task::(_updateState) Task=`0af8f46d-4c7a-419c-a574-233670afb700`::moving from state preparing -> state finished Thread-19::DEBUG::2012-10-15 09:03:49,389::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-19::DEBUG::2012-10-15 09:03:49,390::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-19::DEBUG::2012-10-15 09:03:49,391::task::980::TaskManager.Task::(_decref) Task=`0af8f46d-4c7a-419c-a574-233670afb700`::ref 0 aborting False Thread-20::DEBUG::2012-10-15 09:03:49,420::clientIF::261::Storage.Dispatcher.Protect::(wrapper) [172.16.101.90] Thread-20::DEBUG::2012-10-15 09:03:49,423::task::588::TaskManager.Task::(_updateState) Task=`86db04e5-9eb2-4f89-a760-50b1db785471`::moving from state init -> state preparing Thread-20::INFO::2012-10-15 09:03:49,425::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', conList=[{'connection': '172.16.101.95:/DE-SD-NFS-ISO', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '0232df92-be0d-4b2f-b715-e179cc17b40e', 'port': ''}], options=None) Thread-20::INFO::2012-10-15 09:03:49,426::storage_connection::146::Storage.ServerConnection::(connect) Request to connect NFS storage server Thread-20::DEBUG::2012-10-15 09:03:49,453::mount::111::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6 172.16.101.95:/DE-SD-NFS-ISO /rhev/data-center/mnt/172.16.101.95:_DE-SD-NFS-ISO' (cwd None) Thread-20::DEBUG::2012-10-15 09:03:49,639::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-20::DEBUG::2012-10-15 09:03:49,644::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-20::DEBUG::2012-10-15 09:03:49,647::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-20::DEBUG::2012-10-15 09:03:49,650::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-20::DEBUG::2012-10-15 09:03:49,653::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-20::DEBUG::2012-10-15 09:03:49,656::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-20::INFO::2012-10-15 09:03:49,659::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '0232df92-be0d-4b2f-b715-e179cc17b40e'}]} Thread-20::DEBUG::2012-10-15 09:03:49,661::task::1174::TaskManager.Task::(prepare) Task=`86db04e5-9eb2-4f89-a760-50b1db785471`::finished: {'statuslist': [{'status': 0, 'id': '0232df92-be0d-4b2f-b715-e179cc17b40e'}]} Thread-20::DEBUG::2012-10-15 09:03:49,663::task::588::TaskManager.Task::(_updateState) Task=`86db04e5-9eb2-4f89-a760-50b1db785471`::moving from state preparing -> state finished Thread-20::DEBUG::2012-10-15 09:03:49,665::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-20::DEBUG::2012-10-15 09:03:49,667::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-20::DEBUG::2012-10-15 09:03:49,670::task::980::TaskManager.Task::(_decref) Task=`86db04e5-9eb2-4f89-a760-50b1db785471`::ref 0 aborting False Thread-21::DEBUG::2012-10-15 09:03:49,700::clientIF::261::Storage.Dispatcher.Protect::(wrapper) [172.16.101.90] Thread-21::DEBUG::2012-10-15 09:03:49,702::task::588::TaskManager.Task::(_updateState) Task=`75cd1288-2970-4e58-bda5-16e612025063`::moving from state init -> state preparing Thread-21::INFO::2012-10-15 09:03:49,704::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', conList=[{'connection': '172.16.101.95:/DE-SD-Export-NFS', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'a6c18efd-71c7-4224-ad9a-d344958e0075', 'port': ''}], options=None) Thread-21::INFO::2012-10-15 09:03:49,705::storage_connection::146::Storage.ServerConnection::(connect) Request to connect NFS storage server Thread-21::DEBUG::2012-10-15 09:03:49,734::mount::111::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6 172.16.101.95:/DE-SD-Export-NFS /rhev/data-center/mnt/172.16.101.95:_DE-SD-Export-NFS' (cwd None) Thread-21::DEBUG::2012-10-15 09:03:49,884::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-21::DEBUG::2012-10-15 09:03:49,887::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-21::DEBUG::2012-10-15 09:03:49,888::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-21::DEBUG::2012-10-15 09:03:49,890::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-21::DEBUG::2012-10-15 09:03:49,892::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-21::DEBUG::2012-10-15 09:03:49,893::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-21::INFO::2012-10-15 09:03:49,895::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'a6c18efd-71c7-4224-ad9a-d344958e0075'}]} Thread-21::DEBUG::2012-10-15 09:03:49,896::task::1174::TaskManager.Task::(prepare) Task=`75cd1288-2970-4e58-bda5-16e612025063`::finished: {'statuslist': [{'status': 0, 'id': 'a6c18efd-71c7-4224-ad9a-d344958e0075'}]} Thread-21::DEBUG::2012-10-15 09:03:49,897::task::588::TaskManager.Task::(_updateState) Task=`75cd1288-2970-4e58-bda5-16e612025063`::moving from state preparing -> state finished Thread-21::DEBUG::2012-10-15 09:03:49,899::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-21::DEBUG::2012-10-15 09:03:49,900::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-21::DEBUG::2012-10-15 09:03:49,901::task::980::TaskManager.Task::(_decref) Task=`75cd1288-2970-4e58-bda5-16e612025063`::ref 0 aborting False Thread-22::DEBUG::2012-10-15 09:03:49,931::clientIF::261::Storage.Dispatcher.Protect::(wrapper) [172.16.101.90] Thread-22::DEBUG::2012-10-15 09:03:49,934::task::588::TaskManager.Task::(_updateState) Task=`d4b4f3a3-9fd9-4816-a1c3-d683befac8bb`::moving from state init -> state preparing Thread-22::INFO::2012-10-15 09:03:49,936::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', hostID=2, scsiKey='4e37e18a-ae32-41a3-a558-af2495d64da8', msdUUID='b19f2012-59ff-4ce8-80da-76005ce43be2', masterVersion=148, options=None) Thread-22::DEBUG::2012-10-15 09:03:49,938::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4e37e18a-ae32-41a3-a558-af2495d64da8`ReqID=`1d14ea43-b914-4592-97ae-191504bb61c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '747' at '_connectStoragePool' Thread-22::DEBUG::2012-10-15 09:03:49,940::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.4e37e18a-ae32-41a3-a558-af2495d64da8' for lock type 'exclusive' Thread-22::DEBUG::2012-10-15 09:03:49,942::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.4e37e18a-ae32-41a3-a558-af2495d64da8' is free. Now locking as 'exclusive' (1 active user) Thread-22::DEBUG::2012-10-15 09:03:49,943::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4e37e18a-ae32-41a3-a558-af2495d64da8`ReqID=`1d14ea43-b914-4592-97ae-191504bb61c3`::Granted request Thread-22::INFO::2012-10-15 09:03:49,947::sp::608::Storage.StoragePool::(connect) Connect host #2 to the storage pool 4e37e18a-ae32-41a3-a558-af2495d64da8 with master domain: b19f2012-59ff-4ce8-80da-76005ce43be2 (ver = 148) Thread-22::DEBUG::2012-10-15 09:03:49,949::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:49,950::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:49,952::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:49,954::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:49,955::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:49,957::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:49,958::misc::1017::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) Thread-22::DEBUG::2012-10-15 09:03:49,959::misc::1019::SamplingMethod::(__call__) Got in to sampling method Thread-22::DEBUG::2012-10-15 09:03:49,960::misc::1017::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) Thread-22::DEBUG::2012-10-15 09:03:49,962::misc::1019::SamplingMethod::(__call__) Got in to sampling method Thread-22::DEBUG::2012-10-15 09:03:49,963::iscsi::389::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:50,179::iscsi::389::Storage.Misc.excCmd::(rescan) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:50,182::misc::1027::SamplingMethod::(__call__) Returning last result Thread-22::DEBUG::2012-10-15 09:03:51,621::multipath::71::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:52,897::multipath::71::Storage.Misc.excCmd::(rescan) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:52,901::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:52,903::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:52,904::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:52,906::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:52,908::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:52,909::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:52,910::misc::1027::SamplingMethod::(__call__) Returning last result Thread-22::DEBUG::2012-10-15 09:03:52,912::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:52,925::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b19f2012-59ff-4ce8-80da-76005ce43be2' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:53,485::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:53,495::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:53,497::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with LvMetadataRW backend Thread-22::DEBUG::2012-10-15 09:03:53,500::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y b19f2012-59ff-4ce8-80da-76005ce43be2/metadata' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:54,207::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:54,211::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:54,212::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:54,214::blockSD::177::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/b19f2012-59ff-4ce8-80da-76005ce43be2/metadata count=1' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:54,259::blockSD::177::Storage.Misc.excCmd::(readlines) SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000842765 s, 2.4 MB/s\n'; = 0 Thread-22::DEBUG::2012-10-15 09:03:54,261::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000842765 s, 2.4 MB/s'], size: 2048 Thread-22::DEBUG::2012-10-15 09:03:54,263::persistentDict::216::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] Thread-22::WARNING::2012-10-15 09:03:54,264::persistentDict::238::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is Thread-22::DEBUG::2012-10-15 09:03:54,265::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with VGTagMetadataRW backend Thread-22::DEBUG::2012-10-15 09:03:54,268::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y b19f2012-59ff-4ce8-80da-76005ce43be2/leases' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:54,943::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:54,947::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:54,949::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:54,953::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y b19f2012-59ff-4ce8-80da-76005ce43be2/ids b19f2012-59ff-4ce8-80da-76005ce43be2/inbox b19f2012-59ff-4ce8-80da-76005ce43be2/outbox b19f2012-59ff-4ce8-80da-76005ce43be2/master' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:55,643::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:55,646::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:55,647::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:55,650::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:55,651::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:55,653::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:55,654::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:55,656::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:55,659::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b19f2012-59ff-4ce8-80da-76005ce43be2' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:56,081::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:56,089::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:56,092::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:36d4ae520008545ee00001e714fc736e8,uuid:IAEHA4-ZCg3-UeIP-mb2z-4XZY-xKFA-X4CTmx,pestart:0,pecount:13385,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'LOGBLKSIZE=512', u'LEASERETRIES=3', u'SDUUID=b19f2012-59ff-4ce8-80da-76005ce43be2', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'VGUUID=xApfsL-dzNy-0Cro-7Myd-xIWg-d27d-KrLIrm', u'DESCRIPTION=DE-VM-DATA', u'CLASS=Data', u'TYPE=ISCSI', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'ROLE=Master', u'MASTER_VERSION=148', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'POOL_SPM_LVER=9', u'POOL_SPM_ID=4', u'_SHA_CKSUM=652e395d4ed429010af692cadb62603d76152d67'] Thread-22::DEBUG::2012-10-15 09:03:56,095::lvm::319::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:56,098::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:56,555::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:56,558::lvm::342::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:56,562::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace 'b19f2012-59ff-4ce8-80da-76005ce43be2_imageNS' Thread-22::DEBUG::2012-10-15 09:03:56,564::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace 'b19f2012-59ff-4ce8-80da-76005ce43be2_volumeNS' Thread-22::DEBUG::2012-10-15 09:03:56,566::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace 'b19f2012-59ff-4ce8-80da-76005ce43be2_lvmActivationNS' Thread-22::DEBUG::2012-10-15 09:03:56,568::sp::1452::Storage.StoragePool::(getMasterDomain) Master domain b19f2012-59ff-4ce8-80da-76005ce43be2 verified, version 148 Thread-22::DEBUG::2012-10-15 09:03:56,569::misc::1017::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) Thread-22::DEBUG::2012-10-15 09:03:56,571::misc::1019::SamplingMethod::(__call__) Got in to sampling method Thread-22::DEBUG::2012-10-15 09:03:56,573::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:56,574::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:56,576::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:56,577::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:56,579::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:56,582::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free b19f2012-59ff-4ce8-80da-76005ce43be2' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:57,000::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:57,009::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:57,014::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'PV0=pv:36d4ae520008545ee00001e714fc736e8,uuid:IAEHA4-ZCg3-UeIP-mb2z-4XZY-xKFA-X4CTmx,pestart:0,pecount:13385,mapoffset:0', u'LOCKPOLICY=', u'VERSION=2', u'LOGBLKSIZE=512', u'LEASERETRIES=3', u'SDUUID=b19f2012-59ff-4ce8-80da-76005ce43be2', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'VGUUID=xApfsL-dzNy-0Cro-7Myd-xIWg-d27d-KrLIrm', u'DESCRIPTION=DE-VM-DATA', u'CLASS=Data', u'TYPE=ISCSI', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'ROLE=Master', u'MASTER_VERSION=148', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'POOL_SPM_LVER=9', u'POOL_SPM_ID=4', u'_SHA_CKSUM=652e395d4ed429010af692cadb62603d76152d67'] Thread-22::DEBUG::2012-10-15 09:03:57,017::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:57,021::lvm::287::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:57,456::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:57,465::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:57,467::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with LvMetadataRW backend Thread-22::DEBUG::2012-10-15 09:03:57,470::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:58,157::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:58,160::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:58,162::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:58,164::blockSD::177::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:58,207::blockSD::177::Storage.Misc.excCmd::(readlines) SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000762788 s, 2.7 MB/s\n'; = 0 Thread-22::DEBUG::2012-10-15 09:03:58,210::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000762788 s, 2.7 MB/s'], size: 2048 Thread-22::DEBUG::2012-10-15 09:03:58,211::persistentDict::216::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] Thread-22::WARNING::2012-10-15 09:03:58,212::persistentDict::238::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is Thread-22::DEBUG::2012-10-15 09:03:58,214::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with VGTagMetadataRW backend Thread-22::DEBUG::2012-10-15 09:03:58,217::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/leases' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:58,936::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:58,939::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:58,940::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:58,945::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/ids ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/inbox ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/outbox ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/master' (cwd None) Thread-22::DEBUG::2012-10-15 09:03:59,663::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:03:59,666::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:59,668::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:59,670::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:59,671::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:59,673::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:59,675::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:03:59,676::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:03:59,679::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-22::DEBUG::2012-10-15 09:04:00,119::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:04:00,128::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:04:00,130::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-22::DEBUG::2012-10-15 09:04:00,135::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS' Thread-22::DEBUG::2012-10-15 09:04:00,137::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS' Thread-22::DEBUG::2012-10-15 09:04:00,139::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS' Thread-23::DEBUG::2012-10-15 09:04:00,146::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-22::DEBUG::2012-10-15 09:04:00,147::sp::1482::Storage.StoragePool::(updateMonitoringThreads) sp `4e37e18a-ae32-41a3-a558-af2495d64da8` started monitoring domain `ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5` Thread-22::DEBUG::2012-10-15 09:04:00,169::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:04:00,174::lvm::287::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 17e82ced-d839-4b4d-9d81-5333ad777100' (cwd None) Thread-23::DEBUG::2012-10-15 09:04:00,594::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:04:00,706::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Volume group "17e82ced-d839-4b4d-9d81-5333ad777100" not found\n'; = 5 Thread-22::WARNING::2012-10-15 09:04:00,720::lvm::356::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "17e82ced-d839-4b4d-9d81-5333ad777100" not found'] Thread-22::DEBUG::2012-10-15 09:04:00,721::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:04:00,760::fileSD::98::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/172.16.101.95:_DE-SD-NFS-ISO/17e82ced-d839-4b4d-9d81-5333ad777100 Thread-22::DEBUG::2012-10-15 09:04:00,763::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with FileMetadataRW backend Thread-22::DEBUG::2012-10-15 09:04:00,772::persistentDict::216::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=DE-SD-NFS-ISO', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', 'REMOTE_PATH=172.16.101.95:/DE-SD-NFS-ISO', 'ROLE=Regular', 'SDUUID=17e82ced-d839-4b4d-9d81-5333ad777100', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=033275fbdc9b8ec8a25eadaae3e57660504315f6'] Thread-22::DEBUG::2012-10-15 09:04:00,780::fileSD::316::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-22::DEBUG::2012-10-15 09:04:00,783::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace '17e82ced-d839-4b4d-9d81-5333ad777100_imageNS' Thread-22::DEBUG::2012-10-15 09:04:00,784::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace '17e82ced-d839-4b4d-9d81-5333ad777100_volumeNS' Thread-22::DEBUG::2012-10-15 09:04:00,787::sp::1482::Storage.StoragePool::(updateMonitoringThreads) sp `4e37e18a-ae32-41a3-a558-af2495d64da8` started monitoring domain `17e82ced-d839-4b4d-9d81-5333ad777100` Thread-22::DEBUG::2012-10-15 09:04:00,790::sp::1482::Storage.StoragePool::(updateMonitoringThreads) sp `4e37e18a-ae32-41a3-a558-af2495d64da8` started monitoring domain `b19f2012-59ff-4ce8-80da-76005ce43be2` Thread-27::DEBUG::2012-10-15 09:04:00,806::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " b19f2012-59ff-4ce8-80da-76005ce43be2' (cwd None) Thread-22::DEBUG::2012-10-15 09:04:00,817::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:04:00,838::lvm::287::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae' (cwd None) Thread-27::DEBUG::2012-10-15 09:04:01,263::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-22::DEBUG::2012-10-15 09:04:01,340::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Volume group "5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae" not found\n'; = 5 Thread-22::WARNING::2012-10-15 09:04:01,354::lvm::356::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae" not found'] Thread-22::DEBUG::2012-10-15 09:04:01,356::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-22::DEBUG::2012-10-15 09:04:01,387::fileSD::98::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/172.16.101.95:_DE-SD-Export-NFS/5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae Thread-22::DEBUG::2012-10-15 09:04:01,389::persistentDict::175::Storage.PersistentDict::(__init__) Created a persistant dict with FileMetadataRW backend Thread-22::DEBUG::2012-10-15 09:04:01,395::persistentDict::216::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=DE-SD-Export-NFS', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', 'REMOTE_PATH=172.16.101.95:/DE-SD-Export-NFS', 'ROLE=Regular', 'SDUUID=5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=b7b16a5b8af8e978147737690d5d6ee89e194f06'] Thread-22::DEBUG::2012-10-15 09:04:01,402::fileSD::316::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-22::DEBUG::2012-10-15 09:04:01,404::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae_imageNS' Thread-22::DEBUG::2012-10-15 09:04:01,406::resourceManager::376::ResourceManager::(registerNamespace) Registering namespace '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae_volumeNS' Thread-22::DEBUG::2012-10-15 09:04:01,409::sp::1482::Storage.StoragePool::(updateMonitoringThreads) sp `4e37e18a-ae32-41a3-a558-af2495d64da8` started monitoring domain `5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae` Thread-22::DEBUG::2012-10-15 09:04:01,411::misc::1027::SamplingMethod::(__call__) Returning last result Thread-22::DEBUG::2012-10-15 09:04:01,440::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-22::DEBUG::2012-10-15 09:04:01,446::lvm::287::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 17e82ced-d839-4b4d-9d81-5333ad777100 5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae' (cwd None) Thread-22::DEBUG::2012-10-15 09:04:01,993::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Volume group "17e82ced-d839-4b4d-9d81-5333ad777100" not found\n Volume group "5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae" not found\n'; = 5 Thread-22::WARNING::2012-10-15 09:04:02,008::lvm::356::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [' 2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N|ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5|wz--n-|17998463107072|15251965739008|134217728|134099|113636|MDT_DESCRIPTION=DE-VM-SYSTEM,MDT_LOCKPOLICY=,MDT_VERSION=2,MDT_TYPE=ISCSI,MDT_PV0=pv:36d4ae520008545ee000003594fa9b441&44&uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr&44&pestart:0&44&pecount:134099&44&mapoffset:0,MDT_LOGBLKSIZE=512,MDT_VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N,MDT_SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5,MDT_LEASERETRIES=3,MDT_LOCKRENEWALINTERVALSEC=5,MDT_PHYBLKSIZE=512,MDT_CLASS=Data,RHAT_storage_domain,MDT_POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8,MDT_LEASETIMESEC=60,MDT_IOOPTIMEOUTSEC=10,MDT_POOL_DESCRIPTION=DE-KL-DC01,MDT_ROLE=Master,MDT_MASTER_VERSION=14,MDT_POOL_SPM_ID=1,MDT_POOL_SPM_LVER=1,MDT_POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active&44&17e82ced-d839-4b4d-9d81-5333ad777100:Active&44&b19f2012-59ff-4ce8-80da-76005ce43be2:Active&44&5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active,MDT__SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919|134598656|67274752'] [' Volume group "17e82ced-d839-4b4d-9d81-5333ad777100" not found', ' Volume group "5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae" not found'] Thread-22::DEBUG::2012-10-15 09:04:02,015::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-22::INFO::2012-10-15 09:04:02,028::sp::1052::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 to /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-22::INFO::2012-10-15 09:04:02,031::sp::1052::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/172.16.101.95:_DE-SD-NFS-ISO/17e82ced-d839-4b4d-9d81-5333ad777100 to /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100 Thread-22::INFO::2012-10-15 09:04:02,033::sp::1052::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/172.16.101.95:_DE-SD-Export-NFS/5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae to /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae Thread-22::INFO::2012-10-15 09:04:02,037::sp::1052::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/b19f2012-59ff-4ce8-80da-76005ce43be2 to /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/b19f2012-59ff-4ce8-80da-76005ce43be2 Thread-22::INFO::2012-10-15 09:04:02,039::sp::1052::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/b19f2012-59ff-4ce8-80da-76005ce43be2 to /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/mastersd Thread-22::DEBUG::2012-10-15 09:04:02,041::threadPool::45::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 Thread-22::DEBUG::2012-10-15 09:04:02,053::storage_mailbox::250::Storage.Misc.excCmd::(_initMailbox) 'dd if=/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=16' (cwd None) Thread-22::DEBUG::2012-10-15 09:04:02,110::storage_mailbox::250::Storage.Misc.excCmd::(_initMailbox) SUCCESS: = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00339824 s, 1.2 MB/s\n'; = 0 Thread-22::INFO::2012-10-15 09:04:02,112::storage_mailbox::340::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['dd', 'of=/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=16'] Thread-22::DEBUG::2012-10-15 09:04:02,115::storage_mailbox::344::Storage.Misc.excCmd::(_sendMail) 'dd of=/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=16' (cwd None) Thread-22::DEBUG::2012-10-15 09:04:02,169::storage_mailbox::344::Storage.Misc.excCmd::(_sendMail) SUCCESS: = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00437115 s, 937 kB/s\n'; = 0 Thread-22::DEBUG::2012-10-15 09:04:02,174::storage_mailbox::181::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 4e37e18a-ae32-41a3-a558-af2495d64da8 Thread-22::DEBUG::2012-10-15 09:04:02,177::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.4e37e18a-ae32-41a3-a558-af2495d64da8' Thread-22::DEBUG::2012-10-15 09:04:02,179::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.4e37e18a-ae32-41a3-a558-af2495d64da8' (0 active users) Thread-22::DEBUG::2012-10-15 09:04:02,180::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.4e37e18a-ae32-41a3-a558-af2495d64da8' is free, finding out if anyone is waiting for it. Thread-22::DEBUG::2012-10-15 09:04:02,181::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4e37e18a-ae32-41a3-a558-af2495d64da8', Clearing records. Thread-22::INFO::2012-10-15 09:04:02,183::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True Thread-22::DEBUG::2012-10-15 09:04:02,185::task::1174::TaskManager.Task::(prepare) Task=`d4b4f3a3-9fd9-4816-a1c3-d683befac8bb`::finished: True Thread-22::DEBUG::2012-10-15 09:04:02,186::task::588::TaskManager.Task::(_updateState) Task=`d4b4f3a3-9fd9-4816-a1c3-d683befac8bb`::moving from state preparing -> state finished Thread-22::DEBUG::2012-10-15 09:04:02,187::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-22::DEBUG::2012-10-15 09:04:02,188::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-22::DEBUG::2012-10-15 09:04:02,190::task::980::TaskManager.Task::(_decref) Task=`d4b4f3a3-9fd9-4816-a1c3-d683befac8bb`::ref 0 aborting False Thread-40::DEBUG::2012-10-15 09:04:06,277::task::588::TaskManager.Task::(_updateState) Task=`ab3fcd82-d837-48b1-8803-b2bf45886853`::moving from state init -> state preparing Thread-40::INFO::2012-10-15 09:04:06,279::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-40::INFO::2012-10-15 09:04:06,281::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00253295898438', 'lastCheck': 1350291840.619503, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00115418434143', 'lastCheck': 1350291841.287683, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.021744966507', 'lastCheck': 1350291840.847094, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.0043671131134', 'lastCheck': 1350291841.447755, 'code': 0, 'valid': True}} Thread-40::DEBUG::2012-10-15 09:04:06,282::task::1174::TaskManager.Task::(prepare) Task=`ab3fcd82-d837-48b1-8803-b2bf45886853`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00253295898438', 'lastCheck': 1350291840.619503, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00115418434143', 'lastCheck': 1350291841.287683, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.021744966507', 'lastCheck': 1350291840.847094, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.0043671131134', 'lastCheck': 1350291841.447755, 'code': 0, 'valid': True}} Thread-40::DEBUG::2012-10-15 09:04:06,284::task::588::TaskManager.Task::(_updateState) Task=`ab3fcd82-d837-48b1-8803-b2bf45886853`::moving from state preparing -> state finished Thread-40::DEBUG::2012-10-15 09:04:06,285::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-40::DEBUG::2012-10-15 09:04:06,286::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-40::DEBUG::2012-10-15 09:04:06,287::task::980::TaskManager.Task::(_decref) Task=`ab3fcd82-d837-48b1-8803-b2bf45886853`::ref 0 aborting False Thread-46::DEBUG::2012-10-15 09:04:16,438::task::588::TaskManager.Task::(_updateState) Task=`1c5e2151-11af-4791-8901-a5fae1c126b4`::moving from state init -> state preparing Thread-46::INFO::2012-10-15 09:04:16,440::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-46::INFO::2012-10-15 09:04:16,442::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00108408927917', 'lastCheck': 1350291850.641632, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00106000900269', 'lastCheck': 1350291851.30929, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00314116477966', 'lastCheck': 1350291850.874874, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00323486328125', 'lastCheck': 1350291851.475461, 'code': 0, 'valid': True}} Thread-46::DEBUG::2012-10-15 09:04:16,443::task::1174::TaskManager.Task::(prepare) Task=`1c5e2151-11af-4791-8901-a5fae1c126b4`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00108408927917', 'lastCheck': 1350291850.641632, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00106000900269', 'lastCheck': 1350291851.30929, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00314116477966', 'lastCheck': 1350291850.874874, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00323486328125', 'lastCheck': 1350291851.475461, 'code': 0, 'valid': True}} Thread-46::DEBUG::2012-10-15 09:04:16,445::task::588::TaskManager.Task::(_updateState) Task=`1c5e2151-11af-4791-8901-a5fae1c126b4`::moving from state preparing -> state finished Thread-46::DEBUG::2012-10-15 09:04:16,446::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-46::DEBUG::2012-10-15 09:04:16,447::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-46::DEBUG::2012-10-15 09:04:16,449::task::980::TaskManager.Task::(_decref) Task=`1c5e2151-11af-4791-8901-a5fae1c126b4`::ref 0 aborting False Thread-52::DEBUG::2012-10-15 09:04:26,600::task::588::TaskManager.Task::(_updateState) Task=`312fd00c-55de-4bad-b71b-cc5b866b474b`::moving from state init -> state preparing Thread-52::INFO::2012-10-15 09:04:26,601::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-52::INFO::2012-10-15 09:04:26,603::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00102806091309', 'lastCheck': 1350291860.662487, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000964879989624', 'lastCheck': 1350291861.330414, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00294709205627', 'lastCheck': 1350291860.90178, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00273895263672', 'lastCheck': 1350291861.502195, 'code': 0, 'valid': True}} Thread-52::DEBUG::2012-10-15 09:04:26,604::task::1174::TaskManager.Task::(prepare) Task=`312fd00c-55de-4bad-b71b-cc5b866b474b`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00102806091309', 'lastCheck': 1350291860.662487, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000964879989624', 'lastCheck': 1350291861.330414, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00294709205627', 'lastCheck': 1350291860.90178, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00273895263672', 'lastCheck': 1350291861.502195, 'code': 0, 'valid': True}} Thread-52::DEBUG::2012-10-15 09:04:26,606::task::588::TaskManager.Task::(_updateState) Task=`312fd00c-55de-4bad-b71b-cc5b866b474b`::moving from state preparing -> state finished Thread-52::DEBUG::2012-10-15 09:04:26,607::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-52::DEBUG::2012-10-15 09:04:26,609::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-52::DEBUG::2012-10-15 09:04:26,610::task::980::TaskManager.Task::(_decref) Task=`312fd00c-55de-4bad-b71b-cc5b866b474b`::ref 0 aborting False Thread-58::DEBUG::2012-10-15 09:04:36,768::task::588::TaskManager.Task::(_updateState) Task=`7b72b310-ffd4-44c5-a0f0-472d6ab4c6ac`::moving from state init -> state preparing Thread-58::INFO::2012-10-15 09:04:36,769::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-58::INFO::2012-10-15 09:04:36,771::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.000929832458496', 'lastCheck': 1350291870.685115, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000919103622437', 'lastCheck': 1350291871.351843, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00324511528015', 'lastCheck': 1350291870.928954, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00312495231628', 'lastCheck': 1350291871.529035, 'code': 0, 'valid': True}} Thread-58::DEBUG::2012-10-15 09:04:36,773::task::1174::TaskManager.Task::(prepare) Task=`7b72b310-ffd4-44c5-a0f0-472d6ab4c6ac`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.000929832458496', 'lastCheck': 1350291870.685115, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000919103622437', 'lastCheck': 1350291871.351843, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00324511528015', 'lastCheck': 1350291870.928954, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00312495231628', 'lastCheck': 1350291871.529035, 'code': 0, 'valid': True}} Thread-58::DEBUG::2012-10-15 09:04:36,774::task::588::TaskManager.Task::(_updateState) Task=`7b72b310-ffd4-44c5-a0f0-472d6ab4c6ac`::moving from state preparing -> state finished Thread-58::DEBUG::2012-10-15 09:04:36,775::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-58::DEBUG::2012-10-15 09:04:36,777::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-58::DEBUG::2012-10-15 09:04:36,778::task::980::TaskManager.Task::(_decref) Task=`7b72b310-ffd4-44c5-a0f0-472d6ab4c6ac`::ref 0 aborting False Thread-64::DEBUG::2012-10-15 09:04:46,937::task::588::TaskManager.Task::(_updateState) Task=`e5a416d1-f4bb-4bd9-9686-527e019eb524`::moving from state init -> state preparing Thread-64::INFO::2012-10-15 09:04:46,939::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-64::INFO::2012-10-15 09:04:46,940::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.0011100769043', 'lastCheck': 1350291880.706471, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00100588798523', 'lastCheck': 1350291881.37273, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00281405448914', 'lastCheck': 1350291880.95514, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00267887115479', 'lastCheck': 1350291881.555484, 'code': 0, 'valid': True}} Thread-64::DEBUG::2012-10-15 09:04:46,942::task::1174::TaskManager.Task::(prepare) Task=`e5a416d1-f4bb-4bd9-9686-527e019eb524`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.0011100769043', 'lastCheck': 1350291880.706471, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00100588798523', 'lastCheck': 1350291881.37273, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00281405448914', 'lastCheck': 1350291880.95514, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00267887115479', 'lastCheck': 1350291881.555484, 'code': 0, 'valid': True}} Thread-64::DEBUG::2012-10-15 09:04:46,944::task::588::TaskManager.Task::(_updateState) Task=`e5a416d1-f4bb-4bd9-9686-527e019eb524`::moving from state preparing -> state finished Thread-64::DEBUG::2012-10-15 09:04:46,945::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-64::DEBUG::2012-10-15 09:04:46,946::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-64::DEBUG::2012-10-15 09:04:46,948::task::980::TaskManager.Task::(_decref) Task=`e5a416d1-f4bb-4bd9-9686-527e019eb524`::ref 0 aborting False Thread-70::DEBUG::2012-10-15 09:04:57,097::task::588::TaskManager.Task::(_updateState) Task=`14e908e8-4364-4656-a8ea-84b69f31ef01`::moving from state init -> state preparing Thread-70::INFO::2012-10-15 09:04:57,099::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-70::INFO::2012-10-15 09:04:57,101::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00159001350403', 'lastCheck': 1350291890.731164, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000991106033325', 'lastCheck': 1350291891.393891, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00288105010986', 'lastCheck': 1350291890.98152, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00268697738647', 'lastCheck': 1350291891.581943, 'code': 0, 'valid': True}} Thread-70::DEBUG::2012-10-15 09:04:57,102::task::1174::TaskManager.Task::(prepare) Task=`14e908e8-4364-4656-a8ea-84b69f31ef01`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00159001350403', 'lastCheck': 1350291890.731164, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000991106033325', 'lastCheck': 1350291891.393891, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00288105010986', 'lastCheck': 1350291890.98152, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00268697738647', 'lastCheck': 1350291891.581943, 'code': 0, 'valid': True}} Thread-70::DEBUG::2012-10-15 09:04:57,104::task::588::TaskManager.Task::(_updateState) Task=`14e908e8-4364-4656-a8ea-84b69f31ef01`::moving from state preparing -> state finished Thread-70::DEBUG::2012-10-15 09:04:57,105::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-70::DEBUG::2012-10-15 09:04:57,106::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-70::DEBUG::2012-10-15 09:04:57,108::task::980::TaskManager.Task::(_decref) Task=`14e908e8-4364-4656-a8ea-84b69f31ef01`::ref 0 aborting False Thread-76::DEBUG::2012-10-15 09:05:07,263::task::588::TaskManager.Task::(_updateState) Task=`e9a24540-8fe5-4ba5-ab30-bf16a83a179b`::moving from state init -> state preparing Thread-76::INFO::2012-10-15 09:05:07,265::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-76::INFO::2012-10-15 09:05:07,267::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.0010039806366', 'lastCheck': 1350291900.752163, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000980138778687', 'lastCheck': 1350291901.415101, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00320291519165', 'lastCheck': 1350291901.007768, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00310015678406', 'lastCheck': 1350291901.608999, 'code': 0, 'valid': True}} Thread-76::DEBUG::2012-10-15 09:05:07,268::task::1174::TaskManager.Task::(prepare) Task=`e9a24540-8fe5-4ba5-ab30-bf16a83a179b`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.0010039806366', 'lastCheck': 1350291900.752163, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000980138778687', 'lastCheck': 1350291901.415101, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00320291519165', 'lastCheck': 1350291901.007768, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00310015678406', 'lastCheck': 1350291901.608999, 'code': 0, 'valid': True}} Thread-76::DEBUG::2012-10-15 09:05:07,270::task::588::TaskManager.Task::(_updateState) Task=`e9a24540-8fe5-4ba5-ab30-bf16a83a179b`::moving from state preparing -> state finished Thread-76::DEBUG::2012-10-15 09:05:07,271::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-76::DEBUG::2012-10-15 09:05:07,272::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-76::DEBUG::2012-10-15 09:05:07,273::task::980::TaskManager.Task::(_decref) Task=`e9a24540-8fe5-4ba5-ab30-bf16a83a179b`::ref 0 aborting False Thread-78::DEBUG::2012-10-15 09:05:09,168::clientIF::76::vds::(wrapper) [172.16.101.90]::call create with ({'bridge': 'VLAN_242', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '4', 'macAddr': '52:54:00:74:f2:d2', 'boot': 'c', 'custom': {}, 'vmType': 'kvm', 'memSize': 2000, 'smpCoresPerSocket': '1', 'vmName': 'nba-apac', 'spiceMonitors': '1', 'nice': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '0af28965-6749-4f4c-83ad-fffac9c0617a', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'nicModel': 'pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'timeOffset': '-313', 'spiceSecureChannels': 'smain,sinputs', 'display': 'qxl'},) {} Thread-78::INFO::2012-10-15 09:05:09,261::clientIF::712::vds::(create) vmContainerLock acquired by vm ae5dca11-2aa1-43be-a7c1-a636374a869a Thread-79::DEBUG::2012-10-15 09:05:09,402::vm::512::vm.Vm::(_startUnderlyingVm) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Start Thread-78::DEBUG::2012-10-15 09:05:09,404::clientIF::725::vds::(create) Total desktops after creation of ae5dca11-2aa1-43be-a7c1-a636374a869a is 1 Thread-79::DEBUG::2012-10-15 09:05:09,406::vm::516::vm.Vm::(_startUnderlyingVm) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::_ongoingCreations acquired Thread-78::DEBUG::2012-10-15 09:05:09,408::clientIF::81::vds::(wrapper) return create with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'bridge': 'VLAN_242', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'pid': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '0af28965-6749-4f4c-83ad-fffac9c0617a', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'transparentHugePages': 'true', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'custom': {}, 'clientIp': '', 'nicModel': 'pv', 'macAddr': '52:54:00:74:f2:d2', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'boot': 'c', 'smp': '4', 'vmType': 'kvm', 'timeOffset': '-313', 'memSize': 2000, 'displayIp': '172.16.101.102', 'spiceSecureChannels': 'smain,sinputs', 'smpCoresPerSocket': '1', 'vmName': 'nba-apac', 'display': 'qxl', 'spiceMonitors': '1', 'nice': '0'}} Thread-79::INFO::2012-10-15 09:05:09,410::libvirtvm::1105::vm.Vm::(_run) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::VM wrapper has started Thread-79::DEBUG::2012-10-15 09:05:09,422::task::588::TaskManager.Task::(_updateState) Task=`f6dd86a1-f0d2-4299-919c-7a40b2982047`::moving from state init -> state preparing Thread-79::INFO::2012-10-15 09:05:09,425::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='9be3a4e5-0ab5-4705-a743-818fa2165c6a', volUUID='0af28965-6749-4f4c-83ad-fffac9c0617a', options=None) Thread-79::DEBUG::2012-10-15 09:05:09,428::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`db807039-7492-4f8e-bafd-0a51fd02942b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-79::DEBUG::2012-10-15 09:05:09,429::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-79::DEBUG::2012-10-15 09:05:09,433::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-79::DEBUG::2012-10-15 09:05:09,434::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`db807039-7492-4f8e-bafd-0a51fd02942b`::Granted request Thread-79::DEBUG::2012-10-15 09:05:09,439::task::819::TaskManager.Task::(resourceAcquired) Task=`f6dd86a1-f0d2-4299-919c-7a40b2982047`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-79::DEBUG::2012-10-15 09:05:09,442::task::980::TaskManager.Task::(_decref) Task=`f6dd86a1-f0d2-4299-919c-7a40b2982047`::ref 1 aborting False Thread-79::DEBUG::2012-10-15 09:05:09,445::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-79::DEBUG::2012-10-15 09:05:09,448::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:10,420::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-79::DEBUG::2012-10-15 09:05:10,758::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-79::INFO::2012-10-15 09:05:10,763::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-79::DEBUG::2012-10-15 09:05:10,766::task::1174::TaskManager.Task::(prepare) Task=`f6dd86a1-f0d2-4299-919c-7a40b2982047`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-79::DEBUG::2012-10-15 09:05:10,783::task::588::TaskManager.Task::(_updateState) Task=`f6dd86a1-f0d2-4299-919c-7a40b2982047`::moving from state preparing -> state finished Thread-79::DEBUG::2012-10-15 09:05:10,791::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-79::DEBUG::2012-10-15 09:05:10,794::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-79::DEBUG::2012-10-15 09:05:10,798::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-79::DEBUG::2012-10-15 09:05:10,801::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-79::DEBUG::2012-10-15 09:05:10,804::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-79::DEBUG::2012-10-15 09:05:10,806::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-79::DEBUG::2012-10-15 09:05:10,809::task::980::TaskManager.Task::(_decref) Task=`f6dd86a1-f0d2-4299-919c-7a40b2982047`::ref 0 aborting False Thread-79::DEBUG::2012-10-15 09:05:10,813::task::588::TaskManager.Task::(_updateState) Task=`2df39964-7824-4e45-9da3-020723554db7`::moving from state init -> state preparing Thread-79::INFO::2012-10-15 09:05:10,816::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', options=None) Thread-79::INFO::2012-10-15 09:05:10,818::blockSD::695::Storage.StorageDomain::(validate) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-79::DEBUG::2012-10-15 09:05:10,821::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-79::DEBUG::2012-10-15 09:05:10,824::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-79::DEBUG::2012-10-15 09:05:10,827::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-79::DEBUG::2012-10-15 09:05:10,831::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-79::DEBUG::2012-10-15 09:05:10,834::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-79::DEBUG::2012-10-15 09:05:10,839::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:11,286::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-79::DEBUG::2012-10-15 09:05:11,294::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-79::DEBUG::2012-10-15 09:05:11,297::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-79::DEBUG::2012-10-15 09:05:11,304::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2d355349-cf15-485e-b175-8ae6c1dbd86f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2032' at 'getStorageDomainInfo' Thread-79::DEBUG::2012-10-15 09:05:11,305::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-79::DEBUG::2012-10-15 09:05:11,307::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-79::DEBUG::2012-10-15 09:05:11,308::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2d355349-cf15-485e-b175-8ae6c1dbd86f`::Granted request Thread-79::DEBUG::2012-10-15 09:05:11,311::task::819::TaskManager.Task::(resourceAcquired) Task=`2df39964-7824-4e45-9da3-020723554db7`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-79::DEBUG::2012-10-15 09:05:11,312::task::980::TaskManager.Task::(_decref) Task=`2df39964-7824-4e45-9da3-020723554db7`::ref 1 aborting False Thread-79::INFO::2012-10-15 09:05:11,315::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-79::DEBUG::2012-10-15 09:05:11,316::task::1174::TaskManager.Task::(prepare) Task=`2df39964-7824-4e45-9da3-020723554db7`::finished: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-79::DEBUG::2012-10-15 09:05:11,318::task::588::TaskManager.Task::(_updateState) Task=`2df39964-7824-4e45-9da3-020723554db7`::moving from state preparing -> state finished Thread-79::DEBUG::2012-10-15 09:05:11,319::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-79::DEBUG::2012-10-15 09:05:11,320::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-79::DEBUG::2012-10-15 09:05:11,322::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-79::DEBUG::2012-10-15 09:05:11,324::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-79::DEBUG::2012-10-15 09:05:11,325::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-79::DEBUG::2012-10-15 09:05:11,326::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-79::DEBUG::2012-10-15 09:05:11,327::task::980::TaskManager.Task::(_decref) Task=`2df39964-7824-4e45-9da3-020723554db7`::ref 0 aborting False Thread-79::DEBUG::2012-10-15 09:05:11,330::task::588::TaskManager.Task::(_updateState) Task=`987676d4-d81d-4ccd-83cd-4ec7a4635186`::moving from state init -> state preparing Thread-79::INFO::2012-10-15 09:05:11,331::logUtils::37::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='9be3a4e5-0ab5-4705-a743-818fa2165c6a', volUUID='0af28965-6749-4f4c-83ad-fffac9c0617a', rw=True, options=None) Thread-79::DEBUG::2012-10-15 09:05:11,334::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`898e801a-7a0d-4770-bc77-24b2a81a0703`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2423' at 'prepareVolume' Thread-79::DEBUG::2012-10-15 09:05:11,335::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-79::DEBUG::2012-10-15 09:05:11,337::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-79::DEBUG::2012-10-15 09:05:11,338::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`898e801a-7a0d-4770-bc77-24b2a81a0703`::Granted request Thread-79::DEBUG::2012-10-15 09:05:11,340::task::819::TaskManager.Task::(resourceAcquired) Task=`987676d4-d81d-4ccd-83cd-4ec7a4635186`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-79::DEBUG::2012-10-15 09:05:11,342::task::980::TaskManager.Task::(_decref) Task=`987676d4-d81d-4ccd-83cd-4ec7a4635186`::ref 1 aborting False Thread-79::DEBUG::2012-10-15 09:05:11,344::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.9be3a4e5-0ab5-4705-a743-818fa2165c6a`ReqID=`a5bd36c1-ff91-4af4-9ddd-ba7535d9d5c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2428' at 'prepareVolume' Thread-79::DEBUG::2012-10-15 09:05:11,345::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.9be3a4e5-0ab5-4705-a743-818fa2165c6a' for lock type 'exclusive' Thread-79::DEBUG::2012-10-15 09:05:11,348::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-79::DEBUG::2012-10-15 09:05:11,351::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:11,817::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-79::DEBUG::2012-10-15 09:05:12,125::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-79::DEBUG::2012-10-15 09:05:12,133::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=32 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-83::DEBUG::2012-10-15 09:05:12,169::clientIF::76::vds::(wrapper) [172.16.101.90]::call create with ({'bridge': 'VLAN_90', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '1', 'macAddr': '00:1a:4a:10:01:02', 'boot': 'dc', 'custom': {}, 'vmType': 'kvm', 'memSize': 2048, 'smpCoresPerSocket': '1', 'vmName': 'srvfiler01', 'spiceMonitors': '1', 'nice': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'cow', 'boot': 'true', 'volumeID': 'dfec79c0-c6ab-44fb-ad0f-4469a9553a23', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'nicModel': 'pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'timeOffset': '7093', 'spiceSecureChannels': 'smain,sinputs', 'display': 'qxl'},) {} Thread-79::DEBUG::2012-10-15 09:05:12,193::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00122402 s, 418 kB/s\n'; = 0 Thread-79::DEBUG::2012-10-15 09:05:12,198::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00122402 s, 418 kB/s'], size: 512 Thread-79::DEBUG::2012-10-15 09:05:12,203::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=32 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:12,257::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00087813 s, 583 kB/s\n'; = 0 Thread-79::DEBUG::2012-10-15 09:05:12,259::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00087813 s, 583 kB/s'], size: 512 Thread-79::INFO::2012-10-15 09:05:12,266::image::354::Storage.Image::(getChain) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 imgUUID=9be3a4e5-0ab5-4705-a743-818fa2165c6a chain=[] Thread-83::INFO::2012-10-15 09:05:12,267::clientIF::712::vds::(create) vmContainerLock acquired by vm dea83ab1-6310-47c9-8c0c-88171c24045e Thread-79::DEBUG::2012-10-15 09:05:12,273::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/0af28965-6749-4f4c-83ad-fffac9c0617a' (cwd None) Thread-83::DEBUG::2012-10-15 09:05:12,305::clientIF::725::vds::(create) Total desktops after creation of dea83ab1-6310-47c9-8c0c-88171c24045e is 2 Thread-84::DEBUG::2012-10-15 09:05:12,309::vm::512::vm.Vm::(_startUnderlyingVm) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Start Thread-83::DEBUG::2012-10-15 09:05:12,313::clientIF::81::vds::(wrapper) return create with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'bridge': 'VLAN_90', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'pid': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'cow', 'boot': 'true', 'volumeID': 'dfec79c0-c6ab-44fb-ad0f-4469a9553a23', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'transparentHugePages': 'true', 'keyboardLayout': 'en-us', 'displaySecurePort': '-1', 'displayPort': '-1', 'cpuType': 'Opteron_G3', 'custom': {}, 'clientIp': '', 'nicModel': 'pv', 'macAddr': '00:1a:4a:10:01:02', 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'boot': 'dc', 'smp': '1', 'vmType': 'kvm', 'spiceSslCipherSuite': 'DEFAULT', 'status': 'WaitForLaunch', 'timeOffset': '7093', 'memSize': 2048, 'displayIp': '172.16.101.102', 'spiceSecureChannels': 'smain,sinputs', 'smpCoresPerSocket': '1', 'vmName': 'srvfiler01', 'display': 'qxl', 'spiceMonitors': '1', 'nice': '0'}} Thread-84::DEBUG::2012-10-15 09:05:12,315::vm::516::vm.Vm::(_startUnderlyingVm) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::_ongoingCreations acquired Thread-84::INFO::2012-10-15 09:05:12,324::libvirtvm::1105::vm.Vm::(_run) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::VM wrapper has started Thread-84::DEBUG::2012-10-15 09:05:12,333::task::588::TaskManager.Task::(_updateState) Task=`e7c7731b-a5b0-4981-8cbe-5d81eece7e3b`::moving from state init -> state preparing Thread-84::INFO::2012-10-15 09:05:12,338::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='70028937-af10-4aa1-a93a-1e8fcc9827fb', volUUID='dfec79c0-c6ab-44fb-ad0f-4469a9553a23', options=None) Thread-84::DEBUG::2012-10-15 09:05:12,341::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`84d3f978-a704-45a6-9b52-a4902612e71e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-84::DEBUG::2012-10-15 09:05:12,342::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-84::DEBUG::2012-10-15 09:05:12,344::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (2 active users) Thread-84::DEBUG::2012-10-15 09:05:12,346::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`84d3f978-a704-45a6-9b52-a4902612e71e`::Granted request Thread-84::DEBUG::2012-10-15 09:05:12,348::task::819::TaskManager.Task::(resourceAcquired) Task=`e7c7731b-a5b0-4981-8cbe-5d81eece7e3b`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-84::DEBUG::2012-10-15 09:05:12,350::task::980::TaskManager.Task::(_decref) Task=`e7c7731b-a5b0-4981-8cbe-5d81eece7e3b`::ref 1 aborting False Thread-84::INFO::2012-10-15 09:05:12,352::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '19327352832', 'apparentsize': '19327352832'} Thread-84::DEBUG::2012-10-15 09:05:12,353::task::1174::TaskManager.Task::(prepare) Task=`e7c7731b-a5b0-4981-8cbe-5d81eece7e3b`::finished: {'truesize': '19327352832', 'apparentsize': '19327352832'} Thread-84::DEBUG::2012-10-15 09:05:12,354::task::588::TaskManager.Task::(_updateState) Task=`e7c7731b-a5b0-4981-8cbe-5d81eece7e3b`::moving from state preparing -> state finished Thread-84::DEBUG::2012-10-15 09:05:12,355::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-84::DEBUG::2012-10-15 09:05:12,357::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-84::DEBUG::2012-10-15 09:05:12,358::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-84::DEBUG::2012-10-15 09:05:12,360::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (1 active users) Thread-84::DEBUG::2012-10-15 09:05:12,361::task::980::TaskManager.Task::(_decref) Task=`e7c7731b-a5b0-4981-8cbe-5d81eece7e3b`::ref 0 aborting False Thread-84::DEBUG::2012-10-15 09:05:12,363::task::588::TaskManager.Task::(_updateState) Task=`4e582fb1-a3c6-4173-9982-d9723f118a49`::moving from state init -> state preparing Thread-84::INFO::2012-10-15 09:05:12,365::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', options=None) Thread-84::INFO::2012-10-15 09:05:12,366::blockSD::695::Storage.StorageDomain::(validate) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-84::DEBUG::2012-10-15 09:05:12,368::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-84::DEBUG::2012-10-15 09:05:12,370::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-84::DEBUG::2012-10-15 09:05:12,371::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-84::DEBUG::2012-10-15 09:05:12,375::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-84::DEBUG::2012-10-15 09:05:12,377::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-84::DEBUG::2012-10-15 09:05:12,380::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:12,839::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-84::DEBUG::2012-10-15 09:05:12,848::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-84::DEBUG::2012-10-15 09:05:12,851::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-84::DEBUG::2012-10-15 09:05:12,858::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`cf04a754-987b-4977-9b5a-67ea550fbcb6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2032' at 'getStorageDomainInfo' Thread-84::DEBUG::2012-10-15 09:05:12,859::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-84::DEBUG::2012-10-15 09:05:12,861::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (2 active users) Thread-84::DEBUG::2012-10-15 09:05:12,862::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`cf04a754-987b-4977-9b5a-67ea550fbcb6`::Granted request Thread-84::DEBUG::2012-10-15 09:05:12,865::task::819::TaskManager.Task::(resourceAcquired) Task=`4e582fb1-a3c6-4173-9982-d9723f118a49`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-84::DEBUG::2012-10-15 09:05:12,866::task::980::TaskManager.Task::(_decref) Task=`4e582fb1-a3c6-4173-9982-d9723f118a49`::ref 1 aborting False Thread-84::INFO::2012-10-15 09:05:12,871::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-84::DEBUG::2012-10-15 09:05:12,873::task::1174::TaskManager.Task::(prepare) Task=`4e582fb1-a3c6-4173-9982-d9723f118a49`::finished: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-84::DEBUG::2012-10-15 09:05:12,876::task::588::TaskManager.Task::(_updateState) Task=`4e582fb1-a3c6-4173-9982-d9723f118a49`::moving from state preparing -> state finished Thread-84::DEBUG::2012-10-15 09:05:12,878::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-84::DEBUG::2012-10-15 09:05:12,881::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-84::DEBUG::2012-10-15 09:05:12,886::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-84::DEBUG::2012-10-15 09:05:12,888::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (1 active users) Thread-84::DEBUG::2012-10-15 09:05:12,894::task::980::TaskManager.Task::(_decref) Task=`4e582fb1-a3c6-4173-9982-d9723f118a49`::ref 0 aborting False Thread-84::DEBUG::2012-10-15 09:05:12,898::task::588::TaskManager.Task::(_updateState) Task=`1002709b-0f17-4d9a-9714-79f3b1894676`::moving from state init -> state preparing Thread-84::INFO::2012-10-15 09:05:12,901::logUtils::37::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='70028937-af10-4aa1-a93a-1e8fcc9827fb', volUUID='dfec79c0-c6ab-44fb-ad0f-4469a9553a23', rw=True, options=None) Thread-84::DEBUG::2012-10-15 09:05:12,906::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`288794de-9b23-45cb-b51a-eb6afb3b63d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2423' at 'prepareVolume' Thread-84::DEBUG::2012-10-15 09:05:12,908::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-84::DEBUG::2012-10-15 09:05:12,911::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (2 active users) Thread-84::DEBUG::2012-10-15 09:05:12,913::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`288794de-9b23-45cb-b51a-eb6afb3b63d7`::Granted request Thread-84::DEBUG::2012-10-15 09:05:12,918::task::819::TaskManager.Task::(resourceAcquired) Task=`1002709b-0f17-4d9a-9714-79f3b1894676`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-84::DEBUG::2012-10-15 09:05:12,921::task::980::TaskManager.Task::(_decref) Task=`1002709b-0f17-4d9a-9714-79f3b1894676`::ref 1 aborting False Thread-84::DEBUG::2012-10-15 09:05:12,925::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.70028937-af10-4aa1-a93a-1e8fcc9827fb`ReqID=`52016158-5fa7-479e-ba2a-59a2e52d81d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2428' at 'prepareVolume' Thread-84::DEBUG::2012-10-15 09:05:12,927::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.70028937-af10-4aa1-a93a-1e8fcc9827fb' for lock type 'exclusive' Thread-79::DEBUG::2012-10-15 09:05:13,055::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-79::DEBUG::2012-10-15 09:05:13,057::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-79::DEBUG::2012-10-15 09:05:13,059::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-79::DEBUG::2012-10-15 09:05:13,061::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.0af28965-6749-4f4c-83ad-fffac9c0617a`ReqID=`fef6697b-d43e-4903-9cae-be901dd791ad`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-79::DEBUG::2012-10-15 09:05:13,062::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.0af28965-6749-4f4c-83ad-fffac9c0617a' for lock type 'exclusive' Thread-79::DEBUG::2012-10-15 09:05:13,064::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.0af28965-6749-4f4c-83ad-fffac9c0617a' is free. Now locking as 'exclusive' (1 active user) Thread-79::DEBUG::2012-10-15 09:05:13,065::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.0af28965-6749-4f4c-83ad-fffac9c0617a`ReqID=`fef6697b-d43e-4903-9cae-be901dd791ad`::Granted request Thread-79::DEBUG::2012-10-15 09:05:13,067::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.9be3a4e5-0ab5-4705-a743-818fa2165c6a' is free. Now locking as 'exclusive' (1 active user) Thread-79::DEBUG::2012-10-15 09:05:13,069::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.9be3a4e5-0ab5-4705-a743-818fa2165c6a`ReqID=`a5bd36c1-ff91-4af4-9ddd-ba7535d9d5c3`::Granted request Thread-84::DEBUG::2012-10-15 09:05:13,073::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-84::DEBUG::2012-10-15 09:05:13,078::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:13,080::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-79::DEBUG::2012-10-15 09:05:13,084::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:13,554::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-79::DEBUG::2012-10-15 09:05:13,882::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-84::DEBUG::2012-10-15 09:05:13,887::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=16 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:14,205::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-79::DEBUG::2012-10-15 09:05:14,231::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/0af28965-6749-4f4c-83ad-fffac9c0617a' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:14,264::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00192769 s, 266 kB/s\n'; = 0 Thread-84::DEBUG::2012-10-15 09:05:14,267::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00192769 s, 266 kB/s'], size: 512 Thread-84::DEBUG::2012-10-15 09:05:14,274::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:14,331::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000874977 s, 585 kB/s\n'; = 0 Thread-84::DEBUG::2012-10-15 09:05:14,334::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000874977 s, 585 kB/s'], size: 512 Thread-84::INFO::2012-10-15 09:05:14,336::image::354::Storage.Image::(getChain) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 imgUUID=70028937-af10-4aa1-a93a-1e8fcc9827fb chain=[, ] Thread-84::DEBUG::2012-10-15 09:05:14,339::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/dfec79c0-c6ab-44fb-ad0f-4469a9553a23 ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/eb4c23df-f052-4bb4-8b94-90eae6323e7c' (cwd None) Thread-87::DEBUG::2012-10-15 09:05:14,514::clientIF::76::vds::(wrapper) [172.16.101.90]::call create with ({'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '4', 'macAddr': '00:0c:29:4f:6c:c6', 'boot': 'c', 'custom': {}, 'vmType': 'kvm', 'memSize': 12288, 'smpCoresPerSocket': '1', 'vmName': 'stage6_1', 'spiceMonitors': '1', 'nice': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '9c9137ae-bfc5-404b-a03b-b6833f61603e', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'nicModel': 'pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'timeOffset': '-352', 'spiceSecureChannels': 'smain,sinputs', 'display': 'qxl'},) {} Thread-87::INFO::2012-10-15 09:05:14,609::clientIF::712::vds::(create) vmContainerLock acquired by vm 66fcf199-aa3e-4dc9-b4bf-ea91649bace4 Thread-88::DEBUG::2012-10-15 09:05:14,623::vm::512::vm.Vm::(_startUnderlyingVm) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Start Thread-87::DEBUG::2012-10-15 09:05:14,624::clientIF::725::vds::(create) Total desktops after creation of 66fcf199-aa3e-4dc9-b4bf-ea91649bace4 is 3 Thread-88::DEBUG::2012-10-15 09:05:14,627::vm::516::vm.Vm::(_startUnderlyingVm) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::_ongoingCreations acquired Thread-87::DEBUG::2012-10-15 09:05:14,630::clientIF::81::vds::(wrapper) return create with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'pid': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '9c9137ae-bfc5-404b-a03b-b6833f61603e', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'transparentHugePages': 'true', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'custom': {}, 'clientIp': '', 'nicModel': 'pv', 'macAddr': '00:0c:29:4f:6c:c6', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'boot': 'c', 'smp': '4', 'vmType': 'kvm', 'timeOffset': '-352', 'memSize': 12288, 'displayIp': '172.16.101.102', 'spiceSecureChannels': 'smain,sinputs', 'smpCoresPerSocket': '1', 'vmName': 'stage6_1', 'display': 'qxl', 'spiceMonitors': '1', 'nice': '0'}} Thread-88::INFO::2012-10-15 09:05:14,632::libvirtvm::1105::vm.Vm::(_run) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::VM wrapper has started Thread-88::DEBUG::2012-10-15 09:05:14,642::task::588::TaskManager.Task::(_updateState) Task=`1102dbe0-5733-440d-a4f0-2dcf553c3abe`::moving from state init -> state preparing Thread-88::INFO::2012-10-15 09:05:14,648::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='93966c50-a1ac-4735-a814-fca83010fff7', volUUID='9c9137ae-bfc5-404b-a03b-b6833f61603e', options=None) Thread-88::DEBUG::2012-10-15 09:05:14,651::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2ffbc805-00b8-48c3-8ead-1494c2ec98a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-88::DEBUG::2012-10-15 09:05:14,653::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-88::DEBUG::2012-10-15 09:05:14,654::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (3 active users) Thread-88::DEBUG::2012-10-15 09:05:14,656::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2ffbc805-00b8-48c3-8ead-1494c2ec98a0`::Granted request Thread-88::DEBUG::2012-10-15 09:05:14,658::task::819::TaskManager.Task::(resourceAcquired) Task=`1102dbe0-5733-440d-a4f0-2dcf553c3abe`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-88::DEBUG::2012-10-15 09:05:14,660::task::980::TaskManager.Task::(_decref) Task=`1102dbe0-5733-440d-a4f0-2dcf553c3abe`::ref 1 aborting False Thread-88::INFO::2012-10-15 09:05:14,661::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-88::DEBUG::2012-10-15 09:05:14,662::task::1174::TaskManager.Task::(prepare) Task=`1102dbe0-5733-440d-a4f0-2dcf553c3abe`::finished: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-88::DEBUG::2012-10-15 09:05:14,664::task::588::TaskManager.Task::(_updateState) Task=`1102dbe0-5733-440d-a4f0-2dcf553c3abe`::moving from state preparing -> state finished Thread-88::DEBUG::2012-10-15 09:05:14,665::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-88::DEBUG::2012-10-15 09:05:14,666::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-88::DEBUG::2012-10-15 09:05:14,668::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-88::DEBUG::2012-10-15 09:05:14,670::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (2 active users) Thread-88::DEBUG::2012-10-15 09:05:14,671::task::980::TaskManager.Task::(_decref) Task=`1102dbe0-5733-440d-a4f0-2dcf553c3abe`::ref 0 aborting False Thread-88::DEBUG::2012-10-15 09:05:14,674::task::588::TaskManager.Task::(_updateState) Task=`67cd2076-91f4-4003-bb7b-a5280d840310`::moving from state init -> state preparing Thread-88::INFO::2012-10-15 09:05:14,675::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', options=None) Thread-88::INFO::2012-10-15 09:05:14,676::blockSD::695::Storage.StorageDomain::(validate) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-88::DEBUG::2012-10-15 09:05:14,678::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-88::DEBUG::2012-10-15 09:05:14,680::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-88::DEBUG::2012-10-15 09:05:14,682::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-88::DEBUG::2012-10-15 09:05:14,685::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-88::DEBUG::2012-10-15 09:05:14,688::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-88::DEBUG::2012-10-15 09:05:14,691::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:14,860::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-79::DEBUG::2012-10-15 09:05:14,864::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-84::DEBUG::2012-10-15 09:05:14,985::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-84::DEBUG::2012-10-15 09:05:14,988::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-88::DEBUG::2012-10-15 09:05:15,163::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-88::DEBUG::2012-10-15 09:05:15,172::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-88::DEBUG::2012-10-15 09:05:15,175::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-79::DEBUG::2012-10-15 09:05:15,176::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-88::DEBUG::2012-10-15 09:05:15,185::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2ba87032-4e74-4689-9eee-38f18b112935`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2032' at 'getStorageDomainInfo' Thread-88::DEBUG::2012-10-15 09:05:15,188::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-84::DEBUG::2012-10-15 09:05:15,189::lvm::478::OperationMutex::(_invalidatelvs) Got the operational mutex Thread-88::DEBUG::2012-10-15 09:05:15,192::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (3 active users) Thread-84::DEBUG::2012-10-15 09:05:15,195::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-88::DEBUG::2012-10-15 09:05:15,196::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2ba87032-4e74-4689-9eee-38f18b112935`::Granted request Thread-79::INFO::2012-10-15 09:05:15,197::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/0af28965-6749-4f4c-83ad-fffac9c0617a Thread-84::DEBUG::2012-10-15 09:05:15,201::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.dfec79c0-c6ab-44fb-ad0f-4469a9553a23`ReqID=`82b7269c-5b1c-44bf-8cf5-5b54d09043f4`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-79::DEBUG::2012-10-15 09:05:15,206::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-84::DEBUG::2012-10-15 09:05:15,208::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.dfec79c0-c6ab-44fb-ad0f-4469a9553a23' for lock type 'exclusive' Thread-88::DEBUG::2012-10-15 09:05:15,214::task::819::TaskManager.Task::(resourceAcquired) Task=`67cd2076-91f4-4003-bb7b-a5280d840310`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-79::DEBUG::2012-10-15 09:05:15,213::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:15,216::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.dfec79c0-c6ab-44fb-ad0f-4469a9553a23' is free. Now locking as 'exclusive' (1 active user) Thread-88::DEBUG::2012-10-15 09:05:15,218::task::980::TaskManager.Task::(_decref) Task=`67cd2076-91f4-4003-bb7b-a5280d840310`::ref 1 aborting False Thread-84::DEBUG::2012-10-15 09:05:15,221::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.dfec79c0-c6ab-44fb-ad0f-4469a9553a23`ReqID=`82b7269c-5b1c-44bf-8cf5-5b54d09043f4`::Granted request Thread-88::INFO::2012-10-15 09:05:15,243::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-88::DEBUG::2012-10-15 09:05:15,249::task::1174::TaskManager.Task::(prepare) Task=`67cd2076-91f4-4003-bb7b-a5280d840310`::finished: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-88::DEBUG::2012-10-15 09:05:15,254::task::588::TaskManager.Task::(_updateState) Task=`67cd2076-91f4-4003-bb7b-a5280d840310`::moving from state preparing -> state finished Thread-84::DEBUG::2012-10-15 09:05:15,259::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.eb4c23df-f052-4bb4-8b94-90eae6323e7c`ReqID=`d1357119-f219-499a-96b1-7eccb0629016`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-88::DEBUG::2012-10-15 09:05:15,261::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-84::DEBUG::2012-10-15 09:05:15,263::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.eb4c23df-f052-4bb4-8b94-90eae6323e7c' for lock type 'exclusive' Thread-88::DEBUG::2012-10-15 09:05:15,265::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-84::DEBUG::2012-10-15 09:05:15,267::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.eb4c23df-f052-4bb4-8b94-90eae6323e7c' is free. Now locking as 'exclusive' (1 active user) Thread-88::DEBUG::2012-10-15 09:05:15,272::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-84::DEBUG::2012-10-15 09:05:15,275::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.eb4c23df-f052-4bb4-8b94-90eae6323e7c`ReqID=`d1357119-f219-499a-96b1-7eccb0629016`::Granted request Thread-88::DEBUG::2012-10-15 09:05:15,277::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (2 active users) Thread-84::DEBUG::2012-10-15 09:05:15,282::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.70028937-af10-4aa1-a93a-1e8fcc9827fb' is free. Now locking as 'exclusive' (1 active user) Thread-84::DEBUG::2012-10-15 09:05:15,286::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.70028937-af10-4aa1-a93a-1e8fcc9827fb`ReqID=`52016158-5fa7-479e-ba2a-59a2e52d81d1`::Granted request Thread-88::DEBUG::2012-10-15 09:05:15,287::task::980::TaskManager.Task::(_decref) Task=`67cd2076-91f4-4003-bb7b-a5280d840310`::ref 0 aborting False Thread-88::DEBUG::2012-10-15 09:05:15,293::task::588::TaskManager.Task::(_updateState) Task=`6e9f3ae1-bf38-4b51-97bd-b766c05ef48d`::moving from state init -> state preparing Thread-84::DEBUG::2012-10-15 09:05:15,297::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-88::INFO::2012-10-15 09:05:15,299::logUtils::37::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='93966c50-a1ac-4735-a814-fca83010fff7', volUUID='9c9137ae-bfc5-404b-a03b-b6833f61603e', rw=True, options=None) Thread-84::DEBUG::2012-10-15 09:05:15,305::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:15,308::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2d90b538-9ef9-41e5-b6cc-86d356e37e4f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2423' at 'prepareVolume' Thread-88::DEBUG::2012-10-15 09:05:15,311::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-88::DEBUG::2012-10-15 09:05:15,329::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (3 active users) Thread-88::DEBUG::2012-10-15 09:05:15,331::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2d90b538-9ef9-41e5-b6cc-86d356e37e4f`::Granted request Thread-88::DEBUG::2012-10-15 09:05:15,336::task::819::TaskManager.Task::(resourceAcquired) Task=`6e9f3ae1-bf38-4b51-97bd-b766c05ef48d`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-88::DEBUG::2012-10-15 09:05:15,337::task::980::TaskManager.Task::(_decref) Task=`6e9f3ae1-bf38-4b51-97bd-b766c05ef48d`::ref 1 aborting False Thread-88::DEBUG::2012-10-15 09:05:15,341::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.93966c50-a1ac-4735-a814-fca83010fff7`ReqID=`dce30f44-ae42-4d93-9a10-0a9b7e03b304`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2428' at 'prepareVolume' Thread-88::DEBUG::2012-10-15 09:05:15,343::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.93966c50-a1ac-4735-a814-fca83010fff7' for lock type 'exclusive' Thread-88::DEBUG::2012-10-15 09:05:15,347::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-88::DEBUG::2012-10-15 09:05:15,350::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:15,704::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-79::DEBUG::2012-10-15 09:05:16,030::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=32 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:16,068::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-88::DEBUG::2012-10-15 09:05:16,169::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-91::DEBUG::2012-10-15 09:05:16,587::clientIF::76::vds::(wrapper) [172.16.101.90]::call create with ({'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '4', 'macAddr': '00:0c:29:4d:84:12', 'boot': 'c', 'custom': {}, 'vmType': 'kvm', 'memSize': 3500, 'smpCoresPerSocket': '1', 'vmName': 'stage6_4', 'spiceMonitors': '1', 'nice': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '5540600c-b4fd-4546-ae5c-6310b2d25eef', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'nicModel': 'pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'timeOffset': '115691', 'spiceSecureChannels': 'smain,sinputs', 'display': 'qxl'},) {} Thread-84::DEBUG::2012-10-15 09:05:16,751::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-79::DEBUG::2012-10-15 09:05:16,754::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000923731 s, 554 kB/s\n'; = 0 Thread-88::DEBUG::2012-10-15 09:05:16,759::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:16,784::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/dfec79c0-c6ab-44fb-ad0f-4469a9553a23' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:16,788::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000923731 s, 554 kB/s'], size: 512 Thread-79::DEBUG::2012-10-15 09:05:16,813::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=32 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-91::INFO::2012-10-15 09:05:16,856::clientIF::712::vds::(create) vmContainerLock acquired by vm 08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab Thread-88::DEBUG::2012-10-15 09:05:16,866::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00114025 s, 449 kB/s\n'; = 0 Thread-88::DEBUG::2012-10-15 09:05:16,880::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00114025 s, 449 kB/s'], size: 512 Thread-88::DEBUG::2012-10-15 09:05:16,887::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:16,912::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000831741 s, 616 kB/s\n'; = 0 Thread-79::DEBUG::2012-10-15 09:05:16,924::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000831741 s, 616 kB/s'], size: 512 Thread-79::DEBUG::2012-10-15 09:05:16,932::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.0af28965-6749-4f4c-83ad-fffac9c0617a`ReqID=`d02b9924-cc18-4fd0-b81c-3443246d5510`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-79::DEBUG::2012-10-15 09:05:16,936::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.0af28965-6749-4f4c-83ad-fffac9c0617a' for lock type 'exclusive' Thread-91::DEBUG::2012-10-15 09:05:16,946::clientIF::725::vds::(create) Total desktops after creation of 08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab is 4 Thread-79::DEBUG::2012-10-15 09:05:16,949::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission rw ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/0af28965-6749-4f4c-83ad-fffac9c0617a' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:16,950::vm::512::vm.Vm::(_startUnderlyingVm) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Start Thread-88::DEBUG::2012-10-15 09:05:16,976::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000822838 s, 622 kB/s\n'; = 0 Thread-91::DEBUG::2012-10-15 09:05:16,953::clientIF::81::vds::(wrapper) return create with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'pid': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '5540600c-b4fd-4546-ae5c-6310b2d25eef', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'transparentHugePages': 'true', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'custom': {}, 'clientIp': '', 'nicModel': 'pv', 'macAddr': '00:0c:29:4d:84:12', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'boot': 'c', 'smp': '4', 'vmType': 'kvm', 'timeOffset': '115691', 'memSize': 3500, 'displayIp': '172.16.101.102', 'spiceSecureChannels': 'smain,sinputs', 'smpCoresPerSocket': '1', 'vmName': 'stage6_4', 'display': 'qxl', 'spiceMonitors': '1', 'nice': '0'}} Thread-92::DEBUG::2012-10-15 09:05:16,980::vm::516::vm.Vm::(_startUnderlyingVm) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::_ongoingCreations acquired Thread-88::DEBUG::2012-10-15 09:05:16,998::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000822838 s, 622 kB/s'], size: 512 Thread-92::INFO::2012-10-15 09:05:16,999::libvirtvm::1105::vm.Vm::(_run) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::VM wrapper has started Thread-88::INFO::2012-10-15 09:05:17,008::image::354::Storage.Image::(getChain) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 imgUUID=93966c50-a1ac-4735-a814-fca83010fff7 chain=[] Thread-88::DEBUG::2012-10-15 09:05:17,014::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/9c9137ae-bfc5-404b-a03b-b6833f61603e' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:17,018::task::588::TaskManager.Task::(_updateState) Task=`c1b32543-21c4-488c-916b-dd4e54c80ace`::moving from state init -> state preparing Thread-92::INFO::2012-10-15 09:05:17,025::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='e2059ec7-8dc5-4058-bab8-73762de5e0f5', volUUID='5540600c-b4fd-4546-ae5c-6310b2d25eef', options=None) Thread-92::DEBUG::2012-10-15 09:05:17,051::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`96820953-a181-4c1c-b106-6bc3da8e8075`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-92::DEBUG::2012-10-15 09:05:17,053::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-92::DEBUG::2012-10-15 09:05:17,059::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-92::DEBUG::2012-10-15 09:05:17,061::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`96820953-a181-4c1c-b106-6bc3da8e8075`::Granted request Thread-92::DEBUG::2012-10-15 09:05:17,068::task::819::TaskManager.Task::(resourceAcquired) Task=`c1b32543-21c4-488c-916b-dd4e54c80ace`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-92::DEBUG::2012-10-15 09:05:17,070::task::980::TaskManager.Task::(_decref) Task=`c1b32543-21c4-488c-916b-dd4e54c80ace`::ref 1 aborting False Thread-92::INFO::2012-10-15 09:05:17,073::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-92::DEBUG::2012-10-15 09:05:17,078::task::1174::TaskManager.Task::(prepare) Task=`c1b32543-21c4-488c-916b-dd4e54c80ace`::finished: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-92::DEBUG::2012-10-15 09:05:17,080::task::588::TaskManager.Task::(_updateState) Task=`c1b32543-21c4-488c-916b-dd4e54c80ace`::moving from state preparing -> state finished Thread-92::DEBUG::2012-10-15 09:05:17,083::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-92::DEBUG::2012-10-15 09:05:17,085::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-92::DEBUG::2012-10-15 09:05:17,089::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-92::DEBUG::2012-10-15 09:05:17,092::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-92::DEBUG::2012-10-15 09:05:17,095::task::980::TaskManager.Task::(_decref) Task=`c1b32543-21c4-488c-916b-dd4e54c80ace`::ref 0 aborting False Thread-92::DEBUG::2012-10-15 09:05:17,100::task::588::TaskManager.Task::(_updateState) Task=`d296e514-d055-4257-b7dc-2f1ebe12627c`::moving from state init -> state preparing Thread-92::INFO::2012-10-15 09:05:17,102::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', options=None) Thread-92::INFO::2012-10-15 09:05:17,105::blockSD::695::Storage.StorageDomain::(validate) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-92::DEBUG::2012-10-15 09:05:17,109::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-92::DEBUG::2012-10-15 09:05:17,112::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-92::DEBUG::2012-10-15 09:05:17,115::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-92::DEBUG::2012-10-15 09:05:17,121::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-92::DEBUG::2012-10-15 09:05:17,125::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-92::DEBUG::2012-10-15 09:05:17,130::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:17,438::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-84::DEBUG::2012-10-15 09:05:17,442::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-79::DEBUG::2012-10-15 09:05:17,560::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "0af28965-6749-4f4c-83ad-fffac9c0617a" is already writable\n'; = 5 Thread-94::DEBUG::2012-10-15 09:05:17,596::task::588::TaskManager.Task::(_updateState) Task=`4e6604f9-385a-4bd7-adb9-41f81bd2b3b0`::moving from state init -> state preparing Thread-94::INFO::2012-10-15 09:05:17,600::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-94::INFO::2012-10-15 09:05:17,604::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00301885604858', 'lastCheck': 1350291910.790646, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00122594833374', 'lastCheck': 1350291911.438175, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00296306610107', 'lastCheck': 1350291911.036586, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00281405448914', 'lastCheck': 1350291911.639083, 'code': 0, 'valid': True}} Thread-94::DEBUG::2012-10-15 09:05:17,607::task::1174::TaskManager.Task::(prepare) Task=`4e6604f9-385a-4bd7-adb9-41f81bd2b3b0`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00301885604858', 'lastCheck': 1350291910.790646, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00122594833374', 'lastCheck': 1350291911.438175, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00296306610107', 'lastCheck': 1350291911.036586, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00281405448914', 'lastCheck': 1350291911.639083, 'code': 0, 'valid': True}} Thread-94::DEBUG::2012-10-15 09:05:17,610::task::588::TaskManager.Task::(_updateState) Task=`4e6604f9-385a-4bd7-adb9-41f81bd2b3b0`::moving from state preparing -> state finished Thread-94::DEBUG::2012-10-15 09:05:17,612::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-94::DEBUG::2012-10-15 09:05:17,615::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-94::DEBUG::2012-10-15 09:05:17,617::task::980::TaskManager.Task::(_decref) Task=`4e6604f9-385a-4bd7-adb9-41f81bd2b3b0`::ref 0 aborting False Thread-79::DEBUG::2012-10-15 09:05:17,640::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:17,712::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-92::DEBUG::2012-10-15 09:05:17,722::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-79::DEBUG::2012-10-15 09:05:17,727::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-92::DEBUG::2012-10-15 09:05:17,728::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-84::DEBUG::2012-10-15 09:05:17,740::lvm::478::OperationMutex::(_invalidatelvs) Got the operational mutex Thread-92::DEBUG::2012-10-15 09:05:17,742::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`74f8a845-cbe2-4bcc-9e05-01dd10233b4c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2032' at 'getStorageDomainInfo' Thread-92::DEBUG::2012-10-15 09:05:17,745::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-84::DEBUG::2012-10-15 09:05:17,746::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-92::DEBUG::2012-10-15 09:05:17,750::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-79::DEBUG::2012-10-15 09:05:17,752::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-84::INFO::2012-10-15 09:05:17,754::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/dfec79c0-c6ab-44fb-ad0f-4469a9553a23 Thread-92::DEBUG::2012-10-15 09:05:17,755::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`74f8a845-cbe2-4bcc-9e05-01dd10233b4c`::Granted request Thread-79::DEBUG::2012-10-15 09:05:17,760::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:17,763::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-84::DEBUG::2012-10-15 09:05:17,771::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:17,793::task::819::TaskManager.Task::(resourceAcquired) Task=`d296e514-d055-4257-b7dc-2f1ebe12627c`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-92::DEBUG::2012-10-15 09:05:17,812::task::980::TaskManager.Task::(_decref) Task=`d296e514-d055-4257-b7dc-2f1ebe12627c`::ref 1 aborting False Thread-92::INFO::2012-10-15 09:05:17,820::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-92::DEBUG::2012-10-15 09:05:17,825::task::1174::TaskManager.Task::(prepare) Task=`d296e514-d055-4257-b7dc-2f1ebe12627c`::finished: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-92::DEBUG::2012-10-15 09:05:17,829::task::588::TaskManager.Task::(_updateState) Task=`d296e514-d055-4257-b7dc-2f1ebe12627c`::moving from state preparing -> state finished Thread-92::DEBUG::2012-10-15 09:05:17,831::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-92::DEBUG::2012-10-15 09:05:17,832::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-92::DEBUG::2012-10-15 09:05:17,835::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-92::DEBUG::2012-10-15 09:05:17,836::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-92::DEBUG::2012-10-15 09:05:17,838::task::980::TaskManager.Task::(_decref) Task=`d296e514-d055-4257-b7dc-2f1ebe12627c`::ref 0 aborting False Thread-92::DEBUG::2012-10-15 09:05:17,842::task::588::TaskManager.Task::(_updateState) Task=`ce6fade2-9d7e-41ec-9658-94c6d6264d2b`::moving from state init -> state preparing Thread-92::INFO::2012-10-15 09:05:17,843::logUtils::37::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='e2059ec7-8dc5-4058-bab8-73762de5e0f5', volUUID='5540600c-b4fd-4546-ae5c-6310b2d25eef', rw=True, options=None) Thread-92::DEBUG::2012-10-15 09:05:17,848::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`d2615b52-de14-4c27-958f-25b43ef4c741`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2423' at 'prepareVolume' Thread-92::DEBUG::2012-10-15 09:05:17,851::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-92::DEBUG::2012-10-15 09:05:17,852::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-92::DEBUG::2012-10-15 09:05:17,854::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`d2615b52-de14-4c27-958f-25b43ef4c741`::Granted request Thread-92::DEBUG::2012-10-15 09:05:17,856::task::819::TaskManager.Task::(resourceAcquired) Task=`ce6fade2-9d7e-41ec-9658-94c6d6264d2b`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-92::DEBUG::2012-10-15 09:05:17,858::task::980::TaskManager.Task::(_decref) Task=`ce6fade2-9d7e-41ec-9658-94c6d6264d2b`::ref 1 aborting False Thread-92::DEBUG::2012-10-15 09:05:17,860::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.e2059ec7-8dc5-4058-bab8-73762de5e0f5`ReqID=`635c9216-bc59-4ec7-adba-f3aea53e4306`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2428' at 'prepareVolume' Thread-92::DEBUG::2012-10-15 09:05:17,861::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.e2059ec7-8dc5-4058-bab8-73762de5e0f5' for lock type 'exclusive' Thread-88::DEBUG::2012-10-15 09:05:18,009::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-88::DEBUG::2012-10-15 09:05:18,012::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-79::DEBUG::2012-10-15 09:05:18,251::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-84::DEBUG::2012-10-15 09:05:18,382::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-79::DEBUG::2012-10-15 09:05:18,631::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.0af28965-6749-4f4c-83ad-fffac9c0617a' is free. Now locking as 'exclusive' (1 active user) Thread-79::DEBUG::2012-10-15 09:05:18,700::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.0af28965-6749-4f4c-83ad-fffac9c0617a`ReqID=`d02b9924-cc18-4fd0-b81c-3443246d5510`::Granted request Thread-84::DEBUG::2012-10-15 09:05:18,922::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-79::DEBUG::2012-10-15 09:05:18,926::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=32 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:18,928::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=16 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:18,930::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-88::DEBUG::2012-10-15 09:05:18,962::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-88::DEBUG::2012-10-15 09:05:18,969::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.9c9137ae-bfc5-404b-a03b-b6833f61603e`ReqID=`1f8adc1c-e55f-4f64-9a76-e774d2d82e16`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-88::DEBUG::2012-10-15 09:05:18,970::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.9c9137ae-bfc5-404b-a03b-b6833f61603e' for lock type 'exclusive' Thread-88::DEBUG::2012-10-15 09:05:18,973::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.9c9137ae-bfc5-404b-a03b-b6833f61603e' is free. Now locking as 'exclusive' (1 active user) Thread-88::DEBUG::2012-10-15 09:05:18,974::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.9c9137ae-bfc5-404b-a03b-b6833f61603e`ReqID=`1f8adc1c-e55f-4f64-9a76-e774d2d82e16`::Granted request Thread-88::DEBUG::2012-10-15 09:05:18,977::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.93966c50-a1ac-4735-a814-fca83010fff7' is free. Now locking as 'exclusive' (1 active user) Thread-88::DEBUG::2012-10-15 09:05:18,979::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.93966c50-a1ac-4735-a814-fca83010fff7`ReqID=`dce30f44-ae42-4d93-9a10-0a9b7e03b304`::Granted request Thread-92::DEBUG::2012-10-15 09:05:18,989::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-79::DEBUG::2012-10-15 09:05:18,997::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000913277 s, 561 kB/s\n'; = 0 Thread-88::DEBUG::2012-10-15 09:05:19,000::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-92::DEBUG::2012-10-15 09:05:19,003::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:19,010::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:19,011::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000913277 s, 561 kB/s'], size: 512 Thread-84::DEBUG::2012-10-15 09:05:19,019::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000853463 s, 600 kB/s\n'; = 0 Thread-79::INFO::2012-10-15 09:05:19,053::logUtils::39::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None Thread-84::DEBUG::2012-10-15 09:05:19,060::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000853463 s, 600 kB/s'], size: 512 Thread-79::DEBUG::2012-10-15 09:05:19,062::task::1174::TaskManager.Task::(prepare) Task=`987676d4-d81d-4ccd-83cd-4ec7a4635186`::finished: None Thread-84::DEBUG::2012-10-15 09:05:19,068::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=16 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:19,072::task::588::TaskManager.Task::(_updateState) Task=`987676d4-d81d-4ccd-83cd-4ec7a4635186`::moving from state preparing -> state finished Thread-79::DEBUG::2012-10-15 09:05:19,076::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-79::DEBUG::2012-10-15 09:05:19,097::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-79::DEBUG::2012-10-15 09:05:19,105::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-79::DEBUG::2012-10-15 09:05:19,108::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-79::DEBUG::2012-10-15 09:05:19,112::task::980::TaskManager.Task::(_decref) Task=`987676d4-d81d-4ccd-83cd-4ec7a4635186`::ref 0 aborting False Thread-79::DEBUG::2012-10-15 09:05:19,116::task::588::TaskManager.Task::(_updateState) Task=`bb0c13d5-c513-466b-86af-f1b8fdfe2a4d`::moving from state init -> state preparing Thread-79::INFO::2012-10-15 09:05:19,118::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='9be3a4e5-0ab5-4705-a743-818fa2165c6a', volUUID='0af28965-6749-4f4c-83ad-fffac9c0617a', options=None) Thread-79::DEBUG::2012-10-15 09:05:19,120::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`50353c36-f3ba-4d76-9c3a-ba85f87e3c5d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2400' at 'getVolumePath' Thread-79::DEBUG::2012-10-15 09:05:19,122::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-79::DEBUG::2012-10-15 09:05:19,123::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-79::DEBUG::2012-10-15 09:05:19,127::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`50353c36-f3ba-4d76-9c3a-ba85f87e3c5d`::Granted request Thread-84::DEBUG::2012-10-15 09:05:19,140::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000846716 s, 605 kB/s\n'; = 0 Thread-79::DEBUG::2012-10-15 09:05:19,142::task::819::TaskManager.Task::(resourceAcquired) Task=`bb0c13d5-c513-466b-86af-f1b8fdfe2a4d`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-84::DEBUG::2012-10-15 09:05:19,144::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000846716 s, 605 kB/s'], size: 512 Thread-79::DEBUG::2012-10-15 09:05:19,147::task::980::TaskManager.Task::(_decref) Task=`bb0c13d5-c513-466b-86af-f1b8fdfe2a4d`::ref 1 aborting False Thread-84::DEBUG::2012-10-15 09:05:19,152::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.dfec79c0-c6ab-44fb-ad0f-4469a9553a23`ReqID=`179a6364-c0e6-496b-8546-57ddc34858a1`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-96::DEBUG::2012-10-15 09:05:19,164::clientIF::76::vds::(wrapper) [172.16.101.90]::call create with ({'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '4', 'macAddr': '52:54:00:68:b5:cf', 'boot': 'c', 'custom': {}, 'vmType': 'kvm', 'memSize': 3500, 'smpCoresPerSocket': '4', 'vmName': 'stage7-2', 'spiceMonitors': '1', 'nice': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '1be33b9b-4efe-495d-95db-4a983e1396a4', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'nicModel': 'pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'timeOffset': '-6', 'spiceSecureChannels': 'smain,sinputs', 'display': 'qxl'},) {} Thread-79::INFO::2012-10-15 09:05:19,170::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/9be3a4e5-0ab5-4705-a743-818fa2165c6a/0af28965-6749-4f4c-83ad-fffac9c0617a'} Thread-84::DEBUG::2012-10-15 09:05:19,171::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.dfec79c0-c6ab-44fb-ad0f-4469a9553a23' for lock type 'exclusive' Thread-79::DEBUG::2012-10-15 09:05:19,177::task::1174::TaskManager.Task::(prepare) Task=`bb0c13d5-c513-466b-86af-f1b8fdfe2a4d`::finished: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/9be3a4e5-0ab5-4705-a743-818fa2165c6a/0af28965-6749-4f4c-83ad-fffac9c0617a'} Thread-79::DEBUG::2012-10-15 09:05:19,198::task::588::TaskManager.Task::(_updateState) Task=`bb0c13d5-c513-466b-86af-f1b8fdfe2a4d`::moving from state preparing -> state finished Thread-84::DEBUG::2012-10-15 09:05:19,207::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission rw ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/dfec79c0-c6ab-44fb-ad0f-4469a9553a23' (cwd None) Thread-79::DEBUG::2012-10-15 09:05:19,211::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-79::DEBUG::2012-10-15 09:05:19,215::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-79::DEBUG::2012-10-15 09:05:19,243::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-79::DEBUG::2012-10-15 09:05:19,249::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-79::DEBUG::2012-10-15 09:05:19,255::task::980::TaskManager.Task::(_decref) Task=`bb0c13d5-c513-466b-86af-f1b8fdfe2a4d`::ref 0 aborting False Thread-79::INFO::2012-10-15 09:05:19,260::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/9be3a4e5-0ab5-4705-a743-818fa2165c6a/0af28965-6749-4f4c-83ad-fffac9c0617a Thread-79::INFO::2012-10-15 09:05:19,265::clientIF::606::vds::(_prepareVolumePath) prepared volume path: Thread-96::INFO::2012-10-15 09:05:19,293::clientIF::712::vds::(create) vmContainerLock acquired by vm 3a53bfa7-943b-4162-b570-997f548ed5ee Thread-79::DEBUG::2012-10-15 09:05:19,337::libvirtvm::1145::vm.Vm::(_run) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`:: nba-apac ae5dca11-2aa1-43be-a7c1-a636374a869a 2048000 2048000 4 9be3a4e5-0ab5-4705-a743-818fa2165c6a hvm Red Hat RHEV Hypervisor 16-1 4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10 ae5dca11-2aa1-43be-a7c1-a636374a869a Opteron_G3 Thread-97::DEBUG::2012-10-15 09:05:19,351::vm::512::vm.Vm::(_startUnderlyingVm) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Start Thread-96::DEBUG::2012-10-15 09:05:19,352::clientIF::725::vds::(create) Total desktops after creation of 3a53bfa7-943b-4162-b570-997f548ed5ee is 5 Thread-97::DEBUG::2012-10-15 09:05:19,355::vm::516::vm.Vm::(_startUnderlyingVm) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::_ongoingCreations acquired Thread-96::DEBUG::2012-10-15 09:05:19,356::clientIF::81::vds::(wrapper) return create with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'pid': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '1be33b9b-4efe-495d-95db-4a983e1396a4', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'transparentHugePages': 'true', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'custom': {}, 'clientIp': '', 'nicModel': 'pv', 'macAddr': '52:54:00:68:b5:cf', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'boot': 'c', 'smp': '4', 'vmType': 'kvm', 'timeOffset': '-6', 'memSize': 3500, 'displayIp': '172.16.101.102', 'spiceSecureChannels': 'smain,sinputs', 'smpCoresPerSocket': '4', 'vmName': 'stage7-2', 'display': 'qxl', 'spiceMonitors': '1', 'nice': '0'}} Thread-97::INFO::2012-10-15 09:05:19,357::libvirtvm::1105::vm.Vm::(_run) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::VM wrapper has started Thread-97::DEBUG::2012-10-15 09:05:19,370::task::588::TaskManager.Task::(_updateState) Task=`980059c8-a65b-4443-a222-c20745e3a492`::moving from state init -> state preparing Thread-97::INFO::2012-10-15 09:05:19,373::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='9a4ceabd-615d-430b-9dc5-ec94079581e1', volUUID='1be33b9b-4efe-495d-95db-4a983e1396a4', options=None) Thread-97::DEBUG::2012-10-15 09:05:19,375::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`3e70e886-639d-4b09-bc23-b05f7826c8c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-97::DEBUG::2012-10-15 09:05:19,377::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-97::DEBUG::2012-10-15 09:05:19,378::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-97::DEBUG::2012-10-15 09:05:19,379::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`3e70e886-639d-4b09-bc23-b05f7826c8c7`::Granted request Thread-97::DEBUG::2012-10-15 09:05:19,382::task::819::TaskManager.Task::(resourceAcquired) Task=`980059c8-a65b-4443-a222-c20745e3a492`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-97::DEBUG::2012-10-15 09:05:19,383::task::980::TaskManager.Task::(_decref) Task=`980059c8-a65b-4443-a222-c20745e3a492`::ref 1 aborting False Thread-97::INFO::2012-10-15 09:05:19,385::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-97::DEBUG::2012-10-15 09:05:19,386::task::1174::TaskManager.Task::(prepare) Task=`980059c8-a65b-4443-a222-c20745e3a492`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-97::DEBUG::2012-10-15 09:05:19,387::task::588::TaskManager.Task::(_updateState) Task=`980059c8-a65b-4443-a222-c20745e3a492`::moving from state preparing -> state finished Thread-97::DEBUG::2012-10-15 09:05:19,389::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-97::DEBUG::2012-10-15 09:05:19,390::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-97::DEBUG::2012-10-15 09:05:19,392::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-97::DEBUG::2012-10-15 09:05:19,394::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-97::DEBUG::2012-10-15 09:05:19,396::task::980::TaskManager.Task::(_decref) Task=`980059c8-a65b-4443-a222-c20745e3a492`::ref 0 aborting False Thread-97::DEBUG::2012-10-15 09:05:19,398::task::588::TaskManager.Task::(_updateState) Task=`86ca2428-e5cd-42b2-9c37-c832e5b217a4`::moving from state init -> state preparing Thread-97::INFO::2012-10-15 09:05:19,399::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', options=None) Thread-97::INFO::2012-10-15 09:05:19,401::blockSD::695::Storage.StorageDomain::(validate) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-97::DEBUG::2012-10-15 09:05:19,403::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:19,502::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-88::DEBUG::2012-10-15 09:05:19,546::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-84::DEBUG::2012-10-15 09:05:19,901::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "dfec79c0-c6ab-44fb-ad0f-4469a9553a23" is already writable\n'; = 5 Thread-88::DEBUG::2012-10-15 09:05:20,186::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-97::DEBUG::2012-10-15 09:05:20,192::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-92::DEBUG::2012-10-15 09:05:20,195::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=25 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:20,199::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-97::DEBUG::2012-10-15 09:05:20,228::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-97::DEBUG::2012-10-15 09:05:20,242::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-97::DEBUG::2012-10-15 09:05:20,245::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-92::DEBUG::2012-10-15 09:05:20,259::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000993421 s, 515 kB/s\n'; = 0 Thread-92::DEBUG::2012-10-15 09:05:20,262::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000993421 s, 515 kB/s'], size: 512 Thread-92::DEBUG::2012-10-15 09:05:20,266::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-88::DEBUG::2012-10-15 09:05:20,280::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/9c9137ae-bfc5-404b-a03b-b6833f61603e' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:20,283::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:20,275::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-97::DEBUG::2012-10-15 09:05:20,286::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-23::DEBUG::2012-10-15 09:05:20,793::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:20,805::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-97::DEBUG::2012-10-15 09:05:20,909::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-97::DEBUG::2012-10-15 09:05:21,081::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-88::DEBUG::2012-10-15 09:05:21,162::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-97::DEBUG::2012-10-15 09:05:21,183::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`7432b9af-34bd-4025-b82a-d244591a3366`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2032' at 'getStorageDomainInfo' Thread-92::DEBUG::2012-10-15 09:05:21,204::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-97::DEBUG::2012-10-15 09:05:21,210::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-84::DEBUG::2012-10-15 09:05:21,214::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-97::DEBUG::2012-10-15 09:05:21,220::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-92::DEBUG::2012-10-15 09:05:21,222::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=25 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-23::DEBUG::2012-10-15 09:05:21,223::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-97::DEBUG::2012-10-15 09:05:21,228::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`7432b9af-34bd-4025-b82a-d244591a3366`::Granted request Thread-88::DEBUG::2012-10-15 09:05:21,251::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-84::DEBUG::2012-10-15 09:05:21,260::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-97::DEBUG::2012-10-15 09:05:21,269::task::819::TaskManager.Task::(resourceAcquired) Task=`86ca2428-e5cd-42b2-9c37-c832e5b217a4`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-88::DEBUG::2012-10-15 09:05:21,272::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-97::DEBUG::2012-10-15 09:05:21,274::task::980::TaskManager.Task::(_decref) Task=`86ca2428-e5cd-42b2-9c37-c832e5b217a4`::ref 1 aborting False Thread-23::DEBUG::2012-10-15 09:05:21,277::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-97::INFO::2012-10-15 09:05:21,283::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-84::DEBUG::2012-10-15 09:05:21,288::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-97::DEBUG::2012-10-15 09:05:21,291::task::1174::TaskManager.Task::(prepare) Task=`86ca2428-e5cd-42b2-9c37-c832e5b217a4`::finished: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-92::DEBUG::2012-10-15 09:05:21,293::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000882815 s, 580 kB/s\n'; = 0 Thread-88::DEBUG::2012-10-15 09:05:21,296::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-97::DEBUG::2012-10-15 09:05:21,298::task::588::TaskManager.Task::(_updateState) Task=`86ca2428-e5cd-42b2-9c37-c832e5b217a4`::moving from state preparing -> state finished Thread-92::DEBUG::2012-10-15 09:05:21,300::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000882815 s, 580 kB/s'], size: 512 Thread-88::INFO::2012-10-15 09:05:21,302::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/9c9137ae-bfc5-404b-a03b-b6833f61603e Thread-84::DEBUG::2012-10-15 09:05:21,303::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-92::INFO::2012-10-15 09:05:21,307::image::354::Storage.Image::(getChain) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 imgUUID=e2059ec7-8dc5-4058-bab8-73762de5e0f5 chain=[] Thread-97::DEBUG::2012-10-15 09:05:21,308::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-23::DEBUG::2012-10-15 09:05:21,314::lvm::352::OperationMutex::(_reloadvgs) Got the operational mutex Thread-92::DEBUG::2012-10-15 09:05:21,317::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/5540600c-b4fd-4546-ae5c-6310b2d25eef' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:21,322::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:21,323::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-88::DEBUG::2012-10-15 09:05:21,327::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-23::DEBUG::2012-10-15 09:05:21,329::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:21,383::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-88::DEBUG::2012-10-15 09:05:21,392::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:21,433::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-97::DEBUG::2012-10-15 09:05:21,478::task::980::TaskManager.Task::(_decref) Task=`86ca2428-e5cd-42b2-9c37-c832e5b217a4`::ref 0 aborting False Thread-97::DEBUG::2012-10-15 09:05:21,516::task::588::TaskManager.Task::(_updateState) Task=`7989624e-b86c-4f8c-a3fe-51cd8dd9b8bb`::moving from state init -> state preparing Thread-97::INFO::2012-10-15 09:05:21,521::logUtils::37::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='9a4ceabd-615d-430b-9dc5-ec94079581e1', volUUID='1be33b9b-4efe-495d-95db-4a983e1396a4', rw=True, options=None) Thread-97::DEBUG::2012-10-15 09:05:21,534::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`70908411-d73a-46a7-9c49-db3048c39b5a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2423' at 'prepareVolume' Thread-97::DEBUG::2012-10-15 09:05:21,537::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-97::DEBUG::2012-10-15 09:05:21,545::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-97::DEBUG::2012-10-15 09:05:21,550::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`70908411-d73a-46a7-9c49-db3048c39b5a`::Granted request Thread-97::DEBUG::2012-10-15 09:05:21,552::task::819::TaskManager.Task::(resourceAcquired) Task=`7989624e-b86c-4f8c-a3fe-51cd8dd9b8bb`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-97::DEBUG::2012-10-15 09:05:21,554::task::980::TaskManager.Task::(_decref) Task=`7989624e-b86c-4f8c-a3fe-51cd8dd9b8bb`::ref 1 aborting False Thread-97::DEBUG::2012-10-15 09:05:21,556::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.9a4ceabd-615d-430b-9dc5-ec94079581e1`ReqID=`7230ff10-aa7a-4a98-ab3e-5c25a6d41b1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2428' at 'prepareVolume' Thread-97::DEBUG::2012-10-15 09:05:21,557::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.9a4ceabd-615d-430b-9dc5-ec94079581e1' for lock type 'exclusive' Thread-84::DEBUG::2012-10-15 09:05:21,860::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-23::DEBUG::2012-10-15 09:05:21,954::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-92::DEBUG::2012-10-15 09:05:22,186::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-84::DEBUG::2012-10-15 09:05:22,231::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.dfec79c0-c6ab-44fb-ad0f-4469a9553a23' is free. Now locking as 'exclusive' (1 active user) Thread-92::DEBUG::2012-10-15 09:05:22,234::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-84::DEBUG::2012-10-15 09:05:22,239::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.dfec79c0-c6ab-44fb-ad0f-4469a9553a23`ReqID=`179a6364-c0e6-496b-8546-57ddc34858a1`::Granted request Thread-88::DEBUG::2012-10-15 09:05:22,258::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-88::DEBUG::2012-10-15 09:05:22,595::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-84::DEBUG::2012-10-15 09:05:22,599::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=16 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:22,601::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:22,602::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-92::DEBUG::2012-10-15 09:05:22,638::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-92::DEBUG::2012-10-15 09:05:22,648::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.5540600c-b4fd-4546-ae5c-6310b2d25eef`ReqID=`e40d7143-b480-4498-8e3d-322f2684b4e9`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-92::DEBUG::2012-10-15 09:05:22,649::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.5540600c-b4fd-4546-ae5c-6310b2d25eef' for lock type 'exclusive' Thread-92::DEBUG::2012-10-15 09:05:22,651::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.5540600c-b4fd-4546-ae5c-6310b2d25eef' is free. Now locking as 'exclusive' (1 active user) Thread-92::DEBUG::2012-10-15 09:05:22,653::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.5540600c-b4fd-4546-ae5c-6310b2d25eef`ReqID=`e40d7143-b480-4498-8e3d-322f2684b4e9`::Granted request Thread-92::DEBUG::2012-10-15 09:05:22,659::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.e2059ec7-8dc5-4058-bab8-73762de5e0f5' is free. Now locking as 'exclusive' (1 active user) Thread-92::DEBUG::2012-10-15 09:05:22,662::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.e2059ec7-8dc5-4058-bab8-73762de5e0f5`ReqID=`635c9216-bc59-4ec7-adba-f3aea53e4306`::Granted request Thread-97::DEBUG::2012-10-15 09:05:22,672::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-84::DEBUG::2012-10-15 09:05:22,681::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000757905 s, 676 kB/s\n'; = 0 Thread-92::DEBUG::2012-10-15 09:05:22,687::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-84::DEBUG::2012-10-15 09:05:22,689::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000757905 s, 676 kB/s'], size: 512 Thread-97::DEBUG::2012-10-15 09:05:22,692::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:22,694::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000660738 s, 775 kB/s\n'; = 0 Thread-92::DEBUG::2012-10-15 09:05:22,697::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-84::INFO::2012-10-15 09:05:22,707::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/eb4c23df-f052-4bb4-8b94-90eae6323e7c Thread-88::DEBUG::2012-10-15 09:05:22,709::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000660738 s, 775 kB/s'], size: 512 Thread-84::DEBUG::2012-10-15 09:05:22,751::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:22,757::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:22,822::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000838138 s, 611 kB/s\n'; = 0 Thread-84::DEBUG::2012-10-15 09:05:22,826::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000838138 s, 611 kB/s'], size: 512 Thread-84::DEBUG::2012-10-15 09:05:22,829::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.eb4c23df-f052-4bb4-8b94-90eae6323e7c`ReqID=`18440bda-3dc6-48e2-923d-393d8c7f5ae4`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-84::DEBUG::2012-10-15 09:05:22,831::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.eb4c23df-f052-4bb4-8b94-90eae6323e7c' for lock type 'shared' Thread-84::DEBUG::2012-10-15 09:05:22,835::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission r ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/eb4c23df-f052-4bb4-8b94-90eae6323e7c' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:22,858::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000659872 s, 776 kB/s\n'; = 0 Thread-88::DEBUG::2012-10-15 09:05:22,863::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000659872 s, 776 kB/s'], size: 512 Thread-88::DEBUG::2012-10-15 09:05:22,869::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.9c9137ae-bfc5-404b-a03b-b6833f61603e`ReqID=`f9b1d79a-5317-45bc-9b2a-d079d495b140`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-88::DEBUG::2012-10-15 09:05:22,871::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.9c9137ae-bfc5-404b-a03b-b6833f61603e' for lock type 'exclusive' libvirtEventLoop::DEBUG::2012-10-15 09:05:22,911::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::event Started detail 0 opaque None Thread-79::DEBUG::2012-10-15 09:05:23,016::utils::323::vm.Vm::(start) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Start statistics collection Thread-101::DEBUG::2012-10-15 09:05:23,020::utils::352::vm.Vm::(run) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Stats thread started Thread-102::DEBUG::2012-10-15 09:05:23,024::guestIF::67::root::(_connect) Attempting connection to /var/lib/libvirt/qemu/channels/nba-apac.com.redhat.rhevm.vdsm Thread-101::DEBUG::2012-10-15 09:05:23,029::task::588::TaskManager.Task::(_updateState) Task=`61ddfeb8-bdae-4123-a157-4a4ff95f9085`::moving from state init -> state preparing Thread-102::DEBUG::2012-10-15 09:05:23,032::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/prepare-vmchannel /var/lib/libvirt/qemu/channels/nba-apac.com.redhat.rhevm.vdsm' (cwd None) Thread-79::WARNING::2012-10-15 09:05:23,034::libvirtvm::1180::vm.Vm::(_readPauseCode) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::_readPauseCode unsupported by libvirt vm Thread-101::INFO::2012-10-15 09:05:23,035::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='9be3a4e5-0ab5-4705-a743-818fa2165c6a', volUUID='0af28965-6749-4f4c-83ad-fffac9c0617a', options=None) Thread-79::DEBUG::2012-10-15 09:05:23,058::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/get-vm-pid nba-apac' (cwd None) Thread-101::DEBUG::2012-10-15 09:05:23,067::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`e68a42f2-9849-4ae0-ba82-53e3eaccd7ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-101::DEBUG::2012-10-15 09:05:23,086::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-101::DEBUG::2012-10-15 09:05:23,094::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (5 active users) Thread-101::DEBUG::2012-10-15 09:05:23,098::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`e68a42f2-9849-4ae0-ba82-53e3eaccd7ab`::Granted request Thread-101::DEBUG::2012-10-15 09:05:23,107::task::819::TaskManager.Task::(resourceAcquired) Task=`61ddfeb8-bdae-4123-a157-4a4ff95f9085`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-101::DEBUG::2012-10-15 09:05:23,109::task::980::TaskManager.Task::(_decref) Task=`61ddfeb8-bdae-4123-a157-4a4ff95f9085`::ref 1 aborting False Thread-101::INFO::2012-10-15 09:05:23,112::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-101::DEBUG::2012-10-15 09:05:23,114::task::1174::TaskManager.Task::(prepare) Task=`61ddfeb8-bdae-4123-a157-4a4ff95f9085`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-101::DEBUG::2012-10-15 09:05:23,115::task::588::TaskManager.Task::(_updateState) Task=`61ddfeb8-bdae-4123-a157-4a4ff95f9085`::moving from state preparing -> state finished Thread-101::DEBUG::2012-10-15 09:05:23,117::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-101::DEBUG::2012-10-15 09:05:23,118::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-101::DEBUG::2012-10-15 09:05:23,120::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-101::DEBUG::2012-10-15 09:05:23,121::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (4 active users) Thread-101::DEBUG::2012-10-15 09:05:23,123::task::980::TaskManager.Task::(_decref) Task=`61ddfeb8-bdae-4123-a157-4a4ff95f9085`::ref 0 aborting False Thread-102::DEBUG::2012-10-15 09:05:23,161::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-102::DEBUG::2012-10-15 09:05:23,167::guestIF::73::root::(_connect) connected to /var/lib/libvirt/qemu/channels/nba-apac.com.redhat.rhevm.vdsm Thread-79::DEBUG::2012-10-15 09:05:23,187::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-101::ERROR::2012-10-15 09:05:23,200::utils::393::vm.Vm::(collect) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-97::DEBUG::2012-10-15 09:05:23,240::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-79::DEBUG::2012-10-15 09:05:23,375::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:23,606::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=39 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:23,637::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-84::DEBUG::2012-10-15 09:05:23,658::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "eb4c23df-f052-4bb4-8b94-90eae6323e7c" is already read only\n'; = 5 Thread-97::DEBUG::2012-10-15 09:05:23,871::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000774713 s, 661 kB/s\n'; = 0 Thread-79::DEBUG::2012-10-15 09:05:23,883::utils::595::Storage.Misc.excCmd::(execCmd) FAILED: = 'Unknown operation retune\n'; = 1 Thread-92::DEBUG::2012-10-15 09:05:24,032::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-97::DEBUG::2012-10-15 09:05:24,040::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000774713 s, 661 kB/s'], size: 512 Thread-79::DEBUG::2012-10-15 09:05:24,042::vm::528::vm.Vm::(_startUnderlyingVm) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::_ongoingCreations released Thread-97::DEBUG::2012-10-15 09:05:24,051::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=39 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:24,125::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00100286 s, 511 kB/s\n'; = 0 Thread-97::DEBUG::2012-10-15 09:05:24,134::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00100286 s, 511 kB/s'], size: 512 Thread-97::INFO::2012-10-15 09:05:24,138::image::354::Storage.Image::(getChain) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 imgUUID=9a4ceabd-615d-430b-9dc5-ec94079581e1 chain=[] Thread-84::DEBUG::2012-10-15 09:05:24,172::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-92::DEBUG::2012-10-15 09:05:24,176::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/5540600c-b4fd-4546-ae5c-6310b2d25eef' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:24,180::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/1be33b9b-4efe-495d-95db-4a983e1396a4' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:24,184::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-84::DEBUG::2012-10-15 09:05:24,253::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-84::DEBUG::2012-10-15 09:05:24,269::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-104::DEBUG::2012-10-15 09:05:24,400::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-104::DEBUG::2012-10-15 09:05:24,403::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::CPU stats not available Thread-104::DEBUG::2012-10-15 09:05:24,404::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Network stats not available Thread-104::DEBUG::2012-10-15 09:05:24,406::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-104::DEBUG::2012-10-15 09:05:24,407::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-104::DEBUG::2012-10-15 09:05:24,408::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-104::DEBUG::2012-10-15 09:05:24,409::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-104::DEBUG::2012-10-15 09:05:24,411::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '52:54:00:74:f2:d2', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.38', 'cpuIdle': '100.00', 'elapsedTime': '15', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-84::DEBUG::2012-10-15 09:05:24,774::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-92::DEBUG::2012-10-15 09:05:24,921::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-97::DEBUG::2012-10-15 09:05:24,936::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-84::DEBUG::2012-10-15 09:05:25,116::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-84::DEBUG::2012-10-15 09:05:25,119::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.eb4c23df-f052-4bb4-8b94-90eae6323e7c' is free. Now locking as 'shared' (1 active user) Thread-92::DEBUG::2012-10-15 09:05:25,121::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-84::DEBUG::2012-10-15 09:05:25,123::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.eb4c23df-f052-4bb4-8b94-90eae6323e7c`ReqID=`18440bda-3dc6-48e2-923d-393d8c7f5ae4`::Granted request Thread-97::DEBUG::2012-10-15 09:05:25,125::lvm::478::OperationMutex::(_invalidatelvs) Got the operational mutex Thread-88::DEBUG::2012-10-15 09:05:25,133::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission rw ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/9c9137ae-bfc5-404b-a03b-b6833f61603e' (cwd None) Thread-92::INFO::2012-10-15 09:05:25,135::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/5540600c-b4fd-4546-ae5c-6310b2d25eef Thread-97::DEBUG::2012-10-15 09:05:25,136::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-84::INFO::2012-10-15 09:05:25,142::logUtils::39::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None Thread-92::DEBUG::2012-10-15 09:05:25,172::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-97::DEBUG::2012-10-15 09:05:25,176::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.1be33b9b-4efe-495d-95db-4a983e1396a4`ReqID=`65dd3e78-e5db-4b5d-92a0-e22e8e390dff`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-84::DEBUG::2012-10-15 09:05:25,180::task::1174::TaskManager.Task::(prepare) Task=`1002709b-0f17-4d9a-9714-79f3b1894676`::finished: None Thread-92::DEBUG::2012-10-15 09:05:25,189::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:25,191::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.1be33b9b-4efe-495d-95db-4a983e1396a4' for lock type 'exclusive' Thread-84::DEBUG::2012-10-15 09:05:25,193::task::588::TaskManager.Task::(_updateState) Task=`1002709b-0f17-4d9a-9714-79f3b1894676`::moving from state preparing -> state finished Thread-97::DEBUG::2012-10-15 09:05:25,202::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.1be33b9b-4efe-495d-95db-4a983e1396a4' is free. Now locking as 'exclusive' (1 active user) Thread-84::DEBUG::2012-10-15 09:05:25,225::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-97::DEBUG::2012-10-15 09:05:25,238::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.1be33b9b-4efe-495d-95db-4a983e1396a4`ReqID=`65dd3e78-e5db-4b5d-92a0-e22e8e390dff`::Granted request Thread-84::DEBUG::2012-10-15 09:05:25,241::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-97::DEBUG::2012-10-15 09:05:25,250::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.9a4ceabd-615d-430b-9dc5-ec94079581e1' is free. Now locking as 'exclusive' (1 active user) Thread-97::DEBUG::2012-10-15 09:05:25,255::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.9a4ceabd-615d-430b-9dc5-ec94079581e1`ReqID=`7230ff10-aa7a-4a98-ab3e-5c25a6d41b1e`::Granted request Thread-105::DEBUG::2012-10-15 09:05:25,270::clientIF::76::vds::(wrapper) [172.16.101.90]::call create with ({'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '2', 'macAddr': '00:1a:4a:10:01:10', 'boot': 'cd', 'custom': {}, 'vmType': 'kvm', 'memSize': 12288, 'smpCoresPerSocket': '1', 'vmName': 'stageportal01', 'spiceMonitors': '1', 'nice': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': 'f6af481f-89da-40ef-943a-dd46b500af45', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'nicModel': 'pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'timeOffset': '-132', 'spiceSecureChannels': 'smain,sinputs', 'display': 'qxl'},) {} Thread-84::DEBUG::2012-10-15 09:05:25,271::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-84::DEBUG::2012-10-15 09:05:25,307::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-97::DEBUG::2012-10-15 09:05:25,312::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-97::DEBUG::2012-10-15 09:05:25,323::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:25,326::task::980::TaskManager.Task::(_decref) Task=`1002709b-0f17-4d9a-9714-79f3b1894676`::ref 0 aborting False Thread-84::DEBUG::2012-10-15 09:05:25,356::task::588::TaskManager.Task::(_updateState) Task=`a42bdc77-2f5f-444d-a40f-751cefcdf710`::moving from state init -> state preparing Thread-84::INFO::2012-10-15 09:05:25,362::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='70028937-af10-4aa1-a93a-1e8fcc9827fb', volUUID='dfec79c0-c6ab-44fb-ad0f-4469a9553a23', options=None) Thread-84::DEBUG::2012-10-15 09:05:25,367::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`5a0f1ac6-56fd-408c-a05a-d2c56e9f584f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2400' at 'getVolumePath' Thread-84::DEBUG::2012-10-15 09:05:25,368::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-84::DEBUG::2012-10-15 09:05:25,372::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-84::DEBUG::2012-10-15 09:05:25,373::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`5a0f1ac6-56fd-408c-a05a-d2c56e9f584f`::Granted request Thread-84::DEBUG::2012-10-15 09:05:25,376::task::819::TaskManager.Task::(resourceAcquired) Task=`a42bdc77-2f5f-444d-a40f-751cefcdf710`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-84::DEBUG::2012-10-15 09:05:25,377::task::980::TaskManager.Task::(_decref) Task=`a42bdc77-2f5f-444d-a40f-751cefcdf710`::ref 1 aborting False Thread-84::INFO::2012-10-15 09:05:25,380::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/70028937-af10-4aa1-a93a-1e8fcc9827fb/dfec79c0-c6ab-44fb-ad0f-4469a9553a23'} Thread-105::INFO::2012-10-15 09:05:25,387::clientIF::712::vds::(create) vmContainerLock acquired by vm e454d24b-7675-4cbc-8ad2-1832195ba1ff Thread-84::DEBUG::2012-10-15 09:05:25,388::task::1174::TaskManager.Task::(prepare) Task=`a42bdc77-2f5f-444d-a40f-751cefcdf710`::finished: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/70028937-af10-4aa1-a93a-1e8fcc9827fb/dfec79c0-c6ab-44fb-ad0f-4469a9553a23'} Thread-84::DEBUG::2012-10-15 09:05:25,393::task::588::TaskManager.Task::(_updateState) Task=`a42bdc77-2f5f-444d-a40f-751cefcdf710`::moving from state preparing -> state finished Thread-84::DEBUG::2012-10-15 09:05:25,401::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-84::DEBUG::2012-10-15 09:05:25,406::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-105::DEBUG::2012-10-15 09:05:25,418::clientIF::725::vds::(create) Total desktops after creation of e454d24b-7675-4cbc-8ad2-1832195ba1ff is 6 Thread-84::DEBUG::2012-10-15 09:05:25,419::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-106::DEBUG::2012-10-15 09:05:25,420::vm::512::vm.Vm::(_startUnderlyingVm) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Start Thread-105::DEBUG::2012-10-15 09:05:25,422::clientIF::81::vds::(wrapper) return create with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'pid': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': 'f6af481f-89da-40ef-943a-dd46b500af45', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'transparentHugePages': 'true', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'custom': {}, 'clientIp': '', 'nicModel': 'pv', 'macAddr': '00:1a:4a:10:01:10', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'boot': 'cd', 'smp': '2', 'vmType': 'kvm', 'timeOffset': '-132', 'memSize': 12288, 'displayIp': '172.16.101.102', 'spiceSecureChannels': 'smain,sinputs', 'smpCoresPerSocket': '1', 'vmName': 'stageportal01', 'display': 'qxl', 'spiceMonitors': '1', 'nice': '0'}} Thread-84::DEBUG::2012-10-15 09:05:25,424::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-106::DEBUG::2012-10-15 09:05:25,427::vm::516::vm.Vm::(_startUnderlyingVm) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::_ongoingCreations acquired Thread-106::INFO::2012-10-15 09:05:25,440::libvirtvm::1105::vm.Vm::(_run) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::VM wrapper has started Thread-84::DEBUG::2012-10-15 09:05:25,443::task::980::TaskManager.Task::(_decref) Task=`a42bdc77-2f5f-444d-a40f-751cefcdf710`::ref 0 aborting False Thread-106::DEBUG::2012-10-15 09:05:25,447::task::588::TaskManager.Task::(_updateState) Task=`ddc8f185-7430-40c2-9dd3-fa046f34b0f1`::moving from state init -> state preparing Thread-84::INFO::2012-10-15 09:05:25,448::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/70028937-af10-4aa1-a93a-1e8fcc9827fb/dfec79c0-c6ab-44fb-ad0f-4469a9553a23 Thread-106::INFO::2012-10-15 09:05:25,451::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='61e6b472-42e2-453a-b58e-ab437940cb3d', volUUID='f6af481f-89da-40ef-943a-dd46b500af45', options=None) Thread-84::INFO::2012-10-15 09:05:25,453::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso Thread-106::DEBUG::2012-10-15 09:05:25,457::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`c24dce2f-f0f7-4a60-8ac8-90341f4eb42c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-106::DEBUG::2012-10-15 09:05:25,467::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-106::DEBUG::2012-10-15 09:05:25,499::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-84::DEBUG::2012-10-15 09:05:25,500::libvirtvm::1145::vm.Vm::(_run) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`:: srvfiler01 dea83ab1-6310-47c9-8c0c-88171c24045e 2097152 2097152 1 70028937-af10-4aa1-a93a-1e8fcc9827fb hvm Red Hat RHEV Hypervisor 16-1 4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10 dea83ab1-6310-47c9-8c0c-88171c24045e Opteron_G3 Thread-106::DEBUG::2012-10-15 09:05:25,502::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`c24dce2f-f0f7-4a60-8ac8-90341f4eb42c`::Granted request Thread-106::DEBUG::2012-10-15 09:05:25,508::task::819::TaskManager.Task::(resourceAcquired) Task=`ddc8f185-7430-40c2-9dd3-fa046f34b0f1`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-106::DEBUG::2012-10-15 09:05:25,510::task::980::TaskManager.Task::(_decref) Task=`ddc8f185-7430-40c2-9dd3-fa046f34b0f1`::ref 1 aborting False Thread-106::INFO::2012-10-15 09:05:25,511::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-106::DEBUG::2012-10-15 09:05:25,512::task::1174::TaskManager.Task::(prepare) Task=`ddc8f185-7430-40c2-9dd3-fa046f34b0f1`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-106::DEBUG::2012-10-15 09:05:25,514::task::588::TaskManager.Task::(_updateState) Task=`ddc8f185-7430-40c2-9dd3-fa046f34b0f1`::moving from state preparing -> state finished Thread-106::DEBUG::2012-10-15 09:05:25,515::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-106::DEBUG::2012-10-15 09:05:25,516::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-106::DEBUG::2012-10-15 09:05:25,518::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-106::DEBUG::2012-10-15 09:05:25,520::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-106::DEBUG::2012-10-15 09:05:25,521::task::980::TaskManager.Task::(_decref) Task=`ddc8f185-7430-40c2-9dd3-fa046f34b0f1`::ref 0 aborting False Thread-106::DEBUG::2012-10-15 09:05:25,524::task::588::TaskManager.Task::(_updateState) Task=`a4ab8656-7e8b-4635-8868-72f205f35d8e`::moving from state init -> state preparing Thread-106::INFO::2012-10-15 09:05:25,525::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', options=None) Thread-106::INFO::2012-10-15 09:05:25,527::blockSD::695::Storage.StorageDomain::(validate) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-106::DEBUG::2012-10-15 09:05:25,528::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-88::DEBUG::2012-10-15 09:05:25,623::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "9c9137ae-bfc5-404b-a03b-b6833f61603e" is already writable\n'; = 5 Thread-88::DEBUG::2012-10-15 09:05:25,645::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:25,785::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-97::DEBUG::2012-10-15 09:05:25,946::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-92::DEBUG::2012-10-15 09:05:26,010::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=25 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:26,183::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-88::DEBUG::2012-10-15 09:05:26,187::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-106::DEBUG::2012-10-15 09:05:26,189::lvm::467::OperationMutex::(_invalidatevgs) Got the operational mutex Thread-97::DEBUG::2012-10-15 09:05:26,192::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/1be33b9b-4efe-495d-95db-4a983e1396a4' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:26,193::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000861937 s, 594 kB/s\n'; = 0 Thread-88::DEBUG::2012-10-15 09:05:26,193::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:26,203::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000861937 s, 594 kB/s'], size: 512 Thread-106::DEBUG::2012-10-15 09:05:26,205::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-92::DEBUG::2012-10-15 09:05:26,207::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=25 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:26,209::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-88::DEBUG::2012-10-15 09:05:26,211::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-106::DEBUG::2012-10-15 09:05:26,211::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:26,236::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000458079 s, 1.1 MB/s\n'; = 0 Thread-92::DEBUG::2012-10-15 09:05:26,240::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000458079 s, 1.1 MB/s'], size: 512 Thread-92::DEBUG::2012-10-15 09:05:26,242::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.5540600c-b4fd-4546-ae5c-6310b2d25eef`ReqID=`f774c4b8-555f-4a40-bb23-6b1f1c7f700a`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-92::DEBUG::2012-10-15 09:05:26,242::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.5540600c-b4fd-4546-ae5c-6310b2d25eef' for lock type 'exclusive' Thread-109::DEBUG::2012-10-15 09:05:26,461::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-109::DEBUG::2012-10-15 09:05:26,463::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::CPU stats not available Thread-109::DEBUG::2012-10-15 09:05:26,465::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Network stats not available Thread-109::DEBUG::2012-10-15 09:05:26,466::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-109::DEBUG::2012-10-15 09:05:26,468::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-109::DEBUG::2012-10-15 09:05:26,469::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-109::DEBUG::2012-10-15 09:05:26,470::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-109::DEBUG::2012-10-15 09:05:26,472::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '52:54:00:74:f2:d2', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.23', 'cpuIdle': '100.00', 'elapsedTime': '17', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-97::DEBUG::2012-10-15 09:05:26,531::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-97::DEBUG::2012-10-15 09:05:26,534::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-88::DEBUG::2012-10-15 09:05:26,681::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-88::DEBUG::2012-10-15 09:05:26,960::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-88::DEBUG::2012-10-15 09:05:26,961::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.9c9137ae-bfc5-404b-a03b-b6833f61603e' is free. Now locking as 'exclusive' (1 active user) Thread-106::DEBUG::2012-10-15 09:05:26,961::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-88::DEBUG::2012-10-15 09:05:26,962::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.9c9137ae-bfc5-404b-a03b-b6833f61603e`ReqID=`f9b1d79a-5317-45bc-9b2a-d079d495b140`::Granted request Thread-97::DEBUG::2012-10-15 09:05:26,964::lvm::478::OperationMutex::(_invalidatelvs) Got the operational mutex Thread-92::DEBUG::2012-10-15 09:05:26,966::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-97::DEBUG::2012-10-15 09:05:26,967::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-97::INFO::2012-10-15 09:05:26,967::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/1be33b9b-4efe-495d-95db-4a983e1396a4 Thread-106::DEBUG::2012-10-15 09:05:26,968::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-88::DEBUG::2012-10-15 09:05:26,969::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-106::DEBUG::2012-10-15 09:05:26,970::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:26,971::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-92::DEBUG::2012-10-15 09:05:26,973::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:26,973::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-106::DEBUG::2012-10-15 09:05:27,185::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-106::DEBUG::2012-10-15 09:05:27,188::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-106::DEBUG::2012-10-15 09:05:27,191::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`f6ae4c4f-0d7a-474a-b79f-6ea63f5c82f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2032' at 'getStorageDomainInfo' Thread-106::DEBUG::2012-10-15 09:05:27,191::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-106::DEBUG::2012-10-15 09:05:27,192::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-106::DEBUG::2012-10-15 09:05:27,192::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`f6ae4c4f-0d7a-474a-b79f-6ea63f5c82f3`::Granted request Thread-106::DEBUG::2012-10-15 09:05:27,193::task::819::TaskManager.Task::(resourceAcquired) Task=`a4ab8656-7e8b-4635-8868-72f205f35d8e`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-106::DEBUG::2012-10-15 09:05:27,194::task::980::TaskManager.Task::(_decref) Task=`a4ab8656-7e8b-4635-8868-72f205f35d8e`::ref 1 aborting False Thread-106::INFO::2012-10-15 09:05:27,195::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-106::DEBUG::2012-10-15 09:05:27,195::task::1174::TaskManager.Task::(prepare) Task=`a4ab8656-7e8b-4635-8868-72f205f35d8e`::finished: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-106::DEBUG::2012-10-15 09:05:27,196::task::588::TaskManager.Task::(_updateState) Task=`a4ab8656-7e8b-4635-8868-72f205f35d8e`::moving from state preparing -> state finished Thread-106::DEBUG::2012-10-15 09:05:27,196::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-106::DEBUG::2012-10-15 09:05:27,197::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-106::DEBUG::2012-10-15 09:05:27,197::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-106::DEBUG::2012-10-15 09:05:27,198::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-106::DEBUG::2012-10-15 09:05:27,198::task::980::TaskManager.Task::(_decref) Task=`a4ab8656-7e8b-4635-8868-72f205f35d8e`::ref 0 aborting False Thread-106::DEBUG::2012-10-15 09:05:27,199::task::588::TaskManager.Task::(_updateState) Task=`810f0113-c3bb-4c05-bd06-1b0e952cb064`::moving from state init -> state preparing Thread-106::INFO::2012-10-15 09:05:27,200::logUtils::37::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='61e6b472-42e2-453a-b58e-ab437940cb3d', volUUID='f6af481f-89da-40ef-943a-dd46b500af45', rw=True, options=None) Thread-106::DEBUG::2012-10-15 09:05:27,201::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`225272e6-574c-41d6-813a-af2a5aad1ad8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2423' at 'prepareVolume' Thread-106::DEBUG::2012-10-15 09:05:27,201::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-106::DEBUG::2012-10-15 09:05:27,202::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-106::DEBUG::2012-10-15 09:05:27,202::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`225272e6-574c-41d6-813a-af2a5aad1ad8`::Granted request Thread-106::DEBUG::2012-10-15 09:05:27,203::task::819::TaskManager.Task::(resourceAcquired) Task=`810f0113-c3bb-4c05-bd06-1b0e952cb064`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-106::DEBUG::2012-10-15 09:05:27,203::task::980::TaskManager.Task::(_decref) Task=`810f0113-c3bb-4c05-bd06-1b0e952cb064`::ref 1 aborting False Thread-106::DEBUG::2012-10-15 09:05:27,204::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.61e6b472-42e2-453a-b58e-ab437940cb3d`ReqID=`f31a0510-06e7-4c3e-914d-81af245fc900`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2428' at 'prepareVolume' Thread-106::DEBUG::2012-10-15 09:05:27,205::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.61e6b472-42e2-453a-b58e-ab437940cb3d' for lock type 'exclusive' Thread-106::DEBUG::2012-10-15 09:05:27,205::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-110::DEBUG::2012-10-15 09:05:27,223::clientIF::76::vds::(wrapper) [172.16.101.90]::call create with ({'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '2', 'macAddr': '00:1a:4a:10:01:11', 'boot': 'cd', 'custom': {}, 'vmType': 'kvm', 'memSize': 12288, 'smpCoresPerSocket': '1', 'vmName': 'stageportal02', 'spiceMonitors': '1', 'nice': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '4033677e-6930-4582-aa90-1b90f8ff38ee', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'nicModel': 'pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'timeOffset': '-1', 'spiceSecureChannels': 'smain,sinputs', 'display': 'qxl'},) {} Thread-110::INFO::2012-10-15 09:05:27,281::clientIF::712::vds::(create) vmContainerLock acquired by vm 949630d3-c5aa-4047-9250-28cfe479985d Thread-111::DEBUG::2012-10-15 09:05:27,286::vm::512::vm.Vm::(_startUnderlyingVm) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Start Thread-110::DEBUG::2012-10-15 09:05:27,287::clientIF::725::vds::(create) Total desktops after creation of 949630d3-c5aa-4047-9250-28cfe479985d is 7 Thread-111::DEBUG::2012-10-15 09:05:27,290::vm::516::vm.Vm::(_startUnderlyingVm) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::_ongoingCreations acquired Thread-110::DEBUG::2012-10-15 09:05:27,291::clientIF::81::vds::(wrapper) return create with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'pid': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '4033677e-6930-4582-aa90-1b90f8ff38ee', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'transparentHugePages': 'true', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'custom': {}, 'clientIp': '', 'nicModel': 'pv', 'macAddr': '00:1a:4a:10:01:11', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'boot': 'cd', 'smp': '2', 'vmType': 'kvm', 'timeOffset': '-1', 'memSize': 12288, 'displayIp': '172.16.101.102', 'spiceSecureChannels': 'smain,sinputs', 'smpCoresPerSocket': '1', 'vmName': 'stageportal02', 'display': 'qxl', 'spiceMonitors': '1', 'nice': '0'}} Thread-111::INFO::2012-10-15 09:05:27,292::libvirtvm::1105::vm.Vm::(_run) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::VM wrapper has started Thread-111::DEBUG::2012-10-15 09:05:27,306::task::588::TaskManager.Task::(_updateState) Task=`2e8b8335-564a-4e3a-8a5e-b13cc0570c26`::moving from state init -> state preparing Thread-111::INFO::2012-10-15 09:05:27,309::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='0587da1b-6e3d-436b-aa1a-16baa05f5cdb', volUUID='4033677e-6930-4582-aa90-1b90f8ff38ee', options=None) Thread-111::DEBUG::2012-10-15 09:05:27,312::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`386eeb19-f732-455e-bb4f-108db2c39303`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-111::DEBUG::2012-10-15 09:05:27,314::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-111::DEBUG::2012-10-15 09:05:27,315::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (5 active users) Thread-111::DEBUG::2012-10-15 09:05:27,316::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`386eeb19-f732-455e-bb4f-108db2c39303`::Granted request Thread-111::DEBUG::2012-10-15 09:05:27,319::task::819::TaskManager.Task::(resourceAcquired) Task=`2e8b8335-564a-4e3a-8a5e-b13cc0570c26`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-111::DEBUG::2012-10-15 09:05:27,320::task::980::TaskManager.Task::(_decref) Task=`2e8b8335-564a-4e3a-8a5e-b13cc0570c26`::ref 1 aborting False Thread-111::DEBUG::2012-10-15 09:05:27,320::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:27,336::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-92::DEBUG::2012-10-15 09:05:27,467::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex libvirtEventLoop::DEBUG::2012-10-15 09:05:27,474::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::event Started detail 0 opaque None Thread-97::DEBUG::2012-10-15 09:05:27,482::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-92::DEBUG::2012-10-15 09:05:27,485::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission rw ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/5540600c-b4fd-4546-ae5c-6310b2d25eef' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:27,489::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-106::DEBUG::2012-10-15 09:05:27,491::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-106::DEBUG::2012-10-15 09:05:27,551::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:27,554::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-88::DEBUG::2012-10-15 09:05:27,623::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-111::DEBUG::2012-10-15 09:05:27,644::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:27,694::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-84::DEBUG::2012-10-15 09:05:27,769::utils::323::vm.Vm::(start) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Start statistics collection Thread-113::DEBUG::2012-10-15 09:05:27,793::utils::352::vm.Vm::(run) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Stats thread started Thread-114::DEBUG::2012-10-15 09:05:27,801::guestIF::67::root::(_connect) Attempting connection to /var/lib/libvirt/qemu/channels/srvfiler01.com.redhat.rhevm.vdsm Thread-114::DEBUG::2012-10-15 09:05:27,804::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/prepare-vmchannel /var/lib/libvirt/qemu/channels/srvfiler01.com.redhat.rhevm.vdsm' (cwd None) Thread-84::WARNING::2012-10-15 09:05:27,834::libvirtvm::1180::vm.Vm::(_readPauseCode) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::_readPauseCode unsupported by libvirt vm Thread-113::DEBUG::2012-10-15 09:05:27,849::task::588::TaskManager.Task::(_updateState) Task=`55cfd8e9-6287-4dcb-9666-5e83a6f5214d`::moving from state init -> state preparing Thread-84::DEBUG::2012-10-15 09:05:27,853::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/get-vm-pid srvfiler01' (cwd None) Thread-113::INFO::2012-10-15 09:05:27,857::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='70028937-af10-4aa1-a93a-1e8fcc9827fb', volUUID='dfec79c0-c6ab-44fb-ad0f-4469a9553a23', options=None) Thread-113::DEBUG::2012-10-15 09:05:27,890::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`063f4be0-d9f0-4997-aa5b-38156d7d981c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-113::DEBUG::2012-10-15 09:05:27,893::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-113::DEBUG::2012-10-15 09:05:27,896::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (6 active users) Thread-113::DEBUG::2012-10-15 09:05:27,897::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`063f4be0-d9f0-4997-aa5b-38156d7d981c`::Granted request Thread-113::DEBUG::2012-10-15 09:05:27,901::task::819::TaskManager.Task::(resourceAcquired) Task=`55cfd8e9-6287-4dcb-9666-5e83a6f5214d`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-113::DEBUG::2012-10-15 09:05:27,902::task::980::TaskManager.Task::(_decref) Task=`55cfd8e9-6287-4dcb-9666-5e83a6f5214d`::ref 1 aborting False Thread-113::INFO::2012-10-15 09:05:27,905::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '19327352832', 'apparentsize': '19327352832'} Thread-113::DEBUG::2012-10-15 09:05:27,907::task::1174::TaskManager.Task::(prepare) Task=`55cfd8e9-6287-4dcb-9666-5e83a6f5214d`::finished: {'truesize': '19327352832', 'apparentsize': '19327352832'} Thread-113::DEBUG::2012-10-15 09:05:27,908::task::588::TaskManager.Task::(_updateState) Task=`55cfd8e9-6287-4dcb-9666-5e83a6f5214d`::moving from state preparing -> state finished Thread-113::DEBUG::2012-10-15 09:05:27,910::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-113::DEBUG::2012-10-15 09:05:27,913::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-113::DEBUG::2012-10-15 09:05:27,916::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-113::DEBUG::2012-10-15 09:05:27,919::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (5 active users) Thread-113::DEBUG::2012-10-15 09:05:27,926::task::980::TaskManager.Task::(_decref) Task=`55cfd8e9-6287-4dcb-9666-5e83a6f5214d`::ref 0 aborting False Thread-114::DEBUG::2012-10-15 09:05:27,931::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-114::DEBUG::2012-10-15 09:05:27,936::guestIF::73::root::(_connect) connected to /var/lib/libvirt/qemu/channels/srvfiler01.com.redhat.rhevm.vdsm Thread-84::DEBUG::2012-10-15 09:05:27,990::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-92::DEBUG::2012-10-15 09:05:28,001::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "5540600c-b4fd-4546-ae5c-6310b2d25eef" is already writable\n'; = 5 Thread-113::ERROR::2012-10-15 09:05:28,033::utils::393::vm.Vm::(collect) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-84::DEBUG::2012-10-15 09:05:28,065::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:28,137::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-84::DEBUG::2012-10-15 09:05:28,279::utils::595::Storage.Misc.excCmd::(execCmd) FAILED: = 'Unknown operation retune\n'; = 1 Thread-84::DEBUG::2012-10-15 09:05:28,289::vm::528::vm.Vm::(_startUnderlyingVm) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::_ongoingCreations released Thread-106::DEBUG::2012-10-15 09:05:28,317::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-97::DEBUG::2012-10-15 09:05:28,415::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-88::DEBUG::2012-10-15 09:05:28,436::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-111::DEBUG::2012-10-15 09:05:28,480::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-97::DEBUG::2012-10-15 09:05:29,184::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=39 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:29,209::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-115::DEBUG::2012-10-15 09:05:29,246::task::588::TaskManager.Task::(_updateState) Task=`9034922c-d95d-4400-9934-5d542426bb52`::moving from state init -> state preparing Thread-115::INFO::2012-10-15 09:05:29,534::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-106::DEBUG::2012-10-15 09:05:29,571::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=58 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:29,574::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000931339 s, 550 kB/s\n'; = 0 Thread-115::INFO::2012-10-15 09:05:29,620::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.0323708057404', 'lastCheck': 1350291922.265584, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00986003875732', 'lastCheck': 1350291921.50784, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00855278968811', 'lastCheck': 1350291921.227428, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00322890281677', 'lastCheck': 1350291921.676382, 'code': 0, 'valid': True}} Thread-97::DEBUG::2012-10-15 09:05:29,709::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000931339 s, 550 kB/s'], size: 512 Thread-115::DEBUG::2012-10-15 09:05:29,736::task::1174::TaskManager.Task::(prepare) Task=`9034922c-d95d-4400-9934-5d542426bb52`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.0323708057404', 'lastCheck': 1350291922.265584, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00986003875732', 'lastCheck': 1350291921.50784, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00855278968811', 'lastCheck': 1350291921.227428, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00322890281677', 'lastCheck': 1350291921.676382, 'code': 0, 'valid': True}} Thread-88::DEBUG::2012-10-15 09:05:29,794::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000768696 s, 666 kB/s\n'; = 0 Thread-97::DEBUG::2012-10-15 09:05:29,812::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=39 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-115::DEBUG::2012-10-15 09:05:29,827::task::588::TaskManager.Task::(_updateState) Task=`9034922c-d95d-4400-9934-5d542426bb52`::moving from state preparing -> state finished Thread-106::DEBUG::2012-10-15 09:05:29,876::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000968421 s, 529 kB/s\n'; = 0 Thread-88::DEBUG::2012-10-15 09:05:29,877::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000768696 s, 666 kB/s'], size: 512 Thread-111::DEBUG::2012-10-15 09:05:29,884::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-115::DEBUG::2012-10-15 09:05:29,907::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-106::DEBUG::2012-10-15 09:05:29,919::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000968421 s, 529 kB/s'], size: 512 Thread-88::INFO::2012-10-15 09:05:29,931::logUtils::39::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None Thread-111::INFO::2012-10-15 09:05:29,936::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-92::DEBUG::2012-10-15 09:05:29,939::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-115::DEBUG::2012-10-15 09:05:29,939::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-106::DEBUG::2012-10-15 09:05:29,948::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=58 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:29,950::task::1174::TaskManager.Task::(prepare) Task=`6e9f3ae1-bf38-4b51-97bd-b766c05ef48d`::finished: None Thread-111::DEBUG::2012-10-15 09:05:29,958::task::1174::TaskManager.Task::(prepare) Task=`2e8b8335-564a-4e3a-8a5e-b13cc0570c26`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-92::DEBUG::2012-10-15 09:05:29,961::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-97::DEBUG::2012-10-15 09:05:29,964::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000853956 s, 600 kB/s\n'; = 0 Thread-115::DEBUG::2012-10-15 09:05:29,969::task::980::TaskManager.Task::(_decref) Task=`9034922c-d95d-4400-9934-5d542426bb52`::ref 0 aborting False Thread-88::DEBUG::2012-10-15 09:05:29,972::task::588::TaskManager.Task::(_updateState) Task=`6e9f3ae1-bf38-4b51-97bd-b766c05ef48d`::moving from state preparing -> state finished Thread-111::DEBUG::2012-10-15 09:05:30,008::task::588::TaskManager.Task::(_updateState) Task=`2e8b8335-564a-4e3a-8a5e-b13cc0570c26`::moving from state preparing -> state finished Thread-92::DEBUG::2012-10-15 09:05:30,023::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-97::DEBUG::2012-10-15 09:05:30,031::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000853956 s, 600 kB/s'], size: 512 Thread-88::DEBUG::2012-10-15 09:05:30,036::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-111::DEBUG::2012-10-15 09:05:30,048::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-106::DEBUG::2012-10-15 09:05:30,058::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000785253 s, 652 kB/s\n'; = 0 Thread-92::DEBUG::2012-10-15 09:05:30,064::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:30,074::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.1be33b9b-4efe-495d-95db-4a983e1396a4`ReqID=`6d47453b-cdd8-4d56-9eb8-d4390c0ede52`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-111::DEBUG::2012-10-15 09:05:30,091::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-88::DEBUG::2012-10-15 09:05:30,096::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-97::DEBUG::2012-10-15 09:05:30,131::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.1be33b9b-4efe-495d-95db-4a983e1396a4' for lock type 'exclusive' Thread-106::DEBUG::2012-10-15 09:05:30,138::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000785253 s, 652 kB/s'], size: 512 Thread-111::DEBUG::2012-10-15 09:05:30,149::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-106::INFO::2012-10-15 09:05:30,162::image::354::Storage.Image::(getChain) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 imgUUID=61e6b472-42e2-453a-b58e-ab437940cb3d chain=[] Thread-106::DEBUG::2012-10-15 09:05:30,172::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/f6af481f-89da-40ef-943a-dd46b500af45' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:30,175::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-116::DEBUG::2012-10-15 09:05:30,185::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::CPU stats not available Thread-111::DEBUG::2012-10-15 09:05:30,203::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (4 active users) Thread-116::DEBUG::2012-10-15 09:05:30,219::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-88::DEBUG::2012-10-15 09:05:30,222::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-116::DEBUG::2012-10-15 09:05:30,225::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-111::DEBUG::2012-10-15 09:05:30,232::task::980::TaskManager.Task::(_decref) Task=`2e8b8335-564a-4e3a-8a5e-b13cc0570c26`::ref 0 aborting False Thread-116::DEBUG::2012-10-15 09:05:30,235::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-88::DEBUG::2012-10-15 09:05:30,238::task::980::TaskManager.Task::(_decref) Task=`6e9f3ae1-bf38-4b51-97bd-b766c05ef48d`::ref 0 aborting False Thread-111::DEBUG::2012-10-15 09:05:30,241::task::588::TaskManager.Task::(_updateState) Task=`970fcb47-0d49-412d-bb17-e44fcf2eec18`::moving from state init -> state preparing Thread-116::DEBUG::2012-10-15 09:05:30,244::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-88::DEBUG::2012-10-15 09:05:30,255::task::588::TaskManager.Task::(_updateState) Task=`2966d278-190b-4ebb-92fb-b43e533f28a4`::moving from state init -> state preparing Thread-116::DEBUG::2012-10-15 09:05:30,264::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::CPU stats not available Thread-111::INFO::2012-10-15 09:05:30,268::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', options=None) Thread-88::INFO::2012-10-15 09:05:30,270::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='93966c50-a1ac-4735-a814-fca83010fff7', volUUID='9c9137ae-bfc5-404b-a03b-b6833f61603e', options=None) Thread-116::DEBUG::2012-10-15 09:05:30,273::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Network stats not available Thread-111::INFO::2012-10-15 09:05:30,276::blockSD::695::Storage.StorageDomain::(validate) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-116::DEBUG::2012-10-15 09:05:30,282::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-88::DEBUG::2012-10-15 09:05:30,283::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`4b4c71e9-107e-49c3-afdd-7e2fd93fdebd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2400' at 'getVolumePath' Thread-111::DEBUG::2012-10-15 09:05:30,287::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-116::DEBUG::2012-10-15 09:05:30,289::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-88::DEBUG::2012-10-15 09:05:30,290::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-116::DEBUG::2012-10-15 09:05:30,294::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-88::DEBUG::2012-10-15 09:05:30,297::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-116::DEBUG::2012-10-15 09:05:30,298::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-88::DEBUG::2012-10-15 09:05:30,299::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`4b4c71e9-107e-49c3-afdd-7e2fd93fdebd`::Granted request Thread-88::DEBUG::2012-10-15 09:05:30,318::task::819::TaskManager.Task::(resourceAcquired) Task=`2966d278-190b-4ebb-92fb-b43e533f28a4`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-88::DEBUG::2012-10-15 09:05:30,320::task::980::TaskManager.Task::(_decref) Task=`2966d278-190b-4ebb-92fb-b43e533f28a4`::ref 1 aborting False Thread-92::DEBUG::2012-10-15 09:05:30,615::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-92::DEBUG::2012-10-15 09:05:30,948::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-92::DEBUG::2012-10-15 09:05:30,951::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.5540600c-b4fd-4546-ae5c-6310b2d25eef' is free. Now locking as 'exclusive' (1 active user) Thread-111::DEBUG::2012-10-15 09:05:30,952::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-92::DEBUG::2012-10-15 09:05:30,954::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.5540600c-b4fd-4546-ae5c-6310b2d25eef`ReqID=`f774c4b8-555f-4a40-bb23-6b1f1c7f700a`::Granted request Thread-111::DEBUG::2012-10-15 09:05:30,957::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-111::DEBUG::2012-10-15 09:05:30,963::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-97::DEBUG::2012-10-15 09:05:30,967::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission rw ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/1be33b9b-4efe-495d-95db-4a983e1396a4' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:30,970::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=25 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:30,972::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-111::DEBUG::2012-10-15 09:05:30,986::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-111::DEBUG::2012-10-15 09:05:30,988::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-106::DEBUG::2012-10-15 09:05:31,005::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-92::DEBUG::2012-10-15 09:05:31,006::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000570722 s, 897 kB/s\n'; = 0 Thread-106::DEBUG::2012-10-15 09:05:31,007::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:31,007::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000570722 s, 897 kB/s'], size: 512 Thread-92::DEBUG::2012-10-15 09:05:31,008::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-111::DEBUG::2012-10-15 09:05:31,418::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-111::DEBUG::2012-10-15 09:05:31,420::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-111::DEBUG::2012-10-15 09:05:31,420::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-106::DEBUG::2012-10-15 09:05:31,420::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-111::DEBUG::2012-10-15 09:05:31,424::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`55a99ced-0540-4ca9-92ad-03dacac0e3f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2032' at 'getStorageDomainInfo' Thread-92::DEBUG::2012-10-15 09:05:31,424::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-111::DEBUG::2012-10-15 09:05:31,424::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-88::DEBUG::2012-10-15 09:05:31,426::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-111::DEBUG::2012-10-15 09:05:31,427::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (5 active users) Thread-106::DEBUG::2012-10-15 09:05:31,429::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-111::DEBUG::2012-10-15 09:05:31,430::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`55a99ced-0540-4ca9-92ad-03dacac0e3f0`::Granted request Thread-106::DEBUG::2012-10-15 09:05:31,431::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.f6af481f-89da-40ef-943a-dd46b500af45`ReqID=`d175cff6-5c29-4d55-ba5e-1ad9f8c10ac0`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-88::DEBUG::2012-10-15 09:05:31,432::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-106::DEBUG::2012-10-15 09:05:31,432::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.f6af481f-89da-40ef-943a-dd46b500af45' for lock type 'exclusive' Thread-88::DEBUG::2012-10-15 09:05:31,433::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-106::DEBUG::2012-10-15 09:05:31,433::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.f6af481f-89da-40ef-943a-dd46b500af45' is free. Now locking as 'exclusive' (1 active user) Thread-92::DEBUG::2012-10-15 09:05:31,434::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-111::DEBUG::2012-10-15 09:05:31,434::task::819::TaskManager.Task::(resourceAcquired) Task=`970fcb47-0d49-412d-bb17-e44fcf2eec18`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-106::DEBUG::2012-10-15 09:05:31,434::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.f6af481f-89da-40ef-943a-dd46b500af45`ReqID=`d175cff6-5c29-4d55-ba5e-1ad9f8c10ac0`::Granted request Thread-92::DEBUG::2012-10-15 09:05:31,440::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:31,441::task::980::TaskManager.Task::(_decref) Task=`970fcb47-0d49-412d-bb17-e44fcf2eec18`::ref 1 aborting False Thread-106::DEBUG::2012-10-15 09:05:31,443::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.61e6b472-42e2-453a-b58e-ab437940cb3d' is free. Now locking as 'exclusive' (1 active user) Thread-106::DEBUG::2012-10-15 09:05:31,451::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.61e6b472-42e2-453a-b58e-ab437940cb3d`ReqID=`f31a0510-06e7-4c3e-914d-81af245fc900`::Granted request Thread-111::INFO::2012-10-15 09:05:31,453::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-106::DEBUG::2012-10-15 09:05:31,455::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-106::DEBUG::2012-10-15 09:05:31,455::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:31,463::task::1174::TaskManager.Task::(prepare) Task=`970fcb47-0d49-412d-bb17-e44fcf2eec18`::finished: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-111::DEBUG::2012-10-15 09:05:31,472::task::588::TaskManager.Task::(_updateState) Task=`970fcb47-0d49-412d-bb17-e44fcf2eec18`::moving from state preparing -> state finished Thread-111::DEBUG::2012-10-15 09:05:31,473::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-111::DEBUG::2012-10-15 09:05:31,473::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-111::DEBUG::2012-10-15 09:05:31,473::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-111::DEBUG::2012-10-15 09:05:31,474::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (4 active users) Thread-111::DEBUG::2012-10-15 09:05:31,474::task::980::TaskManager.Task::(_decref) Task=`970fcb47-0d49-412d-bb17-e44fcf2eec18`::ref 0 aborting False Thread-111::DEBUG::2012-10-15 09:05:31,475::task::588::TaskManager.Task::(_updateState) Task=`304092db-f962-4ea6-96f9-66259c4d92bb`::moving from state init -> state preparing Thread-111::INFO::2012-10-15 09:05:31,475::logUtils::37::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='0587da1b-6e3d-436b-aa1a-16baa05f5cdb', volUUID='4033677e-6930-4582-aa90-1b90f8ff38ee', rw=True, options=None) Thread-111::DEBUG::2012-10-15 09:05:31,476::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`9dac0a0d-d717-4a00-861e-aa1e0bf60b61`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2423' at 'prepareVolume' Thread-111::DEBUG::2012-10-15 09:05:31,476::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-111::DEBUG::2012-10-15 09:05:31,476::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (5 active users) Thread-111::DEBUG::2012-10-15 09:05:31,476::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`9dac0a0d-d717-4a00-861e-aa1e0bf60b61`::Granted request Thread-111::DEBUG::2012-10-15 09:05:31,477::task::819::TaskManager.Task::(resourceAcquired) Task=`304092db-f962-4ea6-96f9-66259c4d92bb`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-111::DEBUG::2012-10-15 09:05:31,477::task::980::TaskManager.Task::(_decref) Task=`304092db-f962-4ea6-96f9-66259c4d92bb`::ref 1 aborting False Thread-111::DEBUG::2012-10-15 09:05:31,477::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.0587da1b-6e3d-436b-aa1a-16baa05f5cdb`ReqID=`c4569a14-2f96-4712-a9ae-464e7b4f5e1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2428' at 'prepareVolume' Thread-111::DEBUG::2012-10-15 09:05:31,478::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.0587da1b-6e3d-436b-aa1a-16baa05f5cdb' for lock type 'exclusive' Thread-111::DEBUG::2012-10-15 09:05:31,478::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-111::DEBUG::2012-10-15 09:05:31,479::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:31,553::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "1be33b9b-4efe-495d-95db-4a983e1396a4" is already writable\n'; = 5 Thread-97::DEBUG::2012-10-15 09:05:31,559::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-106::DEBUG::2012-10-15 09:05:31,577::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-106::DEBUG::2012-10-15 09:05:31,646::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/f6af481f-89da-40ef-943a-dd46b500af45' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:31,648::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-88::INFO::2012-10-15 09:05:31,710::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/93966c50-a1ac-4735-a814-fca83010fff7/9c9137ae-bfc5-404b-a03b-b6833f61603e'} Thread-88::DEBUG::2012-10-15 09:05:31,715::task::1174::TaskManager.Task::(prepare) Task=`2966d278-190b-4ebb-92fb-b43e533f28a4`::finished: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/93966c50-a1ac-4735-a814-fca83010fff7/9c9137ae-bfc5-404b-a03b-b6833f61603e'} Thread-88::DEBUG::2012-10-15 09:05:31,716::task::588::TaskManager.Task::(_updateState) Task=`2966d278-190b-4ebb-92fb-b43e533f28a4`::moving from state preparing -> state finished Thread-88::DEBUG::2012-10-15 09:05:31,716::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-88::DEBUG::2012-10-15 09:05:31,717::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-88::DEBUG::2012-10-15 09:05:31,718::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-88::DEBUG::2012-10-15 09:05:31,719::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (4 active users) Thread-88::DEBUG::2012-10-15 09:05:31,719::task::980::TaskManager.Task::(_decref) Task=`2966d278-190b-4ebb-92fb-b43e533f28a4`::ref 0 aborting False Thread-88::INFO::2012-10-15 09:05:31,719::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/93966c50-a1ac-4735-a814-fca83010fff7/9c9137ae-bfc5-404b-a03b-b6833f61603e Thread-88::INFO::2012-10-15 09:05:31,720::clientIF::606::vds::(_prepareVolumePath) prepared volume path: Thread-88::DEBUG::2012-10-15 09:05:31,725::libvirtvm::1145::vm.Vm::(_run) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`:: stage6_1 66fcf199-aa3e-4dc9-b4bf-ea91649bace4 12582912 12582912 4 93966c50-a1ac-4735-a814-fca83010fff7 hvm Red Hat RHEV Hypervisor 16-1 4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10 66fcf199-aa3e-4dc9-b4bf-ea91649bace4 Opteron_G3 Thread-117::DEBUG::2012-10-15 09:05:31,738::clientIF::76::vds::(wrapper) [172.16.101.90]::call create with ({'bridge': 'VLAN_242', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '4', 'macAddr': '52:54:00:d5:91:74', 'boot': 'c', 'custom': {}, 'vmType': 'kvm', 'memSize': 2000, 'smpCoresPerSocket': '1', 'vmName': 'nba-emea', 'spiceMonitors': '1', 'nice': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': 'eb184918-d1ca-4934-953b-7626056a0194', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'nicModel': 'pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'timeOffset': '-217', 'spiceSecureChannels': 'smain,sinputs', 'display': 'qxl'},) {} Thread-117::INFO::2012-10-15 09:05:31,845::clientIF::712::vds::(create) vmContainerLock acquired by vm ea6e0e35-b833-43b3-8ddf-99f2c085fb43 Thread-118::DEBUG::2012-10-15 09:05:31,859::vm::512::vm.Vm::(_startUnderlyingVm) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Start Thread-117::DEBUG::2012-10-15 09:05:31,859::clientIF::725::vds::(create) Total desktops after creation of ea6e0e35-b833-43b3-8ddf-99f2c085fb43 is 8 Thread-117::DEBUG::2012-10-15 09:05:31,862::clientIF::81::vds::(wrapper) return create with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'bridge': 'VLAN_242', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'pid': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': 'eb184918-d1ca-4934-953b-7626056a0194', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'transparentHugePages': 'true', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'custom': {}, 'clientIp': '', 'nicModel': 'pv', 'macAddr': '52:54:00:d5:91:74', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'boot': 'c', 'smp': '4', 'vmType': 'kvm', 'timeOffset': '-217', 'memSize': 2000, 'displayIp': '172.16.101.102', 'spiceSecureChannels': 'smain,sinputs', 'smpCoresPerSocket': '1', 'vmName': 'nba-emea', 'display': 'qxl', 'spiceMonitors': '1', 'nice': '0'}} Thread-118::DEBUG::2012-10-15 09:05:31,863::vm::516::vm.Vm::(_startUnderlyingVm) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::_ongoingCreations acquired Thread-118::INFO::2012-10-15 09:05:31,865::libvirtvm::1105::vm.Vm::(_run) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::VM wrapper has started Thread-118::DEBUG::2012-10-15 09:05:31,866::task::588::TaskManager.Task::(_updateState) Task=`ff369757-c5f3-4891-9a20-c3e630445e29`::moving from state init -> state preparing Thread-118::INFO::2012-10-15 09:05:31,867::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='c0ce18f3-31a7-4f67-8026-db6a49a50c96', volUUID='eb184918-d1ca-4934-953b-7626056a0194', options=None) Thread-118::DEBUG::2012-10-15 09:05:31,867::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`9c17838f-1ecb-4973-9d76-7b745d4ebc6a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-118::DEBUG::2012-10-15 09:05:31,867::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-118::DEBUG::2012-10-15 09:05:31,868::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (5 active users) Thread-118::DEBUG::2012-10-15 09:05:31,868::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`9c17838f-1ecb-4973-9d76-7b745d4ebc6a`::Granted request Thread-118::DEBUG::2012-10-15 09:05:31,868::task::819::TaskManager.Task::(resourceAcquired) Task=`ff369757-c5f3-4891-9a20-c3e630445e29`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-118::DEBUG::2012-10-15 09:05:31,869::task::980::TaskManager.Task::(_decref) Task=`ff369757-c5f3-4891-9a20-c3e630445e29`::ref 1 aborting False Thread-118::INFO::2012-10-15 09:05:31,869::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-118::DEBUG::2012-10-15 09:05:31,869::task::1174::TaskManager.Task::(prepare) Task=`ff369757-c5f3-4891-9a20-c3e630445e29`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-118::DEBUG::2012-10-15 09:05:31,869::task::588::TaskManager.Task::(_updateState) Task=`ff369757-c5f3-4891-9a20-c3e630445e29`::moving from state preparing -> state finished Thread-118::DEBUG::2012-10-15 09:05:31,870::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-118::DEBUG::2012-10-15 09:05:31,870::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-118::DEBUG::2012-10-15 09:05:31,870::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-118::DEBUG::2012-10-15 09:05:31,870::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (4 active users) Thread-118::DEBUG::2012-10-15 09:05:31,871::task::980::TaskManager.Task::(_decref) Task=`ff369757-c5f3-4891-9a20-c3e630445e29`::ref 0 aborting False Thread-118::DEBUG::2012-10-15 09:05:31,871::task::588::TaskManager.Task::(_updateState) Task=`5cb119e1-fccf-4a54-aa8d-55298bb65e09`::moving from state init -> state preparing Thread-118::INFO::2012-10-15 09:05:31,871::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', options=None) Thread-118::INFO::2012-10-15 09:05:31,871::blockSD::695::Storage.StorageDomain::(validate) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-118::DEBUG::2012-10-15 09:05:31,872::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:31,902::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-106::DEBUG::2012-10-15 09:05:31,937::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-111::DEBUG::2012-10-15 09:05:31,962::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-106::DEBUG::2012-10-15 09:05:31,964::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-92::INFO::2012-10-15 09:05:31,968::logUtils::39::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None Thread-92::DEBUG::2012-10-15 09:05:32,062::task::1174::TaskManager.Task::(prepare) Task=`ce6fade2-9d7e-41ec-9658-94c6d6264d2b`::finished: None Thread-92::DEBUG::2012-10-15 09:05:32,235::task::588::TaskManager.Task::(_updateState) Task=`ce6fade2-9d7e-41ec-9658-94c6d6264d2b`::moving from state preparing -> state finished Thread-111::DEBUG::2012-10-15 09:05:32,298::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-92::DEBUG::2012-10-15 09:05:32,299::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-118::DEBUG::2012-10-15 09:05:32,305::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-111::DEBUG::2012-10-15 09:05:32,307::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=59 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:32,308::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-106::DEBUG::2012-10-15 09:05:32,309::lvm::478::OperationMutex::(_invalidatelvs) Got the operational mutex Thread-97::DEBUG::2012-10-15 09:05:32,311::lvm::478::OperationMutex::(_invalidatelvs) Got the operational mutex Thread-92::DEBUG::2012-10-15 09:05:32,321::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-106::INFO::2012-10-15 09:05:32,326::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/f6af481f-89da-40ef-943a-dd46b500af45 Thread-97::DEBUG::2012-10-15 09:05:32,327::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-92::DEBUG::2012-10-15 09:05:32,329::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-118::DEBUG::2012-10-15 09:05:32,331::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-106::DEBUG::2012-10-15 09:05:32,334::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:32,333::task::980::TaskManager.Task::(_decref) Task=`ce6fade2-9d7e-41ec-9658-94c6d6264d2b`::ref 0 aborting False Thread-97::DEBUG::2012-10-15 09:05:32,338::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-92::DEBUG::2012-10-15 09:05:32,340::task::588::TaskManager.Task::(_updateState) Task=`4f10b4ab-63fe-452d-89d4-f45bfb458308`::moving from state init -> state preparing Thread-118::DEBUG::2012-10-15 09:05:32,342::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-92::INFO::2012-10-15 09:05:32,343::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='e2059ec7-8dc5-4058-bab8-73762de5e0f5', volUUID='5540600c-b4fd-4546-ae5c-6310b2d25eef', options=None) Thread-97::DEBUG::2012-10-15 09:05:32,345::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-97::DEBUG::2012-10-15 09:05:32,348::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-106::DEBUG::2012-10-15 09:05:32,349::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-92::DEBUG::2012-10-15 09:05:32,349::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`bf46581a-1bcb-4856-9af3-63662e8fb942`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2400' at 'getVolumePath' Thread-118::DEBUG::2012-10-15 09:05:32,351::lvm::352::OperationMutex::(_reloadvgs) Got the operational mutex Thread-106::DEBUG::2012-10-15 09:05:32,364::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:32,371::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-111::DEBUG::2012-10-15 09:05:32,376::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000732583 s, 699 kB/s\n'; = 0 Thread-118::DEBUG::2012-10-15 09:05:32,377::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:32,388::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000732583 s, 699 kB/s'], size: 512 Thread-92::DEBUG::2012-10-15 09:05:32,392::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-111::DEBUG::2012-10-15 09:05:32,393::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-92::DEBUG::2012-10-15 09:05:32,409::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`bf46581a-1bcb-4856-9af3-63662e8fb942`::Granted request Thread-111::DEBUG::2012-10-15 09:05:32,412::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:32,434::task::819::TaskManager.Task::(resourceAcquired) Task=`4f10b4ab-63fe-452d-89d4-f45bfb458308`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-92::DEBUG::2012-10-15 09:05:32,437::task::980::TaskManager.Task::(_decref) Task=`4f10b4ab-63fe-452d-89d4-f45bfb458308`::ref 1 aborting False Thread-121::DEBUG::2012-10-15 09:05:32,448::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-121::DEBUG::2012-10-15 09:05:32,449::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::CPU stats not available Thread-121::DEBUG::2012-10-15 09:05:32,450::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-121::DEBUG::2012-10-15 09:05:32,450::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-121::DEBUG::2012-10-15 09:05:32,451::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-121::DEBUG::2012-10-15 09:05:32,451::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-121::DEBUG::2012-10-15 09:05:32,452::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.19', 'cpuIdle': '100.00', 'elapsedTime': '23', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-122::DEBUG::2012-10-15 09:05:32,463::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-122::DEBUG::2012-10-15 09:05:32,464::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::CPU stats not available Thread-122::DEBUG::2012-10-15 09:05:32,465::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Network stats not available Thread-122::DEBUG::2012-10-15 09:05:32,465::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-122::DEBUG::2012-10-15 09:05:32,469::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-122::DEBUG::2012-10-15 09:05:32,469::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-122::DEBUG::2012-10-15 09:05:32,470::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-122::DEBUG::2012-10-15 09:05:32,471::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'state': 'unknown', 'macAddr': '00:1a:4a:10:01:02', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '0.27', 'cpuIdle': '100.00', 'elapsedTime': '20', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-106::DEBUG::2012-10-15 09:05:32,765::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-118::DEBUG::2012-10-15 09:05:32,999::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-106::DEBUG::2012-10-15 09:05:33,142::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=58 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-118::DEBUG::2012-10-15 09:05:33,152::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-118::DEBUG::2012-10-15 09:05:33,203::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2595314d-80a9-409a-816f-a3f805fa8f53`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2032' at 'getStorageDomainInfo' Thread-92::INFO::2012-10-15 09:05:33,237::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/e2059ec7-8dc5-4058-bab8-73762de5e0f5/5540600c-b4fd-4546-ae5c-6310b2d25eef'} Thread-111::DEBUG::2012-10-15 09:05:33,242::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-97::DEBUG::2012-10-15 09:05:33,246::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-118::DEBUG::2012-10-15 09:05:33,249::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-92::DEBUG::2012-10-15 09:05:33,248::task::1174::TaskManager.Task::(prepare) Task=`4f10b4ab-63fe-452d-89d4-f45bfb458308`::finished: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/e2059ec7-8dc5-4058-bab8-73762de5e0f5/5540600c-b4fd-4546-ae5c-6310b2d25eef'} Thread-106::DEBUG::2012-10-15 09:05:33,269::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000860923 s, 595 kB/s\n'; = 0 Thread-111::DEBUG::2012-10-15 09:05:33,615::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=59 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:33,862::task::588::TaskManager.Task::(_updateState) Task=`4f10b4ab-63fe-452d-89d4-f45bfb458308`::moving from state preparing -> state finished Thread-118::DEBUG::2012-10-15 09:05:33,863::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (5 active users) Thread-106::DEBUG::2012-10-15 09:05:33,864::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000860923 s, 595 kB/s'], size: 512 Thread-97::DEBUG::2012-10-15 09:05:33,971::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-92::DEBUG::2012-10-15 09:05:33,989::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-106::DEBUG::2012-10-15 09:05:33,992::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=58 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-118::DEBUG::2012-10-15 09:05:33,995::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2595314d-80a9-409a-816f-a3f805fa8f53`::Granted request Thread-97::DEBUG::2012-10-15 09:05:34,003::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.1be33b9b-4efe-495d-95db-4a983e1396a4' is free. Now locking as 'exclusive' (1 active user) Thread-111::DEBUG::2012-10-15 09:05:34,005::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00072019 s, 711 kB/s\n'; = 0 Thread-92::DEBUG::2012-10-15 09:05:34,007::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-97::DEBUG::2012-10-15 09:05:34,035::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.1be33b9b-4efe-495d-95db-4a983e1396a4`ReqID=`6d47453b-cdd8-4d56-9eb8-d4390c0ede52`::Granted request Thread-111::DEBUG::2012-10-15 09:05:34,046::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00072019 s, 711 kB/s'], size: 512 Thread-111::INFO::2012-10-15 09:05:34,060::image::354::Storage.Image::(getChain) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 imgUUID=0587da1b-6e3d-436b-aa1a-16baa05f5cdb chain=[] Thread-92::DEBUG::2012-10-15 09:05:34,061::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-118::DEBUG::2012-10-15 09:05:34,062::task::819::TaskManager.Task::(resourceAcquired) Task=`5cb119e1-fccf-4a54-aa8d-55298bb65e09`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-111::DEBUG::2012-10-15 09:05:34,074::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/4033677e-6930-4582-aa90-1b90f8ff38ee' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:34,079::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=39 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-106::DEBUG::2012-10-15 09:05:34,082::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000858219 s, 597 kB/s\n'; = 0 Thread-92::DEBUG::2012-10-15 09:05:34,084::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (4 active users) Thread-118::DEBUG::2012-10-15 09:05:34,085::task::980::TaskManager.Task::(_decref) Task=`5cb119e1-fccf-4a54-aa8d-55298bb65e09`::ref 1 aborting False Thread-106::DEBUG::2012-10-15 09:05:34,130::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000858219 s, 597 kB/s'], size: 512 Thread-92::DEBUG::2012-10-15 09:05:34,151::task::980::TaskManager.Task::(_decref) Task=`4f10b4ab-63fe-452d-89d4-f45bfb458308`::ref 0 aborting False Thread-106::DEBUG::2012-10-15 09:05:34,163::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.f6af481f-89da-40ef-943a-dd46b500af45`ReqID=`e3f4decb-1eec-4b5c-b343-8cc0fccccb28`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-92::INFO::2012-10-15 09:05:34,164::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/e2059ec7-8dc5-4058-bab8-73762de5e0f5/5540600c-b4fd-4546-ae5c-6310b2d25eef Thread-118::INFO::2012-10-15 09:05:34,169::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-97::DEBUG::2012-10-15 09:05:34,169::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000842865 s, 607 kB/s\n'; = 0 Thread-106::DEBUG::2012-10-15 09:05:34,171::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.f6af481f-89da-40ef-943a-dd46b500af45' for lock type 'exclusive' Thread-92::INFO::2012-10-15 09:05:34,175::clientIF::606::vds::(_prepareVolumePath) prepared volume path: Thread-118::DEBUG::2012-10-15 09:05:34,179::task::1174::TaskManager.Task::(prepare) Task=`5cb119e1-fccf-4a54-aa8d-55298bb65e09`::finished: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-97::DEBUG::2012-10-15 09:05:34,183::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000842865 s, 607 kB/s'], size: 512 Thread-118::DEBUG::2012-10-15 09:05:34,223::task::588::TaskManager.Task::(_updateState) Task=`5cb119e1-fccf-4a54-aa8d-55298bb65e09`::moving from state preparing -> state finished Thread-106::DEBUG::2012-10-15 09:05:34,226::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission rw ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/f6af481f-89da-40ef-943a-dd46b500af45' (cwd None) Thread-92::DEBUG::2012-10-15 09:05:34,229::libvirtvm::1145::vm.Vm::(_run) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`:: stage6_4 08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab 3584000 3584000 4 e2059ec7-8dc5-4058-bab8-73762de5e0f5 hvm Red Hat RHEV Hypervisor 16-1 4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10 08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab Opteron_G3 Thread-118::DEBUG::2012-10-15 09:05:34,232::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-97::INFO::2012-10-15 09:05:34,235::logUtils::39::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None Thread-118::DEBUG::2012-10-15 09:05:34,260::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-97::DEBUG::2012-10-15 09:05:34,265::task::1174::TaskManager.Task::(prepare) Task=`7989624e-b86c-4f8c-a3fe-51cd8dd9b8bb`::finished: None Thread-118::DEBUG::2012-10-15 09:05:34,272::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-97::DEBUG::2012-10-15 09:05:34,274::task::588::TaskManager.Task::(_updateState) Task=`7989624e-b86c-4f8c-a3fe-51cd8dd9b8bb`::moving from state preparing -> state finished Thread-118::DEBUG::2012-10-15 09:05:34,278::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-97::DEBUG::2012-10-15 09:05:34,280::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-118::DEBUG::2012-10-15 09:05:34,283::task::980::TaskManager.Task::(_decref) Task=`5cb119e1-fccf-4a54-aa8d-55298bb65e09`::ref 0 aborting False Thread-97::DEBUG::2012-10-15 09:05:34,285::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-118::DEBUG::2012-10-15 09:05:34,289::task::588::TaskManager.Task::(_updateState) Task=`8faccd7d-ca40-4ac9-a0dd-da6eca689dda`::moving from state init -> state preparing Thread-97::DEBUG::2012-10-15 09:05:34,291::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-118::INFO::2012-10-15 09:05:34,295::logUtils::37::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='c0ce18f3-31a7-4f67-8026-db6a49a50c96', volUUID='eb184918-d1ca-4934-953b-7626056a0194', rw=True, options=None) Thread-97::DEBUG::2012-10-15 09:05:34,300::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (2 active users) Thread-118::DEBUG::2012-10-15 09:05:34,310::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`0204f447-6956-4a28-b798-2d099b4a8784`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2423' at 'prepareVolume' Thread-97::DEBUG::2012-10-15 09:05:34,313::task::980::TaskManager.Task::(_decref) Task=`7989624e-b86c-4f8c-a3fe-51cd8dd9b8bb`::ref 0 aborting False Thread-118::DEBUG::2012-10-15 09:05:34,314::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-97::DEBUG::2012-10-15 09:05:34,317::task::588::TaskManager.Task::(_updateState) Task=`49248ea1-1444-40fc-a215-56752afd50de`::moving from state init -> state preparing Thread-118::DEBUG::2012-10-15 09:05:34,319::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (3 active users) Thread-97::INFO::2012-10-15 09:05:34,322::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='9a4ceabd-615d-430b-9dc5-ec94079581e1', volUUID='1be33b9b-4efe-495d-95db-4a983e1396a4', options=None) Thread-118::DEBUG::2012-10-15 09:05:34,323::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`0204f447-6956-4a28-b798-2d099b4a8784`::Granted request Thread-97::DEBUG::2012-10-15 09:05:34,326::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`8e91bd2a-0c76-48bd-aaf6-9dcdd6e014b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2400' at 'getVolumePath' Thread-118::DEBUG::2012-10-15 09:05:34,330::task::819::TaskManager.Task::(resourceAcquired) Task=`8faccd7d-ca40-4ac9-a0dd-da6eca689dda`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-97::DEBUG::2012-10-15 09:05:34,332::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-118::DEBUG::2012-10-15 09:05:34,334::task::980::TaskManager.Task::(_decref) Task=`8faccd7d-ca40-4ac9-a0dd-da6eca689dda`::ref 1 aborting False Thread-97::DEBUG::2012-10-15 09:05:34,337::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-118::DEBUG::2012-10-15 09:05:34,340::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.c0ce18f3-31a7-4f67-8026-db6a49a50c96`ReqID=`bdff4ac0-167d-40c2-8e1f-5ff7e638ac3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2428' at 'prepareVolume' Thread-97::DEBUG::2012-10-15 09:05:34,342::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`8e91bd2a-0c76-48bd-aaf6-9dcdd6e014b9`::Granted request Thread-118::DEBUG::2012-10-15 09:05:34,344::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.c0ce18f3-31a7-4f67-8026-db6a49a50c96' for lock type 'exclusive' Thread-97::DEBUG::2012-10-15 09:05:34,349::task::819::TaskManager.Task::(resourceAcquired) Task=`49248ea1-1444-40fc-a215-56752afd50de`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-97::DEBUG::2012-10-15 09:05:34,351::task::980::TaskManager.Task::(_decref) Task=`49248ea1-1444-40fc-a215-56752afd50de`::ref 1 aborting False Thread-97::INFO::2012-10-15 09:05:34,354::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/9a4ceabd-615d-430b-9dc5-ec94079581e1/1be33b9b-4efe-495d-95db-4a983e1396a4'} Thread-97::DEBUG::2012-10-15 09:05:34,355::task::1174::TaskManager.Task::(prepare) Task=`49248ea1-1444-40fc-a215-56752afd50de`::finished: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/9a4ceabd-615d-430b-9dc5-ec94079581e1/1be33b9b-4efe-495d-95db-4a983e1396a4'} Thread-97::DEBUG::2012-10-15 09:05:34,357::task::588::TaskManager.Task::(_updateState) Task=`49248ea1-1444-40fc-a215-56752afd50de`::moving from state preparing -> state finished Thread-97::DEBUG::2012-10-15 09:05:34,358::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-97::DEBUG::2012-10-15 09:05:34,359::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-97::DEBUG::2012-10-15 09:05:34,361::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-97::DEBUG::2012-10-15 09:05:34,362::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-97::DEBUG::2012-10-15 09:05:34,364::task::980::TaskManager.Task::(_decref) Task=`49248ea1-1444-40fc-a215-56752afd50de`::ref 0 aborting False Thread-97::INFO::2012-10-15 09:05:34,366::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/9a4ceabd-615d-430b-9dc5-ec94079581e1/1be33b9b-4efe-495d-95db-4a983e1396a4 Thread-97::INFO::2012-10-15 09:05:34,367::clientIF::606::vds::(_prepareVolumePath) prepared volume path: Thread-97::DEBUG::2012-10-15 09:05:34,395::libvirtvm::1145::vm.Vm::(_run) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`:: stage7-2 3a53bfa7-943b-4162-b570-997f548ed5ee 3584000 3584000 4 9a4ceabd-615d-430b-9dc5-ec94079581e1 hvm Red Hat RHEV Hypervisor 16-1 4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10 3a53bfa7-943b-4162-b570-997f548ed5ee Opteron_G3 Thread-123::DEBUG::2012-10-15 09:05:34,490::clientIF::76::vds::(wrapper) [172.16.101.90]::call create with ({'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '2', 'macAddr': '00:1a:4a:10:01:0d', 'boot': 'cd', 'custom': {}, 'vmType': 'kvm', 'memSize': 12288, 'smpCoresPerSocket': '1', 'vmName': 'devportal01', 'spiceMonitors': '1', 'nice': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '27ab4d15-dbee-4e8e-87ae-cabdfa95cd02', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'nicModel': 'pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'timeOffset': '-208', 'spiceSecureChannels': 'smain,sinputs', 'display': 'qxl'},) {} Thread-123::INFO::2012-10-15 09:05:34,609::clientIF::712::vds::(create) vmContainerLock acquired by vm a74d3ee7-16ee-4f01-a7cd-ae929a136915 Thread-124::DEBUG::2012-10-15 09:05:34,627::vm::512::vm.Vm::(_startUnderlyingVm) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Start Thread-123::DEBUG::2012-10-15 09:05:34,629::clientIF::725::vds::(create) Total desktops after creation of a74d3ee7-16ee-4f01-a7cd-ae929a136915 is 9 Thread-124::DEBUG::2012-10-15 09:05:34,631::vm::516::vm.Vm::(_startUnderlyingVm) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::_ongoingCreations acquired Thread-123::DEBUG::2012-10-15 09:05:34,634::clientIF::81::vds::(wrapper) return create with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'pid': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': '27ab4d15-dbee-4e8e-87ae-cabdfa95cd02', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'transparentHugePages': 'true', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'custom': {}, 'clientIp': '', 'nicModel': 'pv', 'macAddr': '00:1a:4a:10:01:0d', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'boot': 'cd', 'smp': '2', 'vmType': 'kvm', 'timeOffset': '-208', 'memSize': 12288, 'displayIp': '172.16.101.102', 'spiceSecureChannels': 'smain,sinputs', 'smpCoresPerSocket': '1', 'vmName': 'devportal01', 'display': 'qxl', 'spiceMonitors': '1', 'nice': '0'}} Thread-124::INFO::2012-10-15 09:05:34,637::libvirtvm::1105::vm.Vm::(_run) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::VM wrapper has started Thread-124::DEBUG::2012-10-15 09:05:34,649::task::588::TaskManager.Task::(_updateState) Task=`f0120bb5-9897-4f29-a5a6-a9d4f2dfad35`::moving from state init -> state preparing Thread-124::INFO::2012-10-15 09:05:34,652::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='6db264ea-c386-4b44-80a4-7af6fef85578', volUUID='27ab4d15-dbee-4e8e-87ae-cabdfa95cd02', options=None) Thread-124::DEBUG::2012-10-15 09:05:34,655::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`869f5d25-3de0-4c27-b5d7-519d2c22a2e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-124::DEBUG::2012-10-15 09:05:34,657::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-124::DEBUG::2012-10-15 09:05:34,658::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-124::DEBUG::2012-10-15 09:05:34,660::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`869f5d25-3de0-4c27-b5d7-519d2c22a2e5`::Granted request Thread-124::DEBUG::2012-10-15 09:05:34,663::task::819::TaskManager.Task::(resourceAcquired) Task=`f0120bb5-9897-4f29-a5a6-a9d4f2dfad35`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-124::DEBUG::2012-10-15 09:05:34,668::task::980::TaskManager.Task::(_decref) Task=`f0120bb5-9897-4f29-a5a6-a9d4f2dfad35`::ref 1 aborting False Thread-124::INFO::2012-10-15 09:05:34,671::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-124::DEBUG::2012-10-15 09:05:34,674::task::1174::TaskManager.Task::(prepare) Task=`f0120bb5-9897-4f29-a5a6-a9d4f2dfad35`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-124::DEBUG::2012-10-15 09:05:34,676::task::588::TaskManager.Task::(_updateState) Task=`f0120bb5-9897-4f29-a5a6-a9d4f2dfad35`::moving from state preparing -> state finished Thread-124::DEBUG::2012-10-15 09:05:34,677::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-124::DEBUG::2012-10-15 09:05:34,678::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-124::DEBUG::2012-10-15 09:05:34,680::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-124::DEBUG::2012-10-15 09:05:34,682::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-124::DEBUG::2012-10-15 09:05:34,684::task::980::TaskManager.Task::(_decref) Task=`f0120bb5-9897-4f29-a5a6-a9d4f2dfad35`::ref 0 aborting False Thread-124::DEBUG::2012-10-15 09:05:34,696::task::588::TaskManager.Task::(_updateState) Task=`1a19b254-aa3c-43f9-b324-0b5457f1ae7e`::moving from state init -> state preparing Thread-124::INFO::2012-10-15 09:05:34,701::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', options=None) Thread-124::INFO::2012-10-15 09:05:34,703::blockSD::695::Storage.StorageDomain::(validate) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-124::DEBUG::2012-10-15 09:05:34,707::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-124::DEBUG::2012-10-15 09:05:34,711::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-127::DEBUG::2012-10-15 09:05:34,714::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-124::DEBUG::2012-10-15 09:05:34,718::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-127::DEBUG::2012-10-15 09:05:34,721::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::CPU stats not available Thread-127::DEBUG::2012-10-15 09:05:34,727::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-124::DEBUG::2012-10-15 09:05:34,731::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-127::DEBUG::2012-10-15 09:05:34,733::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-124::DEBUG::2012-10-15 09:05:34,735::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-127::DEBUG::2012-10-15 09:05:34,738::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-124::DEBUG::2012-10-15 09:05:34,742::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-127::DEBUG::2012-10-15 09:05:34,743::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-127::DEBUG::2012-10-15 09:05:34,766::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.45', 'cpuIdle': '100.00', 'elapsedTime': '25', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-128::DEBUG::2012-10-15 09:05:34,802::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-128::DEBUG::2012-10-15 09:05:34,805::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'WaitForLaunch', 'acpiEnable': 'true', 'pid': '0', 'displayIp': '172.16.101.102', 'displayPort': '-1', 'displaySecurePort': '-1', 'timeOffset': '-208', 'kvmEnable': 'true', 'network': {}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'disks': {}, 'boot': 'cd', 'elapsedTime': '0', 'vmType': 'kvm', 'clientIp': '', 'displayType': 'qxl', 'nice': ''}]} Thread-129::DEBUG::2012-10-15 09:05:34,830::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-129::DEBUG::2012-10-15 09:05:34,832::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::CPU stats not available Thread-129::DEBUG::2012-10-15 09:05:34,834::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-129::DEBUG::2012-10-15 09:05:34,836::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-129::DEBUG::2012-10-15 09:05:34,837::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-129::DEBUG::2012-10-15 09:05:34,839::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-129::DEBUG::2012-10-15 09:05:34,840::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '0.86', 'cpuIdle': '100.00', 'elapsedTime': '22', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-111::DEBUG::2012-10-15 09:05:35,023::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-111::DEBUG::2012-10-15 09:05:35,026::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-106::DEBUG::2012-10-15 09:05:35,165::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "f6af481f-89da-40ef-943a-dd46b500af45" is already writable\n'; = 5 Thread-106::DEBUG::2012-10-15 09:05:35,184::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-124::DEBUG::2012-10-15 09:05:35,292::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-124::DEBUG::2012-10-15 09:05:35,300::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-111::DEBUG::2012-10-15 09:05:35,304::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-124::DEBUG::2012-10-15 09:05:35,307::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-106::DEBUG::2012-10-15 09:05:35,310::lvm::478::OperationMutex::(_invalidatelvs) Got the operational mutex Thread-124::DEBUG::2012-10-15 09:05:35,319::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`b53c927e-3726-418f-bc85-e557e354d843`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2032' at 'getStorageDomainInfo' Thread-106::DEBUG::2012-10-15 09:05:35,322::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-111::DEBUG::2012-10-15 09:05:35,323::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.4033677e-6930-4582-aa90-1b90f8ff38ee`ReqID=`71241e6f-303d-47a4-bda3-1dbb62306a1a`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-124::DEBUG::2012-10-15 09:05:35,325::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-106::DEBUG::2012-10-15 09:05:35,331::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-111::DEBUG::2012-10-15 09:05:35,332::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.4033677e-6930-4582-aa90-1b90f8ff38ee' for lock type 'exclusive' Thread-124::DEBUG::2012-10-15 09:05:35,335::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-111::DEBUG::2012-10-15 09:05:35,340::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.4033677e-6930-4582-aa90-1b90f8ff38ee' is free. Now locking as 'exclusive' (1 active user) Thread-111::DEBUG::2012-10-15 09:05:35,342::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.4033677e-6930-4582-aa90-1b90f8ff38ee`ReqID=`71241e6f-303d-47a4-bda3-1dbb62306a1a`::Granted request Thread-106::DEBUG::2012-10-15 09:05:35,345::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:35,349::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.0587da1b-6e3d-436b-aa1a-16baa05f5cdb' is free. Now locking as 'exclusive' (1 active user) Thread-124::DEBUG::2012-10-15 09:05:35,350::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`b53c927e-3726-418f-bc85-e557e354d843`::Granted request Thread-111::DEBUG::2012-10-15 09:05:35,354::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.0587da1b-6e3d-436b-aa1a-16baa05f5cdb`ReqID=`c4569a14-2f96-4712-a9ae-464e7b4f5e1c`::Granted request Thread-118::DEBUG::2012-10-15 09:05:35,392::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-124::DEBUG::2012-10-15 09:05:35,396::task::819::TaskManager.Task::(resourceAcquired) Task=`1a19b254-aa3c-43f9-b324-0b5457f1ae7e`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-118::DEBUG::2012-10-15 09:05:35,404::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:35,411::task::980::TaskManager.Task::(_decref) Task=`1a19b254-aa3c-43f9-b324-0b5457f1ae7e`::ref 1 aborting False Thread-111::DEBUG::2012-10-15 09:05:35,413::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-111::DEBUG::2012-10-15 09:05:35,448::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-124::INFO::2012-10-15 09:05:35,454::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-124::DEBUG::2012-10-15 09:05:35,460::task::1174::TaskManager.Task::(prepare) Task=`1a19b254-aa3c-43f9-b324-0b5457f1ae7e`::finished: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-124::DEBUG::2012-10-15 09:05:35,484::task::588::TaskManager.Task::(_updateState) Task=`1a19b254-aa3c-43f9-b324-0b5457f1ae7e`::moving from state preparing -> state finished Thread-124::DEBUG::2012-10-15 09:05:35,491::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-124::DEBUG::2012-10-15 09:05:35,493::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-124::DEBUG::2012-10-15 09:05:35,496::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-124::DEBUG::2012-10-15 09:05:35,499::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-124::DEBUG::2012-10-15 09:05:35,502::task::980::TaskManager.Task::(_decref) Task=`1a19b254-aa3c-43f9-b324-0b5457f1ae7e`::ref 0 aborting False Thread-124::DEBUG::2012-10-15 09:05:35,507::task::588::TaskManager.Task::(_updateState) Task=`7a903a2d-9844-4e03-ba05-655fc2ea4824`::moving from state init -> state preparing Thread-124::INFO::2012-10-15 09:05:35,509::logUtils::37::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='6db264ea-c386-4b44-80a4-7af6fef85578', volUUID='27ab4d15-dbee-4e8e-87ae-cabdfa95cd02', rw=True, options=None) Thread-124::DEBUG::2012-10-15 09:05:35,512::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`3f3b16c8-6625-4ccb-8ef1-dd7d0523e619`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2423' at 'prepareVolume' Thread-124::DEBUG::2012-10-15 09:05:35,513::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-124::DEBUG::2012-10-15 09:05:35,515::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-124::DEBUG::2012-10-15 09:05:35,516::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`3f3b16c8-6625-4ccb-8ef1-dd7d0523e619`::Granted request Thread-124::DEBUG::2012-10-15 09:05:35,521::task::819::TaskManager.Task::(resourceAcquired) Task=`7a903a2d-9844-4e03-ba05-655fc2ea4824`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-124::DEBUG::2012-10-15 09:05:35,522::task::980::TaskManager.Task::(_decref) Task=`7a903a2d-9844-4e03-ba05-655fc2ea4824`::ref 1 aborting False Thread-124::DEBUG::2012-10-15 09:05:35,525::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.6db264ea-c386-4b44-80a4-7af6fef85578`ReqID=`ee0c3ed1-fd1e-4b92-bc43-38301fea4ebf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2428' at 'prepareVolume' Thread-124::DEBUG::2012-10-15 09:05:35,526::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.6db264ea-c386-4b44-80a4-7af6fef85578' for lock type 'exclusive' Thread-106::DEBUG::2012-10-15 09:05:35,878::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-106::DEBUG::2012-10-15 09:05:36,225::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.f6af481f-89da-40ef-943a-dd46b500af45' is free. Now locking as 'exclusive' (1 active user) Thread-106::DEBUG::2012-10-15 09:05:36,240::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.f6af481f-89da-40ef-943a-dd46b500af45`ReqID=`e3f4decb-1eec-4b5c-b343-8cc0fccccb28`::Granted request Thread-118::DEBUG::2012-10-15 09:05:36,260::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-106::DEBUG::2012-10-15 09:05:36,264::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=58 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:36,268::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-118::DEBUG::2012-10-15 09:05:36,826::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=33 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-106::DEBUG::2012-10-15 09:05:36,995::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000871998 s, 587 kB/s\n'; = 0 Thread-111::DEBUG::2012-10-15 09:05:36,996::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-106::DEBUG::2012-10-15 09:05:37,022::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000871998 s, 587 kB/s'], size: 512 Thread-106::INFO::2012-10-15 09:05:37,044::logUtils::39::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None Thread-111::DEBUG::2012-10-15 09:05:37,049::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/4033677e-6930-4582-aa90-1b90f8ff38ee' (cwd None) Thread-106::DEBUG::2012-10-15 09:05:37,052::task::1174::TaskManager.Task::(prepare) Task=`810f0113-c3bb-4c05-bd06-1b0e952cb064`::finished: None Thread-106::DEBUG::2012-10-15 09:05:37,063::task::588::TaskManager.Task::(_updateState) Task=`810f0113-c3bb-4c05-bd06-1b0e952cb064`::moving from state preparing -> state finished Thread-106::DEBUG::2012-10-15 09:05:37,073::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-106::DEBUG::2012-10-15 09:05:37,078::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-118::DEBUG::2012-10-15 09:05:37,110::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000767559 s, 667 kB/s\n'; = 0 Thread-106::DEBUG::2012-10-15 09:05:37,125::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-118::DEBUG::2012-10-15 09:05:37,126::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000767559 s, 667 kB/s'], size: 512 Thread-131::DEBUG::2012-10-15 09:05:37,136::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-118::DEBUG::2012-10-15 09:05:37,141::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=33 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-131::DEBUG::2012-10-15 09:05:37,150::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::CPU stats not available Thread-106::DEBUG::2012-10-15 09:05:37,145::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-131::DEBUG::2012-10-15 09:05:37,154::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-131::DEBUG::2012-10-15 09:05:37,175::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-106::DEBUG::2012-10-15 09:05:37,190::task::980::TaskManager.Task::(_decref) Task=`810f0113-c3bb-4c05-bd06-1b0e952cb064`::ref 0 aborting False Thread-131::DEBUG::2012-10-15 09:05:37,193::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-106::DEBUG::2012-10-15 09:05:37,203::task::588::TaskManager.Task::(_updateState) Task=`8e62d00c-0b69-406e-b61a-9dcd355981cb`::moving from state init -> state preparing Thread-131::DEBUG::2012-10-15 09:05:37,205::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-106::INFO::2012-10-15 09:05:37,208::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='61e6b472-42e2-453a-b58e-ab437940cb3d', volUUID='f6af481f-89da-40ef-943a-dd46b500af45', options=None) Thread-131::DEBUG::2012-10-15 09:05:37,211::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.77', 'cpuIdle': '100.00', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-106::DEBUG::2012-10-15 09:05:37,229::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`846c8b8d-5dfb-4db1-b523-93435985cb9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2400' at 'getVolumePath' Thread-118::DEBUG::2012-10-15 09:05:37,235::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000755297 s, 678 kB/s\n'; = 0 Thread-106::DEBUG::2012-10-15 09:05:37,240::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-118::DEBUG::2012-10-15 09:05:37,249::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000755297 s, 678 kB/s'], size: 512 Thread-118::INFO::2012-10-15 09:05:37,253::image::354::Storage.Image::(getChain) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 imgUUID=c0ce18f3-31a7-4f67-8026-db6a49a50c96 chain=[] Thread-118::DEBUG::2012-10-15 09:05:37,258::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/eb184918-d1ca-4934-953b-7626056a0194' (cwd None) Thread-106::DEBUG::2012-10-15 09:05:37,261::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-132::DEBUG::2012-10-15 09:05:37,265::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-106::DEBUG::2012-10-15 09:05:37,295::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`846c8b8d-5dfb-4db1-b523-93435985cb9c`::Granted request Thread-132::DEBUG::2012-10-15 09:05:37,302::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::CPU stats not available Thread-132::DEBUG::2012-10-15 09:05:37,314::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-132::DEBUG::2012-10-15 09:05:37,317::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-132::DEBUG::2012-10-15 09:05:37,320::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-132::DEBUG::2012-10-15 09:05:37,322::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-106::DEBUG::2012-10-15 09:05:37,325::task::819::TaskManager.Task::(resourceAcquired) Task=`8e62d00c-0b69-406e-b61a-9dcd355981cb`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-132::DEBUG::2012-10-15 09:05:37,331::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '2.31', 'cpuIdle': '100.00', 'elapsedTime': '25', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-106::DEBUG::2012-10-15 09:05:37,335::task::980::TaskManager.Task::(_decref) Task=`8e62d00c-0b69-406e-b61a-9dcd355981cb`::ref 1 aborting False Thread-106::INFO::2012-10-15 09:05:37,352::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/61e6b472-42e2-453a-b58e-ab437940cb3d/f6af481f-89da-40ef-943a-dd46b500af45'} Thread-106::DEBUG::2012-10-15 09:05:37,355::task::1174::TaskManager.Task::(prepare) Task=`8e62d00c-0b69-406e-b61a-9dcd355981cb`::finished: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/61e6b472-42e2-453a-b58e-ab437940cb3d/f6af481f-89da-40ef-943a-dd46b500af45'} Thread-106::DEBUG::2012-10-15 09:05:37,357::task::588::TaskManager.Task::(_updateState) Task=`8e62d00c-0b69-406e-b61a-9dcd355981cb`::moving from state preparing -> state finished Thread-106::DEBUG::2012-10-15 09:05:37,358::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-106::DEBUG::2012-10-15 09:05:37,360::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-106::DEBUG::2012-10-15 09:05:37,364::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-106::DEBUG::2012-10-15 09:05:37,366::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-106::DEBUG::2012-10-15 09:05:37,368::task::980::TaskManager.Task::(_decref) Task=`8e62d00c-0b69-406e-b61a-9dcd355981cb`::ref 0 aborting False Thread-106::INFO::2012-10-15 09:05:37,370::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/61e6b472-42e2-453a-b58e-ab437940cb3d/f6af481f-89da-40ef-943a-dd46b500af45 Thread-106::INFO::2012-10-15 09:05:37,372::clientIF::606::vds::(_prepareVolumePath) prepared volume path: Thread-106::DEBUG::2012-10-15 09:05:37,407::libvirtvm::1145::vm.Vm::(_run) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`:: stageportal01 e454d24b-7675-4cbc-8ad2-1832195ba1ff 12582912 12582912 2 61e6b472-42e2-453a-b58e-ab437940cb3d hvm Red Hat RHEV Hypervisor 16-1 4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10 e454d24b-7675-4cbc-8ad2-1832195ba1ff Opteron_G3 Thread-111::DEBUG::2012-10-15 09:05:37,814::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-111::DEBUG::2012-10-15 09:05:37,818::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-111::DEBUG::2012-10-15 09:05:37,820::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-111::INFO::2012-10-15 09:05:37,822::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/4033677e-6930-4582-aa90-1b90f8ff38ee Thread-111::DEBUG::2012-10-15 09:05:37,824::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-111::DEBUG::2012-10-15 09:05:37,827::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-118::DEBUG::2012-10-15 09:05:38,088::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-118::DEBUG::2012-10-15 09:05:38,093::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-111::DEBUG::2012-10-15 09:05:38,392::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-111::DEBUG::2012-10-15 09:05:38,724::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-111::DEBUG::2012-10-15 09:05:38,727::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=59 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-118::DEBUG::2012-10-15 09:05:38,728::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-118::DEBUG::2012-10-15 09:05:38,750::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-118::DEBUG::2012-10-15 09:05:38,759::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.eb184918-d1ca-4934-953b-7626056a0194`ReqID=`30324312-b8b3-4b52-9b12-90530cab744c`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-118::DEBUG::2012-10-15 09:05:38,760::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.eb184918-d1ca-4934-953b-7626056a0194' for lock type 'exclusive' Thread-118::DEBUG::2012-10-15 09:05:38,763::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.eb184918-d1ca-4934-953b-7626056a0194' is free. Now locking as 'exclusive' (1 active user) Thread-118::DEBUG::2012-10-15 09:05:38,764::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.eb184918-d1ca-4934-953b-7626056a0194`ReqID=`30324312-b8b3-4b52-9b12-90530cab744c`::Granted request Thread-118::DEBUG::2012-10-15 09:05:38,768::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.c0ce18f3-31a7-4f67-8026-db6a49a50c96' is free. Now locking as 'exclusive' (1 active user) Thread-118::DEBUG::2012-10-15 09:05:38,769::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.c0ce18f3-31a7-4f67-8026-db6a49a50c96`ReqID=`bdff4ac0-167d-40c2-8e1f-5ff7e638ac3e`::Granted request Thread-124::DEBUG::2012-10-15 09:05:38,776::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-124::DEBUG::2012-10-15 09:05:38,784::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-118::DEBUG::2012-10-15 09:05:38,787::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-118::DEBUG::2012-10-15 09:05:38,817::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:38,822::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00129273 s, 396 kB/s\n'; = 0 Thread-111::DEBUG::2012-10-15 09:05:38,843::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00129273 s, 396 kB/s'], size: 512 Thread-111::DEBUG::2012-10-15 09:05:38,854::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=59 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:38,919::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000694156 s, 738 kB/s\n'; = 0 Thread-111::DEBUG::2012-10-15 09:05:38,922::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000694156 s, 738 kB/s'], size: 512 Thread-111::DEBUG::2012-10-15 09:05:38,926::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.4033677e-6930-4582-aa90-1b90f8ff38ee`ReqID=`d73961a1-c372-45cd-b6f5-726d757e623e`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-111::DEBUG::2012-10-15 09:05:38,927::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.4033677e-6930-4582-aa90-1b90f8ff38ee' for lock type 'exclusive' Thread-111::DEBUG::2012-10-15 09:05:38,932::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission rw ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/4033677e-6930-4582-aa90-1b90f8ff38ee' (cwd None) libvirtEventLoop::DEBUG::2012-10-15 09:05:39,290::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::event Started detail 0 opaque None Thread-118::DEBUG::2012-10-15 09:05:39,371::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-124::DEBUG::2012-10-15 09:05:39,381::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 libvirtEventLoop::DEBUG::2012-10-15 09:05:39,885::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::event Started detail 0 opaque None Thread-118::DEBUG::2012-10-15 09:05:39,891::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/eb184918-d1ca-4934-953b-7626056a0194' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:39,897::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "4033677e-6930-4582-aa90-1b90f8ff38ee" is already writable\n'; = 5 Thread-124::DEBUG::2012-10-15 09:05:40,226::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex libvirtEventLoop::DEBUG::2012-10-15 09:05:40,230::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::event Started detail 0 opaque None Thread-134::DEBUG::2012-10-15 09:05:40,238::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-124::DEBUG::2012-10-15 09:05:40,278::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=55 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-134::DEBUG::2012-10-15 09:05:40,306::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available libvirtEventLoop::DEBUG::2012-10-15 09:05:40,370::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::event Started detail 0 opaque None Thread-88::DEBUG::2012-10-15 09:05:40,381::utils::323::vm.Vm::(start) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Start statistics collection Thread-134::DEBUG::2012-10-15 09:05:40,387::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-135::DEBUG::2012-10-15 09:05:40,434::utils::352::vm.Vm::(run) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Stats thread started Thread-134::DEBUG::2012-10-15 09:05:40,435::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-134::DEBUG::2012-10-15 09:05:40,466::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-136::DEBUG::2012-10-15 09:05:40,471::guestIF::67::root::(_connect) Attempting connection to /var/lib/libvirt/qemu/channels/stage6_1.com.redhat.rhevm.vdsm Thread-135::DEBUG::2012-10-15 09:05:40,470::task::588::TaskManager.Task::(_updateState) Task=`59676f86-cffe-448d-a524-bd73b1d7a4ee`::moving from state init -> state preparing Thread-134::DEBUG::2012-10-15 09:05:40,479::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '80.72', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.05', 'cpuIdle': '19.28', 'elapsedTime': '31', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-124::DEBUG::2012-10-15 09:05:40,482::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000471146 s, 1.1 MB/s\n'; = 0 Thread-136::DEBUG::2012-10-15 09:05:40,484::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/prepare-vmchannel /var/lib/libvirt/qemu/channels/stage6_1.com.redhat.rhevm.vdsm' (cwd None) Thread-88::WARNING::2012-10-15 09:05:40,495::libvirtvm::1180::vm.Vm::(_readPauseCode) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::_readPauseCode unsupported by libvirt vm Thread-92::DEBUG::2012-10-15 09:05:40,506::utils::323::vm.Vm::(start) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Start statistics collection Thread-135::INFO::2012-10-15 09:05:40,507::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='93966c50-a1ac-4735-a814-fca83010fff7', volUUID='9c9137ae-bfc5-404b-a03b-b6833f61603e', options=None) Thread-97::DEBUG::2012-10-15 09:05:40,525::utils::323::vm.Vm::(start) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Start statistics collection Thread-88::DEBUG::2012-10-15 09:05:40,536::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/get-vm-pid stage6_1' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:40,537::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000471146 s, 1.1 MB/s'], size: 512 Thread-106::DEBUG::2012-10-15 09:05:40,574::utils::323::vm.Vm::(start) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Start statistics collection Thread-138::DEBUG::2012-10-15 09:05:40,580::utils::352::vm.Vm::(run) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Stats thread started Thread-135::DEBUG::2012-10-15 09:05:40,581::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`0f7cc8c0-b2ec-494c-8caa-9ae77bd36945`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-137::DEBUG::2012-10-15 09:05:40,582::utils::352::vm.Vm::(run) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Stats thread started Thread-141::DEBUG::2012-10-15 09:05:40,583::guestIF::67::root::(_connect) Attempting connection to /var/lib/libvirt/qemu/channels/stage6_4.com.redhat.rhevm.vdsm Thread-124::DEBUG::2012-10-15 09:05:40,599::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=55 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-139::DEBUG::2012-10-15 09:05:40,602::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-92::WARNING::2012-10-15 09:05:40,606::libvirtvm::1180::vm.Vm::(_readPauseCode) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::_readPauseCode unsupported by libvirt vm Thread-142::DEBUG::2012-10-15 09:05:40,606::guestIF::67::root::(_connect) Attempting connection to /var/lib/libvirt/qemu/channels/stage7-2.com.redhat.rhevm.vdsm Thread-118::DEBUG::2012-10-15 09:05:40,609::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-97::WARNING::2012-10-15 09:05:40,610::libvirtvm::1180::vm.Vm::(_readPauseCode) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::_readPauseCode unsupported by libvirt vm Thread-135::DEBUG::2012-10-15 09:05:40,615::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-138::DEBUG::2012-10-15 09:05:40,616::task::588::TaskManager.Task::(_updateState) Task=`6f9bb870-7530-4979-816c-42141dadd3d7`::moving from state init -> state preparing Thread-140::DEBUG::2012-10-15 09:05:40,696::utils::352::vm.Vm::(run) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Stats thread started Thread-138::INFO::2012-10-15 09:05:40,740::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='9a4ceabd-615d-430b-9dc5-ec94079581e1', volUUID='1be33b9b-4efe-495d-95db-4a983e1396a4', options=None) Thread-136::DEBUG::2012-10-15 09:05:40,703::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-143::DEBUG::2012-10-15 09:05:40,720::guestIF::67::root::(_connect) Attempting connection to /var/lib/libvirt/qemu/channels/stageportal01.com.redhat.rhevm.vdsm Thread-139::DEBUG::2012-10-15 09:05:40,721::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::CPU stats not available Thread-92::DEBUG::2012-10-15 09:05:40,728::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/get-vm-pid stage6_4' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:40,728::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-142::DEBUG::2012-10-15 09:05:40,730::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/prepare-vmchannel /var/lib/libvirt/qemu/channels/stage7-2.com.redhat.rhevm.vdsm' (cwd None) Thread-137::DEBUG::2012-10-15 09:05:40,731::task::588::TaskManager.Task::(_updateState) Task=`5c2a0056-4bf0-4ff3-87f7-39cdae631e3e`::moving from state init -> state preparing Thread-106::WARNING::2012-10-15 09:05:40,732::libvirtvm::1180::vm.Vm::(_readPauseCode) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::_readPauseCode unsupported by libvirt vm Thread-118::DEBUG::2012-10-15 09:05:40,735::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-97::DEBUG::2012-10-15 09:05:40,735::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/get-vm-pid stage7-2' (cwd None) Thread-135::DEBUG::2012-10-15 09:05:40,738::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-141::DEBUG::2012-10-15 09:05:40,702::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/prepare-vmchannel /var/lib/libvirt/qemu/channels/stage6_4.com.redhat.rhevm.vdsm' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:40,742::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000551106 s, 929 kB/s\n'; = 0 Thread-140::DEBUG::2012-10-15 09:05:40,744::task::588::TaskManager.Task::(_updateState) Task=`a25ad0f8-e3ae-4296-9478-26c0f0a4b7df`::moving from state init -> state preparing Thread-138::DEBUG::2012-10-15 09:05:40,745::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`dce6652c-283e-41fa-a8b6-80eb2a02133d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-136::DEBUG::2012-10-15 09:05:40,746::guestIF::73::root::(_connect) connected to /var/lib/libvirt/qemu/channels/stage6_1.com.redhat.rhevm.vdsm Thread-139::DEBUG::2012-10-15 09:05:40,747::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-143::DEBUG::2012-10-15 09:05:40,748::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/prepare-vmchannel /var/lib/libvirt/qemu/channels/stageportal01.com.redhat.rhevm.vdsm' (cwd None) Thread-139::DEBUG::2012-10-15 09:05:40,818::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-118::DEBUG::2012-10-15 09:05:40,774::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-106::DEBUG::2012-10-15 09:05:40,776::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/get-vm-pid stageportal01' (cwd None) Thread-135::DEBUG::2012-10-15 09:05:40,801::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`0f7cc8c0-b2ec-494c-8caa-9ae77bd36945`::Granted request Thread-124::DEBUG::2012-10-15 09:05:40,803::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000551106 s, 929 kB/s'], size: 512 Thread-140::INFO::2012-10-15 09:05:40,811::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='61e6b472-42e2-453a-b58e-ab437940cb3d', volUUID='f6af481f-89da-40ef-943a-dd46b500af45', options=None) Thread-92::DEBUG::2012-10-15 09:05:40,813::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-138::DEBUG::2012-10-15 09:05:40,814::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-88::DEBUG::2012-10-15 09:05:40,820::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) Thread-137::INFO::2012-10-15 09:05:40,768::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='e2059ec7-8dc5-4058-bab8-73762de5e0f5', volUUID='5540600c-b4fd-4546-ae5c-6310b2d25eef', options=None) Thread-139::DEBUG::2012-10-15 09:05:40,821::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-118::INFO::2012-10-15 09:05:40,846::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/eb184918-d1ca-4934-953b-7626056a0194 Thread-97::DEBUG::2012-10-15 09:05:40,849::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-111::DEBUG::2012-10-15 09:05:40,851::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-124::INFO::2012-10-15 09:05:40,853::image::354::Storage.Image::(getChain) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 imgUUID=6db264ea-c386-4b44-80a4-7af6fef85578 chain=[] Thread-141::DEBUG::2012-10-15 09:05:40,871::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-135::DEBUG::2012-10-15 09:05:40,876::task::819::TaskManager.Task::(resourceAcquired) Task=`59676f86-cffe-448d-a524-bd73b1d7a4ee`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-140::DEBUG::2012-10-15 09:05:40,877::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`c9edcbcf-c6f7-4bd4-9a53-7787411849cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-138::DEBUG::2012-10-15 09:05:40,881::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (5 active users) Thread-139::DEBUG::2012-10-15 09:05:40,884::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-137::DEBUG::2012-10-15 09:05:40,884::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`0f41d26b-f90a-47c8-a99f-32c5caa68aac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-143::DEBUG::2012-10-15 09:05:40,905::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-142::DEBUG::2012-10-15 09:05:40,909::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-118::DEBUG::2012-10-15 09:05:40,916::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... Thread-106::DEBUG::2012-10-15 09:05:40,921::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-124::DEBUG::2012-10-15 09:05:40,923::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/27ab4d15-dbee-4e8e-87ae-cabdfa95cd02' (cwd None) Thread-135::DEBUG::2012-10-15 09:05:40,926::task::980::TaskManager.Task::(_decref) Task=`59676f86-cffe-448d-a524-bd73b1d7a4ee`::ref 1 aborting False Thread-141::DEBUG::2012-10-15 09:05:40,928::guestIF::73::root::(_connect) connected to /var/lib/libvirt/qemu/channels/stage6_4.com.redhat.rhevm.vdsm Thread-140::DEBUG::2012-10-15 09:05:40,928::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-138::DEBUG::2012-10-15 09:05:40,929::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`dce6652c-283e-41fa-a8b6-80eb2a02133d`::Granted request Thread-139::DEBUG::2012-10-15 09:05:40,931::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '0.84', 'cpuIdle': '100.00', 'elapsedTime': '28', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-137::DEBUG::2012-10-15 09:05:40,932::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-111::DEBUG::2012-10-15 09:05:40,937::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-143::DEBUG::2012-10-15 09:05:40,939::guestIF::73::root::(_connect) connected to /var/lib/libvirt/qemu/channels/stageportal01.com.redhat.rhevm.vdsm Thread-142::DEBUG::2012-10-15 09:05:40,940::guestIF::73::root::(_connect) connected to /var/lib/libvirt/qemu/channels/stage7-2.com.redhat.rhevm.vdsm Thread-135::INFO::2012-10-15 09:05:40,942::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-140::DEBUG::2012-10-15 09:05:40,972::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (6 active users) Thread-138::DEBUG::2012-10-15 09:05:40,982::task::819::TaskManager.Task::(resourceAcquired) Task=`6f9bb870-7530-4979-816c-42141dadd3d7`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-118::DEBUG::2012-10-15 09:05:40,990::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-135::DEBUG::2012-10-15 09:05:40,992::task::1174::TaskManager.Task::(prepare) Task=`59676f86-cffe-448d-a524-bd73b1d7a4ee`::finished: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-140::DEBUG::2012-10-15 09:05:40,993::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`c9edcbcf-c6f7-4bd4-9a53-7787411849cd`::Granted request Thread-138::DEBUG::2012-10-15 09:05:40,994::task::980::TaskManager.Task::(_decref) Task=`6f9bb870-7530-4979-816c-42141dadd3d7`::ref 1 aborting False Thread-111::DEBUG::2012-10-15 09:05:41,001::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-135::DEBUG::2012-10-15 09:05:41,003::task::588::TaskManager.Task::(_updateState) Task=`59676f86-cffe-448d-a524-bd73b1d7a4ee`::moving from state preparing -> state finished Thread-118::DEBUG::2012-10-15 09:05:41,005::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-137::DEBUG::2012-10-15 09:05:41,005::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (7 active users) Thread-138::INFO::2012-10-15 09:05:41,006::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-135::DEBUG::2012-10-15 09:05:41,009::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-111::DEBUG::2012-10-15 09:05:41,008::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-140::DEBUG::2012-10-15 09:05:41,022::task::819::TaskManager.Task::(resourceAcquired) Task=`a25ad0f8-e3ae-4296-9478-26c0f0a4b7df`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-137::DEBUG::2012-10-15 09:05:41,027::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`0f41d26b-f90a-47c8-a99f-32c5caa68aac`::Granted request Thread-138::DEBUG::2012-10-15 09:05:41,029::task::1174::TaskManager.Task::(prepare) Task=`6f9bb870-7530-4979-816c-42141dadd3d7`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-135::DEBUG::2012-10-15 09:05:41,029::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-88::DEBUG::2012-10-15 09:05:41,031::utils::595::Storage.Misc.excCmd::(execCmd) FAILED: = 'Unknown operation retune\n'; = 1 Thread-140::DEBUG::2012-10-15 09:05:41,040::task::980::TaskManager.Task::(_decref) Task=`a25ad0f8-e3ae-4296-9478-26c0f0a4b7df`::ref 1 aborting False Thread-137::DEBUG::2012-10-15 09:05:41,044::task::819::TaskManager.Task::(resourceAcquired) Task=`5c2a0056-4bf0-4ff3-87f7-39cdae631e3e`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-138::DEBUG::2012-10-15 09:05:41,047::task::588::TaskManager.Task::(_updateState) Task=`6f9bb870-7530-4979-816c-42141dadd3d7`::moving from state preparing -> state finished Thread-135::DEBUG::2012-10-15 09:05:41,050::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-140::INFO::2012-10-15 09:05:41,053::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-137::DEBUG::2012-10-15 09:05:41,054::task::980::TaskManager.Task::(_decref) Task=`5c2a0056-4bf0-4ff3-87f7-39cdae631e3e`::ref 1 aborting False Thread-138::DEBUG::2012-10-15 09:05:41,056::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-135::DEBUG::2012-10-15 09:05:41,057::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (6 active users) Thread-92::DEBUG::2012-10-15 09:05:41,058::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) Thread-88::DEBUG::2012-10-15 09:05:41,059::vm::528::vm.Vm::(_startUnderlyingVm) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::_ongoingCreations released Thread-140::DEBUG::2012-10-15 09:05:41,059::task::1174::TaskManager.Task::(prepare) Task=`a25ad0f8-e3ae-4296-9478-26c0f0a4b7df`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-137::INFO::2012-10-15 09:05:41,060::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-138::DEBUG::2012-10-15 09:05:41,061::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-135::DEBUG::2012-10-15 09:05:41,062::task::980::TaskManager.Task::(_decref) Task=`59676f86-cffe-448d-a524-bd73b1d7a4ee`::ref 0 aborting False Thread-140::DEBUG::2012-10-15 09:05:41,082::task::588::TaskManager.Task::(_updateState) Task=`a25ad0f8-e3ae-4296-9478-26c0f0a4b7df`::moving from state preparing -> state finished Thread-137::DEBUG::2012-10-15 09:05:41,084::task::1174::TaskManager.Task::(prepare) Task=`5c2a0056-4bf0-4ff3-87f7-39cdae631e3e`::finished: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-138::DEBUG::2012-10-15 09:05:41,088::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-137::DEBUG::2012-10-15 09:05:41,094::task::588::TaskManager.Task::(_updateState) Task=`5c2a0056-4bf0-4ff3-87f7-39cdae631e3e`::moving from state preparing -> state finished Thread-137::DEBUG::2012-10-15 09:05:41,096::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-137::DEBUG::2012-10-15 09:05:41,096::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-138::DEBUG::2012-10-15 09:05:41,095::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (5 active users) Thread-140::DEBUG::2012-10-15 09:05:41,092::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-137::DEBUG::2012-10-15 09:05:41,099::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-140::DEBUG::2012-10-15 09:05:41,100::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-138::DEBUG::2012-10-15 09:05:41,102::task::980::TaskManager.Task::(_decref) Task=`6f9bb870-7530-4979-816c-42141dadd3d7`::ref 0 aborting False Thread-137::DEBUG::2012-10-15 09:05:41,103::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (4 active users) Thread-137::DEBUG::2012-10-15 09:05:41,106::task::980::TaskManager.Task::(_decref) Task=`5c2a0056-4bf0-4ff3-87f7-39cdae631e3e`::ref 0 aborting False Thread-140::DEBUG::2012-10-15 09:05:41,109::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-140::DEBUG::2012-10-15 09:05:41,120::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-140::DEBUG::2012-10-15 09:05:41,121::task::980::TaskManager.Task::(_decref) Task=`a25ad0f8-e3ae-4296-9478-26c0f0a4b7df`::ref 0 aborting False Thread-135::ERROR::2012-10-15 09:05:41,134::utils::393::vm.Vm::(collect) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-138::ERROR::2012-10-15 09:05:41,153::utils::393::vm.Vm::(collect) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-137::ERROR::2012-10-15 09:05:41,165::utils::393::vm.Vm::(collect) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-140::ERROR::2012-10-15 09:05:41,179::utils::393::vm.Vm::(collect) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-92::DEBUG::2012-10-15 09:05:41,257::utils::595::Storage.Misc.excCmd::(execCmd) FAILED: = 'Unknown operation retune\n'; = 1 Thread-92::DEBUG::2012-10-15 09:05:41,268::vm::528::vm.Vm::(_startUnderlyingVm) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::_ongoingCreations released Thread-97::DEBUG::2012-10-15 09:05:41,269::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) Thread-97::DEBUG::2012-10-15 09:05:41,351::utils::595::Storage.Misc.excCmd::(execCmd) FAILED: = 'Unknown operation retune\n'; = 1 Thread-97::DEBUG::2012-10-15 09:05:41,353::vm::528::vm.Vm::(_startUnderlyingVm) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::_ongoingCreations released Thread-106::DEBUG::2012-10-15 09:05:41,354::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:41,453::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-124::DEBUG::2012-10-15 09:05:41,454::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... Thread-106::DEBUG::2012-10-15 09:05:41,481::utils::595::Storage.Misc.excCmd::(execCmd) FAILED: = 'Unknown operation retune\n'; = 1 Thread-106::DEBUG::2012-10-15 09:05:41,482::vm::528::vm.Vm::(_startUnderlyingVm) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::_ongoingCreations released Thread-118::DEBUG::2012-10-15 09:05:41,566::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-111::DEBUG::2012-10-15 09:05:41,667::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-118::DEBUG::2012-10-15 09:05:41,692::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=33 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:41,874::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-111::DEBUG::2012-10-15 09:05:41,880::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.4033677e-6930-4582-aa90-1b90f8ff38ee' is free. Now locking as 'exclusive' (1 active user) Thread-124::DEBUG::2012-10-15 09:05:41,881::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-111::DEBUG::2012-10-15 09:05:41,882::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.4033677e-6930-4582-aa90-1b90f8ff38ee`ReqID=`d73961a1-c372-45cd-b6f5-726d757e623e`::Granted request Thread-118::DEBUG::2012-10-15 09:05:41,883::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000801115 s, 639 kB/s\n'; = 0 Thread-124::DEBUG::2012-10-15 09:05:41,884::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-111::DEBUG::2012-10-15 09:05:41,886::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=59 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:41,889::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.27ab4d15-dbee-4e8e-87ae-cabdfa95cd02`ReqID=`48a27ead-8f77-4100-80a1-3b5a6ea3dbc1`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-118::DEBUG::2012-10-15 09:05:41,887::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000801115 s, 639 kB/s'], size: 512 Thread-124::DEBUG::2012-10-15 09:05:41,892::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.27ab4d15-dbee-4e8e-87ae-cabdfa95cd02' for lock type 'exclusive' Thread-118::DEBUG::2012-10-15 09:05:41,893::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=33 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:41,894::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.27ab4d15-dbee-4e8e-87ae-cabdfa95cd02' is free. Now locking as 'exclusive' (1 active user) Thread-124::DEBUG::2012-10-15 09:05:41,903::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.27ab4d15-dbee-4e8e-87ae-cabdfa95cd02`ReqID=`48a27ead-8f77-4100-80a1-3b5a6ea3dbc1`::Granted request Thread-124::DEBUG::2012-10-15 09:05:41,914::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.6db264ea-c386-4b44-80a4-7af6fef85578' is free. Now locking as 'exclusive' (1 active user) Thread-124::DEBUG::2012-10-15 09:05:41,916::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.6db264ea-c386-4b44-80a4-7af6fef85578`ReqID=`ee0c3ed1-fd1e-4b92-bc43-38301fea4ebf`::Granted request Thread-124::DEBUG::2012-10-15 09:05:41,919::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-124::DEBUG::2012-10-15 09:05:41,920::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:41,943::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000624624 s, 820 kB/s\n'; = 0 Thread-111::DEBUG::2012-10-15 09:05:41,944::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000624624 s, 820 kB/s'], size: 512 Thread-111::INFO::2012-10-15 09:05:41,946::logUtils::39::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None Thread-111::DEBUG::2012-10-15 09:05:41,947::task::1174::TaskManager.Task::(prepare) Task=`304092db-f962-4ea6-96f9-66259c4d92bb`::finished: None Thread-111::DEBUG::2012-10-15 09:05:41,948::task::588::TaskManager.Task::(_updateState) Task=`304092db-f962-4ea6-96f9-66259c4d92bb`::moving from state preparing -> state finished Thread-111::DEBUG::2012-10-15 09:05:41,948::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-111::DEBUG::2012-10-15 09:05:41,949::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-111::DEBUG::2012-10-15 09:05:41,950::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-111::DEBUG::2012-10-15 09:05:41,951::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (2 active users) Thread-111::DEBUG::2012-10-15 09:05:41,952::task::980::TaskManager.Task::(_decref) Task=`304092db-f962-4ea6-96f9-66259c4d92bb`::ref 0 aborting False Thread-111::DEBUG::2012-10-15 09:05:41,954::task::588::TaskManager.Task::(_updateState) Task=`a5ab2e3a-6144-4e6a-918a-151e961e48a0`::moving from state init -> state preparing Thread-111::INFO::2012-10-15 09:05:41,954::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='0587da1b-6e3d-436b-aa1a-16baa05f5cdb', volUUID='4033677e-6930-4582-aa90-1b90f8ff38ee', options=None) Thread-111::DEBUG::2012-10-15 09:05:41,956::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`ccf47e29-14d8-439a-9d60-528a214da280`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2400' at 'getVolumePath' Thread-111::DEBUG::2012-10-15 09:05:41,956::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-111::DEBUG::2012-10-15 09:05:41,957::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (3 active users) Thread-111::DEBUG::2012-10-15 09:05:41,957::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`ccf47e29-14d8-439a-9d60-528a214da280`::Granted request Thread-111::DEBUG::2012-10-15 09:05:41,958::task::819::TaskManager.Task::(resourceAcquired) Task=`a5ab2e3a-6144-4e6a-918a-151e961e48a0`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-111::DEBUG::2012-10-15 09:05:41,959::task::980::TaskManager.Task::(_decref) Task=`a5ab2e3a-6144-4e6a-918a-151e961e48a0`::ref 1 aborting False Thread-111::INFO::2012-10-15 09:05:41,960::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/0587da1b-6e3d-436b-aa1a-16baa05f5cdb/4033677e-6930-4582-aa90-1b90f8ff38ee'} Thread-111::DEBUG::2012-10-15 09:05:41,962::task::1174::TaskManager.Task::(prepare) Task=`a5ab2e3a-6144-4e6a-918a-151e961e48a0`::finished: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/0587da1b-6e3d-436b-aa1a-16baa05f5cdb/4033677e-6930-4582-aa90-1b90f8ff38ee'} Thread-118::DEBUG::2012-10-15 09:05:41,964::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000515822 s, 993 kB/s\n'; = 0 Thread-111::DEBUG::2012-10-15 09:05:41,964::task::588::TaskManager.Task::(_updateState) Task=`a5ab2e3a-6144-4e6a-918a-151e961e48a0`::moving from state preparing -> state finished Thread-118::DEBUG::2012-10-15 09:05:41,965::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000515822 s, 993 kB/s'], size: 512 Thread-111::DEBUG::2012-10-15 09:05:41,966::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-118::DEBUG::2012-10-15 09:05:41,967::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.eb184918-d1ca-4934-953b-7626056a0194`ReqID=`4e9d942a-b4b0-4780-8a4a-621badf9f50d`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-111::DEBUG::2012-10-15 09:05:41,968::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-118::DEBUG::2012-10-15 09:05:41,968::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.eb184918-d1ca-4934-953b-7626056a0194' for lock type 'exclusive' Thread-111::DEBUG::2012-10-15 09:05:41,970::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-118::DEBUG::2012-10-15 09:05:41,971::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission rw ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/eb184918-d1ca-4934-953b-7626056a0194' (cwd None) Thread-111::DEBUG::2012-10-15 09:05:41,972::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (2 active users) Thread-111::DEBUG::2012-10-15 09:05:41,990::task::980::TaskManager.Task::(_decref) Task=`a5ab2e3a-6144-4e6a-918a-151e961e48a0`::ref 0 aborting False Thread-111::INFO::2012-10-15 09:05:41,993::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/0587da1b-6e3d-436b-aa1a-16baa05f5cdb/4033677e-6930-4582-aa90-1b90f8ff38ee Thread-111::INFO::2012-10-15 09:05:41,996::clientIF::606::vds::(_prepareVolumePath) prepared volume path: Thread-111::DEBUG::2012-10-15 09:05:42,035::libvirtvm::1145::vm.Vm::(_run) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`:: stageportal02 949630d3-c5aa-4047-9250-28cfe479985d 12582912 12582912 2 0587da1b-6e3d-436b-aa1a-16baa05f5cdb hvm Red Hat RHEV Hypervisor 16-1 4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10 949630d3-c5aa-4047-9250-28cfe479985d Opteron_G3 Thread-124::DEBUG::2012-10-15 09:05:42,314::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-124::DEBUG::2012-10-15 09:05:42,663::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-118::DEBUG::2012-10-15 09:05:42,665::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "eb184918-d1ca-4934-953b-7626056a0194" is already writable\n'; = 5 Thread-124::DEBUG::2012-10-15 09:05:42,672::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/27ab4d15-dbee-4e8e-87ae-cabdfa95cd02' (cwd None) Thread-118::DEBUG::2012-10-15 09:05:42,714::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-118::DEBUG::2012-10-15 09:05:42,718::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-118::DEBUG::2012-10-15 09:05:42,720::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-118::DEBUG::2012-10-15 09:05:42,724::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-144::DEBUG::2012-10-15 09:05:43,013::task::588::TaskManager.Task::(_updateState) Task=`697d7d21-1880-4c38-a57c-9c8d3c86dac2`::moving from state init -> state preparing Thread-144::INFO::2012-10-15 09:05:43,016::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-144::INFO::2012-10-15 09:05:43,018::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00237989425659', 'lastCheck': 1350291933.239792, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000619888305664', 'lastCheck': 1350291941.556116, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00337386131287', 'lastCheck': 1350291941.288221, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.0185689926147', 'lastCheck': 1350291941.875934, 'code': 0, 'valid': True}} Thread-144::DEBUG::2012-10-15 09:05:43,019::task::1174::TaskManager.Task::(prepare) Task=`697d7d21-1880-4c38-a57c-9c8d3c86dac2`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00237989425659', 'lastCheck': 1350291933.239792, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000619888305664', 'lastCheck': 1350291941.556116, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00337386131287', 'lastCheck': 1350291941.288221, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.0185689926147', 'lastCheck': 1350291941.875934, 'code': 0, 'valid': True}} Thread-144::DEBUG::2012-10-15 09:05:43,021::task::588::TaskManager.Task::(_updateState) Task=`697d7d21-1880-4c38-a57c-9c8d3c86dac2`::moving from state preparing -> state finished Thread-144::DEBUG::2012-10-15 09:05:43,022::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-144::DEBUG::2012-10-15 09:05:43,024::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-144::DEBUG::2012-10-15 09:05:43,025::task::980::TaskManager.Task::(_decref) Task=`697d7d21-1880-4c38-a57c-9c8d3c86dac2`::ref 0 aborting False Thread-145::DEBUG::2012-10-15 09:05:43,071::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::CPU stats not available Thread-145::DEBUG::2012-10-15 09:05:43,073::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Network stats not available Thread-145::DEBUG::2012-10-15 09:05:43,075::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-145::DEBUG::2012-10-15 09:05:43,076::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-145::DEBUG::2012-10-15 09:05:43,077::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-145::DEBUG::2012-10-15 09:05:43,079::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-145::DEBUG::2012-10-15 09:05:43,081::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-145::DEBUG::2012-10-15 09:05:43,082::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-145::DEBUG::2012-10-15 09:05:43,084::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-145::DEBUG::2012-10-15 09:05:43,085::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-145::DEBUG::2012-10-15 09:05:43,087::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::CPU stats not available Thread-145::DEBUG::2012-10-15 09:05:43,089::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Network stats not available Thread-145::DEBUG::2012-10-15 09:05:43,091::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-145::DEBUG::2012-10-15 09:05:43,093::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-145::DEBUG::2012-10-15 09:05:43,094::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-145::DEBUG::2012-10-15 09:05:43,096::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-145::DEBUG::2012-10-15 09:05:43,098::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::CPU stats not available Thread-145::DEBUG::2012-10-15 09:05:43,100::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-145::DEBUG::2012-10-15 09:05:43,103::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-145::DEBUG::2012-10-15 09:05:43,105::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-145::DEBUG::2012-10-15 09:05:43,107::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-145::DEBUG::2012-10-15 09:05:43,111::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::CPU stats not available Thread-145::DEBUG::2012-10-15 09:05:43,113::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Network stats not available Thread-145::DEBUG::2012-10-15 09:05:43,114::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-145::DEBUG::2012-10-15 09:05:43,117::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-145::DEBUG::2012-10-15 09:05:43,118::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-145::DEBUG::2012-10-15 09:05:43,119::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-145::DEBUG::2012-10-15 09:05:43,122::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::CPU stats not available Thread-145::DEBUG::2012-10-15 09:05:43,124::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Network stats not available Thread-145::DEBUG::2012-10-15 09:05:43,125::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-145::DEBUG::2012-10-15 09:05:43,126::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-145::DEBUG::2012-10-15 09:05:43,127::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-145::DEBUG::2012-10-15 09:05:43,129::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-118::DEBUG::2012-10-15 09:05:43,278::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-124::DEBUG::2012-10-15 09:05:43,444::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-118::DEBUG::2012-10-15 09:05:43,637::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-118::DEBUG::2012-10-15 09:05:43,640::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.eb184918-d1ca-4934-953b-7626056a0194' is free. Now locking as 'exclusive' (1 active user) Thread-124::DEBUG::2012-10-15 09:05:43,642::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-118::DEBUG::2012-10-15 09:05:43,644::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.eb184918-d1ca-4934-953b-7626056a0194`ReqID=`4e9d942a-b4b0-4780-8a4a-621badf9f50d`::Granted request Thread-124::DEBUG::2012-10-15 09:05:43,648::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-124::INFO::2012-10-15 09:05:43,654::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/27ab4d15-dbee-4e8e-87ae-cabdfa95cd02 Thread-124::DEBUG::2012-10-15 09:05:43,658::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-118::DEBUG::2012-10-15 09:05:43,664::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=33 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:43,667::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-118::DEBUG::2012-10-15 09:05:43,754::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000976067 s, 525 kB/s\n'; = 0 Thread-118::DEBUG::2012-10-15 09:05:43,759::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000976067 s, 525 kB/s'], size: 512 Thread-118::INFO::2012-10-15 09:05:43,764::logUtils::39::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None Thread-118::DEBUG::2012-10-15 09:05:43,766::task::1174::TaskManager.Task::(prepare) Task=`8faccd7d-ca40-4ac9-a0dd-da6eca689dda`::finished: None Thread-118::DEBUG::2012-10-15 09:05:43,768::task::588::TaskManager.Task::(_updateState) Task=`8faccd7d-ca40-4ac9-a0dd-da6eca689dda`::moving from state preparing -> state finished Thread-118::DEBUG::2012-10-15 09:05:43,769::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-118::DEBUG::2012-10-15 09:05:43,771::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-118::DEBUG::2012-10-15 09:05:43,777::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-118::DEBUG::2012-10-15 09:05:43,779::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (1 active users) Thread-118::DEBUG::2012-10-15 09:05:43,781::task::980::TaskManager.Task::(_decref) Task=`8faccd7d-ca40-4ac9-a0dd-da6eca689dda`::ref 0 aborting False Thread-118::DEBUG::2012-10-15 09:05:43,784::task::588::TaskManager.Task::(_updateState) Task=`a3ef0cf2-23a3-4e50-94f6-7d592d3bc781`::moving from state init -> state preparing Thread-118::INFO::2012-10-15 09:05:43,786::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='c0ce18f3-31a7-4f67-8026-db6a49a50c96', volUUID='eb184918-d1ca-4934-953b-7626056a0194', options=None) Thread-118::DEBUG::2012-10-15 09:05:43,788::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`ad980286-05d0-4501-99cf-3d7a2928a868`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2400' at 'getVolumePath' Thread-118::DEBUG::2012-10-15 09:05:43,790::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-118::DEBUG::2012-10-15 09:05:43,791::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (2 active users) Thread-118::DEBUG::2012-10-15 09:05:43,792::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`ad980286-05d0-4501-99cf-3d7a2928a868`::Granted request Thread-118::DEBUG::2012-10-15 09:05:43,795::task::819::TaskManager.Task::(resourceAcquired) Task=`a3ef0cf2-23a3-4e50-94f6-7d592d3bc781`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-118::DEBUG::2012-10-15 09:05:43,796::task::980::TaskManager.Task::(_decref) Task=`a3ef0cf2-23a3-4e50-94f6-7d592d3bc781`::ref 1 aborting False Thread-118::INFO::2012-10-15 09:05:43,799::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/c0ce18f3-31a7-4f67-8026-db6a49a50c96/eb184918-d1ca-4934-953b-7626056a0194'} Thread-118::DEBUG::2012-10-15 09:05:43,801::task::1174::TaskManager.Task::(prepare) Task=`a3ef0cf2-23a3-4e50-94f6-7d592d3bc781`::finished: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/c0ce18f3-31a7-4f67-8026-db6a49a50c96/eb184918-d1ca-4934-953b-7626056a0194'} Thread-118::DEBUG::2012-10-15 09:05:43,802::task::588::TaskManager.Task::(_updateState) Task=`a3ef0cf2-23a3-4e50-94f6-7d592d3bc781`::moving from state preparing -> state finished Thread-118::DEBUG::2012-10-15 09:05:43,803::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-118::DEBUG::2012-10-15 09:05:43,805::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-118::DEBUG::2012-10-15 09:05:43,806::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-118::DEBUG::2012-10-15 09:05:43,808::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (1 active users) Thread-118::DEBUG::2012-10-15 09:05:43,810::task::980::TaskManager.Task::(_decref) Task=`a3ef0cf2-23a3-4e50-94f6-7d592d3bc781`::ref 0 aborting False Thread-118::INFO::2012-10-15 09:05:43,811::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/c0ce18f3-31a7-4f67-8026-db6a49a50c96/eb184918-d1ca-4934-953b-7626056a0194 Thread-118::INFO::2012-10-15 09:05:43,813::clientIF::606::vds::(_prepareVolumePath) prepared volume path: Thread-118::DEBUG::2012-10-15 09:05:43,841::libvirtvm::1145::vm.Vm::(_run) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`:: nba-emea ea6e0e35-b833-43b3-8ddf-99f2c085fb43 2048000 2048000 4 c0ce18f3-31a7-4f67-8026-db6a49a50c96 hvm Red Hat RHEV Hypervisor 16-1 4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10 ea6e0e35-b833-43b3-8ddf-99f2c085fb43 Opteron_G3 Thread-124::DEBUG::2012-10-15 09:05:44,243::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-124::DEBUG::2012-10-15 09:05:44,608::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-124::DEBUG::2012-10-15 09:05:44,612::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=55 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:44,685::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00124517 s, 411 kB/s\n'; = 0 Thread-124::DEBUG::2012-10-15 09:05:44,688::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00124517 s, 411 kB/s'], size: 512 Thread-124::DEBUG::2012-10-15 09:05:44,690::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=55 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:44,760::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000881801 s, 581 kB/s\n'; = 0 Thread-124::DEBUG::2012-10-15 09:05:44,763::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000881801 s, 581 kB/s'], size: 512 Thread-124::DEBUG::2012-10-15 09:05:44,768::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.27ab4d15-dbee-4e8e-87ae-cabdfa95cd02`ReqID=`25f88873-cd7b-48f7-8311-89c8c77a6151`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-124::DEBUG::2012-10-15 09:05:44,769::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.27ab4d15-dbee-4e8e-87ae-cabdfa95cd02' for lock type 'exclusive' Thread-124::DEBUG::2012-10-15 09:05:44,773::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission rw ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/27ab4d15-dbee-4e8e-87ae-cabdfa95cd02' (cwd None) Thread-147::DEBUG::2012-10-15 09:05:45,279::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} libvirtEventLoop::DEBUG::2012-10-15 09:05:45,287::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::event Started detail 0 opaque None Thread-147::DEBUG::2012-10-15 09:05:45,295::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::CPU stats not available Thread-147::DEBUG::2012-10-15 09:05:45,301::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Network stats not available Thread-124::DEBUG::2012-10-15 09:05:45,304::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "27ab4d15-dbee-4e8e-87ae-cabdfa95cd02" is already writable\n'; = 5 Thread-147::DEBUG::2012-10-15 09:05:45,307::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-147::DEBUG::2012-10-15 09:05:45,336::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-147::DEBUG::2012-10-15 09:05:45,353::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-147::DEBUG::2012-10-15 09:05:45,357::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-147::DEBUG::2012-10-15 09:05:45,359::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'state': 'unknown', 'macAddr': '00:1a:4a:10:01:10', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.11', 'cpuIdle': '100.00', 'elapsedTime': '19', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-111::DEBUG::2012-10-15 09:05:45,436::utils::323::vm.Vm::(start) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Start statistics collection Thread-148::DEBUG::2012-10-15 09:05:45,442::utils::352::vm.Vm::(run) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Stats thread started Thread-150::DEBUG::2012-10-15 09:05:45,447::guestIF::67::root::(_connect) Attempting connection to /var/lib/libvirt/qemu/channels/stageportal02.com.redhat.rhevm.vdsm Thread-149::DEBUG::2012-10-15 09:05:45,456::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-150::DEBUG::2012-10-15 09:05:45,460::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/prepare-vmchannel /var/lib/libvirt/qemu/channels/stageportal02.com.redhat.rhevm.vdsm' (cwd None) Thread-111::WARNING::2012-10-15 09:05:45,461::libvirtvm::1180::vm.Vm::(_readPauseCode) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::_readPauseCode unsupported by libvirt vm Thread-148::DEBUG::2012-10-15 09:05:45,461::task::588::TaskManager.Task::(_updateState) Task=`53761eb4-8665-4d0d-ace2-059b07322cb2`::moving from state init -> state preparing Thread-149::DEBUG::2012-10-15 09:05:45,467::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-111::DEBUG::2012-10-15 09:05:45,494::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/get-vm-pid stageportal02' (cwd None) Thread-148::INFO::2012-10-15 09:05:45,500::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='0587da1b-6e3d-436b-aa1a-16baa05f5cdb', volUUID='4033677e-6930-4582-aa90-1b90f8ff38ee', options=None) Thread-149::DEBUG::2012-10-15 09:05:45,504::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-149::DEBUG::2012-10-15 09:05:45,531::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-149::DEBUG::2012-10-15 09:05:45,540::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-148::DEBUG::2012-10-15 09:05:45,547::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`80e0bf27-e599-47f6-96bd-83ff03d0e269`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-149::DEBUG::2012-10-15 09:05:45,556::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '80.72', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.11', 'cpuIdle': '19.28', 'elapsedTime': '36', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-148::DEBUG::2012-10-15 09:05:45,563::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-148::DEBUG::2012-10-15 09:05:45,585::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (2 active users) Thread-148::DEBUG::2012-10-15 09:05:45,591::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`80e0bf27-e599-47f6-96bd-83ff03d0e269`::Granted request Thread-148::DEBUG::2012-10-15 09:05:45,603::task::819::TaskManager.Task::(resourceAcquired) Task=`53761eb4-8665-4d0d-ace2-059b07322cb2`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-148::DEBUG::2012-10-15 09:05:45,606::task::980::TaskManager.Task::(_decref) Task=`53761eb4-8665-4d0d-ace2-059b07322cb2`::ref 1 aborting False Thread-148::INFO::2012-10-15 09:05:45,617::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-150::DEBUG::2012-10-15 09:05:45,620::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-151::DEBUG::2012-10-15 09:05:45,626::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-148::DEBUG::2012-10-15 09:05:45,627::task::1174::TaskManager.Task::(prepare) Task=`53761eb4-8665-4d0d-ace2-059b07322cb2`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-150::DEBUG::2012-10-15 09:05:45,633::guestIF::73::root::(_connect) connected to /var/lib/libvirt/qemu/channels/stageportal02.com.redhat.rhevm.vdsm Thread-151::DEBUG::2012-10-15 09:05:45,637::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::CPU stats not available Thread-148::DEBUG::2012-10-15 09:05:45,638::task::588::TaskManager.Task::(_updateState) Task=`53761eb4-8665-4d0d-ace2-059b07322cb2`::moving from state preparing -> state finished Thread-151::DEBUG::2012-10-15 09:05:45,642::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Network stats not available Thread-111::DEBUG::2012-10-15 09:05:45,648::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-148::DEBUG::2012-10-15 09:05:45,650::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-151::DEBUG::2012-10-15 09:05:45,652::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-124::DEBUG::2012-10-15 09:05:45,654::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-148::DEBUG::2012-10-15 09:05:45,661::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-151::DEBUG::2012-10-15 09:05:45,662::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-124::DEBUG::2012-10-15 09:05:45,665::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-148::DEBUG::2012-10-15 09:05:45,668::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-151::DEBUG::2012-10-15 09:05:45,670::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-124::DEBUG::2012-10-15 09:05:45,675::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-148::DEBUG::2012-10-15 09:05:45,678::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (1 active users) Thread-151::DEBUG::2012-10-15 09:05:45,679::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-124::DEBUG::2012-10-15 09:05:45,684::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-151::DEBUG::2012-10-15 09:05:45,690::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'state': 'unknown', 'macAddr': '52:54:00:68:b5:cf', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.48', 'cpuIdle': '100.00', 'elapsedTime': '26', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-148::DEBUG::2012-10-15 09:05:45,694::task::980::TaskManager.Task::(_decref) Task=`53761eb4-8665-4d0d-ace2-059b07322cb2`::ref 0 aborting False Thread-111::DEBUG::2012-10-15 09:05:45,752::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) Thread-152::DEBUG::2012-10-15 09:05:45,817::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-152::DEBUG::2012-10-15 09:05:45,837::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::CPU stats not available Thread-152::DEBUG::2012-10-15 09:05:45,839::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Network stats not available Thread-152::DEBUG::2012-10-15 09:05:45,841::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-152::DEBUG::2012-10-15 09:05:45,843::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-152::DEBUG::2012-10-15 09:05:45,845::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-152::DEBUG::2012-10-15 09:05:45,846::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-152::DEBUG::2012-10-15 09:05:45,854::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'state': 'unknown', 'macAddr': '00:0c:29:4f:6c:c6', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.68', 'cpuIdle': '100.00', 'elapsedTime': '31', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-153::DEBUG::2012-10-15 09:05:45,886::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-153::DEBUG::2012-10-15 09:05:45,888::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::CPU stats not available Thread-153::DEBUG::2012-10-15 09:05:45,890::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-153::DEBUG::2012-10-15 09:05:45,891::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-153::DEBUG::2012-10-15 09:05:45,892::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-153::DEBUG::2012-10-15 09:05:45,893::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-153::DEBUG::2012-10-15 09:05:45,895::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '0.26', 'cpuIdle': '100.00', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-154::DEBUG::2012-10-15 09:05:45,927::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-154::DEBUG::2012-10-15 09:05:45,932::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::CPU stats not available Thread-154::DEBUG::2012-10-15 09:05:45,937::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Network stats not available Thread-154::DEBUG::2012-10-15 09:05:45,944::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-154::DEBUG::2012-10-15 09:05:45,954::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-154::DEBUG::2012-10-15 09:05:45,958::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-154::DEBUG::2012-10-15 09:05:45,962::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-154::DEBUG::2012-10-15 09:05:45,972::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'state': 'unknown', 'macAddr': '00:0c:29:4d:84:12', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.76', 'cpuIdle': '100.00', 'elapsedTime': '29', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-111::DEBUG::2012-10-15 09:05:46,024::utils::595::Storage.Misc.excCmd::(execCmd) FAILED: = 'Unknown operation retune\n'; = 1 Thread-111::DEBUG::2012-10-15 09:05:46,027::vm::528::vm.Vm::(_startUnderlyingVm) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::_ongoingCreations released Thread-148::ERROR::2012-10-15 09:05:46,036::utils::393::vm.Vm::(collect) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' libvirtEventLoop::DEBUG::2012-10-15 09:05:46,102::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::event Started detail 0 opaque None Thread-118::DEBUG::2012-10-15 09:05:46,322::utils::323::vm.Vm::(start) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Start statistics collection Thread-155::DEBUG::2012-10-15 09:05:46,325::utils::352::vm.Vm::(run) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Stats thread started Thread-156::DEBUG::2012-10-15 09:05:46,333::guestIF::67::root::(_connect) Attempting connection to /var/lib/libvirt/qemu/channels/nba-emea.com.redhat.rhevm.vdsm Thread-156::DEBUG::2012-10-15 09:05:46,341::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/prepare-vmchannel /var/lib/libvirt/qemu/channels/nba-emea.com.redhat.rhevm.vdsm' (cwd None) Thread-155::DEBUG::2012-10-15 09:05:46,347::task::588::TaskManager.Task::(_updateState) Task=`96600ccd-5381-4de2-b0ac-80fa1c1f8b95`::moving from state init -> state preparing Thread-118::WARNING::2012-10-15 09:05:46,368::libvirtvm::1180::vm.Vm::(_readPauseCode) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::_readPauseCode unsupported by libvirt vm Thread-124::DEBUG::2012-10-15 09:05:46,379::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-155::INFO::2012-10-15 09:05:46,384::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='c0ce18f3-31a7-4f67-8026-db6a49a50c96', volUUID='eb184918-d1ca-4934-953b-7626056a0194', options=None) Thread-118::DEBUG::2012-10-15 09:05:46,390::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/get-vm-pid nba-emea' (cwd None) Thread-155::DEBUG::2012-10-15 09:05:46,471::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`384023ad-4c92-495e-800e-44da4f639da8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-156::DEBUG::2012-10-15 09:05:46,523::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-155::DEBUG::2012-10-15 09:05:46,542::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-156::DEBUG::2012-10-15 09:05:46,791::guestIF::73::root::(_connect) connected to /var/lib/libvirt/qemu/channels/nba-emea.com.redhat.rhevm.vdsm Thread-124::DEBUG::2012-10-15 09:05:46,813::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-155::DEBUG::2012-10-15 09:05:46,816::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (2 active users) Thread-124::DEBUG::2012-10-15 09:05:46,822::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.27ab4d15-dbee-4e8e-87ae-cabdfa95cd02' is free. Now locking as 'exclusive' (1 active user) Thread-118::DEBUG::2012-10-15 09:05:46,824::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-155::DEBUG::2012-10-15 09:05:46,826::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`384023ad-4c92-495e-800e-44da4f639da8`::Granted request Thread-124::DEBUG::2012-10-15 09:05:46,828::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.27ab4d15-dbee-4e8e-87ae-cabdfa95cd02`ReqID=`25f88873-cd7b-48f7-8311-89c8c77a6151`::Granted request Thread-124::DEBUG::2012-10-15 09:05:46,842::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=55 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-155::DEBUG::2012-10-15 09:05:46,844::task::819::TaskManager.Task::(resourceAcquired) Task=`96600ccd-5381-4de2-b0ac-80fa1c1f8b95`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-155::DEBUG::2012-10-15 09:05:46,872::task::980::TaskManager.Task::(_decref) Task=`96600ccd-5381-4de2-b0ac-80fa1c1f8b95`::ref 1 aborting False Thread-155::INFO::2012-10-15 09:05:46,879::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-155::DEBUG::2012-10-15 09:05:46,881::task::1174::TaskManager.Task::(prepare) Task=`96600ccd-5381-4de2-b0ac-80fa1c1f8b95`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-155::DEBUG::2012-10-15 09:05:46,883::task::588::TaskManager.Task::(_updateState) Task=`96600ccd-5381-4de2-b0ac-80fa1c1f8b95`::moving from state preparing -> state finished Thread-155::DEBUG::2012-10-15 09:05:46,885::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-155::DEBUG::2012-10-15 09:05:46,887::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-155::DEBUG::2012-10-15 09:05:46,891::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-155::DEBUG::2012-10-15 09:05:46,894::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (1 active users) Thread-155::DEBUG::2012-10-15 09:05:46,897::task::980::TaskManager.Task::(_decref) Task=`96600ccd-5381-4de2-b0ac-80fa1c1f8b95`::ref 0 aborting False Thread-118::DEBUG::2012-10-15 09:05:46,918::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:46,957::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00141267 s, 362 kB/s\n'; = 0 Thread-124::DEBUG::2012-10-15 09:05:46,961::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00141267 s, 362 kB/s'], size: 512 Thread-124::INFO::2012-10-15 09:05:46,968::logUtils::39::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None Thread-124::DEBUG::2012-10-15 09:05:46,970::task::1174::TaskManager.Task::(prepare) Task=`7a903a2d-9844-4e03-ba05-655fc2ea4824`::finished: None Thread-124::DEBUG::2012-10-15 09:05:46,972::task::588::TaskManager.Task::(_updateState) Task=`7a903a2d-9844-4e03-ba05-655fc2ea4824`::moving from state preparing -> state finished Thread-124::DEBUG::2012-10-15 09:05:46,974::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-124::DEBUG::2012-10-15 09:05:46,976::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-124::DEBUG::2012-10-15 09:05:46,978::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-124::DEBUG::2012-10-15 09:05:46,980::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-124::DEBUG::2012-10-15 09:05:46,982::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-124::DEBUG::2012-10-15 09:05:46,986::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-124::DEBUG::2012-10-15 09:05:46,989::task::980::TaskManager.Task::(_decref) Task=`7a903a2d-9844-4e03-ba05-655fc2ea4824`::ref 0 aborting False Thread-124::DEBUG::2012-10-15 09:05:46,993::task::588::TaskManager.Task::(_updateState) Task=`72b2d2f0-4187-4f07-a241-ae6f4f16a9ad`::moving from state init -> state preparing Thread-124::INFO::2012-10-15 09:05:46,997::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='6db264ea-c386-4b44-80a4-7af6fef85578', volUUID='27ab4d15-dbee-4e8e-87ae-cabdfa95cd02', options=None) Thread-124::DEBUG::2012-10-15 09:05:47,001::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`00e2a1ee-f2be-4f84-91b6-2526f4e24562`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2400' at 'getVolumePath' Thread-124::DEBUG::2012-10-15 09:05:47,003::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-124::DEBUG::2012-10-15 09:05:47,005::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-124::DEBUG::2012-10-15 09:05:47,008::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`00e2a1ee-f2be-4f84-91b6-2526f4e24562`::Granted request Thread-124::DEBUG::2012-10-15 09:05:47,015::task::819::TaskManager.Task::(resourceAcquired) Task=`72b2d2f0-4187-4f07-a241-ae6f4f16a9ad`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-124::DEBUG::2012-10-15 09:05:47,017::task::980::TaskManager.Task::(_decref) Task=`72b2d2f0-4187-4f07-a241-ae6f4f16a9ad`::ref 1 aborting False Thread-124::INFO::2012-10-15 09:05:47,022::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/6db264ea-c386-4b44-80a4-7af6fef85578/27ab4d15-dbee-4e8e-87ae-cabdfa95cd02'} Thread-124::DEBUG::2012-10-15 09:05:47,024::task::1174::TaskManager.Task::(prepare) Task=`72b2d2f0-4187-4f07-a241-ae6f4f16a9ad`::finished: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/6db264ea-c386-4b44-80a4-7af6fef85578/27ab4d15-dbee-4e8e-87ae-cabdfa95cd02'} Thread-124::DEBUG::2012-10-15 09:05:47,026::task::588::TaskManager.Task::(_updateState) Task=`72b2d2f0-4187-4f07-a241-ae6f4f16a9ad`::moving from state preparing -> state finished Thread-124::DEBUG::2012-10-15 09:05:47,027::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-124::DEBUG::2012-10-15 09:05:47,029::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-124::DEBUG::2012-10-15 09:05:47,032::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-155::ERROR::2012-10-15 09:05:47,037::utils::393::vm.Vm::(collect) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-124::DEBUG::2012-10-15 09:05:47,038::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-124::DEBUG::2012-10-15 09:05:47,044::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-124::DEBUG::2012-10-15 09:05:47,045::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-124::DEBUG::2012-10-15 09:05:47,047::task::980::TaskManager.Task::(_decref) Task=`72b2d2f0-4187-4f07-a241-ae6f4f16a9ad`::ref 0 aborting False Thread-124::INFO::2012-10-15 09:05:47,050::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/6db264ea-c386-4b44-80a4-7af6fef85578/27ab4d15-dbee-4e8e-87ae-cabdfa95cd02 Thread-124::INFO::2012-10-15 09:05:47,053::clientIF::606::vds::(_prepareVolumePath) prepared volume path: Thread-124::DEBUG::2012-10-15 09:05:47,091::libvirtvm::1145::vm.Vm::(_run) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`:: devportal01 a74d3ee7-16ee-4f01-a7cd-ae929a136915 12582912 12582912 2 6db264ea-c386-4b44-80a4-7af6fef85578 hvm Red Hat RHEV Hypervisor 16-1 4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10 a74d3ee7-16ee-4f01-a7cd-ae929a136915 Opteron_G3 Thread-118::DEBUG::2012-10-15 09:05:47,187::utils::595::Storage.Misc.excCmd::(execCmd) FAILED: = 'Unknown operation retune\n'; = 1 Thread-118::DEBUG::2012-10-15 09:05:47,191::vm::528::vm.Vm::(_startUnderlyingVm) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::_ongoingCreations released Thread-158::DEBUG::2012-10-15 09:05:48,097::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-158::DEBUG::2012-10-15 09:05:48,103::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::CPU stats not available Thread-158::DEBUG::2012-10-15 09:05:48,108::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-158::DEBUG::2012-10-15 09:05:48,112::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-158::DEBUG::2012-10-15 09:05:48,114::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-158::DEBUG::2012-10-15 09:05:48,118::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-158::DEBUG::2012-10-15 09:05:48,120::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.85', 'cpuIdle': '100.00', 'elapsedTime': '22', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-159::DEBUG::2012-10-15 09:05:48,147::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-159::DEBUG::2012-10-15 09:05:48,150::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-159::DEBUG::2012-10-15 09:05:48,151::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-159::DEBUG::2012-10-15 09:05:48,153::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-159::DEBUG::2012-10-15 09:05:48,154::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-159::DEBUG::2012-10-15 09:05:48,157::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '80.72', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.06', 'cpuIdle': '19.28', 'elapsedTime': '38', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-160::DEBUG::2012-10-15 09:05:48,182::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-160::DEBUG::2012-10-15 09:05:48,184::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::CPU stats not available Thread-160::DEBUG::2012-10-15 09:05:48,186::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-160::DEBUG::2012-10-15 09:05:48,187::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-160::DEBUG::2012-10-15 09:05:48,188::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-160::DEBUG::2012-10-15 09:05:48,190::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-160::DEBUG::2012-10-15 09:05:48,191::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.95', 'cpuIdle': '100.00', 'elapsedTime': '28', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-161::DEBUG::2012-10-15 09:05:48,207::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-161::DEBUG::2012-10-15 09:05:48,208::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::CPU stats not available Thread-161::DEBUG::2012-10-15 09:05:48,208::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-161::DEBUG::2012-10-15 09:05:48,208::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-161::DEBUG::2012-10-15 09:05:48,208::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-161::DEBUG::2012-10-15 09:05:48,208::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-161::DEBUG::2012-10-15 09:05:48,209::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.98', 'cpuIdle': '100.00', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-162::DEBUG::2012-10-15 09:05:48,226::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-162::DEBUG::2012-10-15 09:05:48,228::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::CPU stats not available Thread-162::DEBUG::2012-10-15 09:05:48,230::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-162::DEBUG::2012-10-15 09:05:48,232::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-162::DEBUG::2012-10-15 09:05:48,233::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-162::DEBUG::2012-10-15 09:05:48,234::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-162::DEBUG::2012-10-15 09:05:48,236::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '0.56', 'cpuIdle': '100.00', 'elapsedTime': '35', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-163::DEBUG::2012-10-15 09:05:48,259::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-163::DEBUG::2012-10-15 09:05:48,261::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::CPU stats not available Thread-163::DEBUG::2012-10-15 09:05:48,263::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-163::DEBUG::2012-10-15 09:05:48,264::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-163::DEBUG::2012-10-15 09:05:48,264::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-163::DEBUG::2012-10-15 09:05:48,265::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-163::DEBUG::2012-10-15 09:05:48,265::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.03', 'cpuIdle': '100.00', 'elapsedTime': '31', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-164::DEBUG::2012-10-15 09:05:48,283::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-164::DEBUG::2012-10-15 09:05:48,285::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::CPU stats not available Thread-164::DEBUG::2012-10-15 09:05:48,286::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Network stats not available Thread-164::DEBUG::2012-10-15 09:05:48,288::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-164::DEBUG::2012-10-15 09:05:48,289::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-164::DEBUG::2012-10-15 09:05:48,290::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-164::DEBUG::2012-10-15 09:05:48,291::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-164::DEBUG::2012-10-15 09:05:48,293::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'state': 'unknown', 'macAddr': '00:1a:4a:10:01:11', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.22', 'cpuIdle': '100.00', 'elapsedTime': '21', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} libvirtEventLoop::DEBUG::2012-10-15 09:05:49,867::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::event Started detail 0 opaque None Thread-124::DEBUG::2012-10-15 09:05:49,949::utils::323::vm.Vm::(start) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Start statistics collection Thread-165::DEBUG::2012-10-15 09:05:49,952::utils::352::vm.Vm::(run) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Stats thread started Thread-165::DEBUG::2012-10-15 09:05:49,958::task::588::TaskManager.Task::(_updateState) Task=`facca9a5-3cb8-45ba-a31d-b7e430a4f936`::moving from state init -> state preparing Thread-166::DEBUG::2012-10-15 09:05:49,959::guestIF::67::root::(_connect) Attempting connection to /var/lib/libvirt/qemu/channels/devportal01.com.redhat.rhevm.vdsm Thread-165::INFO::2012-10-15 09:05:49,963::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='6db264ea-c386-4b44-80a4-7af6fef85578', volUUID='27ab4d15-dbee-4e8e-87ae-cabdfa95cd02', options=None) Thread-166::DEBUG::2012-10-15 09:05:49,965::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/prepare-vmchannel /var/lib/libvirt/qemu/channels/devportal01.com.redhat.rhevm.vdsm' (cwd None) Thread-165::DEBUG::2012-10-15 09:05:49,967::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`5460d005-99d0-49ea-bc9c-b9be96cd9eb1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-124::WARNING::2012-10-15 09:05:49,968::libvirtvm::1180::vm.Vm::(_readPauseCode) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::_readPauseCode unsupported by libvirt vm Thread-165::DEBUG::2012-10-15 09:05:49,969::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-124::DEBUG::2012-10-15 09:05:49,980::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/get-vm-pid devportal01' (cwd None) Thread-165::DEBUG::2012-10-15 09:05:49,988::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-165::DEBUG::2012-10-15 09:05:50,010::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`5460d005-99d0-49ea-bc9c-b9be96cd9eb1`::Granted request Thread-165::DEBUG::2012-10-15 09:05:50,019::task::819::TaskManager.Task::(resourceAcquired) Task=`facca9a5-3cb8-45ba-a31d-b7e430a4f936`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-165::DEBUG::2012-10-15 09:05:50,020::task::980::TaskManager.Task::(_decref) Task=`facca9a5-3cb8-45ba-a31d-b7e430a4f936`::ref 1 aborting False Thread-165::INFO::2012-10-15 09:05:50,021::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-165::DEBUG::2012-10-15 09:05:50,022::task::1174::TaskManager.Task::(prepare) Task=`facca9a5-3cb8-45ba-a31d-b7e430a4f936`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-165::DEBUG::2012-10-15 09:05:50,022::task::588::TaskManager.Task::(_updateState) Task=`facca9a5-3cb8-45ba-a31d-b7e430a4f936`::moving from state preparing -> state finished Thread-165::DEBUG::2012-10-15 09:05:50,023::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-165::DEBUG::2012-10-15 09:05:50,023::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-165::DEBUG::2012-10-15 09:05:50,024::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-165::DEBUG::2012-10-15 09:05:50,025::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-165::DEBUG::2012-10-15 09:05:50,026::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-165::DEBUG::2012-10-15 09:05:50,026::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-165::DEBUG::2012-10-15 09:05:50,027::task::980::TaskManager.Task::(_decref) Task=`facca9a5-3cb8-45ba-a31d-b7e430a4f936`::ref 0 aborting False Thread-166::DEBUG::2012-10-15 09:05:50,056::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-166::DEBUG::2012-10-15 09:05:50,057::guestIF::73::root::(_connect) connected to /var/lib/libvirt/qemu/channels/devportal01.com.redhat.rhevm.vdsm Thread-124::DEBUG::2012-10-15 09:05:50,095::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-165::ERROR::2012-10-15 09:05:50,106::utils::393::vm.Vm::(collect) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-124::DEBUG::2012-10-15 09:05:50,141::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) Thread-124::DEBUG::2012-10-15 09:05:50,271::utils::595::Storage.Misc.excCmd::(execCmd) FAILED: = 'Unknown operation retune\n'; = 1 Thread-124::DEBUG::2012-10-15 09:05:50,277::vm::528::vm.Vm::(_startUnderlyingVm) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::_ongoingCreations released Thread-168::DEBUG::2012-10-15 09:05:50,387::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-168::DEBUG::2012-10-15 09:05:50,390::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::CPU stats not available Thread-168::DEBUG::2012-10-15 09:05:50,391::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-168::DEBUG::2012-10-15 09:05:50,393::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-168::DEBUG::2012-10-15 09:05:50,394::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-168::DEBUG::2012-10-15 09:05:50,395::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-168::DEBUG::2012-10-15 09:05:50,397::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.14', 'cpuIdle': '100.00', 'elapsedTime': '24', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-169::DEBUG::2012-10-15 09:05:50,438::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-169::DEBUG::2012-10-15 09:05:50,441::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-169::DEBUG::2012-10-15 09:05:50,443::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-169::DEBUG::2012-10-15 09:05:50,444::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-169::DEBUG::2012-10-15 09:05:50,446::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-169::DEBUG::2012-10-15 09:05:50,448::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '80.72', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.35', 'cpuIdle': '19.28', 'elapsedTime': '41', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-170::DEBUG::2012-10-15 09:05:50,479::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-170::DEBUG::2012-10-15 09:05:50,481::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::CPU stats not available Thread-170::DEBUG::2012-10-15 09:05:50,482::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Network stats not available Thread-170::DEBUG::2012-10-15 09:05:50,484::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-170::DEBUG::2012-10-15 09:05:50,485::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-170::DEBUG::2012-10-15 09:05:50,486::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-170::DEBUG::2012-10-15 09:05:50,487::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-170::DEBUG::2012-10-15 09:05:50,489::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'state': 'unknown', 'macAddr': '52:54:00:d5:91:74', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.43', 'cpuIdle': '100.00', 'elapsedTime': '18', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-171::DEBUG::2012-10-15 09:05:50,525::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-171::DEBUG::2012-10-15 09:05:50,530::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::CPU stats not available Thread-171::DEBUG::2012-10-15 09:05:50,537::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-171::DEBUG::2012-10-15 09:05:50,544::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-171::DEBUG::2012-10-15 09:05:50,550::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-171::DEBUG::2012-10-15 09:05:50,554::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-171::DEBUG::2012-10-15 09:05:50,561::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.30', 'cpuIdle': '100.00', 'elapsedTime': '31', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-172::DEBUG::2012-10-15 09:05:50,585::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-172::DEBUG::2012-10-15 09:05:50,588::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::CPU stats not available Thread-172::DEBUG::2012-10-15 09:05:50,589::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-172::DEBUG::2012-10-15 09:05:50,591::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-172::DEBUG::2012-10-15 09:05:50,593::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-172::DEBUG::2012-10-15 09:05:50,594::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-172::DEBUG::2012-10-15 09:05:50,596::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.36', 'cpuIdle': '100.00', 'elapsedTime': '35', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-173::DEBUG::2012-10-15 09:05:50,632::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-173::DEBUG::2012-10-15 09:05:50,636::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::CPU stats not available Thread-173::DEBUG::2012-10-15 09:05:50,642::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Network stats not available Thread-173::DEBUG::2012-10-15 09:05:50,645::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-173::DEBUG::2012-10-15 09:05:50,647::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-173::DEBUG::2012-10-15 09:05:50,648::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-173::DEBUG::2012-10-15 09:05:50,650::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-173::DEBUG::2012-10-15 09:05:50,652::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'state': 'unknown', 'macAddr': '00:1a:4a:10:01:0d', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.68', 'cpuIdle': '100.00', 'elapsedTime': '16', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-174::DEBUG::2012-10-15 09:05:50,692::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-174::DEBUG::2012-10-15 09:05:50,697::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-174::DEBUG::2012-10-15 09:05:50,698::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-174::DEBUG::2012-10-15 09:05:50,702::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-174::DEBUG::2012-10-15 09:05:50,703::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-174::DEBUG::2012-10-15 09:05:50,708::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '87.60', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '0.06', 'cpuIdle': '12.40', 'elapsedTime': '38', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-175::DEBUG::2012-10-15 09:05:50,740::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-175::DEBUG::2012-10-15 09:05:50,742::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::CPU stats not available Thread-175::DEBUG::2012-10-15 09:05:50,744::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-175::DEBUG::2012-10-15 09:05:50,746::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-175::DEBUG::2012-10-15 09:05:50,747::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-175::DEBUG::2012-10-15 09:05:50,749::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-175::DEBUG::2012-10-15 09:05:50,751::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.51', 'cpuIdle': '100.00', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-176::DEBUG::2012-10-15 09:05:50,785::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-176::DEBUG::2012-10-15 09:05:50,790::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::CPU stats not available Thread-176::DEBUG::2012-10-15 09:05:50,791::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Network stats not available Thread-176::DEBUG::2012-10-15 09:05:50,793::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-176::DEBUG::2012-10-15 09:05:50,796::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-176::DEBUG::2012-10-15 09:05:50,798::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-176::DEBUG::2012-10-15 09:05:50,799::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-176::DEBUG::2012-10-15 09:05:50,803::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'state': 'unknown', 'macAddr': '00:1a:4a:10:01:11', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.72', 'cpuIdle': '100.00', 'elapsedTime': '23', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-178::DEBUG::2012-10-15 09:05:52,883::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-178::DEBUG::2012-10-15 09:05:52,885::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::CPU stats not available Thread-178::DEBUG::2012-10-15 09:05:52,887::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-178::DEBUG::2012-10-15 09:05:52,889::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-178::DEBUG::2012-10-15 09:05:52,891::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-178::DEBUG::2012-10-15 09:05:52,892::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-178::DEBUG::2012-10-15 09:05:52,895::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.63', 'cpuIdle': '100.00', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-179::DEBUG::2012-10-15 09:05:52,922::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-179::DEBUG::2012-10-15 09:05:52,925::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-179::DEBUG::2012-10-15 09:05:52,926::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-179::DEBUG::2012-10-15 09:05:52,928::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-179::DEBUG::2012-10-15 09:05:52,930::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-179::DEBUG::2012-10-15 09:05:52,932::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '80.72', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.82', 'cpuIdle': '19.28', 'elapsedTime': '43', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-180::DEBUG::2012-10-15 09:05:52,960::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-180::DEBUG::2012-10-15 09:05:52,963::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::CPU stats not available Thread-180::DEBUG::2012-10-15 09:05:52,965::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-180::DEBUG::2012-10-15 09:05:52,966::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-180::DEBUG::2012-10-15 09:05:52,968::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-180::DEBUG::2012-10-15 09:05:52,970::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-180::DEBUG::2012-10-15 09:05:52,972::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.91', 'cpuIdle': '100.00', 'elapsedTime': '21', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-181::DEBUG::2012-10-15 09:05:52,999::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-181::DEBUG::2012-10-15 09:05:53,001::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::CPU stats not available Thread-181::DEBUG::2012-10-15 09:05:53,003::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-181::DEBUG::2012-10-15 09:05:53,005::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-181::DEBUG::2012-10-15 09:05:53,008::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-181::DEBUG::2012-10-15 09:05:53,010::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-181::DEBUG::2012-10-15 09:05:53,013::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.77', 'cpuIdle': '100.00', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-182::DEBUG::2012-10-15 09:05:53,054::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-182::DEBUG::2012-10-15 09:05:53,056::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::CPU stats not available Thread-182::DEBUG::2012-10-15 09:05:53,058::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-182::DEBUG::2012-10-15 09:05:53,060::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-182::DEBUG::2012-10-15 09:05:53,065::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-182::DEBUG::2012-10-15 09:05:53,068::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-182::DEBUG::2012-10-15 09:05:53,070::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.82', 'cpuIdle': '100.00', 'elapsedTime': '38', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-183::DEBUG::2012-10-15 09:05:53,123::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-183::DEBUG::2012-10-15 09:05:53,125::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::CPU stats not available Thread-183::DEBUG::2012-10-15 09:05:53,126::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Network stats not available Thread-183::DEBUG::2012-10-15 09:05:53,127::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-183::DEBUG::2012-10-15 09:05:53,129::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-183::DEBUG::2012-10-15 09:05:53,131::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-183::DEBUG::2012-10-15 09:05:53,132::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-183::DEBUG::2012-10-15 09:05:53,134::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'state': 'unknown', 'macAddr': '00:1a:4a:10:01:0d', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.00', 'cpuIdle': '100.00', 'elapsedTime': '18', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-184::DEBUG::2012-10-15 09:05:53,160::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-184::DEBUG::2012-10-15 09:05:53,163::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-184::DEBUG::2012-10-15 09:05:53,165::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-184::DEBUG::2012-10-15 09:05:53,166::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-184::DEBUG::2012-10-15 09:05:53,168::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-184::DEBUG::2012-10-15 09:05:53,170::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '87.60', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '0.49', 'cpuIdle': '12.40', 'elapsedTime': '40', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-185::DEBUG::2012-10-15 09:05:53,221::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-185::DEBUG::2012-10-15 09:05:53,224::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::CPU stats not available Thread-185::DEBUG::2012-10-15 09:05:53,226::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-185::DEBUG::2012-10-15 09:05:53,227::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-185::DEBUG::2012-10-15 09:05:53,229::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-185::DEBUG::2012-10-15 09:05:53,231::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-185::DEBUG::2012-10-15 09:05:53,233::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.99', 'cpuIdle': '100.00', 'elapsedTime': '36', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-186::DEBUG::2012-10-15 09:05:53,315::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-186::DEBUG::2012-10-15 09:05:53,324::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::CPU stats not available Thread-186::DEBUG::2012-10-15 09:05:53,335::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-186::DEBUG::2012-10-15 09:05:53,345::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-186::DEBUG::2012-10-15 09:05:53,347::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-186::DEBUG::2012-10-15 09:05:53,348::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-186::DEBUG::2012-10-15 09:05:53,350::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.25', 'cpuIdle': '100.00', 'elapsedTime': '26', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-187::DEBUG::2012-10-15 09:05:55,417::task::588::TaskManager.Task::(_updateState) Task=`0d27627a-25b2-4f19-aed4-0d704d9a62f6`::moving from state init -> state preparing Thread-187::INFO::2012-10-15 09:05:55,419::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-187::INFO::2012-10-15 09:05:55,422::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00251412391663', 'lastCheck': 1350291953.305558, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00120377540588', 'lastCheck': 1350291951.583925, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00486493110657', 'lastCheck': 1350291951.329068, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00487184524536', 'lastCheck': 1350291951.912839, 'code': 0, 'valid': True}} Thread-187::DEBUG::2012-10-15 09:05:55,424::task::1174::TaskManager.Task::(prepare) Task=`0d27627a-25b2-4f19-aed4-0d704d9a62f6`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00251412391663', 'lastCheck': 1350291953.305558, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00120377540588', 'lastCheck': 1350291951.583925, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00486493110657', 'lastCheck': 1350291951.329068, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00487184524536', 'lastCheck': 1350291951.912839, 'code': 0, 'valid': True}} Thread-187::DEBUG::2012-10-15 09:05:55,426::task::588::TaskManager.Task::(_updateState) Task=`0d27627a-25b2-4f19-aed4-0d704d9a62f6`::moving from state preparing -> state finished Thread-187::DEBUG::2012-10-15 09:05:55,427::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-187::DEBUG::2012-10-15 09:05:55,429::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-187::DEBUG::2012-10-15 09:05:55,430::task::980::TaskManager.Task::(_decref) Task=`0d27627a-25b2-4f19-aed4-0d704d9a62f6`::ref 0 aborting False Thread-188::DEBUG::2012-10-15 09:05:55,472::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::CPU stats not available Thread-188::DEBUG::2012-10-15 09:05:55,473::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-188::DEBUG::2012-10-15 09:05:55,473::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-188::DEBUG::2012-10-15 09:05:55,474::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-188::DEBUG::2012-10-15 09:05:55,474::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-188::DEBUG::2012-10-15 09:05:55,475::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::CPU stats not available Thread-188::DEBUG::2012-10-15 09:05:55,475::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-188::DEBUG::2012-10-15 09:05:55,476::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-188::DEBUG::2012-10-15 09:05:55,476::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-188::DEBUG::2012-10-15 09:05:55,476::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-188::DEBUG::2012-10-15 09:05:55,477::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::CPU stats not available Thread-188::DEBUG::2012-10-15 09:05:55,477::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-188::DEBUG::2012-10-15 09:05:55,478::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-188::DEBUG::2012-10-15 09:05:55,478::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-188::DEBUG::2012-10-15 09:05:55,479::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-188::DEBUG::2012-10-15 09:05:55,479::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-188::DEBUG::2012-10-15 09:05:55,480::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-188::DEBUG::2012-10-15 09:05:55,480::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-188::DEBUG::2012-10-15 09:05:55,480::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-188::DEBUG::2012-10-15 09:05:55,481::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::CPU stats not available Thread-188::DEBUG::2012-10-15 09:05:55,481::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-188::DEBUG::2012-10-15 09:05:55,482::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-188::DEBUG::2012-10-15 09:05:55,482::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-188::DEBUG::2012-10-15 09:05:55,483::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-188::DEBUG::2012-10-15 09:05:55,483::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-188::DEBUG::2012-10-15 09:05:55,484::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-188::DEBUG::2012-10-15 09:05:55,484::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-188::DEBUG::2012-10-15 09:05:55,484::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-188::DEBUG::2012-10-15 09:05:55,485::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::CPU stats not available Thread-188::DEBUG::2012-10-15 09:05:55,485::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-188::DEBUG::2012-10-15 09:05:55,486::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-188::DEBUG::2012-10-15 09:05:55,486::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-188::DEBUG::2012-10-15 09:05:55,487::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-188::DEBUG::2012-10-15 09:05:55,487::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::CPU stats not available Thread-188::DEBUG::2012-10-15 09:05:55,488::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-188::DEBUG::2012-10-15 09:05:55,488::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-188::DEBUG::2012-10-15 09:05:55,488::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-188::DEBUG::2012-10-15 09:05:55,489::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-188::DEBUG::2012-10-15 09:05:55,489::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::CPU stats not available Thread-188::DEBUG::2012-10-15 09:05:55,490::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-188::DEBUG::2012-10-15 09:05:55,490::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-188::DEBUG::2012-10-15 09:05:55,491::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-188::DEBUG::2012-10-15 09:05:55,491::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-190::DEBUG::2012-10-15 09:05:57,588::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-190::DEBUG::2012-10-15 09:05:57,589::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-190::DEBUG::2012-10-15 09:05:57,590::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-190::DEBUG::2012-10-15 09:05:57,590::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-190::DEBUG::2012-10-15 09:05:57,591::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-190::DEBUG::2012-10-15 09:05:57,592::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '79.23', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.30', 'cpuIdle': '20.77', 'elapsedTime': '32', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-191::DEBUG::2012-10-15 09:05:57,613::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-191::DEBUG::2012-10-15 09:05:57,615::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-191::DEBUG::2012-10-15 09:05:57,617::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-191::DEBUG::2012-10-15 09:05:57,619::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-191::DEBUG::2012-10-15 09:05:57,620::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-191::DEBUG::2012-10-15 09:05:57,622::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '113.43', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.50', 'cpuIdle': '0.00', 'elapsedTime': '48', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-192::DEBUG::2012-10-15 09:05:57,648::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-192::DEBUG::2012-10-15 09:05:57,650::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::CPU stats not available Thread-192::DEBUG::2012-10-15 09:05:57,652::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-192::DEBUG::2012-10-15 09:05:57,653::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-192::DEBUG::2012-10-15 09:05:57,654::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-192::DEBUG::2012-10-15 09:05:57,656::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-192::DEBUG::2012-10-15 09:05:57,658::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.59', 'cpuIdle': '100.00', 'elapsedTime': '25', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-193::DEBUG::2012-10-15 09:05:57,680::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-193::DEBUG::2012-10-15 09:05:57,682::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-193::DEBUG::2012-10-15 09:05:57,684::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-193::DEBUG::2012-10-15 09:05:57,685::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-193::DEBUG::2012-10-15 09:05:57,687::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-193::DEBUG::2012-10-15 09:05:57,688::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '79.21', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.41', 'cpuIdle': '20.79', 'elapsedTime': '38', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-194::DEBUG::2012-10-15 09:05:57,704::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-194::DEBUG::2012-10-15 09:05:57,705::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-194::DEBUG::2012-10-15 09:05:57,705::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-194::DEBUG::2012-10-15 09:05:57,705::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-194::DEBUG::2012-10-15 09:05:57,705::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-194::DEBUG::2012-10-15 09:05:57,706::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '79.14', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.44', 'cpuIdle': '20.86', 'elapsedTime': '43', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-195::DEBUG::2012-10-15 09:05:57,717::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-195::DEBUG::2012-10-15 09:05:57,717::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::CPU stats not available Thread-195::DEBUG::2012-10-15 09:05:57,717::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-195::DEBUG::2012-10-15 09:05:57,718::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-195::DEBUG::2012-10-15 09:05:57,718::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-195::DEBUG::2012-10-15 09:05:57,718::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-195::DEBUG::2012-10-15 09:05:57,719::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.59', 'cpuIdle': '100.00', 'elapsedTime': '23', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-196::DEBUG::2012-10-15 09:05:57,737::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-196::DEBUG::2012-10-15 09:05:57,739::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-196::DEBUG::2012-10-15 09:05:57,740::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-196::DEBUG::2012-10-15 09:05:57,742::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-196::DEBUG::2012-10-15 09:05:57,743::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-196::DEBUG::2012-10-15 09:05:57,745::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '87.60', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '1.04', 'cpuIdle': '12.40', 'elapsedTime': '45', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-197::DEBUG::2012-10-15 09:05:57,760::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-197::DEBUG::2012-10-15 09:05:57,760::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-197::DEBUG::2012-10-15 09:05:57,761::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-197::DEBUG::2012-10-15 09:05:57,761::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-197::DEBUG::2012-10-15 09:05:57,761::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-197::DEBUG::2012-10-15 09:05:57,762::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.48', 'cpuIdle': '20.84', 'elapsedTime': '40', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-198::DEBUG::2012-10-15 09:05:57,781::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-198::DEBUG::2012-10-15 09:05:57,783::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::CPU stats not available Thread-198::DEBUG::2012-10-15 09:05:57,785::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-198::DEBUG::2012-10-15 09:05:57,787::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-198::DEBUG::2012-10-15 09:05:57,788::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-198::DEBUG::2012-10-15 09:05:57,790::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-198::DEBUG::2012-10-15 09:05:57,792::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.70', 'cpuIdle': '100.00', 'elapsedTime': '30', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-200::DEBUG::2012-10-15 09:05:59,853::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-200::DEBUG::2012-10-15 09:05:59,854::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-200::DEBUG::2012-10-15 09:05:59,854::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-200::DEBUG::2012-10-15 09:05:59,855::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-200::DEBUG::2012-10-15 09:05:59,855::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-200::DEBUG::2012-10-15 09:05:59,856::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '79.23', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.57', 'cpuIdle': '20.77', 'elapsedTime': '34', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-201::DEBUG::2012-10-15 09:05:59,869::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-201::DEBUG::2012-10-15 09:05:59,870::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-201::DEBUG::2012-10-15 09:05:59,871::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-201::DEBUG::2012-10-15 09:05:59,872::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-201::DEBUG::2012-10-15 09:05:59,872::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-201::DEBUG::2012-10-15 09:05:59,873::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '113.43', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.76', 'cpuIdle': '0.00', 'elapsedTime': '50', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-202::DEBUG::2012-10-15 09:05:59,887::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-202::DEBUG::2012-10-15 09:05:59,888::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::CPU stats not available Thread-202::DEBUG::2012-10-15 09:05:59,889::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-202::DEBUG::2012-10-15 09:05:59,890::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-202::DEBUG::2012-10-15 09:05:59,890::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-202::DEBUG::2012-10-15 09:05:59,891::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-202::DEBUG::2012-10-15 09:05:59,891::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.82', 'cpuIdle': '100.00', 'elapsedTime': '28', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-203::DEBUG::2012-10-15 09:05:59,908::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-203::DEBUG::2012-10-15 09:05:59,909::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-203::DEBUG::2012-10-15 09:05:59,910::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-203::DEBUG::2012-10-15 09:05:59,910::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-203::DEBUG::2012-10-15 09:05:59,911::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-203::DEBUG::2012-10-15 09:05:59,912::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '79.21', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.64', 'cpuIdle': '20.79', 'elapsedTime': '40', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-204::DEBUG::2012-10-15 09:05:59,926::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-204::DEBUG::2012-10-15 09:05:59,927::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-204::DEBUG::2012-10-15 09:05:59,927::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-204::DEBUG::2012-10-15 09:05:59,928::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-204::DEBUG::2012-10-15 09:05:59,929::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-204::DEBUG::2012-10-15 09:05:59,929::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '79.14', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.66', 'cpuIdle': '20.86', 'elapsedTime': '45', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-205::DEBUG::2012-10-15 09:05:59,943::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-205::DEBUG::2012-10-15 09:05:59,944::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::CPU stats not available Thread-205::DEBUG::2012-10-15 09:05:59,944::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-205::DEBUG::2012-10-15 09:05:59,945::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-205::DEBUG::2012-10-15 09:05:59,945::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-205::DEBUG::2012-10-15 09:05:59,946::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-205::DEBUG::2012-10-15 09:05:59,947::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.82', 'cpuIdle': '100.00', 'elapsedTime': '25', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-206::DEBUG::2012-10-15 09:05:59,961::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-206::DEBUG::2012-10-15 09:05:59,962::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-206::DEBUG::2012-10-15 09:05:59,963::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-206::DEBUG::2012-10-15 09:05:59,963::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-206::DEBUG::2012-10-15 09:05:59,964::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-206::DEBUG::2012-10-15 09:05:59,965::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '87.60', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '0.22', 'cpuIdle': '12.40', 'elapsedTime': '47', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-207::DEBUG::2012-10-15 09:05:59,978::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-207::DEBUG::2012-10-15 09:05:59,979::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-207::DEBUG::2012-10-15 09:05:59,980::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-207::DEBUG::2012-10-15 09:05:59,980::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-207::DEBUG::2012-10-15 09:05:59,981::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-207::DEBUG::2012-10-15 09:05:59,982::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.69', 'cpuIdle': '20.84', 'elapsedTime': '43', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-208::DEBUG::2012-10-15 09:06:00,001::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-208::DEBUG::2012-10-15 09:06:00,004::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::CPU stats not available Thread-208::DEBUG::2012-10-15 09:06:00,005::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-208::DEBUG::2012-10-15 09:06:00,007::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-208::DEBUG::2012-10-15 09:06:00,008::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-208::DEBUG::2012-10-15 09:06:00,010::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-208::DEBUG::2012-10-15 09:06:00,012::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.92', 'cpuIdle': '100.00', 'elapsedTime': '32', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-210::DEBUG::2012-10-15 09:06:02,064::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-210::DEBUG::2012-10-15 09:06:02,065::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-210::DEBUG::2012-10-15 09:06:02,066::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-210::DEBUG::2012-10-15 09:06:02,067::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-210::DEBUG::2012-10-15 09:06:02,071::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-210::DEBUG::2012-10-15 09:06:02,073::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '79.23', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.78', 'cpuIdle': '20.77', 'elapsedTime': '36', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-211::DEBUG::2012-10-15 09:06:02,090::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-211::DEBUG::2012-10-15 09:06:02,093::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-211::DEBUG::2012-10-15 09:06:02,096::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-211::DEBUG::2012-10-15 09:06:02,098::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-211::DEBUG::2012-10-15 09:06:02,099::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-211::DEBUG::2012-10-15 09:06:02,101::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '113.43', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.97', 'cpuIdle': '0.00', 'elapsedTime': '52', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-212::DEBUG::2012-10-15 09:06:02,119::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-212::DEBUG::2012-10-15 09:06:02,120::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-212::DEBUG::2012-10-15 09:06:02,120::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-212::DEBUG::2012-10-15 09:06:02,121::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-212::DEBUG::2012-10-15 09:06:02,122::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-212::DEBUG::2012-10-15 09:06:02,122::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.05', 'cpuIdle': '20.84', 'elapsedTime': '30', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-213::DEBUG::2012-10-15 09:06:02,137::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-213::DEBUG::2012-10-15 09:06:02,138::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-213::DEBUG::2012-10-15 09:06:02,139::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-213::DEBUG::2012-10-15 09:06:02,139::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-213::DEBUG::2012-10-15 09:06:02,140::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-213::DEBUG::2012-10-15 09:06:02,141::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '79.21', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.86', 'cpuIdle': '20.79', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-214::DEBUG::2012-10-15 09:06:02,154::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-214::DEBUG::2012-10-15 09:06:02,155::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-214::DEBUG::2012-10-15 09:06:02,156::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-214::DEBUG::2012-10-15 09:06:02,156::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-214::DEBUG::2012-10-15 09:06:02,157::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-214::DEBUG::2012-10-15 09:06:02,157::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '79.14', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.88', 'cpuIdle': '20.86', 'elapsedTime': '47', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-215::DEBUG::2012-10-15 09:06:02,179::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-215::DEBUG::2012-10-15 09:06:02,180::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::CPU stats not available Thread-215::DEBUG::2012-10-15 09:06:02,181::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-215::DEBUG::2012-10-15 09:06:02,181::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-215::DEBUG::2012-10-15 09:06:02,183::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-215::DEBUG::2012-10-15 09:06:02,184::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-215::DEBUG::2012-10-15 09:06:02,184::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.05', 'cpuIdle': '100.00', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-216::DEBUG::2012-10-15 09:06:02,206::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-216::DEBUG::2012-10-15 09:06:02,207::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-216::DEBUG::2012-10-15 09:06:02,208::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-216::DEBUG::2012-10-15 09:06:02,208::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-216::DEBUG::2012-10-15 09:06:02,209::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-216::DEBUG::2012-10-15 09:06:02,210::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '87.60', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '1.46', 'cpuIdle': '12.40', 'elapsedTime': '49', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-217::DEBUG::2012-10-15 09:06:02,232::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-217::DEBUG::2012-10-15 09:06:02,233::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-217::DEBUG::2012-10-15 09:06:02,234::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-217::DEBUG::2012-10-15 09:06:02,234::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-217::DEBUG::2012-10-15 09:06:02,235::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-217::DEBUG::2012-10-15 09:06:02,236::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.95', 'cpuIdle': '20.84', 'elapsedTime': '45', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-218::DEBUG::2012-10-15 09:06:02,255::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-218::DEBUG::2012-10-15 09:06:02,258::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-218::DEBUG::2012-10-15 09:06:02,258::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-218::DEBUG::2012-10-15 09:06:02,259::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-218::DEBUG::2012-10-15 09:06:02,260::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-218::DEBUG::2012-10-15 09:06:02,261::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '71.70', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.15', 'cpuIdle': '28.30', 'elapsedTime': '34', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-220::DEBUG::2012-10-15 09:06:04,333::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-220::DEBUG::2012-10-15 09:06:04,336::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-220::DEBUG::2012-10-15 09:06:04,338::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-220::DEBUG::2012-10-15 09:06:04,339::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-220::DEBUG::2012-10-15 09:06:04,341::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-220::DEBUG::2012-10-15 09:06:04,343::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '79.23', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.04', 'cpuIdle': '20.77', 'elapsedTime': '38', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-221::DEBUG::2012-10-15 09:06:04,389::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-221::DEBUG::2012-10-15 09:06:04,392::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-221::DEBUG::2012-10-15 09:06:04,393::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-221::DEBUG::2012-10-15 09:06:04,418::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-221::DEBUG::2012-10-15 09:06:04,437::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-221::DEBUG::2012-10-15 09:06:04,450::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '113.43', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.27', 'cpuIdle': '0.00', 'elapsedTime': '55', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-222::DEBUG::2012-10-15 09:06:04,489::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-222::DEBUG::2012-10-15 09:06:04,491::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-222::DEBUG::2012-10-15 09:06:04,493::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-222::DEBUG::2012-10-15 09:06:04,494::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-222::DEBUG::2012-10-15 09:06:04,496::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-222::DEBUG::2012-10-15 09:06:04,497::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.40', 'cpuIdle': '20.84', 'elapsedTime': '32', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-223::DEBUG::2012-10-15 09:06:04,523::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-223::DEBUG::2012-10-15 09:06:04,525::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-223::DEBUG::2012-10-15 09:06:04,527::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-223::DEBUG::2012-10-15 09:06:04,529::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-223::DEBUG::2012-10-15 09:06:04,531::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-223::DEBUG::2012-10-15 09:06:04,533::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '79.21', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.24', 'cpuIdle': '20.79', 'elapsedTime': '45', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-224::DEBUG::2012-10-15 09:06:04,559::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-224::DEBUG::2012-10-15 09:06:04,561::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-224::DEBUG::2012-10-15 09:06:04,563::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-224::DEBUG::2012-10-15 09:06:04,564::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-224::DEBUG::2012-10-15 09:06:04,566::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-224::DEBUG::2012-10-15 09:06:04,568::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '79.14', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.28', 'cpuIdle': '20.86', 'elapsedTime': '49', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-225::DEBUG::2012-10-15 09:06:04,594::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-225::DEBUG::2012-10-15 09:06:04,596::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::CPU stats not available Thread-225::DEBUG::2012-10-15 09:06:04,597::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-225::DEBUG::2012-10-15 09:06:04,599::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-225::DEBUG::2012-10-15 09:06:04,600::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-225::DEBUG::2012-10-15 09:06:04,602::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-225::DEBUG::2012-10-15 09:06:04,603::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.47', 'cpuIdle': '100.00', 'elapsedTime': '29', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-226::DEBUG::2012-10-15 09:06:04,628::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-226::DEBUG::2012-10-15 09:06:04,630::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-226::DEBUG::2012-10-15 09:06:04,631::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-226::DEBUG::2012-10-15 09:06:04,633::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-226::DEBUG::2012-10-15 09:06:04,634::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-226::DEBUG::2012-10-15 09:06:04,636::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '87.60', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '1.86', 'cpuIdle': '12.40', 'elapsedTime': '52', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-227::DEBUG::2012-10-15 09:06:04,661::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-227::DEBUG::2012-10-15 09:06:04,663::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-227::DEBUG::2012-10-15 09:06:04,664::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-227::DEBUG::2012-10-15 09:06:04,666::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-227::DEBUG::2012-10-15 09:06:04,667::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-227::DEBUG::2012-10-15 09:06:04,669::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.37', 'cpuIdle': '20.84', 'elapsedTime': '47', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-228::DEBUG::2012-10-15 09:06:04,695::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-228::DEBUG::2012-10-15 09:06:04,697::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-228::DEBUG::2012-10-15 09:06:04,698::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-228::DEBUG::2012-10-15 09:06:04,700::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-228::DEBUG::2012-10-15 09:06:04,701::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-228::DEBUG::2012-10-15 09:06:04,703::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '71.70', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.59', 'cpuIdle': '28.30', 'elapsedTime': '37', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-229::DEBUG::2012-10-15 09:06:06,831::task::588::TaskManager.Task::(_updateState) Task=`8b574f51-5866-4554-b7a1-27c7edaf7736`::moving from state init -> state preparing Thread-229::INFO::2012-10-15 09:06:06,848::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-229::INFO::2012-10-15 09:06:06,850::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.0291788578033', 'lastCheck': 1350291963.364314, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000506162643433', 'lastCheck': 1350291961.591834, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00217199325562', 'lastCheck': 1350291961.363161, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00143384933472', 'lastCheck': 1350291961.926703, 'code': 0, 'valid': True}} Thread-229::DEBUG::2012-10-15 09:06:06,852::task::1174::TaskManager.Task::(prepare) Task=`8b574f51-5866-4554-b7a1-27c7edaf7736`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.0291788578033', 'lastCheck': 1350291963.364314, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.000506162643433', 'lastCheck': 1350291961.591834, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00217199325562', 'lastCheck': 1350291961.363161, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00143384933472', 'lastCheck': 1350291961.926703, 'code': 0, 'valid': True}} Thread-229::DEBUG::2012-10-15 09:06:06,854::task::588::TaskManager.Task::(_updateState) Task=`8b574f51-5866-4554-b7a1-27c7edaf7736`::moving from state preparing -> state finished Thread-229::DEBUG::2012-10-15 09:06:06,855::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-229::DEBUG::2012-10-15 09:06:06,857::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-229::DEBUG::2012-10-15 09:06:06,858::task::980::TaskManager.Task::(_decref) Task=`8b574f51-5866-4554-b7a1-27c7edaf7736`::ref 0 aborting False Thread-230::DEBUG::2012-10-15 09:06:06,904::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-230::DEBUG::2012-10-15 09:06:06,905::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-230::DEBUG::2012-10-15 09:06:06,907::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-230::DEBUG::2012-10-15 09:06:06,908::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-230::DEBUG::2012-10-15 09:06:06,910::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-230::DEBUG::2012-10-15 09:06:06,912::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-230::DEBUG::2012-10-15 09:06:06,913::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-230::DEBUG::2012-10-15 09:06:06,914::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-230::DEBUG::2012-10-15 09:06:06,916::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-230::DEBUG::2012-10-15 09:06:06,918::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-230::DEBUG::2012-10-15 09:06:06,919::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-230::DEBUG::2012-10-15 09:06:06,920::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-230::DEBUG::2012-10-15 09:06:06,922::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-230::DEBUG::2012-10-15 09:06:06,924::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-230::DEBUG::2012-10-15 09:06:06,925::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-230::DEBUG::2012-10-15 09:06:06,926::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-230::DEBUG::2012-10-15 09:06:06,928::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-230::DEBUG::2012-10-15 09:06:06,930::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-230::DEBUG::2012-10-15 09:06:06,931::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-230::DEBUG::2012-10-15 09:06:06,933::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-230::DEBUG::2012-10-15 09:06:06,935::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-230::DEBUG::2012-10-15 09:06:06,936::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-230::DEBUG::2012-10-15 09:06:06,937::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-230::DEBUG::2012-10-15 09:06:06,939::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-230::DEBUG::2012-10-15 09:06:06,941::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-230::DEBUG::2012-10-15 09:06:06,942::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-230::DEBUG::2012-10-15 09:06:06,944::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-230::DEBUG::2012-10-15 09:06:06,945::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-230::DEBUG::2012-10-15 09:06:06,947::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-230::DEBUG::2012-10-15 09:06:06,948::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-230::DEBUG::2012-10-15 09:06:06,950::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-230::DEBUG::2012-10-15 09:06:06,951::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-230::DEBUG::2012-10-15 09:06:06,953::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-230::DEBUG::2012-10-15 09:06:06,954::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-230::DEBUG::2012-10-15 09:06:06,956::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-230::DEBUG::2012-10-15 09:06:06,957::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-232::DEBUG::2012-10-15 09:06:09,074::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-232::DEBUG::2012-10-15 09:06:09,076::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-232::DEBUG::2012-10-15 09:06:09,078::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-232::DEBUG::2012-10-15 09:06:09,079::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-232::DEBUG::2012-10-15 09:06:09,121::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-232::DEBUG::2012-10-15 09:06:09,123::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '79.23', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.77', 'cpuIdle': '20.77', 'elapsedTime': '43', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-233::DEBUG::2012-10-15 09:06:09,154::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-233::DEBUG::2012-10-15 09:06:09,156::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-233::DEBUG::2012-10-15 09:06:09,157::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-233::DEBUG::2012-10-15 09:06:09,159::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-233::DEBUG::2012-10-15 09:06:09,160::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-233::DEBUG::2012-10-15 09:06:09,161::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '113.43', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.03', 'cpuIdle': '0.00', 'elapsedTime': '59', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-234::DEBUG::2012-10-15 09:06:09,187::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-234::DEBUG::2012-10-15 09:06:09,190::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-234::DEBUG::2012-10-15 09:06:09,192::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-234::DEBUG::2012-10-15 09:06:09,193::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-234::DEBUG::2012-10-15 09:06:09,195::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-234::DEBUG::2012-10-15 09:06:09,197::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.07', 'cpuIdle': '20.84', 'elapsedTime': '37', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-235::DEBUG::2012-10-15 09:06:09,221::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-235::DEBUG::2012-10-15 09:06:09,224::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-235::DEBUG::2012-10-15 09:06:09,225::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-235::DEBUG::2012-10-15 09:06:09,226::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-235::DEBUG::2012-10-15 09:06:09,228::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-235::DEBUG::2012-10-15 09:06:09,230::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '79.21', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.93', 'cpuIdle': '20.79', 'elapsedTime': '49', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-236::DEBUG::2012-10-15 09:06:09,254::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-236::DEBUG::2012-10-15 09:06:09,256::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-236::DEBUG::2012-10-15 09:06:09,259::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-236::DEBUG::2012-10-15 09:06:09,261::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-236::DEBUG::2012-10-15 09:06:09,262::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-236::DEBUG::2012-10-15 09:06:09,264::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '79.14', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.96', 'cpuIdle': '20.86', 'elapsedTime': '54', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-237::DEBUG::2012-10-15 09:06:09,290::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-237::DEBUG::2012-10-15 09:06:09,292::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-237::DEBUG::2012-10-15 09:06:09,294::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-237::DEBUG::2012-10-15 09:06:09,296::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-237::DEBUG::2012-10-15 09:06:09,298::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-237::DEBUG::2012-10-15 09:06:09,299::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '72.83', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.14', 'cpuIdle': '27.17', 'elapsedTime': '34', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-238::DEBUG::2012-10-15 09:06:09,325::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-238::DEBUG::2012-10-15 09:06:09,327::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-238::DEBUG::2012-10-15 09:06:09,329::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-238::DEBUG::2012-10-15 09:06:09,330::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-238::DEBUG::2012-10-15 09:06:09,332::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-238::DEBUG::2012-10-15 09:06:09,334::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '98.70', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '0.44', 'cpuIdle': '1.30', 'elapsedTime': '57', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-239::DEBUG::2012-10-15 09:06:09,357::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-239::DEBUG::2012-10-15 09:06:09,359::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-239::DEBUG::2012-10-15 09:06:09,361::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-239::DEBUG::2012-10-15 09:06:09,362::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-239::DEBUG::2012-10-15 09:06:09,364::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-239::DEBUG::2012-10-15 09:06:09,366::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.05', 'cpuIdle': '20.84', 'elapsedTime': '52', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-240::DEBUG::2012-10-15 09:06:09,389::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-240::DEBUG::2012-10-15 09:06:09,391::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-240::DEBUG::2012-10-15 09:06:09,393::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-240::DEBUG::2012-10-15 09:06:09,394::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-240::DEBUG::2012-10-15 09:06:09,396::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-240::DEBUG::2012-10-15 09:06:09,398::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '71.70', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.27', 'cpuIdle': '28.30', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-242::DEBUG::2012-10-15 09:06:11,470::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-242::DEBUG::2012-10-15 09:06:11,472::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-242::DEBUG::2012-10-15 09:06:11,511::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-242::DEBUG::2012-10-15 09:06:11,512::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-242::DEBUG::2012-10-15 09:06:11,514::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-242::DEBUG::2012-10-15 09:06:11,516::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '53.20', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.16', 'cpuIdle': '46.80', 'elapsedTime': '46', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-243::DEBUG::2012-10-15 09:06:11,636::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ae5dca11-2aa1-43be-a7c1-a636374a869a',) {} Thread-243::DEBUG::2012-10-15 09:06:11,639::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-243::DEBUG::2012-10-15 09:06:11,640::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-243::DEBUG::2012-10-15 09:06:11,643::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-243::DEBUG::2012-10-15 09:06:11,645::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-243::DEBUG::2012-10-15 09:06:11,648::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5606', 'displayIp': '172.16.101.102', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '-313', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '52:54:00:74:f2:d2', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ae5dca11-2aa1-43be-a7c1-a636374a869a', 'monitorResponse': '0', 'cpuUser': '99.81', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '9be3a4e5-0ab5-4705-a743-818fa2165c6a'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.50', 'cpuIdle': '0.19', 'elapsedTime': '62', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-244::DEBUG::2012-10-15 09:06:11,779::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-244::DEBUG::2012-10-15 09:06:11,782::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-244::DEBUG::2012-10-15 09:06:11,784::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-244::DEBUG::2012-10-15 09:06:11,785::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-244::DEBUG::2012-10-15 09:06:11,787::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-244::DEBUG::2012-10-15 09:06:11,789::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.66', 'cpuIdle': '20.84', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-245::DEBUG::2012-10-15 09:06:11,820::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-245::DEBUG::2012-10-15 09:06:11,820::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-245::DEBUG::2012-10-15 09:06:11,821::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-245::DEBUG::2012-10-15 09:06:11,821::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-245::DEBUG::2012-10-15 09:06:11,821::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-245::DEBUG::2012-10-15 09:06:11,821::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '53.19', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.52', 'cpuIdle': '46.81', 'elapsedTime': '52', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-246::DEBUG::2012-10-15 09:06:11,923::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-246::DEBUG::2012-10-15 09:06:11,925::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-246::DEBUG::2012-10-15 09:06:11,927::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-246::DEBUG::2012-10-15 09:06:11,932::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-246::DEBUG::2012-10-15 09:06:11,935::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-246::DEBUG::2012-10-15 09:06:11,937::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '59.84', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.63', 'cpuIdle': '40.16', 'elapsedTime': '57', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-247::DEBUG::2012-10-15 09:06:11,961::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-247::DEBUG::2012-10-15 09:06:11,961::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-247::DEBUG::2012-10-15 09:06:11,962::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-247::DEBUG::2012-10-15 09:06:11,962::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-247::DEBUG::2012-10-15 09:06:11,962::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-247::DEBUG::2012-10-15 09:06:11,962::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '72.83', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.81', 'cpuIdle': '27.17', 'elapsedTime': '37', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-248::DEBUG::2012-10-15 09:06:11,980::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-248::DEBUG::2012-10-15 09:06:11,980::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-248::DEBUG::2012-10-15 09:06:11,981::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-248::DEBUG::2012-10-15 09:06:11,981::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-248::DEBUG::2012-10-15 09:06:11,981::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-248::DEBUG::2012-10-15 09:06:11,981::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '98.70', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '1.07', 'cpuIdle': '1.30', 'elapsedTime': '59', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-249::DEBUG::2012-10-15 09:06:12,004::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-249::DEBUG::2012-10-15 09:06:12,007::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-249::DEBUG::2012-10-15 09:06:12,009::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-249::DEBUG::2012-10-15 09:06:12,010::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-249::DEBUG::2012-10-15 09:06:12,012::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-249::DEBUG::2012-10-15 09:06:12,014::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '79.80', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.70', 'cpuIdle': '20.20', 'elapsedTime': '55', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-250::DEBUG::2012-10-15 09:06:12,038::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-250::DEBUG::2012-10-15 09:06:12,041::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-250::DEBUG::2012-10-15 09:06:12,042::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-250::DEBUG::2012-10-15 09:06:12,044::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-250::DEBUG::2012-10-15 09:06:12,045::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-250::DEBUG::2012-10-15 09:06:12,047::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '71.70', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.92', 'cpuIdle': '28.30', 'elapsedTime': '44', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-252::DEBUG::2012-10-15 09:06:14,123::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-252::DEBUG::2012-10-15 09:06:14,125::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-252::DEBUG::2012-10-15 09:06:14,127::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-252::DEBUG::2012-10-15 09:06:14,129::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-252::DEBUG::2012-10-15 09:06:14,130::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-252::DEBUG::2012-10-15 09:06:14,132::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '53.20', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.81', 'cpuIdle': '46.80', 'elapsedTime': '48', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-253::DEBUG::2012-10-15 09:06:14,155::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-253::DEBUG::2012-10-15 09:06:14,158::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-253::DEBUG::2012-10-15 09:06:14,160::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-253::DEBUG::2012-10-15 09:06:14,161::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-253::DEBUG::2012-10-15 09:06:14,163::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-253::DEBUG::2012-10-15 09:06:14,164::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.04', 'cpuIdle': '20.84', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-254::DEBUG::2012-10-15 09:06:14,187::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-254::DEBUG::2012-10-15 09:06:14,189::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-254::DEBUG::2012-10-15 09:06:14,191::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-254::DEBUG::2012-10-15 09:06:14,192::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-254::DEBUG::2012-10-15 09:06:14,194::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-254::DEBUG::2012-10-15 09:06:14,195::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '53.19', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.89', 'cpuIdle': '46.81', 'elapsedTime': '54', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-255::DEBUG::2012-10-15 09:06:14,220::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-255::DEBUG::2012-10-15 09:06:14,227::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-255::DEBUG::2012-10-15 09:06:14,230::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-255::DEBUG::2012-10-15 09:06:14,240::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-255::DEBUG::2012-10-15 09:06:14,243::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-255::DEBUG::2012-10-15 09:06:14,245::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '59.84', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.93', 'cpuIdle': '40.16', 'elapsedTime': '59', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-256::DEBUG::2012-10-15 09:06:14,270::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-256::DEBUG::2012-10-15 09:06:14,272::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-256::DEBUG::2012-10-15 09:06:14,274::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-256::DEBUG::2012-10-15 09:06:14,275::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-256::DEBUG::2012-10-15 09:06:14,276::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-256::DEBUG::2012-10-15 09:06:14,278::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '72.83', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.12', 'cpuIdle': '27.17', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-257::DEBUG::2012-10-15 09:06:14,303::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('dea83ab1-6310-47c9-8c0c-88171c24045e',) {} Thread-257::DEBUG::2012-10-15 09:06:14,305::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-257::DEBUG::2012-10-15 09:06:14,307::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-257::DEBUG::2012-10-15 09:06:14,308::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-257::DEBUG::2012-10-15 09:06:14,310::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-257::DEBUG::2012-10-15 09:06:14,312::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5720', 'displayIp': '172.16.101.102', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'cdrom': '/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/17e82ced-d839-4b4d-9d81-5333ad777100/images/11111111-1111-1111-1111-111111111111/win2k8r2_64.iso', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:10:01:02', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'dea83ab1-6310-47c9-8c0c-88171c24045e', 'monitorResponse': '0', 'cpuUser': '98.70', 'disks': {'vda': {'truesize': '19327352832', 'apparentsize': '19327352832', 'imageID': '70028937-af10-4aa1-a93a-1e8fcc9827fb'}, 'hdc': {}}, 'boot': 'dc', 'statsAge': '1.39', 'cpuIdle': '1.30', 'elapsedTime': '62', 'vmType': 'kvm', 'cpuSys': '0.00', 'timeOffset': '7093', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-258::DEBUG::2012-10-15 09:06:14,337::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-258::DEBUG::2012-10-15 09:06:14,340::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-258::DEBUG::2012-10-15 09:06:14,341::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-258::DEBUG::2012-10-15 09:06:14,343::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-258::DEBUG::2012-10-15 09:06:14,344::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-258::DEBUG::2012-10-15 09:06:14,346::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '79.80', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.03', 'cpuIdle': '20.20', 'elapsedTime': '57', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-259::DEBUG::2012-10-15 09:06:14,370::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-259::DEBUG::2012-10-15 09:06:14,372::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-259::DEBUG::2012-10-15 09:06:14,374::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-259::DEBUG::2012-10-15 09:06:14,375::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-259::DEBUG::2012-10-15 09:06:14,377::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-259::DEBUG::2012-10-15 09:06:14,378::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '71.70', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.24', 'cpuIdle': '28.30', 'elapsedTime': '47', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-261::DEBUG::2012-10-15 09:06:16,463::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-261::DEBUG::2012-10-15 09:06:16,465::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-261::DEBUG::2012-10-15 09:06:16,467::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-261::DEBUG::2012-10-15 09:06:16,469::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-261::DEBUG::2012-10-15 09:06:16,470::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-261::DEBUG::2012-10-15 09:06:16,473::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '53.20', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.15', 'cpuIdle': '46.80', 'elapsedTime': '51', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-262::DEBUG::2012-10-15 09:06:16,501::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-262::DEBUG::2012-10-15 09:06:16,504::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-262::DEBUG::2012-10-15 09:06:16,505::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-262::DEBUG::2012-10-15 09:06:16,507::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-262::DEBUG::2012-10-15 09:06:16,509::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-262::DEBUG::2012-10-15 09:06:16,511::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '79.16', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '1.38', 'cpuIdle': '20.84', 'elapsedTime': '44', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-263::DEBUG::2012-10-15 09:06:16,548::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-263::DEBUG::2012-10-15 09:06:16,550::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-263::DEBUG::2012-10-15 09:06:16,552::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-263::DEBUG::2012-10-15 09:06:16,553::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-263::DEBUG::2012-10-15 09:06:16,555::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-263::DEBUG::2012-10-15 09:06:16,557::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '53.19', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.25', 'cpuIdle': '46.81', 'elapsedTime': '57', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-264::DEBUG::2012-10-15 09:06:16,774::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('66fcf199-aa3e-4dc9-b4bf-ea91649bace4',) {} Thread-264::DEBUG::2012-10-15 09:06:16,790::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-264::DEBUG::2012-10-15 09:06:16,826::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-264::DEBUG::2012-10-15 09:06:16,854::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-264::DEBUG::2012-10-15 09:06:16,856::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-264::DEBUG::2012-10-15 09:06:16,859::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5855', 'displayIp': '172.16.101.102', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '-352', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:0c:29:4f:6c:c6', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '66fcf199-aa3e-4dc9-b4bf-ea91649bace4', 'monitorResponse': '0', 'cpuUser': '59.84', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': '93966c50-a1ac-4735-a814-fca83010fff7'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.49', 'cpuIdle': '40.16', 'elapsedTime': '62', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-265::DEBUG::2012-10-15 09:06:16,886::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-265::DEBUG::2012-10-15 09:06:16,888::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-265::DEBUG::2012-10-15 09:06:16,890::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-265::DEBUG::2012-10-15 09:06:16,892::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-265::DEBUG::2012-10-15 09:06:16,893::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-265::DEBUG::2012-10-15 09:06:16,895::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '72.83', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.72', 'cpuIdle': '27.17', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-266::DEBUG::2012-10-15 09:06:16,924::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab',) {} Thread-266::DEBUG::2012-10-15 09:06:16,927::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-266::DEBUG::2012-10-15 09:06:16,929::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-266::DEBUG::2012-10-15 09:06:16,930::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-266::DEBUG::2012-10-15 09:06:16,932::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-266::DEBUG::2012-10-15 09:06:16,934::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5925', 'displayIp': '172.16.101.102', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '115691', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:0c:29:4d:84:12', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab', 'monitorResponse': '0', 'cpuUser': '79.80', 'disks': {'vda': {'truesize': '118111600640', 'apparentsize': '118111600640', 'imageID': 'e2059ec7-8dc5-4058-bab8-73762de5e0f5'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.61', 'cpuIdle': '20.20', 'elapsedTime': '60', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-267::DEBUG::2012-10-15 09:06:16,962::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-267::DEBUG::2012-10-15 09:06:16,965::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-267::DEBUG::2012-10-15 09:06:16,968::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-267::DEBUG::2012-10-15 09:06:16,970::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-267::DEBUG::2012-10-15 09:06:16,971::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-267::DEBUG::2012-10-15 09:06:16,973::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '73.13', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.84', 'cpuIdle': '26.87', 'elapsedTime': '49', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-268::DEBUG::2012-10-15 09:06:19,033::task::588::TaskManager.Task::(_updateState) Task=`55c29aba-82b4-481a-a718-e15f42b65c36`::moving from state init -> state preparing Thread-268::INFO::2012-10-15 09:06:19,035::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-268::INFO::2012-10-15 09:06:19,037::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.0648348331451', 'lastCheck': 1350291973.453151, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00384402275085', 'lastCheck': 1350291971.623105, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00257706642151', 'lastCheck': 1350291971.374378, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.064423084259', 'lastCheck': 1350291972.002446, 'code': 0, 'valid': True}} Thread-268::DEBUG::2012-10-15 09:06:19,039::task::1174::TaskManager.Task::(prepare) Task=`55c29aba-82b4-481a-a718-e15f42b65c36`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.0648348331451', 'lastCheck': 1350291973.453151, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00384402275085', 'lastCheck': 1350291971.623105, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00257706642151', 'lastCheck': 1350291971.374378, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.064423084259', 'lastCheck': 1350291972.002446, 'code': 0, 'valid': True}} Thread-268::DEBUG::2012-10-15 09:06:19,041::task::588::TaskManager.Task::(_updateState) Task=`55c29aba-82b4-481a-a718-e15f42b65c36`::moving from state preparing -> state finished Thread-268::DEBUG::2012-10-15 09:06:19,042::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-268::DEBUG::2012-10-15 09:06:19,044::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-268::DEBUG::2012-10-15 09:06:19,045::task::980::TaskManager.Task::(_decref) Task=`55c29aba-82b4-481a-a718-e15f42b65c36`::ref 0 aborting False Thread-269::DEBUG::2012-10-15 09:06:19,086::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-269::DEBUG::2012-10-15 09:06:19,088::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-269::DEBUG::2012-10-15 09:06:19,089::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-269::DEBUG::2012-10-15 09:06:19,090::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-269::DEBUG::2012-10-15 09:06:19,092::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-269::DEBUG::2012-10-15 09:06:19,094::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-269::DEBUG::2012-10-15 09:06:19,095::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-269::DEBUG::2012-10-15 09:06:19,096::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-269::DEBUG::2012-10-15 09:06:19,098::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-269::DEBUG::2012-10-15 09:06:19,100::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-269::DEBUG::2012-10-15 09:06:19,101::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-269::DEBUG::2012-10-15 09:06:19,102::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-269::DEBUG::2012-10-15 09:06:19,104::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda stats not available Thread-269::DEBUG::2012-10-15 09:06:19,106::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-269::DEBUG::2012-10-15 09:06:19,107::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-269::DEBUG::2012-10-15 09:06:19,108::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-269::DEBUG::2012-10-15 09:06:19,110::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-269::DEBUG::2012-10-15 09:06:19,112::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-269::DEBUG::2012-10-15 09:06:19,113::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-269::DEBUG::2012-10-15 09:06:19,115::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-269::DEBUG::2012-10-15 09:06:19,117::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-269::DEBUG::2012-10-15 09:06:19,118::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-269::DEBUG::2012-10-15 09:06:19,119::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-269::DEBUG::2012-10-15 09:06:19,121::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-269::DEBUG::2012-10-15 09:06:19,123::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-269::DEBUG::2012-10-15 09:06:19,124::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-269::DEBUG::2012-10-15 09:06:19,125::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-269::DEBUG::2012-10-15 09:06:19,127::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-269::DEBUG::2012-10-15 09:06:19,129::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-269::DEBUG::2012-10-15 09:06:19,130::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-269::DEBUG::2012-10-15 09:06:19,131::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-269::DEBUG::2012-10-15 09:06:19,133::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-269::DEBUG::2012-10-15 09:06:19,135::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-269::DEBUG::2012-10-15 09:06:19,137::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-269::DEBUG::2012-10-15 09:06:19,138::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-269::DEBUG::2012-10-15 09:06:19,139::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-271::DEBUG::2012-10-15 09:06:21,255::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-271::DEBUG::2012-10-15 09:06:21,258::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-271::DEBUG::2012-10-15 09:06:21,261::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-271::DEBUG::2012-10-15 09:06:21,263::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-271::DEBUG::2012-10-15 09:06:21,265::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-271::DEBUG::2012-10-15 09:06:21,267::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '53.20', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.93', 'cpuIdle': '46.80', 'elapsedTime': '55', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-272::DEBUG::2012-10-15 09:06:21,295::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-272::DEBUG::2012-10-15 09:06:21,297::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-272::DEBUG::2012-10-15 09:06:21,299::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-272::DEBUG::2012-10-15 09:06:21,301::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-272::DEBUG::2012-10-15 09:06:21,303::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-272::DEBUG::2012-10-15 09:06:21,305::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '99.65', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.15', 'cpuIdle': '0.35', 'elapsedTime': '49', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-273::DEBUG::2012-10-15 09:06:21,336::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('3a53bfa7-943b-4162-b570-997f548ed5ee',) {} Thread-273::DEBUG::2012-10-15 09:06:21,342::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-273::DEBUG::2012-10-15 09:06:21,343::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-273::DEBUG::2012-10-15 09:06:21,345::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-273::DEBUG::2012-10-15 09:06:21,346::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-273::DEBUG::2012-10-15 09:06:21,348::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '5987', 'displayIp': '172.16.101.102', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '-6', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '52:54:00:68:b5:cf', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '3a53bfa7-943b-4162-b570-997f548ed5ee', 'monitorResponse': '0', 'cpuUser': '53.19', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '9a4ceabd-615d-430b-9dc5-ec94079581e1'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.02', 'cpuIdle': '46.81', 'elapsedTime': '62', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-274::DEBUG::2012-10-15 09:06:21,386::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-274::DEBUG::2012-10-15 09:06:21,398::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-274::DEBUG::2012-10-15 09:06:21,408::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-274::DEBUG::2012-10-15 09:06:21,412::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-274::DEBUG::2012-10-15 09:06:21,416::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-274::DEBUG::2012-10-15 09:06:21,420::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '106.40', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.23', 'cpuIdle': '0.00', 'elapsedTime': '46', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-275::DEBUG::2012-10-15 09:06:21,447::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-275::DEBUG::2012-10-15 09:06:21,449::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-275::DEBUG::2012-10-15 09:06:21,451::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-275::DEBUG::2012-10-15 09:06:21,452::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-275::DEBUG::2012-10-15 09:06:21,454::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-275::DEBUG::2012-10-15 09:06:21,455::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '73.13', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.30', 'cpuIdle': '26.87', 'elapsedTime': '54', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-277::DEBUG::2012-10-15 09:06:23,526::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-277::DEBUG::2012-10-15 09:06:23,529::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-277::DEBUG::2012-10-15 09:06:23,530::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-277::DEBUG::2012-10-15 09:06:23,532::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-277::DEBUG::2012-10-15 09:06:23,534::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-277::DEBUG::2012-10-15 09:06:23,536::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '53.20', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.19', 'cpuIdle': '46.80', 'elapsedTime': '58', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-278::DEBUG::2012-10-15 09:06:23,562::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-278::DEBUG::2012-10-15 09:06:23,564::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-278::DEBUG::2012-10-15 09:06:23,566::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-278::DEBUG::2012-10-15 09:06:23,567::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-278::DEBUG::2012-10-15 09:06:23,569::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-278::DEBUG::2012-10-15 09:06:23,571::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '99.65', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.41', 'cpuIdle': '0.35', 'elapsedTime': '51', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-279::DEBUG::2012-10-15 09:06:23,647::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-279::DEBUG::2012-10-15 09:06:23,650::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-279::DEBUG::2012-10-15 09:06:23,652::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-279::DEBUG::2012-10-15 09:06:23,654::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-279::DEBUG::2012-10-15 09:06:23,656::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-279::DEBUG::2012-10-15 09:06:23,658::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '106.40', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.47', 'cpuIdle': '0.00', 'elapsedTime': '49', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-280::DEBUG::2012-10-15 09:06:23,686::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-280::DEBUG::2012-10-15 09:06:23,688::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-280::DEBUG::2012-10-15 09:06:23,690::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-280::DEBUG::2012-10-15 09:06:23,691::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-280::DEBUG::2012-10-15 09:06:23,693::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-280::DEBUG::2012-10-15 09:06:23,695::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '73.13', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.52', 'cpuIdle': '26.87', 'elapsedTime': '56', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-101::DEBUG::2012-10-15 09:06:25,164::task::588::TaskManager.Task::(_updateState) Task=`e5de4b45-a4de-401d-ba27-3842660e33da`::moving from state init -> state preparing Thread-101::INFO::2012-10-15 09:06:25,167::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='9be3a4e5-0ab5-4705-a743-818fa2165c6a', volUUID='0af28965-6749-4f4c-83ad-fffac9c0617a', options=None) Thread-101::DEBUG::2012-10-15 09:06:25,170::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`bed75a3a-bd92-4117-9580-895c94b0ce41`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-101::DEBUG::2012-10-15 09:06:25,172::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-101::DEBUG::2012-10-15 09:06:25,175::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-101::DEBUG::2012-10-15 09:06:25,176::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`bed75a3a-bd92-4117-9580-895c94b0ce41`::Granted request Thread-101::DEBUG::2012-10-15 09:06:25,180::task::819::TaskManager.Task::(resourceAcquired) Task=`e5de4b45-a4de-401d-ba27-3842660e33da`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-101::DEBUG::2012-10-15 09:06:25,181::task::980::TaskManager.Task::(_decref) Task=`e5de4b45-a4de-401d-ba27-3842660e33da`::ref 1 aborting False Thread-101::INFO::2012-10-15 09:06:25,184::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-101::DEBUG::2012-10-15 09:06:25,188::task::1174::TaskManager.Task::(prepare) Task=`e5de4b45-a4de-401d-ba27-3842660e33da`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-101::DEBUG::2012-10-15 09:06:25,190::task::588::TaskManager.Task::(_updateState) Task=`e5de4b45-a4de-401d-ba27-3842660e33da`::moving from state preparing -> state finished Thread-101::DEBUG::2012-10-15 09:06:25,191::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-101::DEBUG::2012-10-15 09:06:25,194::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-101::DEBUG::2012-10-15 09:06:25,197::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-101::DEBUG::2012-10-15 09:06:25,199::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-101::DEBUG::2012-10-15 09:06:25,200::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-101::DEBUG::2012-10-15 09:06:25,202::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-101::DEBUG::2012-10-15 09:06:25,204::task::980::TaskManager.Task::(_decref) Task=`e5de4b45-a4de-401d-ba27-3842660e33da`::ref 0 aborting False Thread-101::ERROR::2012-10-15 09:06:25,285::utils::393::vm.Vm::(collect) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-282::DEBUG::2012-10-15 09:06:25,759::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('e454d24b-7675-4cbc-8ad2-1832195ba1ff',) {} Thread-282::DEBUG::2012-10-15 09:06:25,761::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-282::DEBUG::2012-10-15 09:06:25,763::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-282::DEBUG::2012-10-15 09:06:25,765::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-282::DEBUG::2012-10-15 09:06:25,766::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-282::DEBUG::2012-10-15 09:06:25,769::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6052', 'displayIp': '172.16.101.102', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '-132', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:10:01:10', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': 'e454d24b-7675-4cbc-8ad2-1832195ba1ff', 'monitorResponse': '0', 'cpuUser': '53.20', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '61e6b472-42e2-453a-b58e-ab437940cb3d'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.42', 'cpuIdle': '46.80', 'elapsedTime': '60', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-283::DEBUG::2012-10-15 09:06:25,796::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-283::DEBUG::2012-10-15 09:06:25,798::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-283::DEBUG::2012-10-15 09:06:25,800::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-283::DEBUG::2012-10-15 09:06:25,801::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-283::DEBUG::2012-10-15 09:06:25,803::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-283::DEBUG::2012-10-15 09:06:25,805::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '99.65', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.64', 'cpuIdle': '0.35', 'elapsedTime': '53', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-284::DEBUG::2012-10-15 09:06:25,833::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-284::DEBUG::2012-10-15 09:06:25,835::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-284::DEBUG::2012-10-15 09:06:25,837::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-284::DEBUG::2012-10-15 09:06:25,838::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-284::DEBUG::2012-10-15 09:06:25,840::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-284::DEBUG::2012-10-15 09:06:25,841::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '106.40', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.65', 'cpuIdle': '0.00', 'elapsedTime': '51', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-285::DEBUG::2012-10-15 09:06:25,868::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-285::DEBUG::2012-10-15 09:06:25,871::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-285::DEBUG::2012-10-15 09:06:25,872::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-285::DEBUG::2012-10-15 09:06:25,874::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-285::DEBUG::2012-10-15 09:06:25,875::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-285::DEBUG::2012-10-15 09:06:25,877::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '73.13', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.71', 'cpuIdle': '26.87', 'elapsedTime': '58', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-287::DEBUG::2012-10-15 09:06:28,002::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-287::DEBUG::2012-10-15 09:06:28,005::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-287::DEBUG::2012-10-15 09:06:28,006::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-287::DEBUG::2012-10-15 09:06:28,008::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-287::DEBUG::2012-10-15 09:06:28,010::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-287::DEBUG::2012-10-15 09:06:28,012::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '99.65', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.85', 'cpuIdle': '0.35', 'elapsedTime': '56', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-288::DEBUG::2012-10-15 09:06:28,040::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-288::DEBUG::2012-10-15 09:06:28,043::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-288::DEBUG::2012-10-15 09:06:28,045::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-288::DEBUG::2012-10-15 09:06:28,047::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-288::DEBUG::2012-10-15 09:06:28,048::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-288::DEBUG::2012-10-15 09:06:28,051::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '106.40', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.85', 'cpuIdle': '0.00', 'elapsedTime': '53', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-289::DEBUG::2012-10-15 09:06:28,078::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('949630d3-c5aa-4047-9250-28cfe479985d',) {} Thread-289::DEBUG::2012-10-15 09:06:28,081::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-289::DEBUG::2012-10-15 09:06:28,082::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-289::DEBUG::2012-10-15 09:06:28,084::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-289::DEBUG::2012-10-15 09:06:28,086::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-289::DEBUG::2012-10-15 09:06:28,088::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6200', 'displayIp': '172.16.101.102', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '-1', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:10:01:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': '949630d3-c5aa-4047-9250-28cfe479985d', 'monitorResponse': '0', 'cpuUser': '73.13', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '0587da1b-6e3d-436b-aa1a-16baa05f5cdb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.92', 'cpuIdle': '26.87', 'elapsedTime': '60', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-290::DEBUG::2012-10-15 09:06:30,136::task::588::TaskManager.Task::(_updateState) Task=`0284946f-f039-4f5d-9efc-f3c7efaa43ae`::moving from state init -> state preparing Thread-290::INFO::2012-10-15 09:06:30,138::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-290::INFO::2012-10-15 09:06:30,141::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.146235942841', 'lastCheck': 1350291983.63077, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00116205215454', 'lastCheck': 1350291981.651261, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00398588180542', 'lastCheck': 1350291981.41815, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00382494926453', 'lastCheck': 1350291982.037357, 'code': 0, 'valid': True}} Thread-290::DEBUG::2012-10-15 09:06:30,153::task::1174::TaskManager.Task::(prepare) Task=`0284946f-f039-4f5d-9efc-f3c7efaa43ae`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.146235942841', 'lastCheck': 1350291983.63077, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00116205215454', 'lastCheck': 1350291981.651261, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00398588180542', 'lastCheck': 1350291981.41815, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00382494926453', 'lastCheck': 1350291982.037357, 'code': 0, 'valid': True}} Thread-290::DEBUG::2012-10-15 09:06:30,156::task::588::TaskManager.Task::(_updateState) Task=`0284946f-f039-4f5d-9efc-f3c7efaa43ae`::moving from state preparing -> state finished Thread-290::DEBUG::2012-10-15 09:06:30,158::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-290::DEBUG::2012-10-15 09:06:30,159::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-290::DEBUG::2012-10-15 09:06:30,161::task::980::TaskManager.Task::(_decref) Task=`0284946f-f039-4f5d-9efc-f3c7efaa43ae`::ref 0 aborting False Thread-291::DEBUG::2012-10-15 09:06:30,212::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-291::DEBUG::2012-10-15 09:06:30,215::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-291::DEBUG::2012-10-15 09:06:30,217::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-291::DEBUG::2012-10-15 09:06:30,218::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-291::DEBUG::2012-10-15 09:06:30,221::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-291::DEBUG::2012-10-15 09:06:30,223::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-291::DEBUG::2012-10-15 09:06:30,224::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-291::DEBUG::2012-10-15 09:06:30,226::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-291::DEBUG::2012-10-15 09:06:30,228::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-291::DEBUG::2012-10-15 09:06:30,230::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-291::DEBUG::2012-10-15 09:06:30,231::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-291::DEBUG::2012-10-15 09:06:30,233::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-291::DEBUG::2012-10-15 09:06:30,235::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-291::DEBUG::2012-10-15 09:06:30,237::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-291::DEBUG::2012-10-15 09:06:30,239::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-291::DEBUG::2012-10-15 09:06:30,241::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-291::DEBUG::2012-10-15 09:06:30,242::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-291::DEBUG::2012-10-15 09:06:30,244::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-291::DEBUG::2012-10-15 09:06:30,246::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-291::DEBUG::2012-10-15 09:06:30,249::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda stats not available Thread-291::DEBUG::2012-10-15 09:06:30,251::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-291::DEBUG::2012-10-15 09:06:30,252::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-291::DEBUG::2012-10-15 09:06:30,254::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-291::DEBUG::2012-10-15 09:06:30,257::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-291::DEBUG::2012-10-15 09:06:30,260::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-291::DEBUG::2012-10-15 09:06:30,262::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-291::DEBUG::2012-10-15 09:06:30,265::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-291::DEBUG::2012-10-15 09:06:30,268::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-291::DEBUG::2012-10-15 09:06:30,270::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-291::DEBUG::2012-10-15 09:06:30,272::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-291::DEBUG::2012-10-15 09:06:30,273::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-291::DEBUG::2012-10-15 09:06:30,275::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-291::DEBUG::2012-10-15 09:06:30,277::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-291::DEBUG::2012-10-15 09:06:30,281::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-291::DEBUG::2012-10-15 09:06:30,283::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-293::DEBUG::2012-10-15 09:06:32,401::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('ea6e0e35-b833-43b3-8ddf-99f2c085fb43',) {} Thread-293::DEBUG::2012-10-15 09:06:32,404::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-293::DEBUG::2012-10-15 09:06:32,405::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-293::DEBUG::2012-10-15 09:06:32,407::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-293::DEBUG::2012-10-15 09:06:32,408::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-293::DEBUG::2012-10-15 09:06:32,410::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6250', 'displayIp': '172.16.101.102', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '-217', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '52:54:00:d5:91:74', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': 'ea6e0e35-b833-43b3-8ddf-99f2c085fb43', 'monitorResponse': '0', 'cpuUser': '79.78', 'disks': {'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': 'c0ce18f3-31a7-4f67-8026-db6a49a50c96'}, 'hdc': {}}, 'boot': 'c', 'statsAge': '0.24', 'cpuIdle': '20.22', 'elapsedTime': '60', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-294::DEBUG::2012-10-15 09:06:32,436::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-294::DEBUG::2012-10-15 09:06:32,439::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-294::DEBUG::2012-10-15 09:06:32,440::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-294::DEBUG::2012-10-15 09:06:32,442::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-294::DEBUG::2012-10-15 09:06:32,443::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-294::DEBUG::2012-10-15 09:06:32,446::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '106.40', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.22', 'cpuIdle': '0.00', 'elapsedTime': '57', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-295::DEBUG::2012-10-15 09:06:32,502::clientIF::76::vds::(wrapper) [172.16.101.90]::call create with ({'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': '388f6bff-d9cd-4f96-b323-180e52d1be05', 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '2', 'macAddr': '00:1a:4a:10:01:0e', 'boot': 'cd', 'custom': {}, 'vmType': 'kvm', 'memSize': 12228, 'smpCoresPerSocket': '1', 'vmName': 'devportal02', 'spiceMonitors': '1', 'nice': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': 'fe93fef2-3a6e-488f-81e2-d016eb7c0976', 'imageID': '49b16912-deba-4884-b9d6-73779e3ba3eb', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'nicModel': 'pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'timeOffset': '-204', 'spiceSecureChannels': 'smain,sinputs', 'display': 'qxl'},) {} Thread-295::INFO::2012-10-15 09:06:32,651::clientIF::712::vds::(create) vmContainerLock acquired by vm 388f6bff-d9cd-4f96-b323-180e52d1be05 Thread-296::DEBUG::2012-10-15 09:06:32,671::vm::512::vm.Vm::(_startUnderlyingVm) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Start Thread-295::DEBUG::2012-10-15 09:06:32,674::clientIF::725::vds::(create) Total desktops after creation of 388f6bff-d9cd-4f96-b323-180e52d1be05 is 10 Thread-295::DEBUG::2012-10-15 09:06:32,679::clientIF::81::vds::(wrapper) return create with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'vmId': '388f6bff-d9cd-4f96-b323-180e52d1be05', 'pid': '0', 'drives': [{'index': '0', 'domainID': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'format': 'raw', 'boot': 'true', 'volumeID': 'fe93fef2-3a6e-488f-81e2-d016eb7c0976', 'imageID': '49b16912-deba-4884-b9d6-73779e3ba3eb', 'poolID': '4e37e18a-ae32-41a3-a558-af2495d64da8', 'propagateErrors': 'off', 'if': 'virtio'}], 'transparentHugePages': 'true', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'custom': {}, 'clientIp': '', 'nicModel': 'pv', 'macAddr': '00:1a:4a:10:01:0e', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'boot': 'cd', 'smp': '2', 'vmType': 'kvm', 'timeOffset': '-204', 'memSize': 12228, 'displayIp': '172.16.101.102', 'spiceSecureChannels': 'smain,sinputs', 'smpCoresPerSocket': '1', 'vmName': 'devportal02', 'display': 'qxl', 'spiceMonitors': '1', 'nice': '0'}} Thread-296::DEBUG::2012-10-15 09:06:32,678::vm::516::vm.Vm::(_startUnderlyingVm) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::_ongoingCreations acquired Thread-296::INFO::2012-10-15 09:06:32,692::libvirtvm::1105::vm.Vm::(_run) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::VM wrapper has started Thread-296::DEBUG::2012-10-15 09:06:32,695::task::588::TaskManager.Task::(_updateState) Task=`3b2185f9-b1c6-4f02-bfbb-19b055fddb6d`::moving from state init -> state preparing Thread-296::INFO::2012-10-15 09:06:32,698::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='49b16912-deba-4884-b9d6-73779e3ba3eb', volUUID='fe93fef2-3a6e-488f-81e2-d016eb7c0976', options=None) Thread-296::DEBUG::2012-10-15 09:06:32,701::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`8719ea85-612f-43d0-bbdc-f3302ba7d5ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-296::DEBUG::2012-10-15 09:06:32,703::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-296::DEBUG::2012-10-15 09:06:32,705::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-296::DEBUG::2012-10-15 09:06:32,707::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`8719ea85-612f-43d0-bbdc-f3302ba7d5ab`::Granted request Thread-296::DEBUG::2012-10-15 09:06:32,709::task::819::TaskManager.Task::(resourceAcquired) Task=`3b2185f9-b1c6-4f02-bfbb-19b055fddb6d`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-296::DEBUG::2012-10-15 09:06:32,711::task::980::TaskManager.Task::(_decref) Task=`3b2185f9-b1c6-4f02-bfbb-19b055fddb6d`::ref 1 aborting False Thread-296::INFO::2012-10-15 09:06:32,713::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-296::DEBUG::2012-10-15 09:06:32,714::task::1174::TaskManager.Task::(prepare) Task=`3b2185f9-b1c6-4f02-bfbb-19b055fddb6d`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-296::DEBUG::2012-10-15 09:06:32,716::task::588::TaskManager.Task::(_updateState) Task=`3b2185f9-b1c6-4f02-bfbb-19b055fddb6d`::moving from state preparing -> state finished Thread-296::DEBUG::2012-10-15 09:06:32,717::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-296::DEBUG::2012-10-15 09:06:32,719::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-296::DEBUG::2012-10-15 09:06:32,721::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-296::DEBUG::2012-10-15 09:06:32,723::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-296::DEBUG::2012-10-15 09:06:32,724::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-296::DEBUG::2012-10-15 09:06:32,726::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-296::DEBUG::2012-10-15 09:06:32,728::task::980::TaskManager.Task::(_decref) Task=`3b2185f9-b1c6-4f02-bfbb-19b055fddb6d`::ref 0 aborting False Thread-296::DEBUG::2012-10-15 09:06:32,730::task::588::TaskManager.Task::(_updateState) Task=`b4265531-6976-4215-842a-0d55f695ef26`::moving from state init -> state preparing Thread-296::INFO::2012-10-15 09:06:32,732::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', options=None) Thread-296::INFO::2012-10-15 09:06:32,733::blockSD::695::Storage.StorageDomain::(validate) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 Thread-296::DEBUG::2012-10-15 09:06:32,735::lvm::467::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex Thread-296::DEBUG::2012-10-15 09:06:32,738::lvm::469::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-296::DEBUG::2012-10-15 09:06:32,739::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-296::DEBUG::2012-10-15 09:06:32,745::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-296::DEBUG::2012-10-15 09:06:32,747::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-296::DEBUG::2012-10-15 09:06:32,750::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-23::DEBUG::2012-10-15 09:06:33,633::lvm::352::OperationMutex::(_reloadvgs) Got the operational mutex Thread-23::DEBUG::2012-10-15 09:06:33,638::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-296::DEBUG::2012-10-15 09:06:34,129::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-296::DEBUG::2012-10-15 09:06:34,143::persistentDict::216::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[u'DESCRIPTION=DE-VM-SYSTEM', u'LOCKPOLICY=', u'VERSION=2', u'TYPE=ISCSI', u'PV0=pv:36d4ae520008545ee000003594fa9b441,uuid:OefJEe-PT03-YzPK-7nnk-fYlW-VOOc-DWrfUr,pestart:0,pecount:134099,mapoffset:0', u'LOGBLKSIZE=512', u'VGUUID=2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', u'SDUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', u'LEASERETRIES=3', u'LOCKRENEWALINTERVALSEC=5', u'PHYBLKSIZE=512', u'CLASS=Data', u'POOL_UUID=4e37e18a-ae32-41a3-a558-af2495d64da8', u'LEASETIMESEC=60', u'IOOPTIMEOUTSEC=10', u'POOL_DESCRIPTION=DE-KL-DC01', u'ROLE=Master', u'MASTER_VERSION=14', u'POOL_SPM_ID=1', u'POOL_SPM_LVER=1', u'POOL_DOMAINS=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5:Active,17e82ced-d839-4b4d-9d81-5333ad777100:Active,b19f2012-59ff-4ce8-80da-76005ce43be2:Active,5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae:Active', u'_SHA_CKSUM=6fdb59ee0db89ff31c713372b0f8822256c1b919'] Thread-296::DEBUG::2012-10-15 09:06:34,151::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`fe057d3f-eab0-4c6b-875c-a0ae6f983c4c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2032' at 'getStorageDomainInfo' Thread-296::DEBUG::2012-10-15 09:06:34,153::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-296::DEBUG::2012-10-15 09:06:34,155::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-296::DEBUG::2012-10-15 09:06:34,157::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`fe057d3f-eab0-4c6b-875c-a0ae6f983c4c`::Granted request Thread-296::DEBUG::2012-10-15 09:06:34,160::task::819::TaskManager.Task::(resourceAcquired) Task=`b4265531-6976-4215-842a-0d55f695ef26`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-296::DEBUG::2012-10-15 09:06:34,162::task::980::TaskManager.Task::(_decref) Task=`b4265531-6976-4215-842a-0d55f695ef26`::ref 1 aborting False Thread-296::INFO::2012-10-15 09:06:34,166::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-296::DEBUG::2012-10-15 09:06:34,167::task::1174::TaskManager.Task::(prepare) Task=`b4265531-6976-4215-842a-0d55f695ef26`::finished: {'info': {'uuid': 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', 'vguuid': '2gm9ae-0ZTO-Sv3M-Y9nd-xZmU-vC4l-vQHs3N', 'lver': -1, 'state': 'OK', 'version': '2', 'role': 'Master', 'master_ver': 0, 'spm_id': -1, 'type': 'ISCSI', 'class': 'Data', 'pool': [u'4e37e18a-ae32-41a3-a558-af2495d64da8'], 'name': 'DE-VM-SYSTEM'}} Thread-296::DEBUG::2012-10-15 09:06:34,169::task::588::TaskManager.Task::(_updateState) Task=`b4265531-6976-4215-842a-0d55f695ef26`::moving from state preparing -> state finished Thread-296::DEBUG::2012-10-15 09:06:34,171::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-296::DEBUG::2012-10-15 09:06:34,173::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-296::DEBUG::2012-10-15 09:06:34,175::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-296::DEBUG::2012-10-15 09:06:34,177::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-296::DEBUG::2012-10-15 09:06:34,179::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-296::DEBUG::2012-10-15 09:06:34,180::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-296::DEBUG::2012-10-15 09:06:34,182::task::980::TaskManager.Task::(_decref) Task=`b4265531-6976-4215-842a-0d55f695ef26`::ref 0 aborting False Thread-296::DEBUG::2012-10-15 09:06:34,186::task::588::TaskManager.Task::(_updateState) Task=`ff2883cf-b608-498c-9acf-f25f7fffc42b`::moving from state init -> state preparing Thread-296::INFO::2012-10-15 09:06:34,188::logUtils::37::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='49b16912-deba-4884-b9d6-73779e3ba3eb', volUUID='fe93fef2-3a6e-488f-81e2-d016eb7c0976', rw=True, options=None) Thread-296::DEBUG::2012-10-15 09:06:34,191::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`93d0784b-c6c2-4063-a505-7cbc61e5d90d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2423' at 'prepareVolume' Thread-296::DEBUG::2012-10-15 09:06:34,192::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-296::DEBUG::2012-10-15 09:06:34,194::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-296::DEBUG::2012-10-15 09:06:34,196::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`93d0784b-c6c2-4063-a505-7cbc61e5d90d`::Granted request Thread-296::DEBUG::2012-10-15 09:06:34,199::task::819::TaskManager.Task::(resourceAcquired) Task=`ff2883cf-b608-498c-9acf-f25f7fffc42b`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-296::DEBUG::2012-10-15 09:06:34,202::task::980::TaskManager.Task::(_decref) Task=`ff2883cf-b608-498c-9acf-f25f7fffc42b`::ref 1 aborting False Thread-296::DEBUG::2012-10-15 09:06:34,206::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.49b16912-deba-4884-b9d6-73779e3ba3eb`ReqID=`f7eda836-4a14-4cd4-a2cb-742d18bdd38d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2428' at 'prepareVolume' Thread-296::DEBUG::2012-10-15 09:06:34,207::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.49b16912-deba-4884-b9d6-73779e3ba3eb' for lock type 'exclusive' Thread-296::DEBUG::2012-10-15 09:06:34,211::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-296::DEBUG::2012-10-15 09:06:34,215::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-299::DEBUG::2012-10-15 09:06:34,535::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-299::DEBUG::2012-10-15 09:06:34,539::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-299::DEBUG::2012-10-15 09:06:34,541::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-299::DEBUG::2012-10-15 09:06:34,543::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-299::DEBUG::2012-10-15 09:06:34,544::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-299::DEBUG::2012-10-15 09:06:34,547::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '106.40', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.32', 'cpuIdle': '0.00', 'elapsedTime': '59', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-113::DEBUG::2012-10-15 09:06:35,283::task::588::TaskManager.Task::(_updateState) Task=`b7d0b183-3c63-4e3a-b173-a85601a9539b`::moving from state init -> state preparing Thread-113::INFO::2012-10-15 09:06:35,285::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='70028937-af10-4aa1-a93a-1e8fcc9827fb', volUUID='dfec79c0-c6ab-44fb-ad0f-4469a9553a23', options=None) Thread-113::DEBUG::2012-10-15 09:06:35,290::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`fed72182-1b44-498e-a0b2-4759e982f2fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-113::DEBUG::2012-10-15 09:06:35,292::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-113::DEBUG::2012-10-15 09:06:35,294::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (2 active users) Thread-113::DEBUG::2012-10-15 09:06:35,295::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`fed72182-1b44-498e-a0b2-4759e982f2fb`::Granted request Thread-113::DEBUG::2012-10-15 09:06:35,298::task::819::TaskManager.Task::(resourceAcquired) Task=`b7d0b183-3c63-4e3a-b173-a85601a9539b`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-113::DEBUG::2012-10-15 09:06:35,300::task::980::TaskManager.Task::(_decref) Task=`b7d0b183-3c63-4e3a-b173-a85601a9539b`::ref 1 aborting False Thread-113::DEBUG::2012-10-15 09:06:35,302::lvm::393::OperationMutex::(_reloadlvs) Got the operational mutex Thread-113::DEBUG::2012-10-15 09:06:35,306::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-301::DEBUG::2012-10-15 09:06:36,608::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('a74d3ee7-16ee-4f01-a7cd-ae929a136915',) {} Thread-301::DEBUG::2012-10-15 09:06:36,612::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-301::DEBUG::2012-10-15 09:06:36,614::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-301::DEBUG::2012-10-15 09:06:36,616::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-301::DEBUG::2012-10-15 09:06:36,617::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-301::DEBUG::2012-10-15 09:06:36,620::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6355', 'displayIp': '172.16.101.102', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '-208', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:10:01:0d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': 'a74d3ee7-16ee-4f01-a7cd-ae929a136915', 'monitorResponse': '0', 'cpuUser': '66.44', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '6db264ea-c386-4b44-80a4-7af6fef85578'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.37', 'cpuIdle': '33.56', 'elapsedTime': '61', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-296::DEBUG::2012-10-15 09:06:36,897::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-296::DEBUG::2012-10-15 09:06:37,298::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=56 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-23::DEBUG::2012-10-15 09:06:37,418::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-296::DEBUG::2012-10-15 09:06:38,365::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.938808 s, 0.5 kB/s\n'; = 0 Thread-296::DEBUG::2012-10-15 09:06:38,368::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.938808 s, 0.5 kB/s'], size: 512 Thread-296::DEBUG::2012-10-15 09:06:38,374::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=56 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-113::DEBUG::2012-10-15 09:06:38,470::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-113::DEBUG::2012-10-15 09:06:38,860::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-113::INFO::2012-10-15 09:06:38,867::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '19327352832', 'apparentsize': '19327352832'} Thread-113::DEBUG::2012-10-15 09:06:38,903::task::1174::TaskManager.Task::(prepare) Task=`b7d0b183-3c63-4e3a-b173-a85601a9539b`::finished: {'truesize': '19327352832', 'apparentsize': '19327352832'} Thread-113::DEBUG::2012-10-15 09:06:38,906::task::588::TaskManager.Task::(_updateState) Task=`b7d0b183-3c63-4e3a-b173-a85601a9539b`::moving from state preparing -> state finished Thread-113::DEBUG::2012-10-15 09:06:38,908::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-113::DEBUG::2012-10-15 09:06:38,910::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-113::DEBUG::2012-10-15 09:06:38,915::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-113::DEBUG::2012-10-15 09:06:38,918::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (1 active users) Thread-113::DEBUG::2012-10-15 09:06:38,921::task::980::TaskManager.Task::(_decref) Task=`b7d0b183-3c63-4e3a-b173-a85601a9539b`::ref 0 aborting False Thread-113::ERROR::2012-10-15 09:06:39,009::utils::393::vm.Vm::(collect) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-296::DEBUG::2012-10-15 09:06:39,397::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.941871 s, 0.5 kB/s\n'; = 0 Thread-296::DEBUG::2012-10-15 09:06:39,401::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.941871 s, 0.5 kB/s'], size: 512 Thread-296::INFO::2012-10-15 09:06:39,404::image::354::Storage.Image::(getChain) sdUUID=ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 imgUUID=49b16912-deba-4884-b9d6-73779e3ba3eb chain=[] Thread-296::DEBUG::2012-10-15 09:06:39,408::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/fe93fef2-3a6e-488f-81e2-d016eb7c0976' (cwd None) Thread-303::DEBUG::2012-10-15 09:06:40,925::task::588::TaskManager.Task::(_updateState) Task=`8fd367c1-a878-436d-8ba9-327ff1ce7fcf`::moving from state init -> state preparing Thread-303::INFO::2012-10-15 09:06:40,954::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-303::INFO::2012-10-15 09:06:40,958::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.905571937561', 'lastCheck': 1350291998.414328, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00114297866821', 'lastCheck': 1350291991.675628, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00375008583069', 'lastCheck': 1350291991.45173, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00359702110291', 'lastCheck': 1350291992.069578, 'code': 0, 'valid': True}} Thread-303::DEBUG::2012-10-15 09:06:40,959::task::1174::TaskManager.Task::(prepare) Task=`8fd367c1-a878-436d-8ba9-327ff1ce7fcf`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.905571937561', 'lastCheck': 1350291998.414328, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00114297866821', 'lastCheck': 1350291991.675628, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00375008583069', 'lastCheck': 1350291991.45173, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00359702110291', 'lastCheck': 1350291992.069578, 'code': 0, 'valid': True}} Thread-303::DEBUG::2012-10-15 09:06:40,962::task::588::TaskManager.Task::(_updateState) Task=`8fd367c1-a878-436d-8ba9-327ff1ce7fcf`::moving from state preparing -> state finished Thread-303::DEBUG::2012-10-15 09:06:40,963::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-303::DEBUG::2012-10-15 09:06:40,965::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-303::DEBUG::2012-10-15 09:06:40,967::task::980::TaskManager.Task::(_decref) Task=`8fd367c1-a878-436d-8ba9-327ff1ce7fcf`::ref 0 aborting False Thread-304::DEBUG::2012-10-15 09:06:41,018::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda stats not available Thread-304::DEBUG::2012-10-15 09:06:41,020::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-304::DEBUG::2012-10-15 09:06:41,024::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-304::DEBUG::2012-10-15 09:06:41,026::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-304::DEBUG::2012-10-15 09:06:41,030::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda stats not available Thread-304::DEBUG::2012-10-15 09:06:41,032::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-304::DEBUG::2012-10-15 09:06:41,034::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-304::DEBUG::2012-10-15 09:06:41,036::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-304::DEBUG::2012-10-15 09:06:41,039::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda stats not available Thread-304::DEBUG::2012-10-15 09:06:41,040::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-304::DEBUG::2012-10-15 09:06:41,042::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-304::DEBUG::2012-10-15 09:06:41,044::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-304::DEBUG::2012-10-15 09:06:41,047::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-304::DEBUG::2012-10-15 09:06:41,051::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-304::DEBUG::2012-10-15 09:06:41,053::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-304::DEBUG::2012-10-15 09:06:41,057::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda stats not available Thread-304::DEBUG::2012-10-15 09:06:41,059::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-304::DEBUG::2012-10-15 09:06:41,060::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-304::DEBUG::2012-10-15 09:06:41,062::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-304::DEBUG::2012-10-15 09:06:41,065::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-304::DEBUG::2012-10-15 09:06:41,067::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-304::DEBUG::2012-10-15 09:06:41,069::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-304::DEBUG::2012-10-15 09:06:41,071::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda stats not available Thread-304::DEBUG::2012-10-15 09:06:41,073::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-304::DEBUG::2012-10-15 09:06:41,075::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-304::DEBUG::2012-10-15 09:06:41,077::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-304::DEBUG::2012-10-15 09:06:41,080::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda stats not available Thread-304::DEBUG::2012-10-15 09:06:41,081::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-304::DEBUG::2012-10-15 09:06:41,083::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-304::DEBUG::2012-10-15 09:06:41,085::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-304::DEBUG::2012-10-15 09:06:41,088::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda stats not available Thread-304::DEBUG::2012-10-15 09:06:41,089::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-304::DEBUG::2012-10-15 09:06:41,091::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-304::DEBUG::2012-10-15 09:06:41,093::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-135::DEBUG::2012-10-15 09:06:41,365::task::588::TaskManager.Task::(_updateState) Task=`e56d5eee-e6cd-4ca4-b348-2d73cbcb675d`::moving from state init -> state preparing Thread-135::INFO::2012-10-15 09:06:41,371::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='93966c50-a1ac-4735-a814-fca83010fff7', volUUID='9c9137ae-bfc5-404b-a03b-b6833f61603e', options=None) Thread-135::DEBUG::2012-10-15 09:06:41,375::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`648c9424-8051-453a-8950-611a69499d18`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-135::DEBUG::2012-10-15 09:06:41,376::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-135::DEBUG::2012-10-15 09:06:41,379::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (2 active users) Thread-135::DEBUG::2012-10-15 09:06:41,380::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`648c9424-8051-453a-8950-611a69499d18`::Granted request Thread-135::DEBUG::2012-10-15 09:06:41,384::task::819::TaskManager.Task::(resourceAcquired) Task=`e56d5eee-e6cd-4ca4-b348-2d73cbcb675d`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-135::DEBUG::2012-10-15 09:06:41,385::task::980::TaskManager.Task::(_decref) Task=`e56d5eee-e6cd-4ca4-b348-2d73cbcb675d`::ref 1 aborting False Thread-135::INFO::2012-10-15 09:06:41,388::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-135::DEBUG::2012-10-15 09:06:41,389::task::1174::TaskManager.Task::(prepare) Task=`e56d5eee-e6cd-4ca4-b348-2d73cbcb675d`::finished: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-138::DEBUG::2012-10-15 09:06:41,392::task::588::TaskManager.Task::(_updateState) Task=`f2e133ed-92ed-426d-b714-b15427c6efe7`::moving from state init -> state preparing Thread-135::DEBUG::2012-10-15 09:06:41,394::task::588::TaskManager.Task::(_updateState) Task=`e56d5eee-e6cd-4ca4-b348-2d73cbcb675d`::moving from state preparing -> state finished Thread-138::INFO::2012-10-15 09:06:41,397::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='9a4ceabd-615d-430b-9dc5-ec94079581e1', volUUID='1be33b9b-4efe-495d-95db-4a983e1396a4', options=None) Thread-135::DEBUG::2012-10-15 09:06:41,398::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-140::DEBUG::2012-10-15 09:06:41,404::task::588::TaskManager.Task::(_updateState) Task=`160ed55c-6327-4734-a203-052edfd23eed`::moving from state init -> state preparing Thread-137::DEBUG::2012-10-15 09:06:41,407::task::588::TaskManager.Task::(_updateState) Task=`5d1f3588-0802-4880-a171-03d901f442db`::moving from state init -> state preparing Thread-138::DEBUG::2012-10-15 09:06:41,416::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`7503471d-da21-4306-97f1-49c4c5000722`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-135::DEBUG::2012-10-15 09:06:41,412::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-137::INFO::2012-10-15 09:06:41,418::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='e2059ec7-8dc5-4058-bab8-73762de5e0f5', volUUID='5540600c-b4fd-4546-ae5c-6310b2d25eef', options=None) Thread-140::INFO::2012-10-15 09:06:41,418::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='61e6b472-42e2-453a-b58e-ab437940cb3d', volUUID='f6af481f-89da-40ef-943a-dd46b500af45', options=None) Thread-138::DEBUG::2012-10-15 09:06:41,420::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-135::DEBUG::2012-10-15 09:06:41,422::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-137::DEBUG::2012-10-15 09:06:41,428::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`279a397e-9a99-462f-bd2c-2daee72bdb59`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-140::DEBUG::2012-10-15 09:06:41,436::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`0f80d9a1-5267-4e0f-93cd-6a38ac199da7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-137::DEBUG::2012-10-15 09:06:41,439::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-140::DEBUG::2012-10-15 09:06:41,440::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-138::DEBUG::2012-10-15 09:06:41,437::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (3 active users) Thread-138::DEBUG::2012-10-15 09:06:41,447::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`7503471d-da21-4306-97f1-49c4c5000722`::Granted request Thread-135::DEBUG::2012-10-15 09:06:41,449::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (2 active users) Thread-138::DEBUG::2012-10-15 09:06:41,451::task::819::TaskManager.Task::(resourceAcquired) Task=`f2e133ed-92ed-426d-b714-b15427c6efe7`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-137::DEBUG::2012-10-15 09:06:41,457::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (3 active users) Thread-135::DEBUG::2012-10-15 09:06:41,480::task::980::TaskManager.Task::(_decref) Task=`e56d5eee-e6cd-4ca4-b348-2d73cbcb675d`::ref 0 aborting False Thread-138::DEBUG::2012-10-15 09:06:41,488::task::980::TaskManager.Task::(_decref) Task=`f2e133ed-92ed-426d-b714-b15427c6efe7`::ref 1 aborting False Thread-137::DEBUG::2012-10-15 09:06:41,494::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`279a397e-9a99-462f-bd2c-2daee72bdb59`::Granted request Thread-138::INFO::2012-10-15 09:06:41,501::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-138::DEBUG::2012-10-15 09:06:41,509::task::1174::TaskManager.Task::(prepare) Task=`f2e133ed-92ed-426d-b714-b15427c6efe7`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-140::DEBUG::2012-10-15 09:06:41,511::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (4 active users) Thread-138::DEBUG::2012-10-15 09:06:41,514::task::588::TaskManager.Task::(_updateState) Task=`f2e133ed-92ed-426d-b714-b15427c6efe7`::moving from state preparing -> state finished Thread-140::DEBUG::2012-10-15 09:06:41,516::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`0f80d9a1-5267-4e0f-93cd-6a38ac199da7`::Granted request Thread-137::DEBUG::2012-10-15 09:06:41,524::task::819::TaskManager.Task::(resourceAcquired) Task=`5d1f3588-0802-4880-a171-03d901f442db`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-138::DEBUG::2012-10-15 09:06:41,525::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-140::DEBUG::2012-10-15 09:06:41,528::task::819::TaskManager.Task::(resourceAcquired) Task=`160ed55c-6327-4734-a203-052edfd23eed`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-137::DEBUG::2012-10-15 09:06:41,530::task::980::TaskManager.Task::(_decref) Task=`5d1f3588-0802-4880-a171-03d901f442db`::ref 1 aborting False Thread-138::DEBUG::2012-10-15 09:06:41,532::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-140::DEBUG::2012-10-15 09:06:41,537::task::980::TaskManager.Task::(_decref) Task=`160ed55c-6327-4734-a203-052edfd23eed`::ref 1 aborting False Thread-137::INFO::2012-10-15 09:06:41,539::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-140::INFO::2012-10-15 09:06:41,542::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-138::DEBUG::2012-10-15 09:06:41,541::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-137::DEBUG::2012-10-15 09:06:41,544::task::1174::TaskManager.Task::(prepare) Task=`5d1f3588-0802-4880-a171-03d901f442db`::finished: {'truesize': '118111600640', 'apparentsize': '118111600640'} Thread-140::DEBUG::2012-10-15 09:06:41,545::task::1174::TaskManager.Task::(prepare) Task=`160ed55c-6327-4734-a203-052edfd23eed`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-137::DEBUG::2012-10-15 09:06:41,552::task::588::TaskManager.Task::(_updateState) Task=`5d1f3588-0802-4880-a171-03d901f442db`::moving from state preparing -> state finished Thread-140::DEBUG::2012-10-15 09:06:41,554::task::588::TaskManager.Task::(_updateState) Task=`160ed55c-6327-4734-a203-052edfd23eed`::moving from state preparing -> state finished Thread-137::DEBUG::2012-10-15 09:06:41,556::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-138::DEBUG::2012-10-15 09:06:41,557::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (3 active users) Thread-140::DEBUG::2012-10-15 09:06:41,558::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-137::DEBUG::2012-10-15 09:06:41,561::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-138::DEBUG::2012-10-15 09:06:41,565::task::980::TaskManager.Task::(_decref) Task=`f2e133ed-92ed-426d-b714-b15427c6efe7`::ref 0 aborting False Thread-140::DEBUG::2012-10-15 09:06:41,567::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-137::DEBUG::2012-10-15 09:06:41,571::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-140::DEBUG::2012-10-15 09:06:41,578::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-137::DEBUG::2012-10-15 09:06:41,582::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (2 active users) Thread-140::DEBUG::2012-10-15 09:06:41,585::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (1 active users) Thread-137::DEBUG::2012-10-15 09:06:41,590::task::980::TaskManager.Task::(_decref) Task=`5d1f3588-0802-4880-a171-03d901f442db`::ref 0 aborting False Thread-140::DEBUG::2012-10-15 09:06:41,593::task::980::TaskManager.Task::(_decref) Task=`160ed55c-6327-4734-a203-052edfd23eed`::ref 0 aborting False Thread-135::ERROR::2012-10-15 09:06:41,612::utils::393::vm.Vm::(collect) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-140::ERROR::2012-10-15 09:06:41,711::utils::393::vm.Vm::(collect) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-137::ERROR::2012-10-15 09:06:41,746::utils::393::vm.Vm::(collect) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-138::ERROR::2012-10-15 09:06:41,752::utils::393::vm.Vm::(collect) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-296::DEBUG::2012-10-15 09:06:43,632::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-296::DEBUG::2012-10-15 09:06:43,635::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-296::DEBUG::2012-10-15 09:06:43,637::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-296::DEBUG::2012-10-15 09:06:43,639::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.fe93fef2-3a6e-488f-81e2-d016eb7c0976`ReqID=`cfe7c1a8-cc39-4d3b-8ec9-6df8b09c5c06`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '165' at '__getResourceCandidatesList' Thread-296::DEBUG::2012-10-15 09:06:43,641::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.fe93fef2-3a6e-488f-81e2-d016eb7c0976' for lock type 'exclusive' Thread-296::DEBUG::2012-10-15 09:06:43,643::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.fe93fef2-3a6e-488f-81e2-d016eb7c0976' is free. Now locking as 'exclusive' (1 active user) Thread-296::DEBUG::2012-10-15 09:06:43,644::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_volumeNS.fe93fef2-3a6e-488f-81e2-d016eb7c0976`ReqID=`cfe7c1a8-cc39-4d3b-8ec9-6df8b09c5c06`::Granted request Thread-296::DEBUG::2012-10-15 09:06:43,646::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.49b16912-deba-4884-b9d6-73779e3ba3eb' is free. Now locking as 'exclusive' (1 active user) Thread-296::DEBUG::2012-10-15 09:06:43,648::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_imageNS.49b16912-deba-4884-b9d6-73779e3ba3eb`ReqID=`f7eda836-4a14-4cd4-a2cb-742d18bdd38d`::Granted request Thread-296::DEBUG::2012-10-15 09:06:43,652::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-296::DEBUG::2012-10-15 09:06:43,655::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-296::DEBUG::2012-10-15 09:06:44,712::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-296::DEBUG::2012-10-15 09:06:45,059::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-296::DEBUG::2012-10-15 09:06:45,067::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/fe93fef2-3a6e-488f-81e2-d016eb7c0976' (cwd None) Thread-148::DEBUG::2012-10-15 09:06:46,236::task::588::TaskManager.Task::(_updateState) Task=`20468454-f060-4d6c-9179-54e525bb1c31`::moving from state init -> state preparing Thread-148::INFO::2012-10-15 09:06:46,239::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='0587da1b-6e3d-436b-aa1a-16baa05f5cdb', volUUID='4033677e-6930-4582-aa90-1b90f8ff38ee', options=None) Thread-148::DEBUG::2012-10-15 09:06:46,242::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`826d6cf4-b28a-42ca-8c06-29fb1bbbf2f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-148::DEBUG::2012-10-15 09:06:46,244::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-148::DEBUG::2012-10-15 09:06:46,246::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (2 active users) Thread-148::DEBUG::2012-10-15 09:06:46,247::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`826d6cf4-b28a-42ca-8c06-29fb1bbbf2f5`::Granted request Thread-148::DEBUG::2012-10-15 09:06:46,250::task::819::TaskManager.Task::(resourceAcquired) Task=`20468454-f060-4d6c-9179-54e525bb1c31`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-148::DEBUG::2012-10-15 09:06:46,252::task::980::TaskManager.Task::(_decref) Task=`20468454-f060-4d6c-9179-54e525bb1c31`::ref 1 aborting False Thread-148::INFO::2012-10-15 09:06:46,254::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-148::DEBUG::2012-10-15 09:06:46,255::task::1174::TaskManager.Task::(prepare) Task=`20468454-f060-4d6c-9179-54e525bb1c31`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-148::DEBUG::2012-10-15 09:06:46,256::task::588::TaskManager.Task::(_updateState) Task=`20468454-f060-4d6c-9179-54e525bb1c31`::moving from state preparing -> state finished Thread-148::DEBUG::2012-10-15 09:06:46,258::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-148::DEBUG::2012-10-15 09:06:46,259::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-148::DEBUG::2012-10-15 09:06:46,261::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-148::DEBUG::2012-10-15 09:06:46,263::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (1 active users) Thread-148::DEBUG::2012-10-15 09:06:46,265::task::980::TaskManager.Task::(_decref) Task=`20468454-f060-4d6c-9179-54e525bb1c31`::ref 0 aborting False Thread-148::ERROR::2012-10-15 09:06:46,307::utils::393::vm.Vm::(collect) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-296::DEBUG::2012-10-15 09:06:47,198::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-296::DEBUG::2012-10-15 09:06:47,201::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-296::DEBUG::2012-10-15 09:06:47,203::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-296::INFO::2012-10-15 09:06:47,205::volume::534::Storage.Volume::(prepare) Volume: preparing volume ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/fe93fef2-3a6e-488f-81e2-d016eb7c0976 Thread-296::DEBUG::2012-10-15 09:06:47,207::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-296::DEBUG::2012-10-15 09:06:47,211::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-155::DEBUG::2012-10-15 09:06:47,351::task::588::TaskManager.Task::(_updateState) Task=`96e98f0e-eeb6-473e-a755-bae6b56c1b19`::moving from state init -> state preparing Thread-155::INFO::2012-10-15 09:06:47,356::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='c0ce18f3-31a7-4f67-8026-db6a49a50c96', volUUID='eb184918-d1ca-4934-953b-7626056a0194', options=None) Thread-155::DEBUG::2012-10-15 09:06:47,360::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2b0b556f-dd90-4b0e-8b31-910076a7669b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-155::DEBUG::2012-10-15 09:06:47,362::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-155::DEBUG::2012-10-15 09:06:47,365::resourceManager::501::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' found in shared state and queue is empty, Joining current shared lock (2 active users) Thread-155::DEBUG::2012-10-15 09:06:47,367::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2b0b556f-dd90-4b0e-8b31-910076a7669b`::Granted request Thread-155::DEBUG::2012-10-15 09:06:47,368::task::819::TaskManager.Task::(resourceAcquired) Task=`96e98f0e-eeb6-473e-a755-bae6b56c1b19`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-155::DEBUG::2012-10-15 09:06:47,368::task::980::TaskManager.Task::(_decref) Task=`96e98f0e-eeb6-473e-a755-bae6b56c1b19`::ref 1 aborting False Thread-155::INFO::2012-10-15 09:06:47,369::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-155::DEBUG::2012-10-15 09:06:47,370::task::1174::TaskManager.Task::(prepare) Task=`96e98f0e-eeb6-473e-a755-bae6b56c1b19`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} Thread-155::DEBUG::2012-10-15 09:06:47,370::task::588::TaskManager.Task::(_updateState) Task=`96e98f0e-eeb6-473e-a755-bae6b56c1b19`::moving from state preparing -> state finished Thread-155::DEBUG::2012-10-15 09:06:47,371::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-155::DEBUG::2012-10-15 09:06:47,371::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-155::DEBUG::2012-10-15 09:06:47,372::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-155::DEBUG::2012-10-15 09:06:47,372::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (1 active users) Thread-155::DEBUG::2012-10-15 09:06:47,373::task::980::TaskManager.Task::(_decref) Task=`96e98f0e-eeb6-473e-a755-bae6b56c1b19`::ref 0 aborting False Thread-155::ERROR::2012-10-15 09:06:47,414::utils::393::vm.Vm::(collect) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-296::DEBUG::2012-10-15 09:06:47,908::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-296::DEBUG::2012-10-15 09:06:48,310::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-296::DEBUG::2012-10-15 09:06:48,315::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=56 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-296::DEBUG::2012-10-15 09:06:48,394::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00473165 s, 108 kB/s\n'; = 0 Thread-296::DEBUG::2012-10-15 09:06:48,397::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00473165 s, 108 kB/s'], size: 512 Thread-296::DEBUG::2012-10-15 09:06:48,401::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=56 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-296::DEBUG::2012-10-15 09:06:48,468::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00247988 s, 206 kB/s\n'; = 0 Thread-296::DEBUG::2012-10-15 09:06:48,471::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00247988 s, 206 kB/s'], size: 512 Thread-296::DEBUG::2012-10-15 09:06:48,476::resourceManager::175::ResourceManager.Request::(__init__) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.fe93fef2-3a6e-488f-81e2-d016eb7c0976`ReqID=`879ba403-4cb0-481a-a78f-f4c06718ea75`::Request was made in '/usr/share/vdsm/storage/volume.py' line '550' at 'prepare' Thread-296::DEBUG::2012-10-15 09:06:48,478::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.fe93fef2-3a6e-488f-81e2-d016eb7c0976' for lock type 'exclusive' Thread-296::DEBUG::2012-10-15 09:06:48,484::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --permission rw ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/fe93fef2-3a6e-488f-81e2-d016eb7c0976' (cwd None) Thread-296::DEBUG::2012-10-15 09:06:49,086::lvm::287::Storage.Misc.excCmd::(cmd) FAILED: = ' Logical volume "fe93fef2-3a6e-488f-81e2-d016eb7c0976" is already writable\n'; = 5 Thread-296::DEBUG::2012-10-15 09:06:49,115::lvm::478::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex Thread-296::DEBUG::2012-10-15 09:06:49,118::lvm::490::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex Thread-296::DEBUG::2012-10-15 09:06:49,120::lvm::393::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex Thread-296::DEBUG::2012-10-15 09:06:49,124::lvm::287::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%3600508e000000000969f7bc3649d140c|36d4ae520008545ee000003594fa9b441|36d4ae520008545ee00001e714fc736e8%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (cwd None) Thread-296::DEBUG::2012-10-15 09:06:49,798::lvm::287::Storage.Misc.excCmd::(cmd) SUCCESS: = ''; = 0 Thread-296::DEBUG::2012-10-15 09:06:49,918::lvm::422::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex Thread-296::DEBUG::2012-10-15 09:06:49,919::resourceManager::525::ResourceManager::(registerResource) Resource 'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.fe93fef2-3a6e-488f-81e2-d016eb7c0976' is free. Now locking as 'exclusive' (1 active user) Thread-296::DEBUG::2012-10-15 09:06:49,920::resourceManager::212::ResourceManager.Request::(grant) ResName=`ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5_lvmActivationNS.fe93fef2-3a6e-488f-81e2-d016eb7c0976`ReqID=`879ba403-4cb0-481a-a78f-f4c06718ea75`::Granted request Thread-296::DEBUG::2012-10-15 09:06:49,921::blockVolume::599::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=56 bs=512 if=/dev/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/metadata count=1' (cwd None) Thread-296::DEBUG::2012-10-15 09:06:49,977::blockVolume::599::Storage.Misc.excCmd::(getMetadata) SUCCESS: = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00034435 s, 1.5 MB/s\n'; = 0 Thread-296::DEBUG::2012-10-15 09:06:49,978::misc::317::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00034435 s, 1.5 MB/s'], size: 512 Thread-296::INFO::2012-10-15 09:06:49,980::logUtils::39::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None Thread-296::DEBUG::2012-10-15 09:06:49,981::task::1174::TaskManager.Task::(prepare) Task=`ff2883cf-b608-498c-9acf-f25f7fffc42b`::finished: None Thread-296::DEBUG::2012-10-15 09:06:49,981::task::588::TaskManager.Task::(_updateState) Task=`ff2883cf-b608-498c-9acf-f25f7fffc42b`::moving from state preparing -> state finished Thread-296::DEBUG::2012-10-15 09:06:49,982::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-296::DEBUG::2012-10-15 09:06:49,982::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-296::DEBUG::2012-10-15 09:06:49,983::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-296::DEBUG::2012-10-15 09:06:49,984::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-296::DEBUG::2012-10-15 09:06:49,984::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-296::DEBUG::2012-10-15 09:06:49,985::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-296::DEBUG::2012-10-15 09:06:49,985::task::980::TaskManager.Task::(_decref) Task=`ff2883cf-b608-498c-9acf-f25f7fffc42b`::ref 0 aborting False Thread-296::DEBUG::2012-10-15 09:06:49,987::task::588::TaskManager.Task::(_updateState) Task=`d9fa0984-5aa0-4f16-ab58-9f176afd6c7b`::moving from state init -> state preparing Thread-296::INFO::2012-10-15 09:06:49,987::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='49b16912-deba-4884-b9d6-73779e3ba3eb', volUUID='fe93fef2-3a6e-488f-81e2-d016eb7c0976', options=None) Thread-296::DEBUG::2012-10-15 09:06:49,989::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`3cccaffc-6905-4b55-b823-266276863f80`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2400' at 'getVolumePath' Thread-296::DEBUG::2012-10-15 09:06:49,989::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-296::DEBUG::2012-10-15 09:06:49,990::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-296::DEBUG::2012-10-15 09:06:49,990::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`3cccaffc-6905-4b55-b823-266276863f80`::Granted request Thread-296::DEBUG::2012-10-15 09:06:49,991::task::819::TaskManager.Task::(resourceAcquired) Task=`d9fa0984-5aa0-4f16-ab58-9f176afd6c7b`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-296::DEBUG::2012-10-15 09:06:49,992::task::980::TaskManager.Task::(_decref) Task=`d9fa0984-5aa0-4f16-ab58-9f176afd6c7b`::ref 1 aborting False Thread-296::INFO::2012-10-15 09:06:49,993::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/49b16912-deba-4884-b9d6-73779e3ba3eb/fe93fef2-3a6e-488f-81e2-d016eb7c0976'} Thread-296::DEBUG::2012-10-15 09:06:49,993::task::1174::TaskManager.Task::(prepare) Task=`d9fa0984-5aa0-4f16-ab58-9f176afd6c7b`::finished: {'path': u'/rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/49b16912-deba-4884-b9d6-73779e3ba3eb/fe93fef2-3a6e-488f-81e2-d016eb7c0976'} Thread-296::DEBUG::2012-10-15 09:06:49,994::task::588::TaskManager.Task::(_updateState) Task=`d9fa0984-5aa0-4f16-ab58-9f176afd6c7b`::moving from state preparing -> state finished Thread-296::DEBUG::2012-10-15 09:06:49,994::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-296::DEBUG::2012-10-15 09:06:49,995::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-296::DEBUG::2012-10-15 09:06:49,995::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-296::DEBUG::2012-10-15 09:06:49,996::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-296::DEBUG::2012-10-15 09:06:49,996::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-296::DEBUG::2012-10-15 09:06:49,997::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-296::DEBUG::2012-10-15 09:06:49,997::task::980::TaskManager.Task::(_decref) Task=`d9fa0984-5aa0-4f16-ab58-9f176afd6c7b`::ref 0 aborting False Thread-296::INFO::2012-10-15 09:06:49,998::clientIF::606::vds::(_prepareVolumePath) prepared volume path: /rhev/data-center/4e37e18a-ae32-41a3-a558-af2495d64da8/ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5/images/49b16912-deba-4884-b9d6-73779e3ba3eb/fe93fef2-3a6e-488f-81e2-d016eb7c0976 Thread-296::INFO::2012-10-15 09:06:49,999::clientIF::606::vds::(_prepareVolumePath) prepared volume path: Thread-296::DEBUG::2012-10-15 09:06:50,011::libvirtvm::1145::vm.Vm::(_run) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`:: devportal02 388f6bff-d9cd-4f96-b323-180e52d1be05 12521472 12521472 2 49b16912-deba-4884-b9d6-73779e3ba3eb hvm Red Hat RHEV Hypervisor 16-1 4C4C4544-004B-5210-805A-B5C04F43354A_00:10:18:DA:34:10 388f6bff-d9cd-4f96-b323-180e52d1be05 Opteron_G3 Thread-165::DEBUG::2012-10-15 09:06:50,292::task::588::TaskManager.Task::(_updateState) Task=`649c83c7-7c7c-4842-aaa3-6b85e3f65437`::moving from state init -> state preparing Thread-165::INFO::2012-10-15 09:06:50,293::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='6db264ea-c386-4b44-80a4-7af6fef85578', volUUID='27ab4d15-dbee-4e8e-87ae-cabdfa95cd02', options=None) Thread-165::DEBUG::2012-10-15 09:06:50,294::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`5f205a86-ec60-444c-aece-ba51bed1c245`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-165::DEBUG::2012-10-15 09:06:50,295::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-165::DEBUG::2012-10-15 09:06:50,296::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-165::DEBUG::2012-10-15 09:06:50,296::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`5f205a86-ec60-444c-aece-ba51bed1c245`::Granted request Thread-165::DEBUG::2012-10-15 09:06:50,297::task::819::TaskManager.Task::(resourceAcquired) Task=`649c83c7-7c7c-4842-aaa3-6b85e3f65437`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-165::DEBUG::2012-10-15 09:06:50,298::task::980::TaskManager.Task::(_decref) Task=`649c83c7-7c7c-4842-aaa3-6b85e3f65437`::ref 1 aborting False Thread-165::INFO::2012-10-15 09:06:50,298::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-165::DEBUG::2012-10-15 09:06:50,299::task::1174::TaskManager.Task::(prepare) Task=`649c83c7-7c7c-4842-aaa3-6b85e3f65437`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-165::DEBUG::2012-10-15 09:06:50,299::task::588::TaskManager.Task::(_updateState) Task=`649c83c7-7c7c-4842-aaa3-6b85e3f65437`::moving from state preparing -> state finished Thread-165::DEBUG::2012-10-15 09:06:50,300::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-165::DEBUG::2012-10-15 09:06:50,300::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-165::DEBUG::2012-10-15 09:06:50,301::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-165::DEBUG::2012-10-15 09:06:50,302::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-165::DEBUG::2012-10-15 09:06:50,302::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-165::DEBUG::2012-10-15 09:06:50,303::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-165::DEBUG::2012-10-15 09:06:50,303::task::980::TaskManager.Task::(_decref) Task=`649c83c7-7c7c-4842-aaa3-6b85e3f65437`::ref 0 aborting False Thread-165::ERROR::2012-10-15 09:06:51,148::utils::393::vm.Vm::(collect) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-309::DEBUG::2012-10-15 09:06:51,398::task::588::TaskManager.Task::(_updateState) Task=`2eb1212a-b718-42f9-81f6-2b8a21d4ec52`::moving from state init -> state preparing Thread-309::INFO::2012-10-15 09:06:51,399::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-309::INFO::2012-10-15 09:06:51,399::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00983691215515', 'lastCheck': 1350292008.463477, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00429511070251', 'lastCheck': 1350292001.708961, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.0083270072937', 'lastCheck': 1350292001.512525, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00395584106445', 'lastCheck': 1350292002.106623, 'code': 0, 'valid': True}} Thread-309::DEBUG::2012-10-15 09:06:51,400::task::1174::TaskManager.Task::(prepare) Task=`2eb1212a-b718-42f9-81f6-2b8a21d4ec52`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.00983691215515', 'lastCheck': 1350292008.463477, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00429511070251', 'lastCheck': 1350292001.708961, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.0083270072937', 'lastCheck': 1350292001.512525, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00395584106445', 'lastCheck': 1350292002.106623, 'code': 0, 'valid': True}} Thread-309::DEBUG::2012-10-15 09:06:51,401::task::588::TaskManager.Task::(_updateState) Task=`2eb1212a-b718-42f9-81f6-2b8a21d4ec52`::moving from state preparing -> state finished Thread-309::DEBUG::2012-10-15 09:06:51,401::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-309::DEBUG::2012-10-15 09:06:51,401::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-309::DEBUG::2012-10-15 09:06:51,402::task::980::TaskManager.Task::(_decref) Task=`2eb1212a-b718-42f9-81f6-2b8a21d4ec52`::ref 0 aborting False Thread-310::DEBUG::2012-10-15 09:06:51,428::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-310::DEBUG::2012-10-15 09:06:51,428::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-310::DEBUG::2012-10-15 09:06:51,429::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-310::DEBUG::2012-10-15 09:06:51,430::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-310::DEBUG::2012-10-15 09:06:51,431::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-310::DEBUG::2012-10-15 09:06:51,431::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-310::DEBUG::2012-10-15 09:06:51,432::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-310::DEBUG::2012-10-15 09:06:51,433::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-310::DEBUG::2012-10-15 09:06:51,433::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-310::DEBUG::2012-10-15 09:06:51,434::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-310::DEBUG::2012-10-15 09:06:51,435::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-310::DEBUG::2012-10-15 09:06:51,435::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-310::DEBUG::2012-10-15 09:06:51,436::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-310::DEBUG::2012-10-15 09:06:51,436::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-310::DEBUG::2012-10-15 09:06:51,437::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-310::DEBUG::2012-10-15 09:06:51,438::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-310::DEBUG::2012-10-15 09:06:51,438::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-310::DEBUG::2012-10-15 09:06:51,439::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-310::DEBUG::2012-10-15 09:06:51,439::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-310::DEBUG::2012-10-15 09:06:51,440::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-310::DEBUG::2012-10-15 09:06:51,440::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-310::DEBUG::2012-10-15 09:06:51,441::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-310::DEBUG::2012-10-15 09:06:51,442::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-310::DEBUG::2012-10-15 09:06:51,442::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-310::DEBUG::2012-10-15 09:06:51,443::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-310::DEBUG::2012-10-15 09:06:51,444::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-310::DEBUG::2012-10-15 09:06:51,444::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available libvirtEventLoop::DEBUG::2012-10-15 09:06:52,135::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::event Started detail 0 opaque None Thread-296::DEBUG::2012-10-15 09:06:52,218::utils::323::vm.Vm::(start) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Start statistics collection Thread-311::DEBUG::2012-10-15 09:06:52,220::utils::352::vm.Vm::(run) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Stats thread started Thread-311::DEBUG::2012-10-15 09:06:52,222::task::588::TaskManager.Task::(_updateState) Task=`ba6ace78-e734-4768-8c3c-bf095fcbeaa6`::moving from state init -> state preparing Thread-311::INFO::2012-10-15 09:06:52,223::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', spUUID='4e37e18a-ae32-41a3-a558-af2495d64da8', imgUUID='49b16912-deba-4884-b9d6-73779e3ba3eb', volUUID='fe93fef2-3a6e-488f-81e2-d016eb7c0976', options=None) Thread-311::DEBUG::2012-10-15 09:06:52,225::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2988d9a1-cf18-42a6-a644-0c87c3e4d5c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2352' at 'getVolumeSize' Thread-311::DEBUG::2012-10-15 09:06:52,225::resourceManager::483::ResourceManager::(registerResource) Trying to register resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' for lock type 'shared' Thread-311::DEBUG::2012-10-15 09:06:52,227::resourceManager::525::ResourceManager::(registerResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free. Now locking as 'shared' (1 active user) Thread-311::DEBUG::2012-10-15 09:06:52,229::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5`ReqID=`2988d9a1-cf18-42a6-a644-0c87c3e4d5c3`::Granted request Thread-312::DEBUG::2012-10-15 09:06:52,232::guestIF::67::root::(_connect) Attempting connection to /var/lib/libvirt/qemu/channels/devportal02.com.redhat.rhevm.vdsm Thread-296::WARNING::2012-10-15 09:06:52,237::libvirtvm::1180::vm.Vm::(_readPauseCode) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::_readPauseCode unsupported by libvirt vm Thread-296::DEBUG::2012-10-15 09:06:52,240::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/get-vm-pid devportal02' (cwd None) Thread-312::DEBUG::2012-10-15 09:06:52,262::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /usr/share/vdsm/prepare-vmchannel /var/lib/libvirt/qemu/channels/devportal02.com.redhat.rhevm.vdsm' (cwd None) Thread-311::DEBUG::2012-10-15 09:06:52,270::task::819::TaskManager.Task::(resourceAcquired) Task=`ba6ace78-e734-4768-8c3c-bf095fcbeaa6`::_resourcesAcquired: Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5 (shared) Thread-311::DEBUG::2012-10-15 09:06:52,273::task::980::TaskManager.Task::(_decref) Task=`ba6ace78-e734-4768-8c3c-bf095fcbeaa6`::ref 1 aborting False Thread-311::INFO::2012-10-15 09:06:52,277::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-311::DEBUG::2012-10-15 09:06:52,278::task::1174::TaskManager.Task::(prepare) Task=`ba6ace78-e734-4768-8c3c-bf095fcbeaa6`::finished: {'truesize': '53687091200', 'apparentsize': '53687091200'} Thread-311::DEBUG::2012-10-15 09:06:52,280::task::588::TaskManager.Task::(_updateState) Task=`ba6ace78-e734-4768-8c3c-bf095fcbeaa6`::moving from state preparing -> state finished Thread-311::DEBUG::2012-10-15 09:06:52,282::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': < ResourceRef 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', isValid: 'True' obj: 'None'>} Thread-311::DEBUG::2012-10-15 09:06:52,308::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-311::DEBUG::2012-10-15 09:06:52,315::resourceManager::535::ResourceManager::(releaseResource) Trying to release resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' Thread-311::DEBUG::2012-10-15 09:06:52,318::resourceManager::550::ResourceManager::(releaseResource) Released resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' (0 active users) Thread-311::DEBUG::2012-10-15 09:06:52,321::resourceManager::555::ResourceManager::(releaseResource) Resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5' is free, finding out if anyone is waiting for it. Thread-296::DEBUG::2012-10-15 09:06:52,326::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-311::DEBUG::2012-10-15 09:06:52,335::resourceManager::562::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5', Clearing records. Thread-311::DEBUG::2012-10-15 09:06:52,336::task::980::TaskManager.Task::(_decref) Task=`ba6ace78-e734-4768-8c3c-bf095fcbeaa6`::ref 0 aborting False Thread-312::DEBUG::2012-10-15 09:06:52,380::utils::595::Storage.Misc.excCmd::(execCmd) SUCCESS: = ''; = 0 Thread-312::DEBUG::2012-10-15 09:06:52,381::guestIF::73::root::(_connect) connected to /var/lib/libvirt/qemu/channels/devportal02.com.redhat.rhevm.vdsm Thread-296::DEBUG::2012-10-15 09:06:52,418::utils::595::Storage.Misc.excCmd::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) Thread-311::ERROR::2012-10-15 09:06:52,461::utils::393::vm.Vm::(collect) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Stats function failed: Traceback (most recent call last): File "/usr/share/vdsm/utils.py", line 389, in collect File "/usr/share/vdsm/utils.py", line 266, in __call__ File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses KeyError: 'flush_operations' Thread-296::DEBUG::2012-10-15 09:06:52,612::utils::595::Storage.Misc.excCmd::(execCmd) FAILED: = 'Unknown operation retune\n'; = 1 Thread-296::DEBUG::2012-10-15 09:06:52,613::vm::528::vm.Vm::(_startUnderlyingVm) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::_ongoingCreations released Thread-314::DEBUG::2012-10-15 09:06:53,564::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('388f6bff-d9cd-4f96-b323-180e52d1be05',) {} Thread-314::DEBUG::2012-10-15 09:06:53,566::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::CPU stats not available Thread-314::DEBUG::2012-10-15 09:06:53,568::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Network stats not available Thread-314::DEBUG::2012-10-15 09:06:53,570::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda stats not available Thread-314::DEBUG::2012-10-15 09:06:53,572::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc stats not available Thread-314::DEBUG::2012-10-15 09:06:53,574::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda latency not available Thread-314::DEBUG::2012-10-15 09:06:53,575::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc latency not available Thread-314::DEBUG::2012-10-15 09:06:53,578::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6615', 'displayIp': '172.16.101.102', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '-204', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'state': 'unknown', 'macAddr': '00:1a:4a:10:01:0e', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': '388f6bff-d9cd-4f96-b323-180e52d1be05', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '49b16912-deba-4884-b9d6-73779e3ba3eb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.34', 'cpuIdle': '100.00', 'elapsedTime': '20', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-316::DEBUG::2012-10-15 09:06:55,617::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('388f6bff-d9cd-4f96-b323-180e52d1be05',) {} Thread-316::DEBUG::2012-10-15 09:06:55,618::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::CPU stats not available Thread-316::DEBUG::2012-10-15 09:06:55,619::libvirtvm::212::vm.Vm::(_getNetworkStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Network stats not available Thread-316::DEBUG::2012-10-15 09:06:55,619::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda stats not available Thread-316::DEBUG::2012-10-15 09:06:55,620::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc stats not available Thread-316::DEBUG::2012-10-15 09:06:55,620::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda latency not available Thread-316::DEBUG::2012-10-15 09:06:55,621::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc latency not available Thread-316::DEBUG::2012-10-15 09:06:55,621::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6615', 'displayIp': '172.16.101.102', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '-204', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'state': 'unknown', 'macAddr': '00:1a:4a:10:01:0e', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': '388f6bff-d9cd-4f96-b323-180e52d1be05', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '49b16912-deba-4884-b9d6-73779e3ba3eb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.14', 'cpuIdle': '100.00', 'elapsedTime': '22', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-318::DEBUG::2012-10-15 09:06:57,650::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('388f6bff-d9cd-4f96-b323-180e52d1be05',) {} Thread-318::DEBUG::2012-10-15 09:06:57,651::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::CPU stats not available Thread-318::DEBUG::2012-10-15 09:06:57,652::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda stats not available Thread-318::DEBUG::2012-10-15 09:06:57,652::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc stats not available Thread-318::DEBUG::2012-10-15 09:06:57,653::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda latency not available Thread-318::DEBUG::2012-10-15 09:06:57,653::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc latency not available Thread-318::DEBUG::2012-10-15 09:06:57,654::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6615', 'displayIp': '172.16.101.102', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '-204', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:10:01:0e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': '388f6bff-d9cd-4f96-b323-180e52d1be05', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '49b16912-deba-4884-b9d6-73779e3ba3eb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.17', 'cpuIdle': '100.00', 'elapsedTime': '24', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-320::DEBUG::2012-10-15 09:06:59,714::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('388f6bff-d9cd-4f96-b323-180e52d1be05',) {} Thread-320::DEBUG::2012-10-15 09:06:59,716::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::CPU stats not available Thread-320::DEBUG::2012-10-15 09:06:59,718::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda stats not available Thread-320::DEBUG::2012-10-15 09:06:59,719::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc stats not available Thread-320::DEBUG::2012-10-15 09:06:59,721::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda latency not available Thread-320::DEBUG::2012-10-15 09:06:59,723::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc latency not available Thread-320::DEBUG::2012-10-15 09:06:59,725::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6615', 'displayIp': '172.16.101.102', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '-204', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:10:01:0e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': '388f6bff-d9cd-4f96-b323-180e52d1be05', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '49b16912-deba-4884-b9d6-73779e3ba3eb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.23', 'cpuIdle': '100.00', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-321::DEBUG::2012-10-15 09:07:01,790::task::588::TaskManager.Task::(_updateState) Task=`6365ea56-31d4-4d25-8c64-db30f4ba8ee5`::moving from state init -> state preparing Thread-321::INFO::2012-10-15 09:07:01,793::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-321::INFO::2012-10-15 09:07:01,796::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.55099606514', 'lastCheck': 1350292019.044943, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00144290924072', 'lastCheck': 1350292021.766694, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00391602516174', 'lastCheck': 1350292021.601022, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00663089752197', 'lastCheck': 1350292012.148874, 'code': 0, 'valid': True}} Thread-321::DEBUG::2012-10-15 09:07:01,798::task::1174::TaskManager.Task::(prepare) Task=`6365ea56-31d4-4d25-8c64-db30f4ba8ee5`::finished: {'ccaa4e7a-fa89-46a6-a6e0-07dfe78d1bd5': {'delay': '0.55099606514', 'lastCheck': 1350292019.044943, 'code': 0, 'valid': True}, 'b19f2012-59ff-4ce8-80da-76005ce43be2': {'delay': '0.00144290924072', 'lastCheck': 1350292021.766694, 'code': 0, 'valid': True}, '17e82ced-d839-4b4d-9d81-5333ad777100': {'delay': '0.00391602516174', 'lastCheck': 1350292021.601022, 'code': 0, 'valid': True}, '5c1dec62-3144-4fc4-8ac5-be4e8c04c3ae': {'delay': '0.00663089752197', 'lastCheck': 1350292012.148874, 'code': 0, 'valid': True}} Thread-321::DEBUG::2012-10-15 09:07:01,801::task::588::TaskManager.Task::(_updateState) Task=`6365ea56-31d4-4d25-8c64-db30f4ba8ee5`::moving from state preparing -> state finished Thread-321::DEBUG::2012-10-15 09:07:01,803::resourceManager::806::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-321::DEBUG::2012-10-15 09:07:01,804::resourceManager::841::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-321::DEBUG::2012-10-15 09:07:01,806::task::980::TaskManager.Task::(_decref) Task=`6365ea56-31d4-4d25-8c64-db30f4ba8ee5`::ref 0 aborting False Thread-322::DEBUG::2012-10-15 09:07:01,854::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc stats not available Thread-322::DEBUG::2012-10-15 09:07:01,856::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk vda latency not available Thread-322::DEBUG::2012-10-15 09:07:01,858::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`949630d3-c5aa-4047-9250-28cfe479985d`::Disk hdc latency not available Thread-322::DEBUG::2012-10-15 09:07:01,860::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::CPU stats not available Thread-322::DEBUG::2012-10-15 09:07:01,862::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda stats not available Thread-322::DEBUG::2012-10-15 09:07:01,863::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc stats not available Thread-322::DEBUG::2012-10-15 09:07:01,865::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda latency not available Thread-322::DEBUG::2012-10-15 09:07:01,867::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc latency not available Thread-322::DEBUG::2012-10-15 09:07:01,869::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc stats not available Thread-322::DEBUG::2012-10-15 09:07:01,871::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk vda latency not available Thread-322::DEBUG::2012-10-15 09:07:01,872::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`66fcf199-aa3e-4dc9-b4bf-ea91649bace4`::Disk hdc latency not available Thread-322::DEBUG::2012-10-15 09:07:01,875::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc stats not available Thread-322::DEBUG::2012-10-15 09:07:01,877::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk vda latency not available Thread-322::DEBUG::2012-10-15 09:07:01,878::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ea6e0e35-b833-43b3-8ddf-99f2c085fb43`::Disk hdc latency not available Thread-322::DEBUG::2012-10-15 09:07:01,881::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc stats not available Thread-322::DEBUG::2012-10-15 09:07:01,882::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk vda latency not available Thread-322::DEBUG::2012-10-15 09:07:01,884::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`ae5dca11-2aa1-43be-a7c1-a636374a869a`::Disk hdc latency not available Thread-322::DEBUG::2012-10-15 09:07:01,886::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc stats not available Thread-322::DEBUG::2012-10-15 09:07:01,888::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk vda latency not available Thread-322::DEBUG::2012-10-15 09:07:01,890::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`3a53bfa7-943b-4162-b570-997f548ed5ee`::Disk hdc latency not available Thread-322::DEBUG::2012-10-15 09:07:01,892::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc stats not available Thread-322::DEBUG::2012-10-15 09:07:01,894::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk vda latency not available Thread-322::DEBUG::2012-10-15 09:07:01,895::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`dea83ab1-6310-47c9-8c0c-88171c24045e`::Disk hdc latency not available Thread-322::DEBUG::2012-10-15 09:07:01,898::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc stats not available Thread-322::DEBUG::2012-10-15 09:07:01,900::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk vda latency not available Thread-322::DEBUG::2012-10-15 09:07:01,901::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`08a20ee5-1497-4d2d-ad75-48ca4d8fe6ab`::Disk hdc latency not available Thread-322::DEBUG::2012-10-15 09:07:01,904::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc stats not available Thread-322::DEBUG::2012-10-15 09:07:01,905::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk vda latency not available Thread-322::DEBUG::2012-10-15 09:07:01,907::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`a74d3ee7-16ee-4f01-a7cd-ae929a136915`::Disk hdc latency not available Thread-322::DEBUG::2012-10-15 09:07:01,909::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc stats not available Thread-322::DEBUG::2012-10-15 09:07:01,911::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk vda latency not available Thread-322::DEBUG::2012-10-15 09:07:01,912::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`e454d24b-7675-4cbc-8ad2-1832195ba1ff`::Disk hdc latency not available Thread-324::DEBUG::2012-10-15 09:07:04,034::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('388f6bff-d9cd-4f96-b323-180e52d1be05',) {} Thread-324::DEBUG::2012-10-15 09:07:04,037::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::CPU stats not available Thread-324::DEBUG::2012-10-15 09:07:04,038::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda stats not available Thread-324::DEBUG::2012-10-15 09:07:04,040::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc stats not available Thread-324::DEBUG::2012-10-15 09:07:04,042::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda latency not available Thread-324::DEBUG::2012-10-15 09:07:04,043::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc latency not available Thread-324::DEBUG::2012-10-15 09:07:04,046::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6615', 'displayIp': '172.16.101.102', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '-204', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:10:01:0e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': '388f6bff-d9cd-4f96-b323-180e52d1be05', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '49b16912-deba-4884-b9d6-73779e3ba3eb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.55', 'cpuIdle': '100.00', 'elapsedTime': '31', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-326::DEBUG::2012-10-15 09:07:06,106::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('388f6bff-d9cd-4f96-b323-180e52d1be05',) {} Thread-326::DEBUG::2012-10-15 09:07:06,109::libvirtvm::181::vm.Vm::(_getCpuStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::CPU stats not available Thread-326::DEBUG::2012-10-15 09:07:06,111::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda stats not available Thread-326::DEBUG::2012-10-15 09:07:06,112::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc stats not available Thread-326::DEBUG::2012-10-15 09:07:06,114::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda latency not available Thread-326::DEBUG::2012-10-15 09:07:06,117::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc latency not available Thread-326::DEBUG::2012-10-15 09:07:06,119::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6615', 'displayIp': '172.16.101.102', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '-204', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:10:01:0e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': '388f6bff-d9cd-4f96-b323-180e52d1be05', 'monitorResponse': '0', 'cpuUser': '0.00', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '49b16912-deba-4884-b9d6-73779e3ba3eb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.61', 'cpuIdle': '100.00', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-328::DEBUG::2012-10-15 09:07:08,179::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('388f6bff-d9cd-4f96-b323-180e52d1be05',) {} Thread-328::DEBUG::2012-10-15 09:07:08,182::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda stats not available Thread-328::DEBUG::2012-10-15 09:07:08,183::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc stats not available Thread-328::DEBUG::2012-10-15 09:07:08,185::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda latency not available Thread-328::DEBUG::2012-10-15 09:07:08,186::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc latency not available Thread-328::DEBUG::2012-10-15 09:07:08,188::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6615', 'displayIp': '172.16.101.102', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '-204', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:10:01:0e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': '388f6bff-d9cd-4f96-b323-180e52d1be05', 'monitorResponse': '0', 'cpuUser': '72.56', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '49b16912-deba-4884-b9d6-73779e3ba3eb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '0.68', 'cpuIdle': '27.44', 'elapsedTime': '35', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-330::DEBUG::2012-10-15 09:07:10,269::clientIF::76::vds::(wrapper) [172.16.101.90]::call getVmStats with ('388f6bff-d9cd-4f96-b323-180e52d1be05',) {} Thread-330::DEBUG::2012-10-15 09:07:10,278::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda stats not available Thread-330::DEBUG::2012-10-15 09:07:10,280::libvirtvm::232::vm.Vm::(_getDiskStats) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc stats not available Thread-330::DEBUG::2012-10-15 09:07:10,281::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk vda latency not available Thread-330::DEBUG::2012-10-15 09:07:10,283::libvirtvm::261::vm.Vm::(_getDiskLatency) vmId=`388f6bff-d9cd-4f96-b323-180e52d1be05`::Disk hdc latency not available Thread-330::DEBUG::2012-10-15 09:07:10,285::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '6615', 'displayIp': '172.16.101.102', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '-204', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:10:01:0e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': '388f6bff-d9cd-4f96-b323-180e52d1be05', 'monitorResponse': '0', 'cpuUser': '72.56', 'disks': {'vda': {'truesize': '53687091200', 'apparentsize': '53687091200', 'imageID': '49b16912-deba-4884-b9d6-73779e3ba3eb'}, 'hdc': {}}, 'boot': 'cd', 'statsAge': '1.76', 'cpuIdle': '27.44', 'elapsedTime': '37', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': '', 'displayType': 'qxl', 'nice': ''}]} Thread-331::DEBUG::2012-10-15 09:07:10,297::clientIF::76::vds::(wrapper) [172.16.101.101]::call getVmStats with ('470eac9b-06bc-4427-afc8-1bb39a3e53fd',) {} Thread-331::DEBUG::2012-10-15 09:07:10,299::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} Thread-332::DEBUG::2012-10-15 09:07:10,339::clientIF::76::vds::(wrapper) [172.16.101.101]::call getVmStats with ('8f68f65c-2e95-461b-84c4-9e7bbc83ee92',) {} Thread-332::DEBUG::2012-10-15 09:07:10,341::clientIF::81::vds::(wrapper) return getVmStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} Thread-333::DEBUG::2012-10-15 09:07:10,392::clientIF::76::vds::(wrapper) [172.16.101.101]::call migrationCreate with ({'bridge': 'VLAN_200', 'acpiEnable': 'true', 'emulatedMachine': 'pc-0.14', 'afterMigrationStatus': 'Up', 'vmId': '470eac9b-06bc-4427-afc8-1bb39a3e53fd', 'transparentHugePages': 'true', 'displaySecurePort': '5903', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G3', 'smp': '1', 'migrationDest': 'libvirt', 'macAddr': '00:1a:4a:10:01:04', 'boot': 'cd', 'custom': {}, 'vmType': 'kvm', '_srcDomXML': "\n dev-d-proxy01\n 470eac9b-06bc-4427-afc8-1bb39a3e53fd\n 524288\n 524288\n 1\n \n 1020\n 100000\n -1\n \n \n \n Red Hat\n RHEV Hypervisor\n 16-1\n 4C4C4544-0052-4710-8037-B4C04F39354A_00:10:18:C8:B6:30\n 470eac9b-06bc-4427-afc8-1bb39a3e53fd\n \n \n \n hvm\n \n \n \n \n \n \n \n \n Opteron_G3\n \n \n \n \n \n destroy\n restart\n destroy\n \n /usr/bin/qemu-kvm\n \n \n \n \n 9d352852-0f8d-419a-8043-40c6360143e7\n \n
\n \n \n \n \n \n \n
\n \n \n \n
\n \n \n \n
\n \n \n \n \n \n \n \n
\n \n \n \n \n \n
\n \n \n \n \n
\n \n \n \n \n \n \n \n