MainThread::INFO::2014-05-12 13:12:32,772::vdsm::119::vds::(run) (PID: 4689) I am the actual vdsm 4.14.6-0.fc19 xion2.smartcity.com (3.13.11-100.fc19.x86_64)
MainThread::DEBUG::2014-05-12 13:12:32,772::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage'
MainThread::DEBUG::2014-05-12 13:12:32,773::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0
MainThread::DEBUG::2014-05-12 13:12:33,029::multipath::151::Storage.Multipath::(isEnabled) multipath Defaulting to False
MainThread::DEBUG::2014-05-12 13:12:33,029::multipath::169::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /usr/bin/cp /tmp/tmp3a0wWy /etc/multipath.conf' (cwd None)
MainThread::DEBUG::2014-05-12 13:12:33,044::multipath::169::Storage.Misc.excCmd::(setupMultipath) SUCCESS: <err> = ''; <rc> = 0
MainThread::DEBUG::2014-05-12 13:12:33,045::multipath::175::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None)
MainThread::DEBUG::2014-05-12 13:12:33,071::multipath::175::Storage.Misc.excCmd::(setupMultipath) FAILED: <err> = ''; <rc> = 1
MainThread::DEBUG::2014-05-12 13:12:33,071::multipath::178::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /usr/bin/vdsm-tool service-reload multipathd' (cwd None)
MainThread::DEBUG::2014-05-12 13:12:33,302::multipath::178::Storage.Misc.excCmd::(setupMultipath) FAILED: <err> = 'Traceback (most recent call last):\n  File "/usr/bin/vdsm-tool", line 145, in <module>\n    sys.exit(main())\n  File "/usr/bin/vdsm-tool", line 142, in main\n    return tool_command[cmd]["command"](*args[1:])\n  File "/usr/lib64/python2.7/site-packages/vdsm/tool/service.py", line 398, in service_reload\n    return _runAlts(_srvReloadAlts, srvName)\n  File "/usr/lib64/python2.7/site-packages/vdsm/tool/service.py", line 350, in _runAlts\n    "%s failed" % alt.func_name, out, err)\nvdsm.tool.service.ServiceOperationError: ServiceOperationError: _systemctlReload failed\nJob for multipathd.service failed. See \'systemctl status multipathd.service\' and \'journalctl -xn\' for details.\n\n'; <rc> = 1
MainThread::ERROR::2014-05-12 13:12:33,302::utils::1107::root::(panic) Panic: Error initializing IRS
Traceback (most recent call last):
  File "/usr/share/vdsm/vdsm", line 72, in serve_clients
    irs = Dispatcher(HSM())
  File "/usr/share/vdsm/storage/hsm.py", line 358, in __init__
    multipath.setupMultipath()
  File "/usr/share/vdsm/storage/multipath.py", line 180, in setupMultipath
    raise se.MultipathReloadError()
MultipathReloadError: Multipath service reload error: ()
MainThread::INFO::2014-05-12 13:12:34,572::vdsm::119::vds::(run) (PID: 4826) I am the actual vdsm 4.14.6-0.fc19 xion2.smartcity.com (3.13.11-100.fc19.x86_64)
MainThread::DEBUG::2014-05-12 13:12:34,572::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage'
MainThread::DEBUG::2014-05-12 13:12:34,572::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0
MainThread::WARNING::2014-05-12 13:12:34,573::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
MainThread::DEBUG::2014-05-12 13:12:34,835::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
MainThread::DEBUG::2014-05-12 13:12:34,839::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
MainThread::DEBUG::2014-05-12 13:12:34,839::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None)
MainThread::DEBUG::2014-05-12 13:12:34,854::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
MainThread::DEBUG::2014-05-12 13:12:34,854::hsm::447::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
MainThread::DEBUG::2014-05-12 13:12:34,858::hsm::479::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
MainThread::DEBUG::2014-05-12 13:12:34,858::hsm::480::Storage.HSM::(__cleanStorageRepository) Mount list: []
MainThread::DEBUG::2014-05-12 13:12:34,858::hsm::482::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
MainThread::DEBUG::2014-05-12 13:12:34,859::hsm::525::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
storageRefresh::DEBUG::2014-05-12 13:12:34,859::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
MainThread::INFO::2014-05-12 13:12:34,860::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
storageRefresh::DEBUG::2014-05-12 13:12:34,860::misc::764::SamplingMethod::(__call__) Got in to sampling method
storageRefresh::DEBUG::2014-05-12 13:12:34,874::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
storageRefresh::DEBUG::2014-05-12 13:12:34,874::misc::764::SamplingMethod::(__call__) Got in to sampling method
storageRefresh::DEBUG::2014-05-12 13:12:34,874::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
storageRefresh::DEBUG::2014-05-12 13:12:34,874::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
MainThread::DEBUG::2014-05-12 13:12:34,890::task::595::TaskManager.Task::(_updateState) Task=`c4bb36c4-506f-40e9-961b-c6815792a604`::moving from state init -> state preparing
MainThread::INFO::2014-05-12 13:12:34,890::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x2c41488>>)
MainThread::INFO::2014-05-12 13:12:34,891::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
MainThread::DEBUG::2014-05-12 13:12:34,891::task::1185::TaskManager.Task::(prepare) Task=`c4bb36c4-506f-40e9-961b-c6815792a604`::finished: None
MainThread::DEBUG::2014-05-12 13:12:34,891::task::595::TaskManager.Task::(_updateState) Task=`c4bb36c4-506f-40e9-961b-c6815792a604`::moving from state preparing -> state finished
MainThread::DEBUG::2014-05-12 13:12:34,891::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
MainThread::DEBUG::2014-05-12 13:12:34,891::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
MainThread::DEBUG::2014-05-12 13:12:34,891::task::990::TaskManager.Task::(_decref) Task=`c4bb36c4-506f-40e9-961b-c6815792a604`::ref 0 aborting False
storageRefresh::DEBUG::2014-05-12 13:12:34,948::misc::772::SamplingMethod::(__call__) Returning last result
storageRefresh::DEBUG::2014-05-12 13:12:34,948::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
MainThread::INFO::2014-05-12 13:12:34,956::momIF::47::MOM::(__init__) Starting up MOM
MainThread::INFO::2014-05-12 13:12:34,958::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds.
VM Channels Listener::INFO::2014-05-12 13:12:34,960::vmChannels::170::vds::(run) Starting VM channels listener thread.
clientIFinit::DEBUG::2014-05-12 13:12:34,972::libvirtconnection::145::root::(get) trying to connect libvirt
MainThread::WARNING::2014-05-12 13:12:34,973::clientIF::181::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed.
storageRefresh::DEBUG::2014-05-12 13:12:35,001::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:12:35,005::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,009::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,012::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,015::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,018::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,021::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,023::misc::772::SamplingMethod::(__call__) Returning last result
storageRefresh::DEBUG::2014-05-12 13:12:35,026::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,040::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:12:35,065::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:12:35,068::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,071::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,078::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:12:35,097::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:12:35,099::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,104::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:12:35,122::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:12:35,123::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,126::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:12:35,140::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:12:35,141::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:12:35,142::hsm::391::Storage.HSM::(storageRefresh) HSM is ready
Thread-13::DEBUG::2014-05-12 13:12:35,656::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {}
Thread-13::DEBUG::2014-05-12 13:12:35,675::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'XPS 8500', 'systemSerialNumber': 'FTQ2DX1', 'systemFamily': 'To be filled by O.E.M.', 'systemVersion': '', 'systemUUID': '4C4C4544-0054-5110-8032-C6C04F445831', 'systemManufacturer': 'Dell Inc.'}}
Thread-15::DEBUG::2014-05-12 13:12:35,771::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1]
Thread-15::DEBUG::2014-05-12 13:12:35,771::task::595::TaskManager.Task::(_updateState) Task=`36a28932-7907-4614-999b-d439b579f8aa`::moving from state init -> state preparing
Thread-15::INFO::2014-05-12 13:12:35,771::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
Thread-15::INFO::2014-05-12 13:12:35,772::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
Thread-15::DEBUG::2014-05-12 13:12:35,772::task::1185::TaskManager.Task::(prepare) Task=`36a28932-7907-4614-999b-d439b579f8aa`::finished: {'poollist': []}
Thread-15::DEBUG::2014-05-12 13:12:35,772::task::595::TaskManager.Task::(_updateState) Task=`36a28932-7907-4614-999b-d439b579f8aa`::moving from state preparing -> state finished
Thread-15::DEBUG::2014-05-12 13:12:35,772::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-15::DEBUG::2014-05-12 13:12:35,772::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-15::DEBUG::2014-05-12 13:12:35,772::task::990::TaskManager.Task::(_decref) Task=`36a28932-7907-4614-999b-d439b579f8aa`::ref 0 aborting False
Thread-16::DEBUG::2014-05-12 13:26:48,146::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1]
Thread-16::DEBUG::2014-05-12 13:26:48,147::task::595::TaskManager.Task::(_updateState) Task=`306e0c82-9241-44da-ae02-9938e933fbbb`::moving from state init -> state preparing
Thread-16::INFO::2014-05-12 13:26:48,147::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'xion2:/export/vm/he1', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'a947cb6e-63de-4e2f-9230-e9266594f03e'}], options=None)
Thread-16::DEBUG::2014-05-12 13:26:48,153::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /usr/bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 xion2:/export/vm/he1 /rhev/data-center/mnt/xion2:_export_vm_he1' (cwd None)
Thread-16::DEBUG::2014-05-12 13:26:48,293::hsm::2317::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/xion2:_export_vm_he1
Thread-16::DEBUG::2014-05-12 13:26:48,294::hsm::2341::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
Thread-16::DEBUG::2014-05-12 13:26:48,294::hsm::2397::Storage.HSM::(connectStorageServer) knownSDs: {}
Thread-16::INFO::2014-05-12 13:26:48,294::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'a947cb6e-63de-4e2f-9230-e9266594f03e'}]}
Thread-16::DEBUG::2014-05-12 13:26:48,294::task::1185::TaskManager.Task::(prepare) Task=`306e0c82-9241-44da-ae02-9938e933fbbb`::finished: {'statuslist': [{'status': 0, 'id': 'a947cb6e-63de-4e2f-9230-e9266594f03e'}]}
Thread-16::DEBUG::2014-05-12 13:26:48,294::task::595::TaskManager.Task::(_updateState) Task=`306e0c82-9241-44da-ae02-9938e933fbbb`::moving from state preparing -> state finished
Thread-16::DEBUG::2014-05-12 13:26:48,295::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-16::DEBUG::2014-05-12 13:26:48,295::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-16::DEBUG::2014-05-12 13:26:48,295::task::990::TaskManager.Task::(_decref) Task=`306e0c82-9241-44da-ae02-9938e933fbbb`::ref 0 aborting False
Thread-17::DEBUG::2014-05-12 13:26:48,304::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1]
Thread-17::DEBUG::2014-05-12 13:26:48,304::task::595::TaskManager.Task::(_updateState) Task=`cd561879-811f-4dc6-8965-1aa97dc41632`::moving from state init -> state preparing
Thread-17::INFO::2014-05-12 13:26:48,304::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=None, storageType=None, remotePath=None, options=None)
Thread-17::DEBUG::2014-05-12 13:26:48,305::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
Thread-17::DEBUG::2014-05-12 13:26:48,305::misc::764::SamplingMethod::(__call__) Got in to sampling method
Thread-17::DEBUG::2014-05-12 13:26:48,305::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
Thread-17::DEBUG::2014-05-12 13:26:48,305::misc::764::SamplingMethod::(__call__) Got in to sampling method
Thread-17::DEBUG::2014-05-12 13:26:48,305::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
Thread-17::DEBUG::2014-05-12 13:26:48,305::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
Thread-17::DEBUG::2014-05-12 13:26:48,315::misc::772::SamplingMethod::(__call__) Returning last result
Thread-17::DEBUG::2014-05-12 13:26:48,315::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
Thread-17::DEBUG::2014-05-12 13:26:48,380::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
Thread-17::DEBUG::2014-05-12 13:26:48,380::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2014-05-12 13:26:48,380::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2014-05-12 13:26:48,380::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2014-05-12 13:26:48,380::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2014-05-12 13:26:48,380::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-17::DEBUG::2014-05-12 13:26:48,380::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-17::DEBUG::2014-05-12 13:26:48,381::misc::772::SamplingMethod::(__call__) Returning last result
Thread-17::DEBUG::2014-05-12 13:26:48,381::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-17::DEBUG::2014-05-12 13:26:48,381::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
Thread-17::DEBUG::2014-05-12 13:26:48,403::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
Thread-17::DEBUG::2014-05-12 13:26:48,403::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-17::INFO::2014-05-12 13:26:48,484::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []}
Thread-17::DEBUG::2014-05-12 13:26:48,485::task::1185::TaskManager.Task::(prepare) Task=`cd561879-811f-4dc6-8965-1aa97dc41632`::finished: {'domlist': []}
Thread-17::DEBUG::2014-05-12 13:26:48,485::task::595::TaskManager.Task::(_updateState) Task=`cd561879-811f-4dc6-8965-1aa97dc41632`::moving from state preparing -> state finished
Thread-17::DEBUG::2014-05-12 13:26:48,485::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-17::DEBUG::2014-05-12 13:26:48,485::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-17::DEBUG::2014-05-12 13:26:48,485::task::990::TaskManager.Task::(_decref) Task=`cd561879-811f-4dc6-8965-1aa97dc41632`::ref 0 aborting False
Thread-19::DEBUG::2014-05-12 13:26:48,494::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1]
Thread-19::DEBUG::2014-05-12 13:26:48,495::task::595::TaskManager.Task::(_updateState) Task=`0147eccb-a46b-4345-9293-ae86654ad09f`::moving from state init -> state preparing
Thread-19::INFO::2014-05-12 13:26:48,495::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'xion2:/export/vm/he1', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'a947cb6e-63de-4e2f-9230-e9266594f03e'}], options=None)
Thread-19::DEBUG::2014-05-12 13:26:48,495::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /usr/bin/umount -f -l /rhev/data-center/mnt/xion2:_export_vm_he1' (cwd None)
Thread-19::DEBUG::2014-05-12 13:26:48,520::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
Thread-19::DEBUG::2014-05-12 13:26:48,520::misc::764::SamplingMethod::(__call__) Got in to sampling method
Thread-19::DEBUG::2014-05-12 13:26:48,520::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
Thread-19::DEBUG::2014-05-12 13:26:48,520::misc::764::SamplingMethod::(__call__) Got in to sampling method
Thread-19::DEBUG::2014-05-12 13:26:48,521::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
Thread-19::DEBUG::2014-05-12 13:26:48,521::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
Thread-19::DEBUG::2014-05-12 13:26:48,531::misc::772::SamplingMethod::(__call__) Returning last result
Thread-19::DEBUG::2014-05-12 13:26:48,531::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
Thread-19::DEBUG::2014-05-12 13:26:48,587::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
Thread-19::DEBUG::2014-05-12 13:26:48,587::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-19::DEBUG::2014-05-12 13:26:48,587::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-19::DEBUG::2014-05-12 13:26:48,587::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-19::DEBUG::2014-05-12 13:26:48,587::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-19::DEBUG::2014-05-12 13:26:48,588::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-19::DEBUG::2014-05-12 13:26:48,588::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-19::DEBUG::2014-05-12 13:26:48,588::misc::772::SamplingMethod::(__call__) Returning last result
Thread-19::INFO::2014-05-12 13:26:48,588::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'a947cb6e-63de-4e2f-9230-e9266594f03e'}]}
Thread-19::DEBUG::2014-05-12 13:26:48,588::task::1185::TaskManager.Task::(prepare) Task=`0147eccb-a46b-4345-9293-ae86654ad09f`::finished: {'statuslist': [{'status': 0, 'id': 'a947cb6e-63de-4e2f-9230-e9266594f03e'}]}
Thread-19::DEBUG::2014-05-12 13:26:48,588::task::595::TaskManager.Task::(_updateState) Task=`0147eccb-a46b-4345-9293-ae86654ad09f`::moving from state preparing -> state finished
Thread-19::DEBUG::2014-05-12 13:26:48,588::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-19::DEBUG::2014-05-12 13:26:48,588::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-19::DEBUG::2014-05-12 13:26:48,588::task::990::TaskManager.Task::(_decref) Task=`0147eccb-a46b-4345-9293-ae86654ad09f`::ref 0 aborting False
MainThread::DEBUG::2014-05-12 13:41:30,225::vdsm::55::vds::(sigtermHandler) Received signal 15
MainThread::INFO::2014-05-12 13:41:30,464::vmChannels::183::vds::(stop) VM channels listener was stopped.
MainThread::INFO::2014-05-12 13:41:30,464::momIF::84::MOM::(stop) Shutting down MOM
MainThread::DEBUG::2014-05-12 13:41:30,465::task::595::TaskManager.Task::(_updateState) Task=`9d3fb39e-ae3d-4542-bfad-2419402c5ca5`::moving from state init -> state preparing
MainThread::INFO::2014-05-12 13:41:30,466::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None)
Thread-11::DEBUG::2014-05-12 13:41:30,466::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped
MainThread::INFO::2014-05-12 13:41:30,774::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors
MainThread::DEBUG::2014-05-12 13:41:30,774::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks
MainThread::INFO::2014-05-12 13:41:30,775::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None
MainThread::DEBUG::2014-05-12 13:41:30,775::task::1185::TaskManager.Task::(prepare) Task=`9d3fb39e-ae3d-4542-bfad-2419402c5ca5`::finished: None
MainThread::DEBUG::2014-05-12 13:41:30,775::task::595::TaskManager.Task::(_updateState) Task=`9d3fb39e-ae3d-4542-bfad-2419402c5ca5`::moving from state preparing -> state finished
MainThread::DEBUG::2014-05-12 13:41:30,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
MainThread::DEBUG::2014-05-12 13:41:30,775::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
MainThread::DEBUG::2014-05-12 13:41:30,775::task::990::TaskManager.Task::(_decref) Task=`9d3fb39e-ae3d-4542-bfad-2419402c5ca5`::ref 0 aborting False
MainThread::INFO::2014-05-12 13:41:30,775::vdsm::125::vds::(run) VDSM main thread ended. Waiting for 16 other threads...
MainThread::INFO::2014-05-12 13:41:30,775::vdsm::129::vds::(run) <Thread(libvirtEventLoop, started daemon 140094772573952)>
MainThread::INFO::2014-05-12 13:41:30,775::vdsm::129::vds::(run) <WorkerThread(Thread-10, started daemon 140094350538496)>
MainThread::INFO::2014-05-12 13:41:30,775::vdsm::129::vds::(run) <HostMonitor(HostMonitor, started daemon 140093377476352)>
MainThread::INFO::2014-05-12 13:41:30,775::vdsm::129::vds::(run) <WorkerThread(Thread-3, started daemon 140094747395840)>
MainThread::INFO::2014-05-12 13:41:30,775::vdsm::129::vds::(run) <WorkerThread(Thread-2, started daemon 140094755788544)>
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <WorkerThread(Thread-1, started daemon 140094764181248)>
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <PolicyEngine(PolicyEngine, started daemon 140094333753088)>
MainThread::INFO::2014-05-12 13:41:30,776::vmChannels::183::vds::(stop) VM channels listener was stopped.
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <Listener(VM Channels Listener, started daemon 140093754951424)>
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <WorkerThread(Thread-7, started daemon 140094375716608)>
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <GuestManager(GuestManager, started daemon 140093369083648)>
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <_MainThread(MainThread, started 140095065859904)>
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <WorkerThread(Thread-9, started daemon 140094358931200)>
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <WorkerThread(Thread-5, started daemon 140094730610432)>
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <WorkerThread(Thread-6, started daemon 140094384109312)>
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <WorkerThread(Thread-4, started daemon 140094739003136)>
MainThread::INFO::2014-05-12 13:41:30,776::momIF::84::MOM::(stop) Shutting down MOM
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <MomThread(MOM, started 140093771736832)>
MainThread::INFO::2014-05-12 13:41:30,776::vdsm::129::vds::(run) <WorkerThread(Thread-8, started daemon 140094367323904)>
VM Channels Listener::INFO::2014-05-12 13:41:30,875::vmChannels::178::vds::(run) VM channels listener thread has ended.
MainThread::INFO::2014-05-12 13:41:40,529::vdsm::119::vds::(run) (PID: 29887) I am the actual vdsm 4.14.6-0.fc19 xion2.smartcity.net (3.13.11-100.fc19.x86_64)
MainThread::DEBUG::2014-05-12 13:41:40,530::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage'
MainThread::DEBUG::2014-05-12 13:41:40,530::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0
MainThread::WARNING::2014-05-12 13:41:40,531::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
MainThread::DEBUG::2014-05-12 13:41:40,811::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
MainThread::DEBUG::2014-05-12 13:41:40,816::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
MainThread::DEBUG::2014-05-12 13:41:40,816::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None)
MainThread::DEBUG::2014-05-12 13:41:40,832::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
MainThread::DEBUG::2014-05-12 13:41:40,832::hsm::447::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
MainThread::DEBUG::2014-05-12 13:41:40,836::hsm::479::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
MainThread::DEBUG::2014-05-12 13:41:40,836::hsm::480::Storage.HSM::(__cleanStorageRepository) Mount list: []
MainThread::DEBUG::2014-05-12 13:41:40,836::hsm::482::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
MainThread::DEBUG::2014-05-12 13:41:40,837::hsm::525::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
storageRefresh::DEBUG::2014-05-12 13:41:40,837::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
MainThread::INFO::2014-05-12 13:41:40,838::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
storageRefresh::DEBUG::2014-05-12 13:41:40,852::misc::764::SamplingMethod::(__call__) Got in to sampling method
storageRefresh::DEBUG::2014-05-12 13:41:40,852::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
storageRefresh::DEBUG::2014-05-12 13:41:40,852::misc::764::SamplingMethod::(__call__) Got in to sampling method
storageRefresh::DEBUG::2014-05-12 13:41:40,853::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
storageRefresh::DEBUG::2014-05-12 13:41:40,854::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:41:40,862::misc::772::SamplingMethod::(__call__) Returning last result
storageRefresh::DEBUG::2014-05-12 13:41:40,863::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
MainThread::DEBUG::2014-05-12 13:41:40,868::task::595::TaskManager.Task::(_updateState) Task=`ae21dd8d-0de3-4e61-8d20-34b11e75f75c`::moving from state init -> state preparing
MainThread::INFO::2014-05-12 13:41:40,868::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x2d09440>>)
MainThread::INFO::2014-05-12 13:41:40,869::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
MainThread::DEBUG::2014-05-12 13:41:40,869::task::1185::TaskManager.Task::(prepare) Task=`ae21dd8d-0de3-4e61-8d20-34b11e75f75c`::finished: None
MainThread::DEBUG::2014-05-12 13:41:40,869::task::595::TaskManager.Task::(_updateState) Task=`ae21dd8d-0de3-4e61-8d20-34b11e75f75c`::moving from state preparing -> state finished
MainThread::DEBUG::2014-05-12 13:41:40,869::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
MainThread::DEBUG::2014-05-12 13:41:40,869::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
MainThread::DEBUG::2014-05-12 13:41:40,869::task::990::TaskManager.Task::(_decref) Task=`ae21dd8d-0de3-4e61-8d20-34b11e75f75c`::ref 0 aborting False
MainThread::INFO::2014-05-12 13:41:40,872::momIF::47::MOM::(__init__) Starting up MOM
MainThread::INFO::2014-05-12 13:41:40,873::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds.
VM Channels Listener::INFO::2014-05-12 13:41:40,875::vmChannels::170::vds::(run) Starting VM channels listener thread.
clientIFinit::DEBUG::2014-05-12 13:41:40,886::libvirtconnection::145::root::(get) trying to connect libvirt
MainThread::WARNING::2014-05-12 13:41:40,889::clientIF::181::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed.
storageRefresh::DEBUG::2014-05-12 13:41:40,956::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:41:40,957::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:40,959::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:40,961::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:40,963::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:40,965::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:40,967::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:40,968::misc::772::SamplingMethod::(__call__) Returning last result
storageRefresh::DEBUG::2014-05-12 13:41:40,970::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:40,978::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:41:40,997::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:41:40,998::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:40,999::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:41,001::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:41:41,019::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:41:41,020::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:41,022::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:41:41,040::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:41:41,041::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:41:41,044::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:41:41,058::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:41:41,059::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
storageRefresh::WARNING::2014-05-12 13:41:41,060::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists
storageRefresh::DEBUG::2014-05-12 13:41:41,061::hsm::391::Storage.HSM::(storageRefresh) HSM is ready
Thread-13::DEBUG::2014-05-12 13:41:41,406::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {}
Thread-13::DEBUG::2014-05-12 13:41:41,425::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'XPS 8500', 'systemSerialNumber': 'FTQ2DX1', 'systemFamily': 'To be filled by O.E.M.', 'systemVersion': '', 'systemUUID': '4C4C4544-0054-5110-8032-C6C04F445831', 'systemManufacturer': 'Dell Inc.'}}
Thread-14::DEBUG::2014-05-12 13:41:41,434::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {}
Thread-14::DEBUG::2014-05-12 13:41:41,469::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None)
Thread-14::DEBUG::2014-05-12 13:41:41,486::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
Thread-14::ERROR::2014-05-12 13:41:41,489::BindingXMLRPC::1086::vds::(wrapper) unexpected error
Traceback (most recent call last):
  File "/usr/share/vdsm/BindingXMLRPC.py", line 1070, in wrapper
    res = f(*args, **kwargs)
  File "/usr/share/vdsm/BindingXMLRPC.py", line 393, in getCapabilities
    ret = api.getCapabilities()
  File "/usr/share/vdsm/API.py", line 1185, in getCapabilities
    c = caps.get()
  File "/usr/share/vdsm/caps.py", line 369, in get
    caps.update(netinfo.get())
  File "/usr/lib64/python2.7/site-packages/vdsm/netinfo.py", line 566, in get
    d['nics'][dev.name] = _nicinfo(dev.name, paddr)
  File "/usr/lib64/python2.7/site-packages/vdsm/netinfo.py", line 516, in _nicinfo
    info = _devinfo(nic)
  File "/usr/lib64/python2.7/site-packages/vdsm/netinfo.py", line 536, in _devinfo
    ipv4addr, ipv4netmask, ipv6addrs = getIpInfo(dev)
  File "/usr/lib64/python2.7/site-packages/vdsm/netinfo.py", line 317, in getIpInfo
    ipv6addrs = devInfo.get_ipv6_addresses()
SystemError: error return without exception set
Thread-15::DEBUG::2014-05-12 13:57:16,004::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {}
Thread-15::DEBUG::2014-05-12 13:57:16,007::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'XPS 8500', 'systemSerialNumber': 'FTQ2DX1', 'systemFamily': 'To be filled by O.E.M.', 'systemVersion': '', 'systemUUID': '4C4C4544-0054-5110-8032-C6C04F445831', 'systemManufacturer': 'Dell Inc.'}}
Thread-17::DEBUG::2014-05-12 13:57:16,083::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1]
Thread-17::DEBUG::2014-05-12 13:57:16,083::task::595::TaskManager.Task::(_updateState) Task=`d2130ae7-8886-4a32-8a54-8198c1b12b28`::moving from state init -> state preparing
Thread-17::INFO::2014-05-12 13:57:16,084::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
Thread-17::INFO::2014-05-12 13:57:16,084::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
Thread-17::DEBUG::2014-05-12 13:57:16,084::task::1185::TaskManager.Task::(prepare) Task=`d2130ae7-8886-4a32-8a54-8198c1b12b28`::finished: {'poollist': []}
Thread-17::DEBUG::2014-05-12 13:57:16,084::task::595::TaskManager.Task::(_updateState) Task=`d2130ae7-8886-4a32-8a54-8198c1b12b28`::moving from state preparing -> state finished
Thread-17::DEBUG::2014-05-12 13:57:16,084::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-17::DEBUG::2014-05-12 13:57:16,084::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-17::DEBUG::2014-05-12 13:57:16,084::task::990::TaskManager.Task::(_decref) Task=`d2130ae7-8886-4a32-8a54-8198c1b12b28`::ref 0 aborting False
Thread-18::DEBUG::2014-05-12 13:57:49,088::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1]
Thread-18::DEBUG::2014-05-12 13:57:49,089::task::595::TaskManager.Task::(_updateState) Task=`12fb57a3-19c3-4450-8826-ac87b2795d62`::moving from state init -> state preparing
Thread-18::INFO::2014-05-12 13:57:49,089::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'xion2:/export/vm/he1', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': '86f16d9a-82a9-4399-8380-823ccbd2ad6f'}], options=None)
Thread-18::DEBUG::2014-05-12 13:57:49,094::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /usr/bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 xion2:/export/vm/he1 /rhev/data-center/mnt/xion2:_export_vm_he1' (cwd None)
Thread-18::DEBUG::2014-05-12 13:57:49,213::hsm::2317::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/xion2:_export_vm_he1
Thread-18::DEBUG::2014-05-12 13:57:49,214::hsm::2341::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
Thread-18::DEBUG::2014-05-12 13:57:49,214::hsm::2397::Storage.HSM::(connectStorageServer) knownSDs: {}
Thread-18::INFO::2014-05-12 13:57:49,214::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '86f16d9a-82a9-4399-8380-823ccbd2ad6f'}]}
Thread-18::DEBUG::2014-05-12 13:57:49,214::task::1185::TaskManager.Task::(prepare) Task=`12fb57a3-19c3-4450-8826-ac87b2795d62`::finished: {'statuslist': [{'status': 0, 'id': '86f16d9a-82a9-4399-8380-823ccbd2ad6f'}]}
Thread-18::DEBUG::2014-05-12 13:57:49,215::task::595::TaskManager.Task::(_updateState) Task=`12fb57a3-19c3-4450-8826-ac87b2795d62`::moving from state preparing -> state finished
Thread-18::DEBUG::2014-05-12 13:57:49,215::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-18::DEBUG::2014-05-12 13:57:49,215::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-18::DEBUG::2014-05-12 13:57:49,215::task::990::TaskManager.Task::(_decref) Task=`12fb57a3-19c3-4450-8826-ac87b2795d62`::ref 0 aborting False
Thread-19::DEBUG::2014-05-12 13:57:49,223::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1]
Thread-19::DEBUG::2014-05-12 13:57:49,224::task::595::TaskManager.Task::(_updateState) Task=`5c51d9ca-444a-4716-a458-514f0e6de764`::moving from state init -> state preparing
Thread-19::INFO::2014-05-12 13:57:49,224::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=None, storageType=None, remotePath=None, options=None)
Thread-19::DEBUG::2014-05-12 13:57:49,224::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
Thread-19::DEBUG::2014-05-12 13:57:49,224::misc::764::SamplingMethod::(__call__) Got in to sampling method
Thread-19::DEBUG::2014-05-12 13:57:49,224::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
Thread-19::DEBUG::2014-05-12 13:57:49,224::misc::764::SamplingMethod::(__call__) Got in to sampling method
Thread-19::DEBUG::2014-05-12 13:57:49,224::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
Thread-19::DEBUG::2014-05-12 13:57:49,224::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
Thread-19::DEBUG::2014-05-12 13:57:49,234::misc::772::SamplingMethod::(__call__) Returning last result
Thread-19::DEBUG::2014-05-12 13:57:49,234::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
Thread-19::DEBUG::2014-05-12 13:57:49,296::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
Thread-19::DEBUG::2014-05-12 13:57:49,297::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-19::DEBUG::2014-05-12 13:57:49,297::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-19::DEBUG::2014-05-12 13:57:49,297::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-19::DEBUG::2014-05-12 13:57:49,297::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-19::DEBUG::2014-05-12 13:57:49,297::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-19::DEBUG::2014-05-12 13:57:49,298::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-19::DEBUG::2014-05-12 13:57:49,298::misc::772::SamplingMethod::(__call__) Returning last result
Thread-19::DEBUG::2014-05-12 13:57:49,298::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-19::DEBUG::2014-05-12 13:57:49,298::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
Thread-19::DEBUG::2014-05-12 13:57:49,319::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
Thread-19::DEBUG::2014-05-12 13:57:49,320::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-19::INFO::2014-05-12 13:57:49,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []}
Thread-19::DEBUG::2014-05-12 13:57:49,403::task::1185::TaskManager.Task::(prepare) Task=`5c51d9ca-444a-4716-a458-514f0e6de764`::finished: {'domlist': []}
Thread-19::DEBUG::2014-05-12 13:57:49,403::task::595::TaskManager.Task::(_updateState) Task=`5c51d9ca-444a-4716-a458-514f0e6de764`::moving from state preparing -> state finished
Thread-19::DEBUG::2014-05-12 13:57:49,403::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-19::DEBUG::2014-05-12 13:57:49,403::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-19::DEBUG::2014-05-12 13:57:49,403::task::990::TaskManager.Task::(_decref) Task=`5c51d9ca-444a-4716-a458-514f0e6de764`::ref 0 aborting False
Thread-21::DEBUG::2014-05-12 13:57:49,412::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1]
Thread-21::DEBUG::2014-05-12 13:57:49,413::task::595::TaskManager.Task::(_updateState) Task=`ae5fa1ea-3add-42c7-9dea-c2ebab07e1bb`::moving from state init -> state preparing
Thread-21::INFO::2014-05-12 13:57:49,413::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'xion2:/export/vm/he1', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': '86f16d9a-82a9-4399-8380-823ccbd2ad6f'}], options=None)
Thread-21::DEBUG::2014-05-12 13:57:49,413::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /usr/bin/umount -f -l /rhev/data-center/mnt/xion2:_export_vm_he1' (cwd None)
Thread-21::DEBUG::2014-05-12 13:57:49,443::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
Thread-21::DEBUG::2014-05-12 13:57:49,443::misc::764::SamplingMethod::(__call__) Got in to sampling method
Thread-21::DEBUG::2014-05-12 13:57:49,444::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
Thread-21::DEBUG::2014-05-12 13:57:49,444::misc::764::SamplingMethod::(__call__) Got in to sampling method
Thread-21::DEBUG::2014-05-12 13:57:49,444::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
Thread-21::DEBUG::2014-05-12 13:57:49,444::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
Thread-21::DEBUG::2014-05-12 13:57:49,453::misc::772::SamplingMethod::(__call__) Returning last result
Thread-21::DEBUG::2014-05-12 13:57:49,454::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
Thread-21::DEBUG::2014-05-12 13:57:49,496::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
Thread-21::DEBUG::2014-05-12 13:57:49,496::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-21::DEBUG::2014-05-12 13:57:49,496::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-21::DEBUG::2014-05-12 13:57:49,496::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-21::DEBUG::2014-05-12 13:57:49,496::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-21::DEBUG::2014-05-12 13:57:49,497::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-21::DEBUG::2014-05-12 13:57:49,497::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-21::DEBUG::2014-05-12 13:57:49,497::misc::772::SamplingMethod::(__call__) Returning last result
Thread-21::INFO::2014-05-12 13:57:49,497::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '86f16d9a-82a9-4399-8380-823ccbd2ad6f'}]}
Thread-21::DEBUG::2014-05-12 13:57:49,497::task::1185::TaskManager.Task::(prepare) Task=`ae5fa1ea-3add-42c7-9dea-c2ebab07e1bb`::finished: {'statuslist': [{'status': 0, 'id': '86f16d9a-82a9-4399-8380-823ccbd2ad6f'}]}
Thread-21::DEBUG::2014-05-12 13:57:49,497::task::595::TaskManager.Task::(_updateState) Task=`ae5fa1ea-3add-42c7-9dea-c2ebab07e1bb`::moving from state preparing -> state finished
Thread-21::DEBUG::2014-05-12 13:57:49,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-21::DEBUG::2014-05-12 13:57:49,497::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-21::DEBUG::2014-05-12 13:57:49,498::task::990::TaskManager.Task::(_decref) Task=`ae5fa1ea-3add-42c7-9dea-c2ebab07e1bb`::ref 0 aborting False
MainThread::DEBUG::2014-05-12 13:59:29,350::vdsm::55::vds::(sigtermHandler) Received signal 15
MainThread::INFO::2014-05-12 13:59:29,521::vmChannels::183::vds::(stop) VM channels listener was stopped.
MainThread::INFO::2014-05-12 13:59:29,522::momIF::84::MOM::(stop) Shutting down MOM
MainThread::DEBUG::2014-05-12 13:59:29,522::task::595::TaskManager.Task::(_updateState) Task=`c15962bb-9cf9-4880-b88f-fdb4b4718062`::moving from state init -> state preparing
MainThread::INFO::2014-05-12 13:59:29,522::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None)
Thread-11::DEBUG::2014-05-12 13:59:29,523::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped
MainThread::INFO::2014-05-12 13:59:29,849::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors
MainThread::DEBUG::2014-05-12 13:59:29,849::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks
MainThread::INFO::2014-05-12 13:59:29,850::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None
MainThread::DEBUG::2014-05-12 13:59:29,850::task::1185::TaskManager.Task::(prepare) Task=`c15962bb-9cf9-4880-b88f-fdb4b4718062`::finished: None
MainThread::DEBUG::2014-05-12 13:59:29,850::task::595::TaskManager.Task::(_updateState) Task=`c15962bb-9cf9-4880-b88f-fdb4b4718062`::moving from state preparing -> state finished
MainThread::DEBUG::2014-05-12 13:59:29,850::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
MainThread::DEBUG::2014-05-12 13:59:29,850::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
MainThread::DEBUG::2014-05-12 13:59:29,850::task::990::TaskManager.Task::(_decref) Task=`c15962bb-9cf9-4880-b88f-fdb4b4718062`::ref 0 aborting False
MainThread::INFO::2014-05-12 13:59:29,850::vdsm::125::vds::(run) VDSM main thread ended. Waiting for 15 other threads...
MainThread::INFO::2014-05-12 13:59:29,850::vdsm::129::vds::(run) <Thread(libvirtEventLoop, started daemon 140455161353984)>
MainThread::INFO::2014-05-12 13:59:29,850::vdsm::129::vds::(run) <WorkerThread(Thread-10, started daemon 140454599313152)>
MainThread::INFO::2014-05-12 13:59:29,850::vdsm::129::vds::(run) <WorkerThread(Thread-7, started daemon 140454624491264)>
MainThread::INFO::2014-05-12 13:59:29,850::vdsm::129::vds::(run) <WorkerThread(Thread-3, started daemon 140455136175872)>
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <WorkerThread(Thread-4, started daemon 140455127783168)>
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <WorkerThread(Thread-6, started daemon 140455110997760)>
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <WorkerThread(Thread-5, started daemon 140455119390464)>
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <PolicyEngine(PolicyEngine, started daemon 140454582527744)>
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <WorkerThread(Thread-1, started daemon 140455152961280)>
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <WorkerThread(Thread-9, started daemon 140454607705856)>
MainThread::INFO::2014-05-12 13:59:29,851::momIF::84::MOM::(stop) Shutting down MOM
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <MomThread(MOM, started 140454087620352)>
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <WorkerThread(Thread-2, started daemon 140455144568576)>
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <_MainThread(MainThread, started 140455280547648)>
MainThread::INFO::2014-05-12 13:59:29,851::vmChannels::183::vds::(stop) VM channels listener was stopped.
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <Listener(VM Channels Listener, started daemon 140454070834944)>
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <WorkerThread(Thread-8, started daemon 140454616098560)>
MainThread::INFO::2014-05-12 13:59:29,851::vdsm::129::vds::(run) <GuestManager(GuestManager, started daemon 140454030747392)>
VM Channels Listener::INFO::2014-05-12 13:59:30,036::vmChannels::178::vds::(run) VM channels listener thread has ended.
MainThread::INFO::2014-05-12 13:59:34,936::vdsm::119::vds::(run) (PID: 30694) I am the actual vdsm 4.14.6-0.fc19 xion2.smartcity.net (3.13.11-100.fc19.x86_64)
MainThread::DEBUG::2014-05-12 13:59:34,936::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage'
MainThread::DEBUG::2014-05-12 13:59:34,936::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0
MainThread::WARNING::2014-05-12 13:59:34,938::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
MainThread::DEBUG::2014-05-12 13:59:35,223::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
MainThread::DEBUG::2014-05-12 13:59:35,228::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
MainThread::DEBUG::2014-05-12 13:59:35,228::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None)
MainThread::DEBUG::2014-05-12 13:59:35,244::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
MainThread::DEBUG::2014-05-12 13:59:35,245::hsm::447::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
MainThread::DEBUG::2014-05-12 13:59:35,249::hsm::479::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
MainThread::DEBUG::2014-05-12 13:59:35,249::hsm::480::Storage.HSM::(__cleanStorageRepository) Mount list: []
MainThread::DEBUG::2014-05-12 13:59:35,249::hsm::482::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
MainThread::DEBUG::2014-05-12 13:59:35,250::hsm::525::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
storageRefresh::DEBUG::2014-05-12 13:59:35,250::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
MainThread::INFO::2014-05-12 13:59:35,251::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
storageRefresh::DEBUG::2014-05-12 13:59:35,251::misc::764::SamplingMethod::(__call__) Got in to sampling method
storageRefresh::DEBUG::2014-05-12 13:59:35,265::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
storageRefresh::DEBUG::2014-05-12 13:59:35,265::misc::764::SamplingMethod::(__call__) Got in to sampling method
storageRefresh::DEBUG::2014-05-12 13:59:35,267::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
storageRefresh::DEBUG::2014-05-12 13:59:35,267::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
MainThread::DEBUG::2014-05-12 13:59:35,280::task::595::TaskManager.Task::(_updateState) Task=`5f24e2f9-597c-4daa-b21e-ffc4c217ab42`::moving from state init -> state preparing
storageRefresh::DEBUG::2014-05-12 13:59:35,280::misc::772::SamplingMethod::(__call__) Returning last result
MainThread::INFO::2014-05-12 13:59:35,281::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x24003f8>>)
storageRefresh::DEBUG::2014-05-12 13:59:35,281::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
MainThread::INFO::2014-05-12 13:59:35,281::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
MainThread::DEBUG::2014-05-12 13:59:35,281::task::1185::TaskManager.Task::(prepare) Task=`5f24e2f9-597c-4daa-b21e-ffc4c217ab42`::finished: None
MainThread::DEBUG::2014-05-12 13:59:35,284::task::595::TaskManager.Task::(_updateState) Task=`5f24e2f9-597c-4daa-b21e-ffc4c217ab42`::moving from state preparing -> state finished
MainThread::DEBUG::2014-05-12 13:59:35,284::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
MainThread::DEBUG::2014-05-12 13:59:35,284::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
MainThread::DEBUG::2014-05-12 13:59:35,284::task::990::TaskManager.Task::(_decref) Task=`5f24e2f9-597c-4daa-b21e-ffc4c217ab42`::ref 0 aborting False
MainThread::INFO::2014-05-12 13:59:35,287::momIF::47::MOM::(__init__) Starting up MOM
MainThread::INFO::2014-05-12 13:59:35,290::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds.
VM Channels Listener::INFO::2014-05-12 13:59:35,295::vmChannels::170::vds::(run) Starting VM channels listener thread.
clientIFinit::DEBUG::2014-05-12 13:59:35,303::libvirtconnection::145::root::(get) trying to connect libvirt
MainThread::WARNING::2014-05-12 13:59:35,305::clientIF::181::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed.
storageRefresh::DEBUG::2014-05-12 13:59:35,346::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:59:35,349::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,352::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,355::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,357::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,360::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,363::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,365::misc::772::SamplingMethod::(__call__) Returning last result
storageRefresh::DEBUG::2014-05-12 13:59:35,369::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,382::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:59:35,406::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:59:35,408::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,410::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,412::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:59:35,428::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:59:35,429::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,431::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:59:35,446::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:59:35,447::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
storageRefresh::DEBUG::2014-05-12 13:59:35,450::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
storageRefresh::DEBUG::2014-05-12 13:59:35,469::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No device found for PV K7q1p6-VKiO-8wTa-YwId-ro1p-dTtc-hhqjLM.\n  No device found for PV 67xPP8-IeGp-99Wh-MrXq-ZkZH-3Y7z-Vl25Jj.\n  No device found for PV dtI7U2-UviQ-Ktpu-gT09-z7XG-4VVi-m2pvHj.\n  No volume groups found\n'; <rc> = 0
storageRefresh::DEBUG::2014-05-12 13:59:35,470::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
storageRefresh::WARNING::2014-05-12 13:59:35,471::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists
storageRefresh::DEBUG::2014-05-12 13:59:35,471::hsm::391::Storage.HSM::(storageRefresh) HSM is ready
Thread-13::DEBUG::2014-05-12 13:59:35,812::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {}
Thread-13::DEBUG::2014-05-12 13:59:35,831::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'XPS 8500', 'systemSerialNumber': 'FTQ2DX1', 'systemFamily': 'To be filled by O.E.M.', 'systemVersion': '', 'systemUUID': '4C4C4544-0054-5110-8032-C6C04F445831', 'systemManufacturer': 'Dell Inc.'}}
Thread-14::DEBUG::2014-05-12 13:59:35,840::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {}
Thread-14::DEBUG::2014-05-12 13:59:35,875::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None)
Thread-14::DEBUG::2014-05-12 13:59:35,879::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
Thread-14::ERROR::2014-05-12 13:59:35,882::BindingXMLRPC::1086::vds::(wrapper) unexpected error
Traceback (most recent call last):
  File "/usr/share/vdsm/BindingXMLRPC.py", line 1070, in wrapper
    res = f(*args, **kwargs)
  File "/usr/share/vdsm/BindingXMLRPC.py", line 393, in getCapabilities
    ret = api.getCapabilities()
  File "/usr/share/vdsm/API.py", line 1185, in getCapabilities
    c = caps.get()
  File "/usr/share/vdsm/caps.py", line 369, in get
    caps.update(netinfo.get())
  File "/usr/lib64/python2.7/site-packages/vdsm/netinfo.py", line 566, in get
    d['nics'][dev.name] = _nicinfo(dev.name, paddr)
  File "/usr/lib64/python2.7/site-packages/vdsm/netinfo.py", line 516, in _nicinfo
    info = _devinfo(nic)
  File "/usr/lib64/python2.7/site-packages/vdsm/netinfo.py", line 536, in _devinfo
    ipv4addr, ipv4netmask, ipv6addrs = getIpInfo(dev)
  File "/usr/lib64/python2.7/site-packages/vdsm/netinfo.py", line 317, in getIpInfo
    ipv6addrs = devInfo.get_ipv6_addresses()
SystemError: error return without exception set