Thread-21::DEBUG::2015-01-22 11:01:02,269::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:02,270::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:02,270::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:02,270::__init__::232::IOProcess::(_processLogs) (464655) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:02,270::__init__::232::IOProcess::(_processLogs) (464655) Queuing response Thread-63::DEBUG::2015-01-22 11:01:02,271::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:01:02,276::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000230612 s, 1.4 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:02,277::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:02,277::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:02,277::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:02,278::__init__::232::IOProcess::(_processLogs) (464656) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:02,278::__init__::232::IOProcess::(_processLogs) (464656) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:02,454::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:02,455::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403889::DEBUG::2015-01-22 11:01:02,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2b2e78-2890-49e2-b11f-5739cc440fc3`::moving from state init -> state preparing Thread-403889::INFO::2015-01-22 11:01:02,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403889::INFO::2015-01-22 11:01:02,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000230612', 'lastCheck': '0.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462303', 'lastCheck': '3.8', 'valid': True}} Thread-403889::DEBUG::2015-01-22 11:01:02,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c2b2e78-2890-49e2-b11f-5739cc440fc3`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000230612', 'lastCheck': '0.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462303', 'lastCheck': '3.8', 'valid': True}} Thread-403889::DEBUG::2015-01-22 11:01:02,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2b2e78-2890-49e2-b11f-5739cc440fc3`::moving from state preparing -> state finished Thread-403889::DEBUG::2015-01-22 11:01:02,458::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403889::DEBUG::2015-01-22 11:01:02,458::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403889::DEBUG::2015-01-22 11:01:02,458::task::993::Storage.TaskManager.Task::(_decref) Task=`9c2b2e78-2890-49e2-b11f-5739cc440fc3`::ref 0 aborting False Thread-403889::ERROR::2015-01-22 11:01:02,459::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403889::DEBUG::2015-01-22 11:01:02,461::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:02,468::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:02,469::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403890::DEBUG::2015-01-22 11:01:02,470::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403890::DEBUG::2015-01-22 11:01:02,471::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:04,825::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:04,826::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:04,845::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:05,527::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:05,528::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403891::DEBUG::2015-01-22 11:01:05,530::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:05,530::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:05,531::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403892::DEBUG::2015-01-22 11:01:05,532::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403892::DEBUG::2015-01-22 11:01:05,533::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:01:07,448::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:08,565::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:08,566::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403893::DEBUG::2015-01-22 11:01:08,567::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:08,569::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:08,570::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403894::DEBUG::2015-01-22 11:01:08,572::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403894::DEBUG::2015-01-22 11:01:08,573::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:01:08,676::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:08,676::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:08,676::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:08,676::__init__::232::IOProcess::(_processLogs) (464657) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:08,678::__init__::232::IOProcess::(_processLogs) (464657) Queuing response Thread-64::DEBUG::2015-01-22 11:01:08,678::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:01:08,688::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00048818 s, 950 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:08,689::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:08,689::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:08,689::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:08,689::__init__::232::IOProcess::(_processLogs) (464658) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:08,689::__init__::232::IOProcess::(_processLogs) (464658) Queuing response Thread-21::DEBUG::2015-01-22 11:01:08,690::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:08,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:08,691::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:08,691::__init__::232::IOProcess::(_processLogs) (464659) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:08,692::__init__::232::IOProcess::(_processLogs) (464659) Queuing response Thread-21::DEBUG::2015-01-22 11:01:08,693::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:08,693::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:08,693::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:08,693::__init__::232::IOProcess::(_processLogs) (464660) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:08,693::__init__::232::IOProcess::(_processLogs) (464660) Queuing response Thread-21::DEBUG::2015-01-22 11:01:08,694::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:08,694::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:08,694::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:08,694::__init__::232::IOProcess::(_processLogs) (464661) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:08,695::__init__::232::IOProcess::(_processLogs) (464661) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:09,851::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:09,852::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:09,864::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:11,603::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:11,604::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403895::DEBUG::2015-01-22 11:01:11,606::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:11,607::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:11,609::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403896::DEBUG::2015-01-22 11:01:11,610::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403896::DEBUG::2015-01-22 11:01:11,611::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:01:12,279::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:12,279::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:12,280::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:12,280::__init__::232::IOProcess::(_processLogs) (464662) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:12,280::__init__::232::IOProcess::(_processLogs) (464662) Queuing response Thread-63::DEBUG::2015-01-22 11:01:12,281::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:01:12,288::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000330835 s, 973 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:12,289::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:12,290::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:12,290::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:12,290::__init__::232::IOProcess::(_processLogs) (464663) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:12,290::__init__::232::IOProcess::(_processLogs) (464663) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:14,638::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:14,640::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403897::DEBUG::2015-01-22 11:01:14,643::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:14,644::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:14,645::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403898::DEBUG::2015-01-22 11:01:14,647::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403898::DEBUG::2015-01-22 11:01:14,648::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:14,870::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:14,870::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:14,874::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:17,678::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:17,681::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403899::DEBUG::2015-01-22 11:01:17,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`d235b3f5-86b8-4521-8a76-7f421160ca52`::moving from state init -> state preparing Thread-403899::INFO::2015-01-22 11:01:17,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403899::INFO::2015-01-22 11:01:17,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000330835', 'lastCheck': '5.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048818', 'lastCheck': '9.0', 'valid': True}} Thread-403899::DEBUG::2015-01-22 11:01:17,693::task::1191::Storage.TaskManager.Task::(prepare) Task=`d235b3f5-86b8-4521-8a76-7f421160ca52`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000330835', 'lastCheck': '5.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048818', 'lastCheck': '9.0', 'valid': True}} Thread-403899::DEBUG::2015-01-22 11:01:17,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`d235b3f5-86b8-4521-8a76-7f421160ca52`::moving from state preparing -> state finished Thread-403899::DEBUG::2015-01-22 11:01:17,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403899::DEBUG::2015-01-22 11:01:17,695::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403899::DEBUG::2015-01-22 11:01:17,696::task::993::Storage.TaskManager.Task::(_decref) Task=`d235b3f5-86b8-4521-8a76-7f421160ca52`::ref 0 aborting False Thread-403899::ERROR::2015-01-22 11:01:17,700::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403899::DEBUG::2015-01-22 11:01:17,732::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:17,742::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:17,744::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403900::DEBUG::2015-01-22 11:01:17,749::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403900::DEBUG::2015-01-22 11:01:17,757::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:01:18,697::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:18,697::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:18,697::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:18,697::__init__::232::IOProcess::(_processLogs) (464664) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:18,698::__init__::232::IOProcess::(_processLogs) (464664) Queuing response Thread-64::DEBUG::2015-01-22 11:01:18,699::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:01:18,709::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00056658 s, 819 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:18,709::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:18,710::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:18,710::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:18,710::__init__::232::IOProcess::(_processLogs) (464665) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:18,710::__init__::232::IOProcess::(_processLogs) (464665) Queuing response Thread-21::DEBUG::2015-01-22 11:01:18,711::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:18,711::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:18,711::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:18,711::__init__::232::IOProcess::(_processLogs) (464666) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:18,712::__init__::232::IOProcess::(_processLogs) (464666) Queuing response Thread-21::DEBUG::2015-01-22 11:01:18,712::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:18,712::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:18,713::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:18,713::__init__::232::IOProcess::(_processLogs) (464667) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:18,713::__init__::232::IOProcess::(_processLogs) (464667) Queuing response Thread-21::DEBUG::2015-01-22 11:01:18,714::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:18,714::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:18,714::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:18,714::__init__::232::IOProcess::(_processLogs) (464668) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:18,715::__init__::232::IOProcess::(_processLogs) (464668) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:19,880::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:19,881::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:19,892::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:20,818::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:20,819::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403901::DEBUG::2015-01-22 11:01:20,822::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:20,823::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:20,824::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403902::DEBUG::2015-01-22 11:01:20,826::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403902::DEBUG::2015-01-22 11:01:20,827::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:01:22,292::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:22,292::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:22,292::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:22,292::__init__::232::IOProcess::(_processLogs) (464669) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:22,292::__init__::232::IOProcess::(_processLogs) (464669) Queuing response Thread-63::DEBUG::2015-01-22 11:01:22,293::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:01:22,301::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000244848 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:22,301::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:22,302::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:22,302::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:22,302::__init__::232::IOProcess::(_processLogs) (464670) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:22,302::__init__::232::IOProcess::(_processLogs) (464670) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:23,857::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:23,858::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403903::DEBUG::2015-01-22 11:01:23,861::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:23,862::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:23,863::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403904::DEBUG::2015-01-22 11:01:23,865::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403904::DEBUG::2015-01-22 11:01:23,865::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:24,898::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:24,899::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:24,906::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:26,894::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:26,895::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403905::DEBUG::2015-01-22 11:01:26,897::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:26,898::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:26,900::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403906::DEBUG::2015-01-22 11:01:26,901::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403906::DEBUG::2015-01-22 11:01:26,903::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:01:28,717::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:28,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:28,717::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:28,718::__init__::232::IOProcess::(_processLogs) (464671) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:28,719::__init__::232::IOProcess::(_processLogs) (464671) Queuing response Thread-64::DEBUG::2015-01-22 11:01:28,720::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:01:28,730::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000453579 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:28,731::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:28,731::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:28,731::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:28,731::__init__::232::IOProcess::(_processLogs) (464672) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:28,732::__init__::232::IOProcess::(_processLogs) (464672) Queuing response Thread-21::DEBUG::2015-01-22 11:01:28,733::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:28,733::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:28,733::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:28,734::__init__::232::IOProcess::(_processLogs) (464673) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:28,734::__init__::232::IOProcess::(_processLogs) (464673) Queuing response Thread-21::DEBUG::2015-01-22 11:01:28,735::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:28,735::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:28,735::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:28,735::__init__::232::IOProcess::(_processLogs) (464674) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:28,735::__init__::232::IOProcess::(_processLogs) (464674) Queuing response Thread-21::DEBUG::2015-01-22 11:01:28,736::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:28,736::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:28,736::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:28,736::__init__::232::IOProcess::(_processLogs) (464675) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:28,737::__init__::232::IOProcess::(_processLogs) (464675) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:29,912::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:29,913::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:29,920::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:29,930::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:29,931::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403907::DEBUG::2015-01-22 11:01:29,933::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:29,934::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:29,936::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403908::DEBUG::2015-01-22 11:01:29,937::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403908::DEBUG::2015-01-22 11:01:29,938::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:01:32,304::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:32,304::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:32,304::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:32,304::__init__::232::IOProcess::(_processLogs) (464676) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:32,304::__init__::232::IOProcess::(_processLogs) (464676) Queuing response Thread-63::DEBUG::2015-01-22 11:01:32,305::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:01:32,312::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000282172 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:32,313::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:32,314::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:32,314::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:32,314::__init__::232::IOProcess::(_processLogs) (464677) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:32,314::__init__::232::IOProcess::(_processLogs) (464677) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:32,966::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:32,967::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403909::DEBUG::2015-01-22 11:01:32,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`4de695a2-204e-4fb9-96b3-fe535bfda89a`::moving from state init -> state preparing Thread-403909::INFO::2015-01-22 11:01:32,970::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403909::INFO::2015-01-22 11:01:32,970::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000282172', 'lastCheck': '0.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453579', 'lastCheck': '4.2', 'valid': True}} Thread-403909::DEBUG::2015-01-22 11:01:32,971::task::1191::Storage.TaskManager.Task::(prepare) Task=`4de695a2-204e-4fb9-96b3-fe535bfda89a`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000282172', 'lastCheck': '0.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453579', 'lastCheck': '4.2', 'valid': True}} Thread-403909::DEBUG::2015-01-22 11:01:32,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`4de695a2-204e-4fb9-96b3-fe535bfda89a`::moving from state preparing -> state finished Thread-403909::DEBUG::2015-01-22 11:01:32,971::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403909::DEBUG::2015-01-22 11:01:32,971::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403909::DEBUG::2015-01-22 11:01:32,971::task::993::Storage.TaskManager.Task::(_decref) Task=`4de695a2-204e-4fb9-96b3-fe535bfda89a`::ref 0 aborting False Thread-403909::ERROR::2015-01-22 11:01:32,972::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403909::DEBUG::2015-01-22 11:01:32,975::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:32,983::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:32,984::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403910::DEBUG::2015-01-22 11:01:32,987::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403910::DEBUG::2015-01-22 11:01:32,987::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:34,926::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:34,927::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:34,938::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:36,054::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:36,055::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403911::DEBUG::2015-01-22 11:01:36,057::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:36,058::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:36,060::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403912::DEBUG::2015-01-22 11:01:36,061::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403912::DEBUG::2015-01-22 11:01:36,062::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:01:37,482::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:01:38,738::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:38,738::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:38,738::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:38,738::__init__::232::IOProcess::(_processLogs) (464678) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:38,740::__init__::232::IOProcess::(_processLogs) (464678) Queuing response Thread-64::DEBUG::2015-01-22 11:01:38,741::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:01:38,751::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000573437 s, 809 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:38,751::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:38,752::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:38,752::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:38,752::__init__::232::IOProcess::(_processLogs) (464679) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:38,752::__init__::232::IOProcess::(_processLogs) (464679) Queuing response Thread-21::DEBUG::2015-01-22 11:01:38,753::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:38,753::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:38,753::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:38,753::__init__::232::IOProcess::(_processLogs) (464680) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:38,754::__init__::232::IOProcess::(_processLogs) (464680) Queuing response Thread-21::DEBUG::2015-01-22 11:01:38,754::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:38,754::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:38,754::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:38,755::__init__::232::IOProcess::(_processLogs) (464681) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:38,755::__init__::232::IOProcess::(_processLogs) (464681) Queuing response Thread-21::DEBUG::2015-01-22 11:01:38,755::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:38,756::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:38,756::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:38,756::__init__::232::IOProcess::(_processLogs) (464682) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:38,756::__init__::232::IOProcess::(_processLogs) (464682) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:39,096::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:39,097::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403913::DEBUG::2015-01-22 11:01:39,099::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:39,100::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:39,102::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403914::DEBUG::2015-01-22 11:01:39,104::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403914::DEBUG::2015-01-22 11:01:39,104::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:39,945::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:39,945::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:39,956::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:42,135::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:42,136::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403915::DEBUG::2015-01-22 11:01:42,138::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:42,139::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:42,141::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403916::DEBUG::2015-01-22 11:01:42,142::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403916::DEBUG::2015-01-22 11:01:42,143::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:01:42,316::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:42,316::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:42,316::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:42,316::__init__::232::IOProcess::(_processLogs) (464683) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:42,317::__init__::232::IOProcess::(_processLogs) (464683) Queuing response Thread-63::DEBUG::2015-01-22 11:01:42,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:01:42,325::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000313194 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:42,326::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:42,326::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:42,326::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:42,326::__init__::232::IOProcess::(_processLogs) (464684) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:42,326::__init__::232::IOProcess::(_processLogs) (464684) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:44,962::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:44,963::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:44,970::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:45,169::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:45,171::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403917::DEBUG::2015-01-22 11:01:45,173::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:45,174::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:45,176::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403918::DEBUG::2015-01-22 11:01:45,177::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403918::DEBUG::2015-01-22 11:01:45,178::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:48,207::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:48,209::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403919::DEBUG::2015-01-22 11:01:48,217::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2ce014a-a56f-4419-9863-cbb1d232a85e`::moving from state init -> state preparing Thread-403919::INFO::2015-01-22 11:01:48,218::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403919::INFO::2015-01-22 11:01:48,220::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000313194', 'lastCheck': '5.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573437', 'lastCheck': '9.5', 'valid': True}} Thread-403919::DEBUG::2015-01-22 11:01:48,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2ce014a-a56f-4419-9863-cbb1d232a85e`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000313194', 'lastCheck': '5.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573437', 'lastCheck': '9.5', 'valid': True}} Thread-403919::DEBUG::2015-01-22 11:01:48,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2ce014a-a56f-4419-9863-cbb1d232a85e`::moving from state preparing -> state finished Thread-403919::DEBUG::2015-01-22 11:01:48,222::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403919::DEBUG::2015-01-22 11:01:48,222::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403919::DEBUG::2015-01-22 11:01:48,223::task::993::Storage.TaskManager.Task::(_decref) Task=`e2ce014a-a56f-4419-9863-cbb1d232a85e`::ref 0 aborting False Thread-403919::ERROR::2015-01-22 11:01:48,227::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403919::DEBUG::2015-01-22 11:01:48,256::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:48,266::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:48,268::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403920::DEBUG::2015-01-22 11:01:48,273::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403920::DEBUG::2015-01-22 11:01:48,280::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:01:48,757::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:48,758::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:48,758::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:48,758::__init__::232::IOProcess::(_processLogs) (464685) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:48,759::__init__::232::IOProcess::(_processLogs) (464685) Queuing response Thread-64::DEBUG::2015-01-22 11:01:48,760::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:01:48,770::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000463144 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:48,771::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:48,771::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:48,771::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:48,772::__init__::232::IOProcess::(_processLogs) (464686) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:48,772::__init__::232::IOProcess::(_processLogs) (464686) Queuing response Thread-21::DEBUG::2015-01-22 11:01:48,773::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:48,773::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:48,773::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:48,774::__init__::232::IOProcess::(_processLogs) (464687) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:48,774::__init__::232::IOProcess::(_processLogs) (464687) Queuing response Thread-21::DEBUG::2015-01-22 11:01:48,774::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:48,774::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:48,775::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:48,775::__init__::232::IOProcess::(_processLogs) (464688) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:48,775::__init__::232::IOProcess::(_processLogs) (464688) Queuing response Thread-21::DEBUG::2015-01-22 11:01:48,775::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:48,776::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:48,776::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:48,776::__init__::232::IOProcess::(_processLogs) (464689) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:48,776::__init__::232::IOProcess::(_processLogs) (464689) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:49,977::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:49,977::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:49,988::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:51,348::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:51,349::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403921::DEBUG::2015-01-22 11:01:51,351::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:51,353::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:51,354::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403922::DEBUG::2015-01-22 11:01:51,355::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403922::DEBUG::2015-01-22 11:01:51,356::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:01:52,328::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:52,328::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:52,328::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:52,328::__init__::232::IOProcess::(_processLogs) (464690) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:52,329::__init__::232::IOProcess::(_processLogs) (464690) Queuing response Thread-63::DEBUG::2015-01-22 11:01:52,329::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:01:52,338::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000267304 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:52,338::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:52,339::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:52,339::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:52,339::__init__::232::IOProcess::(_processLogs) (464691) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:52,339::__init__::232::IOProcess::(_processLogs) (464691) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:54,387::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:54,388::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403923::DEBUG::2015-01-22 11:01:54,391::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:54,392::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:54,393::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403924::DEBUG::2015-01-22 11:01:54,395::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403924::DEBUG::2015-01-22 11:01:54,396::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:01:54,995::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:54,995::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:01:55,002::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:57,425::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:57,426::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403925::DEBUG::2015-01-22 11:01:57,428::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:01:57,429::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:01:57,431::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403926::DEBUG::2015-01-22 11:01:57,432::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403926::DEBUG::2015-01-22 11:01:57,433::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:01:57,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f4e7ffa-53f4-4954-ad62-10353afdae99`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:01:57,627::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:01:57,628::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:57,628::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:57,628::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:57,628::__init__::232::IOProcess::(_processLogs) (464692) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:01:57,630::__init__::232::IOProcess::(_processLogs) (464692) Queuing response Thread-21::DEBUG::2015-01-22 11:01:57,632::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:57,632::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:57,632::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:57,632::__init__::232::IOProcess::(_processLogs) (464693) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:01:57,632::__init__::232::IOProcess::(_processLogs) (464693) Queuing response Thread-360::INFO::2015-01-22 11:01:57,633::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:01:57,633::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f4e7ffa-53f4-4954-ad62-10353afdae99`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:01:57,633::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f4e7ffa-53f4-4954-ad62-10353afdae99`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:01:57,633::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:01:57,633::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:01:57,634::task::993::Storage.TaskManager.Task::(_decref) Task=`7f4e7ffa-53f4-4954-ad62-10353afdae99`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:01:58,777::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:58,778::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:58,778::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:58,778::__init__::232::IOProcess::(_processLogs) (464694) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:58,779::__init__::232::IOProcess::(_processLogs) (464694) Queuing response Thread-64::DEBUG::2015-01-22 11:01:58,780::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:01:58,789::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000570594 s, 813 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:01:58,790::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:58,790::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:58,790::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:58,790::__init__::232::IOProcess::(_processLogs) (464695) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:01:58,790::__init__::232::IOProcess::(_processLogs) (464695) Queuing response Thread-21::DEBUG::2015-01-22 11:01:58,791::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:58,791::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:58,792::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:58,792::__init__::232::IOProcess::(_processLogs) (464696) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:58,792::__init__::232::IOProcess::(_processLogs) (464696) Queuing response Thread-21::DEBUG::2015-01-22 11:01:58,793::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:58,793::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:58,793::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:58,793::__init__::232::IOProcess::(_processLogs) (464697) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:58,794::__init__::232::IOProcess::(_processLogs) (464697) Queuing response Thread-21::DEBUG::2015-01-22 11:01:58,795::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:01:58,795::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:01:58,795::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:01:58,795::__init__::232::IOProcess::(_processLogs) (464698) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:01:58,795::__init__::232::IOProcess::(_processLogs) (464698) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:00,009::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:00,009::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:00,016::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:00,466::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:00,467::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403927::DEBUG::2015-01-22 11:02:00,469::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:00,470::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:00,472::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403928::DEBUG::2015-01-22 11:02:00,474::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403928::DEBUG::2015-01-22 11:02:00,475::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:02:02,341::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:02,341::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:02,341::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:02,341::__init__::232::IOProcess::(_processLogs) (464699) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:02,342::__init__::232::IOProcess::(_processLogs) (464699) Queuing response Thread-63::DEBUG::2015-01-22 11:02:02,342::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:02:02,350::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000305567 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:02,351::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:02,351::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:02,352::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:02,352::__init__::232::IOProcess::(_processLogs) (464700) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:02,352::__init__::232::IOProcess::(_processLogs) (464700) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:03,504::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:03,505::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403929::DEBUG::2015-01-22 11:02:03,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`b07ce120-b1a4-45d3-ab80-b0519f8411e4`::moving from state init -> state preparing Thread-403929::INFO::2015-01-22 11:02:03,508::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403929::INFO::2015-01-22 11:02:03,509::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000305567', 'lastCheck': '1.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570594', 'lastCheck': '4.7', 'valid': True}} Thread-403929::DEBUG::2015-01-22 11:02:03,509::task::1191::Storage.TaskManager.Task::(prepare) Task=`b07ce120-b1a4-45d3-ab80-b0519f8411e4`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000305567', 'lastCheck': '1.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570594', 'lastCheck': '4.7', 'valid': True}} Thread-403929::DEBUG::2015-01-22 11:02:03,509::task::595::Storage.TaskManager.Task::(_updateState) Task=`b07ce120-b1a4-45d3-ab80-b0519f8411e4`::moving from state preparing -> state finished Thread-403929::DEBUG::2015-01-22 11:02:03,509::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403929::DEBUG::2015-01-22 11:02:03,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403929::DEBUG::2015-01-22 11:02:03,509::task::993::Storage.TaskManager.Task::(_decref) Task=`b07ce120-b1a4-45d3-ab80-b0519f8411e4`::ref 0 aborting False Thread-403929::ERROR::2015-01-22 11:02:03,510::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403929::DEBUG::2015-01-22 11:02:03,513::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:03,521::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:03,522::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403930::DEBUG::2015-01-22 11:02:03,524::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403930::DEBUG::2015-01-22 11:02:03,525::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:05,023::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:05,023::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:05,030::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:06,589::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:06,590::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403931::DEBUG::2015-01-22 11:02:06,592::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:06,593::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:06,594::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403932::DEBUG::2015-01-22 11:02:06,596::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403932::DEBUG::2015-01-22 11:02:06,597::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:02:07,517::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:02:08,797::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:08,797::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:08,797::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:08,797::__init__::232::IOProcess::(_processLogs) (464701) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:08,799::__init__::232::IOProcess::(_processLogs) (464701) Queuing response Thread-64::DEBUG::2015-01-22 11:02:08,800::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:02:08,808::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000556872 s, 833 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:08,809::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:08,809::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:08,809::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:08,809::__init__::232::IOProcess::(_processLogs) (464702) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:08,809::__init__::232::IOProcess::(_processLogs) (464702) Queuing response Thread-21::DEBUG::2015-01-22 11:02:08,810::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:08,810::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:08,811::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:08,811::__init__::232::IOProcess::(_processLogs) (464703) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:08,811::__init__::232::IOProcess::(_processLogs) (464703) Queuing response Thread-21::DEBUG::2015-01-22 11:02:08,811::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:08,812::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:08,812::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:08,812::__init__::232::IOProcess::(_processLogs) (464704) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:08,812::__init__::232::IOProcess::(_processLogs) (464704) Queuing response Thread-21::DEBUG::2015-01-22 11:02:08,813::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:08,813::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:08,813::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:08,813::__init__::232::IOProcess::(_processLogs) (464705) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:08,813::__init__::232::IOProcess::(_processLogs) (464705) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:09,626::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:09,628::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403933::DEBUG::2015-01-22 11:02:09,630::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:09,631::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:09,632::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403934::DEBUG::2015-01-22 11:02:09,634::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403934::DEBUG::2015-01-22 11:02:09,635::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:10,036::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:10,037::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:10,045::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:02:12,354::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:12,354::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:12,354::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:12,354::__init__::232::IOProcess::(_processLogs) (464706) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:12,354::__init__::232::IOProcess::(_processLogs) (464706) Queuing response Thread-63::DEBUG::2015-01-22 11:02:12,355::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:02:12,363::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000259741 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:12,364::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:12,364::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:12,365::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:12,365::__init__::232::IOProcess::(_processLogs) (464707) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:12,365::__init__::232::IOProcess::(_processLogs) (464707) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:12,665::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:12,667::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403935::DEBUG::2015-01-22 11:02:12,670::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:12,672::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:12,673::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403936::DEBUG::2015-01-22 11:02:12,676::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403936::DEBUG::2015-01-22 11:02:12,676::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:15,052::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:15,052::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:15,058::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:15,707::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:15,708::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403937::DEBUG::2015-01-22 11:02:15,711::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:15,712::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:15,713::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403938::DEBUG::2015-01-22 11:02:15,715::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403938::DEBUG::2015-01-22 11:02:15,716::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:18,744::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:18,745::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403939::DEBUG::2015-01-22 11:02:18,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f1346aa-fb98-4560-848f-53139fdb3e9b`::moving from state init -> state preparing Thread-403939::INFO::2015-01-22 11:02:18,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403939::INFO::2015-01-22 11:02:18,748::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259741', 'lastCheck': '6.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556872', 'lastCheck': '9.9', 'valid': True}} Thread-403939::DEBUG::2015-01-22 11:02:18,748::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f1346aa-fb98-4560-848f-53139fdb3e9b`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259741', 'lastCheck': '6.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556872', 'lastCheck': '9.9', 'valid': True}} Thread-403939::DEBUG::2015-01-22 11:02:18,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f1346aa-fb98-4560-848f-53139fdb3e9b`::moving from state preparing -> state finished Thread-403939::DEBUG::2015-01-22 11:02:18,748::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403939::DEBUG::2015-01-22 11:02:18,748::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403939::DEBUG::2015-01-22 11:02:18,749::task::993::Storage.TaskManager.Task::(_decref) Task=`0f1346aa-fb98-4560-848f-53139fdb3e9b`::ref 0 aborting False Thread-403939::ERROR::2015-01-22 11:02:18,749::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403939::DEBUG::2015-01-22 11:02:18,752::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:18,761::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:18,762::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403940::DEBUG::2015-01-22 11:02:18,763::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403940::DEBUG::2015-01-22 11:02:18,764::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:02:18,814::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:18,815::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:18,815::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:18,815::__init__::232::IOProcess::(_processLogs) (464708) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:18,817::__init__::232::IOProcess::(_processLogs) (464708) Queuing response Thread-64::DEBUG::2015-01-22 11:02:18,818::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:02:18,828::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00048515 s, 956 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:18,829::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:18,829::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:18,829::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:18,829::__init__::232::IOProcess::(_processLogs) (464709) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:18,829::__init__::232::IOProcess::(_processLogs) (464709) Queuing response Thread-21::DEBUG::2015-01-22 11:02:18,830::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:18,830::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:18,831::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:18,831::__init__::232::IOProcess::(_processLogs) (464710) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:18,831::__init__::232::IOProcess::(_processLogs) (464710) Queuing response Thread-21::DEBUG::2015-01-22 11:02:18,832::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:18,832::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:18,832::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:18,832::__init__::232::IOProcess::(_processLogs) (464711) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:18,832::__init__::232::IOProcess::(_processLogs) (464711) Queuing response Thread-21::DEBUG::2015-01-22 11:02:18,833::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:18,833::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:18,833::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:18,833::__init__::232::IOProcess::(_processLogs) (464712) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:18,833::__init__::232::IOProcess::(_processLogs) (464712) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:20,065::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:20,065::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:20,076::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:21,830::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:21,831::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403941::DEBUG::2015-01-22 11:02:21,835::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:21,836::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:21,837::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403942::DEBUG::2015-01-22 11:02:21,839::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403942::DEBUG::2015-01-22 11:02:21,840::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:02:22,367::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:22,367::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:22,367::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:22,367::__init__::232::IOProcess::(_processLogs) (464713) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:22,367::__init__::232::IOProcess::(_processLogs) (464713) Queuing response Thread-63::DEBUG::2015-01-22 11:02:22,368::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:02:22,375::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000246203 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:22,376::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:22,376::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:22,376::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:22,376::__init__::232::IOProcess::(_processLogs) (464714) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:22,376::__init__::232::IOProcess::(_processLogs) (464714) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:24,874::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:24,875::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403943::DEBUG::2015-01-22 11:02:24,877::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:24,878::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:24,880::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403944::DEBUG::2015-01-22 11:02:24,881::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403944::DEBUG::2015-01-22 11:02:24,882::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:25,083::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:25,083::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:25,090::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:27,908::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:27,909::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403945::DEBUG::2015-01-22 11:02:27,912::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:27,913::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:27,914::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403946::DEBUG::2015-01-22 11:02:27,915::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403946::DEBUG::2015-01-22 11:02:27,916::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:02:28,835::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:28,835::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:28,835::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:28,835::__init__::232::IOProcess::(_processLogs) (464715) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:28,837::__init__::232::IOProcess::(_processLogs) (464715) Queuing response Thread-64::DEBUG::2015-01-22 11:02:28,837::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:02:28,847::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000565466 s, 821 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:28,848::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:28,848::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:28,848::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:28,848::__init__::232::IOProcess::(_processLogs) (464716) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:28,848::__init__::232::IOProcess::(_processLogs) (464716) Queuing response Thread-21::DEBUG::2015-01-22 11:02:28,849::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:28,849::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:28,849::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:28,849::__init__::232::IOProcess::(_processLogs) (464717) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:28,850::__init__::232::IOProcess::(_processLogs) (464717) Queuing response Thread-21::DEBUG::2015-01-22 11:02:28,850::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:28,850::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:28,851::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:28,851::__init__::232::IOProcess::(_processLogs) (464718) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:28,851::__init__::232::IOProcess::(_processLogs) (464718) Queuing response Thread-21::DEBUG::2015-01-22 11:02:28,852::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:28,852::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:28,852::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:28,853::__init__::232::IOProcess::(_processLogs) (464719) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:28,853::__init__::232::IOProcess::(_processLogs) (464719) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:30,097::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:30,097::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:30,104::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:30,946::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:30,947::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403947::DEBUG::2015-01-22 11:02:30,950::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:30,951::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:30,952::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403948::DEBUG::2015-01-22 11:02:30,954::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403948::DEBUG::2015-01-22 11:02:30,955::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:02:32,378::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:32,378::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:32,378::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:32,378::__init__::232::IOProcess::(_processLogs) (464720) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:32,379::__init__::232::IOProcess::(_processLogs) (464720) Queuing response Thread-63::DEBUG::2015-01-22 11:02:32,379::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:02:32,386::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000276544 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:32,387::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:32,388::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:32,388::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:32,388::__init__::232::IOProcess::(_processLogs) (464721) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:32,388::__init__::232::IOProcess::(_processLogs) (464721) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:33,982::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:33,983::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403949::DEBUG::2015-01-22 11:02:33,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`000b389d-1e74-4b52-aebe-9a93400d3ea6`::moving from state init -> state preparing Thread-403949::INFO::2015-01-22 11:02:33,987::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403949::INFO::2015-01-22 11:02:33,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276544', 'lastCheck': '1.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565466', 'lastCheck': '5.1', 'valid': True}} Thread-403949::DEBUG::2015-01-22 11:02:33,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`000b389d-1e74-4b52-aebe-9a93400d3ea6`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276544', 'lastCheck': '1.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565466', 'lastCheck': '5.1', 'valid': True}} Thread-403949::DEBUG::2015-01-22 11:02:33,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`000b389d-1e74-4b52-aebe-9a93400d3ea6`::moving from state preparing -> state finished Thread-403949::DEBUG::2015-01-22 11:02:33,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403949::DEBUG::2015-01-22 11:02:33,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403949::DEBUG::2015-01-22 11:02:33,988::task::993::Storage.TaskManager.Task::(_decref) Task=`000b389d-1e74-4b52-aebe-9a93400d3ea6`::ref 0 aborting False Thread-403949::ERROR::2015-01-22 11:02:33,989::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403949::DEBUG::2015-01-22 11:02:33,991::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:34,000::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:34,001::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403950::DEBUG::2015-01-22 11:02:34,003::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403950::DEBUG::2015-01-22 11:02:34,004::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:35,110::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:35,111::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:35,111::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:37,079::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:37,080::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403951::DEBUG::2015-01-22 11:02:37,083::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:37,084::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:37,085::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403952::DEBUG::2015-01-22 11:02:37,087::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403952::DEBUG::2015-01-22 11:02:37,088::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:02:37,552::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:02:38,854::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:38,854::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:38,855::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:38,855::__init__::232::IOProcess::(_processLogs) (464722) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:38,856::__init__::232::IOProcess::(_processLogs) (464722) Queuing response Thread-64::DEBUG::2015-01-22 11:02:38,857::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:02:38,866::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000447122 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:38,867::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:38,868::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:38,868::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:38,868::__init__::232::IOProcess::(_processLogs) (464723) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:38,868::__init__::232::IOProcess::(_processLogs) (464723) Queuing response Thread-21::DEBUG::2015-01-22 11:02:38,869::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:38,869::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:38,870::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:38,870::__init__::232::IOProcess::(_processLogs) (464724) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:38,870::__init__::232::IOProcess::(_processLogs) (464724) Queuing response Thread-21::DEBUG::2015-01-22 11:02:38,870::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:38,871::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:38,871::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:38,871::__init__::232::IOProcess::(_processLogs) (464725) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:38,872::__init__::232::IOProcess::(_processLogs) (464725) Queuing response Thread-21::DEBUG::2015-01-22 11:02:38,872::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:38,872::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:38,873::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:38,873::__init__::232::IOProcess::(_processLogs) (464726) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:38,873::__init__::232::IOProcess::(_processLogs) (464726) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:40,118::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:40,118::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:40,121::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message GuestMonitor-Sql::DEBUG::2015-01-22 11:02:40,128::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpcServer::DEBUG::2015-01-22 11:02:40,129::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403953::DEBUG::2015-01-22 11:02:40,134::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:40,135::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:40,136::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403954::DEBUG::2015-01-22 11:02:40,138::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403954::DEBUG::2015-01-22 11:02:40,138::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:02:42,390::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:42,390::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:42,390::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:42,390::__init__::232::IOProcess::(_processLogs) (464727) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:42,390::__init__::232::IOProcess::(_processLogs) (464727) Queuing response Thread-63::DEBUG::2015-01-22 11:02:42,391::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:02:42,399::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000322423 s, 999 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:42,400::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:42,400::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:42,400::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:42,400::__init__::232::IOProcess::(_processLogs) (464728) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:42,400::__init__::232::IOProcess::(_processLogs) (464728) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:43,167::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:43,168::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403955::DEBUG::2015-01-22 11:02:43,171::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:43,172::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:43,173::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403956::DEBUG::2015-01-22 11:02:43,175::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403956::DEBUG::2015-01-22 11:02:43,176::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:45,139::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:45,140::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:45,147::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:46,206::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:46,208::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403957::DEBUG::2015-01-22 11:02:46,212::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:46,213::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:46,214::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403958::DEBUG::2015-01-22 11:02:46,216::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403958::DEBUG::2015-01-22 11:02:46,217::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:02:48,875::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:48,875::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:48,875::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:48,875::__init__::232::IOProcess::(_processLogs) (464729) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:48,876::__init__::232::IOProcess::(_processLogs) (464729) Queuing response Thread-64::DEBUG::2015-01-22 11:02:48,877::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:02:48,887::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000488227 s, 950 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:48,888::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:48,888::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:48,888::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:48,889::__init__::232::IOProcess::(_processLogs) (464730) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:48,889::__init__::232::IOProcess::(_processLogs) (464730) Queuing response Thread-21::DEBUG::2015-01-22 11:02:48,890::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:48,890::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:48,890::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:48,890::__init__::232::IOProcess::(_processLogs) (464731) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:48,890::__init__::232::IOProcess::(_processLogs) (464731) Queuing response Thread-21::DEBUG::2015-01-22 11:02:48,891::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:48,891::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:48,891::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:48,891::__init__::232::IOProcess::(_processLogs) (464732) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:48,892::__init__::232::IOProcess::(_processLogs) (464732) Queuing response Thread-21::DEBUG::2015-01-22 11:02:48,893::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:48,893::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:48,893::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:48,893::__init__::232::IOProcess::(_processLogs) (464733) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:48,893::__init__::232::IOProcess::(_processLogs) (464733) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:49,247::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:49,248::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403959::DEBUG::2015-01-22 11:02:49,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`072c4029-4162-45a6-ad85-cef1da449a07`::moving from state init -> state preparing Thread-403959::INFO::2015-01-22 11:02:49,251::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403959::INFO::2015-01-22 11:02:49,252::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322423', 'lastCheck': '6.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488227', 'lastCheck': '0.4', 'valid': True}} Thread-403959::DEBUG::2015-01-22 11:02:49,252::task::1191::Storage.TaskManager.Task::(prepare) Task=`072c4029-4162-45a6-ad85-cef1da449a07`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322423', 'lastCheck': '6.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488227', 'lastCheck': '0.4', 'valid': True}} Thread-403959::DEBUG::2015-01-22 11:02:49,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`072c4029-4162-45a6-ad85-cef1da449a07`::moving from state preparing -> state finished Thread-403959::DEBUG::2015-01-22 11:02:49,252::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403959::DEBUG::2015-01-22 11:02:49,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403959::DEBUG::2015-01-22 11:02:49,252::task::993::Storage.TaskManager.Task::(_decref) Task=`072c4029-4162-45a6-ad85-cef1da449a07`::ref 0 aborting False Thread-403959::ERROR::2015-01-22 11:02:49,253::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403959::DEBUG::2015-01-22 11:02:49,256::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:49,265::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:49,266::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403960::DEBUG::2015-01-22 11:02:49,268::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403960::DEBUG::2015-01-22 11:02:49,268::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:50,153::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:50,153::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:50,165::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:52,323::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:52,324::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403961::DEBUG::2015-01-22 11:02:52,326::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:52,327::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:52,329::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403962::DEBUG::2015-01-22 11:02:52,330::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403962::DEBUG::2015-01-22 11:02:52,331::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:02:52,402::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:52,402::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:52,402::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:52,402::__init__::232::IOProcess::(_processLogs) (464734) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:52,403::__init__::232::IOProcess::(_processLogs) (464734) Queuing response Thread-63::DEBUG::2015-01-22 11:02:52,403::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:02:52,410::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000255732 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:52,411::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:52,411::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:52,411::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:52,411::__init__::232::IOProcess::(_processLogs) (464735) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:52,411::__init__::232::IOProcess::(_processLogs) (464735) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:02:55,171::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:55,171::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:02:55,179::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:55,363::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:55,364::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403963::DEBUG::2015-01-22 11:02:55,366::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:55,367::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:55,369::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403964::DEBUG::2015-01-22 11:02:55,370::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403964::DEBUG::2015-01-22 11:02:55,371::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:02:57,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2bcd727-f9f8-41b7-8b01-1228818a432d`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:02:57,716::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:02:57,717::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:57,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:57,717::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:57,717::__init__::232::IOProcess::(_processLogs) (464736) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:02:57,720::__init__::232::IOProcess::(_processLogs) (464736) Queuing response Thread-21::DEBUG::2015-01-22 11:02:57,721::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:57,721::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:57,721::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:57,721::__init__::232::IOProcess::(_processLogs) (464737) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:02:57,721::__init__::232::IOProcess::(_processLogs) (464737) Queuing response Thread-360::INFO::2015-01-22 11:02:57,722::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:02:57,722::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2bcd727-f9f8-41b7-8b01-1228818a432d`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:02:57,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2bcd727-f9f8-41b7-8b01-1228818a432d`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:02:57,722::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:02:57,723::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:02:57,723::task::993::Storage.TaskManager.Task::(_decref) Task=`e2bcd727-f9f8-41b7-8b01-1228818a432d`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:58,401::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:58,402::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403965::DEBUG::2015-01-22 11:02:58,404::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:02:58,405::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:02:58,406::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403966::DEBUG::2015-01-22 11:02:58,408::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403966::DEBUG::2015-01-22 11:02:58,409::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:02:58,895::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:58,895::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:58,895::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:58,895::__init__::232::IOProcess::(_processLogs) (464738) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:58,897::__init__::232::IOProcess::(_processLogs) (464738) Queuing response Thread-64::DEBUG::2015-01-22 11:02:58,898::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:02:58,908::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000455361 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:02:58,909::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:58,909::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:58,910::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:58,910::__init__::232::IOProcess::(_processLogs) (464739) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:02:58,910::__init__::232::IOProcess::(_processLogs) (464739) Queuing response Thread-21::DEBUG::2015-01-22 11:02:58,911::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:58,911::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:58,911::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:58,911::__init__::232::IOProcess::(_processLogs) (464740) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:58,912::__init__::232::IOProcess::(_processLogs) (464740) Queuing response Thread-21::DEBUG::2015-01-22 11:02:58,913::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:58,913::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:58,913::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:58,913::__init__::232::IOProcess::(_processLogs) (464741) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:58,913::__init__::232::IOProcess::(_processLogs) (464741) Queuing response Thread-21::DEBUG::2015-01-22 11:02:58,914::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:02:58,914::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:02:58,914::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:02:58,914::__init__::232::IOProcess::(_processLogs) (464742) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:02:58,915::__init__::232::IOProcess::(_processLogs) (464742) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:00,185::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:00,186::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:00,189::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:01,437::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:01,438::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403967::DEBUG::2015-01-22 11:03:01,441::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:01,442::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:01,444::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403968::DEBUG::2015-01-22 11:03:01,445::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403968::DEBUG::2015-01-22 11:03:01,446::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:03:02,413::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:02,414::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:02,414::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:02,414::__init__::232::IOProcess::(_processLogs) (464743) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:02,414::__init__::232::IOProcess::(_processLogs) (464743) Queuing response Thread-63::DEBUG::2015-01-22 11:03:02,415::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:03:02,422::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000262307 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:02,423::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:02,423::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:02,423::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:02,423::__init__::232::IOProcess::(_processLogs) (464744) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:02,423::__init__::232::IOProcess::(_processLogs) (464744) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:04,476::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:04,478::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403969::DEBUG::2015-01-22 11:03:04,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b2745d6-0405-4561-9e97-adc9e4f63807`::moving from state init -> state preparing Thread-403969::INFO::2015-01-22 11:03:04,481::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403969::INFO::2015-01-22 11:03:04,481::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262307', 'lastCheck': '2.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455361', 'lastCheck': '5.6', 'valid': True}} Thread-403969::DEBUG::2015-01-22 11:03:04,481::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b2745d6-0405-4561-9e97-adc9e4f63807`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262307', 'lastCheck': '2.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455361', 'lastCheck': '5.6', 'valid': True}} Thread-403969::DEBUG::2015-01-22 11:03:04,481::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b2745d6-0405-4561-9e97-adc9e4f63807`::moving from state preparing -> state finished Thread-403969::DEBUG::2015-01-22 11:03:04,481::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403969::DEBUG::2015-01-22 11:03:04,481::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403969::DEBUG::2015-01-22 11:03:04,482::task::993::Storage.TaskManager.Task::(_decref) Task=`8b2745d6-0405-4561-9e97-adc9e4f63807`::ref 0 aborting False Thread-403969::ERROR::2015-01-22 11:03:04,483::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403969::DEBUG::2015-01-22 11:03:04,485::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:04,494::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:04,495::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403970::DEBUG::2015-01-22 11:03:04,497::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403970::DEBUG::2015-01-22 11:03:04,498::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:05,195::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:05,196::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:05,207::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:07,561::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:07,562::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403971::DEBUG::2015-01-22 11:03:07,565::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:07,566::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:07,568::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403972::DEBUG::2015-01-22 11:03:07,569::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403972::DEBUG::2015-01-22 11:03:07,570::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:03:07,587::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:03:08,916::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:08,917::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:08,917::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:08,917::__init__::232::IOProcess::(_processLogs) (464745) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:08,918::__init__::232::IOProcess::(_processLogs) (464745) Queuing response Thread-64::DEBUG::2015-01-22 11:03:08,919::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:03:08,929::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000558559 s, 831 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:08,930::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:08,930::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:08,930::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:08,930::__init__::232::IOProcess::(_processLogs) (464746) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:08,930::__init__::232::IOProcess::(_processLogs) (464746) Queuing response Thread-21::DEBUG::2015-01-22 11:03:08,931::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:08,931::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:08,931::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:08,931::__init__::232::IOProcess::(_processLogs) (464747) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:08,932::__init__::232::IOProcess::(_processLogs) (464747) Queuing response Thread-21::DEBUG::2015-01-22 11:03:08,932::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:08,933::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:08,933::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:08,933::__init__::232::IOProcess::(_processLogs) (464748) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:08,933::__init__::232::IOProcess::(_processLogs) (464748) Queuing response Thread-21::DEBUG::2015-01-22 11:03:08,934::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:08,934::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:08,934::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:08,934::__init__::232::IOProcess::(_processLogs) (464749) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:08,934::__init__::232::IOProcess::(_processLogs) (464749) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:10,213::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:10,214::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:10,225::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:10,602::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:10,603::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403973::DEBUG::2015-01-22 11:03:10,605::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:10,606::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:10,608::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403974::DEBUG::2015-01-22 11:03:10,609::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403974::DEBUG::2015-01-22 11:03:10,610::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:03:12,425::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:12,425::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:12,425::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:12,425::__init__::232::IOProcess::(_processLogs) (464750) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:12,426::__init__::232::IOProcess::(_processLogs) (464750) Queuing response Thread-63::DEBUG::2015-01-22 11:03:12,426::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:03:12,434::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000328767 s, 979 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:12,435::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:12,435::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:12,435::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:12,435::__init__::232::IOProcess::(_processLogs) (464751) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:12,435::__init__::232::IOProcess::(_processLogs) (464751) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:13,638::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:13,640::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403975::DEBUG::2015-01-22 11:03:13,642::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:13,643::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:13,645::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403976::DEBUG::2015-01-22 11:03:13,647::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403976::DEBUG::2015-01-22 11:03:13,648::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:15,231::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:15,232::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:15,239::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:16,676::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:16,678::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403977::DEBUG::2015-01-22 11:03:16,682::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:16,683::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:16,685::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403978::DEBUG::2015-01-22 11:03:16,687::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403978::DEBUG::2015-01-22 11:03:16,688::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:03:18,936::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:18,936::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:18,936::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:18,936::__init__::232::IOProcess::(_processLogs) (464752) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:18,938::__init__::232::IOProcess::(_processLogs) (464752) Queuing response Thread-64::DEBUG::2015-01-22 11:03:18,939::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:03:18,948::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000563002 s, 824 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:18,949::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:18,949::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:18,949::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:18,950::__init__::232::IOProcess::(_processLogs) (464753) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:18,950::__init__::232::IOProcess::(_processLogs) (464753) Queuing response Thread-21::DEBUG::2015-01-22 11:03:18,951::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:18,951::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:18,951::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:18,951::__init__::232::IOProcess::(_processLogs) (464754) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:18,952::__init__::232::IOProcess::(_processLogs) (464754) Queuing response Thread-21::DEBUG::2015-01-22 11:03:18,953::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:18,953::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:18,953::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:18,953::__init__::232::IOProcess::(_processLogs) (464755) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:18,954::__init__::232::IOProcess::(_processLogs) (464755) Queuing response Thread-21::DEBUG::2015-01-22 11:03:18,954::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:18,954::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:18,954::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:18,954::__init__::232::IOProcess::(_processLogs) (464756) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:18,955::__init__::232::IOProcess::(_processLogs) (464756) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:19,714::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:19,716::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403979::DEBUG::2015-01-22 11:03:19,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`a894b13a-b58b-4ed4-a678-50e7df20f4aa`::moving from state init -> state preparing Thread-403979::INFO::2015-01-22 11:03:19,719::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403979::INFO::2015-01-22 11:03:19,719::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328767', 'lastCheck': '7.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563002', 'lastCheck': '0.8', 'valid': True}} Thread-403979::DEBUG::2015-01-22 11:03:19,719::task::1191::Storage.TaskManager.Task::(prepare) Task=`a894b13a-b58b-4ed4-a678-50e7df20f4aa`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328767', 'lastCheck': '7.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563002', 'lastCheck': '0.8', 'valid': True}} Thread-403979::DEBUG::2015-01-22 11:03:19,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`a894b13a-b58b-4ed4-a678-50e7df20f4aa`::moving from state preparing -> state finished Thread-403979::DEBUG::2015-01-22 11:03:19,719::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403979::DEBUG::2015-01-22 11:03:19,719::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403979::DEBUG::2015-01-22 11:03:19,720::task::993::Storage.TaskManager.Task::(_decref) Task=`a894b13a-b58b-4ed4-a678-50e7df20f4aa`::ref 0 aborting False Thread-403979::ERROR::2015-01-22 11:03:19,720::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403979::DEBUG::2015-01-22 11:03:19,723::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:19,730::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:19,732::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403980::DEBUG::2015-01-22 11:03:19,733::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403980::DEBUG::2015-01-22 11:03:19,734::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:20,245::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:20,245::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:20,257::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-63::DEBUG::2015-01-22 11:03:22,437::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d26c38f9-0719-457c-8ce0-a074d1eff534 Thread-21::DEBUG::2015-01-22 11:03:22,440::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:22,440::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:22,440::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:22,440::__init__::232::IOProcess::(_processLogs) (464757) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:03:22,440::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:22,440::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:22,440::__init__::232::IOProcess::(_processLogs) (464757) Queuing response Thread-21::DEBUG::2015-01-22 11:03:22,441::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:22,441::__init__::232::IOProcess::(_processLogs) (464758) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:03:22,444::__init__::232::IOProcess::(_processLogs) (464758) Queuing response Thread-63::DEBUG::2015-01-22 11:03:22,451::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534 Thread-21::DEBUG::2015-01-22 11:03:22,451::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:22,452::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:22,452::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:22,452::__init__::232::IOProcess::(_processLogs) (464759) Got request for method 'touch' Thread-21::DEBUG::2015-01-22 11:03:22,458::__init__::232::IOProcess::(_processLogs) (464759) Queuing response Thread-63::DEBUG::2015-01-22 11:03:22,458::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend Thread-21::DEBUG::2015-01-22 11:03:22,459::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:22,459::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:22,459::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:22,459::__init__::232::IOProcess::(_processLogs) (464760) Got request for method 'readfile' Thread-21::DEBUG::2015-01-22 11:03:22,459::__init__::232::IOProcess::(_processLogs) (464760) Queuing response Thread-63::DEBUG::2015-01-22 11:03:22,460::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISO', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=67c137fd-0cf2-463a-bc70-b427cc0a5da3', 'REMOTE_PATH=192.168.1.24:/Data/ISO', 'ROLE=Regular', 'SDUUID=d26c38f9-0719-457c-8ce0-a074d1eff534', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2e3c4b23cacb8bd1a5cc7cf85722fc990962eb40'] Thread-21::DEBUG::2015-01-22 11:03:22,460::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:22,461::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:22,461::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:22,461::__init__::232::IOProcess::(_processLogs) (464761) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:22,461::__init__::232::IOProcess::(_processLogs) (464761) Queuing response Thread-21::DEBUG::2015-01-22 11:03:22,462::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:22,462::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:22,462::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:22,462::__init__::232::IOProcess::(_processLogs) (464762) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:03:22,462::__init__::232::IOProcess::(_processLogs) (464762) Queuing response Thread-63::DEBUG::2015-01-22 11:03:22,462::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-63::INFO::2015-01-22 11:03:22,463::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d26c38f9-0719-457c-8ce0-a074d1eff534_imageNS already registered Thread-63::INFO::2015-01-22 11:03:22,463::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d26c38f9-0719-457c-8ce0-a074d1eff534_volumeNS already registered Thread-21::DEBUG::2015-01-22 11:03:22,463::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:22,463::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:22,464::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:22,464::__init__::232::IOProcess::(_processLogs) (464763) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:22,464::__init__::232::IOProcess::(_processLogs) (464763) Queuing response Thread-63::DEBUG::2015-01-22 11:03:22,464::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:03:22,471::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00028501 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:22,472::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:22,473::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:22,473::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:22,473::__init__::232::IOProcess::(_processLogs) (464764) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:22,473::__init__::232::IOProcess::(_processLogs) (464764) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:22,783::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:22,784::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403983::DEBUG::2015-01-22 11:03:22,787::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:22,788::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:22,789::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403984::DEBUG::2015-01-22 11:03:22,791::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403984::DEBUG::2015-01-22 11:03:22,792::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:25,263::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:25,264::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:25,271::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:25,824::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:25,825::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403985::DEBUG::2015-01-22 11:03:25,829::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:25,835::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:25,837::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403986::DEBUG::2015-01-22 11:03:25,840::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403986::DEBUG::2015-01-22 11:03:25,841::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:28,867::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:28,869::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403987::DEBUG::2015-01-22 11:03:28,871::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:28,872::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:28,874::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403988::DEBUG::2015-01-22 11:03:28,875::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403988::DEBUG::2015-01-22 11:03:28,876::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:03:28,957::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:28,957::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:28,957::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:28,957::__init__::232::IOProcess::(_processLogs) (464765) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:28,958::__init__::232::IOProcess::(_processLogs) (464765) Queuing response Thread-64::DEBUG::2015-01-22 11:03:28,959::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:03:28,969::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000462085 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:28,970::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:28,970::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:28,970::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:28,970::__init__::232::IOProcess::(_processLogs) (464766) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:28,970::__init__::232::IOProcess::(_processLogs) (464766) Queuing response Thread-21::DEBUG::2015-01-22 11:03:28,971::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:28,971::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:28,971::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:28,972::__init__::232::IOProcess::(_processLogs) (464767) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:28,972::__init__::232::IOProcess::(_processLogs) (464767) Queuing response Thread-21::DEBUG::2015-01-22 11:03:28,974::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:28,974::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:28,974::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:28,974::__init__::232::IOProcess::(_processLogs) (464768) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:28,974::__init__::232::IOProcess::(_processLogs) (464768) Queuing response Thread-21::DEBUG::2015-01-22 11:03:28,975::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:28,975::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:28,975::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:28,975::__init__::232::IOProcess::(_processLogs) (464769) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:28,976::__init__::232::IOProcess::(_processLogs) (464769) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:30,277::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:30,278::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:30,285::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:31,906::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:31,908::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403989::DEBUG::2015-01-22 11:03:31,911::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:31,912::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:31,914::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403990::DEBUG::2015-01-22 11:03:31,915::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403990::DEBUG::2015-01-22 11:03:31,916::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:03:32,475::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:32,475::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:32,475::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:32,475::__init__::232::IOProcess::(_processLogs) (464770) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:32,475::__init__::232::IOProcess::(_processLogs) (464770) Queuing response Thread-63::DEBUG::2015-01-22 11:03:32,476::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:03:32,483::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000291826 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:32,484::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:32,484::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:32,484::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:32,485::__init__::232::IOProcess::(_processLogs) (464771) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:32,485::__init__::232::IOProcess::(_processLogs) (464771) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:34,947::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:34,948::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403991::DEBUG::2015-01-22 11:03:34,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`73852597-3c52-4f87-a050-9363b84c9139`::moving from state init -> state preparing Thread-403991::INFO::2015-01-22 11:03:34,951::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-403991::INFO::2015-01-22 11:03:34,951::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291826', 'lastCheck': '2.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462085', 'lastCheck': '6.0', 'valid': True}} Thread-403991::DEBUG::2015-01-22 11:03:34,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`73852597-3c52-4f87-a050-9363b84c9139`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291826', 'lastCheck': '2.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462085', 'lastCheck': '6.0', 'valid': True}} Thread-403991::DEBUG::2015-01-22 11:03:34,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`73852597-3c52-4f87-a050-9363b84c9139`::moving from state preparing -> state finished Thread-403991::DEBUG::2015-01-22 11:03:34,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-403991::DEBUG::2015-01-22 11:03:34,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-403991::DEBUG::2015-01-22 11:03:34,952::task::993::Storage.TaskManager.Task::(_decref) Task=`73852597-3c52-4f87-a050-9363b84c9139`::ref 0 aborting False Thread-403991::ERROR::2015-01-22 11:03:34,953::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-403991::DEBUG::2015-01-22 11:03:34,955::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:34,963::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:34,964::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403992::DEBUG::2015-01-22 11:03:34,966::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403992::DEBUG::2015-01-22 11:03:34,967::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:35,291::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:35,292::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:35,303::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:03:37,620::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:38,023::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:38,024::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403993::DEBUG::2015-01-22 11:03:38,027::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:38,028::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:38,029::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403994::DEBUG::2015-01-22 11:03:38,031::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403994::DEBUG::2015-01-22 11:03:38,032::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:03:38,977::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:38,978::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:38,978::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:38,978::__init__::232::IOProcess::(_processLogs) (464772) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:38,979::__init__::232::IOProcess::(_processLogs) (464772) Queuing response Thread-64::DEBUG::2015-01-22 11:03:38,980::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:03:38,989::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000536475 s, 865 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:38,990::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:38,990::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:38,990::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:38,990::__init__::232::IOProcess::(_processLogs) (464773) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:38,991::__init__::232::IOProcess::(_processLogs) (464773) Queuing response Thread-21::DEBUG::2015-01-22 11:03:38,991::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:38,992::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:38,992::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:38,992::__init__::232::IOProcess::(_processLogs) (464774) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:38,992::__init__::232::IOProcess::(_processLogs) (464774) Queuing response Thread-21::DEBUG::2015-01-22 11:03:38,993::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:38,993::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:38,993::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:38,993::__init__::232::IOProcess::(_processLogs) (464775) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:38,994::__init__::232::IOProcess::(_processLogs) (464775) Queuing response Thread-21::DEBUG::2015-01-22 11:03:38,994::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:38,995::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:38,995::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:38,995::__init__::232::IOProcess::(_processLogs) (464776) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:38,995::__init__::232::IOProcess::(_processLogs) (464776) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:40,309::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:40,310::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:40,330::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:41,063::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:41,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403995::DEBUG::2015-01-22 11:03:41,067::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:41,068::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:41,069::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403996::DEBUG::2015-01-22 11:03:41,071::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403996::DEBUG::2015-01-22 11:03:41,072::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:03:42,486::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:42,487::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:42,487::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:42,487::__init__::232::IOProcess::(_processLogs) (464777) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:42,487::__init__::232::IOProcess::(_processLogs) (464777) Queuing response Thread-63::DEBUG::2015-01-22 11:03:42,488::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:03:42,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000310869 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:42,496::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:42,497::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:42,497::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:42,497::__init__::232::IOProcess::(_processLogs) (464778) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:42,497::__init__::232::IOProcess::(_processLogs) (464778) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:44,101::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:44,102::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403997::DEBUG::2015-01-22 11:03:44,104::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:44,106::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:44,107::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403998::DEBUG::2015-01-22 11:03:44,109::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-403998::DEBUG::2015-01-22 11:03:44,110::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:45,336::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:45,336::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:45,344::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:47,136::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:47,138::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-403999::DEBUG::2015-01-22 11:03:47,140::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:47,142::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:47,143::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404000::DEBUG::2015-01-22 11:03:47,145::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404000::DEBUG::2015-01-22 11:03:47,146::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:03:48,996::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:48,997::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:48,997::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:48,997::__init__::232::IOProcess::(_processLogs) (464779) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:48,998::__init__::232::IOProcess::(_processLogs) (464779) Queuing response Thread-64::DEBUG::2015-01-22 11:03:48,999::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:03:49,009::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000646592 s, 718 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:49,009::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:49,010::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:49,010::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:49,010::__init__::232::IOProcess::(_processLogs) (464780) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:49,010::__init__::232::IOProcess::(_processLogs) (464780) Queuing response Thread-21::DEBUG::2015-01-22 11:03:49,011::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:49,011::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:49,011::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:49,011::__init__::232::IOProcess::(_processLogs) (464781) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:49,012::__init__::232::IOProcess::(_processLogs) (464781) Queuing response Thread-21::DEBUG::2015-01-22 11:03:49,013::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:49,013::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:49,013::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:49,013::__init__::232::IOProcess::(_processLogs) (464782) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:49,014::__init__::232::IOProcess::(_processLogs) (464782) Queuing response Thread-21::DEBUG::2015-01-22 11:03:49,015::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:49,015::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:49,015::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:49,015::__init__::232::IOProcess::(_processLogs) (464783) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:49,016::__init__::232::IOProcess::(_processLogs) (464783) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:50,173::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:50,174::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404001::DEBUG::2015-01-22 11:03:50,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d859ea6-d8d7-482d-90bc-1746f1842235`::moving from state init -> state preparing Thread-404001::INFO::2015-01-22 11:03:50,177::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404001::INFO::2015-01-22 11:03:50,177::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000310869', 'lastCheck': '7.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646592', 'lastCheck': '1.2', 'valid': True}} Thread-404001::DEBUG::2015-01-22 11:03:50,177::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d859ea6-d8d7-482d-90bc-1746f1842235`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000310869', 'lastCheck': '7.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646592', 'lastCheck': '1.2', 'valid': True}} Thread-404001::DEBUG::2015-01-22 11:03:50,178::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d859ea6-d8d7-482d-90bc-1746f1842235`::moving from state preparing -> state finished Thread-404001::DEBUG::2015-01-22 11:03:50,178::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404001::DEBUG::2015-01-22 11:03:50,178::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404001::DEBUG::2015-01-22 11:03:50,178::task::993::Storage.TaskManager.Task::(_decref) Task=`6d859ea6-d8d7-482d-90bc-1746f1842235`::ref 0 aborting False Thread-404001::ERROR::2015-01-22 11:03:50,179::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404001::DEBUG::2015-01-22 11:03:50,181::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:50,188::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:50,189::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404002::DEBUG::2015-01-22 11:03:50,191::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404002::DEBUG::2015-01-22 11:03:50,192::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:50,350::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:50,350::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:50,358::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:03:52,499::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:52,499::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:52,499::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:52,499::__init__::232::IOProcess::(_processLogs) (464784) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:52,499::__init__::232::IOProcess::(_processLogs) (464784) Queuing response Thread-63::DEBUG::2015-01-22 11:03:52,500::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:03:52,507::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000318474 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:52,508::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:52,508::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:52,508::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:52,509::__init__::232::IOProcess::(_processLogs) (464785) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:52,509::__init__::232::IOProcess::(_processLogs) (464785) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:53,241::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:53,242::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404003::DEBUG::2015-01-22 11:03:53,245::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:53,246::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:53,247::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404004::DEBUG::2015-01-22 11:03:53,249::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404004::DEBUG::2015-01-22 11:03:53,250::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:03:55,364::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:55,364::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:03:55,372::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:56,279::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:56,281::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404005::DEBUG::2015-01-22 11:03:56,283::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:56,284::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:56,285::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404006::DEBUG::2015-01-22 11:03:56,287::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404006::DEBUG::2015-01-22 11:03:56,288::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:03:57,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`30d5f5e9-0450-48a7-99ba-d1a9660edbfe`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:03:57,803::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:03:57,804::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:57,804::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:57,804::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:57,804::__init__::232::IOProcess::(_processLogs) (464786) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:03:57,807::__init__::232::IOProcess::(_processLogs) (464786) Queuing response Thread-21::DEBUG::2015-01-22 11:03:57,808::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:57,808::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:57,808::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:57,808::__init__::232::IOProcess::(_processLogs) (464787) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:03:57,808::__init__::232::IOProcess::(_processLogs) (464787) Queuing response Thread-360::INFO::2015-01-22 11:03:57,809::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:03:57,809::task::1191::Storage.TaskManager.Task::(prepare) Task=`30d5f5e9-0450-48a7-99ba-d1a9660edbfe`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:03:57,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`30d5f5e9-0450-48a7-99ba-d1a9660edbfe`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:03:57,809::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:03:57,809::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:03:57,810::task::993::Storage.TaskManager.Task::(_decref) Task=`30d5f5e9-0450-48a7-99ba-d1a9660edbfe`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:03:59,017::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:59,017::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:59,017::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:59,017::__init__::232::IOProcess::(_processLogs) (464788) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:59,018::__init__::232::IOProcess::(_processLogs) (464788) Queuing response Thread-64::DEBUG::2015-01-22 11:03:59,019::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:03:59,029::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000550325 s, 843 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:03:59,030::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:59,030::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:59,030::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:59,030::__init__::232::IOProcess::(_processLogs) (464789) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:03:59,030::__init__::232::IOProcess::(_processLogs) (464789) Queuing response Thread-21::DEBUG::2015-01-22 11:03:59,031::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:59,032::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:59,032::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:59,032::__init__::232::IOProcess::(_processLogs) (464790) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:59,032::__init__::232::IOProcess::(_processLogs) (464790) Queuing response Thread-21::DEBUG::2015-01-22 11:03:59,033::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:59,033::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:59,033::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:59,033::__init__::232::IOProcess::(_processLogs) (464791) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:59,034::__init__::232::IOProcess::(_processLogs) (464791) Queuing response Thread-21::DEBUG::2015-01-22 11:03:59,035::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:03:59,035::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:03:59,035::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:03:59,035::__init__::232::IOProcess::(_processLogs) (464792) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:03:59,035::__init__::232::IOProcess::(_processLogs) (464792) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:59,314::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:59,315::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404007::DEBUG::2015-01-22 11:03:59,317::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:03:59,318::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:03:59,319::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404008::DEBUG::2015-01-22 11:03:59,321::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404008::DEBUG::2015-01-22 11:03:59,322::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:00,378::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:00,379::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:00,386::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:02,350::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:02,352::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404009::DEBUG::2015-01-22 11:04:02,354::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:02,355::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:02,356::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404010::DEBUG::2015-01-22 11:04:02,358::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404010::DEBUG::2015-01-22 11:04:02,359::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:04:02,511::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:02,511::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:02,511::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:02,511::__init__::232::IOProcess::(_processLogs) (464793) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:02,511::__init__::232::IOProcess::(_processLogs) (464793) Queuing response Thread-63::DEBUG::2015-01-22 11:04:02,512::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:04:02,519::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000264243 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:02,519::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:02,520::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:02,520::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:02,520::__init__::232::IOProcess::(_processLogs) (464794) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:02,520::__init__::232::IOProcess::(_processLogs) (464794) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:05,388::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:05,389::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404011::DEBUG::2015-01-22 11:04:05,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`03012c4c-6499-4038-8d06-6c4026ecce42`::moving from state init -> state preparing GuestMonitor-Sql::DEBUG::2015-01-22 11:04:05,394::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404011::INFO::2015-01-22 11:04:05,397::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404011::INFO::2015-01-22 11:04:05,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264243', 'lastCheck': '2.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550325', 'lastCheck': '6.4', 'valid': True}} GuestMonitor-Sql::DEBUG::2015-01-22 11:04:05,401::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404011::DEBUG::2015-01-22 11:04:05,401::task::1191::Storage.TaskManager.Task::(prepare) Task=`03012c4c-6499-4038-8d06-6c4026ecce42`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264243', 'lastCheck': '2.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550325', 'lastCheck': '6.4', 'valid': True}} Thread-404011::DEBUG::2015-01-22 11:04:05,402::task::595::Storage.TaskManager.Task::(_updateState) Task=`03012c4c-6499-4038-8d06-6c4026ecce42`::moving from state preparing -> state finished Thread-404011::DEBUG::2015-01-22 11:04:05,403::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404011::DEBUG::2015-01-22 11:04:05,404::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404011::DEBUG::2015-01-22 11:04:05,405::task::993::Storage.TaskManager.Task::(_decref) Task=`03012c4c-6499-4038-8d06-6c4026ecce42`::ref 0 aborting False GuestMonitor-Sql::DEBUG::2015-01-22 11:04:05,405::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404011::ERROR::2015-01-22 11:04:05,409::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404011::DEBUG::2015-01-22 11:04:05,411::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:05,420::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:05,421::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404012::DEBUG::2015-01-22 11:04:05,422::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404012::DEBUG::2015-01-22 11:04:05,423::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:04:07,655::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:08,487::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:08,489::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404013::DEBUG::2015-01-22 11:04:08,491::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:08,492::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:08,494::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404014::DEBUG::2015-01-22 11:04:08,495::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404014::DEBUG::2015-01-22 11:04:08,496::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:04:09,037::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:09,037::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:09,037::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:09,037::__init__::232::IOProcess::(_processLogs) (464795) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:09,039::__init__::232::IOProcess::(_processLogs) (464795) Queuing response Thread-64::DEBUG::2015-01-22 11:04:09,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:04:09,048::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000561957 s, 826 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:09,049::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:09,049::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:09,050::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:09,050::__init__::232::IOProcess::(_processLogs) (464796) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:09,050::__init__::232::IOProcess::(_processLogs) (464796) Queuing response Thread-21::DEBUG::2015-01-22 11:04:09,051::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:09,051::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:09,051::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:09,051::__init__::232::IOProcess::(_processLogs) (464797) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:09,051::__init__::232::IOProcess::(_processLogs) (464797) Queuing response Thread-21::DEBUG::2015-01-22 11:04:09,052::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:09,052::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:09,053::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:09,053::__init__::232::IOProcess::(_processLogs) (464798) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:09,053::__init__::232::IOProcess::(_processLogs) (464798) Queuing response Thread-21::DEBUG::2015-01-22 11:04:09,054::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:09,055::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:09,055::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:09,055::__init__::232::IOProcess::(_processLogs) (464799) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:09,055::__init__::232::IOProcess::(_processLogs) (464799) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:10,414::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:10,414::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:10,438::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:11,529::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:11,530::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404015::DEBUG::2015-01-22 11:04:11,533::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:11,534::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:11,535::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404016::DEBUG::2015-01-22 11:04:11,537::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404016::DEBUG::2015-01-22 11:04:11,538::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:04:12,522::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:12,522::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:12,522::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:12,522::__init__::232::IOProcess::(_processLogs) (464800) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:12,522::__init__::232::IOProcess::(_processLogs) (464800) Queuing response Thread-63::DEBUG::2015-01-22 11:04:12,523::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:04:12,530::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000306923 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:12,531::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:12,531::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:12,531::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:12,531::__init__::232::IOProcess::(_processLogs) (464801) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:12,532::__init__::232::IOProcess::(_processLogs) (464801) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:14,566::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:14,567::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404017::DEBUG::2015-01-22 11:04:14,569::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:14,570::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:14,571::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404018::DEBUG::2015-01-22 11:04:14,574::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404018::DEBUG::2015-01-22 11:04:14,575::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:15,444::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:15,445::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:15,452::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:17,601::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:17,604::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404019::DEBUG::2015-01-22 11:04:17,609::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:17,612::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:17,615::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404020::DEBUG::2015-01-22 11:04:17,618::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404020::DEBUG::2015-01-22 11:04:17,627::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-64::DEBUG::2015-01-22 11:04:19,056::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 06e45ff6-0505-4692-b97d-896d9b710b49 Thread-21::DEBUG::2015-01-22 11:04:19,058::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:19,058::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:19,058::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:19,058::__init__::232::IOProcess::(_processLogs) (464802) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:04:19,062::__init__::232::IOProcess::(_processLogs) (464802) Queuing response Thread-64::DEBUG::2015-01-22 11:04:19,067::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49 Thread-21::DEBUG::2015-01-22 11:04:19,068::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:19,068::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:19,068::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:19,068::__init__::232::IOProcess::(_processLogs) (464803) Got request for method 'touch' Thread-21::DEBUG::2015-01-22 11:04:19,070::__init__::232::IOProcess::(_processLogs) (464803) Queuing response Thread-64::DEBUG::2015-01-22 11:04:19,071::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend Thread-21::DEBUG::2015-01-22 11:04:19,072::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:19,072::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:19,072::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:19,072::__init__::232::IOProcess::(_processLogs) (464804) Got request for method 'readfile' Thread-21::DEBUG::2015-01-22 11:04:19,074::__init__::232::IOProcess::(_processLogs) (464804) Queuing response Thread-64::DEBUG::2015-01-22 11:04:19,074::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=store1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=cllDataCentre', 'POOL_DOMAINS=06e45ff6-0505-4692-b97d-896d9b710b49:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=67c137fd-0cf2-463a-bc70-b427cc0a5da3', 'REMOTE_PATH=192.168.1.25:/Vol2', 'ROLE=Master', 'SDUUID=06e45ff6-0505-4692-b97d-896d9b710b49', 'TYPE=GLUSTERFS', 'VERSION=3', '_SHA_CKSUM=7f3bb8b00fa6ca5bb291ea1e02530cfbc66a33ba'] Thread-21::DEBUG::2015-01-22 11:04:19,076::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:19,076::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:19,076::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:19,076::__init__::232::IOProcess::(_processLogs) (464805) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:19,076::__init__::232::IOProcess::(_processLogs) (464805) Queuing response Thread-21::DEBUG::2015-01-22 11:04:19,077::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:19,077::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:19,077::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:19,077::__init__::232::IOProcess::(_processLogs) (464806) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:04:19,080::__init__::232::IOProcess::(_processLogs) (464806) Queuing response Thread-64::DEBUG::2015-01-22 11:04:19,080::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-64::INFO::2015-01-22 11:04:19,081::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 06e45ff6-0505-4692-b97d-896d9b710b49_imageNS already registered Thread-64::INFO::2015-01-22 11:04:19,081::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 06e45ff6-0505-4692-b97d-896d9b710b49_volumeNS already registered Thread-21::DEBUG::2015-01-22 11:04:19,081::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:19,082::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:19,082::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:19,082::__init__::232::IOProcess::(_processLogs) (464807) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:19,082::__init__::232::IOProcess::(_processLogs) (464807) Queuing response Thread-64::DEBUG::2015-01-22 11:04:19,083::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:04:19,091::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000462774 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:19,092::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:19,092::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:19,092::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:19,092::__init__::232::IOProcess::(_processLogs) (464808) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:19,093::__init__::232::IOProcess::(_processLogs) (464808) Queuing response Thread-21::DEBUG::2015-01-22 11:04:19,094::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:19,094::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:19,094::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:19,094::__init__::232::IOProcess::(_processLogs) (464809) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:19,094::__init__::232::IOProcess::(_processLogs) (464809) Queuing response Thread-21::DEBUG::2015-01-22 11:04:19,095::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:19,095::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:19,095::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:19,095::__init__::232::IOProcess::(_processLogs) (464810) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:19,096::__init__::232::IOProcess::(_processLogs) (464810) Queuing response Thread-21::DEBUG::2015-01-22 11:04:19,096::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:19,097::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:19,097::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:19,097::__init__::232::IOProcess::(_processLogs) (464811) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:19,097::__init__::232::IOProcess::(_processLogs) (464811) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:20,458::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:20,459::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:20,462::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:20,657::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:20,658::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404022::DEBUG::2015-01-22 11:04:20,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`a67b34b6-2c14-4ef5-9a0f-a0a44f2b6fe9`::moving from state init -> state preparing Thread-404022::INFO::2015-01-22 11:04:20,661::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404022::INFO::2015-01-22 11:04:20,661::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306923', 'lastCheck': '8.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462774', 'lastCheck': '1.6', 'valid': True}} Thread-404022::DEBUG::2015-01-22 11:04:20,661::task::1191::Storage.TaskManager.Task::(prepare) Task=`a67b34b6-2c14-4ef5-9a0f-a0a44f2b6fe9`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306923', 'lastCheck': '8.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462774', 'lastCheck': '1.6', 'valid': True}} Thread-404022::DEBUG::2015-01-22 11:04:20,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`a67b34b6-2c14-4ef5-9a0f-a0a44f2b6fe9`::moving from state preparing -> state finished Thread-404022::DEBUG::2015-01-22 11:04:20,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404022::DEBUG::2015-01-22 11:04:20,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404022::DEBUG::2015-01-22 11:04:20,662::task::993::Storage.TaskManager.Task::(_decref) Task=`a67b34b6-2c14-4ef5-9a0f-a0a44f2b6fe9`::ref 0 aborting False Thread-404022::ERROR::2015-01-22 11:04:20,663::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404022::DEBUG::2015-01-22 11:04:20,665::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:20,674::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:20,675::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404023::DEBUG::2015-01-22 11:04:20,677::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404023::DEBUG::2015-01-22 11:04:20,678::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:04:22,533::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:22,534::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:22,534::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:22,534::__init__::232::IOProcess::(_processLogs) (464812) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:22,534::__init__::232::IOProcess::(_processLogs) (464812) Queuing response Thread-63::DEBUG::2015-01-22 11:04:22,535::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:04:22,542::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000249369 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:22,543::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:22,543::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:22,543::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:22,543::__init__::232::IOProcess::(_processLogs) (464813) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:22,543::__init__::232::IOProcess::(_processLogs) (464813) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:23,730::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:23,732::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404024::DEBUG::2015-01-22 11:04:23,734::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:23,735::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:23,736::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404025::DEBUG::2015-01-22 11:04:23,738::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404025::DEBUG::2015-01-22 11:04:23,739::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:25,468::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:25,469::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:25,481::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:26,771::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:26,772::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404026::DEBUG::2015-01-22 11:04:26,775::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:26,776::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:26,777::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404027::DEBUG::2015-01-22 11:04:26,779::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404027::DEBUG::2015-01-22 11:04:26,780::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:04:29,099::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:29,099::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:29,099::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:29,099::__init__::232::IOProcess::(_processLogs) (464814) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:29,102::__init__::232::IOProcess::(_processLogs) (464814) Queuing response Thread-64::DEBUG::2015-01-22 11:04:29,103::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:04:29,113::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00063843 s, 727 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:29,114::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:29,114::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:29,114::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:29,114::__init__::232::IOProcess::(_processLogs) (464815) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:29,114::__init__::232::IOProcess::(_processLogs) (464815) Queuing response Thread-21::DEBUG::2015-01-22 11:04:29,115::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:29,115::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:29,116::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:29,116::__init__::232::IOProcess::(_processLogs) (464816) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:29,117::__init__::232::IOProcess::(_processLogs) (464816) Queuing response Thread-21::DEBUG::2015-01-22 11:04:29,117::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:29,118::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:29,118::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:29,118::__init__::232::IOProcess::(_processLogs) (464817) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:29,118::__init__::232::IOProcess::(_processLogs) (464817) Queuing response Thread-21::DEBUG::2015-01-22 11:04:29,119::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:29,119::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:29,119::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:29,119::__init__::232::IOProcess::(_processLogs) (464818) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:29,120::__init__::232::IOProcess::(_processLogs) (464818) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:29,810::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:29,811::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404028::DEBUG::2015-01-22 11:04:29,813::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:29,814::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:29,815::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404029::DEBUG::2015-01-22 11:04:29,817::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404029::DEBUG::2015-01-22 11:04:29,818::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:30,487::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:30,487::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:30,494::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:04:32,545::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:32,545::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:32,545::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:32,546::__init__::232::IOProcess::(_processLogs) (464819) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:32,546::__init__::232::IOProcess::(_processLogs) (464819) Queuing response Thread-63::DEBUG::2015-01-22 11:04:32,546::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:04:32,553::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000313722 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:32,554::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:32,554::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:32,554::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:32,555::__init__::232::IOProcess::(_processLogs) (464820) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:32,555::__init__::232::IOProcess::(_processLogs) (464820) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:32,848::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:32,850::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404030::DEBUG::2015-01-22 11:04:32,852::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:32,854::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:32,855::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404031::DEBUG::2015-01-22 11:04:32,857::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404031::DEBUG::2015-01-22 11:04:32,857::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:35,500::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:35,500::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:35,508::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:35,884::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:35,885::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404032::DEBUG::2015-01-22 11:04:35,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`28c8b875-de5a-4726-9bef-8b40e8f8d7ae`::moving from state init -> state preparing Thread-404032::INFO::2015-01-22 11:04:35,887::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404032::INFO::2015-01-22 11:04:35,887::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000313722', 'lastCheck': '3.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063843', 'lastCheck': '6.8', 'valid': True}} Thread-404032::DEBUG::2015-01-22 11:04:35,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`28c8b875-de5a-4726-9bef-8b40e8f8d7ae`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000313722', 'lastCheck': '3.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063843', 'lastCheck': '6.8', 'valid': True}} Thread-404032::DEBUG::2015-01-22 11:04:35,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`28c8b875-de5a-4726-9bef-8b40e8f8d7ae`::moving from state preparing -> state finished Thread-404032::DEBUG::2015-01-22 11:04:35,888::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404032::DEBUG::2015-01-22 11:04:35,888::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404032::DEBUG::2015-01-22 11:04:35,888::task::993::Storage.TaskManager.Task::(_decref) Task=`28c8b875-de5a-4726-9bef-8b40e8f8d7ae`::ref 0 aborting False Thread-404032::ERROR::2015-01-22 11:04:35,889::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404032::DEBUG::2015-01-22 11:04:35,891::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:35,898::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:35,899::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404033::DEBUG::2015-01-22 11:04:35,901::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404033::DEBUG::2015-01-22 11:04:35,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:04:37,688::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:38,951::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:38,953::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404034::DEBUG::2015-01-22 11:04:38,955::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:38,956::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:38,958::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404035::DEBUG::2015-01-22 11:04:38,959::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404035::DEBUG::2015-01-22 11:04:38,960::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:04:39,121::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:39,121::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:39,121::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:39,122::__init__::232::IOProcess::(_processLogs) (464821) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:39,123::__init__::232::IOProcess::(_processLogs) (464821) Queuing response Thread-64::DEBUG::2015-01-22 11:04:39,124::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:04:39,133::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000493487 s, 940 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:39,134::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:39,134::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:39,134::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:39,134::__init__::232::IOProcess::(_processLogs) (464822) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:39,135::__init__::232::IOProcess::(_processLogs) (464822) Queuing response Thread-21::DEBUG::2015-01-22 11:04:39,136::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:39,136::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:39,136::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:39,136::__init__::232::IOProcess::(_processLogs) (464823) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:39,136::__init__::232::IOProcess::(_processLogs) (464823) Queuing response Thread-21::DEBUG::2015-01-22 11:04:39,137::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:39,137::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:39,137::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:39,138::__init__::232::IOProcess::(_processLogs) (464824) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:39,138::__init__::232::IOProcess::(_processLogs) (464824) Queuing response Thread-21::DEBUG::2015-01-22 11:04:39,139::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:39,139::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:39,140::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:39,140::__init__::232::IOProcess::(_processLogs) (464825) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:39,140::__init__::232::IOProcess::(_processLogs) (464825) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:40,510::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:40,511::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:40,519::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:41,991::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:41,993::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404036::DEBUG::2015-01-22 11:04:41,995::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:41,996::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:41,998::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404037::DEBUG::2015-01-22 11:04:42,000::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404037::DEBUG::2015-01-22 11:04:42,000::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:04:42,556::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:42,557::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:42,557::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:42,557::__init__::232::IOProcess::(_processLogs) (464826) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:42,557::__init__::232::IOProcess::(_processLogs) (464826) Queuing response Thread-63::DEBUG::2015-01-22 11:04:42,558::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:04:42,566::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000352856 s, 913 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:42,567::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:42,567::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:42,567::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:42,567::__init__::232::IOProcess::(_processLogs) (464827) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:42,567::__init__::232::IOProcess::(_processLogs) (464827) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:45,028::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:45,029::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404038::DEBUG::2015-01-22 11:04:45,031::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:45,032::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:45,033::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404039::DEBUG::2015-01-22 11:04:45,035::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404039::DEBUG::2015-01-22 11:04:45,036::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:45,521::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:45,522::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:45,529::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:48,068::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:48,071::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404040::DEBUG::2015-01-22 11:04:48,076::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:48,079::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:48,082::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404041::DEBUG::2015-01-22 11:04:48,086::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404041::DEBUG::2015-01-22 11:04:48,096::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:04:49,141::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:49,142::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:49,142::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:49,142::__init__::232::IOProcess::(_processLogs) (464828) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:49,143::__init__::232::IOProcess::(_processLogs) (464828) Queuing response Thread-64::DEBUG::2015-01-22 11:04:49,144::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:04:49,154::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000521339 s, 890 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:49,154::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:49,155::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:49,155::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:49,155::__init__::232::IOProcess::(_processLogs) (464829) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:49,155::__init__::232::IOProcess::(_processLogs) (464829) Queuing response Thread-21::DEBUG::2015-01-22 11:04:49,156::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:49,156::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:49,156::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:49,156::__init__::232::IOProcess::(_processLogs) (464830) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:49,157::__init__::232::IOProcess::(_processLogs) (464830) Queuing response Thread-21::DEBUG::2015-01-22 11:04:49,157::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:49,158::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:49,158::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:49,158::__init__::232::IOProcess::(_processLogs) (464831) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:49,158::__init__::232::IOProcess::(_processLogs) (464831) Queuing response Thread-21::DEBUG::2015-01-22 11:04:49,159::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:49,159::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:49,159::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:49,159::__init__::232::IOProcess::(_processLogs) (464832) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:49,159::__init__::232::IOProcess::(_processLogs) (464832) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:50,535::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:50,536::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:50,542::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:51,128::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:51,129::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404042::DEBUG::2015-01-22 11:04:51,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd2d65a4-1f8d-4636-b7d6-771c3218adee`::moving from state init -> state preparing Thread-404042::INFO::2015-01-22 11:04:51,132::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404042::INFO::2015-01-22 11:04:51,132::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000352856', 'lastCheck': '8.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521339', 'lastCheck': '2.0', 'valid': True}} Thread-404042::DEBUG::2015-01-22 11:04:51,132::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd2d65a4-1f8d-4636-b7d6-771c3218adee`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000352856', 'lastCheck': '8.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521339', 'lastCheck': '2.0', 'valid': True}} Thread-404042::DEBUG::2015-01-22 11:04:51,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd2d65a4-1f8d-4636-b7d6-771c3218adee`::moving from state preparing -> state finished Thread-404042::DEBUG::2015-01-22 11:04:51,132::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404042::DEBUG::2015-01-22 11:04:51,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404042::DEBUG::2015-01-22 11:04:51,133::task::993::Storage.TaskManager.Task::(_decref) Task=`cd2d65a4-1f8d-4636-b7d6-771c3218adee`::ref 0 aborting False Thread-404042::ERROR::2015-01-22 11:04:51,134::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404042::DEBUG::2015-01-22 11:04:51,136::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:51,145::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:51,146::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404043::DEBUG::2015-01-22 11:04:51,148::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404043::DEBUG::2015-01-22 11:04:51,149::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:04:52,569::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:52,569::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:52,569::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:52,570::__init__::232::IOProcess::(_processLogs) (464833) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:52,570::__init__::232::IOProcess::(_processLogs) (464833) Queuing response Thread-63::DEBUG::2015-01-22 11:04:52,570::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:04:52,577::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000314136 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:52,578::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:52,578::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:52,578::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:52,579::__init__::232::IOProcess::(_processLogs) (464834) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:52,579::__init__::232::IOProcess::(_processLogs) (464834) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:54,211::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:54,212::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404044::DEBUG::2015-01-22 11:04:54,214::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:54,216::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:54,217::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404045::DEBUG::2015-01-22 11:04:54,219::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404045::DEBUG::2015-01-22 11:04:54,220::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:04:55,548::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:55,549::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:04:55,557::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:57,251::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:57,252::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404046::DEBUG::2015-01-22 11:04:57,255::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:04:57,256::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:04:57,257::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404047::DEBUG::2015-01-22 11:04:57,259::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404047::DEBUG::2015-01-22 11:04:57,260::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:04:57,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2587285-7a74-4a61-8519-3f9992525cee`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:04:57,888::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:04:57,888::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:57,888::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:57,889::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:57,889::__init__::232::IOProcess::(_processLogs) (464835) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:04:57,891::__init__::232::IOProcess::(_processLogs) (464835) Queuing response Thread-21::DEBUG::2015-01-22 11:04:57,892::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:57,892::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:57,892::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:57,892::__init__::232::IOProcess::(_processLogs) (464836) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:04:57,893::__init__::232::IOProcess::(_processLogs) (464836) Queuing response Thread-360::INFO::2015-01-22 11:04:57,893::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:04:57,893::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2587285-7a74-4a61-8519-3f9992525cee`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:04:57,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2587285-7a74-4a61-8519-3f9992525cee`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:04:57,894::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:04:57,894::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:04:57,894::task::993::Storage.TaskManager.Task::(_decref) Task=`e2587285-7a74-4a61-8519-3f9992525cee`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:04:59,161::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:59,161::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:59,161::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:59,161::__init__::232::IOProcess::(_processLogs) (464837) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:59,163::__init__::232::IOProcess::(_processLogs) (464837) Queuing response Thread-64::DEBUG::2015-01-22 11:04:59,164::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:04:59,174::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000534996 s, 867 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:04:59,175::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:59,175::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:59,175::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:59,175::__init__::232::IOProcess::(_processLogs) (464838) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:04:59,175::__init__::232::IOProcess::(_processLogs) (464838) Queuing response Thread-21::DEBUG::2015-01-22 11:04:59,176::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:59,176::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:59,177::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:59,177::__init__::232::IOProcess::(_processLogs) (464839) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:59,177::__init__::232::IOProcess::(_processLogs) (464839) Queuing response Thread-21::DEBUG::2015-01-22 11:04:59,178::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:59,178::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:59,178::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:59,178::__init__::232::IOProcess::(_processLogs) (464840) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:59,179::__init__::232::IOProcess::(_processLogs) (464840) Queuing response Thread-21::DEBUG::2015-01-22 11:04:59,180::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:04:59,180::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:04:59,181::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:04:59,181::__init__::232::IOProcess::(_processLogs) (464841) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:04:59,181::__init__::232::IOProcess::(_processLogs) (464841) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:00,289::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:00,290::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404048::DEBUG::2015-01-22 11:05:00,292::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:00,294::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:00,295::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404049::DEBUG::2015-01-22 11:05:00,296::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404049::DEBUG::2015-01-22 11:05:00,297::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:00,563::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:00,564::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:00,571::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:05:02,580::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:02,581::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:02,581::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:02,581::__init__::232::IOProcess::(_processLogs) (464842) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:02,581::__init__::232::IOProcess::(_processLogs) (464842) Queuing response Thread-63::DEBUG::2015-01-22 11:05:02,582::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:05:02,589::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000272547 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:02,590::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:02,590::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:02,590::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:02,590::__init__::232::IOProcess::(_processLogs) (464843) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:02,591::__init__::232::IOProcess::(_processLogs) (464843) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:03,324::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:03,325::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404050::DEBUG::2015-01-22 11:05:03,328::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:03,329::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:03,330::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404051::DEBUG::2015-01-22 11:05:03,332::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404051::DEBUG::2015-01-22 11:05:03,333::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:05,577::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:05,577::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:05,585::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:06,360::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:06,361::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404052::DEBUG::2015-01-22 11:05:06,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad75a0e1-42c2-47b6-8555-9ad4d7b3061b`::moving from state init -> state preparing Thread-404052::INFO::2015-01-22 11:05:06,364::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404052::INFO::2015-01-22 11:05:06,364::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272547', 'lastCheck': '3.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534996', 'lastCheck': '7.2', 'valid': True}} Thread-404052::DEBUG::2015-01-22 11:05:06,364::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad75a0e1-42c2-47b6-8555-9ad4d7b3061b`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272547', 'lastCheck': '3.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534996', 'lastCheck': '7.2', 'valid': True}} Thread-404052::DEBUG::2015-01-22 11:05:06,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad75a0e1-42c2-47b6-8555-9ad4d7b3061b`::moving from state preparing -> state finished Thread-404052::DEBUG::2015-01-22 11:05:06,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404052::DEBUG::2015-01-22 11:05:06,365::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404052::DEBUG::2015-01-22 11:05:06,365::task::993::Storage.TaskManager.Task::(_decref) Task=`ad75a0e1-42c2-47b6-8555-9ad4d7b3061b`::ref 0 aborting False Thread-404052::ERROR::2015-01-22 11:05:06,366::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404052::DEBUG::2015-01-22 11:05:06,368::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:06,377::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:06,378::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404053::DEBUG::2015-01-22 11:05:06,379::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404053::DEBUG::2015-01-22 11:05:06,380::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:05:07,724::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:05:09,182::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:09,183::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:09,183::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:09,183::__init__::232::IOProcess::(_processLogs) (464844) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:09,184::__init__::232::IOProcess::(_processLogs) (464844) Queuing response Thread-64::DEBUG::2015-01-22 11:05:09,185::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:05:09,194::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000469727 s, 988 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:09,194::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:09,194::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:09,195::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:09,195::__init__::232::IOProcess::(_processLogs) (464845) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:09,195::__init__::232::IOProcess::(_processLogs) (464845) Queuing response Thread-21::DEBUG::2015-01-22 11:05:09,196::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:09,196::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:09,196::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:09,196::__init__::232::IOProcess::(_processLogs) (464846) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:09,197::__init__::232::IOProcess::(_processLogs) (464846) Queuing response Thread-21::DEBUG::2015-01-22 11:05:09,198::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:09,199::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:09,199::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:09,199::__init__::232::IOProcess::(_processLogs) (464847) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:09,199::__init__::232::IOProcess::(_processLogs) (464847) Queuing response Thread-21::DEBUG::2015-01-22 11:05:09,200::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:09,200::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:09,200::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:09,200::__init__::232::IOProcess::(_processLogs) (464848) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:09,200::__init__::232::IOProcess::(_processLogs) (464848) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:09,441::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:09,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404054::DEBUG::2015-01-22 11:05:09,444::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:09,445::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:09,447::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404055::DEBUG::2015-01-22 11:05:09,448::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404055::DEBUG::2015-01-22 11:05:09,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:10,591::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:10,592::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:10,603::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:12,482::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:12,483::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404056::DEBUG::2015-01-22 11:05:12,486::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:12,487::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:12,488::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404057::DEBUG::2015-01-22 11:05:12,490::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404057::DEBUG::2015-01-22 11:05:12,491::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:05:12,592::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:12,592::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:12,593::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:12,593::__init__::232::IOProcess::(_processLogs) (464849) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:12,593::__init__::232::IOProcess::(_processLogs) (464849) Queuing response Thread-63::DEBUG::2015-01-22 11:05:12,594::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:05:12,601::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000317614 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:12,602::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:12,602::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:12,602::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:12,603::__init__::232::IOProcess::(_processLogs) (464850) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:12,603::__init__::232::IOProcess::(_processLogs) (464850) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:15,521::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:15,522::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404058::DEBUG::2015-01-22 11:05:15,524::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:15,526::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:15,527::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404059::DEBUG::2015-01-22 11:05:15,529::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404059::DEBUG::2015-01-22 11:05:15,530::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:15,609::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:15,610::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:15,616::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:18,559::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:18,560::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404060::DEBUG::2015-01-22 11:05:18,562::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:18,564::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:18,565::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404061::DEBUG::2015-01-22 11:05:18,566::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404061::DEBUG::2015-01-22 11:05:18,567::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:05:19,202::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:19,202::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:19,202::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:19,202::__init__::232::IOProcess::(_processLogs) (464851) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:19,203::__init__::232::IOProcess::(_processLogs) (464851) Queuing response Thread-64::DEBUG::2015-01-22 11:05:19,204::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:05:19,213::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000460578 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:19,214::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:19,214::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:19,214::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:19,214::__init__::232::IOProcess::(_processLogs) (464852) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:19,214::__init__::232::IOProcess::(_processLogs) (464852) Queuing response Thread-21::DEBUG::2015-01-22 11:05:19,215::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:19,216::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:19,216::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:19,216::__init__::232::IOProcess::(_processLogs) (464853) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:19,216::__init__::232::IOProcess::(_processLogs) (464853) Queuing response Thread-21::DEBUG::2015-01-22 11:05:19,217::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:19,217::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:19,217::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:19,217::__init__::232::IOProcess::(_processLogs) (464854) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:19,218::__init__::232::IOProcess::(_processLogs) (464854) Queuing response Thread-21::DEBUG::2015-01-22 11:05:19,219::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:19,220::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:19,220::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:19,220::__init__::232::IOProcess::(_processLogs) (464855) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:19,220::__init__::232::IOProcess::(_processLogs) (464855) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:20,622::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:20,623::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:20,627::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:21,598::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:21,599::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404062::DEBUG::2015-01-22 11:05:21,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6b9f177-b364-4c2d-84f8-9fb49a56f905`::moving from state init -> state preparing Thread-404062::INFO::2015-01-22 11:05:21,603::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404062::INFO::2015-01-22 11:05:21,603::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000317614', 'lastCheck': '9.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460578', 'lastCheck': '2.4', 'valid': True}} Thread-404062::DEBUG::2015-01-22 11:05:21,603::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6b9f177-b364-4c2d-84f8-9fb49a56f905`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000317614', 'lastCheck': '9.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460578', 'lastCheck': '2.4', 'valid': True}} Thread-404062::DEBUG::2015-01-22 11:05:21,603::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6b9f177-b364-4c2d-84f8-9fb49a56f905`::moving from state preparing -> state finished Thread-404062::DEBUG::2015-01-22 11:05:21,603::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404062::DEBUG::2015-01-22 11:05:21,603::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404062::DEBUG::2015-01-22 11:05:21,603::task::993::Storage.TaskManager.Task::(_decref) Task=`f6b9f177-b364-4c2d-84f8-9fb49a56f905`::ref 0 aborting False Thread-404062::ERROR::2015-01-22 11:05:21,604::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404062::DEBUG::2015-01-22 11:05:21,607::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:21,616::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:21,617::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404063::DEBUG::2015-01-22 11:05:21,619::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404063::DEBUG::2015-01-22 11:05:21,619::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:05:22,606::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:22,606::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:22,607::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:22,608::__init__::232::IOProcess::(_processLogs) (464856) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:22,608::__init__::232::IOProcess::(_processLogs) (464856) Queuing response Thread-63::DEBUG::2015-01-22 11:05:22,612::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:05:22,621::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000252579 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:22,627::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:22,629::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:22,630::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:22,631::__init__::232::IOProcess::(_processLogs) (464857) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:22,633::__init__::232::IOProcess::(_processLogs) (464857) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:24,675::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:24,676::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404064::DEBUG::2015-01-22 11:05:24,679::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:24,680::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:24,681::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404065::DEBUG::2015-01-22 11:05:24,683::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404065::DEBUG::2015-01-22 11:05:24,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:25,634::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:25,634::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:25,641::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:27,718::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:27,719::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404066::DEBUG::2015-01-22 11:05:27,722::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:27,723::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:27,724::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404067::DEBUG::2015-01-22 11:05:27,726::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404067::DEBUG::2015-01-22 11:05:27,727::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:05:29,221::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:29,222::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:29,222::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:29,222::__init__::232::IOProcess::(_processLogs) (464858) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:29,224::__init__::232::IOProcess::(_processLogs) (464858) Queuing response Thread-64::DEBUG::2015-01-22 11:05:29,224::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:05:29,234::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000529573 s, 876 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:29,235::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:29,235::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:29,236::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:29,236::__init__::232::IOProcess::(_processLogs) (464859) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:29,236::__init__::232::IOProcess::(_processLogs) (464859) Queuing response Thread-21::DEBUG::2015-01-22 11:05:29,237::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:29,237::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:29,237::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:29,238::__init__::232::IOProcess::(_processLogs) (464860) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:29,238::__init__::232::IOProcess::(_processLogs) (464860) Queuing response Thread-21::DEBUG::2015-01-22 11:05:29,239::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:29,239::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:29,239::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:29,239::__init__::232::IOProcess::(_processLogs) (464861) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:29,240::__init__::232::IOProcess::(_processLogs) (464861) Queuing response Thread-21::DEBUG::2015-01-22 11:05:29,240::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:29,240::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:29,240::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:29,241::__init__::232::IOProcess::(_processLogs) (464862) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:29,241::__init__::232::IOProcess::(_processLogs) (464862) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:30,648::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:30,648::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:30,655::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:30,759::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:30,760::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404068::DEBUG::2015-01-22 11:05:30,762::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:30,763::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:30,765::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404069::DEBUG::2015-01-22 11:05:30,766::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404069::DEBUG::2015-01-22 11:05:30,767::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:05:32,641::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:32,642::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:32,642::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:32,642::__init__::232::IOProcess::(_processLogs) (464863) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:32,642::__init__::232::IOProcess::(_processLogs) (464863) Queuing response Thread-63::DEBUG::2015-01-22 11:05:32,643::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:05:32,652::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000356284 s, 904 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:32,653::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:32,653::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:32,653::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:32,653::__init__::232::IOProcess::(_processLogs) (464864) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:32,653::__init__::232::IOProcess::(_processLogs) (464864) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:33,796::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:33,797::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404070::DEBUG::2015-01-22 11:05:33,799::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:33,800::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:33,801::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404071::DEBUG::2015-01-22 11:05:33,803::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404071::DEBUG::2015-01-22 11:05:33,804::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:35,662::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:35,662::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:35,669::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:36,834::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:36,835::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404072::DEBUG::2015-01-22 11:05:36,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f7cb82d-ba7a-42eb-9135-2401c999f84a`::moving from state init -> state preparing Thread-404072::INFO::2015-01-22 11:05:36,837::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404072::INFO::2015-01-22 11:05:36,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000356284', 'lastCheck': '4.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529573', 'lastCheck': '7.6', 'valid': True}} Thread-404072::DEBUG::2015-01-22 11:05:36,838::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f7cb82d-ba7a-42eb-9135-2401c999f84a`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000356284', 'lastCheck': '4.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529573', 'lastCheck': '7.6', 'valid': True}} Thread-404072::DEBUG::2015-01-22 11:05:36,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f7cb82d-ba7a-42eb-9135-2401c999f84a`::moving from state preparing -> state finished Thread-404072::DEBUG::2015-01-22 11:05:36,838::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404072::DEBUG::2015-01-22 11:05:36,838::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404072::DEBUG::2015-01-22 11:05:36,838::task::993::Storage.TaskManager.Task::(_decref) Task=`7f7cb82d-ba7a-42eb-9135-2401c999f84a`::ref 0 aborting False Thread-404072::ERROR::2015-01-22 11:05:36,839::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404072::DEBUG::2015-01-22 11:05:36,841::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:36,850::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:36,851::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404073::DEBUG::2015-01-22 11:05:36,853::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404073::DEBUG::2015-01-22 11:05:36,854::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:05:37,758::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:05:39,242::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:39,243::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:39,243::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:39,243::__init__::232::IOProcess::(_processLogs) (464865) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:39,244::__init__::232::IOProcess::(_processLogs) (464865) Queuing response Thread-64::DEBUG::2015-01-22 11:05:39,245::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:05:39,254::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000512593 s, 905 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:39,255::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:39,255::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:39,255::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:39,255::__init__::232::IOProcess::(_processLogs) (464866) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:39,255::__init__::232::IOProcess::(_processLogs) (464866) Queuing response Thread-21::DEBUG::2015-01-22 11:05:39,256::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:39,256::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:39,257::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:39,257::__init__::232::IOProcess::(_processLogs) (464867) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:39,257::__init__::232::IOProcess::(_processLogs) (464867) Queuing response Thread-21::DEBUG::2015-01-22 11:05:39,258::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:39,258::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:39,258::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:39,259::__init__::232::IOProcess::(_processLogs) (464868) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:39,259::__init__::232::IOProcess::(_processLogs) (464868) Queuing response Thread-21::DEBUG::2015-01-22 11:05:39,260::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:39,260::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:39,260::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:39,260::__init__::232::IOProcess::(_processLogs) (464869) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:39,260::__init__::232::IOProcess::(_processLogs) (464869) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:39,914::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:39,916::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404074::DEBUG::2015-01-22 11:05:39,918::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:39,919::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:39,921::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404075::DEBUG::2015-01-22 11:05:39,922::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404075::DEBUG::2015-01-22 11:05:39,923::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:40,676::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:40,676::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:40,692::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:05:42,655::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:42,655::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:42,656::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:42,656::__init__::232::IOProcess::(_processLogs) (464870) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:42,656::__init__::232::IOProcess::(_processLogs) (464870) Queuing response Thread-63::DEBUG::2015-01-22 11:05:42,657::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:05:42,666::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000289584 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:42,667::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:42,667::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:42,667::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:42,667::__init__::232::IOProcess::(_processLogs) (464871) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:42,667::__init__::232::IOProcess::(_processLogs) (464871) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:42,959::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:42,960::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404076::DEBUG::2015-01-22 11:05:42,964::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:42,965::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:42,966::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404077::DEBUG::2015-01-22 11:05:42,968::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404077::DEBUG::2015-01-22 11:05:42,969::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:45,698::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:45,698::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:45,706::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:45,999::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:46,000::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404078::DEBUG::2015-01-22 11:05:46,002::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:46,003::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:46,004::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404079::DEBUG::2015-01-22 11:05:46,006::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404079::DEBUG::2015-01-22 11:05:46,007::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:49,037::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:49,039::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404080::DEBUG::2015-01-22 11:05:49,040::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:49,042::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:49,043::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404081::DEBUG::2015-01-22 11:05:49,044::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404081::DEBUG::2015-01-22 11:05:49,045::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:05:49,262::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:49,262::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:49,262::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:49,262::__init__::232::IOProcess::(_processLogs) (464872) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:49,264::__init__::232::IOProcess::(_processLogs) (464872) Queuing response Thread-64::DEBUG::2015-01-22 11:05:49,265::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:05:49,274::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00049865 s, 931 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:49,275::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:49,275::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:49,275::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:49,275::__init__::232::IOProcess::(_processLogs) (464873) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:49,275::__init__::232::IOProcess::(_processLogs) (464873) Queuing response Thread-21::DEBUG::2015-01-22 11:05:49,276::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:49,276::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:49,277::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:49,277::__init__::232::IOProcess::(_processLogs) (464874) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:49,277::__init__::232::IOProcess::(_processLogs) (464874) Queuing response Thread-21::DEBUG::2015-01-22 11:05:49,278::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:49,278::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:49,278::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:49,278::__init__::232::IOProcess::(_processLogs) (464875) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:49,279::__init__::232::IOProcess::(_processLogs) (464875) Queuing response Thread-21::DEBUG::2015-01-22 11:05:49,279::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:49,280::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:49,280::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:49,280::__init__::232::IOProcess::(_processLogs) (464876) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:49,280::__init__::232::IOProcess::(_processLogs) (464876) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:50,712::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:50,713::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:50,720::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:52,073::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:52,074::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404082::DEBUG::2015-01-22 11:05:52,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`f93364b1-0fba-4896-896e-f0fdb2ab2598`::moving from state init -> state preparing Thread-404082::INFO::2015-01-22 11:05:52,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404082::INFO::2015-01-22 11:05:52,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289584', 'lastCheck': '9.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049865', 'lastCheck': '2.8', 'valid': True}} Thread-404082::DEBUG::2015-01-22 11:05:52,077::task::1191::Storage.TaskManager.Task::(prepare) Task=`f93364b1-0fba-4896-896e-f0fdb2ab2598`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289584', 'lastCheck': '9.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049865', 'lastCheck': '2.8', 'valid': True}} Thread-404082::DEBUG::2015-01-22 11:05:52,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`f93364b1-0fba-4896-896e-f0fdb2ab2598`::moving from state preparing -> state finished Thread-404082::DEBUG::2015-01-22 11:05:52,077::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404082::DEBUG::2015-01-22 11:05:52,077::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404082::DEBUG::2015-01-22 11:05:52,077::task::993::Storage.TaskManager.Task::(_decref) Task=`f93364b1-0fba-4896-896e-f0fdb2ab2598`::ref 0 aborting False Thread-404082::ERROR::2015-01-22 11:05:52,078::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404082::DEBUG::2015-01-22 11:05:52,081::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:52,088::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:52,089::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404083::DEBUG::2015-01-22 11:05:52,091::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404083::DEBUG::2015-01-22 11:05:52,092::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:05:52,669::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:52,669::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:52,670::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:52,670::__init__::232::IOProcess::(_processLogs) (464877) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:52,670::__init__::232::IOProcess::(_processLogs) (464877) Queuing response Thread-63::DEBUG::2015-01-22 11:05:52,671::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:05:52,677::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000307899 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:52,678::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:52,678::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:52,678::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:52,678::__init__::232::IOProcess::(_processLogs) (464878) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:52,678::__init__::232::IOProcess::(_processLogs) (464878) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:55,140::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:55,142::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404084::DEBUG::2015-01-22 11:05:55,144::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:55,145::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:55,146::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404085::DEBUG::2015-01-22 11:05:55,148::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404085::DEBUG::2015-01-22 11:05:55,149::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:05:55,726::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:55,727::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:05:55,738::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:05:57,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`26ec0dd2-c0fc-435a-bd0a-449a2c5cf5ab`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:05:57,978::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:05:57,978::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:57,979::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:57,979::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:57,979::__init__::232::IOProcess::(_processLogs) (464879) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:05:57,982::__init__::232::IOProcess::(_processLogs) (464879) Queuing response Thread-21::DEBUG::2015-01-22 11:05:57,983::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:57,983::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:57,983::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:57,983::__init__::232::IOProcess::(_processLogs) (464880) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:05:57,983::__init__::232::IOProcess::(_processLogs) (464880) Queuing response Thread-360::INFO::2015-01-22 11:05:57,984::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:05:57,984::task::1191::Storage.TaskManager.Task::(prepare) Task=`26ec0dd2-c0fc-435a-bd0a-449a2c5cf5ab`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:05:57,984::task::595::Storage.TaskManager.Task::(_updateState) Task=`26ec0dd2-c0fc-435a-bd0a-449a2c5cf5ab`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:05:57,984::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:05:57,984::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:05:57,984::task::993::Storage.TaskManager.Task::(_decref) Task=`26ec0dd2-c0fc-435a-bd0a-449a2c5cf5ab`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:58,180::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:58,181::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404086::DEBUG::2015-01-22 11:05:58,184::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:05:58,185::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:05:58,186::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404087::DEBUG::2015-01-22 11:05:58,188::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404087::DEBUG::2015-01-22 11:05:58,189::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:05:59,282::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:59,282::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:59,282::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:59,282::__init__::232::IOProcess::(_processLogs) (464881) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:59,283::__init__::232::IOProcess::(_processLogs) (464881) Queuing response Thread-64::DEBUG::2015-01-22 11:05:59,284::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:05:59,293::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000427881 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:05:59,294::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:59,294::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:59,294::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:59,294::__init__::232::IOProcess::(_processLogs) (464882) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:05:59,294::__init__::232::IOProcess::(_processLogs) (464882) Queuing response Thread-21::DEBUG::2015-01-22 11:05:59,295::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:59,296::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:59,296::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:59,296::__init__::232::IOProcess::(_processLogs) (464883) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:59,297::__init__::232::IOProcess::(_processLogs) (464883) Queuing response Thread-21::DEBUG::2015-01-22 11:05:59,298::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:59,298::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:59,298::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:59,298::__init__::232::IOProcess::(_processLogs) (464884) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:59,298::__init__::232::IOProcess::(_processLogs) (464884) Queuing response Thread-21::DEBUG::2015-01-22 11:05:59,299::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:05:59,299::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:05:59,299::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:05:59,299::__init__::232::IOProcess::(_processLogs) (464885) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:05:59,300::__init__::232::IOProcess::(_processLogs) (464885) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:00,744::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:00,745::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:00,752::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:01,215::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:01,217::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404088::DEBUG::2015-01-22 11:06:01,219::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:01,220::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:01,221::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404089::DEBUG::2015-01-22 11:06:01,223::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404089::DEBUG::2015-01-22 11:06:01,223::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:06:02,680::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:02,680::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:02,681::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:02,681::__init__::232::IOProcess::(_processLogs) (464886) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:02,681::__init__::232::IOProcess::(_processLogs) (464886) Queuing response Thread-63::DEBUG::2015-01-22 11:06:02,682::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:06:02,689::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000252217 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:02,690::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:02,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:02,690::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:02,691::__init__::232::IOProcess::(_processLogs) (464887) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:02,691::__init__::232::IOProcess::(_processLogs) (464887) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:04,252::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:04,254::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404090::DEBUG::2015-01-22 11:06:04,256::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:04,257::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:04,258::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404091::DEBUG::2015-01-22 11:06:04,260::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404091::DEBUG::2015-01-22 11:06:04,261::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:05,758::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:05,759::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:05,762::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:07,290::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:07,290::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404092::DEBUG::2015-01-22 11:06:07,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1f7ff5e-cbe6-4324-88ec-b2065901d7c8`::moving from state init -> state preparing Thread-404092::INFO::2015-01-22 11:06:07,293::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404092::INFO::2015-01-22 11:06:07,293::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000252217', 'lastCheck': '4.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427881', 'lastCheck': '8.0', 'valid': True}} Thread-404092::DEBUG::2015-01-22 11:06:07,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`d1f7ff5e-cbe6-4324-88ec-b2065901d7c8`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000252217', 'lastCheck': '4.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427881', 'lastCheck': '8.0', 'valid': True}} Thread-404092::DEBUG::2015-01-22 11:06:07,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1f7ff5e-cbe6-4324-88ec-b2065901d7c8`::moving from state preparing -> state finished Thread-404092::DEBUG::2015-01-22 11:06:07,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404092::DEBUG::2015-01-22 11:06:07,294::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404092::DEBUG::2015-01-22 11:06:07,294::task::993::Storage.TaskManager.Task::(_decref) Task=`d1f7ff5e-cbe6-4324-88ec-b2065901d7c8`::ref 0 aborting False Thread-404092::ERROR::2015-01-22 11:06:07,295::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404092::DEBUG::2015-01-22 11:06:07,297::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:07,305::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:07,306::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404093::DEBUG::2015-01-22 11:06:07,308::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404093::DEBUG::2015-01-22 11:06:07,309::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:06:07,794::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:06:09,302::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:09,302::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:09,302::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:09,302::__init__::232::IOProcess::(_processLogs) (464888) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:09,303::__init__::232::IOProcess::(_processLogs) (464888) Queuing response Thread-64::DEBUG::2015-01-22 11:06:09,304::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:06:09,313::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000527141 s, 880 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:09,314::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:09,314::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:09,314::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:09,314::__init__::232::IOProcess::(_processLogs) (464889) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:09,314::__init__::232::IOProcess::(_processLogs) (464889) Queuing response Thread-21::DEBUG::2015-01-22 11:06:09,315::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:09,315::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:09,315::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:09,315::__init__::232::IOProcess::(_processLogs) (464890) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:09,316::__init__::232::IOProcess::(_processLogs) (464890) Queuing response Thread-21::DEBUG::2015-01-22 11:06:09,317::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:09,317::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:09,317::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:09,317::__init__::232::IOProcess::(_processLogs) (464891) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:09,317::__init__::232::IOProcess::(_processLogs) (464891) Queuing response Thread-21::DEBUG::2015-01-22 11:06:09,318::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:09,318::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:09,318::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:09,319::__init__::232::IOProcess::(_processLogs) (464892) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:09,319::__init__::232::IOProcess::(_processLogs) (464892) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:10,369::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:10,370::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404094::DEBUG::2015-01-22 11:06:10,373::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:10,374::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:10,375::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404095::DEBUG::2015-01-22 11:06:10,377::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404095::DEBUG::2015-01-22 11:06:10,378::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:10,768::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:10,769::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:10,781::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:06:12,693::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:12,693::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:12,693::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:12,693::__init__::232::IOProcess::(_processLogs) (464893) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:12,693::__init__::232::IOProcess::(_processLogs) (464893) Queuing response Thread-63::DEBUG::2015-01-22 11:06:12,694::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:06:12,700::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000250041 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:12,701::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:12,701::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:12,701::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:12,702::__init__::232::IOProcess::(_processLogs) (464894) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:12,702::__init__::232::IOProcess::(_processLogs) (464894) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:13,408::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:13,409::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404096::DEBUG::2015-01-22 11:06:13,412::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:13,413::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:13,414::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404097::DEBUG::2015-01-22 11:06:13,416::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404097::DEBUG::2015-01-22 11:06:13,417::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:15,787::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:15,788::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:15,794::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:16,446::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:16,447::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404098::DEBUG::2015-01-22 11:06:16,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:16,450::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:16,451::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404099::DEBUG::2015-01-22 11:06:16,453::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404099::DEBUG::2015-01-22 11:06:16,454::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:06:19,320::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:19,321::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:19,321::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:19,321::__init__::232::IOProcess::(_processLogs) (464895) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:19,322::__init__::232::IOProcess::(_processLogs) (464895) Queuing response Thread-64::DEBUG::2015-01-22 11:06:19,323::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:06:19,333::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000587703 s, 790 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:19,333::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:19,334::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:19,334::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:19,334::__init__::232::IOProcess::(_processLogs) (464896) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:19,334::__init__::232::IOProcess::(_processLogs) (464896) Queuing response Thread-21::DEBUG::2015-01-22 11:06:19,335::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:19,335::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:19,335::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:19,335::__init__::232::IOProcess::(_processLogs) (464897) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:19,336::__init__::232::IOProcess::(_processLogs) (464897) Queuing response Thread-21::DEBUG::2015-01-22 11:06:19,337::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:19,337::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:19,337::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:19,338::__init__::232::IOProcess::(_processLogs) (464898) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:19,338::__init__::232::IOProcess::(_processLogs) (464898) Queuing response Thread-21::DEBUG::2015-01-22 11:06:19,338::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:19,338::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:19,339::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:19,339::__init__::232::IOProcess::(_processLogs) (464899) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:19,339::__init__::232::IOProcess::(_processLogs) (464899) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:19,480::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:19,481::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404100::DEBUG::2015-01-22 11:06:19,483::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:19,484::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:19,486::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404101::DEBUG::2015-01-22 11:06:19,488::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404101::DEBUG::2015-01-22 11:06:19,489::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:20,800::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:20,801::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:20,808::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:22,517::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:22,518::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404102::DEBUG::2015-01-22 11:06:22,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ffdaf2a-df22-4118-a8e0-07c53d714cdd`::moving from state init -> state preparing Thread-404102::INFO::2015-01-22 11:06:22,521::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404102::INFO::2015-01-22 11:06:22,521::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250041', 'lastCheck': '9.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587703', 'lastCheck': '3.2', 'valid': True}} Thread-404102::DEBUG::2015-01-22 11:06:22,521::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ffdaf2a-df22-4118-a8e0-07c53d714cdd`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250041', 'lastCheck': '9.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587703', 'lastCheck': '3.2', 'valid': True}} Thread-404102::DEBUG::2015-01-22 11:06:22,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ffdaf2a-df22-4118-a8e0-07c53d714cdd`::moving from state preparing -> state finished Thread-404102::DEBUG::2015-01-22 11:06:22,521::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404102::DEBUG::2015-01-22 11:06:22,522::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404102::DEBUG::2015-01-22 11:06:22,522::task::993::Storage.TaskManager.Task::(_decref) Task=`6ffdaf2a-df22-4118-a8e0-07c53d714cdd`::ref 0 aborting False Thread-404102::ERROR::2015-01-22 11:06:22,522::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404102::DEBUG::2015-01-22 11:06:22,525::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:22,533::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:22,535::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404103::DEBUG::2015-01-22 11:06:22,536::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404103::DEBUG::2015-01-22 11:06:22,537::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:06:22,703::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:22,704::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:22,704::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:22,704::__init__::232::IOProcess::(_processLogs) (464900) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:22,704::__init__::232::IOProcess::(_processLogs) (464900) Queuing response Thread-63::DEBUG::2015-01-22 11:06:22,705::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:06:22,712::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000269628 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:22,713::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:22,713::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:22,713::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:22,714::__init__::232::IOProcess::(_processLogs) (464901) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:22,714::__init__::232::IOProcess::(_processLogs) (464901) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:25,601::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:25,602::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404104::DEBUG::2015-01-22 11:06:25,605::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:25,606::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:25,607::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404105::DEBUG::2015-01-22 11:06:25,609::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404105::DEBUG::2015-01-22 11:06:25,610::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:25,814::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:25,815::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:25,822::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:28,642::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:28,643::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404106::DEBUG::2015-01-22 11:06:28,646::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:28,647::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:28,648::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404107::DEBUG::2015-01-22 11:06:28,650::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404107::DEBUG::2015-01-22 11:06:28,651::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:06:29,340::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:29,340::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:29,341::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:29,341::__init__::232::IOProcess::(_processLogs) (464902) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:29,342::__init__::232::IOProcess::(_processLogs) (464902) Queuing response Thread-64::DEBUG::2015-01-22 11:06:29,343::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:06:29,353::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000478893 s, 969 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:29,353::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:29,354::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:29,354::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:29,354::__init__::232::IOProcess::(_processLogs) (464903) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:29,354::__init__::232::IOProcess::(_processLogs) (464903) Queuing response Thread-21::DEBUG::2015-01-22 11:06:29,355::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:29,355::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:29,355::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:29,355::__init__::232::IOProcess::(_processLogs) (464904) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:29,355::__init__::232::IOProcess::(_processLogs) (464904) Queuing response Thread-21::DEBUG::2015-01-22 11:06:29,356::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:29,356::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:29,356::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:29,356::__init__::232::IOProcess::(_processLogs) (464905) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:29,357::__init__::232::IOProcess::(_processLogs) (464905) Queuing response Thread-21::DEBUG::2015-01-22 11:06:29,358::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:29,358::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:29,358::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:29,359::__init__::232::IOProcess::(_processLogs) (464906) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:29,359::__init__::232::IOProcess::(_processLogs) (464906) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:30,829::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:30,829::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:30,837::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:31,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:31,683::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404108::DEBUG::2015-01-22 11:06:31,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:31,685::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:31,687::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404109::DEBUG::2015-01-22 11:06:31,689::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404109::DEBUG::2015-01-22 11:06:31,690::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:06:32,715::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:32,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:32,716::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:32,716::__init__::232::IOProcess::(_processLogs) (464907) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:32,716::__init__::232::IOProcess::(_processLogs) (464907) Queuing response Thread-63::DEBUG::2015-01-22 11:06:32,717::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:06:32,725::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000247822 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:32,726::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:32,726::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:32,726::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:32,726::__init__::232::IOProcess::(_processLogs) (464908) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:32,726::__init__::232::IOProcess::(_processLogs) (464908) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:34,720::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:34,722::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404110::DEBUG::2015-01-22 11:06:34,724::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:34,725::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:34,726::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404111::DEBUG::2015-01-22 11:06:34,728::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404111::DEBUG::2015-01-22 11:06:34,729::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:35,843::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:35,843::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:35,850::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:37,754::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:37,755::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404112::DEBUG::2015-01-22 11:06:37,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`0886a7cf-94dd-4fb9-b7b3-c918c4740ef5`::moving from state init -> state preparing Thread-404112::INFO::2015-01-22 11:06:37,758::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404112::INFO::2015-01-22 11:06:37,758::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000247822', 'lastCheck': '5.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478893', 'lastCheck': '8.4', 'valid': True}} Thread-404112::DEBUG::2015-01-22 11:06:37,758::task::1191::Storage.TaskManager.Task::(prepare) Task=`0886a7cf-94dd-4fb9-b7b3-c918c4740ef5`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000247822', 'lastCheck': '5.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478893', 'lastCheck': '8.4', 'valid': True}} Thread-404112::DEBUG::2015-01-22 11:06:37,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`0886a7cf-94dd-4fb9-b7b3-c918c4740ef5`::moving from state preparing -> state finished Thread-404112::DEBUG::2015-01-22 11:06:37,758::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404112::DEBUG::2015-01-22 11:06:37,758::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404112::DEBUG::2015-01-22 11:06:37,759::task::993::Storage.TaskManager.Task::(_decref) Task=`0886a7cf-94dd-4fb9-b7b3-c918c4740ef5`::ref 0 aborting False Thread-404112::ERROR::2015-01-22 11:06:37,760::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404112::DEBUG::2015-01-22 11:06:37,762::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:37,769::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:37,770::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404113::DEBUG::2015-01-22 11:06:37,772::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404113::DEBUG::2015-01-22 11:06:37,773::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:06:37,828::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:06:39,360::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:39,360::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:39,360::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:39,361::__init__::232::IOProcess::(_processLogs) (464909) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:39,362::__init__::232::IOProcess::(_processLogs) (464909) Queuing response Thread-64::DEBUG::2015-01-22 11:06:39,363::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:06:39,372::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000489059 s, 949 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:39,372::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:39,372::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:39,373::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:39,373::__init__::232::IOProcess::(_processLogs) (464910) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:39,373::__init__::232::IOProcess::(_processLogs) (464910) Queuing response Thread-21::DEBUG::2015-01-22 11:06:39,374::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:39,374::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:39,374::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:39,374::__init__::232::IOProcess::(_processLogs) (464911) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:39,374::__init__::232::IOProcess::(_processLogs) (464911) Queuing response Thread-21::DEBUG::2015-01-22 11:06:39,375::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:39,375::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:39,375::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:39,375::__init__::232::IOProcess::(_processLogs) (464912) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:39,376::__init__::232::IOProcess::(_processLogs) (464912) Queuing response Thread-21::DEBUG::2015-01-22 11:06:39,376::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:39,376::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:39,376::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:39,377::__init__::232::IOProcess::(_processLogs) (464913) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:39,378::__init__::232::IOProcess::(_processLogs) (464913) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:40,834::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:40,836::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404114::DEBUG::2015-01-22 11:06:40,838::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:40,839::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:40,840::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404115::DEBUG::2015-01-22 11:06:40,842::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404115::DEBUG::2015-01-22 11:06:40,843::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:40,856::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:40,857::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:40,857::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:06:42,728::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:42,728::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:42,728::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:42,728::__init__::232::IOProcess::(_processLogs) (464914) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:42,729::__init__::232::IOProcess::(_processLogs) (464914) Queuing response Thread-63::DEBUG::2015-01-22 11:06:42,729::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:06:42,738::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000375602 s, 857 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:42,739::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:42,739::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:42,739::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:42,739::__init__::232::IOProcess::(_processLogs) (464915) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:42,739::__init__::232::IOProcess::(_processLogs) (464915) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:43,874::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:43,875::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404116::DEBUG::2015-01-22 11:06:43,878::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:43,879::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:43,880::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404117::DEBUG::2015-01-22 11:06:43,882::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404117::DEBUG::2015-01-22 11:06:43,883::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:45,863::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:45,864::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:45,871::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:46,911::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:46,912::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404118::DEBUG::2015-01-22 11:06:46,914::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:46,915::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:46,916::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404119::DEBUG::2015-01-22 11:06:46,918::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404119::DEBUG::2015-01-22 11:06:46,919::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:06:49,380::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:49,380::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:49,380::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:49,380::__init__::232::IOProcess::(_processLogs) (464916) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:49,383::__init__::232::IOProcess::(_processLogs) (464916) Queuing response Thread-64::DEBUG::2015-01-22 11:06:49,384::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:06:49,394::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000518499 s, 895 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:49,395::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:49,395::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:49,395::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:49,395::__init__::232::IOProcess::(_processLogs) (464917) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:49,395::__init__::232::IOProcess::(_processLogs) (464917) Queuing response Thread-21::DEBUG::2015-01-22 11:06:49,396::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:49,396::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:49,397::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:49,397::__init__::232::IOProcess::(_processLogs) (464918) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:49,398::__init__::232::IOProcess::(_processLogs) (464918) Queuing response Thread-21::DEBUG::2015-01-22 11:06:49,399::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:49,399::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:49,399::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:49,399::__init__::232::IOProcess::(_processLogs) (464919) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:49,399::__init__::232::IOProcess::(_processLogs) (464919) Queuing response Thread-21::DEBUG::2015-01-22 11:06:49,400::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:49,400::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:49,400::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:49,400::__init__::232::IOProcess::(_processLogs) (464920) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:49,400::__init__::232::IOProcess::(_processLogs) (464920) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:49,946::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:49,947::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404120::DEBUG::2015-01-22 11:06:49,949::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:49,950::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:49,952::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404121::DEBUG::2015-01-22 11:06:49,953::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404121::DEBUG::2015-01-22 11:06:49,954::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:50,877::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:50,877::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:50,885::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:06:52,741::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:52,741::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:52,741::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:52,742::__init__::232::IOProcess::(_processLogs) (464921) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:52,742::__init__::232::IOProcess::(_processLogs) (464921) Queuing response Thread-63::DEBUG::2015-01-22 11:06:52,742::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:06:52,750::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000249788 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:52,751::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:52,751::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:52,751::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:52,751::__init__::232::IOProcess::(_processLogs) (464922) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:52,751::__init__::232::IOProcess::(_processLogs) (464922) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:52,982::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:52,983::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404122::DEBUG::2015-01-22 11:06:52,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`6242909a-f05d-4c43-a0a3-a875172d2c86`::moving from state init -> state preparing Thread-404122::INFO::2015-01-22 11:06:52,987::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404122::INFO::2015-01-22 11:06:52,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249788', 'lastCheck': '0.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518499', 'lastCheck': '3.6', 'valid': True}} Thread-404122::DEBUG::2015-01-22 11:06:52,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`6242909a-f05d-4c43-a0a3-a875172d2c86`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249788', 'lastCheck': '0.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518499', 'lastCheck': '3.6', 'valid': True}} Thread-404122::DEBUG::2015-01-22 11:06:52,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`6242909a-f05d-4c43-a0a3-a875172d2c86`::moving from state preparing -> state finished Thread-404122::DEBUG::2015-01-22 11:06:52,987::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404122::DEBUG::2015-01-22 11:06:52,987::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404122::DEBUG::2015-01-22 11:06:52,988::task::993::Storage.TaskManager.Task::(_decref) Task=`6242909a-f05d-4c43-a0a3-a875172d2c86`::ref 0 aborting False Thread-404122::ERROR::2015-01-22 11:06:52,994::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404122::DEBUG::2015-01-22 11:06:52,997::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:53,007::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:53,008::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404123::DEBUG::2015-01-22 11:06:53,010::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404123::DEBUG::2015-01-22 11:06:53,011::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:06:55,891::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:55,892::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:06:55,902::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:56,067::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:56,068::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404124::DEBUG::2015-01-22 11:06:56,070::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:56,071::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:56,072::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404125::DEBUG::2015-01-22 11:06:56,074::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404125::DEBUG::2015-01-22 11:06:56,075::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:06:58,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`74f58847-7e15-4d8b-ad6e-55e95f631c14`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:06:58,069::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:06:58,070::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:58,070::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:58,070::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:58,070::__init__::232::IOProcess::(_processLogs) (464923) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:06:58,073::__init__::232::IOProcess::(_processLogs) (464923) Queuing response Thread-21::DEBUG::2015-01-22 11:06:58,074::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:58,074::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:58,074::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:58,074::__init__::232::IOProcess::(_processLogs) (464924) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:06:58,074::__init__::232::IOProcess::(_processLogs) (464924) Queuing response Thread-360::INFO::2015-01-22 11:06:58,075::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:06:58,075::task::1191::Storage.TaskManager.Task::(prepare) Task=`74f58847-7e15-4d8b-ad6e-55e95f631c14`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:06:58,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`74f58847-7e15-4d8b-ad6e-55e95f631c14`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:06:58,075::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:06:58,075::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:06:58,076::task::993::Storage.TaskManager.Task::(_decref) Task=`74f58847-7e15-4d8b-ad6e-55e95f631c14`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:59,103::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:59,104::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404126::DEBUG::2015-01-22 11:06:59,106::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:06:59,108::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:06:59,109::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404127::DEBUG::2015-01-22 11:06:59,111::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404127::DEBUG::2015-01-22 11:06:59,112::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:06:59,401::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:59,402::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:59,402::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:59,402::__init__::232::IOProcess::(_processLogs) (464925) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:59,403::__init__::232::IOProcess::(_processLogs) (464925) Queuing response Thread-64::DEBUG::2015-01-22 11:06:59,404::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:06:59,413::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000578873 s, 802 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:06:59,414::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:59,414::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:59,414::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:59,414::__init__::232::IOProcess::(_processLogs) (464926) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:06:59,415::__init__::232::IOProcess::(_processLogs) (464926) Queuing response Thread-21::DEBUG::2015-01-22 11:06:59,415::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:59,416::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:59,416::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:59,416::__init__::232::IOProcess::(_processLogs) (464927) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:59,416::__init__::232::IOProcess::(_processLogs) (464927) Queuing response Thread-21::DEBUG::2015-01-22 11:06:59,417::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:59,417::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:59,418::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:59,418::__init__::232::IOProcess::(_processLogs) (464928) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:59,418::__init__::232::IOProcess::(_processLogs) (464928) Queuing response Thread-21::DEBUG::2015-01-22 11:06:59,419::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:06:59,419::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:06:59,419::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:06:59,419::__init__::232::IOProcess::(_processLogs) (464929) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:06:59,420::__init__::232::IOProcess::(_processLogs) (464929) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:00,908::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:00,909::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:00,913::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:02,140::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:02,141::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404128::DEBUG::2015-01-22 11:07:02,143::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:02,144::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:02,145::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404129::DEBUG::2015-01-22 11:07:02,147::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404129::DEBUG::2015-01-22 11:07:02,148::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:07:02,753::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:02,753::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:02,753::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:02,753::__init__::232::IOProcess::(_processLogs) (464930) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:02,753::__init__::232::IOProcess::(_processLogs) (464930) Queuing response Thread-63::DEBUG::2015-01-22 11:07:02,754::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:07:02,762::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000248906 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:02,763::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:02,763::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:02,763::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:02,764::__init__::232::IOProcess::(_processLogs) (464931) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:02,764::__init__::232::IOProcess::(_processLogs) (464931) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:05,180::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:05,181::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404130::DEBUG::2015-01-22 11:07:05,184::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:05,185::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:05,186::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404131::DEBUG::2015-01-22 11:07:05,188::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404131::DEBUG::2015-01-22 11:07:05,189::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:05,919::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:05,920::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:05,927::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:07:07,863::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:08,216::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:08,218::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404132::DEBUG::2015-01-22 11:07:08,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a295763-6de9-449a-ba7e-0bb448bcb97f`::moving from state init -> state preparing Thread-404132::INFO::2015-01-22 11:07:08,221::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404132::INFO::2015-01-22 11:07:08,221::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000248906', 'lastCheck': '5.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578873', 'lastCheck': '8.8', 'valid': True}} Thread-404132::DEBUG::2015-01-22 11:07:08,221::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a295763-6de9-449a-ba7e-0bb448bcb97f`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000248906', 'lastCheck': '5.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578873', 'lastCheck': '8.8', 'valid': True}} Thread-404132::DEBUG::2015-01-22 11:07:08,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a295763-6de9-449a-ba7e-0bb448bcb97f`::moving from state preparing -> state finished Thread-404132::DEBUG::2015-01-22 11:07:08,222::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404132::DEBUG::2015-01-22 11:07:08,222::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404132::DEBUG::2015-01-22 11:07:08,222::task::993::Storage.TaskManager.Task::(_decref) Task=`0a295763-6de9-449a-ba7e-0bb448bcb97f`::ref 0 aborting False Thread-404132::ERROR::2015-01-22 11:07:08,223::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404132::DEBUG::2015-01-22 11:07:08,225::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:08,232::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:08,233::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404133::DEBUG::2015-01-22 11:07:08,235::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404133::DEBUG::2015-01-22 11:07:08,236::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:07:09,421::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:09,421::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:09,421::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:09,422::__init__::232::IOProcess::(_processLogs) (464932) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:09,424::__init__::232::IOProcess::(_processLogs) (464932) Queuing response Thread-64::DEBUG::2015-01-22 11:07:09,424::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:07:09,433::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000540319 s, 859 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:09,434::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:09,434::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:09,434::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:09,434::__init__::232::IOProcess::(_processLogs) (464933) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:09,434::__init__::232::IOProcess::(_processLogs) (464933) Queuing response Thread-21::DEBUG::2015-01-22 11:07:09,435::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:09,435::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:09,435::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:09,435::__init__::232::IOProcess::(_processLogs) (464934) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:09,436::__init__::232::IOProcess::(_processLogs) (464934) Queuing response Thread-21::DEBUG::2015-01-22 11:07:09,436::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:09,436::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:09,437::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:09,437::__init__::232::IOProcess::(_processLogs) (464935) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:09,437::__init__::232::IOProcess::(_processLogs) (464935) Queuing response Thread-21::DEBUG::2015-01-22 11:07:09,438::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:09,438::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:09,438::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:09,438::__init__::232::IOProcess::(_processLogs) (464936) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:09,438::__init__::232::IOProcess::(_processLogs) (464936) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:10,933::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:10,934::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:10,944::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:11,301::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:11,302::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404134::DEBUG::2015-01-22 11:07:11,304::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:11,305::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:11,307::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404135::DEBUG::2015-01-22 11:07:11,308::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404135::DEBUG::2015-01-22 11:07:11,309::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:07:12,765::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:12,766::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:12,766::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:12,766::__init__::232::IOProcess::(_processLogs) (464937) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:12,766::__init__::232::IOProcess::(_processLogs) (464937) Queuing response Thread-63::DEBUG::2015-01-22 11:07:12,767::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:07:12,775::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000260746 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:12,776::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:12,776::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:12,776::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:12,776::__init__::232::IOProcess::(_processLogs) (464938) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:12,776::__init__::232::IOProcess::(_processLogs) (464938) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:14,342::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:14,344::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404136::DEBUG::2015-01-22 11:07:14,346::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:14,347::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:14,348::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404137::DEBUG::2015-01-22 11:07:14,350::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404137::DEBUG::2015-01-22 11:07:14,351::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:15,950::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:15,951::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:15,962::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:17,377::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:17,380::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404138::DEBUG::2015-01-22 11:07:17,384::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:17,386::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:17,390::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404139::DEBUG::2015-01-22 11:07:17,393::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404139::DEBUG::2015-01-22 11:07:17,400::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:07:19,440::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:19,440::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:19,440::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:19,441::__init__::232::IOProcess::(_processLogs) (464939) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:19,442::__init__::232::IOProcess::(_processLogs) (464939) Queuing response Thread-64::DEBUG::2015-01-22 11:07:19,443::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:07:19,453::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000573387 s, 809 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:19,453::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:19,454::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:19,454::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:19,454::__init__::232::IOProcess::(_processLogs) (464940) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:19,454::__init__::232::IOProcess::(_processLogs) (464940) Queuing response Thread-21::DEBUG::2015-01-22 11:07:19,455::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:19,455::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:19,455::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:19,455::__init__::232::IOProcess::(_processLogs) (464941) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:19,456::__init__::232::IOProcess::(_processLogs) (464941) Queuing response Thread-21::DEBUG::2015-01-22 11:07:19,457::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:19,457::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:19,457::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:19,457::__init__::232::IOProcess::(_processLogs) (464942) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:19,457::__init__::232::IOProcess::(_processLogs) (464942) Queuing response Thread-21::DEBUG::2015-01-22 11:07:19,458::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:19,459::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:19,459::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:19,459::__init__::232::IOProcess::(_processLogs) (464943) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:19,459::__init__::232::IOProcess::(_processLogs) (464943) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:20,429::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:20,431::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404140::DEBUG::2015-01-22 11:07:20,433::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:20,434::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:20,435::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404141::DEBUG::2015-01-22 11:07:20,437::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404141::DEBUG::2015-01-22 11:07:20,438::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:20,968::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:20,969::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:20,977::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:07:22,778::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:22,778::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:22,778::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:22,778::__init__::232::IOProcess::(_processLogs) (464944) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:22,779::__init__::232::IOProcess::(_processLogs) (464944) Queuing response Thread-63::DEBUG::2015-01-22 11:07:22,779::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:07:22,787::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000255196 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:22,788::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:22,788::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:22,788::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:22,789::__init__::232::IOProcess::(_processLogs) (464945) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:22,789::__init__::232::IOProcess::(_processLogs) (464945) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:23,465::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:23,467::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404142::DEBUG::2015-01-22 11:07:23,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f21943b-4e7a-45da-9e0f-b488cff38c73`::moving from state init -> state preparing Thread-404142::INFO::2015-01-22 11:07:23,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404142::INFO::2015-01-22 11:07:23,472::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255196', 'lastCheck': '0.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573387', 'lastCheck': '4.0', 'valid': True}} Thread-404142::DEBUG::2015-01-22 11:07:23,472::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f21943b-4e7a-45da-9e0f-b488cff38c73`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255196', 'lastCheck': '0.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573387', 'lastCheck': '4.0', 'valid': True}} Thread-404142::DEBUG::2015-01-22 11:07:23,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f21943b-4e7a-45da-9e0f-b488cff38c73`::moving from state preparing -> state finished Thread-404142::DEBUG::2015-01-22 11:07:23,472::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404142::DEBUG::2015-01-22 11:07:23,473::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404142::DEBUG::2015-01-22 11:07:23,473::task::993::Storage.TaskManager.Task::(_decref) Task=`4f21943b-4e7a-45da-9e0f-b488cff38c73`::ref 0 aborting False Thread-404142::ERROR::2015-01-22 11:07:23,474::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404142::DEBUG::2015-01-22 11:07:23,476::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:23,485::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:23,486::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404143::DEBUG::2015-01-22 11:07:23,488::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404143::DEBUG::2015-01-22 11:07:23,489::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:25,984::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:25,984::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:25,995::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:26,562::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:26,562::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404144::DEBUG::2015-01-22 11:07:26,564::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:26,565::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:26,566::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404145::DEBUG::2015-01-22 11:07:26,568::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404145::DEBUG::2015-01-22 11:07:26,569::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:07:29,461::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:29,461::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:29,461::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:29,462::__init__::232::IOProcess::(_processLogs) (464946) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:29,463::__init__::232::IOProcess::(_processLogs) (464946) Queuing response Thread-64::DEBUG::2015-01-22 11:07:29,464::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:07:29,474::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000614619 s, 755 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:29,474::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:29,475::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:29,475::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:29,475::__init__::232::IOProcess::(_processLogs) (464947) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:29,475::__init__::232::IOProcess::(_processLogs) (464947) Queuing response Thread-21::DEBUG::2015-01-22 11:07:29,476::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:29,476::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:29,476::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:29,476::__init__::232::IOProcess::(_processLogs) (464948) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:29,476::__init__::232::IOProcess::(_processLogs) (464948) Queuing response Thread-21::DEBUG::2015-01-22 11:07:29,477::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:29,477::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:29,477::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:29,477::__init__::232::IOProcess::(_processLogs) (464949) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:29,478::__init__::232::IOProcess::(_processLogs) (464949) Queuing response Thread-21::DEBUG::2015-01-22 11:07:29,479::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:29,479::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:29,479::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:29,479::__init__::232::IOProcess::(_processLogs) (464950) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:29,479::__init__::232::IOProcess::(_processLogs) (464950) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:29,600::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:29,601::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404146::DEBUG::2015-01-22 11:07:29,604::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:29,605::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:29,606::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404147::DEBUG::2015-01-22 11:07:29,607::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404147::DEBUG::2015-01-22 11:07:29,608::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:31,001::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:31,001::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:31,008::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:32,639::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:32,640::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404148::DEBUG::2015-01-22 11:07:32,642::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:32,643::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:32,644::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404149::DEBUG::2015-01-22 11:07:32,645::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404149::DEBUG::2015-01-22 11:07:32,646::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:07:32,790::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:32,791::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:32,791::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:32,791::__init__::232::IOProcess::(_processLogs) (464951) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:32,791::__init__::232::IOProcess::(_processLogs) (464951) Queuing response Thread-63::DEBUG::2015-01-22 11:07:32,792::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:07:32,801::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00036751 s, 876 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:32,802::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:32,802::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:32,802::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:32,802::__init__::232::IOProcess::(_processLogs) (464952) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:32,802::__init__::232::IOProcess::(_processLogs) (464952) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:35,673::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:35,675::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404150::DEBUG::2015-01-22 11:07:35,677::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:35,678::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:35,680::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404151::DEBUG::2015-01-22 11:07:35,681::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404151::DEBUG::2015-01-22 11:07:35,682::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:36,014::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:36,015::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:36,022::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:07:37,897::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:38,712::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:38,713::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404152::DEBUG::2015-01-22 11:07:38,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcc0bf8c-1cb9-4172-bddc-345a9ac03b31`::moving from state init -> state preparing Thread-404152::INFO::2015-01-22 11:07:38,717::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404152::INFO::2015-01-22 11:07:38,717::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00036751', 'lastCheck': '5.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614619', 'lastCheck': '9.2', 'valid': True}} Thread-404152::DEBUG::2015-01-22 11:07:38,717::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcc0bf8c-1cb9-4172-bddc-345a9ac03b31`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00036751', 'lastCheck': '5.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614619', 'lastCheck': '9.2', 'valid': True}} Thread-404152::DEBUG::2015-01-22 11:07:38,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcc0bf8c-1cb9-4172-bddc-345a9ac03b31`::moving from state preparing -> state finished Thread-404152::DEBUG::2015-01-22 11:07:38,718::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404152::DEBUG::2015-01-22 11:07:38,718::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404152::DEBUG::2015-01-22 11:07:38,718::task::993::Storage.TaskManager.Task::(_decref) Task=`bcc0bf8c-1cb9-4172-bddc-345a9ac03b31`::ref 0 aborting False Thread-404152::ERROR::2015-01-22 11:07:38,719::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404152::DEBUG::2015-01-22 11:07:38,721::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:38,730::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:38,731::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404153::DEBUG::2015-01-22 11:07:38,733::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404153::DEBUG::2015-01-22 11:07:38,734::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:07:39,481::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:39,481::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:39,481::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:39,481::__init__::232::IOProcess::(_processLogs) (464953) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:39,483::__init__::232::IOProcess::(_processLogs) (464953) Queuing response Thread-64::DEBUG::2015-01-22 11:07:39,484::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:07:39,493::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000627 s, 740 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:39,494::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:39,494::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:39,494::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:39,495::__init__::232::IOProcess::(_processLogs) (464954) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:39,495::__init__::232::IOProcess::(_processLogs) (464954) Queuing response Thread-21::DEBUG::2015-01-22 11:07:39,496::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:39,496::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:39,496::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:39,496::__init__::232::IOProcess::(_processLogs) (464955) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:39,496::__init__::232::IOProcess::(_processLogs) (464955) Queuing response Thread-21::DEBUG::2015-01-22 11:07:39,497::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:39,498::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:39,498::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:39,498::__init__::232::IOProcess::(_processLogs) (464956) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:39,499::__init__::232::IOProcess::(_processLogs) (464956) Queuing response Thread-21::DEBUG::2015-01-22 11:07:39,499::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:39,500::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:39,500::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:39,500::__init__::232::IOProcess::(_processLogs) (464957) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:39,500::__init__::232::IOProcess::(_processLogs) (464957) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:41,029::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:41,029::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:41,041::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:41,793::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:41,794::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404154::DEBUG::2015-01-22 11:07:41,796::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:41,797::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:41,798::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404155::DEBUG::2015-01-22 11:07:41,800::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404155::DEBUG::2015-01-22 11:07:41,801::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:07:42,804::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:42,804::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:42,804::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:42,804::__init__::232::IOProcess::(_processLogs) (464958) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:42,804::__init__::232::IOProcess::(_processLogs) (464958) Queuing response Thread-63::DEBUG::2015-01-22 11:07:42,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:07:42,813::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000265289 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:42,814::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:42,814::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:42,815::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:42,815::__init__::232::IOProcess::(_processLogs) (464959) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:42,815::__init__::232::IOProcess::(_processLogs) (464959) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:44,828::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:44,830::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404156::DEBUG::2015-01-22 11:07:44,833::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:44,834::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:44,835::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404157::DEBUG::2015-01-22 11:07:44,837::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404157::DEBUG::2015-01-22 11:07:44,838::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:46,047::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:46,047::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:46,056::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:47,869::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:47,871::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404158::DEBUG::2015-01-22 11:07:47,875::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:47,878::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:47,881::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404159::DEBUG::2015-01-22 11:07:47,884::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404159::DEBUG::2015-01-22 11:07:47,891::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:07:49,502::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:49,502::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:49,503::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:49,503::__init__::232::IOProcess::(_processLogs) (464960) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:49,504::__init__::232::IOProcess::(_processLogs) (464960) Queuing response Thread-64::DEBUG::2015-01-22 11:07:49,505::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:07:49,513::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000478157 s, 970 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:49,514::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:49,514::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:49,514::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:49,514::__init__::232::IOProcess::(_processLogs) (464961) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:49,515::__init__::232::IOProcess::(_processLogs) (464961) Queuing response Thread-21::DEBUG::2015-01-22 11:07:49,516::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:49,516::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:49,516::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:49,516::__init__::232::IOProcess::(_processLogs) (464962) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:49,516::__init__::232::IOProcess::(_processLogs) (464962) Queuing response Thread-21::DEBUG::2015-01-22 11:07:49,517::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:49,517::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:49,517::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:49,518::__init__::232::IOProcess::(_processLogs) (464963) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:49,518::__init__::232::IOProcess::(_processLogs) (464963) Queuing response Thread-21::DEBUG::2015-01-22 11:07:49,518::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:49,519::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:49,519::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:49,519::__init__::232::IOProcess::(_processLogs) (464964) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:49,519::__init__::232::IOProcess::(_processLogs) (464964) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:50,921::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:50,922::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404160::DEBUG::2015-01-22 11:07:50,924::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:50,925::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:50,926::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404161::DEBUG::2015-01-22 11:07:50,928::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404161::DEBUG::2015-01-22 11:07:50,929::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:51,061::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:51,062::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:51,070::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:07:52,816::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:52,817::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:52,817::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:52,817::__init__::232::IOProcess::(_processLogs) (464965) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:52,817::__init__::232::IOProcess::(_processLogs) (464965) Queuing response Thread-63::DEBUG::2015-01-22 11:07:52,818::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:07:52,826::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000248628 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:52,827::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:52,827::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:52,827::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:52,827::__init__::232::IOProcess::(_processLogs) (464966) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:52,827::__init__::232::IOProcess::(_processLogs) (464966) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:53,955::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:53,957::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404162::DEBUG::2015-01-22 11:07:53,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`04ab3cca-a0d0-4bf0-bd07-14d3cebe86e7`::moving from state init -> state preparing Thread-404162::INFO::2015-01-22 11:07:53,960::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404162::INFO::2015-01-22 11:07:53,960::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000248628', 'lastCheck': '1.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478157', 'lastCheck': '4.4', 'valid': True}} Thread-404162::DEBUG::2015-01-22 11:07:53,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`04ab3cca-a0d0-4bf0-bd07-14d3cebe86e7`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000248628', 'lastCheck': '1.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478157', 'lastCheck': '4.4', 'valid': True}} Thread-404162::DEBUG::2015-01-22 11:07:53,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`04ab3cca-a0d0-4bf0-bd07-14d3cebe86e7`::moving from state preparing -> state finished Thread-404162::DEBUG::2015-01-22 11:07:53,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404162::DEBUG::2015-01-22 11:07:53,961::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404162::DEBUG::2015-01-22 11:07:53,961::task::993::Storage.TaskManager.Task::(_decref) Task=`04ab3cca-a0d0-4bf0-bd07-14d3cebe86e7`::ref 0 aborting False Thread-404162::ERROR::2015-01-22 11:07:53,962::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404162::DEBUG::2015-01-22 11:07:53,964::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:53,973::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:53,974::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404163::DEBUG::2015-01-22 11:07:53,976::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404163::DEBUG::2015-01-22 11:07:53,977::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:07:56,076::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:56,077::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:07:56,087::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:57,036::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:57,037::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404164::DEBUG::2015-01-22 11:07:57,039::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:07:57,040::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:07:57,041::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404165::DEBUG::2015-01-22 11:07:57,043::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404165::DEBUG::2015-01-22 11:07:57,043::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:07:58,154::task::595::Storage.TaskManager.Task::(_updateState) Task=`6951baf1-debd-4ba1-9085-afb086451f55`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:07:58,155::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:07:58,155::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:58,156::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:58,156::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:58,156::__init__::232::IOProcess::(_processLogs) (464967) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:07:58,158::__init__::232::IOProcess::(_processLogs) (464967) Queuing response Thread-21::DEBUG::2015-01-22 11:07:58,159::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:58,159::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:58,160::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:58,160::__init__::232::IOProcess::(_processLogs) (464968) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:07:58,160::__init__::232::IOProcess::(_processLogs) (464968) Queuing response Thread-360::INFO::2015-01-22 11:07:58,160::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:07:58,161::task::1191::Storage.TaskManager.Task::(prepare) Task=`6951baf1-debd-4ba1-9085-afb086451f55`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:07:58,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`6951baf1-debd-4ba1-9085-afb086451f55`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:07:58,161::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:07:58,161::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:07:58,161::task::993::Storage.TaskManager.Task::(_decref) Task=`6951baf1-debd-4ba1-9085-afb086451f55`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:07:59,521::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:59,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:59,521::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:59,521::__init__::232::IOProcess::(_processLogs) (464969) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:59,522::__init__::232::IOProcess::(_processLogs) (464969) Queuing response Thread-64::DEBUG::2015-01-22 11:07:59,523::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:07:59,532::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000483731 s, 959 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:07:59,532::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:59,533::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:59,533::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:59,533::__init__::232::IOProcess::(_processLogs) (464970) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:07:59,533::__init__::232::IOProcess::(_processLogs) (464970) Queuing response Thread-21::DEBUG::2015-01-22 11:07:59,534::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:59,534::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:59,534::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:59,534::__init__::232::IOProcess::(_processLogs) (464971) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:59,535::__init__::232::IOProcess::(_processLogs) (464971) Queuing response Thread-21::DEBUG::2015-01-22 11:07:59,536::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:59,536::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:59,536::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:59,536::__init__::232::IOProcess::(_processLogs) (464972) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:59,536::__init__::232::IOProcess::(_processLogs) (464972) Queuing response Thread-21::DEBUG::2015-01-22 11:07:59,537::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:07:59,537::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:07:59,538::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:07:59,538::__init__::232::IOProcess::(_processLogs) (464973) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:07:59,539::__init__::232::IOProcess::(_processLogs) (464973) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:00,072::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:00,073::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404166::DEBUG::2015-01-22 11:08:00,076::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:00,077::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:00,078::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404167::DEBUG::2015-01-22 11:08:00,080::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404167::DEBUG::2015-01-22 11:08:00,081::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:01,093::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:01,094::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:01,101::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:08:02,829::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:02,829::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:02,829::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:02,829::__init__::232::IOProcess::(_processLogs) (464974) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:02,829::__init__::232::IOProcess::(_processLogs) (464974) Queuing response Thread-63::DEBUG::2015-01-22 11:08:02,830::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:08:02,839::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000314572 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:02,840::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:02,840::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:02,840::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:02,840::__init__::232::IOProcess::(_processLogs) (464975) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:02,841::__init__::232::IOProcess::(_processLogs) (464975) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:03,108::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:03,109::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404168::DEBUG::2015-01-22 11:08:03,112::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:03,113::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:03,115::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404169::DEBUG::2015-01-22 11:08:03,116::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404169::DEBUG::2015-01-22 11:08:03,117::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:06,107::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:06,108::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:06,108::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:06,145::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:06,146::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404170::DEBUG::2015-01-22 11:08:06,150::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:06,151::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:06,152::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404171::DEBUG::2015-01-22 11:08:06,154::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404171::DEBUG::2015-01-22 11:08:06,155::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:08:07,934::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:09,183::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:09,185::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404172::DEBUG::2015-01-22 11:08:09,188::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf1d2a05-f3fc-4802-85de-52437577ed49`::moving from state init -> state preparing Thread-404172::INFO::2015-01-22 11:08:09,188::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404172::INFO::2015-01-22 11:08:09,188::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314572', 'lastCheck': '6.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483731', 'lastCheck': '9.6', 'valid': True}} Thread-404172::DEBUG::2015-01-22 11:08:09,189::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf1d2a05-f3fc-4802-85de-52437577ed49`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314572', 'lastCheck': '6.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483731', 'lastCheck': '9.6', 'valid': True}} Thread-404172::DEBUG::2015-01-22 11:08:09,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf1d2a05-f3fc-4802-85de-52437577ed49`::moving from state preparing -> state finished Thread-404172::DEBUG::2015-01-22 11:08:09,189::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404172::DEBUG::2015-01-22 11:08:09,189::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404172::DEBUG::2015-01-22 11:08:09,189::task::993::Storage.TaskManager.Task::(_decref) Task=`cf1d2a05-f3fc-4802-85de-52437577ed49`::ref 0 aborting False Thread-404172::ERROR::2015-01-22 11:08:09,190::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404172::DEBUG::2015-01-22 11:08:09,193::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:09,201::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:09,203::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404173::DEBUG::2015-01-22 11:08:09,205::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404173::DEBUG::2015-01-22 11:08:09,206::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:08:09,540::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:09,540::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:09,541::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:09,541::__init__::232::IOProcess::(_processLogs) (464976) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:09,542::__init__::232::IOProcess::(_processLogs) (464976) Queuing response Thread-64::DEBUG::2015-01-22 11:08:09,543::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:08:09,551::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000565843 s, 820 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:09,552::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:09,552::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:09,552::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:09,552::__init__::232::IOProcess::(_processLogs) (464977) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:09,553::__init__::232::IOProcess::(_processLogs) (464977) Queuing response Thread-21::DEBUG::2015-01-22 11:08:09,554::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:09,554::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:09,554::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:09,554::__init__::232::IOProcess::(_processLogs) (464978) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:09,554::__init__::232::IOProcess::(_processLogs) (464978) Queuing response Thread-21::DEBUG::2015-01-22 11:08:09,556::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:09,556::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:09,556::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:09,556::__init__::232::IOProcess::(_processLogs) (464979) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:09,557::__init__::232::IOProcess::(_processLogs) (464979) Queuing response Thread-21::DEBUG::2015-01-22 11:08:09,558::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:09,558::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:09,558::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:09,558::__init__::232::IOProcess::(_processLogs) (464980) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:09,558::__init__::232::IOProcess::(_processLogs) (464980) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:11,114::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:11,115::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:11,126::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:12,273::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:12,274::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404174::DEBUG::2015-01-22 11:08:12,276::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:12,277::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:12,278::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404175::DEBUG::2015-01-22 11:08:12,280::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404175::DEBUG::2015-01-22 11:08:12,281::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:08:12,842::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:12,842::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:12,842::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:12,842::__init__::232::IOProcess::(_processLogs) (464981) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:12,843::__init__::232::IOProcess::(_processLogs) (464981) Queuing response Thread-63::DEBUG::2015-01-22 11:08:12,843::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:08:12,852::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000299766 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:12,853::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:12,853::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:12,853::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:12,853::__init__::232::IOProcess::(_processLogs) (464982) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:12,853::__init__::232::IOProcess::(_processLogs) (464982) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:15,313::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:15,315::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404176::DEBUG::2015-01-22 11:08:15,318::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:15,319::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:15,320::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404177::DEBUG::2015-01-22 11:08:15,322::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404177::DEBUG::2015-01-22 11:08:15,323::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:16,132::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:16,133::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:16,139::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:18,352::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:18,353::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404178::DEBUG::2015-01-22 11:08:18,354::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:18,355::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:18,356::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404179::DEBUG::2015-01-22 11:08:18,357::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404179::DEBUG::2015-01-22 11:08:18,358::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:08:19,560::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:19,560::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:19,560::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:19,560::__init__::232::IOProcess::(_processLogs) (464983) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:19,561::__init__::232::IOProcess::(_processLogs) (464983) Queuing response Thread-64::DEBUG::2015-01-22 11:08:19,562::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:08:19,571::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000504167 s, 920 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:19,571::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:19,571::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:19,572::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:19,572::__init__::232::IOProcess::(_processLogs) (464984) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:19,572::__init__::232::IOProcess::(_processLogs) (464984) Queuing response Thread-21::DEBUG::2015-01-22 11:08:19,573::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:19,573::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:19,573::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:19,573::__init__::232::IOProcess::(_processLogs) (464985) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:19,573::__init__::232::IOProcess::(_processLogs) (464985) Queuing response Thread-21::DEBUG::2015-01-22 11:08:19,574::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:19,575::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:19,575::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:19,575::__init__::232::IOProcess::(_processLogs) (464986) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:19,575::__init__::232::IOProcess::(_processLogs) (464986) Queuing response Thread-21::DEBUG::2015-01-22 11:08:19,576::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:19,576::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:19,576::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:19,576::__init__::232::IOProcess::(_processLogs) (464987) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:19,577::__init__::232::IOProcess::(_processLogs) (464987) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:21,145::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:21,146::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:21,154::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:21,388::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:21,389::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404180::DEBUG::2015-01-22 11:08:21,391::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:21,392::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:21,393::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404181::DEBUG::2015-01-22 11:08:21,395::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404181::DEBUG::2015-01-22 11:08:21,396::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-63::DEBUG::2015-01-22 11:08:22,854::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d26c38f9-0719-457c-8ce0-a074d1eff534 Thread-21::DEBUG::2015-01-22 11:08:22,857::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:22,857::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:22,857::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:22,857::__init__::232::IOProcess::(_processLogs) (464988) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:08:22,858::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:22,858::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:22,858::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:22,858::__init__::232::IOProcess::(_processLogs) (464989) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:08:22,858::__init__::232::IOProcess::(_processLogs) (464988) Queuing response Thread-21::DEBUG::2015-01-22 11:08:22,862::__init__::232::IOProcess::(_processLogs) (464989) Queuing response Thread-63::DEBUG::2015-01-22 11:08:22,866::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534 Thread-21::DEBUG::2015-01-22 11:08:22,867::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:22,867::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:22,867::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:22,868::__init__::232::IOProcess::(_processLogs) (464990) Got request for method 'touch' Thread-21::DEBUG::2015-01-22 11:08:22,871::__init__::232::IOProcess::(_processLogs) (464990) Queuing response Thread-63::DEBUG::2015-01-22 11:08:22,872::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend Thread-21::DEBUG::2015-01-22 11:08:22,872::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:22,872::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:22,873::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:22,873::__init__::232::IOProcess::(_processLogs) (464991) Got request for method 'readfile' Thread-21::DEBUG::2015-01-22 11:08:22,873::__init__::232::IOProcess::(_processLogs) (464991) Queuing response Thread-63::DEBUG::2015-01-22 11:08:22,873::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISO', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=67c137fd-0cf2-463a-bc70-b427cc0a5da3', 'REMOTE_PATH=192.168.1.24:/Data/ISO', 'ROLE=Regular', 'SDUUID=d26c38f9-0719-457c-8ce0-a074d1eff534', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2e3c4b23cacb8bd1a5cc7cf85722fc990962eb40'] Thread-21::DEBUG::2015-01-22 11:08:22,874::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:22,874::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:22,874::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:22,874::__init__::232::IOProcess::(_processLogs) (464992) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:22,874::__init__::232::IOProcess::(_processLogs) (464992) Queuing response Thread-21::DEBUG::2015-01-22 11:08:22,875::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:22,875::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:22,875::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:22,875::__init__::232::IOProcess::(_processLogs) (464993) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:08:22,876::__init__::232::IOProcess::(_processLogs) (464993) Queuing response Thread-63::DEBUG::2015-01-22 11:08:22,876::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-63::INFO::2015-01-22 11:08:22,876::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d26c38f9-0719-457c-8ce0-a074d1eff534_imageNS already registered Thread-63::INFO::2015-01-22 11:08:22,877::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d26c38f9-0719-457c-8ce0-a074d1eff534_volumeNS already registered Thread-21::DEBUG::2015-01-22 11:08:22,877::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:22,877::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:22,877::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:22,877::__init__::232::IOProcess::(_processLogs) (464994) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:22,877::__init__::232::IOProcess::(_processLogs) (464994) Queuing response Thread-63::DEBUG::2015-01-22 11:08:22,878::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:08:22,886::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00025494 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:22,887::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:22,887::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:22,887::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:22,887::__init__::232::IOProcess::(_processLogs) (464995) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:22,887::__init__::232::IOProcess::(_processLogs) (464995) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:24,423::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:24,424::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404184::DEBUG::2015-01-22 11:08:24,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`57467c9d-6375-4369-9b56-4e20fcdbb96e`::moving from state init -> state preparing Thread-404184::INFO::2015-01-22 11:08:24,429::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404184::INFO::2015-01-22 11:08:24,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025494', 'lastCheck': '1.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504167', 'lastCheck': '4.9', 'valid': True}} Thread-404184::DEBUG::2015-01-22 11:08:24,429::task::1191::Storage.TaskManager.Task::(prepare) Task=`57467c9d-6375-4369-9b56-4e20fcdbb96e`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025494', 'lastCheck': '1.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504167', 'lastCheck': '4.9', 'valid': True}} Thread-404184::DEBUG::2015-01-22 11:08:24,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`57467c9d-6375-4369-9b56-4e20fcdbb96e`::moving from state preparing -> state finished Thread-404184::DEBUG::2015-01-22 11:08:24,429::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404184::DEBUG::2015-01-22 11:08:24,429::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404184::DEBUG::2015-01-22 11:08:24,429::task::993::Storage.TaskManager.Task::(_decref) Task=`57467c9d-6375-4369-9b56-4e20fcdbb96e`::ref 0 aborting False Thread-404184::ERROR::2015-01-22 11:08:24,430::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404184::DEBUG::2015-01-22 11:08:24,433::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:24,441::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:24,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404185::DEBUG::2015-01-22 11:08:24,444::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404185::DEBUG::2015-01-22 11:08:24,445::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:26,156::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:26,157::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:26,167::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:27,498::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:27,500::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404186::DEBUG::2015-01-22 11:08:27,501::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:27,502::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:27,504::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404187::DEBUG::2015-01-22 11:08:27,505::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404187::DEBUG::2015-01-22 11:08:27,506::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:08:29,579::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:29,579::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:29,579::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:29,579::__init__::232::IOProcess::(_processLogs) (464996) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:29,581::__init__::232::IOProcess::(_processLogs) (464996) Queuing response Thread-64::DEBUG::2015-01-22 11:08:29,582::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:08:29,590::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000505785 s, 917 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:29,591::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:29,591::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:29,591::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:29,591::__init__::232::IOProcess::(_processLogs) (464997) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:29,591::__init__::232::IOProcess::(_processLogs) (464997) Queuing response Thread-21::DEBUG::2015-01-22 11:08:29,592::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:29,593::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:29,593::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:29,593::__init__::232::IOProcess::(_processLogs) (464998) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:29,594::__init__::232::IOProcess::(_processLogs) (464998) Queuing response Thread-21::DEBUG::2015-01-22 11:08:29,595::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:29,595::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:29,595::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:29,595::__init__::232::IOProcess::(_processLogs) (464999) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:29,595::__init__::232::IOProcess::(_processLogs) (464999) Queuing response Thread-21::DEBUG::2015-01-22 11:08:29,596::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:29,596::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:29,596::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:29,596::__init__::232::IOProcess::(_processLogs) (465000) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:29,597::__init__::232::IOProcess::(_processLogs) (465000) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:30,538::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:30,539::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404188::DEBUG::2015-01-22 11:08:30,542::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:30,543::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:30,544::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404189::DEBUG::2015-01-22 11:08:30,546::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404189::DEBUG::2015-01-22 11:08:30,547::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:31,173::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:31,174::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:31,181::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:08:32,889::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:32,889::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:32,889::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:32,890::__init__::232::IOProcess::(_processLogs) (465001) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:32,890::__init__::232::IOProcess::(_processLogs) (465001) Queuing response Thread-63::DEBUG::2015-01-22 11:08:32,890::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:08:32,899::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000268108 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:32,900::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:32,900::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:32,900::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:32,900::__init__::232::IOProcess::(_processLogs) (465002) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:32,900::__init__::232::IOProcess::(_processLogs) (465002) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:33,579::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:33,580::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404190::DEBUG::2015-01-22 11:08:33,583::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:33,584::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:33,585::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404191::DEBUG::2015-01-22 11:08:33,587::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404191::DEBUG::2015-01-22 11:08:33,588::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:36,188::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:36,188::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:36,197::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:36,619::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:36,621::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404192::DEBUG::2015-01-22 11:08:36,623::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:36,624::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:36,625::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404193::DEBUG::2015-01-22 11:08:36,627::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404193::DEBUG::2015-01-22 11:08:36,628::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:08:37,969::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:08:39,599::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:39,599::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:39,599::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:39,599::__init__::232::IOProcess::(_processLogs) (465003) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:39,601::__init__::232::IOProcess::(_processLogs) (465003) Queuing response Thread-64::DEBUG::2015-01-22 11:08:39,602::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:08:39,610::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000505378 s, 918 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:39,610::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:39,611::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:39,611::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:39,611::__init__::232::IOProcess::(_processLogs) (465004) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:39,611::__init__::232::IOProcess::(_processLogs) (465004) Queuing response Thread-21::DEBUG::2015-01-22 11:08:39,612::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:39,612::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:39,612::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:39,612::__init__::232::IOProcess::(_processLogs) (465005) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:39,613::__init__::232::IOProcess::(_processLogs) (465005) Queuing response Thread-21::DEBUG::2015-01-22 11:08:39,614::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:39,614::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:39,615::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:39,615::__init__::232::IOProcess::(_processLogs) (465006) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:39,615::__init__::232::IOProcess::(_processLogs) (465006) Queuing response Thread-21::DEBUG::2015-01-22 11:08:39,615::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:39,616::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:39,616::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:39,616::__init__::232::IOProcess::(_processLogs) (465007) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:39,616::__init__::232::IOProcess::(_processLogs) (465007) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:39,660::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:39,661::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404194::DEBUG::2015-01-22 11:08:39,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5a2c95c-b296-4531-bf18-bbdf9692d792`::moving from state init -> state preparing Thread-404194::INFO::2015-01-22 11:08:39,665::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404194::INFO::2015-01-22 11:08:39,665::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268108', 'lastCheck': '6.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505378', 'lastCheck': '0.0', 'valid': True}} Thread-404194::DEBUG::2015-01-22 11:08:39,665::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5a2c95c-b296-4531-bf18-bbdf9692d792`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268108', 'lastCheck': '6.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505378', 'lastCheck': '0.0', 'valid': True}} Thread-404194::DEBUG::2015-01-22 11:08:39,665::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5a2c95c-b296-4531-bf18-bbdf9692d792`::moving from state preparing -> state finished Thread-404194::DEBUG::2015-01-22 11:08:39,665::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404194::DEBUG::2015-01-22 11:08:39,665::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404194::DEBUG::2015-01-22 11:08:39,666::task::993::Storage.TaskManager.Task::(_decref) Task=`d5a2c95c-b296-4531-bf18-bbdf9692d792`::ref 0 aborting False Thread-404194::ERROR::2015-01-22 11:08:39,666::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404194::DEBUG::2015-01-22 11:08:39,669::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:39,677::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:39,679::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404195::DEBUG::2015-01-22 11:08:39,681::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404195::DEBUG::2015-01-22 11:08:39,682::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:41,201::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:41,202::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:41,211::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:42,731::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:42,732::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404196::DEBUG::2015-01-22 11:08:42,734::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:42,734::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:42,736::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404197::DEBUG::2015-01-22 11:08:42,737::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404197::DEBUG::2015-01-22 11:08:42,738::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:08:42,902::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:42,902::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:42,902::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:42,903::__init__::232::IOProcess::(_processLogs) (465008) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:42,903::__init__::232::IOProcess::(_processLogs) (465008) Queuing response Thread-63::DEBUG::2015-01-22 11:08:42,903::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:08:42,912::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000293194 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:42,913::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:42,913::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:42,913::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:42,913::__init__::232::IOProcess::(_processLogs) (465009) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:42,913::__init__::232::IOProcess::(_processLogs) (465009) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:45,770::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:45,772::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404198::DEBUG::2015-01-22 11:08:45,774::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:45,775::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:45,776::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404199::DEBUG::2015-01-22 11:08:45,778::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404199::DEBUG::2015-01-22 11:08:45,779::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:46,217::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:46,217::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:46,224::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:48,808::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:48,809::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404200::DEBUG::2015-01-22 11:08:48,811::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:48,812::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:48,813::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404201::DEBUG::2015-01-22 11:08:48,815::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404201::DEBUG::2015-01-22 11:08:48,815::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:08:49,618::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:49,618::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:49,618::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:49,618::__init__::232::IOProcess::(_processLogs) (465010) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:49,620::__init__::232::IOProcess::(_processLogs) (465010) Queuing response Thread-64::DEBUG::2015-01-22 11:08:49,621::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:08:49,629::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000552538 s, 840 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:49,629::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:49,630::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:49,630::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:49,630::__init__::232::IOProcess::(_processLogs) (465011) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:49,630::__init__::232::IOProcess::(_processLogs) (465011) Queuing response Thread-21::DEBUG::2015-01-22 11:08:49,631::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:49,631::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:49,631::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:49,631::__init__::232::IOProcess::(_processLogs) (465012) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:49,632::__init__::232::IOProcess::(_processLogs) (465012) Queuing response Thread-21::DEBUG::2015-01-22 11:08:49,633::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:49,633::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:49,633::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:49,633::__init__::232::IOProcess::(_processLogs) (465013) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:49,634::__init__::232::IOProcess::(_processLogs) (465013) Queuing response Thread-21::DEBUG::2015-01-22 11:08:49,634::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:49,634::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:49,635::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:49,635::__init__::232::IOProcess::(_processLogs) (465014) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:49,635::__init__::232::IOProcess::(_processLogs) (465014) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:51,230::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:51,231::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:51,239::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:51,841::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:51,842::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404202::DEBUG::2015-01-22 11:08:51,844::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:51,846::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:51,847::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404203::DEBUG::2015-01-22 11:08:51,849::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404203::DEBUG::2015-01-22 11:08:51,850::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:08:52,915::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:52,915::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:52,915::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:52,915::__init__::232::IOProcess::(_processLogs) (465015) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:52,916::__init__::232::IOProcess::(_processLogs) (465015) Queuing response Thread-63::DEBUG::2015-01-22 11:08:52,916::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:08:52,925::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000245393 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:52,926::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:52,926::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:52,926::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:52,926::__init__::232::IOProcess::(_processLogs) (465016) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:52,926::__init__::232::IOProcess::(_processLogs) (465016) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:54,878::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:54,880::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404204::DEBUG::2015-01-22 11:08:54,883::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e2e80d5-5c0a-4f2c-9575-20297cf51599`::moving from state init -> state preparing Thread-404204::INFO::2015-01-22 11:08:54,883::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404204::INFO::2015-01-22 11:08:54,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000245393', 'lastCheck': '2.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552538', 'lastCheck': '5.2', 'valid': True}} Thread-404204::DEBUG::2015-01-22 11:08:54,884::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e2e80d5-5c0a-4f2c-9575-20297cf51599`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000245393', 'lastCheck': '2.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552538', 'lastCheck': '5.2', 'valid': True}} Thread-404204::DEBUG::2015-01-22 11:08:54,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e2e80d5-5c0a-4f2c-9575-20297cf51599`::moving from state preparing -> state finished Thread-404204::DEBUG::2015-01-22 11:08:54,884::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404204::DEBUG::2015-01-22 11:08:54,884::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404204::DEBUG::2015-01-22 11:08:54,884::task::993::Storage.TaskManager.Task::(_decref) Task=`6e2e80d5-5c0a-4f2c-9575-20297cf51599`::ref 0 aborting False Thread-404204::ERROR::2015-01-22 11:08:54,885::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404204::DEBUG::2015-01-22 11:08:54,888::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:54,895::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:54,896::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404205::DEBUG::2015-01-22 11:08:54,898::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404205::DEBUG::2015-01-22 11:08:54,899::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:08:56,245::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:56,245::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:08:56,256::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:57,951::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:57,952::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404206::DEBUG::2015-01-22 11:08:57,954::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:08:57,955::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:08:57,956::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404207::DEBUG::2015-01-22 11:08:57,957::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404207::DEBUG::2015-01-22 11:08:57,958::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:08:58,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`37876bd4-0b55-4f6c-bde2-868b9d1348ee`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:08:58,245::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:08:58,246::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:58,246::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:58,246::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:58,246::__init__::232::IOProcess::(_processLogs) (465017) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:08:58,249::__init__::232::IOProcess::(_processLogs) (465017) Queuing response Thread-21::DEBUG::2015-01-22 11:08:58,250::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:58,251::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:58,251::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:58,251::__init__::232::IOProcess::(_processLogs) (465018) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:08:58,251::__init__::232::IOProcess::(_processLogs) (465018) Queuing response Thread-360::INFO::2015-01-22 11:08:58,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:08:58,252::task::1191::Storage.TaskManager.Task::(prepare) Task=`37876bd4-0b55-4f6c-bde2-868b9d1348ee`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:08:58,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`37876bd4-0b55-4f6c-bde2-868b9d1348ee`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:08:58,252::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:08:58,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:08:58,252::task::993::Storage.TaskManager.Task::(_decref) Task=`37876bd4-0b55-4f6c-bde2-868b9d1348ee`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:08:59,637::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:59,637::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:59,637::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:59,638::__init__::232::IOProcess::(_processLogs) (465019) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:59,639::__init__::232::IOProcess::(_processLogs) (465019) Queuing response Thread-64::DEBUG::2015-01-22 11:08:59,640::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:08:59,648::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000531945 s, 872 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:08:59,649::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:59,649::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:59,649::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:59,649::__init__::232::IOProcess::(_processLogs) (465020) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:08:59,649::__init__::232::IOProcess::(_processLogs) (465020) Queuing response Thread-21::DEBUG::2015-01-22 11:08:59,650::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:59,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:59,650::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:59,650::__init__::232::IOProcess::(_processLogs) (465021) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:59,651::__init__::232::IOProcess::(_processLogs) (465021) Queuing response Thread-21::DEBUG::2015-01-22 11:08:59,651::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:59,652::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:59,652::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:59,652::__init__::232::IOProcess::(_processLogs) (465022) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:59,653::__init__::232::IOProcess::(_processLogs) (465022) Queuing response Thread-21::DEBUG::2015-01-22 11:08:59,653::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:08:59,654::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:08:59,654::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:08:59,654::__init__::232::IOProcess::(_processLogs) (465023) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:08:59,654::__init__::232::IOProcess::(_processLogs) (465023) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:00,985::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:00,987::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404208::DEBUG::2015-01-22 11:09:00,989::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:00,990::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:00,991::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404209::DEBUG::2015-01-22 11:09:00,993::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404209::DEBUG::2015-01-22 11:09:00,994::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:01,262::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:01,263::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:01,271::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:09:02,928::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:02,928::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:02,928::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:02,928::__init__::232::IOProcess::(_processLogs) (465024) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:02,928::__init__::232::IOProcess::(_processLogs) (465024) Queuing response Thread-63::DEBUG::2015-01-22 11:09:02,929::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:09:02,938::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000295318 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:02,939::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:02,940::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:02,940::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:02,940::__init__::232::IOProcess::(_processLogs) (465025) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:02,940::__init__::232::IOProcess::(_processLogs) (465025) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:04,022::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:04,023::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404210::DEBUG::2015-01-22 11:09:04,026::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:04,027::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:04,027::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404211::DEBUG::2015-01-22 11:09:04,029::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404211::DEBUG::2015-01-22 11:09:04,030::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:06,278::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:06,278::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:06,285::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:07,060::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:07,062::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404212::DEBUG::2015-01-22 11:09:07,064::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:07,065::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:07,066::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404213::DEBUG::2015-01-22 11:09:07,068::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404213::DEBUG::2015-01-22 11:09:07,069::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:09:08,005::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:09:09,656::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:09,656::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:09,657::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:09,657::__init__::232::IOProcess::(_processLogs) (465026) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:09,658::__init__::232::IOProcess::(_processLogs) (465026) Queuing response Thread-64::DEBUG::2015-01-22 11:09:09,663::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:09:09,672::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000500471 s, 927 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:09,674::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:09,674::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:09,675::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:09,675::__init__::232::IOProcess::(_processLogs) (465027) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:09,677::__init__::232::IOProcess::(_processLogs) (465027) Queuing response Thread-21::DEBUG::2015-01-22 11:09:09,683::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:09,684::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:09,685::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:09,686::__init__::232::IOProcess::(_processLogs) (465028) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:09,686::__init__::232::IOProcess::(_processLogs) (465028) Queuing response Thread-21::DEBUG::2015-01-22 11:09:09,689::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:09,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:09,690::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:09,692::__init__::232::IOProcess::(_processLogs) (465029) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:09,693::__init__::232::IOProcess::(_processLogs) (465029) Queuing response Thread-21::DEBUG::2015-01-22 11:09:09,693::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:09,693::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:09,693::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:09,694::__init__::232::IOProcess::(_processLogs) (465030) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:09,694::__init__::232::IOProcess::(_processLogs) (465030) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:10,097::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:10,097::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404214::DEBUG::2015-01-22 11:09:10,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`39927aba-56c9-4990-a714-ea32af2419b0`::moving from state init -> state preparing Thread-404214::INFO::2015-01-22 11:09:10,101::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404214::INFO::2015-01-22 11:09:10,101::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295318', 'lastCheck': '7.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500471', 'lastCheck': '0.4', 'valid': True}} Thread-404214::DEBUG::2015-01-22 11:09:10,101::task::1191::Storage.TaskManager.Task::(prepare) Task=`39927aba-56c9-4990-a714-ea32af2419b0`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295318', 'lastCheck': '7.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500471', 'lastCheck': '0.4', 'valid': True}} Thread-404214::DEBUG::2015-01-22 11:09:10,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`39927aba-56c9-4990-a714-ea32af2419b0`::moving from state preparing -> state finished Thread-404214::DEBUG::2015-01-22 11:09:10,101::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404214::DEBUG::2015-01-22 11:09:10,102::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404214::DEBUG::2015-01-22 11:09:10,102::task::993::Storage.TaskManager.Task::(_decref) Task=`39927aba-56c9-4990-a714-ea32af2419b0`::ref 0 aborting False Thread-404214::ERROR::2015-01-22 11:09:10,102::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404214::DEBUG::2015-01-22 11:09:10,105::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:10,112::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:10,113::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404215::DEBUG::2015-01-22 11:09:10,115::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404215::DEBUG::2015-01-22 11:09:10,116::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:11,292::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:11,292::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:11,298::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:09:12,942::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:12,942::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:12,942::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:12,942::__init__::232::IOProcess::(_processLogs) (465031) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:12,942::__init__::232::IOProcess::(_processLogs) (465031) Queuing response Thread-63::DEBUG::2015-01-22 11:09:12,943::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:09:12,951::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000252292 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:12,952::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:12,952::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:12,952::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:12,952::__init__::232::IOProcess::(_processLogs) (465032) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:12,952::__init__::232::IOProcess::(_processLogs) (465032) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:13,175::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:13,176::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404216::DEBUG::2015-01-22 11:09:13,178::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:13,179::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:13,181::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404217::DEBUG::2015-01-22 11:09:13,182::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404217::DEBUG::2015-01-22 11:09:13,183::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:16,219::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:16,220::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404218::DEBUG::2015-01-22 11:09:16,223::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:16,224::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:16,225::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404219::DEBUG::2015-01-22 11:09:16,227::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404219::DEBUG::2015-01-22 11:09:16,228::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:16,304::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:16,305::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:16,314::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:19,254::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:19,255::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404220::DEBUG::2015-01-22 11:09:19,257::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:19,258::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:19,259::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404221::DEBUG::2015-01-22 11:09:19,261::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404221::DEBUG::2015-01-22 11:09:19,262::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-64::DEBUG::2015-01-22 11:09:19,696::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 06e45ff6-0505-4692-b97d-896d9b710b49 Thread-21::DEBUG::2015-01-22 11:09:19,698::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:19,698::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:19,699::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:19,699::__init__::232::IOProcess::(_processLogs) (465033) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:09:19,703::__init__::232::IOProcess::(_processLogs) (465033) Queuing response Thread-64::DEBUG::2015-01-22 11:09:19,708::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49 Thread-21::DEBUG::2015-01-22 11:09:19,709::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:19,709::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:19,710::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:19,710::__init__::232::IOProcess::(_processLogs) (465034) Got request for method 'touch' Thread-21::DEBUG::2015-01-22 11:09:19,711::__init__::232::IOProcess::(_processLogs) (465034) Queuing response Thread-64::DEBUG::2015-01-22 11:09:19,712::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend Thread-21::DEBUG::2015-01-22 11:09:19,713::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:19,713::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:19,714::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:19,714::__init__::232::IOProcess::(_processLogs) (465035) Got request for method 'readfile' Thread-21::DEBUG::2015-01-22 11:09:19,715::__init__::232::IOProcess::(_processLogs) (465035) Queuing response Thread-64::DEBUG::2015-01-22 11:09:19,715::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=store1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=cllDataCentre', 'POOL_DOMAINS=06e45ff6-0505-4692-b97d-896d9b710b49:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=67c137fd-0cf2-463a-bc70-b427cc0a5da3', 'REMOTE_PATH=192.168.1.25:/Vol2', 'ROLE=Master', 'SDUUID=06e45ff6-0505-4692-b97d-896d9b710b49', 'TYPE=GLUSTERFS', 'VERSION=3', '_SHA_CKSUM=7f3bb8b00fa6ca5bb291ea1e02530cfbc66a33ba'] Thread-21::DEBUG::2015-01-22 11:09:19,716::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:19,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:19,717::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:19,717::__init__::232::IOProcess::(_processLogs) (465036) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:19,717::__init__::232::IOProcess::(_processLogs) (465036) Queuing response Thread-21::DEBUG::2015-01-22 11:09:19,718::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:19,718::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:19,718::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:19,718::__init__::232::IOProcess::(_processLogs) (465037) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:09:19,720::__init__::232::IOProcess::(_processLogs) (465037) Queuing response Thread-64::DEBUG::2015-01-22 11:09:19,720::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-64::INFO::2015-01-22 11:09:19,720::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 06e45ff6-0505-4692-b97d-896d9b710b49_imageNS already registered Thread-64::INFO::2015-01-22 11:09:19,721::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 06e45ff6-0505-4692-b97d-896d9b710b49_volumeNS already registered Thread-21::DEBUG::2015-01-22 11:09:19,721::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:19,721::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:19,721::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:19,721::__init__::232::IOProcess::(_processLogs) (465038) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:19,721::__init__::232::IOProcess::(_processLogs) (465038) Queuing response Thread-64::DEBUG::2015-01-22 11:09:19,722::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:09:19,729::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000506749 s, 916 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:19,729::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:19,729::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:19,730::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:19,730::__init__::232::IOProcess::(_processLogs) (465039) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:19,730::__init__::232::IOProcess::(_processLogs) (465039) Queuing response Thread-21::DEBUG::2015-01-22 11:09:19,731::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:19,731::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:19,731::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:19,731::__init__::232::IOProcess::(_processLogs) (465040) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:19,732::__init__::232::IOProcess::(_processLogs) (465040) Queuing response Thread-21::DEBUG::2015-01-22 11:09:19,733::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:19,733::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:19,733::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:19,733::__init__::232::IOProcess::(_processLogs) (465041) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:19,733::__init__::232::IOProcess::(_processLogs) (465041) Queuing response Thread-21::DEBUG::2015-01-22 11:09:19,734::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:19,734::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:19,734::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:19,734::__init__::232::IOProcess::(_processLogs) (465042) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:19,735::__init__::232::IOProcess::(_processLogs) (465042) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:21,320::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:21,321::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:21,330::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:22,291::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:22,292::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404223::DEBUG::2015-01-22 11:09:22,294::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:22,296::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:22,297::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404224::DEBUG::2015-01-22 11:09:22,299::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404224::DEBUG::2015-01-22 11:09:22,300::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:09:22,954::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:22,954::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:22,954::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:22,954::__init__::232::IOProcess::(_processLogs) (465043) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:22,954::__init__::232::IOProcess::(_processLogs) (465043) Queuing response Thread-63::DEBUG::2015-01-22 11:09:22,955::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:09:22,963::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00024717 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:22,964::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:22,964::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:22,964::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:22,964::__init__::232::IOProcess::(_processLogs) (465044) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:22,964::__init__::232::IOProcess::(_processLogs) (465044) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:25,329::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:25,331::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404225::DEBUG::2015-01-22 11:09:25,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ec550eb-dbd0-45a9-9659-22470f0dadca`::moving from state init -> state preparing Thread-404225::INFO::2015-01-22 11:09:25,334::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404225::INFO::2015-01-22 11:09:25,335::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00024717', 'lastCheck': '2.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506749', 'lastCheck': '5.6', 'valid': True}} Thread-404225::DEBUG::2015-01-22 11:09:25,335::task::1191::Storage.TaskManager.Task::(prepare) Task=`3ec550eb-dbd0-45a9-9659-22470f0dadca`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00024717', 'lastCheck': '2.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506749', 'lastCheck': '5.6', 'valid': True}} Thread-404225::DEBUG::2015-01-22 11:09:25,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ec550eb-dbd0-45a9-9659-22470f0dadca`::moving from state preparing -> state finished Thread-404225::DEBUG::2015-01-22 11:09:25,335::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404225::DEBUG::2015-01-22 11:09:25,335::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404225::DEBUG::2015-01-22 11:09:25,335::task::993::Storage.TaskManager.Task::(_decref) Task=`3ec550eb-dbd0-45a9-9659-22470f0dadca`::ref 0 aborting False Thread-404225::ERROR::2015-01-22 11:09:25,336::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404225::DEBUG::2015-01-22 11:09:25,339::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:25,347::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:25,348::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404226::DEBUG::2015-01-22 11:09:25,350::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404226::DEBUG::2015-01-22 11:09:25,351::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:26,336::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:26,337::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:26,348::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:28,416::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:28,417::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404227::DEBUG::2015-01-22 11:09:28,418::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:28,419::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:28,420::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404228::DEBUG::2015-01-22 11:09:28,422::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404228::DEBUG::2015-01-22 11:09:28,423::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:09:29,737::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:29,737::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:29,737::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:29,737::__init__::232::IOProcess::(_processLogs) (465045) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:29,739::__init__::232::IOProcess::(_processLogs) (465045) Queuing response Thread-64::DEBUG::2015-01-22 11:09:29,740::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:09:29,748::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000498785 s, 930 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:29,748::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:29,749::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:29,749::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:29,749::__init__::232::IOProcess::(_processLogs) (465046) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:29,749::__init__::232::IOProcess::(_processLogs) (465046) Queuing response Thread-21::DEBUG::2015-01-22 11:09:29,750::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:29,750::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:29,750::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:29,750::__init__::232::IOProcess::(_processLogs) (465047) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:29,751::__init__::232::IOProcess::(_processLogs) (465047) Queuing response Thread-21::DEBUG::2015-01-22 11:09:29,752::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:29,752::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:29,752::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:29,752::__init__::232::IOProcess::(_processLogs) (465048) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:29,752::__init__::232::IOProcess::(_processLogs) (465048) Queuing response Thread-21::DEBUG::2015-01-22 11:09:29,753::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:29,753::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:29,753::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:29,753::__init__::232::IOProcess::(_processLogs) (465049) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:29,754::__init__::232::IOProcess::(_processLogs) (465049) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:31,354::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:31,355::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:31,360::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:31,455::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:31,456::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404229::DEBUG::2015-01-22 11:09:31,458::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:31,459::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:31,460::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404230::DEBUG::2015-01-22 11:09:31,462::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404230::DEBUG::2015-01-22 11:09:31,463::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:09:32,966::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:32,966::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:32,967::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:32,967::__init__::232::IOProcess::(_processLogs) (465050) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:32,967::__init__::232::IOProcess::(_processLogs) (465050) Queuing response Thread-63::DEBUG::2015-01-22 11:09:32,967::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:09:32,976::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000250231 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:32,977::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:32,977::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:32,977::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:32,977::__init__::232::IOProcess::(_processLogs) (465051) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:32,977::__init__::232::IOProcess::(_processLogs) (465051) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:34,493::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:34,494::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404231::DEBUG::2015-01-22 11:09:34,496::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:34,498::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:34,499::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404232::DEBUG::2015-01-22 11:09:34,501::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404232::DEBUG::2015-01-22 11:09:34,502::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:36,366::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:36,367::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:36,374::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:37,528::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:37,530::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404233::DEBUG::2015-01-22 11:09:37,532::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:37,533::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:37,534::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404234::DEBUG::2015-01-22 11:09:37,536::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404234::DEBUG::2015-01-22 11:09:37,537::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:09:38,039::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:09:39,756::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:39,756::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:39,756::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:39,756::__init__::232::IOProcess::(_processLogs) (465052) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:39,758::__init__::232::IOProcess::(_processLogs) (465052) Queuing response Thread-64::DEBUG::2015-01-22 11:09:39,758::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:09:39,765::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000531457 s, 873 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:39,766::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:39,766::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:39,766::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:39,766::__init__::232::IOProcess::(_processLogs) (465053) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:39,766::__init__::232::IOProcess::(_processLogs) (465053) Queuing response Thread-21::DEBUG::2015-01-22 11:09:39,767::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:39,767::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:39,767::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:39,768::__init__::232::IOProcess::(_processLogs) (465054) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:39,768::__init__::232::IOProcess::(_processLogs) (465054) Queuing response Thread-21::DEBUG::2015-01-22 11:09:39,769::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:39,769::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:39,770::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:39,770::__init__::232::IOProcess::(_processLogs) (465055) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:39,770::__init__::232::IOProcess::(_processLogs) (465055) Queuing response Thread-21::DEBUG::2015-01-22 11:09:39,771::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:39,771::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:39,771::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:39,771::__init__::232::IOProcess::(_processLogs) (465056) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:39,772::__init__::232::IOProcess::(_processLogs) (465056) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:40,560::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:40,561::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404235::DEBUG::2015-01-22 11:09:40,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9b0754c-8a8a-4abc-8ecb-737d612cbdac`::moving from state init -> state preparing Thread-404235::INFO::2015-01-22 11:09:40,566::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404235::INFO::2015-01-22 11:09:40,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250231', 'lastCheck': '7.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531457', 'lastCheck': '0.8', 'valid': True}} Thread-404235::DEBUG::2015-01-22 11:09:40,566::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9b0754c-8a8a-4abc-8ecb-737d612cbdac`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250231', 'lastCheck': '7.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531457', 'lastCheck': '0.8', 'valid': True}} Thread-404235::DEBUG::2015-01-22 11:09:40,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9b0754c-8a8a-4abc-8ecb-737d612cbdac`::moving from state preparing -> state finished Thread-404235::DEBUG::2015-01-22 11:09:40,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404235::DEBUG::2015-01-22 11:09:40,566::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404235::DEBUG::2015-01-22 11:09:40,566::task::993::Storage.TaskManager.Task::(_decref) Task=`b9b0754c-8a8a-4abc-8ecb-737d612cbdac`::ref 0 aborting False Thread-404235::ERROR::2015-01-22 11:09:40,567::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404235::DEBUG::2015-01-22 11:09:40,570::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:40,577::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:40,578::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404236::DEBUG::2015-01-22 11:09:40,580::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404236::DEBUG::2015-01-22 11:09:40,581::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:41,380::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:41,381::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:41,392::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:09:42,979::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:42,979::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:42,979::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:42,979::__init__::232::IOProcess::(_processLogs) (465057) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:42,980::__init__::232::IOProcess::(_processLogs) (465057) Queuing response Thread-63::DEBUG::2015-01-22 11:09:42,980::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:09:42,990::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000329027 s, 979 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:42,990::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:42,991::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:42,991::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:42,991::__init__::232::IOProcess::(_processLogs) (465058) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:42,991::__init__::232::IOProcess::(_processLogs) (465058) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:43,631::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:43,633::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404237::DEBUG::2015-01-22 11:09:43,635::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:43,636::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:43,637::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404238::DEBUG::2015-01-22 11:09:43,639::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404238::DEBUG::2015-01-22 11:09:43,639::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:46,398::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:46,399::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:46,406::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:46,672::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:46,673::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404239::DEBUG::2015-01-22 11:09:46,676::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:46,677::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:46,679::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404240::DEBUG::2015-01-22 11:09:46,681::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404240::DEBUG::2015-01-22 11:09:46,682::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:49,708::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:49,709::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404241::DEBUG::2015-01-22 11:09:49,711::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:49,712::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:49,713::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404242::DEBUG::2015-01-22 11:09:49,715::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404242::DEBUG::2015-01-22 11:09:49,716::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:09:49,774::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:49,774::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:49,774::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:49,774::__init__::232::IOProcess::(_processLogs) (465059) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:49,776::__init__::232::IOProcess::(_processLogs) (465059) Queuing response Thread-64::DEBUG::2015-01-22 11:09:49,777::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:09:49,786::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000556156 s, 834 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:49,786::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:49,787::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:49,787::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:49,787::__init__::232::IOProcess::(_processLogs) (465060) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:49,787::__init__::232::IOProcess::(_processLogs) (465060) Queuing response Thread-21::DEBUG::2015-01-22 11:09:49,788::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:49,788::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:49,788::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:49,788::__init__::232::IOProcess::(_processLogs) (465061) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:49,789::__init__::232::IOProcess::(_processLogs) (465061) Queuing response Thread-21::DEBUG::2015-01-22 11:09:49,790::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:49,790::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:49,790::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:49,790::__init__::232::IOProcess::(_processLogs) (465062) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:49,790::__init__::232::IOProcess::(_processLogs) (465062) Queuing response Thread-21::DEBUG::2015-01-22 11:09:49,791::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:49,791::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:49,791::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:49,791::__init__::232::IOProcess::(_processLogs) (465063) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:49,791::__init__::232::IOProcess::(_processLogs) (465063) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:51,413::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:51,413::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:51,422::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:52,744::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:52,746::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404243::DEBUG::2015-01-22 11:09:52,748::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:52,749::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:52,751::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404244::DEBUG::2015-01-22 11:09:52,752::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404244::DEBUG::2015-01-22 11:09:52,753::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:09:52,993::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:52,993::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:52,993::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:52,993::__init__::232::IOProcess::(_processLogs) (465064) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:52,993::__init__::232::IOProcess::(_processLogs) (465064) Queuing response Thread-63::DEBUG::2015-01-22 11:09:52,994::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:09:53,003::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000287247 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:53,004::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:53,004::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:53,004::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:53,005::__init__::232::IOProcess::(_processLogs) (465065) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:53,005::__init__::232::IOProcess::(_processLogs) (465065) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:55,782::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:55,784::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404245::DEBUG::2015-01-22 11:09:55,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`00565a3f-ddcd-44d5-8cab-fab616b8842e`::moving from state init -> state preparing Thread-404245::INFO::2015-01-22 11:09:55,787::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404245::INFO::2015-01-22 11:09:55,788::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287247', 'lastCheck': '2.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556156', 'lastCheck': '6.0', 'valid': True}} Thread-404245::DEBUG::2015-01-22 11:09:55,788::task::1191::Storage.TaskManager.Task::(prepare) Task=`00565a3f-ddcd-44d5-8cab-fab616b8842e`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287247', 'lastCheck': '2.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556156', 'lastCheck': '6.0', 'valid': True}} Thread-404245::DEBUG::2015-01-22 11:09:55,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`00565a3f-ddcd-44d5-8cab-fab616b8842e`::moving from state preparing -> state finished Thread-404245::DEBUG::2015-01-22 11:09:55,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404245::DEBUG::2015-01-22 11:09:55,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404245::DEBUG::2015-01-22 11:09:55,788::task::993::Storage.TaskManager.Task::(_decref) Task=`00565a3f-ddcd-44d5-8cab-fab616b8842e`::ref 0 aborting False Thread-404245::ERROR::2015-01-22 11:09:55,789::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404245::DEBUG::2015-01-22 11:09:55,792::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:55,800::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:55,801::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404246::DEBUG::2015-01-22 11:09:55,803::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404246::DEBUG::2015-01-22 11:09:55,804::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:09:56,428::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:56,429::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:09:56,439::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:09:58,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`5231dac9-df77-45fb-96c6-389c4a098015`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:09:58,332::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:09:58,333::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:58,333::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:58,334::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:58,334::__init__::232::IOProcess::(_processLogs) (465066) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:09:58,337::__init__::232::IOProcess::(_processLogs) (465066) Queuing response Thread-21::DEBUG::2015-01-22 11:09:58,338::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:58,338::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:58,338::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:58,338::__init__::232::IOProcess::(_processLogs) (465067) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:09:58,338::__init__::232::IOProcess::(_processLogs) (465067) Queuing response Thread-360::INFO::2015-01-22 11:09:58,339::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:09:58,339::task::1191::Storage.TaskManager.Task::(prepare) Task=`5231dac9-df77-45fb-96c6-389c4a098015`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:09:58,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`5231dac9-df77-45fb-96c6-389c4a098015`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:09:58,339::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:09:58,339::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:09:58,340::task::993::Storage.TaskManager.Task::(_decref) Task=`5231dac9-df77-45fb-96c6-389c4a098015`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:58,854::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:58,855::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404247::DEBUG::2015-01-22 11:09:58,857::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:09:58,858::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:09:58,860::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404248::DEBUG::2015-01-22 11:09:58,861::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404248::DEBUG::2015-01-22 11:09:58,862::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:09:59,793::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:59,793::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:59,793::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:59,793::__init__::232::IOProcess::(_processLogs) (465068) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:59,794::__init__::232::IOProcess::(_processLogs) (465068) Queuing response Thread-64::DEBUG::2015-01-22 11:09:59,795::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:09:59,804::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000456888 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:09:59,804::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:59,805::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:59,805::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:59,805::__init__::232::IOProcess::(_processLogs) (465069) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:09:59,805::__init__::232::IOProcess::(_processLogs) (465069) Queuing response Thread-21::DEBUG::2015-01-22 11:09:59,806::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:59,806::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:59,806::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:59,806::__init__::232::IOProcess::(_processLogs) (465070) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:59,807::__init__::232::IOProcess::(_processLogs) (465070) Queuing response Thread-21::DEBUG::2015-01-22 11:09:59,807::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:59,807::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:59,808::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:59,808::__init__::232::IOProcess::(_processLogs) (465071) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:59,808::__init__::232::IOProcess::(_processLogs) (465071) Queuing response Thread-21::DEBUG::2015-01-22 11:09:59,809::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:09:59,809::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:09:59,809::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:09:59,809::__init__::232::IOProcess::(_processLogs) (465072) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:09:59,809::__init__::232::IOProcess::(_processLogs) (465072) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:01,445::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:01,446::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:01,452::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:01,892::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:01,893::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404249::DEBUG::2015-01-22 11:10:01,895::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:01,896::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:01,898::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404250::DEBUG::2015-01-22 11:10:01,900::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404250::DEBUG::2015-01-22 11:10:01,901::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:10:03,007::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:03,007::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:03,007::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:03,007::__init__::232::IOProcess::(_processLogs) (465073) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:03,007::__init__::232::IOProcess::(_processLogs) (465073) Queuing response Thread-63::DEBUG::2015-01-22 11:10:03,008::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:10:03,016::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000257737 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:03,017::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:03,018::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:03,018::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:03,018::__init__::232::IOProcess::(_processLogs) (465074) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:03,018::__init__::232::IOProcess::(_processLogs) (465074) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:04,930::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:04,931::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404251::DEBUG::2015-01-22 11:10:04,933::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:04,934::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:04,935::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404252::DEBUG::2015-01-22 11:10:04,937::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404252::DEBUG::2015-01-22 11:10:04,938::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:06,459::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:06,460::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:06,460::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:07,964::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:07,965::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404253::DEBUG::2015-01-22 11:10:07,968::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:07,969::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:07,970::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404254::DEBUG::2015-01-22 11:10:07,973::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404254::DEBUG::2015-01-22 11:10:07,977::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:10:08,075::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:10:09,811::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:09,811::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:09,811::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:09,811::__init__::232::IOProcess::(_processLogs) (465075) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:09,814::__init__::232::IOProcess::(_processLogs) (465075) Queuing response Thread-64::DEBUG::2015-01-22 11:10:09,814::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:10:09,824::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000541924 s, 856 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:09,824::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:09,825::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:09,825::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:09,825::__init__::232::IOProcess::(_processLogs) (465076) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:09,825::__init__::232::IOProcess::(_processLogs) (465076) Queuing response Thread-21::DEBUG::2015-01-22 11:10:09,826::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:09,826::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:09,826::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:09,826::__init__::232::IOProcess::(_processLogs) (465077) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:09,827::__init__::232::IOProcess::(_processLogs) (465077) Queuing response Thread-21::DEBUG::2015-01-22 11:10:09,827::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:09,827::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:09,827::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:09,828::__init__::232::IOProcess::(_processLogs) (465078) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:09,828::__init__::232::IOProcess::(_processLogs) (465078) Queuing response Thread-21::DEBUG::2015-01-22 11:10:09,828::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:09,829::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:09,829::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:09,829::__init__::232::IOProcess::(_processLogs) (465079) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:09,829::__init__::232::IOProcess::(_processLogs) (465079) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:11,007::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:11,008::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404255::DEBUG::2015-01-22 11:10:11,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab735990-58ff-4553-b018-bf2aa2236094`::moving from state init -> state preparing Thread-404255::INFO::2015-01-22 11:10:11,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404255::INFO::2015-01-22 11:10:11,011::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257737', 'lastCheck': '8.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541924', 'lastCheck': '1.2', 'valid': True}} Thread-404255::DEBUG::2015-01-22 11:10:11,012::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab735990-58ff-4553-b018-bf2aa2236094`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257737', 'lastCheck': '8.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541924', 'lastCheck': '1.2', 'valid': True}} Thread-404255::DEBUG::2015-01-22 11:10:11,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab735990-58ff-4553-b018-bf2aa2236094`::moving from state preparing -> state finished Thread-404255::DEBUG::2015-01-22 11:10:11,012::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404255::DEBUG::2015-01-22 11:10:11,012::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404255::DEBUG::2015-01-22 11:10:11,012::task::993::Storage.TaskManager.Task::(_decref) Task=`ab735990-58ff-4553-b018-bf2aa2236094`::ref 0 aborting False Thread-404255::ERROR::2015-01-22 11:10:11,013::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404255::DEBUG::2015-01-22 11:10:11,016::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:11,024::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:11,025::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404256::DEBUG::2015-01-22 11:10:11,027::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404256::DEBUG::2015-01-22 11:10:11,028::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:11,466::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:11,467::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:11,467::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:10:13,020::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:13,020::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:13,029::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:13,030::__init__::232::IOProcess::(_processLogs) (465080) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:13,030::__init__::232::IOProcess::(_processLogs) (465080) Queuing response Thread-63::DEBUG::2015-01-22 11:10:13,031::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:10:13,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000317969 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:13,040::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:13,041::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:13,041::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:13,041::__init__::232::IOProcess::(_processLogs) (465081) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:13,041::__init__::232::IOProcess::(_processLogs) (465081) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:14,094::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:14,096::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404257::DEBUG::2015-01-22 11:10:14,098::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:14,100::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:14,101::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404258::DEBUG::2015-01-22 11:10:14,103::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404258::DEBUG::2015-01-22 11:10:14,104::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:16,473::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:16,474::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:16,475::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:17,134::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:17,135::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404259::DEBUG::2015-01-22 11:10:17,138::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:17,139::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:17,140::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404260::DEBUG::2015-01-22 11:10:17,142::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404260::DEBUG::2015-01-22 11:10:17,143::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:10:19,831::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:19,831::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:19,831::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:19,831::__init__::232::IOProcess::(_processLogs) (465082) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:19,833::__init__::232::IOProcess::(_processLogs) (465082) Queuing response Thread-64::DEBUG::2015-01-22 11:10:19,833::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:10:19,843::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000539107 s, 861 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:19,843::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:19,844::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:19,844::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:19,844::__init__::232::IOProcess::(_processLogs) (465083) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:19,844::__init__::232::IOProcess::(_processLogs) (465083) Queuing response Thread-21::DEBUG::2015-01-22 11:10:19,845::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:19,845::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:19,845::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:19,845::__init__::232::IOProcess::(_processLogs) (465084) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:19,846::__init__::232::IOProcess::(_processLogs) (465084) Queuing response Thread-21::DEBUG::2015-01-22 11:10:19,846::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:19,846::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:19,847::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:19,847::__init__::232::IOProcess::(_processLogs) (465085) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:19,847::__init__::232::IOProcess::(_processLogs) (465085) Queuing response Thread-21::DEBUG::2015-01-22 11:10:19,847::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:19,848::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:19,848::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:19,848::__init__::232::IOProcess::(_processLogs) (465086) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:19,848::__init__::232::IOProcess::(_processLogs) (465086) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:20,172::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:20,174::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404261::DEBUG::2015-01-22 11:10:20,176::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:20,177::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:20,178::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404262::DEBUG::2015-01-22 11:10:20,180::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404262::DEBUG::2015-01-22 11:10:20,181::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:21,481::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:21,481::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:21,482::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:10:23,043::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:23,043::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:23,043::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:23,043::__init__::232::IOProcess::(_processLogs) (465087) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:23,043::__init__::232::IOProcess::(_processLogs) (465087) Queuing response Thread-63::DEBUG::2015-01-22 11:10:23,044::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:10:23,053::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000350202 s, 919 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:23,055::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:23,055::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:23,055::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:23,055::__init__::232::IOProcess::(_processLogs) (465088) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:23,055::__init__::232::IOProcess::(_processLogs) (465088) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:23,209::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:23,210::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404263::DEBUG::2015-01-22 11:10:23,212::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:23,214::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:23,215::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404264::DEBUG::2015-01-22 11:10:23,217::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404264::DEBUG::2015-01-22 11:10:23,218::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:26,243::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:26,244::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404265::DEBUG::2015-01-22 11:10:26,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5f46677-2f20-4c4a-ae13-d474754a1dd3`::moving from state init -> state preparing Thread-404265::INFO::2015-01-22 11:10:26,247::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404265::INFO::2015-01-22 11:10:26,248::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000350202', 'lastCheck': '3.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539107', 'lastCheck': '6.4', 'valid': True}} Thread-404265::DEBUG::2015-01-22 11:10:26,248::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5f46677-2f20-4c4a-ae13-d474754a1dd3`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000350202', 'lastCheck': '3.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539107', 'lastCheck': '6.4', 'valid': True}} Thread-404265::DEBUG::2015-01-22 11:10:26,248::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5f46677-2f20-4c4a-ae13-d474754a1dd3`::moving from state preparing -> state finished Thread-404265::DEBUG::2015-01-22 11:10:26,248::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404265::DEBUG::2015-01-22 11:10:26,248::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404265::DEBUG::2015-01-22 11:10:26,248::task::993::Storage.TaskManager.Task::(_decref) Task=`c5f46677-2f20-4c4a-ae13-d474754a1dd3`::ref 0 aborting False Thread-404265::ERROR::2015-01-22 11:10:26,249::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404265::DEBUG::2015-01-22 11:10:26,252::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:26,259::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:26,261::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404266::DEBUG::2015-01-22 11:10:26,263::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404266::DEBUG::2015-01-22 11:10:26,263::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:26,488::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:26,488::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:26,489::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:29,323::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:29,324::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404267::DEBUG::2015-01-22 11:10:29,326::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:29,327::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:29,328::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404268::DEBUG::2015-01-22 11:10:29,330::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404268::DEBUG::2015-01-22 11:10:29,330::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:10:29,850::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:29,850::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:29,850::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:29,850::__init__::232::IOProcess::(_processLogs) (465089) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:29,852::__init__::232::IOProcess::(_processLogs) (465089) Queuing response Thread-64::DEBUG::2015-01-22 11:10:29,853::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:10:29,861::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000541066 s, 858 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:29,862::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:29,862::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:29,862::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:29,863::__init__::232::IOProcess::(_processLogs) (465090) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:29,863::__init__::232::IOProcess::(_processLogs) (465090) Queuing response Thread-21::DEBUG::2015-01-22 11:10:29,864::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:29,864::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:29,864::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:29,864::__init__::232::IOProcess::(_processLogs) (465091) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:29,865::__init__::232::IOProcess::(_processLogs) (465091) Queuing response Thread-21::DEBUG::2015-01-22 11:10:29,866::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:29,866::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:29,867::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:29,867::__init__::232::IOProcess::(_processLogs) (465092) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:29,867::__init__::232::IOProcess::(_processLogs) (465092) Queuing response Thread-21::DEBUG::2015-01-22 11:10:29,867::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:29,868::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:29,868::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:29,868::__init__::232::IOProcess::(_processLogs) (465093) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:29,868::__init__::232::IOProcess::(_processLogs) (465093) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:31,495::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:31,496::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:31,501::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:32,362::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:32,363::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404269::DEBUG::2015-01-22 11:10:32,365::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:32,366::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:32,367::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404270::DEBUG::2015-01-22 11:10:32,369::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404270::DEBUG::2015-01-22 11:10:32,370::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:10:33,057::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:33,057::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:33,057::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:33,057::__init__::232::IOProcess::(_processLogs) (465094) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:33,057::__init__::232::IOProcess::(_processLogs) (465094) Queuing response Thread-63::DEBUG::2015-01-22 11:10:33,058::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:10:33,066::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000245378 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:33,067::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:33,067::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:33,067::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:33,067::__init__::232::IOProcess::(_processLogs) (465095) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:33,068::__init__::232::IOProcess::(_processLogs) (465095) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:35,395::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:35,397::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404271::DEBUG::2015-01-22 11:10:35,400::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:35,401::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:35,402::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404272::DEBUG::2015-01-22 11:10:35,404::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404272::DEBUG::2015-01-22 11:10:35,405::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:36,507::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:36,508::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:36,513::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:10:38,108::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:38,433::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:38,434::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404273::DEBUG::2015-01-22 11:10:38,436::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:38,437::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:38,438::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404274::DEBUG::2015-01-22 11:10:38,440::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404274::DEBUG::2015-01-22 11:10:38,441::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:10:39,870::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:39,870::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:39,870::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:39,870::__init__::232::IOProcess::(_processLogs) (465096) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:39,872::__init__::232::IOProcess::(_processLogs) (465096) Queuing response Thread-64::DEBUG::2015-01-22 11:10:39,873::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:10:39,882::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00053721 s, 864 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:39,882::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:39,883::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:39,883::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:39,883::__init__::232::IOProcess::(_processLogs) (465097) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:39,883::__init__::232::IOProcess::(_processLogs) (465097) Queuing response Thread-21::DEBUG::2015-01-22 11:10:39,884::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:39,884::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:39,884::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:39,884::__init__::232::IOProcess::(_processLogs) (465098) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:39,885::__init__::232::IOProcess::(_processLogs) (465098) Queuing response Thread-21::DEBUG::2015-01-22 11:10:39,885::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:39,885::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:39,886::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:39,886::__init__::232::IOProcess::(_processLogs) (465099) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:39,886::__init__::232::IOProcess::(_processLogs) (465099) Queuing response Thread-21::DEBUG::2015-01-22 11:10:39,887::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:39,887::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:39,887::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:39,888::__init__::232::IOProcess::(_processLogs) (465100) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:39,888::__init__::232::IOProcess::(_processLogs) (465100) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:41,469::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:41,471::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404275::DEBUG::2015-01-22 11:10:41,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`f92652f6-3fff-463d-be0d-7215648213ab`::moving from state init -> state preparing Thread-404275::INFO::2015-01-22 11:10:41,474::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404275::INFO::2015-01-22 11:10:41,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000245378', 'lastCheck': '8.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053721', 'lastCheck': '1.6', 'valid': True}} Thread-404275::DEBUG::2015-01-22 11:10:41,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`f92652f6-3fff-463d-be0d-7215648213ab`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000245378', 'lastCheck': '8.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053721', 'lastCheck': '1.6', 'valid': True}} Thread-404275::DEBUG::2015-01-22 11:10:41,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`f92652f6-3fff-463d-be0d-7215648213ab`::moving from state preparing -> state finished Thread-404275::DEBUG::2015-01-22 11:10:41,475::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404275::DEBUG::2015-01-22 11:10:41,475::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404275::DEBUG::2015-01-22 11:10:41,475::task::993::Storage.TaskManager.Task::(_decref) Task=`f92652f6-3fff-463d-be0d-7215648213ab`::ref 0 aborting False Thread-404275::ERROR::2015-01-22 11:10:41,476::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404275::DEBUG::2015-01-22 11:10:41,479::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:41,487::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:41,488::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404276::DEBUG::2015-01-22 11:10:41,491::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404276::DEBUG::2015-01-22 11:10:41,491::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:41,519::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:41,520::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:41,529::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:10:43,069::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:43,069::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:43,069::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:43,070::__init__::232::IOProcess::(_processLogs) (465101) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:43,070::__init__::232::IOProcess::(_processLogs) (465101) Queuing response Thread-63::DEBUG::2015-01-22 11:10:43,071::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:10:43,079::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000267088 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:43,080::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:43,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:43,080::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:43,081::__init__::232::IOProcess::(_processLogs) (465102) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:43,081::__init__::232::IOProcess::(_processLogs) (465102) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:44,555::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:44,556::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404277::DEBUG::2015-01-22 11:10:44,559::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:44,560::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:44,561::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404278::DEBUG::2015-01-22 11:10:44,563::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404278::DEBUG::2015-01-22 11:10:44,564::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:46,536::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:46,537::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:46,544::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:47,596::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:47,599::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404279::DEBUG::2015-01-22 11:10:47,603::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:47,605::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:47,608::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404280::DEBUG::2015-01-22 11:10:47,610::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404280::DEBUG::2015-01-22 11:10:47,618::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:10:49,889::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:49,889::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:49,889::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:49,890::__init__::232::IOProcess::(_processLogs) (465103) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:49,891::__init__::232::IOProcess::(_processLogs) (465103) Queuing response Thread-64::DEBUG::2015-01-22 11:10:49,892::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:10:49,901::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00048647 s, 954 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:49,902::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:49,902::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:49,902::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:49,902::__init__::232::IOProcess::(_processLogs) (465104) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:49,903::__init__::232::IOProcess::(_processLogs) (465104) Queuing response Thread-21::DEBUG::2015-01-22 11:10:49,904::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:49,904::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:49,904::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:49,904::__init__::232::IOProcess::(_processLogs) (465105) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:49,904::__init__::232::IOProcess::(_processLogs) (465105) Queuing response Thread-21::DEBUG::2015-01-22 11:10:49,905::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:49,905::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:49,906::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:49,906::__init__::232::IOProcess::(_processLogs) (465106) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:49,907::__init__::232::IOProcess::(_processLogs) (465106) Queuing response Thread-21::DEBUG::2015-01-22 11:10:49,907::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:49,908::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:49,908::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:49,908::__init__::232::IOProcess::(_processLogs) (465107) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:49,908::__init__::232::IOProcess::(_processLogs) (465107) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:50,648::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:50,650::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404281::DEBUG::2015-01-22 11:10:50,652::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:50,654::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:50,655::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404282::DEBUG::2015-01-22 11:10:50,657::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404282::DEBUG::2015-01-22 11:10:50,658::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:51,550::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:51,550::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:51,560::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:10:53,083::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:53,083::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:53,083::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:53,083::__init__::232::IOProcess::(_processLogs) (465108) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:53,083::__init__::232::IOProcess::(_processLogs) (465108) Queuing response Thread-63::DEBUG::2015-01-22 11:10:53,084::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:10:53,092::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000246833 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:53,093::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:53,093::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:53,093::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:53,093::__init__::232::IOProcess::(_processLogs) (465109) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:53,093::__init__::232::IOProcess::(_processLogs) (465109) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:53,686::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:53,690::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404283::DEBUG::2015-01-22 11:10:53,696::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:53,699::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:53,702::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404284::DEBUG::2015-01-22 11:10:53,707::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404284::DEBUG::2015-01-22 11:10:53,716::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:10:56,566::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:56,567::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:10:56,574::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:56,748::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:56,750::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404285::DEBUG::2015-01-22 11:10:56,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`8436c81a-b4a0-4795-ae4b-14c09e97cea9`::moving from state init -> state preparing Thread-404285::INFO::2015-01-22 11:10:56,754::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404285::INFO::2015-01-22 11:10:56,754::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246833', 'lastCheck': '3.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048647', 'lastCheck': '6.8', 'valid': True}} Thread-404285::DEBUG::2015-01-22 11:10:56,754::task::1191::Storage.TaskManager.Task::(prepare) Task=`8436c81a-b4a0-4795-ae4b-14c09e97cea9`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246833', 'lastCheck': '3.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048647', 'lastCheck': '6.8', 'valid': True}} Thread-404285::DEBUG::2015-01-22 11:10:56,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`8436c81a-b4a0-4795-ae4b-14c09e97cea9`::moving from state preparing -> state finished Thread-404285::DEBUG::2015-01-22 11:10:56,755::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404285::DEBUG::2015-01-22 11:10:56,755::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404285::DEBUG::2015-01-22 11:10:56,755::task::993::Storage.TaskManager.Task::(_decref) Task=`8436c81a-b4a0-4795-ae4b-14c09e97cea9`::ref 0 aborting False Thread-404285::ERROR::2015-01-22 11:10:56,756::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404285::DEBUG::2015-01-22 11:10:56,758::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:56,767::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:56,768::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404286::DEBUG::2015-01-22 11:10:56,770::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404286::DEBUG::2015-01-22 11:10:56,771::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:10:58,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9b7248f-424a-45ae-bcc9-4aaa910e365f`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:10:58,431::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:10:58,432::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:58,432::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:58,432::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:58,432::__init__::232::IOProcess::(_processLogs) (465110) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:10:58,434::__init__::232::IOProcess::(_processLogs) (465110) Queuing response Thread-21::DEBUG::2015-01-22 11:10:58,435::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:58,436::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:58,436::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:58,436::__init__::232::IOProcess::(_processLogs) (465111) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:10:58,436::__init__::232::IOProcess::(_processLogs) (465111) Queuing response Thread-360::INFO::2015-01-22 11:10:58,437::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:10:58,437::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9b7248f-424a-45ae-bcc9-4aaa910e365f`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:10:58,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9b7248f-424a-45ae-bcc9-4aaa910e365f`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:10:58,437::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:10:58,437::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:10:58,437::task::993::Storage.TaskManager.Task::(_decref) Task=`b9b7248f-424a-45ae-bcc9-4aaa910e365f`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:59,831::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:59,832::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404287::DEBUG::2015-01-22 11:10:59,834::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:10:59,835::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:10:59,836::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404288::DEBUG::2015-01-22 11:10:59,838::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404288::DEBUG::2015-01-22 11:10:59,839::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:10:59,909::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:59,910::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:59,910::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:59,910::__init__::232::IOProcess::(_processLogs) (465112) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:59,912::__init__::232::IOProcess::(_processLogs) (465112) Queuing response Thread-64::DEBUG::2015-01-22 11:10:59,912::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:10:59,921::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000486585 s, 954 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:10:59,922::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:59,922::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:59,923::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:59,923::__init__::232::IOProcess::(_processLogs) (465113) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:10:59,923::__init__::232::IOProcess::(_processLogs) (465113) Queuing response Thread-21::DEBUG::2015-01-22 11:10:59,924::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:59,924::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:59,924::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:59,924::__init__::232::IOProcess::(_processLogs) (465114) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:59,925::__init__::232::IOProcess::(_processLogs) (465114) Queuing response Thread-21::DEBUG::2015-01-22 11:10:59,925::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:59,925::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:59,925::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:59,926::__init__::232::IOProcess::(_processLogs) (465115) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:59,926::__init__::232::IOProcess::(_processLogs) (465115) Queuing response Thread-21::DEBUG::2015-01-22 11:10:59,927::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:10:59,927::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:10:59,927::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:10:59,927::__init__::232::IOProcess::(_processLogs) (465116) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:10:59,928::__init__::232::IOProcess::(_processLogs) (465116) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:01,580::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:01,581::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:01,588::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:02,872::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:02,873::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404289::DEBUG::2015-01-22 11:11:02,875::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:02,877::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:02,878::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404290::DEBUG::2015-01-22 11:11:02,879::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404290::DEBUG::2015-01-22 11:11:02,880::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:11:03,095::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:03,096::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:03,096::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:03,096::__init__::232::IOProcess::(_processLogs) (465117) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:03,096::__init__::232::IOProcess::(_processLogs) (465117) Queuing response Thread-63::DEBUG::2015-01-22 11:11:03,097::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:11:03,105::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000255245 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:03,105::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:03,106::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:03,106::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:03,106::__init__::232::IOProcess::(_processLogs) (465118) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:03,106::__init__::232::IOProcess::(_processLogs) (465118) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:05,912::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:05,914::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404291::DEBUG::2015-01-22 11:11:05,917::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:05,918::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:05,919::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404292::DEBUG::2015-01-22 11:11:05,921::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404292::DEBUG::2015-01-22 11:11:05,922::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:06,594::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:06,594::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:06,600::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:11:08,144::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:08,953::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:08,954::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404293::DEBUG::2015-01-22 11:11:08,956::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:08,957::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:08,958::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404294::DEBUG::2015-01-22 11:11:08,960::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404294::DEBUG::2015-01-22 11:11:08,961::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:11:09,929::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:09,929::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:09,929::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:09,930::__init__::232::IOProcess::(_processLogs) (465119) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:09,931::__init__::232::IOProcess::(_processLogs) (465119) Queuing response Thread-64::DEBUG::2015-01-22 11:11:09,932::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:11:09,941::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000477007 s, 973 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:09,942::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:09,942::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:09,942::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:09,943::__init__::232::IOProcess::(_processLogs) (465120) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:09,943::__init__::232::IOProcess::(_processLogs) (465120) Queuing response Thread-21::DEBUG::2015-01-22 11:11:09,944::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:09,944::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:09,944::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:09,944::__init__::232::IOProcess::(_processLogs) (465121) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:09,945::__init__::232::IOProcess::(_processLogs) (465121) Queuing response Thread-21::DEBUG::2015-01-22 11:11:09,946::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:09,946::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:09,946::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:09,946::__init__::232::IOProcess::(_processLogs) (465122) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:09,947::__init__::232::IOProcess::(_processLogs) (465122) Queuing response Thread-21::DEBUG::2015-01-22 11:11:09,948::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:09,948::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:09,948::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:09,948::__init__::232::IOProcess::(_processLogs) (465123) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:09,948::__init__::232::IOProcess::(_processLogs) (465123) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:11,606::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:11,607::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:11,614::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:11,987::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:11,988::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404295::DEBUG::2015-01-22 11:11:11,991::task::595::Storage.TaskManager.Task::(_updateState) Task=`17988555-1371-463f-9646-4983f7da8bcc`::moving from state init -> state preparing Thread-404295::INFO::2015-01-22 11:11:11,991::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404295::INFO::2015-01-22 11:11:11,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255245', 'lastCheck': '8.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477007', 'lastCheck': '2.0', 'valid': True}} Thread-404295::DEBUG::2015-01-22 11:11:11,992::task::1191::Storage.TaskManager.Task::(prepare) Task=`17988555-1371-463f-9646-4983f7da8bcc`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255245', 'lastCheck': '8.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477007', 'lastCheck': '2.0', 'valid': True}} Thread-404295::DEBUG::2015-01-22 11:11:11,992::task::595::Storage.TaskManager.Task::(_updateState) Task=`17988555-1371-463f-9646-4983f7da8bcc`::moving from state preparing -> state finished Thread-404295::DEBUG::2015-01-22 11:11:11,992::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404295::DEBUG::2015-01-22 11:11:11,992::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404295::DEBUG::2015-01-22 11:11:11,992::task::993::Storage.TaskManager.Task::(_decref) Task=`17988555-1371-463f-9646-4983f7da8bcc`::ref 0 aborting False Thread-404295::ERROR::2015-01-22 11:11:11,993::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404295::DEBUG::2015-01-22 11:11:11,996::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:12,004::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:12,006::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404296::DEBUG::2015-01-22 11:11:12,007::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404296::DEBUG::2015-01-22 11:11:12,008::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:11:13,108::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:13,108::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:13,108::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:13,109::__init__::232::IOProcess::(_processLogs) (465124) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:13,109::__init__::232::IOProcess::(_processLogs) (465124) Queuing response Thread-63::DEBUG::2015-01-22 11:11:13,109::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:11:13,118::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00028583 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:13,120::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:13,120::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:13,120::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:13,120::__init__::232::IOProcess::(_processLogs) (465125) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:13,120::__init__::232::IOProcess::(_processLogs) (465125) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:15,073::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:15,074::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404297::DEBUG::2015-01-22 11:11:15,077::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:15,078::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:15,079::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404298::DEBUG::2015-01-22 11:11:15,081::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404298::DEBUG::2015-01-22 11:11:15,082::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:16,620::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:16,621::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:16,630::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:18,115::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:18,118::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404299::DEBUG::2015-01-22 11:11:18,122::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:18,124::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:18,126::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404300::DEBUG::2015-01-22 11:11:18,129::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404300::DEBUG::2015-01-22 11:11:18,135::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:11:19,950::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:19,950::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:19,950::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:19,951::__init__::232::IOProcess::(_processLogs) (465126) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:19,952::__init__::232::IOProcess::(_processLogs) (465126) Queuing response Thread-64::DEBUG::2015-01-22 11:11:19,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:11:19,961::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000531887 s, 872 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:19,962::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:19,962::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:19,963::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:19,963::__init__::232::IOProcess::(_processLogs) (465127) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:19,963::__init__::232::IOProcess::(_processLogs) (465127) Queuing response Thread-21::DEBUG::2015-01-22 11:11:19,964::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:19,964::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:19,964::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:19,964::__init__::232::IOProcess::(_processLogs) (465128) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:19,965::__init__::232::IOProcess::(_processLogs) (465128) Queuing response Thread-21::DEBUG::2015-01-22 11:11:19,966::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:19,966::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:19,966::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:19,966::__init__::232::IOProcess::(_processLogs) (465129) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:19,966::__init__::232::IOProcess::(_processLogs) (465129) Queuing response Thread-21::DEBUG::2015-01-22 11:11:19,967::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:19,967::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:19,967::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:19,967::__init__::232::IOProcess::(_processLogs) (465130) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:19,968::__init__::232::IOProcess::(_processLogs) (465130) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:21,164::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:21,165::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404301::DEBUG::2015-01-22 11:11:21,168::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:21,169::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:21,170::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404302::DEBUG::2015-01-22 11:11:21,172::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404302::DEBUG::2015-01-22 11:11:21,173::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:21,636::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:21,637::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:21,648::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:11:23,122::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:23,122::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:23,122::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:23,123::__init__::232::IOProcess::(_processLogs) (465131) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:23,123::__init__::232::IOProcess::(_processLogs) (465131) Queuing response Thread-63::DEBUG::2015-01-22 11:11:23,123::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:11:23,131::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000297049 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:23,132::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:23,132::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:23,132::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:23,132::__init__::232::IOProcess::(_processLogs) (465132) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:23,132::__init__::232::IOProcess::(_processLogs) (465132) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:24,202::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:24,203::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404303::DEBUG::2015-01-22 11:11:24,205::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:24,206::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:24,208::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404304::DEBUG::2015-01-22 11:11:24,209::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404304::DEBUG::2015-01-22 11:11:24,210::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:26,654::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:26,655::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:26,662::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:27,239::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:27,241::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404305::DEBUG::2015-01-22 11:11:27,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`73aff8c7-7ff3-43d8-958c-df250488a051`::moving from state init -> state preparing Thread-404305::INFO::2015-01-22 11:11:27,244::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404305::INFO::2015-01-22 11:11:27,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297049', 'lastCheck': '4.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531887', 'lastCheck': '7.3', 'valid': True}} Thread-404305::DEBUG::2015-01-22 11:11:27,244::task::1191::Storage.TaskManager.Task::(prepare) Task=`73aff8c7-7ff3-43d8-958c-df250488a051`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297049', 'lastCheck': '4.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531887', 'lastCheck': '7.3', 'valid': True}} Thread-404305::DEBUG::2015-01-22 11:11:27,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`73aff8c7-7ff3-43d8-958c-df250488a051`::moving from state preparing -> state finished Thread-404305::DEBUG::2015-01-22 11:11:27,244::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404305::DEBUG::2015-01-22 11:11:27,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404305::DEBUG::2015-01-22 11:11:27,245::task::993::Storage.TaskManager.Task::(_decref) Task=`73aff8c7-7ff3-43d8-958c-df250488a051`::ref 0 aborting False Thread-404305::ERROR::2015-01-22 11:11:27,246::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404305::DEBUG::2015-01-22 11:11:27,248::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:27,257::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:27,258::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404306::DEBUG::2015-01-22 11:11:27,260::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404306::DEBUG::2015-01-22 11:11:27,261::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:11:29,970::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:29,970::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:29,970::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:29,970::__init__::232::IOProcess::(_processLogs) (465133) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:29,971::__init__::232::IOProcess::(_processLogs) (465133) Queuing response Thread-64::DEBUG::2015-01-22 11:11:29,972::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:11:29,982::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000560479 s, 828 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:29,983::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:29,983::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:29,983::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:29,983::__init__::232::IOProcess::(_processLogs) (465134) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:29,984::__init__::232::IOProcess::(_processLogs) (465134) Queuing response Thread-21::DEBUG::2015-01-22 11:11:29,984::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:29,985::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:29,985::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:29,985::__init__::232::IOProcess::(_processLogs) (465135) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:29,985::__init__::232::IOProcess::(_processLogs) (465135) Queuing response Thread-21::DEBUG::2015-01-22 11:11:29,986::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:29,986::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:29,986::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:29,986::__init__::232::IOProcess::(_processLogs) (465136) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:29,987::__init__::232::IOProcess::(_processLogs) (465136) Queuing response Thread-21::DEBUG::2015-01-22 11:11:29,987::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:29,987::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:29,987::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:29,987::__init__::232::IOProcess::(_processLogs) (465137) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:29,988::__init__::232::IOProcess::(_processLogs) (465137) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:30,330::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:30,331::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404307::DEBUG::2015-01-22 11:11:30,334::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:30,335::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:30,336::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404308::DEBUG::2015-01-22 11:11:30,337::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404308::DEBUG::2015-01-22 11:11:30,338::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:31,669::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:31,669::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:31,676::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:11:33,134::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:33,134::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:33,135::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:33,135::__init__::232::IOProcess::(_processLogs) (465138) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:33,135::__init__::232::IOProcess::(_processLogs) (465138) Queuing response Thread-63::DEBUG::2015-01-22 11:11:33,136::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:11:33,144::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000290907 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:33,145::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:33,145::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:33,145::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:33,145::__init__::232::IOProcess::(_processLogs) (465139) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:33,145::__init__::232::IOProcess::(_processLogs) (465139) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:33,372::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:33,373::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404309::DEBUG::2015-01-22 11:11:33,375::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:33,376::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:33,377::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404310::DEBUG::2015-01-22 11:11:33,379::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404310::DEBUG::2015-01-22 11:11:33,380::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:36,411::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:36,412::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404311::DEBUG::2015-01-22 11:11:36,414::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:36,415::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:36,416::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404312::DEBUG::2015-01-22 11:11:36,418::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404312::DEBUG::2015-01-22 11:11:36,419::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:36,682::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:36,683::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:36,688::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:11:38,176::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:39,449::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:39,450::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404313::DEBUG::2015-01-22 11:11:39,452::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:39,453::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:39,455::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404314::DEBUG::2015-01-22 11:11:39,456::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404314::DEBUG::2015-01-22 11:11:39,457::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:11:39,989::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:39,990::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:39,990::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:39,990::__init__::232::IOProcess::(_processLogs) (465140) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:39,991::__init__::232::IOProcess::(_processLogs) (465140) Queuing response Thread-64::DEBUG::2015-01-22 11:11:39,992::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:11:40,001::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000590332 s, 786 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:40,002::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:40,002::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:40,002::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:40,002::__init__::232::IOProcess::(_processLogs) (465141) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:40,002::__init__::232::IOProcess::(_processLogs) (465141) Queuing response Thread-21::DEBUG::2015-01-22 11:11:40,003::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:40,003::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:40,003::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:40,004::__init__::232::IOProcess::(_processLogs) (465142) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:40,004::__init__::232::IOProcess::(_processLogs) (465142) Queuing response Thread-21::DEBUG::2015-01-22 11:11:40,004::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:40,005::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:40,005::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:40,005::__init__::232::IOProcess::(_processLogs) (465143) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:40,005::__init__::232::IOProcess::(_processLogs) (465143) Queuing response Thread-21::DEBUG::2015-01-22 11:11:40,006::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:40,006::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:40,006::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:40,007::__init__::232::IOProcess::(_processLogs) (465144) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:40,007::__init__::232::IOProcess::(_processLogs) (465144) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:41,694::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:41,695::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:41,702::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:42,484::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:42,485::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404315::DEBUG::2015-01-22 11:11:42,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`fda069f3-01e9-4927-9ad9-2ad1d181df92`::moving from state init -> state preparing Thread-404315::INFO::2015-01-22 11:11:42,488::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404315::INFO::2015-01-22 11:11:42,489::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290907', 'lastCheck': '9.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590332', 'lastCheck': '2.5', 'valid': True}} Thread-404315::DEBUG::2015-01-22 11:11:42,489::task::1191::Storage.TaskManager.Task::(prepare) Task=`fda069f3-01e9-4927-9ad9-2ad1d181df92`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290907', 'lastCheck': '9.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590332', 'lastCheck': '2.5', 'valid': True}} Thread-404315::DEBUG::2015-01-22 11:11:42,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`fda069f3-01e9-4927-9ad9-2ad1d181df92`::moving from state preparing -> state finished Thread-404315::DEBUG::2015-01-22 11:11:42,489::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404315::DEBUG::2015-01-22 11:11:42,489::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404315::DEBUG::2015-01-22 11:11:42,489::task::993::Storage.TaskManager.Task::(_decref) Task=`fda069f3-01e9-4927-9ad9-2ad1d181df92`::ref 0 aborting False Thread-404315::ERROR::2015-01-22 11:11:42,490::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404315::DEBUG::2015-01-22 11:11:42,493::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:42,501::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:42,502::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404316::DEBUG::2015-01-22 11:11:42,504::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404316::DEBUG::2015-01-22 11:11:42,505::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:11:43,147::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:43,147::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:43,147::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:43,147::__init__::232::IOProcess::(_processLogs) (465145) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:43,147::__init__::232::IOProcess::(_processLogs) (465145) Queuing response Thread-63::DEBUG::2015-01-22 11:11:43,148::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:11:43,157::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000245256 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:43,158::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:43,158::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:43,158::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:43,158::__init__::232::IOProcess::(_processLogs) (465146) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:43,158::__init__::232::IOProcess::(_processLogs) (465146) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:45,573::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:45,574::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404317::DEBUG::2015-01-22 11:11:45,576::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:45,577::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:45,579::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404318::DEBUG::2015-01-22 11:11:45,580::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404318::DEBUG::2015-01-22 11:11:45,581::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:46,708::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:46,708::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:46,718::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:48,618::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:48,619::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404319::DEBUG::2015-01-22 11:11:48,621::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:48,623::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:48,624::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404320::DEBUG::2015-01-22 11:11:48,626::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404320::DEBUG::2015-01-22 11:11:48,627::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:11:50,008::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:50,008::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:50,008::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:50,009::__init__::232::IOProcess::(_processLogs) (465147) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:50,010::__init__::232::IOProcess::(_processLogs) (465147) Queuing response Thread-64::DEBUG::2015-01-22 11:11:50,010::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:11:50,020::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000524587 s, 885 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:50,020::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:50,021::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:50,021::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:50,021::__init__::232::IOProcess::(_processLogs) (465148) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:50,021::__init__::232::IOProcess::(_processLogs) (465148) Queuing response Thread-21::DEBUG::2015-01-22 11:11:50,022::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:50,022::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:50,022::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:50,022::__init__::232::IOProcess::(_processLogs) (465149) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:50,023::__init__::232::IOProcess::(_processLogs) (465149) Queuing response Thread-21::DEBUG::2015-01-22 11:11:50,023::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:50,023::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:50,023::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:50,024::__init__::232::IOProcess::(_processLogs) (465150) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:50,024::__init__::232::IOProcess::(_processLogs) (465150) Queuing response Thread-21::DEBUG::2015-01-22 11:11:50,024::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:50,024::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:50,025::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:50,025::__init__::232::IOProcess::(_processLogs) (465151) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:11:50,025::__init__::232::IOProcess::(_processLogs) (465151) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:51,655::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:51,657::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404321::DEBUG::2015-01-22 11:11:51,659::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:51,660::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:51,661::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404322::DEBUG::2015-01-22 11:11:51,663::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404322::DEBUG::2015-01-22 11:11:51,664::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:51,724::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:51,725::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:51,736::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:11:53,160::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:53,160::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:53,160::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:53,161::__init__::232::IOProcess::(_processLogs) (465152) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:53,161::__init__::232::IOProcess::(_processLogs) (465152) Queuing response Thread-63::DEBUG::2015-01-22 11:11:53,161::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:11:53,169::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000272572 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:11:53,170::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:53,171::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:53,171::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:53,171::__init__::232::IOProcess::(_processLogs) (465153) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:11:53,171::__init__::232::IOProcess::(_processLogs) (465153) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:54,691::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:54,692::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404323::DEBUG::2015-01-22 11:11:54,695::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:54,696::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:54,697::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404324::DEBUG::2015-01-22 11:11:54,699::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404324::DEBUG::2015-01-22 11:11:54,700::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:11:56,743::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:56,743::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:11:56,750::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:57,729::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:57,731::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404325::DEBUG::2015-01-22 11:11:57,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`431c6bdf-c78f-4099-b6f9-1188b8fb6d73`::moving from state init -> state preparing Thread-404325::INFO::2015-01-22 11:11:57,734::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404325::INFO::2015-01-22 11:11:57,734::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272572', 'lastCheck': '4.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524587', 'lastCheck': '7.7', 'valid': True}} Thread-404325::DEBUG::2015-01-22 11:11:57,734::task::1191::Storage.TaskManager.Task::(prepare) Task=`431c6bdf-c78f-4099-b6f9-1188b8fb6d73`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272572', 'lastCheck': '4.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524587', 'lastCheck': '7.7', 'valid': True}} Thread-404325::DEBUG::2015-01-22 11:11:57,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`431c6bdf-c78f-4099-b6f9-1188b8fb6d73`::moving from state preparing -> state finished Thread-404325::DEBUG::2015-01-22 11:11:57,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404325::DEBUG::2015-01-22 11:11:57,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404325::DEBUG::2015-01-22 11:11:57,735::task::993::Storage.TaskManager.Task::(_decref) Task=`431c6bdf-c78f-4099-b6f9-1188b8fb6d73`::ref 0 aborting False Thread-404325::ERROR::2015-01-22 11:11:57,736::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404325::DEBUG::2015-01-22 11:11:57,738::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:11:57,746::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:11:57,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404326::DEBUG::2015-01-22 11:11:57,749::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404326::DEBUG::2015-01-22 11:11:57,750::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:11:58,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8c279bf-8b53-48fe-8052-e6f230db3710`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:11:58,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:11:58,517::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:58,517::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:58,517::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:58,517::__init__::232::IOProcess::(_processLogs) (465154) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:11:58,520::__init__::232::IOProcess::(_processLogs) (465154) Queuing response Thread-21::DEBUG::2015-01-22 11:11:58,521::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:11:58,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:11:58,521::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:11:58,521::__init__::232::IOProcess::(_processLogs) (465155) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:11:58,521::__init__::232::IOProcess::(_processLogs) (465155) Queuing response Thread-360::INFO::2015-01-22 11:11:58,522::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:11:58,522::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8c279bf-8b53-48fe-8052-e6f230db3710`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:11:58,522::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8c279bf-8b53-48fe-8052-e6f230db3710`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:11:58,522::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:11:58,522::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:11:58,522::task::993::Storage.TaskManager.Task::(_decref) Task=`d8c279bf-8b53-48fe-8052-e6f230db3710`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:12:00,026::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:00,026::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:00,027::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:00,027::__init__::232::IOProcess::(_processLogs) (465156) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:00,028::__init__::232::IOProcess::(_processLogs) (465156) Queuing response Thread-64::DEBUG::2015-01-22 11:12:00,029::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:12:00,038::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000582701 s, 796 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:00,039::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:00,039::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:00,039::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:00,039::__init__::232::IOProcess::(_processLogs) (465157) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:00,039::__init__::232::IOProcess::(_processLogs) (465157) Queuing response Thread-21::DEBUG::2015-01-22 11:12:00,040::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:00,040::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:00,040::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:00,041::__init__::232::IOProcess::(_processLogs) (465158) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:00,042::__init__::232::IOProcess::(_processLogs) (465158) Queuing response Thread-21::DEBUG::2015-01-22 11:12:00,042::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:00,043::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:00,043::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:00,043::__init__::232::IOProcess::(_processLogs) (465159) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:00,043::__init__::232::IOProcess::(_processLogs) (465159) Queuing response Thread-21::DEBUG::2015-01-22 11:12:00,044::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:00,044::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:00,044::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:00,044::__init__::232::IOProcess::(_processLogs) (465160) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:00,045::__init__::232::IOProcess::(_processLogs) (465160) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:00,813::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:00,814::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404327::DEBUG::2015-01-22 11:12:00,816::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:00,817::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:00,819::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404328::DEBUG::2015-01-22 11:12:00,821::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404328::DEBUG::2015-01-22 11:12:00,822::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:01,757::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:01,758::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:01,763::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:12:03,173::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:03,173::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:03,173::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:03,173::__init__::232::IOProcess::(_processLogs) (465161) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:03,173::__init__::232::IOProcess::(_processLogs) (465161) Queuing response Thread-63::DEBUG::2015-01-22 11:12:03,174::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:12:03,183::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000316304 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:03,183::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:03,184::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:03,184::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:03,184::__init__::232::IOProcess::(_processLogs) (465162) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:03,184::__init__::232::IOProcess::(_processLogs) (465162) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:03,856::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:03,858::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404329::DEBUG::2015-01-22 11:12:03,860::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:03,861::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:03,862::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404330::DEBUG::2015-01-22 11:12:03,865::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404330::DEBUG::2015-01-22 11:12:03,866::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:06,769::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:06,770::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:06,777::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:06,893::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:06,895::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404331::DEBUG::2015-01-22 11:12:06,897::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:06,898::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:06,899::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404332::DEBUG::2015-01-22 11:12:06,901::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404332::DEBUG::2015-01-22 11:12:06,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:12:08,211::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:09,932::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:09,933::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404333::DEBUG::2015-01-22 11:12:09,935::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:09,936::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:09,937::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404334::DEBUG::2015-01-22 11:12:09,939::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404334::DEBUG::2015-01-22 11:12:09,940::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:12:10,046::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:10,047::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:10,047::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:10,047::__init__::232::IOProcess::(_processLogs) (465163) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:10,049::__init__::232::IOProcess::(_processLogs) (465163) Queuing response Thread-64::DEBUG::2015-01-22 11:12:10,049::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:12:10,058::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000617246 s, 752 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:10,059::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:10,059::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:10,060::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:10,060::__init__::232::IOProcess::(_processLogs) (465164) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:10,060::__init__::232::IOProcess::(_processLogs) (465164) Queuing response Thread-21::DEBUG::2015-01-22 11:12:10,061::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:10,061::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:10,061::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:10,061::__init__::232::IOProcess::(_processLogs) (465165) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:10,062::__init__::232::IOProcess::(_processLogs) (465165) Queuing response Thread-21::DEBUG::2015-01-22 11:12:10,063::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:10,063::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:10,064::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:10,064::__init__::232::IOProcess::(_processLogs) (465166) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:10,064::__init__::232::IOProcess::(_processLogs) (465166) Queuing response Thread-21::DEBUG::2015-01-22 11:12:10,065::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:10,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:10,065::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:10,065::__init__::232::IOProcess::(_processLogs) (465167) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:10,065::__init__::232::IOProcess::(_processLogs) (465167) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:11,784::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:11,784::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:11,791::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:12,970::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:12,972::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404335::DEBUG::2015-01-22 11:12:12,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bf1eac1-3f5a-45c8-88aa-8dc96f9320b2`::moving from state init -> state preparing Thread-404335::INFO::2015-01-22 11:12:12,975::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404335::INFO::2015-01-22 11:12:12,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000316304', 'lastCheck': '9.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617246', 'lastCheck': '2.9', 'valid': True}} Thread-404335::DEBUG::2015-01-22 11:12:12,975::task::1191::Storage.TaskManager.Task::(prepare) Task=`8bf1eac1-3f5a-45c8-88aa-8dc96f9320b2`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000316304', 'lastCheck': '9.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617246', 'lastCheck': '2.9', 'valid': True}} Thread-404335::DEBUG::2015-01-22 11:12:12,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bf1eac1-3f5a-45c8-88aa-8dc96f9320b2`::moving from state preparing -> state finished Thread-404335::DEBUG::2015-01-22 11:12:12,975::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404335::DEBUG::2015-01-22 11:12:12,975::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404335::DEBUG::2015-01-22 11:12:12,976::task::993::Storage.TaskManager.Task::(_decref) Task=`8bf1eac1-3f5a-45c8-88aa-8dc96f9320b2`::ref 0 aborting False Thread-404335::ERROR::2015-01-22 11:12:12,976::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404335::DEBUG::2015-01-22 11:12:12,979::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:12,987::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:12,989::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404336::DEBUG::2015-01-22 11:12:12,991::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404336::DEBUG::2015-01-22 11:12:12,992::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:12:13,186::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:13,186::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:13,186::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:13,186::__init__::232::IOProcess::(_processLogs) (465168) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:13,186::__init__::232::IOProcess::(_processLogs) (465168) Queuing response Thread-63::DEBUG::2015-01-22 11:12:13,187::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:12:13,196::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000308024 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:13,197::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:13,197::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:13,197::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:13,198::__init__::232::IOProcess::(_processLogs) (465169) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:13,198::__init__::232::IOProcess::(_processLogs) (465169) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:16,047::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:16,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404337::DEBUG::2015-01-22 11:12:16,051::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:16,052::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:16,053::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404338::DEBUG::2015-01-22 11:12:16,055::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404338::DEBUG::2015-01-22 11:12:16,056::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:16,797::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:16,798::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:16,807::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:19,083::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:19,085::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404339::DEBUG::2015-01-22 11:12:19,087::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:19,088::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:19,089::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404340::DEBUG::2015-01-22 11:12:19,091::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404340::DEBUG::2015-01-22 11:12:19,091::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:12:20,067::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:20,067::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:20,067::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:20,067::__init__::232::IOProcess::(_processLogs) (465170) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:20,069::__init__::232::IOProcess::(_processLogs) (465170) Queuing response Thread-64::DEBUG::2015-01-22 11:12:20,070::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:12:20,079::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000499393 s, 929 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:20,080::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:20,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:20,080::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:20,080::__init__::232::IOProcess::(_processLogs) (465171) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:20,080::__init__::232::IOProcess::(_processLogs) (465171) Queuing response Thread-21::DEBUG::2015-01-22 11:12:20,081::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:20,082::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:20,082::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:20,082::__init__::232::IOProcess::(_processLogs) (465172) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:20,083::__init__::232::IOProcess::(_processLogs) (465172) Queuing response Thread-21::DEBUG::2015-01-22 11:12:20,084::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:20,084::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:20,084::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:20,084::__init__::232::IOProcess::(_processLogs) (465173) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:20,084::__init__::232::IOProcess::(_processLogs) (465173) Queuing response Thread-21::DEBUG::2015-01-22 11:12:20,085::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:20,085::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:20,085::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:20,085::__init__::232::IOProcess::(_processLogs) (465174) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:20,086::__init__::232::IOProcess::(_processLogs) (465174) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:21,813::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:21,814::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:21,825::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:22,118::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:22,119::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404341::DEBUG::2015-01-22 11:12:22,121::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:22,122::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:22,123::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404342::DEBUG::2015-01-22 11:12:22,125::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404342::DEBUG::2015-01-22 11:12:22,126::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:12:23,200::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:23,200::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:23,200::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:23,200::__init__::232::IOProcess::(_processLogs) (465175) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:23,200::__init__::232::IOProcess::(_processLogs) (465175) Queuing response Thread-63::DEBUG::2015-01-22 11:12:23,201::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:12:23,209::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000279288 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:23,210::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:23,210::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:23,211::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:23,211::__init__::232::IOProcess::(_processLogs) (465176) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:23,211::__init__::232::IOProcess::(_processLogs) (465176) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:25,155::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:25,156::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404343::DEBUG::2015-01-22 11:12:25,159::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:25,160::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:25,161::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404344::DEBUG::2015-01-22 11:12:25,163::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404344::DEBUG::2015-01-22 11:12:25,164::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:26,831::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:26,832::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:26,839::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:28,190::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:28,191::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404345::DEBUG::2015-01-22 11:12:28,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`8536c09e-7aa7-418c-8281-aae03d1159e6`::moving from state init -> state preparing Thread-404345::INFO::2015-01-22 11:12:28,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404345::INFO::2015-01-22 11:12:28,195::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000279288', 'lastCheck': '5.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499393', 'lastCheck': '8.1', 'valid': True}} Thread-404345::DEBUG::2015-01-22 11:12:28,195::task::1191::Storage.TaskManager.Task::(prepare) Task=`8536c09e-7aa7-418c-8281-aae03d1159e6`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000279288', 'lastCheck': '5.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499393', 'lastCheck': '8.1', 'valid': True}} Thread-404345::DEBUG::2015-01-22 11:12:28,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`8536c09e-7aa7-418c-8281-aae03d1159e6`::moving from state preparing -> state finished Thread-404345::DEBUG::2015-01-22 11:12:28,195::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404345::DEBUG::2015-01-22 11:12:28,195::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404345::DEBUG::2015-01-22 11:12:28,195::task::993::Storage.TaskManager.Task::(_decref) Task=`8536c09e-7aa7-418c-8281-aae03d1159e6`::ref 0 aborting False Thread-404345::ERROR::2015-01-22 11:12:28,196::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404345::DEBUG::2015-01-22 11:12:28,199::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:28,206::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:28,207::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404346::DEBUG::2015-01-22 11:12:28,209::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404346::DEBUG::2015-01-22 11:12:28,210::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:12:30,088::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:30,088::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:30,088::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:30,088::__init__::232::IOProcess::(_processLogs) (465177) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:30,090::__init__::232::IOProcess::(_processLogs) (465177) Queuing response Thread-64::DEBUG::2015-01-22 11:12:30,091::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:12:30,100::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000480352 s, 966 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:30,101::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:30,101::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:30,101::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:30,101::__init__::232::IOProcess::(_processLogs) (465178) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:30,101::__init__::232::IOProcess::(_processLogs) (465178) Queuing response Thread-21::DEBUG::2015-01-22 11:12:30,102::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:30,102::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:30,103::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:30,103::__init__::232::IOProcess::(_processLogs) (465179) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:30,103::__init__::232::IOProcess::(_processLogs) (465179) Queuing response Thread-21::DEBUG::2015-01-22 11:12:30,104::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:30,104::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:30,105::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:30,105::__init__::232::IOProcess::(_processLogs) (465180) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:30,105::__init__::232::IOProcess::(_processLogs) (465180) Queuing response Thread-21::DEBUG::2015-01-22 11:12:30,105::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:30,106::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:30,106::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:30,106::__init__::232::IOProcess::(_processLogs) (465181) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:30,107::__init__::232::IOProcess::(_processLogs) (465181) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:31,271::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:31,272::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404347::DEBUG::2015-01-22 11:12:31,274::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:31,275::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:31,277::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404348::DEBUG::2015-01-22 11:12:31,279::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404348::DEBUG::2015-01-22 11:12:31,280::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:31,845::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:31,846::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:31,857::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:12:33,213::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:33,213::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:33,213::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:33,213::__init__::232::IOProcess::(_processLogs) (465182) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:33,213::__init__::232::IOProcess::(_processLogs) (465182) Queuing response Thread-63::DEBUG::2015-01-22 11:12:33,214::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:12:33,222::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000251896 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:33,223::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:33,223::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:33,223::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:33,223::__init__::232::IOProcess::(_processLogs) (465183) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:33,224::__init__::232::IOProcess::(_processLogs) (465183) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:34,311::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:34,312::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404349::DEBUG::2015-01-22 11:12:34,315::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:34,316::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:34,317::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404350::DEBUG::2015-01-22 11:12:34,319::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404350::DEBUG::2015-01-22 11:12:34,320::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:36,863::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:36,864::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:36,871::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:37,346::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:37,348::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404351::DEBUG::2015-01-22 11:12:37,351::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:37,352::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:37,353::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404352::DEBUG::2015-01-22 11:12:37,355::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404352::DEBUG::2015-01-22 11:12:37,356::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:12:38,245::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:12:40,108::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:40,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:40,109::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:40,109::__init__::232::IOProcess::(_processLogs) (465184) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:40,110::__init__::232::IOProcess::(_processLogs) (465184) Queuing response Thread-64::DEBUG::2015-01-22 11:12:40,111::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:12:40,120::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00048006 s, 967 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:40,121::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:40,121::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:40,121::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:40,122::__init__::232::IOProcess::(_processLogs) (465185) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:40,122::__init__::232::IOProcess::(_processLogs) (465185) Queuing response Thread-21::DEBUG::2015-01-22 11:12:40,123::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:40,123::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:40,123::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:40,123::__init__::232::IOProcess::(_processLogs) (465186) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:40,123::__init__::232::IOProcess::(_processLogs) (465186) Queuing response Thread-21::DEBUG::2015-01-22 11:12:40,124::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:40,124::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:40,125::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:40,125::__init__::232::IOProcess::(_processLogs) (465187) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:40,125::__init__::232::IOProcess::(_processLogs) (465187) Queuing response Thread-21::DEBUG::2015-01-22 11:12:40,126::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:40,126::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:40,127::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:40,127::__init__::232::IOProcess::(_processLogs) (465188) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:40,127::__init__::232::IOProcess::(_processLogs) (465188) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:40,388::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:40,390::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404353::DEBUG::2015-01-22 11:12:40,392::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:40,393::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:40,394::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404354::DEBUG::2015-01-22 11:12:40,396::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404354::DEBUG::2015-01-22 11:12:40,397::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:41,877::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:41,878::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:41,887::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:12:43,226::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:43,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:43,226::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:43,226::__init__::232::IOProcess::(_processLogs) (465189) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:43,226::__init__::232::IOProcess::(_processLogs) (465189) Queuing response Thread-63::DEBUG::2015-01-22 11:12:43,227::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:12:43,237::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000318151 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:43,238::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:43,238::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:43,238::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:43,238::__init__::232::IOProcess::(_processLogs) (465190) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:43,238::__init__::232::IOProcess::(_processLogs) (465190) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:43,427::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:43,428::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404355::DEBUG::2015-01-22 11:12:43,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`1735a0fb-73ff-4343-a90f-f3faf5453bd3`::moving from state init -> state preparing Thread-404355::INFO::2015-01-22 11:12:43,432::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404355::INFO::2015-01-22 11:12:43,432::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000318151', 'lastCheck': '0.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048006', 'lastCheck': '3.3', 'valid': True}} Thread-404355::DEBUG::2015-01-22 11:12:43,432::task::1191::Storage.TaskManager.Task::(prepare) Task=`1735a0fb-73ff-4343-a90f-f3faf5453bd3`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000318151', 'lastCheck': '0.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048006', 'lastCheck': '3.3', 'valid': True}} Thread-404355::DEBUG::2015-01-22 11:12:43,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`1735a0fb-73ff-4343-a90f-f3faf5453bd3`::moving from state preparing -> state finished Thread-404355::DEBUG::2015-01-22 11:12:43,433::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404355::DEBUG::2015-01-22 11:12:43,433::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404355::DEBUG::2015-01-22 11:12:43,433::task::993::Storage.TaskManager.Task::(_decref) Task=`1735a0fb-73ff-4343-a90f-f3faf5453bd3`::ref 0 aborting False Thread-404355::ERROR::2015-01-22 11:12:43,434::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404355::DEBUG::2015-01-22 11:12:43,436::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:43,445::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:43,446::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404356::DEBUG::2015-01-22 11:12:43,448::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404356::DEBUG::2015-01-22 11:12:43,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:46,512::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:46,513::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404357::DEBUG::2015-01-22 11:12:46,515::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:46,516::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:46,517::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404358::DEBUG::2015-01-22 11:12:46,518::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404358::DEBUG::2015-01-22 11:12:46,519::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:46,894::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:46,895::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:46,907::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:49,552::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:49,553::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404359::DEBUG::2015-01-22 11:12:49,556::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:49,557::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:49,558::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404360::DEBUG::2015-01-22 11:12:49,560::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404360::DEBUG::2015-01-22 11:12:49,561::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:12:50,128::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:50,129::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:50,129::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:50,129::__init__::232::IOProcess::(_processLogs) (465191) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:50,130::__init__::232::IOProcess::(_processLogs) (465191) Queuing response Thread-64::DEBUG::2015-01-22 11:12:50,131::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:12:50,140::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000493488 s, 940 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:50,141::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:50,141::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:50,141::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:50,142::__init__::232::IOProcess::(_processLogs) (465192) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:50,142::__init__::232::IOProcess::(_processLogs) (465192) Queuing response Thread-21::DEBUG::2015-01-22 11:12:50,143::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:50,143::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:50,143::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:50,143::__init__::232::IOProcess::(_processLogs) (465193) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:50,143::__init__::232::IOProcess::(_processLogs) (465193) Queuing response Thread-21::DEBUG::2015-01-22 11:12:50,144::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:50,145::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:50,145::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:50,145::__init__::232::IOProcess::(_processLogs) (465194) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:50,145::__init__::232::IOProcess::(_processLogs) (465194) Queuing response Thread-21::DEBUG::2015-01-22 11:12:50,146::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:50,146::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:50,146::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:50,146::__init__::232::IOProcess::(_processLogs) (465195) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:12:50,147::__init__::232::IOProcess::(_processLogs) (465195) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:51,913::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:51,914::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:51,925::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:52,591::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:52,592::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404361::DEBUG::2015-01-22 11:12:52,595::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:52,596::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:52,597::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404362::DEBUG::2015-01-22 11:12:52,599::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404362::DEBUG::2015-01-22 11:12:52,600::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:12:53,240::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:53,240::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:53,240::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:53,240::__init__::232::IOProcess::(_processLogs) (465196) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:53,241::__init__::232::IOProcess::(_processLogs) (465196) Queuing response Thread-63::DEBUG::2015-01-22 11:12:53,241::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:12:53,249::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000247607 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:12:53,250::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:53,251::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:53,251::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:53,251::__init__::232::IOProcess::(_processLogs) (465197) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:12:53,251::__init__::232::IOProcess::(_processLogs) (465197) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:55,625::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:55,626::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404363::DEBUG::2015-01-22 11:12:55,628::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:55,629::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:55,631::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404364::DEBUG::2015-01-22 11:12:55,632::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404364::DEBUG::2015-01-22 11:12:55,633::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:12:56,932::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:56,932::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:12:56,943::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:12:58,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`bec30dac-f371-49e5-8529-f41a77cb46e5`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:12:58,604::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:12:58,606::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:58,606::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:58,606::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:58,606::__init__::232::IOProcess::(_processLogs) (465198) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:12:58,609::__init__::232::IOProcess::(_processLogs) (465198) Queuing response Thread-21::DEBUG::2015-01-22 11:12:58,610::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:12:58,610::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:12:58,610::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:12:58,611::__init__::232::IOProcess::(_processLogs) (465199) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:12:58,611::__init__::232::IOProcess::(_processLogs) (465199) Queuing response Thread-360::INFO::2015-01-22 11:12:58,611::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:12:58,612::task::1191::Storage.TaskManager.Task::(prepare) Task=`bec30dac-f371-49e5-8529-f41a77cb46e5`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:12:58,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`bec30dac-f371-49e5-8529-f41a77cb46e5`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:12:58,612::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:12:58,612::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:12:58,612::task::993::Storage.TaskManager.Task::(_decref) Task=`bec30dac-f371-49e5-8529-f41a77cb46e5`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:58,662::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:58,663::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404365::DEBUG::2015-01-22 11:12:58,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`e91591c7-fa23-4e2b-ba31-8749567b2420`::moving from state init -> state preparing Thread-404365::INFO::2015-01-22 11:12:58,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404365::INFO::2015-01-22 11:12:58,666::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000247607', 'lastCheck': '5.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493488', 'lastCheck': '8.5', 'valid': True}} Thread-404365::DEBUG::2015-01-22 11:12:58,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`e91591c7-fa23-4e2b-ba31-8749567b2420`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000247607', 'lastCheck': '5.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493488', 'lastCheck': '8.5', 'valid': True}} Thread-404365::DEBUG::2015-01-22 11:12:58,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`e91591c7-fa23-4e2b-ba31-8749567b2420`::moving from state preparing -> state finished Thread-404365::DEBUG::2015-01-22 11:12:58,667::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404365::DEBUG::2015-01-22 11:12:58,667::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404365::DEBUG::2015-01-22 11:12:58,667::task::993::Storage.TaskManager.Task::(_decref) Task=`e91591c7-fa23-4e2b-ba31-8749567b2420`::ref 0 aborting False Thread-404365::ERROR::2015-01-22 11:12:58,668::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404365::DEBUG::2015-01-22 11:12:58,671::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:12:58,679::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:12:58,680::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404366::DEBUG::2015-01-22 11:12:58,682::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404366::DEBUG::2015-01-22 11:12:58,683::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:13:00,148::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:00,149::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:00,149::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:00,149::__init__::232::IOProcess::(_processLogs) (465200) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:00,151::__init__::232::IOProcess::(_processLogs) (465200) Queuing response Thread-64::DEBUG::2015-01-22 11:13:00,153::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:13:00,162::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000490013 s, 947 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:00,163::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:00,163::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:00,163::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:00,163::__init__::232::IOProcess::(_processLogs) (465201) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:00,163::__init__::232::IOProcess::(_processLogs) (465201) Queuing response Thread-21::DEBUG::2015-01-22 11:13:00,164::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:00,164::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:00,165::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:00,165::__init__::232::IOProcess::(_processLogs) (465202) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:00,166::__init__::232::IOProcess::(_processLogs) (465202) Queuing response Thread-21::DEBUG::2015-01-22 11:13:00,167::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:00,167::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:00,167::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:00,167::__init__::232::IOProcess::(_processLogs) (465203) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:00,168::__init__::232::IOProcess::(_processLogs) (465203) Queuing response Thread-21::DEBUG::2015-01-22 11:13:00,168::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:00,168::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:00,168::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:00,169::__init__::232::IOProcess::(_processLogs) (465204) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:00,169::__init__::232::IOProcess::(_processLogs) (465204) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:01,736::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:01,737::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404367::DEBUG::2015-01-22 11:13:01,740::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:01,741::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:01,742::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404368::DEBUG::2015-01-22 11:13:01,744::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404368::DEBUG::2015-01-22 11:13:01,745::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:01,950::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:01,950::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:01,961::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:13:03,253::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:03,253::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:03,253::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:03,253::__init__::232::IOProcess::(_processLogs) (465205) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:03,254::__init__::232::IOProcess::(_processLogs) (465205) Queuing response Thread-63::DEBUG::2015-01-22 11:13:03,254::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:13:03,262::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000353413 s, 911 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:03,263::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:03,264::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:03,264::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:03,264::__init__::232::IOProcess::(_processLogs) (465206) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:03,264::__init__::232::IOProcess::(_processLogs) (465206) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:04,781::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:04,782::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404369::DEBUG::2015-01-22 11:13:04,785::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:04,786::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:04,790::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404370::DEBUG::2015-01-22 11:13:04,794::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404370::DEBUG::2015-01-22 11:13:04,797::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:06,968::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:06,969::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:06,975::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:07,839::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:07,840::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404371::DEBUG::2015-01-22 11:13:07,843::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:07,844::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:07,845::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404372::DEBUG::2015-01-22 11:13:07,847::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404372::DEBUG::2015-01-22 11:13:07,848::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:13:08,280::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:13:10,171::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:10,171::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:10,171::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:10,172::__init__::232::IOProcess::(_processLogs) (465207) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:10,173::__init__::232::IOProcess::(_processLogs) (465207) Queuing response Thread-64::DEBUG::2015-01-22 11:13:10,174::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:13:10,183::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000532485 s, 871 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:10,184::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:10,184::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:10,184::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:10,184::__init__::232::IOProcess::(_processLogs) (465208) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:10,184::__init__::232::IOProcess::(_processLogs) (465208) Queuing response Thread-21::DEBUG::2015-01-22 11:13:10,185::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:10,185::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:10,185::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:10,185::__init__::232::IOProcess::(_processLogs) (465209) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:10,186::__init__::232::IOProcess::(_processLogs) (465209) Queuing response Thread-21::DEBUG::2015-01-22 11:13:10,186::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:10,187::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:10,187::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:10,187::__init__::232::IOProcess::(_processLogs) (465210) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:10,187::__init__::232::IOProcess::(_processLogs) (465210) Queuing response Thread-21::DEBUG::2015-01-22 11:13:10,188::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:10,188::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:10,188::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:10,188::__init__::232::IOProcess::(_processLogs) (465211) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:10,188::__init__::232::IOProcess::(_processLogs) (465211) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:10,879::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:10,880::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404373::DEBUG::2015-01-22 11:13:10,883::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:10,884::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:10,885::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404374::DEBUG::2015-01-22 11:13:10,887::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404374::DEBUG::2015-01-22 11:13:10,888::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:11,982::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:11,983::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:11,992::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:13:13,266::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:13,266::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:13,266::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:13,266::__init__::232::IOProcess::(_processLogs) (465212) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:13,266::__init__::232::IOProcess::(_processLogs) (465212) Queuing response Thread-63::DEBUG::2015-01-22 11:13:13,267::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:13:13,276::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000269857 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:13,277::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:13,277::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:13,277::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:13,277::__init__::232::IOProcess::(_processLogs) (465213) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:13,278::__init__::232::IOProcess::(_processLogs) (465213) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:13,913::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:13,915::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404375::DEBUG::2015-01-22 11:13:13,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`25deb923-b749-453a-bafa-d64c0b16af93`::moving from state init -> state preparing Thread-404375::INFO::2015-01-22 11:13:13,918::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404375::INFO::2015-01-22 11:13:13,919::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000269857', 'lastCheck': '0.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532485', 'lastCheck': '3.7', 'valid': True}} Thread-404375::DEBUG::2015-01-22 11:13:13,919::task::1191::Storage.TaskManager.Task::(prepare) Task=`25deb923-b749-453a-bafa-d64c0b16af93`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000269857', 'lastCheck': '0.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532485', 'lastCheck': '3.7', 'valid': True}} Thread-404375::DEBUG::2015-01-22 11:13:13,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`25deb923-b749-453a-bafa-d64c0b16af93`::moving from state preparing -> state finished Thread-404375::DEBUG::2015-01-22 11:13:13,919::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404375::DEBUG::2015-01-22 11:13:13,919::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404375::DEBUG::2015-01-22 11:13:13,919::task::993::Storage.TaskManager.Task::(_decref) Task=`25deb923-b749-453a-bafa-d64c0b16af93`::ref 0 aborting False Thread-404375::ERROR::2015-01-22 11:13:13,920::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404375::DEBUG::2015-01-22 11:13:13,923::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:13,930::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:13,931::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404376::DEBUG::2015-01-22 11:13:13,933::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404376::DEBUG::2015-01-22 11:13:13,934::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:16,994::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:16,997::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request GuestMonitor-Sql::DEBUG::2015-01-22 11:13:17,002::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404377::DEBUG::2015-01-22 11:13:17,006::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:17,008::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:17,010::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message GuestMonitor-Sql::DEBUG::2015-01-22 11:13:17,014::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpcServer::DEBUG::2015-01-22 11:13:17,014::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404378::DEBUG::2015-01-22 11:13:17,019::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404378::DEBUG::2015-01-22 11:13:17,020::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:20,051::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:20,052::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404379::DEBUG::2015-01-22 11:13:20,054::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:20,055::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:20,056::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404380::DEBUG::2015-01-22 11:13:20,057::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404380::DEBUG::2015-01-22 11:13:20,058::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:13:20,190::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:20,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:20,190::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:20,190::__init__::232::IOProcess::(_processLogs) (465214) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:20,192::__init__::232::IOProcess::(_processLogs) (465214) Queuing response Thread-64::DEBUG::2015-01-22 11:13:20,193::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:13:20,202::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00050206 s, 924 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:20,203::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:20,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:20,203::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:20,203::__init__::232::IOProcess::(_processLogs) (465215) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:20,203::__init__::232::IOProcess::(_processLogs) (465215) Queuing response Thread-21::DEBUG::2015-01-22 11:13:20,204::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:20,204::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:20,204::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:20,204::__init__::232::IOProcess::(_processLogs) (465216) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:20,205::__init__::232::IOProcess::(_processLogs) (465216) Queuing response Thread-21::DEBUG::2015-01-22 11:13:20,205::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:20,206::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:20,206::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:20,206::__init__::232::IOProcess::(_processLogs) (465217) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:20,206::__init__::232::IOProcess::(_processLogs) (465217) Queuing response Thread-21::DEBUG::2015-01-22 11:13:20,207::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:20,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:20,207::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:20,207::__init__::232::IOProcess::(_processLogs) (465218) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:20,207::__init__::232::IOProcess::(_processLogs) (465218) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:22,025::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:22,039::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:22,039::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:23,085::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:23,086::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404381::DEBUG::2015-01-22 11:13:23,088::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:23,089::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:23,090::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404382::DEBUG::2015-01-22 11:13:23,092::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404382::DEBUG::2015-01-22 11:13:23,093::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-63::DEBUG::2015-01-22 11:13:23,279::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d26c38f9-0719-457c-8ce0-a074d1eff534 Thread-21::DEBUG::2015-01-22 11:13:23,281::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:23,281::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:23,282::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:23,282::__init__::232::IOProcess::(_processLogs) (465219) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:13:23,282::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:23,282::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:23,282::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:23,282::__init__::232::IOProcess::(_processLogs) (465220) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:13:23,282::__init__::232::IOProcess::(_processLogs) (465219) Queuing response Thread-21::DEBUG::2015-01-22 11:13:23,286::__init__::232::IOProcess::(_processLogs) (465220) Queuing response Thread-63::DEBUG::2015-01-22 11:13:23,292::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534 Thread-21::DEBUG::2015-01-22 11:13:23,292::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:23,292::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:23,292::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:23,293::__init__::232::IOProcess::(_processLogs) (465221) Got request for method 'touch' Thread-21::DEBUG::2015-01-22 11:13:23,296::__init__::232::IOProcess::(_processLogs) (465221) Queuing response Thread-63::DEBUG::2015-01-22 11:13:23,297::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend Thread-21::DEBUG::2015-01-22 11:13:23,298::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:23,298::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:23,298::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:23,298::__init__::232::IOProcess::(_processLogs) (465222) Got request for method 'readfile' Thread-21::DEBUG::2015-01-22 11:13:23,299::__init__::232::IOProcess::(_processLogs) (465222) Queuing response Thread-63::DEBUG::2015-01-22 11:13:23,299::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISO', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=67c137fd-0cf2-463a-bc70-b427cc0a5da3', 'REMOTE_PATH=192.168.1.24:/Data/ISO', 'ROLE=Regular', 'SDUUID=d26c38f9-0719-457c-8ce0-a074d1eff534', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2e3c4b23cacb8bd1a5cc7cf85722fc990962eb40'] Thread-21::DEBUG::2015-01-22 11:13:23,300::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:23,300::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:23,300::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:23,300::__init__::232::IOProcess::(_processLogs) (465223) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:23,300::__init__::232::IOProcess::(_processLogs) (465223) Queuing response Thread-21::DEBUG::2015-01-22 11:13:23,301::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:23,301::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:23,301::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:23,301::__init__::232::IOProcess::(_processLogs) (465224) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:13:23,302::__init__::232::IOProcess::(_processLogs) (465224) Queuing response Thread-63::DEBUG::2015-01-22 11:13:23,302::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-63::INFO::2015-01-22 11:13:23,302::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d26c38f9-0719-457c-8ce0-a074d1eff534_imageNS already registered Thread-63::INFO::2015-01-22 11:13:23,302::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d26c38f9-0719-457c-8ce0-a074d1eff534_volumeNS already registered Thread-21::DEBUG::2015-01-22 11:13:23,303::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:23,303::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:23,303::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:23,303::__init__::232::IOProcess::(_processLogs) (465225) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:23,303::__init__::232::IOProcess::(_processLogs) (465225) Queuing response Thread-63::DEBUG::2015-01-22 11:13:23,304::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:13:23,312::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000249495 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:23,313::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:23,313::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:23,313::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:23,313::__init__::232::IOProcess::(_processLogs) (465226) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:23,313::__init__::232::IOProcess::(_processLogs) (465226) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:26,119::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:26,120::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404385::DEBUG::2015-01-22 11:13:26,123::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:26,124::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:26,125::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404386::DEBUG::2015-01-22 11:13:26,127::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404386::DEBUG::2015-01-22 11:13:26,128::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:27,045::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:27,046::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:27,060::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:29,154::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:29,155::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404387::DEBUG::2015-01-22 11:13:29,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b19e3cf-922e-4ea1-bca4-f04de53de9c6`::moving from state init -> state preparing Thread-404387::INFO::2015-01-22 11:13:29,158::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404387::INFO::2015-01-22 11:13:29,159::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249495', 'lastCheck': '5.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050206', 'lastCheck': '9.0', 'valid': True}} Thread-404387::DEBUG::2015-01-22 11:13:29,159::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b19e3cf-922e-4ea1-bca4-f04de53de9c6`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249495', 'lastCheck': '5.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050206', 'lastCheck': '9.0', 'valid': True}} Thread-404387::DEBUG::2015-01-22 11:13:29,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b19e3cf-922e-4ea1-bca4-f04de53de9c6`::moving from state preparing -> state finished Thread-404387::DEBUG::2015-01-22 11:13:29,159::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404387::DEBUG::2015-01-22 11:13:29,159::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404387::DEBUG::2015-01-22 11:13:29,159::task::993::Storage.TaskManager.Task::(_decref) Task=`2b19e3cf-922e-4ea1-bca4-f04de53de9c6`::ref 0 aborting False Thread-404387::ERROR::2015-01-22 11:13:29,160::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404387::DEBUG::2015-01-22 11:13:29,163::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:29,171::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:29,172::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404388::DEBUG::2015-01-22 11:13:29,174::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404388::DEBUG::2015-01-22 11:13:29,175::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:13:30,209::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:30,209::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:30,209::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:30,209::__init__::232::IOProcess::(_processLogs) (465227) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:30,211::__init__::232::IOProcess::(_processLogs) (465227) Queuing response Thread-64::DEBUG::2015-01-22 11:13:30,211::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:13:30,220::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000551066 s, 842 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:30,221::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:30,221::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:30,221::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:30,221::__init__::232::IOProcess::(_processLogs) (465228) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:30,222::__init__::232::IOProcess::(_processLogs) (465228) Queuing response Thread-21::DEBUG::2015-01-22 11:13:30,222::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:30,223::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:30,223::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:30,223::__init__::232::IOProcess::(_processLogs) (465229) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:30,223::__init__::232::IOProcess::(_processLogs) (465229) Queuing response Thread-21::DEBUG::2015-01-22 11:13:30,224::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:30,224::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:30,224::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:30,225::__init__::232::IOProcess::(_processLogs) (465230) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:30,225::__init__::232::IOProcess::(_processLogs) (465230) Queuing response Thread-21::DEBUG::2015-01-22 11:13:30,226::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:30,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:30,226::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:30,227::__init__::232::IOProcess::(_processLogs) (465231) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:30,227::__init__::232::IOProcess::(_processLogs) (465231) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:32,067::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:32,067::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:32,068::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:32,238::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:32,240::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404389::DEBUG::2015-01-22 11:13:32,242::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:32,243::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:32,245::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404390::DEBUG::2015-01-22 11:13:32,247::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404390::DEBUG::2015-01-22 11:13:32,248::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:13:33,315::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:33,315::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:33,315::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:33,315::__init__::232::IOProcess::(_processLogs) (465232) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:33,315::__init__::232::IOProcess::(_processLogs) (465232) Queuing response Thread-63::DEBUG::2015-01-22 11:13:33,316::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:13:33,324::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000254219 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:33,325::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:33,325::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:33,326::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:33,326::__init__::232::IOProcess::(_processLogs) (465233) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:33,326::__init__::232::IOProcess::(_processLogs) (465233) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:35,280::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:35,281::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404391::DEBUG::2015-01-22 11:13:35,283::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:35,284::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:35,285::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404392::DEBUG::2015-01-22 11:13:35,287::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404392::DEBUG::2015-01-22 11:13:35,289::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:37,074::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:37,074::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:37,084::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:13:38,314::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:38,316::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:38,318::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404393::DEBUG::2015-01-22 11:13:38,320::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:38,321::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:38,322::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404394::DEBUG::2015-01-22 11:13:38,324::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404394::DEBUG::2015-01-22 11:13:38,325::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:13:40,228::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:40,228::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:40,228::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:40,229::__init__::232::IOProcess::(_processLogs) (465234) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:40,230::__init__::232::IOProcess::(_processLogs) (465234) Queuing response Thread-64::DEBUG::2015-01-22 11:13:40,231::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:13:40,239::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000499273 s, 929 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:40,240::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:40,240::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:40,240::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:40,241::__init__::232::IOProcess::(_processLogs) (465235) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:40,241::__init__::232::IOProcess::(_processLogs) (465235) Queuing response Thread-21::DEBUG::2015-01-22 11:13:40,242::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:40,242::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:40,242::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:40,242::__init__::232::IOProcess::(_processLogs) (465236) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:40,243::__init__::232::IOProcess::(_processLogs) (465236) Queuing response Thread-21::DEBUG::2015-01-22 11:13:40,244::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:40,244::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:40,244::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:40,244::__init__::232::IOProcess::(_processLogs) (465237) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:40,245::__init__::232::IOProcess::(_processLogs) (465237) Queuing response Thread-21::DEBUG::2015-01-22 11:13:40,245::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:40,245::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:40,245::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:40,246::__init__::232::IOProcess::(_processLogs) (465238) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:40,246::__init__::232::IOProcess::(_processLogs) (465238) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:41,351::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:41,352::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404395::DEBUG::2015-01-22 11:13:41,354::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:41,355::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:41,356::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404396::DEBUG::2015-01-22 11:13:41,358::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404396::DEBUG::2015-01-22 11:13:41,359::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:42,090::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:42,090::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:42,096::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:13:43,328::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:43,328::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:43,328::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:43,328::__init__::232::IOProcess::(_processLogs) (465239) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:43,328::__init__::232::IOProcess::(_processLogs) (465239) Queuing response Thread-63::DEBUG::2015-01-22 11:13:43,329::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:13:43,339::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000345889 s, 931 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:43,339::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:43,340::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:43,340::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:43,340::__init__::232::IOProcess::(_processLogs) (465240) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:43,340::__init__::232::IOProcess::(_processLogs) (465240) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:44,385::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:44,386::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404397::DEBUG::2015-01-22 11:13:44,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`e44a0478-2370-4112-b87c-b1bd06f202b7`::moving from state init -> state preparing Thread-404397::INFO::2015-01-22 11:13:44,389::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404397::INFO::2015-01-22 11:13:44,390::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000345889', 'lastCheck': '1.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499273', 'lastCheck': '4.1', 'valid': True}} Thread-404397::DEBUG::2015-01-22 11:13:44,390::task::1191::Storage.TaskManager.Task::(prepare) Task=`e44a0478-2370-4112-b87c-b1bd06f202b7`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000345889', 'lastCheck': '1.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499273', 'lastCheck': '4.1', 'valid': True}} Thread-404397::DEBUG::2015-01-22 11:13:44,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`e44a0478-2370-4112-b87c-b1bd06f202b7`::moving from state preparing -> state finished Thread-404397::DEBUG::2015-01-22 11:13:44,390::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404397::DEBUG::2015-01-22 11:13:44,390::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404397::DEBUG::2015-01-22 11:13:44,390::task::993::Storage.TaskManager.Task::(_decref) Task=`e44a0478-2370-4112-b87c-b1bd06f202b7`::ref 0 aborting False Thread-404397::ERROR::2015-01-22 11:13:44,391::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404397::DEBUG::2015-01-22 11:13:44,393::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:44,401::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:44,402::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404398::DEBUG::2015-01-22 11:13:44,404::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404398::DEBUG::2015-01-22 11:13:44,405::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:47,102::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:47,108::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:47,108::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:47,454::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:47,458::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404399::DEBUG::2015-01-22 11:13:47,462::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:47,464::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:47,467::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404400::DEBUG::2015-01-22 11:13:47,471::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404400::DEBUG::2015-01-22 11:13:47,478::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:13:50,247::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:50,248::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:50,248::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:50,248::__init__::232::IOProcess::(_processLogs) (465241) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:50,249::__init__::232::IOProcess::(_processLogs) (465241) Queuing response Thread-64::DEBUG::2015-01-22 11:13:50,250::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:13:50,259::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000673028 s, 689 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:50,260::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:50,260::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:50,260::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:50,260::__init__::232::IOProcess::(_processLogs) (465242) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:50,260::__init__::232::IOProcess::(_processLogs) (465242) Queuing response Thread-21::DEBUG::2015-01-22 11:13:50,261::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:50,261::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:50,261::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:50,262::__init__::232::IOProcess::(_processLogs) (465243) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:50,262::__init__::232::IOProcess::(_processLogs) (465243) Queuing response Thread-21::DEBUG::2015-01-22 11:13:50,262::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:50,263::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:50,263::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:50,263::__init__::232::IOProcess::(_processLogs) (465244) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:50,263::__init__::232::IOProcess::(_processLogs) (465244) Queuing response Thread-21::DEBUG::2015-01-22 11:13:50,264::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:50,264::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:50,264::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:50,264::__init__::232::IOProcess::(_processLogs) (465245) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:13:50,264::__init__::232::IOProcess::(_processLogs) (465245) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:50,511::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:50,513::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404401::DEBUG::2015-01-22 11:13:50,515::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:50,516::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:50,517::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404402::DEBUG::2015-01-22 11:13:50,519::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404402::DEBUG::2015-01-22 11:13:50,520::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:52,114::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:52,115::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:52,122::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:13:53,342::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:53,342::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:53,342::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:53,343::__init__::232::IOProcess::(_processLogs) (465246) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:53,343::__init__::232::IOProcess::(_processLogs) (465246) Queuing response Thread-63::DEBUG::2015-01-22 11:13:53,343::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:13:53,350::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000300908 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:13:53,351::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:53,351::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:53,351::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:53,351::__init__::232::IOProcess::(_processLogs) (465247) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:13:53,352::__init__::232::IOProcess::(_processLogs) (465247) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:53,546::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:53,547::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404403::DEBUG::2015-01-22 11:13:53,549::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:53,550::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:53,552::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404404::DEBUG::2015-01-22 11:13:53,554::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404404::DEBUG::2015-01-22 11:13:53,555::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:56,584::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:56,585::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404405::DEBUG::2015-01-22 11:13:56,587::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:56,588::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:56,589::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404406::DEBUG::2015-01-22 11:13:56,591::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404406::DEBUG::2015-01-22 11:13:56,592::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:13:57,128::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:57,129::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:13:57,140::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:13:58,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e29e46e-e1da-4903-b276-ec0527179128`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:13:58,694::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:13:58,695::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:58,695::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:58,695::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:58,695::__init__::232::IOProcess::(_processLogs) (465248) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:13:58,697::__init__::232::IOProcess::(_processLogs) (465248) Queuing response Thread-21::DEBUG::2015-01-22 11:13:58,698::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:13:58,699::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:13:58,699::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:13:58,699::__init__::232::IOProcess::(_processLogs) (465249) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:13:58,699::__init__::232::IOProcess::(_processLogs) (465249) Queuing response Thread-360::INFO::2015-01-22 11:13:58,699::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:13:58,700::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e29e46e-e1da-4903-b276-ec0527179128`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:13:58,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e29e46e-e1da-4903-b276-ec0527179128`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:13:58,700::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:13:58,700::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:13:58,700::task::993::Storage.TaskManager.Task::(_decref) Task=`7e29e46e-e1da-4903-b276-ec0527179128`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:59,622::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:59,623::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404407::DEBUG::2015-01-22 11:13:59,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`918897d7-638c-40f9-8d70-716d5ae13d88`::moving from state init -> state preparing Thread-404407::INFO::2015-01-22 11:13:59,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404407::INFO::2015-01-22 11:13:59,626::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300908', 'lastCheck': '6.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673028', 'lastCheck': '9.4', 'valid': True}} Thread-404407::DEBUG::2015-01-22 11:13:59,626::task::1191::Storage.TaskManager.Task::(prepare) Task=`918897d7-638c-40f9-8d70-716d5ae13d88`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300908', 'lastCheck': '6.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673028', 'lastCheck': '9.4', 'valid': True}} Thread-404407::DEBUG::2015-01-22 11:13:59,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`918897d7-638c-40f9-8d70-716d5ae13d88`::moving from state preparing -> state finished Thread-404407::DEBUG::2015-01-22 11:13:59,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404407::DEBUG::2015-01-22 11:13:59,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404407::DEBUG::2015-01-22 11:13:59,627::task::993::Storage.TaskManager.Task::(_decref) Task=`918897d7-638c-40f9-8d70-716d5ae13d88`::ref 0 aborting False Thread-404407::ERROR::2015-01-22 11:13:59,628::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404407::DEBUG::2015-01-22 11:13:59,631::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:13:59,639::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:13:59,640::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404408::DEBUG::2015-01-22 11:13:59,641::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404408::DEBUG::2015-01-22 11:13:59,642::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:14:00,265::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:00,266::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:00,266::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:00,266::__init__::232::IOProcess::(_processLogs) (465250) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:00,268::__init__::232::IOProcess::(_processLogs) (465250) Queuing response Thread-64::DEBUG::2015-01-22 11:14:00,268::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:14:00,278::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000454914 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:00,278::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:00,279::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:00,279::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:00,279::__init__::232::IOProcess::(_processLogs) (465251) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:00,279::__init__::232::IOProcess::(_processLogs) (465251) Queuing response Thread-21::DEBUG::2015-01-22 11:14:00,280::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:00,280::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:00,280::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:00,280::__init__::232::IOProcess::(_processLogs) (465252) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:00,281::__init__::232::IOProcess::(_processLogs) (465252) Queuing response Thread-21::DEBUG::2015-01-22 11:14:00,282::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:00,282::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:00,282::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:00,282::__init__::232::IOProcess::(_processLogs) (465253) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:00,282::__init__::232::IOProcess::(_processLogs) (465253) Queuing response Thread-21::DEBUG::2015-01-22 11:14:00,283::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:00,283::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:00,283::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:00,283::__init__::232::IOProcess::(_processLogs) (465254) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:00,283::__init__::232::IOProcess::(_processLogs) (465254) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:02,143::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:02,143::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:02,146::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:02,693::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:02,695::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404409::DEBUG::2015-01-22 11:14:02,697::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:02,698::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:02,700::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404410::DEBUG::2015-01-22 11:14:02,702::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404410::DEBUG::2015-01-22 11:14:02,702::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:14:03,353::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:03,354::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:03,354::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:03,354::__init__::232::IOProcess::(_processLogs) (465255) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:03,354::__init__::232::IOProcess::(_processLogs) (465255) Queuing response Thread-63::DEBUG::2015-01-22 11:14:03,355::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:14:03,362::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000265034 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:03,362::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:03,363::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:03,363::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:03,363::__init__::232::IOProcess::(_processLogs) (465256) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:03,363::__init__::232::IOProcess::(_processLogs) (465256) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:05,733::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:05,734::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404411::DEBUG::2015-01-22 11:14:05,736::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:05,737::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:05,738::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404412::DEBUG::2015-01-22 11:14:05,740::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404412::DEBUG::2015-01-22 11:14:05,741::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:07,152::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:07,153::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:07,159::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:14:08,350::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:08,772::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:08,773::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404413::DEBUG::2015-01-22 11:14:08,776::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:08,777::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:08,778::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404414::DEBUG::2015-01-22 11:14:08,780::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404414::DEBUG::2015-01-22 11:14:08,781::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:14:10,285::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:10,285::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:10,285::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:10,285::__init__::232::IOProcess::(_processLogs) (465257) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:10,287::__init__::232::IOProcess::(_processLogs) (465257) Queuing response Thread-64::DEBUG::2015-01-22 11:14:10,287::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:14:10,297::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000439571 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:10,297::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:10,298::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:10,298::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:10,298::__init__::232::IOProcess::(_processLogs) (465258) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:10,298::__init__::232::IOProcess::(_processLogs) (465258) Queuing response Thread-21::DEBUG::2015-01-22 11:14:10,299::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:10,299::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:10,299::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:10,299::__init__::232::IOProcess::(_processLogs) (465259) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:10,300::__init__::232::IOProcess::(_processLogs) (465259) Queuing response Thread-21::DEBUG::2015-01-22 11:14:10,300::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:10,300::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:10,300::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:10,301::__init__::232::IOProcess::(_processLogs) (465260) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:10,301::__init__::232::IOProcess::(_processLogs) (465260) Queuing response Thread-21::DEBUG::2015-01-22 11:14:10,301::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:10,302::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:10,302::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:10,302::__init__::232::IOProcess::(_processLogs) (465261) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:10,302::__init__::232::IOProcess::(_processLogs) (465261) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:11,806::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:11,808::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404415::DEBUG::2015-01-22 11:14:11,810::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:11,811::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:11,812::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404416::DEBUG::2015-01-22 11:14:11,814::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404416::DEBUG::2015-01-22 11:14:11,815::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:12,165::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:12,166::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:12,173::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:14:13,365::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:13,365::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:13,365::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:13,366::__init__::232::IOProcess::(_processLogs) (465262) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:13,366::__init__::232::IOProcess::(_processLogs) (465262) Queuing response Thread-63::DEBUG::2015-01-22 11:14:13,366::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:14:13,373::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000260506 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:13,374::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:13,374::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:13,374::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:13,374::__init__::232::IOProcess::(_processLogs) (465263) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:13,374::__init__::232::IOProcess::(_processLogs) (465263) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:14,844::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:14,846::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404417::DEBUG::2015-01-22 11:14:14,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e28c13a-674e-4410-a953-cb08af4944be`::moving from state init -> state preparing Thread-404417::INFO::2015-01-22 11:14:14,850::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404417::INFO::2015-01-22 11:14:14,850::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260506', 'lastCheck': '1.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439571', 'lastCheck': '4.5', 'valid': True}} Thread-404417::DEBUG::2015-01-22 11:14:14,851::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e28c13a-674e-4410-a953-cb08af4944be`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260506', 'lastCheck': '1.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439571', 'lastCheck': '4.5', 'valid': True}} Thread-404417::DEBUG::2015-01-22 11:14:14,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e28c13a-674e-4410-a953-cb08af4944be`::moving from state preparing -> state finished Thread-404417::DEBUG::2015-01-22 11:14:14,851::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404417::DEBUG::2015-01-22 11:14:14,851::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404417::DEBUG::2015-01-22 11:14:14,851::task::993::Storage.TaskManager.Task::(_decref) Task=`0e28c13a-674e-4410-a953-cb08af4944be`::ref 0 aborting False Thread-404417::ERROR::2015-01-22 11:14:14,852::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404417::DEBUG::2015-01-22 11:14:14,854::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:14,863::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:14,864::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404418::DEBUG::2015-01-22 11:14:14,866::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404418::DEBUG::2015-01-22 11:14:14,867::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:17,176::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:17,177::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:17,188::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:17,935::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:17,938::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404419::DEBUG::2015-01-22 11:14:17,942::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:17,945::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:17,947::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404420::DEBUG::2015-01-22 11:14:17,951::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404420::DEBUG::2015-01-22 11:14:17,957::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-64::DEBUG::2015-01-22 11:14:20,303::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 06e45ff6-0505-4692-b97d-896d9b710b49 Thread-21::DEBUG::2015-01-22 11:14:20,305::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:20,305::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:20,305::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:20,305::__init__::232::IOProcess::(_processLogs) (465264) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:14:20,309::__init__::232::IOProcess::(_processLogs) (465264) Queuing response Thread-64::DEBUG::2015-01-22 11:14:20,314::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49 Thread-21::DEBUG::2015-01-22 11:14:20,315::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:20,315::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:20,315::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:20,315::__init__::232::IOProcess::(_processLogs) (465265) Got request for method 'touch' Thread-21::DEBUG::2015-01-22 11:14:20,316::__init__::232::IOProcess::(_processLogs) (465265) Queuing response Thread-64::DEBUG::2015-01-22 11:14:20,317::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend Thread-21::DEBUG::2015-01-22 11:14:20,317::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:20,317::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:20,318::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:20,318::__init__::232::IOProcess::(_processLogs) (465266) Got request for method 'readfile' Thread-21::DEBUG::2015-01-22 11:14:20,319::__init__::232::IOProcess::(_processLogs) (465266) Queuing response Thread-64::DEBUG::2015-01-22 11:14:20,319::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=store1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=cllDataCentre', 'POOL_DOMAINS=06e45ff6-0505-4692-b97d-896d9b710b49:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=67c137fd-0cf2-463a-bc70-b427cc0a5da3', 'REMOTE_PATH=192.168.1.25:/Vol2', 'ROLE=Master', 'SDUUID=06e45ff6-0505-4692-b97d-896d9b710b49', 'TYPE=GLUSTERFS', 'VERSION=3', '_SHA_CKSUM=7f3bb8b00fa6ca5bb291ea1e02530cfbc66a33ba'] Thread-21::DEBUG::2015-01-22 11:14:20,320::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:20,320::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:20,320::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:20,320::__init__::232::IOProcess::(_processLogs) (465267) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:20,320::__init__::232::IOProcess::(_processLogs) (465267) Queuing response Thread-21::DEBUG::2015-01-22 11:14:20,321::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:20,321::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:20,321::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:20,321::__init__::232::IOProcess::(_processLogs) (465268) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:14:20,323::__init__::232::IOProcess::(_processLogs) (465268) Queuing response Thread-64::DEBUG::2015-01-22 11:14:20,324::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-64::INFO::2015-01-22 11:14:20,324::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 06e45ff6-0505-4692-b97d-896d9b710b49_imageNS already registered Thread-64::INFO::2015-01-22 11:14:20,324::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 06e45ff6-0505-4692-b97d-896d9b710b49_volumeNS already registered Thread-21::DEBUG::2015-01-22 11:14:20,324::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:20,324::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:20,325::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:20,325::__init__::232::IOProcess::(_processLogs) (465269) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:20,325::__init__::232::IOProcess::(_processLogs) (465269) Queuing response Thread-64::DEBUG::2015-01-22 11:14:20,325::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:14:20,334::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000479374 s, 968 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:20,335::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:20,335::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:20,335::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:20,335::__init__::232::IOProcess::(_processLogs) (465270) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:20,335::__init__::232::IOProcess::(_processLogs) (465270) Queuing response Thread-21::DEBUG::2015-01-22 11:14:20,336::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:20,336::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:20,336::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:20,336::__init__::232::IOProcess::(_processLogs) (465271) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:20,337::__init__::232::IOProcess::(_processLogs) (465271) Queuing response Thread-21::DEBUG::2015-01-22 11:14:20,337::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:20,337::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:20,337::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:20,338::__init__::232::IOProcess::(_processLogs) (465272) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:20,338::__init__::232::IOProcess::(_processLogs) (465272) Queuing response Thread-21::DEBUG::2015-01-22 11:14:20,338::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:20,339::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:20,339::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:20,339::__init__::232::IOProcess::(_processLogs) (465273) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:20,339::__init__::232::IOProcess::(_processLogs) (465273) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:20,990::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:20,992::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404422::DEBUG::2015-01-22 11:14:20,994::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:20,995::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:20,996::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404423::DEBUG::2015-01-22 11:14:20,998::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404423::DEBUG::2015-01-22 11:14:20,999::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:22,194::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:22,194::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:22,202::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:14:23,376::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:23,376::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:23,376::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:23,377::__init__::232::IOProcess::(_processLogs) (465274) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:23,377::__init__::232::IOProcess::(_processLogs) (465274) Queuing response Thread-63::DEBUG::2015-01-22 11:14:23,378::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:14:23,384::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000264188 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:23,385::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:23,385::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:23,385::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:23,385::__init__::232::IOProcess::(_processLogs) (465275) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:23,386::__init__::232::IOProcess::(_processLogs) (465275) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:24,026::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:24,027::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404424::DEBUG::2015-01-22 11:14:24,029::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:24,031::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:24,032::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404425::DEBUG::2015-01-22 11:14:24,033::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404425::DEBUG::2015-01-22 11:14:24,034::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:27,063::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:27,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404426::DEBUG::2015-01-22 11:14:27,066::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:27,067::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:27,068::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404427::DEBUG::2015-01-22 11:14:27,070::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404427::DEBUG::2015-01-22 11:14:27,071::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:27,209::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:27,209::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:27,220::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:30,100::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:30,101::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404428::DEBUG::2015-01-22 11:14:30,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5cd87ae-ab69-4b4c-806d-aaa62a805cf8`::moving from state init -> state preparing Thread-404428::INFO::2015-01-22 11:14:30,105::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404428::INFO::2015-01-22 11:14:30,105::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264188', 'lastCheck': '6.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479374', 'lastCheck': '9.8', 'valid': True}} Thread-404428::DEBUG::2015-01-22 11:14:30,105::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5cd87ae-ab69-4b4c-806d-aaa62a805cf8`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264188', 'lastCheck': '6.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479374', 'lastCheck': '9.8', 'valid': True}} Thread-404428::DEBUG::2015-01-22 11:14:30,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5cd87ae-ab69-4b4c-806d-aaa62a805cf8`::moving from state preparing -> state finished Thread-404428::DEBUG::2015-01-22 11:14:30,105::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404428::DEBUG::2015-01-22 11:14:30,105::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404428::DEBUG::2015-01-22 11:14:30,105::task::993::Storage.TaskManager.Task::(_decref) Task=`a5cd87ae-ab69-4b4c-806d-aaa62a805cf8`::ref 0 aborting False Thread-404428::ERROR::2015-01-22 11:14:30,106::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404428::DEBUG::2015-01-22 11:14:30,109::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:30,118::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:30,119::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404429::DEBUG::2015-01-22 11:14:30,121::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404429::DEBUG::2015-01-22 11:14:30,122::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:14:30,341::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:30,341::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:30,341::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:30,341::__init__::232::IOProcess::(_processLogs) (465276) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:30,342::__init__::232::IOProcess::(_processLogs) (465276) Queuing response Thread-64::DEBUG::2015-01-22 11:14:30,343::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:14:30,353::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000539061 s, 861 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:30,353::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:30,353::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:30,354::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:30,354::__init__::232::IOProcess::(_processLogs) (465277) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:30,354::__init__::232::IOProcess::(_processLogs) (465277) Queuing response Thread-21::DEBUG::2015-01-22 11:14:30,355::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:30,355::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:30,355::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:30,355::__init__::232::IOProcess::(_processLogs) (465278) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:30,355::__init__::232::IOProcess::(_processLogs) (465278) Queuing response Thread-21::DEBUG::2015-01-22 11:14:30,356::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:30,356::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:30,356::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:30,356::__init__::232::IOProcess::(_processLogs) (465279) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:30,357::__init__::232::IOProcess::(_processLogs) (465279) Queuing response Thread-21::DEBUG::2015-01-22 11:14:30,357::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:30,357::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:30,358::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:30,358::__init__::232::IOProcess::(_processLogs) (465280) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:30,358::__init__::232::IOProcess::(_processLogs) (465280) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:32,224::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:32,224::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:32,238::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:33,175::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:33,176::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404430::DEBUG::2015-01-22 11:14:33,180::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:33,185::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:33,186::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404431::DEBUG::2015-01-22 11:14:33,190::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404431::DEBUG::2015-01-22 11:14:33,197::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:14:33,387::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:33,387::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:33,388::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:33,388::__init__::232::IOProcess::(_processLogs) (465281) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:33,388::__init__::232::IOProcess::(_processLogs) (465281) Queuing response Thread-63::DEBUG::2015-01-22 11:14:33,389::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:14:33,396::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000300608 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:33,397::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:33,397::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:33,397::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:33,397::__init__::232::IOProcess::(_processLogs) (465282) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:33,397::__init__::232::IOProcess::(_processLogs) (465282) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:36,236::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:36,237::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404432::DEBUG::2015-01-22 11:14:36,239::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:36,240::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:36,241::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404433::DEBUG::2015-01-22 11:14:36,243::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404433::DEBUG::2015-01-22 11:14:36,244::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:37,239::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:37,239::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:37,245::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:14:38,385::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:39,274::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:39,276::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404434::DEBUG::2015-01-22 11:14:39,278::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:39,279::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:39,280::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404435::DEBUG::2015-01-22 11:14:39,282::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404435::DEBUG::2015-01-22 11:14:39,283::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:14:40,359::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:40,359::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:40,359::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:40,360::__init__::232::IOProcess::(_processLogs) (465283) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:40,361::__init__::232::IOProcess::(_processLogs) (465283) Queuing response Thread-64::DEBUG::2015-01-22 11:14:40,362::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:14:40,371::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000532626 s, 871 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:40,372::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:40,372::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:40,372::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:40,372::__init__::232::IOProcess::(_processLogs) (465284) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:40,372::__init__::232::IOProcess::(_processLogs) (465284) Queuing response Thread-21::DEBUG::2015-01-22 11:14:40,373::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:40,373::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:40,374::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:40,374::__init__::232::IOProcess::(_processLogs) (465285) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:40,374::__init__::232::IOProcess::(_processLogs) (465285) Queuing response Thread-21::DEBUG::2015-01-22 11:14:40,375::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:40,375::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:40,375::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:40,375::__init__::232::IOProcess::(_processLogs) (465286) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:40,375::__init__::232::IOProcess::(_processLogs) (465286) Queuing response Thread-21::DEBUG::2015-01-22 11:14:40,376::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:40,376::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:40,376::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:40,376::__init__::232::IOProcess::(_processLogs) (465287) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:40,377::__init__::232::IOProcess::(_processLogs) (465287) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:42,251::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:42,252::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:42,258::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:42,313::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:42,315::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404436::DEBUG::2015-01-22 11:14:42,317::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:42,318::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:42,319::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404437::DEBUG::2015-01-22 11:14:42,321::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404437::DEBUG::2015-01-22 11:14:42,322::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:14:43,399::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:43,400::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:43,400::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:43,400::__init__::232::IOProcess::(_processLogs) (465288) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:43,400::__init__::232::IOProcess::(_processLogs) (465288) Queuing response Thread-63::DEBUG::2015-01-22 11:14:43,401::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:14:43,408::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000252014 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:43,409::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:43,409::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:43,409::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:43,409::__init__::232::IOProcess::(_processLogs) (465289) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:43,409::__init__::232::IOProcess::(_processLogs) (465289) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:45,352::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:45,353::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404438::DEBUG::2015-01-22 11:14:45,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`920f7573-f557-44c0-b0e1-d233d94eec0e`::moving from state init -> state preparing Thread-404438::INFO::2015-01-22 11:14:45,356::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404438::INFO::2015-01-22 11:14:45,356::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000252014', 'lastCheck': '1.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532626', 'lastCheck': '5.0', 'valid': True}} Thread-404438::DEBUG::2015-01-22 11:14:45,357::task::1191::Storage.TaskManager.Task::(prepare) Task=`920f7573-f557-44c0-b0e1-d233d94eec0e`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000252014', 'lastCheck': '1.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532626', 'lastCheck': '5.0', 'valid': True}} Thread-404438::DEBUG::2015-01-22 11:14:45,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`920f7573-f557-44c0-b0e1-d233d94eec0e`::moving from state preparing -> state finished Thread-404438::DEBUG::2015-01-22 11:14:45,357::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404438::DEBUG::2015-01-22 11:14:45,357::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404438::DEBUG::2015-01-22 11:14:45,357::task::993::Storage.TaskManager.Task::(_decref) Task=`920f7573-f557-44c0-b0e1-d233d94eec0e`::ref 0 aborting False Thread-404438::ERROR::2015-01-22 11:14:45,358::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404438::DEBUG::2015-01-22 11:14:45,361::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:45,369::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:45,370::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404439::DEBUG::2015-01-22 11:14:45,372::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404439::DEBUG::2015-01-22 11:14:45,373::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:47,263::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:47,264::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:47,269::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:48,436::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:48,438::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404440::DEBUG::2015-01-22 11:14:48,440::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:48,441::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:48,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404441::DEBUG::2015-01-22 11:14:48,444::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404441::DEBUG::2015-01-22 11:14:48,445::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:14:50,378::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:50,378::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:50,379::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:50,379::__init__::232::IOProcess::(_processLogs) (465290) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:50,381::__init__::232::IOProcess::(_processLogs) (465290) Queuing response Thread-64::DEBUG::2015-01-22 11:14:50,381::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:14:50,391::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000545309 s, 851 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:50,392::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:50,392::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:50,392::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:50,392::__init__::232::IOProcess::(_processLogs) (465291) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:50,392::__init__::232::IOProcess::(_processLogs) (465291) Queuing response Thread-21::DEBUG::2015-01-22 11:14:50,393::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:50,393::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:50,393::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:50,393::__init__::232::IOProcess::(_processLogs) (465292) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:50,394::__init__::232::IOProcess::(_processLogs) (465292) Queuing response Thread-21::DEBUG::2015-01-22 11:14:50,394::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:50,395::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:50,395::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:50,395::__init__::232::IOProcess::(_processLogs) (465293) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:50,395::__init__::232::IOProcess::(_processLogs) (465293) Queuing response Thread-21::DEBUG::2015-01-22 11:14:50,396::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:50,396::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:50,396::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:50,396::__init__::232::IOProcess::(_processLogs) (465294) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:14:50,397::__init__::232::IOProcess::(_processLogs) (465294) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:51,475::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:51,476::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404442::DEBUG::2015-01-22 11:14:51,479::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:51,480::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:51,481::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404443::DEBUG::2015-01-22 11:14:51,483::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404443::DEBUG::2015-01-22 11:14:51,484::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:52,275::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:52,275::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:52,283::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:14:53,411::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:53,412::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:53,412::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:53,412::__init__::232::IOProcess::(_processLogs) (465295) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:53,412::__init__::232::IOProcess::(_processLogs) (465295) Queuing response Thread-63::DEBUG::2015-01-22 11:14:53,413::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:14:53,421::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000337837 s, 953 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:14:53,422::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:53,422::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:53,422::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:53,423::__init__::232::IOProcess::(_processLogs) (465296) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:14:53,423::__init__::232::IOProcess::(_processLogs) (465296) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:54,514::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:54,515::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404444::DEBUG::2015-01-22 11:14:54,517::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:54,518::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:54,520::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404445::DEBUG::2015-01-22 11:14:54,522::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404445::DEBUG::2015-01-22 11:14:54,523::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:14:57,289::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:57,290::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:14:57,301::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:57,553::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:57,554::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404446::DEBUG::2015-01-22 11:14:57,556::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:14:57,557::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:14:57,558::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404447::DEBUG::2015-01-22 11:14:57,559::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404447::DEBUG::2015-01-22 11:14:57,560::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:14:58,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`575f1d16-dd63-4b05-9a93-a1815efbc6e2`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:14:58,779::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:14:58,780::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:58,780::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:58,781::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:58,781::__init__::232::IOProcess::(_processLogs) (465297) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:14:58,783::__init__::232::IOProcess::(_processLogs) (465297) Queuing response Thread-21::DEBUG::2015-01-22 11:14:58,784::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:14:58,784::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:14:58,784::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:14:58,784::__init__::232::IOProcess::(_processLogs) (465298) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:14:58,785::__init__::232::IOProcess::(_processLogs) (465298) Queuing response Thread-360::INFO::2015-01-22 11:14:58,785::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:14:58,785::task::1191::Storage.TaskManager.Task::(prepare) Task=`575f1d16-dd63-4b05-9a93-a1815efbc6e2`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:14:58,785::task::595::Storage.TaskManager.Task::(_updateState) Task=`575f1d16-dd63-4b05-9a93-a1815efbc6e2`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:14:58,786::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:14:58,786::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:14:58,786::task::993::Storage.TaskManager.Task::(_decref) Task=`575f1d16-dd63-4b05-9a93-a1815efbc6e2`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:15:00,398::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:00,399::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:00,399::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:00,399::__init__::232::IOProcess::(_processLogs) (465299) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:00,400::__init__::232::IOProcess::(_processLogs) (465299) Queuing response Thread-64::DEBUG::2015-01-22 11:15:00,401::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:15:00,410::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000479386 s, 968 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:00,410::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:00,411::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:00,411::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:00,411::__init__::232::IOProcess::(_processLogs) (465300) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:00,411::__init__::232::IOProcess::(_processLogs) (465300) Queuing response Thread-21::DEBUG::2015-01-22 11:15:00,412::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:00,412::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:00,412::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:00,412::__init__::232::IOProcess::(_processLogs) (465301) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:00,413::__init__::232::IOProcess::(_processLogs) (465301) Queuing response Thread-21::DEBUG::2015-01-22 11:15:00,413::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:00,413::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:00,413::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:00,413::__init__::232::IOProcess::(_processLogs) (465302) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:00,414::__init__::232::IOProcess::(_processLogs) (465302) Queuing response Thread-21::DEBUG::2015-01-22 11:15:00,414::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:00,415::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:00,415::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:00,415::__init__::232::IOProcess::(_processLogs) (465303) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:00,415::__init__::232::IOProcess::(_processLogs) (465303) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:00,587::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:00,589::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404448::DEBUG::2015-01-22 11:15:00,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`115843f7-c1f9-4d7c-bb28-5a9548f07984`::moving from state init -> state preparing Thread-404448::INFO::2015-01-22 11:15:00,592::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404448::INFO::2015-01-22 11:15:00,592::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000337837', 'lastCheck': '7.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479386', 'lastCheck': '0.2', 'valid': True}} Thread-404448::DEBUG::2015-01-22 11:15:00,592::task::1191::Storage.TaskManager.Task::(prepare) Task=`115843f7-c1f9-4d7c-bb28-5a9548f07984`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000337837', 'lastCheck': '7.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479386', 'lastCheck': '0.2', 'valid': True}} Thread-404448::DEBUG::2015-01-22 11:15:00,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`115843f7-c1f9-4d7c-bb28-5a9548f07984`::moving from state preparing -> state finished Thread-404448::DEBUG::2015-01-22 11:15:00,592::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404448::DEBUG::2015-01-22 11:15:00,593::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404448::DEBUG::2015-01-22 11:15:00,593::task::993::Storage.TaskManager.Task::(_decref) Task=`115843f7-c1f9-4d7c-bb28-5a9548f07984`::ref 0 aborting False Thread-404448::ERROR::2015-01-22 11:15:00,594::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404448::DEBUG::2015-01-22 11:15:00,596::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:00,603::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:00,605::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404449::DEBUG::2015-01-22 11:15:00,606::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404449::DEBUG::2015-01-22 11:15:00,607::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:02,307::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:02,308::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:02,322::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:15:03,424::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:03,425::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:03,425::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:03,425::__init__::232::IOProcess::(_processLogs) (465304) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:03,425::__init__::232::IOProcess::(_processLogs) (465304) Queuing response Thread-63::DEBUG::2015-01-22 11:15:03,426::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:15:03,434::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000321452 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:03,435::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:03,436::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:03,436::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:03,436::__init__::232::IOProcess::(_processLogs) (465305) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:03,436::__init__::232::IOProcess::(_processLogs) (465305) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:03,668::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:03,669::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404450::DEBUG::2015-01-22 11:15:03,672::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:03,673::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:03,674::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404451::DEBUG::2015-01-22 11:15:03,676::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404451::DEBUG::2015-01-22 11:15:03,677::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:06,708::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:06,709::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404452::DEBUG::2015-01-22 11:15:06,710::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:06,711::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:06,712::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404453::DEBUG::2015-01-22 11:15:06,714::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404453::DEBUG::2015-01-22 11:15:06,715::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:07,328::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:07,329::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:07,333::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:15:08,419::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:09,740::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:09,742::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404454::DEBUG::2015-01-22 11:15:09,744::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:09,746::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:09,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404455::DEBUG::2015-01-22 11:15:09,749::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404455::DEBUG::2015-01-22 11:15:09,750::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:15:10,416::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:10,417::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:10,417::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:10,417::__init__::232::IOProcess::(_processLogs) (465306) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:10,418::__init__::232::IOProcess::(_processLogs) (465306) Queuing response Thread-64::DEBUG::2015-01-22 11:15:10,419::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:15:10,427::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000501227 s, 926 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:10,428::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:10,428::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:10,428::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:10,428::__init__::232::IOProcess::(_processLogs) (465307) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:10,428::__init__::232::IOProcess::(_processLogs) (465307) Queuing response Thread-21::DEBUG::2015-01-22 11:15:10,429::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:10,430::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:10,430::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:10,430::__init__::232::IOProcess::(_processLogs) (465308) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:10,430::__init__::232::IOProcess::(_processLogs) (465308) Queuing response Thread-21::DEBUG::2015-01-22 11:15:10,431::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:10,431::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:10,431::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:10,431::__init__::232::IOProcess::(_processLogs) (465309) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:10,431::__init__::232::IOProcess::(_processLogs) (465309) Queuing response Thread-21::DEBUG::2015-01-22 11:15:10,432::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:10,432::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:10,432::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:10,432::__init__::232::IOProcess::(_processLogs) (465310) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:10,432::__init__::232::IOProcess::(_processLogs) (465310) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:12,339::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:12,340::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:12,347::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:12,780::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:12,781::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404456::DEBUG::2015-01-22 11:15:12,783::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:12,784::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:12,785::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404457::DEBUG::2015-01-22 11:15:12,787::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404457::DEBUG::2015-01-22 11:15:12,788::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:15:13,438::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:13,438::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:13,438::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:13,438::__init__::232::IOProcess::(_processLogs) (465311) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:13,439::__init__::232::IOProcess::(_processLogs) (465311) Queuing response Thread-63::DEBUG::2015-01-22 11:15:13,439::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:15:13,448::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000254948 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:13,449::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:13,449::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:13,449::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:13,449::__init__::232::IOProcess::(_processLogs) (465312) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:13,449::__init__::232::IOProcess::(_processLogs) (465312) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:15,815::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:15,816::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404458::DEBUG::2015-01-22 11:15:15,819::task::595::Storage.TaskManager.Task::(_updateState) Task=`184c30d6-4df0-4e43-855e-a3ee076a3b5d`::moving from state init -> state preparing Thread-404458::INFO::2015-01-22 11:15:15,819::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404458::INFO::2015-01-22 11:15:15,820::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000254948', 'lastCheck': '2.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501227', 'lastCheck': '5.4', 'valid': True}} Thread-404458::DEBUG::2015-01-22 11:15:15,820::task::1191::Storage.TaskManager.Task::(prepare) Task=`184c30d6-4df0-4e43-855e-a3ee076a3b5d`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000254948', 'lastCheck': '2.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501227', 'lastCheck': '5.4', 'valid': True}} Thread-404458::DEBUG::2015-01-22 11:15:15,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`184c30d6-4df0-4e43-855e-a3ee076a3b5d`::moving from state preparing -> state finished Thread-404458::DEBUG::2015-01-22 11:15:15,820::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404458::DEBUG::2015-01-22 11:15:15,820::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404458::DEBUG::2015-01-22 11:15:15,820::task::993::Storage.TaskManager.Task::(_decref) Task=`184c30d6-4df0-4e43-855e-a3ee076a3b5d`::ref 0 aborting False Thread-404458::ERROR::2015-01-22 11:15:15,821::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404458::DEBUG::2015-01-22 11:15:15,824::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:15,832::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:15,833::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404459::DEBUG::2015-01-22 11:15:15,835::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404459::DEBUG::2015-01-22 11:15:15,836::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:17,350::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:17,354::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:17,360::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:18,888::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:18,889::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404460::DEBUG::2015-01-22 11:15:18,892::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:18,893::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:18,894::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404461::DEBUG::2015-01-22 11:15:18,896::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404461::DEBUG::2015-01-22 11:15:18,896::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:15:20,434::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:20,434::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:20,434::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:20,434::__init__::232::IOProcess::(_processLogs) (465313) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:20,436::__init__::232::IOProcess::(_processLogs) (465313) Queuing response Thread-64::DEBUG::2015-01-22 11:15:20,437::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:15:20,447::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000457268 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:20,448::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:20,448::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:20,448::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:20,448::__init__::232::IOProcess::(_processLogs) (465314) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:20,448::__init__::232::IOProcess::(_processLogs) (465314) Queuing response Thread-21::DEBUG::2015-01-22 11:15:20,449::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:20,450::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:20,450::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:20,450::__init__::232::IOProcess::(_processLogs) (465315) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:20,450::__init__::232::IOProcess::(_processLogs) (465315) Queuing response Thread-21::DEBUG::2015-01-22 11:15:20,451::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:20,451::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:20,451::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:20,451::__init__::232::IOProcess::(_processLogs) (465316) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:20,451::__init__::232::IOProcess::(_processLogs) (465316) Queuing response Thread-21::DEBUG::2015-01-22 11:15:20,452::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:20,452::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:20,452::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:20,452::__init__::232::IOProcess::(_processLogs) (465317) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:20,452::__init__::232::IOProcess::(_processLogs) (465317) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:21,929::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:21,929::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404462::DEBUG::2015-01-22 11:15:21,932::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:21,933::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:21,934::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404463::DEBUG::2015-01-22 11:15:21,935::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404463::DEBUG::2015-01-22 11:15:21,936::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:22,369::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:22,369::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:22,379::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:15:23,451::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:23,451::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:23,452::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:23,452::__init__::232::IOProcess::(_processLogs) (465318) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:23,452::__init__::232::IOProcess::(_processLogs) (465318) Queuing response Thread-63::DEBUG::2015-01-22 11:15:23,453::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:15:23,459::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000281852 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:23,460::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:23,460::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:23,460::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:23,460::__init__::232::IOProcess::(_processLogs) (465319) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:23,460::__init__::232::IOProcess::(_processLogs) (465319) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:24,965::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:24,966::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404464::DEBUG::2015-01-22 11:15:24,969::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:24,970::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:24,971::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404465::DEBUG::2015-01-22 11:15:24,973::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404465::DEBUG::2015-01-22 11:15:24,974::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:27,385::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:27,385::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:27,389::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:28,001::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:28,002::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404466::DEBUG::2015-01-22 11:15:28,003::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:28,004::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:28,005::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404467::DEBUG::2015-01-22 11:15:28,007::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404467::DEBUG::2015-01-22 11:15:28,008::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:15:30,454::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:30,454::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:30,455::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:30,455::__init__::232::IOProcess::(_processLogs) (465320) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:30,456::__init__::232::IOProcess::(_processLogs) (465320) Queuing response Thread-64::DEBUG::2015-01-22 11:15:30,457::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:15:30,466::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000468115 s, 991 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:30,467::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:30,467::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:30,467::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:30,468::__init__::232::IOProcess::(_processLogs) (465321) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:30,468::__init__::232::IOProcess::(_processLogs) (465321) Queuing response Thread-21::DEBUG::2015-01-22 11:15:30,469::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:30,469::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:30,469::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:30,469::__init__::232::IOProcess::(_processLogs) (465322) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:30,469::__init__::232::IOProcess::(_processLogs) (465322) Queuing response Thread-21::DEBUG::2015-01-22 11:15:30,470::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:30,470::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:30,470::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:30,471::__init__::232::IOProcess::(_processLogs) (465323) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:30,471::__init__::232::IOProcess::(_processLogs) (465323) Queuing response Thread-21::DEBUG::2015-01-22 11:15:30,471::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:30,472::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:30,472::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:30,472::__init__::232::IOProcess::(_processLogs) (465324) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:30,472::__init__::232::IOProcess::(_processLogs) (465324) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:31,036::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:31,038::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404468::DEBUG::2015-01-22 11:15:31,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`0febfcf0-ca33-439f-a786-57f534b2c717`::moving from state init -> state preparing Thread-404468::INFO::2015-01-22 11:15:31,041::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404468::INFO::2015-01-22 11:15:31,041::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281852', 'lastCheck': '7.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468115', 'lastCheck': '0.6', 'valid': True}} Thread-404468::DEBUG::2015-01-22 11:15:31,041::task::1191::Storage.TaskManager.Task::(prepare) Task=`0febfcf0-ca33-439f-a786-57f534b2c717`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281852', 'lastCheck': '7.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468115', 'lastCheck': '0.6', 'valid': True}} Thread-404468::DEBUG::2015-01-22 11:15:31,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`0febfcf0-ca33-439f-a786-57f534b2c717`::moving from state preparing -> state finished Thread-404468::DEBUG::2015-01-22 11:15:31,042::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404468::DEBUG::2015-01-22 11:15:31,042::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404468::DEBUG::2015-01-22 11:15:31,042::task::993::Storage.TaskManager.Task::(_decref) Task=`0febfcf0-ca33-439f-a786-57f534b2c717`::ref 0 aborting False Thread-404468::ERROR::2015-01-22 11:15:31,043::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404468::DEBUG::2015-01-22 11:15:31,045::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:31,053::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:31,055::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404469::DEBUG::2015-01-22 11:15:31,057::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404469::DEBUG::2015-01-22 11:15:31,058::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:32,395::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:32,396::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:32,407::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:15:33,462::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:33,463::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:33,463::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:33,463::__init__::232::IOProcess::(_processLogs) (465325) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:33,463::__init__::232::IOProcess::(_processLogs) (465325) Queuing response Thread-63::DEBUG::2015-01-22 11:15:33,464::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:15:33,470::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000253537 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:33,473::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:33,474::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:33,474::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:33,474::__init__::232::IOProcess::(_processLogs) (465326) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:33,475::__init__::232::IOProcess::(_processLogs) (465326) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:34,118::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:34,119::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404470::DEBUG::2015-01-22 11:15:34,122::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:34,123::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:34,124::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404471::DEBUG::2015-01-22 11:15:34,126::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404471::DEBUG::2015-01-22 11:15:34,127::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:37,158::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:37,159::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404472::DEBUG::2015-01-22 11:15:37,161::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:37,162::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:37,163::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404473::DEBUG::2015-01-22 11:15:37,165::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404473::DEBUG::2015-01-22 11:15:37,166::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:37,413::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:37,413::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:37,417::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:15:38,465::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:40,194::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:40,195::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404474::DEBUG::2015-01-22 11:15:40,197::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:40,198::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:40,200::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404475::DEBUG::2015-01-22 11:15:40,201::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404475::DEBUG::2015-01-22 11:15:40,202::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:15:40,474::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:40,474::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:40,474::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:40,474::__init__::232::IOProcess::(_processLogs) (465327) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:40,475::__init__::232::IOProcess::(_processLogs) (465327) Queuing response Thread-64::DEBUG::2015-01-22 11:15:40,476::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:15:40,485::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000576561 s, 805 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:40,486::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:40,486::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:40,486::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:40,486::__init__::232::IOProcess::(_processLogs) (465328) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:40,486::__init__::232::IOProcess::(_processLogs) (465328) Queuing response Thread-21::DEBUG::2015-01-22 11:15:40,487::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:40,488::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:40,488::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:40,488::__init__::232::IOProcess::(_processLogs) (465329) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:40,488::__init__::232::IOProcess::(_processLogs) (465329) Queuing response Thread-21::DEBUG::2015-01-22 11:15:40,489::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:40,489::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:40,489::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:40,489::__init__::232::IOProcess::(_processLogs) (465330) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:40,489::__init__::232::IOProcess::(_processLogs) (465330) Queuing response Thread-21::DEBUG::2015-01-22 11:15:40,490::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:40,490::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:40,490::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:40,490::__init__::232::IOProcess::(_processLogs) (465331) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:40,491::__init__::232::IOProcess::(_processLogs) (465331) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:42,423::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:42,424::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:42,431::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:43,232::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:43,233::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404476::DEBUG::2015-01-22 11:15:43,235::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:43,236::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:43,237::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404477::DEBUG::2015-01-22 11:15:43,239::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404477::DEBUG::2015-01-22 11:15:43,240::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:15:43,478::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:43,478::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:43,478::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:43,478::__init__::232::IOProcess::(_processLogs) (465332) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:43,478::__init__::232::IOProcess::(_processLogs) (465332) Queuing response Thread-63::DEBUG::2015-01-22 11:15:43,479::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:15:43,488::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000330822 s, 973 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:43,489::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:43,489::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:43,490::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:43,490::__init__::232::IOProcess::(_processLogs) (465333) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:43,490::__init__::232::IOProcess::(_processLogs) (465333) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:46,265::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:46,267::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404478::DEBUG::2015-01-22 11:15:46,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c75ff18-756c-45b8-bb87-c14c86d49197`::moving from state init -> state preparing Thread-404478::INFO::2015-01-22 11:15:46,270::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404478::INFO::2015-01-22 11:15:46,270::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000330822', 'lastCheck': '2.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576561', 'lastCheck': '5.8', 'valid': True}} Thread-404478::DEBUG::2015-01-22 11:15:46,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c75ff18-756c-45b8-bb87-c14c86d49197`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000330822', 'lastCheck': '2.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576561', 'lastCheck': '5.8', 'valid': True}} Thread-404478::DEBUG::2015-01-22 11:15:46,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c75ff18-756c-45b8-bb87-c14c86d49197`::moving from state preparing -> state finished Thread-404478::DEBUG::2015-01-22 11:15:46,271::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404478::DEBUG::2015-01-22 11:15:46,271::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404478::DEBUG::2015-01-22 11:15:46,271::task::993::Storage.TaskManager.Task::(_decref) Task=`7c75ff18-756c-45b8-bb87-c14c86d49197`::ref 0 aborting False Thread-404478::ERROR::2015-01-22 11:15:46,272::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404478::DEBUG::2015-01-22 11:15:46,274::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:46,282::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:46,283::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404479::DEBUG::2015-01-22 11:15:46,285::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404479::DEBUG::2015-01-22 11:15:46,286::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:47,439::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:47,443::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:47,456::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:49,347::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:49,349::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404480::DEBUG::2015-01-22 11:15:49,351::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:49,352::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:49,353::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404481::DEBUG::2015-01-22 11:15:49,355::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404481::DEBUG::2015-01-22 11:15:49,356::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:15:50,492::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:50,492::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:50,493::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:50,493::__init__::232::IOProcess::(_processLogs) (465334) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:50,494::__init__::232::IOProcess::(_processLogs) (465334) Queuing response Thread-64::DEBUG::2015-01-22 11:15:50,495::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:15:50,503::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000492063 s, 943 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:50,504::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:50,504::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:50,504::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:50,504::__init__::232::IOProcess::(_processLogs) (465335) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:50,505::__init__::232::IOProcess::(_processLogs) (465335) Queuing response Thread-21::DEBUG::2015-01-22 11:15:50,506::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:50,506::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:50,506::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:50,506::__init__::232::IOProcess::(_processLogs) (465336) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:50,506::__init__::232::IOProcess::(_processLogs) (465336) Queuing response Thread-21::DEBUG::2015-01-22 11:15:50,507::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:50,507::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:50,507::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:50,507::__init__::232::IOProcess::(_processLogs) (465337) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:50,508::__init__::232::IOProcess::(_processLogs) (465337) Queuing response Thread-21::DEBUG::2015-01-22 11:15:50,508::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:50,508::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:50,508::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:50,509::__init__::232::IOProcess::(_processLogs) (465338) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:15:50,509::__init__::232::IOProcess::(_processLogs) (465338) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:52,388::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:52,389::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404482::DEBUG::2015-01-22 11:15:52,391::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:52,392::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:52,393::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404483::DEBUG::2015-01-22 11:15:52,395::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404483::DEBUG::2015-01-22 11:15:52,396::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:52,464::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:52,464::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:52,471::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:15:53,495::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:53,495::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:53,496::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:53,496::__init__::232::IOProcess::(_processLogs) (465339) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:53,496::__init__::232::IOProcess::(_processLogs) (465339) Queuing response Thread-63::DEBUG::2015-01-22 11:15:53,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:15:53,505::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00025801 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:15:53,506::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:53,506::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:53,506::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:53,506::__init__::232::IOProcess::(_processLogs) (465340) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:15:53,506::__init__::232::IOProcess::(_processLogs) (465340) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:55,422::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:55,424::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404484::DEBUG::2015-01-22 11:15:55,427::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:55,428::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:55,429::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404485::DEBUG::2015-01-22 11:15:55,431::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404485::DEBUG::2015-01-22 11:15:55,432::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:15:57,477::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:57,478::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:15:57,482::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:58,463::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:58,464::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404486::DEBUG::2015-01-22 11:15:58,465::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:15:58,466::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:15:58,467::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404487::DEBUG::2015-01-22 11:15:58,469::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404487::DEBUG::2015-01-22 11:15:58,470::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:15:58,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c55a4c4-f8cd-4500-b3eb-56a5a7f20d8a`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:15:58,863::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:15:58,864::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:58,864::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:58,864::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:58,864::__init__::232::IOProcess::(_processLogs) (465341) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:15:58,867::__init__::232::IOProcess::(_processLogs) (465341) Queuing response Thread-21::DEBUG::2015-01-22 11:15:58,868::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:15:58,868::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:15:58,868::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:15:58,868::__init__::232::IOProcess::(_processLogs) (465342) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:15:58,868::__init__::232::IOProcess::(_processLogs) (465342) Queuing response Thread-360::INFO::2015-01-22 11:15:58,869::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:15:58,869::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c55a4c4-f8cd-4500-b3eb-56a5a7f20d8a`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:15:58,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c55a4c4-f8cd-4500-b3eb-56a5a7f20d8a`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:15:58,869::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:15:58,869::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:15:58,870::task::993::Storage.TaskManager.Task::(_decref) Task=`7c55a4c4-f8cd-4500-b3eb-56a5a7f20d8a`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:16:00,510::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:00,510::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:00,510::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:00,510::__init__::232::IOProcess::(_processLogs) (465343) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:00,512::__init__::232::IOProcess::(_processLogs) (465343) Queuing response Thread-64::DEBUG::2015-01-22 11:16:00,512::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:16:00,521::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000481799 s, 963 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:00,522::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:00,522::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:00,522::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:00,522::__init__::232::IOProcess::(_processLogs) (465344) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:00,522::__init__::232::IOProcess::(_processLogs) (465344) Queuing response Thread-21::DEBUG::2015-01-22 11:16:00,523::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:00,523::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:00,524::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:00,524::__init__::232::IOProcess::(_processLogs) (465345) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:00,524::__init__::232::IOProcess::(_processLogs) (465345) Queuing response Thread-21::DEBUG::2015-01-22 11:16:00,525::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:00,525::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:00,525::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:00,525::__init__::232::IOProcess::(_processLogs) (465346) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:00,526::__init__::232::IOProcess::(_processLogs) (465346) Queuing response Thread-21::DEBUG::2015-01-22 11:16:00,526::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:00,526::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:00,526::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:00,526::__init__::232::IOProcess::(_processLogs) (465347) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:00,527::__init__::232::IOProcess::(_processLogs) (465347) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:01,497::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:01,498::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404488::DEBUG::2015-01-22 11:16:01,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f36e4ce-ff0c-48aa-a8e3-8a62018ac8cd`::moving from state init -> state preparing Thread-404488::INFO::2015-01-22 11:16:01,502::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404488::INFO::2015-01-22 11:16:01,502::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025801', 'lastCheck': '8.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481799', 'lastCheck': '1.0', 'valid': True}} Thread-404488::DEBUG::2015-01-22 11:16:01,502::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f36e4ce-ff0c-48aa-a8e3-8a62018ac8cd`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025801', 'lastCheck': '8.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481799', 'lastCheck': '1.0', 'valid': True}} Thread-404488::DEBUG::2015-01-22 11:16:01,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f36e4ce-ff0c-48aa-a8e3-8a62018ac8cd`::moving from state preparing -> state finished Thread-404488::DEBUG::2015-01-22 11:16:01,503::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404488::DEBUG::2015-01-22 11:16:01,503::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404488::DEBUG::2015-01-22 11:16:01,503::task::993::Storage.TaskManager.Task::(_decref) Task=`0f36e4ce-ff0c-48aa-a8e3-8a62018ac8cd`::ref 0 aborting False Thread-404488::ERROR::2015-01-22 11:16:01,504::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404488::DEBUG::2015-01-22 11:16:01,506::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:01,515::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:01,516::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404489::DEBUG::2015-01-22 11:16:01,518::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404489::DEBUG::2015-01-22 11:16:01,519::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:02,488::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:02,488::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:02,496::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:16:03,508::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:03,508::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:03,508::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:03,508::__init__::232::IOProcess::(_processLogs) (465348) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:03,508::__init__::232::IOProcess::(_processLogs) (465348) Queuing response Thread-63::DEBUG::2015-01-22 11:16:03,509::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:16:03,517::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00029682 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:03,518::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:03,519::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:03,519::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:03,519::__init__::232::IOProcess::(_processLogs) (465349) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:03,519::__init__::232::IOProcess::(_processLogs) (465349) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:04,571::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:04,573::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404490::DEBUG::2015-01-22 11:16:04,575::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:04,576::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:04,578::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404491::DEBUG::2015-01-22 11:16:04,579::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404491::DEBUG::2015-01-22 11:16:04,580::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:07,502::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:07,502::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:07,510::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:07,624::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:07,625::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404492::DEBUG::2015-01-22 11:16:07,627::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:07,628::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:07,630::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404493::DEBUG::2015-01-22 11:16:07,631::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404493::DEBUG::2015-01-22 11:16:07,632::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:16:08,501::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:16:10,528::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:10,529::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:10,529::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:10,529::__init__::232::IOProcess::(_processLogs) (465350) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:10,530::__init__::232::IOProcess::(_processLogs) (465350) Queuing response Thread-64::DEBUG::2015-01-22 11:16:10,531::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:16:10,539::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00046162 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:10,540::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:10,540::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:10,541::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:10,541::__init__::232::IOProcess::(_processLogs) (465351) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:10,541::__init__::232::IOProcess::(_processLogs) (465351) Queuing response Thread-21::DEBUG::2015-01-22 11:16:10,542::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:10,542::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:10,542::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:10,542::__init__::232::IOProcess::(_processLogs) (465352) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:10,543::__init__::232::IOProcess::(_processLogs) (465352) Queuing response Thread-21::DEBUG::2015-01-22 11:16:10,543::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:10,543::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:10,543::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:10,543::__init__::232::IOProcess::(_processLogs) (465353) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:10,544::__init__::232::IOProcess::(_processLogs) (465353) Queuing response Thread-21::DEBUG::2015-01-22 11:16:10,545::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:10,545::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:10,545::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:10,545::__init__::232::IOProcess::(_processLogs) (465354) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:10,545::__init__::232::IOProcess::(_processLogs) (465354) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:10,663::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:10,664::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404494::DEBUG::2015-01-22 11:16:10,667::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:10,668::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:10,669::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404495::DEBUG::2015-01-22 11:16:10,671::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404495::DEBUG::2015-01-22 11:16:10,672::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:12,516::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:12,517::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:12,524::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:16:13,521::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:13,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:13,521::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:13,521::__init__::232::IOProcess::(_processLogs) (465355) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:13,521::__init__::232::IOProcess::(_processLogs) (465355) Queuing response Thread-63::DEBUG::2015-01-22 11:16:13,522::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:16:13,531::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000307773 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:13,532::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:13,532::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:13,532::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:13,533::__init__::232::IOProcess::(_processLogs) (465356) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:13,533::__init__::232::IOProcess::(_processLogs) (465356) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:13,701::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:13,702::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404496::DEBUG::2015-01-22 11:16:13,705::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:13,706::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:13,707::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404497::DEBUG::2015-01-22 11:16:13,709::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404497::DEBUG::2015-01-22 11:16:13,710::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:16,737::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:16,739::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404498::DEBUG::2015-01-22 11:16:16,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`be9c295d-67c2-436e-8fb4-e65122574f8a`::moving from state init -> state preparing Thread-404498::INFO::2015-01-22 11:16:16,742::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404498::INFO::2015-01-22 11:16:16,743::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000307773', 'lastCheck': '3.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046162', 'lastCheck': '6.2', 'valid': True}} Thread-404498::DEBUG::2015-01-22 11:16:16,743::task::1191::Storage.TaskManager.Task::(prepare) Task=`be9c295d-67c2-436e-8fb4-e65122574f8a`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000307773', 'lastCheck': '3.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046162', 'lastCheck': '6.2', 'valid': True}} Thread-404498::DEBUG::2015-01-22 11:16:16,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`be9c295d-67c2-436e-8fb4-e65122574f8a`::moving from state preparing -> state finished Thread-404498::DEBUG::2015-01-22 11:16:16,743::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404498::DEBUG::2015-01-22 11:16:16,743::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404498::DEBUG::2015-01-22 11:16:16,743::task::993::Storage.TaskManager.Task::(_decref) Task=`be9c295d-67c2-436e-8fb4-e65122574f8a`::ref 0 aborting False Thread-404498::ERROR::2015-01-22 11:16:16,744::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404498::DEBUG::2015-01-22 11:16:16,747::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:16,754::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:16,755::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404499::DEBUG::2015-01-22 11:16:16,757::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404499::DEBUG::2015-01-22 11:16:16,758::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:17,531::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:17,535::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:17,545::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:19,820::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:19,821::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404500::DEBUG::2015-01-22 11:16:19,823::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:19,824::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:19,826::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404501::DEBUG::2015-01-22 11:16:19,828::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404501::DEBUG::2015-01-22 11:16:19,829::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:16:20,547::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:20,547::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:20,547::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:20,547::__init__::232::IOProcess::(_processLogs) (465357) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:20,549::__init__::232::IOProcess::(_processLogs) (465357) Queuing response Thread-64::DEBUG::2015-01-22 11:16:20,550::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:16:20,558::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000523399 s, 887 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:20,559::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:20,559::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:20,559::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:20,559::__init__::232::IOProcess::(_processLogs) (465358) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:20,559::__init__::232::IOProcess::(_processLogs) (465358) Queuing response Thread-21::DEBUG::2015-01-22 11:16:20,560::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:20,560::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:20,561::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:20,561::__init__::232::IOProcess::(_processLogs) (465359) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:20,561::__init__::232::IOProcess::(_processLogs) (465359) Queuing response Thread-21::DEBUG::2015-01-22 11:16:20,562::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:20,562::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:20,562::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:20,562::__init__::232::IOProcess::(_processLogs) (465360) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:20,562::__init__::232::IOProcess::(_processLogs) (465360) Queuing response Thread-21::DEBUG::2015-01-22 11:16:20,563::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:20,563::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:20,563::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:20,563::__init__::232::IOProcess::(_processLogs) (465361) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:20,564::__init__::232::IOProcess::(_processLogs) (465361) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:22,553::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:22,554::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:22,560::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:22,861::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:22,862::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404502::DEBUG::2015-01-22 11:16:22,864::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:22,865::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:22,866::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404503::DEBUG::2015-01-22 11:16:22,868::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404503::DEBUG::2015-01-22 11:16:22,869::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:16:23,534::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:23,534::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:23,534::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:23,535::__init__::232::IOProcess::(_processLogs) (465362) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:23,535::__init__::232::IOProcess::(_processLogs) (465362) Queuing response Thread-63::DEBUG::2015-01-22 11:16:23,536::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:16:23,544::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000250582 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:23,545::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:23,545::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:23,545::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:23,545::__init__::232::IOProcess::(_processLogs) (465363) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:23,545::__init__::232::IOProcess::(_processLogs) (465363) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:25,895::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:25,896::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404504::DEBUG::2015-01-22 11:16:25,898::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:25,899::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:25,900::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404505::DEBUG::2015-01-22 11:16:25,903::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404505::DEBUG::2015-01-22 11:16:25,903::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:27,566::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:27,567::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:27,574::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:28,930::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:28,933::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404506::DEBUG::2015-01-22 11:16:28,941::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:28,942::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:28,944::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404507::DEBUG::2015-01-22 11:16:28,946::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404507::DEBUG::2015-01-22 11:16:28,947::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:16:30,566::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:30,566::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:30,566::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:30,566::__init__::232::IOProcess::(_processLogs) (465364) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:30,568::__init__::232::IOProcess::(_processLogs) (465364) Queuing response Thread-64::DEBUG::2015-01-22 11:16:30,569::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:16:30,578::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000610227 s, 760 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:30,579::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:30,579::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:30,579::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:30,579::__init__::232::IOProcess::(_processLogs) (465365) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:30,580::__init__::232::IOProcess::(_processLogs) (465365) Queuing response Thread-21::DEBUG::2015-01-22 11:16:30,580::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:30,581::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:30,581::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:30,581::__init__::232::IOProcess::(_processLogs) (465366) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:30,581::__init__::232::IOProcess::(_processLogs) (465366) Queuing response Thread-21::DEBUG::2015-01-22 11:16:30,582::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:30,582::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:30,582::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:30,583::__init__::232::IOProcess::(_processLogs) (465367) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:30,583::__init__::232::IOProcess::(_processLogs) (465367) Queuing response Thread-21::DEBUG::2015-01-22 11:16:30,584::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:30,584::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:30,584::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:30,584::__init__::232::IOProcess::(_processLogs) (465368) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:30,584::__init__::232::IOProcess::(_processLogs) (465368) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:31,975::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:31,976::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404508::DEBUG::2015-01-22 11:16:31,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`07ceb2dd-3a39-4de4-a944-ee3f8d56f5a4`::moving from state init -> state preparing Thread-404508::INFO::2015-01-22 11:16:31,979::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404508::INFO::2015-01-22 11:16:31,979::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250582', 'lastCheck': '8.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610227', 'lastCheck': '1.4', 'valid': True}} Thread-404508::DEBUG::2015-01-22 11:16:31,979::task::1191::Storage.TaskManager.Task::(prepare) Task=`07ceb2dd-3a39-4de4-a944-ee3f8d56f5a4`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250582', 'lastCheck': '8.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610227', 'lastCheck': '1.4', 'valid': True}} Thread-404508::DEBUG::2015-01-22 11:16:31,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`07ceb2dd-3a39-4de4-a944-ee3f8d56f5a4`::moving from state preparing -> state finished Thread-404508::DEBUG::2015-01-22 11:16:31,980::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404508::DEBUG::2015-01-22 11:16:31,980::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404508::DEBUG::2015-01-22 11:16:31,980::task::993::Storage.TaskManager.Task::(_decref) Task=`07ceb2dd-3a39-4de4-a944-ee3f8d56f5a4`::ref 0 aborting False Thread-404508::ERROR::2015-01-22 11:16:31,981::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404508::DEBUG::2015-01-22 11:16:31,983::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:31,992::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:31,993::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404509::DEBUG::2015-01-22 11:16:31,995::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404509::DEBUG::2015-01-22 11:16:31,996::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:32,580::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:32,581::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:32,588::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:16:33,547::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:33,547::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:33,547::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:33,548::__init__::232::IOProcess::(_processLogs) (465369) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:33,548::__init__::232::IOProcess::(_processLogs) (465369) Queuing response Thread-63::DEBUG::2015-01-22 11:16:33,549::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:16:33,556::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000332695 s, 968 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:33,557::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:33,558::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:33,558::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:33,558::__init__::232::IOProcess::(_processLogs) (465370) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:33,558::__init__::232::IOProcess::(_processLogs) (465370) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:35,048::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:35,050::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404510::DEBUG::2015-01-22 11:16:35,052::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:35,053::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:35,054::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404511::DEBUG::2015-01-22 11:16:35,056::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404511::DEBUG::2015-01-22 11:16:35,057::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:37,594::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:37,595::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:37,602::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:38,089::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:38,090::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404512::DEBUG::2015-01-22 11:16:38,092::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:38,093::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:38,094::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404513::DEBUG::2015-01-22 11:16:38,095::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404513::DEBUG::2015-01-22 11:16:38,096::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:16:38,534::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:16:40,586::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:40,586::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:40,586::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:40,586::__init__::232::IOProcess::(_processLogs) (465371) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:40,588::__init__::232::IOProcess::(_processLogs) (465371) Queuing response Thread-64::DEBUG::2015-01-22 11:16:40,589::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:16:40,597::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000486757 s, 953 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:40,598::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:40,598::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:40,598::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:40,598::__init__::232::IOProcess::(_processLogs) (465372) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:40,598::__init__::232::IOProcess::(_processLogs) (465372) Queuing response Thread-21::DEBUG::2015-01-22 11:16:40,599::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:40,599::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:40,600::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:40,600::__init__::232::IOProcess::(_processLogs) (465373) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:40,600::__init__::232::IOProcess::(_processLogs) (465373) Queuing response Thread-21::DEBUG::2015-01-22 11:16:40,601::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:40,601::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:40,601::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:40,601::__init__::232::IOProcess::(_processLogs) (465374) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:40,601::__init__::232::IOProcess::(_processLogs) (465374) Queuing response Thread-21::DEBUG::2015-01-22 11:16:40,602::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:40,602::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:40,602::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:40,602::__init__::232::IOProcess::(_processLogs) (465375) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:40,603::__init__::232::IOProcess::(_processLogs) (465375) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:41,125::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:41,127::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404514::DEBUG::2015-01-22 11:16:41,129::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:41,130::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:41,131::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404515::DEBUG::2015-01-22 11:16:41,133::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404515::DEBUG::2015-01-22 11:16:41,134::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:42,608::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:42,609::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:42,616::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:16:43,560::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:43,560::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:43,560::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:43,560::__init__::232::IOProcess::(_processLogs) (465376) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:43,560::__init__::232::IOProcess::(_processLogs) (465376) Queuing response Thread-63::DEBUG::2015-01-22 11:16:43,561::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:16:43,570::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000268608 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:43,571::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:43,571::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:43,572::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:43,572::__init__::232::IOProcess::(_processLogs) (465377) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:43,572::__init__::232::IOProcess::(_processLogs) (465377) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:44,160::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:44,161::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404516::DEBUG::2015-01-22 11:16:44,164::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:44,165::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:44,166::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404517::DEBUG::2015-01-22 11:16:44,168::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404517::DEBUG::2015-01-22 11:16:44,169::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:47,196::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:47,197::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404518::DEBUG::2015-01-22 11:16:47,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`c853d8f0-3115-4f4f-ad68-defa8a2d5368`::moving from state init -> state preparing Thread-404518::INFO::2015-01-22 11:16:47,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404518::INFO::2015-01-22 11:16:47,200::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268608', 'lastCheck': '3.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486757', 'lastCheck': '6.6', 'valid': True}} Thread-404518::DEBUG::2015-01-22 11:16:47,200::task::1191::Storage.TaskManager.Task::(prepare) Task=`c853d8f0-3115-4f4f-ad68-defa8a2d5368`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268608', 'lastCheck': '3.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486757', 'lastCheck': '6.6', 'valid': True}} Thread-404518::DEBUG::2015-01-22 11:16:47,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`c853d8f0-3115-4f4f-ad68-defa8a2d5368`::moving from state preparing -> state finished Thread-404518::DEBUG::2015-01-22 11:16:47,200::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404518::DEBUG::2015-01-22 11:16:47,200::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404518::DEBUG::2015-01-22 11:16:47,201::task::993::Storage.TaskManager.Task::(_decref) Task=`c853d8f0-3115-4f4f-ad68-defa8a2d5368`::ref 0 aborting False Thread-404518::ERROR::2015-01-22 11:16:47,201::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404518::DEBUG::2015-01-22 11:16:47,204::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:47,212::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:47,213::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404519::DEBUG::2015-01-22 11:16:47,215::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404519::DEBUG::2015-01-22 11:16:47,216::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:47,623::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:47,627::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:47,637::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:50,272::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:50,273::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404520::DEBUG::2015-01-22 11:16:50,275::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:50,276::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:50,278::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404521::DEBUG::2015-01-22 11:16:50,279::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404521::DEBUG::2015-01-22 11:16:50,280::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:16:50,604::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:50,604::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:50,605::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:50,605::__init__::232::IOProcess::(_processLogs) (465378) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:50,606::__init__::232::IOProcess::(_processLogs) (465378) Queuing response Thread-64::DEBUG::2015-01-22 11:16:50,607::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:16:50,615::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000524912 s, 884 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:50,616::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:50,616::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:50,616::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:50,616::__init__::232::IOProcess::(_processLogs) (465379) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:50,617::__init__::232::IOProcess::(_processLogs) (465379) Queuing response Thread-21::DEBUG::2015-01-22 11:16:50,617::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:50,618::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:50,618::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:50,618::__init__::232::IOProcess::(_processLogs) (465380) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:50,618::__init__::232::IOProcess::(_processLogs) (465380) Queuing response Thread-21::DEBUG::2015-01-22 11:16:50,619::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:50,619::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:50,619::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:50,619::__init__::232::IOProcess::(_processLogs) (465381) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:50,620::__init__::232::IOProcess::(_processLogs) (465381) Queuing response Thread-21::DEBUG::2015-01-22 11:16:50,620::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:50,621::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:50,621::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:50,621::__init__::232::IOProcess::(_processLogs) (465382) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:16:50,621::__init__::232::IOProcess::(_processLogs) (465382) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:52,645::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:52,646::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:52,653::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:53,311::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:53,313::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404522::DEBUG::2015-01-22 11:16:53,315::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:53,316::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:53,317::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404523::DEBUG::2015-01-22 11:16:53,319::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404523::DEBUG::2015-01-22 11:16:53,320::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:16:53,573::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:53,574::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:53,574::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:53,574::__init__::232::IOProcess::(_processLogs) (465383) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:53,574::__init__::232::IOProcess::(_processLogs) (465383) Queuing response Thread-63::DEBUG::2015-01-22 11:16:53,575::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:16:53,583::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000272405 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:16:53,584::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:53,584::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:53,584::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:53,584::__init__::232::IOProcess::(_processLogs) (465384) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:16:53,584::__init__::232::IOProcess::(_processLogs) (465384) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:56,349::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:56,350::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404524::DEBUG::2015-01-22 11:16:56,352::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:56,353::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:56,355::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404525::DEBUG::2015-01-22 11:16:56,356::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404525::DEBUG::2015-01-22 11:16:56,358::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:16:57,659::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:57,659::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:16:57,667::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:16:58,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ad39d00-dd13-4cef-aed0-2294228c6b2c`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:16:58,948::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:16:58,949::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:58,949::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:58,949::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:58,949::__init__::232::IOProcess::(_processLogs) (465385) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:16:58,952::__init__::232::IOProcess::(_processLogs) (465385) Queuing response Thread-21::DEBUG::2015-01-22 11:16:58,953::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:16:58,953::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:16:58,953::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:16:58,953::__init__::232::IOProcess::(_processLogs) (465386) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:16:58,953::__init__::232::IOProcess::(_processLogs) (465386) Queuing response Thread-360::INFO::2015-01-22 11:16:58,954::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:16:58,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ad39d00-dd13-4cef-aed0-2294228c6b2c`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:16:58,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ad39d00-dd13-4cef-aed0-2294228c6b2c`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:16:58,955::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:16:58,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:16:58,955::task::993::Storage.TaskManager.Task::(_decref) Task=`1ad39d00-dd13-4cef-aed0-2294228c6b2c`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:59,387::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:59,389::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404526::DEBUG::2015-01-22 11:16:59,391::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:16:59,393::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:16:59,394::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404527::DEBUG::2015-01-22 11:16:59,396::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404527::DEBUG::2015-01-22 11:16:59,397::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:17:00,622::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:00,623::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:00,623::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:00,623::__init__::232::IOProcess::(_processLogs) (465387) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:00,624::__init__::232::IOProcess::(_processLogs) (465387) Queuing response Thread-64::DEBUG::2015-01-22 11:17:00,625::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:17:00,633::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000506506 s, 916 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:00,634::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:00,634::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:00,634::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:00,635::__init__::232::IOProcess::(_processLogs) (465388) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:00,635::__init__::232::IOProcess::(_processLogs) (465388) Queuing response Thread-21::DEBUG::2015-01-22 11:17:00,636::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:00,636::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:00,636::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:00,636::__init__::232::IOProcess::(_processLogs) (465389) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:00,637::__init__::232::IOProcess::(_processLogs) (465389) Queuing response Thread-21::DEBUG::2015-01-22 11:17:00,638::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:00,638::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:00,638::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:00,638::__init__::232::IOProcess::(_processLogs) (465390) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:00,639::__init__::232::IOProcess::(_processLogs) (465390) Queuing response Thread-21::DEBUG::2015-01-22 11:17:00,639::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:00,639::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:00,639::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:00,640::__init__::232::IOProcess::(_processLogs) (465391) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:00,640::__init__::232::IOProcess::(_processLogs) (465391) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:02,425::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:02,426::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404528::DEBUG::2015-01-22 11:17:02,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`b58608e2-5b50-49a8-9d40-79156225899a`::moving from state init -> state preparing Thread-404528::INFO::2015-01-22 11:17:02,429::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404528::INFO::2015-01-22 11:17:02,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272405', 'lastCheck': '8.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506506', 'lastCheck': '1.8', 'valid': True}} Thread-404528::DEBUG::2015-01-22 11:17:02,429::task::1191::Storage.TaskManager.Task::(prepare) Task=`b58608e2-5b50-49a8-9d40-79156225899a`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272405', 'lastCheck': '8.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506506', 'lastCheck': '1.8', 'valid': True}} Thread-404528::DEBUG::2015-01-22 11:17:02,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`b58608e2-5b50-49a8-9d40-79156225899a`::moving from state preparing -> state finished Thread-404528::DEBUG::2015-01-22 11:17:02,429::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404528::DEBUG::2015-01-22 11:17:02,429::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404528::DEBUG::2015-01-22 11:17:02,429::task::993::Storage.TaskManager.Task::(_decref) Task=`b58608e2-5b50-49a8-9d40-79156225899a`::ref 0 aborting False Thread-404528::ERROR::2015-01-22 11:17:02,430::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404528::DEBUG::2015-01-22 11:17:02,433::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:02,441::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:02,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404529::DEBUG::2015-01-22 11:17:02,444::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404529::DEBUG::2015-01-22 11:17:02,445::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:02,673::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:02,673::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:02,689::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:17:03,586::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:03,586::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:03,586::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:03,586::__init__::232::IOProcess::(_processLogs) (465392) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:03,587::__init__::232::IOProcess::(_processLogs) (465392) Queuing response Thread-63::DEBUG::2015-01-22 11:17:03,587::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:17:03,595::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000288863 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:03,596::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:03,596::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:03,597::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:03,597::__init__::232::IOProcess::(_processLogs) (465393) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:03,597::__init__::232::IOProcess::(_processLogs) (465393) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:05,498::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:05,499::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404530::DEBUG::2015-01-22 11:17:05,502::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:05,503::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:05,504::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404531::DEBUG::2015-01-22 11:17:05,506::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404531::DEBUG::2015-01-22 11:17:05,507::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:07,695::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:07,695::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:07,699::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:08,539::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:08,540::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404532::DEBUG::2015-01-22 11:17:08,541::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:08,542::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:08,544::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404533::DEBUG::2015-01-22 11:17:08,545::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404533::DEBUG::2015-01-22 11:17:08,546::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:17:08,569::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:17:10,642::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:10,642::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:10,642::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:10,642::__init__::232::IOProcess::(_processLogs) (465394) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:10,643::__init__::232::IOProcess::(_processLogs) (465394) Queuing response Thread-64::DEBUG::2015-01-22 11:17:10,644::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:17:10,653::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000567082 s, 818 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:10,653::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:10,654::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:10,654::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:10,654::__init__::232::IOProcess::(_processLogs) (465395) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:10,654::__init__::232::IOProcess::(_processLogs) (465395) Queuing response Thread-21::DEBUG::2015-01-22 11:17:10,655::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:10,655::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:10,655::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:10,655::__init__::232::IOProcess::(_processLogs) (465396) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:10,656::__init__::232::IOProcess::(_processLogs) (465396) Queuing response Thread-21::DEBUG::2015-01-22 11:17:10,657::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:10,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:10,657::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:10,657::__init__::232::IOProcess::(_processLogs) (465397) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:10,657::__init__::232::IOProcess::(_processLogs) (465397) Queuing response Thread-21::DEBUG::2015-01-22 11:17:10,658::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:10,658::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:10,658::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:10,658::__init__::232::IOProcess::(_processLogs) (465398) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:10,659::__init__::232::IOProcess::(_processLogs) (465398) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:11,575::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:11,577::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404534::DEBUG::2015-01-22 11:17:11,579::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:11,580::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:11,581::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404535::DEBUG::2015-01-22 11:17:11,583::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404535::DEBUG::2015-01-22 11:17:11,584::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:12,705::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:12,705::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:12,713::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:17:13,598::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:13,599::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:13,599::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:13,599::__init__::232::IOProcess::(_processLogs) (465399) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:13,599::__init__::232::IOProcess::(_processLogs) (465399) Queuing response Thread-63::DEBUG::2015-01-22 11:17:13,600::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:17:13,609::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000292788 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:13,610::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:13,610::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:13,610::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:13,610::__init__::232::IOProcess::(_processLogs) (465400) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:13,610::__init__::232::IOProcess::(_processLogs) (465400) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:14,613::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:14,614::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404536::DEBUG::2015-01-22 11:17:14,616::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:14,617::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:14,619::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404537::DEBUG::2015-01-22 11:17:14,620::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404537::DEBUG::2015-01-22 11:17:14,621::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:17,652::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:17,655::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404538::DEBUG::2015-01-22 11:17:17,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`4602e675-8333-49b4-9989-7da3909f5777`::moving from state init -> state preparing Thread-404538::INFO::2015-01-22 11:17:17,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404538::INFO::2015-01-22 11:17:17,663::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292788', 'lastCheck': '4.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567082', 'lastCheck': '7.0', 'valid': True}} Thread-404538::DEBUG::2015-01-22 11:17:17,664::task::1191::Storage.TaskManager.Task::(prepare) Task=`4602e675-8333-49b4-9989-7da3909f5777`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292788', 'lastCheck': '4.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567082', 'lastCheck': '7.0', 'valid': True}} Thread-404538::DEBUG::2015-01-22 11:17:17,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`4602e675-8333-49b4-9989-7da3909f5777`::moving from state preparing -> state finished Thread-404538::DEBUG::2015-01-22 11:17:17,665::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404538::DEBUG::2015-01-22 11:17:17,665::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404538::DEBUG::2015-01-22 11:17:17,666::task::993::Storage.TaskManager.Task::(_decref) Task=`4602e675-8333-49b4-9989-7da3909f5777`::ref 0 aborting False Thread-404538::ERROR::2015-01-22 11:17:17,668::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404538::DEBUG::2015-01-22 11:17:17,690::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:17,700::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:17,702::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404539::DEBUG::2015-01-22 11:17:17,706::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404539::DEBUG::2015-01-22 11:17:17,712::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:17,721::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:17,724::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:17,728::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:17:20,660::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:20,661::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:20,661::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:20,661::__init__::232::IOProcess::(_processLogs) (465401) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:20,662::__init__::232::IOProcess::(_processLogs) (465401) Queuing response Thread-64::DEBUG::2015-01-22 11:17:20,663::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:17:20,671::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000496472 s, 935 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:20,672::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:20,672::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:20,673::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:20,673::__init__::232::IOProcess::(_processLogs) (465402) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:20,673::__init__::232::IOProcess::(_processLogs) (465402) Queuing response Thread-21::DEBUG::2015-01-22 11:17:20,674::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:20,674::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:20,674::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:20,674::__init__::232::IOProcess::(_processLogs) (465403) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:20,675::__init__::232::IOProcess::(_processLogs) (465403) Queuing response Thread-21::DEBUG::2015-01-22 11:17:20,676::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:20,676::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:20,676::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:20,676::__init__::232::IOProcess::(_processLogs) (465404) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:20,677::__init__::232::IOProcess::(_processLogs) (465404) Queuing response Thread-21::DEBUG::2015-01-22 11:17:20,677::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:20,677::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:20,678::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:20,678::__init__::232::IOProcess::(_processLogs) (465405) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:20,678::__init__::232::IOProcess::(_processLogs) (465405) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:20,788::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:20,790::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404540::DEBUG::2015-01-22 11:17:20,792::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:20,793::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:20,794::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404541::DEBUG::2015-01-22 11:17:20,796::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404541::DEBUG::2015-01-22 11:17:20,797::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:22,736::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:22,736::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:22,741::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:17:23,612::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:23,612::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:23,612::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:23,612::__init__::232::IOProcess::(_processLogs) (465406) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:23,613::__init__::232::IOProcess::(_processLogs) (465406) Queuing response Thread-63::DEBUG::2015-01-22 11:17:23,613::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:17:23,621::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000325432 s, 989 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:23,622::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:23,622::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:23,622::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:23,623::__init__::232::IOProcess::(_processLogs) (465407) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:23,623::__init__::232::IOProcess::(_processLogs) (465407) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:23,831::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:23,833::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404542::DEBUG::2015-01-22 11:17:23,835::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:23,836::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:23,837::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404543::DEBUG::2015-01-22 11:17:23,839::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404543::DEBUG::2015-01-22 11:17:23,840::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:26,871::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:26,872::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404544::DEBUG::2015-01-22 11:17:26,874::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:26,875::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:26,877::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404545::DEBUG::2015-01-22 11:17:26,878::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404545::DEBUG::2015-01-22 11:17:26,879::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:27,744::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:27,744::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:27,755::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:29,907::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:29,909::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404546::DEBUG::2015-01-22 11:17:29,911::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:29,912::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:29,914::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404547::DEBUG::2015-01-22 11:17:29,916::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404547::DEBUG::2015-01-22 11:17:29,917::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:17:30,679::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:30,680::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:30,680::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:30,680::__init__::232::IOProcess::(_processLogs) (465408) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:30,681::__init__::232::IOProcess::(_processLogs) (465408) Queuing response Thread-64::DEBUG::2015-01-22 11:17:30,682::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:17:30,691::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000565449 s, 821 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:30,692::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:30,692::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:30,692::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:30,692::__init__::232::IOProcess::(_processLogs) (465409) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:30,692::__init__::232::IOProcess::(_processLogs) (465409) Queuing response Thread-21::DEBUG::2015-01-22 11:17:30,693::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:30,693::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:30,693::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:30,694::__init__::232::IOProcess::(_processLogs) (465410) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:30,694::__init__::232::IOProcess::(_processLogs) (465410) Queuing response Thread-21::DEBUG::2015-01-22 11:17:30,695::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:30,696::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:30,696::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:30,696::__init__::232::IOProcess::(_processLogs) (465411) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:30,696::__init__::232::IOProcess::(_processLogs) (465411) Queuing response Thread-21::DEBUG::2015-01-22 11:17:30,697::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:30,697::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:30,697::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:30,697::__init__::232::IOProcess::(_processLogs) (465412) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:30,697::__init__::232::IOProcess::(_processLogs) (465412) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:32,761::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:32,762::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:32,773::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:32,946::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:32,947::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404548::DEBUG::2015-01-22 11:17:32,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3b9600e-0bb8-4835-bae1-d8c89062f054`::moving from state init -> state preparing Thread-404548::INFO::2015-01-22 11:17:32,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404548::INFO::2015-01-22 11:17:32,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000325432', 'lastCheck': '9.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565449', 'lastCheck': '2.3', 'valid': True}} Thread-404548::DEBUG::2015-01-22 11:17:32,950::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3b9600e-0bb8-4835-bae1-d8c89062f054`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000325432', 'lastCheck': '9.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565449', 'lastCheck': '2.3', 'valid': True}} Thread-404548::DEBUG::2015-01-22 11:17:32,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3b9600e-0bb8-4835-bae1-d8c89062f054`::moving from state preparing -> state finished Thread-404548::DEBUG::2015-01-22 11:17:32,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404548::DEBUG::2015-01-22 11:17:32,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404548::DEBUG::2015-01-22 11:17:32,951::task::993::Storage.TaskManager.Task::(_decref) Task=`f3b9600e-0bb8-4835-bae1-d8c89062f054`::ref 0 aborting False Thread-404548::ERROR::2015-01-22 11:17:32,952::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404548::DEBUG::2015-01-22 11:17:32,954::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:32,961::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:32,963::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404549::DEBUG::2015-01-22 11:17:32,965::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404549::DEBUG::2015-01-22 11:17:32,965::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:17:33,624::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:33,625::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:33,625::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:33,625::__init__::232::IOProcess::(_processLogs) (465413) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:33,625::__init__::232::IOProcess::(_processLogs) (465413) Queuing response Thread-63::DEBUG::2015-01-22 11:17:33,626::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:17:33,634::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000319467 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:33,636::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:33,636::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:33,636::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:33,636::__init__::232::IOProcess::(_processLogs) (465414) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:33,636::__init__::232::IOProcess::(_processLogs) (465414) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:36,018::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:36,019::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404550::DEBUG::2015-01-22 11:17:36,022::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:36,023::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:36,024::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404551::DEBUG::2015-01-22 11:17:36,026::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404551::DEBUG::2015-01-22 11:17:36,027::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:37,779::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:37,781::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:37,791::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:17:38,604::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:39,059::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:39,060::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404552::DEBUG::2015-01-22 11:17:39,062::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:39,063::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:39,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404553::DEBUG::2015-01-22 11:17:39,066::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404553::DEBUG::2015-01-22 11:17:39,067::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:17:40,699::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:40,699::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:40,699::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:40,699::__init__::232::IOProcess::(_processLogs) (465415) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:40,701::__init__::232::IOProcess::(_processLogs) (465415) Queuing response Thread-64::DEBUG::2015-01-22 11:17:40,702::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:17:40,710::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000483124 s, 960 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:40,711::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:40,711::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:40,712::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:40,712::__init__::232::IOProcess::(_processLogs) (465416) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:40,712::__init__::232::IOProcess::(_processLogs) (465416) Queuing response Thread-21::DEBUG::2015-01-22 11:17:40,713::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:40,713::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:40,713::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:40,713::__init__::232::IOProcess::(_processLogs) (465417) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:40,714::__init__::232::IOProcess::(_processLogs) (465417) Queuing response Thread-21::DEBUG::2015-01-22 11:17:40,715::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:40,715::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:40,715::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:40,715::__init__::232::IOProcess::(_processLogs) (465418) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:40,716::__init__::232::IOProcess::(_processLogs) (465418) Queuing response Thread-21::DEBUG::2015-01-22 11:17:40,717::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:40,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:40,717::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:40,718::__init__::232::IOProcess::(_processLogs) (465419) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:40,718::__init__::232::IOProcess::(_processLogs) (465419) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:42,094::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:42,097::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404554::DEBUG::2015-01-22 11:17:42,102::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:42,104::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:42,106::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404555::DEBUG::2015-01-22 11:17:42,108::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404555::DEBUG::2015-01-22 11:17:42,109::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:42,797::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:42,798::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:42,805::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:17:43,638::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:43,638::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:43,638::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:43,638::__init__::232::IOProcess::(_processLogs) (465420) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:43,638::__init__::232::IOProcess::(_processLogs) (465420) Queuing response Thread-63::DEBUG::2015-01-22 11:17:43,639::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:17:43,648::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000309522 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:43,649::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:43,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:43,650::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:43,650::__init__::232::IOProcess::(_processLogs) (465421) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:43,650::__init__::232::IOProcess::(_processLogs) (465421) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:45,137::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:45,138::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404556::DEBUG::2015-01-22 11:17:45,140::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:45,141::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:45,142::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404557::DEBUG::2015-01-22 11:17:45,144::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404557::DEBUG::2015-01-22 11:17:45,144::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:47,812::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:47,815::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:47,821::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:48,174::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:48,177::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404558::DEBUG::2015-01-22 11:17:48,183::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5233cdd-6328-4619-8491-682e7bef82c3`::moving from state init -> state preparing Thread-404558::INFO::2015-01-22 11:17:48,183::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404558::INFO::2015-01-22 11:17:48,184::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000309522', 'lastCheck': '4.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483124', 'lastCheck': '7.5', 'valid': True}} Thread-404558::DEBUG::2015-01-22 11:17:48,185::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5233cdd-6328-4619-8491-682e7bef82c3`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000309522', 'lastCheck': '4.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483124', 'lastCheck': '7.5', 'valid': True}} Thread-404558::DEBUG::2015-01-22 11:17:48,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5233cdd-6328-4619-8491-682e7bef82c3`::moving from state preparing -> state finished Thread-404558::DEBUG::2015-01-22 11:17:48,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404558::DEBUG::2015-01-22 11:17:48,186::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404558::DEBUG::2015-01-22 11:17:48,186::task::993::Storage.TaskManager.Task::(_decref) Task=`d5233cdd-6328-4619-8491-682e7bef82c3`::ref 0 aborting False Thread-404558::ERROR::2015-01-22 11:17:48,189::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404558::DEBUG::2015-01-22 11:17:48,210::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:48,220::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:48,222::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404559::DEBUG::2015-01-22 11:17:48,225::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404559::DEBUG::2015-01-22 11:17:48,231::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:17:50,719::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:50,720::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:50,720::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:50,720::__init__::232::IOProcess::(_processLogs) (465422) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:50,721::__init__::232::IOProcess::(_processLogs) (465422) Queuing response Thread-64::DEBUG::2015-01-22 11:17:50,722::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:17:50,730::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000460638 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:50,731::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:50,731::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:50,731::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:50,731::__init__::232::IOProcess::(_processLogs) (465423) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:50,732::__init__::232::IOProcess::(_processLogs) (465423) Queuing response Thread-21::DEBUG::2015-01-22 11:17:50,733::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:50,733::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:50,733::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:50,733::__init__::232::IOProcess::(_processLogs) (465424) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:50,734::__init__::232::IOProcess::(_processLogs) (465424) Queuing response Thread-21::DEBUG::2015-01-22 11:17:50,735::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:50,736::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:50,736::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:50,736::__init__::232::IOProcess::(_processLogs) (465425) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:50,736::__init__::232::IOProcess::(_processLogs) (465425) Queuing response Thread-21::DEBUG::2015-01-22 11:17:50,737::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:50,737::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:50,737::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:50,737::__init__::232::IOProcess::(_processLogs) (465426) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:17:50,738::__init__::232::IOProcess::(_processLogs) (465426) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:51,283::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:51,284::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404560::DEBUG::2015-01-22 11:17:51,286::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:51,288::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:51,289::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404561::DEBUG::2015-01-22 11:17:51,290::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404561::DEBUG::2015-01-22 11:17:51,291::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:52,829::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:52,830::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:52,833::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:17:53,652::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:53,652::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:53,652::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:53,652::__init__::232::IOProcess::(_processLogs) (465427) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:53,652::__init__::232::IOProcess::(_processLogs) (465427) Queuing response Thread-63::DEBUG::2015-01-22 11:17:53,653::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:17:53,661::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000249743 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:17:53,662::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:53,662::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:53,662::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:53,662::__init__::232::IOProcess::(_processLogs) (465428) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:17:53,662::__init__::232::IOProcess::(_processLogs) (465428) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:54,324::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:54,325::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404562::DEBUG::2015-01-22 11:17:54,327::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:54,328::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:54,329::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404563::DEBUG::2015-01-22 11:17:54,331::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404563::DEBUG::2015-01-22 11:17:54,332::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:57,363::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:57,364::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404564::DEBUG::2015-01-22 11:17:57,366::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:17:57,367::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:17:57,368::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404565::DEBUG::2015-01-22 11:17:57,370::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404565::DEBUG::2015-01-22 11:17:57,371::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:17:57,839::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:57,839::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:17:57,847::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:17:59,030::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f7e88dd-8011-4a7a-97fa-06a28789d7e2`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:17:59,030::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:17:59,031::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:59,031::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:59,031::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:59,031::__init__::232::IOProcess::(_processLogs) (465429) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:17:59,034::__init__::232::IOProcess::(_processLogs) (465429) Queuing response Thread-21::DEBUG::2015-01-22 11:17:59,035::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:17:59,035::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:17:59,035::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:17:59,036::__init__::232::IOProcess::(_processLogs) (465430) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:17:59,036::__init__::232::IOProcess::(_processLogs) (465430) Queuing response Thread-360::INFO::2015-01-22 11:17:59,036::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:17:59,037::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f7e88dd-8011-4a7a-97fa-06a28789d7e2`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:17:59,037::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f7e88dd-8011-4a7a-97fa-06a28789d7e2`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:17:59,037::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:17:59,037::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:17:59,037::task::993::Storage.TaskManager.Task::(_decref) Task=`0f7e88dd-8011-4a7a-97fa-06a28789d7e2`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:00,399::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:00,401::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404566::DEBUG::2015-01-22 11:18:00,403::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:00,404::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:00,405::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404567::DEBUG::2015-01-22 11:18:00,407::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404567::DEBUG::2015-01-22 11:18:00,408::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:18:00,740::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:00,740::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:00,740::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:00,740::__init__::232::IOProcess::(_processLogs) (465431) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:00,742::__init__::232::IOProcess::(_processLogs) (465431) Queuing response Thread-64::DEBUG::2015-01-22 11:18:00,743::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:18:00,751::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00045324 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:00,752::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:00,752::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:00,752::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:00,752::__init__::232::IOProcess::(_processLogs) (465432) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:00,752::__init__::232::IOProcess::(_processLogs) (465432) Queuing response Thread-21::DEBUG::2015-01-22 11:18:00,753::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:00,753::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:00,754::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:00,754::__init__::232::IOProcess::(_processLogs) (465433) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:00,754::__init__::232::IOProcess::(_processLogs) (465433) Queuing response Thread-21::DEBUG::2015-01-22 11:18:00,755::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:00,755::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:00,755::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:00,755::__init__::232::IOProcess::(_processLogs) (465434) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:00,755::__init__::232::IOProcess::(_processLogs) (465434) Queuing response Thread-21::DEBUG::2015-01-22 11:18:00,756::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:00,756::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:00,756::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:00,756::__init__::232::IOProcess::(_processLogs) (465435) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:00,756::__init__::232::IOProcess::(_processLogs) (465435) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:02,854::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:02,854::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:02,861::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:03,437::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:03,438::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404568::DEBUG::2015-01-22 11:18:03,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3f6614f-13c8-497a-9266-25cb05593106`::moving from state init -> state preparing Thread-404568::INFO::2015-01-22 11:18:03,441::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404568::INFO::2015-01-22 11:18:03,441::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249743', 'lastCheck': '9.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045324', 'lastCheck': '2.7', 'valid': True}} Thread-404568::DEBUG::2015-01-22 11:18:03,441::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3f6614f-13c8-497a-9266-25cb05593106`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249743', 'lastCheck': '9.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045324', 'lastCheck': '2.7', 'valid': True}} Thread-404568::DEBUG::2015-01-22 11:18:03,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3f6614f-13c8-497a-9266-25cb05593106`::moving from state preparing -> state finished Thread-404568::DEBUG::2015-01-22 11:18:03,442::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404568::DEBUG::2015-01-22 11:18:03,442::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404568::DEBUG::2015-01-22 11:18:03,442::task::993::Storage.TaskManager.Task::(_decref) Task=`f3f6614f-13c8-497a-9266-25cb05593106`::ref 0 aborting False Thread-404568::ERROR::2015-01-22 11:18:03,443::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404568::DEBUG::2015-01-22 11:18:03,445::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:03,454::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:03,455::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404569::DEBUG::2015-01-22 11:18:03,457::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404569::DEBUG::2015-01-22 11:18:03,458::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:18:03,664::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:03,664::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:03,664::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:03,665::__init__::232::IOProcess::(_processLogs) (465436) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:03,665::__init__::232::IOProcess::(_processLogs) (465436) Queuing response Thread-63::DEBUG::2015-01-22 11:18:03,665::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:18:03,673::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000293447 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:03,674::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:03,675::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:03,675::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:03,675::__init__::232::IOProcess::(_processLogs) (465437) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:03,675::__init__::232::IOProcess::(_processLogs) (465437) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:06,528::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:06,529::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404570::DEBUG::2015-01-22 11:18:06,531::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:06,532::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:06,534::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404571::DEBUG::2015-01-22 11:18:06,536::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404571::DEBUG::2015-01-22 11:18:06,536::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:07,867::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:07,868::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:07,880::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:18:08,640::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:09,570::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:09,571::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404572::DEBUG::2015-01-22 11:18:09,573::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:09,577::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:09,579::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404573::DEBUG::2015-01-22 11:18:09,580::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404573::DEBUG::2015-01-22 11:18:09,581::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:18:10,758::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:10,758::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:10,758::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:10,758::__init__::232::IOProcess::(_processLogs) (465438) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:10,760::__init__::232::IOProcess::(_processLogs) (465438) Queuing response Thread-64::DEBUG::2015-01-22 11:18:10,761::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:18:10,769::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00056504 s, 821 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:10,770::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:10,770::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:10,770::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:10,770::__init__::232::IOProcess::(_processLogs) (465439) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:10,770::__init__::232::IOProcess::(_processLogs) (465439) Queuing response Thread-21::DEBUG::2015-01-22 11:18:10,771::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:10,771::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:10,771::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:10,771::__init__::232::IOProcess::(_processLogs) (465440) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:10,772::__init__::232::IOProcess::(_processLogs) (465440) Queuing response Thread-21::DEBUG::2015-01-22 11:18:10,773::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:10,773::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:10,773::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:10,773::__init__::232::IOProcess::(_processLogs) (465441) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:10,773::__init__::232::IOProcess::(_processLogs) (465441) Queuing response Thread-21::DEBUG::2015-01-22 11:18:10,774::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:10,775::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:10,775::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:10,775::__init__::232::IOProcess::(_processLogs) (465442) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:10,775::__init__::232::IOProcess::(_processLogs) (465442) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:12,612::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:12,613::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404574::DEBUG::2015-01-22 11:18:12,615::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:12,617::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:12,618::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404575::DEBUG::2015-01-22 11:18:12,619::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404575::DEBUG::2015-01-22 11:18:12,620::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:12,886::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:12,886::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:12,894::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:18:13,677::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:13,677::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:13,677::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:13,677::__init__::232::IOProcess::(_processLogs) (465443) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:13,677::__init__::232::IOProcess::(_processLogs) (465443) Queuing response Thread-63::DEBUG::2015-01-22 11:18:13,678::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:18:13,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000350273 s, 919 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:13,687::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:13,687::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:13,688::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:13,688::__init__::232::IOProcess::(_processLogs) (465444) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:13,688::__init__::232::IOProcess::(_processLogs) (465444) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:15,651::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:15,652::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404576::DEBUG::2015-01-22 11:18:15,655::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:15,656::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:15,658::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404577::DEBUG::2015-01-22 11:18:15,660::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404577::DEBUG::2015-01-22 11:18:15,661::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:17,901::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:17,904::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:17,910::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:18,707::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:18,708::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404578::DEBUG::2015-01-22 11:18:18,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`57d5a75a-368a-4038-8fc4-ef0deeee488a`::moving from state init -> state preparing Thread-404578::INFO::2015-01-22 11:18:18,710::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404578::INFO::2015-01-22 11:18:18,711::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000350273', 'lastCheck': '5.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056504', 'lastCheck': '7.9', 'valid': True}} Thread-404578::DEBUG::2015-01-22 11:18:18,711::task::1191::Storage.TaskManager.Task::(prepare) Task=`57d5a75a-368a-4038-8fc4-ef0deeee488a`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000350273', 'lastCheck': '5.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056504', 'lastCheck': '7.9', 'valid': True}} Thread-404578::DEBUG::2015-01-22 11:18:18,711::task::595::Storage.TaskManager.Task::(_updateState) Task=`57d5a75a-368a-4038-8fc4-ef0deeee488a`::moving from state preparing -> state finished Thread-404578::DEBUG::2015-01-22 11:18:18,711::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404578::DEBUG::2015-01-22 11:18:18,711::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404578::DEBUG::2015-01-22 11:18:18,711::task::993::Storage.TaskManager.Task::(_decref) Task=`57d5a75a-368a-4038-8fc4-ef0deeee488a`::ref 0 aborting False Thread-404578::ERROR::2015-01-22 11:18:18,712::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404578::DEBUG::2015-01-22 11:18:18,715::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:18,721::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:18,722::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404579::DEBUG::2015-01-22 11:18:18,724::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404579::DEBUG::2015-01-22 11:18:18,725::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:18:20,777::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:20,777::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:20,777::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:20,777::__init__::232::IOProcess::(_processLogs) (465445) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:20,779::__init__::232::IOProcess::(_processLogs) (465445) Queuing response Thread-64::DEBUG::2015-01-22 11:18:20,780::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:18:20,787::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000499659 s, 929 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:20,788::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:20,788::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:20,789::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:20,789::__init__::232::IOProcess::(_processLogs) (465446) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:20,789::__init__::232::IOProcess::(_processLogs) (465446) Queuing response Thread-21::DEBUG::2015-01-22 11:18:20,790::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:20,790::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:20,790::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:20,790::__init__::232::IOProcess::(_processLogs) (465447) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:20,791::__init__::232::IOProcess::(_processLogs) (465447) Queuing response Thread-21::DEBUG::2015-01-22 11:18:20,791::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:20,791::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:20,792::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:20,792::__init__::232::IOProcess::(_processLogs) (465448) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:20,792::__init__::232::IOProcess::(_processLogs) (465448) Queuing response Thread-21::DEBUG::2015-01-22 11:18:20,793::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:20,793::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:20,793::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:20,793::__init__::232::IOProcess::(_processLogs) (465449) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:20,793::__init__::232::IOProcess::(_processLogs) (465449) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:21,773::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:21,775::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404580::DEBUG::2015-01-22 11:18:21,777::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:21,779::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:21,780::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404581::DEBUG::2015-01-22 11:18:21,782::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404581::DEBUG::2015-01-22 11:18:21,783::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:22,913::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:22,914::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:22,926::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-63::DEBUG::2015-01-22 11:18:23,689::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d26c38f9-0719-457c-8ce0-a074d1eff534 Thread-21::DEBUG::2015-01-22 11:18:23,692::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:23,692::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:23,693::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:23,693::__init__::232::IOProcess::(_processLogs) (465450) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:18:23,693::__init__::232::IOProcess::(_processLogs) (465450) Queuing response Thread-21::DEBUG::2015-01-22 11:18:23,693::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:23,695::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:23,696::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:23,697::__init__::232::IOProcess::(_processLogs) (465451) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:18:23,698::__init__::232::IOProcess::(_processLogs) (465451) Queuing response Thread-63::DEBUG::2015-01-22 11:18:23,705::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534 Thread-21::DEBUG::2015-01-22 11:18:23,706::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:23,706::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:23,706::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:23,706::__init__::232::IOProcess::(_processLogs) (465452) Got request for method 'touch' Thread-21::DEBUG::2015-01-22 11:18:23,713::__init__::232::IOProcess::(_processLogs) (465452) Queuing response Thread-63::DEBUG::2015-01-22 11:18:23,714::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend Thread-21::DEBUG::2015-01-22 11:18:23,714::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:23,714::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:23,715::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:23,715::__init__::232::IOProcess::(_processLogs) (465453) Got request for method 'readfile' Thread-21::DEBUG::2015-01-22 11:18:23,715::__init__::232::IOProcess::(_processLogs) (465453) Queuing response Thread-63::DEBUG::2015-01-22 11:18:23,715::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISO', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=67c137fd-0cf2-463a-bc70-b427cc0a5da3', 'REMOTE_PATH=192.168.1.24:/Data/ISO', 'ROLE=Regular', 'SDUUID=d26c38f9-0719-457c-8ce0-a074d1eff534', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2e3c4b23cacb8bd1a5cc7cf85722fc990962eb40'] Thread-21::DEBUG::2015-01-22 11:18:23,716::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:23,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:23,716::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:23,716::__init__::232::IOProcess::(_processLogs) (465454) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:23,716::__init__::232::IOProcess::(_processLogs) (465454) Queuing response Thread-21::DEBUG::2015-01-22 11:18:23,717::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:23,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:23,718::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:23,718::__init__::232::IOProcess::(_processLogs) (465455) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:18:23,718::__init__::232::IOProcess::(_processLogs) (465455) Queuing response Thread-63::DEBUG::2015-01-22 11:18:23,718::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-63::INFO::2015-01-22 11:18:23,718::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d26c38f9-0719-457c-8ce0-a074d1eff534_imageNS already registered Thread-63::INFO::2015-01-22 11:18:23,719::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d26c38f9-0719-457c-8ce0-a074d1eff534_volumeNS already registered Thread-21::DEBUG::2015-01-22 11:18:23,719::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:23,719::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:23,719::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:23,719::__init__::232::IOProcess::(_processLogs) (465456) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:23,720::__init__::232::IOProcess::(_processLogs) (465456) Queuing response Thread-63::DEBUG::2015-01-22 11:18:23,720::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:18:23,728::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000317005 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:23,729::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:23,729::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:23,730::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:23,730::__init__::232::IOProcess::(_processLogs) (465457) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:23,730::__init__::232::IOProcess::(_processLogs) (465457) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:24,815::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:24,816::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404584::DEBUG::2015-01-22 11:18:24,818::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:24,819::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:24,821::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404585::DEBUG::2015-01-22 11:18:24,823::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404585::DEBUG::2015-01-22 11:18:24,824::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:27,852::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:27,854::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404586::DEBUG::2015-01-22 11:18:27,856::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:27,857::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:27,859::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404587::DEBUG::2015-01-22 11:18:27,860::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404587::DEBUG::2015-01-22 11:18:27,861::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:27,932::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:27,932::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:27,940::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:18:30,795::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:30,796::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:30,796::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:30,796::__init__::232::IOProcess::(_processLogs) (465458) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:30,798::__init__::232::IOProcess::(_processLogs) (465458) Queuing response Thread-64::DEBUG::2015-01-22 11:18:30,798::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:18:30,806::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000602494 s, 770 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:30,807::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:30,807::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:30,807::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:30,807::__init__::232::IOProcess::(_processLogs) (465459) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:30,807::__init__::232::IOProcess::(_processLogs) (465459) Queuing response Thread-21::DEBUG::2015-01-22 11:18:30,808::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:30,808::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:30,808::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:30,809::__init__::232::IOProcess::(_processLogs) (465460) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:30,809::__init__::232::IOProcess::(_processLogs) (465460) Queuing response Thread-21::DEBUG::2015-01-22 11:18:30,810::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:30,810::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:30,810::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:30,810::__init__::232::IOProcess::(_processLogs) (465461) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:30,810::__init__::232::IOProcess::(_processLogs) (465461) Queuing response Thread-21::DEBUG::2015-01-22 11:18:30,811::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:30,811::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:30,811::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:30,811::__init__::232::IOProcess::(_processLogs) (465462) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:30,811::__init__::232::IOProcess::(_processLogs) (465462) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:30,890::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:30,891::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404588::DEBUG::2015-01-22 11:18:30,893::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:30,894::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:30,896::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404589::DEBUG::2015-01-22 11:18:30,897::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404589::DEBUG::2015-01-22 11:18:30,898::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:32,946::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:32,947::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:32,958::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:18:33,731::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:33,732::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:33,732::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:33,732::__init__::232::IOProcess::(_processLogs) (465463) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:33,732::__init__::232::IOProcess::(_processLogs) (465463) Queuing response Thread-63::DEBUG::2015-01-22 11:18:33,733::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:18:33,741::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000255677 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:33,741::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:33,742::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:33,742::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:33,742::__init__::232::IOProcess::(_processLogs) (465464) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:33,742::__init__::232::IOProcess::(_processLogs) (465464) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:33,925::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:33,926::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404590::DEBUG::2015-01-22 11:18:33,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2c847d7-2624-48a3-ac78-91048257a0d3`::moving from state init -> state preparing Thread-404590::INFO::2015-01-22 11:18:33,929::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404590::INFO::2015-01-22 11:18:33,929::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255677', 'lastCheck': '0.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602494', 'lastCheck': '3.1', 'valid': True}} Thread-404590::DEBUG::2015-01-22 11:18:33,930::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2c847d7-2624-48a3-ac78-91048257a0d3`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255677', 'lastCheck': '0.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602494', 'lastCheck': '3.1', 'valid': True}} Thread-404590::DEBUG::2015-01-22 11:18:33,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2c847d7-2624-48a3-ac78-91048257a0d3`::moving from state preparing -> state finished Thread-404590::DEBUG::2015-01-22 11:18:33,930::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404590::DEBUG::2015-01-22 11:18:33,930::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404590::DEBUG::2015-01-22 11:18:33,930::task::993::Storage.TaskManager.Task::(_decref) Task=`d2c847d7-2624-48a3-ac78-91048257a0d3`::ref 0 aborting False Thread-404590::ERROR::2015-01-22 11:18:33,931::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404590::DEBUG::2015-01-22 11:18:33,934::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:33,943::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:33,944::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404591::DEBUG::2015-01-22 11:18:33,946::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404591::DEBUG::2015-01-22 11:18:33,947::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:37,009::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:37,010::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404592::DEBUG::2015-01-22 11:18:37,013::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:37,014::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:37,015::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404593::DEBUG::2015-01-22 11:18:37,017::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404593::DEBUG::2015-01-22 11:18:37,018::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:37,964::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:37,964::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:37,972::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:18:38,675::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:40,045::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:40,045::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404594::DEBUG::2015-01-22 11:18:40,047::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:40,048::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:40,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404595::DEBUG::2015-01-22 11:18:40,051::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404595::DEBUG::2015-01-22 11:18:40,052::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:18:40,813::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:40,813::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:40,813::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:40,813::__init__::232::IOProcess::(_processLogs) (465465) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:40,814::__init__::232::IOProcess::(_processLogs) (465465) Queuing response Thread-64::DEBUG::2015-01-22 11:18:40,815::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:18:40,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000539966 s, 859 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:40,824::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:40,824::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:40,824::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:40,824::__init__::232::IOProcess::(_processLogs) (465466) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:40,824::__init__::232::IOProcess::(_processLogs) (465466) Queuing response Thread-21::DEBUG::2015-01-22 11:18:40,825::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:40,825::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:40,826::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:40,826::__init__::232::IOProcess::(_processLogs) (465467) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:40,826::__init__::232::IOProcess::(_processLogs) (465467) Queuing response Thread-21::DEBUG::2015-01-22 11:18:40,827::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:40,827::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:40,827::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:40,827::__init__::232::IOProcess::(_processLogs) (465468) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:40,827::__init__::232::IOProcess::(_processLogs) (465468) Queuing response Thread-21::DEBUG::2015-01-22 11:18:40,828::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:40,828::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:40,828::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:40,828::__init__::232::IOProcess::(_processLogs) (465469) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:40,829::__init__::232::IOProcess::(_processLogs) (465469) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:42,978::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:42,979::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:42,986::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:43,080::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:43,081::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404596::DEBUG::2015-01-22 11:18:43,084::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:43,085::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:43,086::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404597::DEBUG::2015-01-22 11:18:43,088::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404597::DEBUG::2015-01-22 11:18:43,089::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:18:43,743::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:43,744::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:43,744::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:43,744::__init__::232::IOProcess::(_processLogs) (465470) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:43,744::__init__::232::IOProcess::(_processLogs) (465470) Queuing response Thread-63::DEBUG::2015-01-22 11:18:43,745::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:18:43,753::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000253237 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:43,754::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:43,754::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:43,754::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:43,755::__init__::232::IOProcess::(_processLogs) (465471) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:43,755::__init__::232::IOProcess::(_processLogs) (465471) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:45,823::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:45,824::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404598::ERROR::2015-01-22 11:18:45,826::__init__::491::jsonrpc.JsonRpcServer::(_serveRequest) Internal server error Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/yajsonrpc/__init__.py", line 486, in _serveRequest res = method(**params) File "/usr/share/vdsm/rpc/Bridge.py", line 252, in _dynamicMethod self._fixupArgs(className, methodName, methodArgs) File "/usr/share/vdsm/rpc/Bridge.py", line 227, in _fixupArgs self._typeFixup(argName, argType, val) File "/usr/share/vdsm/rpc/Bridge.py", line 214, in _typeFixup if k in item: TypeError: argument of type 'NoneType' is not iterable Thread-404598::DEBUG::2015-01-22 11:18:45,827::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:45,828::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:45,829::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404599::ERROR::2015-01-22 11:18:45,831::__init__::491::jsonrpc.JsonRpcServer::(_serveRequest) Internal server error Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/yajsonrpc/__init__.py", line 486, in _serveRequest res = method(**params) File "/usr/share/vdsm/rpc/Bridge.py", line 252, in _dynamicMethod self._fixupArgs(className, methodName, methodArgs) File "/usr/share/vdsm/rpc/Bridge.py", line 227, in _fixupArgs self._typeFixup(argName, argType, val) File "/usr/share/vdsm/rpc/Bridge.py", line 214, in _typeFixup if k in item: TypeError: argument of type 'NoneType' is not iterable Thread-404599::DEBUG::2015-01-22 11:18:45,831::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:46,088::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:46,089::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404600::ERROR::2015-01-22 11:18:46,090::__init__::491::jsonrpc.JsonRpcServer::(_serveRequest) Internal server error Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/yajsonrpc/__init__.py", line 486, in _serveRequest res = method(**params) File "/usr/share/vdsm/rpc/Bridge.py", line 252, in _dynamicMethod self._fixupArgs(className, methodName, methodArgs) File "/usr/share/vdsm/rpc/Bridge.py", line 227, in _fixupArgs self._typeFixup(argName, argType, val) File "/usr/share/vdsm/rpc/Bridge.py", line 214, in _typeFixup if k in item: TypeError: argument of type 'NoneType' is not iterable Thread-404600::DEBUG::2015-01-22 11:18:46,091::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:46,092::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:46,093::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404601::ERROR::2015-01-22 11:18:46,095::__init__::491::jsonrpc.JsonRpcServer::(_serveRequest) Internal server error Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/yajsonrpc/__init__.py", line 486, in _serveRequest res = method(**params) File "/usr/share/vdsm/rpc/Bridge.py", line 252, in _dynamicMethod self._fixupArgs(className, methodName, methodArgs) File "/usr/share/vdsm/rpc/Bridge.py", line 227, in _fixupArgs self._typeFixup(argName, argType, val) File "/usr/share/vdsm/rpc/Bridge.py", line 214, in _typeFixup if k in item: TypeError: argument of type 'NoneType' is not iterable Thread-404601::DEBUG::2015-01-22 11:18:46,095::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:46,121::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:46,122::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404602::DEBUG::2015-01-22 11:18:46,123::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:46,124::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:46,126::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404603::DEBUG::2015-01-22 11:18:46,128::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404603::DEBUG::2015-01-22 11:18:46,129::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:47,993::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:47,996::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:48,007::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:49,156::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:49,156::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404604::DEBUG::2015-01-22 11:18:49,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`8818d3e1-8fec-4d03-868c-3e4ecf761ebc`::moving from state init -> state preparing Thread-404604::INFO::2015-01-22 11:18:49,159::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404604::INFO::2015-01-22 11:18:49,159::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000253237', 'lastCheck': '5.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539966', 'lastCheck': '8.3', 'valid': True}} Thread-404604::DEBUG::2015-01-22 11:18:49,159::task::1191::Storage.TaskManager.Task::(prepare) Task=`8818d3e1-8fec-4d03-868c-3e4ecf761ebc`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000253237', 'lastCheck': '5.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539966', 'lastCheck': '8.3', 'valid': True}} Thread-404604::DEBUG::2015-01-22 11:18:49,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`8818d3e1-8fec-4d03-868c-3e4ecf761ebc`::moving from state preparing -> state finished Thread-404604::DEBUG::2015-01-22 11:18:49,160::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404604::DEBUG::2015-01-22 11:18:49,160::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404604::DEBUG::2015-01-22 11:18:49,160::task::993::Storage.TaskManager.Task::(_decref) Task=`8818d3e1-8fec-4d03-868c-3e4ecf761ebc`::ref 0 aborting False Thread-404604::ERROR::2015-01-22 11:18:49,161::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404604::DEBUG::2015-01-22 11:18:49,163::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:49,171::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:49,172::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404605::DEBUG::2015-01-22 11:18:49,173::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404605::DEBUG::2015-01-22 11:18:49,174::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:18:50,830::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:50,831::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:50,831::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:50,831::__init__::232::IOProcess::(_processLogs) (465472) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:50,833::__init__::232::IOProcess::(_processLogs) (465472) Queuing response Thread-64::DEBUG::2015-01-22 11:18:50,834::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:18:50,842::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000475871 s, 975 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:50,842::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:50,843::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:50,843::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:50,843::__init__::232::IOProcess::(_processLogs) (465473) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:50,843::__init__::232::IOProcess::(_processLogs) (465473) Queuing response Thread-21::DEBUG::2015-01-22 11:18:50,844::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:50,844::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:50,844::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:50,844::__init__::232::IOProcess::(_processLogs) (465474) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:50,845::__init__::232::IOProcess::(_processLogs) (465474) Queuing response Thread-21::DEBUG::2015-01-22 11:18:50,846::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:50,846::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:50,846::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:50,846::__init__::232::IOProcess::(_processLogs) (465475) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:50,847::__init__::232::IOProcess::(_processLogs) (465475) Queuing response Thread-21::DEBUG::2015-01-22 11:18:50,847::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:50,848::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:50,848::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:50,848::__init__::232::IOProcess::(_processLogs) (465476) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:18:50,848::__init__::232::IOProcess::(_processLogs) (465476) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:52,236::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:52,237::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404606::DEBUG::2015-01-22 11:18:52,239::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:52,240::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:52,242::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404607::DEBUG::2015-01-22 11:18:52,244::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404607::DEBUG::2015-01-22 11:18:52,245::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:53,014::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:53,015::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:53,026::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:18:53,756::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:53,757::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:53,757::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:53,757::__init__::232::IOProcess::(_processLogs) (465477) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:53,757::__init__::232::IOProcess::(_processLogs) (465477) Queuing response Thread-63::DEBUG::2015-01-22 11:18:53,758::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:18:53,766::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000271309 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:18:53,767::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:53,767::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:53,767::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:53,767::__init__::232::IOProcess::(_processLogs) (465478) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:18:53,767::__init__::232::IOProcess::(_processLogs) (465478) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:55,277::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:55,278::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404608::DEBUG::2015-01-22 11:18:55,280::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:55,281::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:55,283::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404609::DEBUG::2015-01-22 11:18:55,285::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404609::DEBUG::2015-01-22 11:18:55,285::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:18:58,033::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:58,033::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:18:58,045::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:58,313::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:58,315::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404610::DEBUG::2015-01-22 11:18:58,317::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:18:58,318::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:18:58,319::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404611::DEBUG::2015-01-22 11:18:58,321::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404611::DEBUG::2015-01-22 11:18:58,323::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:18:59,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`30bbea99-5df6-4d2a-8e58-09045941ebcc`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:18:59,114::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:18:59,114::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:59,114::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:59,115::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:59,115::__init__::232::IOProcess::(_processLogs) (465479) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:18:59,117::__init__::232::IOProcess::(_processLogs) (465479) Queuing response Thread-21::DEBUG::2015-01-22 11:18:59,118::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:18:59,119::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:18:59,119::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:18:59,119::__init__::232::IOProcess::(_processLogs) (465480) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:18:59,119::__init__::232::IOProcess::(_processLogs) (465480) Queuing response Thread-360::INFO::2015-01-22 11:18:59,119::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:18:59,120::task::1191::Storage.TaskManager.Task::(prepare) Task=`30bbea99-5df6-4d2a-8e58-09045941ebcc`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:18:59,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`30bbea99-5df6-4d2a-8e58-09045941ebcc`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:18:59,120::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:18:59,120::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:18:59,120::task::993::Storage.TaskManager.Task::(_decref) Task=`30bbea99-5df6-4d2a-8e58-09045941ebcc`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:19:00,850::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:00,850::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:00,850::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:00,850::__init__::232::IOProcess::(_processLogs) (465481) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:00,851::__init__::232::IOProcess::(_processLogs) (465481) Queuing response Thread-64::DEBUG::2015-01-22 11:19:00,852::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:19:00,860::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000482836 s, 961 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:00,861::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:00,861::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:00,861::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:00,861::__init__::232::IOProcess::(_processLogs) (465482) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:00,861::__init__::232::IOProcess::(_processLogs) (465482) Queuing response Thread-21::DEBUG::2015-01-22 11:19:00,862::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:00,863::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:00,863::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:00,863::__init__::232::IOProcess::(_processLogs) (465483) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:00,863::__init__::232::IOProcess::(_processLogs) (465483) Queuing response Thread-21::DEBUG::2015-01-22 11:19:00,864::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:00,864::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:00,864::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:00,864::__init__::232::IOProcess::(_processLogs) (465484) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:00,864::__init__::232::IOProcess::(_processLogs) (465484) Queuing response Thread-21::DEBUG::2015-01-22 11:19:00,865::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:00,865::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:00,865::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:00,866::__init__::232::IOProcess::(_processLogs) (465485) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:00,866::__init__::232::IOProcess::(_processLogs) (465485) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:01,353::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:01,354::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404612::DEBUG::2015-01-22 11:19:01,357::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:01,358::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:01,359::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404613::DEBUG::2015-01-22 11:19:01,361::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404613::DEBUG::2015-01-22 11:19:01,362::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:03,051::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:03,051::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:03,059::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:19:03,769::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:03,770::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:03,770::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:03,770::__init__::232::IOProcess::(_processLogs) (465486) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:03,770::__init__::232::IOProcess::(_processLogs) (465486) Queuing response Thread-63::DEBUG::2015-01-22 11:19:03,771::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:19:03,779::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000274348 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:03,780::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:03,780::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:03,780::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:03,780::__init__::232::IOProcess::(_processLogs) (465487) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:03,780::__init__::232::IOProcess::(_processLogs) (465487) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:04,391::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:04,392::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404614::DEBUG::2015-01-22 11:19:04,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fc044bd-92ae-495b-96a8-3d310678bdfc`::moving from state init -> state preparing Thread-404614::INFO::2015-01-22 11:19:04,395::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404614::INFO::2015-01-22 11:19:04,395::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274348', 'lastCheck': '0.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482836', 'lastCheck': '3.5', 'valid': True}} Thread-404614::DEBUG::2015-01-22 11:19:04,396::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fc044bd-92ae-495b-96a8-3d310678bdfc`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274348', 'lastCheck': '0.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482836', 'lastCheck': '3.5', 'valid': True}} Thread-404614::DEBUG::2015-01-22 11:19:04,396::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fc044bd-92ae-495b-96a8-3d310678bdfc`::moving from state preparing -> state finished Thread-404614::DEBUG::2015-01-22 11:19:04,396::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404614::DEBUG::2015-01-22 11:19:04,396::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404614::DEBUG::2015-01-22 11:19:04,396::task::993::Storage.TaskManager.Task::(_decref) Task=`9fc044bd-92ae-495b-96a8-3d310678bdfc`::ref 0 aborting False Thread-404614::ERROR::2015-01-22 11:19:04,397::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404614::DEBUG::2015-01-22 11:19:04,400::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:04,408::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:04,409::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404615::DEBUG::2015-01-22 11:19:04,411::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404615::DEBUG::2015-01-22 11:19:04,412::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:07,473::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:07,475::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404616::DEBUG::2015-01-22 11:19:07,477::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:07,478::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:07,480::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404617::DEBUG::2015-01-22 11:19:07,482::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404617::DEBUG::2015-01-22 11:19:07,482::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:08,065::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:08,066::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:08,073::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:19:08,711::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:10,514::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:10,515::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404618::DEBUG::2015-01-22 11:19:10,517::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:10,518::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:10,519::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404619::DEBUG::2015-01-22 11:19:10,521::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404619::DEBUG::2015-01-22 11:19:10,522::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:19:10,869::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:10,869::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:10,869::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:10,869::__init__::232::IOProcess::(_processLogs) (465488) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:10,871::__init__::232::IOProcess::(_processLogs) (465488) Queuing response Thread-64::DEBUG::2015-01-22 11:19:10,872::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:19:10,880::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000478127 s, 970 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:10,881::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:10,881::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:10,881::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:10,881::__init__::232::IOProcess::(_processLogs) (465489) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:10,881::__init__::232::IOProcess::(_processLogs) (465489) Queuing response Thread-21::DEBUG::2015-01-22 11:19:10,882::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:10,882::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:10,883::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:10,883::__init__::232::IOProcess::(_processLogs) (465490) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:10,883::__init__::232::IOProcess::(_processLogs) (465490) Queuing response Thread-21::DEBUG::2015-01-22 11:19:10,884::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:10,884::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:10,884::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:10,884::__init__::232::IOProcess::(_processLogs) (465491) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:10,884::__init__::232::IOProcess::(_processLogs) (465491) Queuing response Thread-21::DEBUG::2015-01-22 11:19:10,885::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:10,885::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:10,885::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:10,885::__init__::232::IOProcess::(_processLogs) (465492) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:10,886::__init__::232::IOProcess::(_processLogs) (465492) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:13,079::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:13,080::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:13,086::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:13,549::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:13,550::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404620::DEBUG::2015-01-22 11:19:13,552::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:13,553::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:13,554::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404621::DEBUG::2015-01-22 11:19:13,556::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404621::DEBUG::2015-01-22 11:19:13,557::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:19:13,782::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:13,782::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:13,782::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:13,782::__init__::232::IOProcess::(_processLogs) (465493) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:13,782::__init__::232::IOProcess::(_processLogs) (465493) Queuing response Thread-63::DEBUG::2015-01-22 11:19:13,783::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:19:13,792::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000329608 s, 977 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:13,793::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:13,793::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:13,793::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:13,794::__init__::232::IOProcess::(_processLogs) (465494) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:13,794::__init__::232::IOProcess::(_processLogs) (465494) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:16,583::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:16,585::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404622::DEBUG::2015-01-22 11:19:16,587::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:16,588::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:16,590::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404623::DEBUG::2015-01-22 11:19:16,592::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404623::DEBUG::2015-01-22 11:19:16,593::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:18,094::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:18,098::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:18,103::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:19,620::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:19,621::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404624::DEBUG::2015-01-22 11:19:19,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a67c34d-9faf-4a96-827b-c371953ff3ac`::moving from state init -> state preparing Thread-404624::INFO::2015-01-22 11:19:19,624::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404624::INFO::2015-01-22 11:19:19,624::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000329608', 'lastCheck': '5.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478127', 'lastCheck': '8.7', 'valid': True}} Thread-404624::DEBUG::2015-01-22 11:19:19,624::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a67c34d-9faf-4a96-827b-c371953ff3ac`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000329608', 'lastCheck': '5.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478127', 'lastCheck': '8.7', 'valid': True}} Thread-404624::DEBUG::2015-01-22 11:19:19,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a67c34d-9faf-4a96-827b-c371953ff3ac`::moving from state preparing -> state finished Thread-404624::DEBUG::2015-01-22 11:19:19,625::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404624::DEBUG::2015-01-22 11:19:19,625::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404624::DEBUG::2015-01-22 11:19:19,625::task::993::Storage.TaskManager.Task::(_decref) Task=`6a67c34d-9faf-4a96-827b-c371953ff3ac`::ref 0 aborting False Thread-404624::ERROR::2015-01-22 11:19:19,626::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404624::DEBUG::2015-01-22 11:19:19,628::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:19,636::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:19,638::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404625::DEBUG::2015-01-22 11:19:19,639::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404625::DEBUG::2015-01-22 11:19:19,640::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-64::DEBUG::2015-01-22 11:19:20,887::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 06e45ff6-0505-4692-b97d-896d9b710b49 Thread-21::DEBUG::2015-01-22 11:19:20,889::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:20,889::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:20,889::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:20,889::__init__::232::IOProcess::(_processLogs) (465495) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:19:20,893::__init__::232::IOProcess::(_processLogs) (465495) Queuing response Thread-64::DEBUG::2015-01-22 11:19:20,898::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49 Thread-21::DEBUG::2015-01-22 11:19:20,899::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:20,899::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:20,899::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:20,899::__init__::232::IOProcess::(_processLogs) (465496) Got request for method 'touch' Thread-21::DEBUG::2015-01-22 11:19:20,901::__init__::232::IOProcess::(_processLogs) (465496) Queuing response Thread-64::DEBUG::2015-01-22 11:19:20,901::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend Thread-21::DEBUG::2015-01-22 11:19:20,902::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:20,902::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:20,902::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:20,902::__init__::232::IOProcess::(_processLogs) (465497) Got request for method 'readfile' Thread-21::DEBUG::2015-01-22 11:19:20,904::__init__::232::IOProcess::(_processLogs) (465497) Queuing response Thread-64::DEBUG::2015-01-22 11:19:20,904::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=store1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=cllDataCentre', 'POOL_DOMAINS=06e45ff6-0505-4692-b97d-896d9b710b49:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=67c137fd-0cf2-463a-bc70-b427cc0a5da3', 'REMOTE_PATH=192.168.1.25:/Vol2', 'ROLE=Master', 'SDUUID=06e45ff6-0505-4692-b97d-896d9b710b49', 'TYPE=GLUSTERFS', 'VERSION=3', '_SHA_CKSUM=7f3bb8b00fa6ca5bb291ea1e02530cfbc66a33ba'] Thread-21::DEBUG::2015-01-22 11:19:20,905::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:20,905::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:20,905::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:20,905::__init__::232::IOProcess::(_processLogs) (465498) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:20,906::__init__::232::IOProcess::(_processLogs) (465498) Queuing response Thread-21::DEBUG::2015-01-22 11:19:20,906::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:20,906::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:20,906::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:20,906::__init__::232::IOProcess::(_processLogs) (465499) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:19:20,909::__init__::232::IOProcess::(_processLogs) (465499) Queuing response Thread-64::DEBUG::2015-01-22 11:19:20,909::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-64::INFO::2015-01-22 11:19:20,909::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 06e45ff6-0505-4692-b97d-896d9b710b49_imageNS already registered Thread-64::INFO::2015-01-22 11:19:20,909::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 06e45ff6-0505-4692-b97d-896d9b710b49_volumeNS already registered Thread-21::DEBUG::2015-01-22 11:19:20,910::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:20,910::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:20,910::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:20,910::__init__::232::IOProcess::(_processLogs) (465500) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:20,910::__init__::232::IOProcess::(_processLogs) (465500) Queuing response Thread-64::DEBUG::2015-01-22 11:19:20,911::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:19:20,918::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000540682 s, 858 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:20,919::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:20,919::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:20,919::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:20,919::__init__::232::IOProcess::(_processLogs) (465501) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:20,919::__init__::232::IOProcess::(_processLogs) (465501) Queuing response Thread-21::DEBUG::2015-01-22 11:19:20,920::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:20,920::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:20,920::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:20,921::__init__::232::IOProcess::(_processLogs) (465502) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:20,921::__init__::232::IOProcess::(_processLogs) (465502) Queuing response Thread-21::DEBUG::2015-01-22 11:19:20,923::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:20,923::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:20,923::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:20,923::__init__::232::IOProcess::(_processLogs) (465503) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:20,923::__init__::232::IOProcess::(_processLogs) (465503) Queuing response Thread-21::DEBUG::2015-01-22 11:19:20,924::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:20,924::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:20,924::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:20,924::__init__::232::IOProcess::(_processLogs) (465504) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:20,924::__init__::232::IOProcess::(_processLogs) (465504) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:22,697::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:22,699::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404627::DEBUG::2015-01-22 11:19:22,701::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:22,702::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:22,703::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404628::DEBUG::2015-01-22 11:19:22,705::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404628::DEBUG::2015-01-22 11:19:22,706::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:23,111::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:23,112::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:23,112::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:19:23,795::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:23,795::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:23,796::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:23,796::__init__::232::IOProcess::(_processLogs) (465505) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:23,796::__init__::232::IOProcess::(_processLogs) (465505) Queuing response Thread-63::DEBUG::2015-01-22 11:19:23,797::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:19:23,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000257946 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:23,806::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:23,806::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:23,806::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:23,806::__init__::232::IOProcess::(_processLogs) (465506) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:23,806::__init__::232::IOProcess::(_processLogs) (465506) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:25,739::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:25,740::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404629::DEBUG::2015-01-22 11:19:25,743::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:25,744::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:25,745::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404630::DEBUG::2015-01-22 11:19:25,747::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404630::DEBUG::2015-01-22 11:19:25,748::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:28,118::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:28,119::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:28,125::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:28,779::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:28,780::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404631::DEBUG::2015-01-22 11:19:28,782::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:28,783::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:28,784::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404632::DEBUG::2015-01-22 11:19:28,786::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404632::DEBUG::2015-01-22 11:19:28,787::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:19:30,926::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:30,926::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:30,926::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:30,926::__init__::232::IOProcess::(_processLogs) (465507) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:30,928::__init__::232::IOProcess::(_processLogs) (465507) Queuing response Thread-64::DEBUG::2015-01-22 11:19:30,929::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:19:30,936::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000469587 s, 988 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:30,937::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:30,937::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:30,937::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:30,937::__init__::232::IOProcess::(_processLogs) (465508) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:30,937::__init__::232::IOProcess::(_processLogs) (465508) Queuing response Thread-21::DEBUG::2015-01-22 11:19:30,938::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:30,938::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:30,939::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:30,939::__init__::232::IOProcess::(_processLogs) (465509) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:30,939::__init__::232::IOProcess::(_processLogs) (465509) Queuing response Thread-21::DEBUG::2015-01-22 11:19:30,940::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:30,940::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:30,940::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:30,940::__init__::232::IOProcess::(_processLogs) (465510) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:30,940::__init__::232::IOProcess::(_processLogs) (465510) Queuing response Thread-21::DEBUG::2015-01-22 11:19:30,941::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:30,941::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:30,941::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:30,941::__init__::232::IOProcess::(_processLogs) (465511) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:30,942::__init__::232::IOProcess::(_processLogs) (465511) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:31,815::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:31,817::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404633::DEBUG::2015-01-22 11:19:31,819::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:31,820::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:31,821::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404634::DEBUG::2015-01-22 11:19:31,823::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404634::DEBUG::2015-01-22 11:19:31,824::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:33,131::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:33,132::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:33,139::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:33,724::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:33,725::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404635::ERROR::2015-01-22 11:19:33,726::__init__::491::jsonrpc.JsonRpcServer::(_serveRequest) Internal server error Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/yajsonrpc/__init__.py", line 486, in _serveRequest res = method(**params) File "/usr/share/vdsm/rpc/Bridge.py", line 252, in _dynamicMethod self._fixupArgs(className, methodName, methodArgs) File "/usr/share/vdsm/rpc/Bridge.py", line 227, in _fixupArgs self._typeFixup(argName, argType, val) File "/usr/share/vdsm/rpc/Bridge.py", line 214, in _typeFixup if k in item: TypeError: argument of type 'NoneType' is not iterable Thread-404635::DEBUG::2015-01-22 11:19:33,727::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:33,728::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:33,729::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404636::ERROR::2015-01-22 11:19:33,731::__init__::491::jsonrpc.JsonRpcServer::(_serveRequest) Internal server error Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/yajsonrpc/__init__.py", line 486, in _serveRequest res = method(**params) File "/usr/share/vdsm/rpc/Bridge.py", line 252, in _dynamicMethod self._fixupArgs(className, methodName, methodArgs) File "/usr/share/vdsm/rpc/Bridge.py", line 227, in _fixupArgs self._typeFixup(argName, argType, val) File "/usr/share/vdsm/rpc/Bridge.py", line 214, in _typeFixup if k in item: TypeError: argument of type 'NoneType' is not iterable Thread-404636::DEBUG::2015-01-22 11:19:33,731::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:19:33,808::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:33,808::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:33,809::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:33,809::__init__::232::IOProcess::(_processLogs) (465512) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:33,809::__init__::232::IOProcess::(_processLogs) (465512) Queuing response Thread-63::DEBUG::2015-01-22 11:19:33,809::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:19:33,818::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00025421 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:33,819::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:33,819::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:33,819::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:33,819::__init__::232::IOProcess::(_processLogs) (465513) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:33,819::__init__::232::IOProcess::(_processLogs) (465513) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:33,980::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:33,981::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404637::ERROR::2015-01-22 11:19:33,983::__init__::491::jsonrpc.JsonRpcServer::(_serveRequest) Internal server error Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/yajsonrpc/__init__.py", line 486, in _serveRequest res = method(**params) File "/usr/share/vdsm/rpc/Bridge.py", line 252, in _dynamicMethod self._fixupArgs(className, methodName, methodArgs) File "/usr/share/vdsm/rpc/Bridge.py", line 227, in _fixupArgs self._typeFixup(argName, argType, val) File "/usr/share/vdsm/rpc/Bridge.py", line 214, in _typeFixup if k in item: TypeError: argument of type 'NoneType' is not iterable Thread-404637::DEBUG::2015-01-22 11:19:33,984::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:33,985::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:33,986::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404638::ERROR::2015-01-22 11:19:33,987::__init__::491::jsonrpc.JsonRpcServer::(_serveRequest) Internal server error Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/yajsonrpc/__init__.py", line 486, in _serveRequest res = method(**params) File "/usr/share/vdsm/rpc/Bridge.py", line 252, in _dynamicMethod self._fixupArgs(className, methodName, methodArgs) File "/usr/share/vdsm/rpc/Bridge.py", line 227, in _fixupArgs self._typeFixup(argName, argType, val) File "/usr/share/vdsm/rpc/Bridge.py", line 214, in _typeFixup if k in item: TypeError: argument of type 'NoneType' is not iterable Thread-404638::DEBUG::2015-01-22 11:19:33,988::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:34,851::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:34,852::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404639::DEBUG::2015-01-22 11:19:34,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`924a698c-624c-408a-ae22-f0d6286bb376`::moving from state init -> state preparing Thread-404639::INFO::2015-01-22 11:19:34,855::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404639::INFO::2015-01-22 11:19:34,855::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025421', 'lastCheck': '1.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469587', 'lastCheck': '3.9', 'valid': True}} Thread-404639::DEBUG::2015-01-22 11:19:34,856::task::1191::Storage.TaskManager.Task::(prepare) Task=`924a698c-624c-408a-ae22-f0d6286bb376`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025421', 'lastCheck': '1.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469587', 'lastCheck': '3.9', 'valid': True}} Thread-404639::DEBUG::2015-01-22 11:19:34,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`924a698c-624c-408a-ae22-f0d6286bb376`::moving from state preparing -> state finished Thread-404639::DEBUG::2015-01-22 11:19:34,856::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404639::DEBUG::2015-01-22 11:19:34,856::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404639::DEBUG::2015-01-22 11:19:34,856::task::993::Storage.TaskManager.Task::(_decref) Task=`924a698c-624c-408a-ae22-f0d6286bb376`::ref 0 aborting False Thread-404639::ERROR::2015-01-22 11:19:34,857::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404639::DEBUG::2015-01-22 11:19:34,859::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:34,867::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:34,868::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404640::DEBUG::2015-01-22 11:19:34,870::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404640::DEBUG::2015-01-22 11:19:34,871::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:37,931::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:37,932::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404641::DEBUG::2015-01-22 11:19:37,935::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:37,936::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:37,937::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404642::DEBUG::2015-01-22 11:19:37,939::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404642::DEBUG::2015-01-22 11:19:37,941::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:38,145::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:38,146::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:38,153::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:19:38,745::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:19:40,943::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:40,944::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:40,944::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:40,945::__init__::232::IOProcess::(_processLogs) (465514) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:40,945::__init__::232::IOProcess::(_processLogs) (465514) Queuing response Thread-64::DEBUG::2015-01-22 11:19:40,946::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:19:40,955::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000506568 s, 916 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:40,955::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:40,956::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:40,956::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:40,956::__init__::232::IOProcess::(_processLogs) (465515) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:40,956::__init__::232::IOProcess::(_processLogs) (465515) Queuing response Thread-21::DEBUG::2015-01-22 11:19:40,957::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:40,957::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:40,957::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:40,958::__init__::232::IOProcess::(_processLogs) (465516) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:40,958::__init__::232::IOProcess::(_processLogs) (465516) Queuing response Thread-21::DEBUG::2015-01-22 11:19:40,958::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:40,958::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:40,959::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:40,959::__init__::232::IOProcess::(_processLogs) (465517) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:40,959::__init__::232::IOProcess::(_processLogs) (465517) Queuing response Thread-21::DEBUG::2015-01-22 11:19:40,959::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:40,960::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:40,960::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:40,960::__init__::232::IOProcess::(_processLogs) (465518) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:40,960::__init__::232::IOProcess::(_processLogs) (465518) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:40,972::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:40,973::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404643::DEBUG::2015-01-22 11:19:40,975::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:40,976::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:40,977::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404644::DEBUG::2015-01-22 11:19:40,979::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404644::DEBUG::2015-01-22 11:19:40,980::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:43,158::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:43,159::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:43,167::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:19:43,820::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:43,821::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:43,821::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:43,821::__init__::232::IOProcess::(_processLogs) (465519) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:43,821::__init__::232::IOProcess::(_processLogs) (465519) Queuing response Thread-63::DEBUG::2015-01-22 11:19:43,822::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:19:43,828::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000264499 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:43,829::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:43,829::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:43,829::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:43,830::__init__::232::IOProcess::(_processLogs) (465520) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:43,830::__init__::232::IOProcess::(_processLogs) (465520) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:44,022::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:44,023::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404645::DEBUG::2015-01-22 11:19:44,025::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:44,026::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:44,027::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404646::DEBUG::2015-01-22 11:19:44,029::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404646::DEBUG::2015-01-22 11:19:44,029::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:47,063::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:47,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404647::DEBUG::2015-01-22 11:19:47,066::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:47,068::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:47,069::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404648::DEBUG::2015-01-22 11:19:47,071::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404648::DEBUG::2015-01-22 11:19:47,072::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:48,174::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:48,177::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:48,184::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:50,099::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:50,101::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404649::DEBUG::2015-01-22 11:19:50,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1142770-d757-4fad-9ddd-3460cce2ffbc`::moving from state init -> state preparing Thread-404649::INFO::2015-01-22 11:19:50,103::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404649::INFO::2015-01-22 11:19:50,103::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264499', 'lastCheck': '6.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506568', 'lastCheck': '9.1', 'valid': True}} Thread-404649::DEBUG::2015-01-22 11:19:50,103::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1142770-d757-4fad-9ddd-3460cce2ffbc`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264499', 'lastCheck': '6.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506568', 'lastCheck': '9.1', 'valid': True}} Thread-404649::DEBUG::2015-01-22 11:19:50,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1142770-d757-4fad-9ddd-3460cce2ffbc`::moving from state preparing -> state finished Thread-404649::DEBUG::2015-01-22 11:19:50,104::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404649::DEBUG::2015-01-22 11:19:50,104::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404649::DEBUG::2015-01-22 11:19:50,104::task::993::Storage.TaskManager.Task::(_decref) Task=`f1142770-d757-4fad-9ddd-3460cce2ffbc`::ref 0 aborting False Thread-404649::ERROR::2015-01-22 11:19:50,105::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404649::DEBUG::2015-01-22 11:19:50,107::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:50,114::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:50,115::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404650::DEBUG::2015-01-22 11:19:50,117::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404650::DEBUG::2015-01-22 11:19:50,118::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:19:50,961::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:50,962::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:50,962::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:50,962::__init__::232::IOProcess::(_processLogs) (465521) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:50,963::__init__::232::IOProcess::(_processLogs) (465521) Queuing response Thread-64::DEBUG::2015-01-22 11:19:50,964::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:19:50,973::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000479529 s, 968 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:50,974::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:50,974::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:50,974::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:50,974::__init__::232::IOProcess::(_processLogs) (465522) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:50,975::__init__::232::IOProcess::(_processLogs) (465522) Queuing response Thread-21::DEBUG::2015-01-22 11:19:50,975::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:50,976::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:50,976::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:50,976::__init__::232::IOProcess::(_processLogs) (465523) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:50,976::__init__::232::IOProcess::(_processLogs) (465523) Queuing response Thread-21::DEBUG::2015-01-22 11:19:50,977::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:50,977::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:50,978::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:50,978::__init__::232::IOProcess::(_processLogs) (465524) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:50,978::__init__::232::IOProcess::(_processLogs) (465524) Queuing response Thread-21::DEBUG::2015-01-22 11:19:50,979::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:50,980::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:50,980::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:50,980::__init__::232::IOProcess::(_processLogs) (465525) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:19:50,980::__init__::232::IOProcess::(_processLogs) (465525) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:53,165::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:53,166::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404651::DEBUG::2015-01-22 11:19:53,169::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:53,170::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:53,171::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404652::DEBUG::2015-01-22 11:19:53,173::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404652::DEBUG::2015-01-22 11:19:53,174::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:53,192::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:53,193::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:53,204::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:19:53,831::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:53,831::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:53,832::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:53,832::__init__::232::IOProcess::(_processLogs) (465526) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:53,832::__init__::232::IOProcess::(_processLogs) (465526) Queuing response Thread-63::DEBUG::2015-01-22 11:19:53,833::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:19:53,841::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000255004 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:19:53,842::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:53,842::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:53,842::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:53,842::__init__::232::IOProcess::(_processLogs) (465527) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:19:53,842::__init__::232::IOProcess::(_processLogs) (465527) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:56,207::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:56,208::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404653::DEBUG::2015-01-22 11:19:56,211::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:56,212::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:56,213::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404654::DEBUG::2015-01-22 11:19:56,215::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404654::DEBUG::2015-01-22 11:19:56,216::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:19:58,210::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:58,211::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:19:58,218::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:19:59,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d65df23-0a57-4d52-9a1e-27ecbba02889`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:19:59,197::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:19:59,198::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:59,198::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:59,198::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:59,198::__init__::232::IOProcess::(_processLogs) (465528) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:19:59,200::__init__::232::IOProcess::(_processLogs) (465528) Queuing response Thread-21::DEBUG::2015-01-22 11:19:59,201::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:19:59,201::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:19:59,201::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:19:59,202::__init__::232::IOProcess::(_processLogs) (465529) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:19:59,202::__init__::232::IOProcess::(_processLogs) (465529) Queuing response Thread-360::INFO::2015-01-22 11:19:59,202::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:19:59,202::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d65df23-0a57-4d52-9a1e-27ecbba02889`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:19:59,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d65df23-0a57-4d52-9a1e-27ecbba02889`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:19:59,203::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:19:59,203::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:19:59,203::task::993::Storage.TaskManager.Task::(_decref) Task=`6d65df23-0a57-4d52-9a1e-27ecbba02889`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:59,243::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:59,244::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404655::DEBUG::2015-01-22 11:19:59,245::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:19:59,246::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:19:59,247::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404656::DEBUG::2015-01-22 11:19:59,249::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404656::DEBUG::2015-01-22 11:19:59,249::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:20:00,981::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:00,981::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:00,981::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:00,982::__init__::232::IOProcess::(_processLogs) (465530) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:00,983::__init__::232::IOProcess::(_processLogs) (465530) Queuing response Thread-64::DEBUG::2015-01-22 11:20:00,984::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:20:00,993::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000596812 s, 777 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:00,994::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:00,994::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:00,994::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:00,994::__init__::232::IOProcess::(_processLogs) (465531) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:00,994::__init__::232::IOProcess::(_processLogs) (465531) Queuing response Thread-21::DEBUG::2015-01-22 11:20:00,995::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:00,995::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:00,995::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:00,995::__init__::232::IOProcess::(_processLogs) (465532) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:00,996::__init__::232::IOProcess::(_processLogs) (465532) Queuing response Thread-21::DEBUG::2015-01-22 11:20:00,996::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:00,997::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:00,997::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:00,997::__init__::232::IOProcess::(_processLogs) (465533) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:00,997::__init__::232::IOProcess::(_processLogs) (465533) Queuing response Thread-21::DEBUG::2015-01-22 11:20:00,997::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:00,998::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:00,998::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:00,998::__init__::232::IOProcess::(_processLogs) (465534) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:00,998::__init__::232::IOProcess::(_processLogs) (465534) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:02,282::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:02,284::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404657::DEBUG::2015-01-22 11:20:02,286::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:02,287::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:02,289::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404658::DEBUG::2015-01-22 11:20:02,291::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404658::DEBUG::2015-01-22 11:20:02,292::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:03,224::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:03,224::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:03,225::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:20:03,844::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:03,844::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:03,844::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:03,844::__init__::232::IOProcess::(_processLogs) (465535) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:03,845::__init__::232::IOProcess::(_processLogs) (465535) Queuing response Thread-63::DEBUG::2015-01-22 11:20:03,845::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:20:03,854::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000324195 s, 993 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:03,855::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:03,855::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:03,855::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:03,855::__init__::232::IOProcess::(_processLogs) (465536) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:03,856::__init__::232::IOProcess::(_processLogs) (465536) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:05,322::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:05,323::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404659::DEBUG::2015-01-22 11:20:05,326::task::595::Storage.TaskManager.Task::(_updateState) Task=`b83c2bcb-adef-4ce5-b893-3edb50a9ad3a`::moving from state init -> state preparing Thread-404659::INFO::2015-01-22 11:20:05,326::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404659::INFO::2015-01-22 11:20:05,326::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324195', 'lastCheck': '1.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596812', 'lastCheck': '4.3', 'valid': True}} Thread-404659::DEBUG::2015-01-22 11:20:05,327::task::1191::Storage.TaskManager.Task::(prepare) Task=`b83c2bcb-adef-4ce5-b893-3edb50a9ad3a`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324195', 'lastCheck': '1.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596812', 'lastCheck': '4.3', 'valid': True}} Thread-404659::DEBUG::2015-01-22 11:20:05,327::task::595::Storage.TaskManager.Task::(_updateState) Task=`b83c2bcb-adef-4ce5-b893-3edb50a9ad3a`::moving from state preparing -> state finished Thread-404659::DEBUG::2015-01-22 11:20:05,327::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404659::DEBUG::2015-01-22 11:20:05,327::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404659::DEBUG::2015-01-22 11:20:05,327::task::993::Storage.TaskManager.Task::(_decref) Task=`b83c2bcb-adef-4ce5-b893-3edb50a9ad3a`::ref 0 aborting False Thread-404659::ERROR::2015-01-22 11:20:05,328::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404659::DEBUG::2015-01-22 11:20:05,331::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:05,339::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:05,341::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404660::DEBUG::2015-01-22 11:20:05,343::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404660::DEBUG::2015-01-22 11:20:05,343::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:08,231::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:08,232::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:08,232::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:08,408::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:08,410::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404661::DEBUG::2015-01-22 11:20:08,412::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:08,413::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:08,414::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404662::DEBUG::2015-01-22 11:20:08,416::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404662::DEBUG::2015-01-22 11:20:08,417::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:20:08,779::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:20:11,000::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:11,000::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:11,001::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:11,001::__init__::232::IOProcess::(_processLogs) (465537) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:11,002::__init__::232::IOProcess::(_processLogs) (465537) Queuing response Thread-64::DEBUG::2015-01-22 11:20:11,003::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:20:11,012::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000557792 s, 832 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:11,012::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:11,013::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:11,013::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:11,013::__init__::232::IOProcess::(_processLogs) (465538) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:11,013::__init__::232::IOProcess::(_processLogs) (465538) Queuing response Thread-21::DEBUG::2015-01-22 11:20:11,014::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:11,014::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:11,014::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:11,014::__init__::232::IOProcess::(_processLogs) (465539) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:11,015::__init__::232::IOProcess::(_processLogs) (465539) Queuing response Thread-21::DEBUG::2015-01-22 11:20:11,016::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:11,016::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:11,016::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:11,016::__init__::232::IOProcess::(_processLogs) (465540) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:11,016::__init__::232::IOProcess::(_processLogs) (465540) Queuing response Thread-21::DEBUG::2015-01-22 11:20:11,017::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:11,017::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:11,017::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:11,017::__init__::232::IOProcess::(_processLogs) (465541) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:11,018::__init__::232::IOProcess::(_processLogs) (465541) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:11,447::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:11,448::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404663::DEBUG::2015-01-22 11:20:11,450::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:11,451::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:11,453::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404664::DEBUG::2015-01-22 11:20:11,454::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404664::DEBUG::2015-01-22 11:20:11,455::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:13,238::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:13,239::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:13,247::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:20:13,857::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:13,857::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:13,858::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:13,858::__init__::232::IOProcess::(_processLogs) (465542) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:13,858::__init__::232::IOProcess::(_processLogs) (465542) Queuing response Thread-63::DEBUG::2015-01-22 11:20:13,859::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:20:13,868::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000321899 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:13,869::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:13,869::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:13,869::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:13,869::__init__::232::IOProcess::(_processLogs) (465543) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:13,869::__init__::232::IOProcess::(_processLogs) (465543) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:14,485::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:14,487::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404665::DEBUG::2015-01-22 11:20:14,489::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:14,490::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:14,491::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404666::DEBUG::2015-01-22 11:20:14,493::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404666::DEBUG::2015-01-22 11:20:14,494::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:17,521::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:17,525::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404667::DEBUG::2015-01-22 11:20:17,529::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:17,531::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:17,534::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404668::DEBUG::2015-01-22 11:20:17,537::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404668::DEBUG::2015-01-22 11:20:17,544::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:18,255::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:18,259::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:18,265::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:20,575::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:20,576::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404669::DEBUG::2015-01-22 11:20:20,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbec77dc-560c-467c-9dfa-742caa884bdd`::moving from state init -> state preparing Thread-404669::INFO::2015-01-22 11:20:20,578::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404669::INFO::2015-01-22 11:20:20,579::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321899', 'lastCheck': '6.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557792', 'lastCheck': '9.6', 'valid': True}} Thread-404669::DEBUG::2015-01-22 11:20:20,579::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbec77dc-560c-467c-9dfa-742caa884bdd`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321899', 'lastCheck': '6.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557792', 'lastCheck': '9.6', 'valid': True}} Thread-404669::DEBUG::2015-01-22 11:20:20,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbec77dc-560c-467c-9dfa-742caa884bdd`::moving from state preparing -> state finished Thread-404669::DEBUG::2015-01-22 11:20:20,579::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404669::DEBUG::2015-01-22 11:20:20,579::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404669::DEBUG::2015-01-22 11:20:20,579::task::993::Storage.TaskManager.Task::(_decref) Task=`cbec77dc-560c-467c-9dfa-742caa884bdd`::ref 0 aborting False Thread-404669::ERROR::2015-01-22 11:20:20,580::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404669::DEBUG::2015-01-22 11:20:20,582::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:20,591::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:20,592::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404670::DEBUG::2015-01-22 11:20:20,594::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404670::DEBUG::2015-01-22 11:20:20,594::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:20:21,019::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:21,019::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:21,019::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:21,020::__init__::232::IOProcess::(_processLogs) (465544) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:21,021::__init__::232::IOProcess::(_processLogs) (465544) Queuing response Thread-64::DEBUG::2015-01-22 11:20:21,022::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:20:21,031::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000543314 s, 854 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:21,032::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:21,032::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:21,032::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:21,032::__init__::232::IOProcess::(_processLogs) (465545) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:21,032::__init__::232::IOProcess::(_processLogs) (465545) Queuing response Thread-21::DEBUG::2015-01-22 11:20:21,033::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:21,033::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:21,033::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:21,033::__init__::232::IOProcess::(_processLogs) (465546) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:21,035::__init__::232::IOProcess::(_processLogs) (465546) Queuing response Thread-21::DEBUG::2015-01-22 11:20:21,036::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:21,036::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:21,036::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:21,036::__init__::232::IOProcess::(_processLogs) (465547) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:21,036::__init__::232::IOProcess::(_processLogs) (465547) Queuing response Thread-21::DEBUG::2015-01-22 11:20:21,037::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:21,037::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:21,037::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:21,037::__init__::232::IOProcess::(_processLogs) (465548) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:21,038::__init__::232::IOProcess::(_processLogs) (465548) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:23,271::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:23,272::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:23,280::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:23,644::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:23,645::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404671::DEBUG::2015-01-22 11:20:23,648::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:23,649::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:23,650::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404672::DEBUG::2015-01-22 11:20:23,652::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404672::DEBUG::2015-01-22 11:20:23,653::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:20:23,871::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:23,871::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:23,871::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:23,871::__init__::232::IOProcess::(_processLogs) (465549) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:23,872::__init__::232::IOProcess::(_processLogs) (465549) Queuing response Thread-63::DEBUG::2015-01-22 11:20:23,872::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:20:23,881::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000273147 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:23,882::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:23,882::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:23,882::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:23,882::__init__::232::IOProcess::(_processLogs) (465550) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:23,882::__init__::232::IOProcess::(_processLogs) (465550) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:26,687::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:26,688::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404673::DEBUG::2015-01-22 11:20:26,690::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:26,692::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:26,693::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404674::DEBUG::2015-01-22 11:20:26,695::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404674::DEBUG::2015-01-22 11:20:26,696::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:28,286::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:28,287::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:28,295::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:29,727::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:29,728::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404675::DEBUG::2015-01-22 11:20:29,730::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:29,731::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:29,732::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404676::DEBUG::2015-01-22 11:20:29,733::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404676::DEBUG::2015-01-22 11:20:29,734::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:20:31,040::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:31,040::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:31,040::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:31,040::__init__::232::IOProcess::(_processLogs) (465551) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:31,041::__init__::232::IOProcess::(_processLogs) (465551) Queuing response Thread-64::DEBUG::2015-01-22 11:20:31,042::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:20:31,051::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000580494 s, 799 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:31,052::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:31,052::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:31,052::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:31,052::__init__::232::IOProcess::(_processLogs) (465552) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:31,052::__init__::232::IOProcess::(_processLogs) (465552) Queuing response Thread-21::DEBUG::2015-01-22 11:20:31,053::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:31,053::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:31,053::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:31,053::__init__::232::IOProcess::(_processLogs) (465553) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:31,055::__init__::232::IOProcess::(_processLogs) (465553) Queuing response Thread-21::DEBUG::2015-01-22 11:20:31,055::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:31,056::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:31,056::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:31,056::__init__::232::IOProcess::(_processLogs) (465554) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:31,056::__init__::232::IOProcess::(_processLogs) (465554) Queuing response Thread-21::DEBUG::2015-01-22 11:20:31,057::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:31,057::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:31,057::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:31,057::__init__::232::IOProcess::(_processLogs) (465555) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:31,058::__init__::232::IOProcess::(_processLogs) (465555) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:32,761::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:32,762::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404677::DEBUG::2015-01-22 11:20:32,765::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:32,766::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:32,767::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404678::DEBUG::2015-01-22 11:20:32,769::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404678::DEBUG::2015-01-22 11:20:32,770::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:33,300::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:33,301::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:33,309::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:20:33,884::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:33,884::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:33,884::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:33,885::__init__::232::IOProcess::(_processLogs) (465556) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:33,885::__init__::232::IOProcess::(_processLogs) (465556) Queuing response Thread-63::DEBUG::2015-01-22 11:20:33,885::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:20:33,893::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000353936 s, 910 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:33,894::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:33,895::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:33,895::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:33,895::__init__::232::IOProcess::(_processLogs) (465557) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:33,895::__init__::232::IOProcess::(_processLogs) (465557) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:35,798::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:35,799::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404679::DEBUG::2015-01-22 11:20:35,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cb7bc19-0413-436a-937b-f91620b07c40`::moving from state init -> state preparing Thread-404679::INFO::2015-01-22 11:20:35,802::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404679::INFO::2015-01-22 11:20:35,802::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000353936', 'lastCheck': '1.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580494', 'lastCheck': '4.7', 'valid': True}} Thread-404679::DEBUG::2015-01-22 11:20:35,803::task::1191::Storage.TaskManager.Task::(prepare) Task=`1cb7bc19-0413-436a-937b-f91620b07c40`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000353936', 'lastCheck': '1.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580494', 'lastCheck': '4.7', 'valid': True}} Thread-404679::DEBUG::2015-01-22 11:20:35,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cb7bc19-0413-436a-937b-f91620b07c40`::moving from state preparing -> state finished Thread-404679::DEBUG::2015-01-22 11:20:35,803::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404679::DEBUG::2015-01-22 11:20:35,803::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404679::DEBUG::2015-01-22 11:20:35,803::task::993::Storage.TaskManager.Task::(_decref) Task=`1cb7bc19-0413-436a-937b-f91620b07c40`::ref 0 aborting False Thread-404679::ERROR::2015-01-22 11:20:35,804::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404679::DEBUG::2015-01-22 11:20:35,806::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:35,815::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:35,816::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404680::DEBUG::2015-01-22 11:20:35,818::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404680::DEBUG::2015-01-22 11:20:35,819::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:38,315::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:38,316::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:38,326::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:20:38,812::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:38,868::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:38,869::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404681::DEBUG::2015-01-22 11:20:38,871::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:38,873::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:38,874::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404682::DEBUG::2015-01-22 11:20:38,876::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404682::DEBUG::2015-01-22 11:20:38,877::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:20:41,059::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:41,060::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:41,060::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:41,060::__init__::232::IOProcess::(_processLogs) (465558) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:41,061::__init__::232::IOProcess::(_processLogs) (465558) Queuing response Thread-64::DEBUG::2015-01-22 11:20:41,062::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:20:41,071::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000526345 s, 882 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:41,071::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:41,072::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:41,072::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:41,072::__init__::232::IOProcess::(_processLogs) (465559) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:41,072::__init__::232::IOProcess::(_processLogs) (465559) Queuing response Thread-21::DEBUG::2015-01-22 11:20:41,073::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:41,073::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:41,073::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:41,073::__init__::232::IOProcess::(_processLogs) (465560) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:41,074::__init__::232::IOProcess::(_processLogs) (465560) Queuing response Thread-21::DEBUG::2015-01-22 11:20:41,074::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:41,074::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:41,075::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:41,075::__init__::232::IOProcess::(_processLogs) (465561) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:41,075::__init__::232::IOProcess::(_processLogs) (465561) Queuing response Thread-21::DEBUG::2015-01-22 11:20:41,075::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:41,076::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:41,076::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:41,076::__init__::232::IOProcess::(_processLogs) (465562) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:41,076::__init__::232::IOProcess::(_processLogs) (465562) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:41,905::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:41,907::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404683::DEBUG::2015-01-22 11:20:41,909::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:41,910::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:41,912::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404684::DEBUG::2015-01-22 11:20:41,914::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404684::DEBUG::2015-01-22 11:20:41,915::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:43,332::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:43,332::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:43,341::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:20:43,896::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:43,897::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:43,897::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:43,897::__init__::232::IOProcess::(_processLogs) (465563) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:43,897::__init__::232::IOProcess::(_processLogs) (465563) Queuing response Thread-63::DEBUG::2015-01-22 11:20:43,898::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:20:43,908::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000333571 s, 965 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:43,909::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:43,909::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:43,909::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:43,909::__init__::232::IOProcess::(_processLogs) (465564) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:43,909::__init__::232::IOProcess::(_processLogs) (465564) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:44,943::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:44,944::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404685::DEBUG::2015-01-22 11:20:44,946::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:44,947::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:44,948::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404686::DEBUG::2015-01-22 11:20:44,950::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404686::DEBUG::2015-01-22 11:20:44,951::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:47,980::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:47,983::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404687::DEBUG::2015-01-22 11:20:47,988::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:47,990::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:47,993::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404688::DEBUG::2015-01-22 11:20:47,995::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404688::DEBUG::2015-01-22 11:20:48,002::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:48,347::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:48,347::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:48,355::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:51,032::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:51,033::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404689::DEBUG::2015-01-22 11:20:51,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`71031b45-3f11-4476-be9b-f532386d0295`::moving from state init -> state preparing Thread-404689::INFO::2015-01-22 11:20:51,035::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404689::INFO::2015-01-22 11:20:51,036::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000333571', 'lastCheck': '7.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526345', 'lastCheck': '10.0', 'valid': True}} Thread-404689::DEBUG::2015-01-22 11:20:51,036::task::1191::Storage.TaskManager.Task::(prepare) Task=`71031b45-3f11-4476-be9b-f532386d0295`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000333571', 'lastCheck': '7.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526345', 'lastCheck': '10.0', 'valid': True}} Thread-404689::DEBUG::2015-01-22 11:20:51,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`71031b45-3f11-4476-be9b-f532386d0295`::moving from state preparing -> state finished Thread-404689::DEBUG::2015-01-22 11:20:51,036::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404689::DEBUG::2015-01-22 11:20:51,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404689::DEBUG::2015-01-22 11:20:51,036::task::993::Storage.TaskManager.Task::(_decref) Task=`71031b45-3f11-4476-be9b-f532386d0295`::ref 0 aborting False Thread-404689::ERROR::2015-01-22 11:20:51,037::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404689::DEBUG::2015-01-22 11:20:51,040::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:51,048::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:51,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404690::DEBUG::2015-01-22 11:20:51,051::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404690::DEBUG::2015-01-22 11:20:51,052::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:20:51,077::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:51,078::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:51,078::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:51,078::__init__::232::IOProcess::(_processLogs) (465565) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:51,079::__init__::232::IOProcess::(_processLogs) (465565) Queuing response Thread-64::DEBUG::2015-01-22 11:20:51,080::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:20:51,088::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000460356 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:51,089::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:51,089::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:51,089::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:51,090::__init__::232::IOProcess::(_processLogs) (465566) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:51,090::__init__::232::IOProcess::(_processLogs) (465566) Queuing response Thread-21::DEBUG::2015-01-22 11:20:51,091::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:51,091::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:51,091::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:51,091::__init__::232::IOProcess::(_processLogs) (465567) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:51,092::__init__::232::IOProcess::(_processLogs) (465567) Queuing response Thread-21::DEBUG::2015-01-22 11:20:51,092::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:51,093::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:51,093::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:51,093::__init__::232::IOProcess::(_processLogs) (465568) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:51,093::__init__::232::IOProcess::(_processLogs) (465568) Queuing response Thread-21::DEBUG::2015-01-22 11:20:51,094::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:51,094::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:51,094::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:51,094::__init__::232::IOProcess::(_processLogs) (465569) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:20:51,094::__init__::232::IOProcess::(_processLogs) (465569) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:53,361::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:53,361::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:53,369::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:20:53,912::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:53,912::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:53,912::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:53,912::__init__::232::IOProcess::(_processLogs) (465570) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:53,912::__init__::232::IOProcess::(_processLogs) (465570) Queuing response Thread-63::DEBUG::2015-01-22 11:20:53,913::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:20:53,921::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000255817 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:20:53,922::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:53,922::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:53,922::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:53,922::__init__::232::IOProcess::(_processLogs) (465571) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:20:53,922::__init__::232::IOProcess::(_processLogs) (465571) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:54,102::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:54,103::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404691::DEBUG::2015-01-22 11:20:54,106::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:54,107::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:54,108::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404692::DEBUG::2015-01-22 11:20:54,110::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404692::DEBUG::2015-01-22 11:20:54,111::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:57,141::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:57,142::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404693::DEBUG::2015-01-22 11:20:57,145::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:20:57,146::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:20:57,147::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404694::DEBUG::2015-01-22 11:20:57,149::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404694::DEBUG::2015-01-22 11:20:57,151::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:20:58,375::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:58,376::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:20:58,383::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:20:59,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`1580c3ac-6ea5-46e0-bbba-350c30fd927b`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:20:59,281::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:20:59,282::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:59,282::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:59,282::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:59,282::__init__::232::IOProcess::(_processLogs) (465572) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:20:59,284::__init__::232::IOProcess::(_processLogs) (465572) Queuing response Thread-21::DEBUG::2015-01-22 11:20:59,285::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:20:59,286::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:20:59,286::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:20:59,286::__init__::232::IOProcess::(_processLogs) (465573) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:20:59,286::__init__::232::IOProcess::(_processLogs) (465573) Queuing response Thread-360::INFO::2015-01-22 11:20:59,286::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:20:59,287::task::1191::Storage.TaskManager.Task::(prepare) Task=`1580c3ac-6ea5-46e0-bbba-350c30fd927b`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:20:59,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`1580c3ac-6ea5-46e0-bbba-350c30fd927b`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:20:59,287::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:20:59,287::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:20:59,287::task::993::Storage.TaskManager.Task::(_decref) Task=`1580c3ac-6ea5-46e0-bbba-350c30fd927b`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:00,178::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:00,179::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404695::DEBUG::2015-01-22 11:21:00,180::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:00,181::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:00,183::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404696::DEBUG::2015-01-22 11:21:00,184::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404696::DEBUG::2015-01-22 11:21:00,185::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:21:01,096::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:01,096::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:01,096::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:01,096::__init__::232::IOProcess::(_processLogs) (465574) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:01,098::__init__::232::IOProcess::(_processLogs) (465574) Queuing response Thread-64::DEBUG::2015-01-22 11:21:01,098::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:21:01,108::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000495814 s, 936 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:01,108::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:01,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:01,109::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:01,109::__init__::232::IOProcess::(_processLogs) (465575) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:01,109::__init__::232::IOProcess::(_processLogs) (465575) Queuing response Thread-21::DEBUG::2015-01-22 11:21:01,110::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:01,110::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:01,110::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:01,111::__init__::232::IOProcess::(_processLogs) (465576) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:01,112::__init__::232::IOProcess::(_processLogs) (465576) Queuing response Thread-21::DEBUG::2015-01-22 11:21:01,113::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:01,113::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:01,113::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:01,113::__init__::232::IOProcess::(_processLogs) (465577) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:01,113::__init__::232::IOProcess::(_processLogs) (465577) Queuing response Thread-21::DEBUG::2015-01-22 11:21:01,114::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:01,114::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:01,114::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:01,114::__init__::232::IOProcess::(_processLogs) (465578) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:01,115::__init__::232::IOProcess::(_processLogs) (465578) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:03,210::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:03,212::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404697::DEBUG::2015-01-22 11:21:03,213::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:03,215::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:03,216::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404698::DEBUG::2015-01-22 11:21:03,218::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404698::DEBUG::2015-01-22 11:21:03,219::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:03,389::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:03,390::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:03,397::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:21:03,924::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:03,924::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:03,924::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:03,925::__init__::232::IOProcess::(_processLogs) (465579) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:03,925::__init__::232::IOProcess::(_processLogs) (465579) Queuing response Thread-63::DEBUG::2015-01-22 11:21:03,925::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:21:03,935::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000313845 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:03,936::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:03,936::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:03,936::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:03,936::__init__::232::IOProcess::(_processLogs) (465580) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:03,936::__init__::232::IOProcess::(_processLogs) (465580) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:06,248::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:06,249::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404699::DEBUG::2015-01-22 11:21:06,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`981d33b2-c631-4e0e-ad2b-47b7774cc993`::moving from state init -> state preparing Thread-404699::INFO::2015-01-22 11:21:06,252::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404699::INFO::2015-01-22 11:21:06,253::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000313845', 'lastCheck': '2.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495814', 'lastCheck': '5.1', 'valid': True}} Thread-404699::DEBUG::2015-01-22 11:21:06,253::task::1191::Storage.TaskManager.Task::(prepare) Task=`981d33b2-c631-4e0e-ad2b-47b7774cc993`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000313845', 'lastCheck': '2.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495814', 'lastCheck': '5.1', 'valid': True}} Thread-404699::DEBUG::2015-01-22 11:21:06,253::task::595::Storage.TaskManager.Task::(_updateState) Task=`981d33b2-c631-4e0e-ad2b-47b7774cc993`::moving from state preparing -> state finished Thread-404699::DEBUG::2015-01-22 11:21:06,253::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404699::DEBUG::2015-01-22 11:21:06,253::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404699::DEBUG::2015-01-22 11:21:06,253::task::993::Storage.TaskManager.Task::(_decref) Task=`981d33b2-c631-4e0e-ad2b-47b7774cc993`::ref 0 aborting False Thread-404699::ERROR::2015-01-22 11:21:06,254::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404699::DEBUG::2015-01-22 11:21:06,257::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:06,264::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:06,265::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404700::DEBUG::2015-01-22 11:21:06,267::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404700::DEBUG::2015-01-22 11:21:06,267::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:08,403::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:08,404::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:08,411::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:21:08,846::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:09,326::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:09,327::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404701::DEBUG::2015-01-22 11:21:09,330::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:09,331::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:09,332::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404702::DEBUG::2015-01-22 11:21:09,334::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404702::DEBUG::2015-01-22 11:21:09,335::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:21:11,116::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:11,116::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:11,117::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:11,117::__init__::232::IOProcess::(_processLogs) (465581) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:11,118::__init__::232::IOProcess::(_processLogs) (465581) Queuing response Thread-64::DEBUG::2015-01-22 11:21:11,119::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:21:11,127::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00046516 s, 998 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:11,128::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:11,128::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:11,128::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:11,128::__init__::232::IOProcess::(_processLogs) (465582) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:11,129::__init__::232::IOProcess::(_processLogs) (465582) Queuing response Thread-21::DEBUG::2015-01-22 11:21:11,130::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:11,130::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:11,130::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:11,130::__init__::232::IOProcess::(_processLogs) (465583) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:11,130::__init__::232::IOProcess::(_processLogs) (465583) Queuing response Thread-21::DEBUG::2015-01-22 11:21:11,131::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:11,131::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:11,131::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:11,131::__init__::232::IOProcess::(_processLogs) (465584) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:11,132::__init__::232::IOProcess::(_processLogs) (465584) Queuing response Thread-21::DEBUG::2015-01-22 11:21:11,133::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:11,134::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:11,134::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:11,134::__init__::232::IOProcess::(_processLogs) (465585) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:11,134::__init__::232::IOProcess::(_processLogs) (465585) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:12,361::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:12,363::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404703::DEBUG::2015-01-22 11:21:12,365::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:12,366::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:12,367::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404704::DEBUG::2015-01-22 11:21:12,369::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404704::DEBUG::2015-01-22 11:21:12,370::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:13,417::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:13,418::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:13,425::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:21:13,938::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:13,938::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:13,939::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:13,939::__init__::232::IOProcess::(_processLogs) (465586) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:13,939::__init__::232::IOProcess::(_processLogs) (465586) Queuing response Thread-63::DEBUG::2015-01-22 11:21:13,940::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:21:13,948::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000255808 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:13,949::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:13,949::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:13,949::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:13,949::__init__::232::IOProcess::(_processLogs) (465587) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:13,949::__init__::232::IOProcess::(_processLogs) (465587) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:15,398::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:15,399::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404705::DEBUG::2015-01-22 11:21:15,401::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:15,403::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:15,404::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404706::DEBUG::2015-01-22 11:21:15,405::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404706::DEBUG::2015-01-22 11:21:15,406::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:18,431::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:18,432::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:18,434::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:18,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request GuestMonitor-Sql::DEBUG::2015-01-22 11:21:18,444::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404707::DEBUG::2015-01-22 11:21:18,447::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:18,448::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:18,449::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404708::DEBUG::2015-01-22 11:21:18,451::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404708::DEBUG::2015-01-22 11:21:18,451::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:21:21,135::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:21,136::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:21,136::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:21,136::__init__::232::IOProcess::(_processLogs) (465588) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:21,137::__init__::232::IOProcess::(_processLogs) (465588) Queuing response Thread-64::DEBUG::2015-01-22 11:21:21,138::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:21:21,147::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000555054 s, 836 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:21,147::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:21,147::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:21,148::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:21,148::__init__::232::IOProcess::(_processLogs) (465589) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:21,148::__init__::232::IOProcess::(_processLogs) (465589) Queuing response Thread-21::DEBUG::2015-01-22 11:21:21,149::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:21,149::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:21,149::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:21,149::__init__::232::IOProcess::(_processLogs) (465590) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:21,150::__init__::232::IOProcess::(_processLogs) (465590) Queuing response Thread-21::DEBUG::2015-01-22 11:21:21,151::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:21,151::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:21,151::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:21,151::__init__::232::IOProcess::(_processLogs) (465591) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:21,152::__init__::232::IOProcess::(_processLogs) (465591) Queuing response Thread-21::DEBUG::2015-01-22 11:21:21,152::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:21,152::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:21,152::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:21,153::__init__::232::IOProcess::(_processLogs) (465592) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:21,153::__init__::232::IOProcess::(_processLogs) (465592) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:21,484::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:21,485::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404709::DEBUG::2015-01-22 11:21:21,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`75f95813-aa34-46f2-8d57-20f6f5e32768`::moving from state init -> state preparing Thread-404709::INFO::2015-01-22 11:21:21,488::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404709::INFO::2015-01-22 11:21:21,489::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255808', 'lastCheck': '7.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555054', 'lastCheck': '0.3', 'valid': True}} Thread-404709::DEBUG::2015-01-22 11:21:21,489::task::1191::Storage.TaskManager.Task::(prepare) Task=`75f95813-aa34-46f2-8d57-20f6f5e32768`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255808', 'lastCheck': '7.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555054', 'lastCheck': '0.3', 'valid': True}} Thread-404709::DEBUG::2015-01-22 11:21:21,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`75f95813-aa34-46f2-8d57-20f6f5e32768`::moving from state preparing -> state finished Thread-404709::DEBUG::2015-01-22 11:21:21,489::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404709::DEBUG::2015-01-22 11:21:21,489::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404709::DEBUG::2015-01-22 11:21:21,489::task::993::Storage.TaskManager.Task::(_decref) Task=`75f95813-aa34-46f2-8d57-20f6f5e32768`::ref 0 aborting False Thread-404709::ERROR::2015-01-22 11:21:21,490::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404709::DEBUG::2015-01-22 11:21:21,493::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:21,500::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:21,501::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404710::DEBUG::2015-01-22 11:21:21,503::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404710::DEBUG::2015-01-22 11:21:21,504::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:23,453::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:23,453::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:23,461::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:21:23,951::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:23,952::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:23,952::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:23,952::__init__::232::IOProcess::(_processLogs) (465593) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:23,952::__init__::232::IOProcess::(_processLogs) (465593) Queuing response Thread-63::DEBUG::2015-01-22 11:21:23,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:21:23,961::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000279779 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:23,962::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:23,962::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:23,962::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:23,962::__init__::232::IOProcess::(_processLogs) (465594) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:23,962::__init__::232::IOProcess::(_processLogs) (465594) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:24,566::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:24,567::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404711::DEBUG::2015-01-22 11:21:24,570::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:24,571::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:24,573::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404712::DEBUG::2015-01-22 11:21:24,574::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404712::DEBUG::2015-01-22 11:21:24,575::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:27,607::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:27,608::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404713::DEBUG::2015-01-22 11:21:27,611::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:27,612::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:27,613::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404714::DEBUG::2015-01-22 11:21:27,615::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404714::DEBUG::2015-01-22 11:21:27,615::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:28,466::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:28,467::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:28,476::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:30,642::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:30,643::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404715::DEBUG::2015-01-22 11:21:30,645::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:30,646::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:30,647::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404716::DEBUG::2015-01-22 11:21:30,649::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404716::DEBUG::2015-01-22 11:21:30,649::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:21:31,155::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:31,155::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:31,155::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:31,155::__init__::232::IOProcess::(_processLogs) (465595) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:31,157::__init__::232::IOProcess::(_processLogs) (465595) Queuing response Thread-64::DEBUG::2015-01-22 11:21:31,157::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:21:31,166::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000547645 s, 847 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:31,167::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:31,167::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:31,167::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:31,167::__init__::232::IOProcess::(_processLogs) (465596) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:31,168::__init__::232::IOProcess::(_processLogs) (465596) Queuing response Thread-21::DEBUG::2015-01-22 11:21:31,169::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:31,169::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:31,169::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:31,169::__init__::232::IOProcess::(_processLogs) (465597) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:31,169::__init__::232::IOProcess::(_processLogs) (465597) Queuing response Thread-21::DEBUG::2015-01-22 11:21:31,170::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:31,170::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:31,170::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:31,170::__init__::232::IOProcess::(_processLogs) (465598) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:31,171::__init__::232::IOProcess::(_processLogs) (465598) Queuing response Thread-21::DEBUG::2015-01-22 11:21:31,171::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:31,171::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:31,171::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:31,172::__init__::232::IOProcess::(_processLogs) (465599) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:31,172::__init__::232::IOProcess::(_processLogs) (465599) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:33,482::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:33,482::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:33,493::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:33,679::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:33,680::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404717::DEBUG::2015-01-22 11:21:33,682::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:33,684::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:33,685::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404718::DEBUG::2015-01-22 11:21:33,686::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404718::DEBUG::2015-01-22 11:21:33,687::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:21:33,964::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:33,964::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:33,965::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:33,965::__init__::232::IOProcess::(_processLogs) (465600) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:33,965::__init__::232::IOProcess::(_processLogs) (465600) Queuing response Thread-63::DEBUG::2015-01-22 11:21:33,965::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:21:33,973::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000318171 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:33,974::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:33,975::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:33,975::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:33,975::__init__::232::IOProcess::(_processLogs) (465601) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:33,975::__init__::232::IOProcess::(_processLogs) (465601) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:36,715::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:36,716::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404719::DEBUG::2015-01-22 11:21:36,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd6aa6a5-d2f4-4af7-8e4a-ff2ddda96371`::moving from state init -> state preparing Thread-404719::INFO::2015-01-22 11:21:36,719::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404719::INFO::2015-01-22 11:21:36,720::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000318171', 'lastCheck': '2.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547645', 'lastCheck': '5.5', 'valid': True}} Thread-404719::DEBUG::2015-01-22 11:21:36,720::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd6aa6a5-d2f4-4af7-8e4a-ff2ddda96371`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000318171', 'lastCheck': '2.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547645', 'lastCheck': '5.5', 'valid': True}} Thread-404719::DEBUG::2015-01-22 11:21:36,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd6aa6a5-d2f4-4af7-8e4a-ff2ddda96371`::moving from state preparing -> state finished Thread-404719::DEBUG::2015-01-22 11:21:36,720::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404719::DEBUG::2015-01-22 11:21:36,720::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404719::DEBUG::2015-01-22 11:21:36,720::task::993::Storage.TaskManager.Task::(_decref) Task=`dd6aa6a5-d2f4-4af7-8e4a-ff2ddda96371`::ref 0 aborting False Thread-404719::ERROR::2015-01-22 11:21:36,721::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404719::DEBUG::2015-01-22 11:21:36,723::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:36,732::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:36,733::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404720::DEBUG::2015-01-22 11:21:36,734::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404720::DEBUG::2015-01-22 11:21:36,735::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:38,499::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:38,500::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:38,508::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:21:38,881::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:39,792::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:39,793::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404721::DEBUG::2015-01-22 11:21:39,795::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:39,796::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:39,797::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404722::DEBUG::2015-01-22 11:21:39,799::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404722::DEBUG::2015-01-22 11:21:39,800::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:21:41,173::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:41,174::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:41,174::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:41,174::__init__::232::IOProcess::(_processLogs) (465602) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:41,176::__init__::232::IOProcess::(_processLogs) (465602) Queuing response Thread-64::DEBUG::2015-01-22 11:21:41,176::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:21:41,185::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000555977 s, 835 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:41,186::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:41,186::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:41,186::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:41,187::__init__::232::IOProcess::(_processLogs) (465603) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:41,187::__init__::232::IOProcess::(_processLogs) (465603) Queuing response Thread-21::DEBUG::2015-01-22 11:21:41,188::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:41,188::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:41,188::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:41,188::__init__::232::IOProcess::(_processLogs) (465604) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:41,189::__init__::232::IOProcess::(_processLogs) (465604) Queuing response Thread-21::DEBUG::2015-01-22 11:21:41,189::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:41,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:41,190::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:41,190::__init__::232::IOProcess::(_processLogs) (465605) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:41,190::__init__::232::IOProcess::(_processLogs) (465605) Queuing response Thread-21::DEBUG::2015-01-22 11:21:41,191::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:41,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:41,192::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:41,192::__init__::232::IOProcess::(_processLogs) (465606) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:41,192::__init__::232::IOProcess::(_processLogs) (465606) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:42,831::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:42,833::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404723::DEBUG::2015-01-22 11:21:42,836::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:42,837::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:42,838::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404724::DEBUG::2015-01-22 11:21:42,840::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404724::DEBUG::2015-01-22 11:21:42,841::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:43,514::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:43,514::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:43,522::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:21:43,976::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:43,977::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:43,977::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:43,977::__init__::232::IOProcess::(_processLogs) (465607) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:43,977::__init__::232::IOProcess::(_processLogs) (465607) Queuing response Thread-63::DEBUG::2015-01-22 11:21:43,978::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:21:43,986::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000370863 s, 868 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:43,987::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:43,987::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:43,988::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:43,988::__init__::232::IOProcess::(_processLogs) (465608) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:43,988::__init__::232::IOProcess::(_processLogs) (465608) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:45,870::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:45,871::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404725::DEBUG::2015-01-22 11:21:45,873::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:45,874::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:45,875::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404726::DEBUG::2015-01-22 11:21:45,877::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404726::DEBUG::2015-01-22 11:21:45,878::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:48,528::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:48,529::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:48,535::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:48,905::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:48,906::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404727::DEBUG::2015-01-22 11:21:48,908::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:48,910::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:48,911::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404728::DEBUG::2015-01-22 11:21:48,913::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404728::DEBUG::2015-01-22 11:21:48,915::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:21:51,196::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:51,196::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:51,196::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:51,196::__init__::232::IOProcess::(_processLogs) (465609) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:51,198::__init__::232::IOProcess::(_processLogs) (465609) Queuing response Thread-64::DEBUG::2015-01-22 11:21:51,199::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:21:51,208::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000494555 s, 938 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:51,209::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:51,209::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:51,209::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:51,209::__init__::232::IOProcess::(_processLogs) (465610) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:51,209::__init__::232::IOProcess::(_processLogs) (465610) Queuing response Thread-21::DEBUG::2015-01-22 11:21:51,210::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:51,210::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:51,210::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:51,211::__init__::232::IOProcess::(_processLogs) (465611) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:51,211::__init__::232::IOProcess::(_processLogs) (465611) Queuing response Thread-21::DEBUG::2015-01-22 11:21:51,211::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:51,212::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:51,212::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:51,212::__init__::232::IOProcess::(_processLogs) (465612) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:51,212::__init__::232::IOProcess::(_processLogs) (465612) Queuing response Thread-21::DEBUG::2015-01-22 11:21:51,213::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:51,213::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:51,213::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:51,213::__init__::232::IOProcess::(_processLogs) (465613) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:21:51,213::__init__::232::IOProcess::(_processLogs) (465613) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:51,944::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:51,946::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404729::DEBUG::2015-01-22 11:21:51,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a755954-e46e-4d52-a727-51021dda89e3`::moving from state init -> state preparing Thread-404729::INFO::2015-01-22 11:21:51,949::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404729::INFO::2015-01-22 11:21:51,949::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000370863', 'lastCheck': '8.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494555', 'lastCheck': '0.7', 'valid': True}} Thread-404729::DEBUG::2015-01-22 11:21:51,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`7a755954-e46e-4d52-a727-51021dda89e3`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000370863', 'lastCheck': '8.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494555', 'lastCheck': '0.7', 'valid': True}} Thread-404729::DEBUG::2015-01-22 11:21:51,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a755954-e46e-4d52-a727-51021dda89e3`::moving from state preparing -> state finished Thread-404729::DEBUG::2015-01-22 11:21:51,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404729::DEBUG::2015-01-22 11:21:51,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404729::DEBUG::2015-01-22 11:21:51,950::task::993::Storage.TaskManager.Task::(_decref) Task=`7a755954-e46e-4d52-a727-51021dda89e3`::ref 0 aborting False Thread-404729::ERROR::2015-01-22 11:21:51,951::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404729::DEBUG::2015-01-22 11:21:51,953::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:51,962::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:51,963::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404730::DEBUG::2015-01-22 11:21:51,965::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404730::DEBUG::2015-01-22 11:21:51,966::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:53,541::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:53,542::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:53,553::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:21:53,990::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:53,990::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:53,990::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:53,990::__init__::232::IOProcess::(_processLogs) (465614) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:53,990::__init__::232::IOProcess::(_processLogs) (465614) Queuing response Thread-63::DEBUG::2015-01-22 11:21:53,991::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:21:53,999::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000298964 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:21:54,000::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:54,000::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:54,000::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:54,001::__init__::232::IOProcess::(_processLogs) (465615) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:21:54,001::__init__::232::IOProcess::(_processLogs) (465615) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:55,022::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:55,023::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404731::DEBUG::2015-01-22 11:21:55,026::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:55,027::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:55,028::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404732::DEBUG::2015-01-22 11:21:55,030::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404732::DEBUG::2015-01-22 11:21:55,031::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:58,060::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:58,061::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404733::DEBUG::2015-01-22 11:21:58,064::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:21:58,065::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:21:58,066::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404734::DEBUG::2015-01-22 11:21:58,068::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404734::DEBUG::2015-01-22 11:21:58,069::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:21:58,559::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:58,559::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:21:58,568::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:21:59,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`f811596a-c9b2-405d-bae3-4abe0b11d506`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:21:59,364::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:21:59,365::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:59,365::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:59,365::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:59,365::__init__::232::IOProcess::(_processLogs) (465616) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:21:59,368::__init__::232::IOProcess::(_processLogs) (465616) Queuing response Thread-21::DEBUG::2015-01-22 11:21:59,369::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:21:59,369::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:21:59,369::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:21:59,369::__init__::232::IOProcess::(_processLogs) (465617) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:21:59,369::__init__::232::IOProcess::(_processLogs) (465617) Queuing response Thread-360::INFO::2015-01-22 11:21:59,370::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:21:59,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`f811596a-c9b2-405d-bae3-4abe0b11d506`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:21:59,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`f811596a-c9b2-405d-bae3-4abe0b11d506`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:21:59,371::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:21:59,371::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:21:59,371::task::993::Storage.TaskManager.Task::(_decref) Task=`f811596a-c9b2-405d-bae3-4abe0b11d506`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:01,098::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:01,099::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404735::DEBUG::2015-01-22 11:22:01,101::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:01,102::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:01,103::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404736::DEBUG::2015-01-22 11:22:01,104::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404736::DEBUG::2015-01-22 11:22:01,105::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:22:01,215::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:01,215::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:01,215::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:01,215::__init__::232::IOProcess::(_processLogs) (465618) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:01,216::__init__::232::IOProcess::(_processLogs) (465618) Queuing response Thread-64::DEBUG::2015-01-22 11:22:01,217::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:22:01,226::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000491337 s, 944 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:01,227::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:01,227::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:01,227::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:01,227::__init__::232::IOProcess::(_processLogs) (465619) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:01,227::__init__::232::IOProcess::(_processLogs) (465619) Queuing response Thread-21::DEBUG::2015-01-22 11:22:01,228::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:01,228::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:01,228::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:01,228::__init__::232::IOProcess::(_processLogs) (465620) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:01,229::__init__::232::IOProcess::(_processLogs) (465620) Queuing response Thread-21::DEBUG::2015-01-22 11:22:01,229::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:01,229::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:01,230::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:01,230::__init__::232::IOProcess::(_processLogs) (465621) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:01,230::__init__::232::IOProcess::(_processLogs) (465621) Queuing response Thread-21::DEBUG::2015-01-22 11:22:01,231::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:01,231::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:01,231::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:01,231::__init__::232::IOProcess::(_processLogs) (465622) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:01,231::__init__::232::IOProcess::(_processLogs) (465622) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:03,574::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:03,575::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:03,586::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:22:04,002::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:04,003::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:04,003::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:04,003::__init__::232::IOProcess::(_processLogs) (465623) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:04,003::__init__::232::IOProcess::(_processLogs) (465623) Queuing response Thread-63::DEBUG::2015-01-22 11:22:04,004::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:22:04,012::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000339122 s, 950 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:04,013::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:04,013::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:04,014::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:04,014::__init__::232::IOProcess::(_processLogs) (465624) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:04,014::__init__::232::IOProcess::(_processLogs) (465624) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:04,136::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:04,137::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404737::DEBUG::2015-01-22 11:22:04,140::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:04,141::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:04,142::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404738::DEBUG::2015-01-22 11:22:04,144::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404738::DEBUG::2015-01-22 11:22:04,145::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:07,171::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:07,172::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404739::DEBUG::2015-01-22 11:22:07,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`e835162a-944f-414c-9f09-dc2e28c3f29f`::moving from state init -> state preparing Thread-404739::INFO::2015-01-22 11:22:07,175::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404739::INFO::2015-01-22 11:22:07,175::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000339122', 'lastCheck': '3.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491337', 'lastCheck': '5.9', 'valid': True}} Thread-404739::DEBUG::2015-01-22 11:22:07,175::task::1191::Storage.TaskManager.Task::(prepare) Task=`e835162a-944f-414c-9f09-dc2e28c3f29f`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000339122', 'lastCheck': '3.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491337', 'lastCheck': '5.9', 'valid': True}} Thread-404739::DEBUG::2015-01-22 11:22:07,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`e835162a-944f-414c-9f09-dc2e28c3f29f`::moving from state preparing -> state finished Thread-404739::DEBUG::2015-01-22 11:22:07,176::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404739::DEBUG::2015-01-22 11:22:07,176::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404739::DEBUG::2015-01-22 11:22:07,176::task::993::Storage.TaskManager.Task::(_decref) Task=`e835162a-944f-414c-9f09-dc2e28c3f29f`::ref 0 aborting False Thread-404739::ERROR::2015-01-22 11:22:07,177::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404739::DEBUG::2015-01-22 11:22:07,179::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:07,188::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:07,189::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404740::DEBUG::2015-01-22 11:22:07,190::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404740::DEBUG::2015-01-22 11:22:07,191::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:08,592::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:08,593::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:08,604::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:22:08,916::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:10,250::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:10,251::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404741::DEBUG::2015-01-22 11:22:10,253::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:10,254::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:10,255::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404742::DEBUG::2015-01-22 11:22:10,257::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404742::DEBUG::2015-01-22 11:22:10,258::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:22:11,233::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:11,233::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:11,233::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:11,233::__init__::232::IOProcess::(_processLogs) (465625) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:11,235::__init__::232::IOProcess::(_processLogs) (465625) Queuing response Thread-64::DEBUG::2015-01-22 11:22:11,236::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:22:11,244::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000517385 s, 897 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:11,245::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:11,245::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:11,245::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:11,245::__init__::232::IOProcess::(_processLogs) (465626) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:11,245::__init__::232::IOProcess::(_processLogs) (465626) Queuing response Thread-21::DEBUG::2015-01-22 11:22:11,246::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:11,246::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:11,247::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:11,247::__init__::232::IOProcess::(_processLogs) (465627) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:11,247::__init__::232::IOProcess::(_processLogs) (465627) Queuing response Thread-21::DEBUG::2015-01-22 11:22:11,247::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:11,248::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:11,248::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:11,248::__init__::232::IOProcess::(_processLogs) (465628) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:11,248::__init__::232::IOProcess::(_processLogs) (465628) Queuing response Thread-21::DEBUG::2015-01-22 11:22:11,249::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:11,249::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:11,249::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:11,249::__init__::232::IOProcess::(_processLogs) (465629) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:11,249::__init__::232::IOProcess::(_processLogs) (465629) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:13,289::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:13,292::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404743::DEBUG::2015-01-22 11:22:13,297::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:13,300::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:13,303::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404744::DEBUG::2015-01-22 11:22:13,308::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404744::DEBUG::2015-01-22 11:22:13,313::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:13,610::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:13,611::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:13,618::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:22:14,016::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:14,016::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:14,016::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:14,016::__init__::232::IOProcess::(_processLogs) (465630) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:14,016::__init__::232::IOProcess::(_processLogs) (465630) Queuing response Thread-63::DEBUG::2015-01-22 11:22:14,017::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:22:14,025::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000259026 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:14,026::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:14,026::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:14,026::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:14,027::__init__::232::IOProcess::(_processLogs) (465631) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:14,027::__init__::232::IOProcess::(_processLogs) (465631) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:16,345::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:16,346::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404745::DEBUG::2015-01-22 11:22:16,348::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:16,350::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:16,351::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404746::DEBUG::2015-01-22 11:22:16,353::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404746::DEBUG::2015-01-22 11:22:16,354::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:18,625::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:18,626::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:18,632::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:19,381::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:19,382::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404747::DEBUG::2015-01-22 11:22:19,384::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:19,386::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:19,387::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404748::DEBUG::2015-01-22 11:22:19,388::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404748::DEBUG::2015-01-22 11:22:19,389::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:22:21,250::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:21,251::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:21,251::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:21,251::__init__::232::IOProcess::(_processLogs) (465632) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:21,357::__init__::232::IOProcess::(_processLogs) (465632) Queuing response Thread-64::DEBUG::2015-01-22 11:22:21,358::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:22:21,368::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000438132 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:21,370::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:21,371::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:21,372::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:21,372::__init__::232::IOProcess::(_processLogs) (465633) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:21,372::__init__::232::IOProcess::(_processLogs) (465633) Queuing response Thread-21::DEBUG::2015-01-22 11:22:21,375::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:21,376::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:21,377::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:21,377::__init__::232::IOProcess::(_processLogs) (465634) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:21,378::__init__::232::IOProcess::(_processLogs) (465634) Queuing response Thread-21::DEBUG::2015-01-22 11:22:21,380::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:21,381::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:21,381::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:21,382::__init__::232::IOProcess::(_processLogs) (465635) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:21,382::__init__::232::IOProcess::(_processLogs) (465635) Queuing response Thread-21::DEBUG::2015-01-22 11:22:21,384::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:21,385::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:21,385::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:21,386::__init__::232::IOProcess::(_processLogs) (465636) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:21,386::__init__::232::IOProcess::(_processLogs) (465636) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:22,418::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:22,419::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404749::DEBUG::2015-01-22 11:22:22,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`574ddf7e-f903-4d1f-b646-43f80c470a2e`::moving from state init -> state preparing Thread-404749::INFO::2015-01-22 11:22:22,422::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404749::INFO::2015-01-22 11:22:22,422::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259026', 'lastCheck': '8.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438132', 'lastCheck': '1.0', 'valid': True}} Thread-404749::DEBUG::2015-01-22 11:22:22,422::task::1191::Storage.TaskManager.Task::(prepare) Task=`574ddf7e-f903-4d1f-b646-43f80c470a2e`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259026', 'lastCheck': '8.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438132', 'lastCheck': '1.0', 'valid': True}} Thread-404749::DEBUG::2015-01-22 11:22:22,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`574ddf7e-f903-4d1f-b646-43f80c470a2e`::moving from state preparing -> state finished Thread-404749::DEBUG::2015-01-22 11:22:22,423::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404749::DEBUG::2015-01-22 11:22:22,423::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404749::DEBUG::2015-01-22 11:22:22,423::task::993::Storage.TaskManager.Task::(_decref) Task=`574ddf7e-f903-4d1f-b646-43f80c470a2e`::ref 0 aborting False Thread-404749::ERROR::2015-01-22 11:22:22,424::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404749::DEBUG::2015-01-22 11:22:22,426::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:22,433::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:22,435::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404750::DEBUG::2015-01-22 11:22:22,436::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404750::DEBUG::2015-01-22 11:22:22,437::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:23,639::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:23,639::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:23,649::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:22:24,029::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:24,029::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:24,029::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:24,029::__init__::232::IOProcess::(_processLogs) (465637) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:24,029::__init__::232::IOProcess::(_processLogs) (465637) Queuing response Thread-63::DEBUG::2015-01-22 11:22:24,030::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:22:24,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000300381 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:24,039::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:24,040::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:24,040::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:24,040::__init__::232::IOProcess::(_processLogs) (465638) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:24,040::__init__::232::IOProcess::(_processLogs) (465638) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:25,500::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:25,501::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404751::DEBUG::2015-01-22 11:22:25,504::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:25,505::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:25,507::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404752::DEBUG::2015-01-22 11:22:25,508::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404752::DEBUG::2015-01-22 11:22:25,509::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:28,542::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:28,544::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404753::DEBUG::2015-01-22 11:22:28,546::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:28,547::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:28,549::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404754::DEBUG::2015-01-22 11:22:28,551::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404754::DEBUG::2015-01-22 11:22:28,552::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:28,655::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:28,656::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:28,665::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:22:31,387::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:31,388::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:31,388::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:31,388::__init__::232::IOProcess::(_processLogs) (465639) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:31,389::__init__::232::IOProcess::(_processLogs) (465639) Queuing response Thread-64::DEBUG::2015-01-22 11:22:31,390::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:22:31,398::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000479524 s, 968 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:31,399::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:31,399::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:31,400::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:31,400::__init__::232::IOProcess::(_processLogs) (465640) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:31,400::__init__::232::IOProcess::(_processLogs) (465640) Queuing response Thread-21::DEBUG::2015-01-22 11:22:31,401::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:31,401::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:31,401::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:31,401::__init__::232::IOProcess::(_processLogs) (465641) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:31,401::__init__::232::IOProcess::(_processLogs) (465641) Queuing response Thread-21::DEBUG::2015-01-22 11:22:31,402::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:31,402::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:31,402::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:31,402::__init__::232::IOProcess::(_processLogs) (465642) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:31,403::__init__::232::IOProcess::(_processLogs) (465642) Queuing response Thread-21::DEBUG::2015-01-22 11:22:31,403::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:31,403::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:31,404::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:31,404::__init__::232::IOProcess::(_processLogs) (465643) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:31,404::__init__::232::IOProcess::(_processLogs) (465643) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:31,589::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:31,589::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404755::DEBUG::2015-01-22 11:22:31,592::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:31,593::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:31,594::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404756::DEBUG::2015-01-22 11:22:31,596::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404756::DEBUG::2015-01-22 11:22:31,597::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:33,671::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:33,671::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:33,672::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:22:34,042::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:34,042::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:34,042::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:34,042::__init__::232::IOProcess::(_processLogs) (465644) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:34,042::__init__::232::IOProcess::(_processLogs) (465644) Queuing response Thread-63::DEBUG::2015-01-22 11:22:34,043::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:22:34,051::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00025517 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:34,052::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:34,052::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:34,052::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:34,052::__init__::232::IOProcess::(_processLogs) (465645) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:34,053::__init__::232::IOProcess::(_processLogs) (465645) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:34,628::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:34,629::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404757::DEBUG::2015-01-22 11:22:34,631::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:34,633::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:34,634::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404758::DEBUG::2015-01-22 11:22:34,636::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404758::DEBUG::2015-01-22 11:22:34,636::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:37,665::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:37,666::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404759::DEBUG::2015-01-22 11:22:37,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`a822e6c8-33f6-4ea0-af8a-f81ba8d6c9b7`::moving from state init -> state preparing Thread-404759::INFO::2015-01-22 11:22:37,669::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404759::INFO::2015-01-22 11:22:37,669::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025517', 'lastCheck': '3.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479524', 'lastCheck': '6.3', 'valid': True}} Thread-404759::DEBUG::2015-01-22 11:22:37,669::task::1191::Storage.TaskManager.Task::(prepare) Task=`a822e6c8-33f6-4ea0-af8a-f81ba8d6c9b7`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025517', 'lastCheck': '3.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479524', 'lastCheck': '6.3', 'valid': True}} Thread-404759::DEBUG::2015-01-22 11:22:37,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`a822e6c8-33f6-4ea0-af8a-f81ba8d6c9b7`::moving from state preparing -> state finished Thread-404759::DEBUG::2015-01-22 11:22:37,670::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404759::DEBUG::2015-01-22 11:22:37,670::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404759::DEBUG::2015-01-22 11:22:37,670::task::993::Storage.TaskManager.Task::(_decref) Task=`a822e6c8-33f6-4ea0-af8a-f81ba8d6c9b7`::ref 0 aborting False Thread-404759::ERROR::2015-01-22 11:22:37,671::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404759::DEBUG::2015-01-22 11:22:37,673::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:37,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:37,682::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404760::DEBUG::2015-01-22 11:22:37,684::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404760::DEBUG::2015-01-22 11:22:37,685::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:38,678::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:38,679::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:38,685::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:22:38,951::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:40,743::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:40,744::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404761::DEBUG::2015-01-22 11:22:40,747::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:40,748::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:40,749::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404762::DEBUG::2015-01-22 11:22:40,751::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404762::DEBUG::2015-01-22 11:22:40,752::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:22:41,406::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:41,406::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:41,406::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:41,406::__init__::232::IOProcess::(_processLogs) (465646) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:41,408::__init__::232::IOProcess::(_processLogs) (465646) Queuing response Thread-64::DEBUG::2015-01-22 11:22:41,409::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:22:41,418::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000513838 s, 903 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:41,419::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:41,419::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:41,419::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:41,419::__init__::232::IOProcess::(_processLogs) (465647) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:41,420::__init__::232::IOProcess::(_processLogs) (465647) Queuing response Thread-21::DEBUG::2015-01-22 11:22:41,421::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:41,421::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:41,421::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:41,421::__init__::232::IOProcess::(_processLogs) (465648) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:41,421::__init__::232::IOProcess::(_processLogs) (465648) Queuing response Thread-21::DEBUG::2015-01-22 11:22:41,422::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:41,422::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:41,422::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:41,422::__init__::232::IOProcess::(_processLogs) (465649) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:41,422::__init__::232::IOProcess::(_processLogs) (465649) Queuing response Thread-21::DEBUG::2015-01-22 11:22:41,423::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:41,423::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:41,423::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:41,423::__init__::232::IOProcess::(_processLogs) (465650) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:41,423::__init__::232::IOProcess::(_processLogs) (465650) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:43,691::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:43,692::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:43,699::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:43,789::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:43,790::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404763::DEBUG::2015-01-22 11:22:43,793::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:43,794::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:43,795::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404764::DEBUG::2015-01-22 11:22:43,797::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404764::DEBUG::2015-01-22 11:22:43,798::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:22:44,054::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:44,054::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:44,054::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:44,055::__init__::232::IOProcess::(_processLogs) (465651) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:44,055::__init__::232::IOProcess::(_processLogs) (465651) Queuing response Thread-63::DEBUG::2015-01-22 11:22:44,056::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:22:44,064::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000322163 s, 999 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:44,065::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:44,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:44,066::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:44,066::__init__::232::IOProcess::(_processLogs) (465652) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:44,066::__init__::232::IOProcess::(_processLogs) (465652) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:46,827::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:46,828::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404765::DEBUG::2015-01-22 11:22:46,830::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:46,832::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:46,833::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404766::DEBUG::2015-01-22 11:22:46,835::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404766::DEBUG::2015-01-22 11:22:46,836::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:48,705::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:48,706::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:48,712::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:49,866::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:49,867::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404767::DEBUG::2015-01-22 11:22:49,869::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:49,870::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:49,871::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404768::DEBUG::2015-01-22 11:22:49,873::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404768::DEBUG::2015-01-22 11:22:49,873::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:22:51,425::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:51,425::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:51,425::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:51,425::__init__::232::IOProcess::(_processLogs) (465653) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:51,427::__init__::232::IOProcess::(_processLogs) (465653) Queuing response Thread-64::DEBUG::2015-01-22 11:22:51,428::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:22:51,437::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00062992 s, 737 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:51,438::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:51,438::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:51,438::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:51,439::__init__::232::IOProcess::(_processLogs) (465654) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:51,439::__init__::232::IOProcess::(_processLogs) (465654) Queuing response Thread-21::DEBUG::2015-01-22 11:22:51,440::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:51,440::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:51,440::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:51,440::__init__::232::IOProcess::(_processLogs) (465655) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:51,440::__init__::232::IOProcess::(_processLogs) (465655) Queuing response Thread-21::DEBUG::2015-01-22 11:22:51,441::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:51,441::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:51,441::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:51,441::__init__::232::IOProcess::(_processLogs) (465656) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:51,442::__init__::232::IOProcess::(_processLogs) (465656) Queuing response Thread-21::DEBUG::2015-01-22 11:22:51,442::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:51,442::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:51,442::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:51,442::__init__::232::IOProcess::(_processLogs) (465657) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:22:51,443::__init__::232::IOProcess::(_processLogs) (465657) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:52,899::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:52,902::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404769::DEBUG::2015-01-22 11:22:52,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`20c8e2b5-160c-4b44-9737-f216e2a61e07`::moving from state init -> state preparing Thread-404769::INFO::2015-01-22 11:22:52,905::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404769::INFO::2015-01-22 11:22:52,905::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322163', 'lastCheck': '8.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062992', 'lastCheck': '1.5', 'valid': True}} Thread-404769::DEBUG::2015-01-22 11:22:52,905::task::1191::Storage.TaskManager.Task::(prepare) Task=`20c8e2b5-160c-4b44-9737-f216e2a61e07`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322163', 'lastCheck': '8.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062992', 'lastCheck': '1.5', 'valid': True}} Thread-404769::DEBUG::2015-01-22 11:22:52,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`20c8e2b5-160c-4b44-9737-f216e2a61e07`::moving from state preparing -> state finished Thread-404769::DEBUG::2015-01-22 11:22:52,905::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404769::DEBUG::2015-01-22 11:22:52,905::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404769::DEBUG::2015-01-22 11:22:52,906::task::993::Storage.TaskManager.Task::(_decref) Task=`20c8e2b5-160c-4b44-9737-f216e2a61e07`::ref 0 aborting False Thread-404769::ERROR::2015-01-22 11:22:52,907::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404769::DEBUG::2015-01-22 11:22:52,909::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:52,918::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:52,919::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404770::DEBUG::2015-01-22 11:22:52,922::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404770::DEBUG::2015-01-22 11:22:52,923::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:53,717::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:53,718::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:53,730::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:22:54,067::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:54,068::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:54,068::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:54,068::__init__::232::IOProcess::(_processLogs) (465658) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:54,068::__init__::232::IOProcess::(_processLogs) (465658) Queuing response Thread-63::DEBUG::2015-01-22 11:22:54,069::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:22:54,077::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00027712 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:22:54,078::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:54,078::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:54,078::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:54,078::__init__::232::IOProcess::(_processLogs) (465659) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:22:54,079::__init__::232::IOProcess::(_processLogs) (465659) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:55,980::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:55,982::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404771::DEBUG::2015-01-22 11:22:55,984::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:55,985::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:55,986::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404772::DEBUG::2015-01-22 11:22:55,988::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404772::DEBUG::2015-01-22 11:22:55,989::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:22:58,736::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:58,737::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:22:58,745::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:59,019::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:59,020::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404773::DEBUG::2015-01-22 11:22:59,023::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:22:59,024::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:22:59,025::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404774::DEBUG::2015-01-22 11:22:59,026::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404774::DEBUG::2015-01-22 11:22:59,027::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-360::DEBUG::2015-01-22 11:22:59,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`a8794cdc-888a-43c8-9e0b-02c222c9127e`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:22:59,453::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:22:59,454::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:59,454::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:59,454::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:59,454::__init__::232::IOProcess::(_processLogs) (465660) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:22:59,458::__init__::232::IOProcess::(_processLogs) (465660) Queuing response Thread-21::DEBUG::2015-01-22 11:22:59,459::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:22:59,459::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:22:59,459::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:22:59,459::__init__::232::IOProcess::(_processLogs) (465661) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:22:59,459::__init__::232::IOProcess::(_processLogs) (465661) Queuing response Thread-360::INFO::2015-01-22 11:22:59,460::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:22:59,460::task::1191::Storage.TaskManager.Task::(prepare) Task=`a8794cdc-888a-43c8-9e0b-02c222c9127e`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:22:59,460::task::595::Storage.TaskManager.Task::(_updateState) Task=`a8794cdc-888a-43c8-9e0b-02c222c9127e`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:22:59,460::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:22:59,460::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:22:59,460::task::993::Storage.TaskManager.Task::(_decref) Task=`a8794cdc-888a-43c8-9e0b-02c222c9127e`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:23:01,444::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:01,444::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:01,444::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:01,444::__init__::232::IOProcess::(_processLogs) (465662) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:01,445::__init__::232::IOProcess::(_processLogs) (465662) Queuing response Thread-64::DEBUG::2015-01-22 11:23:01,446::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:23:01,455::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00056963 s, 815 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:01,456::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:01,456::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:01,456::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:01,457::__init__::232::IOProcess::(_processLogs) (465663) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:01,457::__init__::232::IOProcess::(_processLogs) (465663) Queuing response Thread-21::DEBUG::2015-01-22 11:23:01,458::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:01,458::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:01,458::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:01,458::__init__::232::IOProcess::(_processLogs) (465664) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:01,458::__init__::232::IOProcess::(_processLogs) (465664) Queuing response Thread-21::DEBUG::2015-01-22 11:23:01,459::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:01,459::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:01,459::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:01,459::__init__::232::IOProcess::(_processLogs) (465665) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:01,460::__init__::232::IOProcess::(_processLogs) (465665) Queuing response Thread-21::DEBUG::2015-01-22 11:23:01,460::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:01,460::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:01,460::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:01,461::__init__::232::IOProcess::(_processLogs) (465666) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:01,461::__init__::232::IOProcess::(_processLogs) (465666) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:02,054::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:02,055::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404775::DEBUG::2015-01-22 11:23:02,057::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:02,058::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:02,059::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404776::DEBUG::2015-01-22 11:23:02,061::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404776::DEBUG::2015-01-22 11:23:02,062::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:03,751::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:03,752::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:03,763::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:23:04,080::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:04,081::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:04,081::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:04,081::__init__::232::IOProcess::(_processLogs) (465667) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:04,081::__init__::232::IOProcess::(_processLogs) (465667) Queuing response Thread-63::DEBUG::2015-01-22 11:23:04,082::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:23:04,090::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000265252 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:04,091::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:04,091::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:04,091::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:04,091::__init__::232::IOProcess::(_processLogs) (465668) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:04,091::__init__::232::IOProcess::(_processLogs) (465668) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:05,087::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:05,088::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404777::DEBUG::2015-01-22 11:23:05,091::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:05,092::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:05,093::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404778::DEBUG::2015-01-22 11:23:05,095::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404778::DEBUG::2015-01-22 11:23:05,096::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:08,126::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:08,128::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404779::DEBUG::2015-01-22 11:23:08,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`a37439cd-5d2e-4c61-abd3-005231e687fc`::moving from state init -> state preparing Thread-404779::INFO::2015-01-22 11:23:08,133::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404779::INFO::2015-01-22 11:23:08,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000265252', 'lastCheck': '4.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056963', 'lastCheck': '6.7', 'valid': True}} Thread-404779::DEBUG::2015-01-22 11:23:08,135::task::1191::Storage.TaskManager.Task::(prepare) Task=`a37439cd-5d2e-4c61-abd3-005231e687fc`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000265252', 'lastCheck': '4.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056963', 'lastCheck': '6.7', 'valid': True}} Thread-404779::DEBUG::2015-01-22 11:23:08,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`a37439cd-5d2e-4c61-abd3-005231e687fc`::moving from state preparing -> state finished Thread-404779::DEBUG::2015-01-22 11:23:08,135::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404779::DEBUG::2015-01-22 11:23:08,135::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404779::DEBUG::2015-01-22 11:23:08,135::task::993::Storage.TaskManager.Task::(_decref) Task=`a37439cd-5d2e-4c61-abd3-005231e687fc`::ref 0 aborting False Thread-404779::ERROR::2015-01-22 11:23:08,136::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404779::DEBUG::2015-01-22 11:23:08,138::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:08,147::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:08,148::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404780::DEBUG::2015-01-22 11:23:08,150::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404780::DEBUG::2015-01-22 11:23:08,151::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:08,769::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:08,770::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:08,781::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:23:08,986::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:11,215::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:11,216::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404781::DEBUG::2015-01-22 11:23:11,218::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:11,218::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:11,220::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404782::DEBUG::2015-01-22 11:23:11,221::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404782::DEBUG::2015-01-22 11:23:11,222::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:23:11,463::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:11,463::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:11,463::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:11,463::__init__::232::IOProcess::(_processLogs) (465669) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:11,465::__init__::232::IOProcess::(_processLogs) (465669) Queuing response Thread-64::DEBUG::2015-01-22 11:23:11,466::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:23:11,475::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000592758 s, 783 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:11,475::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:11,476::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:11,476::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:11,476::__init__::232::IOProcess::(_processLogs) (465670) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:11,476::__init__::232::IOProcess::(_processLogs) (465670) Queuing response Thread-21::DEBUG::2015-01-22 11:23:11,477::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:11,477::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:11,477::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:11,477::__init__::232::IOProcess::(_processLogs) (465671) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:11,478::__init__::232::IOProcess::(_processLogs) (465671) Queuing response Thread-21::DEBUG::2015-01-22 11:23:11,478::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:11,478::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:11,479::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:11,479::__init__::232::IOProcess::(_processLogs) (465672) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:11,479::__init__::232::IOProcess::(_processLogs) (465672) Queuing response Thread-21::DEBUG::2015-01-22 11:23:11,480::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:11,480::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:11,480::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:11,480::__init__::232::IOProcess::(_processLogs) (465673) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:11,481::__init__::232::IOProcess::(_processLogs) (465673) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:13,788::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:13,788::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:13,794::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:23:14,093::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:14,093::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:14,094::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:14,094::__init__::232::IOProcess::(_processLogs) (465674) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:14,094::__init__::232::IOProcess::(_processLogs) (465674) Queuing response Thread-63::DEBUG::2015-01-22 11:23:14,095::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:23:14,103::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000303559 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:14,104::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:14,104::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:14,104::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:14,104::__init__::232::IOProcess::(_processLogs) (465675) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:14,104::__init__::232::IOProcess::(_processLogs) (465675) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:14,249::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:14,250::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404783::DEBUG::2015-01-22 11:23:14,253::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:14,254::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:14,255::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404784::DEBUG::2015-01-22 11:23:14,257::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404784::DEBUG::2015-01-22 11:23:14,258::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:17,286::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:17,288::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404785::DEBUG::2015-01-22 11:23:17,289::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:17,290::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:17,292::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404786::DEBUG::2015-01-22 11:23:17,294::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404786::DEBUG::2015-01-22 11:23:17,295::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:18,800::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:18,801::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:18,808::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:20,322::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:20,323::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404787::DEBUG::2015-01-22 11:23:20,325::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:20,326::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:20,327::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404788::DEBUG::2015-01-22 11:23:20,329::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404788::DEBUG::2015-01-22 11:23:20,330::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:23:21,482::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:21,482::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:21,483::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:21,483::__init__::232::IOProcess::(_processLogs) (465676) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:21,484::__init__::232::IOProcess::(_processLogs) (465676) Queuing response Thread-64::DEBUG::2015-01-22 11:23:21,485::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:23:21,495::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000548834 s, 845 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:21,495::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:21,496::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:21,496::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:21,496::__init__::232::IOProcess::(_processLogs) (465677) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:21,496::__init__::232::IOProcess::(_processLogs) (465677) Queuing response Thread-21::DEBUG::2015-01-22 11:23:21,497::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:21,497::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:21,497::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:21,497::__init__::232::IOProcess::(_processLogs) (465678) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:21,498::__init__::232::IOProcess::(_processLogs) (465678) Queuing response Thread-21::DEBUG::2015-01-22 11:23:21,498::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:21,498::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:21,498::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:21,499::__init__::232::IOProcess::(_processLogs) (465679) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:21,499::__init__::232::IOProcess::(_processLogs) (465679) Queuing response Thread-21::DEBUG::2015-01-22 11:23:21,499::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:21,500::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:21,500::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:21,500::__init__::232::IOProcess::(_processLogs) (465680) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:21,500::__init__::232::IOProcess::(_processLogs) (465680) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:23,356::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:23,357::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404789::DEBUG::2015-01-22 11:23:23,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7f37754-ebee-4312-a04d-553958b0ba0b`::moving from state init -> state preparing Thread-404789::INFO::2015-01-22 11:23:23,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404789::INFO::2015-01-22 11:23:23,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303559', 'lastCheck': '9.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548834', 'lastCheck': '1.9', 'valid': True}} Thread-404789::DEBUG::2015-01-22 11:23:23,361::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7f37754-ebee-4312-a04d-553958b0ba0b`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303559', 'lastCheck': '9.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548834', 'lastCheck': '1.9', 'valid': True}} Thread-404789::DEBUG::2015-01-22 11:23:23,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7f37754-ebee-4312-a04d-553958b0ba0b`::moving from state preparing -> state finished Thread-404789::DEBUG::2015-01-22 11:23:23,361::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404789::DEBUG::2015-01-22 11:23:23,361::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404789::DEBUG::2015-01-22 11:23:23,362::task::993::Storage.TaskManager.Task::(_decref) Task=`b7f37754-ebee-4312-a04d-553958b0ba0b`::ref 0 aborting False Thread-404789::ERROR::2015-01-22 11:23:23,363::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404789::DEBUG::2015-01-22 11:23:23,365::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:23,372::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:23,374::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404790::DEBUG::2015-01-22 11:23:23,375::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404790::DEBUG::2015-01-22 11:23:23,376::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:23,814::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:23,815::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:23,826::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-63::DEBUG::2015-01-22 11:23:24,105::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d26c38f9-0719-457c-8ce0-a074d1eff534 Thread-21::DEBUG::2015-01-22 11:23:24,108::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:24,108::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:24,109::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:24,109::__init__::232::IOProcess::(_processLogs) (465681) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:23:24,109::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:24,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:24,109::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:24,109::__init__::232::IOProcess::(_processLogs) (465682) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:23:24,109::__init__::232::IOProcess::(_processLogs) (465681) Queuing response Thread-21::DEBUG::2015-01-22 11:23:24,113::__init__::232::IOProcess::(_processLogs) (465682) Queuing response Thread-63::DEBUG::2015-01-22 11:23:24,119::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534 Thread-21::DEBUG::2015-01-22 11:23:24,119::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:24,119::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:24,119::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:24,120::__init__::232::IOProcess::(_processLogs) (465683) Got request for method 'touch' Thread-21::DEBUG::2015-01-22 11:23:24,126::__init__::232::IOProcess::(_processLogs) (465683) Queuing response Thread-63::DEBUG::2015-01-22 11:23:24,127::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend Thread-21::DEBUG::2015-01-22 11:23:24,127::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:24,128::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:24,128::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:24,128::__init__::232::IOProcess::(_processLogs) (465684) Got request for method 'readfile' Thread-21::DEBUG::2015-01-22 11:23:24,128::__init__::232::IOProcess::(_processLogs) (465684) Queuing response Thread-63::DEBUG::2015-01-22 11:23:24,128::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISO', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=67c137fd-0cf2-463a-bc70-b427cc0a5da3', 'REMOTE_PATH=192.168.1.24:/Data/ISO', 'ROLE=Regular', 'SDUUID=d26c38f9-0719-457c-8ce0-a074d1eff534', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=2e3c4b23cacb8bd1a5cc7cf85722fc990962eb40'] Thread-21::DEBUG::2015-01-22 11:23:24,129::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:24,129::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:24,129::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:24,130::__init__::232::IOProcess::(_processLogs) (465685) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:24,130::__init__::232::IOProcess::(_processLogs) (465685) Queuing response Thread-21::DEBUG::2015-01-22 11:23:24,130::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:24,130::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:24,130::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:24,131::__init__::232::IOProcess::(_processLogs) (465686) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:23:24,131::__init__::232::IOProcess::(_processLogs) (465686) Queuing response Thread-63::DEBUG::2015-01-22 11:23:24,131::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-63::INFO::2015-01-22 11:23:24,131::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d26c38f9-0719-457c-8ce0-a074d1eff534_imageNS already registered Thread-63::INFO::2015-01-22 11:23:24,131::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d26c38f9-0719-457c-8ce0-a074d1eff534_volumeNS already registered Thread-21::DEBUG::2015-01-22 11:23:24,132::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:24,132::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:24,132::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:24,132::__init__::232::IOProcess::(_processLogs) (465687) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:24,132::__init__::232::IOProcess::(_processLogs) (465687) Queuing response Thread-63::DEBUG::2015-01-22 11:23:24,133::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:23:24,140::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000295114 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:24,141::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:24,141::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:24,141::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:24,141::__init__::232::IOProcess::(_processLogs) (465688) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:24,141::__init__::232::IOProcess::(_processLogs) (465688) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:26,431::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:26,432::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404793::DEBUG::2015-01-22 11:23:26,434::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:26,435::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:26,436::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404794::DEBUG::2015-01-22 11:23:26,438::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404794::DEBUG::2015-01-22 11:23:26,439::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:28,833::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:28,833::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:28,844::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:29,473::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:29,474::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404795::DEBUG::2015-01-22 11:23:29,477::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:29,478::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:29,479::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404796::DEBUG::2015-01-22 11:23:29,480::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404796::DEBUG::2015-01-22 11:23:29,481::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:23:31,501::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:31,502::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:31,502::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:31,502::__init__::232::IOProcess::(_processLogs) (465689) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:31,504::__init__::232::IOProcess::(_processLogs) (465689) Queuing response Thread-64::DEBUG::2015-01-22 11:23:31,505::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:23:31,514::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000536021 s, 866 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:31,515::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:31,515::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:31,515::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:31,516::__init__::232::IOProcess::(_processLogs) (465690) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:31,516::__init__::232::IOProcess::(_processLogs) (465690) Queuing response Thread-21::DEBUG::2015-01-22 11:23:31,517::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:31,517::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:31,517::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:31,517::__init__::232::IOProcess::(_processLogs) (465691) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:31,517::__init__::232::IOProcess::(_processLogs) (465691) Queuing response Thread-21::DEBUG::2015-01-22 11:23:31,518::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:31,518::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:31,518::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:31,518::__init__::232::IOProcess::(_processLogs) (465692) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:31,518::__init__::232::IOProcess::(_processLogs) (465692) Queuing response Thread-21::DEBUG::2015-01-22 11:23:31,519::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:31,519::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:31,519::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:31,519::__init__::232::IOProcess::(_processLogs) (465693) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:31,520::__init__::232::IOProcess::(_processLogs) (465693) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:32,508::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:32,509::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404797::DEBUG::2015-01-22 11:23:32,511::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:32,512::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:32,513::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404798::DEBUG::2015-01-22 11:23:32,515::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404798::DEBUG::2015-01-22 11:23:32,516::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:33,850::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:33,851::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:33,864::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:23:34,143::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:34,143::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:34,144::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:34,144::__init__::232::IOProcess::(_processLogs) (465694) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:34,144::__init__::232::IOProcess::(_processLogs) (465694) Queuing response Thread-63::DEBUG::2015-01-22 11:23:34,145::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:23:34,151::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000257541 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:34,152::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:34,152::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:34,152::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:34,152::__init__::232::IOProcess::(_processLogs) (465695) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:34,153::__init__::232::IOProcess::(_processLogs) (465695) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:35,546::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:35,547::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404799::DEBUG::2015-01-22 11:23:35,549::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:35,550::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:35,552::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404800::DEBUG::2015-01-22 11:23:35,554::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404800::DEBUG::2015-01-22 11:23:35,555::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:38,582::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:38,584::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404801::DEBUG::2015-01-22 11:23:38,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c27da33-892c-47e9-a520-2435e292b552`::moving from state init -> state preparing Thread-404801::INFO::2015-01-22 11:23:38,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404801::INFO::2015-01-22 11:23:38,588::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257541', 'lastCheck': '4.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536021', 'lastCheck': '7.1', 'valid': True}} Thread-404801::DEBUG::2015-01-22 11:23:38,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c27da33-892c-47e9-a520-2435e292b552`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257541', 'lastCheck': '4.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536021', 'lastCheck': '7.1', 'valid': True}} Thread-404801::DEBUG::2015-01-22 11:23:38,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c27da33-892c-47e9-a520-2435e292b552`::moving from state preparing -> state finished Thread-404801::DEBUG::2015-01-22 11:23:38,588::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404801::DEBUG::2015-01-22 11:23:38,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404801::DEBUG::2015-01-22 11:23:38,589::task::993::Storage.TaskManager.Task::(_decref) Task=`5c27da33-892c-47e9-a520-2435e292b552`::ref 0 aborting False Thread-404801::ERROR::2015-01-22 11:23:38,590::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404801::DEBUG::2015-01-22 11:23:38,592::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:38,601::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:38,602::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404802::DEBUG::2015-01-22 11:23:38,604::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404802::DEBUG::2015-01-22 11:23:38,605::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:38,870::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:38,870::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:38,880::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:23:39,019::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. Thread-21::DEBUG::2015-01-22 11:23:41,521::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:41,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:41,521::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:41,521::__init__::232::IOProcess::(_processLogs) (465696) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:41,523::__init__::232::IOProcess::(_processLogs) (465696) Queuing response Thread-64::DEBUG::2015-01-22 11:23:41,523::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:23:41,533::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000483252 s, 960 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:41,534::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:41,534::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:41,535::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:41,535::__init__::232::IOProcess::(_processLogs) (465697) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:41,535::__init__::232::IOProcess::(_processLogs) (465697) Queuing response Thread-21::DEBUG::2015-01-22 11:23:41,536::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:41,536::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:41,536::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:41,537::__init__::232::IOProcess::(_processLogs) (465698) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:41,537::__init__::232::IOProcess::(_processLogs) (465698) Queuing response Thread-21::DEBUG::2015-01-22 11:23:41,537::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:41,538::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:41,538::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:41,538::__init__::232::IOProcess::(_processLogs) (465699) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:41,538::__init__::232::IOProcess::(_processLogs) (465699) Queuing response Thread-21::DEBUG::2015-01-22 11:23:41,539::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:41,539::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:41,539::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:41,539::__init__::232::IOProcess::(_processLogs) (465700) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:41,539::__init__::232::IOProcess::(_processLogs) (465700) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:41,656::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:41,657::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404803::DEBUG::2015-01-22 11:23:41,659::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:41,660::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:41,661::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404804::DEBUG::2015-01-22 11:23:41,663::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404804::DEBUG::2015-01-22 11:23:41,664::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:43,886::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:43,887::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:43,894::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:23:44,154::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:44,154::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:44,155::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:44,155::__init__::232::IOProcess::(_processLogs) (465701) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:44,155::__init__::232::IOProcess::(_processLogs) (465701) Queuing response Thread-63::DEBUG::2015-01-22 11:23:44,156::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:23:44,165::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000291837 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:44,165::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:44,166::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:44,166::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:44,166::__init__::232::IOProcess::(_processLogs) (465702) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:44,166::__init__::232::IOProcess::(_processLogs) (465702) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:44,698::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:44,699::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404805::DEBUG::2015-01-22 11:23:44,702::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:44,703::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:44,704::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404806::DEBUG::2015-01-22 11:23:44,706::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404806::DEBUG::2015-01-22 11:23:44,707::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:47,737::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:47,739::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404807::DEBUG::2015-01-22 11:23:47,743::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:47,745::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:47,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404808::DEBUG::2015-01-22 11:23:47,750::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404808::DEBUG::2015-01-22 11:23:47,756::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:48,900::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:48,901::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:48,908::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:50,782::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:50,784::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404809::DEBUG::2015-01-22 11:23:50,786::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:50,787::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:50,788::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404810::DEBUG::2015-01-22 11:23:50,790::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404810::DEBUG::2015-01-22 11:23:50,791::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:23:51,541::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:51,541::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:51,541::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:51,542::__init__::232::IOProcess::(_processLogs) (465703) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:51,543::__init__::232::IOProcess::(_processLogs) (465703) Queuing response Thread-64::DEBUG::2015-01-22 11:23:51,544::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:23:51,553::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00055272 s, 839 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:51,553::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:51,554::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:51,554::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:51,554::__init__::232::IOProcess::(_processLogs) (465704) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:51,554::__init__::232::IOProcess::(_processLogs) (465704) Queuing response Thread-21::DEBUG::2015-01-22 11:23:51,555::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:51,555::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:51,555::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:51,555::__init__::232::IOProcess::(_processLogs) (465705) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:51,556::__init__::232::IOProcess::(_processLogs) (465705) Queuing response Thread-21::DEBUG::2015-01-22 11:23:51,556::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:51,556::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:51,556::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:51,557::__init__::232::IOProcess::(_processLogs) (465706) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:51,557::__init__::232::IOProcess::(_processLogs) (465706) Queuing response Thread-21::DEBUG::2015-01-22 11:23:51,557::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:51,558::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:51,558::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:51,558::__init__::232::IOProcess::(_processLogs) (465707) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:23:51,558::__init__::232::IOProcess::(_processLogs) (465707) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:53,820::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:53,823::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404811::DEBUG::2015-01-22 11:23:53,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`134c5891-003d-4b8e-94ac-402cd7286be0`::moving from state init -> state preparing Thread-404811::INFO::2015-01-22 11:23:53,832::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404811::INFO::2015-01-22 11:23:53,833::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291837', 'lastCheck': '9.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055272', 'lastCheck': '2.3', 'valid': True}} Thread-404811::DEBUG::2015-01-22 11:23:53,834::task::1191::Storage.TaskManager.Task::(prepare) Task=`134c5891-003d-4b8e-94ac-402cd7286be0`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291837', 'lastCheck': '9.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055272', 'lastCheck': '2.3', 'valid': True}} Thread-404811::DEBUG::2015-01-22 11:23:53,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`134c5891-003d-4b8e-94ac-402cd7286be0`::moving from state preparing -> state finished Thread-404811::DEBUG::2015-01-22 11:23:53,834::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404811::DEBUG::2015-01-22 11:23:53,834::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404811::DEBUG::2015-01-22 11:23:53,834::task::993::Storage.TaskManager.Task::(_decref) Task=`134c5891-003d-4b8e-94ac-402cd7286be0`::ref 0 aborting False Thread-404811::ERROR::2015-01-22 11:23:53,835::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404811::DEBUG::2015-01-22 11:23:53,839::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:53,846::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:53,847::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404812::DEBUG::2015-01-22 11:23:53,848::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404812::DEBUG::2015-01-22 11:23:53,849::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:53,914::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:53,915::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:53,926::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:23:54,168::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:54,168::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:54,168::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:54,168::__init__::232::IOProcess::(_processLogs) (465708) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:54,168::__init__::232::IOProcess::(_processLogs) (465708) Queuing response Thread-63::DEBUG::2015-01-22 11:23:54,169::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:23:54,177::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000321373 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:23:54,178::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:54,179::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:54,179::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:54,179::__init__::232::IOProcess::(_processLogs) (465709) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:23:54,179::__init__::232::IOProcess::(_processLogs) (465709) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:56,905::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:56,906::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404813::DEBUG::2015-01-22 11:23:56,908::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:56,909::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:56,910::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404814::DEBUG::2015-01-22 11:23:56,912::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404814::DEBUG::2015-01-22 11:23:56,913::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:23:58,933::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:58,933::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:23:58,942::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:23:59,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`06ab3c93-86c9-41cc-b080-0c6b0496e2da`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:23:59,554::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:23:59,555::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:59,555::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:59,555::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:59,555::__init__::232::IOProcess::(_processLogs) (465710) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:23:59,558::__init__::232::IOProcess::(_processLogs) (465710) Queuing response Thread-21::DEBUG::2015-01-22 11:23:59,559::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:23:59,560::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:23:59,560::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:23:59,560::__init__::232::IOProcess::(_processLogs) (465711) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:23:59,560::__init__::232::IOProcess::(_processLogs) (465711) Queuing response Thread-360::INFO::2015-01-22 11:23:59,561::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:23:59,561::task::1191::Storage.TaskManager.Task::(prepare) Task=`06ab3c93-86c9-41cc-b080-0c6b0496e2da`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:23:59,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`06ab3c93-86c9-41cc-b080-0c6b0496e2da`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:23:59,561::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:23:59,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:23:59,561::task::993::Storage.TaskManager.Task::(_decref) Task=`06ab3c93-86c9-41cc-b080-0c6b0496e2da`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:59,941::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:59,942::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404815::DEBUG::2015-01-22 11:23:59,944::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:23:59,945::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:23:59,946::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404816::DEBUG::2015-01-22 11:23:59,948::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404816::DEBUG::2015-01-22 11:23:59,949::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:24:01,559::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:01,560::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:01,560::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:01,560::__init__::232::IOProcess::(_processLogs) (465712) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:01,561::__init__::232::IOProcess::(_processLogs) (465712) Queuing response Thread-64::DEBUG::2015-01-22 11:24:01,562::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:24:01,570::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000486404 s, 954 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:01,571::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:01,571::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:01,572::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:01,572::__init__::232::IOProcess::(_processLogs) (465713) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:01,572::__init__::232::IOProcess::(_processLogs) (465713) Queuing response Thread-21::DEBUG::2015-01-22 11:24:01,573::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:01,573::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:01,573::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:01,573::__init__::232::IOProcess::(_processLogs) (465714) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:01,574::__init__::232::IOProcess::(_processLogs) (465714) Queuing response Thread-21::DEBUG::2015-01-22 11:24:01,575::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:01,575::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:01,576::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:01,576::__init__::232::IOProcess::(_processLogs) (465715) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:01,576::__init__::232::IOProcess::(_processLogs) (465715) Queuing response Thread-21::DEBUG::2015-01-22 11:24:01,577::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:01,577::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:01,577::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:01,577::__init__::232::IOProcess::(_processLogs) (465716) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:01,577::__init__::232::IOProcess::(_processLogs) (465716) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:02,974::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:02,975::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404817::DEBUG::2015-01-22 11:24:02,977::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:02,979::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:02,980::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404818::DEBUG::2015-01-22 11:24:02,981::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404818::DEBUG::2015-01-22 11:24:02,982::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:03,945::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:03,946::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:03,956::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:24:04,181::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:04,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:04,181::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:04,181::__init__::232::IOProcess::(_processLogs) (465717) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:04,181::__init__::232::IOProcess::(_processLogs) (465717) Queuing response Thread-63::DEBUG::2015-01-22 11:24:04,182::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:24:04,191::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00030553 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:04,192::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:04,192::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:04,192::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:04,192::__init__::232::IOProcess::(_processLogs) (465718) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:04,192::__init__::232::IOProcess::(_processLogs) (465718) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:06,010::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:06,011::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404819::DEBUG::2015-01-22 11:24:06,013::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:06,014::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:06,015::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404820::DEBUG::2015-01-22 11:24:06,017::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404820::DEBUG::2015-01-22 11:24:06,018::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:08,963::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:08,964::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:08,964::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:09,043::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:09,044::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404821::DEBUG::2015-01-22 11:24:09,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d80f724-f76d-4052-b448-3402bc704ddf`::moving from state init -> state preparing Thread-404821::INFO::2015-01-22 11:24:09,048::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404821::INFO::2015-01-22 11:24:09,048::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00030553', 'lastCheck': '4.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486404', 'lastCheck': '7.5', 'valid': True}} Thread-404821::DEBUG::2015-01-22 11:24:09,048::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d80f724-f76d-4052-b448-3402bc704ddf`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00030553', 'lastCheck': '4.9', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486404', 'lastCheck': '7.5', 'valid': True}} Thread-404821::DEBUG::2015-01-22 11:24:09,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d80f724-f76d-4052-b448-3402bc704ddf`::moving from state preparing -> state finished Thread-404821::DEBUG::2015-01-22 11:24:09,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404821::DEBUG::2015-01-22 11:24:09,049::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404821::DEBUG::2015-01-22 11:24:09,049::task::993::Storage.TaskManager.Task::(_decref) Task=`1d80f724-f76d-4052-b448-3402bc704ddf`::ref 0 aborting False Thread-404821::ERROR::2015-01-22 11:24:09,050::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404821::DEBUG::2015-01-22 11:24:09,052::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:24:09,053::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:09,061::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:09,062::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404822::DEBUG::2015-01-22 11:24:09,064::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404822::DEBUG::2015-01-22 11:24:09,065::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:24:11,579::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:11,579::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:11,579::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:11,580::__init__::232::IOProcess::(_processLogs) (465719) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:11,583::__init__::232::IOProcess::(_processLogs) (465719) Queuing response Thread-64::DEBUG::2015-01-22 11:24:11,584::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:24:11,593::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000526637 s, 881 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:11,594::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:11,594::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:11,594::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:11,594::__init__::232::IOProcess::(_processLogs) (465720) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:11,595::__init__::232::IOProcess::(_processLogs) (465720) Queuing response Thread-21::DEBUG::2015-01-22 11:24:11,596::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:11,596::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:11,596::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:11,596::__init__::232::IOProcess::(_processLogs) (465721) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:11,596::__init__::232::IOProcess::(_processLogs) (465721) Queuing response Thread-21::DEBUG::2015-01-22 11:24:11,597::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:11,597::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:11,597::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:11,598::__init__::232::IOProcess::(_processLogs) (465722) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:11,598::__init__::232::IOProcess::(_processLogs) (465722) Queuing response Thread-21::DEBUG::2015-01-22 11:24:11,599::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:11,599::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:11,599::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:11,599::__init__::232::IOProcess::(_processLogs) (465723) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:11,599::__init__::232::IOProcess::(_processLogs) (465723) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:12,131::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:12,140::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404823::DEBUG::2015-01-22 11:24:12,143::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:12,144::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:12,145::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404824::DEBUG::2015-01-22 11:24:12,147::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404824::DEBUG::2015-01-22 11:24:12,148::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:13,970::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:13,971::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:13,990::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:24:14,194::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:14,194::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:14,194::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:14,195::__init__::232::IOProcess::(_processLogs) (465724) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:14,196::__init__::232::IOProcess::(_processLogs) (465724) Queuing response Thread-63::DEBUG::2015-01-22 11:24:14,197::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:24:14,207::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000310968 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:14,208::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:14,208::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:14,208::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:14,209::__init__::232::IOProcess::(_processLogs) (465725) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:14,209::__init__::232::IOProcess::(_processLogs) (465725) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:15,180::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:15,182::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404825::DEBUG::2015-01-22 11:24:15,184::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:15,185::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:15,186::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404826::DEBUG::2015-01-22 11:24:15,188::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404826::DEBUG::2015-01-22 11:24:15,189::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:18,219::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:18,222::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404827::DEBUG::2015-01-22 11:24:18,226::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:18,228::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:18,231::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404828::DEBUG::2015-01-22 11:24:18,233::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404828::DEBUG::2015-01-22 11:24:18,240::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:18,996::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:18,997::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:19,005::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:21,282::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:21,284::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404829::DEBUG::2015-01-22 11:24:21,286::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:21,287::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:21,288::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404830::DEBUG::2015-01-22 11:24:21,290::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404830::DEBUG::2015-01-22 11:24:21,290::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-64::DEBUG::2015-01-22 11:24:21,600::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 06e45ff6-0505-4692-b97d-896d9b710b49 Thread-21::DEBUG::2015-01-22 11:24:21,601::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:21,602::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:21,602::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:21,602::__init__::232::IOProcess::(_processLogs) (465726) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:24:21,620::__init__::232::IOProcess::(_processLogs) (465726) Queuing response Thread-64::DEBUG::2015-01-22 11:24:21,628::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49 Thread-21::DEBUG::2015-01-22 11:24:21,628::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:21,628::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:21,629::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:21,629::__init__::232::IOProcess::(_processLogs) (465727) Got request for method 'touch' Thread-21::DEBUG::2015-01-22 11:24:21,630::__init__::232::IOProcess::(_processLogs) (465727) Queuing response Thread-64::DEBUG::2015-01-22 11:24:21,631::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend Thread-21::DEBUG::2015-01-22 11:24:21,631::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:21,631::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:21,631::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:21,632::__init__::232::IOProcess::(_processLogs) (465728) Got request for method 'readfile' Thread-21::DEBUG::2015-01-22 11:24:21,633::__init__::232::IOProcess::(_processLogs) (465728) Queuing response Thread-64::DEBUG::2015-01-22 11:24:21,634::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=store1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=cllDataCentre', 'POOL_DOMAINS=06e45ff6-0505-4692-b97d-896d9b710b49:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=67c137fd-0cf2-463a-bc70-b427cc0a5da3', 'REMOTE_PATH=192.168.1.25:/Vol2', 'ROLE=Master', 'SDUUID=06e45ff6-0505-4692-b97d-896d9b710b49', 'TYPE=GLUSTERFS', 'VERSION=3', '_SHA_CKSUM=7f3bb8b00fa6ca5bb291ea1e02530cfbc66a33ba'] Thread-21::DEBUG::2015-01-22 11:24:21,634::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:21,635::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:21,635::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:21,635::__init__::232::IOProcess::(_processLogs) (465729) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:21,635::__init__::232::IOProcess::(_processLogs) (465729) Queuing response Thread-21::DEBUG::2015-01-22 11:24:21,635::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:21,636::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:21,636::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:21,636::__init__::232::IOProcess::(_processLogs) (465730) Got request for method 'glob' Thread-21::DEBUG::2015-01-22 11:24:21,638::__init__::232::IOProcess::(_processLogs) (465730) Queuing response Thread-64::DEBUG::2015-01-22 11:24:21,638::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] Thread-64::INFO::2015-01-22 11:24:21,639::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 06e45ff6-0505-4692-b97d-896d9b710b49_imageNS already registered Thread-64::INFO::2015-01-22 11:24:21,639::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 06e45ff6-0505-4692-b97d-896d9b710b49_volumeNS already registered Thread-21::DEBUG::2015-01-22 11:24:21,639::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:21,639::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:21,639::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:21,640::__init__::232::IOProcess::(_processLogs) (465731) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:21,640::__init__::232::IOProcess::(_processLogs) (465731) Queuing response Thread-64::DEBUG::2015-01-22 11:24:21,642::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:24:21,649::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000493712 s, 940 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:21,650::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:21,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:21,650::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:21,651::__init__::232::IOProcess::(_processLogs) (465732) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:21,651::__init__::232::IOProcess::(_processLogs) (465732) Queuing response Thread-21::DEBUG::2015-01-22 11:24:21,652::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:21,652::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:21,652::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:21,652::__init__::232::IOProcess::(_processLogs) (465733) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:21,652::__init__::232::IOProcess::(_processLogs) (465733) Queuing response Thread-21::DEBUG::2015-01-22 11:24:21,653::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:21,653::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:21,654::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:21,654::__init__::232::IOProcess::(_processLogs) (465734) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:21,654::__init__::232::IOProcess::(_processLogs) (465734) Queuing response Thread-21::DEBUG::2015-01-22 11:24:21,654::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:21,654::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:21,655::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:21,655::__init__::232::IOProcess::(_processLogs) (465735) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:21,656::__init__::232::IOProcess::(_processLogs) (465735) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:24,012::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:24,015::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:24,025::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:24:24,210::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:24,211::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:24,211::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:24,211::__init__::232::IOProcess::(_processLogs) (465736) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:24,211::__init__::232::IOProcess::(_processLogs) (465736) Queuing response Thread-63::DEBUG::2015-01-22 11:24:24,212::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:24:24,220::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000274156 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:24,221::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:24,221::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:24,221::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:24,222::__init__::232::IOProcess::(_processLogs) (465737) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:24,222::__init__::232::IOProcess::(_processLogs) (465737) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:24,322::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:24,323::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404832::DEBUG::2015-01-22 11:24:24,327::task::595::Storage.TaskManager.Task::(_updateState) Task=`caf43b83-8328-4286-8fe7-53ae713be835`::moving from state init -> state preparing Thread-404832::INFO::2015-01-22 11:24:24,327::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404832::INFO::2015-01-22 11:24:24,327::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274156', 'lastCheck': '0.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493712', 'lastCheck': '2.7', 'valid': True}} Thread-404832::DEBUG::2015-01-22 11:24:24,328::task::1191::Storage.TaskManager.Task::(prepare) Task=`caf43b83-8328-4286-8fe7-53ae713be835`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274156', 'lastCheck': '0.1', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493712', 'lastCheck': '2.7', 'valid': True}} Thread-404832::DEBUG::2015-01-22 11:24:24,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`caf43b83-8328-4286-8fe7-53ae713be835`::moving from state preparing -> state finished Thread-404832::DEBUG::2015-01-22 11:24:24,328::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404832::DEBUG::2015-01-22 11:24:24,328::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404832::DEBUG::2015-01-22 11:24:24,328::task::993::Storage.TaskManager.Task::(_decref) Task=`caf43b83-8328-4286-8fe7-53ae713be835`::ref 0 aborting False Thread-404832::ERROR::2015-01-22 11:24:24,329::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404832::DEBUG::2015-01-22 11:24:24,340::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:24,348::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:24,349::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404833::DEBUG::2015-01-22 11:24:24,351::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404833::DEBUG::2015-01-22 11:24:24,352::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:27,405::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:27,406::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404834::DEBUG::2015-01-22 11:24:27,408::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:27,409::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:27,410::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404835::DEBUG::2015-01-22 11:24:27,412::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404835::DEBUG::2015-01-22 11:24:27,413::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:29,031::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:29,032::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:29,041::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:30,447::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:30,449::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404836::DEBUG::2015-01-22 11:24:30,453::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:30,454::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:30,455::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404837::DEBUG::2015-01-22 11:24:30,457::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404837::DEBUG::2015-01-22 11:24:30,458::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:24:31,660::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:31,660::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:31,660::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:31,660::__init__::232::IOProcess::(_processLogs) (465738) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:31,665::__init__::232::IOProcess::(_processLogs) (465738) Queuing response Thread-64::DEBUG::2015-01-22 11:24:31,665::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:24:31,675::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000624879 s, 743 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:31,676::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:31,676::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:31,676::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:31,676::__init__::232::IOProcess::(_processLogs) (465739) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:31,676::__init__::232::IOProcess::(_processLogs) (465739) Queuing response Thread-21::DEBUG::2015-01-22 11:24:31,677::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:31,677::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:31,677::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:31,677::__init__::232::IOProcess::(_processLogs) (465740) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:31,678::__init__::232::IOProcess::(_processLogs) (465740) Queuing response Thread-21::DEBUG::2015-01-22 11:24:31,680::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:31,680::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:31,680::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:31,680::__init__::232::IOProcess::(_processLogs) (465741) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:31,680::__init__::232::IOProcess::(_processLogs) (465741) Queuing response Thread-21::DEBUG::2015-01-22 11:24:31,681::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:31,681::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:31,681::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:31,681::__init__::232::IOProcess::(_processLogs) (465742) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:31,681::__init__::232::IOProcess::(_processLogs) (465742) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:33,487::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:33,488::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404838::DEBUG::2015-01-22 11:24:33,490::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:33,491::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:33,492::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404839::DEBUG::2015-01-22 11:24:33,494::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404839::DEBUG::2015-01-22 11:24:33,495::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:34,047::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:34,048::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:34,059::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:24:34,224::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:34,224::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:34,224::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:34,224::__init__::232::IOProcess::(_processLogs) (465743) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:34,224::__init__::232::IOProcess::(_processLogs) (465743) Queuing response Thread-63::DEBUG::2015-01-22 11:24:34,225::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:24:34,233::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.0002757 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:34,234::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:34,234::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:34,234::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:34,234::__init__::232::IOProcess::(_processLogs) (465744) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:34,234::__init__::232::IOProcess::(_processLogs) (465744) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:36,526::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:36,528::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404840::DEBUG::2015-01-22 11:24:36,530::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:36,531::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:36,532::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404841::DEBUG::2015-01-22 11:24:36,534::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404841::DEBUG::2015-01-22 11:24:36,535::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:39,065::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:39,065::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:39,073::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set VM Channels Listener::DEBUG::2015-01-22 11:24:39,087::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:39,561::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:39,562::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404842::DEBUG::2015-01-22 11:24:39,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`31526d35-98c7-4838-8707-bd79777629a6`::moving from state init -> state preparing Thread-404842::INFO::2015-01-22 11:24:39,566::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404842::INFO::2015-01-22 11:24:39,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002757', 'lastCheck': '5.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624879', 'lastCheck': '7.9', 'valid': True}} Thread-404842::DEBUG::2015-01-22 11:24:39,566::task::1191::Storage.TaskManager.Task::(prepare) Task=`31526d35-98c7-4838-8707-bd79777629a6`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002757', 'lastCheck': '5.3', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624879', 'lastCheck': '7.9', 'valid': True}} Thread-404842::DEBUG::2015-01-22 11:24:39,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`31526d35-98c7-4838-8707-bd79777629a6`::moving from state preparing -> state finished Thread-404842::DEBUG::2015-01-22 11:24:39,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404842::DEBUG::2015-01-22 11:24:39,567::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404842::DEBUG::2015-01-22 11:24:39,567::task::993::Storage.TaskManager.Task::(_decref) Task=`31526d35-98c7-4838-8707-bd79777629a6`::ref 0 aborting False Thread-404842::ERROR::2015-01-22 11:24:39,568::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404842::DEBUG::2015-01-22 11:24:39,570::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:39,577::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:39,579::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404843::DEBUG::2015-01-22 11:24:39,581::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404843::DEBUG::2015-01-22 11:24:39,581::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:24:41,684::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:41,684::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:41,684::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:41,684::__init__::232::IOProcess::(_processLogs) (465745) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:41,685::__init__::232::IOProcess::(_processLogs) (465745) Queuing response Thread-64::DEBUG::2015-01-22 11:24:41,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:24:41,695::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000606573 s, 765 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:41,696::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:41,696::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:41,696::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:41,696::__init__::232::IOProcess::(_processLogs) (465746) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:41,696::__init__::232::IOProcess::(_processLogs) (465746) Queuing response Thread-21::DEBUG::2015-01-22 11:24:41,697::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:41,697::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:41,698::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:41,698::__init__::232::IOProcess::(_processLogs) (465747) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:41,698::__init__::232::IOProcess::(_processLogs) (465747) Queuing response Thread-21::DEBUG::2015-01-22 11:24:41,699::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:41,699::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:41,699::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:41,699::__init__::232::IOProcess::(_processLogs) (465748) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:41,700::__init__::232::IOProcess::(_processLogs) (465748) Queuing response Thread-21::DEBUG::2015-01-22 11:24:41,700::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:41,701::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:41,701::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:41,701::__init__::232::IOProcess::(_processLogs) (465749) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:41,701::__init__::232::IOProcess::(_processLogs) (465749) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:42,643::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:42,644::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404844::DEBUG::2015-01-22 11:24:42,646::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:42,648::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:42,649::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404845::DEBUG::2015-01-22 11:24:42,651::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404845::DEBUG::2015-01-22 11:24:42,651::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:44,079::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:44,080::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:44,089::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:24:44,241::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:44,242::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:44,242::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:44,242::__init__::232::IOProcess::(_processLogs) (465750) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:44,243::__init__::232::IOProcess::(_processLogs) (465750) Queuing response Thread-63::DEBUG::2015-01-22 11:24:44,244::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:24:44,253::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000272584 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:44,254::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:44,255::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:44,255::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:44,255::__init__::232::IOProcess::(_processLogs) (465751) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:44,255::__init__::232::IOProcess::(_processLogs) (465751) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:45,683::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:45,685::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404846::DEBUG::2015-01-22 11:24:45,687::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:45,688::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:45,689::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404847::DEBUG::2015-01-22 11:24:45,691::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404847::DEBUG::2015-01-22 11:24:45,692::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:48,717::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:48,718::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404848::DEBUG::2015-01-22 11:24:48,720::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:48,721::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:48,722::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404849::DEBUG::2015-01-22 11:24:48,724::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404849::DEBUG::2015-01-22 11:24:48,725::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:49,095::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:49,096::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:49,103::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:24:51,703::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:51,703::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:51,703::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:51,703::__init__::232::IOProcess::(_processLogs) (465752) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:51,704::__init__::232::IOProcess::(_processLogs) (465752) Queuing response Thread-64::DEBUG::2015-01-22 11:24:51,705::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:24:51,714::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000443893 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:51,715::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:51,715::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:51,715::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:51,715::__init__::232::IOProcess::(_processLogs) (465753) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:51,716::__init__::232::IOProcess::(_processLogs) (465753) Queuing response Thread-21::DEBUG::2015-01-22 11:24:51,717::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:51,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:51,717::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:51,717::__init__::232::IOProcess::(_processLogs) (465754) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:51,717::__init__::232::IOProcess::(_processLogs) (465754) Queuing response Thread-21::DEBUG::2015-01-22 11:24:51,718::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:51,718::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:51,718::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:51,718::__init__::232::IOProcess::(_processLogs) (465755) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:51,718::__init__::232::IOProcess::(_processLogs) (465755) Queuing response Thread-21::DEBUG::2015-01-22 11:24:51,719::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:51,719::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:51,719::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:51,719::__init__::232::IOProcess::(_processLogs) (465756) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:24:51,720::__init__::232::IOProcess::(_processLogs) (465756) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:51,752::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:51,753::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404850::DEBUG::2015-01-22 11:24:51,756::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:51,757::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:51,758::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404851::DEBUG::2015-01-22 11:24:51,760::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404851::DEBUG::2015-01-22 11:24:51,761::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:54,109::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:54,110::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:54,110::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:24:54,257::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:54,257::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:54,257::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:54,257::__init__::232::IOProcess::(_processLogs) (465757) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:54,257::__init__::232::IOProcess::(_processLogs) (465757) Queuing response Thread-63::DEBUG::2015-01-22 11:24:54,258::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:24:54,267::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.00032066 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:24:54,268::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:54,268::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:54,268::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:54,269::__init__::232::IOProcess::(_processLogs) (465758) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:24:54,269::__init__::232::IOProcess::(_processLogs) (465758) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:54,789::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:54,791::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404852::DEBUG::2015-01-22 11:24:54,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe6a0ed8-227c-45ee-99e2-a99ffefa7b90`::moving from state init -> state preparing Thread-404852::INFO::2015-01-22 11:24:54,795::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404852::INFO::2015-01-22 11:24:54,795::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00032066', 'lastCheck': '0.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443893', 'lastCheck': '3.1', 'valid': True}} Thread-404852::DEBUG::2015-01-22 11:24:54,795::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe6a0ed8-227c-45ee-99e2-a99ffefa7b90`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00032066', 'lastCheck': '0.5', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443893', 'lastCheck': '3.1', 'valid': True}} Thread-404852::DEBUG::2015-01-22 11:24:54,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe6a0ed8-227c-45ee-99e2-a99ffefa7b90`::moving from state preparing -> state finished Thread-404852::DEBUG::2015-01-22 11:24:54,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404852::DEBUG::2015-01-22 11:24:54,795::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404852::DEBUG::2015-01-22 11:24:54,795::task::993::Storage.TaskManager.Task::(_decref) Task=`fe6a0ed8-227c-45ee-99e2-a99ffefa7b90`::ref 0 aborting False Thread-404852::ERROR::2015-01-22 11:24:54,796::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404852::DEBUG::2015-01-22 11:24:54,799::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:54,807::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:54,808::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404853::DEBUG::2015-01-22 11:24:54,810::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404853::DEBUG::2015-01-22 11:24:54,811::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:57,872::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:57,873::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404854::DEBUG::2015-01-22 11:24:57,875::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:24:57,876::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:24:57,877::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404855::DEBUG::2015-01-22 11:24:57,878::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404855::DEBUG::2015-01-22 11:24:57,879::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:24:59,116::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:59,117::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:24:59,132::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:24:59,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ac2e597-34dd-4281-9fd2-f62d829d93fb`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:24:59,656::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:24:59,657::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:59,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:59,657::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:59,657::__init__::232::IOProcess::(_processLogs) (465759) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:24:59,659::__init__::232::IOProcess::(_processLogs) (465759) Queuing response Thread-21::DEBUG::2015-01-22 11:24:59,661::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:24:59,661::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:24:59,661::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:24:59,661::__init__::232::IOProcess::(_processLogs) (465760) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:24:59,661::__init__::232::IOProcess::(_processLogs) (465760) Queuing response Thread-360::INFO::2015-01-22 11:24:59,662::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:24:59,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ac2e597-34dd-4281-9fd2-f62d829d93fb`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:24:59,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ac2e597-34dd-4281-9fd2-f62d829d93fb`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:24:59,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:24:59,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:24:59,662::task::993::Storage.TaskManager.Task::(_decref) Task=`8ac2e597-34dd-4281-9fd2-f62d829d93fb`::ref 0 aborting False JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:00,913::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:00,914::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404856::DEBUG::2015-01-22 11:25:00,916::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:00,917::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:00,918::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404857::DEBUG::2015-01-22 11:25:00,920::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404857::DEBUG::2015-01-22 11:25:00,921::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:25:01,722::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:01,722::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:01,722::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:01,723::__init__::232::IOProcess::(_processLogs) (465761) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:01,724::__init__::232::IOProcess::(_processLogs) (465761) Queuing response Thread-64::DEBUG::2015-01-22 11:25:01,725::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:25:01,734::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000522814 s, 888 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:01,735::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:01,735::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:01,735::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:01,736::__init__::232::IOProcess::(_processLogs) (465762) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:01,736::__init__::232::IOProcess::(_processLogs) (465762) Queuing response Thread-21::DEBUG::2015-01-22 11:25:01,737::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:01,737::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:01,737::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:01,737::__init__::232::IOProcess::(_processLogs) (465763) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:01,738::__init__::232::IOProcess::(_processLogs) (465763) Queuing response Thread-21::DEBUG::2015-01-22 11:25:01,739::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:01,739::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:01,739::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:01,739::__init__::232::IOProcess::(_processLogs) (465764) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:01,740::__init__::232::IOProcess::(_processLogs) (465764) Queuing response Thread-21::DEBUG::2015-01-22 11:25:01,741::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:01,741::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:01,741::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:01,741::__init__::232::IOProcess::(_processLogs) (465765) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:01,741::__init__::232::IOProcess::(_processLogs) (465765) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:03,950::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:03,952::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404858::DEBUG::2015-01-22 11:25:03,954::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:03,955::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:03,956::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404859::DEBUG::2015-01-22 11:25:03,958::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404859::DEBUG::2015-01-22 11:25:03,959::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:25:04,138::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:04,138::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:04,153::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:25:04,270::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:04,270::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:04,271::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:04,271::__init__::232::IOProcess::(_processLogs) (465766) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:04,271::__init__::232::IOProcess::(_processLogs) (465766) Queuing response Thread-63::DEBUG::2015-01-22 11:25:04,272::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:25:04,280::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000320264 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:04,281::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:04,281::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:04,281::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:04,281::__init__::232::IOProcess::(_processLogs) (465767) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:04,281::__init__::232::IOProcess::(_processLogs) (465767) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:06,985::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:06,987::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404860::DEBUG::2015-01-22 11:25:06,989::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:06,990::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:06,991::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404861::DEBUG::2015-01-22 11:25:06,993::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404861::DEBUG::2015-01-22 11:25:06,994::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:25:09,121::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. GuestMonitor-Sql::DEBUG::2015-01-22 11:25:09,158::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:09,159::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:09,160::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:10,024::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:10,025::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404862::DEBUG::2015-01-22 11:25:10,030::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa0ac2d0-077d-46e8-956a-f3a021a4b8ab`::moving from state init -> state preparing Thread-404862::INFO::2015-01-22 11:25:10,030::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404862::INFO::2015-01-22 11:25:10,031::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000320264', 'lastCheck': '5.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522814', 'lastCheck': '8.3', 'valid': True}} Thread-404862::DEBUG::2015-01-22 11:25:10,031::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa0ac2d0-077d-46e8-956a-f3a021a4b8ab`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000320264', 'lastCheck': '5.7', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522814', 'lastCheck': '8.3', 'valid': True}} Thread-404862::DEBUG::2015-01-22 11:25:10,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa0ac2d0-077d-46e8-956a-f3a021a4b8ab`::moving from state preparing -> state finished Thread-404862::DEBUG::2015-01-22 11:25:10,031::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404862::DEBUG::2015-01-22 11:25:10,031::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404862::DEBUG::2015-01-22 11:25:10,031::task::993::Storage.TaskManager.Task::(_decref) Task=`aa0ac2d0-077d-46e8-956a-f3a021a4b8ab`::ref 0 aborting False Thread-404862::ERROR::2015-01-22 11:25:10,032::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404862::DEBUG::2015-01-22 11:25:10,034::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:10,043::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:10,044::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404863::DEBUG::2015-01-22 11:25:10,046::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404863::DEBUG::2015-01-22 11:25:10,047::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:25:11,743::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:11,743::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:11,743::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:11,743::__init__::232::IOProcess::(_processLogs) (465768) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:11,745::__init__::232::IOProcess::(_processLogs) (465768) Queuing response Thread-64::DEBUG::2015-01-22 11:25:11,746::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:25:11,754::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000522426 s, 888 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:11,755::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:11,755::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:11,756::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:11,756::__init__::232::IOProcess::(_processLogs) (465769) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:11,756::__init__::232::IOProcess::(_processLogs) (465769) Queuing response Thread-21::DEBUG::2015-01-22 11:25:11,757::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:11,757::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:11,757::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:11,757::__init__::232::IOProcess::(_processLogs) (465770) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:11,758::__init__::232::IOProcess::(_processLogs) (465770) Queuing response Thread-21::DEBUG::2015-01-22 11:25:11,758::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:11,759::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:11,759::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:11,759::__init__::232::IOProcess::(_processLogs) (465771) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:11,759::__init__::232::IOProcess::(_processLogs) (465771) Queuing response Thread-21::DEBUG::2015-01-22 11:25:11,760::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:11,761::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:11,761::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:11,761::__init__::232::IOProcess::(_processLogs) (465772) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:11,761::__init__::232::IOProcess::(_processLogs) (465772) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:13,100::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:13,102::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404864::DEBUG::2015-01-22 11:25:13,104::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:13,105::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:13,106::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404865::DEBUG::2015-01-22 11:25:13,108::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404865::DEBUG::2015-01-22 11:25:13,109::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:25:14,166::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:14,166::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:14,174::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:25:14,283::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:14,283::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:14,283::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:14,284::__init__::232::IOProcess::(_processLogs) (465773) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:14,284::__init__::232::IOProcess::(_processLogs) (465773) Queuing response Thread-63::DEBUG::2015-01-22 11:25:14,284::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:25:14,292::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000348869 s, 923 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:14,293::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:14,294::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:14,294::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:14,294::__init__::232::IOProcess::(_processLogs) (465774) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:14,294::__init__::232::IOProcess::(_processLogs) (465774) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:16,142::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:16,144::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404866::DEBUG::2015-01-22 11:25:16,147::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:16,148::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:16,149::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404867::DEBUG::2015-01-22 11:25:16,151::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404867::DEBUG::2015-01-22 11:25:16,152::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:25:19,180::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:19,180::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:19,182::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:19,189::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request GuestMonitor-Sql::DEBUG::2015-01-22 11:25:19,191::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404868::DEBUG::2015-01-22 11:25:19,194::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:19,195::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:19,196::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404869::DEBUG::2015-01-22 11:25:19,198::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404869::DEBUG::2015-01-22 11:25:19,199::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:25:21,763::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:21,763::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:21,763::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:21,763::__init__::232::IOProcess::(_processLogs) (465775) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:21,765::__init__::232::IOProcess::(_processLogs) (465775) Queuing response Thread-64::DEBUG::2015-01-22 11:25:21,766::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:25:21,774::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000514777 s, 901 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:21,775::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:21,775::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:21,775::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:21,775::__init__::232::IOProcess::(_processLogs) (465776) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:21,776::__init__::232::IOProcess::(_processLogs) (465776) Queuing response Thread-21::DEBUG::2015-01-22 11:25:21,777::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:21,777::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:21,777::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:21,777::__init__::232::IOProcess::(_processLogs) (465777) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:21,777::__init__::232::IOProcess::(_processLogs) (465777) Queuing response Thread-21::DEBUG::2015-01-22 11:25:21,778::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:21,778::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:21,778::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:21,778::__init__::232::IOProcess::(_processLogs) (465778) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:21,779::__init__::232::IOProcess::(_processLogs) (465778) Queuing response Thread-21::DEBUG::2015-01-22 11:25:21,779::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:21,779::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:21,779::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:21,780::__init__::232::IOProcess::(_processLogs) (465779) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:21,780::__init__::232::IOProcess::(_processLogs) (465779) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:22,230::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:22,232::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404870::DEBUG::2015-01-22 11:25:22,234::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:22,235::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:22,237::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404871::DEBUG::2015-01-22 11:25:22,238::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404871::DEBUG::2015-01-22 11:25:22,239::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:25:24,199::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:24,200::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:24,206::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:25:24,296::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:24,296::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:24,296::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:24,296::__init__::232::IOProcess::(_processLogs) (465780) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:24,296::__init__::232::IOProcess::(_processLogs) (465780) Queuing response Thread-63::DEBUG::2015-01-22 11:25:24,297::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:25:24,306::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000250818 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:24,309::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:24,310::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:24,310::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:24,310::__init__::232::IOProcess::(_processLogs) (465781) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:24,310::__init__::232::IOProcess::(_processLogs) (465781) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:25,267::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:25,269::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404872::DEBUG::2015-01-22 11:25:25,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`524c7045-16ba-451a-ab88-7dcb88e858a1`::moving from state init -> state preparing Thread-404872::INFO::2015-01-22 11:25:25,273::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404872::INFO::2015-01-22 11:25:25,273::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250818', 'lastCheck': '1.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514777', 'lastCheck': '3.5', 'valid': True}} Thread-404872::DEBUG::2015-01-22 11:25:25,273::task::1191::Storage.TaskManager.Task::(prepare) Task=`524c7045-16ba-451a-ab88-7dcb88e858a1`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250818', 'lastCheck': '1.0', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514777', 'lastCheck': '3.5', 'valid': True}} Thread-404872::DEBUG::2015-01-22 11:25:25,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`524c7045-16ba-451a-ab88-7dcb88e858a1`::moving from state preparing -> state finished Thread-404872::DEBUG::2015-01-22 11:25:25,273::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404872::DEBUG::2015-01-22 11:25:25,274::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404872::DEBUG::2015-01-22 11:25:25,274::task::993::Storage.TaskManager.Task::(_decref) Task=`524c7045-16ba-451a-ab88-7dcb88e858a1`::ref 0 aborting False Thread-404872::ERROR::2015-01-22 11:25:25,275::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404872::DEBUG::2015-01-22 11:25:25,277::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:25,286::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:25,286::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404873::DEBUG::2015-01-22 11:25:25,289::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404873::DEBUG::2015-01-22 11:25:25,289::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:28,344::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:28,347::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404874::DEBUG::2015-01-22 11:25:28,353::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:28,354::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:28,357::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404875::DEBUG::2015-01-22 11:25:28,358::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404875::DEBUG::2015-01-22 11:25:28,359::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:25:29,212::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:29,213::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:29,226::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:31,395::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:31,397::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404876::DEBUG::2015-01-22 11:25:31,399::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:31,400::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:31,401::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404877::DEBUG::2015-01-22 11:25:31,403::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404877::DEBUG::2015-01-22 11:25:31,404::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:25:31,781::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:31,782::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:31,782::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:31,782::__init__::232::IOProcess::(_processLogs) (465782) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:31,784::__init__::232::IOProcess::(_processLogs) (465782) Queuing response Thread-64::DEBUG::2015-01-22 11:25:31,785::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:25:31,793::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000586781 s, 791 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:31,794::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:31,794::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:31,795::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:31,795::__init__::232::IOProcess::(_processLogs) (465783) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:31,795::__init__::232::IOProcess::(_processLogs) (465783) Queuing response Thread-21::DEBUG::2015-01-22 11:25:31,796::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:31,796::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:31,796::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:31,796::__init__::232::IOProcess::(_processLogs) (465784) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:31,797::__init__::232::IOProcess::(_processLogs) (465784) Queuing response Thread-21::DEBUG::2015-01-22 11:25:31,797::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:31,798::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:31,798::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:31,798::__init__::232::IOProcess::(_processLogs) (465785) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:31,798::__init__::232::IOProcess::(_processLogs) (465785) Queuing response Thread-21::DEBUG::2015-01-22 11:25:31,799::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:31,799::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:31,799::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:31,799::__init__::232::IOProcess::(_processLogs) (465786) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:31,800::__init__::232::IOProcess::(_processLogs) (465786) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:25:34,232::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:34,233::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:34,242::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:25:34,314::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:34,314::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:34,314::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:34,314::__init__::232::IOProcess::(_processLogs) (465787) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:34,315::__init__::232::IOProcess::(_processLogs) (465787) Queuing response Thread-63::DEBUG::2015-01-22 11:25:34,315::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:25:34,323::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000263405 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:34,324::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:34,324::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:34,324::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:34,325::__init__::232::IOProcess::(_processLogs) (465788) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:34,325::__init__::232::IOProcess::(_processLogs) (465788) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:34,435::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:34,437::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404878::DEBUG::2015-01-22 11:25:34,439::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:34,440::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:34,441::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404879::DEBUG::2015-01-22 11:25:34,443::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404879::DEBUG::2015-01-22 11:25:34,444::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:37,472::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:37,474::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404880::DEBUG::2015-01-22 11:25:37,476::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:37,477::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:37,478::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404881::DEBUG::2015-01-22 11:25:37,480::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404881::DEBUG::2015-01-22 11:25:37,481::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:25:39,157::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. GuestMonitor-Sql::DEBUG::2015-01-22 11:25:39,248::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:39,249::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:39,256::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:40,510::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:40,512::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404882::DEBUG::2015-01-22 11:25:40,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`222d0f7e-e229-4e86-a206-255c94ad70b2`::moving from state init -> state preparing Thread-404882::INFO::2015-01-22 11:25:40,515::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404882::INFO::2015-01-22 11:25:40,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000263405', 'lastCheck': '6.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586781', 'lastCheck': '8.7', 'valid': True}} Thread-404882::DEBUG::2015-01-22 11:25:40,515::task::1191::Storage.TaskManager.Task::(prepare) Task=`222d0f7e-e229-4e86-a206-255c94ad70b2`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000263405', 'lastCheck': '6.2', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586781', 'lastCheck': '8.7', 'valid': True}} Thread-404882::DEBUG::2015-01-22 11:25:40,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`222d0f7e-e229-4e86-a206-255c94ad70b2`::moving from state preparing -> state finished Thread-404882::DEBUG::2015-01-22 11:25:40,515::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404882::DEBUG::2015-01-22 11:25:40,516::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404882::DEBUG::2015-01-22 11:25:40,516::task::993::Storage.TaskManager.Task::(_decref) Task=`222d0f7e-e229-4e86-a206-255c94ad70b2`::ref 0 aborting False Thread-404882::ERROR::2015-01-22 11:25:40,517::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404882::DEBUG::2015-01-22 11:25:40,519::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:40,526::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:40,527::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404883::DEBUG::2015-01-22 11:25:40,529::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404883::DEBUG::2015-01-22 11:25:40,530::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:25:41,801::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:41,802::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:41,802::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:41,802::__init__::232::IOProcess::(_processLogs) (465789) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:41,803::__init__::232::IOProcess::(_processLogs) (465789) Queuing response Thread-64::DEBUG::2015-01-22 11:25:41,804::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:25:41,812::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000516823 s, 898 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:41,813::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:41,813::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:41,814::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:41,814::__init__::232::IOProcess::(_processLogs) (465790) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:41,814::__init__::232::IOProcess::(_processLogs) (465790) Queuing response Thread-21::DEBUG::2015-01-22 11:25:41,815::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:41,815::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:41,815::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:41,815::__init__::232::IOProcess::(_processLogs) (465791) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:41,816::__init__::232::IOProcess::(_processLogs) (465791) Queuing response Thread-21::DEBUG::2015-01-22 11:25:41,817::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:41,817::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:41,817::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:41,817::__init__::232::IOProcess::(_processLogs) (465792) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:41,817::__init__::232::IOProcess::(_processLogs) (465792) Queuing response Thread-21::DEBUG::2015-01-22 11:25:41,818::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:41,818::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:41,819::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:41,819::__init__::232::IOProcess::(_processLogs) (465793) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:41,819::__init__::232::IOProcess::(_processLogs) (465793) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:43,598::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:43,599::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404884::DEBUG::2015-01-22 11:25:43,602::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:43,603::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:43,604::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404885::DEBUG::2015-01-22 11:25:43,606::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404885::DEBUG::2015-01-22 11:25:43,607::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:25:44,263::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:44,263::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:44,272::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:25:44,326::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:44,326::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:44,326::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:44,326::__init__::232::IOProcess::(_processLogs) (465794) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:44,327::__init__::232::IOProcess::(_processLogs) (465794) Queuing response Thread-63::DEBUG::2015-01-22 11:25:44,327::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:25:44,336::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000279672 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:44,337::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:44,337::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:44,338::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:44,338::__init__::232::IOProcess::(_processLogs) (465795) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:44,338::__init__::232::IOProcess::(_processLogs) (465795) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:46,639::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:46,641::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404886::DEBUG::2015-01-22 11:25:46,643::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:46,644::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:46,645::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404887::DEBUG::2015-01-22 11:25:46,648::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404887::DEBUG::2015-01-22 11:25:46,649::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:25:49,278::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:49,278::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:49,286::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:49,678::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:49,679::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404888::DEBUG::2015-01-22 11:25:49,681::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:49,682::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:49,684::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404889::DEBUG::2015-01-22 11:25:49,685::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404889::DEBUG::2015-01-22 11:25:49,686::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:25:51,821::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:51,821::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:51,821::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:51,821::__init__::232::IOProcess::(_processLogs) (465796) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:51,823::__init__::232::IOProcess::(_processLogs) (465796) Queuing response Thread-64::DEBUG::2015-01-22 11:25:51,824::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:25:51,834::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000622536 s, 745 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:51,835::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:51,835::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:51,835::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:51,835::__init__::232::IOProcess::(_processLogs) (465797) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:51,835::__init__::232::IOProcess::(_processLogs) (465797) Queuing response Thread-21::DEBUG::2015-01-22 11:25:51,836::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:51,836::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:51,837::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:51,837::__init__::232::IOProcess::(_processLogs) (465798) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:51,837::__init__::232::IOProcess::(_processLogs) (465798) Queuing response Thread-21::DEBUG::2015-01-22 11:25:51,838::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:51,838::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:51,838::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:51,838::__init__::232::IOProcess::(_processLogs) (465799) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:51,838::__init__::232::IOProcess::(_processLogs) (465799) Queuing response Thread-21::DEBUG::2015-01-22 11:25:51,839::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:51,840::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:51,840::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:51,840::__init__::232::IOProcess::(_processLogs) (465800) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:25:51,840::__init__::232::IOProcess::(_processLogs) (465800) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:52,713::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:52,714::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404890::DEBUG::2015-01-22 11:25:52,717::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:52,718::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:52,719::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404891::DEBUG::2015-01-22 11:25:52,721::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404891::DEBUG::2015-01-22 11:25:52,722::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:25:54,292::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:54,293::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:54,300::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:25:54,340::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:54,340::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:54,340::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:54,340::__init__::232::IOProcess::(_processLogs) (465801) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:54,340::__init__::232::IOProcess::(_processLogs) (465801) Queuing response Thread-63::DEBUG::2015-01-22 11:25:54,341::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:25:54,349::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000319495 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:25:54,349::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:54,350::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:54,350::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:54,350::__init__::232::IOProcess::(_processLogs) (465802) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:25:54,350::__init__::232::IOProcess::(_processLogs) (465802) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:55,750::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:55,752::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404892::DEBUG::2015-01-22 11:25:55,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`497b3884-c4d8-4c92-95db-7dc8ccb7ddd2`::moving from state init -> state preparing Thread-404892::INFO::2015-01-22 11:25:55,756::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404892::INFO::2015-01-22 11:25:55,756::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000319495', 'lastCheck': '1.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622536', 'lastCheck': '3.9', 'valid': True}} Thread-404892::DEBUG::2015-01-22 11:25:55,756::task::1191::Storage.TaskManager.Task::(prepare) Task=`497b3884-c4d8-4c92-95db-7dc8ccb7ddd2`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000319495', 'lastCheck': '1.4', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622536', 'lastCheck': '3.9', 'valid': True}} Thread-404892::DEBUG::2015-01-22 11:25:55,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`497b3884-c4d8-4c92-95db-7dc8ccb7ddd2`::moving from state preparing -> state finished Thread-404892::DEBUG::2015-01-22 11:25:55,757::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404892::DEBUG::2015-01-22 11:25:55,757::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404892::DEBUG::2015-01-22 11:25:55,757::task::993::Storage.TaskManager.Task::(_decref) Task=`497b3884-c4d8-4c92-95db-7dc8ccb7ddd2`::ref 0 aborting False Thread-404892::ERROR::2015-01-22 11:25:55,758::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404892::DEBUG::2015-01-22 11:25:55,760::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:55,767::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:55,769::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404893::DEBUG::2015-01-22 11:25:55,771::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404893::DEBUG::2015-01-22 11:25:55,772::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:58,821::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:58,823::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404894::DEBUG::2015-01-22 11:25:58,824::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:25:58,825::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:25:58,827::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404895::DEBUG::2015-01-22 11:25:58,828::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404895::DEBUG::2015-01-22 11:25:58,829::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:25:59,306::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:59,306::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:25:59,319::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-360::DEBUG::2015-01-22 11:25:59,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c1f74cd-919a-4b16-84bb-dcbf4ad39b07`::moving from state init -> state preparing Thread-360::INFO::2015-01-22 11:25:59,748::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u'06e45ff6-0505-4692-b97d-896d9b710b49', spUUID='67c137fd-0cf2-463a-bc70-b427cc0a5da3', imgUUID=u'3bbc4173-2766-43ec-b677-e513204d3ee2', volUUID=u'a581abe6-3692-458a-bdc1-50c7a8e7687a', options=None) Thread-21::DEBUG::2015-01-22 11:25:59,749::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:59,749::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:59,749::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:59,749::__init__::232::IOProcess::(_processLogs) (465803) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:25:59,752::__init__::232::IOProcess::(_processLogs) (465803) Queuing response Thread-21::DEBUG::2015-01-22 11:25:59,753::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:25:59,753::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:25:59,753::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:25:59,753::__init__::232::IOProcess::(_processLogs) (465804) Got request for method 'stat' Thread-21::DEBUG::2015-01-22 11:25:59,753::__init__::232::IOProcess::(_processLogs) (465804) Queuing response Thread-360::INFO::2015-01-22 11:25:59,754::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:25:59,754::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c1f74cd-919a-4b16-84bb-dcbf4ad39b07`::finished: {'truesize': '6002049024', 'apparentsize': '6002049024'} Thread-360::DEBUG::2015-01-22 11:25:59,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c1f74cd-919a-4b16-84bb-dcbf4ad39b07`::moving from state preparing -> state finished Thread-360::DEBUG::2015-01-22 11:25:59,754::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-360::DEBUG::2015-01-22 11:25:59,754::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-360::DEBUG::2015-01-22 11:25:59,754::task::993::Storage.TaskManager.Task::(_decref) Task=`2c1f74cd-919a-4b16-84bb-dcbf4ad39b07`::ref 0 aborting False Thread-21::DEBUG::2015-01-22 11:26:01,842::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:01,842::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:01,842::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:01,842::__init__::232::IOProcess::(_processLogs) (465805) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:01,843::__init__::232::IOProcess::(_processLogs) (465805) Queuing response Thread-64::DEBUG::2015-01-22 11:26:01,844::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:26:01,854::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000462306 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:26:01,855::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:01,855::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:01,855::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:01,855::__init__::232::IOProcess::(_processLogs) (465806) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:01,855::__init__::232::IOProcess::(_processLogs) (465806) Queuing response Thread-21::DEBUG::2015-01-22 11:26:01,856::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:01,856::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:01,856::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:01,857::__init__::232::IOProcess::(_processLogs) (465807) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:01,858::__init__::232::IOProcess::(_processLogs) (465807) Queuing response Thread-21::DEBUG::2015-01-22 11:26:01,859::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:01,859::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:01,859::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:01,859::__init__::232::IOProcess::(_processLogs) (465808) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:01,859::__init__::232::IOProcess::(_processLogs) (465808) Queuing response Thread-21::DEBUG::2015-01-22 11:26:01,860::__init__::232::IOProcess::(_processLogs) Receiving request... JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:01,861::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message Thread-21::DEBUG::2015-01-22 11:26:01,861::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:01,863::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:01,866::__init__::232::IOProcess::(_processLogs) (465809) Got request for method 'access' JsonRpcServer::DEBUG::2015-01-22 11:26:01,865::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-21::DEBUG::2015-01-22 11:26:01,869::__init__::232::IOProcess::(_processLogs) (465809) Queuing response Thread-404896::DEBUG::2015-01-22 11:26:01,871::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:01,873::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:01,874::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404897::DEBUG::2015-01-22 11:26:01,876::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404897::DEBUG::2015-01-22 11:26:01,877::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:26:04,325::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:26:04,326::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:26:04,335::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:26:04,352::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:04,352::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:04,352::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:04,352::__init__::232::IOProcess::(_processLogs) (465810) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:04,352::__init__::232::IOProcess::(_processLogs) (465810) Queuing response Thread-63::DEBUG::2015-01-22 11:26:04,353::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:26:04,361::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000306444 s, 1.1 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:26:04,362::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:04,362::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:04,362::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:04,362::__init__::232::IOProcess::(_processLogs) (465811) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:04,362::__init__::232::IOProcess::(_processLogs) (465811) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:04,920::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:04,922::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404898::DEBUG::2015-01-22 11:26:04,924::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:04,925::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:04,926::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404899::DEBUG::2015-01-22 11:26:04,928::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404899::DEBUG::2015-01-22 11:26:04,929::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:07,960::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:07,961::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404900::DEBUG::2015-01-22 11:26:07,963::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:07,964::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:07,965::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404901::DEBUG::2015-01-22 11:26:07,967::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404901::DEBUG::2015-01-22 11:26:07,968::stompReactor::163::yajsonrpc.StompServer::(send) Sending response VM Channels Listener::DEBUG::2015-01-22 11:26:09,191::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. GuestMonitor-Sql::DEBUG::2015-01-22 11:26:09,341::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:26:09,341::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:26:09,349::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:10,999::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:11,000::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404902::DEBUG::2015-01-22 11:26:11,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`8605cd4c-459e-4cd9-819e-53ba30175309`::moving from state init -> state preparing Thread-404902::INFO::2015-01-22 11:26:11,004::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404902::INFO::2015-01-22 11:26:11,004::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306444', 'lastCheck': '6.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462306', 'lastCheck': '9.1', 'valid': True}} Thread-404902::DEBUG::2015-01-22 11:26:11,004::task::1191::Storage.TaskManager.Task::(prepare) Task=`8605cd4c-459e-4cd9-819e-53ba30175309`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306444', 'lastCheck': '6.6', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462306', 'lastCheck': '9.1', 'valid': True}} Thread-404902::DEBUG::2015-01-22 11:26:11,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`8605cd4c-459e-4cd9-819e-53ba30175309`::moving from state preparing -> state finished Thread-404902::DEBUG::2015-01-22 11:26:11,004::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404902::DEBUG::2015-01-22 11:26:11,004::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404902::DEBUG::2015-01-22 11:26:11,004::task::993::Storage.TaskManager.Task::(_decref) Task=`8605cd4c-459e-4cd9-819e-53ba30175309`::ref 0 aborting False Thread-404902::ERROR::2015-01-22 11:26:11,005::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404902::DEBUG::2015-01-22 11:26:11,008::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:11,016::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:11,017::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404903::DEBUG::2015-01-22 11:26:11,019::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404903::DEBUG::2015-01-22 11:26:11,019::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:26:11,873::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:11,873::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:11,873::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:11,873::__init__::232::IOProcess::(_processLogs) (465812) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:11,875::__init__::232::IOProcess::(_processLogs) (465812) Queuing response Thread-64::DEBUG::2015-01-22 11:26:11,876::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:26:11,885::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000478826 s, 969 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:26:11,886::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:11,886::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:11,886::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:11,886::__init__::232::IOProcess::(_processLogs) (465813) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:11,887::__init__::232::IOProcess::(_processLogs) (465813) Queuing response Thread-21::DEBUG::2015-01-22 11:26:11,888::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:11,888::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:11,888::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:11,888::__init__::232::IOProcess::(_processLogs) (465814) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:11,888::__init__::232::IOProcess::(_processLogs) (465814) Queuing response Thread-21::DEBUG::2015-01-22 11:26:11,889::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:11,889::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:11,889::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:11,890::__init__::232::IOProcess::(_processLogs) (465815) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:11,890::__init__::232::IOProcess::(_processLogs) (465815) Queuing response Thread-21::DEBUG::2015-01-22 11:26:11,891::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:11,891::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:11,891::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:11,891::__init__::232::IOProcess::(_processLogs) (465816) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:11,891::__init__::232::IOProcess::(_processLogs) (465816) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:14,080::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:14,081::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404904::DEBUG::2015-01-22 11:26:14,083::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:14,084::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:14,085::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404905::DEBUG::2015-01-22 11:26:14,087::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404905::DEBUG::2015-01-22 11:26:14,088::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:26:14,355::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:26:14,355::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:26:14,364::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:14,365::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:14,366::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:14,367::__init__::232::IOProcess::(_processLogs) (465817) Got request for method 'statvfs' GuestMonitor-Sql::DEBUG::2015-01-22 11:26:14,368::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:26:14,369::__init__::232::IOProcess::(_processLogs) (465817) Queuing response Thread-63::DEBUG::2015-01-22 11:26:14,372::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:26:14,380::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000239689 s, 1.3 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:26:14,380::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:14,381::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:14,381::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:14,381::__init__::232::IOProcess::(_processLogs) (465818) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:14,381::__init__::232::IOProcess::(_processLogs) (465818) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:17,114::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:17,115::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404906::DEBUG::2015-01-22 11:26:17,118::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:17,119::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:17,120::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404907::DEBUG::2015-01-22 11:26:17,122::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404907::DEBUG::2015-01-22 11:26:17,123::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:26:19,377::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:26:19,378::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:26:19,385::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:20,150::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:20,151::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404908::DEBUG::2015-01-22 11:26:20,153::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:20,154::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:20,155::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404909::DEBUG::2015-01-22 11:26:20,157::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404909::DEBUG::2015-01-22 11:26:20,157::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:26:21,894::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:21,895::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:21,895::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:21,895::__init__::232::IOProcess::(_processLogs) (465819) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:21,896::__init__::232::IOProcess::(_processLogs) (465819) Queuing response Thread-64::DEBUG::2015-01-22 11:26:21,897::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:26:21,907::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.000460088 s, 1.0 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:26:21,908::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:21,908::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:21,908::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:21,908::__init__::232::IOProcess::(_processLogs) (465820) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:21,908::__init__::232::IOProcess::(_processLogs) (465820) Queuing response Thread-21::DEBUG::2015-01-22 11:26:21,909::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:21,909::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:21,909::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:21,909::__init__::232::IOProcess::(_processLogs) (465821) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:21,910::__init__::232::IOProcess::(_processLogs) (465821) Queuing response Thread-21::DEBUG::2015-01-22 11:26:21,910::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:21,911::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:21,911::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:21,911::__init__::232::IOProcess::(_processLogs) (465822) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:21,911::__init__::232::IOProcess::(_processLogs) (465822) Queuing response Thread-21::DEBUG::2015-01-22 11:26:21,912::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:21,912::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:21,912::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:21,912::__init__::232::IOProcess::(_processLogs) (465823) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:21,912::__init__::232::IOProcess::(_processLogs) (465823) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:23,184::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:23,185::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404910::DEBUG::2015-01-22 11:26:23,187::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:23,188::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:23,189::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404911::DEBUG::2015-01-22 11:26:23,191::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404911::DEBUG::2015-01-22 11:26:23,192::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:26:24,382::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:24,383::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:24,388::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:24,388::__init__::232::IOProcess::(_processLogs) (465824) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:24,389::__init__::232::IOProcess::(_processLogs) (465824) Queuing response Thread-63::DEBUG::2015-01-22 11:26:24,389::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) GuestMonitor-Sql::DEBUG::2015-01-22 11:26:24,398::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-63::DEBUG::2015-01-22 11:26:24,399::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000249514 s, 1.3 MB/s\n'; = 0 GuestMonitor-Sql::DEBUG::2015-01-22 11:26:24,402::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:26:24,402::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:24,403::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:24,405::__init__::232::IOProcess::(_processLogs) Extracting request information... GuestMonitor-Sql::DEBUG::2015-01-22 11:26:24,406::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:26:24,406::__init__::232::IOProcess::(_processLogs) (465825) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:24,407::__init__::232::IOProcess::(_processLogs) (465825) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:26,220::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:26,221::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404912::DEBUG::2015-01-22 11:26:26,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`6aa4cc62-2b91-40f4-802a-2388f8175a40`::moving from state init -> state preparing Thread-404912::INFO::2015-01-22 11:26:26,225::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-404912::INFO::2015-01-22 11:26:26,225::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249514', 'lastCheck': '1.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460088', 'lastCheck': '4.3', 'valid': True}} Thread-404912::DEBUG::2015-01-22 11:26:26,225::task::1191::Storage.TaskManager.Task::(prepare) Task=`6aa4cc62-2b91-40f4-802a-2388f8175a40`::finished: {u'd26c38f9-0719-457c-8ce0-a074d1eff534': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249514', 'lastCheck': '1.8', 'valid': True}, u'06e45ff6-0505-4692-b97d-896d9b710b49': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460088', 'lastCheck': '4.3', 'valid': True}} Thread-404912::DEBUG::2015-01-22 11:26:26,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`6aa4cc62-2b91-40f4-802a-2388f8175a40`::moving from state preparing -> state finished Thread-404912::DEBUG::2015-01-22 11:26:26,225::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-404912::DEBUG::2015-01-22 11:26:26,226::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-404912::DEBUG::2015-01-22 11:26:26,226::task::993::Storage.TaskManager.Task::(_decref) Task=`6aa4cc62-2b91-40f4-802a-2388f8175a40`::ref 0 aborting False Thread-404912::ERROR::2015-01-22 11:26:26,227::API::1687::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info Traceback (most recent call last): File "/usr/share/vdsm/API.py", line 1674, in _getHaInfo host_id = instance.get_local_host_id() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id self._config = config.Config() File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ self._load(Config.static_files) File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load with open(fname, 'r') as f: IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' Thread-404912::DEBUG::2015-01-22 11:26:26,229::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:26,238::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:26,239::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404913::DEBUG::2015-01-22 11:26:26,240::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404913::DEBUG::2015-01-22 11:26:26,241::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:29,299::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:29,300::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404914::DEBUG::2015-01-22 11:26:29,302::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:29,303::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:29,304::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404915::DEBUG::2015-01-22 11:26:29,306::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404915::DEBUG::2015-01-22 11:26:29,307::stompReactor::163::yajsonrpc.StompServer::(send) Sending response GuestMonitor-Sql::DEBUG::2015-01-22 11:26:29,413::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:26:29,414::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:26:29,421::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:26:31,914::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:31,915::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:31,915::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:31,915::__init__::232::IOProcess::(_processLogs) (465826) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:31,917::__init__::232::IOProcess::(_processLogs) (465826) Queuing response Thread-64::DEBUG::2015-01-22 11:26:31,918::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/glusterSD/192.168.1.25:_Vol2/06e45ff6-0505-4692-b97d-896d9b710b49/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-64::DEBUG::2015-01-22 11:26:31,927::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n464 bytes (464 B) copied, 0.00052295 s, 887 kB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:26:31,928::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:31,928::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:31,928::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:31,928::__init__::232::IOProcess::(_processLogs) (465827) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:31,928::__init__::232::IOProcess::(_processLogs) (465827) Queuing response Thread-21::DEBUG::2015-01-22 11:26:31,929::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:31,930::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:31,930::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:31,930::__init__::232::IOProcess::(_processLogs) (465828) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:31,930::__init__::232::IOProcess::(_processLogs) (465828) Queuing response Thread-21::DEBUG::2015-01-22 11:26:31,931::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:31,931::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:31,931::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:31,931::__init__::232::IOProcess::(_processLogs) (465829) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:31,931::__init__::232::IOProcess::(_processLogs) (465829) Queuing response Thread-21::DEBUG::2015-01-22 11:26:31,932::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:31,932::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:31,932::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:31,932::__init__::232::IOProcess::(_processLogs) (465830) Got request for method 'access' Thread-21::DEBUG::2015-01-22 11:26:31,933::__init__::232::IOProcess::(_processLogs) (465830) Queuing response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:32,344::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:32,345::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404916::DEBUG::2015-01-22 11:26:32,348::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:32,349::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:32,350::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404917::DEBUG::2015-01-22 11:26:32,352::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404917::DEBUG::2015-01-22 11:26:32,353::stompReactor::163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2015-01-22 11:26:34,409::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:34,409::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... Thread-21::DEBUG::2015-01-22 11:26:34,409::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:34,410::__init__::232::IOProcess::(_processLogs) (465831) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:34,410::__init__::232::IOProcess::(_processLogs) (465831) Queuing response Thread-63::DEBUG::2015-01-22 11:26:34,410::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.24:_Data_ISO/d26c38f9-0719-457c-8ce0-a074d1eff534/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-63::DEBUG::2015-01-22 11:26:34,418::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n322 bytes (322 B) copied, 0.000264251 s, 1.2 MB/s\n'; = 0 Thread-21::DEBUG::2015-01-22 11:26:34,419::__init__::232::IOProcess::(_processLogs) Receiving request... Thread-21::DEBUG::2015-01-22 11:26:34,428::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... GuestMonitor-Sql::DEBUG::2015-01-22 11:26:34,429::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-21::DEBUG::2015-01-22 11:26:34,430::__init__::232::IOProcess::(_processLogs) Extracting request information... Thread-21::DEBUG::2015-01-22 11:26:34,431::__init__::232::IOProcess::(_processLogs) (465832) Got request for method 'statvfs' Thread-21::DEBUG::2015-01-22 11:26:34,433::__init__::232::IOProcess::(_processLogs) (465832) Queuing response GuestMonitor-Sql::DEBUG::2015-01-22 11:26:34,434::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set GuestMonitor-Sql::DEBUG::2015-01-22 11:26:34,439::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:35,381::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:35,382::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404918::DEBUG::2015-01-22 11:26:35,384::stompReactor::163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2015-01-22 11:26:35,386::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message JsonRpcServer::DEBUG::2015-01-22 11:26:35,387::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-404919::DEBUG::2015-01-22 11:26:35,389::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`e2f9460a-ece9-4b6a-9e03-295955020e9d`::Domain Metadata is not set Thread-404919::DEBUG::2015-01-22 11:26:35,390::stompReactor::163::yajsonrpc.StompServer::(send) Sending response