<div dir="ltr">Below are the logs..<br><br><br><br> tail -f /var/log/vdsm<br>vdsm/     vdsm-reg/ <br>[root@pbuovirt3 ~]# tail -f /var/log/vdsm/vdsm.log<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py&quot;, line 173, in _configure_broker_conn<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/env/config.py&quot;, line 129, in get<br>Exception: Configuration value not found: file=/etc/ovirt-hosted-engine/hosted-engine.conf, key=sdUUID<br>Thread-178420::DEBUG::2015-10-19 03:17:31,101::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-25::DEBUG::2015-10-19 03:17:31,112::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_var_lib_exports_iso/342d943d-bccb-49eb-abf5-be9f5a2afbb5/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-25::DEBUG::2015-10-19 03:17:31,123::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000262612 s, 1.3 MB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178421::DEBUG::2015-10-19 03:17:31,131::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-74698::DEBUG::2015-10-19 03:17:31,221::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present<br>Thread-178422::DEBUG::2015-10-19 03:17:34,156::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-178423::DEBUG::2015-10-19 03:17:37,164::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-32442::DEBUG::2015-10-19 03:17:37,824::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_home_export__domain/1484ea07-4269-44c4-a503-fa6bf43d8bd9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-32442::DEBUG::2015-10-19 03:17:37,834::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n347 bytes (347 B) copied, 0.000355762 s, 975 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-26::DEBUG::2015-10-19 03:17:39,764::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.206.10:_ovirt/49d4a9cd-946d-41e0-a7ae-f2620f010302/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-26::DEBUG::2015-10-19 03:17:39,773::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n329 bytes (329 B) copied, 0.00037456 s, 878 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178424::DEBUG::2015-10-19 03:17:40,172::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-25::DEBUG::2015-10-19 03:17:41,131::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_var_lib_exports_iso/342d943d-bccb-49eb-abf5-be9f5a2afbb5/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-25::DEBUG::2015-10-19 03:17:41,141::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000363463 s, 941 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178425::DEBUG::2015-10-19 03:17:43,179::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-74187::DEBUG::2015-10-19 03:17:44,816::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present<br>Thread-74194::DEBUG::2015-10-19 03:17:44,816::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present<br>Thread-178426::DEBUG::2015-10-19 03:17:46,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e671cc5-9f6d-457b-8ad1-2f41e898aa56`::moving from state init -&gt; state preparing<br>Thread-178426::INFO::2015-10-19 03:17:46,187::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)<br>Thread-178426::INFO::2015-10-19 03:17:46,188::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u&#39;342d943d-bccb-49eb-abf5-be9f5a2afbb5&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000363463&#39;, &#39;lastCheck&#39;: &#39;5.0&#39;, &#39;valid&#39;: True}, u&#39;1484ea07-4269-44c4-a503-fa6bf43d8bd9&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000355762&#39;, &#39;lastCheck&#39;: &#39;8.3&#39;, &#39;valid&#39;: True}, u&#39;49d4a9cd-946d-41e0-a7ae-f2620f010302&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 3, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.00037456&#39;, &#39;lastCheck&#39;: &#39;6.4&#39;, &#39;valid&#39;: True}}<br>Thread-178426::DEBUG::2015-10-19 03:17:46,188::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e671cc5-9f6d-457b-8ad1-2f41e898aa56`::finished: {u&#39;342d943d-bccb-49eb-abf5-be9f5a2afbb5&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000363463&#39;, &#39;lastCheck&#39;: &#39;5.0&#39;, &#39;valid&#39;: True}, u&#39;1484ea07-4269-44c4-a503-fa6bf43d8bd9&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000355762&#39;, &#39;lastCheck&#39;: &#39;8.3&#39;, &#39;valid&#39;: True}, u&#39;49d4a9cd-946d-41e0-a7ae-f2620f010302&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 3, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.00037456&#39;, &#39;lastCheck&#39;: &#39;6.4&#39;, &#39;valid&#39;: True}}<br>Thread-178426::DEBUG::2015-10-19 03:17:46,188::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e671cc5-9f6d-457b-8ad1-2f41e898aa56`::moving from state preparing -&gt; state finished<br>Thread-178426::DEBUG::2015-10-19 03:17:46,189::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}<br>Thread-178426::DEBUG::2015-10-19 03:17:46,189::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}<br>Thread-178426::DEBUG::2015-10-19 03:17:46,189::task::993::Storage.TaskManager.Task::(_decref) Task=`5e671cc5-9f6d-457b-8ad1-2f41e898aa56`::ref 0 aborting False<br>Thread-178426::ERROR::2015-10-19 03:17:46,191::config::103::ovirt_hosted_engine_ha.env.config::(_load) Configuration file &#39;/etc/ovirt-hosted-engine/hosted-engine.conf&#39; not available [[Errno 2] No such file or directory: &#39;/etc/ovirt-hosted-engine/hosted-engine.conf&#39;]<br>Thread-178426::ERROR::2015-10-19 03:17:46,191::config::103::ovirt_hosted_engine_ha.env.config::(_load) Configuration file &#39;/etc/ovirt-hosted-engine/vm.conf&#39; not available [[Errno 2] No such file or directory: &#39;/etc/ovirt-hosted-engine/vm.conf&#39;]<br>Thread-178426::ERROR::2015-10-19 03:17:46,191::API::1723::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info<br>Traceback (most recent call last):<br>  File &quot;/usr/share/vdsm/API.py&quot;, line 1703, in _getHaInfo<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py&quot;, line 100, in get_all_stats<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py&quot;, line 173, in _configure_broker_conn<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/env/config.py&quot;, line 129, in get<br>Exception: Configuration value not found: file=/etc/ovirt-hosted-engine/hosted-engine.conf, key=sdUUID<br>Thread-178426::DEBUG::2015-10-19 03:17:46,192::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-178427::DEBUG::2015-10-19 03:17:46,204::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-74698::DEBUG::2015-10-19 03:17:46,228::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present<br>Thread-32442::DEBUG::2015-10-19 03:17:47,841::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_home_export__domain/1484ea07-4269-44c4-a503-fa6bf43d8bd9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-32442::DEBUG::2015-10-19 03:17:47,852::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n347 bytes (347 B) copied, 0.000259381 s, 1.3 MB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178428::DEBUG::2015-10-19 03:17:49,229::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-26::DEBUG::2015-10-19 03:17:49,780::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.206.10:_ovirt/49d4a9cd-946d-41e0-a7ae-f2620f010302/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-26::DEBUG::2015-10-19 03:17:49,790::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n329 bytes (329 B) copied, 0.000346972 s, 948 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-25::DEBUG::2015-10-19 03:17:51,146::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_var_lib_exports_iso/342d943d-bccb-49eb-abf5-be9f5a2afbb5/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-25::DEBUG::2015-10-19 03:17:51,155::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000290823 s, 1.2 MB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178429::DEBUG::2015-10-19 03:17:52,238::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-178430::DEBUG::2015-10-19 03:17:55,246::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-32442::DEBUG::2015-10-19 03:17:57,859::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_home_export__domain/1484ea07-4269-44c4-a503-fa6bf43d8bd9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-32442::DEBUG::2015-10-19 03:17:57,868::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n347 bytes (347 B) copied, 0.000393319 s, 882 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178431::DEBUG::2015-10-19 03:17:58,255::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-26::DEBUG::2015-10-19 03:17:59,796::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.206.10:_ovirt/49d4a9cd-946d-41e0-a7ae-f2620f010302/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-26::DEBUG::2015-10-19 03:17:59,805::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n329 bytes (329 B) copied, 0.000300772 s, 1.1 MB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-74187::DEBUG::2015-10-19 03:17:59,827::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present<br>Thread-74194::DEBUG::2015-10-19 03:17:59,827::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present<br>Thread-25::DEBUG::2015-10-19 03:18:01,159::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_var_lib_exports_iso/342d943d-bccb-49eb-abf5-be9f5a2afbb5/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-25::DEBUG::2015-10-19 03:18:01,168::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000290265 s, 1.2 MB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-74698::DEBUG::2015-10-19 03:18:01,236::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present<br>Thread-178432::DEBUG::2015-10-19 03:18:01,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`fef96575-8a4c-486d-afc3-a346deec8ae0`::moving from state init -&gt; state preparing<br>Thread-178432::INFO::2015-10-19 03:18:01,262::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)<br>Thread-178432::INFO::2015-10-19 03:18:01,262::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u&#39;342d943d-bccb-49eb-abf5-be9f5a2afbb5&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000290265&#39;, &#39;lastCheck&#39;: &#39;0.1&#39;, &#39;valid&#39;: True}, u&#39;1484ea07-4269-44c4-a503-fa6bf43d8bd9&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000393319&#39;, &#39;lastCheck&#39;: &#39;3.4&#39;, &#39;valid&#39;: True}, u&#39;49d4a9cd-946d-41e0-a7ae-f2620f010302&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 3, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000300772&#39;, &#39;lastCheck&#39;: &#39;1.5&#39;, &#39;valid&#39;: True}}<br>Thread-178432::DEBUG::2015-10-19 03:18:01,263::task::1191::Storage.TaskManager.Task::(prepare) Task=`fef96575-8a4c-486d-afc3-a346deec8ae0`::finished: {u&#39;342d943d-bccb-49eb-abf5-be9f5a2afbb5&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000290265&#39;, &#39;lastCheck&#39;: &#39;0.1&#39;, &#39;valid&#39;: True}, u&#39;1484ea07-4269-44c4-a503-fa6bf43d8bd9&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000393319&#39;, &#39;lastCheck&#39;: &#39;3.4&#39;, &#39;valid&#39;: True}, u&#39;49d4a9cd-946d-41e0-a7ae-f2620f010302&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 3, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000300772&#39;, &#39;lastCheck&#39;: &#39;1.5&#39;, &#39;valid&#39;: True}}<br>Thread-178432::DEBUG::2015-10-19 03:18:01,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`fef96575-8a4c-486d-afc3-a346deec8ae0`::moving from state preparing -&gt; state finished<br>Thread-178432::DEBUG::2015-10-19 03:18:01,263::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}<br>Thread-178432::DEBUG::2015-10-19 03:18:01,263::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}<br>Thread-178432::DEBUG::2015-10-19 03:18:01,263::task::993::Storage.TaskManager.Task::(_decref) Task=`fef96575-8a4c-486d-afc3-a346deec8ae0`::ref 0 aborting False<br>Thread-178432::ERROR::2015-10-19 03:18:01,265::config::103::ovirt_hosted_engine_ha.env.config::(_load) Configuration file &#39;/etc/ovirt-hosted-engine/hosted-engine.conf&#39; not available [[Errno 2] No such file or directory: &#39;/etc/ovirt-hosted-engine/hosted-engine.conf&#39;]<br>Thread-178432::ERROR::2015-10-19 03:18:01,265::config::103::ovirt_hosted_engine_ha.env.config::(_load) Configuration file &#39;/etc/ovirt-hosted-engine/vm.conf&#39; not available [[Errno 2] No such file or directory: &#39;/etc/ovirt-hosted-engine/vm.conf&#39;]<br>Thread-178432::ERROR::2015-10-19 03:18:01,266::API::1723::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info<br>Traceback (most recent call last):<br>  File &quot;/usr/share/vdsm/API.py&quot;, line 1703, in _getHaInfo<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py&quot;, line 100, in get_all_stats<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py&quot;, line 173, in _configure_broker_conn<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/env/config.py&quot;, line 129, in get<br>Exception: Configuration value not found: file=/etc/ovirt-hosted-engine/hosted-engine.conf, key=sdUUID<br>Thread-178432::DEBUG::2015-10-19 03:18:01,267::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-178433::DEBUG::2015-10-19 03:18:01,278::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-178434::DEBUG::2015-10-19 03:18:04,302::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-178435::DEBUG::2015-10-19 03:18:07,313::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-32442::DEBUG::2015-10-19 03:18:07,873::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_home_export__domain/1484ea07-4269-44c4-a503-fa6bf43d8bd9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-32442::DEBUG::2015-10-19 03:18:07,882::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n347 bytes (347 B) copied, 0.000382904 s, 906 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-26::DEBUG::2015-10-19 03:18:09,810::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.206.10:_ovirt/49d4a9cd-946d-41e0-a7ae-f2620f010302/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-26::DEBUG::2015-10-19 03:18:09,819::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n329 bytes (329 B) copied, 0.000372718 s, 883 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178436::DEBUG::2015-10-19 03:18:10,320::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-25::DEBUG::2015-10-19 03:18:11,171::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_var_lib_exports_iso/342d943d-bccb-49eb-abf5-be9f5a2afbb5/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-25::DEBUG::2015-10-19 03:18:11,180::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000348527 s, 981 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178437::DEBUG::2015-10-19 03:18:13,325::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-74187::DEBUG::2015-10-19 03:18:14,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`d140d5d5-3cab-407a-8b3b-ddf2ddf16b14`::moving from state init -&gt; state preparing<br>Thread-74194::DEBUG::2015-10-19 03:18:14,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`06eb876d-eb40-49b4-870b-f75deb9a60cb`::moving from state init -&gt; state preparing<br>Thread-74187::INFO::2015-10-19 03:18:14,837::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u&#39;49d4a9cd-946d-41e0-a7ae-f2620f010302&#39;, spUUID=u&#39;a24369bc-3e57-451b-a21c-422c5aa7b1e5&#39;, imgUUID=u&#39;ae633317-e647-41df-81f5-d4c81c2c5def&#39;, volUUID=u&#39;31d5b7b7-f0f2-4287-ad8f-666e57c0ff61&#39;, options=None)<br>Thread-74194::INFO::2015-10-19 03:18:14,837::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u&#39;49d4a9cd-946d-41e0-a7ae-f2620f010302&#39;, spUUID=u&#39;a24369bc-3e57-451b-a21c-422c5aa7b1e5&#39;, imgUUID=u&#39;73367293-d532-48b5-9755-b323190df47f&#39;, volUUID=u&#39;64ebcf8d-ecd7-479f-ba9e-fff0d11a1c20&#39;, options=None)<br>Thread-74194::INFO::2015-10-19 03:18:14,843::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {&#39;truesize&#39;: &#39;6664757248&#39;, &#39;apparentsize&#39;: &#39;6664814592&#39;}<br>Thread-74187::INFO::2015-10-19 03:18:14,844::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {&#39;truesize&#39;: &#39;3695058944&#39;, &#39;apparentsize&#39;: &#39;3695181824&#39;}<br>Thread-74194::DEBUG::2015-10-19 03:18:14,844::task::1191::Storage.TaskManager.Task::(prepare) Task=`06eb876d-eb40-49b4-870b-f75deb9a60cb`::finished: {&#39;truesize&#39;: &#39;6664757248&#39;, &#39;apparentsize&#39;: &#39;6664814592&#39;}<br>Thread-74187::DEBUG::2015-10-19 03:18:14,845::task::1191::Storage.TaskManager.Task::(prepare) Task=`d140d5d5-3cab-407a-8b3b-ddf2ddf16b14`::finished: {&#39;truesize&#39;: &#39;3695058944&#39;, &#39;apparentsize&#39;: &#39;3695181824&#39;}<br>Thread-74194::DEBUG::2015-10-19 03:18:14,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`06eb876d-eb40-49b4-870b-f75deb9a60cb`::moving from state preparing -&gt; state finished<br>Thread-74187::DEBUG::2015-10-19 03:18:14,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`d140d5d5-3cab-407a-8b3b-ddf2ddf16b14`::moving from state preparing -&gt; state finished<br>Thread-74194::DEBUG::2015-10-19 03:18:14,846::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}<br>Thread-74187::DEBUG::2015-10-19 03:18:14,847::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}<br>Thread-74194::DEBUG::2015-10-19 03:18:14,847::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}<br>Thread-74187::DEBUG::2015-10-19 03:18:14,847::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}<br>Thread-74194::DEBUG::2015-10-19 03:18:14,848::task::993::Storage.TaskManager.Task::(_decref) Task=`06eb876d-eb40-49b4-870b-f75deb9a60cb`::ref 0 aborting False<br>Thread-74187::DEBUG::2015-10-19 03:18:14,848::task::993::Storage.TaskManager.Task::(_decref) Task=`d140d5d5-3cab-407a-8b3b-ddf2ddf16b14`::ref 0 aborting False<br>Thread-74187::DEBUG::2015-10-19 03:18:14,874::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present<br>Thread-74194::DEBUG::2015-10-19 03:18:14,874::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present<br>Thread-74698::DEBUG::2015-10-19 03:18:16,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`515b9bf4-d51b-48b8-847f-53816a01a7b7`::moving from state init -&gt; state preparing<br>Thread-74698::INFO::2015-10-19 03:18:16,240::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID=u&#39;49d4a9cd-946d-41e0-a7ae-f2620f010302&#39;, spUUID=u&#39;a24369bc-3e57-451b-a21c-422c5aa7b1e5&#39;, imgUUID=u&#39;86f7a0dc-6ad8-4690-bae7-e3e4248bff28&#39;, volUUID=u&#39;890ea1b5-9201-441e-8d4f-3fff58c00849&#39;, options=None)<br>Thread-74698::INFO::2015-10-19 03:18:16,246::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {&#39;truesize&#39;: &#39;7419543552&#39;, &#39;apparentsize&#39;: &#39;21474836480&#39;}<br>Thread-74698::DEBUG::2015-10-19 03:18:16,247::task::1191::Storage.TaskManager.Task::(prepare) Task=`515b9bf4-d51b-48b8-847f-53816a01a7b7`::finished: {&#39;truesize&#39;: &#39;7419543552&#39;, &#39;apparentsize&#39;: &#39;21474836480&#39;}<br>Thread-74698::DEBUG::2015-10-19 03:18:16,248::task::595::Storage.TaskManager.Task::(_updateState) Task=`515b9bf4-d51b-48b8-847f-53816a01a7b7`::moving from state preparing -&gt; state finished<br>Thread-74698::DEBUG::2015-10-19 03:18:16,248::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}<br>Thread-74698::DEBUG::2015-10-19 03:18:16,248::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}<br>Thread-74698::DEBUG::2015-10-19 03:18:16,249::task::993::Storage.TaskManager.Task::(_decref) Task=`515b9bf4-d51b-48b8-847f-53816a01a7b7`::ref 0 aborting False<br>Thread-74698::DEBUG::2015-10-19 03:18:16,273::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present<br>Thread-178438::DEBUG::2015-10-19 03:18:16,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3fb7540-0a63-49ef-a44e-05197d37b333`::moving from state init -&gt; state preparing<br>Thread-178438::INFO::2015-10-19 03:18:16,332::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)<br>Thread-178438::INFO::2015-10-19 03:18:16,332::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u&#39;342d943d-bccb-49eb-abf5-be9f5a2afbb5&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000348527&#39;, &#39;lastCheck&#39;: &#39;5.2&#39;, &#39;valid&#39;: True}, u&#39;1484ea07-4269-44c4-a503-fa6bf43d8bd9&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000382904&#39;, &#39;lastCheck&#39;: &#39;8.4&#39;, &#39;valid&#39;: True}, u&#39;49d4a9cd-946d-41e0-a7ae-f2620f010302&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 3, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000372718&#39;, &#39;lastCheck&#39;: &#39;6.5&#39;, &#39;valid&#39;: True}}<br>Thread-178438::DEBUG::2015-10-19 03:18:16,333::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3fb7540-0a63-49ef-a44e-05197d37b333`::finished: {u&#39;342d943d-bccb-49eb-abf5-be9f5a2afbb5&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000348527&#39;, &#39;lastCheck&#39;: &#39;5.2&#39;, &#39;valid&#39;: True}, u&#39;1484ea07-4269-44c4-a503-fa6bf43d8bd9&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 0, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000382904&#39;, &#39;lastCheck&#39;: &#39;8.4&#39;, &#39;valid&#39;: True}, u&#39;49d4a9cd-946d-41e0-a7ae-f2620f010302&#39;: {&#39;code&#39;: 0, &#39;actual&#39;: True, &#39;version&#39;: 3, &#39;acquired&#39;: True, &#39;delay&#39;: &#39;0.000372718&#39;, &#39;lastCheck&#39;: &#39;6.5&#39;, &#39;valid&#39;: True}}<br>Thread-178438::DEBUG::2015-10-19 03:18:16,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3fb7540-0a63-49ef-a44e-05197d37b333`::moving from state preparing -&gt; state finished<br>Thread-178438::DEBUG::2015-10-19 03:18:16,333::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}<br>Thread-178438::DEBUG::2015-10-19 03:18:16,333::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}<br>Thread-178438::DEBUG::2015-10-19 03:18:16,333::task::993::Storage.TaskManager.Task::(_decref) Task=`e3fb7540-0a63-49ef-a44e-05197d37b333`::ref 0 aborting False<br>Thread-178438::ERROR::2015-10-19 03:18:16,335::config::103::ovirt_hosted_engine_ha.env.config::(_load) Configuration file &#39;/etc/ovirt-hosted-engine/hosted-engine.conf&#39; not available [[Errno 2] No such file or directory: &#39;/etc/ovirt-hosted-engine/hosted-engine.conf&#39;]<br>Thread-178438::ERROR::2015-10-19 03:18:16,335::config::103::ovirt_hosted_engine_ha.env.config::(_load) Configuration file &#39;/etc/ovirt-hosted-engine/vm.conf&#39; not available [[Errno 2] No such file or directory: &#39;/etc/ovirt-hosted-engine/vm.conf&#39;]<br>Thread-178438::ERROR::2015-10-19 03:18:16,335::API::1723::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info<br>Traceback (most recent call last):<br>  File &quot;/usr/share/vdsm/API.py&quot;, line 1703, in _getHaInfo<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py&quot;, line 100, in get_all_stats<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py&quot;, line 173, in _configure_broker_conn<br>  File &quot;/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/env/config.py&quot;, line 129, in get<br>Exception: Configuration value not found: file=/etc/ovirt-hosted-engine/hosted-engine.conf, key=sdUUID<br>Thread-178438::DEBUG::2015-10-19 03:18:16,336::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-178439::DEBUG::2015-10-19 03:18:16,349::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-32442::DEBUG::2015-10-19 03:18:17,886::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_home_export__domain/1484ea07-4269-44c4-a503-fa6bf43d8bd9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-32442::DEBUG::2015-10-19 03:18:17,895::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n347 bytes (347 B) copied, 0.000457796 s, 758 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178440::DEBUG::2015-10-19 03:18:19,374::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-26::DEBUG::2015-10-19 03:18:19,825::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.206.10:_ovirt/49d4a9cd-946d-41e0-a7ae-f2620f010302/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-26::DEBUG::2015-10-19 03:18:19,834::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n329 bytes (329 B) copied, 0.00035298 s, 932 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-25::DEBUG::2015-10-19 03:18:21,182::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 342d943d-bccb-49eb-abf5-be9f5a2afbb5<br>Thread-178441::DEBUG::2015-10-19 03:18:21,185::__init__::298::IOProcessClient::(_run) Starting IOProcess...<br>Thread-178442::DEBUG::2015-10-19 03:18:21,196::__init__::298::IOProcessClient::(_run) Starting IOProcess...<br>Thread-178443::DEBUG::2015-10-19 03:18:21,208::__init__::298::IOProcessClient::(_run) Starting IOProcess...<br>Thread-25::DEBUG::2015-10-19 03:18:21,239::fileSD::153::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.204.207.171:_var_lib_exports_iso/342d943d-bccb-49eb-abf5-be9f5a2afbb5<br>Thread-25::DEBUG::2015-10-19 03:18:21,242::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend<br>Thread-25::DEBUG::2015-10-19 03:18:21,245::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[&#39;CLASS=Iso&#39;, &#39;DESCRIPTION=ISO_DOMAIN&#39;, &#39;IOOPTIMEOUTSEC=10&#39;, &#39;LEASERETRIES=3&#39;, &#39;LEASETIMESEC=60&#39;, &#39;LOCKPOLICY=&#39;, &#39;LOCKRENEWALINTERVALSEC=5&#39;, &#39;POOL_UUID=a24369bc-3e57-451b-a21c-422c5aa7b1e5&#39;, &#39;REMOTE_PATH=10.204.207.171:/var/lib/exports/iso&#39;, &#39;ROLE=Regular&#39;, &#39;SDUUID=342d943d-bccb-49eb-abf5-be9f5a2afbb5&#39;, &#39;TYPE=NFS&#39;, &#39;VERSION=0&#39;, &#39;_SHA_CKSUM=93a3e46086203d6e02fc76fd6c8db89d8903846f&#39;]<br>Thread-25::DEBUG::2015-10-19 03:18:21,247::fileSD::632::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []<br>Thread-25::INFO::2015-10-19 03:18:21,248::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 342d943d-bccb-49eb-abf5-be9f5a2afbb5_imageNS already registered<br>Thread-25::INFO::2015-10-19 03:18:21,248::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 342d943d-bccb-49eb-abf5-be9f5a2afbb5_volumeNS already registered<br>Thread-25::DEBUG::2015-10-19 03:18:21,249::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_var_lib_exports_iso/342d943d-bccb-49eb-abf5-be9f5a2afbb5/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-25::DEBUG::2015-10-19 03:18:21,258::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000359113 s, 952 kB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178444::DEBUG::2015-10-19 03:18:22,381::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-178445::DEBUG::2015-10-19 03:18:25,390::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>Thread-32442::DEBUG::2015-10-19 03:18:27,899::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.171:_home_export__domain/1484ea07-4269-44c4-a503-fa6bf43d8bd9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br>Thread-32442::DEBUG::2015-10-19 03:18:27,908::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: &lt;err&gt; = &#39;0+1 records in\n0+1 records out\n347 bytes (347 B) copied, 0.000332208 s, 1.0 MB/s\n&#39;; &lt;rc&gt; = 0<br>Thread-178446::DEBUG::2015-10-19 03:18:28,396::stompReactor::162::yajsonrpc.StompServer::(send) Sending response<br>^C<br><br><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Oct 16, 2015 at 4:59 PM, Nir Soffer <span dir="ltr">&lt;<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr"><br>
בתאריך 16 באוק׳ 2015 2:10 אחה״צ,‏ &quot;Budur Nagaraju&quot; &lt;<a href="mailto:nbudoor@gmail.com" target="_blank">nbudoor@gmail.com</a>&gt; כתב:<span class=""><br>
&gt;<br>
&gt; Below are the details,<br>
&gt;<br>
&gt; Template size :virtual size 20GB ,actual size :4GB<br>
&gt; Storage server :Dell mounted through NFS storage capacity 2TB<br>
&gt; Free space :1.5TB<br>
&gt;<br>
&gt; There is no warn message in the engine ,let me know what logs you are expecting ?</span></p>
<p dir="ltr">vdsm.log showing the these 15 minutes may be useful.<span class=""><br>
&gt;<br>
&gt; Thanks,<br>
&gt; Nagaraju<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt; On Fri, Oct 16, 2015 at 4:24 PM, Nir Soffer &lt;<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>&gt; wrote:<br>
&gt;&gt;<br>
&gt;&gt;<br>
&gt;&gt; בתאריך 16 באוק׳ 2015 9:11 לפנה״צ,‏ &quot;Budur Nagaraju&quot; &lt;<a href="mailto:nbudoor@gmail.com" target="_blank">nbudoor@gmail.com</a>&gt; כתב:<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; HI ,<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; While a deploying a vm from the template ,its taking minimum 15 minutes is there any ways to solve the issues ?<br>
&gt;&gt;<br>
&gt;&gt; What is the template size? storage server? network? free space on storage? logs?<br>
&gt;&gt;<br>
&gt;&gt; Nir<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; Thanks,<br>
&gt;&gt; &gt; Nagaraju<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; _______________________________________________<br>
&gt;&gt; &gt; Users mailing list<br>
&gt;&gt; &gt; <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
&gt;&gt; &gt; <a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
&gt;&gt; &gt;<br>
&gt;<br>
&gt;<br>
</span></p>
</blockquote></div><br></div>