<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Ok, so the mount logs do not have any errors - only messages
regarding dir creation and file renames.<br>
<br>
Yaniv's already answered regarding the log messages.<br>
<br>
<div class="moz-cite-prefix">On 11/03/2015 06:14 PM, Christophe
TREFOIS wrote:<br>
</div>
<blockquote cite="mid:E85DBDC7-07A4-4BEF-A5C1-F17D6176979F@uni.lu"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<div class="" style="word-wrap:break-word">Dear Sahina,
<div class=""><br class="">
</div>
<div class="">I attached the logs from the glusterfs folder. </div>
<div class=""><br class="">
</div>
</div>
<div class="" style="word-wrap:break-word">
<div class=""><br class="">
</div>
<div class="">thank you for your help,</div>
<div class=""><br class="">
</div>
<div class="">Kind regards,</div>
<div class=""><br class="">
</div>
<div class="">—</div>
<div class="">Christophe
<div class="">
<div class="" style="color:rgb(0,0,0);
letter-spacing:normal; orphans:auto; text-align:start;
text-indent:0px; text-transform:none; white-space:normal;
widows:auto; word-spacing:0px; word-wrap:break-word">
<span class="x_Apple-converted-space"> </span></div>
</div>
<br class="">
<div>
<blockquote type="cite" class="">
<div class="">On 03 Nov 2015, at 09:04, Sahina Bose <<a
moz-do-not-send="true" href="mailto:sabose@redhat.com"
class=""><a class="moz-txt-link-abbreviated" href="mailto:sabose@redhat.com">sabose@redhat.com</a></a>> wrote:</div>
<br class="x_Apple-interchange-newline">
<div class="">
<div bgcolor="#FFFFFF" class="">Could you also attach
the glusterfs and gluster mount logs from the
hypervisor? (Logs would be at /var/log/glusterfs)<br
class="">
<br class="">
<div class="x_moz-cite-prefix">On 11/03/2015 01:22 PM,
Christophe TREFOIS wrote:<br class="">
</div>
<blockquote type="cite" class="">Hi,
<div class=""><br class="">
</div>
<div class="">I checked the logs on my hypervisor
that contains also the overt-engine (self-hosted)
and I see strange unknown libvirterrors that come
periodically in the vdsm.log file. The storage is
glusterFS running on the hypervisor as well, one
NFS export domain and an ISO domain. A NFS domain
from another place is in maintenance mode.</div>
<div class=""><br class="">
</div>
<div class="">I am running oVirt 3.5.3.</div>
<div class=""><br class="">
</div>
<div class="">Thank you for any pointers as to where
to start fixing this issue.</div>
<div class=""><br class="">
</div>
<div class="">— log excerpt --</div>
<div class="">
<div class=""><br class="">
</div>
<div class="">
<div class="">Thread-1947641::DEBUG::2015-11-03
08:47:31,398::stompReactor::163::yajsonrpc.StompServer::(send)
Sending response</div>
<div class="">Thread-8108::DEBUG::2015-11-03
08:47:31,410::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Dummy-1895260::DEBUG::2015-11-03
08:47:31,477::storage_<a
moz-do-not-send="true"
class="x_moz-txt-link-freetext" href=""><a class="moz-txt-link-freetext" href="mailbox::731::Storage.Misc.excCmd::(_checkForMail)">mailbox::731::Storage.Misc.excCmd::(_checkForMail)</a></a>
dd
if=/rhev/data-center/00000002-0002-0002-0002-0000000003d5/mastersd/dom_md/inbox
iflag=direct,fullblock count=1 bs=1024000 (cwd
None)</div>
<div class="">Dummy-1895260::DEBUG::2015-11-03
08:47:31,501::storage_<a
moz-do-not-send="true"
class="x_moz-txt-link-freetext" href=""><a class="moz-txt-link-freetext" href="mailbox::731::Storage.Misc.excCmd::(_checkForMail)">mailbox::731::Storage.Misc.excCmd::(_checkForMail)</a></a>
SUCCESS: <err> = '1+0 records in\n1+0
records out\n1024000 bytes (1.0 MB) copied,
0.00331278 s, 309 MB/s\n'; <rc> = 0</div>
<div class="">Thread-7913::DEBUG::2015-11-03
08:47:32,298::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Thread-5682::DEBUG::2015-11-03
08:47:32,417::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Detector thread::DEBUG::2015-11-03
08:47:32,591::protocoldetector::187::vds.MultiProtocolAcceptor::(_add_connection)
Adding connection from 127.0.0.1:44671</div>
<div class="">Detector thread::DEBUG::2015-11-03
08:47:32,598::protocoldetector::201::vds.MultiProtocolAcceptor::(_remove_connection)
Connection removed from 127.0.0.1:44671</div>
<div class="">Detector thread::DEBUG::2015-11-03
08:47:32,599::protocoldetector::247::vds.MultiProtocolAcceptor::(_handle_connection_read)
Detected protocol xml from 127.0.0.1:44671</div>
<div class="">Detector thread::DEBUG::2015-11-03
08:47:32,599::BindingXMLRPC::1173::XmlDetector::(handleSocket)
xml over http detected from ('127.0.0.1',
44671)</div>
<div class="">Thread-1947642::DEBUG::2015-11-03
08:47:32,602::task::595::Storage.TaskManager.Task::(_updateState)
Task=`1d99a166-cb9a-4025-8211-a48e210b5234`::moving
from state init -> state preparing</div>
<div class="">Thread-1947642::<a
moz-do-not-send="true"
class="x_moz-txt-link-freetext" href=""><a class="moz-txt-link-freetext" href="INFO::2015-11-03">INFO::2015-11-03</a></a>
08:47:32,603::logUtils::44::dispatcher::(wrapper)
Run and protect: repoStats(options=None)</div>
<div class="">Thread-1947642::<a
moz-do-not-send="true"
class="x_moz-txt-link-freetext" href=""><a class="moz-txt-link-freetext" href="INFO::2015-11-03">INFO::2015-11-03</a></a>
08:47:32,603::logUtils::47::dispatcher::(wrapper)
Run and protect: repoStats, Return response:
{u'de9eb737-691f-4622-9070-891531d599a0':
{'code': 0, 'actual': True, 'version': 0,
'acquired': True, 'delay': '0.000373613',
'lastCheck': '2.5', 'valid': True},
u'fe4fd19a-8714-44e0-ae41-663a4b62da7a':
{'code': 0, 'actual': True, 'version': 0,
'acquired': True, 'delay': '0.000409446',
'lastCheck': '6.4', 'valid': True},
u'8253a89b-651e-4ff4-865b-57adef05d383':
{'code': 0, 'actual': True, 'version': 3,
'acquired': True, 'delay': '0.000520671',
'lastCheck': '1.8', 'valid': True},
'b18eb29e-8bb1-45b9-a60e-a8e07210e066':
{'code': 0, 'actual': True, 'version': 3,
'acquired': True, 'delay': '0.000424445',
'lastCheck': '6.5', 'valid': True}}</div>
<div class="">Thread-1947642::DEBUG::2015-11-03
08:47:32,603::task::1191::Storage.TaskManager.Task::(prepare)
Task=`1d99a166-cb9a-4025-8211-a48e210b5234`::finished:
{u'de9eb737-691f-4622-9070-891531d599a0':
{'code': 0, 'actual': True, 'version': 0,
'acquired': True, 'delay': '0.000373613',
'lastCheck': '2.5', 'valid': True},
u'fe4fd19a-8714-44e0-ae41-663a4b62da7a':
{'code': 0, 'actual': True, 'version': 0,
'acquired': True, 'delay': '0.000409446',
'lastCheck': '6.4', 'valid': True},
u'8253a89b-651e-4ff4-865b-57adef05d383':
{'code': 0, 'actual': True, 'version': 3,
'acquired': True, 'delay': '0.000520671',
'lastCheck': '1.8', 'valid': True},
'b18eb29e-8bb1-45b9-a60e-a8e07210e066':
{'code': 0, 'actual': True, 'version': 3,
'acquired': True, 'delay': '0.000424445',
'lastCheck': '6.5', 'valid': True}}</div>
<div class="">Thread-1947642::DEBUG::2015-11-03
08:47:32,603::task::595::Storage.TaskManager.Task::(_updateState)
Task=`1d99a166-cb9a-4025-8211-a48e210b5234`::moving
from state preparing -> state finished</div>
<div class="">Thread-1947642::DEBUG::2015-11-03
08:47:32,604::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll)
Owner.releaseAll requests {} resources {}</div>
<div class="">Thread-1947642::DEBUG::2015-11-03
08:47:32,604::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll)
Owner.cancelAll requests {}</div>
<div class="">Thread-1947642::DEBUG::2015-11-03
08:47:32,604::task::993::Storage.TaskManager.Task::(_decref)
Task=`1d99a166-cb9a-4025-8211-a48e210b5234`::ref
0 aborting False</div>
<div class="">Thread-6348::DEBUG::2015-11-03
08:47:33,261::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Thread-7286::DEBUG::2015-11-03
08:47:33,462::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Dummy-1895260::DEBUG::2015-11-03
08:47:33,514::storage_<a
moz-do-not-send="true"
class="x_moz-txt-link-freetext" href=""><a class="moz-txt-link-freetext" href="mailbox::731::Storage.Misc.excCmd::(_checkForMail)">mailbox::731::Storage.Misc.excCmd::(_checkForMail)</a></a>
dd
if=/rhev/data-center/00000002-0002-0002-0002-0000000003d5/mastersd/dom_md/inbox
iflag=direct,fullblock count=1 bs=1024000 (cwd
None)</div>
<div class="">Dummy-1895260::DEBUG::2015-11-03
08:47:33,540::storage_<a
moz-do-not-send="true"
class="x_moz-txt-link-freetext" href=""><a class="moz-txt-link-freetext" href="mailbox::731::Storage.Misc.excCmd::(_checkForMail)">mailbox::731::Storage.Misc.excCmd::(_checkForMail)</a></a>
SUCCESS: <err> = '1+0 records in\n1+0
records out\n1024000 bytes (1.0 MB) copied,
0.00385901 s, 265 MB/s\n'; <rc> = 0</div>
<div class="">Thread-7627::DEBUG::2015-11-03
08:47:33,938::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Thread-7951::DEBUG::2015-11-03
08:47:33,938::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Thread-3882::DEBUG::2015-11-03
08:47:33,940::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Thread-7967::DEBUG::2015-11-03
08:47:33,940::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Thread-7899::DEBUG::2015-11-03
08:47:33,951::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,383::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 133.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,383::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 135.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,383::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 136.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,383::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 146.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,384::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 160.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,384::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 161.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,384::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 167.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,384::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 171.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,384::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 172.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,384::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 159.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,385::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 189.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,385::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 190.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,385::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 195.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,385::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 197.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,385::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 198.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,385::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 213.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,386::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 215.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,386::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 98.</div>
<div class="">VM Channels
Listener::DEBUG::2015-11-03
08:47:34,386::vmchannels::96::vds::(_handle_timeouts)
Timeout on fileno 125.</div>
<div class="">JsonRpc
(StompReactor)::DEBUG::2015-11-03
08:47:34,412::stompReactor::98::Broker.StompAdapter::(handle_frame)
Handling message <StompFrame
command='SEND'></div>
<div class="">JsonRpcServer::DEBUG::2015-11-03
08:47:34,413::__init__::530::jsonrpc.JsonRpcServer::(serve_requests)
Waiting for request</div>
<div class="">Thread-1947643::DEBUG::2015-11-03
08:47:34,437::stompReactor::163::yajsonrpc.StompServer::(send)
Sending response</div>
<div class="">Thread-7613::DEBUG::2015-11-03
08:47:34,713::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Thread-6393::DEBUG::2015-11-03
08:47:34,713::libvirtconnection::143::root::(wrapper)
Unknown libvirterror: ecode: 80 edom: 20
level: 2 message: metadata not found:
Requested metadata element is not present</div>
<div class="">Thread-226941::DEBUG::2015-11-03
08:47:35,511::task::595::Storage.TaskManager.Task::(_updateState)
Task=`bdf26401-324c-4220-9034-19c7d816f642`::moving
from state init -> state preparing</div>
<div class="">Thread-4709::DEBUG::2015-11-03
08:47:35,511::task::595::Storage.TaskManager.Task::(_updateState)
Task=`0ac2f854-41e3-4427-a0f4-5eaa1842e212`::moving
from state init -> state preparing</div>
<div class="">
<div class="" style="letter-spacing:normal;
orphans:auto; text-align:start;
text-indent:0px; text-transform:none;
white-space:normal; widows:auto;
word-spacing:0px; word-wrap:break-word">
<p class=""
style="font-family:Arial,sans-serif;
font-size:10pt; line-height:16px">
<font class="" color="#3d3b3b"><b class="">--</b></font></p>
<div class="">Christophe</div>
<span class="x_Apple-converted-space"
style=""> </span></div>
</div>
<br class="">
</div>
</div>
<br class="">
<fieldset class="x_mimeAttachmentHeader"></fieldset>
<br class="">
<pre class="">_______________________________________________
Users mailing list
<a moz-do-not-send="true" class="x_moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a moz-do-not-send="true" class="x_moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br class="">
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
</blockquote>
<br>
</body>
</html>