7:17 p.m.
This is a multi-part message in MIME format.
--------------5D6A91148DA6085EC6E1019D
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
Hi,
we have a failed test that is caused by failing to start vdsm on host-0.
**
*Link to suspected patches: *
*
patch reported as reason: https://gerrit.ovirt.org/#/c/83275/
**
patch reported as a more likely reason: https://gerrit.ovirt.org/#/c/83186/3
*
**
*Link to
Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3505*
**
**
*Link to all logs:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3505/artifact*
***
(Relevant) error snippet from the log:
<error>
Error in host deploy log:
*
*2017-10-27 11:52:22,516-0400 DEBUG otopi.plugins.otopi.services.systemd
plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start',
'vdsmd.service') stderr:
A dependency job for vdsmd.service failed. See 'journalctl -xe' for details.
2017-10-27 11:52:22,516-0400 DEBUG otopi.context
context._executeMethod:143 method exception
Traceback (most recent call last):
File "/tmp/ovirt-GJGz7NSZHZ/pythonlib/otopi/context.py", line 133, in
_executeMethod
method['method']()
File
"/tmp/ovirt-GJGz7NSZHZ/otopi-plugins/ovirt-host-deploy/vdsm/packages.py",
line 220, in _start
self.services.state('vdsmd', True)
File "/tmp/ovirt-GJGz7NSZHZ/otopi-plugins/otopi/services/systemd.py",
line 141, in state
service=name,
RuntimeError: Failed to start service 'vdsmd'
2017-10-27 11:52:22,519-0400 ERROR otopi.context
context._executeMethod:152 Failed to execute stage 'Closing up': Failed
to start service 'vdsmd'
2017-10-27 11:52:22,520-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND **%EventEnd STAGE closeup
METHOD otopi.plugins.ovirt_host_deploy.vdsm.packages.Plugin._start
(odeploycons.packages.vdsm.started
)
*
*
*
*Actual error from messages log:
*
*
*
*Oct 27 11:52:24 lago-basic-suite-master-host-0 systemd: Started
Auxiliary vdsm service for running helper functions as root.
Oct 27 11:52:24 lago-basic-suite-master-host-0 systemd: Starting
Auxiliary vdsm service for running helper functions as root...
Oct 27 11:52:24 lago-basic-suite-master-host-0 python2: detected
unhandled Python exception in '/usr/share/vdsm/supervdsmd'
Oct 27 11:52:24 lago-basic-suite-master-host-0 abrt-server: Not saving
repeating crash in '/usr/share/vdsm/supervdsmd'
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: Traceback
(most recent call last):
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File
"/usr/share/vdsm/supervdsmd", line 22, in <module>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm
import supervdsm_server
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File
"/usr/lib/python2.7/site-packages/vdsm/supervdsm_server.py", line 50, in
<module>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from
vdsm.storage import fuser
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File
"/usr/lib/python2.7/site-packages/vdsm/storage/fuser.py", line 25, in
<module>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from
vdsm.storage import misc
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File
"/usr/lib/python2.7/site-packages/vdsm/storage/misc.py", line 50, in
<module>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm
import commands
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File
"/usr/lib/python2.7/site-packages/vdsm/commands.py", line 33, in <module>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from
.utils import terminating
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File
"/usr/lib/python2.7/site-packages/vdsm/utils.py", line 47, in <module>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from
vdsm.common.compat import pickle
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File
"/usr/lib/python2.7/site-packages/vdsm/common/compat.py", line 86, in
<module>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: import
subprocess32 as subprocess
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
ImportError: No module named subprocess32
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd:
supervdsmd.service: main process exited, code=exited, status=1/FAILURE
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Unit
supervdsmd.service entered failed state.
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd:
supervdsmd.service failed.
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd:
supervdsmd.service holdoff time over, scheduling restart.
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: start request
repeated too quickly for supervdsmd.service
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Failed to start
Auxiliary vdsm service for running helper functions as root.
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Unit
supervdsmd.service entered failed state.
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd:
supervdsmd.service failed.
*
*</error>*
*
*
*
*
--------------5D6A91148DA6085EC6E1019D
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta http-equiv="content-type" content="text/html;
charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Hi, <br>
</p>
<p>we have a failed test that is caused by failing to start vdsm on
host-0. <br>
</p>
<p><br>
</p>
<p><b><span style="font-weight:normal;">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span
style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link
to suspected patches:
</span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span
style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">patch
reported as reason: <a class="moz-txt-link-freetext"
href="https://gerrit.ovirt.org/#/c/83275/">https://gerrit.ov...
</span></b><b><span
style="font-weight:normal;">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span
style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">patch
reported as a more likely reason: </span><span
style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"></span><a
class="moz-txt-link-freetext"
href="https://gerrit.ovirt.org/#/c/83186/3">https://gerrit.o...
</span></b></p>
<p><b><span style="font-weight:normal;">
<p><span
style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link
to Job:</span><span
style="font-weight:normal;">
<a class="moz-txt-link-freetext"
href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/...
</span></b></p>
<p><b><span style="font-weight:normal;">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span
style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link
to all logs: <a class="moz-txt-link-freetext"
href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/...
</span></b><b><span
style="font-weight:normal;"><br>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span
style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">(Relevant)
error snippet from the log: </span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span
style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"><error></span></p>
<br>
Error in host deploy log: <br>
</span></b></p>
<p><b><span style="font-weight:normal;">2017-10-27
11:52:22,516-0400
DEBUG otopi.plugins.otopi.services.systemd plugin.execute:926
execute-output: ('/usr/bin/systemctl', 'start',
'vdsmd.service') stderr:<br>
A dependency job for vdsmd.service failed. See 'journalctl
-xe' for details.<br>
<br>
2017-10-27 11:52:22,516-0400 DEBUG otopi.context
context._executeMethod:143 method exception<br>
Traceback (most recent call last):<br>
File "/tmp/ovirt-GJGz7NSZHZ/pythonlib/otopi/context.py",
line 133, in _executeMethod<br>
method['method']()<br>
File
"/tmp/ovirt-GJGz7NSZHZ/otopi-plugins/ovirt-host-deploy/vdsm/packages.py",
line 220, in _start<br>
self.services.state('vdsmd', True)<br>
File
"/tmp/ovirt-GJGz7NSZHZ/otopi-plugins/otopi/services/systemd.py",
line 141, in state<br>
service=name,<br>
RuntimeError: Failed to start service 'vdsmd'<br>
2017-10-27 11:52:22,519-0400 ERROR otopi.context
context._executeMethod:152 Failed to execute stage 'Closing
up': Failed to start service 'vdsmd'<br>
2017-10-27 11:52:22,520-0400 DEBUG
otopi.plugins.otopi.dialog.machine dialog.__logString:204
DIALOG:SEND **%EventEnd STAGE closeup METHOD
otopi.plugins.ovirt_host_deploy.vdsm.packages.Plugin._start
(odeploycons.packages.vdsm.started<br>
)<br>
</span></b></p>
<p><b><br>
</b></p>
<p><b><span style="font-weight:normal;">Actual error from
messages
log: <br>
</span></b></p>
<p><b><span style="font-weight:normal;"><br>
</span></b></p>
<p><b><span style="font-weight:normal;">Oct 27 11:52:24
lago-basic-suite-master-host-0 systemd: Started Auxiliary vdsm
service for running helper functions as root.<br>
Oct 27 11:52:24 lago-basic-suite-master-host-0 systemd:
Starting Auxiliary vdsm service for running helper functions
as root...<br>
Oct 27 11:52:24 lago-basic-suite-master-host-0 python2:
detected unhandled Python exception in
'/usr/share/vdsm/supervdsmd'<br>
Oct 27 11:52:24 lago-basic-suite-master-host-0 abrt-server:
Not saving repeating crash in '/usr/share/vdsm/supervdsmd'<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
Traceback (most recent call last):<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
File "/usr/share/vdsm/supervdsmd", line 22, in
<module><br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
from vdsm import supervdsm_server<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
File
"/usr/lib/python2.7/site-packages/vdsm/supervdsm_server.py",
line 50, in <module><br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
from vdsm.storage import fuser<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
File "/usr/lib/python2.7/site-packages/vdsm/storage/fuser.py",
line 25, in <module><br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
from vdsm.storage import misc<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
File "/usr/lib/python2.7/site-packages/vdsm/storage/misc.py",
line 50, in <module><br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
from vdsm import commands<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
File "/usr/lib/python2.7/site-packages/vdsm/commands.py", line
33, in <module><br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
from .utils import terminating<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line
47, in <module><br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
from vdsm.common.compat import pickle<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
File "/usr/lib/python2.7/site-packages/vdsm/common/compat.py",
line 86, in <module><br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
import subprocess32 as subprocess<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter:
ImportError: No module named subprocess32<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd:
supervdsmd.service: main process exited, code=exited,
status=1/FAILURE<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Unit
supervdsmd.service entered failed state.<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd:
supervdsmd.service failed.<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd:
supervdsmd.service holdoff time over, scheduling restart.<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: start
request repeated too quickly for supervdsmd.service<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Failed
to start Auxiliary vdsm service for running helper functions
as root.<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Unit
supervdsmd.service entered failed state.<br>
Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd:
supervdsmd.service failed.<br>
<br>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span
style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"></error></span></p>
<br>
</span></b></p>
<p><b><br>
</b></p>
</body>
</html>
--------------5D6A91148DA6085EC6E1019D--