This is a multi-part message in MIME format. --------------5D6A91148DA6085EC6E1019D Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi, we have a failed test that is caused by failing to start vdsm on host-0. ** *Link to suspected patches: * * patch reported as reason: https://gerrit.ovirt.org/#/c/83275/ ** patch reported as a more likely reason: https://gerrit.ovirt.org/#/c/83186/3 * ** *Link to Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3505* ** ** *Link to all logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3505/artifact* *** (Relevant) error snippet from the log: <error> Error in host deploy log: * *2017-10-27 11:52:22,516-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', 'vdsmd.service') stderr: A dependency job for vdsmd.service failed. See 'journalctl -xe' for details. 2017-10-27 11:52:22,516-0400 DEBUG otopi.context context._executeMethod:143 method exception Traceback (most recent call last): File "/tmp/ovirt-GJGz7NSZHZ/pythonlib/otopi/context.py", line 133, in _executeMethod method['method']() File "/tmp/ovirt-GJGz7NSZHZ/otopi-plugins/ovirt-host-deploy/vdsm/packages.py", line 220, in _start self.services.state('vdsmd', True) File "/tmp/ovirt-GJGz7NSZHZ/otopi-plugins/otopi/services/systemd.py", line 141, in state service=name, RuntimeError: Failed to start service 'vdsmd' 2017-10-27 11:52:22,519-0400 ERROR otopi.context context._executeMethod:152 Failed to execute stage 'Closing up': Failed to start service 'vdsmd' 2017-10-27 11:52:22,520-0400 DEBUG otopi.plugins.otopi.dialog.machine dialog.__logString:204 DIALOG:SEND **%EventEnd STAGE closeup METHOD otopi.plugins.ovirt_host_deploy.vdsm.packages.Plugin._start (odeploycons.packages.vdsm.started ) * * * *Actual error from messages log: * * * *Oct 27 11:52:24 lago-basic-suite-master-host-0 systemd: Started Auxiliary vdsm service for running helper functions as root. Oct 27 11:52:24 lago-basic-suite-master-host-0 systemd: Starting Auxiliary vdsm service for running helper functions as root... Oct 27 11:52:24 lago-basic-suite-master-host-0 python2: detected unhandled Python exception in '/usr/share/vdsm/supervdsmd' Oct 27 11:52:24 lago-basic-suite-master-host-0 abrt-server: Not saving repeating crash in '/usr/share/vdsm/supervdsmd' Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: Traceback (most recent call last): Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/share/vdsm/supervdsmd", line 22, in <module> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm import supervdsm_server Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/supervdsm_server.py", line 50, in <module> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm.storage import fuser Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/storage/fuser.py", line 25, in <module> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm.storage import misc Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/storage/misc.py", line 50, in <module> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm import commands Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/commands.py", line 33, in <module> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from .utils import terminating Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 47, in <module> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm.common.compat import pickle Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/common/compat.py", line 86, in <module> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: import subprocess32 as subprocess Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: ImportError: No module named subprocess32 Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: supervdsmd.service: main process exited, code=exited, status=1/FAILURE Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Unit supervdsmd.service entered failed state. Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: supervdsmd.service failed. Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: supervdsmd.service holdoff time over, scheduling restart. Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: start request repeated too quickly for supervdsmd.service Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Failed to start Auxiliary vdsm service for running helper functions as root. Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Unit supervdsmd.service entered failed state. Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: supervdsmd.service failed. * *</error>* * * * * --------------5D6A91148DA6085EC6E1019D Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body text="#000000" bgcolor="#FFFFFF"> <p>Hi, <br> </p> <p>we have a failed test that is caused by failing to start vdsm on host-0. <br> </p> <p><br> </p> <p><b><span style="font-weight:normal;"> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to suspected patches: </span></p> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">patch reported as reason: <a class="moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/83275/">https://gerrit.ovirt.org/#/c/83275/</a></span></p> </span></b><b><span style="font-weight:normal;"> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">patch reported as a more likely reason: </span><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"></span><a class="moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/83186/3">https://gerrit.ovirt.org/#/c/83186/3</a></p> </span></b></p> <p><b><span style="font-weight:normal;"> <p><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to Job:</span><span style="font-weight:normal;"> <a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3505">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3505</a></span></p> </span></b></p> <p><b><span style="font-weight:normal;"> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to all logs: <a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3505/artifact">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3505/artifact</a></span></p> </span></b><b><span style="font-weight:normal;"><br> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">(Relevant) error snippet from the log: </span></p> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"><error></span></p> <br> Error in host deploy log: <br> </span></b></p> <p><b><span style="font-weight:normal;">2017-10-27 11:52:22,516-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', 'vdsmd.service') stderr:<br> A dependency job for vdsmd.service failed. See 'journalctl -xe' for details.<br> <br> 2017-10-27 11:52:22,516-0400 DEBUG otopi.context context._executeMethod:143 method exception<br> Traceback (most recent call last):<br>   File "/tmp/ovirt-GJGz7NSZHZ/pythonlib/otopi/context.py", line 133, in _executeMethod<br>     method['method']()<br>   File "/tmp/ovirt-GJGz7NSZHZ/otopi-plugins/ovirt-host-deploy/vdsm/packages.py", line 220, in _start<br>     self.services.state('vdsmd', True)<br>   File "/tmp/ovirt-GJGz7NSZHZ/otopi-plugins/otopi/services/systemd.py", line 141, in state<br>     service=name,<br> RuntimeError: Failed to start service 'vdsmd'<br> 2017-10-27 11:52:22,519-0400 ERROR otopi.context context._executeMethod:152 Failed to execute stage 'Closing up': Failed to start service 'vdsmd'<br> 2017-10-27 11:52:22,520-0400 DEBUG otopi.plugins.otopi.dialog.machine dialog.__logString:204 DIALOG:SEND       **%EventEnd STAGE closeup METHOD otopi.plugins.ovirt_host_deploy.vdsm.packages.Plugin._start (odeploycons.packages.vdsm.started<br> )<br> </span></b></p> <p><b><br> </b></p> <p><b><span style="font-weight:normal;">Actual error from messages log: <br> </span></b></p> <p><b><span style="font-weight:normal;"><br> </span></b></p> <p><b><span style="font-weight:normal;">Oct 27 11:52:24 lago-basic-suite-master-host-0 systemd: Started Auxiliary vdsm service for running helper functions as root.<br> Oct 27 11:52:24 lago-basic-suite-master-host-0 systemd: Starting Auxiliary vdsm service for running helper functions as root...<br> Oct 27 11:52:24 lago-basic-suite-master-host-0 python2: detected unhandled Python exception in '/usr/share/vdsm/supervdsmd'<br> Oct 27 11:52:24 lago-basic-suite-master-host-0 abrt-server: Not saving repeating crash in '/usr/share/vdsm/supervdsmd'<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: Traceback (most recent call last):<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/share/vdsm/supervdsmd", line 22, in <module><br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm import supervdsm_server<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/supervdsm_server.py", line 50, in <module><br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm.storage import fuser<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/storage/fuser.py", line 25, in <module><br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm.storage import misc<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/storage/misc.py", line 50, in <module><br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm import commands<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/commands.py", line 33, in <module><br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from .utils import terminating<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 47, in <module><br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: from vdsm.common.compat import pickle<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: File "/usr/lib/python2.7/site-packages/vdsm/common/compat.py", line 86, in <module><br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: import subprocess32 as subprocess<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 daemonAdapter: ImportError: No module named subprocess32<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: supervdsmd.service: main process exited, code=exited, status=1/FAILURE<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Unit supervdsmd.service entered failed state.<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: supervdsmd.service failed.<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: supervdsmd.service holdoff time over, scheduling restart.<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: start request repeated too quickly for supervdsmd.service<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Failed to start Auxiliary vdsm service for running helper functions as root.<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: Unit supervdsmd.service entered failed state.<br> Oct 27 11:52:25 lago-basic-suite-master-host-0 systemd: supervdsmd.service failed.<br> <br> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"></error></span></p> <br> </span></b></p> <p><b><br> </b></p> </body> </html> --------------5D6A91148DA6085EC6E1019D--