<div dir="ltr"><div><div><div>hi, <br><br></div>I saw this failure on Friday and I also see it in 4.2 branch as well as Master. <br><br></div><div>host-0 did not finish installation on misconfiguration (which I can only asume has to do with the block device list) but I cannot see anything in host-0 or engine to suggest what was the actual problem. <br></div><br></div><div>The patches its reporting are not related. <br></div><div><br><b style="font-weight:normal" id="gmail-docs-internal-guid-5859b7a1-8a55-51b7-9f5f-f6a62057e5d2"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link and headline of suspected patches: Not related</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to Job:</span></p></b><br><b style="font-weight:normal" id="gmail-docs-internal-guid-5859b7a1-8a55-51b7-9f5f-f6a62057e5d2"><a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5613/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-master_change-queue-<wbr>tester/5613/</a><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to all logs:</span></p></b><br><b style="font-weight:normal" id="gmail-docs-internal-guid-5859b7a1-8a55-51b7-9f5f-f6a62057e5d2"><a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5613/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-master_change-queue-<wbr>tester/5613/artifacts</a><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">(Relevant) error snippet from the log: </span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><error></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><br></span></p><p style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b>Api error: <br></b></span></p><p style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b><br></b></span></p></b><h3>Error Message</h3><pre>Could not find block_vda1 device in host devices: </pre><h3>Stacktrace</h3><pre>Traceback (most recent call last):
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 78, in wrapper
prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs
File "/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 1208, in get_host_devices
raise RuntimeError('Could not find block_vda1 device in host devices: {}'.format(device_list))
RuntimeError: Could not find block_vda1 device in host devices:
</pre><b style="font-weight:normal" id="gmail-docs-internal-guid-5859b7a1-8a55-51b7-9f5f-f6a62057e5d2"><p style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"></span></p><br></b></div><b style="font-weight:normal" id="gmail-docs-internal-guid-5859b7a1-8a55-51b7-9f5f-f6a62057e5d2">eng</b><span style="font-weight:normal">ine log: <br><br>[dron@dron post-002_bootstrap.py]$ less lago-basic-suite-master-engine/_var_log/ovirt-engine/engine.log |grep host-0<br>2018-02-12 07:20:17,184-05 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-9) [ebedf4a6-07be-45b3-9062-7996c362f747] method: getByName, params: [lago-basic-suite-master-host-0], timeElapsed: 18ms<br>2018-02-12 07:20:17,201-05 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-9) [ebedf4a6-07be-45b3-9062-7996c362f747] method: getAllForHostname, params: [lago-basic-suite-master-host-0], timeElapsed: 17ms<br>2018-02-12 07:20:17,220-05 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHClient] (default task-9) [ebedf4a6-07be-45b3-9062-7996c362f747] Connecting 'root@lago-basic-suite-master-host-0'<br>2018-02-12 07:20:17,414-05 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHClient] (default task-9) [ebedf4a6-07be-45b3-9062-7996c362f747] Connected: 'root@lago-basic-suite-master-host-0'<br>2018-02-12 07:20:17,427-05 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHClient] (default task-9) [ebedf4a6-07be-45b3-9062-7996c362f747] Authenticating: 'root@lago-basic-suite-master-host-0'<br>2018-02-12 07:20:17,490-05 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHClient] (default task-9) [ebedf4a6-07be-45b3-9062-7996c362f747] Authenticated: 'root@lago-basic-suite-master-host-0'<br>2018-02-12 07:20:18,247-05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (default task-9) [21f04b96] START, RemoveVdsVDSCommand(HostName = lago-basic-suite-master-host-0, RemoveVdsVDSCommandParameters:{hostId='468d8314-e2e0-416b-af9d-295f8ab5a522'}), log id: 9f1017d<br>2018-02-12 07:20:18,262-05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-9) [21f04b96] START, AddVdsVDSCommand(HostName = lago-basic-suite-master-host-0, AddVdsVDSCommandParameters:{hostId='468d8314-e2e0-416b-af9d-295f8ab5a522'}), log id: a336fc4<br>2018-02-12 07:20:18,288-05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default task-9) [21f04b96] Initialize vdsBroker 'lago-basic-suite-master-host-0:54321'<br>2018-02-12 07:20:18,345-05 DEBUG [org.ovirt.engine.core.vdsbroker.ResourceManager] (default task-9) [21f04b96] subscribe called with subscription id: lago-basic-suite-master-host-0|*|VM_status|*<br>2018-02-12 07:20:18,346-05 DEBUG [org.ovirt.engine.core.vdsbroker.ResourceManager] (default task-9) [21f04b96] subscribe called with subscription id: lago-basic-suite-master-host-0|net|host_conn|no_id<br>2018-02-12 07:20:18,369-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-9) [21f04b96] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host lago-basic-suite-master-host-0.<br>2018-02-12 07:20:18,398-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-9) [21f04b96] EVENT_ID: USER_ADD_VDS(42), Host lago-basic-suite-master-host-0 was added by admin@internal-authz.<br>2018-02-12 07:20:18,486-05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-1) [7389a3fe] Before Installation host 468d8314-e2e0-416b-af9d-295f8ab5a522, lago-basic-suite-masterhost-0<br>2018-02-12 07:20:18,549-05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-1) [7389a3fe] START, SetVdsStatusVDSCommand(HostName = lago-basic-suite-master-host-0, SetVdsStatusVDSCommandParameters:{hostId='468d8314-e2e0-416b-af9d-295f8ab5a522', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 4a95e559<br>2018-02-12 07:20:18,567-05 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-1) [7389a3fe] connect enter (lago-basic-suite-master-host-0:22, 1800000, 600000)<br>2018-02-12 07:20:18,567-05 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHClient] (EE-ManagedThreadFactory-engine-Thread-1) [7389a3fe] Connecting 'root@lago-basic-suite-master-host-0'<br>2018-02-12 07:20:18,751-05 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHClient] (EE-ManagedThreadFactory-engine-Thread-1) [7389a3fe] Connected: 'root@lago-basic-suite-master-host-0'<br>2018-02-12 07:20:18,767-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Connected to host lago-basic-suite-master-host-0 with SSH key fingerprint: SHA256:efkJTmSmltPF5S4VbnQ1avsb7whAX0dgLgxZJTxFgqo.<br>2018-02-12 07:20:18,767-05 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHClient] (EE-ManagedThreadFactory-engine-Thread-1) [7389a3fe] Authenticating: 'root@lago-basic-suite-master-host-0'<br>2018-02-12 07:20:18,835-05 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHClient] (EE-ManagedThreadFactory-engine-Thread-1) [7389a3fe] Authenticated: 'root@lago-basic-suite-master-host-0'<br>2018-02-12 07:20:18,835-05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-1) [7389a3fe] Installation of lago-basic-suite-master-host-0. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar<br>2018-02-12 07:20:18,888-05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-1) [7389a3fe] SSH execute 'root@lago-basic-suite-master-host-0' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True'<br>2018-02-12 07:20:19,933-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Initializing.<br>2018-02-12 07:20:20,094-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Environment setup.<br>2018-02-12 07:20:20,112-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Environment packages setup.<br>2018-02-12 07:20:24,084-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Programs detection.<br>2018-02-12 07:20:24,199-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Environment setup.<br>2018-02-12 07:20:24,205-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Environment customization.<br>2018-02-12 07:20:24,617-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Kdump supported.<br>2018-02-12 07:20:24,775-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Logs at host located at: '/tmp/ovirt-host-deploy-20180212072019-56s96x.log'.<br>2018-02-12 07:20:24,890-05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [7389a3fe] Host lago-basic-suite-master-host-0 reports unique id A29E23CD-AF59-423B-9FCB-D3E4A0CD6AA1<br>2018-02-12 07:20:24,908-05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [7389a3fe] Assigning unique id A29E23CD-AF59-423B-9FCB-D3E4A0CD6AA1 to Host lago-basic-suite-master-host-0<br>2018-02-12 07:20:24,987-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Disabling Kdump integration.<br>2018-02-12 07:20:25,070-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Setup validation.<br>2018-02-12 07:20:25,280-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Hardware supports virtualization.<br>2018-02-12 07:20:25,383-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Transaction setup.<br>2018-02-12 07:20:25,429-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Misc configuration.<br>2018-02-12 07:20:25,433-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Package installation.<br>2018-02-12 07:20:27,065-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Yum Status: Downloading Packages.<br>2018-02-12 07:20:27,069-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Yum Download/Verify: tuned-2.8.0-5.el7_4.2.noarch.<br>2018-02-12 07:20:27,074-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Yum Status: Check Package Signatures.<br>2018-02-12 07:20:27,078-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Yum Status: Running Test Transaction.<br>2018-02-12 07:20:27,192-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Yum Status: Running Transaction.<br>2018-02-12 07:20:27,309-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Yum update: 1/2: tuned-2.8.0-5.el7_4.2.noarch.<br>2018-02-12 07:20:27,524-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Yum updated: 2/2: tuned.<br>2018-02-12 07:20:29,174-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Yum Verify: 1/2: tuned.noarch 0:2.8.0-5.el7_4.2 - u.<br>2018-02-12 07:20:29,182-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Yum Verify: 2/2: tuned.noarch 0:2.8.0-5.el7 - ud.<br>2018-02-12 07:20:29,266-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [7389a3fe] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-basic-suite-master-host-0. Stage: Misc configuration.<br></span><b style="font-weight:normal" id="gmail-docs-internal-guid-5859b7a1-8a55-51b7-9f5f-f6a62057e5d2"></b><div><b style="font-weight:normal" id="gmail-docs-internal-guid-5859b7a1-8a55-51b7-9f5f-f6a62057e5d2"><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"></error></span></p></b><br class="gmail-Apple-interchange-newline"></div></div>