<div dir="ltr"><div><div>We had a second failure on the same root cause patch. <br></div>Dan, can you please have a look? <br><br></div><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 16, 2018 at 10:50 AM, Dafna Ron <span dir="ltr"><<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div><div>Hi,<br></div><br></div>We had a failure in OST on the upgrade suite. <br></div><br></div><b style="font-weight:normal" id="m_316927136976285517gmail-docs-internal-guid-3c9dfc43-fe91-23e0-6e57-521242607f33"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link and headline of suspected patches: <br></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt">Reported as the cause:<b> </b><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><a href="https://gerrit.ovirt.org/#/c/86115/4" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/8<wbr>6115/4 - </a></span>vm: support error_policy='report' for CDROMs</p></b><span style="font-weight:normal">Reported</span><b style="font-weight:normal" id="m_316927136976285517gmail-docs-internal-guid-3c9dfc43-fe91-23e0-6e57-521242607f33"> as the root cause: </b><a href="https://gerrit.ovirt.org/#/c/86114/4" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/8<wbr>6114/4 net tests: Fix vlan creation name length in nettestlib</a><br><b style="font-weight:normal" id="m_316927136976285517gmail-docs-internal-guid-3c9dfc43-fe91-23e0-6e57-521242607f33"><a href="https://gerrit.ovirt.org/#/c/86114/4" rel="noreferrer" target="_blank"></a></b><div><b style="font-weight:normal" id="m_316927136976285517gmail-docs-internal-guid-3c9dfc43-fe91-23e0-6e57-521242607f33"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to Job:</span></p></b><b style="font-weight:normal" id="m_316927136976285517gmail-docs-internal-guid-3c9dfc43-fe91-23e0-6e57-521242607f33"><a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4854/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/4854/</a><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to all logs:</span></p><a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4854/artifact/" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-master_change-queue-<wbr>tester/4854/artifact/</a><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">(Relevant) error snippet from the log: </span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><error></span></p><br></b></div><div><b style="font-weight:normal" id="m_316927136976285517gmail-docs-internal-guid-3c9dfc43-fe91-23e0-6e57-521242607f33">vdsm: <br><br></b><span style="font-weight:normal">type=file, path= threshold=unset at 0x7f57d8027d40>> watermarkLimit:536870912 (vm:2134)<br>2018-01-15 13:12:06,126-0500 ERROR (vm/75adb67b) [virt.vm] (vmId='75adb67b-4390-45f7-<wbr>a677-8d4515cf4a2b') The vm start process failed (vm:917)<br>Traceback (most recent call last):<br> File "/usr/lib/python2.7/site-<wbr>packages/vdsm/virt/vm.py", line 846, in _startUnderlyingVm<br> self._run()<br> File "/usr/lib/python2.7/site-<wbr>packages/vdsm/virt/vm.py", line 2735, in _run<br> domxml = hooks.before_vm_start(self._<wbr>buildDomainXML(),<br> File "/usr/lib/python2.7/site-<wbr>packages/vdsm/virt/vm.py", line 2191, in _buildDomainXML<br> return self._make_domain_xml()<br> File "/usr/lib/python2.7/site-<wbr>packages/vdsm/virt/vm.py", line 2236, in _make_domain_xml<br> devices_xml = self._process_devices()<br> File "/usr/lib/python2.7/site-<wbr>packages/vdsm/virt/vm.py", line 2116, in _process_devices<br> dev_xml = dev.getXML()<br> File "/usr/lib/python2.7/site-<wbr>packages/vdsm/virt/vmdevices/<wbr>storage.py", line 595, in getXML<br> diskelem.appendChild(_<wbr>getDriverXML(self))<br> File "/usr/lib/python2.7/site-<wbr>packages/vdsm/virt/vmdevices/<wbr>storage.py", line 957, in _getDriverXML<br> if (drive['propagateErrors'] == 'on' or<br> File "/usr/lib/python2.7/site-<wbr>packages/vdsm/virt/vmdevices/<wbr>storage.py", line 292, in __getitem__<br> raise KeyError(key)<br>KeyError: 'propagateErrors'<br>2018-01-15 13:12:06,129-0500 INFO (vm/75adb67b) [virt.vm] (vmId='75adb67b-4390-45f7-<wbr>a677-8d4515cf4a2b') Changed state to Down: 'propagateErrors' (code=1) (vm:1636)<br><br></span></div><div><span style="font-weight:normal">engine: </span><b style="font-weight:normal" id="m_316927136976285517gmail-docs-internal-guid-3c9dfc43-fe91-23e0-6e57-521242607f33"><b><br><br></b></b></div><div><b style="font-weight:normal" id="m_316927136976285517gmail-docs-internal-guid-3c9dfc43-fe91-23e0-6e57-521242607f33">2018-01-15 13:12:07,203-05 ERROR [org.ovirt.engine.core.<wbr>vdsbroker.monitoring.<wbr>VmsMonitoring] (ForkJoinPool-1-worker-15) [] Rerun VM '75adb67b-4390-45f7-a677-<wbr>8d4515cf4a2b'. Called from VDS 'lago-upgrade-from-release-<wbr>suite-master-host0'<br>2018-01-15 13:12:07,205-05 INFO [org.ovirt.engine.core.<wbr>vdsbroker.VdsManager] (ForkJoinPool-1-worker-15) [] VMs initialization finished for Host: 'lago-upgrade-from-release-<wbr>suite-master-host0:c98b0719-<wbr>383b-4656-a28d-03005e2fb862'<br>2018-01-15 13:12:07,256-05 WARN [org.ovirt.engine.core.dal.<wbr>dbbroker.auditloghandling.<wbr>AuditLogDirector] (EE-ManagedThreadFactory-<wbr>engine-Thread-19) [] EVENT_ID: USER_INITIATED_RUN_VM_FAILED(<wbr>151), Failed to run VM vm0 on Host lago-upgrade-f<br>rom-release-suite-master-<wbr>host0.<br>2018-01-15 13:12:07,274-05 INFO [org.ovirt.engine.core.bll.<wbr>RunVmOnceCommand] (EE-ManagedThreadFactory-<wbr>engine-Thread-19) [] Lock Acquired to object 'EngineLock:{exclusiveLocks='[<wbr>75adb67b-4390-45f7-a677-<wbr>8d4515cf4a2b=VM]', sharedLocks=''}'<br>2018-01-15 13:12:07,294-05 INFO [org.ovirt.engine.core.<wbr>vdsbroker.<wbr>IsVmDuringInitiatingVDSCommand<wbr>] (EE-ManagedThreadFactory-<wbr>engine-Thread-19) [] START, IsVmDuringInitiatingVDSCommand<wbr>( IsVmDuringInitiatingVDSCommand<wbr>Parameters:{vmId='75adb67<br>b-4390-45f7-a677-8d4515cf4a2b'<wbr>}), log id: 41c281dc<br>2018-01-15 13:12:07,294-05 INFO [org.ovirt.engine.core.<wbr>vdsbroker.<wbr>IsVmDuringInitiatingVDSCommand<wbr>] (EE-ManagedThreadFactory-<wbr>engine-Thread-19) [] FINISH, IsVmDuringInitiatingVDSCommand<wbr>, return: false, log id: 41c281dc<br>2018-01-15 13:12:07,300-05 WARN [org.ovirt.engine.core.bll.<wbr>RunVmOnceCommand] (EE-ManagedThreadFactory-<wbr>engine-Thread-19) [] Validation of action 'RunVmOnce' failed for user admin@internal-authz. Reasons: VAR__ACTION__RUN,VAR__TYPE__<wbr>VM,VAR<br>__ACTION__RUN,VAR__TYPE__VM,<wbr>SCHEDULING_NO_HOSTS<br><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"></error></span></p></b><br class="m_316927136976285517gmail-Apple-interchange-newline"> </div></div>
</blockquote></div><br></div>