<div dir="ltr"><div><div><div><div><div>Hello, <br><br></div>I would like to update on this week&#39;s failures and OST current status.<br><br></div>We had a few failures this week and some are still on-going issues. <br><br></div>We had two unrelated issues failing the test: 006_migrations.prepare_migration_attachments_ipv6 <br></div>This failure was periodical and is causing failure for several changes. <br></div><div>This issue is still on-going and seems to be pointing to this change as the root cause: <br><a href="https://gerrit.ovirt.org/#/c/89812/1" rel="noreferrer" target="_blank"><span class="gmail-il">https</span>://<span class="gmail-il">gerrit</span>.<span class="gmail-il">ovirt</span>.<span class="gmail-il">org</span>/#/<span class="gmail-il">c</span>/<wbr><span class="gmail-il">89812</span>/<span class="gmail-il">1</span></a> - examples: export template to an export domain<br><br></div><div>Issue is still under investigation. <br><br></div><div>On Thursday evening and Friday we seem to have had failures which indicate issues with migration and ipv6 configuration, <br></div><div>The tests that failed were 006_migrations.migrate_vm and 004_basic_sanity.hotplug_cpu<br></div><div><br></div><div>cpu hotplug failure was reporting these changes: <br><br>Failed patch:<br>virt: storage: minimal changes to the drive XML - <a href="https://gerrit.ovirt.org/#/c/89508/">https://gerrit.ovirt.org/#/c/89508/</a><br><br>Reported as failure cause:<br>virt: extract local adjustments to XML - <a href="https://gerrit.ovirt.org/#/c/89506/">https://gerrit.ovirt.org/#/c/89506/</a><br><br></div><div>and migration failure was reporting this patch: <br><br><b style="font-weight:normal" id="gmail-m_4956937856327844083gmail-docs-internal-guid-e8ba4241-9ada-3ee1-8ebb-8da1e7cb8aa8"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">aaa: can&#39;t switch user when accessing the engine with an active kerberos ticket - <a href="https://gerrit.ovirt.org/#/c/89872/" target="_blank">https://gerrit.ovirt.org/#/c/<wbr>89872/</a><br><br></span></b></div><div><b style="font-weight:normal" id="gmail-m_4956937856327844083gmail-docs-internal-guid-e8ba4241-9ada-3ee1-8ebb-8da1e7cb8aa8"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b>This three issues are still on-going and you can see the cases resolved vs the backlog which is going forward to next week: <br><br><img src="cid:ii_jfo3pth20_1629b8f5dc25e0ab" width="207" height="111"><br><br><img src="cid:ii_jfo3q4h01_1629b8f94cd04e7a" width="534" height="362"><br><br></b><br></span></b></div><div><b style="font-weight:normal" id="gmail-m_4956937856327844083gmail-docs-internal-guid-e8ba4241-9ada-3ee1-8ebb-8da1e7cb8aa8"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b>Infra/OST tests  related issues: </b><br></span></b></div><div><b style="font-weight:normal" id="gmail-m_4956937856327844083gmail-docs-internal-guid-e8ba4241-9ada-3ee1-8ebb-8da1e7cb8aa8"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><br></span></b></div><div><span style="font-weight:normal"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">We also had a failure which seems to be related to the ost test and was fixed in this patch: <br><a href="https://gerrit.ovirt.org/#/c/89781/">https://gerrit.ovirt.org/#/c/89781/</a> - Prevent network to be imported by auto_sync <br><br></span></span></div><div><span style="font-weight:normal"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Further discussion on this can be found in the google doc opened by Dominik: <a href="https://docs.google.com/document/d/1VeKfI7luw-HHTCCmfogLNiYLTtIG_3maENVQlDwx0zk/edit#heading=h.peefxb3julf3">https://docs.google.com/document/d/1VeKfI7luw-HHTCCmfogLNiYLTtIG_3maENVQlDwx0zk/edit#heading=h.peefxb3julf3</a><br><br></span></span><br><span style="font-weight:normal"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b>Below you can see the chart for this week&#39;s resolved issues but cause of failure:<br></b><br></span></span><span style="font-weight:normal"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b>Code</b> = regression of working components/functionalities <br><b>Infra</b> = infrastructure/OST Infrastructure/Lago related issues/Power outages<br><b>OST Tests</b> - package related issues, failed build artifacts <b><b><br></b><img src="cid:ii_jfo3rqxj2_1629b90bfc88a87e" width="221" height="154"><br><br><img src="cid:ii_jfo3rymn3_1629b90e37a7ceb8" width="534" height="368"><br></b></span></span><br><span style="font-weight:normal"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b><b><b><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><b>Below is a chart of resolved failures based on ovirt version<br><br><img src="cid:ii_jfo3y6qm4_1629b95538de3d81" width="208" height="122"><br><br><img src="cid:ii_jfo3ygsy5_1629b9585650cf97" width="534" height="370"><br><br></b></span></span></font></b></b></b></span></span><b><b><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><b><b><b><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><b><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><b><b>Below is a chart showing failures by suite type: <br><br><img src="cid:ii_jfo3zry36_1629b96724dd3382" width="189" height="117"><br><br><img src="cid:ii_jfo402gp7_1629b96a8cfa3f7d" width="534" height="372"><br></b></b></span></span></b></span></span></font></b></b></b></span></span></font></b></b><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><br></span></span></span></span></font></span></span></font></div><div><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none">Thanks, <br></span></span></span></span></font></span></span></font></div><div><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none">Dafna</span></span></span></span></font></span></span></font><b><b><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><b><b><b><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><b><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"><b><b><br></b></b></span></span></b></span></span></font></b></b></b></span></span></font></b></b></div><div><span style="font-weight:normal"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b><b><b><font size="2"><span style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(53,53,53);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none"></span></span></font></b></b></b></span></span></div><div><b style="font-weight:normal" id="gmail-m_4956937856327844083gmail-docs-internal-guid-e8ba4241-9ada-3ee1-8ebb-8da1e7cb8aa8"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"></span></b></div></div>