From dron at redhat.com Wed Nov 1 10:01:08 2017 Content-Type: multipart/mixed; boundary="===============4462317958696696432==" MIME-Version: 1.0 From: Dafna Ron To: infra at ovirt.org Subject: [ OST Failure Report ] [ oVirt master ] [ 01 Nov 2017 ] [ 098_ovirt_provider_ovn.test_ovn_provider_rest ] Date: Wed, 01 Nov 2017 10:01:05 +0000 Message-ID: --===============4462317958696696432== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------4781A375DC902B82C9DFEC94 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit Hi, 098_ovirt_provider_ovn.test_ovn_provider_rest failed on removing the interface from a running vm. I have seen this before, do we perhaps have a race in OST where the vm is still running at times? ** *Link to suspected patches: Patch reported is below but I am suspecting its a race and not related* * * **https://gerrit.ovirt.org/#/c/83414/* * *Link to Job:* * * **http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3558/** *** * *Link to all logs:* * *http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3558/artifac= t/* (Relevant) error snippet from the log: 2017-10-31 10:58:43,516-04 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-32) [] Operation Failed: [Cannot remove Interface. The VM Network Interface is plugged to a running VM.] * --------------4781A375DC902B82C9DFEC94 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 7bit

Hi,

098_ovirt_provider_ovn.test_ovn_provider_rest failed on removing the interface from a running vm.

I have seen this before, do we perhaps have a race in OST where the vm is still running at times?

Link to suspecte= d patches: Patch reported is below but I am suspecting its a race and not = related


<= a class=3D"moz-txt-link-freetext" href=3D"https://gerrit.ovirt.org/#/c/8341= 4/">https://gerrit.ovirt.org/#/c/83414/

Link to Job:


<= a class=3D"moz-txt-link-freetext" href=3D"http://jenkins.ovirt.org/job/ovir= t-master_change-queue-tester/3558/">http://jenkins.ovirt.org/job/ovirt-mast= er_change-queue-tester/3558/

<= /b>

Link to all logs= :

http://jenkins.ovirt.org/job/ovirt-master_= change-queue-tester/3558/artifact/


(Relevant) error= snippet from the log:

<error>


2017-10-31 10:58:43,516-04 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-32) [] Operation Failed: [Cannot remove Interface. The VM Network Interface is plugged to a running VM.]

</error>


--------------4781A375DC902B82C9DFEC94-- --===============4462317958696696432== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS00NzgxQTM3NURDOTAyQjgyQzlERkVDOTQKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQKCkhpLAoKMDk4X292aXJ0 X3Byb3ZpZGVyX292bi50ZXN0X292bl9wcm92aWRlcl9yZXN0IGZhaWxlZCBvbiByZW1vdmluZyB0 aGUKaW50ZXJmYWNlIGZyb20gYSBydW5uaW5nIHZtLgoKSSBoYXZlIHNlZW4gdGhpcyBiZWZvcmUs IGRvIHdlIHBlcmhhcHMgaGF2ZSBhIHJhY2UgaW4gT1NUIHdoZXJlIHRoZSB2bQppcyBzdGlsbCBy dW5uaW5nIGF0IHRpbWVzPwoKKioKCipMaW5rIHRvIHN1c3BlY3RlZCBwYXRjaGVzOiBQYXRjaCBy ZXBvcnRlZCBpcyBiZWxvdyBidXQgSSBhbSBzdXNwZWN0aW5nCml0cyBhIHJhY2UgYW5kIG5vdCBy ZWxhdGVkKgoKKgoqCgoqKmh0dHBzOi8vZ2Vycml0Lm92aXJ0Lm9yZy8jL2MvODM0MTQvKgoqCgoq TGluayB0byBKb2I6KgoKKgoqCgoqKmh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQt bWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzU1OC8qKgoKKioqCioKCipMaW5rIHRvIGFsbCBs b2dzOioKCioKCipodHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFu Z2UtcXVldWUtdGVzdGVyLzM1NTgvYXJ0aWZhY3QvKgoKCgooUmVsZXZhbnQpIGVycm9yIHNuaXBw ZXQgZnJvbSB0aGUgbG9nOgoKPGVycm9yPgoKCjIwMTctMTAtMzEgMTA6NTg6NDMsNTE2LTA0IEVS Uk9SCltvcmcub3ZpcnQuZW5naW5lLmFwaS5yZXN0YXBpLnJlc291cmNlLkFic3RyYWN0QmFja2Vu ZFJlc291cmNlXSAoZGVmYXVsdAp0YXNrLTMyKSBbXSBPcGVyYXRpb24gRmFpbGVkOiBbQ2Fubm90 IHJlbW92ZSBJbnRlcmZhY2UuIFRoZSBWTSBOZXR3b3JrCkludGVyZmFjZSBpcyBwbHVnZ2VkIHRv IGEgcnVubmluZyBWTS5dCgo8L2Vycm9yPgoKKgoKCi0tLS0tLS0tLS0tLS0tNDc4MUEzNzVEQzkw MkI4MkM5REZFQzk0CkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04CkNvbnRl bnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQKCjxodG1sPgogIDxoZWFkPgoKICAgIDxtZXRhIGh0 dHAtZXF1aXY9ImNvbnRlbnQtdHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04 Ij4KICA8L2hlYWQ+CiAgPGJvZHkgdGV4dD0iIzAwMDAwMCIgYmdjb2xvcj0iI0ZGRkZGRiI+CiAg ICA8cD5IaSwgPGJyPgogICAgPC9wPgogICAgPHA+MDk4X292aXJ0X3Byb3ZpZGVyX292bi50ZXN0 X292bl9wcm92aWRlcl9yZXN0IGZhaWxlZCBvbiByZW1vdmluZwogICAgICB0aGUgaW50ZXJmYWNl IGZyb20gYSBydW5uaW5nIHZtLiA8YnI+CiAgICA8L3A+CiAgICA8cD5JIGhhdmUgc2VlbiB0aGlz IGJlZm9yZSwgZG8gd2UgcGVyaGFwcyBoYXZlIGEgcmFjZSBpbiBPU1Qgd2hlcmUKICAgICAgdGhl IHZtIGlzIHN0aWxsIHJ1bm5pbmcgYXQgdGltZXM/IDxicj4KICAgIDwvcD4KICAgIDxwPjxiIHN0 eWxlPSJmb250LXdlaWdodDpub3JtYWw7IgogICAgICAgIGlkPSJkb2NzLWludGVybmFsLWd1aWQt NTg1OWI3YTEtNzcwNC1jZjUzLTNkYjUtMmIxYTY5OGM4MGMxIj4KICAgICAgICA8cCBkaXI9Imx0 ciIKICAgICAgICAgIHN0eWxlPSJsaW5lLWhlaWdodDoxLjM4O21hcmdpbi10b3A6MHB0O21hcmdp bi1ib3R0b206MHB0OyI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5OkFy aWFsO2NvbG9yOiMwMDAwMDA7YmFja2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtmb250LXdlaWdo dDo0MDA7Zm9udC1zdHlsZTpub3JtYWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29yYXRp b246bm9uZTt2ZXJ0aWNhbC1hbGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcDsiPkxp bmsgdG8gc3VzcGVjdGVkIHBhdGNoZXM6ICBQYXRjaCByZXBvcnRlZCBpcyBiZWxvdyBidXQgSSBh bSBzdXNwZWN0aW5nIGl0cyBhIHJhY2UgYW5kIG5vdCByZWxhdGVkPC9zcGFuPjwvcD4KICAgICAg ICA8YnI+CiAgICAgIDwvYj48L3A+CiAgICA8cD48YiBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFs OyIKICAgICAgICBpZD0iZG9jcy1pbnRlcm5hbC1ndWlkLTU4NTliN2ExLTc3MDQtY2Y1My0zZGI1 LTJiMWE2OThjODBjMSI+PGI+PGEgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIgaHJlZj0i aHR0cHM6Ly9nZXJyaXQub3ZpcnQub3JnLyMvYy84MzQxNC8iPmh0dHBzOi8vZ2Vycml0Lm92aXJ0 Lm9yZy8jL2MvODM0MTQvPC9hPjwvYj48YnI+CiAgICAgICAgPHAgZGlyPSJsdHIiCiAgICAgICAg ICBzdHlsZT0ibGluZS1oZWlnaHQ6MS4zODttYXJnaW4tdG9wOjBwdDttYXJnaW4tYm90dG9tOjBw dDsiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTFwdDtmb250LWZhbWlseTpBcmlhbDtjb2xvcjoj MDAwMDAwO2JhY2tncm91bmQtY29sb3I6dHJhbnNwYXJlbnQ7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQt c3R5bGU6bm9ybWFsO2ZvbnQtdmFyaWFudDpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7dmVy dGljYWwtYWxpZ246YmFzZWxpbmU7d2hpdGUtc3BhY2U6cHJlLXdyYXA7Ij5MaW5rIHRvIEpvYjo8 L3NwYW4+PC9wPgogICAgICAgIDxicj4KICAgICAgPC9iPjwvcD4KICAgIDxwPjxiIHN0eWxlPSJm b250LXdlaWdodDpub3JtYWw7IgogICAgICAgIGlkPSJkb2NzLWludGVybmFsLWd1aWQtNTg1OWI3 YTEtNzcwNC1jZjUzLTNkYjUtMmIxYTY5OGM4MGMxIj48Yj48YSBjbGFzcz0ibW96LXR4dC1saW5r LWZyZWV0ZXh0IiBocmVmPSJodHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rl cl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM1NTgvIj5odHRwOi8vamVua2lucy5vdmlydC5vcmcvam9i L292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM1NTgvPC9hPjwvYj48L2I+PC9wPgog ICAgPHA+PGIgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbDsiCiAgICAgICAgaWQ9ImRvY3MtaW50 ZXJuYWwtZ3VpZC01ODU5YjdhMS03NzA0LWNmNTMtM2RiNS0yYjFhNjk4YzgwYzEiPjxiPjwvYj48 YnI+CiAgICAgICAgPHAgZGlyPSJsdHIiCiAgICAgICAgICBzdHlsZT0ibGluZS1oZWlnaHQ6MS4z ODttYXJnaW4tdG9wOjBwdDttYXJnaW4tYm90dG9tOjBwdDsiPjxzcGFuIHN0eWxlPSJmb250LXNp emU6MTFwdDtmb250LWZhbWlseTpBcmlhbDtjb2xvcjojMDAwMDAwO2JhY2tncm91bmQtY29sb3I6 dHJhbnNwYXJlbnQ7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9ybWFsO2ZvbnQtdmFyaWFu dDpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7dmVydGljYWwtYWxpZ246YmFzZWxpbmU7d2hp dGUtc3BhY2U6cHJlLXdyYXA7Ij5MaW5rIHRvIGFsbCBsb2dzOjwvc3Bhbj48L3A+CiAgICAgICAg PHAgZGlyPSJsdHIiCiAgICAgICAgICBzdHlsZT0ibGluZS1oZWlnaHQ6MS4zODttYXJnaW4tdG9w OjBwdDttYXJnaW4tYm90dG9tOjBwdDsiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTFwdDtmb250 LWZhbWlseTpBcmlhbDtjb2xvcjojMDAwMDAwO2JhY2tncm91bmQtY29sb3I6dHJhbnNwYXJlbnQ7 Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9ybWFsO2ZvbnQtdmFyaWFudDpub3JtYWw7dGV4 dC1kZWNvcmF0aW9uOm5vbmU7dmVydGljYWwtYWxpZ246YmFzZWxpbmU7d2hpdGUtc3BhY2U6cHJl LXdyYXA7Ij4KPC9zcGFuPjwvcD4KICAgICAgICA8cCBkaXI9Imx0ciIKICAgICAgICAgIHN0eWxl PSJsaW5lLWhlaWdodDoxLjM4O21hcmdpbi10b3A6MHB0O21hcmdpbi1ib3R0b206MHB0OyI+PHNw YW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5OkFyaWFsO2NvbG9yOiMwMDAwMDA7 YmFja2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtmb250LXdlaWdodDo0MDA7Zm9udC1zdHlsZTpu b3JtYWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9uZTt2ZXJ0aWNhbC1h bGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcDsiPjxiPjxhIGNsYXNzPSJtb3otdHh0 LWxpbmstZnJlZXRleHQiIGhyZWY9Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQt bWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzU1OC9hcnRpZmFjdC8iPmh0dHA6Ly9qZW5raW5z Lm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzU1OC9hcnRp ZmFjdC88L2E+PC9iPgo8L3NwYW4+PC9wPgogICAgICAgIDxicj4KICAgICAgICA8cCBkaXI9Imx0 ciIKICAgICAgICAgIHN0eWxlPSJsaW5lLWhlaWdodDoxLjM4O21hcmdpbi10b3A6MHB0O21hcmdp bi1ib3R0b206MHB0OyI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5OkFy aWFsO2NvbG9yOiMwMDAwMDA7YmFja2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtmb250LXdlaWdo dDo0MDA7Zm9udC1zdHlsZTpub3JtYWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29yYXRp b246bm9uZTt2ZXJ0aWNhbC1hbGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcDsiPihS ZWxldmFudCkgZXJyb3Igc25pcHBldCBmcm9tIHRoZSBsb2c6IDwvc3Bhbj48L3A+CiAgICAgICAg PHAgZGlyPSJsdHIiCiAgICAgICAgICBzdHlsZT0ibGluZS1oZWlnaHQ6MS4zODttYXJnaW4tdG9w OjBwdDttYXJnaW4tYm90dG9tOjBwdDsiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTFwdDtmb250 LWZhbWlseTpBcmlhbDtjb2xvcjojMDAwMDAwO2JhY2tncm91bmQtY29sb3I6dHJhbnNwYXJlbnQ7 Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9ybWFsO2ZvbnQtdmFyaWFudDpub3JtYWw7dGV4 dC1kZWNvcmF0aW9uOm5vbmU7dmVydGljYWwtYWxpZ246YmFzZWxpbmU7d2hpdGUtc3BhY2U6cHJl LXdyYXA7Ij4mbHQ7ZXJyb3ImZ3Q7PC9zcGFuPjwvcD4KICAgICAgICA8YnI+CiAgICAgICAgMjAx Ny0xMC0zMSAxMDo1ODo0Myw1MTYtMDQgRVJST1IKICAgICAgICBbb3JnLm92aXJ0LmVuZ2luZS5h cGkucmVzdGFwaS5yZXNvdXJjZS5BYnN0cmFjdEJhY2tlbmRSZXNvdXJjZV0KICAgICAgICAoZGVm YXVsdCB0YXNrLTMyKSBbXSBPcGVyYXRpb24gRmFpbGVkOiBbQ2Fubm90IHJlbW92ZSBJbnRlcmZh Y2UuCiAgICAgICAgVGhlIFZNIE5ldHdvcmsgSW50ZXJmYWNlIGlzIHBsdWdnZWQgdG8gYSBydW5u aW5nIFZNLl08YnI+CiAgICAgICAgPGJyPgogICAgICAgIDxwIGRpcj0ibHRyIgogICAgICAgICAg c3R5bGU9ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDowcHQ7bWFyZ2luLWJvdHRvbTowcHQ7 Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExcHQ7Zm9udC1mYW1pbHk6QXJpYWw7Y29sb3I6IzAw MDAwMDtiYWNrZ3JvdW5kLWNvbG9yOnRyYW5zcGFyZW50O2ZvbnQtd2VpZ2h0OjQwMDtmb250LXN0 eWxlOm5vcm1hbDtmb250LXZhcmlhbnQ6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO3ZlcnRp Y2FsLWFsaWduOmJhc2VsaW5lO3doaXRlLXNwYWNlOnByZS13cmFwOyI+Jmx0Oy9lcnJvciZndDs8 L3NwYW4+PC9wPgogICAgICA8L2I+PGJyIGNsYXNzPSJBcHBsZS1pbnRlcmNoYW5nZS1uZXdsaW5l Ij4KICAgIDwvcD4KICA8L2JvZHk+CjwvaHRtbD4KCi0tLS0tLS0tLS0tLS0tNDc4MUEzNzVEQzkw MkI4MkM5REZFQzk0LS0K --===============4462317958696696432==--