Tests failed because of infra error after running check-patch.sh
Hi infra, This failure is not a valid reason to mark the patch with -1. 00:15:09.614 ERROR: Failed to umount /var/lib/mock/epel-6-x86_64-d496d3daa673001f46dbbd9addf9ba1b/root/home/jenkins/workspace/ovirt-engine_3.6_check-patch-el6-x86_64/ovirt-engine. 00:15:09.614 + failed=true See http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/363/console... Basically, any failure before or after running check-patch.sh is an infra error and should appear on gerrit as an infra error (no vote). Can someone take a look? Nir
--IJpNTDwzlM2Ie8A6 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable There was on slave that still carried failures from the latest cleanup issue last week, it's now solved and should not happen again. Thanks for the suggestion. On 11/20 20:22, Nir Soffer wrote:
Hi infra, =20 This failure is not a valid reason to mark the patch with -1. =20 00:15:09.614 ERROR: Failed to umount /var/lib/mock/epel-6-x86_64-d496d3daa673001f46dbbd9addf9ba1b/root/home/je= nkins/workspace/ovirt-engine_3.6_check-patch-el6-x86_64/ovirt-engine. 00:15:09.614 + failed=3Dtrue =20 See http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/363/= consoleFull =20 Basically, any failure before or after running check-patch.sh is an infra error and should appear on gerrit as an infra error (no vote). =20 Can someone take a look? =20 Nir _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
--=20 David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605 --IJpNTDwzlM2Ie8A6 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJWT3OqAAoJEEBxx+HSYmnDAj0IAIKv0228aGGLm2r0Sfwj6dZL GkQBYegIvRyTTXsvIF+grTNn8T4dlXmixYiaIh7VUVzyoJRHCupIE9QGmXQd+W1W BQAUCNSGa152R2OHV+X1DauafdxStVcapiYTgxU1O0mqgbi6p28ZKQ1ZJnoilg2W 3YZfVHoWbeB419oCrxu3DcQhGhMbqYRJRJI+clwHIg9bBQ4/CP9p+kEJEzSqruXA rN5bEAjT3jXRUZWjJwJUi2Aa4/HKGvOQ1GVHrhiMc6dpxAGqIMJWKtmQOA3ZfwCb ZHFb/pK249FxfWE3qVucN6I5BOQtoZS+aq8sif9+XkVyQuVd6AbFr4xYbWV+9O4= =tbZX -----END PGP SIGNATURE----- --IJpNTDwzlM2Ie8A6--
On Fri, Nov 20, 2015 at 9:25 PM, David Caro <dcaro@redhat.com> wrote:
There was on slave that still carried failures from the latest cleanup issue last week, it's now solved and should not happen again.
Thanks for the quick response David! Unfortunately, It just happened again :-) http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/368/console
Thanks for the suggestion.
On 11/20 20:22, Nir Soffer wrote:
Hi infra,
This failure is not a valid reason to mark the patch with -1.
00:15:09.614 ERROR: Failed to umount /var/lib/mock/epel-6-x86_64-d496d3daa673001f46dbbd9addf9ba1b/root/home/jenkins/workspace/ovirt-engine_3.6_check-patch-el6-x86_64/ovirt-engine. 00:15:09.614 + failed=true
See http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/363/console...
Basically, any failure before or after running check-patch.sh is an infra error and should appear on gerrit as an infra error (no vote).
Can someone take a look?
Nir _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
-- David Caro
Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D
Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605
On Fri, Nov 20, 2015 at 9:25 PM, David Caro <dcaro@redhat.com> wrote:
There was on slave that still carried failures from the latest cleanup =
issue
last week, it's now solved and should not happen again. =20 Thanks for the quick response David! =20 Unfortunately, It just happened again :-) =20 http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/368/cons=
--+pHx0qQiF2pBVqBT Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 11/20 22:59, Nir Soffer wrote: ole
=20
I've just retriggered, the network issues today + the upgrade have made some hosts dirty, I've been the last hours trying to clean them up manually but = some still might have issues. The network issues are supposed to be over too, but it's not yet 100% resto= red so some issues might still happen, so please be patient. I'll try to give another full look tomorrow to make sure, but for the next couple days you might find similar issues, as a workaround, you can try retriggering the patch to run it in another slave and send us an email with= the failed job (so we can fix). Sorry for the inconvenience
Thanks for the suggestion.
On 11/20 20:22, Nir Soffer wrote:
Hi infra,
This failure is not a valid reason to mark the patch with -1.
00:15:09.614 ERROR: Failed to umount /var/lib/mock/epel-6-x86_64-d496d3daa673001f46dbbd9addf9ba1b/root/home=
/jenkins/workspace/ovirt-engine_3.6_check-patch-el6-x86_64/ovirt-engine.
00:15:09.614 + failed=3Dtrue
See http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/3= 63/consoleFull
Basically, any failure before or after running check-patch.sh is an infra error and should appear on gerrit as an infra error (no vote).
Can someone take a look?
Nir _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
-- David Caro
Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D
Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605
--=20 David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605 --+pHx0qQiF2pBVqBT Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJWT5QpAAoJEEBxx+HSYmnDnWIH/j885HdhJ4hmctSQ7FFZAOpz pdFMyX0hCwbZmre0yQfog7QEqoXJQ+ZD1FOXc4A9zmLvWqu/68ZKfn25yHNZhByu RZEY9X1aeaQmeTQ1vC0/+yhyD9GgwPpkf3jH1iZtO1pxFHTfnda7o/zSUJKk7FGx ODAk4xo7y0pfbOTsEmA4II8gU+sgvf9qdhvhgPS5FZZ+09XZIkH+fVqwl3yOZiGW ctqZRt8u79/jjRVbem0i5L1ovMYwQnQRea4uLPGkrRx+4uZag9SR/Wbfe7BtXEPi RfODU7sp47v+VIoays5uCl2MEdYYdbHHUJ83ju4lG4HR23Co9gTtERizndK8t9o= =DPwf -----END PGP SIGNATURE----- --+pHx0qQiF2pBVqBT--
Thanks David, I will report failures as usual. Nir On Fri, Nov 20, 2015 at 11:44 PM, David Caro <dcaro@redhat.com> wrote:
On 11/20 22:59, Nir Soffer wrote:
On Fri, Nov 20, 2015 at 9:25 PM, David Caro <dcaro@redhat.com> wrote:
There was on slave that still carried failures from the latest cleanup issue last week, it's now solved and should not happen again.
Thanks for the quick response David!
Unfortunately, It just happened again :-)
http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/368/console
I've just retriggered, the network issues today + the upgrade have made some hosts dirty, I've been the last hours trying to clean them up manually but some still might have issues.
The network issues are supposed to be over too, but it's not yet 100% restored so some issues might still happen, so please be patient.
I'll try to give another full look tomorrow to make sure, but for the next couple days you might find similar issues, as a workaround, you can try retriggering the patch to run it in another slave and send us an email with the failed job (so we can fix).
Sorry for the inconvenience
Thanks for the suggestion.
On 11/20 20:22, Nir Soffer wrote:
Hi infra,
This failure is not a valid reason to mark the patch with -1.
00:15:09.614 ERROR: Failed to umount /var/lib/mock/epel-6-x86_64-d496d3daa673001f46dbbd9addf9ba1b/root/home/jenkins/workspace/ovirt-engine_3.6_check-patch-el6-x86_64/ovirt-engine. 00:15:09.614 + failed=true
See http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/363/console...
Basically, any failure before or after running check-patch.sh is an infra error and should appear on gerrit as an infra error (no vote).
Can someone take a look?
Nir _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
-- David Caro
Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D
Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605
-- David Caro
Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D
Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605
David, Can you please explain what was the problem with the upgrade jobs? Is there anything that can be done to improve them? Thanks, Sharon On Fri, Nov 20, 2015 at 11:44 PM, David Caro <dcaro@redhat.com> wrote:
On 11/20 22:59, Nir Soffer wrote:
On Fri, Nov 20, 2015 at 9:25 PM, David Caro <dcaro@redhat.com> wrote:
There was on slave that still carried failures from the latest cleanup
issue
last week, it's now solved and should not happen again.
Thanks for the quick response David!
Unfortunately, It just happened again :-)
http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/368/console
I've just retriggered, the network issues today + the upgrade have made some hosts dirty, I've been the last hours trying to clean them up manually but some still might have issues.
The network issues are supposed to be over too, but it's not yet 100% restored so some issues might still happen, so please be patient.
I'll try to give another full look tomorrow to make sure, but for the next couple days you might find similar issues, as a workaround, you can try retriggering the patch to run it in another slave and send us an email with the failed job (so we can fix).
Sorry for the inconvenience
Thanks for the suggestion.
On 11/20 20:22, Nir Soffer wrote:
Hi infra,
This failure is not a valid reason to mark the patch with -1.
00:15:09.614 ERROR: Failed to umount
/var/lib/mock/epel-6-x86_64-d496d3daa673001f46dbbd9addf9ba1b/root/home/jenkins/workspace/ovirt-engine_3.6_check-patch-el6-x86_64/ovirt-engine.
00:15:09.614 + failed=true
See http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/363/console...
Basically, any failure before or after running check-patch.sh is an infra error and should appear on gerrit as an infra error (no vote).
Can someone take a look?
Nir _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
-- David Caro
Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D
Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605
-- David Caro
Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D
Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
--JgQwtEuHJzHdouWu Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 11/24 10:08, Sharon Naftaly wrote:
David, Can you please explain what was the problem with the upgrade jobs? Is there anything that can be done to improve them?
The upgrade I was talking about was the jenkins upgrade :)
=20 Thanks, Sharon =20 On Fri, Nov 20, 2015 at 11:44 PM, David Caro <dcaro@redhat.com> wrote: =20
On 11/20 22:59, Nir Soffer wrote:
On Fri, Nov 20, 2015 at 9:25 PM, David Caro <dcaro@redhat.com> wrote:
There was on slave that still carried failures from the latest clea=
nup
issue
last week, it's now solved and should not happen again.
Thanks for the quick response David!
Unfortunately, It just happened again :-)
http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/368/co= nsole
I've just retriggered, the network issues today + the upgrade have made some hosts dirty, I've been the last hours trying to clean them up manually = but some still might have issues.
The network issues are supposed to be over too, but it's not yet 100% restored so some issues might still happen, so please be patient.
I'll try to give another full look tomorrow to make sure, but for the n= ext couple days you might find similar issues, as a workaround, you can try retriggering the patch to run it in another slave and send us an email with the failed job (so we can fix).
Sorry for the inconvenience
Thanks for the suggestion.
On 11/20 20:22, Nir Soffer wrote:
Hi infra,
This failure is not a valid reason to mark the patch with -1.
00:15:09.614 ERROR: Failed to umount
/var/lib/mock/epel-6-x86_64-d496d3daa673001f46dbbd9addf9ba1b/root/home/= jenkins/workspace/ovirt-engine_3.6_check-patch-el6-x86_64/ovirt-engine.
00:15:09.614 + failed=3Dtrue
See http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/363/co= nsoleFull
Basically, any failure before or after running check-patch.sh is an infra error and should appear on gerrit as an infra error (no vote).
Can someone take a look?
Nir _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
-- David Caro
Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D
Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605
-- David Caro
Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D
Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
--=20 David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro@redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605 --JgQwtEuHJzHdouWu Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJWVCY7AAoJEEBxx+HSYmnD+wIH/R15BVBrFQUlqf9DaoVL1bpQ oijmK3vQOUKCM1fr6OQLTyW7rydTWtjKCSvz4DybZUG2B/UKbvC6mIW8fJdovgDL kWgVTLw6LQ3yDu0t20PNiY0mBYYpgYOwj6dk3qLOnv1eSsv7x17Ar///DHJhcu/D 1XlZQIGJkrZgA5SWeU/czoYT5fhjzy5LzKv6CTfO9lCJntIktmuXuRxLLVa6leck ZTBYS4waDWRE647CyoI6+rojCn6fowUkZibAM0oTtByhSgb5kuRINQk3vjjwkXDV RwMd8T3Jw/ltC6Pf2mWOR7M0eMSC76Csc/nAIwXq0IEEuz8eq12HnC1oh95sHK0= =+Qy9 -----END PGP SIGNATURE----- --JgQwtEuHJzHdouWu--
participants (3)
-
David Caro -
Nir Soffer -
Sharon Naftaly