Re: [ovirt-devel] [Devel] Vdsm functional tests

----- Original Message -----
From: "Dan Kenigsberg" <danken@redhat.com> To: devel@ovirt.org Cc: vdsm-devel@ovirt.org, vered@redhat.com, fromani@redhat.com Sent: Thursday, April 3, 2014 6:08:31 PM Subject: [Devel] Vdsm functional tests
Functional tests are intended to verify that a running Vdsm instance does what it should, when treated as a black box, over its public API.
They should be comprehensive and representative of a typical field usage of Vdsm. It is a sin to break such a test - but we must be able to know when such a sin is committed.
We currently have the following functional tests modules:
- sosPluginTests.py supervdsmFuncTests.py
- storageTests.py
Storage localfs will be good to go by May 8th.
- momTests.py virtTests.py
- networkTests.py
I'd like to have a designated developer per team (infra, storage, virt and network), responsible to having these tests ever-running.
When could we expect to have it running per commit on a Jenkins slaves?
Volunteers, please come forward.
Dan. _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel

On Apr 10, 2014, at 06:37 , Vered Volansky <vered@redhat.com> wrote:
----- Original Message -----
From: "Dan Kenigsberg" <danken@redhat.com> To: devel@ovirt.org Cc: vdsm-devel@ovirt.org, vered@redhat.com, fromani@redhat.com Sent: Thursday, April 3, 2014 6:08:31 PM Subject: [Devel] Vdsm functional tests
Functional tests are intended to verify that a running Vdsm instance does what it should, when treated as a black box, over its public API.
They should be comprehensive and representative of a typical field usage of Vdsm. It is a sin to break such a test - but we must be able to know when such a sin is committed.
We currently have the following functional tests modules:
- sosPluginTests.py supervdsmFuncTests.py
- storageTests.py
Storage localfs will be good to go by May 8th.
- momTests.py virtTests.py
- networkTests.py
I'd like to have a designated developer per team (infra, storage, virt and network), responsible to having these tests ever-running.
When could we expect to have it running per commit on a Jenkins slaves?
virt tests are running There is a common initialization issue with VdsProxy at the moment, once it's fixed the virt tests can be un-silenced and they will hopefully come out of "failing-only" mode:) I'd say end of this week... Thanks, michal
Volunteers, please come forward.
Dan. _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel
_______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel

----- Original Message -----
From: "Michal Skrivanek" <michal.skrivanek@redhat.com> To: "Dan Kenigsberg" <danken@redhat.com> Cc: vdsm-devel@ovirt.org, devel@ovirt.org Sent: Thursday, April 10, 2014 8:13:55 AM Subject: Re: [ovirt-devel] [Devel] Vdsm functional tests
When could we expect to have it running per commit on a Jenkins slaves?
virt tests are running There is a common initialization issue with VdsProxy at the moment, once it's fixed the virt tests can be un-silenced and they will hopefully come out of "failing-only" mode:) I'd say end of this week...
Confirmed. This http://gerrit.ovirt.org/#/c/26514/ should fix the current VdsProxy troubles Bests, -- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani

On Apr 10, 2014, at 08:34 , Francesco Romani <fromani@redhat.com> wrote:
----- Original Message -----
From: "Michal Skrivanek" <michal.skrivanek@redhat.com> To: "Dan Kenigsberg" <danken@redhat.com> Cc: vdsm-devel@ovirt.org, devel@ovirt.org Sent: Thursday, April 10, 2014 8:13:55 AM Subject: Re: [ovirt-devel] [Devel] Vdsm functional tests
When could we expect to have it running per commit on a Jenkins slaves?
virt tests are running There is a common initialization issue with VdsProxy at the moment, once it's fixed the virt tests can be un-silenced and they will hopefully come out of "failing-only" mode:) I'd say end of this week...
Confirmed. This http://gerrit.ovirt.org/#/c/26514/ should fix the current VdsProxy troubles
Plus ideally a better initialization to get rid of that embarrassing "sleep 10" in gerrit config. We should check and wait till vdsm responds in VdsProxy init. We need to make the test as fast as possible, otherwise people won't run them... Thanks, michal
Bests,
-- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani

----- Original Message -----
From: "Michal Skrivanek" <michal.skrivanek@redhat.com> To: "Francesco Romani" <fromani@redhat.com> Cc: vdsm-devel@ovirt.org, devel@ovirt.org Sent: Thursday, April 10, 2014 8:37:18 AM Subject: Re: [ovirt-devel] [Devel] Vdsm functional tests
On Apr 10, 2014, at 08:34 , Francesco Romani <fromani@redhat.com> wrote:
----- Original Message -----
From: "Michal Skrivanek" <michal.skrivanek@redhat.com> To: "Dan Kenigsberg" <danken@redhat.com> Cc: vdsm-devel@ovirt.org, devel@ovirt.org Sent: Thursday, April 10, 2014 8:13:55 AM Subject: Re: [ovirt-devel] [Devel] Vdsm functional tests
When could we expect to have it running per commit on a Jenkins slaves?
virt tests are running There is a common initialization issue with VdsProxy at the moment, once it's fixed the virt tests can be un-silenced and they will hopefully come out of "failing-only" mode:) I'd say end of this week...
Confirmed. This http://gerrit.ovirt.org/#/c/26514/ should fix the current VdsProxy troubles
Plus ideally a better initialization to get rid of that embarrassing "sleep 10" in gerrit config. Well, that happens to you because you all copied our network functional tests job xD Where it really doesn't matter 10 seconds since the tests take upwards of 10 minutes to run.
We should check and wait till vdsm responds in VdsProxy init. We need to make the test as fast as possible, otherwise people won't run them...
Thanks, michal
Bests,
-- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani
_______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel

----- Original Message -----
From: "Michal Skrivanek" <michal.skrivanek@redhat.com> To: "Francesco Romani" <fromani@redhat.com> Cc: devel@ovirt.org, vdsm-devel@ovirt.org, "Dan Kenigsberg" <danken@redhat.com> Sent: Thursday, April 10, 2014 8:37:18 AM Subject: Re: [ovirt-devel] [Devel] Vdsm functional tests
I'd say end of this week... Confirmed. This http://gerrit.ovirt.org/#/c/26514/ should fix the current VdsProxy troubles
Plus ideally a better initialization to get rid of that embarrassing "sleep 10" in gerrit config. We should check and wait till vdsm responds in VdsProxy init. We need to make the test as fast as possible, otherwise people won't run them...
Agreed and added to my TODO -- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani

----- Original Message -----
From: "Francesco Romani" <fromani@redhat.com> To: vdsm-devel@ovirt.org, devel@ovirt.org Sent: Thursday, April 10, 2014 8:43:46 AM Subject: Re: [ovirt-devel] [Devel] Vdsm functional tests
Plus ideally a better initialization to get rid of that embarrassing "sleep 10" in gerrit config. We should check and wait till vdsm responds in VdsProxy init. We need to make the test as fast as possible, otherwise people won't run them...
Agreed and added to my TODO
http://gerrit.ovirt.org/#/c/26638/ -- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani

This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --Lx2Kq68o9u3qlNHCG9I9IQ9bqAduDUpcj Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Thu 10 Apr 2014 09:55:21 AM CEST, Francesco Romani wrote:
----- Original Message -----
From: "Francesco Romani" <fromani@redhat.com> To: vdsm-devel@ovirt.org, devel@ovirt.org Sent: Thursday, April 10, 2014 8:43:46 AM Subject: Re: [ovirt-devel] [Devel] Vdsm functional tests
Plus ideally a better initialization to get rid of that embarrassing = "sleep 10" in gerrit config. We should check and wait till vdsm responds in VdsProxy init. We need to make the test as fast as possible, otherwise people won't = run them...
Agreed and added to my TODO
@Toni: I'll fix a couple things (not needed branches and stuff) with=20 the network tests and rename it to meet the "unwritten" consensus for=20 the job names, is that ok? -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Email: dcaro@redhat.com Web: www.redhat.com RHT Global #: 82-62605 --Lx2Kq68o9u3qlNHCG9I9IQ9bqAduDUpcj Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJTRlIfAAoJEEBxx+HSYmnD08QH/jxKe871G/poSuriuv2hm1ZI d2oQJNN9HAG+rhIQPk1AoKEoudZFhto/8DiRwj/EcAC29xXCak58fgPAo3HVRgEr nNOEhU+ArageMvfXv999skD0lByN3EHhfnCP/8wdKdOY6/bnm4v/ekEeUMVSxS27 bdu30qNpobPKllSRE/BA2KDdysB3TcVnl07+FnxNxMx4t/m/VyhXvPL6wAYwdBtL 58sgSd+gwmBrb5mQK5gwHpSUO4s7c9DPV3kMwP2v13aLNUgqSxC5Kt2TGBTuH9Vj m00WDsqc/rYqqe2KVAye4KH/4on45UXaEGBOxFNaRMO2rFQX9H6JgkaZDJS/fh0= =44+V -----END PGP SIGNATURE----- --Lx2Kq68o9u3qlNHCG9I9IQ9bqAduDUpcj--

On Thu, Apr 10, 2014 at 02:34:12AM -0400, Francesco Romani wrote:
When could we expect to have it running per commit on a Jenkins slaves?
virt tests are running There is a common initialization issue with VdsProxy at the moment, once it's fixed the virt tests can be un-silenced and they will hopefully come out of "failing-only" mode:) I'd say end of this week...
Confirmed. This http://gerrit.ovirt.org/#/c/26514/ should fix the current VdsProxy troubles
Please find the time to review it, then!
participants (6)
-
Antoni Segura Puimedon
-
Dan Kenigsberg
-
David Caro
-
Francesco Romani
-
Michal Skrivanek
-
Vered Volansky