- lago-devel - oVirt List Archives

Lago Announcement - changing lago-devel@ovirt.org to devel@ovirt.org
by Galit Rosenthal 11 Apr '19

11 Apr '19

Hi All, On behalf of the Lago team, Lago will be using devel(a)ovirt.org as our mailing list (instead of lago-devel(a)ovirt.org, which will be retired on April 22nd, 2019). In order to receive Lago announcements, please subscribe to devel(a)ovirt.org mailing list https://lists.ovirt.org/admin/lists/devel.ovirt.org Resources ========== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Pypi: https://pypi.python.org/pypi/lago Docker Hub: https://hub.docker.com/r/lagoproject/lago/ Changelog: https://lago.readthedocs.io/en/latest/_static/ChangeLog.txt As always, if you find any problems, or willing to contribute, visit our GitHub page. Enjoy! -- GALIT ROSENTHAL SOFTWARE ENGINEER <https://red.ht/sig>

1 0

Re: query on running OST
by Milan Zamazal 21 Jan '19

21 Jan '19

Greg Sheremeta <gshereme(a)redhat.com> writes: > On Sat, Jan 19, 2019 at 5:10 AM Dan Kenigsberg <danken(a)redhat.com> wrote: > >> On Sat, 19 Jan 2019, 9:34 Pooja Pandey <pooja.pandey(a)msystechnologies.com >> wrote: >> >>> Hi Dan, >>> >>> Thankyou so much for the reply.I really appreciate your quick response on >>> this. >>> >>> I have one more query==> >>> >>> Can we run OST with the ovirt source code if I want to run on any Hyper >>> converged system? >>> >> >> I'm not sure that I'm answering your question, but... >> >> Unfortunately, in OST we have a tight coupling between the provisioning >> tool (Lago) and the tests. >> >> It is possible to decouple them in order to run the tests (minus oVirt >> deployment test) on an existing system. +Eitan used to have a private patch >> for that (limited to the network suite). Finishing it would require some >> effort from you. >> >>> Also not sure I'm answering your question, specifically re "on any > hyperconverged system" -- ? > But this might help: > https://ovirt.org/blog/2016/12/ci-please-build.html > > ^ that allows us to build rpms from code (an existing gerrit patch), which > we can then feed to OST. We do this in Jenkins quite frequently -- if you > want to do something like this outside of Jenkins, that's probably > possible. I guess you would just have to feed it your rpms, perhaps the > same way it's done in Jenkins, but I'm not sure. Yes, it's possible to give a local or another repo to -s option of run_suite.sh. You can put your rpm's somewhere, run `createrepo' on the given directory and pass it to `run_suite.sh -s'.

1 0

Lago v0.45 Release Announcement
by Gal Ben Haim 10 Dec '18

10 Dec '18

Hi All, On behalf of the Lago team, I'm pleased to announce Lago v0.45 is available! For a detailed release announcement please refer to our Github page at: https://github.com/lago-project/lago/releases/tag/0.45 Resources ========== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Pypi: https://pypi.python.org/pypi/lago Docker Hub: https://hub.docker.com/r/lagoproject/lago/ Changelog: https://lago.readthedocs.io/en/latest/_static/ChangeLog.txt As always, if you find any problems, or willing to contribute, visit our GitHub page. Enjoy! -- *GAL BEN HAIM* RHV DEVOPS -- *GAL bEN HAIM* RHV DEVOPS

1 0

IT Field Engineer
by kumarfield28＠gmail.com 19 Nov '18

19 Nov '18

Information technologies are omnipresent, yet IT engineering remains a mystery to many. To most people, an IT engineer is a wizard behind the screen who makes sure computers work smoothly. To an extent, they might be right, but there is much more to the vocation than just installing a firewall and updating the OS. And it is important to differentiate between career paths here, because the sector is so prolific and ever-changing, that knowing what exactly to expect from it is the key to becoming a happy IT engineer. Firstly, IT engineers may either specialize in software development or computer hardware engineering. The first includes computer programming and smartphone apps, and the latter – designing physical products. https://www.fieldengineer.com/blogs/it-engineering/

1 0

Re: [ovirt-devel] query on running OST
by Greg Sheremeta 19 Nov '18

19 Nov '18

Hi, OST should be run on bare metal. You might be able to get it working in a nested KVM setup [1] but this is untested afaik. [1] https://docs.fedoraproject.org/en-US/quick-docs/using-nested-virtualization… Best wishes, Greg On Mon, Nov 19, 2018 at 7:13 AM Pooja Pandey < pooja.pandey(a)msystechnologies.com> wrote: > Hello Team, > > Could you please help me in answering a query about OST run.I am trying to > run on a virtual machine and it is failing with an error that libvirtError: > unsupported configuration: Domain requires KVM, but it is not available. > > Is it necessary to run this Ovirt System Test on a hypervisor only?Please > reply on this so that I can proceed further.Thanks.... > > Regards, > Pooja > > > DISCLAIMER - *MSysTechnologies LLC* > > This email message, contents and its attachments may contain confidential, > proprietary or legally privileged information and is intended solely for > the use of the individual or entity to whom it is actually intended. If you > have erroneously received this message, please permanently delete it > immediately and notify the sender. If you are not the intended recipient of > the email message,you are notified strictly not to disseminate,distribute > or copy this e-mail.E-mail transmission cannot be guaranteed to be secure > or error-free as Information could be intercepted, corrupted, lost, > destroyed, incomplete or contain viruses and MSysTechnologies LLC accepts > no liability for the contents and integrity of this mail or for any damage > caused by the limitations of the e-mail transmission. > > _______________________________________________ > Devel mailing list -- devel(a)ovirt.org > To unsubscribe send an email to devel-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/devel@ovirt.org/message/E4ML6ED5GU46F… > -- GREG SHEREMETA SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX Red Hat NA <https://www.redhat.com/> gshereme(a)redhat.com IRC: gshereme <https://red.ht/sig>

1 0

Query regarding OST test suite execution
by viraj shirsat 31 Oct '18

31 Oct '18

Hi , Good Morning :) This is regarding OST tool setup i need some help on the same. Please find below details. My Setup : 1> Setup one open source ovirt engine 2> Setup one node and added the same on ovrit engine 3> Setup one VM for OST tool with following dependencies. 1.Setup LAGO 2.Git Clone OST 3.Install MOCK *Please let me know if i am missing anything* Query : I am trying to run the OST from local machine but i am not able to figure sequence of the steps to execute . Can i get an sample sequence steps how to run any test suite(any). Error : [root@localhost lago]# lago status Unable to find workdir in /jenkins/jobs/confs/projects/lago What is workdir here, m i missing some thing ? Waiting for your reply :) Thanks in Advance Viraj

2 1

Accessing lago VMs on a remote machine
by Yedidyah Bar David 16 Oct '18

16 Oct '18

Hi all, Is there a documented way to connect to lago VMs where lago runs on a remote machine? I realize I can use ssh, ssh with tunelling, 'lago shell', etc., but this is a bit uncomfortable. Case in point: I want to use OST on some machine (not my laptop) and use it to debug imageio after ovirt-engine-rename. So I need to: 1. Get OST, e.g. basic suite, running 2. Verify that imageio works - here is where I am stuck. Ideally, I'd like to be able to run a browser on my laptop and upload an image directly to the OST env. 3. Run rename 4. Try again to upload an image and fix the broken stuff :-) I realize that two solutions I can already use might be: 1. Run a browser, or perhaps a proxy, on the OST machine 2. Create a complex set of ssh tunnels Anything else? Thanks, -- Didi

2 3

Lago oVirt plugin v0.45 Release Announcement
by Gal Ben Haim 31 Jul '18

31 Jul '18

Hi All, On behalf of the Lago team, I'm pleased to announce Lago oVirt plugin v0.45 is available! For a detailed release announcement, please refer to our Github page at: https://github.com/lago-project/lago-ost-plugin/releases/tag/0.45 Resources ========== Docs: http://lago-ost-plugin.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago-ost-plugin YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/ Changelog: http://lago-ost-plugin.readthedocs.io/en/latest/_static/ChangeLog.txt As always, if you find any issues, or willing to contribute, visit our GitHub page. Enjoy! -- *GAL bEN HAIM* RHV DEVOPS

1 0

Lago v0.44 Release Announcement
by Gal Ben Haim 07 Jun '18

07 Jun '18

Hi All, On behalf of the Lago team, I'm pleased to announce Lago v0.44 is available! The current release adds support for Fedora 28. For a detailed release announcement please refer to our Github page at: https://github.com/lago-project/lago/releases/tag/0.44 Resources ========== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Pypi: https://pypi.python.org/pypi/lago Changelog: https://lago.readthedocs.io/en/0.44/_static/ChangeLog.txt As always, if you find any problems, or willing to contribute, visit our GitHub page. Enjoy! -- *GAL bEN HAIM* RHV DEVOPS

1 0

Snapshot with memory of Engine/host VMs?
by Milan Zamazal 01 Jun '18

01 Jun '18

Hi, I have been playing with using Lago snapshots to restart oVirt system tests from a certain point without all the preceding initialization and tests. The primary purpose is to save time when running a suite over different data center compatibility versions but it could be also useful e.g. when writing and debugging tests. However since `lagocli snapshot' makes disk-only snapshots the VMs get restarted when they are reverted. This may cause various problems. For instance, when I snapshot/revert before running add_dc test then verify_notifier test fails -- I assume due to the event being initiated before the snapshot and completed after the snapshot, so it's missing in after-revert runs. Snapshots with memory should resolve similar issues. Is it possible to make such snapshots in Lago? I'd also like to clarify how is `lagocli revert' supposed to be used. It seems to basically work as such but I could experience network accessibility problems of the reverted Lago VMs. lagocli stop + revert + start seems to be a safer way of reverting to a snapshot. How should `lagocli revert' be used properly? Thanks, Milan

4 6

oVirt Privacy policy change
by Sandro Bonazzola 24 May '18

24 May '18

*As part of an oVirt project review, we're publishing an updated privacy policy.You should read the statement fully, but the key updates include:* Clearer descriptions of how oVirt uses your personal data to provide services;* Additional detail on how your personal data may be shared to serve the public interest and that of the open source community; and* More focus on how you can review, modify, and update your personal data.You can find the new statement on the oVirt website at this location: https://ovirt.org/site/privacy-policy/ <https://ovirt.org/site/privacy-policy/>oVirt website pages have been updated to include links to the privacy policy. The new privacy statement takes effect on Friday, May 25, 2018. * -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> <https://redhat.com/summit>

1 0

Lago v0.43 Release Announcement
by Gal Ben Haim 03 Apr '18

03 Apr '18

Hi All, On behalf of the Lago team, I'm pleased to announce Lago v0.43 is available! For a detailed release announcement please refer to our Github page at: https://github.com/lago-project/lago/releases/tag/0.43 Resources ========== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Pypi: https://pypi.python.org/pypi/lago Changelog: http://lago.readthedocs.io/en/0.43/_static/ChangeLog.txt As always, if you find any problems, or willing to contribute, visit our GitHub page. Enjoy! -- *GAL bEN HAIM* RHV DEVOPS

1 0

Lago oVirt plugin v0.44 Release Announcement
by Gal Ben Haim 24 Jan '18

24 Jan '18

Hi All, On behalf of the Lago team, I'm pleased to announce Lago oVirt plugin v0.44 is available! For a detailed release announcement, please refer to our Github page at: https://github.com/lago-project/lago-ost-plugin/releases/tag/0.44 As always, if you find any issues, or willing to contribute, visit our GitHub page. Enjoy! -- *GAL bEN HAIM* RHV DEVOPS

1 0

Lago v0.42 Release Announcement
by Gal Ben Haim 06 Dec '17

06 Dec '17

Hi All, On behalf of the Lago team, I'm pleased to announce Lago v0.42 is available! For a detailed release announcement please refer to our Github page at: https://github.com/lago-project/lago/releases/tag/0.42 <https://github.com/lago-project/lago/releases/tag/0.40> Resources ========== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Pypi: https://pypi.python.org/pypi/lago OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/ Changelog: http://lago.readthedocs.io/en/0.42/_static/ChangeLog.txt <http://lago.readthedocs.io/en/0.40/_static/ChangeLog.txt> As always, if you find any problems, or willing to contribute, visit our GitHub page. Enjoy! -- *GAL bEN HAIM* RHV DEVOPS

1 0

When do we plan to have 0.42 release?
by Yaniv Kaul 04 Dec '17

04 Dec '17

0.41 was released quite some time ago[1]. Y. [1] https://github.com/lago-project/lago/releases

2 2

Yet another Lago competitor
by Yaniv Kaul 27 Nov '17

27 Nov '17

kcli[1]. Looks interesting, worth diving into a bit. Y. [1] https://github.com/karmab/kcli

1 0

Re: [lago-devel] [ovirt-devel] ovirt-system-tests run specific scenario/debugging
by Eyal Edri 15 Sep '17

15 Sep '17

AFAIK It is not possible ATM, but we were considering adding that feature when we move from python-nose to PyTest [1]. Hmm, maybe it will be possible using the export / import feature, but will probably need some custom code for it. So you'll run basic suite, get your env up and running and then export it to a tar.gz file. next time you want to test something, you import it back and run only the test you want. We've been working on a project called 'ovirt demo tool' [2] which will officially replace ovirt-live using Lago images, it is still under development, but should work for basic suite if you want to try it. The manual job [3] should also allow saving the run as an image as an option [3], by setting the 'create images' option to 'yes'. [1] https://ovirt-jira.atlassian.net/browse/OST-8 [2] https://docs.google.com/document/d/1MZdpHAjNWlpPFhOXFfMavZbg6Kh386PRBg6jG6x… [3] http://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-tests… On Thu, Sep 14, 2017 at 8:59 PM, Marc Young <3vilpenguin(a)gmail.com> wrote: > Is it possible to run a specific scenario without having to run back > through spin up/tear down? > > I want to rapidly debug a `test-scenarios/00#_something.py` and the > bootstrap scripts (001,002) take a really long time. > > Also is it possible to attach to a debugger within the test-scenario with > pdb? I didnt have luck and it looks like its abstracted away and not > executed as a regular python file in a way that i can get to an interactive > debugger > > _______________________________________________ > Devel mailing list > Devel(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -- Eyal edri ASSOCIATE MANAGER RHV DevOps EMEA VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

How do I disable reposync?
by Yaniv Kaul 06 Sep '17

06 Sep '17

I remember there used to be a way (and env. variable?) It is very useful when the EPEL mirror is down... Y.

2 2

Re: [lago-devel] [ovirt-devel] Lago and vm templates
by Yaniv Kaul 05 Sep '17

05 Sep '17

On Thu, Aug 24, 2017 at 4:56 AM, Marc Young <3vilpenguin(a)gmail.com> wrote: > Im currently neck deep in ovirt-system-tests and lago > I see alot of usages about importing VMs from templates, but are there any > examples of exporting a VM to template? > I assume you are looking into Lago templates, not oVirt templates? Currently, I'm not aware of a way. What template do you need? > > Side note I cant find a good source of methods available for use in > python-lago-ovirt (or even python-lago). The docs[1] are pretty lacking > Can you open an issue about it? What do you wish to perform? TIA, Y. > > [1] http://lago.readthedocs.io/en/latest/lago.html > > _______________________________________________ > Devel mailing list > Devel(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel >

4 9

Lago OST plugin v0.43 Release announcement
by Nadav Goldin 30 Aug '17

30 Aug '17

Hi All, On behalf of the Lago team, I'm pleased to announce that Lago OST plugin v0.43 is available. This is a small release, including 2 bug fixes. For details please refer to the release page at GitHub: https://github.com/lago-project/lago-ost-plugin/releases/tag/0.43 Resources ========== Docs: http://lago-ost-plugin.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago-ost-plugin YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/ Changelog: http://lago-ost-plugin.readthedocs.io/en/latest/_static/ChangeLog.txt Thanks, Nadav.

1 0

Re: [lago-devel] [ovirt-devel] OST: libvirt: error : internal error: Check the host setup: enabling IPv6 forwarding with RA routes
by Eyal Edri 10 Aug '17

10 Aug '17

Adding also lago-devel. Eddy, isn't it the same issue I had on Fedora 26? On Thu, Aug 10, 2017 at 2:32 PM, Milan Zamazal <mzamazal(a)redhat.com> wrote: > Hi, I get the following error when I try to run OST, I think since I've > upgraded my computer to RHEL 7.4 recently: > > + lago start > @ Start Prefix: > # Start nets: > * Create network lago-basic-suite-master-net-storage: > libvirt: error : internal error: Check the host setup: enabling IPv6 > forwarding with RA routes without accept_ra set to 2 is likely to cause > routes loss. Interfaces to look at: enp0s25 > * Create network lago-basic-suite-master-net-storage: ERROR (in > 0:00:00) > # Start nets: ERROR (in 0:00:00) > @ Start Prefix: ERROR (in 0:00:00) > Error occured, aborting > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 942, in main > cli_plugins[args.verb].do_run(args) > File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line > 184, in do_run > self._do_run(**vars(args)) > File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in > wrapper > return func(*args, **kwargs) > File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in > wrapper > return func(*args, prefix=prefix, **kwargs) > File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 265, in > do_start > prefix.start(vm_names=vm_names) > File "/usr/lib/python2.7/site-packages/lago/sdk_utils.py", line 50, > in wrapped > return func(*args, **kwargs) > File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1295, in > start > self.virt_env.start(vm_names=vm_names) > File "/usr/lib/python2.7/site-packages/lago/virt.py", line 342, in > start > net.start() > File "/usr/lib/python2.7/site-packages/lago/providers/libvirt/network.py", > line 107, in start > net = self.libvirt_con.networkCreateXML(self._libvirt_xml()) > File "/usr/lib64/python2.7/site-packages/libvirt.py", line 4052, in > networkCreateXML > if ret is None:raise libvirtError('virNetworkCreateXML() failed', > conn=self) > libvirtError: internal error: Check the host setup: enabling IPv6 > forwarding with RA routes without accept_ra set to 2 is likely to cause > routes loss. Interfaces to look at: enp0s25 > > Do you have any idea how to fix / work around that and make OST running > again? > > (Complete lago.log attached.) > > Thanks, > Milan > > > _______________________________________________ > Devel mailing list > Devel(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -- Eyal edri ASSOCIATE MANAGER RHV DevOps EMEA VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

3 2

Lago OST plugin v0.42 Release Announcement
by Gal Ben Haim 01 Aug '17

01 Aug '17

Hi All, On behalf of the Lago OST plugin team, I'm pleased to announce Lago OST plugin v0.42 is available! For a detailed release announcement please refer to our Github page at: https://github.com/lago-project/lago-ost-plugin/releases/tag/0.42 Resources ========== Docs: http://lago-ost-plugin.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago-ost-plugin YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/ Changelog: http://lago-ost-plugin.readthedocs.io/en/latest/_static/ChangeLog.txt -- *GAL bEN HAIM* RHV DEVOPS

1 0

Lago v0.41 Release Announcement
by Gal Ben Haim 01 Aug '17

01 Aug '17

Hi All, On behalf of the Lago team, I'm pleased to announce Lago v0.41 is available! For a detailed release announcement please refer to our Github page at: https://github.com/lago-project/lago/releases/tag/0.41 Resources ========== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Pypi: https://pypi.python.org/pypi/lago OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/ Changelog: http://lago.readthedocs.io/en/0.41/_static/ChangeLog.txt <http://lago.readthedocs.io/en/0.40/_static/ChangeLog.txt> As always, if you find any problems, or willing to contribute, visit our GitHub page. Enjoy! -- *GAL bEN HAIM* RHV DEVOPS

1 0

lago command taking 100% CPU
by Yaniv Kaul 30 Jul '17

30 Jul '17

When running o-s-t, and specifically when running add_secondary_storag, lago command is taking 100% CPU. I'm not sure where and why, and trying to narrow down the relevant threads did not yield a lot - it's not the Glance related functions, for example. I did try to make some changes to testlib.py, in an effort to reduce what I thought was a tight loop, but it made no effect (nevertheless, I think those are good changes): [ykaul@ykaul lago-ost-plugin]$ diff -u ovirtlago/testlib.py /usr/lib/python2.7/site-packages/ovirtlago/testlib.py --- ovirtlago/testlib.py 2017-07-28 11:15:31.506848944 +0300 +++ /usr/lib/python2.7/site-packages/ovirtlago/testlib.py 2017-07-28 09:29:19.403446285 +0300 @@ -209,7 +209,7 @@ return any(True for cls in cls_list if isinstance(obj, cls)) -def assert_equals_within(func, value, timeout, allowed_exceptions=None): +def assert_equals_within(func, value, timeout, allowed_exceptions=None, initial_wait=15): allowed_exceptions = allowed_exceptions or [] with utils.EggTimer(timeout) as timer: while not timer.elapsed(): @@ -219,12 +219,17 @@ return except Exception as exc: if _instance_of_any(exc, allowed_exceptions): + time.sleep(3) continue LOGGER.exception("Unhandled exception in %s", func) raise - time.sleep(3) + if initial_wait == 0: + time.sleep(3) + else: + time.sleep(initial_wait) + initial_wait = 0 try: raise AssertionError( '%s != %s after %s seconds' % (res, value, timeout) Any ideas how to debug this? I'm on F26, with latest Lago. Y.

2 1

Fedora 26 Lago template is now available
by Gal Ben Haim 19 Jul '17

19 Jul '17

Hi All, Fedora 26 Lago template is now available on [1]. The name of the template in the init file is "fc26-base". [1] - http://templates.ovirt.org/repo -- *GAL bEN HAIM* RHV DEVOPS

1 0

Can't upgrade F25 to F26 because of repoman?
by Yaniv Kaul 13 Jul '17

13 Jul '17

Last metadata expiration check: 0:00:24 ago on Wed Jul 12 15:01:00 2017. Error: package repoman-2.0.29-1.fc25.noarch requires python-argparse, but none of the providers can be installed. package python-2.7.13-2.fc25.x86_64 requires python-libs(x86-64) = 2.7.13-2.fc25, but none of the providers can be installed. package repoman-2.0.29-1.fc25.noarch requires python-argparse, but none of the providers can be installed

4 6

Lago v0.40 Release Announcement
by Gal Ben Haim 02 Jul '17

02 Jul '17

Hi All, On behalf of the Lago team, I'm pleased to announce Lago v0.40 is available! For a detailed release announcement please refer to our Github page at: https://github.com/lago-project/lago/releases/tag/0.40 Resources ========== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Pypi: https://pypi.python.org/pypi/lago OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/ Changelog: http://lago.readthedocs.io/en/0.40/_static/ChangeLog.txt As always, if you find any problems, or willing to contribute, visit our GitHub page. Enjoy! -- *GAL bEN HAIM* RHV DEVOPS

1 0

ssh to non-host vm
by Valentina Makarova 23 Jun '17

23 Jun '17

Hello! I try to use lago.ssh for ssh connection to non-host vm in ovirt-system-tests. And I have login/password (not root) for vm, but have not ssh-key. I try to use lago.ssh.get_ssh_client() to get connection but there is next code there: if ssh_key: client.connect( ip_addr, username=username, password=password, key_filename=ssh_key, timeout=ssh_timeout, ) else: client.connect( ip_addr, username='root', timeout=ssh_timeout, ) break But if I can't use key file, client should try to connect using login/password. And according this code I have to create empty file for this function and delete it after. (if ssh key != None but in is not existed file, client.connect ) Example is there: https://github.com/vmakarova/ovirt-system-tests/commit/855dbdf379730d55daf5… Is it a bug? Or is there some reasons for implementing this logic? Sincerely, Valentina Makarova

2 1

Heads up: lago on pip
by Nadav Goldin 22 Jun '17

22 Jun '17

Hi, As we plan in the upcoming release to make Lago available on PyPi, 'master' branch is now available on the PyPi test server. If you can help testing it, follow the instructions on: http://lago.readthedocs.io/en/latest/Installation.html#pip And replace the pip installation command(step 3) with: pip install --extra-index-url https://testpypi.python.org lago Thanks, Nadav.

1 0

Lago v0.39 is out!
by Nadav Goldin 04 Jun '17

04 Jun '17

On behalf of the Lago team, I'm pleased to announce the new release of Lago and Lago-ost-plugin: Lago - v0.39 Lago-ost-plugin v0.41 This is the first release where we've separated Lago and lago-ost-plugin(aka ovirtlago) to different repositories, installation procedures should be the same. However, from now on the lago-ost-plugin will follow a different release cycle. It's repository can be found at [1], and docs at [2]. Note that 'lago-ost-plugin' requires Lago >= 0.39. What's new ========= Lago ------- 1. Improved Ansible inventory support. For more details see [3]. 2. Lago SDK - Allows to run most CLI operations directly from Python. See [4] for the docs, and [5] for an example. This is mostly standardization of the already provided SDK. 3. Debian network support in bootstrap stage. Lago Images ----------------- 3 New images were added, please help in verifying them: 1. fc25-base 2. debian8-base 3. ubuntu16.04-base There is a known issue with host name resolution after boot in debian, but it does not affect connectivity. Tests/CI ------------ 1. Moved to tox to setup the virtualenv during the tests: * `tox -e docs` - builds the docs. * `tox -e py27` - run unittests and linters. * `tox -c tox-sdk.ini -- --stage check_patch/check_merged` - to run the functional SDK tests for each stage(after you have installed lago - either in a nested virtualenv or from RPMs). 2. Added SDK functional tests: * Easy to run sanity check while developing, under tests/functional-sdk run: `pytest -s -vvv --setup-show --stage check_patch test_sdk_sanity.py` 3. Added multi-distro tests, which means prior to merging every Lago patch, we'll ensure the core images in templates.ovirt.org are functional with the new patch. 4. Added ansible functional tests on check-merged. For the full changelog see [6]. Upgrading ======== To upgrade using yum or dnf, simply run: ``` yum/dnf update lago ``` Resources ======== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/ As always, if you find any problems, please open an issue in the GitHub page. Enjoy! Nadav. [1] https://github.com/lago-project/lago-ost-plugin [2] http://lago-ost-plugin.readthedocs.io/en/latest/ [3] https://github.com/lago-project/lago/pull/544 [4] http://lago.readthedocs.io/en/stable/SDK.html [5] https://github.com/lago-project/lago/blob/master/docs/examples/lago_sdk_one… [6] https://github.com/lago-project/lago/compare/0.38...0.39

1 0

Lago OST Plugin (ovirtlago) new repository
by Nadav Goldin 09 May '17

09 May '17

Hi, I finished moving 'ovirtlago' from Lago into a new repository. You can take a look at: https://github.com/lago-project/lago-ost-plugin.git. Reviewing the patches[1][2] and raising concerns(if any) would be appreciated, as changing the cut-off point is a little complicated. Some notes: 1. As far as installation from RPMs, nothing changes - both projects deploy to the same Lago unstable repository, which we manually deploy to 'stable' when releasing. 2. Versions - Lago's next version will be 0.39. Lago-ost-plugin will be 0.40. Which means it will skip v0.39. This to ensure the next release will be from the new repository. 3. lago-ost-plugin requires Lago >= 0.38(current version). 4. CI-GitHub flow is the same(ci test/merge etc). 5. I added in 'lago-ost-plugin' spec file also 'provides: lago-ost-plugin', so theoretically(did not test) it could be installed additionally with 'yum install lago-ost-plugin'. 6. I setup https://lago-ost-plugin.readthedocs.io, not much there for now(references to oVirt/Lago/OST). It is auto-updated via the normal webhooks. 7. lago-ost-plugin's functional tests are identical in check-patch/merged. We could add more tests there, it is relatively thin now. 8. Only files used by ovirtlago are in the git history of the new repository. Though this includes automation/ directory, so some changes might appear to be unrelated. On Lago's repository the relevant files were just 'git rm'ed. With this cleared off the table, we can move to the next goal: pip. Thanks, Nadav. [1] https://github.com/lago-project/lago/pull/537 [2] https://gerrit.ovirt.org/76641

1 0

test
by Eyal Edri 09 May '17

09 May '17

testing lago-devel archives -- Eyal edri ASSOCIATE MANAGER RHV DevOps EMEA VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

Slow reposync
by Yaniv Kaul 07 May '17

07 May '17

2017-05-06 18:52:53,553::log_utils.py::__enter__::599::lago.utils::DEBUG::start task:f141b349-76b3-4fae-bd42-97d73234ace0:Run command: "reposync" "--config=/home/ykaul/ovirt-system-tests/basic-suite-master/reposync-config.repo" "--download_path=/var/lib/lago/reposync" "--newest-only" "--delete" "--cachedir=/var/lib/lago/reposync/cache" "--repoid=ovirt-master-tested-el7": 2017-05-06 18:56:49,811::utils.py::_run_command::189::lago.utils::DEBUG::f141b349-76b3-4fae-bd42-97d73234ace0: command exit with return code: 0 centos-opstools-testing-el7 | 2.9 kB 00:00 9-76b3-4fae-bd42-97d73234ace0: command stdout: copr-sac-gdeploy-el7 | 3.0 kB 00:00 epel-el7 | 4.3 kB 00:00 ovirt-master-snapshot-static-el7 | 2.9 kB 00:00 ovirt-master-tested-el7 | 2.9 kB 00:00 2017-05-06 18:56:49,811::utils.py::_run_command::194::lago.utils::DEBUG::f141b349-76b3-4fae-bd42-97d73234ace0: command stderr: Yum-utils package has been deprecated, use dnf instead. See 'man yum2dnf' for more information. Obviously, if I'm syncing a single repo, why is it fetching metadata from other repos? We perhaps need to start splitting the config files to multiple conf files? It makes sense anyway, especially if we run the reposync per each repo independently anyway? Y.

3 4

Unknown VM type...?
by Yaniv Kaul 27 Apr '17

27 Apr '17

Trying to run o-s-t with Lago on F25 and I'm getting very early in the run an error that it only knows 'default' VM type. Any ideas? Where can I look for logs? TIA, Y.

3 3

Lago v0.38 Release announcement
by Gal Ben Haim 27 Apr '17

27 Apr '17

Hi All, On behalf of the Lago team, I'm pleased to announce Lago v0.38 is available! This quick release is focused on improving lago-ovirt plugin. Resources ======== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/ Full Changelog: * Thu Apr 27 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.38.0 c9f53d4d: Merge pull request #525 from lago-project/do_not_export_dns_records 047b8e50: Remove dns entries from exported init file * Thu Apr 27 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.37.3 fcf0fcd3: Merge pull request #520 from lago-project/improve_lago_ovirt_status 5c864202: Improve lago ovirt status * Thu Apr 27 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.37.2 c5687ae0: Merge pull request #519 from lago-project/print_message_lago_ovirt_start 9cf732ef: Print informative message after "lago ovirt start" * Thu Apr 27 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.37.1 4520202d: Merge pull request #518 from nvgoldin/increase_start_vm_timeout 33ca8c02: ovirtlago: reconfigure timeouts in 'lago ovirt start' As always, if you find any problems, or willing to contribute, visit our GitHub page. Enjoy! Gal.

1 0

Lago v0.37 Release announcement
by Nadav Goldin 23 Apr '17

23 Apr '17

Hi all, On behalf of the Lago team, I'm pleased to announce Lago v0.37 is available! What's new ========= General ------------ 1. Allow running arbitrary 'virt-customize' commands on template disks, prior to boot-up, for example: disks: - build: - virt-customize: ssh-inject: "" mkdir: "/tmp/some_dir" template_name: el7.3-base type: template name: root dev: vda format: qcow2 Will create the directory /tmp/some_dir in the template disk and inject Lago's generated ssh-keys to the root user. For a full list of available commands please consult virt-customize docs[1], under 'Customization options' section. 2. Allow skipping the 'bootstrap' stage(virt-sysprep) per VM, by defining 'bootstrap: false' under the VM definition. Libvirt ---------- 1. Use 'host-passthrough' as the default CPU mode. 2. Allow customizing CPU definitions, with 'cpu_custom' and 'cpu_model' parameters, see [2] for more details. 3. Automatically add DHCP leases for none management networks. 4. Auto select management network if not defined. 5. Allow defining custom DNS records in management networks. 6. Restrict DNS configurations to management networks only. 7. Enforce one management network per VM. ovirtlago ------------- 1. Export junit XML reports generated by nose with *.junit.xml suffix. 2. Add '--with-vms' option to 'lago ovirt start'. 3. Allow defining a custom CPU <-> Cluster level mapping file. For the full commit-log, which also includes several bug-fixes, see [3]. Upgrading ======== To upgrade using yum or dnf, simply run: yum/dnf update lago Resources ======== Lago Docs: http://lago.readthedocs.io/en/latest/ GitHub: https://github.com/lago-project/lago/ YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/ As always, if you find any problems, please open an issue in the GitHub page[4]. Enjoy! Nadav. [1] http://libguestfs.org/virt-customize.1.html [2] http://lago.readthedocs.io/en/latest/LagoInitFile.html#domains-section [3] https://github.com/lago-project/lago/compare/0.36...0.37 [4] https://github.com/lago-project/lago/issues/

1 0

Update yapf version
by Nadav Goldin 10 Apr '17

10 Apr '17

Hi, Please update your yapf version locally, as the old version is no longer pinned on master. I just merged another patch fixing the changes in the new version, probably should have committed it in the same patch that removed the yapf version restriction. Thanks, Nadav.

1 0

Running custom tests in OST
by Nadav Goldin 02 Apr '17

02 Apr '17

Hi, Sometimes I run OST and one of the tests fails, then I want to re-run only a specific test. The process I'm using right now is quite cumbersome[1]: ./run_suite.sh -o /dev/shm/ost basic-suite-master # failure/stop export LAGO_INITFILE_PATH="/home/ngoldin/src/gerrit.ovirt.org/ovirt-system-tests/basic-suite-master/" export LAGO_WORKDIR_PATH="/dev/shm/ost" export SUITE="basic-suite-master" cd /dev/shm/ost PYTHONPATH=$PYTHONPATH:/home/ngoldin/src/gerrit.ovirt.org/ovirt-system-test… lago ovirt runtest /home/ngoldin/src/gerrit.ovirt.org/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py (or any other custom .py file) Maybe there is some easier way to do this I missed? Maybe we should embed this ability in Lago or OST? Nadav. [1] https://gist.github.com/nvgoldin/e5046659a6ea7f002f890e7aafc62f66

1 0

DNS patch in 0.36 broke something?
by Yaniv Kaul 22 Mar '17

22 Mar '17

Now my VMs are getting an internal DNS, instead of libvirt's... (lago-he-basic-suite-4-1-storage.tlv.redhat.com) for example. Y.

2 2

Lago v0.36 released
by Gal Ben Haim 21 Mar '17

21 Mar '17

Hi All, Lago version v0.36 is out. The main changes are: 1. UX improvements. 2. Auto generate init file with 'lago export'. 3. Added 'lago shutdown' for gracefully shutdown and restart vms. 4. Allow to disable dns in libvirt networks. 5. Added "lago ovirt stop / start", high level commands for start and stop ovirt env gracefully. Docs: http://lago.readthedocs.io/en/0.36/index.html Repo: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ The full change-log: * Tue Mar 21 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.36.0 8c801f8a: Merge pull request #491 from lago-project/increase_shutdown_timeout 1893ae30: Increase shutdown timeout * Tue Mar 21 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.35.13 e42a6d56: Merge pull request #490 from lenoch/control-enable-dns 2c2052d1: Let us control if DNS should be enabled in a libvirt network. * Mon Mar 20 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.35.12 14f179f4: Merge pull request #485 from nvgoldin/add_stop_start 3b136c9d: ovirtlago: add 'ovirt start'/'ovirt stop' * Mon Mar 20 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.35.11 fcdc165b: Merge pull request #452 from mykaul/qcow2_changes 179f5114: Change lazy_refcounts to ON in the snapshots, move to virtio-console dc2e4e87: Merge branch 'master' into qcow2_changes 1c72729a: Merge branch 'master' into qcow2_changes * Mon Mar 20 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.35.10 4cf0197f: Merge pull request #479 from mykaul/remove_mark_used ac237733: Remove the whole marking of usage of templates e3f968de: Merge branch 'master' into remove_mark_used 009c3b34: Merge branch 'master' into remove_mark_used * Mon Mar 20 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.35.9 2ab669fd: Merge pull request #482 from lago-project/drop_paramiko_version_requirement 8802fe09: Revert "spec: require paramiko >= 1.16.1-2 on el7" * Mon Mar 20 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.35.8 d26883db: Merge pull request #480 from lago-project/add_shutdown_cmd 22ae3ec1: Adding lago shutdown * Thu Mar 16 2017 ovirt-infra <infra-private(a)ovirt.org> - 0.35.7 61d13934: Merge pull request #471 from mykaul/raise_ioerror 789ee258: Merge branch 'master' into raise_ioerror 2c23ac21: Print the URL if an IO error occurred. * Thu Mar 16 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.35.6 0ea1688e: Merge pull request #477 from lago-project/export_init_file 34417289: Generate an init file that can be used with exported images * Thu Mar 16 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.35.5 d12ed682: Merge pull request #476 from nvgoldin/drop_check_deps c8a7b092: Drop check_deps function * Tue Mar 14 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.35.4 e0ae7b0c: Merge pull request #457 from nvgoldin/informative_workdir_exp 665d77f0: Print informative message when a workdir is not found * Tue Mar 14 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.35.3 a1c4a076: Merge pull request #474 from mykaul/sysprep_update f58acacd: Allow to call sysprep.update() which will update all packages * Mon Mar 06 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.35.2 ff2475a4: Merge pull request #466 from nvgoldin/init_fail_early a2ca17a7: Don't leave malformed workdir on 'lago init' failure * Mon Mar 06 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.35.1 0c07457a: Merge pull request #467 from lago-project/fix_export_test 1bb52aba: Destroy layered env at the end of the tests

1 0

Why do we need qemu-kvm-*ev* ?
by Yaniv Kaul 19 Mar '17

19 Mar '17

I don't see a good reason why we need anything but qemu-kvm. The following commit adds the requirement - but I don't see the real need for it: commit a7d71ad2994aab3234371e850c617b826b3681b1 Author: Rafael Martins <rmartins(a)redhat.com> Date: Tue Jan 3 15:26:54 2017 +0100 Force usage of qemu-kvm-rhev on centos/rhel Lago requires qemu-kvm >= 2.1.2, these are the required package names for each distro: CentOS: the package is named 'qemu-kvm-ev', but it provides 'qemu-kvm-rhev' RHEL: named 'qemu-kvm-rhev' Fedora: 'qemu-kvm' Signed-off-by: gbenhaim <galbh2(a)gmail.com> Signed-off-by: Nadav Goldin <ngoldin(a)redhat.com>

4 10

Can't get selinux-policy-3.13.1-102.el7_3.15.noarch from EL 7 updates in reposync
by Yaniv Kaul 16 Mar '17

16 Mar '17

While I'm trying to update selinux-policy and selinux-policy-targeted updated (suspecting of a SElinux bug), I could only get selinux-policy-targeted downloaded to my internal repo. Any ideas why? Updating it manually from the VMs work well. 2017-03-13 12:19:56,415::INFO::repoman.common.stores.RPM::Adding package /var/lib/lago/reposync/centos-updates-el7/Packages/selinux-policy-targeted-3.13.1-102.el7_3.15.noarch.rpm to repo Non persistent RPMStore 2017-03-13 12:19:56,786::INFO::repoman.common.stores.RPM::Adding package /var/lib/lago/reposync/centos-updates-el7/Packages/selinux-policy-targeted-3.13.1-102.el7_3.15.noarch.rpm to repo /home/ykaul/ovirt-system-tests/deployment-basic-suite-master/default/internal_repo 2017-03-13 12:20:01,901::INFO::root::Saving /home/ykaul/ovirt-system-tests/deployment-basic-suite-master/default/internal_repo/el7/noarch/selinux-policy-targeted-3.13.1-102.el7_3.15.noarch.rpm TIA, Y.

3 2

HE setup failure
by Sahina Bose 09 Mar '17

09 Mar '17

Hi all, The HE setup fails in ovirt-system-tests while deploying HE on hyperconverged gluster setup using master Error : Failed to execute stage 'Misc configuration': <ProtocolError for localhost:54321/RPC2: 400 Bad Request>" Traceback from hosted-engine log: ProtocolError: <ProtocolError for localhost:54321/RPC2: 400 Bad Request> File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/storage_backends.py", line 279, in create_volume volUUID=volume_uuid File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/storage_backends.py", line 245, in _get_volume_path volUUID File "/usr/lib64/python2.7/xmlrpclib.py", line **FILTERED**3, in __call__ return self.__send(self.__name, args) File "/usr/lib64/python2.7/xmlrpclib.py", line 1587, in __request verbose=self.__verbose File "/usr/lib64/python2.7/xmlrpclib.py", line 1273, in request return self.single_request(host, handler, request_body, verbose) File "/usr/lib64/python2.7/xmlrpclib.py", line 1321, in single_request response.msg, ProtocolError: <ProtocolError for localhost:54321/RPC2: 400 Bad Request> Is this a regression?

3 4

OST: HE installation on 4.1 fails due to default cluster level
by Sahina Bose 03 Mar '17

03 Mar '17

Hi all, The ovirt-engine 4.1 appliance has the Default cluster set to 4.2 and the hyperconverged OST tests fail here as the 4.1 host cannot be added to cluster. (CLUSTER_VERSION_INCOMPATIBLE_WITH_CLUSTER) The appliance is from http://resources.ovirt.org/repos/ovirt/tested/master/rpm/el7/noarch/ovirt-e… Has the default cluster level been changed in an updated appliance? Test results at http://jenkins.ovirt.org/view/oVirt system tests/job/ovirt_4.1_hc-system-tests/1/artifact/exported-artifacts thanks sahina

4 5

Lago v0.35 released
by Gal Ben Haim 01 Mar '17

01 Mar '17

Hi All, Lago version v0.35 is out. the main changes are: 1. Add the option to export vm disks that can be used later in other environments. 2. Stop on failure when running tests with 'lago ovirt runtest'. 3. Add three commands to lago ovirt: start-host: puts hosts in activate mode. stop-hosts: puts hosts in maintenance mode. stop-vms: stop layer 2 vms. Docs: http://lago.readthedocs.io/en/0.35/index.html Repo: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ The full change-log: * Tue Feb 28 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.35.0 b2aacea4: Merge pull request #459 from mykaul/start_stop_hosts e83907a6: Add 'start-hosts', 'stop-hosts', 'stop-vms', 'status' to ovirt sub-command * Mon Feb 27 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.34.6 d070675e: Merge pull request #458 from lago-project/adding_basic_video_device 03634af1: Adding basic video device * Sun Feb 26 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.34.5 74b30c3f: Merge pull request #444 from lenoch/explicit-python2 66d47401: Use python2 explicitly. * Sun Feb 26 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.34.4 cf0d6ab3: Merge pull request #455 from mykaul/stop_after_failure ef9a1ecf: Revert bfea3cc4d104381cd6e5a2ffd9d325843f5ac5f0 - stop on failures * Sat Feb 25 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.34.3 4b25a7b4: Merge pull request #450 from nvgoldin/revert_paramiko 79249c14: spec: require paramiko >= 1.16.1-2 on el7 3ba0e79c: Revert "Make paramiko v1.16 work with python2-crypto again" * Wed Feb 22 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.34.2 8e55db61: Merge pull request #401 from lago-project/export_feature f8034519: Added the ability to export images from a prefix * Mon Feb 20 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.34.1 67c3088b: Merge pull request #453 from nvgoldin/reorder_packages f58e3b7d: automation: sort mock configurations

1 0

OST: HE vm does not restart on HC setup
by Sahina Bose 22 Feb '17

22 Feb '17

Hi all, On the HC setup, the HE VM is not restarted. The agent.log has MainThread::INFO::2017-02-21 22:09:58,022::state_machine::169::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} MainThread::INFO::2017-02-21 22:09:58,023::state_machine::177::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'failed to getVmStats', 'health': 'unknown', 'vm': 'unknown', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 4079.0, 'maintenance': False, 'cpu-load': 0.0491, 'gateway': True} ... MainThread::INFO::2017-02-21 22:10:29,219::state_decorators::25::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Unknown local engine vm status no actions taken MainThread::INFO::2017-02-21 22:10:29,219::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1487733029.22 type=state_transition detail=ReinitializeFSM-UnknownLocalVmState hostname='lago-hc-basic-suite-master-host0' MainThread::INFO::2017-02-21 22:10:29,317::brokerlink::121::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-UnknownLocalVmState) sent? ignored and the vdsm.log 2017-02-21 22:09:11,962-0500 INFO (libvirt/events) [virt.vm] (vmId='2ccc0ef0-cc31-45b8-8e91-a78fa4cad671') Changed state to Down: User shut down from within the guest (code=7) (vm:1269) 2017-02-21 22:09:11,962-0500 INFO (libvirt/events) [virt.vm] (vmId='2ccc0ef0-cc31-45b8-8e91-a78fa4cad671') Stopping connection (guestagent:429) 2017-02-21 22:09:29,727-0500 ERROR (jsonrpc/4) [api] FINISH getStats error=Virtual machine does not exist: {'vmId': u'2ccc0ef0-cc31-45b8-8e91-a78fa4cad671'} (api:69) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 67, in method ret = func(*args, **kwargs) File "/usr/share/vdsm/API.py", line 335, in getStats vm = self.vm File "/usr/share/vdsm/API.py", line 130, in vm raise exception.NoSuchVM(vmId=self._UUID) NoSuchVM: Virtual machine does not exist: {'vmId': u'2ccc0ef0-cc31-45b8-8e91-a78fa4cad671'} What should I be looking for to identify the issue? The logs are at http://jenkins.ovirt.org/job/ovirt_master_hc-system-tests/lastCompletedBuil… thanks sahina

7 10

Re: [lago-devel] [ovirt-devel] OST: vm_run fails for me (basic-suite-master)
by Nadav Goldin 10 Feb '17

10 Feb '17

What is the host CPU you are using? I came across the same error few days ago, but without running OST, I tried running with Lago: fc24 host -> el7 vm -> el7 vm. I have a slight suspect that it is related to the CPU model we configure in libvirt, I tried a mixture of few combinations(host-pass-through, pinning down the CPU model), but it always failed on the same error: kvm_put_msrs: Assertion `ret == n' failed. My CPU is Broadwell btw. Milan, any ideas? you think it might be related? Nadav. On Tue, Feb 7, 2017 at 11:14 PM, Ondrej Svoboda <osvoboda(a)redhat.com> wrote: > Yes, I stated that in my message. > > root@osvoboda-t460p /home/src/ovirt-system-tests (git)-[master] # cat > /sys/module/kvm_intel/parameters/nested > :( > Y > > On Tue, Feb 7, 2017 at 1:39 PM, Eyal Edri <eedri(a)redhat.com> wrote: >> >> Did you follow the instructions on [1] ? >> >> Specifically, verifying ' cat /sys/module/kvm_intel/parameters/nested ' >> gives you 'Y'. >> >> [1] >> http://ovirt-system-tests.readthedocs.io/en/latest/docs/general/installatio… >> >> On Tue, Feb 7, 2017 at 2:29 PM, Ondrej Svoboda <osvoboda(a)redhat.com> >> wrote: >>> >>> Hi everyone, >>> >>> Even though I have nested virtualization enabled in my Arch Linux system >>> which I use to run OST, vm_run is the first test to fail in 004_basic_sanity >>> (followed by snapshots_merge and suspend_resume_vm). >>> >>> Can you point me to what I might be missing? I believe I get the same >>> failure even on Fedora. >>> >>> This is what host0's CPU capabilities look like (vmx is there): >>> [root@lago-basic-suite-master-host0 ~]# cat /proc/cpuinfo >>> processor : 0 >>> vendor_id : GenuineIntel >>> cpu family : 6 >>> model : 44 >>> model name : Westmere E56xx/L56xx/X56xx (Nehalem-C) >>> stepping : 1 >>> microcode : 0x1 >>> cpu MHz : 2711.988 >>> cache size : 16384 KB >>> physical id : 0 >>> siblings : 1 >>> core id : 0 >>> cpu cores : 1 >>> apicid : 0 >>> initial apicid : 0 >>> fpu : yes >>> fpu_exception : yes >>> cpuid level : 11 >>> wp : yes >>> flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca >>> cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx lm constant_tsc rep_good >>> nopl xtopology pni pclmulqdq vmx ssse3 cx16 sse4_1 sse4_2 x2apic popcnt aes >>> hypervisor lahf_lm arat tpr_shadow vnmi flexpriority ept vpid >>> bogomips : 5423.97 >>> clflush size : 64 >>> cache_alignment : 64 >>> address sizes : 40 bits physical, 48 bits virtual >>> power management: >>> >>> journalctl -b on host0 shows that libvirt complains about NUMA >>> configuration: >>> >>> Feb 07 06:33:23 lago-basic-suite-master-host0 libvirtd[12888]: libvirt >>> version: 2.0.0, package: 10.el7_3.4 (CentOS BuildSystem >>> <http://bugs.centos.org>, 2017-01-17-23:37:48, c1bm.rdu2.centos.org) >>> Feb 07 06:33:23 lago-basic-suite-master-host0 kernel: ovirtmgmt: port >>> 2(vnet0) entered disabled state >>> Feb 07 06:33:23 lago-basic-suite-master-host0 kernel: device vnet0 left >>> promiscuous mode >>> Feb 07 06:33:23 lago-basic-suite-master-host0 kernel: ovirtmgmt: port >>> 2(vnet0) entered disabled state >>> Feb 07 06:33:23 lago-basic-suite-master-host0 libvirtd[12888]: hostname: >>> lago-basic-suite-master-host0.lago.local >>> Feb 07 06:33:23 lago-basic-suite-master-host0 libvirtd[12888]: Unable to >>> read from monitor: Connection reset by peer >>> Feb 07 06:33:23 lago-basic-suite-master-host0 libvirtd[12888]: internal >>> error: qemu unexpectedly closed the monitor: 2017-02-07T11:33:23.058571Z >>> qemu-kvm: warning: CPU(s) not present in any NUMA nodes: 1 2 3 4 5 6 7 8 9 >>> 10 11 12 13 14 15 >>> >>> 2017-02-07T11:33:23.058826Z qemu-kvm: warning: All CPU(s) up to maxcpus >>> should be described in NUMA config >>> qemu-kvm: >>> /builddir/build/BUILD/qemu-2.6.0/target-i386/kvm.c:1736: kvm_put_msrs: >>> Assertion `ret == n' failed. >>> Feb 07 06:33:23 lago-basic-suite-master-host0 NetworkManager[657]: <info> >>> [1486467203.1025] device (vnet0): state change: disconnected -> unmanaged >>> (reason 'unmanaged') [30 10 3] >>> Feb 07 06:33:23 lago-basic-suite-master-host0 kvm[22059]: 0 guests now >>> active >>> Feb 07 06:33:23 lago-basic-suite-master-host0 systemd-machined[22044]: >>> Machine qemu-1-vm0 terminated. >>> >>> Thanks, >>> Ondra >>> >>> _______________________________________________ >>> Devel mailing list >>> Devel(a)ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/devel >> >> >> >> >> -- >> Eyal Edri >> Associate Manager >> RHV DevOps >> EMEA ENG Virtualization R&D >> Red Hat Israel >> >> phone: +972-9-7692018 >> irc: eedri (on #tlv #rhev-dev #rhev-integ) > > > > _______________________________________________ > Devel mailing list > Devel(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel

3 7

New Lago release - v0.34
by Nadav Goldin 07 Feb '17

07 Feb '17

Hi all, New Lago version is out - v0.34, notable changes in this release: 1. New command - 'lago ansible_hosts' This command will generate an ansible inventory file, it requires the prefix to be initialized before calling it. VMs will be grouped by their respective 'vm-type' in the inventory file, for an example on how to use it, see the PR[1]. 2. A work-around for python2-paramiko-1.16.1-1.el7 failure[2], which was caused due to a new python2-crypto release. Hopefully, a new paramiko version will be pushed to epel soon, so we could remove this by the next release. 3. Require python-paramiko >= v2.1.1 on Fedora 24/25, it is available under fedora/updates. 4. The video device will no longer be created. The full commit log is available at [3], Thanks everyone for their contributions! Upgrading --------------- To upgrade using yum or dnf, simply run: yum/dnf update lago Note to ovirt-system-tests users ----------------------------------------------- Please ensure after upgrading that the 'ovirtlago' service is enabled by executing: sudo firewall-cmd --add-service=ovirtlago --permanent sudo firewall-cmd --reload As always, if you find any problems, please open an issue in the GitHub page[4]. Enjoy, Nadav. Docs: http://lago.readthedocs.io/en/0.34/ RPM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ GitHub: https://github.com/lago-project/lago/ For OST docs: http://ovirt-system-tests.readthedocs.io/en/latest/ [1] https://github.com/lago-project/lago/pull/428#issuecomment-274070364 [2] https://bugzilla.redhat.com/show_bug.cgi?id=1419312 [3] https://github.com/lago-project/lago/compare/0.33...0.34 [4] https://github.com/lago-project/lago/issues/

1 0

vdsm service fails to start on HC setup
by Sahina Bose 07 Feb '17

07 Feb '17

Hi all, While verifying the test to deploy hyperconverged HE [1], I'm running into an issue today where vdsm fails to start. In the logs - lago-basic-suite-hc-host0 vdsmd_init_common.sh: Error: Feb 6 02:21:32 lago-basic-suite-hc-host0 vdsmd_init_common.sh: One of the modules is not configured to work with VDSM. Starting manually - vdsm-tool configure --force gives: Units need configuration: {'lvm2-lvmetad.service': {'LoadState': 'masked', 'ActiveState': 'failed'}} Is this a known issue? [1] - https://gerrit.ovirt.org/57283 thanks sahina

4 5

Lago v0.32 released
by Gal Ben Haim 17 Jan '17

17 Jan '17

Hi All, Lago version v0.32 is out. the main changes are: 1. Allow to configure the cpu model in the init file by adding "cpu_model: MODEL" to the vm definition (for example "cpu_model: SandyBridge"). 2. Allow to specify "repoman" config to "lago ovirt reposetup" with "--repoman-config". The full change-log: * Tue Jan 17 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.32.0 a7a99aee: Merge pull request #431 from nvgoldin/revert_ovirt_cpu 66704a0c: Revert "ovirtlago: drop get_ovirt_cpu_family" * Mon Jan 16 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.31.4 6dd96515: Merge pull request #418 from lago-project/adding_qemu_kvm_ev_dep a7d71ad2: Force usage of qemu-kvm-rhev on centos/rhel * Mon Jan 16 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.31.3 f78e351b: Merge pull request #425 from nvgoldin/custom_repoman_conf 41553b76: ovirtlago: allow defining custom repoman config file 76bf0bae: ovirtlago: don't download source RPMs by default 208bfc34: ovirtlago: allow passing custom repoman filters b816daf8: ovirtlago: remove deprecated per-project repo directories * Mon Jan 16 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.31.2 7f25ef33: Merge pull request #427 from nvgoldin/he_cpu f31b74c4: ovirtlago: drop get_ovirt_cpu_family 548a32a6: Allow configuring cpu_model per libvirt VM * Mon Jan 16 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.31.1 5e647d32: Merge pull request #424 from lveyde/patch-1 8629d41f: Return SandyBridge CPU family Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

2 2

Lago v0.31 released
by Nadav Goldin 09 Jan '17

09 Jan '17

Hi all, New Lago version is out - v0.31, this is a small release with few bug fixes. To upgrade using yum or dnf simply run: yum/dnf update lago Note to ovirt-system-tests users: you might need to re-enable the 'ovirtlago' service after upgrading. This can be done by running: sudo firewall-cmd --add-service=ovirtlago --permanent sudo firewall-cmd --reload If you find any problems, please open an issue in the GitHub page[1]. Docs: http://lago.readthedocs.io/en/0.31/ RPM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ GitHub: https://github.com/lago-project/lago/ For OST docs: http://ovirt-system-tests.readthedocs.io/en/latest/ The full change-log: * Mon Jan 09 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.31.0 c8ee2190: Merge pull request #408 from nvgoldin/reposync_no_file 2cef75b4: ovirtlago: allow running reposync with custom_sources only * Mon Jan 09 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.30.4 5fee77b2: Merge pull request #415 from nvgoldin/collect_libvirt 3a603784: ovirtlago: drop ovirt.collect tests a345d4d8: ovirtlago: collect entire /var/log directory * Sun Jan 08 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.30.3 b12bad3a: Merge pull request #421 from nvgoldin/slow_start 3dea5d04: workaround for cirros images not getting ip on boot * Wed Jan 04 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.30.2 7a990a30: Merge pull request #397 from mz-pdm/fix-rpmbuild ee5327a4: Add build dependency on python2-rpm-macros * Wed Jan 04 2017 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.30.1 bb846b43: Merge pull request #398 from mz-pdm/fix-cpu-model 05ccf724: More robust CPU selection Thanks everyone for their contributions! Nadav. [1] http://github.com/lago-project/lago/issues

1 0

Lago v0.30 released
by Nadav Goldin 26 Dec '16

26 Dec '16

Hi, New Lago version is out - v0.30, this release adds few major improvements: 1. Fedora 25 RPMs are now available, also dropping support for Fedora 23 after it was EOL'ed last week(last fc23 version is 0.29). 2. 'lago collect' command now uses SCP to extract files, if SSH in the VM is unavailable it will attempt to use libguestfs. 3. List multiple IPs in each VM. 4. ovirtlago: add new test_equals* assertion functions to the testlib. Other than that this release includes quite a few bug fixes, details are in the change-log below. Thanks for everyone who contributed and reported issues. To upgrade using yum or dnf simply run: yum/dnf update lago Note to ovirt-system-tests users: you might need to re-enable the 'ovirtlago' service after upgrading, this can be done by running: sudo firewall-cmd --add-service=ovirtlago --permanent sudo firewall-cmd --reload If you find any problems, please open an issue in the GitHub page[1]. Docs: http://lago.readthedocs.io/en/0.30/ RPM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ GitHub: https://github.com/lago-project/lago/ For OST docs: http://ovirt-system-tests.readthedocs.io/en/latest/ The full change-log: * Mon Dec 26 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.30.0 bfd635d8: Merge pull request #400 from mykaul/multiple_ips 1dc030f5: Add a function to get all the IPs of a VM * Mon Dec 26 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.29.10 d62571fa: Merge pull request #385 from leongold/master 39babc10: added test_equals* tests in order for testlib to include tests * Mon Dec 26 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.29.9 b79fc534: Merge pull request #404 from mykaul/master 8855d669: Fix IPv6 subnet allocation. * Mon Dec 26 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.29.8 ca83aab0: Merge pull request #406 from nvgoldin/sshinject ac4f2df0: Revert usage of 'ssh-inject' in sysprep * Mon Dec 26 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.29.7 d94b452f: Merge pull request #383 from nvgoldin/guestfs_backend 4f6eb28d: use LIBGUESTFS_BACKEND variable if set * Mon Dec 26 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.29.6 71b93315: Merge pull request #382 from nvgoldin/continue_on_failure 0f8cee80: ovirtlago: drop exception handling in test_sequence_gen * Sun Dec 25 2016 Yaniv Kaul <ykaul(a)redhat.com> - 0.29.5 c58abf06: Merge pull request #395 from mykaul/inject-keys 9f9e7185: Small sysprep fixes * Sun Dec 25 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.29.4 60bde7d9: Merge pull request #388 from nvgoldin/extract_scp f7c5762a: Refactor collect command to use SCP * Sun Dec 25 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.29.3 62c92b12: Merge pull request #405 from nvgoldin/wait_net 511e3dc5: Check network is active after creation * Mon Dec 19 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.29.2 f4b86af2: Merge pull request #396 from mykaul/fix_apiv4 ed77c957: Fix oVirt APIv4 creation * Mon Dec 19 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.29.1 12b7fbbf: Merge pull request #391 from nvgoldin/guestfs_params afec1ac3: automation: configure KVM and libguestfs parameters Enjoy! Nadav. [1] http://github.com/lago-project/lago/issues

1 0

Re: [lago-devel] [Infra-private] Jenkins failure - parallel build?
by Barak Korren 25 Dec '16

25 Dec '16

On 20 December 2016 at 14:31, Yaniv Kaul <ykaul(a)redhat.com> wrote: > > > On Tue, Dec 20, 2016 at 12:32 PM, Barak Korren <bkorren(a)redhat.com> wrote: >> >> Its just its "nice" way of telling you that check_merged failed on fc23: >> http://jenkins.ovirt.org/job/lago_master_check-merged-fc23-x86_64/276/ > > > Thanks. That seem to fail on an unrelated issue to my patch... > > 08:21:16 not ok 16 basic.full_run: shell to a vm > 08:21:16 # (from function `helpers.contains' in file > tests/functional/helpers.bash, line 96, > 08:21:16 # in test file tests/functional/basic.bats, line 201) > 08:21:16 # `helpers.contains "$output" "$expected_hostname"' failed > > 08:21:16 # RUNNING:lago shell lago_functional_tests_vm01 hostname > > > ARGH... I'll look into it. > Y. > Worked fine on fc24 and el7, so maybe just drop fc23? Adding Nadav and Gal, moving to lago-devel. -- Barak Korren bkorren(a)redhat.com RHCE, RHCi, RHV-DevOps Team https://ifireball.wordpress.com/

3 3

[Attention] Lago release on Tuesday - 20.12.2016
by Nadav Goldin 25 Dec '16

25 Dec '16

Hey all, We plan to release Lago 0.30 on Tuesday, so please make sure all PRs are merged until 11:00 - 20.12.2016 TLV time. Thanks, Nadav.

1 2

New Lago release - v0.29
by Nadav Goldin 13 Dec '16

13 Dec '16

Hey all, New Lago version is out - 0.29, this is a small release with few bug fixes and enhancements, namely: 1. Improvement to VM boot time - interactive boot-menu will now be disabled for fc24/el7 images. 2. The SCSI controller will be generated only if virtio-SCSI is used. 3. 'lago ovirt reposetup' command will run per repository and will handle better conflicting RPMs stored in the local cache. 4. Two bug fixes in the ovirtlago testing library. To upgrade using yum or dnf simply run: yum/dnf update lago If you find any problems, please open an issue in the GitHub page[1]. Known issue with ovirt-system-tests ----------------------------------------------------- After upgrading, the 'ovirtlago' service might be disabled which will fail the 'reposetup' stage. As a work-around please run: sudo firewall-cmd --add-service=ovirtlago --permanent sudo firewall-cmd --reload If not using firewalld, see [2] for iptables instructions. This is caused due to a bug in the spec file, apologizes for the inconvenience. Docs: http://lago.readthedocs.io/en/0.29/ RPM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ GitHub: https://github.com/lago-project/lago/i For OST docs: http://ovirt-system-tests.readthedocs.io/en/latest/ The full change-log: * Sun Dec 11 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.29.0 3cf8d87c: Merge pull request #377 from nvgoldin/log_skiptest 916cd379: ovirtlago: log skipped tests to stdout * Sun Dec 11 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.28.5 45a445b7: Merge pull request #376 from mykaul/sysprep_edit b2511c45: Reduce boot time * Sun Dec 11 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.28.4 955974de: Merge pull request #372 from nvgoldin/caps_bug 53262943: ovirtlago: fix bug in capabilities * Wed Dec 07 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.28.3 fbb96183: Merge pull request #374 from mykaul/fix_reposetup 1e935e94: Fix reposync - use 'continue', not 'return' * Tue Dec 06 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.28.2 48bffab0: Merge pull request #369 from nvgoldin/bz1399235 e8a6edb7: make reposync more verbose and fix bz 1399235 * Mon Dec 05 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.28.1 e8d11e3d: Merge pull request #370 from mykaul/scsi_on_demand ef337fff: Create the SCSI controller only if needed. Enjoy! Nadav. [1] http://github.com/lago-project/lago/issues [2] https://github.com/lago-project/lago/pull/379/commits/454930fab2bb7477cedc4…

1 0

New error in mock on lago check_patch
by Nadav Goldin 12 Dec '16

12 Dec '16

Hi Barak, I saw a new error[1] in mock today, IIRC this is not the same error as the usual 'mirror unavailable': DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-24-x86_64-b43344fe05507be58adc19b93da78705-5023/root/', '--releasever', '24', 'install', '@buildsys-build', 'bats', 'git', 'python-dulwich', 'python2-devel', 'python-virtualenv', 'python-libguestfs', 'libxslt-devel', 'libvirt-devel', 'libffi-devel', 'openssl-devel', 'dnf-command(builddep)', 'grubby', 'python-pip', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ', 'SHELL': '/bin/bash', 'TERM': 'vt100', 'LC_MESSAGES': 'C', 'HOME': '/builddir', 'LD_PRELOAD': '/tmp/tmpzv6o4sbn/$LIB/nosync.so', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007"', 'HOSTNAME': 'mock', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'LANG': 'en_US.UTF-8'} and shell False DEBUG util.py:421: Yum command has been deprecated, use dnf instead. DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information. DEBUG util.py:421: http://mirror.math.princeton.edu/pub/fedora/linux/updates/24/x86_64/repodat…: [Errno -1] repomd.xml does not match metalink for updates DEBUG util.py:421: Trying other mirror. DEBUG util.py:421: http://repo.atlantic.net/fedora/linux/updates/24/x86_64/repodata/repomd.xml: [Errno -1] repomd.xml does not match metalink for updates DEBUG util.py:421: Trying other mirror. DEBUG util.py:421: https://mirrors.kernel.org/fedora/updates/24/x86_64/repodata/repomd.xml: .... You think it might be related to the cache change? Thanks, Nadav. [1] http://jenkins.ovirt.org/job/lago_master_check-patch-fc24-x86_64/260/artifa…

3 7

Fwd: Lago/o-s-t VLAN/dnsmasq issue.
by Leon Goldberg 07 Dec '16

07 Dec '16

Hey, I suspect there's an issue where the current configuration of o-s-t (I've only tried basic-suite-4.0, but I guess it is not suite related), and more specifically dnsmasq's dhcp configuration under Lago/o-s-t (or otherwise) fails to serve VLAN interfaces. After successfully running basic-suite-4.0, I'm trying to call dhclient to serve eth0.600 on host0 (created in 005_network_by_label), which fails. DHCPDISCOVER(s) are reaching the bridge dnsmasq listen on, however no offers are being sent. A couple of things I've tried and the relevant conclusions: 1) After hotplugging a nic (eth1) on host0 via virsh (using the same source network/bridge), I've set a VLAN interface on top of it (eth1.600). Calling dhclient for eth1 worked; eth1.600 failed. I've tried this to rule out the cause being some configuration used in 005_network_by_label. 2) I've added a veth pair, with veth0 being added to Lago's bridge, and with having a VLAN interface (using the same ID) on top of veth1 (veth1.600) dnsmasq was set to listen on/serve veth1.600 without any success, although the VLAN tag is effectively removed. Similarly, DHCPDISCOVER(s) are being received, without any offers being sent. After setting an address manually on eth0.600, I was able to ping veth1.600 <-> eth0.600. Thanks, Leon

2 1

Where is ovirt-engine-sdk-python ?
by Yaniv Kaul 07 Dec '16

07 Dec '16

For some reason, both Hosted Engine and 4.0 ovirt-system-tests suites fail to find the v3 ovirt-engine-sdk-python RPM. I'm pretty sure it was OK yesterday. I do see it in the repos, the failure is: Error: Package: ovirt-engine-cli-3.6.9.2-1.el7.centos.noarch (alocalsync) Requires: ovirt-engine-sdk-python >= 3.6.0.0 However, I do have it: [ykaul@ykaul reposync]$ find . -name "ovirt-engine-cli-3.6.9.2-1.el7.centos.noarch*" ./ovirt-4.0-snapshot-el7/noarch/ovirt-engine-cli-3.6.9.2-1.el7.centos.noarch.rpm ./ovirt-master-snapshot-el7/noarch/ovirt-engine-cli-3.6.9.2-1.el7.centos.noarch.rpm [ykaul@ykaul noarch]$ find . -name "ovirt-engine-sdk-python-*" ./ovirt-engine-sdk-python-3.6.9.2-0.1.20161204.gite99bbd1.el7.centos.noarch.rpm And it's not copied to the deployment - could be a regression in the reposync? Y.

2 1

Deprecating Defaults for to_all_distros Setting in repoman
by Anton Marchukov 01 Dec '16

01 Dec '16

Hello All. If you use repoman please be aware that it currently has hardcoded list of packages that defaults to being distroless. This is controlled by "to_all_distros" configuration setting, but if you do not set it than the defaults are used. For ovirt experimental we decided that we better have all packages to have distro specified in spec. This also inline with most distro packaging guidelines. But then with current defaults repoman will consider those package to be distroless even when they are not and specifying an empty list in configuration is a silly way to override this. This change provides an incompatibility, but you can still use this feature by specifying to_all_distros package list explicitly in the config. So it is just the change of default values at this point: https://gerrit.ovirt.org/#/c/67662/ If somebody is not ok with defaults change and need time to update configuration please let me know. Also if you are not sure we can go another way and have intermediate repoman version that does not do the change, but issue deprecation warning if defaults are being used, so everybody can test their setups. However I think that it is might not be actually needed in this case as it is a configuration thing. Please feel free to comment on change request. Anton. -- Anton Marchukov Senior Software Engineer - RHEV CI - Red Hat

2 2

New Lago release - 0.28.0
by Gal Ben Haim 24 Nov '16

24 Nov '16

Hi Everyone! There's a new Lago release with version 0.28.0 ready for you to upgrade! Key Changes: 1. We are now formatting our code with 'yapf' 0.14.0. For all our contributors, please update 'yapf' if needed. 2. When running 'lago shell' it's possible to specify only the suffix of the vm's name and lago will resolve the full name. 3. We removed some unused code from lago-ovirt plugin. Docs - http://lago.readthedocs.io/en/0.28/ Repo - http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Here are the changes: * Thu Nov 24 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.28.0 ee15dfbb: Merge pull request #356 from lago-project/pkg_resources_exception 81152cd7: Fixed exception handling when checking for deps * Thu Nov 24 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.27.5 ab5aa8a6: Merge pull request #366 from mykaul/skip_freeze 397321e5: Switch to optionall freeze the FS before logs extraction. 5fe33adb: Merge branch 'master' into skip_freeze * Wed Nov 23 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.27.4 c577b8d7: Merge pull request #365 from mykaul/guess_host_name_in_shell d90f2b50: For ease of use, connect to a host even if only the suffix is given. * Tue Nov 22 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.27.3 cb48ad59: Merge pull request #367 from nvgoldin/update_yapf d891034b: Bump yapf version 0.7.1 -> 0.14.0 * Sat Nov 12 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.27.2 fa588e4f: Merge pull request #360 from nvgoldin/ovirtlago_cleanup_i a1bf8dc6: [ost-plugin] cleanup unused commands * Wed Nov 09 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.27.1 290c49a3: Merge pull request #361 from nvgoldin/tests_generate_config 587eba28: Add 'generate-config' verb to functional tests list Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

1 0

yapf and flake8 are running against each other - and my patch is in the middle.
by Yaniv Kaul 22 Nov '16

22 Nov '16

Seems like there's a disagreement between yapf and flake on styling. See http://jenkins.ovirt.org/job/lago_master_check-patch-el7-x86_64/362/console and http://jenkins.ovirt.org/job/lago_master_check-patch-el7-x86_64/361/console : *7:24:57* scripts/check_style.sh*07:24:57* yapf 0.7.1*07:25:59* --- lago/templates.py (original)*07:25:59* +++ lago/templates.py (reformatted)*07:25:59* @@ -260,7 +260,6 @@*07:25:59* finally:*07:25:59* response.close()*07:25:59* *07:25:59* -*07:25:59* #: Registry for template providers*07:25:59* _PROVIDERS = {*07:25:59* 'file': FileSystemTemplateProvider,*07:25:59* Yapf failed, make sure to run:*07:25:59* yapf --style .style.yapf --in-place --recursive . vs. *07:13:48* PYTHONPATH=/home/jenkins/workspace/lago_master_check-patch-el7-x86_64/lago python /home/jenkins/workspace/lago_master_check-patch-el7-x86_64/lago/tests/venv/bin/flake8*07:13:52* ./lago/templates.py:264:1: E305 expected 2 blank lines after class or function definition, found 1*07:13:52* make: *** [check-local] Error 1 Come on... I just want my patch in, it has nothing to do with this supposed breakage. Y.

2 2

Help debugging HC test failures
by Sahina Bose 09 Nov '16

09 Nov '16

Hi, I need some help/pointers to solve the issues I'm running into while running the gluster HC tests - https://gerrit.ovirt.org/57283 1. Once I run the suite, initialization completes successfully, but further tests fail. Engine is running as per "hosted-engine --vm-status" on the first host (lago_basic_suite_hc_host0) and I can ping the engine from the host running the test File "/usr/lib/python2.7/site-packages/ovirtlago/virt.py", line 189, in get_api return self.get_api_v3() File "/usr/lib/python2.7/site-packages/ovirtlago/virt.py", line 195, in get_api_v3 self._api_v3 = self._get_api(api_ver=3) File "/usr/lib/python2.7/site-packages/ovirtlago/virt.py", line 180, in _get_api raise RuntimeError('Failed to connect to the engine') RuntimeError: Failed to connect to the engine Which logs should I look at to debug this issue? 2. Cannot access the web url of engine: I've setup tunnelling: ssh -L hc-engine.lago.local:8443:hc-engine.lago.local:443 root(a)rhsdev-grafton1.lab.eng.blr.redhat.com But continue getting the error: The client is not authorized to request an authorization. It's required to access the system using FQDN. 3. Once the vms are left running for a while, connectivity is lost between the vms and cannot connect to some of the VMs via lago shell . [root@lago_basic_suite_hc_host0 ~]# ping lago_basic_suite_hc_host1 PING lago_basic_suite_hc_host1 (192.168.200.2) 56(84) bytes of data. >From lago-basic-suite-hc-host0.lago.local (192.168.200.3) icmp_seq=1 Destination Host Unreachable Looks like issue with network in VM from console of VM deployment-basic_suite_hc]# virsh console a2051d60-lago_basic_suite_hc_host1 Connected to domain a2051d60-lago_basic_suite_hc_host1 [root@lago_basic_suite_hc_host1 ~]# ip addr show 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 54:52:c0:a8:c8:02 brd ff:ff:ff:ff:ff:ff inet6 fe80::5652:c0ff:fea8:c802/64 scope link valid_lft forever preferred_lft forever Any pointers are much appreciated. thanks sahina

4 7

New Lago release - 0.27
by Nadav Goldin 02 Nov '16

02 Nov '16

Hey all, New Lago version is out - v0.27, included in this release: fixes for a few bugs, improvements to the 'ovirt' verb, packaging fixes and some new docs. Also, a new verb was added: 'generate-config'[1], this verb allows to print the current loaded configuration lago is using. It also introduced a few changes to lago.conf file, so if you are using /etc/lago.d/lago.conf, please make sure you read[1] before upgrading. Specifically these parameters were changed in lago.conf: 1. 'default_ssh_user', changed to: 'ssh_user', no change to the default value. 2. 'default_ssh_password, changed to: 'ssh_password', no change to the default value. 3. 'template_default_repo', changed to: 'template_repo_name'(same as the existing CLI), no change to value. 4. 'template_*' parameters were moved under the [init] section in lago.conf. 5. lago.conf default location changed to /etc/lago/lago.conf(when upgrading via yum or dnf, it will be automatically be installed there) To upgrade using yum/dnf simply run: yum update lago If you find any bugs, or have request for new features please feel free to open an issue in the GitHub page[2]. Also we started working with GitHub's integrated Kanban board[3]. The updated docs can be found here[4], and the full change log here[5]. Thanks everyone who contributed to this release! Enjoy, Nadav. [1] http://lago.readthedocs.io/en/0.27/Configuration.html [2] https://github.com/lago-project/lago/issues [3] https://github.com/lago-project/lago/projects/1 [4] https://lago.readthedocs.org [5] https://github.com/lago-project/lago/milestone/2?closed=1

1 0

Re: [lago-devel] Lago - Installation help needed
by Yaniv Kaul 15 Oct '16

15 Oct '16

Adding the Lago devel mailing list. The download is the reposync phase - which seems to be OK, but then the connection means that for some reason Lago is not serving those RPMs (8585 is the port it should be listening to). Can you share some logs? TIA, Y. On Wed, Sep 21, 2016 at 4:25 PM, Nicolas Ecarnot <nicolas(a)ecarnot.net> wrote: > Hello Yaniv, > > Following your recommendation, I install a new bare metal host, installed > F24, then followed the lago.readthedoc web site. > > When running ./run_suite.sh basic_suite_3.6 , things seems to go right > (downloading...) for a while, then begin some errors about accessing > 192.168.200.1:8585 > > May you tell me where would be the best place to ask some help about Lago > ? (IRC, mailing list, e-mail... ?) > > Best regards, > > -- > Nicolas ECARNOT >

4 24

New Lago release - 0.26
by Gal Ben Haim 10 Oct '16

10 Oct '16

Hey All, Lago 0.26 is out, the key changes in this version are: - Improved the documentation. - Added support for oVirt v4 api. - Changes that are required for Python and Debian packaging for Lago. Docs: http://lago.readthedocs.io/en/0.26/# Here is the full change log: * Mon Oct 10 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.26.0 f070ef82: Merge pull request #338 from mykaul/prep_for_v4_ovirt_api c5dfc9c4: Prep for oVirt v4 API * Sun Oct 09 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.25.9 640247d8: Merge pull request #293 from irosenzw/change_wait_for_ssh 273df672: Changing the ssh connection waiting method. * Thu Oct 06 2016 Yaniv Kaul <ykaul(a)redhat.com> - 0.25.8 4fdd8462: Merge pull request #339 from mykaul/continue_on_failures 8ba99721: Merge branch 'master' into continue_on_failures bfea3cc4: Continue testing on test failures. * Sun Oct 02 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.25.7 6152127f: Merge pull request #337 from eedri/docs c66cd924: restore meaningfull README file 4573c7e9: add also link to main README.rst file 24c6afcb: added missing libvirt & user permissions info * Thu Sep 29 2016 Eyal Edri <eedri(a)redhat.com> - 0.25.6 aa093270: Merge pull request #336 from eedri/docs 24c6afcb: added missing libvirt & user permissions info 4d20490f: removed selinux section, seems to be working with enforcing also * Thu Sep 29 2016 Eyal Edri <eedri(a)redhat.com> - 0.25.5 95bdb652: Merge pull request #330 from eedri/docs eed1fa98: Adding debugging and troubleshooting section fc617149: Merge branch 'master' into docs 26692e59: Moving over get_prefixed_name() to ovirtlago/testlib 68137950: Merge branch 'master' into docs 1e63cd89: fixing typos 327f0b72: Refactoring Lago docs * Wed Sep 28 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.25.4 52b87825: Merge pull request #332 from mykaul/get_prefixed_name 2447e5ab: Merge branch 'master' into get_prefixed_name d255b2fc: Moving over get_prefixed_name() to ovirtlago/testlib * Wed Sep 28 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.25.3 ef90a75e: Merge pull request #296 from pilou-/search_for_kvm_executable_too 8e5d752c: Ask libvirt for path of kvm executable c5158fd9: Don't run flakes on .eggs directory * Tue Sep 27 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.25.2 9e48c95b: Merge pull request #329 from mykaul/switch_qemu_ga_with_agent 627fb675: Replace the order between qemu-ga and qemu-guest-agent. * Mon Sep 26 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.25.1 51158c7c: Merge pull request #327 from lago-project/adding_requirements.txt 2888b6ea: Added requirements.txt Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

1 0

Re: [lago-devel] Lago - Installation help needed
by Nicolas Ecarnot 29 Sep '16

29 Sep '16

Le 26/09/2016 à 12:04, Yedidyah Bar David a écrit : > On Mon, Sep 26, 2016 at 1:02 PM, Nicolas Ecarnot <nicolas(a)ecarnot.net> wrote: >> Le 26/09/2016 à 12:00, Yedidyah Bar David a écrit : >>> >>> On Mon, Sep 26, 2016 at 12:36 PM, Nicolas Ecarnot <nicolas(a)ecarnot.net> >>> wrote: >>>> >>>> Le 26/09/2016 à 10:55, Yedidyah Bar David a écrit : >>>>> >>>>> >>>>> So we need engine logs to know more. >>>>> >>>>> If none were generated, it might have failed too early. >>>>> >>>>> Please check system logs - /var/log/messages, journalctl, etc. Thanks. >>>> >>>> >>>> >>>> Just to be sure : are you speaking about the log files on the bare-metal >>>> server, or the virtual hosts (engine)? >>> >>> >>> I referred to the engine vm. In principle both might be >>> interesting/relevant. >>> >>>> >>>> >>>> If this is the engine, I already provided the only file I got (and I also >>>> double-checked its /var/log/message, with no interesting info). >>> >>> >>> Perhaps journalctl output? >> >> >> Engine is centos 6, so no systemd at this time... > > OK. Can you try starting the service manually and see if you get anything > in any log? You can try getting more debug info using e.g.: > > https://bugzilla.redhat.com/show_bug.cgi?id=1230165#c8 OK. I read this BZ, and I also tried to launch a run using basic_suite_4.0 The results were quite different, as I see no more memory issues. Actually, it looks like all the 3 VMs are deployed OK (engine, host0 and host1). Then the tests about the engine are OK. Then I only have an error in post-001_initialize_engine.py But I can not find any detail : @ Collect artifacts: # [Thread-1] lago_basic_suite_4_0_host0: # [Thread-2] lago_basic_suite_4_0_host1: # [Thread-3] lago_basic_suite_4_0_engine: No handlers could be found for logger "paramiko.transport" # [Thread-3] lago_basic_suite_4_0_engine: Success (in 0:01:07) # [Thread-1] lago_basic_suite_4_0_host0: ERROR (in 0:02:18) # [Thread-2] lago_basic_suite_4_0_host1: ERROR (in 0:02:18) (nothing more). The script is not stopping there, and keeps going until 002_bootstrap.py : # add_dc: # add_dc: Success (in 0:00:03) # add_dc_quota: # add_dc_quota: Success (in 0:00:02) # add_cluster: # add_cluster: Success (in 0:00:01) # add_hosts: * Collect artifacts: * Collect artifacts: ERROR (in 0:01:55) # add_hosts: ERROR (in 0:17:08) # Results located at /data/lago/ovirt-system-tests/deployment-basic_suite_4.0/default/nosetests-002_bootstrap.py.xml @ Run test: 002_bootstrap.py: ERROR (in 0:17:16) Error occured, aborting Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 258, in do_run self.cli_plugins[args.ovirtverb].do_run(args) File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run self._do_run(**vars(args)) File "/usr/lib/python2.7/site-packages/lago/utils.py", line 488, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/utils.py", line 499, in wrapper return func(*args, prefix=prefix, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 102, in do_ovirt_runtest raise RuntimeError('Some tests failed') RuntimeError: Some tests failed I'm still having a look at the log files to see what is the issue. Apart that, by connecting into the engine VM, I saw that the engine process was running, so I tried to access the web GUI, by running an SSH connection to the bare-metal host : ssh -L 8443:192.168.200.4:443 root(a)serv-hv-dev01.sdis.isere.fr (BTW, the readthedoc is showing 200.2 but this is irrelevant for basic_test_4.0, where the engine ip is 200.4) Accessing https://localhost:8443/ is working, but when trying to access the login screen, I'm left with : "The client is not authorized to request an authorization. It's required to access the system using FQDN." ... Dear Redhat employees and al., I sincerely respect your great patience because I'm witnessing the huge complexity of this project, as I'm trying to find my way out this mess^W wonderful project ;) Anyway, I'm feeling I made one step further, so this is encouraging (I have modest expectations and a few is making my day). So about this last issue, please don't answer me that every Lago user is using its own laptop with a graphical layer and running a direct browser access to the web GUI? -- Nicolas ECARNOT

3 11

lago destroy doesn't stop qemu processes
by Nadav Goldin 27 Sep '16

27 Sep '16

Hi, I've noticed a strange issue today. After running successfully lago init && start, then running lago stop && destroy, the qemu-kvm VM's processes are still running even though the destroy command completed successfully. Anyone else encountered this? Nadav.

1 0

moving ovirt-system-tests docs out of lago main doc page
by Eyal Edri 27 Sep '16

27 Sep '16

FYI, I've created a new RTD page for oVirt-system-tests [1] as its an independent project and shouldn't be part of the official Lago documentation, especially not as 1st how-to example. Please feel free to contribute to it and update it with new info, especially on adding new tests or devel use. I've also sent a new PR [2] to remove most of the OST and link to the new OST documentation page, and replacing the main example with the Lago jenkins demo. Going forward, we'll probably create a new lago-examples.git and reference to it for all examples documentation. You'll also notice I've removed some of the documentation around advanced debugging and explanations on internal Lago structure which shouldn't be on how how to page, but in the Lago Tutorial which is also in progress at [3]. I believe this will help new users get Lago up and running much faster and not handle complex settings like nested virt if they are not interested in installing oVirt at first. [1] http://ovirt-system-tests.readthedocs.io [2] https://github.com/lago-project/lago/pull/330 [3] https://github.com/lago-project/lago/pull/228 -- Eyal Edri Associate Manager RHV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

Please create a repo for ansible under lago org
by Roy Golan 27 Sep '16

27 Sep '16

Hi lake swimmers, In this pr[1] I am adding an ansible playbook (which will grow to a role) to install lago and system-tests. Brought up by maintainers and duck-rh, its more appropriate to create an ansible focused repo which will also play nicely with galaxy and will contain potentially multi roles for all sorts of automation and orchestration we can come up with for lago and lago related. Please create `ansible-role-lago` and I'll move the below pr to it. Thanks, Roy [1] https://github.com/lago-project/lago/pull/326

2 1

lago-ovirt-system-tests ansible PR
by Nadav Goldin 26 Sep '16

26 Sep '16

Hi, As discussed in the PR[1], we might need to think of restructuring our demos/examples repositories. I suggest the following structure: - lago-project/lago-examples.git - Examples of how to use lago to deploy 'X' This repository will hold all examples of deploying Lago, each example will have its own directory. Currently we have: lago-project/lago-examples/jenkins - the current lago-demo repository[1](scripts to deploy Jenkins using Lago) lago-project/lago-examples/ovirt-system-tests - installing lago + ovirt-system-tests[3] - lago-project/lago-ansible-examples.git The same as 'lago-examples.git', only it will hold ansible playbooks that use lago and ansible for deployment(such as the PR) - lago-project/lago-ansible.git Holding a generic ansible playbook to install lago(once we have one :) Though I'll note that I have no concrete idea of what are the ansible conventions. Thoughts? Thanks, Nadav. [1] https://github.com/lago-project/lago/pull/326 [2] https://github.com/lago-project/lago-demo [2] https://github.com/lago-project/lago-demo/tree/master/install_scripts

2 1

backward-incompatible changes to lago.conf
by Nadav Goldin 25 Sep '16

25 Sep '16

Hi all, As a side-effect of my proposed PR[1], 3 backward-incompatible changes will be added: variables names in lago.conf ------------------------------------ 1. 'default_ssh_user', changed to: 'ssh_user', value: no change. 2. 'default_ssh_password, changed to: 'ssh_password', value: no change. 3. 'template_default_repo', changed to: 'template_repo_name'(same as the existing CLI), value: was never set. The above 3 were hard-coded in config.py's defaults dictionary and never exposed externally. They had no documents, but, if a user knew about them he could have added them manually to lago.conf The reason for changing is that the PR unifies the configuration files and CLI parameters. So keeping the 'default' prefix is misleading and will lead to awkward results, such as: lago --default-ssh-user root --default-ssh-password .... instead of: lago --ssh-user root --ssh-password ... 'template_*' section ------------------------- 'template_*' parameters which are used by lago init command, will be move to [init] section in lago.conf. lago.conf location ----------------------- 1. Drop /etc/lago.d/lago.conf in favour of /etc/lago/lago.conf 2. The installed file from the RPM will be all commented out(i.e. installed just to use as a reference). 3. /etc/lago/lago.conf will be the least important in the hierarchy(you can read more details about the hierarchy in the PR) I'll note that Lago will be fully functional without any configuration file at all. These changes will possibly affect only already-customized lago.conf files. But, changing to the new configuration format will be easy, using the 'generate-config' command: mkdir -p ~/.config/lago && lago generate-config > ~/.config/lago/lago.conf The changes are needed as the the PR mainly deals with standardizing the configuration loading module, so it is a good time for clean-up, and dropping misleading variable names(which were probably good at the time written). Second, I'm not sure how widely these parameters were used, as some of them didn't have any docs. For instance I couldn't find any evidence of usage for 'template_default_repo'(the CLI parameter is the same as it was, 'template_repo_name'). Some possible alternatives: 1. Issue a warning about variables name change, and use both, then in 2-3 versions from now, completely remove them. 2. lago.conf location: Not a major issue, as far as I know, '.d' suffix was used historically for distinguishing a 'directory' from a single configuration file, so having '/etc/lago/' is better(and keeping lago.d if someday we will need to load other user-defined configurations). But this can be easily changed. If there is no request for the alternatives or objection, I'll try to get it merged for the next version and add a short summary of this message to the release email. Thanks, Nadav. [1] https://github.com/lago-project/lago/pull/324

3 2

New Lago release - 0.25
by Nadav Goldin 22 Sep '16

22 Sep '16

Hey, Lago 0.25 is out, introducing few bug fixes, and 2 new features: - /var/lib/lago/subnets is now configurable, this is useful if you want to install Lago in virtualenv(thanks @pilou-) - virtio-scsi support for none-root disks. More details in the PR[1] Here is the full change log: * Wed Sep 21 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.25.0 fdd63ae4: Merge pull request #298 from pilou-/make_lease_dir_configurable 5fb60899: Make lease_dir configurable * Tue Sep 20 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.24.5 8845853f: Merge pull request #323 from mykaul/get_cpu_caps 350db807: Merge branch 'master' into get_cpu_caps 83a7f68a: Add host CPU model detection * Tue Sep 20 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.24.4 1d7722a6: Merge pull request #322 from rafaelmartins/master 9f423604: utils: fixed typo * Tue Sep 20 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.24.3 3dd77113: Merge pull request #318 from lago-project/add_boot_menu 26e9dd71: Adding boot menu * Sun Sep 11 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.24.2 061207c6: Merge pull request #314 from mykaul/add_serial_to_disks c0baab76: Add serial number to disks. * Wed Sep 07 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.24.1 27856ea9: Merge pull request #306 from mykaul/virtio-scsi af1c52d6: virtio-scsi support in Lago 6334cc2b: Merge branch 'master' into virtio-scsi Repo - http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Docs - http://lago.readthedocs.io/en/0.25/Env_Setup.html Enjoy! [1] https://github.com/lago-project/lago/pull/306

1 0

Lago hostnames
by Sahina Bose 22 Sep '16

22 Sep '16

Hi all, Is it possible to change the generated hostnames in Lago - currently it is of the form lago_basic_suite_hc_host1 and using this hostname fails while peer probing gluster. According to gluster dev: "The valid_host_name () function what we have at gluster CLI is as per RFC 1912 and an underscore in the hostname is *not* accepted." If not, other suggestions? thanks sahina

3 3

reposync
by Sahina Bose 21 Sep '16

21 Sep '16

Hi! Not sure if this is the right forum for this newbie question - if not, please point me to the right one. My issue is the repos available in the guest VMs started by lago. I have executed from the working dir #lagocli ovirt reposetup --reposync-yum-config="/home/ovirt-system-tests/basic_suite_hc/reposync-config.repo" When I launch into shell of guest VM : [root@lago_basic_suite_hc_host0 ~]# yum repolist Loaded plugins: fastestmirror http://192.168.201.1:8585/el7/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to 192.168.201.1:8585; Connection refused" Trying other mirror. I must be missing some step, could you help me figure out what? thanks! sahina

2 2

Re: [lago-devel] Lago check patch is failing when running on my laptop
by Gal Ben Haim 15 Sep '16

15 Sep '16

Not sure why, but adding back "bootmenu enable='yes'" solved the problem. Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps ----- Original Message ----- From: "Yaniv Kaul" <ykaul(a)redhat.com> To: "Gal Ben Haim" <gbenhaim(a)redhat.com> Sent: Thursday, September 15, 2016 9:58:51 AM Subject: Re: [lago-devel] Lago check patch is failing when running on my laptop I'm not very much interested in mock (I think it's not a good idea), but I can check. Where do I get gerrit.ovirt.org/jenkins/mock_configs/mock_runner.sh from? simple wget fails obviously. Y. On Wed, Sep 14, 2016 at 6:13 PM, Gal Ben Haim <gbenhaim(a)redhat.com> wrote: > for running the mock - ~/gerrit.ovirt.org/jenkins/moc > k_configs/mock_runner.sh --mock-confs-dir ~/gerrit.ovirt.org/jenkins/moc > k_configs/ -e automation/check-patch.sh -s fc24 > for running the test inside the mock - ./automation/check-patch.sh > > Gal Ben Haim > gbenhaim(a)redhat.com > RHEV DevOps > > ----- Original Message ----- > From: "Yaniv Kaul" <ykaul(a)redhat.com> > To: "Nadav Goldin" <ngoldin(a)redhat.com> > Cc: "Gal Ben Haim" <gbenhaim(a)redhat.com>, lago-devel(a)ovirt.org > Sent: Wednesday, September 14, 2016 12:41:26 PM > Subject: Re: [lago-devel] Lago check patch is failing when running on my > laptop > > What command are you using to trigger it? > My code adds virtio-scsi - but no one is using it (yet, I am in my tests > and it works well). > It also adds UNMAP support to all disk - which should be silently ignored > (as no one is using yet virtio-scsi). > Apart from that, not sure what could cause it. > > On Wed, Sep 14, 2016 at 12:09 PM, Nadav Goldin <ngoldin(a)redhat.com> wrote: > > > Hitting the same error on 'master' - this time on fc24 host & fc24 > > chroot. Reverting back to '531bd75'(before iSCSI PR) seems to resolve > > the issue. > > Strangely enough, re-triggering the CI on current master branch works.[1] > > As a side note, I was mistaken - check_patch do run on VMs(it is OST > > that run on BMs) > > > > [1] http://jenkins.ovirt.org/job/lago_master_check-patch-fc24-x8 > 6_64/102/ > > > > On Mon, Sep 12, 2016 at 8:46 PM, Nadav Goldin <ngoldin(a)redhat.com> > wrote: > > > iirc, we are runing all lago jobs on fc24 bare metal slaves, since > > > there was an issue with running fc24 chroots on el7 hosts, not sure if > > > it was resolved. It might explain why Jenkins jobs are running ok. > > > > > > > > > > > > > > > On Sun, Sep 11, 2016 at 8:56 PM, Gal Ben Haim <gbenhaim(a)redhat.com> > > wrote: > > >> Hi All, > > >> > > >> When running check-patch on my laptop and mini-dell (rhel 7.1 and mock > > fc-24 on both), > > >> the tests fails on ssh timeout. > > >> > > >> I'm running the tests on the latest commit on master (hash 27856ea). > > >> I tried to run the tests on hash: 531bd75 (0.24 stable release) and it > > >> went well. > > >> > > >> It's strange because I don't see those failures on jenkins. > > >> > > >> test log: http://pastebin.test.redhat.com/410685 > > >> > > >> Does anyone else experiencing this problem ? > > >> > > >> > > >> Gal Ben Haim > > >> gbenhaim(a)redhat.com > > >> RHEV DevOps > > >> _______________________________________________ > > >> lago-devel mailing list > > >> lago-devel(a)ovirt.org > > >> http://lists.ovirt.org/mailman/listinfo/lago-devel > > _______________________________________________ > > lago-devel mailing list > > lago-devel(a)ovirt.org > > http://lists.ovirt.org/mailman/listinfo/lago-devel > > >

1 0

Lago check patch is failing when running on my laptop
by Gal Ben Haim 15 Sep '16

15 Sep '16

Hi All, When running check-patch on my laptop and mini-dell (rhel 7.1 and mock fc-24 on both), the tests fails on ssh timeout. I'm running the tests on the latest commit on master (hash 27856ea). I tried to run the tests on hash: 531bd75 (0.24 stable release) and it went well. It's strange because I don't see those failures on jenkins. test log: http://pastebin.test.redhat.com/410685 Does anyone else experiencing this problem ? Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

3 5

New Lago release - 0.24
by Nadav Goldin 07 Sep '16

07 Sep '16

Hey, Lago 0.24 is out, introducing 2 new features: initial DNS + IPv6 support, and a new flat output formatter for the CLI. Here is the full change log: * Sun Sep 04 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.24.0 531bd754: Merge pull request #303 from lago-project/refactor_engine_api_request 41a15764: Removed redundant checks when getting ovirt api * Sun Sep 04 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.23.4 b17a5c29: Merge pull request #304 from mykaul/DNS 783aae26: Add DNS and IPv6 support * Thu Sep 01 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.23.3 ee7b814f: Merge pull request #301 from lago-project/flat_output_plugin 1f6fc70f: Added flat output formatter * Mon Aug 22 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.23.2 ed6371fa: Merge pull request #294 from sandrobonazzola/master ca3c023b: reposetup: be more verbose on reposync failure 13e921eb: Merge branch 'master' into master * Tue Aug 16 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.23.1 030f6e76: Merge pull request #279 from mpolednik/libvirt-auth ed219883: libvirt: add auth Repo - http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Docs - http://lago.readthedocs.io/en/0.24/Env_Setup.html Enjoy!

1 0

lago_master_check-patch-fc23-x86_64 #224 Console [Jenkins]
by Yaniv Kaul 06 Sep '16

06 Sep '16

New breakage (that I hope) has nothing to do with my patch: Error: nothing provides repoman >= 2.0.12 needed by python-lago-ovirt-0.24.1-1.fc23.noarch Anyone? http://jenkins.ovirt.org/job/lago_master_check-patch-fc23-x86_64/224/console

4 4

Any ideas for root cause of this failure?
by Yaniv Kaul 25 Aug '16

25 Aug '16

Running Lago/ovirt-system-tests on F24: # [Thread-1] Bootstrapping lago_basic_suite_3_6_engine: # [Thread-2] Bootstrapping lago_basic_suite_3_6_host1: # [Thread-3] Bootstrapping lago_basic_suite_3_6_host0: # [Thread-4] Bootstrapping lago_basic_suite_3_6_storage: # [Thread-1] Bootstrapping lago_basic_suite_3_6_engine: ERROR (in 0:00:04) Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 53, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in <lambda> utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 265, in bootstrap return self.provider.bootstrap(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/vm.py", line 128, in bootstrap if 'ip' in nic File "/usr/lib/python2.7/site-packages/lago/sysprep.py", line 134, in sysprep ret.err, RuntimeError: Failed to bootstrap $LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_engine_root.qcow2 command:"virt-sysprep" "-a" "$LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_engine_root.qcow2" "--selinux-relabel" "--hostname" "lago_basic_suite_3_6_engine" "--root-password" "password:123456" "--mkdir" "/root/.ssh" "--chmod" "0700:/root/.ssh" "--upload" "/home/omer/ovirt-system-tests/deployment-basic_suite_3.6/default/id_rsa.pub:/root/.ssh/authorized_keys" "--run-command" "chown root.root /root/.ssh/authorized_keys" "--mkdir" "/etc/iscsi" "--chmod" "0755:/etc/iscsi" "--write" "/etc/iscsi/initiatorname.iscsi:InitiatorName=iqn.2014-07.org.lago:lago_basic_suite_3_6_engine" "--mkdir" "/etc/selinux" "--chmod" "0755:/etc/selinux" "--write" "/etc/selinux/config:SELINUX=enforcing SELINUXTYPE=targeted " "--mkdir" "/etc/sysconfig/network-scripts" "--chmod" "0755:/etc/sysconfig/network-scripts" "--write" "/etc/sysconfig/network-scripts/ifcfg-eth0:HWADDR="54:52:c0:a8:c8:02" BOOTPROTO="dhcp" TYPE="Ethernet" ONBOOT="yes" NAME="eth0"" stdout:[ 0.0] Examining the guest ... stderr:virt-sysprep: error: libguestfs error: guestfs_launch failed. This usually means the libguestfs appliance failed to start or crashed. Do: export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1 and run the command again. For further information, read: http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs You can also run 'libguestfs-test-tool' and post the *complete* output into a bug report or message to the libguestfs mailing list. If reporting bugs, run virt-sysprep with debugging enabled and include the complete output: virt-sysprep -v -x [...] # [Thread-4] Bootstrapping lago_basic_suite_3_6_storage: ERROR (in 0:00:04) Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 53, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in <lambda> utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 265, in bootstrap return self.provider.bootstrap(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/vm.py", line 128, in bootstrap if 'ip' in nic File "/usr/lib/python2.7/site-packages/lago/sysprep.py", line 134, in sysprep ret.err, RuntimeError: Failed to bootstrap $LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_storage_root.qcow2 command:"virt-sysprep" "-a" "$LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_storage_root.qcow2" "--selinux-relabel" "--hostname" "lago_basic_suite_3_6_storage" "--root-password" "password:123456" "--mkdir" "/root/.ssh" "--chmod" "0700:/root/.ssh" "--upload" "/home/omer/ovirt-system-tests/deployment-basic_suite_3.6/default/id_rsa.pub:/root/.ssh/authorized_keys" "--run-command" "chown root.root /root/.ssh/authorized_keys" "--mkdir" "/etc/iscsi" "--chmod" "0755:/etc/iscsi" "--write" "/etc/iscsi/initiatorname.iscsi:InitiatorName=iqn.2014-07.org.lago:lago_basic_suite_3_6_storage" "--mkdir" "/etc/selinux" "--chmod" "0755:/etc/selinux" "--write" "/etc/selinux/config:SELINUX=enforcing SELINUXTYPE=targeted " "--mkdir" "/etc/sysconfig/network-scripts" "--chmod" "0755:/etc/sysconfig/network-scripts" "--write" "/etc/sysconfig/network-scripts/ifcfg-eth0:HWADDR="54:52:c0:a8:c8:05" BOOTPROTO="dhcp" TYPE="Ethernet" ONBOOT="yes" NAME="eth0"" stdout:[ 0.0] Examining the guest ... stderr:virt-sysprep: error: libguestfs error: guestfs_launch failed. This usually means the libguestfs appliance failed to start or crashed. Do: export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1 and run the command again. For further information, read: http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs You can also run 'libguestfs-test-tool' and post the *complete* output into a bug report or message to the libguestfs mailing list. If reporting bugs, run virt-sysprep with debugging enabled and include the complete output: virt-sysprep -v -x [...] # [Thread-2] Bootstrapping lago_basic_suite_3_6_host1: ERROR (in 0:00:04) # [Thread-3] Bootstrapping lago_basic_suite_3_6_host0: ERROR (in 0:00:04) Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 53, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in <lambda> utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 265, in bootstrap return self.provider.bootstrap(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/vm.py", line 128, in bootstrap if 'ip' in nic File "/usr/lib/python2.7/site-packages/lago/sysprep.py", line 134, in sysprep ret.err, RuntimeError: Failed to bootstrap $LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_host1_root.qcow2 command:"virt-sysprep" "-a" "$LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_host1_root.qcow2" "--selinux-relabel" "--hostname" "lago_basic_suite_3_6_host1" "--root-password" "password:123456" "--mkdir" "/root/.ssh" "--chmod" "0700:/root/.ssh" "--upload" "/home/omer/ovirt-system-tests/deployment-basic_suite_3.6/default/id_rsa.pub:/root/.ssh/authorized_keys" "--run-command" "chown root.root /root/.ssh/authorized_keys" "--mkdir" "/etc/iscsi" "--chmod" "0755:/etc/iscsi" "--write" "/etc/iscsi/initiatorname.iscsi:InitiatorName=iqn.2014-07.org.lago:lago_basic_suite_3_6_host1" "--mkdir" "/etc/selinux" "--chmod" "0755:/etc/selinux" "--write" "/etc/selinux/config:SELINUX=enforcing SELINUXTYPE=targeted " "--mkdir" "/etc/sysconfig/network-scripts" "--chmod" "0755:/etc/sysconfig/network-scripts" "--write" "/etc/sysconfig/network-scripts/ifcfg-eth0:HWADDR="54:52:c0:a8:c8:03" BOOTPROTO="dhcp" TYPE="Ethernet" ONBOOT="yes" NAME="eth0"" stdout:[ 0.0] Examining the guest ... stderr:virt-sysprep: error: libguestfs error: guestfs_launch failed. This usually means the libguestfs appliance failed to start or crashed. Do: export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1 and run the command again. For further information, read: http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs You can also run 'libguestfs-test-tool' and post the *complete* output into a bug report or message to the libguestfs mailing list. If reporting bugs, run virt-sysprep with debugging enabled and include the complete output: virt-sysprep -v -x [...] Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 53, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in <lambda> utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 265, in bootstrap return self.provider.bootstrap(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/vm.py", line 128, in bootstrap if 'ip' in nic File "/usr/lib/python2.7/site-packages/lago/sysprep.py", line 134, in sysprep ret.err, RuntimeError: Failed to bootstrap $LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_host0_root.qcow2 command:"virt-sysprep" "-a" "$LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_host0_root.qcow2" "--selinux-relabel" "--hostname" "lago_basic_suite_3_6_host0" "--root-password" "password:123456" "--mkdir" "/root/.ssh" "--chmod" "0700:/root/.ssh" "--upload" "/home/omer/ovirt-system-tests/deployment-basic_suite_3.6/default/id_rsa.pub:/root/.ssh/authorized_keys" "--run-command" "chown root.root /root/.ssh/authorized_keys" "--mkdir" "/etc/iscsi" "--chmod" "0755:/etc/iscsi" "--write" "/etc/iscsi/initiatorname.iscsi:InitiatorName=iqn.2014-07.org.lago:lago_basic_suite_3_6_host0" "--mkdir" "/etc/selinux" "--chmod" "0755:/etc/selinux" "--write" "/etc/selinux/config:SELINUX=enforcing SELINUXTYPE=targeted " "--mkdir" "/etc/sysconfig/network-scripts" "--chmod" "0755:/etc/sysconfig/network-scripts" "--write" "/etc/sysconfig/network-scripts/ifcfg-eth0:HWADDR="54:52:c0:a8:c8:04" BOOTPROTO="dhcp" TYPE="Ethernet" ONBOOT="yes" NAME="eth0"" stdout:[ 0.0] Examining the guest ... stderr:virt-sysprep: error: libguestfs error: guestfs_launch failed. This usually means the libguestfs appliance failed to start or crashed. Do: export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1 and run the command again. For further information, read: http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs You can also run 'libguestfs-test-tool' and post the *complete* output into a bug report or message to the libguestfs mailing list. If reporting bugs, run virt-sysprep with debugging enabled and include the complete output: virt-sysprep -v -x [...] @ Initialize and populate prefix: ERROR (in 0:00:08) Error occured, aborting Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 691, in main cli_plugins[args.verb].do_run(args) File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run self._do_run(**vars(args)) File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 615, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 181, in do_init do_bootstrap=not skip_bootstrap, File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 816, in virt_conf_from_stream do_bootstrap=do_bootstrap, File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 943, in virt_conf self.virt_env.bootstrap() File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in bootstrap utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/utils.py", line 95, in invoke_in_parallel vt.join_all() File "/usr/lib/python2.7/site-packages/lago/utils.py", line 53, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in <lambda> utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 265, in bootstrap return self.provider.bootstrap(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/vm.py", line 128, in bootstrap if 'ip' in nic File "/usr/lib/python2.7/site-packages/lago/sysprep.py", line 134, in sysprep ret.err, RuntimeError: Failed to bootstrap $LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_engine_root.qcow2 command:"virt-sysprep" "-a" "$LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_engine_root.qcow2" "--selinux-relabel" "--hostname" "lago_basic_suite_3_6_engine" "--root-password" "password:123456" "--mkdir" "/root/.ssh" "--chmod" "0700:/root/.ssh" "--upload" "/home/omer/ovirt-system-tests/deployment-basic_suite_3.6/default/id_rsa.pub:/root/.ssh/authorized_keys" "--run-command" "chown root.root /root/.ssh/authorized_keys" "--mkdir" "/etc/iscsi" "--chmod" "0755:/etc/iscsi" "--write" "/etc/iscsi/initiatorname.iscsi:InitiatorName=iqn.2014-07.org.lago:lago_basic_suite_3_6_engine" "--mkdir" "/etc/selinux" "--chmod" "0755:/etc/selinux" "--write" "/etc/selinux/config:SELINUX=enforcing SELINUXTYPE=targeted " "--mkdir" "/etc/sysconfig/network-scripts" "--chmod" "0755:/etc/sysconfig/network-scripts" "--write" "/etc/sysconfig/network-scripts/ifcfg-eth0:HWADDR="54:52:c0:a8:c8:02" BOOTPROTO="dhcp" TYPE="Ethernet" ONBOOT="yes" NAME="eth0"" stdout:[ 0.0] Examining the guest ... stderr:virt-sysprep: error: libguestfs error: guestfs_launch failed. This usually means the libguestfs appliance failed to start or crashed. Do: export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1 and run the command again. For further information, read: http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs You can also run 'libguestfs-test-tool' and post the *complete* output into a bug report or message to the libguestfs mailing list. If reporting bugs, run virt-sysprep with debugging enabled and include the complete output: virt-sysprep -v -x [...] lago-error.txt Open with Google Docs Displaying lago-error.txt.

2 2

New Lago Template For Fedora 24
by Gal Ben Haim 31 Jul '16

31 Jul '16

Hi All, New Lago template for Fedora 24 is now available on: http://templates.ovirt.org/repo/repo.metadata (the default template repo for lago) You can use it by specifying 'fc24-base' with 'template_name' key. Cheers, Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

1 0

New Lago release - 0.23.0
by Gal Ben Haim 25 Jul '16

25 Jul '16

Hi Everyone! There's a new Lago release with version 0.23.0 ready for you to upgrade! Lago is now officially supported on fedora 24. Docs - http://lago.readthedocs.io/en/0.23/index.html Repo - http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Here are the changes: * Mon Jul 18 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.23.0 14d884c0: Merge pull request #290 from mykaul/get_sanlock_logs f5177dd3: Added /var/log/sanlock.log to the log collection from hosts 904721c0: Merge branch 'master' into get_sanlock_logs * Mon Jul 18 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.5 417328cf: Merge pull request #285 from mkopta/systemctl 4ca2deaf: all "supported" OS use systemctl instead of service * Sun Jul 17 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.4 722fa248: Merge pull request #286 from mkopta/these 3b7555e7: s/this/these/ * Thu Jul 14 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.3 6a0089e8: Merge pull request #288 from lago-project/fix_fc24_build 17c943c2: ci:Replaced fc22 package files with fc24 * Tue Jun 21 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.2 cf146a52: Merge pull request #284 from mkopta/master 9af5ab8a: typos * Tue Jun 21 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.1 7678342e: Merge pull request #283 from mkopta/master 43a3ee3b: denoting root priviliges requirement 36982c69: typo Enjoy! Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

1 0

Connection timeout initializing environment
by Eric Helms 11 Jul '16

11 Jul '16

I am getting the following error with 0.22 trying to initialize my environment: @ Initialize and populate prefix: ERROR (in 0:02:07) Error occured, aborting Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 691, in main cli_plugins[args.verb].do_run(args) File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run self._do_run(**vars(args)) File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 615, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 154, in do_init template_repo_path File "/usr/lib/python2.7/site-packages/lago/templates.py", line 347, in from_url response = urllib.urlopen(path) File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen return opener.open(url) File "/usr/lib64/python2.7/urllib.py", line 208, in open return getattr(self, name)(url) File "/usr/lib64/python2.7/urllib.py", line 345, in open_http h.endheaders(data) File "/usr/lib64/python2.7/httplib.py", line 975, in endheaders self._send_output(message_body) File "/usr/lib64/python2.7/httplib.py", line 835, in _send_output self.send(msg) File "/usr/lib64/python2.7/httplib.py", line 797, in send self.connect() File "/usr/lib64/python2.7/httplib.py", line 778, in connect self.timeout, self.source_address) File "/usr/lib64/python2.7/socket.py", line 571, in create_connection raise err IOError: [Errno socket error] [Errno 110] Connection timed out Eric

2 3

Weekly bug status for ovirt-system-tests (using Lago) [ 11/07/16 ]
by Eyal Edri 11 Jul '16

11 Jul '16

*Open bugs:* https://goo.gl/eUaPUY *Open issues:* HE 4.0 support - patch under review - https://gerrit.ovirt.org/#/c/59717/ Initial documentation in progress - https://gerrit.ovirt.org/#/c/59870/ *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open *Jenkins jobs:* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ * Jobs were failing on add host, most failures were due to missing support on new F24 slaves, fixed. * There was an issue with using 3.6 ovirt stable repo in some tests, seems it was leftover from early days, replacing repo with 3.6 nighties as we do in 4.0 and master solved it. * 4 more slaves added to run tests, running F24 * We hit a libvirt bug [1] that forced us to manually enable the service for now. [1] https://bugzilla.redhat.com/show_bug.cgi?id=1290357 *Recently merged patches:* https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:merged+since… -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

ovirt tests failing on missing libxml2-python
by Eyal Edri 04 Jul '16

04 Jul '16

2016-06-24 17:28:17,843 DEBUG [org.ovirt.otopi.dialog.MachineDialogParser] (VdsDeploy) [796140d9] Got: ***L:ERROR Failed to execute stage 'Package installation': [u'libxml2-python-2.9.1-6.el7_2.3.x86_64 requires libxml2 = 2.9.1-6.el7_2.3'] 2016-06-24 17:28:17,844 DEBUG [org.ovirt.otopi.dialog.MachineDialogParser] (VdsDeploy) [796140d9] nextEvent: Log ERROR Failed to execute stage 'Package installation': [u'libxml2-python-2.9.1-6.el7_2.3.x86_64 requires libxml2 = 2.9.1-6.el7_2.3'] 2016-06-24 17:28:17,860 ERROR This is failing 3.6,4.0 and master tests, anyone knows on a recent dependency change in vdsm or other host level pkg? -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

4 9

Weekly bug status for ovirt-system-tests (using Lago) [ 27/06/16 ]
by Eyal Edri 27 Jun '16

27 Jun '16

*Open bugs:* https://goo.gl/eUaPUY *Fixed/Closed bugs:* Bug 1298646 <https://bugzilla.redhat.com/show_bug.cgi?id=1298646> [Lago] - hosted engine setup causes kernel panic Bug 1280361 <https://bugzilla.redhat.com/show_bug.cgi?id=1280361> Create the jenkins jobs to check the ovirt-system-tests patches Bug 1282691 <https://bugzilla.redhat.com/show_bug.cgi?id=1282691> Make the ovirt lago tests run for master code *Open issues:* - add Lago & test logs to check-patch job (bug opened) - add install cockpit-ovirt-dashboard to 4.0/master (now its taking in 500 pkg) - move master and 4.0 tests to use API V4 (bug opened) - hosted engine 4.0 tests are in progress *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open *Jenkins jobs:* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ *Recently merged patches:* https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:merged+since… *A lot of new stuff went in during last week! here are some of the highlights:* 1. New per patch 'check-patch' job added, now jenkins will automatically verify your patches to ovirt-system-tests 2. New 'install cockpit-ovirt-dashboard' test added to 3.6 3. New 'remove default DC & cluster' test added 4. New 'add VM from Glance template' test added 5. New basic 'network add' tests added 6. Compatibility version updated to 4.0 & 4.1 to 4.0 & master respectively Keep those tests coming... -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

Latest ovirt-system-tests doesn't perform reposync?
by Yaniv Kaul 22 Jun '16

22 Jun '16

I'm still running on Lago 0.18 (can't upgrade due to F24 bug deps with repoman), and when I switched to the latest ovirt-system-tests, something's not sync'ing the repos correctly: Good run (from the old ovirt-system-tests): 2016-06-22 14:52:53,770::log_utils.py::__exit__::593::ovirtlago::INFO:: * Running reposync: ESC[32mSuccessESC[0m (in 0:00:06) 2016-06-22 14:52:53,770::log_utils.py::__exit__::593::ovirtlago::INFO:: # Syncing remote repos locally (this might take some time): ESC[32mSuccessESC[0m (in 0:00:06) 2016-06-22 14:52:53,771::log_utils.py::__enter__::586::ovirtlago.merge_repos::INFO:: # [Thread-1] Processing directory /var/lib/lago/reposync/ovirt-master-snapshot-el7: ESC[0mESC[0m 2016-06-22 14:52:53,771::log_utils.py::__enter__::586::lago.utils::DEBUG::start task Run command: "find" "/var/lib/lago/reposync/ovirt-master-snapshot-el7" "-type" "f" "-size" "+0" "-name" "*.rpm" 2016-06-22 14:52:53,775::utils.py::_run_command::178::lago.utils::DEBUG::command exit with 0 ... Bad run (from the latest ovirt-system-tests): 2016-06-22 15:17:19,728::log_utils.py::__exit__::593::ovirtlago::INFO:: * Running reposync: ESC[32mSuccessESC[0m (in 0:00:09) 2016-06-22 15:17:19,728::log_utils.py::__exit__::593::ovirtlago::INFO:: # Syncing remote repos locally (this might take some time): ESC[32mSuccessESC[0m (in 0:00:09) 2016-06-22 15:17:19,728::log_utils.py::__enter__::586::lago.virt::INFO:: # Save prefix: ESC[0mESC[0m Any ideas? TIA, Y.

1 1

Weekly bug status for ovirt-system-tests (using Lago) [ 20/06/16 ]
by Eyal Edri 20 Jun '16

20 Jun '16

*Open bugs:* https://goo.gl/eUaPUY *Open issues:* Work is being done to allow running OST locally per patch and on CI per merge.. more news to come soon *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open *Jenkins jobs:* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ * ALL jobs are stable without know issues ( except master, see below ) * master tests are failing currently, sent email with details to ovirt-devel list. *Recently merged patches:* https://gerrit.ovirt.org/#/c/58575/ -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

[17-06-2016] New lago release - 0.22.0
by Gal Ben Haim 17 Jun '16

17 Jun '16

Hi everyone! There's a new lago release with version 0.22.0 ready for you to upgrade! Docs - http://lago.readthedocs.io/en/0.22/Env_Setup.html Repo - http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Here are the changes: * Thu Jun 16 2016 gbenhaim <galbh2(a)gmail.com> - 0.22.1 20cc8d58: Fixed a bug where script manager stuck on an infinite loop. * Thu Jun 16 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.0 ed677d6b: Merge pull request #280 from lago-project/hide_import_error_when_using_old_versions_of_stevedore be794dc1: Hide import error when using old versions of stevedore. Enjoy! Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

1 0

When is Lago environment SSH'able?
by Eric Helms 16 Jun '16

16 Jun '16

Howdy, Is there a predictable way or a suggested way to know when a Lago environment has fully come up for SSH? Eric

2 1

Lago Ansible Inventory Script
by Eric Helms 15 Jun '16

15 Jun '16

Howdy, Since I didn't find anything searching around, I decided to start implementing a dynamic inventory script for Lago for my local environment while trying to keep it as generic as possible. If you'd be interested I'd like to share it and get feedback but I am not sure where is the best place for me to place it or offer it to Lago via a PR. Eric

5 9

[09-06-2016] New lago release - 0.21.0
by Gal Ben Haim 14 Jun '16

14 Jun '16

Hi everyone! There's a new lago release with version 0.21.0 ready for you to upgrade! Here are the changes: * Thu Jun 02 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.21.0 f28ea953: Merge pull request #272 from lago-project/show_plugin_import_exception_only_in_debug_level 6336d527: Added a callback function to handle import exception Enjoy! Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

3 8

[Request for feedback] Adding [Docker] container support to Lago
by Jan Lieskovsky 08 Jun '16

08 Jun '16

Hello folks, since there's motivation Lago to support containers too (https://github.com/lago-project/lago/issues/149) investigated the possible ways how this could be implemented. Created a WIP PR: [1] https://github.com/lago-project/lago/pull/276 but would appreciate a wider feedback from the list prior continuing on that one. Basically I see three possibilities how [Docker] container support for Lago could be implemented: Approach 1) - Allow Lago container yaml / json init file in "docker-compose.yml" format - Use available "docker-compose" rpm to perform the underlying actions (IOW lago commands would be just wrappers around docker-compose use. E.g. lago start == docker-compose up lago stop == docker-compose down) As a part of this I have added "prefix-provider" support to lago (first commit of [1]). The intention is to define new docker-prefix for lago, which would wrap use of docker-compose, Advantage: Should be easy to implement Disadvantage: Dependency on external docker-compose RPM, which at the moment in F22 doesn't support v2 of docker-compose YAML files yet Approach 2) - allow "docker-compose.yml" as init json/yaml file for lago container configuration, - instead of using "docker-compose" create own docker lago vm provider / plugin (using python-docker-py implementation to access docker service), As part of this I have implemented support for local docker container based provider into Lago (commit 2 of [1]). Advantage: No dependency on external docker-compose RPM Disadvantate: * The need to write own docker-compose.yml file parser (AFAIK python-dockerfile-parse doesn't support parsing them [yet) * Basically we would duplicate the effort the docker-compose tool is doing right now Approach 3) - don't allow docker-compose.yml as Lago container json/yml file, - use rather format instead Advantage: No need for docker-compose.yml parser. We can define custom format, easily to be parsable. Disadvantage: Divergence from commonly used docker-compose.yml files (UX would differ as users would need to get accustomed to different format of configuration file) The question is obvious -- can you hopefully provide comments / opinion, which approach of the above do you like best and why? If having yet another one from the above ones, please share. Thank you for your opinions in advance. Regards, Jan -- Jan iankko Lieskovsky P.S.: Having agreed on an approach how this should be implemented will help us with adding vagrant support to lago too.

2 1

[02-06-2016] New lago release - 0.20.0
by David Caro 02 Jun '16

02 Jun '16

Hi everyone! There's a new lago release with version 0.20.0 ready for you to upgrade! One important change is the ability to use repoman for building the local repo, It also means that repoman is now required when installing python-lago-ovirt, repoman can be found in the following repo: http://resources.ovirt.org/repos/ci-tools/ Here are the other changes: 745e6087: Added possibility to specify ssh-user and ssh-pass on initfile 99e99b75: Detect (and report) any empty domain name possibly c7966a35: Using repoman to merge the reposync downloaded repos 7894c1d4: Added --custom-source option to reposetup 5c5199e9: Allow copying dirs in the vm For the full changelog, you can go to the docs page: http://lago.readthedocs.io/en/0.20/ Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

[2016-05-30] Lago Weekly Meeting Minutes
by David Caro 30 May '16

30 May '16

oVirt system tests status: ========================== * 3.6 working * Master working * Image Failing due to appliance known issue (engine is not getting installed on the appliance, fabiand is on it) * New suite on it's way: Hosted engine (lev is working on it) **AI**: create a readthedocs page Last release items: ==================== Lago VM, VMProvider and Service plugins merged and released Next relase items: ================== Lago + repoman integration patch was merged, next lago release will require repoman to be available (ovirt ci-tools repo has the latest version) Installation howto effort ========================== * Installed lago on rhel 7.2 (some difficulties with the deps, probably mixed channels) * For some reason lago requires ovirtlago on start/stop Cheers!! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Weekly bug status for ovirt-system-tests (using Lago) [ 29/05/16 ]
by Eyal Edri 29 May '16

29 May '16

FYI, Some updates from recent activity on ovirt-system-tests running on Lago. *New training videos:* overview of the framework running on Lago - https://bluejeans.com/s/9FaJ/ <https://mojo.redhat.com/external-link.jspa?url=https%3A%2F%2Fbluejeans.com%…> hands on session on installing and running OST - https://bluejeans.com/s/9Iy0/ <https://mojo.redhat.com/external-link.jspa?url=https%3A%2F%2Fbluejeans.com%…> *Open bugs:* https://goo.gl/eUaPUY *Open issues:* Work is being done to allow running OST locally per patch and on CI per merge.. more news to come soon *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open * Some patches are open on simplification and cleanup of the tests, should be merged this week. * This is part of preparing ovirt-system-tests to support running tests per commit. *Jenkins jobs: (STABLE!)* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ 3.6 & master tests are stable and running on nightlies - please watch out for any new errors, they probably mean there is a regression! 3.6 NGN job is failing - Tolik/David - do we know what the issue is? *Recently merged patches:* https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:merged+since… > -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

[2016-05-26] Weekly lago release 0.19.0
by David Caro 26 May '16

26 May '16

Hi everyone! A new lago release is out, this one adds the possibility to extend lago with three new plugins: * VMPlugin: Allows to modify each and every VM action, useful though when you want to extend the actions a VM can take, or customize some high level behavior (like defining a different set of artifacts to collect) We have lago.vm.DefaultVM (default), ovirtlago.virt.EngineVM (ovirt-engine), ovirtlago.virt.NodeVM (ovirt-node) and ovirtlago.virt.HostVM (ovirt-host). You can specify which one your domain belongs to with the key 'vm-type' and one of the above values, like: domains: my_domain: vm-type: ovirt-engine ... * VMProvider: Allows to implement a different set of low-level methods, like snapshot, or start/stop a vm, to allow to use different virtualization (or not) systems (only LocalLibvirtVMProvider (local-libvirt) and SSHVMProvider (ssh) are implemented right now). You can specify a custom provider for your domains with the 'vm-provider' key, like: domains: my_domain: vm-provider: local-libvirt ... * ServicePlugin: This is the class that implements the service-handling functions for a vm, starting/stopping a service, checking if the service is enabled, etc. Current implementations are SystemdService (systemd), SysVInitService (sysvinit) and SystemdContainerService (systemdcontainer). You can specify a custom service provider for your domain with the key 'service_provider': domains: my_domain: service_provider: systemd ... Another important fixed bug is that now copying a directory to a vm works :) For the latest docs and changelog you can go to the docs page: http://lago.readthedocs.io/en/0.19/ Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

[23-05-2016] Lago weekly meeting minutes
by David Caro 23 May '16

23 May '16

23-05-2016 - Agenda * oVirt system tests status: * 3.6 working (had some storage setup timeout on one run, rerunning to try to reproduce) * Master working * Image working * Cleanup and json->yaml refactor patches: * https://gerrit.ovirt.org/57664 * https://gerrit.ovirt.org/57699 * https://gerrit.ovirt.org/57700 * https://gerrit.ovirt.org/57702 * https://gerrit.ovirt.org/57703 * https://gerrit.ovirt.org/57704 * https://gerrit.ovirt.org/57705 * https://gerrit.ovirt.org/57731 * https://gerrit.ovirt.org/57663 * https://gerrit.ovirt.org/57662 * AI: create a readthedocs page * Lago Tutorial * Splitted the docs on two sections * Getting started: In depth explanation of the tutorial same steps * Tutorial: Per-feature explanation with examples * Lago demo * Totally different project, with it’s own maintenance * Very simple introduction on how to generate the lago repos (quick tutorial) * Lago + repoman integration: * https://github.com/lago-project/lago/pull/251 * Have to think a bit how to distribute repoman (currently it’s in ovirt ci-tools repo) * Lago VM, VMProvider and Service plugins * https://github.com/lago-project/lago/pull/260 * Still working out on the documentation but is functionally complete Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

2 2

Lago and Vagrant
by Eric Helms 22 May '16

22 May '16

I recall seeing some discussion of Lago vs Vagrant and how there could be some leverage between the two. We are currently using Lago in our release testing pipeline, however, for years now we've been using Vagrant for deploying developer and production hand-on testing environments. There are benefits to how we test and build environments to centering on a singular technology. Thus, I had a few questions I was hoping to get some thoughts on: 1) What was the outcome of the Lago vs Vagrant discussions? 2) How to reconcile the built up base of Vagrant use within our group with Lago (or how to sell switching to Lago)? 3) Do you see them as co-existing with different application points? To give an example of a disconnect where centering technology would benefit, we do an installation test currently spinning up a Lago based environment. Users testing our builds are using our existing Vagrant setup to spin up environments. However, we aren't testing the setup and configuration users are using and we end up double building the techniques for setting up environments. Thanks for any thoughts, Eric

3 2

Weekly bug status for ovirt-system-tests (using Lago) [ 22/05/16 ]
by Eyal Edri 22 May '16

22 May '16

FYI, Some updates from recent activity on ovirt-system-tests running on Lago. *Open bugs:* https://goo.gl/eUaPUY *Open issues:* Failure on DirectLun (not merged yet), actually found a blocker by a new test added by Yaniv K, see open patches [1] *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open * Some patches are open on simplification and cleanup of the tests, should be merged this week. * This is part of preparing ovirt-system-tests to support running tests per commit. *Jenkins jobs: (STABLE!)* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ - stable for the past days. 3.6 & master tests are stable and running on nightlies - please watch out for any new errors, they probably mean there is a regression! *Recently merged patches:* https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:merged+since… [1] *Bug 1337909* <https://bugzilla.redhat.com/show_bug.cgi?id=1337909> - NPE when trying to a direct LUN disk -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

New 0.18 version is out!
by David Caro 20 May '16

20 May '16

New lago 0.18 version is out, as the last one was done just a couple of days ago, there are not many changes, just a couple of bugfixes: * Expanding any vars on any url * Pinning down the version of yapf used For the latest docs: http://lago.readthedocs.io/en/0.18/ Cheers! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Lago Demo
by Gal Ben Haim 19 May '16

19 May '16

Hi All, I wrote a document which demonstrates a basic use case of Lago. The reader should follow the instructions in the document, and thus get a sense about Lago's capabilities and ease of use. This document should guide the user in his first experience, and this is why I'm not exposing the advanced capabilities of Lago (we will have another document for this). I would like you to try out the document, and write back a review. Link to the document: https://github.com/gbenhaim/Lago-Demo Thanks ! Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

2 1

[2016-05-18] Weekly lago release
by David Caro 18 May '16

18 May '16

Hi everyone!! Last week's release was delayed a little bit due to the holidays, so we are releasing today, the new 0.17 version of lago comes with some interesting improvements: 9253f807: Added possibility to use env vars on disk path and url c7ff5190: Removed the repo verification code - replaced by retries and workarounds 61813f2e: Fix wait_for_ssh logic - now the times and tries when waiting for ssh make more sense, and have better logging 1ec94d55: Added LAGO_INITFILE_PATH env var when running init 86a8bde1: Setting LAGO_WORKDIR_PATH too on init 7a661154: Copy inside the prefix the deploy scripts 499c9912: Expanding the disks path on vm xml generation c5f6cafb: Using LAGO_PREFIX_DIR for the disk images too So the most change is the possibility to use env variables in the init file, and the addition of the env vars: * LAGO_PREFIX_DIR * LAGO_WORKDIR_PATH * LAGO_INITFILE_PATH (only when running lago init) That allow you to better specify relative paths to the different files (disks, scripts, urls...). And that allow to keep the workdir functional even after renaming them (mv old_workdir new_workdir). For the updated docs and changelog: http://lago.readthedocs.io/en/0.17/ For the rpms: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Can't run tests with latest Lago & ovirt-system-tests
by Yaniv Kaul 16 May '16

16 May '16

I've updated to the latest ovirt-system-tests, and apparently commit ed759a62 was breaking things to me. So I've updated Lago to latest (from http://resources.ovirt.org/repos/lago/unstable/0.0/latest/rpm/fc23/noarch/ ) - which is 0.16.12-1 now, and now things break differently, possibly by Lago commit ba6dda1e92faf26bc6842a78143ced20ae0546ff @ Create prefix internal repo: ERROR (in 0:00:00) Error occured, aborting Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 248, in do_run self.cli_plugins[args.ovirtverb].do_run(args) File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run self._do_run(**vars(args)) File "/usr/lib/python2.7/site-packages/lago/utils.py", line 584, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/utils.py", line 595, in wrapper return func(*args, prefix=prefix, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 166, in do_ovirt_reposetup skip_sync=skip_sync, File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 615, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/__init__.py", line 423, in prepare_repo _sync_rpm_repository(rpm_repo, reposync_yum_config, repos) File "/usr/lib/python2.7/site-packages/ovirtlago/__init__.py", line 105, in _sync_rpm_repository ret, out, _ = utils.run_command(reposync_command) AttributeError: 'module' object has no attribute 'run_command Any idea?

3 3

[2016-05-09] Lago weekly meeting minutes
by David Caro 09 May '16

09 May '16

Agenda ======== * oVirt system tests status: - 3.6 working - Master seems to fail on add-hosts still (investigating) * Merged workaround for reposync issues * Lago tutorial on it’s way - Using the unstable/latest lago (with the new patches) - Latest version: http://jenkins.ovirt.org/job/lago_master_check-patch-el7-x86_64/51/artifact… * Gal released 0.16.0 last week, kudos! * Merged patch to copy the deploy scripts inside the prefix on init, that takes us a step closer to relocatable prefixes (and exportable prefixes too) Let's have a great week! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

[05-05-2016] New lago release - 0.16.0
by Gal Ben Haim 05 May '16

05 May '16

Hi everyone! There's a new lago release with version 0.16.0 ready for you to upgrade! One important change in version 0.16.0 is the support for the following environment variables: $LAGO_PREFIX_PATH = .lago/current $LAGO_WORKDIR_PATH = .lago it's now highly recommended to use those variables when configuring the path to the deployment scripts. Here are the other changes: * Wed May 04 2016 David Caro <dcaroest(a)redhat.com> - 0.16.0 45764a95: Fixed small typo in a string * Wed May 04 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.15.5 66dec63b: Merge pull request #231 from lago-project/fix_el7_dirlock ccf6dca4: Added lock class for el7 locking 9a6e370c: Use lago.utils.LockFile instead of lockfile's one 98322f01: Removed thread pool on reposync 167c8b7d: Moved some code out of a with block db836eda: Yapf fixes * Tue May 03 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.15.4 0e535676: Merge pull request #230 from lago-project/add_prefix_env_vars 17e9be31: tests:Modified deploy funct tests to use vars 1440adee: Add some lago extra vars to the env 577c442a: Expand vars and user contraptions on deploy scripts * Tue May 03 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.15.3 a1a57978: Merge pull request #229 from lago-project/extra_gitignore 2a5a3359: Added extra ignores to .gitignore * Fri Apr 29 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.15.2 25c91601: Merge pull request #227 from lago-project/fix_unhandled_exception 8eeb43cc: Fixed wrong error log on reposetup * Fri Apr 29 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.15.1 5c5bc197: Merge pull request #226 from lago-project/fix_repoverify_check c4380a9a: Fixed repoverify not behaving like reposync d8c9ac55: Added new deps for the tests * Sat Apr 23 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.15.0 4b98d690: Merge pull request #223 from lago-project/try_cleaning_reposync_caches_on_first_failure f87101ee: Reposync first retry with clean caches Enjoy! Gal Ben Haim gbenhaim(a)redhat.com RHEV-CI Team

2 1

Weekly bug status for ovirt-system-tests (using Lago) [ 01/05/16 ]
by Eyal Edri 01 May '16

01 May '16

FYI, Some updates from recent activity on ovirt-system-tests running on Lago. *Open bugs:* https://goo.gl/eUaPUY *Open issues:* Improvements on the host install issue, some env are not reproducing anymore but not sure we're 100% clear yet. *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open * There are quite a few open, some are just temp for helping with the debug of 'stuck in installing state' *Jenkins jobs: (failing on known issues)* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ *Recently merged patches:* commit 211e475c004a2635896e528cd3aed6cd7d0dc5fd Author: Sandro Bonazzola <sbonazzo(a)redhat.com> Date: Thu Apr 28 16:44:50 2016 +0200 common: yum-repos: update glusterfs repos - dropped Gluster community repo for Fedora23: the repo is empty and Gluster community is maintaining Fedora packages within Fedora repositories. For reference: http://download.gluster.org/pub/gluster/glusterfs/LATEST/Fedora/What_About_… - on EL7 moved from Gluster community repo to CentOS Storage SIG repositories: we've been advised by Gluster community that their packaging effort is focused on CentOS Storage SIG and CentOS infrastructure is more reliable. Change-Id: I4d2c752be825fbbb9035222845728d10c5dd288c Signed-off-by: Sandro Bonazzola <sbonazzo(a)redhat.com> ---------------------------------------------------------------------------------------------------------- commit 19c102110279975d274c32477cc28c7c29e75fbc Author: David Caro <dcaroest(a)redhat.com> Date: Wed Apr 20 21:10:37 2016 +0200 Fixed answerfile for master A new question was added to the setup Change-Id: I6be958a70d67126d8067ff1855018125623b10c1 ---------------------------------------------------------------------------------------------------------- commit 5829862d17e92f91cfd04e7b9d5549cd775c800c Author: Yaniv Kaul <ykaul(a)redhat.com> Date: Mon Apr 25 14:06:27 2016 +0300 Add 'device=eth0' to EL7 deploy scripts. Apparently, /etc/sysconfig/network-scripts/ifcfg-eth0 lacks it on EL7 images. This works with NetworkManager, but not without it. When something goes bad, VDSM fails to rollback properly as its missing. For now, add it. Change-Id: I1c4ca07499a3947022e6f943cf05842ee1def408 Signed-off-by: Yaniv Kaul <ykaul(a)redhat.com> ---------------------------------------------------------------------------------------------------------- commit ddb42782968e5c6d411cdc747503fd90bed249d7 Author: David Caro <dcaroest(a)redhat.com> Date: Tue Mar 29 18:53:42 2016 +0200 Fix the master suite runs This is just copying over and adapting a bit (just so it works) the 3.6 suite into the master suite. Only for the 3.6 api, the newapi tests will be added later Still affected by the storage deactivation issues Change-Id: I55781a5d5a746aaf81e403eeeee40880beacb8a0 Signed-off-by: David Caro <dcaroest(a)redhat.com> ---------------------------------------------------------------------------------------------------------- commit c7d50cf8aebd6b566ae5c6ee8d6e3b8ec24ffc2b Author: Yaniv Kaul <ykaul(a)redhat.com> Date: Tue Apr 26 13:57:43 2016 +0300 Remove snapshot and reverting as part of the ovirt-system-tests I currently did not find a use case for it. It slows down the tests and causes (real? false?) issues with SDs. Mainly their activation and deactivation. It dramatically reduced the time to run the whole suite for me. 3-4 minutes on my desktop, and >10 minutes on my laptop. Change-Id: I9f7e509220c83805df78abb94b0ddc390c4a7f54 Signed-off-by: Yaniv Kaul <ykaul(a)redhat.com> ---------------------------------------------------------------------------------------------------------- -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

[2016-04-26] Lago weekly meeting minutes
by David Caro 26 Apr '16

26 Apr '16

Agenda ======== * Ovirt system tests 3.6 status: Gal testing 3.6.6 it locally, it’s expected to pass * Ovirt system tests master status: Affected by: https://bugzilla.redhat.com/show_bug.cgi?id=1322257 https://bugzilla.redhat.com/show_bug.cgi?id=1329317 * Had some issues with jenkins.phx.ovirt.org last week, fixed already * Currently reposetup not working on el7 systems, using old version of lockfile https://github.com/lago-project/lago/issues/225 * Released 0.15 with some improvements: Rotating the dest dir on collect Generic ‘lago deploy’ command More verbose reposetup command In progress: * Lago tutorial * Lago init file spec * Lago high level desing doc * virt.py fixes Action items: * dcaro: fix the el7 lockfile issue * dcaro: review the tutorial to unblock gbenhaim Thanks!! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

2 2

Weekly bug status for ovirt-system-tests (using Lago) [ 24/04/16 ]
by Eyal Edri 24 Apr '16

24 Apr '16

FYI, Some updates from recent activity on ovirt-system-tests running on Lago. *Open bugs:* https://goo.gl/eUaPUY *Open issues:* Still suffering from host add failures (stuck in installing, David has been debugging it constantly with Piotr last week) *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open *Jenkins jobs: (failing on known issues)* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ *Recently merged patches:* (Thanks again to Yaniv K!) Author: Yaniv Kaul <ykaul(a)redhat.com> Date: Wed Apr 20 23:51:55 2016 +0300 More accurate 3.6 repo 1. With this repo, both engine and hosts can be installed, without any external access, I hope. 2. Now we can test latest 3.6, not the released one. Change-Id: I9066af4f5d92e275586c29c65fe7ef7500fe5c20 Signed-off-by: Yaniv Kaul <ykaul(a)redhat.com> -------------------------------------------------------------------------------------------------------------------- Author: Yaniv Kaul <ykaul(a)redhat.com> Date: Tue Apr 12 23:00:16 2016 +0300 Fixes for FC23 local repo setup: 1. The interface may not be eth0. The new code hopefully work with any if name. Depends that the interface is the first, but let's hope it is. 2. Add 'cost=1' to ensure the local repo is preferred over other repos. Change-Id: If846d7bacdf517d1342464c210359e5a0e8cad6e Signed-off-by: Yaniv Kaul <ykaul(a)redhat.com> -------------------------------------------------------------------------------------------------------------------- Author: Yaniv Kaul <ykaul(a)redhat.com> Date: Wed Mar 30 22:46:39 2016 +0300 Basic quota tests Add quota and set it to audit mode, not more than that. Change-Id: Ia35e9b2b65c01cdcca8da7f87ed7a38f8dc2bb17 Signed-off-by: Yaniv Kaul <ykaul(a)redhat.com> -------------------------------------------------------------------------------------------------------------------- Author: Yaniv Kaul <ykaul(a)redhat.com> Date: Thu Apr 14 01:04:28 2016 +0300 Fix mount / path issues with storage_nfs_el7 provisioning script Clearly was not tested well (because of the host installation, but that's an execuse). This patch fixes it, tested on 3.6 with adding all domains, finally. It also again simplifies it - but removes the option of not mounting the export mount. Note that the ISO mount is not completely done as well, I think. Will attend to in a follow up patch. Based on David's request, the whole setup is split into functions. Tested (properly) with 3.6, including the TEMPLATES domain attachment. (The test for it should still be excluded, IMHO). Change-Id: I261f3d3f3b3647cbbc506913478ffc6c36594519 Signed-off-by: Yaniv Kaul <ykaul(a)redhat.com> -------------------------------------------------------------------------------------------------------------------- Author: Yaniv Kaul <ykaul(a)redhat.com> Date: Sun Apr 10 17:10:16 2016 +0300 Simplification and enhancements to iSCSI and NFS servers deployment Removed a lot of not needed code from the setup. Mainly, just straightforward using the disks (in case of NFS), no need for LVM stuff. Disabled firewall, enabled 'noop' scheduler. Tested with both master and 3.6. Never got to test fully master, blocked by a host installation bug. 3.6 passed well. Change-Id: I7ec630ba5fa62529421b8e8f9aec993e7cdc84b6 Signed-off-by: Yaniv Kaul <ykaul(a)redhat.com> Please comment / update on any additional info you have on this thread, Eyal.

1 0

Weekly lago release 0.15
by David Caro 23 Apr '16

23 Apr '16

Hi everyone!! It's been a couple weeks without releases, but we are back and 100% committed to keep up the pace. On this week's release: * Several reposetup command improvements (better logs, friendlier retry, ...) * Collect now rotates the destination folder if it exists * Skip vm bootstrap, what allows faster functional tests * Generic deploy subcommand, now you can use the deploy command with lago, just add a 'deploy-scripts' list entry to the 'metadata' key on any vm/domain definition, with a list of scripts and they will be run on 'lago deploy' For the full changelog, as always, you can go to: http://resources.ovirt.org/repos/lago/stable/0.0/CHANGELOG_0.0.txt And for the latest rpms: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Can I define somewhere the collect artifacts?
by Yaniv Kaul 14 Apr '16

14 Apr '16

I'm extending the VDSM functional tests, and saving files under /tmp/vdsm-results/ - can I simply ask somehow to get all files from there, perhaps via the init.json.ini file would be the right place to add this? TIA, Y.

3 6

Lago + ovirt-system-tests run fail on collecting logs
by Eyal Edri 13 Apr '16

13 Apr '16

After running: ./run_suite.sh --cleanup basic_suite_3.6 ./run_suite.sh basic_suite_3.6 The tests failed at [1] Does it mean the cleanup stage failed? why would log collection fail on a duplicate file? I think it will be beneficial to support multiple logs and rotate it like we do in ovirt for e.g, Since a developer might run a few times without cleanning up the env. Do we have an open issue for it? , cause I didn't find anything similar. [1]. @ Collect artifacts: ERROR (in 0:00:00) Error occured, aborting Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 248, in do_run self.cli_plugins[args.ovirtverb].do_run(args) File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run self._do_run(**vars(args)) File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper return func(*args, prefix=prefix, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 217, in do_ovirt_collect prefix.collect_artifacts(output) File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 598, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 928, in collect_artifacts os.makedirs(output_dir) File "/usr/lib64/python2.7/os.py", line 157, in makedirs mkdir(name, mode) OSError: [Errno 17] File exists: '/home/eedri/lago/ovirt-system-tests/test_logs/basic_suite_3.6/post-001_initialize_engine.py' -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

3 7

configuring path for reposync
by Eyal Edri 12 Apr '16

12 Apr '16

Hi, When installing lago you get these default values in : [lago] log_level = debug template_store = /var/lib/lago/store template_repos = /var/lib/lago/repos First, what is the diff between the 2? store holds the templates, what is repos? Also, when running ovirt-system-tests i see under /var/lib/lago/reposync all the repos sycned, is there away to define this path to be somewhere else? is it in the ovirt-system-tests config (if so why is it under lago dir) if not, shouldn't it be in lago.conf? -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

2 2

repeating libvirt exception in vdsm check-merged job
by Yaniv Bronheim 11 Apr '16

11 Apr '16

Hi, we keep getting the following error in vdsm automation *12:16:47* + lago start vdsm_functional_tests_host-fc23*12:16:49* current session does not belong to lago group.*12:16:49* @ Start specified VMs: *12:16:49* # Start nets: *12:16:49* * Create network vdsm_functional_tests_lago: *12:16:50* * Create network vdsm_functional_tests_lago: Success (in 0:00:00)*12:16:50* # Start nets: Success (in 0:00:00)*12:16:50* # Start vms: *12:16:50* * Starting VM vdsm_functional_tests_host-fc23: *12:16:50* libvirt: QEMU Driver error : Cannot check QEMU binary /usr/libexec/qemu-kvm: No such file or directory*12:16:50* * Starting VM vdsm_functional_tests_host-fc23: ERROR (in 0:00:00)*12:16:50* # Start vms: ERROR (in 0:00:00)*12:16:50* # Destroy network vdsm_functional_tests_lago: *12:16:50* # Destroy network vdsm_functional_tests_lago: ERROR (in 0:00:00)*12:16:50* @ Start specified VMs: ERROR (in 0:00:00)*12:16:50* Error occured, aborting*12:16:50* Traceback (most recent call last):*12:16:50* File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 661, in main*12:16:50* cli_plugins[args.verb].do_run(args)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run*12:16:50* self._do_run(**vars(args))*12:16:50* File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper*12:16:50* return func(*args, **kwargs)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper*12:16:50* return func(*args, prefix=prefix, **kwargs)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 234, in do_start*12:16:50* prefix.start(vm_names=vm_names)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 778, in start*12:16:50* self.virt_env.start(vm_names=vm_names)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/virt.py", line 193, in start*12:16:50* vm.start()*12:16:50* File "/usr/lib/python2.7/site-packages/lago/virt.py", line 910, in start*12:16:50* self._env.libvirt_con.createXML(self._libvirt_xml())*12:16:50* File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3611, in createXML*12:16:50* if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self)*12:16:50* libvirtError: Cannot check QEMU binary /usr/libexec/qemu-kvm: No such file or directory all jobs fail today with the same exception - http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/53/console . any idea why qemu-kvm is missing? -- *Yaniv Bronhaim.*

3 5

libvirt: QEMU Driver error : Guest agent is not responding: QEMU guest agent is not available due to an error
by Eyal Edri 10 Apr '16

10 Apr '16

Anyone run lago before on RHEL 7.2? Its possible we're hitting [1] with libvirt-1.2.17 https://bugzilla.redhat.com/show_bug.cgi?id=1090551 -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

reminder on lago khanban board
by Eyal Edri 10 Apr '16

10 Apr '16

FYI, Lago started using a khanban board [1] to prioritize and visualize the current issues which are being worked on, since it very hard to use GitHub to monitor and prioritize issues. Taiga is an open source project and was chosen (rather than Trello for e.g) because it had already integration with GitHub for syncing automatically issues to the board and moving statuses. If you want to ask for a specific issue prioritization, please use this list to communicate it, We will review issues on a weekly basis and the WIP will be shown on the board. [1] https://tree.taiga.io/project/david-caro-lago/kanban -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

Weekly bug status for ovirt-system-tests (using Lago) [ 10/04/16 ]
by Eyal Edri 10 Apr '16

10 Apr '16

A weekly reminder on open bugs & patches to keep track on blockers for oVirt testing: *Open bugs:* https://goo.gl/eUaPUY *Open issues:* Still suffering from add host failures, pending a fix from network team: https://bugzilla.redhat.com/show_bug.cgi?id=1322257 *Recently merged:* (Thanks Yaniv K!) - Multiple changes to deployment script https://gerrit.ovirt.org/#/c/55695/ - Fix IP Address of engine *https://gerrit.ovirt.org/#/c/55903/ <https://gerrit.ovirt.org/#/c/55903/>* - Improvements to the storage domain add tests - https://gerrit.ovirt.org/#/c/55233/ *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open - *Basic quota tests: https://gerrit.ovirt.org/#/c/55514/ <https://gerrit.ovirt.org/#/c/55514/>* - *Switched between hot-add disk and hot-add NIC tests * https://gerrit.ovirt.org/#/c/55740/ - (Attempt to reduce chance of hitting the deactivate storage bug, though the fix of this bug might be in already, so not sure its needed, Yaniv?) - WIP: Fix master (4.0) suite, still in progress https://gerrit.ovirt.org/#/c/55425/ - Merging the storage VMs into one, still in progress: https://gerrit.ovirt.org/#/c/54957/ If you have any updates on the bugs/patches please reply with more info. -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ) -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

2 1

In which order repos are searched for RPMs?
by Yaniv Kaul 05 Apr '16

05 Apr '16

If I have the RPM on the 'localsync' repo as well as externally (say, from CentOS 7 updates), which repo will it be taken from? - Simple solution: sync all that you need and disable the 'updates' repo. I'm in favor. Same for the 'base' repo and any other repo. Essentially, all that the VM needs should be in the 'localsync' repo. - Simple solution #2 : rename 'localsync' to '*a*localsync' - just to make sure it is the first looked at... Before: [root@lago_basic_suite_3_6_engine ~]# egrep "Updated|Installed" /var/log/yum.log | awk -F\: '{print $NF}' |xargs yum info |grep "From repo" |egrep -c "base|updates" 87 After the change: [root@lago_basic_suite_3_6_engine ~]# egrep "Updated|Installed" /var/log/yum.log | awk -F\: '{print $NF}' |xargs yum info |grep "From repo" |egrep -c "base|updates" 1

2 1

[2016-04-04] Lago weekly meeting minutes
by David Caro 04 Apr '16

04 Apr '16

Hi everyone, short meeting this week: Discussions: ============= * Ovirt system tests 3.6 status: - 3.6 tests running on jenkins (currently failing to add hosts) * Ovirt system tests master status: - Affected by: https://bugzilla.redhat.com/show_bug.cgi?id=1322257 * Investigating about vagrant-lago - https://docs.google.com/spreadsheets/d/1PKIlmhTd-vxEfs7JZC-mLkvWG4cBE1oOnxR… - Have to schedule a meeting to push this forward Action Items ============= * Migrate to jenkins.phx.ovirt.orgt -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Weekly bug status for ovirt-system-tests (using Lago)
by Eyal Edri 03 Apr '16

03 Apr '16

A weekly reminder on open bugs & patches to keep track on blockers for oVirt testing: *Open bugs:* https://goo.gl/eUaPUY *Blocking bugs in potential:* - Bug 1311121 - oVirt system tests for 3.6 fail to deactivate domain on the first try - suspect race between OVF update and SPM stop (engine bug) - Patch provided, pending verification/testing on the tests *Open patches:* https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open - WIP:Fix the master suite runs - Improvements to storage domains add tests - Merged storage servers into one - Basic quote tests If you have any updates on the bugs/patches please reply with more info. -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

2 1

[2016-04-01] Weekly lago release, 0.14.0
by David Caro 01 Apr '16

01 Apr '16

Hi everyone! There's a new lago release, with mostly bug fixes but also some features, the most relevant are: * New default init file: Now you can use a LagoInitFile in the current dir as the default init configuration file (the usual init.json or init.yaml) so when running 'lago init' it will pick it up. * New '--set-current' option for the init command, to allow setting the prefix that's being created as the current prefix. For more detailed changelog you can go to: http://resources.ovirt.org/repos/lago/stable/0.0/CHANGELOG_0.0.txt And the rpms, as usual are at: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

'Persistent' IP addresses for the hosts
by Yaniv Kaul 31 Mar '16

31 Mar '16

Can I ensure that in every run, host0 will get the same IP from the network IP pool? I'd imagine that they would, by the order of their init.json.in - but i'm not sure this is the case. TIA, Y.

3 8

Failing to run ovirt-system-tests using lago due to missing rpms
by Eyal Edri 29 Mar '16

29 Mar '16

Hi, Anyone encountered these errors when running 3.6 basic suite on RHEL 7.2? * STDERR Error: Package: ovirt-engine-3.6.4.1-1.el6.noarch (localsync) Requires: ovirt-iso-uploader >= 3.6.0 Error: Package: ovirt-engine-3.6.4.1-1.el6.noarch (localsync) Requires: slf4j >= 1.7.0 Available: slf4j-1.5.8-8.el6.noarch (base) slf4j = 1.5.8-8.el6 Error: Package: ovirt-engine-backend-3.6.4.1-1.el6.noarch (localsync) Requires: ovirt-host-deploy-java >= 1.4.0 Error: Package: ovirt-engine-vmconsole-proxy-helper-3.6.4.1-1.el6.noarch (localsync) Requires: ovirt-vmconsole-proxy Error: Package: ovirt-engine-3.6.4.1-1.el6.noarch (localsync) Requires: ovirt-image-uploader >= 3.6.0 Error: Package: ovirt-engine-backend-3.6.4.1-1.el6.noarch (localsync) Requires: ebay-cors-filter Error: Package: ovirt-engine-setup-base-3.6.4.1-1.el6.noarch (localsync) Requires: otopi >= 1.4.0 Error: Package: ovirt-engine-setup-plugin-ovirt-engine-3.6.4.1-1.el6.noarch (localsync) Requires: ovirt-engine-extension-aaa-jdbc Error: Package: ovirt-engine-3.6.4.1-1.el6.noarch (localsync) Requires: ovirt-engine-wildfly >= 8.2.1 Error: Package: ovirt-engine-setup-plugin-ovirt-engine-common-3.6.4.1-1.el6.noarch (localsync) Requires: ovirt-setup-lib Error: Package: ovirt-engine-backend-3.6.4.1-1.el6.noarch (localsync) Requires: vdsm-jsonrpc-java >= 1.1.8 Error: Package: ovirt-engine-backend-3.6.4.1-1.el6.noarch (localsync) Requires: ovirt-engine-extension-aaa-jdbc # [Thread-3] Deploy VM lago_basic_suite_3_6_engine: ERROR (in 0:01:59) Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 46, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/ovirtlago/__init__.py", line 472, in _deploy_host host.name(), RuntimeError: /home/eedri/lago/ovirt-system-tests/basic_suite_3.6/deploy-scripts/setup_engine.sh failed with status 1 on lago_basic_suite_3_6_engine @ Deploy oVirt environment: ERROR (in 0:01:59) Error occured, aborting Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 248, in do_run self.cli_plugins[args.ovirtverb].do_run(args) File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run self._do_run(**vars(args)) File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper return func(*args, prefix=prefix, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 174, in do_deploy prefix.deploy() File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 598, in wrapper func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/__init__.py", line 52, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/__init__.py", line 480, in deploy self._deploy_host, self.virt_env.get_vms().values() File "/usr/lib/python2.7/site-packages/lago/utils.py", line 88, in invoke_in_parallel vt.join_all() File "/usr/lib/python2.7/site-packages/lago/utils.py", line 46, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/ovirtlago/__init__.py", line 472, in _deploy_host host.name(), RuntimeError: /home/eedri/lago/ovirt-system-tests/basic_suite_3.6/deploy-scripts/setup_engine.sh failed with status 1 on lago_basic_suite_3_6_engine -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

Reviews needed for ovirt-system-tests
by Eyal Edri 24 Mar '16

24 Mar '16

Hi, There has been progress with fixing a few issues on ovirt-system-tests and patches were submitted [1]. We would like to merge them ASAP so the ovirt tests for 3.6 and 4.0 can get one more step closer to working and being stable both for developers and for CI. Can you please review the pending patches so we can merge them TODAY? [1] https://gerrit.ovirt.org/#/c/53534 - needs a review https://gerrit.ovirt.org/#/c/53518/ - +1, probably can be merged. https://gerrit.ovirt.org/#/c/54738/ - +1, can get merged. https://gerrit.ovirt.org/#/c/54721/ - +1, can get merged https://gerrit.ovirt.org/#/c/51566/4 - +1, can get merged https://gerrit.ovirt.org/#/c/52681/ - not sure about this one -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

[2016-21-03] Lago weekly meeting minutes
by David Caro 21 Mar '16

21 Mar '16

Discussions: --------------- * Ovirt system tests 3.6 status: - Removed template import related tests - Using el6-base and el7-base only templates - Running ok ~50% of the time, current issues: ~ Storage domain is not being deactivated https://bugzilla.redhat.com/show_bug.cgi?id=1311121 ~ Host does not get installed in time (15min) ~ Host vm gets into non-responsive (no ssh, no console, but vm is started) * Investigating about vagrant-lago https://docs.google.com/spreadsheets/d/1PKIlmhTd-vxEfs7JZC-mLkvWG4cBE1oOnxR… * Started using taiga for task prioritization: https://tree.taiga.io/project/david-caro-lago/kanba Last week action items: ------------------------ * [ovirt-system-tests] Open bug on moving 4.0 tests to 3.6 api code https://bugzilla.redhat.com/show_bug.cgi?id=1317610 * [ovirt-system-tests] Skip the template-relate * Open thread on vagrant integration - DONE -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

2 2

merge_repos is not picking the latest version of ioprocess?
by Yaniv Kaul 21 Mar '16

21 Mar '16

The latest I'm interested in is 0.15.0-4.el7: mini@ykaul-mini:~/ovirt-system-tests$ find /var/lib/lago/reposync -name "ioprocess*.rpm" /var/lib/lago/reposync/ovirt-3.6-el7/x86_64/ioprocess-0.15.0-2.el7.x86_64.rpm /var/lib/lago/reposync/epel-el7/i/ioprocess-0.15.0-4.el7.x86_64.rpm /var/lib/lago/reposync/epel-el6/ioprocess-0.14.0-1.el6.x86_64.rpm /var/lib/lago/reposync/ovirt-3.6-el6/x86_64/ioprocess-0.15.0-2.el6.x86_64.rpm But merge picks 0.15.0-2.el7 instead: 2016-03-21 13:14:11,458::merge_repos.py::merge::123::ovirtlago.merge_repos::DEBUG::Copying /var/lib/lago/reposync/ovirt-3.6-el7/x86_64/ioprocess-0.15.0-2.el7.x86_64.rpm to output directory 2016-03-21 13:14:12,224::merge_repos.py::merge::123::ovirtlago.merge_repos::DEBUG::Copying /var/lib/lago/reposync/ovirt-3.6-el7/noarch/python-ioprocess-0.15.0-2.el7.noarch.rpm to output directory Which causes the VM to take the right one from EPEL directly (and not via the localsync). Thoughts?

2 3

Strange logs directory
by Yaniv Kaul 21 Mar '16

21 Mar '16

Did not see it before... running 0.13 (might have been there earlier, but I missed it?) mini@ykaul-mini:/home/zram/3.6/current/test_logs$ ls -l total 0 drwxrwxr-x 7 mini mini 191 מרץ 21 12:35 <nose.suite.ContextSuite context=004_basic_sanity>:setup-20160321123529 I'm running the tests onto /home/zram/3.6 directory (current and default are under it) Y.

2 3

[2016-03-18] Weekly lago release 0.13.0
by David Caro 18 Mar '16

18 Mar '16

Hi everyone! This week's release added a new verb to the default command, the collect one that was only available for the ovirt plugin. You can also now define the artifacts to be collected in the init config file. Now it better handles the artifact collection too, allowing extracting artifacts from live vms without guest agent, and allowing extracting them from any stopped vm. Also added a timeout to the ssh connection to hosts, so it will not hand forever anymore. You can get the just-baked rpms from the usual repos: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ For the full changelog you can go to: http://resources.ovirt.org/repos/lago/stable/0.0/CHANGELOG_0.0.txt Enjoy!! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Error with latest (0.12.6-1) RPMs
by Yaniv Kaul 16 Mar '16

16 Mar '16

File "/usr/lib/python2.7/site-packages/lago/virt.py", line 642, in wrapper return func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 648, in _get_ssh_client ssh_timeout = int(config.get('ssh_timeout')) File "/usr/lib/python2.7/site-packages/lago/config.py", line 83, in get raise KeyError(key) KeyError: 'ssh_timeout' Fixed by manually adding: ssh_tries = 50 ssh_timeout = 10

2 1

strange readthedocs page for lago latest
by Eyal Edri 16 Mar '16

16 Mar '16

http://lago.readthedocs.org/en/latest/ -- Eyal Edri Associate Manager EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

2 3

[2016-03-14] Weekly meeting minutes
by David Caro 14 Mar '16

14 Mar '16

* Discussions: - Add rpdb capabilities (even if it’s just locally): * https://github.com/tamentis/rpdb#trigger-rpdb-with-signal - No more ovirt_3.5_system-tests to check lago full functionality and ovirt_3.6 ones still failing * Action items: - [ovirt-system-tests] Open bug on moving 4.0 tests to 3.6 api code * https://bugzilla.redhat.com/show_bug.cgi?id=1317610 - [ovirt-system-tests] Skip the template-related tests for the 3.6 - Open thread on vagrant integration * Last week action items: - add --set-current option to init - OPEN * https://github.com/lago-project/lago/issues/162 - send bugzilla about nfs issues on 3.6 ovirt system test * https://bugzilla.redhat.com/show_bug.cgi?id=1311121 - Can’t hit it today - Open discussion on change/integration with vagrant - Check trello for issue management - OPEN * It requires license to use github integration :( - Add default init file in the current dir - OPEN * https://github.com/lago-project/lago/issues/165 - Add multiple prefixes definitions on the init config file - OPEN * https://github.com/lago-project/lago/issues/164 - Add multishell (cssh/dssh/tmux/screen) and tailing - OPEN * https://github.com/lago-project/lago/issues/163 -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

time keeping
by Yaniv Kaul 14 Mar '16

14 Mar '16

I'm concerned with two (different) time keeping issues: 1. Timezone - we need to ensure all VMs have the same timezone (At least by default). Best option would be to edit the deploy scripts and set the timezone to the host timezone? should be fairly easy to add @TIMEZONE@ variable to the deploy script in a similar manner to what we do today in the domain XML. It'll be in a command like 'ln -s /usr/share/zoneinfo/@TIMEZONE@ /etc/localtime 2. Time drifting - I have a feeling there's a time drift when we do all the freeze-thaw and snap/revert... Perhaps we should run 'ntpdate' after such actions?

2 2

[11-03-2016] Weekly lago release v0.12.0
by David Caro 11 Mar '16

11 Mar '16

Hi everyone! This week we introduced one big change in how lago handles prefixes, we introduced the 'workdir' concept, that is, a directory that will store one or more prefixes, let me show with an example. Imagine that you have an init.yaml that creates an environment with 1 vm, you can run init like this: lago --prefix-name one_vm init init.yaml That will create a workdir at $PWD/.lago with one prefix inside named one_vm and a soft link named 'current' that points to it, so any further command will run on that one_vm prefix: lago status # shows the one_vm prefix path Until there nothing new, but, now you can create more prefixes, if for example, if you have another init config file named two_vms.yaml, you can create another prefix inside that same workdir with: lago --prefix-name two_vms init two_vms.yaml That will add a new prefix to $PWD/.lago, it will not update the current link though, so any command will still run by default on the previous prefix, but you can change the current prefix with: lago set-current two_vms That will make any command that does not specify the --prefix-name option to use that one by default. NOTE: lago init will create only workdirs from now on, but you can still use the old prefixes if you have any around, it will autodetect them as one or the other. Some other changes: Now it will show the libvirt status of the domains Remove the memory balloon device. We don't use it. Ignore zero sized RPM files when merging repos. Added ignore-warnings option To see the full changelog: http://resources.ovirt.org/repos/lago/stable/0.0/CHANGELOG_0.0.txt And as usual, you can get the rpms from: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Cheers! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Fwd: [ovirt-devel] [VDSM] Moving to py.test
by Yaniv Kaul 10 Mar '16

10 Mar '16

We probably want to move to it in ovirt-system-tests as well, to align with both VDSM and Lago itself, no? ---------- Forwarded message ---------- From: Nir Soffer <nsoffer(a)redhat.com> Date: Thu, Mar 10, 2016 at 3:15 PM Subject: [ovirt-devel] [VDSM] Moving to py.test To: devel <devel(a)ovirt.org>, Yaniv Bronheim <ybronhei(a)redhat.com>, Dan Kenigsberg <danken(a)redhat.com>, Piotr Kliczewski <pkliczew(a)redhat.com>, Francesco Romani <fromani(a)redhat.com>, Adam Litke <alitke(a)redhat.com> Hi all, In the last vdsm call we discussed moving to py.test. Here is how to run the current tests with py.test: cd tests PYTHONPATH=../lib:../vdsm py.test -v *_test.py *_tests.py *Tests.py network Currently we have some failures and errors: 8 failed, 1662 passed, 101 skipped, 14 pytest-warnings, 10 error in 86.05 seconds Some py.test nice tricks: Finding the 10 slowest tests: PYTHONPATH=../lib:../vdsm py.test -v --durations=10 vmTests.py *_test.py *_tests.py *Tests.py network Checking code coverage: PYTHONPATH=../lib:../vdsm py.test -v --cov=../vdsm --cov=vdsm *_test.py *_tests.py *Tests.py network Once we finish moving vdsm code to lib/vdsm, renaming the tests to *_test.py, and add pytest.ini, running the test will be simply: py.test Once all the tests pass, we can: - Drop all the special asserts (assertXXX), py.test uses plain asserts https://pytest.org/latest/assert.html#asserting-with-the-assert-statement - Get better error reports https://pytest.org/latest/example/reportingdemo.html - Remove unneeded classes, or inherit from any class https://pytest.org/latest/getting-started.html - Replace @permutations with more powerfull @pytest.mark.parametrize https://pytest.org/latest/parametrize.html#parametrize-basics - Replace slowtest and stresstest with @pytest.mark https://pytest.org/latest/mark.html - Replace monkeypatch.py with simpler and more powerfull pytest monkeypatch funcarg https://pytest.org/latest/monkeypatch.html#monkeypatching-mocking-modules-a… - Replace NamedTemporaryDir with pytest tmpdir funcarg https://pytest.org/latest/getting-started.html#going-functional-requesting-… - Simplify complex context managers with pytest fixtures https://pytest.org/latest/example/simple.html - Drop testrunner.py, most of testlib.py, some of testValidation.py, run_tests*.sh - And more Nir _______________________________________________ Devel mailing list Devel(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/devel

2 1

Bridge Networking
by Eric Helms 08 Mar '16

08 Mar '16

I couldn't find anything in the documentation so asking here, is there a way to setup bridge networking for a set of VMs to get them public IPs? Thanks, Eric

3 7

Fwd: [VDSM] check_merged failures
by Yaniv Bronheim 08 Mar '16

08 Mar '16

forwarding to lago devels.. shouldn't be any issues with the tests. nothing changed since last time it succeeded ---------- Forwarded message ---------- From: Nir Soffer <nsoffer(a)redhat.com> Date: Tue, Mar 8, 2016 at 4:34 PM Subject: [VDSM] check_merged failures To: devel <devel(a)ovirt.org>, Yaniv Bronheim <ybronhei(a)redhat.com> Hi all, The new check_merged job is failing randomly. I have see this error today: 14:20:16 @ Start specified VMs: 14:20:16 # Start nets: 14:20:16 * Create network vdsm_functional_tests_lago: 14:20:16 libvirt: error : internal error: Network is already in use by interface 7f0c-bc616ef 14:20:16 * Create network vdsm_functional_tests_lago: ERROR (in 0:00:00) 14:20:16 # Start nets: ERROR (in 0:00:00) 14:20:16 @ Start specified VMs: ERROR (in 0:00:00) 14:20:16 Error occured, aborting 14:20:16 Traceback (most recent call last): 14:20:16 File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 539, in main 14:20:16 cli_plugins[args.verb].do_run(args) 14:20:16 File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run 14:20:16 self._do_run(**vars(args)) 14:20:16 File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 132, in wrapper 14:20:16 return func(*args, prefix=lago_prefix.Prefix(prefix_path), **kwargs) 14:20:16 File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 141, in wrapper 14:20:16 return func(*args, prefix=prefix, **kwargs) 14:20:16 File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 191, in do_start 14:20:16 prefix.start(vm_names=vm_names) 14:20:16 File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 819, in start 14:20:16 self.virt_env.start(vm_names=vm_names) 14:20:16 File "/usr/lib/python2.7/site-packages/lago/virt.py", line 187, in start 14:20:16 net.start() 14:20:16 File "/usr/lib/python2.7/site-packages/lago/virt.py", line 354, in start 14:20:16 self._env.libvirt_con.networkCreateXML(self._libvirt_xml()) 14:20:16 File "/usr/lib64/python2.7/site-packages/libvirt.py", line 4093, in networkCreateXML 14:20:16 if ret is None:raise libvirtError('virNetworkCreateXML() failed', conn=self) 14:20:16 libvirtError: internal error: Network is already in use by interface 7f0c-bc616ef Hopefully someone is owning the infrastructure and can look into this. Nir -- *Yaniv Bronhaim.*

2 3

[2016-03-07] Lago weekly meeting minutes
by David Caro 07 Mar '16

07 Mar '16

== Discussions: * Considering taiga (https://tree.taiga.io/project/david-caro-lago/kanban) as task board (has some github integration, looking) * Check trello first * Move to vagrant/oh-my-vagrant * It turns out that oh-my-vagrant has some kind of repo crawler that can make up for the lack of an open-source vagrant boxes repo service * No layered images * The size of a vagrant box is ~2 times the size of our current images * Completely replace current virt code? Totally replace lago? * Vitali (student) proposed to write the code as project * Written in ruby (some python libs) * https://pypi.python.org/pypi/python-vagrant * Change from json to yaml - DONE * Multiple ‘prefixes’ in the same workdir workflows, now that .lago is the default prefix path (see * Should we use multiple envs per prefix? or one prefix per env? * Approved * https://github.com/lago-project/lago/pull/157 * Add default init file in the current dir * https://github.com/lago-project/lago/issues/165 * Add multiple prefixes definitions on the init config file * https://github.com/lago-project/lago/issues/164 * Add multishell (cssh/dssh/tmux/screen) and tailing * https://github.com/lago-project/lago/issues/163 == Last week action items: * Start a thread to discuss the reposync drop: * http://lists.ovirt.org/pipermail/lago-devel/Week-of-Mon-20160307/000027.html * Open github issues for all the agreed features: * https://github.com/lago-project/lago/issues/149 * https://github.com/lago-project/lago/issues/148 * https://github.com/lago-project/lago/issues/147 * Change the ovirt 4.0 publisher to publish the 3.6 sdk (until 4.0 is ready, then publish both on 4.0 repo) - DONE == Action items: * add --set-current option to init * https://github.com/lago-project/lago/issues/162 * send bugzilla about nfs issues on 3.6 ovirt system tests * https://bugzilla.redhat.com/show_bug.cgi?id=1311121 * Open discussion on change/integration with vagrant * Check trello for issue management * It requires license to use the github integration :( -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Drop reposync command
by David Caro 07 Mar '16

07 Mar '16

Hi everyone, I'd like to start a discussion about dropping (at least temporarily) the reposync command. The reposync command is used in lago for two things: * Downloads locally all the packages defined in the repo conf passed (yum config file format) * Creates an internal_repo dir in the prefix and copies over all the packages that match the distros used in the prefix The advantage is that once synced, this allows installing any packages on the vms without having connection to the internet. The downside is that right now, it downloads everything, needed or not, so it takes a lot of space and time the first run to cache all the packages. For that reason on the ovirt system tests we removed the epel/centos base repos from the reposync (it was ~20G) but as that already makes the tests require an internet connection, makes the reposync command obsolete (it is caching only some part of the packages). So the idea is to drop the reposync command until we have a better alternative (maybe a small local proxy that caches everything on the first run or something similar) -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

3 2

[04-03-2016] Weekly lago release - 0.11.0
by David Caro 04 Mar '16

04 Mar '16

Hello everyone! Mostly maintenance week this one, almost duplicated the number of tests, and removed more than 2000 lines of unused stuff. But still a couple features got in: * new --prefix-path option, that will allow you to override the automatic search for a prefix, and allow you to run a lago command for a prefix from anywhere * Added YAML support for the init configuration files, now it's a bit more easy to write the init files (you can even reuse blocks of yaml with yaml anchors! https://en.wikipedia.org/wiki/YAML#Repeated_nodes) * Added a new 'destroy' command, that will run any stop/cleanup in the prefix and finally rm -rf it For the full changelog go: http://resources.ovirt.org/repos/lago/stable/0.0/CHANGELOG_0.0.txt You can get the new rpms from: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Was the check for 'lago' group membership removed?
by Yaniv Kaul 02 Mar '16

02 Mar '16

I uninstalled and reinstalled lago, which made the lago group disappear and reapper - and my user was not part of it. Then running the tests failed, as I could not write the lock file to /var/lib/lago/... Added a bit of code to the exception to see why: File "/usr/lib/python2.7/site-packages/lockfile/linklockfile.py", line 20, in acquire raise LockFailed("Failed to create %s.\nCode: %d\nReason: %s\n" % (self.unique_name, e.errno, e.strerror)) LockFailed: Failed to create /var/lib/lago/store/ykaul-mini.tlv.redhat.com-fa517700.1377-7176078113883238881. Code: 13 Reason: Permission denied And indeed, it was because I was not part of the lago group. Adding, logging out and in again solved it - but shouldn't there be such warning ? (I remember there was in the past). TIA, Y.

2 1

'make check' fails due to yaml
by Yaniv Kaul 01 Mar '16

01 Mar '16

After today's (?) changes: tests/unit/test_config.py::test_nonexistent_throws PASSED ===================================================================================================== ERRORS ====================================================================================================== ___________________________________________________________________________________ ERROR collecting tests/unit/test_dirlock.py ___________________________________________________________________________________ tests/unit/test_dirlock.py:27: in <module> from lago import dirlock lago/dirlock.py:25: in <module> import utils lago/utils.py:36: in <module> import yaml E ImportError: No module named yaml _________________________________________________________________________________ ERROR collecting tests/unit/lago/test_prefix.py _________________________________________________________________________________ tests/unit/lago/test_prefix.py:6: in <module> from lago import prefix lago/prefix.py:36: in <module> import subnet_lease lago/subnet_lease.py:45: in <module> import utils lago/utils.py:36: in <module> import yaml E ImportError: No module named yaml _________________________________________________________________________________ ERROR collecting tests/unit/lago/test_utils.py __________________________________________________________________________________ tests/unit/lago/test_utils.py:2: in <module> import yaml E ImportError: No module named yaml ======================================================================================== 7 passed, 3 error in 0.08 seconds ======================================================================================== Makefile:52: recipe for target 'check-local' failed make: *** [check-local] Error 1 I'm on: commit 5178f92f435791a778d4fbd801baab532819e7b0 Merge: 5deacae 79bb6ca Author: Lago CI bot <dcaroest+cibot(a)redhat.com> Date: Tue Mar 1 16:38:23 2016 +0100 Merge pull request #151 from lago-project/yaml_init_definition Added yaml support for the init config file

3 3

[29-02-2016] Weekly meeting minutes
by David Caro 29 Feb '16

29 Feb '16

Discussions (continued): ======================== * oVirt sdk version * On oVirt 4.0 two versions of the sdk will be supported, 3 and 4, api version 3 is provided by the ovirt-sdk-3.6 rpms, while the 4 is provided by the 4.0 ones (not ready yet), so we will be using the 3.6 until 4.0 ones are ready, when we will start to adapt to it with oVirt 5.0 as deadline * Change from json to yaml * Maybe support both at first * Nicer multiline * Comments * Nicer quoting **Approved** * Userland runs (running lago without special permissions, qemu:///session) * Network is an issue * http://blog.wikichoon.com/2016/01/qemusystem-vs-qemusession.html * https://github.com/pradels/vagrant-libvirt/issues/272 * http://comments.gmane.org/gmane.comp.emulators.libvirt/117725 * ^ have to chat with the libvirt guys on how to use that * You have to create the bridge nets with superuser privs, and then use the bridges from the conf: * A dump of the domain xml shows: <interface type='bridge'> <mac address='52:54:00:91:98:c6'/> <source bridge='virbr0'/> <target dev='tap0'/> <model type='virtio'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </interface> * There’s a default bridge (virbr0) always created and available on fedora boxes (by ways of /etc/qemu/bridge.conf), is what gnome-boxes uses * Might be nice to have, even requesting root pass to create bridges when needed * Multiple ‘envs’ in the same prefix workflows, now that .lago is the default prefix path (see * Should we use multiple envs per prefix? or one prefix per env? * Allow selecting the environment, and the prefix dir **Approved** * layered images for vms (will probably have to develop ourselves, at least, the client side) * Make it work on el7 too (maybe just open/push bzs to bring in the needed libguestfs features * Export/import of vm images from prefix? On the long run, being able to export/import full prefixes? * Very interesting to have * Ovirt: * ovirt-standard-ci plugin to build vdsm/ovirt rpms * Being able to run/deploy live vdsm/ovirt (unpackaged) * Drop reposync for now * Run engine in a container/chroot + vdsm in a vm? * Action items: * Start a thread to discuss the reposync drop * Open github issues for all the agreed features * Change the ovirt 4.0 publisher to publish the 3.6 sdk (until 4.0 is ready, then publish both on 4.0 repo) -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

3.6 suddenly fails
by Yaniv Kaul 28 Feb '16

28 Feb '16

Any idea what could be the problem here: @ Deploy oVirt environment: # [Thread-2] Deploy VM lago_basic_suite_3_6_host1: # [Thread-3] Deploy VM lago_basic_suite_3_6_engine: # [Thread-4] Deploy VM lago_basic_suite_3_6_storage-iscsi: # [Thread-5] Deploy VM lago_basic_suite_3_6_storage-nfs: * [Thread-2] Wait for ssh connectivity: # [Thread-6] Deploy VM lago_basic_suite_3_6_host0: * [Thread-3] Wait for ssh connectivity: * [Thread-4] Wait for ssh connectivity: * [Thread-5] Wait for ssh connectivity: * [Thread-6] Wait for ssh connectivity: * [Thread-5] Wait for ssh connectivity: Success (in 0:01:15) * [Thread-5] Run script setup_storage_nfs.sh: * [Thread-4] Wait for ssh connectivity: Success (in 0:01:17) * [Thread-4] Run script setup_storage_iscsi.sh: * [Thread-5] Run script setup_storage_nfs.sh: Success (in 0:00:09) * STDERR mke2fs 1.42.8 (20-Jun-2013) mount: wrong fs type, bad option, bad superblock on /dev/vdc1, missing codepage or helper program, or other error In some cases useful info is found in syslog - try dmesg | tail or so. # [Thread-5] Deploy VM lago_basic_suite_3_6_storage-nfs: ERROR (in 0:01:25) Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 45, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/ovirtlago/__init__.py", line 469, in _deploy_host host.name(), RuntimeError: /home/mini/ovirt-system-tests/basic_suite_3.6/deploy-scripts/setup_storage_nfs.sh failed with status 64 on lago_basic_suite_3_6_storage-nfs

2 2

[26-02-2016] Weekly lago release - 0.10.0
by David Caro 26 Feb '16

26 Feb '16

Hi everyone! This week we have a couple of very interesting new features: * Using .lago as default prefix for init, that means that if you run init with just the json configuration file, it will create the prefix at $PWD/.lago, but, if you did so, then any command that you run on any dir that's under the $PWD dir that has the .lago prefix, will be run on that prefix! For example: > cd /my/awesome/project > lago init myenv.json # this create the prefix at /my/awesome/project/.lago > cd src/mymodule > lago status # this will run on the /my/awesome/project/.lago prefix automatically! > lago start > lago shell myel7_vm ... * Ouptut format for info gathering commands, for now, just the status and snapshot -l commands. Now you can add the --out-format|-f parameter to lago, and when running a command to extract info from the prefix, it will format the ouptut (yaml, json and 'default' are implemented for now). For example: > lago -f json status { "Prefix": { "Base directory": ..., "Networks": { "n0": { "gateway": "192.168.201.1", "management": true, "status": "down" }, ... }, "UUID": "fe689d3c39d011e5b22b54ee755a00ca", "VMs": { "vm0": { "NICs": { ... }, "VNC port": null, "distro": "cirros", "metadata": {}, "root password": "123456", "snapshots": "", "status": "down" } } } } * Added the public template server as the default template repo, so you don't have to supply it each time * Using 'direct' as default libguestfs backend, that should get rid of the annoying errors when bootstrapping the domains on prefix initialization. The full changelog: http://resources.ovirt.org/repos/lago/stable/0.0/CHANGELOG_0.0.txt -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 1

Fwd: [19-02-2016] Weekly lago release - 0.9.0
by David Caro 26 Feb '16

26 Feb '16

Hi everyone! This week we have a couple of very interesting new features: * Using .lago as default prefix for init, that means that if you run init with just the json configuration file, it will create the prefix at $PWD/.lago, but, if you did so, then any command that you run on any dir that's under the $PWD dir that has the .lago prefix, will be run on that prefix! For example: > cd /my/awesome/project > lago init myenv.json # this create the prefix at /my/awesome/project/.lago > cd src/mymodule > lago status # this will run on the /my/awesome/project/.lago prefix automatically! > lago start > lago shell myel7_vm ... * Ouptut format for info gathering commands, for now, just the status and snapshot -l commands. Now you can add the --out-format|-f parameter to lago, and when running a command to extract info from the prefix, it will format the ouptut (yaml, json and 'default' are implemented for now). For example: > lago -f json status { "Prefix": { "Base directory": ..., "Networks": { "n0": { "gateway": "192.168.201.1", "management": true, "status": "down" }, ... }, "UUID": "fe689d3c39d011e5b22b54ee755a00ca", "VMs": { "vm0": { "NICs": { ... }, "VNC port": null, "distro": "cirros", "metadata": {}, "root password": "123456", "snapshots": "", "status": "down" } } } } * Added the public template server as the default template repo, so you don't have to supply it each time * Using 'direct' as default libguestfs backend, that should get rid of the annoying errors when bootstrapping the domains on prefix initialization. The full changelog: http://resources.ovirt.org/repos/lago/stable/0.0/CHANGELOG_0.0.txt -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 1

Testing oVirt 4.0 with Lago - which SDK should we use?
by Yaniv Kaul 22 Feb '16

22 Feb '16

Currently, the SDK that Lago uses is (at least on my Fedora): ovirt-engine-sdk-python-3.5.1.0-2.fc23.noarch I think we may need to bring in a newer SDK. 1. Which one? 2. If master - is it backward compatible to run against 3.x already? 3. Can we have them side by side perhaps? TIA, Y.

3 3

[ovirt-system-tests] What is the correct value of the engine's answer file entry OVESETUP_CONFIG/fqdn ?
by Yaniv Kaul 22 Feb '16

22 Feb '16

[ykaul@ykaul answer-files]$ pwd /home/ykaul/ovirt-system-tests/common/answer-files [ykaul@ykaul answer-files]$ grep -R "OVESETUP_CONFIG/fqdn" * |sort el6_3.5.conf:OVESETUP_CONFIG/fqdn=str:engine el6_3.6.conf:OVESETUP_CONFIG/fqdn=str:*localhost.localdomain* el6_master.conf:OVESETUP_CONFIG/fqdn=str:engine el7_3.5.conf:OVESETUP_CONFIG/fqdn=str:engine el7_master.conf:OVESETUP_CONFIG/fqdn=str:engine Is the value localhost.localdomain correct for el6-3.6 (only?). TIA, Y.

2 2

[19-02-2016] Weekly lago release - 0.9.0
by David Caro 19 Feb '16

19 Feb '16

Hi everyone! This week release is small, and has not big changes, but a big bump was done on adding some functional tests and starting to move toward py.test for unit tests, the relevant changes: dcaf87c6: Moving to py.test 840d3956: Fix start a bridged network that's already alive a20cff51: Avoiding ssh connection for hosts that have no ovirt-scripts gned bbcebcd0: Adding support for ovirt node specific VM's You can get it fresh from: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ The full changelog: http://resources.ovirt.org/repos/lago/stable/0.0/CHANGELOG_0.0.txt Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

[05-02-2016] Weekly lago release - 0.8.0
by David Caro 05 Feb '16

05 Feb '16

Hi everyone! This week release has a critical bug fix and a new subcommand, the relevant changes: ee68f156: Added console cli command 54e02ff8: Adding use of backing mode for qcow2 files 6b174850: Moving from sftp to scp for copy to/from vms 24f83bf8: Fixed issue with copy-from-vm You can get it fresh from: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ The full changelog: http://resources.ovirt.org/repos/lago/stable/0.0/CHANGELOG_0.0.txt Some other news: * We did a presentation at FOSDEM! The videos are not yet ready, but you can get the slides here: http://redhat.slides.com/dcaroest/raiders_of_the_lost_testing_env * There's a new image repo with bare images being tested here: http://templates.ovirt.org/repo/unstable/ To use it just pass http://templates.ovirt.org/repo/unstable/repo.metadata as the --templates-repo-path option when running lago (take into account that you'll have to change the template names in the init.json you use too) Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Re: [lago-devel] Fwd: test failed, Failed to connect to the engine
by Yaniv Kaul 02 Feb '16

02 Feb '16

On Thu, Jan 28, 2016 at 3:01 PM, Yaniv Kaul <ykaul(a)redhat.com> wrote: > > > On Thu, Jan 28, 2016 at 2:56 PM, Maor Lipchuk <mlipchuk(a)redhat.com> wrote: > >> >> >> >> >> ----- Original Message ----- >> > From: "Yaniv Kaul" <ykaul(a)redhat.com> >> > To: "Maor Lipchuk" <mlipchuk(a)redhat.com> >> > Cc: lago-devel(a)ovirt.org >> > Sent: Thursday, January 28, 2016 12:59:38 PM >> > Subject: Re: [lago-devel] Fwd: test failed, Failed to connect to the >> engine >> > >> > On Thu, Jan 28, 2016 at 12:30 PM, Maor Lipchuk <mlipchuk(a)redhat.com> >> wrote: >> > >> > > Hi all, >> > > >> > > I've been trying to use the LAGO setup, all worked well up to the >> point >> > > which I got an error on one of the tests : >> > > >> > > Run test: 002_bootstrap.py: ERROR >> > > Error occured, aborting >> > > .... >> > > ... line 82, in do_ovirt_runtest >> > > raise RuntimeError('Some tests failed') >> > > RuntimeError: Some tests failed >> > > >> > > Looking in the nosetests it looks like it failed to connect to the >> engine: >> > > >> > > File "usr/lib/python2.7/site-packaged/pvortlago/virt.py", line 106, >> in >> > > _get_api >> > > raise RuntimeError('Failed to connect to the engine') >> > > >> > >> > Can you check if the engine is up? In my case, it was not installed, as >> the >> > answer file was incorrect. >> > See https://bugzilla.redhat.com/show_bug.cgi?id=1302045 for details and >> > solution. >> > Y. >> >> I don't see that ovirt-engine is installed on my env, but I do see that >> the ovirt-release36-002-2 is installed. >> I was trying to set the boolean to false as was mentioned in the bug to >> see if that make any difference but still didn't had much luck. >> > > Need to look at the engine's setup log, then. > I prepared a patch to the installation test that: 1. Verifies the installation succeeded (based on error code from the installation) 2. Verifies the ovirt-engine service is up. Only if both succeed, the test passes. I've cloned the specific bug above to a general bug @ https://bugzilla.redhat.com/show_bug.cgi?id=1303973 Y. > Y. > > >> >> > >> > > >> > > tests="6" error="1" >> > > >> > > Is it only a test issue or is there something wrong with my engine? >> > > >> > > Regards, >> > > Maor >> > > >> > > >> > > _______________________________________________ >> > > lago-devel mailing list >> > > lago-devel(a)ovirt.org >> > > http://lists.ovirt.org/mailman/listinfo/lago-devel >> > > >> > >> > >

1 0

Lago mailing list archives
by David Caro 02 Feb '16

02 Feb '16

Hi everyone!! Last week we realized that the archives for the mailing list were not working, and that has been solved today. Painfully all the emails that were sent before were not actually archived so they have been lost in the archives, but from now on they will be properly archived and backed up. Sorry for the inconvenience :/ -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

TEST-thisisatestemail@akhos.redhat.com, pleaseignore@akhos.redhat.com
by David Caro 02 Feb '16

02 Feb '16

Dummy test email -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0