- lago-devel - oVirt List Archives

Lago check patch is failing when running on my laptop
by Gal Ben Haim 15 Sep '16

15 Sep '16

Hi All, When running check-patch on my laptop and mini-dell (rhel 7.1 and mock fc-24 on both), the tests fails on ssh timeout. I'm running the tests on the latest commit on master (hash 27856ea). I tried to run the tests on hash: 531bd75 (0.24 stable release) and it went well. It's strange because I don't see those failures on jenkins. test log: http://pastebin.test.redhat.com/410685 Does anyone else experiencing this problem ? Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

3 5

New Lago release - 0.24
by Nadav Goldin 07 Sep '16

07 Sep '16

Hey, Lago 0.24 is out, introducing 2 new features: initial DNS + IPv6 support, and a new flat output formatter for the CLI. Here is the full change log: * Sun Sep 04 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.24.0 531bd754: Merge pull request #303 from lago-project/refactor_engine_api_request 41a15764: Removed redundant checks when getting ovirt api * Sun Sep 04 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.23.4 b17a5c29: Merge pull request #304 from mykaul/DNS 783aae26: Add DNS and IPv6 support * Thu Sep 01 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.23.3 ee7b814f: Merge pull request #301 from lago-project/flat_output_plugin 1f6fc70f: Added flat output formatter * Mon Aug 22 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.23.2 ed6371fa: Merge pull request #294 from sandrobonazzola/master ca3c023b: reposetup: be more verbose on reposync failure 13e921eb: Merge branch 'master' into master * Tue Aug 16 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.23.1 030f6e76: Merge pull request #279 from mpolednik/libvirt-auth ed219883: libvirt: add auth Repo - http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Docs - http://lago.readthedocs.io/en/0.24/Env_Setup.html Enjoy!

1 0

lago_master_check-patch-fc23-x86_64 #224 Console [Jenkins]
by Yaniv Kaul 06 Sep '16

06 Sep '16

New breakage (that I hope) has nothing to do with my patch: Error: nothing provides repoman >= 2.0.12 needed by python-lago-ovirt-0.24.1-1.fc23.noarch Anyone? http://jenkins.ovirt.org/job/lago_master_check-patch-fc23-x86_64/224/console

4 4

Any ideas for root cause of this failure?
by Yaniv Kaul 25 Aug '16

25 Aug '16

Running Lago/ovirt-system-tests on F24: # [Thread-1] Bootstrapping lago_basic_suite_3_6_engine: # [Thread-2] Bootstrapping lago_basic_suite_3_6_host1: # [Thread-3] Bootstrapping lago_basic_suite_3_6_host0: # [Thread-4] Bootstrapping lago_basic_suite_3_6_storage: # [Thread-1] Bootstrapping lago_basic_suite_3_6_engine: ERROR (in 0:00:04) Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 53, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in <lambda> utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 265, in bootstrap return self.provider.bootstrap(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/vm.py", line 128, in bootstrap if 'ip' in nic File "/usr/lib/python2.7/site-packages/lago/sysprep.py", line 134, in sysprep ret.err, RuntimeError: Failed to bootstrap $LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_engine_root.qcow2 command:"virt-sysprep" "-a" "$LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_engine_root.qcow2" "--selinux-relabel" "--hostname" "lago_basic_suite_3_6_engine" "--root-password" "password:123456" "--mkdir" "/root/.ssh" "--chmod" "0700:/root/.ssh" "--upload" "/home/omer/ovirt-system-tests/deployment-basic_suite_3.6/default/id_rsa.pub:/root/.ssh/authorized_keys" "--run-command" "chown root.root /root/.ssh/authorized_keys" "--mkdir" "/etc/iscsi" "--chmod" "0755:/etc/iscsi" "--write" "/etc/iscsi/initiatorname.iscsi:InitiatorName=iqn.2014-07.org.lago:lago_basic_suite_3_6_engine" "--mkdir" "/etc/selinux" "--chmod" "0755:/etc/selinux" "--write" "/etc/selinux/config:SELINUX=enforcing SELINUXTYPE=targeted " "--mkdir" "/etc/sysconfig/network-scripts" "--chmod" "0755:/etc/sysconfig/network-scripts" "--write" "/etc/sysconfig/network-scripts/ifcfg-eth0:HWADDR="54:52:c0:a8:c8:02" BOOTPROTO="dhcp" TYPE="Ethernet" ONBOOT="yes" NAME="eth0"" stdout:[ 0.0] Examining the guest ... stderr:virt-sysprep: error: libguestfs error: guestfs_launch failed. This usually means the libguestfs appliance failed to start or crashed. Do: export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1 and run the command again. For further information, read: http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs You can also run 'libguestfs-test-tool' and post the *complete* output into a bug report or message to the libguestfs mailing list. If reporting bugs, run virt-sysprep with debugging enabled and include the complete output: virt-sysprep -v -x [...] # [Thread-4] Bootstrapping lago_basic_suite_3_6_storage: ERROR (in 0:00:04) Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 53, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in <lambda> utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 265, in bootstrap return self.provider.bootstrap(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/vm.py", line 128, in bootstrap if 'ip' in nic File "/usr/lib/python2.7/site-packages/lago/sysprep.py", line 134, in sysprep ret.err, RuntimeError: Failed to bootstrap $LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_storage_root.qcow2 command:"virt-sysprep" "-a" "$LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_storage_root.qcow2" "--selinux-relabel" "--hostname" "lago_basic_suite_3_6_storage" "--root-password" "password:123456" "--mkdir" "/root/.ssh" "--chmod" "0700:/root/.ssh" "--upload" "/home/omer/ovirt-system-tests/deployment-basic_suite_3.6/default/id_rsa.pub:/root/.ssh/authorized_keys" "--run-command" "chown root.root /root/.ssh/authorized_keys" "--mkdir" "/etc/iscsi" "--chmod" "0755:/etc/iscsi" "--write" "/etc/iscsi/initiatorname.iscsi:InitiatorName=iqn.2014-07.org.lago:lago_basic_suite_3_6_storage" "--mkdir" "/etc/selinux" "--chmod" "0755:/etc/selinux" "--write" "/etc/selinux/config:SELINUX=enforcing SELINUXTYPE=targeted " "--mkdir" "/etc/sysconfig/network-scripts" "--chmod" "0755:/etc/sysconfig/network-scripts" "--write" "/etc/sysconfig/network-scripts/ifcfg-eth0:HWADDR="54:52:c0:a8:c8:05" BOOTPROTO="dhcp" TYPE="Ethernet" ONBOOT="yes" NAME="eth0"" stdout:[ 0.0] Examining the guest ... stderr:virt-sysprep: error: libguestfs error: guestfs_launch failed. This usually means the libguestfs appliance failed to start or crashed. Do: export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1 and run the command again. For further information, read: http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs You can also run 'libguestfs-test-tool' and post the *complete* output into a bug report or message to the libguestfs mailing list. If reporting bugs, run virt-sysprep with debugging enabled and include the complete output: virt-sysprep -v -x [...] # [Thread-2] Bootstrapping lago_basic_suite_3_6_host1: ERROR (in 0:00:04) # [Thread-3] Bootstrapping lago_basic_suite_3_6_host0: ERROR (in 0:00:04) Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 53, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in <lambda> utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 265, in bootstrap return self.provider.bootstrap(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/vm.py", line 128, in bootstrap if 'ip' in nic File "/usr/lib/python2.7/site-packages/lago/sysprep.py", line 134, in sysprep ret.err, RuntimeError: Failed to bootstrap $LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_host1_root.qcow2 command:"virt-sysprep" "-a" "$LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_host1_root.qcow2" "--selinux-relabel" "--hostname" "lago_basic_suite_3_6_host1" "--root-password" "password:123456" "--mkdir" "/root/.ssh" "--chmod" "0700:/root/.ssh" "--upload" "/home/omer/ovirt-system-tests/deployment-basic_suite_3.6/default/id_rsa.pub:/root/.ssh/authorized_keys" "--run-command" "chown root.root /root/.ssh/authorized_keys" "--mkdir" "/etc/iscsi" "--chmod" "0755:/etc/iscsi" "--write" "/etc/iscsi/initiatorname.iscsi:InitiatorName=iqn.2014-07.org.lago:lago_basic_suite_3_6_host1" "--mkdir" "/etc/selinux" "--chmod" "0755:/etc/selinux" "--write" "/etc/selinux/config:SELINUX=enforcing SELINUXTYPE=targeted " "--mkdir" "/etc/sysconfig/network-scripts" "--chmod" "0755:/etc/sysconfig/network-scripts" "--write" "/etc/sysconfig/network-scripts/ifcfg-eth0:HWADDR="54:52:c0:a8:c8:03" BOOTPROTO="dhcp" TYPE="Ethernet" ONBOOT="yes" NAME="eth0"" stdout:[ 0.0] Examining the guest ... stderr:virt-sysprep: error: libguestfs error: guestfs_launch failed. This usually means the libguestfs appliance failed to start or crashed. Do: export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1 and run the command again. For further information, read: http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs You can also run 'libguestfs-test-tool' and post the *complete* output into a bug report or message to the libguestfs mailing list. If reporting bugs, run virt-sysprep with debugging enabled and include the complete output: virt-sysprep -v -x [...] Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 53, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in <lambda> utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 265, in bootstrap return self.provider.bootstrap(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/vm.py", line 128, in bootstrap if 'ip' in nic File "/usr/lib/python2.7/site-packages/lago/sysprep.py", line 134, in sysprep ret.err, RuntimeError: Failed to bootstrap $LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_host0_root.qcow2 command:"virt-sysprep" "-a" "$LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_host0_root.qcow2" "--selinux-relabel" "--hostname" "lago_basic_suite_3_6_host0" "--root-password" "password:123456" "--mkdir" "/root/.ssh" "--chmod" "0700:/root/.ssh" "--upload" "/home/omer/ovirt-system-tests/deployment-basic_suite_3.6/default/id_rsa.pub:/root/.ssh/authorized_keys" "--run-command" "chown root.root /root/.ssh/authorized_keys" "--mkdir" "/etc/iscsi" "--chmod" "0755:/etc/iscsi" "--write" "/etc/iscsi/initiatorname.iscsi:InitiatorName=iqn.2014-07.org.lago:lago_basic_suite_3_6_host0" "--mkdir" "/etc/selinux" "--chmod" "0755:/etc/selinux" "--write" "/etc/selinux/config:SELINUX=enforcing SELINUXTYPE=targeted " "--mkdir" "/etc/sysconfig/network-scripts" "--chmod" "0755:/etc/sysconfig/network-scripts" "--write" "/etc/sysconfig/network-scripts/ifcfg-eth0:HWADDR="54:52:c0:a8:c8:04" BOOTPROTO="dhcp" TYPE="Ethernet" ONBOOT="yes" NAME="eth0"" stdout:[ 0.0] Examining the guest ... stderr:virt-sysprep: error: libguestfs error: guestfs_launch failed. This usually means the libguestfs appliance failed to start or crashed. Do: export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1 and run the command again. For further information, read: http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs You can also run 'libguestfs-test-tool' and post the *complete* output into a bug report or message to the libguestfs mailing list. If reporting bugs, run virt-sysprep with debugging enabled and include the complete output: virt-sysprep -v -x [...] @ Initialize and populate prefix: ERROR (in 0:00:08) Error occured, aborting Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 691, in main cli_plugins[args.verb].do_run(args) File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run self._do_run(**vars(args)) File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 615, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 181, in do_init do_bootstrap=not skip_bootstrap, File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 816, in virt_conf_from_stream do_bootstrap=do_bootstrap, File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 943, in virt_conf self.virt_env.bootstrap() File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in bootstrap utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/utils.py", line 95, in invoke_in_parallel vt.join_all() File "/usr/lib/python2.7/site-packages/lago/utils.py", line 53, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/lago/virt.py", line 156, in <lambda> utils.invoke_in_parallel(lambda vm: vm.bootstrap(), self._vms.values()) File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 265, in bootstrap return self.provider.bootstrap(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/vm.py", line 128, in bootstrap if 'ip' in nic File "/usr/lib/python2.7/site-packages/lago/sysprep.py", line 134, in sysprep ret.err, RuntimeError: Failed to bootstrap $LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_engine_root.qcow2 command:"virt-sysprep" "-a" "$LAGO_PREFIX_PATH/images/lago_basic_suite_3_6_engine_root.qcow2" "--selinux-relabel" "--hostname" "lago_basic_suite_3_6_engine" "--root-password" "password:123456" "--mkdir" "/root/.ssh" "--chmod" "0700:/root/.ssh" "--upload" "/home/omer/ovirt-system-tests/deployment-basic_suite_3.6/default/id_rsa.pub:/root/.ssh/authorized_keys" "--run-command" "chown root.root /root/.ssh/authorized_keys" "--mkdir" "/etc/iscsi" "--chmod" "0755:/etc/iscsi" "--write" "/etc/iscsi/initiatorname.iscsi:InitiatorName=iqn.2014-07.org.lago:lago_basic_suite_3_6_engine" "--mkdir" "/etc/selinux" "--chmod" "0755:/etc/selinux" "--write" "/etc/selinux/config:SELINUX=enforcing SELINUXTYPE=targeted " "--mkdir" "/etc/sysconfig/network-scripts" "--chmod" "0755:/etc/sysconfig/network-scripts" "--write" "/etc/sysconfig/network-scripts/ifcfg-eth0:HWADDR="54:52:c0:a8:c8:02" BOOTPROTO="dhcp" TYPE="Ethernet" ONBOOT="yes" NAME="eth0"" stdout:[ 0.0] Examining the guest ... stderr:virt-sysprep: error: libguestfs error: guestfs_launch failed. This usually means the libguestfs appliance failed to start or crashed. Do: export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1 and run the command again. For further information, read: http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs You can also run 'libguestfs-test-tool' and post the *complete* output into a bug report or message to the libguestfs mailing list. If reporting bugs, run virt-sysprep with debugging enabled and include the complete output: virt-sysprep -v -x [...] lago-error.txt Open with Google Docs Displaying lago-error.txt.

2 2

New Lago Template For Fedora 24
by Gal Ben Haim 31 Jul '16

31 Jul '16

Hi All, New Lago template for Fedora 24 is now available on: http://templates.ovirt.org/repo/repo.metadata (the default template repo for lago) You can use it by specifying 'fc24-base' with 'template_name' key. Cheers, Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

1 0

New Lago release - 0.23.0
by Gal Ben Haim 25 Jul '16

25 Jul '16

Hi Everyone! There's a new Lago release with version 0.23.0 ready for you to upgrade! Lago is now officially supported on fedora 24. Docs - http://lago.readthedocs.io/en/0.23/index.html Repo - http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Here are the changes: * Mon Jul 18 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.23.0 14d884c0: Merge pull request #290 from mykaul/get_sanlock_logs f5177dd3: Added /var/log/sanlock.log to the log collection from hosts 904721c0: Merge branch 'master' into get_sanlock_logs * Mon Jul 18 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.5 417328cf: Merge pull request #285 from mkopta/systemctl 4ca2deaf: all "supported" OS use systemctl instead of service * Sun Jul 17 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.4 722fa248: Merge pull request #286 from mkopta/these 3b7555e7: s/this/these/ * Thu Jul 14 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.3 6a0089e8: Merge pull request #288 from lago-project/fix_fc24_build 17c943c2: ci:Replaced fc22 package files with fc24 * Tue Jun 21 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.2 cf146a52: Merge pull request #284 from mkopta/master 9af5ab8a: typos * Tue Jun 21 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.1 7678342e: Merge pull request #283 from mkopta/master 43a3ee3b: denoting root priviliges requirement 36982c69: typo Enjoy! Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

1 0

Connection timeout initializing environment
by Eric Helms 11 Jul '16

11 Jul '16

I am getting the following error with 0.22 trying to initialize my environment: @ Initialize and populate prefix: ERROR (in 0:02:07) Error occured, aborting Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 691, in main cli_plugins[args.verb].do_run(args) File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run self._do_run(**vars(args)) File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 615, in wrapper return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 154, in do_init template_repo_path File "/usr/lib/python2.7/site-packages/lago/templates.py", line 347, in from_url response = urllib.urlopen(path) File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen return opener.open(url) File "/usr/lib64/python2.7/urllib.py", line 208, in open return getattr(self, name)(url) File "/usr/lib64/python2.7/urllib.py", line 345, in open_http h.endheaders(data) File "/usr/lib64/python2.7/httplib.py", line 975, in endheaders self._send_output(message_body) File "/usr/lib64/python2.7/httplib.py", line 835, in _send_output self.send(msg) File "/usr/lib64/python2.7/httplib.py", line 797, in send self.connect() File "/usr/lib64/python2.7/httplib.py", line 778, in connect self.timeout, self.source_address) File "/usr/lib64/python2.7/socket.py", line 571, in create_connection raise err IOError: [Errno socket error] [Errno 110] Connection timed out Eric

2 3

Weekly bug status for ovirt-system-tests (using Lago) [ 11/07/16 ]
by Eyal Edri 11 Jul '16

11 Jul '16

*Open bugs:* https://goo.gl/eUaPUY *Open issues:* HE 4.0 support - patch under review - https://gerrit.ovirt.org/#/c/59717/ Initial documentation in progress - https://gerrit.ovirt.org/#/c/59870/ *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open *Jenkins jobs:* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ * Jobs were failing on add host, most failures were due to missing support on new F24 slaves, fixed. * There was an issue with using 3.6 ovirt stable repo in some tests, seems it was leftover from early days, replacing repo with 3.6 nighties as we do in 4.0 and master solved it. * 4 more slaves added to run tests, running F24 * We hit a libvirt bug [1] that forced us to manually enable the service for now. [1] https://bugzilla.redhat.com/show_bug.cgi?id=1290357 *Recently merged patches:* https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:merged+since… -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

ovirt tests failing on missing libxml2-python
by Eyal Edri 04 Jul '16

04 Jul '16

2016-06-24 17:28:17,843 DEBUG [org.ovirt.otopi.dialog.MachineDialogParser] (VdsDeploy) [796140d9] Got: ***L:ERROR Failed to execute stage 'Package installation': [u'libxml2-python-2.9.1-6.el7_2.3.x86_64 requires libxml2 = 2.9.1-6.el7_2.3'] 2016-06-24 17:28:17,844 DEBUG [org.ovirt.otopi.dialog.MachineDialogParser] (VdsDeploy) [796140d9] nextEvent: Log ERROR Failed to execute stage 'Package installation': [u'libxml2-python-2.9.1-6.el7_2.3.x86_64 requires libxml2 = 2.9.1-6.el7_2.3'] 2016-06-24 17:28:17,860 ERROR This is failing 3.6,4.0 and master tests, anyone knows on a recent dependency change in vdsm or other host level pkg? -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

4 9

Weekly bug status for ovirt-system-tests (using Lago) [ 27/06/16 ]
by Eyal Edri 27 Jun '16

27 Jun '16

*Open bugs:* https://goo.gl/eUaPUY *Fixed/Closed bugs:* Bug 1298646 <https://bugzilla.redhat.com/show_bug.cgi?id=1298646> [Lago] - hosted engine setup causes kernel panic Bug 1280361 <https://bugzilla.redhat.com/show_bug.cgi?id=1280361> Create the jenkins jobs to check the ovirt-system-tests patches Bug 1282691 <https://bugzilla.redhat.com/show_bug.cgi?id=1282691> Make the ovirt lago tests run for master code *Open issues:* - add Lago & test logs to check-patch job (bug opened) - add install cockpit-ovirt-dashboard to 4.0/master (now its taking in 500 pkg) - move master and 4.0 tests to use API V4 (bug opened) - hosted engine 4.0 tests are in progress *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open *Jenkins jobs:* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ *Recently merged patches:* https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:merged+since… *A lot of new stuff went in during last week! here are some of the highlights:* 1. New per patch 'check-patch' job added, now jenkins will automatically verify your patches to ovirt-system-tests 2. New 'install cockpit-ovirt-dashboard' test added to 3.6 3. New 'remove default DC & cluster' test added 4. New 'add VM from Glance template' test added 5. New basic 'network add' tests added 6. Compatibility version updated to 4.0 & 4.1 to 4.0 & master respectively Keep those tests coming... -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

Latest ovirt-system-tests doesn't perform reposync?
by Yaniv Kaul 22 Jun '16

22 Jun '16

I'm still running on Lago 0.18 (can't upgrade due to F24 bug deps with repoman), and when I switched to the latest ovirt-system-tests, something's not sync'ing the repos correctly: Good run (from the old ovirt-system-tests): 2016-06-22 14:52:53,770::log_utils.py::__exit__::593::ovirtlago::INFO:: * Running reposync: ESC[32mSuccessESC[0m (in 0:00:06) 2016-06-22 14:52:53,770::log_utils.py::__exit__::593::ovirtlago::INFO:: # Syncing remote repos locally (this might take some time): ESC[32mSuccessESC[0m (in 0:00:06) 2016-06-22 14:52:53,771::log_utils.py::__enter__::586::ovirtlago.merge_repos::INFO:: # [Thread-1] Processing directory /var/lib/lago/reposync/ovirt-master-snapshot-el7: ESC[0mESC[0m 2016-06-22 14:52:53,771::log_utils.py::__enter__::586::lago.utils::DEBUG::start task Run command: "find" "/var/lib/lago/reposync/ovirt-master-snapshot-el7" "-type" "f" "-size" "+0" "-name" "*.rpm" 2016-06-22 14:52:53,775::utils.py::_run_command::178::lago.utils::DEBUG::command exit with 0 ... Bad run (from the latest ovirt-system-tests): 2016-06-22 15:17:19,728::log_utils.py::__exit__::593::ovirtlago::INFO:: * Running reposync: ESC[32mSuccessESC[0m (in 0:00:09) 2016-06-22 15:17:19,728::log_utils.py::__exit__::593::ovirtlago::INFO:: # Syncing remote repos locally (this might take some time): ESC[32mSuccessESC[0m (in 0:00:09) 2016-06-22 15:17:19,728::log_utils.py::__enter__::586::lago.virt::INFO:: # Save prefix: ESC[0mESC[0m Any ideas? TIA, Y.

1 1

Weekly bug status for ovirt-system-tests (using Lago) [ 20/06/16 ]
by Eyal Edri 20 Jun '16

20 Jun '16

*Open bugs:* https://goo.gl/eUaPUY *Open issues:* Work is being done to allow running OST locally per patch and on CI per merge.. more news to come soon *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open *Jenkins jobs:* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ * ALL jobs are stable without know issues ( except master, see below ) * master tests are failing currently, sent email with details to ovirt-devel list. *Recently merged patches:* https://gerrit.ovirt.org/#/c/58575/ -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

[17-06-2016] New lago release - 0.22.0
by Gal Ben Haim 17 Jun '16

17 Jun '16

Hi everyone! There's a new lago release with version 0.22.0 ready for you to upgrade! Docs - http://lago.readthedocs.io/en/0.22/Env_Setup.html Repo - http://resources.ovirt.org/repos/lago/stable/0.0/rpm/ Here are the changes: * Thu Jun 16 2016 gbenhaim <galbh2(a)gmail.com> - 0.22.1 20cc8d58: Fixed a bug where script manager stuck on an infinite loop. * Thu Jun 16 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.22.0 ed677d6b: Merge pull request #280 from lago-project/hide_import_error_when_using_old_versions_of_stevedore be794dc1: Hide import error when using old versions of stevedore. Enjoy! Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

1 0

When is Lago environment SSH'able?
by Eric Helms 16 Jun '16

16 Jun '16

Howdy, Is there a predictable way or a suggested way to know when a Lago environment has fully come up for SSH? Eric

2 1

Lago Ansible Inventory Script
by Eric Helms 15 Jun '16

15 Jun '16

Howdy, Since I didn't find anything searching around, I decided to start implementing a dynamic inventory script for Lago for my local environment while trying to keep it as generic as possible. If you'd be interested I'd like to share it and get feedback but I am not sure where is the best place for me to place it or offer it to Lago via a PR. Eric

5 9

[09-06-2016] New lago release - 0.21.0
by Gal Ben Haim 14 Jun '16

14 Jun '16

Hi everyone! There's a new lago release with version 0.21.0 ready for you to upgrade! Here are the changes: * Thu Jun 02 2016 Lago CI bot <dcaroest+cibot(a)redhat.com> - 0.21.0 f28ea953: Merge pull request #272 from lago-project/show_plugin_import_exception_only_in_debug_level 6336d527: Added a callback function to handle import exception Enjoy! Gal Ben Haim gbenhaim(a)redhat.com RHEV DevOps

3 8

[Request for feedback] Adding [Docker] container support to Lago
by Jan Lieskovsky 08 Jun '16

08 Jun '16

Hello folks, since there's motivation Lago to support containers too (https://github.com/lago-project/lago/issues/149) investigated the possible ways how this could be implemented. Created a WIP PR: [1] https://github.com/lago-project/lago/pull/276 but would appreciate a wider feedback from the list prior continuing on that one. Basically I see three possibilities how [Docker] container support for Lago could be implemented: Approach 1) - Allow Lago container yaml / json init file in "docker-compose.yml" format - Use available "docker-compose" rpm to perform the underlying actions (IOW lago commands would be just wrappers around docker-compose use. E.g. lago start == docker-compose up lago stop == docker-compose down) As a part of this I have added "prefix-provider" support to lago (first commit of [1]). The intention is to define new docker-prefix for lago, which would wrap use of docker-compose, Advantage: Should be easy to implement Disadvantage: Dependency on external docker-compose RPM, which at the moment in F22 doesn't support v2 of docker-compose YAML files yet Approach 2) - allow "docker-compose.yml" as init json/yaml file for lago container configuration, - instead of using "docker-compose" create own docker lago vm provider / plugin (using python-docker-py implementation to access docker service), As part of this I have implemented support for local docker container based provider into Lago (commit 2 of [1]). Advantage: No dependency on external docker-compose RPM Disadvantate: * The need to write own docker-compose.yml file parser (AFAIK python-dockerfile-parse doesn't support parsing them [yet) * Basically we would duplicate the effort the docker-compose tool is doing right now Approach 3) - don't allow docker-compose.yml as Lago container json/yml file, - use rather format instead Advantage: No need for docker-compose.yml parser. We can define custom format, easily to be parsable. Disadvantage: Divergence from commonly used docker-compose.yml files (UX would differ as users would need to get accustomed to different format of configuration file) The question is obvious -- can you hopefully provide comments / opinion, which approach of the above do you like best and why? If having yet another one from the above ones, please share. Thank you for your opinions in advance. Regards, Jan -- Jan iankko Lieskovsky P.S.: Having agreed on an approach how this should be implemented will help us with adding vagrant support to lago too.

2 1

[02-06-2016] New lago release - 0.20.0
by David Caro 02 Jun '16

02 Jun '16

Hi everyone! There's a new lago release with version 0.20.0 ready for you to upgrade! One important change is the ability to use repoman for building the local repo, It also means that repoman is now required when installing python-lago-ovirt, repoman can be found in the following repo: http://resources.ovirt.org/repos/ci-tools/ Here are the other changes: 745e6087: Added possibility to specify ssh-user and ssh-pass on initfile 99e99b75: Detect (and report) any empty domain name possibly c7966a35: Using repoman to merge the reposync downloaded repos 7894c1d4: Added --custom-source option to reposetup 5c5199e9: Allow copying dirs in the vm For the full changelog, you can go to the docs page: http://lago.readthedocs.io/en/0.20/ Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

[2016-05-30] Lago Weekly Meeting Minutes
by David Caro 30 May '16

30 May '16

oVirt system tests status: ========================== * 3.6 working * Master working * Image Failing due to appliance known issue (engine is not getting installed on the appliance, fabiand is on it) * New suite on it's way: Hosted engine (lev is working on it) **AI**: create a readthedocs page Last release items: ==================== Lago VM, VMProvider and Service plugins merged and released Next relase items: ================== Lago + repoman integration patch was merged, next lago release will require repoman to be available (ovirt ci-tools repo has the latest version) Installation howto effort ========================== * Installed lago on rhel 7.2 (some difficulties with the deps, probably mixed channels) * For some reason lago requires ovirtlago on start/stop Cheers!! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

Weekly bug status for ovirt-system-tests (using Lago) [ 29/05/16 ]
by Eyal Edri 29 May '16

29 May '16

FYI, Some updates from recent activity on ovirt-system-tests running on Lago. *New training videos:* overview of the framework running on Lago - https://bluejeans.com/s/9FaJ/ <https://mojo.redhat.com/external-link.jspa?url=https%3A%2F%2Fbluejeans.com%…> hands on session on installing and running OST - https://bluejeans.com/s/9Iy0/ <https://mojo.redhat.com/external-link.jspa?url=https%3A%2F%2Fbluejeans.com%…> *Open bugs:* https://goo.gl/eUaPUY *Open issues:* Work is being done to allow running OST locally per patch and on CI per merge.. more news to come soon *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open * Some patches are open on simplification and cleanup of the tests, should be merged this week. * This is part of preparing ovirt-system-tests to support running tests per commit. *Jenkins jobs: (STABLE!)* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ 3.6 & master tests are stable and running on nightlies - please watch out for any new errors, they probably mean there is a regression! 3.6 NGN job is failing - Tolik/David - do we know what the issue is? *Recently merged patches:* https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:merged+since… > -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

[2016-05-26] Weekly lago release 0.19.0
by David Caro 26 May '16

26 May '16

Hi everyone! A new lago release is out, this one adds the possibility to extend lago with three new plugins: * VMPlugin: Allows to modify each and every VM action, useful though when you want to extend the actions a VM can take, or customize some high level behavior (like defining a different set of artifacts to collect) We have lago.vm.DefaultVM (default), ovirtlago.virt.EngineVM (ovirt-engine), ovirtlago.virt.NodeVM (ovirt-node) and ovirtlago.virt.HostVM (ovirt-host). You can specify which one your domain belongs to with the key 'vm-type' and one of the above values, like: domains: my_domain: vm-type: ovirt-engine ... * VMProvider: Allows to implement a different set of low-level methods, like snapshot, or start/stop a vm, to allow to use different virtualization (or not) systems (only LocalLibvirtVMProvider (local-libvirt) and SSHVMProvider (ssh) are implemented right now). You can specify a custom provider for your domains with the 'vm-provider' key, like: domains: my_domain: vm-provider: local-libvirt ... * ServicePlugin: This is the class that implements the service-handling functions for a vm, starting/stopping a service, checking if the service is enabled, etc. Current implementations are SystemdService (systemd), SysVInitService (sysvinit) and SystemdContainerService (systemdcontainer). You can specify a custom service provider for your domain with the key 'service_provider': domains: my_domain: service_provider: systemd ... Another important fixed bug is that now copying a directory to a vm works :) For the latest docs and changelog you can go to the docs page: http://lago.readthedocs.io/en/0.19/ Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0

[23-05-2016] Lago weekly meeting minutes
by David Caro 23 May '16

23 May '16

23-05-2016 - Agenda * oVirt system tests status: * 3.6 working (had some storage setup timeout on one run, rerunning to try to reproduce) * Master working * Image working * Cleanup and json->yaml refactor patches: * https://gerrit.ovirt.org/57664 * https://gerrit.ovirt.org/57699 * https://gerrit.ovirt.org/57700 * https://gerrit.ovirt.org/57702 * https://gerrit.ovirt.org/57703 * https://gerrit.ovirt.org/57704 * https://gerrit.ovirt.org/57705 * https://gerrit.ovirt.org/57731 * https://gerrit.ovirt.org/57663 * https://gerrit.ovirt.org/57662 * AI: create a readthedocs page * Lago Tutorial * Splitted the docs on two sections * Getting started: In depth explanation of the tutorial same steps * Tutorial: Per-feature explanation with examples * Lago demo * Totally different project, with it’s own maintenance * Very simple introduction on how to generate the lago repos (quick tutorial) * Lago + repoman integration: * https://github.com/lago-project/lago/pull/251 * Have to think a bit how to distribute repoman (currently it’s in ovirt ci-tools repo) * Lago VM, VMProvider and Service plugins * https://github.com/lago-project/lago/pull/260 * Still working out on the documentation but is functionally complete Enjoy! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

2 2

Lago and Vagrant
by Eric Helms 22 May '16

22 May '16

I recall seeing some discussion of Lago vs Vagrant and how there could be some leverage between the two. We are currently using Lago in our release testing pipeline, however, for years now we've been using Vagrant for deploying developer and production hand-on testing environments. There are benefits to how we test and build environments to centering on a singular technology. Thus, I had a few questions I was hoping to get some thoughts on: 1) What was the outcome of the Lago vs Vagrant discussions? 2) How to reconcile the built up base of Vagrant use within our group with Lago (or how to sell switching to Lago)? 3) Do you see them as co-existing with different application points? To give an example of a disconnect where centering technology would benefit, we do an installation test currently spinning up a Lago based environment. Users testing our builds are using our existing Vagrant setup to spin up environments. However, we aren't testing the setup and configuration users are using and we end up double building the techniques for setting up environments. Thanks for any thoughts, Eric

3 2

Weekly bug status for ovirt-system-tests (using Lago) [ 22/05/16 ]
by Eyal Edri 22 May '16

22 May '16

FYI, Some updates from recent activity on ovirt-system-tests running on Lago. *Open bugs:* https://goo.gl/eUaPUY *Open issues:* Failure on DirectLun (not merged yet), actually found a blocker by a new test added by Yaniv K, see open patches [1] *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open * Some patches are open on simplification and cleanup of the tests, should be merged this week. * This is part of preparing ovirt-system-tests to support running tests per commit. *Jenkins jobs: (STABLE!)* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ - stable for the past days. 3.6 & master tests are stable and running on nightlies - please watch out for any new errors, they probably mean there is a regression! *Recently merged patches:* https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:merged+since… [1] *Bug 1337909* <https://bugzilla.redhat.com/show_bug.cgi?id=1337909> - NPE when trying to a direct LUN disk -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

New 0.18 version is out!
by David Caro 20 May '16

20 May '16

New lago 0.18 version is out, as the last one was done just a couple of days ago, there are not many changes, just a couple of bugfixes: * Expanding any vars on any url * Pinning down the version of yapf used For the latest docs: http://lago.readthedocs.io/en/0.18/ Cheers! -- David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com IRC: dcaro|dcaroest@{freenode|oftc|redhat} Web: www.redhat.com RHT Global #: 82-62605

1 0