repeating libvirt exception in vdsm check-merged job

Hi, we keep getting the following error in vdsm automation *12:16:47* + lago start vdsm_functional_tests_host-fc23*12:16:49* current session does not belong to lago group.*12:16:49* @ Start specified VMs: *12:16:49* # Start nets: *12:16:49* * Create network vdsm_functional_tests_lago: *12:16:50* * Create network vdsm_functional_tests_lago: Success (in 0:00:00)*12:16:50* # Start nets: Success (in 0:00:00)*12:16:50* # Start vms: *12:16:50* * Starting VM vdsm_functional_tests_host-fc23: *12:16:50* libvirt: QEMU Driver error : Cannot check QEMU binary /usr/libexec/qemu-kvm: No such file or directory*12:16:50* * Starting VM vdsm_functional_tests_host-fc23: ERROR (in 0:00:00)*12:16:50* # Start vms: ERROR (in 0:00:00)*12:16:50* # Destroy network vdsm_functional_tests_lago: *12:16:50* # Destroy network vdsm_functional_tests_lago: ERROR (in 0:00:00)*12:16:50* @ Start specified VMs: ERROR (in 0:00:00)*12:16:50* Error occured, aborting*12:16:50* Traceback (most recent call last):*12:16:50* File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 661, in main*12:16:50* cli_plugins[args.verb].do_run(args)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run*12:16:50* self._do_run(**vars(args))*12:16:50* File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper*12:16:50* return func(*args, **kwargs)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper*12:16:50* return func(*args, prefix=prefix, **kwargs)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 234, in do_start*12:16:50* prefix.start(vm_names=vm_names)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 778, in start*12:16:50* self.virt_env.start(vm_names=vm_names)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/virt.py", line 193, in start*12:16:50* vm.start()*12:16:50* File "/usr/lib/python2.7/site-packages/lago/virt.py", line 910, in start*12:16:50* self._env.libvirt_con.createXML(self._libvirt_xml())*12:16:50* File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3611, in createXML*12:16:50* if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self)*12:16:50* libvirtError: Cannot check QEMU binary /usr/libexec/qemu-kvm: No such file or directory all jobs fail today with the same exception - http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/53/console . any idea why qemu-kvm is missing? -- *Yaniv Bronhaim.*

I remember something about a known issue with libvirt on fc23, but not sure. Adding Barak & Tolik who might know. On Thu, Apr 7, 2016 at 7:18 PM, Yaniv Bronheim <ybronhei@redhat.com> wrote:
Hi, we keep getting the following error in vdsm automation
*12:16:47* + lago start vdsm_functional_tests_host-fc23*12:16:49* current session does not belong to lago group.*12:16:49* @ Start specified VMs: *12:16:49* # Start nets: *12:16:49* * Create network vdsm_functional_tests_lago: *12:16:50* * Create network vdsm_functional_tests_lago: Success (in 0:00:00)*12:16:50* # Start nets: Success (in 0:00:00)*12:16:50* # Start vms: *12:16:50* * Starting VM vdsm_functional_tests_host-fc23: *12:16:50* libvirt: QEMU Driver error : Cannot check QEMU binary /usr/libexec/qemu-kvm: No such file or directory*12:16:50* * Starting VM vdsm_functional_tests_host-fc23: ERROR (in 0:00:00)*12:16:50* # Start vms: ERROR (in 0:00:00)*12:16:50* # Destroy network vdsm_functional_tests_lago: *12:16:50* # Destroy network vdsm_functional_tests_lago: ERROR (in 0:00:00)*12:16:50* @ Start specified VMs: ERROR (in 0:00:00)*12:16:50* Error occured, aborting*12:16:50* Traceback (most recent call last):*12:16:50* File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 661, in main*12:16:50* cli_plugins[args.verb].do_run(args)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in do_run*12:16:50* self._do_run(**vars(args))*12:16:50* File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper*12:16:50* return func(*args, **kwargs)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper*12:16:50* return func(*args, prefix=prefix, **kwargs)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 234, in do_start*12:16:50* prefix.start(vm_names=vm_names)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 778, in start*12:16:50* self.virt_env.start(vm_names=vm_names)*12:16:50* File "/usr/lib/python2.7/site-packages/lago/virt.py", line 193, in start*12:16:50* vm.start()*12:16:50* File "/usr/lib/python2.7/site-packages/lago/virt.py", line 910, in start*12:16:50* self._env.libvirt_con.createXML(self._libvirt_xml())*12:16:50* File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3611, in createXML*12:16:50* if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self)*12:16:50* libvirtError: Cannot check QEMU binary /usr/libexec/qemu-kvm: No such file or directory
all jobs fail today with the same exception - http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/53/console .
any idea why qemu-kvm is missing?
-- *Yaniv Bronhaim.*
_______________________________________________ lago-devel mailing list lago-devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/lago-devel
-- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

all jobs fail today with the same exception - http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/53/console .
any idea why qemu-kvm is missing?
--
You are probably running inside mock, so you need to ensure that qemu-kvm is installed by mentioning it in the *.packages file. You will probably also need to get the libvirtd socket mounted inside mock, please see the ovirt-system-tests and lago itself for examples on how to do that. Eyal also mentioned another issue you should be aware of, if you are using fc23, you should be aware that the protocol libvirt uses to talk to libvirtd had changed, therefore you cannot run an fc23 mock using libvirt on top of an older host. AFAIK it works ok the other way around. If that is the issue you are seeing, talk to us and we'll help you tweak the jobs to determine which host they run on. -- Barak Korren bkorren@redhat.com RHEV-CI Team

We didn't change anything in vdsm automation side and it worked great two weeks ago. Did you change something in lago side? maybe David knows? Do I I need now to require qemu-kvm as well? same for the platform, it was always f23 only for lago tests. On Mon, Apr 11, 2016 at 9:20 AM, Barak Korren <bkorren@redhat.com> wrote:
all jobs fail today with the same exception -
http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/53/console
.
any idea why qemu-kvm is missing?
--
You are probably running inside mock, so you need to ensure that qemu-kvm is installed by mentioning it in the *.packages file. You will probably also need to get the libvirtd socket mounted inside mock, please see the ovirt-system-tests and lago itself for examples on how to do that.
Eyal also mentioned another issue you should be aware of, if you are using fc23, you should be aware that the protocol libvirt uses to talk to libvirtd had changed, therefore you cannot run an fc23 mock using libvirt on top of an older host. AFAIK it works ok the other way around. If that is the issue you are seeing, talk to us and we'll help you tweak the jobs to determine which host they run on.
-- Barak Korren bkorren@redhat.com RHEV-CI Team
-- *Yaniv Bronhaim.*

Lago has a new version almost every week, You can see the lago-devel ml for change-log per release. David is on PTO until Wed(exclusive), so he won't be able to look at it until then. On Mon, Apr 11, 2016 at 10:54 AM, Yaniv Bronheim <ybronhei@redhat.com> wrote:
We didn't change anything in vdsm automation side and it worked great two weeks ago. Did you change something in lago side? maybe David knows? Do I I need now to require qemu-kvm as well? same for the platform, it was always f23 only for lago tests.
On Mon, Apr 11, 2016 at 9:20 AM, Barak Korren <bkorren@redhat.com> wrote:
all jobs fail today with the same exception -
http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/53/console
.
any idea why qemu-kvm is missing?
--
You are probably running inside mock, so you need to ensure that qemu-kvm is installed by mentioning it in the *.packages file. You will probably also need to get the libvirtd socket mounted inside mock, please see the ovirt-system-tests and lago itself for examples on how to do that.
Eyal also mentioned another issue you should be aware of, if you are using fc23, you should be aware that the protocol libvirt uses to talk to libvirtd had changed, therefore you cannot run an fc23 mock using libvirt on top of an older host. AFAIK it works ok the other way around. If that is the issue you are seeing, talk to us and we'll help you tweak the jobs to determine which host they run on.
-- Barak Korren bkorren@redhat.com RHEV-CI Team
-- *Yaniv Bronhaim.*
-- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

Oh I just noticed that vdsm job works properly now ! :) http://jenkins.ovirt.org/job/vdsm_master_check-merged-fc23-x86_64/359/consol... Probably it was something with one of the dependencies Thanks On Mon, Apr 11, 2016 at 10:57 AM, Eyal Edri <eedri@redhat.com> wrote:
Lago has a new version almost every week, You can see the lago-devel ml for change-log per release.
David is on PTO until Wed(exclusive), so he won't be able to look at it until then.
On Mon, Apr 11, 2016 at 10:54 AM, Yaniv Bronheim <ybronhei@redhat.com> wrote:
We didn't change anything in vdsm automation side and it worked great two weeks ago. Did you change something in lago side? maybe David knows? Do I I need now to require qemu-kvm as well? same for the platform, it was always f23 only for lago tests.
On Mon, Apr 11, 2016 at 9:20 AM, Barak Korren <bkorren@redhat.com> wrote:
all jobs fail today with the same exception -
http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/53/console
.
any idea why qemu-kvm is missing?
--
You are probably running inside mock, so you need to ensure that qemu-kvm is installed by mentioning it in the *.packages file. You will probably also need to get the libvirtd socket mounted inside mock, please see the ovirt-system-tests and lago itself for examples on how to do that.
Eyal also mentioned another issue you should be aware of, if you are using fc23, you should be aware that the protocol libvirt uses to talk to libvirtd had changed, therefore you cannot run an fc23 mock using libvirt on top of an older host. AFAIK it works ok the other way around. If that is the issue you are seeing, talk to us and we'll help you tweak the jobs to determine which host they run on.
-- Barak Korren bkorren@redhat.com RHEV-CI Team
-- *Yaniv Bronhaim.*
-- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel
phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)
-- *Yaniv Bronhaim.*
participants (3)
-
Barak Korren
-
Eyal Edri
-
Yaniv Bronheim