VM migration/creation on host problem ...
Hello, I've just reinstall a host (ovirt-node2) and now I am unable to create/migrate vm on this host. In attachment, the log from the destination server (ovirt-node2). Any help will be appreciated. James
------=_Part_8537640_21106520.1415897460790 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit ----- Original Message -----
From: "James James" <jreg2k@gmail.com> To: "users" <users@ovirt.org> Sent: Thursday, November 13, 2014 5:41:21 PM Subject: [ovirt-users] VM migration/creation on host problem ...
Hello,
I've just reinstall a host (ovirt-node2) and now I am unable to create/migrate vm on this host.
In attachment, the log from the destination server (ovirt-node2).
Any help will be appreciated.
James
Hi James, can you please add the libvirt logs? depending on the version of oVirt VDSM is either /var/log/libvirt/libvirtd.log or multiplexed into /var/log/messages please also add QEMU logs as found in /var/log/libvirt/qemu/$VM_NAME.log where VM_NAME is "puppetdb" here thanks, -- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani ------=_Part_8537640_21106520.1415897460790 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><div><br></div><hr id=3D"zwchr"><bloc= kquote style=3D"border-left:2px solid #1010FF;margin-left:5px;padding-left:= 5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;fo= nt-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"James J= ames" <jreg2k@gmail.com><br><b>To: </b>"users" <users@ovirt.org>= ;<br><b>Sent: </b>Thursday, November 13, 2014 5:41:21 PM<br><b>Subject: </b=
[ovirt-users] VM migration/creation on host problem ...<br><div><br></div>= <div dir=3D"ltr">Hello,<br><div><br></div>I've just reinstall a host (ovirt= -node2) and now I am unable to create/migrate vm on this host.<br><div><br>= </div>In attachment, the log from the destination server (ovirt-node2).<br>= <div><br></div>Any help will be appreciated.<br><div><br></div>James<br></d= iv></blockquote><div><br></div><div>Hi James,<br></div><div><br></div><div>= can you please add the libvirt logs? depending on the version of oVirt VDSM= is either</div><div>/var/log/libvirt/libvirtd.log <br></div><div>or multip= lexed into<br></div><div>/var/log/messages<br></div><div><br></div><div>ple= ase also add QEMU logs as found in<br></div><div>/var/log/libvirt/qemu/$VM_= NAME.log<br></div><div><br></div><div>where VM_NAME is "puppetdb" here<br><= /div><div><br></div><div>thanks,<br></div><div><br></div><div>-- <br></div>= <div><span name=3D"x"></span>Francesco Romani<br>RedHat Engineering Virtual= ization R & D<br>Phone: 8261328<br>IRC: fromani<span name=3D"x"></span>= <br></div></div></body></html> ------=_Part_8537640_21106520.1415897460790--
Hi Francesco, thanks for your help .... :) 2014-11-13 17:51 GMT+01:00 Francesco Romani <fromani@redhat.com>:
------------------------------
*From: *"James James" <jreg2k@gmail.com> *To: *"users" <users@ovirt.org> *Sent: *Thursday, November 13, 2014 5:41:21 PM *Subject: *[ovirt-users] VM migration/creation on host problem ...
Hello,
I've just reinstall a host (ovirt-node2) and now I am unable to create/migrate vm on this host.
In attachment, the log from the destination server (ovirt-node2).
Any help will be appreciated.
James
Hi James,
can you please add the libvirt logs? depending on the version of oVirt VDSM is either /var/log/libvirt/libvirtd.log or multiplexed into /var/log/messages
please also add QEMU logs as found in /var/log/libvirt/qemu/$VM_NAME.log
where VM_NAME is "puppetdb" here
thanks,
-- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani
It's look like Selinux problem. I've just set selinux in permissive mode and migration and vm creation work but I am not able to connect to the vm. The network doesn't works. ;( /dev/hpet" rdev=0A:E4 acl=rw exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=ANOM_PROMISCUOUS msg=audit(1415921728.561:2869): dev=vnet0 prom=256 old_prom=0 auid=4294967295 uid=0 gid=0 ses=4294967295 type=SYSCALL msg=audit(1415921728.561:2869): arch=c000003e syscall=16 success=yes exit=0 a0=1e a1=89a2 a2=7ff7c77ecd30 a3=3a2032373a65736f items=0 ppid=1 pid=21225 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="libvirtd" exe="/usr/sbin/libvirtd" subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 key=(null) type=VIRT_RESOURCE msg=audit(1415921728.561:2870): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm resrc=net reason=open vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 net=00:1A:4A:7C:94:00 path="/dev/net/tun" rdev=0A:C8 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=VIRT_RESOURCE msg=audit(1415921728.684:2871): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm resrc=net reason=open vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 net=00:1A:4A:7C:94:00 path="/dev/vhost-net" rdev=0A:39 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=AVC msg=audit(1415921728.689:2872): avc: denied { connectto } for pid=22575 comm="libvirtd" path="/var/run/sanlock/sanlock.sock" scontext=system_u:system_r:svirt_t:s0:c110,c335 tcontext=system_u:system_r:sanlock_t:s0-s0:c0.c1023 tclass=unix_stream_socket type=SYSCALL msg=audit(1415921728.689:2872): arch=c000003e syscall=42 success=no exit=-13 a0=3 a1=7ff7c77ec710 a2=6e a3=0 items=0 ppid=1 pid=22575 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="libvirtd" exe="/usr/sbin/libvirtd" subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 key=(null) type=AVC msg=audit(1415921728.690:2873): avc: denied { connectto } for pid=22575 comm="libvirtd" path="/var/run/sanlock/sanlock.sock" scontext=system_u:system_r:svirt_t:s0:c110,c335 tcontext=system_u:system_r:sanlock_t:s0-s0:c0.c1023 tclass=unix_stream_socket type=SYSCALL msg=audit(1415921728.690:2873): arch=c000003e syscall=42 success=no exit=-13 a0=3 a1=7ff7c77ec890 a2=6e a3=0 items=0 ppid=1 pid=22575 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="libvirtd" exe="/usr/sbin/libvirtd" subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 key=(null) type=ANOM_ABEND msg=audit(1415921728.690:2874): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 pid=22575 comm="libvirtd" sig=11 type=ANOM_PROMISCUOUS msg=audit(1415921728.719:2875): dev=vnet0 prom=0 old_prom=256 auid=4294967295 uid=0 gid=0 ses=4294967295 type=VIRT_RESOURCE msg=audit(1415921728.910:2876): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm resrc=net reason=start vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 old-net=? new-net=00:1A:4A:7C:94:00 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=VIRT_RESOURCE msg=audit(1415921728.910:2877): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm resrc=mem reason=start vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 old-mem=0 new-mem=1048576 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=VIRT_RESOURCE msg=audit(1415921728.910:2878): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm resrc=vcpu reason=start vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 old-vcpu=0 new-vcpu=1 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=VIRT_CONTROL msg=audit(1415921728.910:2879): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm op=start reason=booted vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 vm-pid=-1 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=failed' 2014-11-13 19:06 GMT+01:00 James James <jreg2k@gmail.com>:
Hi Francesco,
thanks for your help .... :)
2014-11-13 17:51 GMT+01:00 Francesco Romani <fromani@redhat.com>:
------------------------------
*From: *"James James" <jreg2k@gmail.com> *To: *"users" <users@ovirt.org> *Sent: *Thursday, November 13, 2014 5:41:21 PM *Subject: *[ovirt-users] VM migration/creation on host problem ...
Hello,
I've just reinstall a host (ovirt-node2) and now I am unable to create/migrate vm on this host.
In attachment, the log from the destination server (ovirt-node2).
Any help will be appreciated.
James
Hi James,
can you please add the libvirt logs? depending on the version of oVirt VDSM is either /var/log/libvirt/libvirtd.log or multiplexed into /var/log/messages
please also add QEMU logs as found in /var/log/libvirt/qemu/$VM_NAME.log
where VM_NAME is "puppetdb" here
thanks,
-- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani
In /var/log/libvirt/libvirt.log : [root@ovirt-node2 ~]# tail -f /var/log/libvirt/libvirtd.log 2014-11-14 15:45:03.770+0000: 13769: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:45:18.791+0000: 13772: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:45:33.812+0000: 13772: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:45:48.867+0000: 13768: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:46:03.889+0000: 13772: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:46:18.911+0000: 13768: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:46:21.595+0000: 13767: error : virNetSocketReadWire:1194 : End of file while reading data: Input/output error 2014-11-14 15:46:33.931+0000: 13770: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present Does anybody knows what that means ? 2014-11-14 0:49 GMT+01:00 James James <jreg2k@gmail.com>:
It's look like Selinux problem. I've just set selinux in permissive mode and migration and vm creation work but I am not able to connect to the vm. The network doesn't works. ;(
/dev/hpet" rdev=0A:E4 acl=rw exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=ANOM_PROMISCUOUS msg=audit(1415921728.561:2869): dev=vnet0 prom=256 old_prom=0 auid=4294967295 uid=0 gid=0 ses=4294967295 type=SYSCALL msg=audit(1415921728.561:2869): arch=c000003e syscall=16 success=yes exit=0 a0=1e a1=89a2 a2=7ff7c77ecd30 a3=3a2032373a65736f items=0 ppid=1 pid=21225 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="libvirtd" exe="/usr/sbin/libvirtd" subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 key=(null) type=VIRT_RESOURCE msg=audit(1415921728.561:2870): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm resrc=net reason=open vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 net=00:1A:4A:7C:94:00 path="/dev/net/tun" rdev=0A:C8 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=VIRT_RESOURCE msg=audit(1415921728.684:2871): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm resrc=net reason=open vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 net=00:1A:4A:7C:94:00 path="/dev/vhost-net" rdev=0A:39 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=AVC msg=audit(1415921728.689:2872): avc: denied { connectto } for pid=22575 comm="libvirtd" path="/var/run/sanlock/sanlock.sock" scontext=system_u:system_r:svirt_t:s0:c110,c335 tcontext=system_u:system_r:sanlock_t:s0-s0:c0.c1023 tclass=unix_stream_socket type=SYSCALL msg=audit(1415921728.689:2872): arch=c000003e syscall=42 success=no exit=-13 a0=3 a1=7ff7c77ec710 a2=6e a3=0 items=0 ppid=1 pid=22575 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="libvirtd" exe="/usr/sbin/libvirtd" subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 key=(null) type=AVC msg=audit(1415921728.690:2873): avc: denied { connectto } for pid=22575 comm="libvirtd" path="/var/run/sanlock/sanlock.sock" scontext=system_u:system_r:svirt_t:s0:c110,c335 tcontext=system_u:system_r:sanlock_t:s0-s0:c0.c1023 tclass=unix_stream_socket type=SYSCALL msg=audit(1415921728.690:2873): arch=c000003e syscall=42 success=no exit=-13 a0=3 a1=7ff7c77ec890 a2=6e a3=0 items=0 ppid=1 pid=22575 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="libvirtd" exe="/usr/sbin/libvirtd" subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 key=(null) type=ANOM_ABEND msg=audit(1415921728.690:2874): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 pid=22575 comm="libvirtd" sig=11 type=ANOM_PROMISCUOUS msg=audit(1415921728.719:2875): dev=vnet0 prom=0 old_prom=256 auid=4294967295 uid=0 gid=0 ses=4294967295 type=VIRT_RESOURCE msg=audit(1415921728.910:2876): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm resrc=net reason=start vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 old-net=? new-net=00:1A:4A:7C:94:00 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=VIRT_RESOURCE msg=audit(1415921728.910:2877): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm resrc=mem reason=start vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 old-mem=0 new-mem=1048576 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=VIRT_RESOURCE msg=audit(1415921728.910:2878): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm resrc=vcpu reason=start vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 old-vcpu=0 new-vcpu=1 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' type=VIRT_CONTROL msg=audit(1415921728.910:2879): user pid=21206 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:virtd_t:s0-s0:c0.c1023 msg='virt=kvm op=start reason=booted vm="test" uuid=2932fd25-7c09-48a8-a5f0-c7165ddb3c82 vm-pid=-1 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=failed'
2014-11-13 19:06 GMT+01:00 James James <jreg2k@gmail.com>:
Hi Francesco,
thanks for your help .... :)
2014-11-13 17:51 GMT+01:00 Francesco Romani <fromani@redhat.com>:
------------------------------
*From: *"James James" <jreg2k@gmail.com> *To: *"users" <users@ovirt.org> *Sent: *Thursday, November 13, 2014 5:41:21 PM *Subject: *[ovirt-users] VM migration/creation on host problem ...
Hello,
I've just reinstall a host (ovirt-node2) and now I am unable to create/migrate vm on this host.
In attachment, the log from the destination server (ovirt-node2).
Any help will be appreciated.
James
Hi James,
can you please add the libvirt logs? depending on the version of oVirt VDSM is either /var/log/libvirt/libvirtd.log or multiplexed into /var/log/messages
please also add QEMU logs as found in /var/log/libvirt/qemu/$VM_NAME.log
where VM_NAME is "puppetdb" here
thanks,
-- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani
----- Original Message -----
From: "James James" <jreg2k@gmail.com> To: "Francesco Romani" <fromani@redhat.com> Cc: "users" <users@ovirt.org> Sent: Friday, 14 November, 2014 4:53:22 PM Subject: Re: [ovirt-users] VM migration/creation on host problem ...
In /var/log/libvirt/libvirt.log :
[root@ovirt-node2 ~]# tail -f /var/log/libvirt/libvirtd.log 2014-11-14 15:45:03.770+0000: 13769: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:45:18.791+0000: 13772: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:45:33.812+0000: 13772: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:45:48.867+0000: 13768: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:46:03.889+0000: 13772: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:46:18.911+0000: 13768: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:46:21.595+0000: 13767: error : virNetSocketReadWire:1194 : End of file while reading data: Input/output error 2014-11-14 15:46:33.931+0000: 13770: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present
Does anybody knows what that means ?
That and the selinux issue you reported previously reminded me of one bug: https://bugzilla.redhat.com/show_bug.cgi?id=1157185 further information: https://bugzilla.redhat.com/show_bug.cgi?id=1150243#c17 Can't find more precise information at the moment :( -- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani
Thanks for your answer. There was 2 problems 1 - selinux problem : https://bugzilla.redhat.com/show_bug.cgi?id=1157185 2 - A Network problem : I had to configure my switch port. The 2 problems are solved. Thanks for your help. 2014-11-14 17:05 GMT+01:00 Francesco Romani <fromani@redhat.com>:
----- Original Message -----
From: "James James" <jreg2k@gmail.com> To: "Francesco Romani" <fromani@redhat.com> Cc: "users" <users@ovirt.org> Sent: Friday, 14 November, 2014 4:53:22 PM Subject: Re: [ovirt-users] VM migration/creation on host problem ...
In /var/log/libvirt/libvirt.log :
[root@ovirt-node2 ~]# tail -f /var/log/libvirt/libvirtd.log 2014-11-14 15:45:03.770+0000: 13769: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:45:18.791+0000: 13772: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:45:33.812+0000: 13772: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:45:48.867+0000: 13768: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:46:03.889+0000: 13772: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:46:18.911+0000: 13768: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present 2014-11-14 15:46:21.595+0000: 13767: error : virNetSocketReadWire:1194 : End of file while reading data: Input/output error 2014-11-14 15:46:33.931+0000: 13770: error : virDomainObjGetMetadata:16650 : metadata not found: Requested metadata element is not present
Does anybody knows what that means ?
That and the selinux issue you reported previously reminded me of one bug:
https://bugzilla.redhat.com/show_bug.cgi?id=1157185
further information:
https://bugzilla.redhat.com/show_bug.cgi?id=1150243#c17
Can't find more precise information at the moment :(
-- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani
participants (2)
-
Francesco Romani -
James James