[ovirt-users] Live migration failing

Tue Apr 29 14:51:54 UTC 2014

Hosts packages:
vdsm-4.14.6-0.el6.x86_64
libvirt-0.10.2-29.el6_5.7.x86_64
qemu-kvm-0.12.1.2-2.415.el6_5.8.x86_64 (from the jenkins build with live
snapshot support)

Both those examples are of existing VM's, they were generated from a
template, and they do have snapshots.

I just attempted to migrate another VM 'DHCP01' and it was successful, this
VM was generated from the same template and containing snapshots.
I then was able to migrate the 'owncloud' vm successfully (which failed
multiple times before), then I attempted another vm 'CV_Test' and it
completed successfully but the time is way off, listing the migration was
done in 31 seconds when the log shows 6 minutes. I ran through the same VM
migration again to double check, and there was a kvm process for that VM
running on both hosts for longer than what is listed in the GUI.

2014-Apr-29, 10:15 Migration completed (VM: CV_Test, Source: ovirt001,
Destination: ovirt002, Duration: 31 sec).
2014-Apr-29, 10:09 Migration started (VM: CV_Test, Source: ovirt001,
Destination: ovirt002, User: admin).

2014-Apr-29, 10:09 Migration completed (VM: central-syslog, Source:
ovirt002, Destination: ovirt001, Duration: 26 sec).
2014-Apr-29, 10:09 Migration started (VM: central-syslog, Source: ovirt002,
Destination: ovirt001, User: admin).
2014-Apr-29, 10:08 VM central-syslog started on Host ovirt002
2014-Apr-29, 10:08 User admin at internal is connected to VM central-syslog.
2014-Apr-29, 10:08 user admin initiated console session for VM
central-syslog
2014-Apr-29, 10:07 VM central-syslog was started by admin (Host: ovirt002).
2014-Apr-29, 10:06 Migration completed (VM: owncloud, Source: ovirt002,
Destination: ovirt001, Duration: 20 sec).
2014-Apr-29, 10:06 Migration started (VM: owncloud, Source: ovirt002,
Destination: ovirt001, User: admin).
2014-Apr-29, 09:55 VM DHCP01 is down. Exit message: User shut down
2014-Apr-29, 09:55 Migration completed (VM: syslog, Source: ovirt002,
Destination: ovirt001, Duration: 31 sec).
2014-Apr-29, 09:55 Migration started (VM: syslog, Source: ovirt002,
Destination: ovirt001, User: admin).
2014-Apr-29, 09:54 VM shutdown initiated by admin on VM DHCP01 (Host:
ovirt001).
2014-Apr-29, 09:54 Migration completed (VM: DHCP01, Source: ovirt002,
Destination: ovirt001, Duration: 18 sec).
2014-Apr-29, 09:54 Migration started (VM: DHCP01, Source: ovirt002,
Destination: ovirt001, User: admin).

Right now my greatest concern is a lack of consistency. I've attached
vdsm/libvirt logs from both sides of the first migration error:

2014-Apr-28, 13:12 Migration failed due to Error: Fatal error during
migration (VM: central-syslog, Source: ovirt002, Destination: ovirt001).
2014-Apr-28, 13:12 Migration failed due to Error: Fatal error during
migration. Trying to migrate to another Host (VM: central-syslog, Source:
ovirt002, Destination: ovirt001).
2014-Apr-28, 13:12 Migration started (VM: central-syslog, Source: ovirt002,
Destination: ovirt001, User: admin).

Thanks,
Steve

On Tue, Apr 29, 2014 at 9:51 AM, Dafna Ron <dron at redhat.com> wrote:

> Actually, the best way to debug this would be to look at both des and src
> vdsm logs.
> is this happening on all vm's or just one of them?
> was this vm launched from an iso? is that iso still available?
> are there any snapshots?
> what are the vdsm, libvirt and qemu versions?
>
> Thanks.
>
> Dafna
>
>
>
> On 04/29/2014 02:24 PM, Steve Dainard wrote:
>
>> Thanks, logs attached:
>>
>> libvirtd.log.4/central-syslog.log covers the first event (17:12
>> timestamp)
>> libvirtd.log.3/owncloud.log covers the second event (01:22 timestamp)
>>
>>
>> Steve
>>
>>
>>
>> On Tue, Apr 29, 2014 at 4:48 AM, Francesco Romani <fromani at redhat.com<mailto:
>> fromani at redhat.com>> wrote:
>>
>>     ----- Original Message -----
>>     > From: "Steve Dainard" <sdainard at miovision.com
>>     <mailto:sdainard at miovision.com>>
>>     > To: "users" <users at ovirt.org <mailto:users at ovirt.org>>
>>     > Sent: Tuesday, April 29, 2014 4:32:08 AM
>>     > Subject: Re: [ovirt-users] Live migration failing
>>     >
>>     > Another error on migration.
>>
>>     Hi, in both cases the core issue is
>>
>>     ibvirtError: Unable to read from monitor: Connection reset by peer
>>
>>     can you share the libvirtd and qemu logs?
>>
>>     Hopefully we can find some more information on those logs.
>>
>>     Bests,
>>
>>     --
>>     Francesco Romani
>>     RedHat Engineering Virtualization R & D
>>     Phone: 8261328
>>     IRC: fromani
>>
>>
>>
>>
>> _______________________________________________
>> Users mailing list
>> Users at ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>
>
> --
> Dafna Ron
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20140429/799382c7/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: central-syslog-failed-migrate.tar.gz
Type: application/x-gzip
Size: 2428726 bytes
Desc: not available
URL: <http://lists.ovirt.org/pipermail/users/attachments/20140429/799382c7/attachment-0001.gz>