<div dir="ltr">Failed live migration is wider spread than these two VM's, but they are a good example because they were both built from the same template and have no modifications after they were created. They were also migrated one after the other, with one successfully migrating and the other not.<div>
<br></div><div>Are there any increased logging levels that might help determine what the issue is?</div><div><br></div><div>Thanks,</div></div><div class="gmail_extra"><br clear="all"><div><div dir="ltr"><span style="font-family:arial,sans-serif;font-size:16px"><strong>Steve Dainard </strong></span><span style="font-size:12px"></span><br>
<span style="font-family:arial,sans-serif;font-size:12px">IT Infrastructure Manager<br>
<a href="http://miovision.com/" target="_blank">Miovision</a> | <em>Rethink Traffic</em><br><br>
<strong style="font-family:arial,sans-serif;font-size:13px;color:#999999"><a href="http://miovision.com/blog" target="_blank">Blog</a> | </strong><font color="#999999" style="font-family:arial,sans-serif;font-size:13px"><strong><a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">LinkedIn</a> | <a href="https://twitter.com/miovision" target="_blank">Twitter</a> | <a href="https://www.facebook.com/miovision" target="_blank">Facebook</a></strong></font> </span>
<hr style="font-family:arial,sans-serif;font-size:13px;color:#333333;clear:both">
<div style="color:#999999;font-family:arial,sans-serif;font-size:13px;padding-top:5px">
        <span style="font-family:arial,sans-serif;font-size:12px">Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener, ON, Canada | N2C 1L3</span><br>
        <span style="font-family:arial,sans-serif;font-size:12px">This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.</span></div>
</div></div>
<br><br><div class="gmail_quote">On Mon, Feb 17, 2014 at 11:47 AM, Dafna Ron <span dir="ltr"><<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
did you install these vm's from a cd? run it as run-once with a special monitor?<br>
try to think if there is anything different in the configuration of these vm's from the other vm's that succeed to migrate?<div class=""><br>
<br>
On 02/17/2014 04:36 PM, Steve Dainard wrote:<br>
</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="">
Hi Dafna,<br>
<br>
No snapshots of either of those VM's have been taken, and there are no updates for any of those packages on EL 6.5.<br>
<br></div><div class="">
*Steve Dainard *<br>
IT Infrastructure Manager<br>
Miovision <<a href="http://miovision.com/" target="_blank">http://miovision.com/</a>> | /Rethink Traffic/<br>
<br>
*Blog <<a href="http://miovision.com/blog" target="_blank">http://miovision.com/blog</a>> | **LinkedIn <<a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">https://www.linkedin.com/<u></u>company/miovision-technologies</a><u></u>> | Twitter <<a href="https://twitter.com/miovision" target="_blank">https://twitter.com/miovision</a><u></u>> | Facebook <<a href="https://www.facebook.com/miovision" target="_blank">https://www.facebook.com/<u></u>miovision</a>>*<br>
------------------------------<u></u>------------------------------<u></u>------------<br>
Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener, ON, Canada | N2C 1L3<br>
This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.<br>
<br>
<br></div><div><div class="h5">
On Sun, Feb 16, 2014 at 7:05 AM, Dafna Ron <<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a> <mailto:<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>>> wrote:<br>
<br>
does the vm that fails migration have a live snapshot?<br>
if so how many snapshots does the vm have.<br>
I think that there are newer packages of vdsm, libvirt and qemu -<br>
can you try to update<br>
<br>
<br>
<br>
On 02/16/2014 12:33 AM, Steve Dainard wrote:<br>
<br>
Versions are the same:<br>
<br>
[root@ovirt001 ~]# rpm -qa | egrep 'libvirt|vdsm|qemu' | sort<br>
gpxe-roms-qemu-0.9.7-6.10.el6.<u></u>noarch<br>
libvirt-0.10.2-29.el6_5.3.x86_<u></u>64<br>
libvirt-client-0.10.2-29.el6_<u></u>5.3.x86_64<br>
libvirt-lock-sanlock-0.10.2-<u></u>29.el6_5.3.x86_64<br>
libvirt-python-0.10.2-29.el6_<u></u>5.3.x86_64<br>
qemu-img-rhev-0.12.1.2-2.355.<u></u>el6.5.x86_64<br>
qemu-kvm-rhev-0.12.1.2-2.355.<u></u>el6.5.x86_64<br>
qemu-kvm-rhev-tools-0.12.1.2-<u></u>2.355.el6.5.x86_64<br>
vdsm-4.13.3-3.el6.x86_64<br>
vdsm-cli-4.13.3-3.el6.noarch<br>
vdsm-gluster-4.13.3-3.el6.<u></u>noarch<br>
vdsm-python-4.13.3-3.el6.x86_<u></u>64<br>
vdsm-xmlrpc-4.13.3-3.el6.<u></u>noarch<br>
<br>
[root@ovirt002 ~]# rpm -qa | egrep 'libvirt|vdsm|qemu' | sort<br>
gpxe-roms-qemu-0.9.7-6.10.el6.<u></u>noarch<br>
libvirt-0.10.2-29.el6_5.3.x86_<u></u>64<br>
libvirt-client-0.10.2-29.el6_<u></u>5.3.x86_64<br>
libvirt-lock-sanlock-0.10.2-<u></u>29.el6_5.3.x86_64<br>
libvirt-python-0.10.2-29.el6_<u></u>5.3.x86_64<br>
qemu-img-rhev-0.12.1.2-2.355.<u></u>el6.5.x86_64<br>
qemu-kvm-rhev-0.12.1.2-2.355.<u></u>el6.5.x86_64<br>
qemu-kvm-rhev-tools-0.12.1.2-<u></u>2.355.el6.5.x86_64<br>
vdsm-4.13.3-3.el6.x86_64<br>
vdsm-cli-4.13.3-3.el6.noarch<br>
vdsm-gluster-4.13.3-3.el6.<u></u>noarch<br>
vdsm-python-4.13.3-3.el6.x86_<u></u>64<br>
vdsm-xmlrpc-4.13.3-3.el6.<u></u>noarch<br>
<br>
Logs attached, thanks.<br>
<br>
*Steve Dainard *<br>
IT Infrastructure Manager<br>
Miovision <<a href="http://miovision.com/" target="_blank">http://miovision.com/</a>> | /Rethink Traffic/<br>
<br>
*Blog <<a href="http://miovision.com/blog" target="_blank">http://miovision.com/blog</a>> | **LinkedIn<br>
<<a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">https://www.linkedin.com/<u></u>company/miovision-technologies</a><u></u>> |<br>
Twitter <<a href="https://twitter.com/miovision" target="_blank">https://twitter.com/miovision</a><u></u>> | Facebook<br>
<<a href="https://www.facebook.com/miovision" target="_blank">https://www.facebook.com/<u></u>miovision</a>>*<br>
------------------------------<u></u>------------------------------<u></u>------------<br>
Miovision Technologies Inc. | 148 Manitou Drive, Suite 101,<br>
Kitchener, ON, Canada | N2C 1L3<br>
This e-mail may contain information that is privileged or<br>
confidential. If you are not the intended recipient, please<br>
delete the e-mail and any attachments and notify us immediately.<br>
<br>
<br>
On Sat, Feb 15, 2014 at 6:24 AM, Dafna Ron <<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a><br></div></div>
<mailto:<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>> <mailto:<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a><div><div class="h5"><br>
<mailto:<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>>>> wrote:<br>
<br>
the migration fails in libvirt:<br>
<br>
<br>
Thread-153709::ERROR::2014-02-<u></u>14<br>
11:17:40,420::vm::337::vm.Vm::<u></u>(run)<br>
vmId=`08434c90-ffa3-4b63-aa8e-<u></u>5613f7b0e0cd`::Failed to migrate<br>
Traceback (most recent call last):<br>
File "/usr/share/vdsm/vm.py", line 323, in run<br>
self._<u></u>startUnderlyingMigration()<br>
File "/usr/share/vdsm/vm.py", line 403, in<br>
_startUnderlyingMigration<br>
None, maxBandwidth)<br>
File "/usr/share/vdsm/vm.py", line 841, in f<br>
ret = attr(*args, **kwargs)<br>
File<br>
"/usr/lib64/python2.6/site-<u></u>packages/vdsm/<u></u>libvirtconnection.py",<br>
line 76, in wrapper<br>
ret = f(*args, **kwargs)<br>
File "/usr/lib64/python2.6/site-<u></u>packages/libvirt.py",<br>
line 1178,<br>
in migrateToURI2<br>
if ret == -1: raise libvirtError<br>
('virDomainMigrateToURI2()<br>
failed', dom=self)<br>
libvirtError: Unable to read from monitor: Connection<br>
reset by peer<br>
Thread-54041::DEBUG::2014-02-<u></u>14<br>
11:17:41,752::task::579::<u></u>TaskManager.Task::(_<u></u>updateState)<br>
Task=`094c412a-43dc-4c29-a601-<u></u>d759486469a8`::moving from state<br>
init -> state preparing<br>
Thread-54041::INFO::2014-02-14<br>
11:17:41,753::logUtils::44::<u></u>dispatcher::(wrapper) Run and<br>
protect:<br>
getVolumeSize(sdUUID='<u></u>a52938f7-2cf4-4771-acb2-<u></u>0c78d14999e5',<br>
spUUID='fcb89071-6cdb-4972-<u></u>94d1-c9324cebf814',<br>
imgUUID='97c9108f-a506-415f-<u></u>ad2<br>
c-370d707cb130',<br>
volUUID='61f82f7f-18e4-4ea8-<u></u>9db3-71ddd9d4e836',<br>
options=None)<br>
<br>
Do you have the same libvirt/vdsm/qemu on both your hosts?<br>
Please attach the libvirt and vm logs from both hosts.<br>
<br>
Thanks,<br>
Dafna<br>
<br>
<br>
<br>
On 02/14/2014 04:50 PM, Steve Dainard wrote:<br>
<br>
Quick overview:<br>
Ovirt 3.3.2 running on CentOS 6.5<br>
Two hosts: ovirt001, ovirt002<br>
Migrating two VM's: puppet-agent1, puppet-agent2 from<br>
ovirt002<br>
to ovirt001.<br>
<br>
The first VM puppet-agent1 migrates successfully. The<br>
second<br>
VM puppet-agent2 fails with "Migration failed due to<br>
Error:<br>
Fatal error during migration (VM: puppet-agent2, Source:<br>
ovirt002, Destination: ovirt001)."<br>
<br>
I've attached the logs if anyone can help me track<br>
down the issue.<br>
<br>
Thanks,<br>
<br>
*Steve Dainard *<br>
IT Infrastructure Manager<br>
Miovision <<a href="http://miovision.com/" target="_blank">http://miovision.com/</a>> | /Rethink Traffic/<br>
<br>
*Blog <<a href="http://miovision.com/blog" target="_blank">http://miovision.com/blog</a>> | **LinkedIn<br>
<<a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">https://www.linkedin.com/<u></u>company/miovision-technologies</a><u></u>> |<br>
Twitter <<a href="https://twitter.com/miovision" target="_blank">https://twitter.com/miovision</a><u></u>> | Facebook<br>
<<a href="https://www.facebook.com/miovision" target="_blank">https://www.facebook.com/<u></u>miovision</a>>*<br>
------------------------------<u></u>------------------------------<u></u>------------<br>
<br>
<br>
Miovision Technologies Inc. | 148 Manitou Drive, Suite<br>
101,<br>
Kitchener, ON, Canada | N2C 1L3<br>
This e-mail may contain information that is privileged or<br>
confidential. If you are not the intended recipient,<br>
please<br>
delete the e-mail and any attachments and notify us<br>
immediately.<br>
<br>
<br>
______________________________<u></u>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a>><br></div></div>
<mailto:<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a>>><div class=""><br>
<br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/<u></u>mailman/listinfo/users</a><br>
<br>
<br>
<br>
-- Dafna Ron<br>
<br>
<br>
<br>
<br>
-- Dafna Ron<br>
<br>
<br>
</div></blockquote><span class="HOEnZb"><font color="#888888">
<br>
<br>
-- <br>
Dafna Ron<br>
</font></span></blockquote></div><br></div>