
This is a multi-part message in MIME format. --------------651BD8646697326B808E7677 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hi, I have installed latest upstream master on RHEL7.2. When i try to put a host in maintenance which runs HE vm i see that vm does not get migrated to another host and host is stuck in "preparing for maintenace" state. I see the following errors in the vdsm.log . Can you please help me understand why this error is seen? 1. 2016-10-27 16:40:22,742 ERROR (Thread-3293) [virt.vm] (vmId='21e0e248-19bf-47b3-b72f-6a3740d9ff43') Hook script execution failed: internal error: Child process (LC_ALL=C PAT 2. H=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin /etc/libvirt/hooks/qemu HostedEngine migrate begin -) unexpected exit status 1: Traceback (most recent call last): 3. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main 4. _process_domxml(tree) 5. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 80, in _process_domxml 6. _set_graphics(devices, target_vm_conf) 7. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 156, in _set_graphics 8. target_display_network, target_display_ip = _vmconf_display(target_vm_conf) 9. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 177, in _vmconf_display 10. raise VmMigrationHookError('VM conf graphics not detected') 11. VmMigrationHookError: VM conf graphics not detected 12. Traceback (most recent call last): 13. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 201, in <module> 14. main(*sys.argv[1:]) 15. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main 16. _process_domxml(tree) 17. File "/usr/libexec/vdsm/vm_migrate_hoo (migration:261) 18. 2016-10-27 16:40:22,757 ERROR (Thread-3293) [virt.vm] (vmId='21e0e248-19bf-47b3-b72f-6a3740d9ff43') Failed to migrate (migration:390) 19. Traceback (most recent call last): 20. File "/usr/share/vdsm/virt/migration.py", line 372, in run 21. self._startUnderlyingMigration(time.time()) 22. File "/usr/share/vdsm/virt/migration.py", line 447, in _startUnderlyingMigration 23. self._perform_with_downtime_thread(duri, muri) 24. File "/usr/share/vdsm/virt/migration.py", line 498, in _perform_with_downtime_thread 25. self._perform_migration(duri, muri) 26. File "/usr/share/vdsm/virt/migration.py", line 485, in _perform_migration 27. self._vm._dom.migrateToURI3(duri, params, flags) 28. File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 69, in f 29. ret = attr(*args, **kwargs) 30. File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123, in wrapper 31. ret = f(*args, **kwargs) 32. File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 899, in wrapper 33. return func(inst, *args, **kwargs) 34. File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1836, in migrateToURI3 35. : 36. if ret == -1: raise libvirtError ('virDomainMigrateToURI3() failed', dom=self) 37. libvirtError: Hook script execution failed: internal error: Child process (LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin /etc/libvirt/hooks/qemu HostedEngine migrate begin -) unexpected exit status 1: Traceback (most recent call last): 38. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main 39. _process_domxml(tree) 40. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 80, in _process_domxml 41. _set_graphics(devices, target_vm_conf) 42. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 156, in _set_graphics 43. target_display_network, target_display_ip = _vmconf_display(target_vm_conf) 44. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 177, in _vmconf_display 45. raise VmMigrationHookError('VM conf graphics not detected') 46. VmMigrationHookError: VM conf graphics not detected 47. Traceback (most recent call last): 48. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 201, in <module> 49. main(*sys.argv[1:]) 50. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main 51. _process_domxml(tree) 52. File "/usr/libexec/vdsm/vm_migrate_hoo Thanks kasturi. --------------651BD8646697326B808E7677 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> <p>Hi,</p> <p> I have installed latest upstream master on RHEL7.2. When i try to put a host in maintenance which runs HE vm i see that vm does not get migrated to another host and host is stuck in "preparing for maintenace" state. I see the following errors in the vdsm.log . Can you please help me understand why this error is seen? <br> </p> <p> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </p> <ol style="color: rgb(0, 0, 0); font-family: "Liberation Sans", "Lucida Grande", "Luxi Sans", "Bitstream Vera Sans", helvetica, verdana, arial, sans-serif; font-size: 12px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);"> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;">2016-10-27 16:40:22,742 ERROR (Thread-3293) [virt.vm] (vmId='21e0e248-19bf-47b3-b72f-6a3740d9ff43') Hook script execution failed: internal error: Child process (LC_ALL=C PAT</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;">H=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin /etc/libvirt/hooks/qemu HostedEngine migrate begin -) unexpected exit status 1: Traceback (most recent call last):</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> _process_domxml(tree)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 80, in _process_domxml</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> _set_graphics(devices, target_vm_conf)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 156, in _set_graphics</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> target_display_network, target_display_ip = _vmconf_display(target_vm_conf)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 177, in _vmconf_display</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> raise VmMigrationHookError('VM conf graphics not detected')</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;">VmMigrationHookError: VM conf graphics not detected</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;">Traceback (most recent call last):</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 201, in <module></div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> main(*sys.argv[1:])</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> _process_domxml(tree)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hoo (migration:261)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;">2016-10-27 16:40:22,757 ERROR (Thread-3293) [virt.vm] (vmId='21e0e248-19bf-47b3-b72f-6a3740d9ff43') Failed to migrate (migration:390)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;">Traceback (most recent call last):</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/share/vdsm/virt/migration.py", line 372, in run</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> self._startUnderlyingMigration(time.time())</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/share/vdsm/virt/migration.py", line 447, in _startUnderlyingMigration</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> self._perform_with_downtime_thread(duri, muri)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/share/vdsm/virt/migration.py", line 498, in _perform_with_downtime_thread</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> self._perform_migration(duri, muri)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/share/vdsm/virt/migration.py", line 485, in _perform_migration</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> self._vm._dom.migrateToURI3(duri, params, flags)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 69, in f</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> ret = attr(*args, **kwargs)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123, in wrapper</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> ret = f(*args, **kwargs)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 899, in wrapper</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> return func(inst, *args, **kwargs)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1836, in migrateToURI3</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;">:</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> if ret == -1: raise libvirtError ('virDomainMigrateToURI3() failed', dom=self)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;">libvirtError: Hook script execution failed: internal error: Child process (LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin /etc/libvirt/hooks/qemu HostedEngine migrate begin -) unexpected exit status 1: Traceback (most recent call last):</div> </li> <li style="font-weight: normal; vertical-align: top; background: rgb(240, 240, 240);"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> _process_domxml(tree)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 80, in _process_domxml</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> _set_graphics(devices, target_vm_conf)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 156, in _set_graphics</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> target_display_network, target_display_ip = _vmconf_display(target_vm_conf)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 177, in _vmconf_display</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> raise VmMigrationHookError('VM conf graphics not detected')</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;">VmMigrationHookError: VM conf graphics not detected</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;">Traceback (most recent call last):</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 201, in <module></div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> main(*sys.argv[1:])</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> _process_domxml(tree)</div> </li> <li style="font-weight: normal; vertical-align: top;"> <div style="font-style: normal; font-variant: normal; font-weight: normal; font-stretch: normal; font-size: 1em; line-height: 1.2em; font-family: monospace; margin: 0px; padding: 0px; vertical-align: top; background: none;"> File "/usr/libexec/vdsm/vm_migrate_hoo</div> </li> </ol> <p>Thanks</p> <p>kasturi.<br> </p> </body> </html> --------------651BD8646697326B808E7677--