Thanks Marcin. I think we made a progress, former qemu spice TLS port error is now gone with this hook. Now its seems like py3 issue for hooks handling: 2019-07-29 09:29:54,981-0400 INFO (vm/f62ae48a) [vds] prepared volume path: /rhev/data-center/mnt/10.35.0.136:_exports_data/8a68eacc-0e0e-436a-bb25-c498c9f5f749/images/111de599-2afa-4dbb-9a99-3378ece66187/61e1e186-f289-4ffa-b59e-af90bde5db65 (clientIF:501) 2019-07-29 09:29:54,982-0400 INFO (vm/f62ae48a) [virt.vm] (vmId='f62ae48a-4e6f-4763-9a66-48e04708a2b5') Enabling drive monitoring (drivemonitor:56) 2019-07-29 09:29:55,052-0400 WARN (vm/f62ae48a) [root] Attempting to add an existing net user: ovirtmgmt/f62ae48a-4e6f-4763-9a66-48e04708a2b5 (libvirtnetwork:192) 2019-07-29 09:29:55,054-0400 INFO (vm/f62ae48a) [virt.vm] (vmId='f62ae48a-4e6f-4763-9a66-48e04708a2b5') drive 'hdc' path: 'file=' -> '*file=' (storagexml:333) 2019-07-29 09:29:55,054-0400 INFO (vm/f62ae48a) [virt.vm] (vmId='f62ae48a-4e6f-4763-9a66-48e04708a2b5') drive 'vda' path: 'file=/rhev/data-center/dab8cf3a-a969-11e9-84eb-080027624b78/8a68eacc-0e0e-436a-bb25-c498c9f5f749/images/111de599-2afa-4dbb-9a99-3378ece66187/61e1e186-f289-4ffa-b59e-af90bde5db65' -> '*file=/rhev/data-center/mnt/10.35.0.136:_exports_data/8a68eacc-0e0e-436a-bb25-c498c9f5f749/images/111de599-2afa-4dbb-9a99-3378ece66187/61e1e186-f289-4ffa-b59e-af90bde5db65' (storagexml:333) 2019-07-29 09:29:55,056-0400 ERROR (vm/f62ae48a) [virt.vm] (vmId='f62ae48a-4e6f-4763-9a66-48e04708a2b5') The vm start process failed (vm:841) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/virt/vm.py", line 775, in _startUnderlyingVm self._run() File "/usr/lib/python3.6/site-packages/vdsm/virt/vm.py", line 2564, in _run final_callback=self._updateDomainDescriptor) File "/usr/lib/python3.6/site-packages/vdsm/common/hooks.py", line 159, in before_vm_start raiseError=False, errors=errors) File "/usr/lib/python3.6/site-packages/vdsm/common/hooks.py", line 79, in _runHooksDir os.write(data_fd, data or '') TypeError: a bytes-like object is required, not 'str' On Mon, Jul 29, 2019 at 4:16 PM Marcin Sobczyk <msobczyk@redhat.com> wrote:
On 7/29/19 1:14 PM, Amit Bawer wrote:
Reviving the mail-thread, checking for Non-TLS host-engine communication resolution:
Current master base for PoC RHEL8 host is:
commit cfe7b11c71c1bf0dada89a8209c8d544b0d0f138 (vdsm-master/master) Author: Marcin Sobczyk <msobczyk@redhat.com> Date: Fri Jul 12 12:54:57 2019 +0200
When trying to "Run" VM on RHEL8 vdsm.log shows following failure trace:
9-07-29 06:58:49,140-0400 INFO (vm/f62ae48a) [virt.vm] (vmId='f62ae48a-4e6f-4763-9a66-48e04708a2b5') <?xml version='1.0' encoding='utf-8'?> <domain xmlns:ns0="http://ovirt.org/vm/tune/1.0" xmlns:ovirt-vm=" http://ovirt.org/vm/1.0" type="kvm"> <name>vm1</name> <uuid>f62ae48a-4e6f-4763-9a66-48e04708a2b5</uuid> <memory>1048576</memory> <currentMemory>1048576</currentMemory> <iothreads>1</iothreads> <maxMemory slots="16">4194304</maxMemory> <vcpu current="1">16</vcpu> <sysinfo type="smbios"> <system> <entry name="manufacturer">oVirt</entry> <entry name="product">RHEL</entry> <entry name="version">8.0-0.44.el8</entry> <entry name="serial">e5825ba8-473e-4821-829a-bc6dbbe79617</entry> <entry name="uuid">f62ae48a-4e6f-4763-9a66-48e04708a2b5</entry> </system> </sysinfo> <clock adjustment="0" offset="variable"> <timer name="rtc" tickpolicy="catchup" /> <timer name="pit" tickpolicy="delay" /> <timer name="hpet" present="no" /> </clock> <features> <acpi /> </features> <cpu match="exact"> <model>SandyBridge</model> <topology cores="1" sockets="16" threads="1" /> <numa> <cell cpus="0-15" id="0" memory="1048576" /> </numa> </cpu> <cputune /> <devices> <input bus="usb" type="tablet" /> <channel type="unix"> <target name="ovirt-guest-agent.0" type="virtio" /> <source mode="bind" path="/var/lib/libvirt/qemu/channels/f62ae48a-4e6f-4763-9a66-48e04708a2b5.ovirt-guest-agent.0" /> </channel> <channel type="unix"> <target name="org.qemu.guest_agent.0" type="virtio" /> <source mode="bind" path="/var/lib/libvirt/qemu/channels/f62ae48a-4e6f-4763-9a66-48e04708a2b5.org.qemu.guest_agent.0" /> </channel> <rng model="virtio"> <backend model="random">/dev/urandom</backend> <alias name="ua-06642ecb-5d30-4119-a939-ee8792dee24b" /> </rng> <video> <model heads="1" ram="65536" type="qxl" vgamem="16384" vram="8192" /> <alias name="ua-5b36baa2-cc27-4840-b309-bd1a4bbbab2c" /> </video> <graphics autoport="yes" keymap="en-us" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" type="vnc"> <listen network="vdsm-ovirtmgmt" type="network" /> </graphics> <memballoon model="virtio"> <stats period="5" /> <alias name="ua-b1b3f8c9-0d05-4675-9ab5-28a228d68c54" /> </memballoon> <graphics autoport="yes" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> <channel mode="secure" name="main" /> <channel mode="secure" name="inputs" /> <channel mode="secure" name="cursor" /> <channel mode="secure" name="playback" /> <channel mode="secure" name="record" /> <channel mode="secure" name="display" /> <channel mode="secure" name="smartcard" /> <channel mode="secure" name="usbredir" /> <listen network="vdsm-ovirtmgmt" type="network" /> </graphics> <channel type="spicevmc"> <target name="com.redhat.spice.0" type="virtio" /> </channel> <disk device="cdrom" snapshot="no" type="file"> <driver error_policy="report" name="qemu" type="raw" /> <source file="" startupPolicy="optional"> <seclabel model="dac" relabel="no" type="none" /> </source> <target bus="ide" dev="hdc" /> <readonly /> <alias name="ua-ffd6c93f-62e0-4d6d-a510-03e8a02644ad" /> </disk> <disk device="disk" snapshot="no" type="file"> <target bus="virtio" dev="vda" /> <source file="/rhev/data-center/mnt/10.35.0.136: _exports_data/8a68eacc-0e0e-436a-bb25-c498c9f5f749/images/111de599-2afa-4dbb-9a99-3378ece66187/61e1e186-f289-4ffa-b59e-af90bde5db65"> <seclabel model="dac" relabel="no" type="none" /> </source> <driver cache="none" error_policy="stop" io="threads" iothread="1" name="qemu" type="raw" /> <alias name="ua-111de599-2afa-4dbb-9a99-3378ece66187" /> <serial>111de599-2afa-4dbb-9a99-3378ece66187</serial> </disk> </devices> <pm> <suspend-to-disk enabled="no" /> <suspend-to-mem enabled="no" /> </pm> <os> <type arch="x86_64" machine="pc-i440fx-rhel7.6.0">hvm</type> <smbios mode="sysinfo" /> </os> <metadata> <ns0:qos /> <ovirt-vm:vm> <ovirt-vm:minGuaranteedMemoryMb type="int">1024</ovirt-vm:minGuaranteedMemoryMb> <ovirt-vm:clusterVersion>4.4</ovirt-vm:clusterVersion> <ovirt-vm:custom /> <ovirt-vm:device devtype="disk" name="vda">
<ovirt-vm:poolID>dab8cf3a-a969-11e9-84eb-080027624b78</ovirt-vm:poolID>
<ovirt-vm:volumeID>61e1e186-f289-4ffa-b59e-af90bde5db65</ovirt-vm:volumeID>
<ovirt-vm:imageID>111de599-2afa-4dbb-9a99-3378ece66187</ovirt-vm:imageID>
<ovirt-vm:domainID>8a68eacc-0e0e-436a-bb25-c498c9f5f749</ovirt-vm:domainID> </ovirt-vm:device> <ovirt-vm:launchPaused>false</ovirt-vm:launchPaused> <ovirt-vm:resumeBehavior>auto_resume</ovirt-vm:resumeBehavior> </ovirt-vm:vm> </metadata> </domain> (vm:2570) 2019-07-29 06:58:49,845-0400 ERROR (vm/f62ae48a) [virt.vm] (vmId='f62ae48a-4e6f-4763-9a66-48e04708a2b5') The vm start process failed (vm:841) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/virt/vm.py", line 775, in _startUnderlyingVm self._run() File "/usr/lib/python3.6/site-packages/vdsm/virt/vm.py", line 2575, in _run dom.createWithFlags(flags) File "/usr/lib/python3.6/site-packages/vdsm/common/libvirtconnection.py", line 131, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/common/function.py", line 94, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python3.6/site-packages/libvirt.py", line 1110, in createWithFlags if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) libvirt.libvirtError: unsupported configuration: Auto allocation of spice TLS port requested but spice TLS is disabled in qemu.conf 2019-07-29 06:58:49,845-0400 INFO (vm/f62ae48a) [virt.vm] (vmId='f62ae48a-4e6f-4763-9a66-48e04708a2b5') Changed state to Down: unsupported configuration: Auto allocation of spice TLS port requested but spice TLS is disabled in qemu.conf (code=1) (vm:1595) 2019-07-29 06:58:49,875-0400 INFO (vm/f62ae48a) [virt.vm] (vmId='f62ae48a-4e6f-4763-9a66-48e04708a2b5') Stopping connection (guestagent:455) 2019-07-29 06:58:49,875-0400 DEBUG (vm/f62ae48a) [jsonrpc.Notification] Sending event {"jsonrpc": "2.0", "method": "|virt|VM_status|f62ae48a-4e6f-4763-9a66-48e04708a2b5", "params": {"f62ae48a-4e6f-4763-9a66-48e04708a2b5": {"status": "Down", "vmId": "f62ae48a-4e6f-4763-9a66-48e04708a2b5", "exitCode": 1, "exitMessage": "unsupported configuration: Auto allocation of spice TLS port requested but spice TLS is disabled in qemu.conf", "exitReason": 1}, "notify_time": 4883259290}} (__init__:181)
I'm definitely not a libvirt expert and not sure if it will work, but if you have my 'py3-hooks' patch in your tree and per [1], you can tree forcing the VM to run with insecure spice:
cat << EOF > /usr/libexec/vdsm/hooks/before_vm_start/insecure_spice.sh
#!/bin/bash
sed -i 's/secure/insecure/' "$_hook_domxml" sed -i 's/tlsPort="-1"//' "$_hook_domxml"
EOF
chmod +x /usr/libexec/vdsm/hooks/before_vm_start/insecure_spice.sh
[1] https://github.com/libvirt/libvirt/blob/3f93884a4d047a012b968c62b94ea07dadd1...
On Wed, Jul 24, 2019 at 12:09 PM Amit Bawer <abawer@redhat.com> wrote:
On Wed, Jul 24, 2019 at 12:02 PM Michal Skrivanek < michal.skrivanek@redhat.com> wrote:
On 24 Jul 2019, at 10:36, Amit Bawer <abawer@redhat.com> wrote:
Per +Milan Zamazal <mzamazal@redhat.com> comment, adding +devel <devel@ovirt.org>
On Wed, Jul 24, 2019 at 11:32 AM Michal Skrivanek < michal.skrivanek@redhat.com> wrote:
On 24 Jul 2019, at 10:24, Amit Bawer <abawer@redhat.com> wrote:
Thanks, applied the fixed patch.
No I am punished for choosing not to work with SSL/TLS in Vdsm when trying to "Run" VM. - Any known workaround for this?
yes, vdsm-tool reconfigure
"vdsm-tool reconfigure" is not a valid option.
That’s part of the ongoing fixes, please don’t discuss this privately, this belongs to devel@ list. Many people are struggling with the same issues while they’re working on their areas, and we need complete visibility
24 04:04:54,610-0400 INFO (vm/01de706d) [virt.vm] (vmId='01de706d-ee4c-484f-a17f-6b3355adf047') <?xml version='1.0' encoding='utf-8'?> <domain xmlns:ns0="http://ovirt.org/vm/tune/1.0" xmlns:ovirt-vm=" http://ovirt.org/vm/1.0" type="kvm"> <name>vm1</name> <uuid>01de706d-ee4c-484f-a17f-6b3355adf047</uuid> <memory>1048576</memory> <currentMemory>1048576</currentMemory> <iothreads>1</iothreads> <maxMemory slots="16">4194304</maxMemory> <vcpu current="1">16</vcpu> <sysinfo type="smbios"> <system> <entry name="manufacturer">oVirt</entry> <entry name="product">RHEL</entry> <entry name="version">8.0-0.44.el8</entry> <entry name="serial">e5825ba8-473e-4821-829a-bc6dbbe79617</entry> <entry name="uuid">01de706d-ee4c-484f-a17f-6b3355adf047</entry> </system> </sysinfo> <clock adjustment="0" offset="variable"> <timer name="rtc" tickpolicy="catchup" /> <timer name="pit" tickpolicy="delay" /> <timer name="hpet" present="no" /> </clock> <features> <acpi /> </features> <cpu match="exact"> <model>SandyBridge</model> <topology cores="1" sockets="16" threads="1" /> <numa> <cell cpus="0-15" id="0" memory="1048576" /> </numa> </cpu> <cputune /> <devices> <input bus="usb" type="tablet" /> <channel type="unix"> <target name="ovirt-guest-agent.0" type="virtio" /> <source mode="bind" path="/var/lib/libvirt/qemu/channels/01de706d-ee4c-484f-a17f-6b3355adf047.ovirt-guest-agent.0" /> </channel> <channel type="unix"> <target name="org.qemu.guest_agent.0" type="virtio" /> <source mode="bind" path="/var/lib/libvirt/qemu/channels/01de706d-ee4c-484f-a17f-6b3355adf047.org.qemu.guest_agent.0" /> </channel> <rng model="virtio"> <backend model="random">/dev/urandom</backend> <alias name="ua-117e932d-e465-40d6-9005-bf7d7eb22023" /> </rng> <graphics autoport="yes" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> <channel mode="secure" name="main" /> <channel mode="secure" name="inputs" /> <channel mode="secure" name="cursor" /> <channel mode="secure" name="playback" /> <channel mode="secure" name="record" /> <channel mode="secure" name="display" /> <channel mode="secure" name="smartcard" /> <channel mode="secure" name="usbredir" /> <listen network="vdsm-ovirtmgmt" type="network" /> </graphics> <controller index="0" model="piix3-uhci" type="usb" /> <controller index="0" model="virtio-scsi" type="scsi"> <driver iothread="1" /> <alias name="ua-73437643-3c01-4763-b8ef-c4275527606b" /> </controller> <graphics autoport="yes" keymap="en-us" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" type="vnc"> <listen network="vdsm-ovirtmgmt" type="network" /> </graphics> <memballoon model="virtio"> <stats period="5" /> <alias name="ua-93d69b50-e010-4879-80db-713ee4a11727" /> </memballoon> <controller index="0" ports="16" type="virtio-serial"> <alias name="ua-cd3edc3f-25c5-4fef-b555-cedf45c86adc" /> </controller> <video> <model heads="1" ram="65536" type="qxl" vgamem="16384" vram="8192" /> <alias name="ua-d660095f-dfe6-4f2c-aa76-c3525fb6244e" /> </video> <channel type="spicevmc"> <target name="com.redhat.spice.0" type="virtio" /> </channel> <disk device="cdrom" snapshot="no" type="file"> <driver error_policy="report" name="qemu" type="raw" /> <source file="" startupPolicy="optional"> <seclabel model="dac" relabel="no" type="none" /> </source> <target bus="ide" dev="hdc" /> <readonly /> <alias name="ua-917aea8a-bc4b-4d15-8580-a0c442e925ee" /> </disk> <disk device="disk" snapshot="no" type="file"> <target bus="scsi" dev="sda" /> <source file="/rhev/data-center/mnt/10.35.1.6: _exports_data/f49de997-9fb7-4ef8-82bd-f5b97ba31fb0/images/7dee6442-1838-48dd-892a-86fb96a85737/da070fc0-4af5-406e-bf2b-2cf4d89eb276"> <seclabel model="dac" relabel="no" type="none" /> </source> <driver cache="none" error_policy="stop" io="threads" name="qemu" type="raw" /> <alias name="ua-7dee6442-1838-48dd-892a-86fb96a85737" /> <address bus="0" controller="0" target="0" type="drive" unit="0" /> <boot order="1" /> <serial>7dee6442-1838-48dd-892a-86fb96a85737</serial> </disk> </devices> <pm> <suspend-to-disk enabled="no" /> <suspend-to-mem enabled="no" /> </pm> <os> <type arch="x86_64" machine="pc-i440fx-rhel7.6.0">hvm</type> <smbios mode="sysinfo" /> </os> <metadata> <ns0:qos /> <ovirt-vm:vm> <ovirt-vm:minGuaranteedMemoryMb type="int">1024</ovirt-vm:minGuaranteedMemoryMb> <ovirt-vm:clusterVersion>4.4</ovirt-vm:clusterVersion> <ovirt-vm:custom /> <ovirt-vm:device devtype="disk" name="sda">
<ovirt-vm:poolID>dab8cf3a-a969-11e9-84eb-080027624b78</ovirt-vm:poolID>
<ovirt-vm:volumeID>da070fc0-4af5-406e-bf2b-2cf4d89eb276</ovirt-vm:volumeID>
<ovirt-vm:imageID>7dee6442-1838-48dd-892a-86fb96a85737</ovirt-vm:imageID>
<ovirt-vm:domainID>f49de997-9fb7-4ef8-82bd-f5b97ba31fb0</ovirt-vm:domainID> </ovirt-vm:device> <ovirt-vm:launchPaused>false</ovirt-vm:launchPaused>
<ovirt-vm:resumeBehavior>auto_resume</ovirt-vm:resumeBehavior> </ovirt-vm:vm> </metadata> </domain> (vm:2570) 2019-07-24 04:04:55,348-0400 ERROR (vm/01de706d) [virt.vm] (vmId='01de706d-ee4c-484f-a17f-6b3355adf047') The vm start process failed (vm:841) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/virt/vm.py", line 775, in _startUnderlyingVm self._run() File "/usr/lib/python3.6/site-packages/vdsm/virt/vm.py", line 2575, in _run dom.createWithFlags(flags) File "/usr/lib/python3.6/site-packages/vdsm/common/libvirtconnection.py", line 131, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/common/function.py", line 94, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python3.6/site-packages/libvirt.py", line 1110, in createWithFlags if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) libvirt.libvirtError: unsupported configuration: Auto allocation of spice TLS port requested but spice TLS is disabled in qemu.conf 2019-07-24 04:04:55,348-0400 INFO (vm/01de706d) [virt.vm] (vmId='01de706d-ee4c-484f-a17f-6b3355adf047') Changed state to Down: unsupported configuration: Auto allocation of spice TLS port requested but spice TLS is disabled in qemu.conf (code=1) (vm:1595) 2019-07-24 04:04:55,525-0400 INFO (vm/01de706d) [virt.vm] (vmId='01de706d-ee4c-484f-a17f-6b3355adf047') Stopping connection (guestagent:455) 2019-07-24 04:04:55,525-0400 DEBUG (vm/01de706d) [jsonrpc.Notification] Sending event {"jsonrpc": "2.0", "method": "|virt|VM_status|01de706d-ee4c-484f-a17f-6b3355adf047", "params": {"01de706d-ee4c-484f-a17f-6b3355adf047": {"status": "Down", "vmId": "01de706d-ee4c-484f-a17f-6b3355adf047", "exitCode": 1, "exitMessage": "unsupported configuration: Auto allocation of spice TLS port requested but spice TLS is disabled in qemu.conf", "exitReason": 1}, "notify_time": 4440824940}} (__init__:181)