On Tue, Apr 25, 2017 at 1:00 PM, Evgenia Tokar <etokar@redhat.com> wrote:

It seems that the main issue here is that the graphics device is missing from the engine db.
This causes the generated ovf to not contain a graphics device which in turn makes the vm.conf not have it, and so the console is not available.

So what we need to understand now is what caused the graphics device to disappear and a way to return it.

Did anything out of the regular update flow happened with the vm?

Thanks,

Jenny

It seems not.

Based on log files that I see, the environment was initially installed with 3.6.0 and the engine installed from the ova contained into ovirt-engine-appliance-20151104.0-1.el7.centos.ova

Then I updated the engine with the usual procedure to 3.6.1, 3.6.2, 3.6.3, 3.6.5, 4.0.0.6-1, 4.0.2.6-1, 4.0.2.7-1, 4.0.4.4-1, 4.0.5.5-1, -4.0.6.3-1, 4.1.0.4-1, 4.1.1.8-1

Watching qemu logs on host for the HosteEngine VM I see this:

On 19/11/15 the console seemed to be vnc, based on HostedEngine.log-20170421

-device cirrus-vga,id=video0,bus=pci.0,addr=0x2

full line:

2015-11-19 14:29:33.908+0000: starting up

LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin QEMU_AUDIO_DRV=none /usr/libexec/qem

u-kvm -name HostedEngine -S -machine pc-i440fx-rhel7.2.0,accel=kvm,usb=off -cpu Nehalem -m 16384 -re

altime mlock=off -smp 4,sockets=4,cores=1,threads=1 -uuid 7b0ff898-0a9e-4b97-8292-1d9f2a0a6683 -smbi

os type=1,manufacturer=oVirt,product=oVirt Node,version=7-1.1503.el7.centos.2.8,serial=4C4C4544-0054

-5910-8056-C4C04F30354A,uuid=7b0ff898-0a9e-4b97-8292-1d9f2a0a6683 -no-user-config -nodefaults -chard

ev socket,id=charmonitor,path=/var/lib/libvirt/qemu/HostedEngine.monitor,server,nowait -mon chardev=

charmonitor,id=monitor,mode=control -rtc base=2015-11-19T14:29:33,driftfix=slew -global kvm-pit.lost

_tick_policy=discard -no-hpet -no-reboot -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,add

r=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-se

rial0,bus=pci.0,addr=0x5 -drive file=/tmp/tmpKbdZDZ/seed.iso,if=none,id=drive-ide0-1-0,readonly=on,f

ormat=raw,serial= -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -drive file=/var/

run/vdsm/storage/2025c2ea-6205-4bc1-b29d-745b47f8f806/d6287dfb-27af-461b-ab79-4eb3a45d8c8a/43ee87b9-4293-4d43-beab-582f500667a7,if=none,id=drive-virtio-disk0,format=raw,serial=d6287dfb-27af-461b-ab79-4eb3a45d8c8a,cache=none,werror=stop,rerror=stop,aio=threads -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -netdev tap,fd=27,id=hostnet0,vhost=on,vhostfd=28 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:16:3e:3a:ee:a5,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev socket,id=charchannel2,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.org.ovirt.hosted-engine-setup.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=org.ovirt.hosted-engine-setup.0 -chardev socket,id=charconsole0,path=/var/run/ovirt-vmconsole-console/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.sock,server,nowait -device virtconsole,chardev=charconsole0,id=console0 -vnc 0:0,password -device cirrus-vga,id=video0,bus=pci.0,addr=0x2 -msg timestamp=on

I don't know how and when I set it to spice, but I think I didn't do anything...

The first entry with the word "spice" was here:

2016-07-04 16:01:43.443+0000: starting up libvirt version: 1.2.17, package: 13.el7_2.5 (CentOS Build

System <http://bugs.centos.org>, 2016-06-23-14:23:27, worker1.bsys.centos.org), qemu version: 2.3.0 

(qemu-kvm-ev-2.3.0-31.el7_2.10.1)

LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin QEMU_AUDIO_DRV=spice /usr/libexec/qemu-kvm -name HostedEngine -S -machine pc-i440fx-rhel7.2.0,accel=kvm,usb=off -cpu qemu64,-svm -m 16384 -realtime mlock=off -smp 4,sockets=4,cores=1,threads=1 -uuid 7b0ff898-0a9e-4b97-8292-1d9f2a0a6683 -smbios type=1,manufacturer=oVirt,product=oVirt Node,version=7-2.1511.el7.centos.2.10,serial=4C4C4544-0054-5910-8056-C4C04F30354A,uuid=7b0ff898-0a9e-4b97-8292-1d9f2a0a6683 -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-HostedEngine/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2016-07-04T16:01:43,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-reboot -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 -drive file=/var/run/vdsm/storage/2025c2ea-6205-4bc1-b29d-745b47f8f806/d6287dfb-27af-461b-ab79-4eb3a45d8c8a/43ee87b9-4293-4d43-beab-582f500667a7,if=none,id=drive-virtio-disk0,format=raw,serial=d6287dfb-27af-461b-ab79-4eb3a45d8c8a,cache=none,werror=stop,rerror=stop,aio=threads -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive if=none,id=drive-ide0-1-0,readonly=on,format=raw -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -netdev tap,fd=26,id=hostnet0,vhost=on,vhostfd=27 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:16:3e:3a:ee:a5,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev spicevmc,id=charchannel2,name=vdagent -device virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0 -chardev socket,id=charchannel3,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.org.ovirt.hosted-engine-setup.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=4,chardev=charchannel3,id=channel3,name=org.ovirt.hosted-engine-setup.0 -spice tls-port=5900,addr=0,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=default,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on -device cirrus-vga,id=video0,bus=pci.0,addr=0x2 -msg timestamp=on

notice the 

QEMU_AUDIO_DRV=spice 

but still I have

-device cirrus-vga,id=video0,bus=pci.0,addr=0x2 

while before QEMU_AUDIO_DRV was none

Latest one is getting again the QEMU_AUDIO_DRV=none

2017-04-20 17:11:49.947+0000: starting up libvirt version: 2.0.0, package: 10.el7_3.5 (CentOS BuildSystem <http://bugs.centos.org>, 2017-03-03-02:09:45, c1bm.rdu2.centos.org), qemu version: 2.6.0 (qemu-kvm-ev-2.6.0-28.el7_3.6.1), hostname: ractor.datacenter.polimi.it

LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin QEMU_AUDIO_DRV=none /usr/libexec/qemu-kvm -name guest=HostedEngine,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-8-HostedEngine/master-key.aes -machine pc-i440fx-rhel7.3.0,accel=kvm,usb=off -cpu Nehalem -m 16384 -realtime mlock=off -smp 4,maxcpus=16,sockets=16,cores=1,threads=1 -uuid 7b0ff898-0a9e-4b97-8292-1d9f2a0a6683 -smbios 'type=1,manufacturer=oVirt,product=oVirt Node,version=7-3.1611.el7.centos,serial=4C4C4544-0054-5910-8056-C4C04F30354A,uuid=7b0ff898-0a9e-4b97-8292-1d9f2a0a6683' -nographic -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-8-HostedEngine/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2017-04-20T17:11:49,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-reboot -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 -drive file=/var/run/vdsm/storage/2025c2ea-6205-4bc1-b29d-745b47f8f806/d6287dfb-27af-461b-ab79-4eb3a45d8c8a/43ee87b9-4293-4d43-beab-582f500667a7,format=raw,if=none,id=drive-virtio-disk0,serial=d6287dfb-27af-461b-ab79-4eb3a45d8c8a,cache=none,werror=stop,rerror=stop,aio=threads -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive if=none,id=drive-ide0-1-0,readonly=on -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -netdev tap,fd=30,id=hostnet0,vhost=on,vhostfd=33 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:16:3e:3a:ee:a5,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev socket,id=charchannel2,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.org.ovirt.hosted-engine-setup.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=org.ovirt.hosted-engine-setup.0 -chardev pty,id=charconsole0 -device virtconsole,chardev=charconsole0,id=console0 -object rng-random,id=objrng0,filename=/dev/urandom -device virtio-rng-pci,rng=objrng0,id=rng0,bus=pci.0,addr=0x2 -msg timestamp=on

If I check the date 2016-07-04 when the device changed to spice, I see that it corresponds to the update date from 3.6.5 to 4.0

Jul 04 16:00:02 Installed: ovirt-release40-4.0.0-5.noarch

Jul 04 16:01:29 Installed: relaxngDatatype-1.0-11.el7.noarch

Jul 04 16:01:30 Installed: 1:isorelax-0-0.15.release20050331.el7.noarch

Jul 04 16:01:30 Installed: 1:msv-xsdlib-2013.5.1-6.el7.noarch

Jul 04 16:01:31 Updated: otopi-1.5.0-1.el7.centos.noarch

Jul 04 16:01:32 Installed: 1:msv-msv-2013.5.1-6.el7.noarch

Jul 04 16:01:32 Installed: xpp3-1.1.3.8-11.el7.noarch

Jul 04 16:01:33 Installed: postgresql-jdbc-9.2.1002-5.el7.noarch

Jul 04 16:01:33 Installed: apache-commons-collections-3.2.1-22.el7_2.noarch

Jul 04 16:01:33 Installed: antlr-tool-2.7.7-30.el7.noarch

Jul 04 16:01:34 Installed: bea-stax-1.2.0-9.el7.noarch

Jul 04 16:01:34 Updated: ovirt-engine-lib-4.0.0.6-1.el7.centos.noarch

Jul 04 16:01:35 Updated: ovirt-engine-setup-base-4.0.0.6-1.el7.centos.noarch

Jul 04 16:01:35 Updated: ovirt-engine-setup-plugin-ovirt-engine-common-4.0.0.6-1.el7.centos.noarch

Jul 04 16:01:37 Installed: 1:hsqldb-1.8.1.3-13.el7.noarch

Jul 04 16:01:37 Installed: ws-jaxme-0.5.2-10.el7.noarch

Jul 04 16:01:38 Installed: jdom-1.1.3-6.el7.noarch

Jul 04 16:01:38 Installed: jaxen-1.1.3-11.el7.noarch

Jul 04 16:01:38 Installed: dom4j-1.6.1-20.el7.noarch

Jul 04 16:01:39 Installed: ovirt-engine-dwh-setup-4.0.0-2.git38f5db5.el7.centos.noarch

Jul 04 16:01:40 Installed: ovirt-engine-dwh-4.0.0-2.git38f5db5.el7.centos.noarch

Jul 04 16:01:40 Updated: ovirt-engine-setup-plugin-vmconsole-proxy-helper-4.0.0.6-1.el7.centos.noarch

Jul 04 16:01:42 Updated: ovirt-engine-setup-plugin-ovirt-engine-4.0.0.6-1.el7.centos.noarch

Jul 04 16:01:42 Updated: ovirt-engine-setup-4.0.0.6-1.el7.centos.noarch

Jul 04 16:01:42 Updated: ovirt-engine-setup-plugin-websocket-proxy-4.0.0.6-1.el7.centos.noarch

The latest with "-device cirrus-vga" was this one:

2017-01-11 11:16:55.669+0000: starting up libvirt version: 2.0.0, package: 10.el7_3.2 (CentOS BuildS

ystem <http://bugs.centos.org>, 2016-12-06-19:53:38, c1bm.rdu2.centos.org), qemu version: 2.6.0 (qem

u-kvm-ev-2.6.0-27.1.el7), hostname: ractor.datacenter.polimi.it

LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin QEMU_AUDIO_DRV=spice /usr/libexec/qe

mu-kvm -name guest=HostedEngine,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/va

r/lib/libvirt/qemu/domain-1-HostedEngine/master-key.aes -machine pc-i440fx-rhel7.3.0,accel=kvm,usb=o

ff -cpu qemu64,-svm -m 16384 -realtime mlock=off -smp 4,sockets=4,cores=1,threads=1 -uuid 7b0ff898-0a9e-4b97-8292-1d9f2a0a6683 -smbios 'type=1,manufacturer=oVirt,product=oVirt Node,version=7-3.1611.el7.centos,serial=4C4C4544-0054-5910-8056-C4C04F30354A,uuid=7b0ff898-0a9e-4b97-8292-1d9f2a0a6683' -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-1-HostedEngine/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2017-01-11T11:16:55,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-reboot -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 -drive file=/var/run/vdsm/storage/2025c2ea-6205-4bc1-b29d-745b47f8f806/d6287dfb-27af-461b-ab79-4eb3a45d8c8a/43ee87b9-4293-4d43-beab-582f500667a7,format=raw,if=none,id=drive-virtio-disk0,serial=d6287dfb-27af-461b-ab79-4eb3a45d8c8a,cache=none,werror=stop,rerror=stop,aio=threads -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive if=none,id=drive-ide0-1-0,readonly=on -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -netdev tap,fd=30,id=hostnet0,vhost=on,vhostfd=32 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:16:3e:3a:ee:a5,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev spicevmc,id=charchannel2,name=vdagent -device virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0 -chardev socket,id=charchannel3,path=/var/lib/libvirt/qemu/channels/7b0ff898-0a9e-4b97-8292-1d9f2a0a6683.org.ovirt.hosted-engine-setup.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=4,chardev=charchannel3,id=channel3,name=org.ovirt.hosted-engine-setup.0 -spice tls-port=5900,addr=0,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=default,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on -device cirrus-vga,id=video0,bus=pci.0,addr=0x2 -msg timestamp=on

and the next one was 

2017-02-14 15:22:54.758+0000: shutting down

2017-02-14 15:50:17.173+0000: starting up

Matching yum logs, it was the date when I passed form 4.0.6 to 4.1 (ovirt-engine-4.0.6.3-1.el7.centos.noarch to ovirt-engine-4.1.0.4-1.el7.centos.noarch)

HIH understanding....