<div dir="ltr"><div><div><div><div>Yes I have a BusID inside the xorg.conf.<br></div>I just tested with virt-manager and indeed it is not a ovirt failure. <br></div>It is something to do with qemu-kvm + nvidia.<br></div>I found here:<a href="https://wiki.debian.org/VGAPassthrough">https://wiki.debian.org/VGAPassthrough</a> that nvidia disables device when it is running on qemu-kvm is it still the case? to overcome that one need to set:<br></div><pre>-cpu host,kvm=off<br></pre><pre>in the command line of qemu.<br></pre><div><div>I was trying to convert virsh commands to qemu native, but it fails on Centos 7 :( <br>virsh dumpxml > render.xml<br>virsh domxml-to-native qemu-argv render.xml <br>error: internal error: invalid PCI passthrough type 'default'<br><br></div><br></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature">***********************************************************<br><br> Dr. Arman Khalatyan eScience -SuperComputing <br> Leibniz-Institut für Astrophysik Potsdam (AIP) <br> An der Sternwarte 16, 14482 Potsdam, Germany <br><br>***********************************************************</div></div>
<br><div class="gmail_quote">On Mon, Jul 11, 2016 at 11:55 AM, Martin Polednik <span dir="ltr"><<a href="mailto:mpolednik@redhat.com" target="_blank">mpolednik@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">On 11/07/16 09:46 +0000, Karli Sjöberg wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
Den 11 jul 2016 11:37 fm skrev Arman Khalatyan <<a href="mailto:arm2arm@gmail.com" target="_blank">arm2arm@gmail.com</a>>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
I just testing several GPUs with pci-passthrough: GTX630, Tesla 2050 and FX5800.<br>
None of them I got running with opengl/direct rendering inside the virtual machine.<br>
I was thinking something to do with qxl driver, but after blacklisting it in the VMs kernel nothing was changed.<br>
The VMs Xorg claiming always no display found even if I configure it with headless option: nvidia-xconfig -a --use-display-device=None --virtual=1280x1024<br>
But with nvidia-smi I can see the GPU status, and I can run all cuda tests where opengl/X11 is not involved.<br>
My test system is CentOS 7 with ovirt 4.<br>
BTW If I clone VM which was not running, to real host on bare metal, everything is running as expecting.<br>
</blockquote>
<br>
Don't remember If this was mentioned but have you tried doing the same thing but with virt-manager on a standalone host, just to rule out oVirt from the equation?<br>
</blockquote>
<br></span>
Also, the xorg must be setup to use the VFIO GPU. There is BusID<br>
option in device section that must point to the guest address of the<br>
GPU. I'm not sure if you've done that (and I'm quite sure it's missing<br>
on the wiki, noted).<br>
<br>
[in the guest]<br>
$ lspci | grep VGA<br>
03:00.0 VGA compatible controller: NVIDIA Corporation GM107GL [Quadro<br>
K2200] (rev a2)<br>
<br>
and using the address, add device section to /etc/X11/xorg.conf<br>
<br>
Section "Device"<br>
Identifier "Device0"<br>
Driver "nvidia"<br>
VendorName "NVIDIA Corporation"<br>
BusID "PCI:3:0:0"<br>
EndSection<br>
<br>
That should allow xorg to use the assigned GPU.<br>
<br>
mpolednik<div class="HOEnZb"><div class="h5"><br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
/K<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
<br>
<br>
<br>
<br>
<br>
<br>
***********************************************************<br>
<br>
Dr. Arman Khalatyan eScience -SuperComputing<br>
Leibniz-Institut für Astrophysik Potsdam (AIP)<br>
An der Sternwarte 16, 14482 Potsdam, Germany<br>
<br>
***********************************************************<br>
<br>
On Mon, Jul 11, 2016 at 9:06 AM, Martin Polednik <<a href="mailto:mpolednik@redhat.com" target="_blank">mpolednik@redhat.com</a>> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
On 08/07/16 11:29 +0200, Michal Skrivanek wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
On 06 Jul 2016, at 14:06, Francesco Romani <<a href="mailto:fromani@redhat.com" target="_blank">fromani@redhat.com</a>> wrote:<br>
<br>
<br>
From: "Arman Khalatyan" <<a href="mailto:arm2arm@gmail.com" target="_blank">arm2arm@gmail.com</a>><br>
To: "users" <<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>><br>
Sent: Monday, July 4, 2016 11:52:24 AM<br>
Subject: [ovirt-users] Is it possible to disable qxl video?<br>
<br>
<br>
Hi,<br>
I am doing PCI Passthrough for GPUs.<br>
Is it possible somehow to disable/remove default video qxl?<br>
thanks,<br>
Arman,.<br>
Hi,<br>
<br>
The 4.0 Vdsm allows you to run a headless VM, meaning a VM without graphic device/frontend.<br>
Not sure Engine allows you that however.<br>
</blockquote>
<br>
<br>
no it doesn’t<br>
</blockquote>
<br>
<br>
Even if engine allowed that, it may not be the correct solution.<br>
<br>
Running headless with PCI passthrough is considered primary VGA<br>
passthrough[1]. Using primary VGA passthrough without OVMF could cause<br>
(will cause) quite a bit of headaches.<br>
<br>
If you really want to try that, I assume using before_vm_start hook to<br>
remove the video device should be enough.<br>
<br>
[1] <a href="http://wiki.xenproject.org/wiki/Xen_VGA_Passthrough" rel="noreferrer" target="_blank">http://wiki.xenproject.org/wiki/Xen_VGA_Passthrough</a> - it's<br>
possible to read about primary and secondary passthrough between the<br>
lines<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
However, if QXL is the problem (why is that so?) then you can switch to VGA(or CIRRUS if this is still 3.6)<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
I'm afraid you will need to write a Vdsm hook.<br>
<br>
There could be simpler solutions depending on the Engine<br>
<br>
Bests,<br>
<br>
--<br>
Francesco Romani<br>
RedHat Engineering Virtualization R & D<br>
Phone: 8261328<br>
IRC: fromani<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a>><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a> <<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a>><br>
</blockquote></blockquote>
<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
</blockquote>
<br>
<br>
</blockquote>
<br>
</blockquote></blockquote>
</div></div></blockquote></div><br></div>