[Users] oVirt Solaris support
René Koch (ovido)
r.koch at ovido.at
Mon Sep 16 14:39:47 UTC 2013
On Mon, 2013-09-16 at 15:14 +0100, Dan Kenigsberg wrote:
> On Mon, Sep 16, 2013 at 12:33:34PM +0200, René Koch (ovido) wrote:
> >
> > On Fri, 2013-09-06 at 22:26 +0100, Dan Kenigsberg wrote:
> >
> > > On Fri, Sep 06, 2013 at 06:23:42PM +0200, René Koch (ovido) wrote:
> > > > Hi,
> > > >
> > > > I want to start the discussion about Solaris support on oVirt again, as
> > > > there was no solution for it yet.
> > > >
> > > > On my oVirt 3.2.2 environment I installed Solaris 11 U1 with the
> > > > following specs:
> > > > * Operating System: Other
> > > > * nic1: rtl8139
> > > > * Disk1: IDE (Thin Provision)
> > > > * Host: CentOS 6.4 with qemu-kvm-0.12.1.2-2.355.0.1.el6.centos.7.x86_64
> > > >
> > > > These are the same settings as on my RHEL 6.4 KVM host (except I can
> > > > choose Solaris 10 as OS in virt-manager), which has KVM version:
> > > > qemu-kvm-rhev-0.12.1.2-2.295.el6_3.2.x86_64 (I wanted to use this host
> > > > as a RHEV host, so the qemu-kvm-rhev package is installed in case you
> > > > wounder)...
> > > >
> > > > What's working:
> > > > * OS installation on IDE disk
> > > > * Bringing up network interface
> > > >
> > > > What's not working on oVirt:
> > > > * Network connections - on RHEL 6.4 with plain libvirt/kvm this is
> > > > working...
> > > >
> > > >
> > > > I can see the mac address on my CentOS host, but can't ping the Solaris
> > > > vm:
> > > >
> > > > # brctl showmacs ovirtmgmt | egrep '00:99:4a:00:64:83|port'
> > > > port no mac addr is local? ageing timer
> > > > 2 00:99:4a:00:64:83 no 10.72
> > > >
> > > > # arp -an | grep '00:99:4a:00:64:83'
> > > > ? (10.0.100.123) at 00:99:4a:00:64:83 [ether] on ovirtmgmt
> > > >
> > > > When using tcpdump on the vnet interface which belongs to the Solaris vm
> > > > (ip 10.0.100.123) I can see ARP requests from the vm for ip address of
> > > > my CentOS host (10.0.100.42) but no response to it. Same when pinging
> > > > other ips in this network:
> > > >
> > > > # tcpdump -n -i vnet2
> > > > tcpdump: WARNING: vnet2: no IPv4 address assigned
> > > > tcpdump: verbose output suppressed, use -v or -vv for full protocol
> > > > decode
> > > > listening on vnet2, link-type EN10MB (Ethernet), capture size 65535
> > > > bytes
> > > > 18:15:35.987868 ARP, Request who-has 10.0.100.42 (Broadcast) tell
> > > > 10.0.100.123, length 46
> > > > 18:15:36.487399 ARP, Request who-has 10.0.100.42 (Broadcast) tell
> > > > 10.0.100.123, length 46
> > > > 18:15:36.987536 ARP, Request who-has 10.0.100.42 (Broadcast) tell
> > > > 10.0.100.123, length 46
> > > >
> > > > I also compared the qemu-kvm process list on the KVM with the oVirt
> > > > machine and can't see much differences except that oVirt has more
> > > > information like smbios....
> > > > oVirt host:
> > > > /usr/libexec/qemu-kvm
> > > > <snip>
> > > > -netdev tap,fd=27,id=hostnet0
> > > > -device
> > > > rtl8139,netdev=hostnet0,id=net0,mac=00:99:4a:00:64:83,bus=pci.0,addr=0x3
> > > >
> > > > RHEL KVM host:
> > > > /usr/libexec/qemu-kvm
> > > > <snip>
> > > > -netdev tap,fd=32,id=hostnet0
> > > > -device
> > > > rtl8139,netdev=hostnet0,id=net0,mac=52:54:00:51:c2:97,bus=pci.0,addr=0x3
> > > >
> > > > Any suggestions on how to troubleshoot / get Solaris networking running
> > > > is welcome.
> > > > Changing the interface to e1000 doesn't work either.
> >
> >
> >
> > Thanks a lot for your answer and sorry for my late response - I was sick
> > leaving last week.
> >
> >
> > >
> > > - Would you share the output of your `brctl show`?
> >
> >
> > # brctl show
> > bridge name bridge id STP enabled interfaces
> > ;vdsmdummy; 8000.000000000000 no
> > dmz 8000.0025901ad140 no eth0.200
> > ovirtmgmt 8000.0025901ad140 no eth0.100
> > vnet1
> > vnet2
> > setup 8000.0025901ad140 no eth0.500
> > test2 8000.0025901ad140 no eth0.602
> > vnet0
> >
> > vnet1 is a Debian 7 vm which has a perfectly working network.
> > vnet2 is the Solaris 11 vm which can't communicate over the network.
> >
> >
> > > - Particulalry, does the host device with 10.0.100.42 sit on the same
> > > bridge as your Solaris VM?
> >
> >
> > 10.0.100.42 is the ip of the oVirt host and it's ip is configured on
> > this bridge (and reachable from the Debian 7 vm):
> >
> > # ip a | grep ovirt
> > 5: ovirtmgmt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
> > state UNKNOWN
> > inet 10.0.100.42/24 brd 10.0.100.255 scope global ovirtmgmt
> >
> >
> > > - Do you see the who-has packet when sniffing the bridge device?
> >
> >
> >
> > Yes, I can see them:
> > 12:24:16.311218 ARP, Request who-has 10.0.100.42 (Broadcast) tell
> > 10.0.100.123, length 46
> > 12:24:16.311246 ARP, Reply 10.0.100.42 is-at 00:25:90:1a:d1:40, length
> > 28
> >
> > I can also see the MAC of the Solaris vm in arp cache of oVirt host:
> > # arp -an
> > ? (10.0.100.123) at 00:99:4a:00:64:83 [ether] on ovirtmgmt
> >
> > But I can't see the MAC address of oVirt host (10.0.100.42) in arp table
> > of the Solaris 11 vm. To be more clear: I can't see any MAC address in
> > ARP table of Solaris vm except the MAC of the vm itself.
> >
> >
> > > - Have yout tried guest-to-guest communication (over the same bridge)?
> >
> >
> > I can communicate from the Debian 7 vm to all hosts in my network, but I
> > can't reach the Solaris 11 vm.
> > The network of the oVirt setup is working fine for Windows and various
> > Linux guests, but not for Solaris.
> >
> > Btw, excatly same behavior on RHEV 3.2 with Solaris 10/11 - Windows and
> > Linux is working as expected, but no networking for Solaris guests...
>
> I'm afraid I'm out of ideas. Is the kernel the same on both hosts?
> Would you reply with the complete qemu commandline? Maybe Michael could
> sport the difference between the working plain-KVM host and the
> non-working oVirt host.
The kernel is not the same:
CentOS 6 (oVirt): 2.6.32-358.18.1.el6.x86_64
RHEL 6 (KVM): 2.6.32-358.11.1.el6.x86_64
But I think it's not kernel related as I successfully ran Solaris on the
KVM server 1 year ago (so kernel was an old RHEL 6.2 or 6.3 kernel) and
didn't worked this time on oVirt 3.1, too (hypervisor was CentOS 6.2 or
6.3 using dreyou's-repository, now I'm running CentOS 6.4 with official
oVirt repository). So many kernel upgrades later Solaris still has a
working network on plain KVM but not on oVirt 3.2 or RHEV 3.2.
Here's the complete qemu cmd:
RHEL 6.4 (plain KVM - Solaris networking is fine):
/usr/libexec/qemu-kvm -name solaris11 -S -M rhel6.3.0 -enable-kvm -m
1024 -smp 1,sockets=1,cores=1,threads=1 -uuid
e7d3b9a4-8605-dc4f-9092-41d68dd83735 -nodefconfig -nodefaults -chardev
socket,id=charmonitor,path=/var/lib/libvirt/qemu/solaris11.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime -no-shutdown -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/libvirt/images/solaris11.img,if=none,id=drive-ide0-0-0,format=raw -device ide-drive,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=1 -drive if=none,media=cdrom,id=drive-ide0-1-0,readonly=on,format=raw -device ide-drive,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -netdev tap,fd=40,id=hostnet0 -device rtl8139,netdev=hostnet0,id=net0,mac=52:54:00:f0:27:d3,bus=pci.0,addr=0x3 -chardev pty,id=charserial0 -device isa-serial,chardev=charserial0,id=serial0 -device usb-tablet,id=input0 -vnc 127.0.0.1:13 -vga cirrus -device intel-hda,id=sound0,bus=pci.0,addr=0x4 -device hda-duplex,id=sound0-codec0,bus=sound0.0,cad=0 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
CentOS 6.4 (oVirt - Solaris can't reach other nodes):
/usr/libexec/qemu-kvm -name solaris11 -S -M rhel6.3.0 -cpu Nehalem
-enable-kvm -m 1024 -smp 1,sockets=1,cores=1,threads=1 -uuid
cbaa0cf5-d9e6-40e4-a269-9dc495f4c0d5 -smbios
type=1,manufacturer=oVirt,product=oVirt
Node,version=6-4.el6.centos.10,serial=54443858-4E54-2500-901A-0025901AD140,uuid=cbaa0cf5-d9e6-40e4-a269-9dc495f4c0d5,sku=solaris11 -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/solaris11.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2013-09-06T15:08:22,driftfix=slew -no-shutdown -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x4 -drive file=/rhev/data-center/484e62d7-7a01-4b5e-aec8-59d366100281/2055b80d-d59d-4fe6-80ec-5499674feed5/images/0786a273-780a-4f58-acc4-9b123953bde8/0c07f1f9-f9c0-4ac0-bfec-bee7a1c35a0b,if=none,id=drive-ide0-0-0,format=raw,serial=0786a273-780a-4f58-acc4-9b123953bde8,cache=none,werror=stop,rerror=stop,aio=threads -device ide-drive,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=1 -drive if=none,media=cdrom,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-drive,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -drive file=/var/run/vdsm/payload/cbaa0cf5-d9e6-40e4-a269-9dc495f4c0d5.f3b4e68b93e9d35d3f17328fae2e178e.img,if=none,media=cdrom,id=drive-ide0-1-1,readonly=on,format=raw,serial= -device ide-drive,bus=ide.1,unit=1,drive=drive-ide0-1-1,id=ide0-1-1 -netdev tap,fd=27,id=hostnet0 -device rtl8139,netdev=hostnet0,id=net0,mac=00:99:4a:00:64:83,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/solaris11.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/solaris11.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev spicevmc,id=charchannel2,name=vdagent -device virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0 -spice port=5902,tls-port=5903,addr=0,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on -k en-us -vga qxl -global qxl-vga.ram_size=67108864 -global qxl-vga.vram_size=67108864 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
Thanks,
René
>
> Regrads,
> Dan.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20130916/17303345/attachment-0001.html>
More information about the Users
mailing list