[Users] Stack trace caused by FreeBSD client
by Johan Kooijman
Hi all,
Interesting thing I found out this afternoon. I have a FreeBSD 10 guest
with virtio drivers, both disk and net.
The VM works fine, but when I connect over SSH to the VM, I see this stack
trace in messages on the node:
Feb 23 19:19:42 hv3 kernel: ------------[ cut here ]------------
Feb 23 19:19:42 hv3 kernel: WARNING: at net/core/dev.c:1907
skb_warn_bad_offload+0xc2/0xf0() (Tainted: G W --------------- )
Feb 23 19:19:42 hv3 kernel: Hardware name: X9DR3-F
Feb 23 19:19:42 hv3 kernel: igb: caps=(0x12114bb3, 0x0) len=5686
data_len=5620 ip_summed=0
Feb 23 19:19:42 hv3 kernel: Modules linked in: ebt_arp nfs lockd fscache
auth_rpcgss nfs_acl sunrpc bonding 8021q garp ebtable_nat ebtables bridge
stp llc xt_physdev ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 xt_multiport
iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6
xt_state nf_conntrack ip6table_filter ip6_tables ipv6 dm_round_robin
dm_multipath vhost_net macvtap macvlan tun kvm_intel kvm iTCO_wdt
iTCO_vendor_support sg ixgbe mdio sb_edac edac_core lpc_ich mfd_core
i2c_i801 ioatdma igb dca i2c_algo_bit i2c_core ptp pps_core ext4 jbd2
mbcache sd_mod crc_t10dif 3w_sas ahci isci libsas scsi_transport_sas
dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
Feb 23 19:19:42 hv3 kernel: Pid: 15280, comm: vhost-15276 Tainted: G
W --------------- 2.6.32-431.5.1.el6.x86_64 #1
Feb 23 19:19:42 hv3 kernel: Call Trace:
Feb 23 19:19:42 hv3 kernel: <IRQ> [<ffffffff81071e27>] ?
warn_slowpath_common+0x87/0xc0
Feb 23 19:19:42 hv3 kernel: [<ffffffff81071f16>] ?
warn_slowpath_fmt+0x46/0x50
Feb 23 19:19:42 hv3 kernel: [<ffffffffa016c862>] ?
igb_get_drvinfo+0x82/0xe0 [igb]
Feb 23 19:19:42 hv3 kernel: [<ffffffff8145b1d2>] ?
skb_warn_bad_offload+0xc2/0xf0
Feb 23 19:19:42 hv3 kernel: [<ffffffff814602c1>] ?
__skb_gso_segment+0x71/0xc0
Feb 23 19:19:42 hv3 kernel: [<ffffffff81460323>] ? skb_gso_segment+0x13/0x20
Feb 23 19:19:42 hv3 kernel: [<ffffffff814603cb>] ?
dev_hard_start_xmit+0x9b/0x480
Feb 23 19:19:42 hv3 kernel: [<ffffffff8147bf5a>] ?
sch_direct_xmit+0x15a/0x1c0
Feb 23 19:19:42 hv3 kernel: [<ffffffff81460a58>] ?
dev_queue_xmit+0x228/0x320
Feb 23 19:19:42 hv3 kernel: [<ffffffffa035a898>] ?
br_dev_queue_push_xmit+0x88/0xc0 [bridge]
Feb 23 19:19:42 hv3 kernel: [<ffffffffa035a928>] ?
br_forward_finish+0x58/0x60 [bridge]
Feb 23 19:19:42 hv3 kernel: [<ffffffffa035a9da>] ? __br_forward+0xaa/0xd0
[bridge]
Feb 23 19:19:42 hv3 kernel: [<ffffffff814897b6>] ? nf_hook_slow+0x76/0x120
Feb 23 19:19:42 hv3 kernel: [<ffffffffa035aa5d>] ? br_forward+0x5d/0x70
[bridge]
Feb 23 19:19:42 hv3 kernel: [<ffffffffa035ba6b>] ?
br_handle_frame_finish+0x17b/0x2a0 [bridge]
Feb 23 19:19:42 hv3 kernel: [<ffffffffa035bd3a>] ?
br_handle_frame+0x1aa/0x250 [bridge]
Feb 23 19:19:42 hv3 kernel: [<ffffffff8145b7c9>] ?
__netif_receive_skb+0x529/0x750
Feb 23 19:19:42 hv3 kernel: [<ffffffff8145ba8a>] ?
process_backlog+0x9a/0x100
Feb 23 19:19:42 hv3 kernel: [<ffffffff81460d43>] ? net_rx_action+0x103/0x2f0
Feb 23 19:19:42 hv3 kernel: [<ffffffff8107a8e1>] ? __do_softirq+0xc1/0x1e0
Feb 23 19:19:42 hv3 kernel: [<ffffffff8100c30c>] ? call_softirq+0x1c/0x30
Feb 23 19:19:42 hv3 kernel: <EOI> [<ffffffff8100fa75>] ?
do_softirq+0x65/0xa0
Feb 23 19:19:42 hv3 kernel: [<ffffffff814611c8>] ? netif_rx_ni+0x28/0x30
Feb 23 19:19:42 hv3 kernel: [<ffffffffa01a0749>] ? tun_sendmsg+0x229/0x4ec
[tun]
Feb 23 19:19:42 hv3 kernel: [<ffffffffa027bcf5>] ? handle_tx+0x275/0x5e0
[vhost_net]
Feb 23 19:19:42 hv3 kernel: [<ffffffffa027c095>] ? handle_tx_kick+0x15/0x20
[vhost_net]
Feb 23 19:19:42 hv3 kernel: [<ffffffffa027955c>] ? vhost_worker+0xbc/0x140
[vhost_net]
Feb 23 19:19:42 hv3 kernel: [<ffffffffa02794a0>] ? vhost_worker+0x0/0x140
[vhost_net]
Feb 23 19:19:42 hv3 kernel: [<ffffffff8109aee6>] ? kthread+0x96/0xa0
Feb 23 19:19:42 hv3 kernel: [<ffffffff8100c20a>] ? child_rip+0xa/0x20
Feb 23 19:19:42 hv3 kernel: [<ffffffff8109ae50>] ? kthread+0x0/0xa0
Feb 23 19:19:42 hv3 kernel: [<ffffffff8100c200>] ? child_rip+0x0/0x20
Feb 23 19:19:42 hv3 kernel: ---[ end trace e93142595d6ecfc7 ]---
This is 100% reproducable, every time. The login itself works just fine.
Some more info:
[root@hv3 ~]# uname -a
Linux hv3.ovirt.gs.cloud.lan 2.6.32-431.5.1.el6.x86_64 #1 SMP Wed Feb 12
00:41:43 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
[root@hv3 ~]# rpm -qa | grep vdsm
vdsm-4.13.3-3.el6.x86_64
vdsm-xmlrpc-4.13.3-3.el6.noarch
vdsm-python-4.13.3-3.el6.x86_64
vdsm-cli-4.13.3-3.el6.noarch
--
Met vriendelijke groeten / With kind regards,
Johan Kooijman
E mail(a)johankooijman.com
10 years, 10 months
[Users] Vm's being paused
by Neil
Hi guys,
I've had two different Vm's randomly pause this past week and inside ovirt
the error received is something like 'vm ran out of storage and was
paused'. Resuming the vm's didn't work and I had to force them off and then
on which resolved the issue.
Has anyone had this issue before?
I realise this is very vague so if you could please let me know which logs
to send in.
Thank you
Regards.
Neil Wilson
10 years, 10 months
[Users] Setting up a test enviroment
by Andy Michielsen
Hello,
I 'm starting to set up an ovirt enviroment to provide our test users a
free but decent setup.
I have two servers and I would like to use one for NFS storage because of
the availability of 1 Tb and the the other server only as a node. I'm not
sure where to install the ovirt-engine on.
The NFS server has two quadcores and 32 Gb of RAM and 6 NIC's
The Node has two sixcores and 64 Gb of RAM and only 2 NIC's
Kind regards.
10 years, 10 months
[Users] Fwd: Sample code for setting NIC - CloudInit
by Tejesh M
Hi,
Can someone share me sample java code for assigning IP address for VM on
eth0 through Java SDK via CloudInit ?
*Something Like this but in Java:*
<network_configuration>
<nics>
<nic>
<name>eth0</name>
<boot_protocol>STATIC</boot_protocol>
<network>
<ip address="192.168.2.11" netmask="255.255.0.0"
gateway="192.168.2.1" />
</network>
<on_boot>true</on_boot>
</nic>
<nic>
<name>eth1</name>
<boot_protocol>DHCP</boot_protocol>
</nic>
<nic>
<name>eth2</name>
<boot_protocol>NONE</boot_protocol>
<on_boot>true</on_boot>
</nic>
</nics>
<dns>
<servers>
<host>
<address>1.1.2.2</address>
</host>
<host>
<address>1.2.3.4</address>
</host>
</servers>
<search_domains>
<host>
<address>qa.lab</address>
</host>
<host>
<address>google.com</address>
</host>
</search_domains>
</dns>
</network_configuration>
--
Thanks & Regards
Tejesh
10 years, 10 months
[Users] (no subject)
by Koen Vanoppen
Hey Guys,
I'm back ;-). This time I have a question from one of our programmers.
He's trying this:
http://www.ovirt.org/How_to_Connect_to_SPICE_Console_Without_Portal#Conne...
But he bumps into this:
Connect to the client again (again, r-v will ask for the password in a
pop-up window):
bash$ *remote-viewer --spice-ca-file ${CA_FILE} --spice-host-subject
"${SUBJECT}" spice://${HOST}/?port=${PORT}\&tls-port=${SPORT}*
Now, the question is.... What's the password? Or where can I find it?
Kind regards,
Koen
10 years, 10 months
[Users] Cancel Disk Migration
by Maurice James
--_e40eed59-1695-41ec-8813-05dd7a436720_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
how do I cancel a live disk migration. I have a 13GB disk that I was trying=
to move between storage domains and looks like its hung up
=
--_e40eed59-1695-41ec-8813-05dd7a436720_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<style><!--
.hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 12pt=3B
font-family:Calibri
}
--></style></head>
<body class=3D'hmmessage'><div dir=3D'ltr'>how do I cancel a live disk migr=
ation. I have a 13GB disk that I was trying to move between storage domains=
and looks like its hung up<br> </div></body>
</html>=
--_e40eed59-1695-41ec-8813-05dd7a436720_--
10 years, 10 months
[Users] Cannot delete storage connection
by sirin
Hi all,
i have next connection
<storage_connections>
<storage_connection href="/api/storageconnections/d94d9341-6116-4b1a-94c5-5c3327aa1b09" id="d94d9341-6116-4b1a-94c5-5c3327aa1b09»>
<address>192.168.0.171</address>
<type>nfs</type>
<path>/srv/lstore/vm</path>
</storage_connection>
<storage_connection href="/api/storageconnections/67539ba5-9b6d-46df-8c96-4acd3f212f4a" id="67539ba5-9b6d-46df-8c96-4acd3f212f4a»>
<address>rhevm.cebra.lab</address>
<type>nfs</type>
<path>/var/lib/exports/iso</path>
</storage_connection>
<storage_connection href="/api/storageconnections/fdc92419-b278-4b11-9eba-f68fd4914132" id="fdc92419-b278-4b11-9eba-f68fd4914132»>
<address>192.168.0.171</address>
<type>nfs</type>
<path>/srv/store/vm</path>
</storage_connection>
<storage_connection href="/api/storageconnections/92fc6cf3-17b1-4b69-af80-5782270137ed" id="92fc6cf3-17b1-4b69-af80-5782270137ed»>
<address>192.168.0.171</address>
<type>nfs</type>
<path>/srv/bstore/vm</path>
</storage_connection>
</storage_connections>
I want to remove this connection id="d94d9341-6116-4b1a-94c5-5c3327aa1b09» but… fail
[RHEVM shell (connected)]# show storageconnection d94d9341-6116-4b1a-94c5-5c3327aa1b09
id : d94d9341-6116-4b1a-94c5-5c3327aa1b09
address: 192.168.0.171
path : /srv/lstore/vm
type : nfs
[RHEVM shell (connected)]# remove storageconnection d94d9341-6116-4b1a-94c5-5c3327aa1b09
error:
status: 404
reason: Not Found
detail: Entity not found: null
[RHEVM shell (connected)]# show storageconnection d94d9341-6116-4b1a-94c5-5c3327aa1b09
id : d94d9341-6116-4b1a-94c5-5c3327aa1b09
address: 192.168.0.171
path : /srv/lstore/vm
type : nfs
okay… i use curl with DELETE
[root@rhevhst ~]# curl -X GET -H "Accept: application/xml" -u admin@internal:<pass> https://192.168.0.170/api/storageconnections/d94d9341-6116-4b1a-94c5-5c33... --insecure
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<storage_connection href="/api/storageconnections/d94d9341-6116-4b1a-94c5-5c3327aa1b09" id="d94d9341-6116-4b1a-94c5-5c3327aa1b09">
<address>192.168.0.171</address>
<type>nfs</type>
<path>/srv/lstore/vm</path>
</storage_connection>
[root@rhevhst ~]#
[root@rhevhst ~]# curl -X DELETE -H "Accept: application/xml" -u admin@internal:<pass> https://192.168.0.170/api/storageconnections/d94d9341-6116-4b1a-94c5-5c33... --insecure
<?xml version="1.0" encoding="UTF-8" standalone="yes"?><fault><reason>Operation Failed</reason><detail>Entity not found: null</detail></fault>
[root@rhevhst ~]#
how i can remove connection?! this is bug?
Artem
10 years, 10 months
[Users] "Last Updated" shows current time instead of last update
by Yedidyah Bar David
Hi all,
Sorry for cross-posting. Not sure what's the correct address to discuss this.
Almost all of the pages on the ovirt.org wiki that have "Last Updated:",
actually have:
Last updated: {{CURRENTMONTHNAME}} {{CURRENTDAY}}, {{CURRENTYEAR}}<!--This is markup for current date, do not change-->
thus showing the current date and not the last change date. When searching
google you see the last time its robot happened to fetch the page.
See e.g. [1] for a (possibly non-complete) list.
Not sure if that's intended or not, but I personally find it useless and
misleading. I guess that someone started it some time ago and everyone else
just copied without caring much. Can all of these lines be removed? If anyone
really wants to know when was the last change, they can use:
http://www.ovirt.org/index.php?title=SOME_TITLE&action=history
(which is easily-accessed from the "Page" menu for logged in users. Not sure
why it's not the same for non-logged-in ones). It might be possible to add
some wiki markup to make it automatically show this, but: 1. I tried a bit
and failed (used [2] as a guide) 2. Not sure it's worth it 3. It will increase
the load on the server.
[1] http://tinyurl.com/nyhgt3j
[2] http://www.mediawiki.org/wiki/Help:Magic_words
Best regards,
--
Didi
10 years, 10 months
Re: [Users] Fwd: Re: Memory usage
by Koen Vanoppen
Bug created
https://bugzilla.redhat.com/show_bug.cgi?id=1068884
Thank you all!
On Feb 22, 2014 2:25 PM, "Koen Vanoppen" <vanoppen.koen(a)gmail.com> wrote:
> Zie facebook :-). Doe dat vandaag nog. Misschien maandag antwoord :-)
> On Feb 22, 2014 12:22 PM, "David Van Zeebroeck" <
> david.van.zeebroeck(a)brusselsairport.be> wrote:
>
>> Maandag is ook goed hoor
>>
>> Schildpad ?
>>
>> On 22-feb.-2014, at 10:57, "Koen Vanoppen" <vanoppen.koen(a)gmail.com>
>> wrote:
>>
>> Komt in orde hoor... Geen probleem. Zal dat vanavond doen. Eerst
>> schildpad gaan halen... ☺.
>>
>>
>>
>> David Van Zeebroeck
>>
>> Product Manager Unix Infrastructure
>>
>> *Brussels Airport Company*
>>
>> T +32 (0)2 753 66 24
>>
>> david.van.zeebroeck(a)brusselsairport.be
>>
>> *www.brusselsairport.be <http://www.brusselsairport.be>*
>>
>>
>>
>>
>>
>> *FOLLOW US ON:*
>>
>> <http://https://nl-nl.facebook.com/BrusselsairportBRU>
>>
>> <http://www.brusselsairport.be/en/mediaroom/brusm/>
>>
>>
>>
>> DISCLAIMER <http://www.brusselsairport.be/en/maildisclaimer/>
>>
>> On Feb 22, 2014 10:51 AM, "david van zeebroeck" <
>> david(a)analytics.brusselsairport.be> wrote:
>>
>>> koen file er een bug voor want ik denk niet dat iemand het gedaan heeft
>>>
>>>
>>> On Fri, Feb 21, 2014 at 12:48 PM, Koen Vanoppen <vanoppen.koen(a)gmail.com
>>> > wrote:
>>>
>>>> I think someone created one. Don't know for sure... What do you think
>>>> it is then?
>>>> On Feb 21, 2014 11:24 AM, "Martin Sivak" <msivak(a)redhat.com> wrote:
>>>>
>>>>> Hi
>>>>>
>>>>> I think I found the issue. I suspect it will happen when you get over
>>>>> 35% of used memory.
>>>>>
>>>>> Can you please create a bug for this issue? Or is there one already?
>>>>>
>>>>> --
>>>>> Martin Sivák
>>>>> msivak(a)redhat.com
>>>>> Red Hat Czech
>>>>> RHEV-M SLA / Brno, CZ
>>>>>
>>>>> ----- Original Message -----
>>>>> > I'm waiting for the next alarm. In the meanwhile this is the output
>>>>> now:
>>>>> > vdsClient -s saturnus2 getVmStats
>>>>> 3b9aa245-75ff-42e8-b921-1c9ce61826bf
>>>>> >
>>>>> > 3b9aa245-75ff-42e8-b921-1c9ce61826bf
>>>>> > Status = Running
>>>>> > guestFQDN = galatea.***.****
>>>>> > memUsage = 32
>>>>> > acpiEnable = true
>>>>> > netIfaces = [{'inet6': [], 'hw': '52:54:00:49:11:9d', 'inet':
>>>>> > ['192.168.99.19'], 'name': 'eth1'}, {'inet6': [], 'hw':
>>>>> > '00:1a:4a:67:c4:b3', 'inet': ['10.110.X.X'], 'name': 'eth2'},
>>>>> {'inet6': [],
>>>>> > 'hw': '52:54:00:f1:22:48', 'inet': ['192.168.122.1'], 'name':
>>>>> 'virbr0'}]
>>>>> > pid = 38144
>>>>> > session = Unknown
>>>>> > vmType = kvm
>>>>> > timeOffset = 0
>>>>> > balloonInfo = {'balloon_max': '12582912', 'balloon_min':
>>>>> '8388608',
>>>>> > 'balloon_target': '12582912', 'balloon_cur': '12582912'}
>>>>> > pauseCode = NOERR
>>>>> > disksUsage = [{'path': '/', 'total': '37655093248', 'fs': 'ext4',
>>>>> > 'used': '21765771264'}, {'path': '/boot', 'total': '507744256', 'fs':
>>>>> > 'ext4', 'used': '49356800'}]
>>>>> > network = {'vnet0': {'macAddr': '00:1a:4a:67:c4:b3',
>>>>> 'rxDropped': '0',
>>>>> > 'txDropped': '0', 'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0',
>>>>> > 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name':
>>>>> 'vnet0'},
>>>>> > 'vnet1': {'macAddr': '52:54:00:49:11:9d', 'rxDropped': '0',
>>>>> 'txDropped':
>>>>> > '0', 'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors':
>>>>> '0',
>>>>> > 'state': 'unknown', 'speed': '1000', 'name': 'vnet1'}, 'vnet2':
>>>>> {'macAddr':
>>>>> > '52:54:00:66:d3:aa', 'rxDropped': '0', 'txDropped': '0', 'rxErrors':
>>>>> '0',
>>>>> > 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state':
>>>>> 'unknown',
>>>>> > 'speed': '1000', 'name': 'vnet2'}}
>>>>> > memoryStats = {'swap_out': '0', 'majflt': '0', 'mem_free':
>>>>> '8520656',
>>>>> > 'swap_in': '0', 'pageflt': '396', 'mem_total': '12197520',
>>>>> 'mem_unused':
>>>>> > '1580896'}
>>>>> > guestName = galatea.brusselsairport.aero
>>>>> > elapsedTime = 2251149
>>>>> > displayType = qxl
>>>>> > cpuSys = 12.76
>>>>> > appsList = ['ovirt-guest-agent-1.0.8-1.el6',
>>>>> 'kernel-2.6.32-71.el6']
>>>>> > guestOs = 2.6.32-71.el6.x86_64
>>>>> > username = vandenpt
>>>>> > hash = -3779086589437073991
>>>>> > displayIp = 0
>>>>> > displayPort = 5900
>>>>> > guestIPs = 192.168.99.19 10.110.50.84 192.168.122.1
>>>>> > kvmEnable = true
>>>>> > disks = {'vda': {'readLatency': '0', 'apparentsize':
>>>>> '45097156608',
>>>>> > 'writeLatency': '1313701', 'imageID':
>>>>> > '528a377f-4f98-4023-92de-ce52c394d4a9', 'flushLatency': '187524',
>>>>> > 'readRate': '0.00', 'truesize': '45097156608', 'writeRate':
>>>>> '8502.90'},
>>>>> > 'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0',
>>>>> > 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0',
>>>>> 'writeRate':
>>>>> > '0.00'}}
>>>>> > monitorResponse = 0
>>>>> > statsAge = 0.47
>>>>> > cpuUser = 68.45
>>>>> > lastLogin = 1392707812.29
>>>>> > clientIp =
>>>>> > displaySecurePort = 5901
>>>>> >
>>>>> >
>>>>> >
>>>>> > 2014-02-17 14:00 GMT+01:00 Martin Sivak <msivak(a)redhat.com>:
>>>>> >
>>>>> > > Hi Koen,
>>>>> > >
>>>>> > > can you try the mentioned vdsClient command (vdsClient getVmStats
>>>>> > > <affected vm>) as soon as you get the warning about negative
>>>>> memory? The
>>>>> > > one David sent to us does not contain the negative number and we
>>>>> weren't
>>>>> > > able to find the issue based on it.
>>>>> > >
>>>>> > > Thanks
>>>>> > >
>>>>> > > --
>>>>> > > Martin Sivák
>>>>> > > msivak(a)redhat.com
>>>>> > > Red Hat Czech
>>>>> > > RHEV-M SLA / Brno, CZ
>>>>> > >
>>>>> > > ----- Original Message -----
>>>>> > > > Any updates about the issue? Because just now, the alarm went
>>>>> off again
>>>>> > > :-)
>>>>> > > > Kind regards,
>>>>> > > >
>>>>> > > > Koen
>>>>> > > >
>>>>> > > >
>>>>> > > > 2014-02-13 16:55 GMT+01:00 Martin Sivak <msivak(a)redhat.com>:
>>>>> > > >
>>>>> > > > > Thank you.
>>>>> > > > >
>>>>> > > > > I wonder why mem_total is smaller than balloon_cur (and max).
>>>>> I will
>>>>> > > have
>>>>> > > > > to dig a bit more to see what happened.
>>>>> > > > >
>>>>> > > > > --
>>>>> > > > > Martin Sivák
>>>>> > > > > msivak(a)redhat.com
>>>>> > > > > Red Hat Czech
>>>>> > > > > RHEV-M SLA / Brno, CZ
>>>>> > > > >
>>>>> > > > > ----- Original Message -----
>>>>> > > > > > ---------- Forwarded message ----------
>>>>> > > > > > From: "david van zeebroeck" <
>>>>> david(a)analytics.brusselsairport.be >
>>>>> > > > > > Date: Feb 13, 2014 4:31 PM
>>>>> > > > > > Subject: Re: [Users] Memory usage
>>>>> > > > > > To: "Martin Sivak" < msivak(a)redhat.com >
>>>>> > > > > > Cc: "Doron Fediuck" < dfediuck(a)redhat.com >, "Koen
>>>>> Vanoppen" <
>>>>> > > > > > vanoppen.koen(a)gmail.com >, < users(a)ovirt.org >
>>>>> > > > > >
>>>>> > > > > > in attachement is the output of vdsclient
>>>>> > > > > >
>>>>> > > > > >
>>>>> > > > > >
>>>>> > > > > >
>>>>> > > > > > On Thu, Feb 13, 2014 at 2:26 PM, Martin Sivak <
>>>>> msivak(a)redhat.com >
>>>>> > > > > wrote:
>>>>> > > > > >
>>>>> > > > > >
>>>>> > > > > > Hi everybody,
>>>>> > > > > >
>>>>> > > > > > would it be possible to add the output of vdsClient
>>>>> getVmStats
>>>>> > > <affected
>>>>> > > > > vm
>>>>> > > > > > id> from the affected host here and to the bug?
>>>>> > > > > >
>>>>> > > > > > Also can we please get the bug number that tracks this
>>>>> issue? I
>>>>> > > could not
>>>>> > > > > > find it in BZ.
>>>>> > > > > >
>>>>> > > > > > --
>>>>> > > > > > Martin Sivák
>>>>> > > > > > msivak(a)redhat.com
>>>>> > > > > > Red Hat Czech
>>>>> > > > > > RHEV-M SLA / Brno, CZ
>>>>> > > > > >
>>>>> > > > > > ----- Original Message -----
>>>>> > > > > > >
>>>>> > > > > > >
>>>>> > > > > > > ----- Original Message -----
>>>>> > > > > > > > From: "Koen Vanoppen" < vanoppen.koen(a)gmail.com >
>>>>> > > > > > > > To: users(a)ovirt.org
>>>>> > > > > > > > Sent: Thursday, February 13, 2014 12:18:24 PM
>>>>> > > > > > > > Subject: Re: [Users] Memory usage
>>>>> > > > > > > >
>>>>> > > > > > > >
>>>>> > > > > > > >
>>>>> > > > > > > > We can't turn off the memory balloon option because we
>>>>> are
>>>>> > > running
>>>>> > > > > the
>>>>> > > > > > > > 3.3.2
>>>>> > > > > > > > with the bug of the memory balloon. Thx for the help!
>>>>> > > > > > >
>>>>> > > > > > > Which balloon bug?
>>>>> > > > > > >
>>>>> > > > > > > > On Feb 13, 2014 10:51 AM, "Doron Fediuck" <
>>>>> dfediuck(a)redhat.com>
>>>>> > > > > wrote:
>>>>> > > > > > > >
>>>>> > > > > > > >
>>>>> > > > > > > >
>>>>> > > > > > > >
>>>>> > > > > > > > ----- Original Message -----
>>>>> > > > > > > > > From: "René Koch" < rkoch(a)linuxland.at >
>>>>> > > > > > > > > To: "Doron Fediuck" < dfediuck(a)redhat.com >
>>>>> > > > > > > > > Cc: "Koen Vanoppen" < vanoppen.koen(a)gmail.com >,
>>>>> > > users(a)ovirt.org ,
>>>>> > > > > > > > > "Martin
>>>>> > > > > > > > > Sivak" < msivak(a)redhat.com >
>>>>> > > > > > > > > Sent: Thursday, February 13, 2014 11:16:27 AM
>>>>> > > > > > > > > Subject: Re: [Users] Memory usage
>>>>> > > > > > > > >
>>>>> > > > > > > > > On Thu, 2014-02-13 at 03:49 -0500, Doron Fediuck wrote:
>>>>> > > > > > > > > >
>>>>> > > > > > > > > > ----- Original Message -----
>>>>> > > > > > > > > > > From: "René Koch" < rkoch(a)linuxland.at >
>>>>> > > > > > > > > > > To: "Doron Fediuck" < dfediuck(a)redhat.com >
>>>>> > > > > > > > > > > Cc: "Koen Vanoppen" < vanoppen.koen(a)gmail.com >,
>>>>> > > > > users(a)ovirt.org ,
>>>>> > > > > > > > > > > "Martin
>>>>> > > > > > > > > > > Sivak" < msivak(a)redhat.com >
>>>>> > > > > > > > > > > Sent: Wednesday, February 12, 2014 7:31:47 PM
>>>>> > > > > > > > > > > Subject: Re: [Users] Memory usage
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > > On Wed, 2014-02-12 at 11:22 -0500, Doron Fediuck
>>>>> wrote:
>>>>> > > > > > > > > > > >
>>>>> > > > > > > > > > > > ----- Original Message -----
>>>>> > > > > > > > > > > > > From: "René Koch" < rkoch(a)linuxland.at >
>>>>> > > > > > > > > > > > > To: "Koen Vanoppen" < vanoppen.koen(a)gmail.com>
>>>>> > > > > > > > > > > > > Cc: users(a)ovirt.org
>>>>> > > > > > > > > > > > > Sent: Wednesday, February 12, 2014 4:18:37 PM
>>>>> > > > > > > > > > > > > Subject: Re: [Users] Memory usage
>>>>> > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > On Wed, 2014-02-12 at 15:14 +0100, Koen
>>>>> Vanoppen wrote:
>>>>> > > > > > > > > > > > > > In The GUI, it says it's using 25% of the
>>>>> memory.
>>>>> > > > > > > > > > > > >
>>>>> > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > I guess it's the real value, right?
>>>>> > > > > > > > > > > > > The same happened for the memcached vm, someone
>>>>> > > reported
>>>>> > > > > to me
>>>>> > > > > > > > > > > > > -
>>>>> > > > > > > > > > > > > negative value in REST-API, but correct graph
>>>>> in oVirt
>>>>> > > > > webadmin
>>>>> > > > > > > > > > > > > GUI.
>>>>> > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > I fear I have no idea how this can happen - so
>>>>> maybe
>>>>> > > > > someone
>>>>> > > > > > > > > > > > > else
>>>>> > > > > > > > > > > > > can
>>>>> > > > > > > > > > > > > help you troubleshoot this issue.
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > 2014-02-12 15:10 GMT+01:00 Koen Vanoppen <
>>>>> > > > > > > > > > > > > > vanoppen.koen(a)gmail.com >:
>>>>> > > > > > > > > > > > > > Thanks for the quick respons, but there is no
>>>>> > > memcached
>>>>> > > > > > > > > > > > > > running on that VM.
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > Kind regards
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > 2014-02-12 15:06 GMT+01:00 René Koch <
>>>>> > > > > rkoch(a)linuxland.at >:
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > On Wed, 2014-02-12 at 14:55 +0100, Koen
>>>>> Vanoppen
>>>>> > > > > > > > > > > > > > wrote:
>>>>> > > > > > > > > > > > > > > Dear all,
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > > When we monitor one of our machines, we
>>>>> noticed
>>>>> > > > > > > > > > > > > > > that
>>>>> > > > > > > > > > > > > > there was one vm
>>>>> > > > > > > > > > > > > > > that was constantly giving a error of
>>>>> memory
>>>>> > > > > > > > > > > > > > > usage.
>>>>> > > > > > > > > > > > > > But when we took a
>>>>> > > > > > > > > > > > > > > look at it, there is actually nothing
>>>>> wrong with
>>>>> > > > > > > > > > > > > > > it.
>>>>> > > > > > > > > > > > > > Now we looked
>>>>> > > > > > > > > > > > > > > furhter then that. We looked at the API of
>>>>> the
>>>>> > > > > > > > > > > > > > machine and noticed
>>>>> > > > > > > > > > > > > > > something very strange:
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > > <statistic
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > >
>>>>> > > > >
>>>>> > >
>>>>> href="/api/vms/3b9aa245-75ff-42e8-b921-1c9ce61826bf/statistics/b7499508-c1c3-32f0-8174-c1783e57bb08"
>>>>> > > > > > > > > > > > > >
>>>>> > > > >
>>>>> > >
>>>>> id="b7499508-c1c3-32f0-8174-c1783e57bb08"><name>memory.used</name><description>Memory
>>>>> > > > > > > > > > > > > > used (agent)</description><values
>>>>> > > > > > > > > > > > > >
>>>>> > > > >
>>>>> > >
>>>>> type="INTEGER"><value><datum>-944892806</datum></value></values><type>GAUGE</type><unit>BYTES</unit>
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > > It's a negative...
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > Do you have memcached running in this vm?
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > I heard about this issue with memcached, but
>>>>> never
>>>>> > > > > > > > > > > > > > tested memcached in
>>>>> > > > > > > > > > > > > > my oVirt environment. You get the real usage
>>>>> value
>>>>> > > > > > > > > > > > > > with
>>>>> > > > > > > > > > > > > > memory.used = memory.installed + memory.used
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > Regards,
>>>>> > > > > > > > > > > > > > René
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > > What could be the problem?
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > > Kind regards,
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > > > koen
>>>>> > > > > > > > > > > > > > >
>>>>> > > > > > > > > > > > > >
>>>>> > > > > > > > > > > >
>>>>> > > > > > > > > > > > Guys,
>>>>> > > > > > > > > > > > these values are usually a result of
>>>>> overcommitment
>>>>> > > mechanism
>>>>> > > > > > > > > > > > usage.
>>>>> > > > > > > > > > > > For example, if KSM is effective, it will free a
>>>>> lot of
>>>>> > > > > memory
>>>>> > > > > > > > > > > > pages,
>>>>> > > > > > > > > > > > and total-free-committed becomes negative.
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > > Thanks a lot for the information.
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > > >
>>>>> > > > > > > > > > > > This was reported in
>>>>> > > > > > > > > > > >
>>>>> https://bugzilla.redhat.com/show_bug.cgi?id=977758
>>>>> > > > > > > > > > > > and the engine is using memFree reported by
>>>>> vdsm, which
>>>>> > > is
>>>>> > > > > more
>>>>> > > > > > > > > > > > accurate.
>>>>> > > > > > > > > > > >
>>>>> > > > > > > > > > > > The API reports the old version due to backwards
>>>>> > > > > compatibility.
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > > I just had a look at the bugzilla report and the
>>>>> RHEV
>>>>> > > > > documentation
>>>>> > > > > > > > > > > which says "Current memory in bytes used by the
>>>>> virtual
>>>>> > > > > machine.".
>>>>> > > > > > > > > > > So this means, the reported values are totally
>>>>> useless for
>>>>> > > > > > > > > > > monitoring
>>>>> > > > > > > > > > > memory usage of a virtual machine if KSM is
>>>>> active. I would
>>>>> > > > > expect
>>>>> > > > > > > > > > > to
>>>>> > > > > > > > > > > get the memory usage of a virtual machine and not
>>>>> how much
>>>>> > > > > memory
>>>>> > > > > > > > > > > is
>>>>> > > > > > > > > > > consumed on the hypervisor (this is pretty useless
>>>>> > > information
>>>>> > > > > for
>>>>> > > > > > > > > > > me).
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > > Is it planned to report the memory usage in a
>>>>> virtual
>>>>> > > machine
>>>>> > > > > in
>>>>> > > > > > > > > > > the
>>>>> > > > > > > > > > > API
>>>>> > > > > > > > > > > as well?
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > > Regards,
>>>>> > > > > > > > > > > René
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > > >
>>>>> > > > > > > > > >
>>>>> > > > > > > > > > René,
>>>>> > > > > > > > > > started digging into this, but it may take some time.
>>>>> > > > > > > > > >
>>>>> > > > > > > > > > Note that there are 2 memory usage reports; one for
>>>>> the host,
>>>>> > > > > > > > > > and another for each VM.
>>>>> > > > > > > > > > My response is related to the host, while the
>>>>> original
>>>>> > > question
>>>>> > > > > was
>>>>> > > > > > > > > > for the VM. I still think the root cause is the same
>>>>> (ie-
>>>>> > > > > related to
>>>>> > > > > > > > > > overcommitment; for example the VM may have a balloon
>>>>> > > inflated),
>>>>> > > > > but
>>>>> > > > > > > > > > would like to properly check and fix if needed.
>>>>> > > > > > > > >
>>>>> > > > > > > > >
>>>>> > > > > > > > > Yes, I know. So my question was if we can add another
>>>>> value
>>>>> > > for the
>>>>> > > > > > > > > usage in the vm in addition to the usage of the vm on
>>>>> the host.
>>>>> > > > > > > > >
>>>>> > > > > > > > We'll know once we understand the cause- ie is it a bug
>>>>> needs
>>>>> > > fixing
>>>>> > > > > or
>>>>> > > > > > > > should we indeed add another value
>>>>> > > > > > > >
>>>>> > > > > > > > If you have a setup with this issue, try removing the
>>>>> balloon
>>>>> > > device
>>>>> > > > > > > > and see if it helps / changes.
>>>>> > > > > > > >
>>>>> > > > > > > > >
>>>>> > > > > > > > > >
>>>>> > > > > > > > > > In order to make sure we keep track of it, please
>>>>> open a bug
>>>>> > > > > with all
>>>>> > > > > > > > > > the
>>>>> > > > > > > > > > relevant info.
>>>>> > > > > > > > > >
>>>>> > > > > > > > >
>>>>> > > > > > > > > I'll open a bug for this.
>>>>> > > > > > > > >
>>>>> > > > > > > > Thanks
>>>>> > > > > > > >
>>>>> > > > > > > > >
>>>>> > > > > > > > > > Thanks and keep reporting!
>>>>> > > > > > > > > > Doron
>>>>> > > > > > > > >
>>>>> > > > > > > > >
>>>>> > > > > > > > >
>>>>> > > > > > > >
>>>>> > > > > > > > _______________________________________________
>>>>> > > > > > > > Users mailing list
>>>>> > > > > > > > Users(a)ovirt.org
>>>>> > > > > > > > http://lists.ovirt.org/mailman/listinfo/users
>>>>> > > > > > > >
>>>>> > > > > > > _______________________________________________
>>>>> > > > > > > Users mailing list
>>>>> > > > > > > Users(a)ovirt.org
>>>>> > > > > > > http://lists.ovirt.org/mailman/listinfo/users
>>>>> > > > > > >
>>>>> > > > > > _______________________________________________
>>>>> > > > > > Users mailing list
>>>>> > > > > > Users(a)ovirt.org
>>>>> > > > > > http://lists.ovirt.org/mailman/listinfo/users
>>>>> > > > > >
>>>>> > > > > >
>>>>> > > > > > _______________________________________________
>>>>> > > > > > Users mailing list
>>>>> > > > > > Users(a)ovirt.org
>>>>> > > > > > http://lists.ovirt.org/mailman/listinfo/users
>>>>> > > > > >
>>>>> > > > >
>>>>> > > >
>>>>> > >
>>>>> >
>>>>>
>>>>
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users(a)ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>
>>>>
>>>
10 years, 10 months
[Users] Yum Installation Problems (ovirt 3.3, CentOS 6.5)
by Jon Forrest
I have a brand new CentOS 6.5 x86_64 installation with all the updates
as of today installed.
I want to create a test All-In-One node, so I follow the documentation and run
yum install epel-release-6-8.noarch.rpm
yum localinstall http://ovirt.org/releases/ovirt-release-el.noarch.rpm
These work fine. I then run
yum install ovirt-engine-setup-plugin-allinone -y
and I get
Error: Package: libvirt-lock-sanlock-0.10.2-29.el6_5.3.x86_64 (updates)
Requires: libsanlock_client.so.1()(64bit)
Error: Package: libvirt-lock-sanlock-0.10.2-29.el6_5.3.x86_64 (updates)
Requires: sanlock >= 2.4
Error: Package: vdsm-4.13.3-3.el6.x86_64 (ovirt-3.3.3)
Requires: sanlock >= 2.3-4
Error: Package: vdsm-4.13.3-3.el6.x86_64 (ovirt-3.3.3)
Requires: sanlock-python
Is this expected? What's weird is that IIRC I did the same thing last
week without problems.
Should I just grab newer versions of libvirt?
Thanks,
Jon Forrest
10 years, 10 months
