messages file filled by vdsm logs in 4.0
Hello, since updating to 4.0 yesterday, my /var/log/messages on hypervisor seem filled by vdsm messages sudo awk -F ":" '{print $4}' /var/log/messages | sort | uniq -c| sort -rnk 1,1 gives these top lines 126052 INFO ovirt_hosted_engine_ha.broker.listener.ConnectionHandler 46278 INFO ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine 34364 INFO ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore 25773 INFO ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config 25737 INFO ovirt_hosted_engine_ha.lib.storage_server.StorageServer 16579 vdsm SchemaCache WARNING Parameter disktotal is not int type 16579 vdsm SchemaCache WARNING Parameter diskfree is not int type 16567 INFO mem_free.MemFree 15288 vdsm SchemaCache WARNING Following parameters ['isoprefix'] were not recognized 15194 vdsm SchemaCache WARNING Provided parameters {'displayInfo' [{'tlsPort' 13184 vdsm SchemaCache WARNING Following parameters ['type'] were not recognized 8574 INFO ovirt_hosted_engine_ha.lib.image.Image 8088 vdsm SchemaCache WARNING Required property allocType is not provided when calling Volume.getInfo 8088 vdsm SchemaCache WARNING Provided value "2" not defined in DiskType enum for Volume.getInfo 8088 vdsm SchemaCache WARNING Parameter truesize is not uint type 8088 vdsm SchemaCache WARNING Parameter mtime is not uint type 8088 vdsm SchemaCache WARNING Parameter ctime is not int type 8088 vdsm SchemaCache WARNING Parameter capacity is not uint type 8088 vdsm SchemaCache WARNING Parameter apparentsize is not uint type 8026 vdsm SchemaCache WARNING No default value specified for systemVersion parameter in Host.getHardwareInfo 8026 vdsm SchemaCache WARNING No default value specified for systemUUID parameter in Host.getHardwareInfo 8026 vdsm SchemaCache WARNING No default value specified for systemSerialNumber parameter in Host.getHardwareInfo 8026 vdsm SchemaCache WARNING No default value specified for systemProductName parameter in Host.getHardwareInfo 8026 vdsm SchemaCache WARNING No default value specified for systemManufacturer parameter in Host.getHardwareInfo 8026 vdsm SchemaCache WARNING No default value specified for systemFamily parameter in Host.getHardwareInfo 7998 vdsm vds.dispatcher WARNING unhandled close event 7989 vdsm vds.dispatcher ERROR SSL error during reading data (104, 'Connection reset by peer') 7777 vdsm SchemaCache WARNING Parameter version is not int type 5096 vdsm SchemaCache WARNING Required property domainType is not provided when calling StoragePool.getInfo 5096 vdsm SchemaCache WARNING Parameter spmLver is not int type 5096 vdsm SchemaCache WARNING Parameter lver is not int type 3787 vdsm SchemaCache WARNING Provided parameters {'vcpuCount' '2', 'displayInfo' 3245 INFO cpu_load_no_engine.EngineHealth 3190 INFO ping.Ping 3011 INFO mgmt_bridge.MgmtBridge 2869 INFO engine_health.CpuLoadNoEngine 2681 vdsm SchemaCache WARNING Required property spm_id is not provided when calling StorageDomain.getInfo 2681 vdsm SchemaCache WARNING Required property master_ver is not provided when calling StorageDomain.getInfo 2681 vdsm SchemaCache WARNING Required property lver is not provided when calling StorageDomain.getInfo 2681 vdsm SchemaCache WARNING Required property domainType is not provided when calling StorageDomain.getInfo 2681 vdsm SchemaCache WARNING Required property domainClass is not provided when calling StorageDomain.getInfo 2681 vdsm SchemaCache WARNING Following parameters ['remotePath', 'type', 'class'] were not recognized 1335 vdsm SchemaCache WARNING Provided value "1" not defined in StorageDomainType enum for StoragePool.connectStorageServer 1333 vdsm SchemaCache WARNING Provided parameters {u'protocol_version' 3, u'connection' If I limit to messages related to today (11 hours): 26108 INFO ovirt_hosted_engine_ha.broker.listener.ConnectionHandler 10905 vdsm SchemaCache WARNING Parameter disktotal is not int type 10905 vdsm SchemaCache WARNING Parameter diskfree is not int type 10036 vdsm SchemaCache WARNING Provided parameters {'displayInfo' [{'tlsPort' 10032 vdsm SchemaCache WARNING Following parameters ['isoprefix'] were not recognized 8636 vdsm SchemaCache WARNING Following parameters ['type'] were not recognized 5292 vdsm SchemaCache WARNING Required property allocType is not provided when calling Volume.getInfo 5292 vdsm SchemaCache WARNING Provided value "2" not defined in DiskType enum for Volume.getInfo 5292 vdsm SchemaCache WARNING Parameter truesize is not uint type 5292 vdsm SchemaCache WARNING Parameter mtime is not uint type 5292 vdsm SchemaCache WARNING Parameter ctime is not int type 5292 vdsm SchemaCache WARNING Parameter capacity is not uint type 5292 vdsm SchemaCache WARNING Parameter apparentsize is not uint type 5255 vdsm SchemaCache WARNING No default value specified for systemVersion parameter in Host.getHardwareInfo 5255 vdsm SchemaCache WARNING No default value specified for systemUUID parameter in Host.getHardwareInfo 5255 vdsm SchemaCache WARNING No default value specified for systemSerialNumber parameter in Host.getHardwareInfo 5255 vdsm SchemaCache WARNING No default value specified for systemProductName parameter in Host.getHardwareInfo 5255 vdsm SchemaCache WARNING No default value specified for systemManufacturer parameter in Host.getHardwareInfo 5255 vdsm SchemaCache WARNING No default value specified for systemFamily parameter in Host.getHardwareInfo 5233 vdsm vds.dispatcher WARNING unhandled close event 5227 vdsm vds.dispatcher ERROR SSL error during reading data (104, 'Connection reset by peer') 5100 vdsm SchemaCache WARNING Parameter version is not int type 5052 INFO ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine 3528 INFO ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore 3495 INFO mem_free.MemFree 3344 vdsm SchemaCache WARNING Required property domainType is not provided when calling StoragePool.getInfo 3344 vdsm SchemaCache WARNING Parameter spmLver is not int type 3344 vdsm SchemaCache WARNING Parameter lver is not int type 2646 INFO ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config 2629 INFO ovirt_hosted_engine_ha.lib.storage_server.StorageServer 2507 vdsm SchemaCache WARNING Provided parameters {'vcpuCount' '2', 'displayInfo' 1756 vdsm SchemaCache WARNING Required property spm_id is not provided when calling StorageDomain.getInfo 1756 vdsm SchemaCache WARNING Required property master_ver is not provided when calling StorageDomain.getInfo 1756 vdsm SchemaCache WARNING Required property lver is not provided when calling StorageDomain.getInfo 1756 vdsm SchemaCache WARNING Required property domainType is not provided when calling StorageDomain.getInfo 1756 vdsm SchemaCache WARNING Required property domainClass is not provided when calling StorageDomain.getInfo 1756 vdsm SchemaCache WARNING Following parameters ['remotePath', 'type', 'class'] were not recognized 873 vdsm SchemaCache WARNING Provided value "1" not defined in StorageDomainType enum for StoragePool.connectStorageServer 873 vdsm SchemaCache WARNING Provided parameters {u'protocol_version' 3, u'connection' 873 INFO ovirt_hosted_engine_ha.lib.image.Image 673 INFO cpu_load_no_engine.EngineHealth 667 INFO ping.Ping 597 INFO mgmt_bridge.MgmtBridge 596 INFO engine_health.CpuLoadNoEngine 200 INFO ovirt_hosted_engine_ha.broker.monitor.Monitor 170 INFO ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink Is there a way to limit or put into another dedicated file? And also to have less verbose....: $ sudo ls -l /var/log/vdsm/vdsm.log -rw-r--r--. 1 vdsm kvm 8393615 Jul 5 11:14 /var/log/vdsm/vdsm.log with first line 14 minutes ago....?????: Reactor thread::INFO::2016-07-05 11:01:02,276::protocoldetector::72::ProtocolDetector.AcceptorImpl::(handle_accept) Accepting connection from 127.0.0.1:42882 $ ls -lrt /var/log/vdsm/vdsm.log* ... -rw-r--r--. 1 vdsm kvm 1166120 Jul 5 00:01 /var/log/vdsm/vdsm.log.12.xz -rw-r--r--. 1 vdsm kvm 1167044 Jul 5 01:01 /var/log/vdsm/vdsm.log.11.xz -rw-r--r--. 1 vdsm kvm 1167176 Jul 5 02:01 /var/log/vdsm/vdsm.log.10.xz -rw-r--r--. 1 vdsm kvm 1167076 Jul 5 03:01 /var/log/vdsm/vdsm.log.9.xz -rw-r--r--. 1 vdsm kvm 1171028 Jul 5 04:01 /var/log/vdsm/vdsm.log.8.xz -rw-r--r--. 1 vdsm kvm 1161760 Jul 5 05:01 /var/log/vdsm/vdsm.log.7.xz -rw-r--r--. 1 vdsm kvm 1171864 Jul 5 06:01 /var/log/vdsm/vdsm.log.6.xz -rw-r--r--. 1 vdsm kvm 1174436 Jul 5 07:01 /var/log/vdsm/vdsm.log.5.xz -rw-r--r--. 1 vdsm kvm 1198336 Jul 5 08:01 /var/log/vdsm/vdsm.log.4.xz -rw-r--r--. 1 vdsm kvm 1201948 Jul 5 09:01 /var/log/vdsm/vdsm.log.3.xz -rw-r--r--. 1 vdsm kvm 1171604 Jul 5 10:01 /var/log/vdsm/vdsm.log.2.xz -rw-r--r--. 1 vdsm kvm 1173764 Jul 5 11:01 /var/log/vdsm/vdsm.log.1.xz -rw-r--r--. 1 vdsm kvm 8714234 Jul 5 11:15 /var/log/vdsm/vdsm.log thanks, Gianluca
------=_Part_2845989_957509383.1467808422532 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit ----- Original Message -----
From: "Gianluca Cecchi" <gianluca.cecchi@gmail.com> To: "users" <users@ovirt.org> Sent: Tuesday, July 5, 2016 11:16:54 AM Subject: [ovirt-users] messages file filled by vdsm logs in 4.0
Hello, since updating to 4.0 yesterday, my /var/log/messages on hypervisor seem filled by vdsm messages
python_warnings_enable =3D false<br></div><div>3. changes will take place = after a Vdsm restart<br></div><div><br></div><div>HTH,<br></div><div><br></=
Ciao Gianluca, please try the following: 1. edit /etc/vdsm/vdsm.conf 2. in the [devel] section, set "python_warnings_enable=false" it should read like [devel] python_warnings_enable = false 3. changes will take place after a Vdsm restart HTH, Bests, -- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani ------=_Part_2845989_957509383.1467808422532 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><hr id=3D"zwchr"><blockquote style=3D= "border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;= font-weight:normal;font-style:normal;text-decoration:none;font-family:Helve= tica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Gianluca Cecchi" <g= ianluca.cecchi@gmail.com><br><b>To: </b>"users" <users@ovirt.org><= br><b>Sent: </b>Tuesday, July 5, 2016 11:16:54 AM<br><b>Subject: </b>[ovirt= -users] messages file filled by vdsm logs in 4.0<br><div><br></div><div dir= =3D"ltr">Hello,<div>since updating to 4.0 yesterday, my /var/log/messages o= n hypervisor seem filled by vdsm messages</div></div></blockquote><div><br>= </div><div>Ciao Gianluca,<br></div><div><br></div><div>please try the follo= wing:<br></div><div>1. edit /etc/vdsm/vdsm.conf<br></div><div>2. in the [de= vel] section, set "python_warnings_enable=3Dfalse"<br></div><div><br></div>= <div>it should read like<br></div><div><br></div><div>[devel]<br></div><div= div><div>Bests,<br></div><div><br></div><div><br></div><div>-- <br></div><d= iv><span name=3D"x"></span>Francesco Romani<br>RedHat Engineering Virtualiz= ation R & D<br>Phone: 8261328<br>IRC: fromani<span name=3D"x"></span><b= r></div></div></body></html> ------=_Part_2845989_957509383.1467808422532--
On Tue, Jul 5, 2016 at 12:16 PM, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
Hello, since updating to 4.0 yesterday, my /var/log/messages on hypervisor seem filled by vdsm messages
sudo awk -F ":" '{print $4}' /var/log/messages | sort | uniq -c| sort -rnk 1,1
gives these top lines 126052 INFO ovirt_hosted_engine_ha.broker.listener.ConnectionHandler 46278 INFO ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine 34364 INFO ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore 25773 INFO ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config 25737 INFO ovirt_hosted_engine_ha.lib.storage_server.StorageServer
These messages are from hosted engine agent. Martin, why are you logging info level message to syslog?
16579 vdsm SchemaCache WARNING Parameter disktotal is not int type 16579 vdsm SchemaCache WARNING Parameter diskfree is not int type 16567 INFO mem_free.MemFree 15288 vdsm SchemaCache WARNING Following parameters ['isoprefix'] were not recognized 15194 vdsm SchemaCache WARNING Provided parameters {'displayInfo' [{'tlsPort' 13184 vdsm SchemaCache WARNING Following parameters ['type'] were not recognized 8574 INFO ovirt_hosted_engine_ha.lib.image.Image 8088 vdsm SchemaCache WARNING Required property allocType is not provided when calling Volume.getInfo 8088 vdsm SchemaCache WARNING Provided value "2" not defined in DiskType enum for Volume.getInfo 8088 vdsm SchemaCache WARNING Parameter truesize is not uint type 8088 vdsm SchemaCache WARNING Parameter mtime is not uint type 8088 vdsm SchemaCache WARNING Parameter ctime is not int type 8088 vdsm SchemaCache WARNING Parameter capacity is not uint type 8088 vdsm SchemaCache WARNING Parameter apparentsize is not uint type 8026 vdsm SchemaCache WARNING No default value specified for systemVersion parameter in Host.getHardwareInfo 8026 vdsm SchemaCache WARNING No default value specified for systemUUID parameter in Host.getHardwareInfo 8026 vdsm SchemaCache WARNING No default value specified for systemSerialNumber parameter in Host.getHardwareInfo 8026 vdsm SchemaCache WARNING No default value specified for systemProductName parameter in Host.getHardwareInfo 8026 vdsm SchemaCache WARNING No default value specified for systemManufacturer parameter in Host.getHardwareInfo 8026 vdsm SchemaCache WARNING No default value specified for systemFamily parameter in Host.getHardwareInfo 7998 vdsm vds.dispatcher WARNING unhandled close event 7989 vdsm vds.dispatcher ERROR SSL error during reading data (104, 'Connection reset by peer') 7777 vdsm SchemaCache WARNING Parameter version is not int type 5096 vdsm SchemaCache WARNING Required property domainType is not provided when calling StoragePool.getInfo 5096 vdsm SchemaCache WARNING Parameter spmLver is not int type 5096 vdsm SchemaCache WARNING Parameter lver is not int type 3787 vdsm SchemaCache WARNING Provided parameters {'vcpuCount' '2', 'displayInfo' 3245 INFO cpu_load_no_engine.EngineHealth 3190 INFO ping.Ping 3011 INFO mgmt_bridge.MgmtBridge 2869 INFO engine_health.CpuLoadNoEngine 2681 vdsm SchemaCache WARNING Required property spm_id is not provided when calling StorageDomain.getInfo 2681 vdsm SchemaCache WARNING Required property master_ver is not provided when calling StorageDomain.getInfo 2681 vdsm SchemaCache WARNING Required property lver is not provided when calling StorageDomain.getInfo 2681 vdsm SchemaCache WARNING Required property domainType is not provided when calling StorageDomain.getInfo 2681 vdsm SchemaCache WARNING Required property domainClass is not provided when calling StorageDomain.getInfo 2681 vdsm SchemaCache WARNING Following parameters ['remotePath', 'type', 'class'] were not recognized 1335 vdsm SchemaCache WARNING Provided value "1" not defined in StorageDomainType enum for StoragePool.connectStorageServer 1333 vdsm SchemaCache WARNING Provided parameters {u'protocol_version' 3, u'connection'
The SchemaCache warnings were disabled in vdsm-4.18.5.1
If I limit to messages related to today (11 hours): 26108 INFO ovirt_hosted_engine_ha.broker.listener.ConnectionHandler 10905 vdsm SchemaCache WARNING Parameter disktotal is not int type 10905 vdsm SchemaCache WARNING Parameter diskfree is not int type 10036 vdsm SchemaCache WARNING Provided parameters {'displayInfo' [{'tlsPort' 10032 vdsm SchemaCache WARNING Following parameters ['isoprefix'] were not recognized 8636 vdsm SchemaCache WARNING Following parameters ['type'] were not recognized 5292 vdsm SchemaCache WARNING Required property allocType is not provided when calling Volume.getInfo 5292 vdsm SchemaCache WARNING Provided value "2" not defined in DiskType enum for Volume.getInfo 5292 vdsm SchemaCache WARNING Parameter truesize is not uint type 5292 vdsm SchemaCache WARNING Parameter mtime is not uint type 5292 vdsm SchemaCache WARNING Parameter ctime is not int type 5292 vdsm SchemaCache WARNING Parameter capacity is not uint type 5292 vdsm SchemaCache WARNING Parameter apparentsize is not uint type 5255 vdsm SchemaCache WARNING No default value specified for systemVersion parameter in Host.getHardwareInfo 5255 vdsm SchemaCache WARNING No default value specified for systemUUID parameter in Host.getHardwareInfo 5255 vdsm SchemaCache WARNING No default value specified for systemSerialNumber parameter in Host.getHardwareInfo 5255 vdsm SchemaCache WARNING No default value specified for systemProductName parameter in Host.getHardwareInfo 5255 vdsm SchemaCache WARNING No default value specified for systemManufacturer parameter in Host.getHardwareInfo 5255 vdsm SchemaCache WARNING No default value specified for systemFamily parameter in Host.getHardwareInfo 5233 vdsm vds.dispatcher WARNING unhandled close event 5227 vdsm vds.dispatcher ERROR SSL error during reading data (104, 'Connection reset by peer') 5100 vdsm SchemaCache WARNING Parameter version is not int type 5052 INFO ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine 3528 INFO ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore 3495 INFO mem_free.MemFree 3344 vdsm SchemaCache WARNING Required property domainType is not provided when calling StoragePool.getInfo 3344 vdsm SchemaCache WARNING Parameter spmLver is not int type 3344 vdsm SchemaCache WARNING Parameter lver is not int type 2646 INFO ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config 2629 INFO ovirt_hosted_engine_ha.lib.storage_server.StorageServer 2507 vdsm SchemaCache WARNING Provided parameters {'vcpuCount' '2', 'displayInfo' 1756 vdsm SchemaCache WARNING Required property spm_id is not provided when calling StorageDomain.getInfo 1756 vdsm SchemaCache WARNING Required property master_ver is not provided when calling StorageDomain.getInfo 1756 vdsm SchemaCache WARNING Required property lver is not provided when calling StorageDomain.getInfo 1756 vdsm SchemaCache WARNING Required property domainType is not provided when calling StorageDomain.getInfo 1756 vdsm SchemaCache WARNING Required property domainClass is not provided when calling StorageDomain.getInfo 1756 vdsm SchemaCache WARNING Following parameters ['remotePath', 'type', 'class'] were not recognized 873 vdsm SchemaCache WARNING Provided value "1" not defined in StorageDomainType enum for StoragePool.connectStorageServer 873 vdsm SchemaCache WARNING Provided parameters {u'protocol_version' 3, u'connection' 873 INFO ovirt_hosted_engine_ha.lib.image.Image 673 INFO cpu_load_no_engine.EngineHealth 667 INFO ping.Ping 597 INFO mgmt_bridge.MgmtBridge 596 INFO engine_health.CpuLoadNoEngine 200 INFO ovirt_hosted_engine_ha.broker.monitor.Monitor 170 INFO ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink
Is there a way to limit or put into another dedicated file?
And also to have less verbose....:
$ sudo ls -l /var/log/vdsm/vdsm.log -rw-r--r--. 1 vdsm kvm 8393615 Jul 5 11:14 /var/log/vdsm/vdsm.log
with first line 14 minutes ago....?????: Reactor thread::INFO::2016-07-05 11:01:02,276::protocoldetector::72::ProtocolDetector.AcceptorImpl::(handle_accept) Accepting connection from 127.0.0.1:42882
If you see a lot of these, it means some vdsm client is openning a new connection for each request, instead of reusing the same connection. I guess this is hosted engine agent, mom, or both. But this is not a new issue, should be the same on 3.6. Nir
participants (3)
-
Francesco Romani -
Gianluca Cecchi -
Nir Soffer