4:39 p.m.
This service seems to be logging to both /var/log/messages
and /var/log/ovirt-hosted-engine-ha/agent.log
Anything that may be causing that? Centos7 ovirt 3.6.7
MainThread::INFO::2016-08-25
15:38:36,912::ovf_store::109::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
Extracting Engine VM OVF from the OVF_STORE
MainThread::INFO::2016-08-25
15:38:36,976::ovf_store::116::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
OVF_STORE volume path:
/rhev/data-center/mnt/glusterSD/ccgl1.gl.local:HOST1/6a0bca4a-a1be-47d3-be51-64c6277d1f0f/images/c12c8000-0373-419b-963b-98b04adca760/fb6e2509-4786-433d-868f-a6303dd69cca
MainThread::INFO::2016-08-25
15:38:37,097::config::226::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
Found an OVF for HE VM, trying to convert
MainThread::INFO::2016-08-25
15:38:37,102::config::231::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
Got vm.conf from OVF_STORE
MainThread::INFO::2016-08-25
15:38:37,200::hosted_engine::462::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Current state EngineDown (score: 3400)
MainThread::INFO::2016-08-25
15:38:37,201::hosted_engine::467::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Best remote host ccovirt1.carouselchecks.local (id: 1, score: 3400)
MainThread::INFO::2016-08-25
15:38:47,346::hosted_engine::613::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm)
Initializing VDSM
MainThread::INFO::2016-08-25
15:38:47,439::hosted_engine::658::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
Connecting the storage
MainThread::INFO::2016-08-25
15:38:47,454::storage_server::218::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Connecting storage server
MainThread::INFO::2016-08-25
15:38:47,618::storage_server::222::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Connecting storage server
Aug 25 15:38:40 ccovirt3 ovirt-ha-broker:
INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection
closed
Aug 25 15:38:40 ccovirt3 ovirt-ha-broker: INFO:mem_free.MemFree:memFree:
16466
Aug 25 15:38:40 ccovirt3 ovirt-ha-broker:
INFO:engine_health.CpuLoadNoEngine:VM not on this host
Aug 25 15:38:45 ccovirt3 ovirt-ha-broker: INFO:mgmt_bridge.MgmtBridge:Found
bridge ovirtmgmt with ports
Aug 25 15:38:45 ccovirt3 ovirt-ha-broker:
INFO:cpu_load_no_engine.EngineHealth:VM not on this host
Aug 25 15:38:45 ccovirt3 ovirt-ha-broker:
INFO:cpu_load_no_engine.EngineHealth:System load total=0.1022,
engine=0.0000, non-engine=0.1022
Aug 25 15:38:47 ccovirt3 ovirt-ha-agent:
INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Initializing
VDSM
Aug 25 15:38:47 ccovirt3 ovirt-ha-agent:
INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Connecting the
storage
Aug 25 15:38:47 ccovirt3 ovirt-ha-agent:
INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Connecting
storage server
Aug 25 15:38:47 ccovirt3 ovirt-ha-agent:
INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Connecting
storage server
*David Gossage*
*Carousel Checks Inc. | System Administrator*
*Office* 708.613.2284
2:38 a.m.
Depends on your systemd configuration. ovirt-ha-agent and broker daemon's
both log to stdout and it's own logfile. All messages to stdout will go to
journald and be forwarded to /var/log/messages (ForwardToSyslog=yes in
/etc/systemd/journald.conf I think).
So the ovirt-ha-agent doesn't log to /var/log/messages, journald does. if
it should log to stdout is another discussion, but maybe there's good
reason for that, backwards compatibility, don't know.
An easy fix is redirecting the output of the daemon to /dev/null. in
/usr/lib/systemd/system/ovirt-ha-agent.service add StandardOutput=null to
the [service] section.
Renout
On Thu, Aug 25, 2016 at 10:39 PM, David Gossage <dgossage(a)carouselchecks.com
wrote:
This service seems to be logging to both /var/log/messages
and /var/log/ovirt-hosted-engine-ha/agent.log
Anything that may be causing that? Centos7 ovirt 3.6.7
MainThread::INFO::2016-08-25 15:38:36,912::ovf_store::109::
ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
Extracting Engine VM OVF from the OVF_STORE
MainThread::INFO::2016-08-25 15:38:36,976::ovf_store::116::
ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
OVF_STORE volume path: /rhev/data-center/mnt/glusterSD/ccgl1.gl.local:
HOST1/6a0bca4a-a1be-47d3-be51-64c6277d1f0f/images/c12c8000-
0373-419b-963b-98b04adca760/fb6e2509-4786-433d-868f-a6303dd69cca
MainThread::INFO::2016-08-25 15:38:37,097::config::226::
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
config::(refresh_local_conf_file) Found an OVF for HE VM, trying to
convert
MainThread::INFO::2016-08-25 15:38:37,102::config::231::
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
config::(refresh_local_conf_file) Got vm.conf from OVF_STORE
MainThread::INFO::2016-08-25 15:38:37,200::hosted_engine::
462::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Current state EngineDown (score: 3400)
MainThread::INFO::2016-08-25 15:38:37,201::hosted_engine::
467::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Best remote host ccovirt1.carouselchecks.local (id: 1, score: 3400)
MainThread::INFO::2016-08-25 15:38:47,346::hosted_engine::
613::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_initialize_vdsm) Initializing VDSM
MainThread::INFO::2016-08-25 15:38:47,439::hosted_engine::
658::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_initialize_storage_images) Connecting the storage
MainThread::INFO::2016-08-25 15:38:47,454::storage_server::
218::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Connecting storage server
MainThread::INFO::2016-08-25 15:38:47,618::storage_server::
222::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Connecting storage server
Aug 25 15:38:40 ccovirt3 ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.
broker.listener.ConnectionHandler:Connection closed
Aug 25 15:38:40 ccovirt3 ovirt-ha-broker: INFO:mem_free.MemFree:memFree:
16466
Aug 25 15:38:40 ccovirt3 ovirt-ha-broker: INFO:engine_health.CpuLoadNoEngine:VM
not on this host
Aug 25 15:38:45 ccovirt3 ovirt-ha-broker: INFO:mgmt_bridge.MgmtBridge:Found
bridge ovirtmgmt with ports
Aug 25 15:38:45 ccovirt3 ovirt-ha-broker: INFO:cpu_load_no_engine.EngineHealth:VM
not on this host
Aug 25 15:38:45 ccovirt3 ovirt-ha-broker: INFO:cpu_load_no_engine.EngineHealth:System
load total=0.1022, engine=0.0000, non-engine=0.1022
Aug 25 15:38:47 ccovirt3 ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.
agent.hosted_engine.HostedEngine:Initializing VDSM
Aug 25 15:38:47 ccovirt3 ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.
agent.hosted_engine.HostedEngine:Connecting the storage
Aug 25 15:38:47 ccovirt3 ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.
lib.storage_server.StorageServer:Connecting storage server
Aug 25 15:38:47 ccovirt3 ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.
lib.storage_server.StorageServer:Connecting storage server
*David Gossage*
*Carousel Checks Inc. | System Administrator*
*Office* 708.613.2284
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
5:13 a.m.
On Fri, Aug 26, 2016 at 1:38 AM, Renout Gerrits <mail(a)renout.nl> wrote:
Depends on your systemd configuration. ovirt-ha-agent and broker
daemon's
both log to stdout and it's own logfile. All messages to stdout will go to
journald and be forwarded to /var/log/messages (ForwardToSyslog=yes in
/etc/systemd/journald.conf I think).
So the ovirt-ha-agent doesn't log to /var/log/messages, journald does. if
it should log to stdout is another discussion, but maybe there's good
reason for that, backwards compatibility, don't know.
An easy fix is redirecting the output of the daemon to /dev/null. in
/usr/lib/systemd/system/ovirt-ha-agent.service add StandardOutput=null to
the [service] section.
This did not start occurring until after I updated ovirt on August 12th. I
jumped a couple updates I think so which update it started with not sure.
Aug 12 21:54:58 Updated: ovirt-vmconsole-1.0.2-1.el7.centos.noarch
Aug 12 21:55:23 Updated: ovirt-vmconsole-host-1.0.2-1.el7.centos.noarch
Aug 12 21:55:34 Updated: ovirt-setup-lib-1.0.1-1.el7.centos.noarch
Aug 12 21:55:42 Updated: libgovirt-0.3.3-1.el7_2.4.x86_64
Aug 12 21:56:37 Updated: ovirt-hosted-engine-ha-1.3.5.7-1.el7.centos.noarch
Aug 12 21:56:37 Updated: ovirt-engine-sdk-python-3.6.7.0-1.el7.centos.noarch
Aug 12 21:56:38 Updated:
ovirt-hosted-engine-setup-1.3.7.2-1.el7.centos.noarch
Aug 12 21:58:46 Updated: 1:ovirt-release36-3.6.7-1.noarch
So is this considered normal behavior that everyone should need to
reconfigure their logging to deal with or did someone leave it going to
stdout for debugging and not turn it back off? I know I can manipulate
logging myself if I need to, but I'd rather not have to customize that and
then check every update that it's still applied or that I still get logs at
all.
Renout
On Thu, Aug 25, 2016 at 10:39 PM, David Gossage <
dgossage(a)carouselchecks.com> wrote:
> This service seems to be logging to both /var/log/messages
> and /var/log/ovirt-hosted-engine-ha/agent.log
>
> Anything that may be causing that? Centos7 ovirt 3.6.7
>
> MainThread::INFO::2016-08-25 15:38:36,912::ovf_store::109::
> ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
> Extracting Engine VM OVF from the OVF_STORE
> MainThread::INFO::2016-08-25 15:38:36,976::ovf_store::116::
> ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
> OVF_STORE volume path: /rhev/data-center/mnt/glusterS
> D/ccgl1.gl.local:HOST1/6a0bca4a-a1be-47d3-be51-64c627
> 7d1f0f/images/c12c8000-0373-419b-963b-98b04adca760/fb6e250
> 9-4786-433d-868f-a6303dd69cca
> MainThread::INFO::2016-08-25 15:38:37,097::config::226::ovi
>
rt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
> Found an OVF for HE VM, trying to convert
> MainThread::INFO::2016-08-25 15:38:37,102::config::231::ovi
>
rt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
> Got vm.conf from OVF_STORE
> MainThread::INFO::2016-08-25 15:38:37,200::hosted_engine::4
> 62::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Current state EngineDown (score: 3400)
> MainThread::INFO::2016-08-25 15:38:37,201::hosted_engine::4
> 67::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Best remote host ccovirt1.carouselchecks.local (id: 1, score: 3400)
> MainThread::INFO::2016-08-25 15:38:47,346::hosted_engine::6
> 13::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm)
> Initializing VDSM
> MainThread::INFO::2016-08-25 15:38:47,439::hosted_engine::6
>
58::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Connecting the storage
> MainThread::INFO::2016-08-25 15:38:47,454::storage_server::218::
> ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
> MainThread::INFO::2016-08-25 15:38:47,618::storage_server::222::
> ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
> Aug 25 15:38:40 ccovirt3 ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.br
> oker.listener.ConnectionHandler:Connection closed
>
> Aug 25 15:38:40 ccovirt3 ovirt-ha-broker: INFO:mem_free.MemFree:memFree:
> 16466
> Aug 25 15:38:40 ccovirt3 ovirt-ha-broker: INFO:engine_health.CpuLoadNoEngine:VM
> not on this host
> Aug 25 15:38:45 ccovirt3 ovirt-ha-broker: INFO:mgmt_bridge.MgmtBridge:Found
> bridge ovirtmgmt with ports
> Aug 25 15:38:45 ccovirt3 ovirt-ha-broker: INFO:cpu_load_no_engine.EngineHealth:VM
> not on this host
> Aug 25 15:38:45 ccovirt3 ovirt-ha-broker:
INFO:cpu_load_no_engine.EngineHealth:System
> load total=0.1022, engine=0.0000, non-engine=0.1022
> Aug 25 15:38:47 ccovirt3 ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.ag
> ent.hosted_engine.HostedEngine:Initializing VDSM
> Aug 25 15:38:47 ccovirt3 ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.ag
> ent.hosted_engine.HostedEngine:Connecting the storage
> Aug 25 15:38:47 ccovirt3 ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.li
> b.storage_server.StorageServer:Connecting storage server
> Aug 25 15:38:47 ccovirt3 ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.li
> b.storage_server.StorageServer:Connecting storage server
>
> *David Gossage*
> *Carousel Checks Inc. | System Administrator*
> *Office* 708.613.2284
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
2:24 a.m.
Adding Martin.
Il 26/Ago/2016 11:14, "David Gossage" <dgossage(a)carouselchecks.com> ha
scritto:
On Fri, Aug 26, 2016 at 1:38 AM, Renout Gerrits <mail(a)renout.nl> wrote:
>
> Depends on your systemd configuration. ovirt-ha-agent and broker
daemon's
both log to stdout and it's own logfile. All messages to stdout
will go to journald and be forwarded to /var/log/messages
(ForwardToSyslog=yes in /etc/systemd/journald.conf I think).
> So the ovirt-ha-agent doesn't log to /var/log/messages,
journald does.
if it should log to stdout is another discussion, but maybe
there's good
reason for that, backwards compatibility, don't know.
>
> An easy fix is redirecting the output of the daemon to /dev/null. in
/usr/lib/systemd/system/ovirt-ha-agent.service add StandardOutput=null to
the [service] section.
This did not start occurring until after I updated ovirt on August 12th.
I jumped a
couple updates I think so which update it started with not sure.
Aug 12 21:54:58 Updated: ovirt-vmconsole-1.0.2-1.el7.centos.noarch
Aug 12 21:55:23 Updated: ovirt-vmconsole-host-1.0.2-1.el7.centos.noarch
Aug 12 21:55:34 Updated: ovirt-setup-lib-1.0.1-1.el7.centos.noarch
Aug 12 21:55:42 Updated: libgovirt-0.3.3-1.el7_2.4.x86_64
Aug 12 21:56:37 Updated:
ovirt-hosted-engine-ha-1.3.5.7-1.el7.centos.noarch
Aug 12 21:56:37 Updated:
ovirt-engine-sdk-python-3.6.7.0-1.el7.centos.noarch
Aug 12 21:56:38 Updated:
ovirt-hosted-engine-setup-1.3.7.2-1.el7.centos.noarch
Aug 12 21:58:46 Updated: 1:ovirt-release36-3.6.7-1.noarch
So is this considered normal behavior that everyone should need to
reconfigure
their logging to deal with or did someone leave it going to
stdout for debugging and not turn it back off? I know I can manipulate
logging myself if I need to, but I'd rather not have to customize that and
then check every update that it's still applied or that I still get logs at
all.
>
> Renout
>
> On Thu, Aug 25, 2016 at 10:39 PM, David Gossage <
dgossage(a)carouselchecks.com> wrote:
>>
>> This service seems to be logging to both /var/log/messages
and
/var/log/ovirt-hosted-engine-ha/agent.log
>>
>> Anything that may be causing that? Centos7 ovirt 3.6.7
>>
>> MainThread::INFO::2016-08-25
15:38:36,912::ovf_store::109::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
Extracting Engine VM OVF from the OVF_STORE
>> MainThread::INFO::2016-08-25
15:38:36,976::ovf_store::116::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
OVF_STORE volume path:
/rhev/data-center/mnt/glusterSD/ccgl1.gl.local:HOST1/6a0bca4a-a1be-47d3-be51-64c6277d1f0f/images/c12c8000-0373-419b-963b-98b04adca760/fb6e2509-4786-433d-868f-a6303dd69cca
>> MainThread::INFO::2016-08-25
15:38:37,097::config::226::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
Found an OVF for HE VM, trying to convert
>> MainThread::INFO::2016-08-25
15:38:37,102::config::231::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
Got vm.conf from OVF_STORE
>> MainThread::INFO::2016-08-25
15:38:37,200::hosted_engine::462::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Current state EngineDown (score: 3400)
>> MainThread::INFO::2016-08-25
15:38:37,201::hosted_engine::467::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
Best remote host ccovirt1.carouselchecks.local (id: 1, score: 3400)
>> MainThread::INFO::2016-08-25
15:38:47,346::hosted_engine::613::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm)
Initializing VDSM
>> MainThread::INFO::2016-08-25
15:38:47,439::hosted_engine::658::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
Connecting the storage
>> MainThread::INFO::2016-08-25
15:38:47,454::storage_server::218::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Connecting storage server
>> MainThread::INFO::2016-08-25
15:38:47,618::storage_server::222::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
Connecting storage server
>> Aug 25 15:38:40 ccovirt3 ovirt-ha-broker:
INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection
closed
>>>
>> Aug 25 15:38:40 ccovirt3 ovirt-ha-broker:
INFO:mem_free.MemFree:memFree: 16466
>> Aug 25 15:38:40 ccovirt3 ovirt-ha-broker:
INFO:engine_health.CpuLoadNoEngine:VM not on this host
>> Aug 25 15:38:45 ccovirt3 ovirt-ha-broker:
INFO:mgmt_bridge.MgmtBridge:Found bridge ovirtmgmt with ports
>> Aug 25 15:38:45 ccovirt3 ovirt-ha-broker:
INFO:cpu_load_no_engine.EngineHealth:VM not on this host
>> Aug 25 15:38:45 ccovirt3 ovirt-ha-broker:
INFO:cpu_load_no_engine.EngineHealth:System load total=0.1022,
engine=0.0000, non-engine=0.1022
>> Aug 25 15:38:47 ccovirt3 ovirt-ha-agent:
INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Initializing
VDSM
>> Aug 25 15:38:47 ccovirt3 ovirt-ha-agent:
INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Connecting the
storage
>> Aug 25 15:38:47 ccovirt3 ovirt-ha-agent:
INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Connecting
storage server
>> Aug 25 15:38:47 ccovirt3 ovirt-ha-agent:
INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Connecting
storage server
>>
>> David Gossage
>> Carousel Checks Inc. | System Administrator
>> Office 708.613.2284
>>
>> _______________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
2818
days inactive
2820
days old
3 comments
3 participants
participants (3)
-
David Gossage -
Renout Gerrits -
Sandro Bonazzola