[Users] errors in engine log and tones of sync messages

Hi, I'm trying to debug why I can't import a VM to my brand new glusterfs domain and I see that engine.log is full of gluster volumelist calls and less but often, errors of not been able to call async, I'm I missing any package to install in the engine other than vdsm-gluster? Is there a way not to log all the VolumeList commands (without lowering log level) to avoid having so many entries that difficult searching in the log? Regards, : 5c8baf53 2013-12-13 13:27:58,504 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-33) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedMethodAccessor108.invoke(Unknown Source) [:1.7.0_45] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: org.apache.xmlrpc.XmlRpcException: <type 'exceptions.Exception'>:method "glusterTasksList" is not supported (Failed with error VDS_NETWORK_ERROR and code 5022) at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] ... 6 more 2013-12-13 13:28:00,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = Dell4, HostId = 001f72ef-fac6-42bc-be8e-b17e249e80bd), log id: 75cbf869 2013-12-13 13:28:00,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {30759593-86cf-47d3-8527-d36623674ea6=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac95f510}, log id: 75cbf869 2013-12-13 13:28:05,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = Dell3, HostId = 342b037f-e4ab-4c3b-b804-806d3ec30ba9), log id: 76386ce 2013-12-13 13:28:07,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {30759593-86cf-47d3-8527-d36623674ea6=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee3bee7d}, log id: 76386ce

Hi Juan, The following patch should handle the messages: http://gerrit.ovirt.org/#/c/22287 This looks like the issue mentioned in thread: https://www.mail-archive.com/users@ovirt.org/msg12378.html Regards, Vered ----- Original Message -----
From: "Juan Pablo Lorier" <jplorier@gmail.com> To: "users" <users@ovirt.org> Sent: Friday, December 13, 2013 6:23:41 PM Subject: [Users] errors in engine log and tones of sync messages
Hi,
I'm trying to debug why I can't import a VM to my brand new glusterfs domain and I see that engine.log is full of gluster volumelist calls and less but often, errors of not been able to call async, I'm I missing any package to install in the engine other than vdsm-gluster? Is there a way not to log all the VolumeList commands (without lowering log level) to avoid having so many entries that difficult searching in the log? Regards,
: 5c8baf53 2013-12-13 13:27:58,504 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-33) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedMethodAccessor108.invoke(Unknown Source) [:1.7.0_45] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: org.apache.xmlrpc.XmlRpcException: <type 'exceptions.Exception'>:method "glusterTasksList" is not supported (Failed with error VDS_NETWORK_ERROR and code 5022) at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] ... 6 more
2013-12-13 13:28:00,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = Dell4, HostId = 001f72ef-fac6-42bc-be8e-b17e249e80bd), log id: 75cbf869 2013-12-13 13:28:00,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {30759593-86cf-47d3-8527-d36623674ea6=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac95f510}, log id: 75cbf869 2013-12-13 13:28:05,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = Dell3, HostId = 342b037f-e4ab-4c3b-b804-806d3ec30ba9), log id: 76386ce 2013-12-13 13:28:07,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {30759593-86cf-47d3-8527-d36623674ea6=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee3bee7d}, log id: 76386ce
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

On Sun, Dec 15, 2013 at 8:33 AM, Vered Volansky wrote:
Hi Juan,
The following patch should handle the messages: http://gerrit.ovirt.org/#/c/22287
Can we safely run the sql statements referred in that patch against a running environment, eventually stopping engine service before: so against the engine db only run select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.0'); select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.1'); select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.2'); select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.3'); ? Thanks, Gianluca

I think Sahina is qualified to answer this question, Sahina? ----- Original Message -----
From: "Gianluca Cecchi" <gianluca.cecchi@gmail.com> To: "Vered Volansky" <vered@redhat.com> Cc: "Juan Pablo Lorier" <jplorier@gmail.com>, "users" <users@ovirt.org> Sent: Sunday, December 15, 2013 6:52:07 PM Subject: Re: [Users] errors in engine log and tones of sync messages
On Sun, Dec 15, 2013 at 8:33 AM, Vered Volansky wrote:
Hi Juan,
The following patch should handle the messages: http://gerrit.ovirt.org/#/c/22287
Can we safely run the sql statements referred in that patch against a running environment, eventually stopping engine service before: so against the engine db only run
select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.0'); select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.1'); select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.2'); select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.3');
? Thanks, Gianluca _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

On 12/16/2013 03:26 PM, Vered Volansky wrote:
I think Sahina is qualified to answer this question, Sahina?
----- Original Message -----
From: "Gianluca Cecchi" <gianluca.cecchi@gmail.com> To: "Vered Volansky" <vered@redhat.com> Cc: "Juan Pablo Lorier" <jplorier@gmail.com>, "users" <users@ovirt.org> Sent: Sunday, December 15, 2013 6:52:07 PM Subject: Re: [Users] errors in engine log and tones of sync messages
On Sun, Dec 15, 2013 at 8:33 AM, Vered Volansky wrote:
Hi Juan,
The following patch should handle the messages: http://gerrit.ovirt.org/#/c/22287
Can we safely run the sql statements referred in that patch against a running environment, eventually stopping engine service before: so against the engine db only run
select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.0'); select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.1'); select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.2'); select fn_db_add_config_value('GlusterAysncTasksSupport', 'false', '3.3');
Yes, it is safe to run these.
? Thanks, Gianluca _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

Hi Vered and all other who answered my question. Thank you very much for the answer, I'll see to do the db change to avoid the messages. I'm so busy this days that I just couldn't answer before. Regards, On 15/12/13 05:33, Vered Volansky wrote:
Hi Juan,
The following patch should handle the messages: http://gerrit.ovirt.org/#/c/22287
This looks like the issue mentioned in thread: https://www.mail-archive.com/users@ovirt.org/msg12378.html
Regards, Vered
----- Original Message -----
From: "Juan Pablo Lorier" <jplorier@gmail.com> To: "users" <users@ovirt.org> Sent: Friday, December 13, 2013 6:23:41 PM Subject: [Users] errors in engine log and tones of sync messages
Hi,
I'm trying to debug why I can't import a VM to my brand new glusterfs domain and I see that engine.log is full of gluster volumelist calls and less but often, errors of not been able to call async, I'm I missing any package to install in the engine other than vdsm-gluster? Is there a way not to log all the VolumeList commands (without lowering log level) to avoid having so many entries that difficult searching in the log? Regards,
: 5c8baf53 2013-12-13 13:27:58,504 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-33) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedMethodAccessor108.invoke(Unknown Source) [:1.7.0_45] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: org.apache.xmlrpc.XmlRpcException: <type 'exceptions.Exception'>:method "glusterTasksList" is not supported (Failed with error VDS_NETWORK_ERROR and code 5022) at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] ... 6 more
2013-12-13 13:28:00,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = Dell4, HostId = 001f72ef-fac6-42bc-be8e-b17e249e80bd), log id: 75cbf869 2013-12-13 13:28:00,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {30759593-86cf-47d3-8527-d36623674ea6=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac95f510}, log id: 75cbf869 2013-12-13 13:28:05,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = Dell3, HostId = 342b037f-e4ab-4c3b-b804-806d3ec30ba9), log id: 76386ce 2013-12-13 13:28:07,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {30759593-86cf-47d3-8527-d36623674ea6=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee3bee7d}, log id: 76386ce
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

On Mon, Dec 16, 2013 at 6:47 PM, Juan Pablo Lorier wrote:
Hi Vered and all other who answered my question. Thank you very much for the answer, I'll see to do the db change to avoid the messages. I'm so busy this days that I just couldn't answer before. Regards,
On 15/12/13 05:33, Vered Volansky wrote:
Hi Juan,
The following patch should handle the messages: http://gerrit.ovirt.org/#/c/22287
This looks like the issue mentioned in thread: https://www.mail-archive.com/users@ovirt.org/msg12378.html
Regards, Vered
I confirm no more error messages related to " Failed to invoke scheduled method gluster_async_task_poll_event " after applying the patch sql statements Previously I received one every minute. Thanks, Gianluca
participants (4)
-
Gianluca Cecchi
-
Juan Pablo Lorier
-
Sahina Bose
-
Vered Volansky