[ovirt-users] Failed to check for available updates on host * with message 'Command returned failure code 1 during SSH session 'root@*

Mon Sep 12 07:20:12 UTC 2016

Hello oVirt guru`s!

oVirt Engine Version: 4.0.1.1-1.el7.centos

Every day there is a message in web UI for one of my two hosts:

"Failed to check for available updates on host KOM-AD01-VM31 with message 'Command returned failure code 1 during SSH session 'root at kom-ad01-vm31.holding.com''.

In /var/log/ovirt-engine/engine.log at this time:

...
2016-09-12 01:59:45,045 INFO  [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [] Stage: Initializing
2016-09-12 01:59:45,055 INFO  [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [] Stage: Environment setup
2016-09-12 01:59:45,070 INFO  [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [] Stage: Environment packages setup
2016-09-12 02:00:13,300 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [] Yum Cannot queue package iproute: Cannot find a valid baseurl for repo: base/7/x86_64
2016-09-12 02:00:13,304 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [] Failed to execute stage 'Environment packages setup': Cannot find a valid baseurl for repo: base/7/x86_64
2016-09-12 02:00:13,304 INFO  [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [] Yum Performing yum transaction rollback
2016-09-12 02:00:13,368 INFO  [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [] Stage: Pre-termination
2016-09-12 02:00:13,388 INFO  [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [] Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-mgmt-20160912020013-kom-ad01-vm31.holding.com-null.l$
2016-09-12 02:00:13,459 INFO  [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [] Stage: Termination
2016-09-12 02:00:13,506 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (DefaultQuartzScheduler5) [] SSH error running command root at kom-ad01-vm31.holding.com:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x &&  "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True': Command returned failure code 1 during SSH session 'root at kom-ad01-vm31.holding.com'

2016-09-12 02:00:13,506 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (DefaultQuartzScheduler5) [] Exception: java.io.IOException: Command returned failure code 1 during SSH session 'root at kom-ad01-vm31.holding.com'
        at org.ovirt.engine.core.uutils.ssh.SSHClient.executeCommand(SSHClient.java:526) [uutils.jar:]
        at org.ovirt.engine.core.uutils.ssh.SSHDialog.executeCommand(SSHDialog.java:317) [uutils.jar:]
        at org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase.execute(VdsDeployBase.java:563) [bll.jar:]
        at org.ovirt.engine.core.bll.host.HostUpgradeManager.isUpdateAvailable(HostUpgradeManager.java:44) [bll.jar:]
        at org.ovirt.engine.core.bll.host.AvailableUpdatesFinder.isUpdateAvailable(AvailableUpdatesFinder.java:26) [bll.jar:]
        at org.ovirt.engine.core.bll.VdsEventListener.isUpdateAvailable(VdsEventListener.java:553) [bll.jar:]
        at org.ovirt.engine.core.vdsbroker.ResourceManager.isUpdateAvailable(ResourceManager.java:510) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.VdsManager.availableUpdates(VdsManager.java:306) [vdsbroker.jar:]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_101]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_101]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_101]
        at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_101]
        at org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:77) [scheduler.jar:]
        at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:51) [scheduler.jar:]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_101]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_101]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_101]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_101]
        at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_101]

2016-09-12 02:00:13,507 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (DefaultQuartzScheduler5) [] Error during host kom-ad01-vm31.holding.com install: java.io.IOException: Command returned failure code 1 during SSH session 'root at kom-ad01-vm31.holding.com'
        at org.ovirt.engine.core.uutils.ssh.SSHClient.executeCommand(SSHClient.java:526) [uutils.jar:]
        at org.ovirt.engine.core.uutils.ssh.SSHDialog.executeCommand(SSHDialog.java:317) [uutils.jar:]
        at org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase.execute(VdsDeployBase.java:563) [bll.jar:]
        at org.ovirt.engine.core.bll.host.HostUpgradeManager.isUpdateAvailable(HostUpgradeManager.java:44) [bll.jar:]
        at org.ovirt.engine.core.bll.host.AvailableUpdatesFinder.isUpdateAvailable(AvailableUpdatesFinder.java:26) [bll.jar:]
        at org.ovirt.engine.core.bll.VdsEventListener.isUpdateAvailable(VdsEventListener.java:553) [bll.jar:]
        at org.ovirt.engine.core.vdsbroker.ResourceManager.isUpdateAvailable(ResourceManager.java:510) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.VdsManager.availableUpdates(VdsManager.java:306) [vdsbroker.jar:]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_101]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_101]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_101]
        at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_101]
        at org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:77) [scheduler.jar:]
        at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:51) [scheduler.jar:]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_101]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_101]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_101]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_101]
        at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_101]

2016-09-12 02:00:13,512 ERROR [org.ovirt.engine.core.bll.host.HostUpgradeManager] (DefaultQuartzScheduler5) [] Failed to refresh host 'KOM-AD01-VM31' packages 'vdsm-cli, vdsm' availability.
2016-09-12 02:00:13,512 ERROR [org.ovirt.engine.core.bll.host.HostUpgradeManager] (DefaultQuartzScheduler5) [] Exception: java.io.IOException: Command returned failure code 1 during SSH session 'root at kom-ad01-vm31.holding.com'
        at org.ovirt.engine.core.uutils.ssh.SSHClient.executeCommand(SSHClient.java:526) [uutils.jar:]
        at org.ovirt.engine.core.uutils.ssh.SSHDialog.executeCommand(SSHDialog.java:317) [uutils.jar:]
        at org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase.execute(VdsDeployBase.java:563) [bll.jar:]
        at org.ovirt.engine.core.bll.host.HostUpgradeManager.isUpdateAvailable(HostUpgradeManager.java:44) [bll.jar:]
        at org.ovirt.engine.core.bll.host.AvailableUpdatesFinder.isUpdateAvailable(AvailableUpdatesFinder.java:26) [bll.jar:]
        at org.ovirt.engine.core.bll.VdsEventListener.isUpdateAvailable(VdsEventListener.java:553) [bll.jar:]
        at org.ovirt.engine.core.vdsbroker.ResourceManager.isUpdateAvailable(ResourceManager.java:510) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.VdsManager.availableUpdates(VdsManager.java:306) [vdsbroker.jar:]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_101]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_101]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_101]
        at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_101]
        at org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:77) [scheduler.jar:]
        at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:51) [scheduler.jar:]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_101]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_101]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_101]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_101]
        at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_101]

2016-09-12 02:00:13,513 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler5) [] Failed to check if updates are available for host 'KOM-AD01-VM31'
2016-09-12 02:00:13,518 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler5) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to check for available updates on host KOM-AD01-VM31 with message 'Command returned failure code 1 during SSH session 'root at kom-ad01-vm31.holding.com''.

...

What could be the problem?