[ OST Failure Report ] [ oVirt Master (ovirt-host) ] [ 22-02-2018 ] [002_bootstrap.add_hosts ]
by Dafna Ron
hi,
we have a failed test for ovirt-host in upgrade suite.
*Link and headline of suspected patches: *
*Require collectd-virt plugin - https://gerrit.ovirt.org/#/c/87311/
<https://gerrit.ovirt.org/#/c/87311/>Link to Job:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5827/
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5827/>Link
to all
logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5827/a...
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5827/artifacts>(Relevant)
error snippet from the log: <error>*
2018-02-22 05:38:47,587-05 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(VdsDeploy) [546df98d] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509),
Installing Host lago-upgrade-from-release-suite-master-host0. Setting
kernel arguments.
2018-02-22 05:38:47,858-05 ERROR
[org.ovirt.engine.core.uutils.ssh.SSHDialog]
(EE-ManagedThreadFactory-engine-Thread-1) [546df98d] Swallowing
exception as preferring stderr
2018-02-22 05:38:47,859-05 ERROR
[org.ovirt.engine.core.uutils.ssh.SSHDialog]
(EE-ManagedThreadFactory-engine-Thread-1) [546df98d] SSH error running
command root@lago-upgrade-from-release-suite-master-host0:'umask 0077;
MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)";
trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr
\"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C
"${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy
DIALOG/dialect=str:machine DIALOG/customization=bool:True':
RuntimeException: Unexpected error during execution: bash: line 1:
1395 Segmentation fault "${MYTMP}"/ovirt-host-deploy
DIALOG/dialect=str:machine DIALOG/customization=bool:True
2018-02-22 05:38:47,859-05 ERROR
[org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy)
[546df98d] Error during deploy dialog
2018-02-22 05:38:47,860-05 ERROR
[org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase]
(EE-ManagedThreadFactory-engine-Thread-1) [546df98d] Error during host
lago-upgrade-from-release-suite-master-host0 install
2018-02-22 05:38:47,864-05 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-1) [546df98d] EVENT_ID:
VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during
installation of Host lago-upgrade-from-release-suite-master-host0:
Unexpected error during execution: bash: line 1: 1395 Segmentation
fault "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine
DIALOG/customization=bool:True
.
2018-02-22 05:38:47,864-05 ERROR
[org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase]
(EE-ManagedThreadFactory-engine-Thread-1) [546df98d] Error during host
lago-upgrade-from-release-suite-master-host0 install, preferring first
exception: Unexpected connection termination
2018-02-22 05:38:47,864-05 ERROR
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1) [546df98d] Host installation
failed for host '65c048e5-a97a-422d-88b8-abe1fd925602',
'lago-upgrade-from-release-suite-master-host0': Unexpected connection
termination
2018-02-22 05:38:47,869-05 INFO
[org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-1) [546df98d] START,
SetVdsStatusVDSCommand(HostName =
lago-upgrade-from-release-suite-master-host0,
SetVdsStatusVDSCommandParameters:{hostId='65c048e5-a97a-422d-88b8-abe1fd925602',
status='InstallFailed', nonOperationalReason='NONE',
stopSpmFailureLogged='false', maintenanceReason='null'}), log id:
1973b09c
2018-02-22 05:38:47,898-05 INFO
[org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-1) [546df98d] FINISH,
SetVdsStatusVDSCommand, log id: 1973b09c
2018-02-22 05:38:47,911-05 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-1) [546df98d] EVENT_ID:
VDS_INSTALL_FAILED(505), Host
lago-upgrade-from-release-suite-master-host0 installation failed.
Unexpected connection termination.
2018-02-22 05:38:47,920-05 INFO
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1) [546df98d] Lock freed to
object 'EngineLock:{exclusiveLocks='[65c048e5-a97a-422d-88b8-abe1fd925602=VDS]',
sharedLocks=''}'
*</error>*
6 years, 9 months
oVirt infra weekly meeting notes 21.02.2018
by Evgheni Dereveanchin
Hi everyone,
Please find the topics of this week's infra meeting below:
We had Sahil join the meeting who volunteered to help with the infra
- we can start working on improving ovirt-infra-docs.readthedocs.io
- patches can be sent to gerrit:
https://gerrit.ovirt.org/#/admin/projects/infra-docs
*PHX DC - Jenkins updated, puppet bug caused service restarts- Several VMs
had ipv6 disabled - fixed- Resources was slow due to a VM imposing load on
storage- Cockpit QA requested 2 PPC VMs for testingAI - Split global_setup
patch into individual functions and merge one by one- Update mirror
snapshots to get the new mock*
--
Regards,
Evgheni Dereveanchin
6 years, 9 months
[ OST Failure Report ] [ oVirt $VER (ovirt-log-collector) ] [ 21-02-2018 ] [ 098_ovirt_provider_ovn.use_ovn_provider ]
by Dafna Ron
Hi,
We failed test on duplicate network name. I don't think that the change is
related.
I can see that we are importing network_1 and then trying to create a
network by the same name.
I don't think there was a change made to ovn before this failure that could
have cause this to fail but adding Dan in case he is aware of any changes.
*Link and headline of suspected patches: failed change: *
inventory: handle to postgresql dumps from sosreport -
https://gerrit.ovirt.org/#/c/88010/
*Change reported as root cause of failure: *collector: fix list function -
https://gerrit.ovirt.org/#/c/87798/
*Link to
Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5805
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5805>Link to
all logs:*
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5805/artifacts
*(Relevant) error snippet from the log: <error>*
2018-02-20 23:51:03,179-05 DEBUG
[org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall]
(default task-19) [4a0a588a-e606-4151-936a-f66a8c580a78] Compiled
stored procedure. Call string is [{call
getdcidbyexternalnetworkid(?)}]
2018-02-20 23:51:03,179-05 DEBUG
[org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall]
(default task-19) [4a0a588a-e606-4151-936a-f66a8c580a78] SqlCall for
procedure [GetDcIdByExternalNetworkId] compiled
2018-02-20 23:51:03,180-05 DEBUG
[org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor]
(default task-19) [4a0a588a-e606-4151-936a-f66a8c580a78] method:
runQuery, params: [GetAllExternalNetworksOnProvider,
IdQueryParameters:{refresh='false', filtered='false'}], timeElapsed:
266ms
2018-02-20 23:51:03,187-05 INFO
[org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (default
task-19) [4a0a588a-e606-4151-936a-f66a8c580a78] Lock Acquired to
object 'EngineLock:{exclusiveLocks='[network_1=NETWORK,
94fc81b9-fbf2-4262-a877-32a066a573c2=PROVIDER]', sharedLocks=''}'
2018-02-20 23:51:03,190-05 WARN
[org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (default
task-19) [4a0a588a-e606-4151-936a-f66a8c580a78] Validation of action
'AddNetwork' failed for user admin@internal-authz. Reasons:
VAR__TYPE__NETWORK,VAR__ACTION__ADD,ACTION_TYPE_FAILED_NETWORK_NAME_IN_USE,$NetworkName
network_1
2018-02-20 23:51:03,190-05 INFO
[org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (default
task-19) [4a0a588a-e606-4151-936a-f66a8c580a78] Lock freed to object
'EngineLock:{exclusiveLocks='[network_1=NETWORK,
94fc81b9-fbf2-4262-a877-32a066a573c2=PROVIDER]', sharedLocks=''}'
2018-02-20 23:51:03,191-05 DEBUG
[org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor]
(default task-19) [4a0a588a-e606-4151-936a-f66a8c580a78] method:
runAction, params: [AddNetwork,
AddNetworkStoragePoolParameters:{commandId='41c44658-04e5-4aeb-9f65-cc2ad76e0c42',
user='null', commandType='Unknown'}], timeElapsed: 10ms
2018-02-20 23:51:03,196-05 ERROR
[org.ovirt.engine.api.restapi.resource.AbstractBackendResource]
(default task-19) [] Operation Failed: [Cannot add Network. The name
of the logical network 'network_1' is already used by an existing
logical network in the same data-center.
-Please choose a different name.]
2018-02-20 23:51:03,346-05 DEBUG
[org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor]
(EE-ManagedThreadFactory-engineScheduled-Thread-47) [] method: get,
params: [da0bebdb-cb83-415f-bcba-8920126e31a4], timeElapsed: 6ms
2018-02-20 23:51:03,346-05 DEBUG
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
(EE-ManagedThreadFactory-engineScheduled-Thread-47) []
vdsManager::refreshVdsStats entered,
host='lago-basic-suite-master-host-1'(da0bebdb-cb83-415f-bcba-8920126e31a4)
2018-02-20 23:51:03,365-05 DEBUG
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-47) [] START,
GetStatsAsyncVDSCommand(HostName = lago-basic-suite-master-host-1,
VdsIdAndVdsVDSCommandParametersBase:{hostId='da0bebdb-cb83-415f-bcba-8920126e31a4',
vds='Host[lago-basic-suite-master-host-1,da0bebdb-cb83-415f-bcba-8920126e31a4]'}),
log id: 279de334
2018-02-20 23:51:03,365-05 DEBUG
[org.ovirt.vdsm.jsonrpc.client.reactors.stomp.impl.Message]
(EE-ManagedThreadFactory-engineScheduled-Thread-47) [] SEND
destination:jms.topic.vdsm_requests
reply-to:jms.topic.vdsm_responses
content-length:98
*</error>*
6 years, 9 months