VDSM test failures on CentOS Stream 9
by Sandro Bonazzola
[2021-09-15T07:51:34.718Z] ssl_test.py .............. [100
%]/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/rpc/Bridge.py:
214: SyntaxWarning: "is not" with a literal. Did you mean "!="?
[2021-09-15T07:51:34.718Z] if key is not 'status'])
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] =================================== FAILURES
===================================
[2021-09-15T07:51:49.765Z] ______________________
TestTerminating.test_poll_failure _______________________
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] self = <utils_test.TestTerminating
testMethod=test_poll_failure>
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] def tearDown(self):
[2021-09-15T07:51:49.765Z] if self.proc_poll() is None:
[2021-09-15T07:51:49.765Z] > self.proc_kill()
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] lib/utils_test.py:88:
[2021-09-15T07:51:49.765Z] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[2021-09-15T07:51:49.765Z] /usr/lib64/python3.9/subprocess.py:2080: in kill
[2021-09-15T07:51:49.765Z] self.send_signal(signal.SIGKILL)
[2021-09-15T07:51:49.765Z] /usr/lib64/python3.9/subprocess.py:2058: in
send_signal
[2021-09-15T07:51:49.765Z] self.poll()
[2021-09-15T07:51:49.765Z] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] def fail():
[2021-09-15T07:51:49.765Z] > raise ExpectedFailure("Fake poll failure")
[2021-09-15T07:51:49.765Z] E utils_test.ExpectedFailure: Fake poll failure
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] lib/utils_test.py:122: ExpectedFailure
[2021-09-15T07:51:49.765Z] ------------------------------ Captured log call
-------------------------------
[2021-09-15T07:51:49.765Z] 03:50:38,141 DEBUG (MainThread)
[common.commands] /usr/bin/taskset --cpu-list 0-1 /usr/bin/sleep 2 (cwd None)
(commands:153)
[2021-09-15T07:51:49.765Z] _____________
TestExecCmdAffinity.testResetAffinityWhenConfigured ______________
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] a = (<utils_test.TestExecCmdAffinity
testMethod=testResetAffinityWhenConfigured>,)
[2021-09-15T07:51:49.765Z] kw = {}, r = 13, w = 14, pid = 440223
[2021-09-15T07:51:49.765Z] e = AssertionError('Items in the first set but
not the second:\n1'), _ = 440223
[2021-09-15T07:51:49.765Z] status = 256
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] @functools.wraps(f)
[2021-09-15T07:51:49.765Z] def wrapper(*a, **kw):
[2021-09-15T07:51:49.765Z] r, w = os.pipe()
[2021-09-15T07:51:49.765Z] try:
[2021-09-15T07:51:49.765Z] pid = os.fork()
[2021-09-15T07:51:49.765Z] if pid == 0:
[2021-09-15T07:51:49.765Z] try:
[2021-09-15T07:51:49.765Z] f(*a, **kw)
[2021-09-15T07:51:49.765Z] os._exit(0)
[2021-09-15T07:51:49.765Z] except Exception as e:
[2021-09-15T07:51:49.765Z] os.write(w, pickle.dumps(e))
[2021-09-15T07:51:49.765Z] os._exit(1)
[2021-09-15T07:51:49.765Z] else:
[2021-09-15T07:51:49.765Z] _, status = osutils.uninterruptible(os.waitpid,
pid, 0)
[2021-09-15T07:51:49.765Z] if status != 0:
[2021-09-15T07:51:49.765Z] e = pickle.loads(os.read(r, 4006))
[2021-09-15T07:51:49.765Z] > raise e
[2021-09-15T07:51:49.765Z] E AssertionError: Items in the first set but not
the second:
[2021-09-15T07:51:49.765Z] E 1
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] testlib.py:570: AssertionError
[2021-09-15T07:51:49.765Z] =============================== warnings summary
===============================
[2021-09-15T07:51:49.765Z]
../../../../../../usr/lib/python3.9/site-packages/nose/importer.py:12
[2021-09-15T07:51:49.765Z]
/usr/lib/python3.9/site-packages/nose/importer.py:12: DeprecationWarning:
the imp module is deprecated in favour of importlib; see the module's
documentation for alternative uses
[2021-09-15T07:51:49.765Z] from imp import find_module, load_module,
acquire_lock, release_lock
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] ../lib/vdsm/rpc/Bridge.py:214
[2021-09-15T07:51:49.765Z]
/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/rpc/Bridge.py:
214: SyntaxWarning: "is not" with a literal. Did you mean "!="?
[2021-09-15T07:51:49.765Z] if key is not 'status'])
[2021-09-15T07:51:49.765Z]
[2021-09-15T07:51:49.765Z] -- Docs:
https://docs.pytest.org/en/stable/warnings.html
[2021-09-15T07:51:49.765Z]
Any chance someone can investigate them?
https://jenkins.ovirt.org/blue/organizations/jenkins/vdsm_standard-check-...
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV
Red Hat EMEA <https://www.redhat.com/>
sbonazzo(a)redhat.com
<https://www.redhat.com/>
*Red Hat respects your work life balance. Therefore there is no need to
answer this email out of your office hours.*
3 years, 2 months
ovirt-engine-extension-aaa-ldap broken, if using CNAME for LDAP server DNS
by Erdősi Péter
Hello!
We're started the upgrade one of our oVirt clusters to the recent 4.4
minor version (4.4.8.5-1.el8) and we found a bug in the recent change of
the aaa-ldap plugin.
This bug came along after the IPv4/IPv6 selection introduced in
ovirt-engine-extension-aaa-ldap 1.4.4
We've dig down in the rabbit hole, and it looks like, our DNS solution
is just not compatible with the plugin after this commit:
https://github.com/oVirt/ovirt-engine-extension-aaa-ldap/commit/4c0f2e72d...
I don't know, how the industry actually use CNAME records, but we have a
rule, that we use independet DNS names for services, and machines
itself. This become handy, when you migrate/upgrade services, like LDAP
to another machine, and I think, this should be supported.
Our LDAP server service domain is actually ldap-master.niif.hu and
ldap.niif.hu, but in real, there are two servers, which actually have
their own FQDNs.
The actual DNS structure:
host -t CNAME ldap-master.niif.hu
ldap-master.niif.hu is an alias for elm.niif.hu.
host -t CNAME ldap.niif.hu
ldap.niif.hu is an alias for holly.ldap.einfra.hu.
host elm.niif.hu
elm.niif.hu has address 193.225.14.175
elm.niif.hu has IPv6 address 2001:738:0:701::3
host holly.ldap.einfra.hu
holly.ldap.einfra.hu has address 193.224.92.6
holly.ldap.einfra.hu has IPv6 address 2001:738:0:431::6
The commit above (as far as I understand) only tries to resolve A and
AAAA records in DNS, and drop the connection if it not found. Of course,
the certificate only have ldap-master and ldap.niif.hu in it, so using
holly end elm does not solve the problem (also, if the service will be
migrated, the service domain will be kept, but not the machine's FQDN,
since we cannot afford to shut down one of our LDAP server for a
migration windows.
We've tried to downgrade the package to 1.4.3, which is works fine.
The actual error looks like this (engine.log)
2021-09-07 15:53:09,833+02 WARN
[org.ovirt.engine.extension.aaa.ldap.AuthnExtension] (default task-1) []
[ovirt-engine-extension-aaa-ldap.authn::NIIFLdap-authn] Cannot
initialize LDAP framework, deferring initialization. Error: An error
occurred while attempting to connect to server ldap-master.niif.hu:636:
IOException(LDAPException(resultCode=91 (connect error),
errorMessage='An error occurred while attempting to establish a
connection to server ldap-master.niif.hu/193.225.14.175:636:
UnknownHostException(ldap-master.niif.hu), ldapSDKVersion=4.0.14,
revision=c0fb784eebf9d36a67c736d0428fb3577f2e25bb'))
2021-09-07 15:53:09,833+02 ERROR
[org.ovirt.engine.core.sso.servlets.InteractiveAuthServlet] (default
task-1) [] Internal Server Error: An error occurred while attempting to
connect to server ldap-master.niif.hu:636:
IOException(LDAPException(resultCode=91 (connect error),
errorMessage='An error occurred while attempting to establish a
connection to server ldap-master.niif.hu/193.225.14.175:636:
UnknownHostException(ldap-master.niif.hu), ldapSDKVersion=4.0.14,
revision=c0fb784eebf9d36a67c736d0428fb3577f2e25bb'))
2021-09-07 15:53:09,833+02 ERROR
[org.ovirt.engine.core.sso.service.SsoService] (default task-1) [] An
error occurred while attempting to connect to server
ldap-master.niif.hu:636: IOException(LDAPException(resultCode=91
(connect error), errorMessage='An error occurred while attempting to
establish a connection to server ldap-master.niif.hu/193.225.14.175:636:
UnknownHostException(ldap-master.niif.hu), ldapSDKVersion=4.0.14,
revision=c0fb784eebf9d36a67c736d0428fb3577f2e25bb'))
2021-09-07 15:53:09,854+02 ERROR
[org.ovirt.engine.core.aaa.servlet.SsoPostLoginServlet] (default task-1)
[] server_error: An error occurred while attempting to connect to server
ldap-master.niif.hu:636: IOException(LDAPException(resultCode=91
(connect error), errorMessage='An error occurred while attempting to
establish a connection to server ldap-master.niif.hu/193.225.14.175:636:
UnknownHostException(ldap-master.niif.hu), ldapSDKVersion=4.0.14,
revision=c0fb784eebf9d36a67c736d0428fb3577f2e25bb'))
As we tried to run the setup tool, that is also looks broken (after
that, we've copied the required files to /etc/ovirt-engine/aaa and
/etc/ovirt-engine/extensions.d/ from other, working hosted engine) so
we've tested the plugin itself, and the setup too, but no luck.
I think, this (CNAME in DNS) should be working with the plugin.
Could you please investigate this issue? (we're here to help test the
repaired version/patch, if needed, but not feel the knowledge to create
the patch ourself)
Regards:
Peter
--
*Erdősi Péter
* /Informatikus, IKT Fejlesztési Főosztály /
*Kormányzati Informatikai Fejlesztési Ügynökség
* cím: 1134 Budapest, Váci út 35.
tel: +36 1 450 3080 e-mail: erdosi.peter(a)kifu.gov.hu
<mailto:erdosi.peter@kifu.gov.hu>
KIFÜ - www.kifu.gov.hu <http://kifu.gov.hu/kifu/>
3 years, 2 months
Google OAuth enabled on jenkins.ovirt.org
by Evgheni Dereveanchin
Hi Everyone,
TL;DR:
From now on please use a Google account if you need to log in to
jenkins.ovirt.rog
Longer version:
We're using Jenkins CI for oVirt and most content does not need
authentication - this does not change. Some workflows such as manual job
runs do need sign-in and up until now a local user database was used for
that. It was inconvenient and not did not meet modern security standards.
To improve the situation we're moving to Google OAuth. It works similarly
to what we already have on gerrit.ovirt.org and other services.
Existing user accounts were migrated so all permissions should be retained.
Job results will be available without sign-in just as they did before. If
you are unable to perform some actions that worked before - please let me
know or log a JIRA ticket.
--
Regards,
Evgheni Dereveanchin
3 years, 2 months
self hosted engine installation stucks in "run engine-setup with answerfile"
by parkyh0413＠gmail.com
Hi, I'm building ovirt-engine and ovirt-engine-appliance rpm on CentOS8.
But when I install ovirt using "hosted-engine --deploy" command using local repository that contains the rpms,
the installation always stucks in "run engine-setup with answerfile".
So I checked engine-setup log in /var/log/ovirt-engine/setup of HostedEngineLocal VM, the error log is as follow.
I've been trying to solve this problem for a long time, but i'm just not sure what the problem is.
---
2021-09-08 14:44:23,841+0900 DEBUG otopi.plugins.otopi.dialog.human human.queryString:159 query OVESETUP_ENGINE_DB_PASSWORD
2021-09-08 14:44:23,842+0900 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND Engine database password:
2021-09-08 14:44:23,843+0900 DEBUG otopi.ovirt_engine_setup.engine_common.database database.getCredentials:1343 dbenv: {'OVESETUP_DB/host': 'localhost', 'OVESETUP_DB/port': 5432, 'OVESETUP_DB/secured': False, 'OVESETUP_DB/securedHostValidation': False, 'OVESETUP_DB/database': 'engine', 'OVESETUP_DB/user': 'engine', 'OVESETUP_DB/password': ''}
2021-09-08 14:44:23,845+0900 DEBUG otopi.ovirt_engine_setup.engine_common.database database.execute:234 Database: 'None', Statement: '
select 1
', args: {}
2021-09-08 14:44:23,846+0900 DEBUG otopi.ovirt_engine_setup.engine_common.database database.execute:239 Creating own connection
2021-09-08 14:44:23,848+0900 DEBUG otopi.ovirt_engine_setup.engine_common.database database.tryDatabaseConnect:394 Connection failed
Traceback (most recent call last):
File "/usr/share/ovirt-engine/setup/ovirt_engine_setup/engine_common/database.py", line 390, in tryDatabaseConnect
transaction=False,
File "/usr/share/ovirt-engine/setup/ovirt_engine_setup/engine_common/database.py", line 248, in execute
database=database,
File "/usr/share/ovirt-engine/setup/ovirt_engine_setup/engine_common/database.py", line 181, in connect
sslmode=sslmode,
File "/usr/lib64/python3.6/site-packages/psycopg2/__init__.py", line 130, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "localhost" (::1) and accepting
TCP/IP connections on port 5432?
could not connect to server: Connection refused
Is the server running on host "localhost" (127.0.0.1) and accepting
TCP/IP connections on port 5432?
2021-09-08 14:44:23,849+0900 ERROR otopi.ovirt_engine_setup.engine_common.database database.getCredentials:1361 Cannot connect to Engine database: Cannot connect to database: could not connect to server: Connection refused
Is the server running on host "localhost" (::1) and accepting
TCP/IP connections on port 5432?
could not connect to server: Connection refused
Is the server running on host "localhost" (127.0.0.1) and accepting
TCP/IP connections on port 5432?
---
Regards,
parkyh0413
3 years, 2 months
2021-09-08 oVirt 4.4.z branching status update
by Sandro Bonazzola
Hi, an update on where we are with 4.4.z branching:
Result:
package: ovirt-engine-4.4.9-0.0.master.20210831071114.git33e35c629e5.el8.noarch
from ovirt-4.4-tested
unresolved deps:
ovirt-dependencies >= 4.4.2
ovirt-engine-ui-extensions >= 1.0.4
ovirt-cockpit-sso
ovirt-imageio-daemon >= 2.0.10-1
ovirt-web-ui
ovirt-ansible-collection >= 1.2.0
package: ovirt-engine-backend-4.4.9-0.0.master.20210831071114.git33e35c629e5.el8.noarch
from ovirt-4.4-tested
unresolved deps:
java-client-kubevirt >= 0.5.0
ovirt-engine-extension-aaa-jdbc >= 1.2.0
vdsm-jsonrpc-java >= 1.6.0
vdsm-jsonrpc-java < 1.7.0
package: ovirt-engine-setup-plugin-imageio-4.4.9-0.0.master.20210831071114.git33e35c629e5.el8.noarch
from ovirt-4.4-tested
unresolved deps:
ovirt-imageio-daemon >= 2.0.10-1
package: ovirt-engine-setup-plugin-ovirt-engine-4.4.9-0.0.master.20210831071114.git33e35c629e5.el8.noarch
from ovirt-4.4-tested
unresolved deps:
ovirt-engine-extension-aaa-jdbc >= 1.2.0
package: ovirt-host-4.4.8-1.1.20210817163956.git6573056.el8.x86_64
from ovirt-4.4-tested
unresolved deps:
cockpit-ovirt-dashboard
package: ovirt-host-dependencies-4.4.8-1.1.20210817163956.git6573056.el8.x86_64
from ovirt-4.4-tested
unresolved deps:
ovirt-imageio-client
package: ovirt-hosted-engine-setup-2.5.4-0.0.master.20210908141824.git9103df7.el8.noarch
from ovirt-4.4-tested
unresolved deps:
ovirt-hosted-engine-ha >= 2.4
python3-ovirt-engine-sdk4 >= 4.3.1
ovirt-ansible-collection >= 1.5.4
package: ovirt-release-host-node-4.4.9-0.0.master.20210906100952.gitc2eb82a.el8.noarch
from ovirt-4.4-tested
unresolved deps:
python3-ovirt-engine-sdk4
package: vdsm-4.40.90-9.git48250e672.el8.x86_64 from ovirt-4.4-tested
unresolved deps:
ovirt-imageio-daemon >= 2.2.0-1
ovirt-imageio-common
package: vdsm-python-4.40.90-9.git48250e672.el8.noarch from ovirt-4.4-tested
unresolved deps:
python3-ioprocess >= 1.4.1
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV
Red Hat EMEA <https://www.redhat.com/>
sbonazzo(a)redhat.com
<https://www.redhat.com/>
*Red Hat respects your work life balance. Therefore there is no need to
answer this email out of your office hours.*
3 years, 2 months
planned Jenkins CI restart
by Evgheni Dereveanchin
Hi everyone,
I'll be performing a planned Jenkins restart within the next hour.
No new CI jobs will be scheduled during this maintenance period.
I will inform you once it is back online.
--
Regards,
Evgheni Dereveanchin
3 years, 2 months
