- Devel - oVirt List Archives

Parsing gwt rpc messages
by Anastasiya Ruzhanskaya 24 Oct '18

24 Oct '18

Hello everyone! I am trying to determine how the person who knows for example all necessary function calls and parameters can determine the content of the message sent. This is an example of the message I am trying to parse (I already separated it on some meaningful parts), numbers in braces just help to make correspondence between payload and strings: 7| 0| 14| (1)https://engine.localdomain/ovirt-engine/webadmin/| //URL (2)E8B2AD24442204349EF795039C3B87E5| // policy name (3)org.ovirt.engine.ui.frontend.gwtservices.GenericApiGWTService| service interface (4)runMultipleActions| name of the method (5)org.ovirt.engine.core.common.action.ActionType/12242454|, (6)java.util.ArrayList/4159755760|, (7)Z| ( two times)) // bool type (8)org.ovirt.engine.core.common.action.ShutdownVmParameters/1694554255| (9)org.ovirt.engine.core.compat.Guid/1992968158| (10)java.util.UUID/2940008275| (11)org.ovirt.engine.core.common.action.ActionParametersBase$EndProcedure/1568822488| (12)java.util.Collections$EmptyMap/4174664486| (13)org.ovirt.engine.core.common.businessentities.VDSStatus/1938301532| (14)org.ovirt.engine.core.compat.TransactionScopeOption/1475850853| (the following is the payload separated and commented in places where I can understand it) 1| 2| 3| 4| 4|- 4 method parameters 5|- first type = ActionType 6|- second type = arraylist 7|- third type = boolean 7|- fourth type = boolean 5(actionType)|9 (shutdown)| 6(arrayList)|1(??)| 8 (shutdown vm parameters, list object)|1|0|0|0|(??) 9 (guid, ?)|10(UUID)|J$m4mk9wVi3|MjeP460Xkpb (vm uuid)|0|5|0|0|0|11|1|0|6|0|0|0|0|0|0|12|0|-6|13|0|1|0|1|14|2|0|0|0|0|0| Until vm uuid parameter it is kind of clear what is happening, but I still wonder what do the parameters 1 and 0 mean in places marked as (??). I understand, that there is a method called runMultipleActions and it has four parameters. I found in source examples of calling this method (ovirt-engine/frontend/webadmin/modules/./frontend/src/test/java/org/ovirt/engine/ui/frontend/FrontendActionTest.java).Then I determine types of these parameters. Then the type of action performed ( I shut down the machine). Then there should be an ArrayList, which contains several objects. I assume that 8(shutdown vm parameters) should follow right after 6 (arraylist), but there a "1" which I can't explain. Also for shutdown parameters: I see in examples that there are not so many boolean parameters in constructor there. Here are four! (1|0|0|0) What do they mean? And how can I cope with the left payload? Thank you in advance for any help! P.S. Also vm ids have another format when for example I do the same actions from web - ui: c8de3f8e-b45e-4a5b-9fa6-e2693dc158b7. Why this is so?

2 3

jobs failure due to same package version with different checksum
by Dafna Ron 24 Oct '18

24 Oct '18

Hi, We have been having failure in master for different projects due to package ovirt-ansible-disaster-recovery-1.1.2-1.el7.noarch.rpm. It seems the package had been changed without a new version set which means we have the same exact package with two different checksum (one in 4.2 and one in master): ovirt-4.2: [dron@resources02 noarch]$ md5sum ovirt-ansible-disaster-recovery-1.1.2-1.el7.noarch.rpm 07b2c6c7ef94e48be3c197e2a1d45d81 ovirt-ansible-disaster-recovery-1.1.2-1.el7.noarch.rpm ovirt-master: [dron@resources02 noarch]$ md5sum ovirt-ansible-disaster-recovery-1.1.2-1.el7.noarch.rpm f6b2e88ae07b64d5071696ade510d961 ovirt-ansible-disaster-recovery-1.1.2-1.el7.noarch.rpm Can you please create a new package with version change to solve this problem? Thanks, Dafna

2 3

How does the host synchronizes existing storage domains when added to engine?
by Tianyuan Wang 24 Oct '18

24 Oct '18

hi all, We are developing for supporting ceph as a new storage domain type. It went well when creating and using. But we cannot add a new host to the engine when there is already a ceph-StorageDomain. The engine reports "VDSM node1 command ConnectStoragePoolVDS failed: Cannot find master domain" and set the node to "Non Operational" status. The vdsm log reports error like this: INFO (jsonrpc/0) [vdsm.api] FINISH connectStoragePool error=Cannot find master domain: u'spUUID=5bc95ba9-01f7-0307-0342-000000000033, msdUUID=a3d6903d-07d5-4794-9667-9dddc3c84fe6' from=::ffff:192.168.122.22,40166, flow_id=43b39e00, task_id=4128f9d4-3c92-46ed-a230-2505d3a8ddb9 (api:50) 2018-10-24 11:06:22,227+0800 ERROR (jsonrpc/0) [storage.TaskManager.Task] (Task='4128f9d4-3c92-46ed-a230-2505d3a8ddb9') Unexpected error (task:875) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run return fn(*args, **kargs) File "<string>", line 2, in connectStoragePool File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 1032, in connectStoragePool spUUID, hostID, msdUUID, masterVersion, domainsMap) File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 1094, in _connectStoragePool res = pool.connect(hostID, msdUUID, masterVersion) File "/usr/lib/python2.7/site-packages/vdsm/storage/sp.py", line 704, in connect self.__rebuild(msdUUID=msdUUID, masterVersion=masterVersion) File "/usr/lib/python2.7/site-packages/vdsm/storage/sp.py", line 1275, in __rebuild self.setMasterDomain(msdUUID, masterVersion) File "/usr/lib/python2.7/site-packages/vdsm/storage/sp.py", line 1488, in setMasterDomain raise se.StoragePoolMasterNotFound(self.spUUID, msdUUID) StoragePoolMasterNotFound: Cannot find master domain: u'spUUID=5bc95ba9-01f7-0307-0342-000000000033, msdUUID=a3d6903d-07d5-4794-9667-9dddc3c84fe6' After tracing back, I found that there is no local file path under /rhev/data-center/mnt for the storage domain, so it cannot find storage domain when ConnectStoargeSever runs. It only happens when adding a new host to engine and there is already a ceph-StroageDomain in ovirt. So how does the host synchronized the existing storage domains? And what can I do to fix this? Thanks in advance! Yours Sincerely, Tianyuan

3 2

Live merge of snapshot
by Abhay Marode 23 Oct '18

23 Oct '18

Hi, In case of snapshot creation and deletion of VM with chain of snapshots I observed following behavior while deleting the snapshot, * When VM is powered ON, I could see two events in event manager, 1) initiated snapshot deletion 2) snapshot deletion successful * When VM is powered OFF, I saw three events 1) initiated snapshot deletion 2) merge snapshot 'Active VM' into 'snap1' 3) snapshot deletion successful. Why there is difference in events based on power state of VM? Do we free up the storage in deletion of snapshot? Here are config details: Host OS Version: RHEL - 7.5 - 4.3.el7 OS Description: Red Hat Virtualization Host 4.2.4 (el7.5) Kernel Version: 3.10.0 - 862.6.3.el7.x86_64 KVM Version: 2.10.0 - 21.el7_5.4 LIBVIRT Version: libvirt-3.9.0-14.el7_5.6 VDSM Version: vdsm-4.20.31-1.el7ev SPICE Version: 0.14.0 - 2.el7_5.4 GlusterFS Version: glusterfs-3.8.4-54.10.el7rhgs CEPH Version: librbd1-0.94.5-2.el7 Kernel Features: PTI: 1, IBRS: 0, RETP: 1 Regards, -Abhay

2 1

FOSDEM‘19 Virtualization & IaaS Devroom CfP
by Sandro Bonazzola 22 Oct '18

22 Oct '18

We are excited to announce that the call for proposals is now open for the Virtualization & IaaS devroom at the upcoming FOSDEM 2019, to be hosted on February 2nd 2019. This year will mark FOSDEM’s 19th anniversary as one of the longest-running free and open source software developer events, attracting thousands of developers and users from all over the world. FOSDEM will be held once again in Brussels, Belgium, on February 2nd & 3rd, 2019. This devroom is a collaborative effort, and is organized by dedicated folks from projects such as OpenStack, Xen Project, oVirt, QEMU, KVM, and Foreman. We would like to invite all those who are involved in these fields to submit your proposals by December 1st, 2018. About the Devroom The Virtualization & IaaS devroom will feature session topics such as open source hypervisors and virtual machine managers such as Xen Project, KVM, bhyve, and VirtualBox, and Infrastructure-as-a-Service projects such as KubeVirt, Apache CloudStack, OpenStack, oVirt, QEMU and OpenNebula. This devroom will host presentations that focus on topics of shared interest, such as KVM; libvirt; shared storage; virtualized networking; cloud security; clustering and high availability; interfacing with multiple hypervisors; hyperconverged deployments; and scaling across hundreds or thousands of servers. Presentations in this devroom will be aimed at developers working on these platforms who are looking to collaborate and improve shared infrastructure or solve common problems. We seek topics that encourage dialog between projects and continued work post-FOSDEM. Important Dates Submission deadline: 1 December 2019 Acceptance notifications: 14 December 2019 Final schedule announcement: 21 December 2019 Devroom: 2nd February 2019 Submit Your Proposal All submissions must be made via the Pentabarf event planning site[1]. If you have not used Pentabarf before, you will need to create an account. If you submitted proposals for FOSDEM in previous years, you can use your existing account. After creating the account, select Create Event to start the submission process. Make sure to select Virtualization and IaaS devroom from the Track list. Please fill out all the required fields, and provide a meaningful abstract and description of your proposed session. Submission Guidelines We expect more proposals than we can possibly accept, so it is vitally important that you submit your proposal on or before the deadline. Late submissions are unlikely to be considered. All presentation slots are 30 minutes, with 20 minutes planned for presentations, and 10 minutes for Q&A. All presentations will be recorded and made available under Creative Commons licenses. In the Submission notes field, please indicate that you agree that your presentation will be licensed under the CC-By-SA-4.0 or CC-By-4.0 license and that you agree to have your presentation recorded. For example: "If my presentation is accepted for FOSDEM, I hereby agree to license all recordings, slides, and other associated materials under the Creative Commons Attribution Share-Alike 4.0 International License. Sincerely, <NAME>." In the Submission notes field, please also confirm that if your talk is accepted, you will be able to attend FOSDEM and deliver your presentation. We will not consider proposals from prospective speakers who are unsure whether they will be able to secure funds for travel and lodging to attend FOSDEM. (Sadly, we are not able to offer travel funding for prospective speakers.) Speaker Mentoring Program As a part of the rising efforts to grow our communities and encourage a diverse and inclusive conference ecosystem, we're happy to announce that we'll be offering mentoring for new speakers. Our mentors can help you with tasks such as reviewing your abstract, reviewing your presentation outline or slides, or practicing your talk with you. You may apply to the mentoring program as a newcomer speaker if you: - Never presented before or - Presented only lightning talks or - Presented full-length talks at small meetups (<50 ppl) Submission Guidelines Mentored presentations will have 25-minute slots, where 20 minutes will include the presentation and 5 minutes will be reserved for questions. The number of newcomer session slots is limited, so we will probably not be able to accept all applications. You must submit your talk and abstract to apply for the mentoring program, our mentors are volunteering their time and will happily provide feedback but won't write your presentation for you! If you are experiencing problems with Pentabarf, the proposal submission interface, or have other questions, you can email our devroom mailing list[2] and we will try to help you. How to Apply In addition to agreeing to video recording and confirming that you can attend FOSDEM in case your session is accepted, please write "speaker mentoring program application" in the "Submission notes" field, and list any prior speaking experience or other relevant information for your application. Call for Mentors Interested in mentoring newcomer speakers? We'd love to have your help! Please email iaas-virt-devroom at lists.fosdem.org with a short speaker biography and any specific fields of expertise (for example, KVM, OpenStack, storage, etc.) so that we can match you with a newcomer speaker from a similar field. Estimated time investment can be as low as a 5-10 hours in total, usually distributed weekly or bi-weekly. Never mentored a newcomer speaker but interested to try? As the mentoring program coordinator, email Brian Proffitt[3] and he will be happy to answer your questions! Code of Conduct Following the release of the updated code of conduct for FOSDEM, we'd like to remind all speakers and attendees that all of the presentations and discussions in our devroom are held under the guidelines set in the CoC and we expect attendees, speakers, and volunteers to follow the CoC at all times. If you submit a proposal and it is accepted, you will be required to confirm that you accept the FOSDEM CoC. If you have any questions about the CoC or wish to have one of the devroom organizers review your presentation slides or any other content for CoC compliance, please email us and we will do our best to assist you. Call for Volunteers We are also looking for volunteers to help run the devroom. We need assistance watching time for the speakers, and helping with video for the devroom. Please contact Brian Proffitt, for more information. Questions? If you have any questions about this devroom, please send your questions to our devroom mailing list. You can also subscribe to the list to receive updates about important dates, session announcements, and to connect with other attendees. See you all at FOSDEM! [1] https://penta.fosdem.org/submission/FOSDEM17 [2] iaas-virt-devroom at lists.fosdem.org [3] bkp at redhat.com -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> <https://www.redhat.com/en/events/red-hat-open-source-day-italia?sc_cid=701f…>

1 0

[ OST Failure Report ] [ oVirt Master (ovirt-engine) ] [ 14-09-2018 ] [ 002_bootstrap.add_hosts ]
by Dafna Ron 22 Oct '18

22 Oct '18

Hi, The previous regression was resolved and we now have a new regression. I don't think that the reported change is related so can someone from ovirt-engine take a look? The failure is add host on the upgrade suite. Please note that we have not had an engine-ovirt build for over 10 days due to several consecutive regressions and I would ask you to stop merging until we can stabilize the project and have a new package of engine. error: 2018-09-14 05:51:07,670-04 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] SSH execute 'root@lago-upgrade-from-release-suite-master-host-0' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar -b1 --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-09-14 05:51:08,550-04 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5c91fcbd] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-upgrade-from-release-suite-master-host-0. Stage: Initializing. 2018-09-14 05:51:08,565-04 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (VdsDeploy) [5c91fcbd] transaction rolled back 2018-09-14 05:51:08,574-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [5c91fcbd] Error during deploy dialog 2018-09-14 05:51:08,578-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Error during host lago-upgrade-from-release-suite-master-host-0 install 2018-09-14 05:51:08,586-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host lago-upgrade-from-release-suite-master-host-0: CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00. 2018-09-14 05:51:08,586-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Error during host lago-upgrade-from-release-suite-master-host-0 install, preferring first exception: CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00 2018-09-14 05:51:08,586-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Host installation failed for host 'e475e93a-63b3-4573-b242-162c2ed864f0', 'lago-upgrade-from-release-suite-master-host-0': CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00 2018-09-14 05:51:08,615-04 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] START, SetVdsStatusVDSCommand(HostName = lago-upgrade-from-release-suite-master-host-0, SetVdsStatusVDSCommandParameters:{hostId='e475e93a-63b3-4573-b242-162c2ed864f0', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 146cdc08 2018-09-14 05:51:08,626-04 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] FINISH, SetVdsStatusVDSCommand, return: , log id: 146cdc08 2018-09-14 05:51:08,639-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] EVENT_ID: VDS_INSTALL_FAILED(505), Host lago-upgrade-from-release-suite-master-host-0 installation failed. CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00. 2018-09-14 05:51:08,652-04 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Lock freed to object 'EngineLock:{exclusiveLocks='[e475e93a-63b3-4573-b242-162c2ed864f0=VDS]', sharedLocks=''}' 2018-09-14 05:51:37,996-04 INFO [org.ovirt.engine.core.bll.quota.QuotaManager] (EE-ManagedThreadFactory-engineScheduled-Thread-44) [] Quota Cache updated. (19 msec) (END) Thanks, Dafna

9 30

[VDSM] running tests locally
by Vojtech Juranek 19 Oct '18

19 Oct '18

Hi, beginner question: I'm trying to run some VDSM tests locally (e.g. blocksd_test.py), using PYTHON_EXE=python3 ./run_tests_local.sh storage/blocksd_test.py but I'm getting quite a lot of test failures. Most of the tests fail because of mokeypatch fixture is not injected (see error bellow). What I'm doing wrong and how I can run selected tests locally? Thanks in advance Vojta ERROR: storage.blocksd_test.test_meta_size_max_val ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) TypeError: test_meta_size_max_val() missing 1 required positional argument: 'monkeypatch'

3 4

[action required] install ovirt-engine-ui-extensions for "migrate" button and dashboard
by Greg Sheremeta 18 Oct '18

18 Oct '18

Hi, To proof-of-concept moving features from GWT to react, we moved the "migrate" functionality in admin portal from GWT to ovirt-engine-ui-extensions [1]. We also moved the dashboard there and dropped ovirt-engine-dashboard. Please install this new project in your dev environment and then follow the installation instructions in the README [2]. You can skip this in your dev environment if you don't need the dashboard or migrate. [1] https://gerrit.ovirt.org/#/admin/projects/ovirt-engine-ui-extensions [2] https://github.com/oVirt/ovirt-engine-ui-extensions -- GREG SHEREMETA SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX Red Hat NA <https://www.redhat.com/> gshereme(a)redhat.com IRC: gshereme <https://red.ht/sig>

1 0

oVirt 4.2.7 RC3 build blocked
by Sandro Bonazzola 17 Oct '18

17 Oct '18

hi, blocking 4.2.7 RC3 build due to jenkins jobs disappeared deleting the builds to be released. Affected build is: https://jenkins.ovirt.org/job/ovirt-provider-ovn_4.2_build-artifacts-el7-x8… Job has been deleted with: commit 54d376c3b98bf446725348ca6ebaefabdae891d8 (HEAD -> master, origin/master, origin/HEAD) Author: Dafna Ron <dron(a)redhat.com> Date: Tue Oct 16 11:43:57 2018 +0100 Removed ovirt-provider-ovn v1 jobs Jira-ticket: https://ovirt-jira.atlassian.net/browse/OVIRT-2543 Change-Id: I141cbce1a9faeffbd11b7377dd7992dc0cdbd5ea Signed-off-by: Dafna Ron <dron(a)redhat.com> I'm going to revert above patch and re-trigger the build for that package. -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> <https://www.redhat.com/en/events/red-hat-open-source-day-italia?sc_cid=701f…>

2 2

[PTHREADING] No build for ppc64le and s390x, text fail on x86_64
by Nir Soffer 17 Oct '18

17 Oct '18

After adding Victor to jenkins whitelist, CI started to test https://gerrit.ovirt.org/#/c/94974/ But we have only x86_64 jobs. This kind of project must have jobs for all platforms. The last maintainer was Yaniv Bronhaim, so I guess nobody remember why we have only x86_64 builds. I hope someone can help to move the project to new stdci and add ppc64le and s390x builds. While I was writing this the build completed with this failure: 00:01:01.195 ========== Running the shellscript automation/check-patch.sh 00:01:01.204 ./automation/check-patch.sh: line 3: tox: command not found This worked when I added tox for fedora 25. Looks like we need a simple patch to get tox on el7/fc28. Nir

2 2