- Devel - oVirt List Archives

Status update on "Hyperconverged Gluster oVirt support"
by Gobinda Das 30 Sep '18

30 Sep '18

Hi All, Status update on "Hyperconverged Gluster oVirt support" Features Completed: ================ cockpit-ovirt ------------- 1- Asymmetric brick configuration.Brick can be configured per host basis i.e. If the user wanted to make use of sdb from host1, sdc from host2, and sdd from host3. 2- Dedupe and Compression integration via VDO support (see https://github.com/dm-vdo/kvdo) Gluster bricks are created on vdo devices 3- LVM cache configuration support (Configure cache by using fast block device such as SSD drive to imrove the performance of a larger and slower logical volumes) 4- Auto addition of 2nd and 3rd hosts in a 3 node setup during deployment 5- Auto creation of storage domains based on gluster volumes created during setup 6- Single node deployment support via Cockpit UI. For details on single node deployment - https://www.ovirt.org/documentation/gluster-hyperconverged/chap-Single_node… 7- Gluster Management Dashboard (Dashboard will show the nodes in cluster,Volumes and bricks. User can expand the cluster and also can create new volume in existing cluster nodes ) oVirt ------- 1- Reset brick support from UI to allow users to replace a faulty brick 2- Create brick from engine now supports configuring an SSD device as lvmcache device when bricks are created on spinning disks 3- VDO monitoring GlusterFS --------------- Enhancements to performance with fuse by 15x 1. Cluster after eager lock change for better detection of multiple clients 2. Changing qemu option aio to "native" instead of "threads". end-to-end deployment: -------------------------------- 1- End to end deployment of a Gluster + Ovirt hyperconverged environment using ansible roles ( https://github.com/gluster/gluster-ansible/tree/master/playbooks ). The only pre-requisite is a CentOS node/oVirt node Future Plan: ========== cockpit-ovirt: 1- ansible-roles integration for deployment 2- Support for different volume types vdsm: 1- Python3 compatibility of vdsm-gluster 2- Native 4K support -- Thanks, Gobinda

4 5

[ OST Failure Report ] [ oVirt 4.2 (ovirt-engine) ] [ 27-09-20118 ] [ initialize_engine ]
by Dafna Ron 29 Sep '18

29 Sep '18

Hi, we are failing on ovirt-engine 4.1 on the upgrade suite. The issue seems to be related to this change: https://gerrit.ovirt.org/#/c/94551/ - packaging: Generate random MAC pool instead of hardcoded one Can you please have a look and issue a fix? Build log: https://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3234/testReport… error: [ INFO ] Yum Verify: 100/100: ovirt-engine-tools.noarch 0:4.1.9.1-1.el7.centos - ud [ INFO ] Stage: Misc configuration [ INFO ] Upgrading CA [ INFO ] Installing PostgreSQL uuid-ossp extension into database [ INFO ] Creating/refreshing DWH database schema [ INFO ] Configuring WebSocket Proxy [ INFO ] Creating/refreshing Engine database schema [ INFO ] Creating/refreshing Engine 'internal' domain database schema Unregistering existing client registration info. [ INFO ] Creating default mac pool [ ERROR ] Failed to execute stage 'Misc configuration': insert or update on table "mac_pool_ranges" violates foreign key constraint "mac_pool_ranges_mac_pool_id_fkey" DETAIL: Key (mac_pool_id)=(58ca604b-017d-0374-0220-00000000014e) is not present in table "mac_pools". CONTEXT: SQL statement "INSERT INTO mac_pool_ranges ( mac_pool_id, from_mac, to_mac ) VALUES ( v_mac_pool_id, v_from_mac, v_to_mac )" PL/pgSQL function insertmacpoolrange(uuid,character varying,character varying) line 3 at SQL statement [ INFO ] Rolling back to the previous PostgreSQL instance (postgresql). [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20180927090017-97fd5u.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20180927090149-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed ('FATAL Internal error (main): insert or update on table "mac_pool_ranges" violates foreign key constraint "mac_pool_ranges_mac_pool_id_fkey"\nDETAIL: Key (mac_pool_id)=(58ca604b-017d-0374-0220-00000000014e) is not present in table "mac_pools".\nCONTEXT: SQL statement "INSERT INTO mac_pool_ranges (\n mac_pool_id,\n from_mac,\n to_mac\n )\n VALUES (\n v_mac_pool_id,\n v_from_mac,\n v_to_mac\n )"\nPL/pgSQL function insertmacpoolrange(uuid,character varying,character varying) line 3 at SQL statement\n',) lago.ssh: DEBUG: Command 483aadd2 on lago-upgrade-from-prevrelease-suite-4-2-engine errors: Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/otopi/__main__.py", line 88, in main installer.execute() File "/usr/lib/python2.7/site-packages/otopi/main.py", line 157, in execute self.context.runSequence() File "/usr/lib/python2.7/site-packages/otopi/context.py", line 771, in runSequence util.raiseExceptionInformation(infos[0]) File "/usr/lib/python2.7/site-packages/otopi/util.py", line 81, in raiseExceptionInformation exec('raise info[1], None, info[2]') File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in _executeMethod method['method']() File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/network/macpools.py", line 98, in _misc_db_entries self._create_new_mac_pool_range(range_prefix) File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/network/macpools.py", line 73, in _create_new_mac_pool_range to_mac=range_prefix + ':ff:ff', File "/usr/share/ovirt-engine/setup/ovirt_engine_setup/engine_common/database.py", line 266, in execute args, IntegrityError: insert or update on table "mac_pool_ranges" violates foreign key constraint "mac_pool_ranges_mac_pool_id_fkey" DETAIL: Key (mac_pool_id)=(58ca604b-017d-0374-0220-00000000014e) is not present in table "mac_pools". CONTEXT: SQL statement "INSERT INTO mac_pool_ranges ( mac_pool_id, from_mac, to_mac ) VALUES ( v_mac_pool_id, v_from_mac, v_to_mac )" PL/pgSQL function insertmacpoolrange(uuid,character varying,character varying) line 3 at SQL statement Thanks, Dafna

2 4

vdsm_4.2_build-artifacts-fc28-s390x is failing - please fix before merging more changes
by Dafna Ron 28 Sep '18

28 Sep '18

Hi, vdsm changes cannot run on CQ due to failed build-artifacts job for fc28-s390 please do not merge before solving this since changes do not run on CQ when the build-artifacts job is failing. https://jenkins.ovirt.org/job/vdsm_4.2_build-artifacts-fc28-s390x/19/console The error in the job is [Errno 2] No such file or directory: '/var/cache/dnf/updates-07b7057ee4fded96/packages/python2-2.7.15-3.fc28.s390x.rpm' Thanks, Dafna

2 1

ovirt.org documentation refresh
by Greg Sheremeta 28 Sep '18

28 Sep '18

Hi all, Brian Proffitt has kindly offered to refresh the documentation on ovirt.org to version 4.2 (it's currently a mix of 4.0 + whatever people have updated since.) Other than the main 'official' documentation, I noticed that there is a lot of documentation on separate sites. For example, imageio, mom, all of the OST stuff, etc. For now there are no plans for any of this extra stuff, but in the future it should probably all look the same. Can you share ovirt documentation sites that you know of? Best wishes, Greg -- GREG SHEREMETA SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX Red Hat NA <https://www.redhat.com/> gshereme(a)redhat.com IRC: gshereme <https://red.ht/sig>

5 4

Problem installing HE
by Hetz Ben Hamo 27 Sep '18

27 Sep '18

Hi, I've tried installing oVirt HE using the ovirt-NG node ISO (4.2.6.2) running in a nested VM using ESXI 6.7. the HE install part fails when the "TASK [Get local VM IP]" comes. I've created a bugzilla about this, as I've seen this problem on the mailing list quite few times. Link: https://bugzilla.redhat.com/show_bug.cgi?id=1633346 Could someone check if I forgot to add any log file? Thanks Hetz

1 0

'make distcheck' issues in VDSM project (regarding BZ#1297808)
by Marcin Sobczyk 26 Sep '18

26 Sep '18

Hi, I've been doing some work around making 'make distcheck' and VPATH builds successful for VDSM. Some patches have already been merged, but there is one that I've abandoned because it touches a bigger issue. When doing a VPATH build, some python sources are build-time generated from '.py.in' files (at this moment: 'lib/vdsm/common/constants.py.in', 'lib/vdsm/common/config.py.in', 'lib/vdsm/common/dsaversion.py.in', '/lib/sos/vdsm.py.in'). Suppose we do a VPATH build with: cd ${SRCROOT} && \ ./autogen.sh && \ make distclean && \ mkdir -p /tmp/ovirt-build && \ cd /tmp/ovirt-build && \ ${SRCROOT}/configure && \ make The build-generated '.py' files will land in '/tmp/ovirt-build/lib/...'. As a result, even though the build-generated python modules and the source ones refer to each other, they can't see each other. After some trial and error here are my observations: - we can't generate resulting '.py' files in $(srcdir) - 'make distcheck' purposely sets $(srcdir) to be read-only - we can't just simply add $(builddir) to PYTHONPATH - there are no '__init__.py' files in $(builddir), so i.e. 'import vdsm.common.config' will fail - we can't create dummy '__init__.py' files in $(builddir), because that would break in-tree-builds (we would have to clean regular, git-maintained files) In conclusion, I think we would need to implement a custom python module loader to make VPATH/distcheck successful. It would need to be parametrized with $(builddir)'s path, and would try to resolve unsuccessful imports by finding build-time generated files inside. However, after looking at other oVirt projects (i.e. 'ioprocess', 'ovirt-iso-uploader', 'ovirt-node-ng', 'ovirt-register'), I can see that most of them fail 'make distcheck'. They have even more severe 'makefile'-issues than importing build-time generated python files. So the question is - do we really need 'make distcheck' for VDSM to suceed? Marcin

2 1

Jenkins help
by Germano Veit Michel 25 Sep '18

25 Sep '18

Hi, I'm struggling with a check-patch failing. This is the error (I think): [7;33m************* Module vdsm.tool.update_volume [0m [1;31mE [0m: 87,16: [1;31mInstance of '_Client' has no 'Host' member [0m ( [1;31mno-member [0m) [1;31mE [0m:101,23: [1;31mInstance of '_Client' has no 'StoragePool' member [0m ( [1;31mno-member [0m) The way I understand it, the error above from [1] means that the check patch fails because the cli object does not contain Host or StoragePool. However, from reading the code it seems the Host and StoragePool members are created at runtime by parsing the API schema. So static checking for [2] and [3] fails. I see some other tools doing similar things (i,e. dump_volume_chains), but I can't find anything specific done to prevent it. Or am I missing something? Any idea on how to solve this? [1] https://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/25017/arti… [2] https://gerrit.ovirt.org/gitweb?p=vdsm.git;f=lib/vdsm/tool/update_volume.py… [3] https://gerrit.ovirt.org/gitweb?p=vdsm.git;f=lib/vdsm/tool/update_volume.py… Thanks! Germano

1 1

ovirt-engine has been tagged (ovirt-engine-4.2.7.1)
by Piotr Kliczewski 21 Sep '18

21 Sep '18

1 0

Dealing with TaskID in vdsm api
by Germano Veit Michel 21 Sep '18

21 Sep '18

Hello, I've been struggling with TaskID/FlowID when talking to the VDSM API. I am trying to write a tool that uses the vdsm-api to facilitate the troubleshooting of image issues (snapshots). This tool does a series of API calls, but I cannot find a nice way to track the taskID and clear the completed tasks after completion of the tool commands. Currently I'm clearing all Tasks that match the verb and are finished, which is not ideal. I would like to have the exact TaskID to track and dont want to leave Tasks behind. I don't want also to clear tasks from other entities (like engine!). I understand that if I want to specify the task/flow ids when calling the vdsm API, these two need to be passed as headers (http) so they end up in the context of the call. Is this correct? But using vdsm/client.py I cannot figure out how to do this, but I understand it is possible. I've been looking at vdsm/common/api.py and vdsm/client.py and trying several things but nothing seems to do it. Could anyone please put some light on this? Thanks, Germano

4 10

Re: blog post: quick(er) development / testing of GWT code using SDM
by sangeetha r 21 Sep '18

21 Sep '18

Hi Greg, I followed your post "oVirt Webadmin GWT Debug Quick Refresh" in Centos7. I am able to get the SDM compile works. But changes are not reflecting in UI Chrome/Firefox. I didn't see any error in logs as well. This is the GWT log output when I do compile [INFO] The code server is ready at http://10.149.202.159:9876/[INFO] GET /recompile/webadmin[INFO] Job org.ovirt.engine.ui.webadmin.WebAdmin_1_0[INFO] starting job: org.ovirt.engine.ui.webadmin.WebAdmin_1_0[INFO] binding: locale=en_US[INFO] binding: user.agent=safari[INFO] Compiling module org.ovirt.engine.ui.webadmin.WebAdmin[INFO] Computing all possible rebind results for 'com.gwtplatform.mvp.client.DesktopGinjector'[INFO] Rebinding com.gwtplatform.mvp.client.DesktopGinjector[INFO] Invoking generator com.google.gwt.inject.rebind.GinjectorGenerator[INFO] [WARN] Class org.ovirt.engine.ui.gwtaop.AspectJLogHandler is used in Gin, but not available in GWT client code.[INFO] info AspectJ Weaver Version 1.8.10 built on Monday Dec 12, 2016 at 19:07:48 GMT[INFO] info register classloader com.google.gwt.inject.rebind.GinBridgeClassLoader@cbbe9df[INFO] info using configuration file:/home/admin/.m2/repository/org/ovirt/engine/ui/gwt-aop/4.3.0-SNAPSHOT/gwt-aop-4.3.0-SNAPSHOT.jar!/META-INF/aop.xml[INFO] info register aspect org.ovirt.engine.ui.gwtaop.DontPrune[INFO] warning javax.* types are not being woven because the weaver option '-Xset:weaveJavaxPackages=true' has not been specified[INFO] Unification traversed 23500 fields and methods and 8802 types. 667 are considered part of the current module and 672 had all of their fields and methods traversed.[INFO] Compiling 1 permutation[INFO] Compiling permutation 0...[INFO] Linking per-type JS with 667 new/changed types.[INFO] Source Maps Enabled[INFO] Compile of permutations succeeded[INFO] Compilation succeeded -- 27.667s[INFO] Linking into /home/admin/git/ovirt-engine/frontend/webadmin/modules/webadmin/target/tmp/gwt-codeserver-671189326887964275.tmp/org.ovirt.engine.ui.webadmin.WebAdmin/compile-2/war/webadmin; Writing extras to /home/admin/git/ovirt-engine/frontend/webadmin/modules/webadmin/target/tmp/gwt-codeserver-671189326887964275.tmp/org.ovirt.engine.ui.webadmin.WebAdmin/compile-2/extras/webadmin[INFO] Link succeeded[INFO] Linking succeeded -- 4.482s[INFO] 34.746s total -- Compile completed Can you please help me on this issue. Thanks! Sangeetha S

2 1