- Devel - oVirt List Archives

callback hanging making commands executing serial
by Liran Rotenberg 20 Oct '20

20 Oct '20

Hi all, Investigating a bug about serial execution <https://bugzilla.redhat.com/1885286> of the same command more than once shows a problem with our callbacks. The problem is felt when we have synchronized operation (such as running ansible runner service) that takes a bit time to be executed. The problem is, when running multiple commands and one has synchronized long operation within a child command, it will hang out all the commands running on the engine using callbacks. The good example is given in the bug, since export OVA command using ansible(sync) and the pack_ova script takes time to finish. This is not really noticeable with short synchronized commands, but it does execute serial for them as well instead of parallel. Running export to OVA command and then other commands with callbacks will get them hanging if the export command callback started and it reached to performNextOperation. Some technical details: We have one thread in CommandCallbacksPoller[1] that runs, collects the current command on the engine and processes them. Once we have the above scenario (let's say 2 commands), the first one will go into callback.doPolling in invokeCallbackMethodsImpl. [2] In that case it will go to ChildCommandsCallbackBase::doPolling, eventually to childCommandsExecutingEnded. [3] While there are more actions to perform we will do performNextOperation [4], which calls executeNextOperation (in the bug case [5]). When the next operation is long and synchronized, this will block the CommandCallbacksPoller thread and only when it finishes the thread is released and the callbacks continue working. Any idea how to solve this issue? Regards, Liran [1] - https://github.com/oVirt/ovirt-engine/blob/master/backend/manager/modules/b… [2] - https://github.com/oVirt/ovirt-engine/blob/master/backend/manager/modules/b… [3] - https://github.com/oVirt/ovirt-engine/blob/master/backend/manager/modules/b… [4] - https://github.com/oVirt/ovirt-engine/blob/master/backend/manager/modules/b… [5] - https://github.com/oVirt/ovirt-engine/blob/master/backend/manager/modules/b…

4 5

oVirt Survey Autumn 2020 results
by Sandro Bonazzola 19 Oct '20

19 Oct '20

Thanks to the 79 participants to oVirt Survey Autumn 2020! The survey is now closed and results are publicly available at https://docs.google.com/forms/d/1eMYaCoysPkYt2iHZW2RRO1HmSqsD0phrwSTVYFlqLy… We'll analyze collected data in order to improve oVirt thanks to your feedback. Thanks, -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.* * <https://www.redhat.com/it/forums/emea/italy-track>*

1 0

Re: [CQ]: 111471,2 (ovirt-engine) failed "ovirt-master" system tests
by Yedidyah Bar David 15 Oct '20

15 Oct '20

On Wed, Oct 14, 2020 at 7:06 PM oVirt Jenkins <jenkins(a)ovirt.org> wrote: > > Change 111471,2 (ovirt-engine) is probably the reason behind recent system test > failures in the "ovirt-master" change queue and needs to be fixed. > > This change had been removed from the testing queue. Artifacts build from this > change will not be released until it is fixed. > > For further details about the change see: > https://gerrit.ovirt.org/#/c/111471/2 This fails compilation. Liran already commented there with details, posting this for visibility. Is anyone handling this? Should we revert? Thanks and best regards, -- Didi

4 8

ovirt-engine has been tagged (ovirt-engine-4.4.3.7)
by Tal Nisan 14 Oct '20

14 Oct '20

1 0

VDSM CI Fails
by Eyal Shenitzky 11 Oct '20

11 Oct '20

Hi all, I am seeing the following error in VDSM CI - [2020-10-11T08:10:54.836Z] ########################################################## [2020-10-11T08:10:54.836Z] ##! ERROR vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv [2020-10-11T08:10:54.836Z] ##! Last 20 log entries: /tmp/mock_logs.VL5n5w1X/init/stdout_stderr.log [2020-10-11T08:10:54.836Z] ##! [2020-10-11T08:10:54.836Z] will then just ignore the repository until you permanently enable it [2020-10-11T08:10:54.836Z] again or use --enablerepo for temporary usage: [2020-10-11T08:10:54.836Z] [2020-10-11T08:10:54.836Z] yum-config-manager --disable fc30-updates-debuginfo [2020-10-11T08:10:54.836Z] or [2020-10-11T08:10:54.836Z] subscription-manager repos --disable=fc30-updates-debuginfo [2020-10-11T08:10:54.836Z] [2020-10-11T08:10:54.836Z] 5. Configure the failing repository to be skipped, if it is unavailable. [2020-10-11T08:10:54.836Z] Note that yum will try to contact the repo. when it runs most commands, [2020-10-11T08:10:54.836Z] so will have to try and fail each time (and thus. yum will be be much [2020-10-11T08:10:54.836Z] slower). If it is a very temporary problem though, this is often a nice [2020-10-11T08:10:54.836Z] compromise: [2020-10-11T08:10:54.836Z] [2020-10-11T08:10:54.836Z] yum-config-manager --save --setopt=fc30-updates-debuginfo.skip_if_unavailable=true [2020-10-11T08:10:54.836Z] [2020-10-11T08:10:54.836Z] failure: repodata/repomd.xml from fc30-updates-debuginfo: [Errno 256] No more mirrors to try. [2020-10-11T08:10:54.836Z] https://mirror.isoc.org.il/pub/fedora/releases/30/Everything/x86_64/debug/t…: [Errno 14] HTTPS Error 404 - Not Found [2020-10-11T08:10:54.836Z] [2020-10-11T08:10:54.836Z] Init took 6 seconds [2020-10-11T08:10:54.836Z] ============================ [2020-10-11T08:10:54.836Z] ##! [2020-10-11T08:10:54.836Z] ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [2020-10-11T08:10:54.836Z] ##!######################################################## Can be found at - https://jenkins.ovirt.org/blue/organizations/jenkins/vdsm_standard-check-pa… Can someone take a look? Thanks -- Regards, Eyal Shenitzky

2 1

engine-setup failure: "ERROR: column network.port_isolation does not exist"
by Nir Soffer 11 Oct '20

11 Oct '20

Trying to setup engine from master (+some patches) fails now with: [ INFO ] Backing up database localhost:engine to '/home/nsoffer/ovirt-engine/var/lib/ovirt-engine/backups/engine-20201011203045.ttdi_77z.dump'. [ INFO ] Creating/refreshing Engine database schema [ ERROR ] schema.sh: FATAL: Cannot execute sql command: --file=/home/nsoffer/ovirt-engine/share/ovirt-engine/dbscripts/create_views.sql [ ERROR ] Failed to execute stage 'Misc configuration': Engine schema refresh failed Setup log show: psql:/home/nsoffer/ovirt-engine/share/ovirt-engine/dbscripts/create_views.sql:2799: ERROR: column network.port_isolation does not exist LINE 22: network.port_isolation AS port_isolation, ^ FATAL: Cannot execute sql command: --file=/home/nsoffer/ovirt-engine/share/ovirt-engine/dbscripts/create_views.sql 2020-10-11 20:30:51,712+0300 ERROR otopi.plugins.ovirt_engine_setup.ovirt_engine.db.schema schema._misc:530 schema.sh: FATAL: Cannot execute sql command: --file=/home/nsoffer/ovirt-engine/share/ovirt-engine/dbscripts/create_views.sql 2020-10-11 20:30:51,713+0300 DEBUG otopi.context context._executeMethod:145 method exception Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/otopi/context.py", line 132, in _executeMethod method['method']() File "/home/nsoffer/ovirt-engine/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/db/schema.py", line 532, in _misc raise RuntimeError(_('Engine schema refresh failed')) I guess this is related to latest networking changes, maybe some patches were wrong, breaking my database? Do we have a way to fix this? I don't want to clear my database, it has useful storage and host setup. Thanks, Nir

1 1

Re: Incremental Backup | oVirt
by Nir Soffer 09 Oct '20

09 Oct '20

On Thu, Oct 8, 2020, 12:28 luwen.zhang(a)vinchin.com <luwen.zhang(a)vinchin.com> wrote: > Dear team, > > My name is Luwen Zhang from Vinchin Backup & Recovery. > > I'm sending you this Email because our developers encountered some > problems while developing incremental backup feature following the oVirt > documentations. > > https://www.ovirt.org/documentation/incremental-backup-guide/incremental-ba… > > We downloaded oVirt 4.4.1 from oVirt website, and is now developing based > on this version, as per the documentation when we perform the first time > full backup, we should obtain a "checkpoint id", so when we perform > incremental backup using this ID we should know what's have changed on the > VM. But now the problem is that we cannot get the checkpoint ID. > > The components and versions of oVirt are as follows: > You are using qemu 4.2 and libvirt 6.0. These versions are too old, missing some features or have bugs which will not be fixed. These version maya be good enough for development, but your product will need newer version. We require now libvirt 6.6 and qemu 5.1. These versions will be available in CentOS 8.3. On libvirt, incremental backup will be fully supported only in RHEL AV 8.3.1. I guess we will build the relevant version for CentOS after this version is released for RHEL. Nir > > > Could you please kindly check on this issue and point out what should be > wrong and what we should do? > > Looking forward to your reply. > > Thanks & regards! > ------------------------------ > *Luwen Zhang* | Product Manager > > Tel: +86-28-8553-0156 > Mob: +86-138-8042-4687 > Skype: luwen.zhang_cn > E-mail: luwen.zhang(a)vinchin.com > > F5, Block 8, National Information Security Industry Park, No.333 YunHua > Road, Hi-Tech Zone, Chengdu, China | P.C.610015 > _______________________________________________ > Devel mailing list -- devel(a)ovirt.org > To unsubscribe send an email to devel-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/devel@ovirt.org/message/CC56L57GK3DZQ… >

2 1

Broken CI initialization scripts
by Sandro Bonazzola 09 Oct '20

09 Oct '20

1 0

Re: Incremental Backup | oVirt
by Eyal Shenitzky 08 Oct '20

08 Oct '20

Hi Luwen, Full backup using the new API is supported by default, but in order to enable the use of 'incremental backup' you need to follow the following steps that written in the feature page: # engine-config -s "IsIncrementalBackupSupported=true" # systemctl restart ovirt-engine After those steps are done, each backup operation will create a checkpoint so you will receive the created checkpoint ID. On Thu, 8 Oct 2020 at 12:28, luwen.zhang(a)vinchin.com < luwen.zhang(a)vinchin.com> wrote: > Dear team, > > My name is Luwen Zhang from Vinchin Backup & Recovery. > > I'm sending you this Email because our developers encountered some > problems while developing incremental backup feature following the oVirt > documentations. > > https://www.ovirt.org/documentation/incremental-backup-guide/incremental-ba… > > We downloaded oVirt 4.4.1 from oVirt website, and is now developing based > on this version, as per the documentation when we perform the first time > full backup, we should obtain a "checkpoint id", so when we perform > incremental backup using this ID we should know what's have changed on the > VM. But now the problem is that we cannot get the checkpoint ID. > > The components and versions of oVirt are as follows: > > > > Could you please kindly check on this issue and point out what should be > wrong and what we should do? > > Looking forward to your reply. > > Thanks & regards! > ------------------------------ > *Luwen Zhang* | Product Manager > > Tel: +86-28-8553-0156 > Mob: +86-138-8042-4687 > Skype: luwen.zhang_cn > E-mail: luwen.zhang(a)vinchin.com > > F5, Block 8, National Information Security Industry Park, No.333 YunHua > Road, Hi-Tech Zone, Chengdu, China | P.C.610015 > _______________________________________________ > Devel mailing list -- devel(a)ovirt.org > To unsubscribe send an email to devel-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/devel@ovirt.org/message/CC56L57GK3DZQ… > -- Regards, Eyal Shenitzky

1 0

ovirt-engine has been tagged (ovirt-engine-4.4.3.6)
by Tal Nisan 07 Oct '20

07 Oct '20

1 0