- Devel - oVirt List Archives

Re: Incremental Backup | oVirt
by Eyal Shenitzky 08 Oct '20

08 Oct '20

Hi Luwen, Full backup using the new API is supported by default, but in order to enable the use of 'incremental backup' you need to follow the following steps that written in the feature page: # engine-config -s "IsIncrementalBackupSupported=true" # systemctl restart ovirt-engine After those steps are done, each backup operation will create a checkpoint so you will receive the created checkpoint ID. On Thu, 8 Oct 2020 at 12:28, luwen.zhang(a)vinchin.com < luwen.zhang(a)vinchin.com> wrote: > Dear team, > > My name is Luwen Zhang from Vinchin Backup & Recovery. > > I'm sending you this Email because our developers encountered some > problems while developing incremental backup feature following the oVirt > documentations. > > https://www.ovirt.org/documentation/incremental-backup-guide/incremental-ba… > > We downloaded oVirt 4.4.1 from oVirt website, and is now developing based > on this version, as per the documentation when we perform the first time > full backup, we should obtain a "checkpoint id", so when we perform > incremental backup using this ID we should know what's have changed on the > VM. But now the problem is that we cannot get the checkpoint ID. > > The components and versions of oVirt are as follows: > > > > Could you please kindly check on this issue and point out what should be > wrong and what we should do? > > Looking forward to your reply. > > Thanks & regards! > ------------------------------ > *Luwen Zhang* | Product Manager > > Tel: +86-28-8553-0156 > Mob: +86-138-8042-4687 > Skype: luwen.zhang_cn > E-mail: luwen.zhang(a)vinchin.com > > F5, Block 8, National Information Security Industry Park, No.333 YunHua > Road, Hi-Tech Zone, Chengdu, China | P.C.610015 > _______________________________________________ > Devel mailing list -- devel(a)ovirt.org > To unsubscribe send an email to devel-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/devel@ovirt.org/message/CC56L57GK3DZQ… > -- Regards, Eyal Shenitzky

1 0

ovirt-engine has been tagged (ovirt-engine-4.4.3.6)
by Tal Nisan 07 Oct '20

07 Oct '20

1 0

certificates not created?
by lejeczek 06 Oct '20

06 Oct '20

hi I have ovirt from ovirt-release44-4.4.2-1.el8.noarch. I presumed these files should be created without any user intervention and I wonder if this is a bug? ... Oct 03 15:02:42 dzien.private.pawel libvirtd[1291696]: Unable to read from monitor: Connection reset by peer Oct 03 15:02:42 dzien.private.pawel libvirtd[1291696]: internal error: qemu unexpectedly closed the monitor: 2020-10-03T14:02:42.051456Z qemu-kvm: warning: Spice: reds.c:2943:reds_init_ssl: Could not load certificates from /etc/pki/vdsm/libvirt-spice/server-cert.pem 2020-10-03T14:02:42.051477Z qemu-kvm: warning: Spice: error:02001002:system library:fopen:No such file or directory 2020-10-03T14:02:42.051483Z qemu-kvm: warning: Spice: error:20074002:BIO routines:file_ctrl:system lib 2020-10-03T14:02:42.051490Z qemu-kvm: warning: Spice: error:140DC002:SSL routines:use_certificate_chain_file:system lib 2020-10-03T14:02:42.051506Z qemu-kvm: failed to initialize spice server Oct 03 15:02:42 dzien.private.pawel libvirtd[1291696]: internal error: process exited while connecting to monitor: 2020-10-03T14:02:42.051456Z qemu-kvm: warning: Spice: reds.c:2943:reds_init_ssl: Could not load certificates from /etc/pki/vdsm/libvirt-spice/server-cert.pem 2020-10-03T14:02:42.051477Z qemu-kvm: warning: Spice: error:02001002:system library:fopen:No such file or directory 2020-10-03T14:02:42.051483Z qemu-kvm: warning: Spice: error:20074002:BIO routines:file_ctrl:system lib 2020-10-03T14:02:42.051490Z qemu-kvm: warning: Spice: error:140DC002:SSL routines:use_certificate_chain_file:system lib 2020-10-03T14:02:42.051506Z qemu-kvm: failed to initialize spice server ... Would any of you experts have a possible resolution, a workaround? many thanks, L.

2 1

Re: Need help in handling catch block in vdsm
by Michal Skrivanek 05 Oct '20

05 Oct '20

[adding devel list] > On 29 Sep 2020, at 09:51, Ritesh Chikatwar <rchikatw(a)redhat.com> wrote: > > Hello, > > i am new to VDSM codebase. > > There is one minor bug in gluster and they don't have any near plan to fix this. So i need to fix this in vdsm. > > The bug is when i run command > [root@dhcp35-237 ~]# gluster v geo-replication status > No active geo-replication sessions > geo-replication command failed > [root@dhcp35-237 ~]# > > So this engine is piling up with error. i need handle this in vdsm the code at this place > > https://github.com/oVirt/vdsm/blob/master/lib/vdsm/gluster/cli.py#L1231 <https://github.com/oVirt/vdsm/blob/master/lib/vdsm/gluster/cli.py#L1231> > > If i run the above command with xml then i will get > > [root@dhcp35-237 ~]# gluster v geo-replication status --xml > geo-replication command failed > [root@dhcp35-237 ~]# > > so i have to run one more command before executing this and check in exception that it contains No active geo-replication sessions this string. for that i did like this maybe it goes to stderr? other than that, no idea, sorry Thanks, michal > > try: > xmltree = _execGluster(command) > except ge.GlusterCmdFailedException as e: > if str(e).find("No active geo-replication sessions") != -1: > return [] > Seems like this is not working can you help me here > > > Any help will be appreciated > Ritesh >

4 6

Disk sizes not updated on unmap/discard
by Tomáš Golembiovský 02 Oct '20

02 Oct '20

Hi, currently, when we run virt-sparsify on VM or user runs VM with discard enabled and when the disk is on block storage in qcow, the results are not reflected in oVirt. The blocks get discarded, storage can reuse them and reports correct allocation statistics, but oVirt does not. In oVirt one can still see the original allocation for disk and storage domain as it was before blocks were discarded. This is super-confusing to the users because when they check after running virt-sparsify and see the same values they think sparsification is not working. Which is not true. It all seems to be because of our LVM layout that we have on storage domain. The feature page for discard [1] suggests it could be solved by running lvreduce. But this does not seem to be true. When blocks are discarded the QCOW does not necessarily change its apparent size, the blocks don't have to be removed from the end of the disk. So running lvreduce is likely to remove valuable data. At the moment I don't see how we could achieve the correct values. If anyone has any idea feel free to entertain me. The only option seems to be to switch to LVM thin pools. Do we have any plans on doing that? Tomas [1] https://www.ovirt.org/develop/release-management/features/storage/pass-disc… -- Tomáš Golembiovský <tgolembi(a)redhat.com>

5 4

ovirt-engine has been tagged (ovirt-engine-4.4.3.5)
by Tal Nisan 30 Sep '20

30 Sep '20

1 0

Incremental Backup | oVirt
by luwen.zhang＠vinchin.com 30 Sep '20

30 Sep '20

Dear team, My name is Luwen Zhang from Vinchin Backup & Recovery. I'm sending you this Email because our developers encountered some problems while developing incremental backup feature following the oVirt documentations. https://www.ovirt.org/documentation/incremental-backup-guide/incremental-ba… We downloaded oVirt 4.4.1 from oVirt website, and is now developing based on this version, as per the documentation when we perform the first time full backup, we should obtain a "checkpoint id", so when we perform incremental backup using this ID we should know what's have changed on the VM. But now the problem is that we cannot get the checkpoint ID. The components and versions of oVirt are as follows: Could you please kindly check on this issue and point out what should be wrong and what we should do? Looking forward to your reply. Thanks & regards! Luwen Zhang | Product Manager Tel: +86-28-8553-0156 Mob: +86-138-8042-4687 Skype: luwen.zhang_cn E-mail: luwen.zhang(a)vinchin.com F5, Block 8, National Information Security Industry Park, No.333 YunHua Road, Hi-Tech Zone, Chengdu, China | P.C.610015

1 0

Propose Eitan Raviv as a ovirt-system-tests network-suite maintainer
by Dominik Holler 28 Sep '20

28 Sep '20

Hi all, Eitan Raviv has been working on the oVirt project for more than 3 years. He contributed more than 40 patches to ovirt-system-tests, including more than 35 patches to the network-suite. He is already recognized as a relevant reviewer for the network-suite, so it time to give him the official role for the work he is already doing. I would like to propose Eitan as a virt-system-tests network-suite maintainer. Thanks Dominik

5 5

OST fails during 002_bootstrap_pytest
by Vojtech Juranek 24 Sep '20

24 Sep '20

Hi, can anybody look on OST, it fails constantly with error bellow. See e.g. [1, 2] for full logs. Thanks Vojta [1] https://jenkins.ovirt.org/job/ovirt-system-tests_manual/7381/ [2] https://jenkins.ovirt.org/job/ovirt-system-tests_manual/7382/ 13:07:16 ../basic-suite-master/test-scenarios/ 002_bootstrap_pytest.py::test_verify_engine_backup [WARNING]: Invalid characters were found in group names but not replaced, use 13:07:22 -vvvv to see details 13:07:22 /usr/lib/python2.7/site-packages/requests/__init__.py:91: RequestsDependencyWarning: urllib3 (1.25.10) or chardet (3.0.4) doesn't match a supported version! 13:07:22 RequestsDependencyWarning) 13:07:22 lago-basic-suite-master-engine | CHANGED => { 13:07:22 "changed": true, 13:07:22 "gid": 0, 13:07:22 "group": "root", 13:07:22 "mode": "0755", 13:07:22 "owner": "root", 13:07:22 "path": "/var/log/ost-engine-backup", 13:07:22 "secontext": "unconfined_u:object_r:var_log_t:s0", 13:07:22 "size": 6, 13:07:22 "state": "directory", 13:07:22 "uid": 0 13:07:22 } 13:07:44 [WARNING]: Invalid characters were found in group names but not replaced, use 13:07:44 -vvvv to see details 13:07:44 /usr/lib/python2.7/site-packages/requests/__init__.py:91: RequestsDependencyWarning: urllib3 (1.25.10) or chardet (3.0.4) doesn't match a supported version! 13:07:44 RequestsDependencyWarning) 13:07:44 lago-basic-suite-master-engine | FAILED | rc=1 >> 13:07:44 Start of engine-backup with mode 'backup' 13:07:44 scope: all 13:07:44 archive file: /var/log/ost-engine-backup/backup.tgz 13:07:44 log file: /var/log/ost-engine-backup/log.txt 13:07:44 Backing up: 13:07:44 Notifying engine 13:07:44 - Files 13:07:44 - Engine database 'engine' 13:07:44 - DWH database 'ovirt_engine_history' 13:07:44 - Grafana database '/var/lib/grafana/grafana.db' 13:07:44 Notifying engineFATAL: failed to backup /var/lib/grafana/grafana.db with sqlite3non-zero return code 13:17:47 FAILED

5 6

Engine build fails: "found duplicate key "when" with value "collectd_default_files|d(true)"
by Nir Soffer 23 Sep '20

23 Sep '20

I'm trying to build engine on new VM, installed based on README and it fails in ansible-lint on: /usr/share/ansible/roles/oVirt.metrics/roles/oVirt.logging/tasks/main.yml Is this a known issue? any workaround? Nir --- $ make clean install-dev PREFIX="$HOME/ovirt-engine" ... + /usr/bin/ansible-lint -c build/ansible-lint.conf packaging/playbooks/install-skydive.yml packaging/playbooks/ovirt-provider-ovn-driver.yml packaging/ansible-runner-service-project/project/create-brick.yml packaging/ansible-runner-service-project/project/ovirt-fetch-he-config.yml packaging/ansible-runner-service-project/project/ovirt-host-check-upgrade.yml packaging/ansible-runner-service-project/project/ovirt-host-deploy.yml packaging/ansible-runner-service-project/project/ovirt-host-enroll-certificate.yml packaging/ansible-runner-service-project/project/ovirt-host-remove.yml packaging/ansible-runner-service-project/project/ovirt-host-upgrade.yml packaging/ansible-runner-service-project/project/ovirt-image-measure.yml packaging/ansible-runner-service-project/project/ovirt-ova-export.yml packaging/ansible-runner-service-project/project/ovirt-ova-import.yml packaging/ansible-runner-service-project/project/ovirt-ova-query.yml packaging/ansible-runner-service-project/project/ovirt-vnc-sasl.yml packaging/ansible-runner-service-project/project/ovirt_host_upgrade_vars.yml packaging/ansible-runner-service-project/project/replace-gluster.yml packaging/ansible-runner-service-project/project/roles packaging/ansible-runner-service-project/project/roles/gluster-brick-create packaging/ansible-runner-service-project/project/roles/gluster-replace-peers packaging/ansible-runner-service-project/project/roles/hc-gluster-cgroups packaging/ansible-runner-service-project/project/roles/ovirt-host-check-upgrade packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-facts packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-firewalld packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-hosted-engine packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-iptables packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-kdump packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-kernel packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-libvirt-guests packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-misc packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-spice-encryption packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-vdsm-certificates packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-vdsm packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-vm-console-certificates packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-vm-console packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy-vnc-certificates packaging/ansible-runner-service-project/project/roles/ovirt-host-deploy packaging/ansible-runner-service-project/project/roles/ovirt-host-enroll-certificate packaging/ansible-runner-service-project/project/roles/ovirt-host-setup-vnc-sasl packaging/ansible-runner-service-project/project/roles/ovirt-host-upgrade packaging/ansible-runner-service-project/project/roles/ovirt-image-measure packaging/ansible-runner-service-project/project/roles/ovirt-ova-export-post-pack packaging/ansible-runner-service-project/project/roles/ovirt-ova-export-pre-pack packaging/ansible-runner-service-project/project/roles/ovirt-ova-extract packaging/ansible-runner-service-project/project/roles/ovirt-ova-pack packaging/ansible-runner-service-project/project/roles/ovirt-ova-query packaging/ansible-runner-service-project/project/roles/ovirt-provider-ovn-driver packaging/ansible-runner-service-project/project/roles/ovirt-to-vdsm-network packaging/ansible-runner-service-project/project/roles/python-ver-detect [WARNING]: While constructing a mapping from /usr/share/ansible/roles/oVirt.metrics/roles/oVirt.logging/tasks/main.yml, line 118, column 7, found a duplicate dict key (when). Using last defined value only. [WARNING]: While constructing a mapping from <unicode string>, line 118, column 7, found a duplicate dict key (when). Using last defined value only. Traceback (most recent call last): File "/usr/bin/ansible-lint", line 11, in <module> load_entry_point('ansible-lint==4.1.0', 'console_scripts', 'ansible-lint')() File "/usr/lib/python3.6/site-packages/ansiblelint/__main__.py", line 187, in main matches.extend(runner.run()) File "/usr/lib/python3.6/site-packages/ansiblelint/__init__.py", line 282, in run skip_list=self.skip_list)) File "/usr/lib/python3.6/site-packages/ansiblelint/__init__.py", line 174, in run matches.extend(rule.matchtasks(playbookfile, text)) File "/usr/lib/python3.6/site-packages/ansiblelint/__init__.py", line 84, in matchtasks yaml = ansiblelint.utils.append_skipped_rules(yaml, text, file['type']) File "/usr/lib/python3.6/site-packages/ansiblelint/utils.py", line 604, in append_skipped_rules ruamel_data = yaml.load(file_text) File "/usr/lib64/python3.6/site-packages/ruamel/yaml/main.py", line 266, in load return constructor.get_single_data() File "/usr/lib64/python3.6/site-packages/ruamel/yaml/constructor.py", line 105, in get_single_data return self.construct_document(node) File "/usr/lib64/python3.6/site-packages/ruamel/yaml/constructor.py", line 115, in construct_document for dummy in generator: File "/usr/lib64/python3.6/site-packages/ruamel/yaml/constructor.py", line 1357, in construct_yaml_map self.construct_mapping(node, data) File "/usr/lib64/python3.6/site-packages/ruamel/yaml/constructor.py", line 1266, in construct_mapping self.check_mapping_key(node, key_node, maptyp, key, value) File "/usr/lib64/python3.6/site-packages/ruamel/yaml/constructor.py", line 265, in check_mapping_key raise DuplicateKeyError(*args) ruamel.yaml.constructor.DuplicateKeyError: while constructing a mapping in "<unicode string>", line 118, column 7: - name: Populate logging_outputs d ... ^ (line: 118) " (original value: "collect_ovirt_engine_log or collect_ovirt_vdsm_log") in "<unicode string>", line 135, column 7: when: collectd_default_files|d(true) ^ (line: 135) To suppress this check see: http://yaml.readthedocs.io/en/latest/api.html#duplicate-keys Duplicate keys will become and error in future releases, and are errors by default when using the new API. make[1]: *** [Makefile:366: validations] Error 1 make[1]: Leaving directory '/home/nsoffer/src/ovirt-engine' make: *** [Makefile:545: all-dev] Error 2

2 4