March 2017 - Devel - oVirt List Archives

Ceph hyperconvergence
by Logan Kuhn 19 Mar '17

19 Mar '17

Hi It was suggested that I ask this list. Are there any plans to add hyperconverge with Ceph, similar to the way it has been implemented with Gluster? I know that I can add Cinder as an external provider as an interface to Ceph, but it's more clunky than a hyperconverged solution. Regards, Logan Kuhn

3 3

System tests failure (wrong test code?)
by Nir Soffer 19 Mar '17

19 Mar '17

If found this error in system tests - looks like wrong assert - code should check if disk is not None before checking state. I'm not sure who is the owner of this test, so posting here. *08:28:05* # snapshots_merge: *08:28:31* Unhandled exception in <function <lambda> at 0x276a5f0>*08:28:31* Traceback (most recent call last):*08:28:31* File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 217, in assert_equals_within*08:28:31* res = func()*08:28:31* File "/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-master/test-scenarios/004_basic_sanity.py", line 466, in <lambda>*08:28:31* api.vms.get(VM0_NAME).disks.get(disk_name).status.state == 'ok'*08:28:31* AttributeError: 'NoneType' object has no attribute 'state'*08:28:31* Error while running thread*08:28:31* Traceback (most recent call last):*08:28:31* File "/usr/lib/python2.7/site-packages/lago/utils.py", line 57, in _ret_via_queue*08:28:31* queue.put({'return': func()})*08:28:31* File "/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-master/test-scenarios/004_basic_sanity.py", line 465, in snapshot_live_merge*08:28:31* lambda:*08:28:31* File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 264, in assert_true_within_long*08:28:31* assert_equals_within_long(func, True, allowed_exceptions)*08:28:31* File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 251, in assert_equals_within_long*08:28:31* func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions*08:28:31* File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 217, in assert_equals_within*08:28:31* res = func()*08:28:31* File "/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-master/test-scenarios/004_basic_sanity.py", line 466, in <lambda>*08:28:31* api.vms.get(VM0_NAME).disks.get(disk_name).status.state == 'ok'*08:28:31* AttributeError: 'NoneType' object has no attribute 'state'

4 9

[ OST Failure Report ] [ ovirt-engine-4.1 ] [ 02.03.2017 ] [004_basic_sanity]
by Pavel Zhukov 19 Mar '17

19 Mar '17

Hi, This is one-time failure. Non reproducible. disk_id was not inserted into DB because of jsonrpc/networking issue. But once OST runs on localhost networking (should not) be a problem here so adding Piotr. Failed jobs: http://jenkins.ovirt.org/view/experimental%20jobs/job/test-repo_ovirt_exper… Logs: http://jenkins.ovirt.org/view/experimental%20jobs/job/test-repo_ovirt_exper… http://jenkins.ovirt.org/view/experimental%20jobs/job/test-repo_ovirt_exper… [LOGS SNIPPETS] 35897:2017-03-02 07:12:28,721-05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (default task-19) [4adab878] START, CreateImageVDSCommand( CreateImageVDSCommandParameters:{runAsync='true', storagePoolId='9314c679-9a20-48b4-b62a-f7b6a3703287', ignoreFailoverLimit='false', storageDomainId='49226db8-e43f-4a15-a3a3-0bddd690d06b', imageGroupId='9cf5a90d-05fc-45de-a3c1-adbb6822150e', imageSizeInBytes='2', volumeFormat='COW', newImageId='c5275e2f-ac80-47c2-a43e-b5a0420a4211', newImageDescription='{"DiskAlias":"vm0_disk0","DiskDescription":""}', imageInitialSizeInBytes='0'}), log id: 657ef611 35920:{"jsonrpc":"2.0","method":"Volume.create","params":{"volumeID":"c5275e2f-ac80-47c2-a43e-b5a0420a4211","storagepoolID":"9314c679-9a20-48b4-b62a-f7b6a3703287","storagedomainID":"49226db8-e43f-4a15-a3a3-0bddd690d06b","imageID":"9cf5a90d-05fc-45de-a3c1-adbb6822150e","size":"2","volFormat":4,"preallocate":2,"diskType":2,"desc":"{\"DiskAlias\":\"vm0_disk0\",\"DiskDescription\":\"\"}","srcImgUUID":"00000000-0000-0000-0000-000000000000","srcVolUUID":"00000000-0000-0000-0000-000000000000"},"id":"0a757eae-0cc2-4f15-9bb5-05ad3221f697"} <=== NOTE NULL character here 35926:<JsonRpcRequest id: "0a757eae-0cc2-4f15-9bb5-05ad3221f697", method: Volume.create, params: {volumeID=c5275e2f-ac80-47c2-a43e-b5a0420a4211, storagepoolID=9314c679-9a20-48b4-b62a-f7b6a3703287, storagedomainID=49226db8-e43f-4a15-a3a3-0bddd690d06b, imageID=9cf5a90d-05fc-45de-a3c1-adbb6822150e, size=2, volFormat=4, preallocate=2, diskType=2, desc={"DiskAlias":"vm0_disk0","DiskDescription":""}, srcImgUUID=00000000-0000-0000-0000-000000000000, srcVolUUID=00000000-0000-0000-0000-000000000000}> 35996:2017-03-02 07:12:30,468-05 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (default task-19) [4adab878] ERROR, CreateImageVDSCommand( CreateImageVDSCommandParameters:{runAsync='true', storagePoolId='9314c679-9a20-48b4-b62a-f7b6a3703287', ignoreFailoverLimit='false', storageDomainId='49226db8-e43f-4a15-a3a3-0bddd690d06b', imageGroupId='9cf5a90d-05fc-45de-a3c1-adbb6822150e', imageSizeInBytes='2', volumeFormat='COW', newImageId='c5275e2f-ac80-47c2-a43e-b5a0420a4211', newImageDescription='{"DiskAlias":"vm0_disk0","DiskDescription":""}', imageInitialSizeInBytes='0'}), exception: VDSGenericException: VDSNetworkException: 880 > 879, log id: 657ef611 36511:2017-03-02 07:12:35,744-05 INFO [org.ovirt.engine.core.bll.storage.disk.image.AddImageFromScratchCommand] (default task-19) [4adab878] Command [id=35007fba-781c-4a15-8f29-a8efe441b2f3]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.storage.DiskImage; snapshot: 9cf5a90d-05fc-45de-a3c1-adbb6822150e. 2017-03-02 07:12:35,766-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler7) [6dc0e793] EVENT_ID: SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC(980), Correlation ID: 6dc0e793, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center test-dc. Setting status to Non Responsive. 2017-03-02 07:12:35,773-05 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (default task-19) [4adab878] Removed task '10b3bd58-8f3e-4b23-a8b6-27db110810d5' from DataBase 2017-03-02 07:12:35,779-05 DEBUG [org.ovirt.engine.core.dal.dbbroker.CustomSQLErrorCodeSQLExceptionTranslator] (default task-19) [4adab878] Translating SQLException with SQL state '23503', error code '0', message [ERROR: insert or update on table "disk_vm_element" violates foreign key constraint "fk_disk_vm_element_base_disks" Detail: Key (disk_id)=(9cf5a90d-05fc-45de-a3c1-adbb6822150e) is not present in table "base_disks". -- Pavel

7 10

[WARNING] Minimum requirements to fit the disk from the appliance OVF not met (required 50 GiB)
by Yaniv Kaul 19 Mar '17

19 Mar '17

ovirt-system-tests is failing[1] even though I've given it 100GB+ for every disk I could think of. What is it looking for and where exactly? TIA, Y. [1] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_… *13:24:17* [ INFO ] Checking OVF archive content (could take a few minutes depending on archive size)*13:24:43* [ INFO ] Checking OVF XML content (could take a few minutes depending on archive size)*13:25:08* [ INFO ] Detecting host timezone.*13:25:08* [WARNING] Minimum requirements to fit the disk from the appliance OVF not met (required 50 GiB)*13:25:08* [ ERROR ] Failed to execute stage 'Environment customization': Minimum requirements to fit the disk from the appliance OVF not met (required 50 GiB)*13:25:08* [ INFO ] Stage: Clean up

3 3

Error in ovirt-engine installation
by shubham dubey 17 Mar '17

17 Mar '17

Hello, I am trying to install ovirt-engine from almost 2 or 3 weeks in my fedora 25. But everytime I run this $ make install-dev PREFIX="$HOME/ovirt-engine" I got following error http://pastebin.com/cEfDJYix. I have tried to debug the problem lots of time but doesn't get succeeded. With little googling I might think that error is memory related but I have checked the memory usage and that looks normal. So,can anyone help to solve the problem? Thanks, Shubham

5 6

Ovirt 4.1 USB Api problems
by Adolfo 17 Mar '17

17 Mar '17

Hi, I don't know if this is the correct place for this question (i hope it is ;-) ). We are trying to make "enable USB support" work with a machine created from python ovirtsdk4 api, here is the code: cluster = ovirt.types.Cluster(id=six.binary_type(clusterId)) template = ovirt.types.Template(id=six.binary_type(templateId)) if usbType in ('native', 'legacy'): usb = ovirt.types.Usb(enabled=True, type=ovirt.types.UsbType.NATIVE if usbType == 'native' else ovirt.types.UsbType.LEGACY) else: usb = ovirt.types.Usb(enabled=False) memoryPolicy = ovirt.types.MemoryPolicy(guaranteed=guaranteedMB * 1024 * 1024) par = ovirt.types.Vm(name=name, cluster=cluster, template=template, description=comments, type=ovirt.types.VmType.DESKTOP, memory=memoryMB * 1024 * 1024, memory_policy=memoryPolicy, usb=usb) # display=display, return api.system_service().vms_service().add(par).id The cuestion is that the machines gets correctly created, but when we try to start the machine, we get an this error (extract from vdsm): Traceback (most recent call last): File "/usr/share/vdsm/virt/vm.py", line 552, in _startUnderlyingVm self._run() File "/usr/share/vdsm/virt/vm.py", line 1994, in _run self._connection.createXML(domxml, flags), File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 941, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3784, in createXML if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self) libvirtError: Error XML: Duplicate USB controllers with index 0 The question is, that if to this machine we have created, from administration interface, remove an add support for usb, the machine works, and the generated XML differs: This is the difference we have found: < <controller index="0" model="piix3-uhci" type="usb"> < <address bus="0x00" domain="0x0000" function="0x2" slot="0x01" type="pci" /> < </controller> 40a38 > <address bus="0x00" domain="0x0000" function="0x0" slot="0x02" type="pci" /> The "<" are from the non working (created from API call), and the ">" are same machine after disabling and enabling again "usb support". Is this a bug?, if not, ¿How is supposed to be enabled USB support from API on VM Creation?, By the way, the equivalent code for oVirt 3.x was working without problems, the problems arises from 4.0 onwards. Sorry for the inconveniences, and thank in advance for any help, Adolfo Gómez

2 2

Loadbalancer.org Enterprise VA with oVirt(RHEV) 4.1
by Nir Soffer 17 Mar '17

17 Mar '17

User explains how cool is ovirt and image upload: http://www.loadbalancer.org/blog/loadbalancer-org-enterprise-va-with-ovirtr… Enjoy, Nir

2 1

Line of death for tests
by Shmuel Melamud 16 Mar '17

16 Mar '17

Hi! I've found yesterday a very strange bug, most likely in Mockito. Hard to believe it really happens, but I've reproduced it in different environmentы and several revisions of oVirt master. I've added the following line into MigrateVmCommand: private Integer actualDowntime; + private Object actualDowntimeLock; This line causes ALL tests to fail with NullPointerException. Some tests print such a stack trace: java.lang.NullPointerException at org.mockito.internal.junit.util.TestName.getTestName(TestName.java:11) at org.mockito.internal.junit.MismatchReportingTestListener.testFinished(MismatchReportingTestListener.java:29) at org.mockito.internal.runners.DefaultInternalRunner$1$1.testFinished(DefaultInternalRunner.java:56) at org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:56) at org.junit.runner.notification.RunNotifier$7.notifyListener(RunNotifier.java:190) ... Name of the field doesn't matter, but type matters - changing the type to Integer solved the problem. Does anybody has an idea why this happens and how to fix it? Shmuel

2 2

Re: [ovirt-devel] [monitoring][collectd] the collectd virt plugin is now on par with Vdsm needs
by Yaniv Dary 16 Mar '17

16 Mar '17

Yaniv Dary Technical Product Manager Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109 Tel : +972 (9) 7692306 8272306 Email: ydary(a)redhat.com IRC : ydary On Feb 21, 2017 13:06, "Francesco Romani" <fromani(a)redhat.com> wrote: Hello everyone, in the last weeks I've been submitting PRs to collectd upstream, to bring the virt plugin up to date with Vdsm and oVirt needs. Previously, the collectd virt plugin reported only a subset of metrics oVirt uses. In current collectd master, the collectd virt plugin provides all the data Vdsm (thus Engine) needs. This means that it is now possible for Vdsm or Engine to query collectd, not Vdsm/libvirt, and have the same data. There are only two caveats: 1. it is yet to be seen which version of collectd will ship all those enhancements 2. collectd *intentionally* report metrics as rates, not as absolute values as Vdsm does. This may be one issue in presence of restarts/data loss in the link between collectd and the metrics store. How does this work? If we want to show memory usage over time for example, we need to have the usage, not the rate. How would this be reported? Please keep reading for more details: How to get the code? -------------------------------- This somehow tricky until we get one official release. If one is familiar with the RPM build process, it is easy to build one custom packages from a snapshot from collectd master (https://github.com/collectd/collectd) and a recent 5.7.1 RPM (like https://koji.fedoraproject.org/koji/buildinfo?buildID=835669) How to configure it? ------------------------------ Most thing work out of the box. One currently in progress Vdsm patch ships the recommended configuration https://gerrit.ovirt.org/#/c/71176/6/static/etc/collectd.d/virt.conf The meaning of the configuration option is documented in man 5 collectd.conf How it looks like? -------------------------- Let me post one "screenshot" :) $ collectdctl listval | grep a0 a0/virt/disk_octets-hdc a0/virt/disk_octets-vda a0/virt/disk_ops-hdc a0/virt/disk_ops-vda a0/virt/disk_time-hdc a0/virt/disk_time-vda a0/virt/if_dropped-vnet0 a0/virt/if_errors-vnet0 a0/virt/if_octets-vnet0 a0/virt/if_packets-vnet0 a0/virt/memory-actual_balloon a0/virt/memory-rss a0/virt/memory-total a0/virt/ps_cputime a0/virt/total_requests-flush-hdc a0/virt/total_requests-flush-vda a0/virt/total_time_in_ms-flush-hdc a0/virt/total_time_in_ms-flush-vda a0/virt/virt_cpu_total a0/virt/virt_vcpu-0 a0/virt/virt_vcpu-1 How to consume the data? ----------------------------------------- Among the ways to query collectd, the two most popular (and most fitting for oVirt use case) ways are perhaps the network protocol (https://collectd.org/wiki/index.php/Binary_protocol) and the plain text protocol (https://collectd.org/wiki/index.php/Plain_text_protocol) The first could be used by Engine to get the data directly, or to consolidate the metrics in one database (e.g to run any kind of query, for historical series...). The latter will be used by Vdsm to keep reporting the metrics (again https://gerrit.ovirt.org/#/c/71176/6) Please note that the performance of the plain text protocol are known to be lower than the binary protocol What about the unresponsive hosts? ------------------------------------------------------- We know from experience that hosts may become unresponsive, and this can disrupt monitoring. however, we do want to keep monitoring the responsive hosts, avoiding that one rogue hosts makes us lose all the monitoring data. To cope with this need, the virt plugin gained support for "partition tag". With this, we can group VMs together using one arbitrary tag. This is completely transparent to collectd, and also completely optional. oVirt can use this tag to group VMs per-storage-domain, or however it sees fit, trying to minimize the disruption should one host become unresponsive. Read the full docs here: https://github.com/collectd/collectd/commit/999efc28d8e2e96bc15f535254d412 a79755ca4f What about the collectd-ovirt plugin? -------------------------------------------------------- Some time ago I implemented one out-of-tree collectd plugin leveraging the libvirt bulk stats: https://github.com/fromanirh/collectd-ovirt This plugin is meant to be a modern, drop-in replacement for the existing virt plugin. The development of that out of tree plugin is now halted, because we have everything we need in the upstream collectd plugin. Future work ------------------ We believe we have reached feature parity, so we are looking for bugixes/performance tuning in the near term future. I'll be happy to provide more patches/PRs about that. Thanks and bests, -- Francesco Romani Red Hat Engineering Virtualization R & D IRC: fromani _______________________________________________ Devel mailing list Devel(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/devel

3 11

Error in setup of ovirt-engine Development Environment
by shubham dubey 16 Mar '17

16 Mar '17

Hello, I am trying to setup ovirt-engine using this link http://www.ovirt.org/develop/developer-guide/engine/engine-development-envi… . Now when I am trying these commands I am getting following error $ postgres -c "psql -d template1 -c \"create user engine password 'engine';\"" FATAL: -c psql -d template1 -c "create user engine password 'engine';" requires a value and $postgres -c "psql -d template1 -c "create database engine \ owner engine template template0 encoding 'UTF8' lc_collate \ 'en_US.UTF-8' lc_ctype 'en_US.UTF-8';\"" FATAL: -c psql -d template1 -c "create database engine owner engine template template0 encoding 'UTF8' lc_collate 'en_US.UTF-8' lc_ctype 'en_US.UTF-8';" requires a value So I think the syntax given there is not right,So can anyone tell me the correct syntax.Or maybe I am doing something wrong. Thanks, Shubham

6 8