Ceph hyperconvergence
by Logan Kuhn
Hi
It was suggested that I ask this list. Are there any plans to add
hyperconverge with Ceph, similar to the way it has been implemented with
Gluster? I know that I can add Cinder as an external provider as an
interface to Ceph, but it's more clunky than a hyperconverged solution.
Regards,
Logan Kuhn
7 years, 9 months
System tests failure (wrong test code?)
by Nir Soffer
If found this error in system tests - looks like wrong assert - code should
check
if disk is not None before checking state.
I'm not sure who is the owner of this test, so posting here.
*08:28:05* # snapshots_merge: *08:28:31* Unhandled exception in
<function <lambda> at 0x276a5f0>*08:28:31* Traceback (most recent call
last):*08:28:31* File
"/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 217, in
assert_equals_within*08:28:31* res = func()*08:28:31* File
"/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-master/test-scenarios/004_basic_sanity.py",
line 466, in <lambda>*08:28:31*
api.vms.get(VM0_NAME).disks.get(disk_name).status.state ==
'ok'*08:28:31* AttributeError: 'NoneType' object has no attribute
'state'*08:28:31* Error while running thread*08:28:31* Traceback (most
recent call last):*08:28:31* File
"/usr/lib/python2.7/site-packages/lago/utils.py", line 57, in
_ret_via_queue*08:28:31* queue.put({'return': func()})*08:28:31*
File "/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-master/test-scenarios/004_basic_sanity.py",
line 465, in snapshot_live_merge*08:28:31* lambda:*08:28:31*
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line
264, in assert_true_within_long*08:28:31*
assert_equals_within_long(func, True, allowed_exceptions)*08:28:31*
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line
251, in assert_equals_within_long*08:28:31* func, value,
LONG_TIMEOUT, allowed_exceptions=allowed_exceptions*08:28:31* File
"/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 217, in
assert_equals_within*08:28:31* res = func()*08:28:31* File
"/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-master/test-scenarios/004_basic_sanity.py",
line 466, in <lambda>*08:28:31*
api.vms.get(VM0_NAME).disks.get(disk_name).status.state ==
'ok'*08:28:31* AttributeError: 'NoneType' object has no attribute
'state'
7 years, 9 months
[ OST Failure Report ] [ ovirt-engine-4.1 ] [ 02.03.2017 ] [004_basic_sanity]
by Pavel Zhukov
Hi,
This is one-time failure. Non reproducible. disk_id was not inserted
into DB because of jsonrpc/networking issue. But once OST runs on
localhost networking (should not) be a problem here so adding Piotr.
Failed jobs:
http://jenkins.ovirt.org/view/experimental%20jobs/job/test-repo_ovirt_exp...
Logs:
http://jenkins.ovirt.org/view/experimental%20jobs/job/test-repo_ovirt_exp...
http://jenkins.ovirt.org/view/experimental%20jobs/job/test-repo_ovirt_exp...
[LOGS SNIPPETS]
35897:2017-03-02 07:12:28,721-05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (default task-19) [4adab878] START, CreateImageVDSCommand( CreateImageVDSCommandParameters:{runAsync='true', storagePoolId='9314c679-9a20-48b4-b62a-f7b6a3703287', ignoreFailoverLimit='false', storageDomainId='49226db8-e43f-4a15-a3a3-0bddd690d06b', imageGroupId='9cf5a90d-05fc-45de-a3c1-adbb6822150e', imageSizeInBytes='2', volumeFormat='COW', newImageId='c5275e2f-ac80-47c2-a43e-b5a0420a4211', newImageDescription='{"DiskAlias":"vm0_disk0","DiskDescription":""}', imageInitialSizeInBytes='0'}), log id: 657ef611
35920:{"jsonrpc":"2.0","method":"Volume.create","params":{"volumeID":"c5275e2f-ac80-47c2-a43e-b5a0420a4211","storagepoolID":"9314c679-9a20-48b4-b62a-f7b6a3703287","storagedomainID":"49226db8-e43f-4a15-a3a3-0bddd690d06b","imageID":"9cf5a90d-05fc-45de-a3c1-adbb6822150e","size":"2","volFormat":4,"preallocate":2,"diskType":2,"desc":"{\"DiskAlias\":\"vm0_disk0\",\"DiskDescription\":\"\"}","srcImgUUID":"00000000-0000-0000-0000-000000000000","srcVolUUID":"00000000-0000-0000-0000-000000000000"},"id":"0a757eae-0cc2-4f15-9bb5-05ad3221f697"} <=== NOTE NULL character here
35926:<JsonRpcRequest id: "0a757eae-0cc2-4f15-9bb5-05ad3221f697", method: Volume.create, params: {volumeID=c5275e2f-ac80-47c2-a43e-b5a0420a4211, storagepoolID=9314c679-9a20-48b4-b62a-f7b6a3703287, storagedomainID=49226db8-e43f-4a15-a3a3-0bddd690d06b, imageID=9cf5a90d-05fc-45de-a3c1-adbb6822150e, size=2, volFormat=4, preallocate=2, diskType=2, desc={"DiskAlias":"vm0_disk0","DiskDescription":""}, srcImgUUID=00000000-0000-0000-0000-000000000000, srcVolUUID=00000000-0000-0000-0000-000000000000}>
35996:2017-03-02 07:12:30,468-05 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (default task-19) [4adab878] ERROR, CreateImageVDSCommand( CreateImageVDSCommandParameters:{runAsync='true', storagePoolId='9314c679-9a20-48b4-b62a-f7b6a3703287', ignoreFailoverLimit='false', storageDomainId='49226db8-e43f-4a15-a3a3-0bddd690d06b', imageGroupId='9cf5a90d-05fc-45de-a3c1-adbb6822150e', imageSizeInBytes='2', volumeFormat='COW', newImageId='c5275e2f-ac80-47c2-a43e-b5a0420a4211', newImageDescription='{"DiskAlias":"vm0_disk0","DiskDescription":""}', imageInitialSizeInBytes='0'}), exception: VDSGenericException: VDSNetworkException: 880 > 879, log id: 657ef611
36511:2017-03-02 07:12:35,744-05 INFO [org.ovirt.engine.core.bll.storage.disk.image.AddImageFromScratchCommand] (default task-19) [4adab878] Command [id=35007fba-781c-4a15-8f29-a8efe441b2f3]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.storage.DiskImage; snapshot: 9cf5a90d-05fc-45de-a3c1-adbb6822150e.
2017-03-02 07:12:35,766-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler7) [6dc0e793] EVENT_ID: SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC(980), Correlation ID: 6dc0e793, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center test-dc. Setting status to Non Responsive.
2017-03-02 07:12:35,773-05 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (default task-19) [4adab878] Removed task '10b3bd58-8f3e-4b23-a8b6-27db110810d5' from DataBase
2017-03-02 07:12:35,779-05 DEBUG [org.ovirt.engine.core.dal.dbbroker.CustomSQLErrorCodeSQLExceptionTranslator] (default task-19) [4adab878] Translating SQLException with SQL state '23503', error code '0', message [ERROR: insert or update on table "disk_vm_element" violates foreign key constraint "fk_disk_vm_element_base_disks"
Detail: Key (disk_id)=(9cf5a90d-05fc-45de-a3c1-adbb6822150e) is not present in table "base_disks".
--
Pavel
7 years, 9 months
[WARNING] Minimum requirements to fit the disk from the appliance OVF not met (required 50 GiB)
by Yaniv Kaul
ovirt-system-tests is failing[1] even though I've given it 100GB+ for every
disk I could think of. What is it looking for and where exactly?
TIA,
Y.
[1]
http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x8...
*13:24:17* [ INFO ] Checking OVF archive content (could take a few
minutes depending on archive size)*13:24:43* [ INFO ] Checking OVF
XML content (could take a few minutes depending on archive
size)*13:25:08* [ INFO ] Detecting host timezone.*13:25:08* [WARNING]
Minimum requirements to fit the disk from the appliance OVF not met
(required 50 GiB)*13:25:08* [ ERROR ] Failed to execute stage
'Environment customization': Minimum requirements to fit the disk from
the appliance OVF not met (required 50 GiB)*13:25:08* [ INFO ] Stage:
Clean up
7 years, 9 months
Error in ovirt-engine installation
by shubham dubey
Hello,
I am trying to install ovirt-engine from almost 2 or 3 weeks in my fedora
25.
But everytime I run this $ make install-dev PREFIX="$HOME/ovirt-engine"
I got following error http://pastebin.com/cEfDJYix. I have tried to debug
the problem lots of time but doesn't get succeeded. With little googling I
might think that error is memory related but I have checked the memory
usage and that looks normal.
So,can anyone help to solve the problem?
Thanks,
Shubham
7 years, 9 months
Ovirt 4.1 USB Api problems
by Adolfo
Hi,
I don't know if this is the correct place for this question (i hope it
is ;-) ).
We are trying to make "enable USB support" work with a machine created
from python ovirtsdk4 api,
here is the code:
cluster = ovirt.types.Cluster(id=six.binary_type(clusterId))
template = ovirt.types.Template(id=six.binary_type(templateId))
if usbType in ('native', 'legacy'):
usb = ovirt.types.Usb(enabled=True,
type=ovirt.types.UsbType.NATIVE if usbType == 'native' else
ovirt.types.UsbType.LEGACY)
else:
usb = ovirt.types.Usb(enabled=False)
memoryPolicy =
ovirt.types.MemoryPolicy(guaranteed=guaranteedMB * 1024 * 1024)
par = ovirt.types.Vm(name=name, cluster=cluster,
template=template, description=comments,
type=ovirt.types.VmType.DESKTOP, memory=memoryMB * 1024 * 1024,
memory_policy=memoryPolicy,
usb=usb) # display=display,
return api.system_service().vms_service().add(par).id
The cuestion is that the machines gets correctly created, but when we
try to start the machine, we get an this error (extract from vdsm):
Traceback (most recent call last):
File "/usr/share/vdsm/virt/vm.py", line 552, in _startUnderlyingVm
self._run()
File "/usr/share/vdsm/virt/vm.py", line 1994, in _run
self._connection.createXML(domxml, flags),
File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py",
line 123, in wrapper
ret = f(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 941, in
wrapper
return func(inst, *args, **kwargs)
File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3784, in
createXML
if ret is None:raise libvirtError('virDomainCreateXML() failed',
conn=self)
libvirtError: Error XML: Duplicate USB controllers with index 0
The question is, that if to this machine we have created, from
administration interface, remove an add support for usb, the machine
works, and the generated XML differs:
This is the difference we have found:
< <controller index="0" model="piix3-uhci" type="usb">
< <address bus="0x00" domain="0x0000" function="0x2"
slot="0x01" type="pci" />
< </controller>
40a38
> <address bus="0x00" domain="0x0000" function="0x0"
slot="0x02" type="pci" />
The "<" are from the non working (created from API call), and the ">"
are same machine after disabling and enabling again "usb support".
Is this a bug?, if not, ¿How is supposed to be enabled USB support from
API on VM Creation?,
By the way, the equivalent code for oVirt 3.x was working without
problems, the problems arises from 4.0 onwards.
Sorry for the inconveniences, and thank in advance for any help,
Adolfo Gómez
7 years, 9 months
Line of death for tests
by Shmuel Melamud
Hi!
I've found yesterday a very strange bug, most likely in Mockito. Hard
to believe it really happens, but I've reproduced it in different
environmentы and several revisions of oVirt master.
I've added the following line into MigrateVmCommand:
private Integer actualDowntime;
+ private Object actualDowntimeLock;
This line causes ALL tests to fail with NullPointerException. Some
tests print such a stack trace:
java.lang.NullPointerException
at org.mockito.internal.junit.util.TestName.getTestName(TestName.java:11)
at org.mockito.internal.junit.MismatchReportingTestListener.testFinished(MismatchReportingTestListener.java:29)
at org.mockito.internal.runners.DefaultInternalRunner$1$1.testFinished(DefaultInternalRunner.java:56)
at org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:56)
at org.junit.runner.notification.RunNotifier$7.notifyListener(RunNotifier.java:190)
...
Name of the field doesn't matter, but type matters - changing the type
to Integer solved the problem.
Does anybody has an idea why this happens and how to fix it?
Shmuel
7 years, 9 months
Re: [ovirt-devel] [monitoring][collectd] the collectd virt plugin is now on par with Vdsm needs
by Yaniv Dary
Yaniv Dary
Technical Product Manager
Red Hat Israel Ltd.
34 Jerusalem Road
Building A, 4th floor
Ra'anana, Israel 4350109
Tel : +972 (9) 7692306
8272306
Email: ydary(a)redhat.com
IRC : ydary
On Feb 21, 2017 13:06, "Francesco Romani" <fromani(a)redhat.com> wrote:
Hello everyone,
in the last weeks I've been submitting PRs to collectd upstream, to
bring the virt plugin up to date with Vdsm and oVirt needs.
Previously, the collectd virt plugin reported only a subset of metrics
oVirt uses.
In current collectd master, the collectd virt plugin provides all the
data Vdsm (thus Engine) needs. This means that it is now
possible for Vdsm or Engine to query collectd, not Vdsm/libvirt, and
have the same data.
There are only two caveats:
1. it is yet to be seen which version of collectd will ship all those
enhancements
2. collectd *intentionally* report metrics as rates, not as absolute
values as Vdsm does. This may be one issue in presence of restarts/data
loss in the link between collectd and the metrics store.
How does this work?
If we want to show memory usage over time for example, we need to have the
usage, not the rate.
How would this be reported?
Please keep reading for more details:
How to get the code?
--------------------------------
This somehow tricky until we get one official release. If one is
familiar with the RPM build process, it is easy to build one custom packages
from a snapshot from collectd master
(https://github.com/collectd/collectd) and a recent 5.7.1 RPM (like
https://koji.fedoraproject.org/koji/buildinfo?buildID=835669)
How to configure it?
------------------------------
Most thing work out of the box. One currently in progress Vdsm patch
ships the recommended configuration
https://gerrit.ovirt.org/#/c/71176/6/static/etc/collectd.d/virt.conf
The meaning of the configuration option is documented in man 5 collectd.conf
How it looks like?
--------------------------
Let me post one "screenshot" :)
$ collectdctl listval | grep a0
a0/virt/disk_octets-hdc
a0/virt/disk_octets-vda
a0/virt/disk_ops-hdc
a0/virt/disk_ops-vda
a0/virt/disk_time-hdc
a0/virt/disk_time-vda
a0/virt/if_dropped-vnet0
a0/virt/if_errors-vnet0
a0/virt/if_octets-vnet0
a0/virt/if_packets-vnet0
a0/virt/memory-actual_balloon
a0/virt/memory-rss
a0/virt/memory-total
a0/virt/ps_cputime
a0/virt/total_requests-flush-hdc
a0/virt/total_requests-flush-vda
a0/virt/total_time_in_ms-flush-hdc
a0/virt/total_time_in_ms-flush-vda
a0/virt/virt_cpu_total
a0/virt/virt_vcpu-0
a0/virt/virt_vcpu-1
How to consume the data?
-----------------------------------------
Among the ways to query collectd, the two most popular (and most fitting
for oVirt use case) ways are perhaps the network protocol
(https://collectd.org/wiki/index.php/Binary_protocol)
and the plain text protocol
(https://collectd.org/wiki/index.php/Plain_text_protocol). The first
could be used by Engine to get the data directly, or to consolidate the
metrics in one database (e.g to run any kind of query, for historical
series...).
The latter will be used by Vdsm to keep reporting the metrics (again
https://gerrit.ovirt.org/#/c/71176/6)
Please note that the performance of the plain text protocol are known to
be lower than the binary protocol
What about the unresponsive hosts?
-------------------------------------------------------
We know from experience that hosts may become unresponsive, and this can
disrupt monitoring. however, we do want to keep monitoring the
responsive hosts, avoiding that one rogue hosts makes us lose all the
monitoring data.
To cope with this need, the virt plugin gained support for "partition
tag". With this, we can group VMs together using one arbitrary tag. This
is completely transparent to collectd, and also completely optional.
oVirt can use this tag to group VMs per-storage-domain, or however it
sees fit, trying to minimize the disruption should one host become
unresponsive.
Read the full docs here:
https://github.com/collectd/collectd/commit/999efc28d8e2e96bc15f535254d412
a79755ca4f
What about the collectd-ovirt plugin?
--------------------------------------------------------
Some time ago I implemented one out-of-tree collectd plugin leveraging
the libvirt bulk stats: https://github.com/fromanirh/collectd-ovirt
This plugin is meant to be a modern, drop-in replacement for the
existing virt plugin.
The development of that out of tree plugin is now halted, because we
have everything we need in the upstream collectd plugin.
Future work
------------------
We believe we have reached feature parity, so we are looking for
bugixes/performance tuning in the near term future. I'll be happy to
provide more patches/PRs about that.
Thanks and bests,
--
Francesco Romani
Red Hat Engineering Virtualization R & D
IRC: fromani
_______________________________________________
Devel mailing list
Devel(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel
7 years, 9 months
Error in setup of ovirt-engine Development Environment
by shubham dubey
Hello,
I am trying to setup ovirt-engine using this link
http://www.ovirt.org/develop/developer-guide/engine/engine-development-en...
.
Now when I am trying these commands I am getting following error
$
postgres -c "psql -d template1 -c \"create user engine password 'engine';\""
FATAL: -c psql -d template1 -c "create user engine password 'engine';"
requires a value
and
$postgres -c "psql -d template1 -c "create database engine \
owner engine template template0 encoding 'UTF8' lc_collate \
'en_US.UTF-8' lc_ctype 'en_US.UTF-8';\""
FATAL: -c psql -d template1 -c "create database engine owner engine
template template0 encoding 'UTF8' lc_collate 'en_US.UTF-8' lc_ctype
'en_US.UTF-8';" requires a value
So I think the syntax given there is not right,So can anyone tell me the
correct syntax.Or maybe I am doing something wrong.
Thanks,
Shubham
7 years, 9 months
