July 2014 - Devel - oVirt List Archives

Summary of my 3.5 oVirt Test Day - BZ987953, BZ1110566
by Allon Mureinik 07 Jul '14

07 Jul '14

Hi all, Following is a summary of my experience from the 3.5 Test Day. As a someone who usually isn't very UX-oriented, I decided to test a couple of UX RFEs, both as a learning experience and out of the thought that a pair of fresh eyes may see things that seasoned UX developers may have become used to overlooking. I wasted about an hour in the morning trying to recover my dev. env. from the mess I left it in, and ultimately decided it was not a good use of my time, and opted to install RPMs on a VM. Once I passed that hurdle I played around with both features a bit, and tried to systematically apply them to all the main tabs. Both features seem to be working properly, although I did stumble across "Bug 1114990 - Clusters main tab is not sorted", which I don't believe is related to either feature, but worth fixing nonetheless. -Allon

2 1

Call for Papers Deadline in Six Days: Linux.conf.au
by Brian Proffitt 07 Jul '14

07 Jul '14

Conference: Linux.conf.au Information: Each year open source geeks from across the globe gather in Australia or New Zealand to meet their fellow technologists, share the latest ideas and innovations, and spend a week discussing and collaborating on open source projects. The conference is well known for the speakers and delegates depth of talent, and its focus on technical linux content. Possible topics: Virtualization, oVirt, KVM, libvirt, RDO, OpenStack, Foreman Date: January 12-15, 2015 Location: Auckland, New Zealand Website: http://lca2015.linux.org.au/ Call for Papers Deadline: July 13, 2014 Call for Papers URL: http://lca2015.linux.org.au/cfp Contact me for more information and assistance with presentations. -- Brian Proffitt oVirt Community Manager Project Atomic Community Lead Open Source and Standards, Red Hat - http://community.redhat.com Phone: +1 574 383 9BKP IRC: bkp @ OFTC

1 0

ovirt test day1 - report
by Yair Zaslavsky 06 Jul '14

06 Jul '14

Hi, I tested https://bugzilla.redhat.com/show_bug.cgi?id=1054241 (http://www.ovirt.org/Feature/OvfOnWantedDomains) The feature worked ok.

1 1

use mvn instead of make to deploy
by Roy Golan 06 Jul '14

06 Jul '14

just merged http://gerrit.ovirt.org/#/c/25661/ to help us use mvn to copy the project artifact instead of make. usage: #build and deploy to $OVIRT_ENGINE_PREIFX mvn clean install -Pmake #just deploy mvn install -pl org.ovirt.engine:make -Pmake #alternative prefix mvn clean install -Pmake -Dprefix=/path/to/prefix

3 2

[VDSM] VDSM threads as in vdsm 4.15.0
by Francesco Romani 06 Jul '14

06 Jul '14

Hi, I'm trying to enumerate all the daemon threads VDSM uses, as in 4.15.0 (to be exact, as in master 3228f5dad8f488192ea62f4e3e39172832435e80) So far I got: === SocketServer: 1 service, short lived thread per request? VDSM alone, with no VM running num what where -------------------------------------------------------- 1 libVirtEventLoop lib/vdsm/libvirtconnection.py P TaskManager vdsm/storage/hsm.py 1 StorageServer vdsm/storage/storageServer.py 1 StorageRefresh vdsm/storage/hsm.py 1 ChannelListener vdsm/virt/vmchannels.py 1 HostStatsThread vdsm/virt/sampling.py 1 MomThread vdsm/momIF.py 1 clientIF vdsm/clientIF.py 1 HostMonitor mom/HostMonitor.py 1 StompReactor vdsm/rpc/BindingJsonRpc.py 1 JsonRpcServer vdsm/rpc/BidningJsonRpc.py 1 GuestManager mom/GuestManager.py 1 PolicyEngine mom/PolicyEngine.py 1 XmlRpcServer? vdsm/rpc/BindingXMLRPC.py 1 Detector vdsm/clientIF.py 1 RPCServer mom/RPCServer.py 1 SocketServer stdlib, triggered by vdsm/rpc/BindingXMLRPC.py 1 IOProcess? vdsm/storage/outOfProcess.py S DomainMonitor vdsm/storage/domainMonitor.py P/2 HSM_MailMonitor vdsm/storage/storage_mailbox.py P/2 SPM_MailMonitor vdsm/storage/storage_mailbox.py P = pool size (config/irs/thread_pool_size) Total: 17 + number(StorageDomains) + P * 2 Total with defaults (P=10) = 37 + number(StorageDomains) Minimum storage domains: 2 (ISO + data) Baseline: 39 threads Per VM 1 sampling vdsm/virt/sampling.py 1 GuestMonitor mom/GuestMonitor.py === More precise update will follow. In the meantime, anyone please feel free to point out omissions/errors. Thanks, -- Francesco Romani RedHat Engineering Virtualization R & D Phone: 8261328 IRC: fromani

5 4

Re: [ovirt-devel] compile vdsm and attach it to a engine
by Nir Soffer 06 Jul '14

06 Jul '14

----- Original Message ----- > From: "aaron Beein" <aaronbeein(a)gmail.com> > To: "Nir Soffer" <nsoffer(a)redhat.com> > Cc: devel(a)ovirt.org > Sent: Sunday, July 6, 2014 12:58:44 PM > Subject: Re: [ovirt-devel] compile vdsm and attach it to a engine > > Thank you very much for your patient explanation. > According to your clues, I selected the centos6.5 and I I've succeeded > to add my host which contains a compiled vdsm to a engine. > > I am working on Cloud Computing and Virtualization. And I like them. > May be I will modify the vdsm code in the future. So this is the first > step to > use modified vdsm. > > Thanks again for your help. When you do have some nice modification, please share it with us. Nir > > aaron > > 2014-07-06 3:56 GMT+08:00 Nir Soffer <nsoffer(a)redhat.com>: > > ----- Original Message ----- > >> From: "aaron Beein" <aaronbeein(a)gmail.com> > >> To: devel(a)ovirt.org > >> Sent: Thursday, July 3, 2014 5:16:15 AM > >> Subject: [ovirt-devel] compile vdsm and attach it to a engine > >> > >> Thank you for your great job on ovirt and vdsm. Now I devote myself to > >> compile vdsm on centos 6.3 host and attach it to a ovirt engine. But when > >> I > >> attach the host which contains a compiled vdsm to a ovirt engine , the > >> status of the host is always ‘Non Responsive’(step 11 below). > > > > I think those pages are misleading. > > > > 1. First Centos 6.3 is too old, I think that current vdsm requires Centos > > 6.5. > > Using old version you may have missing packages. > > Do you have specific reason to use this version? > > > > 2. Why do you want to compile vdsm? Do you plan to modify vdsm or you just > > need a version that works on your machine? > > > > 3. If you want to develop vdsm, first prepare the host: > > > > 1. Install on the host one of the supported versions - RHEL 6.5, Centos > > 6.5 > > or Fedora 19. Fedora 20 should also work. > > > > 2. http://www.ovirt.org/Vdsm_Developers#Installing_required_packages > > > > 3. http://www.ovirt.org/Vdsm_Developers#Getting_the_source > > > > 4. http://www.ovirt.org/Vdsm_Developers#Building_a_Vdsm_RPM > > > > 5. You don't need anything else on that page (but see bellow) > > > > 4. Add the host to ovirt engine > > > > The best way is to do it from the engine, before you install your vdsm > > you built > > from source. This will configure network and certificates and will make > > your life > > easier. > > > > Do not disable ssl or installation from engine, it will only make it > > more > > complex for yourself. > > > > So add the host the engine - it will install the lastest stable vdsm > > version > > on this host and it should be up in few minuets. > > > > 5. Install new vdsm version > > > > This is the step you will do again and again when developing vdsm. > > > > 1. On the engine side, move the host to maintenance > > > > 2. On the host, remove vdsm: > > > > yum remove -y vdsm\* > > > > This is required because the way we version master builds. A version > > you > > build from source will typically have older version number compared > > with > > latest stable version. Removing vdsm is quick and solve this > > versioning > > mess. > > > > 3. And install the rpm packages as described in: > > http://www.ovirt.org/Vdsm_Developers#Basic_installation > > > > Important note: the command to install vdsm in the wiki assume that > > you have only one version of the rpm in rpmbuild/RPMS/*/. If you have > > multiple versions your installation will fail with strange errors. > > > > The best way to avoid this is to remove the RPMS direcotory before you > > build new rpm. If you want to keep multiple rpms version move them > > elsewhere > > after you build. > > > > If you have trouble, please attach engine.log and vdsm.log. We cannot help > > if > > all the info we have is "host is non-responsive". > > > > > > Nir > > > > > > > > > > > > > > >

1 0

ovirt test day report - make ovirt easy configurable to allow redirection of all logs to syslog
by Alona Kaplan 06 Jul '14

06 Jul '14

During the test day I tested - Bug 1078738 - OVIRT35 - [RFE] make ovirt easy configurable to allow redirection of all logs to syslog There was no feature page so it was very hard to understand how this feature should be tested. The build contains only a patch that tailors the api to the engine. abarlev sent me an external rpm with the syslog extension- tested it on f19, seems to work fine. Alona.

2 1

Summary of my 3.5 oVirt Test Day - BZ1108866, BZ1108866
by Maor Lipchuk 06 Jul '14

06 Jul '14

Hi all, I was testing two features of 3.5 in the oVirt test day The first feature was: [RFE] Maintenance operations on a VM would ask for an optional reason (BZ1108866) The feature provides the ability to present a message to the user regarding the reason why this VM has been shutdown. It seems to work very well except when using shutdown while the VM is powering up or shutting down, then the message gets deleted. The other feature I was testing was: Allow to clone a (down) VM without snapshot/template (BZ1108866) This feature provides the ability to clone a VM from the VM itself, instead do it from a snapshot. I have tested many different scenarios such as cloning a VM which was in PREVIEW, VM containing shared disks and read only disks. The feature works very well, and the previewed VM which was cloned, was similar to the cloned one. Regards, Maor

1 0

compile vdsm and attach it to a engine
by aaron Beein 05 Jul '14

05 Jul '14

Hi, Thank you for your great job on ovirt and vdsm. Now I devote myself to compile vdsm on centos 6.3 host and attach it to a ovirt engine. But when I attach the host which contains a compiled vdsm to a ovirt engine , the status of the host is always ‘Non Responsive’(step 11 below). I reference the links below: http://www.ovirt.org/Vdsm_Developers http://www.ovirt.org/Installing_VDSM_from_rpm The steps( 1-9 ) are executed on centos6.3 host, and the steps(10--11) are executed on ovirt engine. So I would be very grateful if you can give me some clues that if I've missed anything or I done something wrong. The attachment is the same as the bellow which makes it easier for you to read. 1 Deployment platform Centos6.3 Linux bogon 2.6.32-431.20.3.el6.x86_64 #1 SMP Thu Jun 19 21:14:45 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Ip ： 10.1.8.252 CPU supports hardware virtualization extensions: # cat /proc/cpuinfo | egrep 'svm|vmx'| grep nx flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm pcid sse4_1 sse4_2 popcnt tsc_deadline_timer xsave lahf_lm arat epb xsaveopt pln pts dts tpr_shadow vnmi flexpriority ept vpid flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm pcid sse4_1 sse4_2 popcnt tsc_deadline_timer xsave lahf_lm arat epb xsaveopt pln pts dts tpr_shadow vnmi flexpriority ept vpid 2 Apply all updates # yum -y update 3 Installing required packages RHEL 6 users must add EPEL yum repository for installing python-ordereddict and pyton-pthreading. The rpm bellow will install the epel yum repo and required gpg keys. # yum install http://download.fedoraproject.org/pub/epel/6/i386/epel-release-6-8.noarch.r… RHEL 6 users must install a newer pep8 version than the one shipped in EPEL6. Older pep8 versions have a bug that's tickled by vdsm. You can use `pip`, or yum install http://danken.fedorapeople.org/python-pep8-1.4.5-2.el6.noarch.rpm oVirt repo: yum install http://resources.ovirt.org/releases/ovirt-release.noarch.rpm RHEL 6 users must add the glusterfs repository, providing newer glusterfs not available on RHEL 6. Optionally install 'wget' if not present rpm -q wget 2> /dev/null || yum install wget wget -O /etc/yum.repos.d/glusterfs-epel.repo *http://download.gluster.org/pub/gluster/glusterfs/LATEST/EPEL.repo/glusterfs-epel.repo* <http://download.gluster.org/pub/gluster/glusterfs/LATEST/EPEL.repo/glusterf…> Fedora and RHEL 6 users must verify the following packages are installed before attempting to build: yum install make autoconf automake pyflakes logrotate gcc python-pep8 libvirt-python python-devel \ python-nose rpm-build sanlock-python genisoimage python-ordereddict python-pthreading libselinux-python\ python-ethtool m2crypto python-dmidecode python-netaddr python-inotify python-argparse git \ python-cpopen bridge-utils libguestfs-tools-c pyparted openssl libnl libtool gettext-devel python-ioprocess libvirt libvirt-client libvirt-lock-sanlock 4 Getting the source cd /root git clone *http://gerrit.ovirt.org/p/vdsm.git* <http://gerrit.ovirt.org/p/vdsm.git> cd vdsm 5 Building a Vdsm RPM ./autogen.sh –system ./configure --prefix=/usr --sysconfdir=/etc --localstatedir=/var --libdir=/usr/lib --enable-hooks make rpm NOSE_EXCLUDE=.* 6 Basic installation and start When building from source, you should enable the ovirt-beta repository, to satisfy dependencies that are not available yet in the release repository. # cd ~/rpmbuild/RPMS # yum install --skip-broken --enablerepo=ovirt-master-snapshot-static x86_64/* noarch/vdsm-xml* noarch/vdsm-cli* noarch/vdsm-python-zombiereaper* noarch/vdsm-*jsonrpc* Before starting vdsmd service for the first time vdsm requires some configuration procedures for external services that being used by vdsmd. To ease this process vdsm provides a utility (vdsm-tool). To perform full reconfiguration of external services perform: # vdsm-tool configure --force (for more information read "vdsm-tool --help") 7 Finally start the vdsmd service # service vdsmd start 8 Yum install -y bridge-utils Configuring the bridge Interface as below Disable the network manager service by executing as root: systemctl stop NetworkManager.service systemctl disable NetworkManager.service service network start chkconfig network on Add the following content into a new file named: */etc/sysconfig/network-scripts/ifcfg-ovirtmgmt*: DEVICE=ovirtmgmt TYPE=Bridge ONBOOT=yes DELAY=0 BOOTPROTO=static IPADDR=10.1.8.252 NETMASK=255.255.255.0 GATEWAY=10.1.8.254 Add the following line into the configuration file of your out going interface (usually em1/eth0) the file is located at: */etc/sysconfig/network-scripts/ifcfg-em1* (assuming the device is em1) BRIDGE=ovirtmgmt and remove the IPADDR, NETMASK and BOOTPROTO keys, since the interface should not have an IP address of its own. Full Example DEVICE=em1 ONBOOT=yes BRIDGE=ovirtmgmt Restart the network service by executing: service network restart *Note that if any other bridge (from ovirtmgmt) is present at the time of host installation, the bridge creation operation is skipped and you have to change the bridge settings to correspond to above shown configuration manually.* *9 Configuring VDSM* Add the following content into the file: */etc/vdsm/vdsm.conf* (you may need to create that file): [vars] ssl = false Restart the vdsmd service by executing: service vdsmd restart If Vdsm was started earlier with ssl=true, it would refuse to start and you may need to use the undocumented verb service vdsmd reconfigure service vdsmd start which edits */etc/libvirt/qemu.conf* and changes *spice_tls=1* to *spice_tls=0*. 10 Connect to overt-engine *ref: OVirt_-_connecting_development_vdsm_to_ovirt_engine <http://www.ovirt.org/OVirt_-_connecting_development_vdsm_to_ovirt_engine>.* *su - postgres -c "psql engine -c \"UPDATE vdc_options set option_value = 'true' where option_name = 'InstallVds'\""* *service overt-engine restart* 11 Attach the host to the engine I login the engine Administration Portal , and attach the centos host to a cluster. But it failed.

2 1

Re: [ovirt-devel] ovirt-engine-3.5 branching
by Oved Ourfali 03 Jul '14

03 Jul '14

On Jul 3, 2014 8:27 PM, Antoni Segura Puimedon <asegurap(a)redhat.com> wrote: > > > > ----- Original Message ----- > > From: "Allon Mureinik" <amureini(a)redhat.com> > > To: "Oved Ourfali" <ovedo(a)redhat.com> > > Cc: "Piotr Kliczewski" <pkliczew(a)redhat.com>, devel(a)ovirt.org > > Sent: Thursday, July 3, 2014 4:57:55 PM > > Subject: Re: [ovirt-devel] ovirt-engine-3.5 branching > > > > I concur. > > > > There are too many flows broken on /master/ to consider the 3.5 branch > > anything remotely near "stable". > > Wouldn't it be better to keep the current branch as "stabilization branch" > and test extensively every patch that goes into it instead of keeping adding > to the master branch and rebranch and then have the same or similar happen > in the next test day? > > If I remember correctly in the previous release cycle something similar happened > in the engine an teams tried to push non critical or stabilization patches > after feature freeze. At the time, it was argued that this release cycle it > would be branch and backport. > > I realize, of course, that it is painstaking to backport a great amount of > patches, but this is a direct result of letting features get merged too late > in the cycle and before being up to a certain standard of stability. > > I would say "let this backporting frenzy be a lesson to all to be more conservative > with the timelines in the next cycle" but I understand the other side of the > argument, so maybe instead we should just count with an extra week between > freeze and branching (note that this will delay review and merge of work > on master for the next feature reducing the chances of big features being > merged early-middle cycle. > I think that we all learn the lesson here, and we are just increasing the risk of having things not back ported due to human error, and by that reducing the stabilization... While we know that a lot was fixed. And also some bugs, and not just things that were added at the last minute. > > > > wrt to holding off 3.6 features, I can confirm that from the storage side > > nothing has been merged, and we can keep holding them back. > > > > > > -Allon > > > > ----- Original Message ----- > > > From: "Oved Ourfali" <ovedo(a)redhat.com> > > > To: devel(a)ovirt.org > > > Cc: "Piotr Kliczewski" <pkliczew(a)redhat.com> > > > Sent: Thursday, July 3, 2014 5:31:43 PM > > > Subject: [ovirt-devel] ovirt-engine-3.5 branching > > > > > > Hi all, > > > > > > The test day revealed a large amount of issues. These issues are being > > > addressed in the last few days. > > > To avoid the need to back-port each and every one of them to the > > > ovirt-engine-3.5 stable branch, I suggest to give a few days for that > > > effort, > > > and revisit it on mid next week, to asses it again and decide whether to do > > > the branching then. > > > > > > I ask the different maintainers not to push 3.6 relevant material into > > > master > > > in the next few days, until the branching is done. > > > To my knowledge no major (or any) patch related to 3.6 has been merge on > > > master, but please correct me if I'm wrong. > > > > > > Thanks all for your efforts in stabilizing the version. > > > > > > Regards, > > > Oved > > > _______________________________________________ > > > Devel mailing list > > > Devel(a)ovirt.org > > > http://lists.ovirt.org/mailman/listinfo/devel > > > > > _______________________________________________ > > Devel mailing list > > Devel(a)ovirt.org > > http://lists.ovirt.org/mailman/listinfo/devel > > > _______________________________________________ > Devel mailing list > Devel(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel

1 0