- Users - oVirt List Archives

Options not being passed fence_ipmilan, Ovirt3.5 on Centos 7.1 hosts
by Mike Lindsay 22 Apr '15

22 Apr '15

Hi All, I have a bit of an issue with a new install of Ovirt 3.5 (our 3.4 cluster is working fine) in a 4 node cluster. When I test fencing (or cause a kernal panic triggering a fence) the fencing fails. On investigation it appears that the fencing options are not being passed to the fencing script (fence_ipmilan in this case): Fence options under GUI(as entered in the gui): lanplus, ipport=623, power_wait=4, privlvl=operator from vdsm.log on the fence proxy node: Thread-818296::DEBUG::2015-04-21 12:39:39,136::API::1209::vds::(fenceNode) fenceNode(addr=x.x.x.x,port=,agent=ipmilan,user=stonith,passwd=XXXX,action=status,secure=False,options= power_wait=4 Thread-818296::DEBUG::2015-04-21 12:39:39,137::utils::739::root::(execCmd) /usr/sbin/fence_ipmilan (cwd None) Thread-818296::DEBUG::2015-04-21 12:39:39,295::utils::759::root::(execCmd) FAILED: <err> = 'Failed: Unable to obtain correct plug status or plug is not available\n\n\n'; <rc> = 1 Thread-818296::DEBUG::2015-04-21 12:39:39,296::API::1164::vds::(fence) rc 1 inp agent=fence_ipmilan Thread-818296::DEBUG::2015-04-21 12:39:39,296::API::1235::vds::(fenceNode) rc 1 in agent=fence_ipmilan Thread-818296::DEBUG::2015-04-21 12:39:39,297::stompReactor::163::yajsonrpc.StompServer::(send) Sending response from engine.log on the engine: 2015-04-21 12:39:38,843 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host mpc-ovirt-node03 from cluster Default was chosen as a proxy to execute Status command on Host mpc-ovirt-node04. 2015-04-21 12:39:38,845 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-4) Using Host mpc-ovirt-node03 from cluster Default as proxy to execute Status command on Host 2015-04-21 12:39:38,885 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-4) Executing <Status> Power Management command, Proxy Host:mpc-ovirt-node03, Agent:ipmilan, Target Host:, Management IP:x.x.x.x, User:stonith, Options: power_wait=4, ipport=623, privlvl=operator,lanplus, Fencing policy:null 2015-04-21 12:39:38,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-4) START, FenceVdsVDSCommand(HostName = mpc-ovirt-node03, HostId = 5613a489-589d-4e89-ab01-3642795eedb8, targetVdsId = dbfa4e85-3e97-4324-b222-bf40a491db08, action = Status, ip = x.x.x.x, port = , type = ipmilan, user = stonith, password = ******, options = ' power_wait=4, ipport=623, privlvl=operator,lanplus', policy = 'null'), log id: 774f328 2015-04-21 12:39:39,338 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Power Management test failed for Host mpc-ovirt-node04.Done 2015-04-21 12:39:39,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-4) FINISH, FenceVdsVDSCommand, return: Test Succeeded, unknown, log id: 774f328 2015-04-21 12:39:39,340 WARN [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-4) Fencing operation failed with proxy host 5613a489-589d-4e89-ab01-3642795eedb8, trying another proxy... 2015-04-21 12:39:39,594 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host mpc-ovirt-node01 from cluster Default was chosen as a proxy to execute Status command on Host mpc-ovirt-node04. 2015-04-21 12:39:39,595 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-4) Using Host mpc-ovirt-node01 from cluster Default as proxy to execute Status command on Host 2015-04-21 12:39:39,598 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-4) Executing <Status> Power Management command, Proxy Host:mpc-ovirt-node01, Agent:ipmilan, Target Host:, Management IP:x.x.x.x, User:stonith, Options: power_wait=4, ipport=623, privlvl=operator,lanplus, Fencing policy:null 2015-04-21 12:39:39,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-4) START, FenceVdsVDSCommand(HostName = mpc-ovirt-node01, HostId = c3e8be6e-ac54-4861-b774-17ba5cc66dc6, targetVdsId = dbfa4e85-3e97-4324-b222-bf40a491db08, action = Status, ip = x.x.x.x, port = , type = ipmilan, user = stonith, password = ******, options = ' power_wait=4, ipport=623, privlvl=operator,lanplus', policy = 'null'), log id: 6369eb1 2015-04-21 12:39:40,056 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Power Management test failed for Host mpc-ovirt-node04.Done 2015-04-21 12:39:40,057 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-4) FINISH, FenceVdsVDSCommand, return: Test Succeeded, unknown, log id: 6369eb1 For verification I temporarily replaced /usr/sbin/fence_ipmilan with a shell script that dumps the env plus any cli args passed into a log file: -------------------------- Tue Apr 21 12:39:39 EDT 2015 ---------------------------- ENV DUMP: LC_ALL=C USER=vdsm PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin PWD=/ LANG=en_CA.UTF-8 LIBVIRT_LOG_FILTERS= SHLVL=1 HOME=/var/lib/vdsm LOGNAME=vdsm LIBVIRT_LOG_OUTPUTS= _=/usr/bin/env ------------------------------ CLI DUMP: <this is where the cli args should be listed> Version info: libvirt version: 1.2.8, package: 16.el7_1.2 (CentOS BuildSystem < http://bugs.centos.org>, 2015-03-26-23:17:42, worker1.bsys.centos.org) fence_ipmilan: 4.0.11 (built Mon Apr 13 13:22:18 UTC 2015) vdsm.x86_64: 4.16.10-8.gitc937927.el7 ovirt-engine.noarch: 3.5.1.1-1.el6 Engine os: Centos 6.6 Host os: Centos 7.1.1503 I've found some old post from 2012 that describe the same problem. Has anyone else run into this? Any thought or suggestions would be appreciated. Cheers, Mike

2 2

Is it possible to limit the number and speed of paralel STORAGE migrations?
by Ernest Beinrohr 22 Apr '15

22 Apr '15

This is a multi-part message in MIME format. --------------000203080307020305010009 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Ovirt uses dd and qemu-img for live migration. Is it possible to limit the number of concurrent live storage moves or limit the bandwidth used? I'd like to move about 30 disks to another storage during the night, but each takes about 30 minutes each and if more than one runs, it chokes my storage. -- Ernest Beinrohr, AXON PRO Ing <http://www.beinrohr.sk/ing.php>, RHCE <http://www.beinrohr.sk/rhce.php>, RHCVA <http://www.beinrohr.sk/rhce.php>, LPIC <http://www.beinrohr.sk/lpic.php>, VCA <http://www.beinrohr.sk/vca.php>, +421-2-62410360 +421-903-482603 --------------000203080307020305010009 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> Ovirt uses dd and qemu-img for live migration. Is it possible to limit the number of concurrent live storage moves or limit the bandwidth used?<br> <br> <br> I'd like to move about 30 disks to another storage during the night, but each takes about 30 minutes each and if more than one runs, it chokes my storage. <br> <br> <div class="moz-signature">-- <br> <div id="oernii_footer" style="color: gray;"> <span style="font-family: Lucida Console, Luxi Mono, Courier, monospace; font-size: 90%;"> Ernest Beinrohr, AXON PRO<br> <a style="text-decoration: none; color: gray;" href="http://www.beinrohr.sk/ing.php">Ing</a>, <a style="text-decoration: none; color: gray;" href="http://www.beinrohr.sk/rhce.php">RHCE</a>, <a style="text-decoration: none; color: gray;" href="http://www.beinrohr.sk/rhce.php">RHCVA</a>, <a style="text-decoration: none; color: gray;" href="http://www.beinrohr.sk/lpic.php">LPIC</a>, <a style="text-decoration: none; color: gray;" href="http://www.beinrohr.sk/vca.php">VCA</a>, <br> +421-2-62410360 +421-903-482603 <br> </span> </div> <img src="http://nojsstats.appspot.com/UA-44497096-1/email.beinrohr.sk" moz-do-not-send="true" border="0" width="1" height="1"> </div> </body> </html> --------------000203080307020305010009--

3 4

oVirt 3.5 problem with gluster, can't set the group and can't find ovirt packages
by Lars Nielsen 22 Apr '15

22 Apr '15

Hey again :) I have a problem with ovirt 3.5. I am trying to setup oVirt 3.5 and using gluster following this guide: http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/ However when I run the install command: yum install -y ovirt-hosted-engine-setup I get the output: No package overt-hosted-engine-setup available Error nothing to do. But I have run: yum localinstall -y http://resources.ovirt.org/pub/yum-repo/ovirt-release35.rpm I get no error, and I have checked the log files. And when I run this command: gluster volume set engine group virt I get this output: Unable to open file ‘/var/lib/glusterd/groups/virt’. Error: No such file or directory Hope some one can help. Thanks in advance - Lars Nielsen

3 5

[QE][ACTION REQUIRED] oVirt 3.5.2 and 3.5.3 status
by Sandro Bonazzola 22 Apr '15

22 Apr '15

Hi, We have no open blockers for 3.5.2[1] and no open dependencies. We still have 1 bug on QA[2]: MODIFIED ON_QA Total network 0 1 1 ACTION: Testers: you're welcome to verify bugs currently ON_QA. All remaining bugs not marked as blockers have been moved to 3.5.3. A release management entry has been added for tracking the schedule of 3.5.3[3] A bug tracker [4] has been created for 3.5.3 and currently shows no blockers. We have 27 bugs currently targeted to 3.5.3[5]: Whiteboard NEW ASSIGNED POST Total docs 1 0 0 1 external 1 0 0 1 gluster 1 0 0 1 infra 1 1 0 2 network 3 0 1 4 node 5 0 1 6 ppc 0 0 1 1 sla 4 0 0 4 storage 4 0 1 5 ux 0 0 1 1 virt 1 0 0 1 Total 21 1 5 27 ACTION: Maintainers / Assignee: to review the bugs targeted to 3.5.3 ensuring they're correctly targeted. ACTION: Maintainers: to fill release notes for 3.5.2, the page has been created and updated here [6] ACTION: Testers: please add yourself to the test page [7] [1] https://bugzilla.redhat.com/1186161 [2] http://goo.gl/UEVTCf [3] http://www.ovirt.org/OVirt_3.5.z_Release_Management#oVirt_3.5.3 [4] https://bugzilla.redhat.com/1198142 [5] https://bugzilla.redhat.com/buglist.cgi?quicksearch=product%3Aovirt%20targe… [6] http://www.ovirt.org/OVirt_3.5.2_Release_Notes [7] http://www.ovirt.org/Testing/oVirt_3.5.2_Testing -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

[ACTION NEEDED][QE] oVirt 3.6.0 status
by Sandro Bonazzola 22 Apr '15

22 Apr '15

Hi, here's an update on 3.6 status on integration / rel-eng side The tracker bug for 3.6.0 [1] currently shows no blockers. Repository closure is currently broken on Fedora 20 due to a missing required dependency on recent libvirt, a patch fixing this issue is currently under review[4]. VDSM builds for EL6 are no more available on master snapshot. ACTION: please review jenkins jobs relying on VDSM to be available on EL6. There are 521 bugs [2] targeted to 3.6.0. NEW ASSIGNED POST Total <unassigned> 1 0 0 1 docs 10 0 0 10 external 1 0 0 1 gluster 32 26 16 74 i18n 2 0 0 2 infra 53 5 7 65 integration 35 3 9 47 network 42 1 9 52 node 26 3 2 31 sla 45 3 2 50 spice 1 0 0 1 storage 67 7 6 80 ux 27 0 2 29 virt 60 6 9 75 Total 402 54 62 518 Features submission is now CLOSED as per current release schedule. ACTION: begin reviewing features tracked in the google doc[3] On Integration side: * Progress on Glance docker integration * Progress on backup / restore RFEs On Release engineering side: * CentOS Virt SIG: CBS tag hierarchy created * Fedora: pushed some dependencies for Fedora inclusion * Worked with infra team fixing jenkins issues ACTION: community members are welcome to join QE effort[5] by testing nightly master snapshot[6] on test systems [1] https://bugzilla.redhat.com/1155425 [2] https://bugzilla.redhat.com/buglist.cgi?quicksearch=target_release%3A3.6.0%… [3] http://goo.gl/9X3G49 [4] https://gerrit.ovirt.org/39249 [5] http://www.ovirt.org/OVirt_Quality_Assurance [6] http://www.ovirt.org/Install_nightly_snapshot -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

Nested KVM on AMD
by Winfried de Heiden 22 Apr '15

22 Apr '15

3 3

storage issue's with oVirt 3.5.1 + Nexenta NFS
by Maikel vd Mosselaar 22 Apr '15

22 Apr '15

Hi, We are running ovirt 3.5.1 with 3 nodes and seperate engine. All on CentOS 6.6: 3 x nodes 1 x engine 1 x storage nexenta with NFS For multiple weeks we are experiencing issues of our nodes that cannot access the storage at random moments (atleast thats what the nodes think). When the nodes are complaining about a unavailable storage then the load rises up to +200 on all three nodes, this causes that all running VMs are unaccessible. During this process oVirt event viewer shows some i/o storage error messages, when this happens random VMs get paused and will not be resumed anymore (this almost happens every time but not all the VMs get paused). During the event we tested the accessibility from the nodes to the storage and it looks like it is working normal, at least we can do a normal "ls" on the storage without any delay of showing the contents. We tried multiple things that we thought it causes this issue but nothing worked so far. * rebooting storage / nodes / engine. * disabling offsite rsync backups. * moved the biggest VMs with highest load to different platform outside of oVirt. * checked the wsize and rsize on the nfs mounts, storage and nodes are correct according to the "NFS troubleshooting page" on ovirt.org. The environment is running in production so we are not free to test everything. I can provide log files if needed. Kind Regards, Maikel

5 15

Move/Migrate Storage Domain to new devices
by Dael Maselli 22 Apr '15

22 Apr '15

Hi, I have a data storage domain that use one FC LUN. I need to move all data to a new storage server. I tried by move single disks to a new storage domain but some cannot be moved, I think because they are thin-cloned by template. When I worked with LVM I use to do a simple pvmove leaving the VG intact, is there something similar (online or in maintenance) in oVirt? Can I just do a pvmove from the SPM host o it's going to destroy everything? Thank you very much. Regards, Dael Maselli. -- ___________________________________________________________________ Dael Maselli --- INFN-LNF Computing Service -- +39.06.9403.2214 ___________________________________________________________________ * http://www.lnf.infn.it/~dmaselli/ * ___________________________________________________________________ Democracy is two wolves and a lamb voting on what to have for lunch ___________________________________________________________________

2 2

oVirt 3.6 new feature: NUMA aware KSM support
by David Maroshi 21 Apr '15

21 Apr '15

Greetings users and developers, Just put up a feature page for the "NUMA aware KSM support"; In summary, =========== The KSM service is optimizing shared memory pages across all NUMA nodes. The consequences is: a shared memory pages (controlled by KSM) to be read from many CPUs across NUMA nodes. Hence degrading (could totally eliminate) the NUMA performance gain. The optimal behavior is for KSM feature to optimize memory usage per NUMA nodes. This feature is implemented in KSM since RHEL 6.5. We want to introduce a new feature to oVirt that will allow host administrator to control NUMA aware KSM policy. You're welcome to review the feature page: http://www.ovirt.org/NumaAwareKsmSupport The feature page is responding to RFE https://bugzilla.redhat.com/show_bug.cgi?id=840114 Your comments appreciated. Thanks Joy and happiness Dudi -- Dudi Maroshi Software Engineer Red Hat Enterprise Virtualization project http://www.redhat.com/en/technologies/virtualization maroshi(a)redhat.com -------------------------------- I am perfectly imperfect. "There is only one absolute truth, and that is: there in no one absolute truth."

1 0

Why my Over Allocation Ratio is negative??
by Arman Khalatyan 21 Apr '15

21 Apr '15

In my ovirt-GUI(Version 3.5.2-1.el6 prerelease) I can see following: Size: 20479 GB Available: 11180 GB Used: 9299 GB Allocated: 290 GB Over Allocation Ratio: -52% What does it mean?? My storage is iscsi with 20TB size. thanks, A. *********************************************************** Dr. Arman Khalatyan eScience -SuperComputing Leibniz-Institut für Astrophysik Potsdam (AIP) An der Sternwarte 16, 14482 Potsdam, Germany ***********************************************************

2 1