<div dir="ltr"><div><div><div>Hi Eli,<br><br></div>All nodes are the same in the cluster (fresh install): <br><br>[mpc-ovirt-node03 ~]# yum list installed *OVIRT* *VDSM* *FENCE*<br>Loaded plugins: fastestmirror, langpacks, priorities<br>Loading mirror speeds from cached hostfile<br> * base: <a href="http://centos.mirror.rafal.ca">centos.mirror.rafal.ca</a><br> * epel: <a href="http://fedora-epel.mirror.iweb.com">fedora-epel.mirror.iweb.com</a><br> * extras: <a href="http://less.cogeco.net">less.cogeco.net</a><br> * ovirt-3.5: <a href="http://resources.ovirt.org">resources.ovirt.org</a><br> * ovirt-3.5-epel: <a href="http://fedora-epel.mirror.iweb.com">fedora-epel.mirror.iweb.com</a><br> * rpmforge: <a href="http://repoforge.mirror.constant.com">repoforge.mirror.constant.com</a><br> * updates: <a href="http://centos.mirror.rafal.ca">centos.mirror.rafal.ca</a><br>183 packages excluded due to repository priority protections<br>Installed Packages<br>fence-agents-all.x86_64                                                                               4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-apc.x86_64                                                                               4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-apc-snmp.x86_64                                                                          4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-bladecenter.x86_64                                                                       4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-brocade.x86_64                                                                           4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-cisco-mds.x86_64                                                                         4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-cisco-ucs.x86_64                                                                         4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-common.x86_64                                                                            4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-drac5.x86_64                                                                             4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-eaton-snmp.x86_64                                                                        4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-eps.x86_64                                                                               4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-hpblade.x86_64                                                                           4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-ibmblade.x86_64                                                                          4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-ifmib.x86_64                                                                             4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-ilo-mp.x86_64                                                                            4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-ilo-ssh.x86_64                                                                           4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-ilo2.x86_64                                                                              4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-intelmodular.x86_64                                                                      4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-ipdu.x86_64                                                                              4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-ipmilan.x86_64                                                                           4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-kdump.x86_64                                                                             4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-rhevm.x86_64                                                                             4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-rsb.x86_64                                                                               4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-scsi.x86_64                                                                              4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-vmware-soap.x86_64                                                                       4.0.11-11.el7_1                                                                               @updates         <br>fence-agents-wti.x86_64                                                                               4.0.11-11.el7_1                                                                               @updates         <br>fence-virt.x86_64                                                                                     0.3.2-1.el7                                                                                   @base            <br>libgovirt.x86_64                                                                                      0.3.1-3.el7                                                                                   @base            <br>ovirt-engine-sdk-python.noarch                                                                        3.5.1.0-1.el7.centos                                                                          @ovirt-3.5       <br>ovirt-host-deploy.noarch                                                                              1.3.1-1.el7                                                                                   @ovirt-3.5       <br>ovirt-hosted-engine-ha.noarch                                                                         1.2.5-1.el7.centos                                                                            @ovirt-3.5       <br>ovirt-hosted-engine-setup.noarch                                                                      1.2.2-1.el7.centos                                                                            @ovirt-3.5       <br>ovirt-release35.noarch                                                                                002-1                                                                                         @/ovirt-release35<br>vdsm.x86_64                                                                                           4.16.10-8.gitc937927.el7                                                                      @ovirt-3.5       <br>vdsm-cli.noarch                                                                                       4.16.10-8.gitc937927.el7                                                                      @ovirt-3.5       <br>vdsm-gluster.noarch                                                                                   4.16.10-8.gitc937927.el7                                                                      @ovirt-3.5       <br>vdsm-jsonrpc.noarch                                                                                   4.16.10-8.gitc937927.el7                                                                      @ovirt-3.5       <br>vdsm-python.noarch                                                                                    4.16.10-8.gitc937927.el7                                                                      @ovirt-3.5       <br>vdsm-python-zombiereaper.noarch                                                                       4.16.10-8.gitc937927.el7                                                                      @ovirt-3.5       <br>vdsm-xmlrpc.noarch                                                                                    4.16.10-8.gitc937927.el7                                                                      @ovirt-3.5       <br>vdsm-yajsonrpc.noarch                                                                                 4.16.10-8.gitc937927.el7                                                                      @ovirt-3.5  <br><br></div>Cheers,<br></div>Mike<br><div><div><div><br></div></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On 22 April 2015 at 03:00, Eli Mesika <span dir="ltr">&lt;<a href="mailto:emesika@redhat.com" target="_blank">emesika@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5"><br>
<br>
----- Original Message -----<br>
&gt; From: &quot;Mike Lindsay&quot; &lt;<a href="mailto:mike.lindsay@cbc.ca">mike.lindsay@cbc.ca</a>&gt;<br>
&gt; To: <a href="mailto:users@ovirt.org">users@ovirt.org</a><br>
&gt; Sent: Tuesday, April 21, 2015 8:16:18 PM<br>
&gt; Subject: [ovirt-users] Options not being passed fence_ipmilan,        Ovirt3.5 on Centos 7.1 hosts<br>
&gt;<br>
&gt; Hi All,<br>
&gt;<br>
&gt; I have a bit of an issue with a new install of Ovirt 3.5 (our 3.4 cluster is<br>
&gt; working fine) in a 4 node cluster.<br>
&gt;<br>
&gt; When I test fencing (or cause a kernal panic triggering a fence) the fencing<br>
&gt; fails. On investigation it appears that the fencing options are not being<br>
&gt; passed to the fencing script (fence_ipmilan in this case):<br>
&gt;<br>
&gt; Fence options under GUI(as entered in the gui): lanplus, ipport=623,<br>
&gt; power_wait=4, privlvl=operator<br>
&gt;<br>
&gt; from vdsm.log on the fence proxy node:<br>
&gt;<br>
&gt; Thread-818296::DEBUG::2015-04-21 12:39:39,136::API::1209::vds::(fenceNode)<br>
&gt; fenceNode(addr=x.x.x.x,port=,agent=ipmilan,user=stonith,passwd=XXXX,action=status,secure=False,options=<br>
&gt; power_wait=4<br>
&gt; Thread-818296::DEBUG::2015-04-21 12:39:39,137::utils::739::root::(execCmd)<br>
&gt; /usr/sbin/fence_ipmilan (cwd None)<br>
&gt; Thread-818296::DEBUG::2015-04-21 12:39:39,295::utils::759::root::(execCmd)<br>
&gt; FAILED: &lt;err&gt; = &#39;Failed: Unable to obtain correct plug status or plug is not<br>
&gt; available\n\n\n&#39;; &lt;rc&gt; = 1<br>
&gt; Thread-818296::DEBUG::2015-04-21 12:39:39,296::API::1164::vds::(fence) rc 1<br>
&gt; inp agent=fence_ipmilan<br>
&gt; Thread-818296::DEBUG::2015-04-21 12:39:39,296::API::1235::vds::(fenceNode) rc<br>
&gt; 1 in agent=fence_ipmilan<br>
&gt; Thread-818296::DEBUG::2015-04-21<br>
&gt; 12:39:39,297::stompReactor::163::yajsonrpc.StompServer::(send) Sending<br>
&gt; response<br>
&gt;<br>
&gt;<br>
&gt; from engine.log on the engine:<br>
&gt; 2015-04-21 12:39:38,843 INFO<br>
&gt; [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]<br>
&gt; (ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null, Custom Event<br>
&gt; ID: -1, Message: Host mpc-ovirt-node03 from cluster Default was chosen as a<br>
&gt; proxy to execute Status command on Host mpc-ovirt-node04.<br>
&gt; 2015-04-21 12:39:38,845 INFO [org.ovirt.engine.core.bll.FenceExecutor]<br>
&gt; (ajp--127.0.0.1-8702-4) Using Host mpc-ovirt-node03 from cluster Default as<br>
&gt; proxy to execute Status command on Host<br>
&gt; 2015-04-21 12:39:38,885 INFO [org.ovirt.engine.core.bll.FenceExecutor]<br>
&gt; (ajp--127.0.0.1-8702-4) Executing &lt;Status&gt; Power Management command, Proxy<br>
&gt; Host:mpc-ovirt-node03, Agent:ipmilan, Target Host:, Management IP:x.x.x.x,<br>
&gt; User:stonith, Options: power_wait=4, ipport=623, privlvl=operator,lanplus,<br>
&gt; Fencing policy:null<br>
&gt; 2015-04-21 12:39:38,921 INFO<br>
&gt; [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand]<br>
&gt; (ajp--127.0.0.1-8702-4) START, FenceVdsVDSCommand(HostName =<br>
&gt; mpc-ovirt-node03, HostId = 5613a489-589d-4e89-ab01-3642795eedb8, targetVdsId<br>
&gt; = dbfa4e85-3e97-4324-b222-bf40a491db08, action = Status, ip = x.x.x.x, port<br>
&gt; = , type = ipmilan, user = stonith, password = ******, options = &#39;<br>
&gt; power_wait=4, ipport=623, privlvl=operator,lanplus&#39;, policy = &#39;null&#39;), log<br>
&gt; id: 774f328<br>
&gt; 2015-04-21 12:39:39,338 WARN<br>
&gt; [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]<br>
&gt; (ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null, Custom Event<br>
&gt; ID: -1, Message: Power Management test failed for Host mpc-ovirt-node04.Done<br>
&gt; 2015-04-21 12:39:39,339 INFO<br>
&gt; [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand]<br>
&gt; (ajp--127.0.0.1-8702-4) FINISH, FenceVdsVDSCommand, return: Test Succeeded,<br>
&gt; unknown, log id: 774f328<br>
&gt; 2015-04-21 12:39:39,340 WARN [org.ovirt.engine.core.bll.FenceExecutor]<br>
&gt; (ajp--127.0.0.1-8702-4) Fencing operation failed with proxy host<br>
&gt; 5613a489-589d-4e89-ab01-3642795eedb8, trying another proxy...<br>
&gt; 2015-04-21 12:39:39,594 INFO<br>
&gt; [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]<br>
&gt; (ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null, Custom Event<br>
&gt; ID: -1, Message: Host mpc-ovirt-node01 from cluster Default was chosen as a<br>
&gt; proxy to execute Status command on Host mpc-ovirt-node04.<br>
&gt; 2015-04-21 12:39:39,595 INFO [org.ovirt.engine.core.bll.FenceExecutor]<br>
&gt; (ajp--127.0.0.1-8702-4) Using Host mpc-ovirt-node01 from cluster Default as<br>
&gt; proxy to execute Status command on Host<br>
&gt; 2015-04-21 12:39:39,598 INFO [org.ovirt.engine.core.bll.FenceExecutor]<br>
&gt; (ajp--127.0.0.1-8702-4) Executing &lt;Status&gt; Power Management command, Proxy<br>
&gt; Host:mpc-ovirt-node01, Agent:ipmilan, Target Host:, Management IP:x.x.x.x,<br>
&gt; User:stonith, Options: power_wait=4, ipport=623, privlvl=operator,lanplus,<br>
&gt; Fencing policy:null<br>
&gt; 2015-04-21 12:39:39,634 INFO<br>
&gt; [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand]<br>
&gt; (ajp--127.0.0.1-8702-4) START, FenceVdsVDSCommand(HostName =<br>
&gt; mpc-ovirt-node01, HostId = c3e8be6e-ac54-4861-b774-17ba5cc66dc6, targetVdsId<br>
&gt; = dbfa4e85-3e97-4324-b222-bf40a491db08, action = Status, ip = x.x.x.x, port<br>
&gt; = , type = ipmilan, user = stonith, password = ******, options = &#39;<br>
&gt; power_wait=4, ipport=623, privlvl=operator,lanplus&#39;, policy = &#39;null&#39;), log<br>
&gt; id: 6369eb1<br>
&gt; 2015-04-21 12:39:40,056 WARN<br>
&gt; [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]<br>
&gt; (ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null, Custom Event<br>
&gt; ID: -1, Message: Power Management test failed for Host mpc-ovirt-node04.Done<br>
&gt; 2015-04-21 12:39:40,057 INFO<br>
&gt; [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand]<br>
&gt; (ajp--127.0.0.1-8702-4) FINISH, FenceVdsVDSCommand, return: Test Succeeded,<br>
&gt; unknown, log id: 6369eb1<br>
&gt;<br>
&gt;<br>
&gt; For verification I temporarily replaced /usr/sbin/fence_ipmilan with a shell<br>
&gt; script that dumps the env plus any cli args passed into a log file:<br>
&gt;<br>
&gt; -------------------------- Tue Apr 21 12:39:39 EDT 2015<br>
&gt; ----------------------------<br>
&gt; ENV DUMP:<br>
&gt; LC_ALL=C<br>
&gt; USER=vdsm<br>
&gt; PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin<br>
&gt; PWD=/<br>
&gt; LANG=en_CA.UTF-8<br>
&gt; LIBVIRT_LOG_FILTERS=<br>
&gt; SHLVL=1<br>
&gt; HOME=/var/lib/vdsm<br>
&gt; LOGNAME=vdsm<br>
&gt; LIBVIRT_LOG_OUTPUTS=<br>
&gt; _=/usr/bin/env<br>
&gt;<br>
&gt; ------------------------------<br>
&gt; CLI DUMP:<br>
&gt;<br>
&gt; &lt;this is where the cli args should be listed&gt;<br>
&gt;<br>
&gt;<br>
&gt; Version info:<br>
&gt; libvirt version: 1.2.8, package: 16.el7_1.2 (CentOS BuildSystem &lt;<br>
&gt; <a href="http://bugs.centos.org" target="_blank">http://bugs.centos.org</a> &gt;, <a href="tel:2015-03-26-23" value="+12015032623">2015-03-26-23</a>:17:42, <a href="http://worker1.bsys.centos.org" target="_blank">worker1.bsys.centos.org</a> )<br>
&gt; fence_ipmilan: 4.0.11 (built Mon Apr 13 13:22:18 UTC 2015)<br>
&gt; vdsm.x86_64: 4.16.10-8.gitc937927.el7<br>
&gt; ovirt-engine.noarch: 3.5.1.1-1.el6<br>
&gt;<br>
&gt; Engine os: Centos 6.6<br>
&gt; Host os: Centos 7.1.1503<br>
&gt;<br>
&gt; I&#39;ve found some old post from 2012 that describe the same problem. Has anyone<br>
&gt; else run into this?<br>
&gt;<br>
&gt; Any thought or suggestions would be appreciated.<br>
<br>
</div></div>Hi Mike<br>
<br>
Seems from the logs above that the oVirt engine got the options correctly but somehow it is ignored by VDSM<br>
Can you please share installed VDSM RPM version on the host that served as a proxy for this operation<br>
Please also provide the cluster version of the cluster that contains the proxy host as well<br>
<br>
Thanks<br>
<br>
Eli<br>
<br>
<br>
<br>
&gt;<br>
&gt; Cheers,<br>
&gt; Mike<br>
&gt;<br>
&gt; _______________________________________________<br>
&gt; Users mailing list<br>
&gt; <a href="mailto:Users@ovirt.org">Users@ovirt.org</a><br>
&gt; <a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
&gt;<br>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature">


<div style="MARGIN:4px 4px 1px;FONT:10pt Microsoft Sans Serif">
<div><strong><font face="Terminal">Mike Lindsay</font></strong></div>
<div><font face="Terminal">Senior Systems Administrator</font></div>
<div><font face="Terminal" size="1"><em>Technological Maintenance and Support</em></font></div>
<div><em><font face="Terminal" size="1">CBC/SRC</font></em></div>
<div><a href="mailto:mike.lindsay@cbc.ca" target="_blank"><font face="Terminal">mike.lindsay@cbc.ca</font></a></div>
<div><font face="Terminal">(o) 416-205-8992</font></div>
<div><font face="Terminal">(c) 416-819-2841</font></div></div></div>
</div>