[ovirt-users] Fencing errors on oVirt Engine Version: 4.0.1 (SOLVED)

Thu Jul 28 09:50:14 UTC 2016

Hi Martin

Now you got it !

Executing: /usr/bin/ipmitool -I lan -H khk9dsk34-mgnt.ip.tdk.dk -U mgntuser -P [set] -p 623 -L ADMINISTRATOR chassis power status

1  Address lookup for khk9dsk34-mgnt.ip.tdk.dk failed
Address lookup for khk9dsk34-mgnt.ip.tdk.dk failed
Address lookup for khk9dsk34-mgnt.ip.tdk.dk failed
Unable to get Chassis Power Status

DNS was defined under installation, but both hosts has been rebooted, and now /etc/resolv.conf is empty
After I redefined nameservers in /etc/resolv.conf it works

Executing: /usr/bin/ipmitool -I lan -H khk9dsk34-mgnt.ip.tdk.dk -U mgntuser -P [set] -p 623 -L ADMINISTRATOR chassis power status
0 Chassis Power is on

I have seen this problem earlier. - After reboot /etc/resolv.conf is empty !!

Thank you for your help

Peter Calum
TDC

Fra: Martin Perina [mailto:mperina at redhat.com]
Sendt: 28. juli 2016 11:08
Til: Peter Michael Calum <pemca at tdc.dk>
Cc: users at ovirt.org; Eli Mesika <emesika at redhat.com>
Emne: Re: [ovirt-users] Fencing errors on oVirt Engine Version: 4.0.1

Hi Peter,
see my inline responses:

On Thu, Jul 28, 2016 at 9:32 AM, Peter Michael Calum <pemca at tdc.dk<mailto:pemca at tdc.dk>> wrote:
Hi Martin

I see no firewall issues.

I have made some more tests :

RHEV  3.6 host khk9dsk30  test to khk9dsk34 & khk9dsk35 - OK
RHEV  3.6 host khk9dsk31  test to khk9dsk34 & khk9dsk35 - OK
RHEV  3.5 host khk9dsk32  test to khk9dsk34 & khk9dsk35 - OK
RHEV  3.5 host khk9dsk33  test to khk9dsk34 & khk9dsk35 – OK
OVIRT 4.01 host

khk9dsk34  test to khk9dsk34 & khk9dsk35 – FAIL
OVIRT 4.01 host khk9dsk35  test to khk9dsk34 & khk9dsk35 – FAIL
OVIRT 4.01 host khk9dsk34  test to khk9dsk30 & khk9dsk31 – FAIL

Could you check in the code  that ipmilan sends on port udp 623 ?

Yes, this is the default port

All hosts are on same VLAN
[root at khk9dsk31 ~]# fence_ipmilan -a khk9dsk35-mgnt.ip.tdk.dk<http://khk9dsk35-mgnt.ip.tdk.dk> -l mgntuser –p xxxxxxxx -o status
Status: ON
[root at khk9dsk31 ~]# fence_ipmilan -a khk9dsk34-mgnt.ip.tdk.dk<http://khk9dsk34-mgnt.ip.tdk.dk> -l mgntuser -p xxxxxxxx -o status
Status: ON
[root at khk9dsk35 ~]# fence_ipmilan -a khk9dsk33-mgnt.ip.tdk.dk<http://khk9dsk33-mgnt.ip.tdk.dk> -l mgntuser -p xxxxxxxx -o status
Failed: Unable to obtain correct plug status or plug is not available

[root at khk9dsk35 ~]# fence_ipmilan -a khk9dsk30-mgnt.ip.tdk.dk<http://khk9dsk30-mgnt.ip.tdk.dk> -l mgntuser -p xxxxxxxx -o status
Failed: Unable to obtain correct plug status or plug is not available

[root at khk9dsk35 ~]# fence_ipmilan -a khk9dsk34-mgnt.ip.tdk.dk<http://khk9dsk34-mgnt.ip.tdk.dk> -l mgntuser -p xxxxxxxx -o status
Failed: Unable to obtain correct plug status or plug is not available

From the above I can say that there are some networking issues on host 

khk9dsk35, you said that firewall is OK, so are IPMI hostnames resolvable?
Please also try to execute above with '-v' as we may get a bit more info about the issue.

[root@

khk9dsk35 ~]# fence_ipmilan -a khk9dsk35-mgnt.ip.tdk.dk<http://khk9dsk35-mgnt.ip.tdk.dk> -l mgntuser -p xxxxxxxx -o status
Failed: Unable to obtain correct plug status or plug is not available

This is normal, you are usually not able to connect to IPMI port of the host from the host

Thanks
Martin Perina

Br,
Peter Calum
Fra: users-bounces at ovirt.org<mailto:users-bounces at ovirt.org> [mailto:users-bounces at ovirt.org<mailto:users-bounces at ovirt.org>] På vegne af Peter Michael Calum
Sendt: 27. juli 2016 21:30
Til: Martin Perina <mperina at redhat.com<mailto:mperina at redhat.com>>
Cc: users at ovirt.org<mailto:users at ovirt.org>
Emne: [Phish] - Re: [ovirt-users] Fencing errors on oVirt Engine Version: 4.0.1

Hi Martin
I was wondering if this could be a firewall problem. We have recently introduced new fw rules, and I have not tested fencing on the 2 hypervisors before I switched them to ovirt 4, but there was no alarm in the old setup before I switched. - I will investigate this further to be sure, and will return.
Thanks for your help
/Peter

Fra: Martin Perina [mailto:mperina at redhat.com]
Sendt: 27. juli 2016 20:19
Til: Peter Michael Calum <pemca at tdc.dk<mailto:pemca at tdc.dk>>
Cc: users at ovirt.org<mailto:users at ovirt.org>; Eli Mesika <emesika at redhat.com<mailto:emesika at redhat.com>>
Emne: Re: [ovirt-users] Fencing errors on oVirt Engine Version: 4.0.1

Hmm, it's really strange that this is working on 3.6 and not on 4.0, I don't see any obvious error, so we need to find out what are correct parameters for your fencing device.
The easiest way is to execute fence_ipmilan, according to vdsm.log following are your current options:
fence_ipmilan -a khk9dsk35-mgnt.ip.tdk.dk<http://khk9dsk35-mgnt.ip.tdk.dk> -l mgntuser -p <PASSWORD> -o status
Does the above works if it's execute from khk9dsk34-mgnt.ip.tdk.dk<http://khk9dsk34-mgnt.ip.tdk.dk>? Btw is username correct? Shouldn't be there 'mgmtuser'?
If all of above is correct and you are still not able to get power status, here are options you could try:
-v
--lanplus
-4
Martin Perina

On Wed, Jul 27, 2016 at 5:07 PM, Peter Michael Calum <pemca at tdc.dk<mailto:pemca at tdc.dk>> wrote:
Hi,

Thank you for answering.

Here is the logs, one from each node.
I see the test from khk9dsk34 goes over khk9dsk35 and vice versa.

Same setup as on my redhat 3.6 setup, and no custom options.

Thanks
Peter

Fra: Martin Perina [mailto:mperina at redhat.com<mailto:mperina at redhat.com>]
Sendt: 27. juli 2016 11:56
Til: Peter Michael Calum <pemca at tdc.dk<mailto:pemca at tdc.dk>>
Cc: users at ovirt.org<http://ovirt.org>; Eli Mesika <emesika at redhat.com<mailto:emesika at redhat.com>>
Emne: Re: [ovirt-users] Fencing errors on oVirt Engine Version: 4.0.1

Hi Peter,
could you please share with us vdsm.log from the host that was used as fence proxy (the one that actually executed fence_ipmi agent)?
Also could you please check that fence agent options are the same as on 3.6 setup? Do you any any custom options for this specific agent?
Thanks
Martin

On Wed, Jul 27, 2016 at 8:34 AM, Peter Michael Calum <pemca at tdc.dk<mailto:pemca at tdc.dk>> wrote:
Hi
I’m testing on Ovirt 4.01 and got errors when testing fencing on the hosts
I use IBM x3550M4 as host and ipmilan as fence agent.

I get this error when testing.
 [Failed: Unable to obtain correct plug status or plug is not available, , ]

I also have a 3.6 setup and there it works.

Ovirt Node 4.02
oVirt Engine Version: 4.0.1.1-1.el7.centos

Is this list the correct way to report errors ?

Venlig hilsen / Kind regards
Peter Calum
TDC, Denmark

_______________________________________________
Users mailing list
Users at ovirt.org<mailto:Users at ovirt.org>
http://lists.ovirt.org/mailman/listinfo/users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20160728/22b1d198/attachment-0001.html>