[ovirt-users] AIO setup problem with master failes due to nfs

Gianluca Cecchi gianluca.cecchi at gmail.com
Wed Aug 20 07:06:02 UTC 2014


Hello,
using this on CentOS 6.5 to configure AIO with ita branch for translation,
updated at 1608

[root at ovirtita ~]# rpm -qa|egrep "engine|vdsm|ovirt"
vdsm-xmlrpc-4.16.0-206.gitdd70c9e.el6.noarch
ovirt-engine-websocket-proxy-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
vdsm-yajsonrpc-4.16.0-206.gitdd70c9e.el6.noarch
ovirt-engine-jboss-as-7.1.1-1.el6.x86_64
ovirt-engine-restapi-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
vdsm-jsonrpc-4.16.0-206.gitdd70c9e.el6.noarch
ovirt-release-master-001-0.0.master.noarch
ovirt-engine-lib-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-engine-extensions-api-impl-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-engine-setup-plugin-ovirt-engine-common-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-engine-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-host-deploy-1.3.0-0.0.master.20140811115624.git89155f8.el6.noarch
ovirt-image-uploader-3.6.0-0.0.master.20140808125503.git066ed25.el6.noarch
ovirt-engine-setup-base-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
vdsm-jsonrpc-java-1.0.1-0.0.master.20140812113145.git7d15fda.el6.noarch
ovirt-host-deploy-java-1.3.0-0.0.master.20140811115624.git89155f8.el6.noarch
ovirt-engine-userportal-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-engine-setup-plugin-ovirt-engine-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-engine-backend-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-host-deploy-offline-1.3.0-0.0.master.20140811115624.git89155f8.el6.x86_64
ovirt-iso-uploader-3.6.0-0.0.master.20140812133505.gita6b721e.el6.noarch
vdsm-python-4.16.0-206.gitdd70c9e.el6.noarch
ovirt-engine-setup-plugin-websocket-proxy-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-engine-cli-3.6.0.0-1.20140718.gite0c7d55.el6.noarch
ovirt-engine-dbscripts-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-engine-tools-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-engine-setup-plugin-allinone-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-engine-sdk-python-3.6.0.0-1.20140811.git56f9da6.el6.noarch
vdsm-python-zombiereaper-4.16.0-206.gitdd70c9e.el6.noarch
ovirt-engine-webadmin-portal-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
ovirt-engine-extensions-api-impl-javadoc-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
vdsm-cli-4.16.0-206.gitdd70c9e.el6.noarch
ovirt-engine-setup-3.6.0-0.0.master.20140816103500.gitb920a2d.el6.noarch
vdsm-4.16.0-206.gitdd70c9e.el6.x86_64


SELinux is set to permissive, iptables and ip6tables are stopped and set to
off.
In setup I say not to configure firewall.
It aborts at nfs share stage with

[ INFO  ] Restarting nfs services
[ ERROR ] Failed to execute stage 'Closing up': [Errno 111] Connection
refused
[ INFO  ] Stage: Clean up
          Log file is located at
/var/log/ovirt-engine/setup/ovirt-engine-setup-20140820084635-z4gm0h.log
[ INFO  ] Generating answer file
'/var/lib/ovirt-engine/setup/answers/20140820084948-setup.conf'
[ INFO  ] Stage: Pre-termination
[ INFO  ] Stage: Termination
[ ERROR ] Execution of setup failed

NOTE: I set to "enabled=0" the rows
in /etc/yum.repos.d/ovirt-master-snapshot.repo so that I'm not forced to
update engine-setup itself or other packages.

Whole output:
[root at ovirtita ~]# engine-setup
[ INFO  ] Stage: Initializing
[ INFO  ] Stage: Environment setup
          Configuration files:
['/etc/ovirt-engine-setup.conf.d/10-packaging-aio.conf',
'/etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf',
'/etc/ovirt-engine-setup.conf.d/10-packaging.conf']
          Log file:
/var/log/ovirt-engine/setup/ovirt-engine-setup-20140820084635-z4gm0h.log
          Version: otopi-1.3.0_master
(otopi-1.3.0-0.0.master.20140728.git336a22e.el6)
[ INFO  ] Hardware supports virtualization
[ INFO  ] Stage: Environment packages setup
[ INFO  ] Stage: Programs detection
[ INFO  ] Stage: Environment setup
[ INFO  ] Stage: Environment customization

          --== PRODUCT OPTIONS ==--

          Configure Engine on this host (Yes, No) [Yes]:
          Configure WebSocket Proxy on this host (Yes, No) [Yes]:

          --== PACKAGES ==--

[ INFO  ] Checking for product updates...
[ INFO  ] No product updates found

          --== ALL IN ONE CONFIGURATION ==--

          Configure VDSM on this host? (Yes, No) [No]: Yes
          Local storage domain path [/var/lib/images]:
          Local storage domain name [local_storage]:

          --== NETWORK CONFIGURATION ==--

          Setup can automatically configure the firewall on this system.
          Note: automatic configuration of the firewall may overwrite
current settings.
          Do you want Setup to configure the firewall? (Yes, No) [Yes]: No
          Host fully qualified DNS name of this server
[ovirtita.localdomain.local]:
[WARNING] Failed to resolve ovirtita.localdomain.local using DNS, it can be
resolved only locally

          --== DATABASE CONFIGURATION ==--

          Where is the Engine database located? (Local, Remote) [Local]:
          Setup can configure the local postgresql server automatically for
the engine to run. This may conflict with existing applications.
          Would you like Setup to automatically configure postgresql and
create Engine database, or prefer to perform that manually? (Automatic,
Manual) [Automatic]:

          --== OVIRT ENGINE CONFIGURATION ==--

          Engine admin password:
          Confirm engine admin password:
[WARNING] Password is weak: it is based on a dictionary word
          Use weak password? (Yes, No) [No]: Yes
          Application mode (Both, Virt, Gluster) [Both]:
          Default storage type: (NFS, FC, ISCSI, POSIXFS, GLUSTERFS) [NFS]:

          --== PKI CONFIGURATION ==--

          Organization name for certificate [localdomain.local]:

          --== APACHE CONFIGURATION ==--

          Setup can configure the default page of the web server to present
the application home page. This may conflict with existing applications.
          Do you wish to set the application as the default page of the web
server? (Yes, No) [Yes]:
          Setup can configure apache to use SSL using a certificate issued
from the internal CA.
          Do you wish Setup to configure that, or prefer to perform that
manually? (Automatic, Manual) [Automatic]:

          --== SYSTEM CONFIGURATION ==--

          Configure an NFS share on this server to be used as an ISO
Domain? (Yes, No) [Yes]:
          Local ISO domain path [/var/lib/exports/iso]:
          Local ISO domain ACL - note that the default will restrict access
to ovirtita.localdomain.local only, for security reasons
[ovirtita.localdomain.local(rw)]:
          Local ISO domain name [ISO_DOMAIN]:

          --== MISC CONFIGURATION ==--


          --== END OF CONFIGURATION ==--

[ INFO  ] Stage: Setup validation
[WARNING] Less than 16384MB of memory is available

          --== CONFIGURATION PREVIEW ==--

          Application mode                        : both
          Update Firewall                         : False
          Host FQDN                               :
ovirtita.localdomain.local
          Datacenter storage type                 : nfs
          Engine database name                    : engine
          Engine database secured connection      : False
          Engine database host                    : localhost
          Engine database user name               : engine
          Engine database host name validation    : False
          Engine database port                    : 5432
          Engine installation                     : True
          NFS setup                               : True
          PKI organization                        : localdomain.local
          NFS mount point                         : /var/lib/exports/iso
          NFS export ACL                          :
ovirtita.localdomain.local(rw)
          Configure VDSM on this host             : True
          Local storage domain directory          : /var/lib/images
          Configure local Engine database         : True
          Set application as default page         : True
          Configure Apache SSL                    : True
          Configure WebSocket Proxy               : True

          Please confirm installation settings (OK, Cancel) [OK]:
[ INFO  ] Stage: Transaction setup
[ INFO  ] Stopping engine service
[ INFO  ] Stopping ovirt-fence-kdump-listener service
[ INFO  ] Stopping websocket-proxy service
[ INFO  ] Stage: Misc configuration
[ INFO  ] Stage: Package installation
[ INFO  ] Stage: Misc configuration
[ INFO  ] Initializing PostgreSQL
[ INFO  ] Creating PostgreSQL 'engine' database
[ INFO  ] Configuring PostgreSQL
[ INFO  ] Creating/refreshing Engine database schema
[ INFO  ] Creating CA
[ INFO  ] Configuring WebSocket Proxy
[ INFO  ] Generating post install configuration file
'/etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf'
[ INFO  ] Stage: Transaction commit
[ INFO  ] Stage: Closing up

          --== SUMMARY ==--

[WARNING] Less than 16384MB of memory is available
          SSH fingerprint: F9:B1:16:C1:85:72:1B:C5:3C:35:9E:45:A0:A2:4C:C3
          Internal CA
78:3E:BB:BD:9D:A3:AE:20:9E:7A:44:BB:01:1F:87:13:E4:7B:FE:7D
          Web access is enabled at:
              http://ovirtita.localdomain.local:80/ovirt-engine
              https://ovirtita.localdomain.local:443/ovirt-engine
          Please use the user "admin" and password specified in order to
login
          In order to configure firewalld, copy the files from
              /etc/ovirt-engine/firewalld to /etc/firewalld/services
              and execute the following commands:
              firewall-cmd -service ovirt-postgres
              firewall-cmd -service ovirt-https
              firewall-cmd -service ovirt-aio
              firewall-cmd -service ovirt-fence-kdump-listener
              firewall-cmd -service ovirt-websocket-proxy
              firewall-cmd -service ovirt-nfs
              firewall-cmd -service ovirt-http
          The following network ports should be opened:
              tcp:111
              tcp:2049
              tcp:32803
              tcp:443
              tcp:49152-49216
              tcp:5432
              tcp:5900-6923
              tcp:6100
              tcp:662
              tcp:80
              tcp:875
              tcp:892
              udp:111
              udp:32769
              udp:662
              udp:7410
              udp:875
              udp:892
          An example of the required configuration for iptables can be
found at:
              /etc/ovirt-engine/iptables.example

          --== END OF SUMMARY ==--

[ INFO  ] Starting engine service
[ INFO  ] Restarting httpd
[ INFO  ] Restarting nfs services
[ ERROR ] Failed to execute stage 'Closing up': [Errno 111] Connection
refused
[ INFO  ] Stage: Clean up
          Log file is located at
/var/log/ovirt-engine/setup/ovirt-engine-setup-20140820084635-z4gm0h.log
[ INFO  ] Generating answer file
'/var/lib/ovirt-engine/setup/answers/20140820084948-setup.conf'
[ INFO  ] Stage: Pre-termination
[ INFO  ] Stage: Termination
[ ERROR ] Execution of setup failed
[root at ovirtita ~]#

Do I miss any basic package? I installed this CentOS 6.5 server specifying
"basic server" in anaconda.

In mesages I have these lines during setup:
Aug 20 08:49:13 ovirtita dbus: avc:  received policyload notice (seqno=2)
Aug 20 08:49:13 ovirtita dbus: [system] Reloaded configuration
Aug 20 08:49:14 ovirtita dbus: avc:  received policyload notice (seqno=3)
Aug 20 08:49:14 ovirtita dbus: [system] Reloaded configuration
Aug 20 08:49:20 ovirtita dbus: avc:  received policyload notice (seqno=4)
Aug 20 08:49:20 ovirtita dbus: [system] Reloaded configuration
Aug 20 08:49:26 ovirtita dbus: avc:  received policyload notice (seqno=5)
Aug 20 08:49:26 ovirtita dbus: [system] Reloaded configuration
Aug 20 08:49:30 ovirtita kernel: RPC: Registered named UNIX socket
transport module.
Aug 20 08:49:30 ovirtita kernel: RPC: Registered udp transport module.
Aug 20 08:49:30 ovirtita kernel: RPC: Registered tcp transport module.
Aug 20 08:49:30 ovirtita kernel: RPC: Registered tcp NFSv4.1 backchannel
transport module.
Aug 20 08:49:31 ovirtita kernel: Installing knfsd (copyright (C) 1996
okir at monad.swb.de).
Aug 20 08:49:31 ovirtita rpc.mountd[12397]: Version 1.2.3 starting
Aug 20 08:49:31 ovirtita kernel: NFSD: Using /var/lib/nfs/v4recovery as the
NFSv4 state recovery directory
Aug 20 08:49:31 ovirtita kernel: NFSD: starting 90-second grace period

Now
[root at ovirtita ~]# exportfs -v
/var/lib/exports/iso
ovirtita.localdomain.local(rw,wdelay,root_squash,no_subtree_check)

And if I run a mount on the share on the server itself it succeeds...
[root at ovirtita ~]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/vg_ovirtita-lv_root
                       29G  3.6G   24G  14% /
tmpfs                 3.9G     0  3.9G   0% /dev/shm
/dev/sda1             485M   67M  393M  15% /boot

[root at ovirtita ~]# mkdir /tmp/p

[root at ovirtita ~]# mount ovirtita.localdomain.local:/var/lib/exports/iso
/tmp/p

[root at ovirtita ~]# df -h /tmp/p
Filesystem            Size  Used Avail Use% Mounted on
ovirtita.localdomain.local:/var/lib/exports/iso
                       29G  3.6G   24G  14% /tmp/p

Does it cause any problem the name resolution that is only local with
/etc/hosts and not with dns?
What should I put in this case for AIO when input requests:

           Local ISO domain ACL - note that the default will restrict
access to ovirtita.localdomain.local only, for security reasons
[ovirtita.localdomain.local(rw)]:

??

In setup log I have:

2014-08-20 08:49:48 DEBUG otopi.ovirt_engine_setup.engine_common.database
database.execute:214 Result: [{'version': 'general', 'option_value':
'3.0,3.1,3.2,3.3,3.4,3.5'}]
2014-08-20 08:49:48 DEBUG
otopi.plugins.ovirt_engine_setup.ovirt_engine.all-in-one.vdsmi
vdsmi._closeup:208 engine SupportedClusterLevels [3.0,3.1,3.2,3.3,3.4,3.5],
PACKAGE_VERSION [3.6.0_master],
2014-08-20 08:49:48 DEBUG otopi.context context._executeMethod:152 method
exception
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/otopi/context.py", line 142, in
_executeMethod
    method['method']()
  File
"/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/all-in-one/vdsmi.py",
line 212, in _closeup
    result = vdscli.connect().getVdsCapabilities()
  File "/usr/lib64/python2.6/xmlrpclib.py", line 1199, in __call__
    return self.__send(self.__name, args)
  File "/usr/lib64/python2.6/xmlrpclib.py", line 1489, in __request
    verbose=self.__verbose
  File "/usr/lib64/python2.6/xmlrpclib.py", line 1235, in request
    self.send_content(h, request_body)
  File "/usr/lib64/python2.6/xmlrpclib.py", line 1349, in send_content
    connection.endheaders()
  File "/usr/lib64/python2.6/httplib.py", line 908, in endheaders
    self._send_output()
  File "/usr/lib64/python2.6/httplib.py", line 780, in _send_output
    self.send(msg)
  File "/usr/lib64/python2.6/httplib.py", line 739, in send
    self.connect()
  File "/usr/lib64/python2.6/site-packages/vdsm/sslutils.py", line 181, in
connect
    sock = socket.create_connection((self.host, self.port), self.timeout)
  File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
    raise error, msg
error: [Errno 111] Connection refused
2014-08-20 08:49:48 ERROR otopi.context context._executeMethod:161 Failed
to execute stage 'Closing up': [Errno 111] Connection refused

What kind of mount test does engine-setup perform?

Full engine log here:
https://drive.google.com/file/d/0BwoPbcrMv8mvWkxEZllSNnFzRTg/edit?usp=sharing

Thanks,
Gianluca
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20140820/cbe802c5/attachment-0001.html>


More information about the Users mailing list