Creating /var/lib/glusterd/groups/virt on each node and adding parameters found here: https://access.redhat.com/site/documentation/en-US/Red_Hat_Storage/2.0/html/... solved this issue. Steve Dainard Infrastructure Manager Miovision Technologies Inc. Phone: 519-513-2407 x250 On Mon, Jul 1, 2013 at 4:54 PM, Steve Dainard <sdainard@miovision.com>wrote:
I'm using Ovirt nightly on Fedora 18 to determine if ovirt + gluster is something that will work for my organization (or at least when RHEV is released with this functionality). I'm attempting to use the nodes for both virt and gluster storage.
I've successfully created gluster bricks on two hosts, ovirt001 & ovirt002, and started volume vol1 through engine web ui. I've created a gluster storage domain, but cannot attach to data center.
*Engine UI error:* Failed to attach Storage Domains to Data Center Default. (User: admin@internal)
*Engine /var/log/ovirt-engine/engine.log errors:* 2013-07-01 16:29:02,650 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterServicesListVDSCommand] (pool-6-thread-49) Command GlusterServicesListVDS execution failed. Exception: VDSNetworkException: org.apache.xmlrpc.XmlRpcException: <type 'exceptions.Exception'>:method "glusterServicesGet" is not supported ****I've attached the much larger log file****
*Host /var/log/glusterfs/rhev-data-center-mnt-glusterSD-ovirt001\:vol1.log when attaching:* [2013-07-01 20:40:33.718871] I [afr-self-heal-data.c:655:afr_sh_data_fix] 0-vol1-replicate-0: no active sinks for performing self-heal on file /b2076340-84de-45ff-9d4b-d0d48b935fca/dom_md/ids [2013-07-01 20:40:33.721059] W [client-rpc-fops.c:873:client3_3_writev_cbk] 0-vol1-client-0: remote operation failed: Invalid argument [2013-07-01 20:40:33.721104] W [client-rpc-fops.c:873:client3_3_writev_cbk] 0-vol1-client-1: remote operation failed: Invalid argument [2013-07-01 20:40:33.721130] W [fuse-bridge.c:2127:fuse_writev_cbk] 0-glusterfs-fuse: 304: WRITE => -1 (Invalid argument)
*Engine repos:* [root@ovirt-manager2 yum.repos.d]# ll total 16 -rw-r--r--. 1 root root 1145 Dec 20 2012 fedora.repo -rw-r--r--. 1 root root 1105 Dec 20 2012 fedora-updates.repo -rw-r--r--. 1 root root 1163 Dec 20 2012 fedora-updates-testing.repo -rw-r--r--. 1 root root 144 Jun 21 18:34 ovirt-nightly.repo
[root@ovirt-manager2 yum.repos.d]# cat * [fedora] name=Fedora $releasever - $basearch failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Ever... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=fedora-$releasever&arch=$basearch enabled=1 #metadata_expire=7d gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[fedora-debuginfo] name=Fedora $releasever - $basearch - Debug failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Ever... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=fedora-debug-$releasever&arch=$basearch enabled=0 metadata_expire=7d gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[fedora-source] name=Fedora $releasever - Source failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Ever... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=fedora-source-$releasever&arch=$basearch enabled=0 metadata_expire=7d gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch [updates] name=Fedora $releasever - $basearch - Updates failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$base... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-released-f$releasever&arch=$basearch enabled=1 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-debuginfo] name=Fedora $releasever - $basearch - Updates - Debug failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$base... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-released-debug-f$releasever&arch=$basearch enabled=0 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-source] name=Fedora $releasever - Updates Source failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/SRPMS... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-released-source-f$releasever&arch=$basearch enabled=0 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch [updates-testing] name=Fedora $releasever - $basearch - Test Updates failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasev... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f$releasever&arch=$basearch enabled=0 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-testing-debuginfo] name=Fedora $releasever - $basearch - Test Updates Debug failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasev... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-testing-debug-f$releasever&arch=$basearch enabled=0 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-testing-source] name=Fedora $releasever - Test Updates Source failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasev... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-testing-source-f$releasever&arch=$basearch enabled=0 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch [ovirt-nightly] name=ovirt-nightly baseurl=http://resources.ovirt.org/releases/nightly/rpm/Fedora/18/ enabled=1 gpgcheck=0 priority=1 protect=1
*Engine RPM's:* [root@ovirt-manager2 ~]# rpm -qa | grep ovirt ovirt-engine-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch ovirt-log-collector-3.3.0-0.0.master.20130630.git2f67014.fc18.noarch
ovirt-engine-dbscripts-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch ovirt-engine-tools-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch ovirt-iso-uploader-3.3.0-0.0.master.20130618.gitc1a21ca.fc18.noarch ovirt-host-deploy-1.1.0-0.0.master.20130629.gitb3e95a5.fc18.noarch ovirt-host-deploy-java-1.1.0-0.0.master.20130629.gitb3e95a5.fc18.noarch
ovirt-engine-userportal-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch ovirt-engine-setup-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch ovirt-image-uploader-3.3.0-0.0.master.20130619.git6ec3569.fc18.noarch ovirt-engine-sdk-3.3.0.3-1.20130621.git2bbf0b8.fc18.noarch ovirt-engine-backend-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch ovirt-engine-restapi-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch
ovirt-engine-webadmin-portal-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch
*Host repos:* [root@ovirt001 yum.repos.d]# ll total 24 -rw-r--r--. 1 root root 1145 Dec 20 2012 fedora.repo -rw-r--r--. 1 root root 1105 Dec 20 2012 fedora-updates.repo -rw-r--r--. 1 root root 1163 Dec 20 2012 fedora-updates-testing.repo -rw-r--r--. 1 root root 782 Jun 4 2012 fedora-virt-preview.repo -rw-r--r--. 1 root root 880 Jun 28 13:19 glusterfs-beta4-fedora.repo -rw-r--r--. 1 root root 145 Jul 1 13:13 ovirt-nightly.repo [root@ovirt001 yum.repos.d]# cat * [fedora] name=Fedora $releasever - $basearch failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Ever... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=fedora-$releasever&arch=$basearch enabled=1 #metadata_expire=7d gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[fedora-debuginfo] name=Fedora $releasever - $basearch - Debug failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Ever... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=fedora-debug-$releasever&arch=$basearch enabled=0 metadata_expire=7d gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[fedora-source] name=Fedora $releasever - Source failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Ever... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=fedora-source-$releasever&arch=$basearch enabled=0 metadata_expire=7d gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch [updates] name=Fedora $releasever - $basearch - Updates failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$base... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-released-f$releasever&arch=$basearch enabled=1 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-debuginfo] name=Fedora $releasever - $basearch - Updates - Debug failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$base... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-released-debug-f$releasever&arch=$basearch enabled=0 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-source] name=Fedora $releasever - Updates Source failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/SRPMS... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-released-source-f$releasever&arch=$basearch enabled=0 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch [updates-testing] name=Fedora $releasever - $basearch - Test Updates failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasev... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f$releasever&arch=$basearch enabled=0 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-testing-debuginfo] name=Fedora $releasever - $basearch - Test Updates Debug failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasev... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-testing-debug-f$releasever&arch=$basearch enabled=0 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-testing-source] name=Fedora $releasever - Test Updates Source failovermethod=priority #baseurl= http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasev... mirrorlist= https://mirrors.fedoraproject.org/metalink?repo=updates-testing-source-f$releasever&arch=$basearch enabled=0 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch # Place this file in your /etc/yum.repos.d/ directory
[fedora-virt-preview] name=Virtualization packages from Rawhide built for latest Fedora baseurl= http://fedorapeople.org/groups/virt/virt-preview/fedora-$releasever/$basearc... enabled=1 skip_if_unavailable=1 gpgcheck=0
[fedora-virt-preview-debuginfo] name=Fedora $releasever - $basearch - Debug name=Virtualization packages from Rawhide built for latest Fedora - Debug baseurl= http://fedorapeople.org/groups/virt/virt-preview/fedora-$releasever/debuginf... enabled=0 skip_if_unavailable=1 gpgcheck=0
[fedora-virt-preview-source] name=Virtualization packages from Rawhide built for latest Fedora - Source baseurl= http://fedorapeople.org/groups/virt/virt-preview/fedora-$releasever/SRPMS enabled=0 skip_if_unavailable=1 gpgcheck=0 # Place this file in your /etc/yum.repos.d/ directory
[glusterfs-beta4-fedora] name=GlusterFS is a clustered file-system capable of scaling to several petabytes. baseurl= http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.4.0beta4/Fed... enabled=1 skip_if_unavailable=1 gpgcheck=0
[glusterfs-beta4-noarch-fedora] name=GlusterFS is a clustered file-system capable of scaling to several petabytes. baseurl= http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.4.0beta4/Fed... enabled=1 skip_if_unavailable=1 gpgcheck=0
[glusterfs-beta4-source-fedora] name=GlusterFS is a clustered file-system capable of scaling to several petabytes. - Source baseurl= http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.4.0beta4/Fed... enabled=0 skip_if_unavailable=1 gpgcheck=0 [ovirt-nightly] name=ovirt-nightly baseurl=http://resources.ovirt.org/releases/nightly/rpm/Fedora/18/ enabled=1 gpgcheck=0 priority=1 protect=1
*Host RPM's:* [root@ovirt001 ~]# rpm -qa | grep gluster glusterfs-rdma-3.4.0-0.8.beta4.fc18.x86_64 vdsm-gluster-4.11.0-60.git847f7c6.fc18.noarch glusterfs-3.4.0-0.8.beta4.fc18.x86_64 glusterfs-fuse-3.4.0-0.8.beta4.fc18.x86_64 glusterfs-server-3.4.0-0.8.beta4.fc18.x86_64
[root@ovirt001 ~]# rpm -qa | grep vdsm vdsm-cli-4.11.0-60.git847f7c6.fc18.noarch vdsm-python-4.11.0-60.git847f7c6.fc18.x86_64 vdsm-xmlrpc-4.11.0-60.git847f7c6.fc18.noarch vdsm-gluster-4.11.0-60.git847f7c6.fc18.noarch vdsm-4.11.0-60.git847f7c6.fc18.x86_64 vdsm-python-cpopen-4.11.0-60.git847f7c6.fc18.x86_64
[root@ovirt001 ~]# rpm -qa | grep libvirt libvirt-client-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-lxc-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-secret-1.0.6-3.fc18.x86_64 libvirt-daemon-config-nwfilter-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-uml-1.0.6-3.fc18.x86_64 libvirt-python-1.0.6-3.fc18.x86_64 libvirt-lock-sanlock-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-vbox-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-xen-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-network-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-nwfilter-1.0.6-3.fc18.x86_64 libvirt-daemon-config-network-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-interface-1.0.6-3.fc18.x86_64 libvirt-1.0.6-3.fc18.x86_64 libvirt-daemon-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-qemu-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-nodedev-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-libxl-1.0.6-3.fc18.x86_64 libvirt-daemon-driver-storage-1.0.6-3.fc18.x86_64
Steve Dainard Infrastructure Manager Miovision Technologies Inc.