I'm using Ovirt nightly on Fedora 18 to determine if ovirt + gluster is something that will work for my organization (or at least when RHEV is released with this functionality). I'm attempting to use the nodes for both virt and gluster storage.

I've successfully created gluster bricks on two hosts, ovirt001 & ovirt002, and started volume vol1 through engine web ui. I've created a gluster storage domain, but cannot attach to data center.

Engine UI error:

Failed to attach Storage Domains to Data Center Default. (User: admin@internal)

Engine /var/log/ovirt-engine/engine.log errors:

2013-07-01 16:29:02,650 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterServicesListVDSCommand] (pool-6-thread-49) Command GlusterServicesListVDS execution failed. Exception: VDSNetworkException: org.apache.xmlrpc.XmlRpcException: <type 'exceptions.Exception'>:method "glusterServicesGet" is not supported

****I've attached the much larger log file****

Host /var/log/glusterfs/rhev-data-center-mnt-glusterSD-ovirt001\:vol1.log when attaching:

[2013-07-01 20:40:33.718871] I [afr-self-heal-data.c:655:afr_sh_data_fix] 0-vol1-replicate-0: no active sinks for performing self-heal on file /b2076340-84de-45ff-9d4b-d0d48b935fca/dom_md/ids

[2013-07-01 20:40:33.721059] W [client-rpc-fops.c:873:client3_3_writev_cbk] 0-vol1-client-0: remote operation failed: Invalid argument

[2013-07-01 20:40:33.721104] W [client-rpc-fops.c:873:client3_3_writev_cbk] 0-vol1-client-1: remote operation failed: Invalid argument

[2013-07-01 20:40:33.721130] W [fuse-bridge.c:2127:fuse_writev_cbk] 0-glusterfs-fuse: 304: WRITE => -1 (Invalid argument)

Engine repos:

[root@ovirt-manager2 yum.repos.d]# ll

total 16

-rw-r--r--. 1 root root 1145 Dec 20  2012 fedora.repo

-rw-r--r--. 1 root root 1105 Dec 20  2012 fedora-updates.repo

-rw-r--r--. 1 root root 1163 Dec 20  2012 fedora-updates-testing.repo

-rw-r--r--. 1 root root  144 Jun 21 18:34 ovirt-nightly.repo

[root@ovirt-manager2 yum.repos.d]# cat *

[fedora]

name=Fedora $releasever - $basearch

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Everything/$basearch/os/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=fedora-$releasever&arch=$basearch

enabled=1

#metadata_expire=7d

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[fedora-debuginfo]

name=Fedora $releasever - $basearch - Debug

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Everything/$basearch/debug/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=fedora-debug-$releasever&arch=$basearch

enabled=0

metadata_expire=7d

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[fedora-source]

name=Fedora $releasever - Source

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Everything/source/SRPMS/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=fedora-source-$releasever&arch=$basearch

enabled=0

metadata_expire=7d

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates]

name=Fedora $releasever - $basearch - Updates

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$basearch/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-released-f$releasever&arch=$basearch

enabled=1

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates-debuginfo]

name=Fedora $releasever - $basearch - Updates - Debug

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$basearch/debug/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-released-debug-f$releasever&arch=$basearch

enabled=0

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates-source]

name=Fedora $releasever - Updates Source

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/SRPMS/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-released-source-f$releasever&arch=$basearch

enabled=0

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates-testing]

name=Fedora $releasever - $basearch - Test Updates

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasever/$basearch/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f$releasever&arch=$basearch

enabled=0

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates-testing-debuginfo]

name=Fedora $releasever - $basearch - Test Updates Debug

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasever/$basearch/debug/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-testing-debug-f$releasever&arch=$basearch

enabled=0

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates-testing-source]

name=Fedora $releasever - Test Updates Source

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasever/SRPMS/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-testing-source-f$releasever&arch=$basearch

enabled=0

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[ovirt-nightly]

name=ovirt-nightly

baseurl=http://resources.ovirt.org/releases/nightly/rpm/Fedora/18/

enabled=1

gpgcheck=0

priority=1

protect=1

Engine RPM's:

[root@ovirt-manager2 ~]# rpm -qa | grep ovirt

ovirt-engine-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch

ovirt-log-collector-3.3.0-0.0.master.20130630.git2f67014.fc18.noarch

ovirt-engine-dbscripts-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch

ovirt-engine-tools-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch

ovirt-iso-uploader-3.3.0-0.0.master.20130618.gitc1a21ca.fc18.noarch

ovirt-host-deploy-1.1.0-0.0.master.20130629.gitb3e95a5.fc18.noarch

ovirt-host-deploy-java-1.1.0-0.0.master.20130629.gitb3e95a5.fc18.noarch

ovirt-engine-userportal-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch

ovirt-engine-setup-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch

ovirt-image-uploader-3.3.0-0.0.master.20130619.git6ec3569.fc18.noarch

ovirt-engine-sdk-3.3.0.3-1.20130621.git2bbf0b8.fc18.noarch

ovirt-engine-backend-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch

ovirt-engine-restapi-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch

ovirt-engine-webadmin-portal-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch

Host repos:

[root@ovirt001 yum.repos.d]# ll

total 24

-rw-r--r--. 1 root root 1145 Dec 20  2012 fedora.repo

-rw-r--r--. 1 root root 1105 Dec 20  2012 fedora-updates.repo

-rw-r--r--. 1 root root 1163 Dec 20  2012 fedora-updates-testing.repo

-rw-r--r--. 1 root root  782 Jun  4  2012 fedora-virt-preview.repo

-rw-r--r--. 1 root root  880 Jun 28 13:19 glusterfs-beta4-fedora.repo

-rw-r--r--. 1 root root  145 Jul  1 13:13 ovirt-nightly.repo

[root@ovirt001 yum.repos.d]# cat *

[fedora]

name=Fedora $releasever - $basearch

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Everything/$basearch/os/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=fedora-$releasever&arch=$basearch

enabled=1

#metadata_expire=7d

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[fedora-debuginfo]

name=Fedora $releasever - $basearch - Debug

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Everything/$basearch/debug/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=fedora-debug-$releasever&arch=$basearch

enabled=0

metadata_expire=7d

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[fedora-source]

name=Fedora $releasever - Source

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/Everything/source/SRPMS/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=fedora-source-$releasever&arch=$basearch

enabled=0

metadata_expire=7d

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates]

name=Fedora $releasever - $basearch - Updates

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$basearch/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-released-f$releasever&arch=$basearch

enabled=1

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates-debuginfo]

name=Fedora $releasever - $basearch - Updates - Debug

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$basearch/debug/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-released-debug-f$releasever&arch=$basearch

enabled=0

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates-source]

name=Fedora $releasever - Updates Source

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/SRPMS/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-released-source-f$releasever&arch=$basearch

enabled=0

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates-testing]

name=Fedora $releasever - $basearch - Test Updates

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasever/$basearch/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f$releasever&arch=$basearch

enabled=0

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates-testing-debuginfo]

name=Fedora $releasever - $basearch - Test Updates Debug

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasever/$basearch/debug/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-testing-debug-f$releasever&arch=$basearch

enabled=0

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

[updates-testing-source]

name=Fedora $releasever - Test Updates Source

failovermethod=priority

#baseurl=http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$releasever/SRPMS/

mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=updates-testing-source-f$releasever&arch=$basearch

enabled=0

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch

# Place this file in your /etc/yum.repos.d/ directory

[fedora-virt-preview]

name=Virtualization packages from Rawhide built for latest Fedora

baseurl=http://fedorapeople.org/groups/virt/virt-preview/fedora-$releasever/$basearch

enabled=1

skip_if_unavailable=1

gpgcheck=0

[fedora-virt-preview-debuginfo]

name=Fedora $releasever - $basearch - Debug

name=Virtualization packages from Rawhide built for latest Fedora - Debug

baseurl=http://fedorapeople.org/groups/virt/virt-preview/fedora-$releasever/debuginfo

enabled=0

skip_if_unavailable=1

gpgcheck=0

[fedora-virt-preview-source]

name=Virtualization packages from Rawhide built for latest Fedora - Source

baseurl=http://fedorapeople.org/groups/virt/virt-preview/fedora-$releasever/SRPMS

enabled=0

skip_if_unavailable=1

gpgcheck=0

# Place this file in your /etc/yum.repos.d/ directory

[glusterfs-beta4-fedora]

name=GlusterFS is a clustered file-system capable of scaling to several petabytes.

baseurl=http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.4.0beta4/Fedora/fedora-$releasever/$basearch/

enabled=1

skip_if_unavailable=1

gpgcheck=0

[glusterfs-beta4-noarch-fedora]

name=GlusterFS is a clustered file-system capable of scaling to several petabytes.

baseurl=http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.4.0beta4/Fedora/fedora-$releasever/noarch/

enabled=1

skip_if_unavailable=1

gpgcheck=0

[glusterfs-beta4-source-fedora]

name=GlusterFS is a clustered file-system capable of scaling to several petabytes. - Source

baseurl=http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.4.0beta4/Fedora/fedora-$releasever/SRPMS/

enabled=0

skip_if_unavailable=1

gpgcheck=0

[ovirt-nightly]

name=ovirt-nightly

baseurl=http://resources.ovirt.org/releases/nightly/rpm/Fedora/18/

enabled=1

gpgcheck=0

priority=1

protect=1

Host RPM's:

[root@ovirt001 ~]# rpm -qa | grep gluster

glusterfs-rdma-3.4.0-0.8.beta4.fc18.x86_64

vdsm-gluster-4.11.0-60.git847f7c6.fc18.noarch

glusterfs-3.4.0-0.8.beta4.fc18.x86_64

glusterfs-fuse-3.4.0-0.8.beta4.fc18.x86_64

glusterfs-server-3.4.0-0.8.beta4.fc18.x86_64

[root@ovirt001 ~]# rpm -qa | grep vdsm

vdsm-cli-4.11.0-60.git847f7c6.fc18.noarch

vdsm-python-4.11.0-60.git847f7c6.fc18.x86_64

vdsm-xmlrpc-4.11.0-60.git847f7c6.fc18.noarch

vdsm-gluster-4.11.0-60.git847f7c6.fc18.noarch

vdsm-4.11.0-60.git847f7c6.fc18.x86_64

vdsm-python-cpopen-4.11.0-60.git847f7c6.fc18.x86_64

[root@ovirt001 ~]# rpm -qa | grep libvirt

libvirt-client-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-lxc-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-secret-1.0.6-3.fc18.x86_64

libvirt-daemon-config-nwfilter-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-uml-1.0.6-3.fc18.x86_64

libvirt-python-1.0.6-3.fc18.x86_64

libvirt-lock-sanlock-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-vbox-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-xen-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-network-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-nwfilter-1.0.6-3.fc18.x86_64

libvirt-daemon-config-network-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-interface-1.0.6-3.fc18.x86_64

libvirt-1.0.6-3.fc18.x86_64

libvirt-daemon-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-qemu-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-nodedev-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-libxl-1.0.6-3.fc18.x86_64

libvirt-daemon-driver-storage-1.0.6-3.fc18.x86_64

Steve Dainard
Infrastructure Manager

Miovision Technologies Inc.