I'm using Ovirt nightly on Fedora 18 to determine if ovirt + gluster is
something that will work for my organization (or at least when RHEV is
released with this functionality). I'm attempting to use the nodes for both
virt and gluster storage.
I've successfully created gluster bricks on two hosts, ovirt001 & ovirt002,
and started volume vol1 through engine web ui. I've created a gluster
storage domain, but cannot attach to data center.
*Engine UI error:*
Failed to attach Storage Domains to Data Center Default. (User:
admin@internal)
*Engine /var/log/ovirt-engine/engine.log errors:*
2013-07-01 16:29:02,650 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterServicesListVDSCommand]
(pool-6-thread-49) Command GlusterServicesListVDS execution failed.
Exception: VDSNetworkException: org.apache.xmlrpc.XmlRpcException: <type
'exceptions.Exception'>:method "glusterServicesGet" is not supported
****I've attached the much larger log file****
*Host /var/log/glusterfs/rhev-data-center-mnt-glusterSD-ovirt001\:vol1.log
when attaching:*
[2013-07-01 20:40:33.718871] I [afr-self-heal-data.c:655:afr_sh_data_fix]
0-vol1-replicate-0: no active sinks for performing self-heal on file
/b2076340-84de-45ff-9d4b-d0d48b935fca/dom_md/ids
[2013-07-01 20:40:33.721059] W [client-rpc-fops.c:873:client3_3_writev_cbk]
0-vol1-client-0: remote operation failed: Invalid argument
[2013-07-01 20:40:33.721104] W [client-rpc-fops.c:873:client3_3_writev_cbk]
0-vol1-client-1: remote operation failed: Invalid argument
[2013-07-01 20:40:33.721130] W [fuse-bridge.c:2127:fuse_writev_cbk]
0-glusterfs-fuse: 304: WRITE => -1 (Invalid argument)
*Engine repos:*
[root@ovirt-manager2 yum.repos.d]# ll
total 16
-rw-r--r--. 1 root root 1145 Dec 20 2012 fedora.repo
-rw-r--r--. 1 root root 1105 Dec 20 2012 fedora-updates.repo
-rw-r--r--. 1 root root 1163 Dec 20 2012 fedora-updates-testing.repo
-rw-r--r--. 1 root root 144 Jun 21 18:34 ovirt-nightly.repo
[root@ovirt-manager2 yum.repos.d]# cat *
[fedora]
name=Fedora $releasever - $basearch
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/E...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=fedora-$releasever&ar...
enabled=1
#metadata_expire=7d
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[fedora-debuginfo]
name=Fedora $releasever - $basearch - Debug
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/E...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=fedora-debug-$releasever&...
enabled=0
metadata_expire=7d
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[fedora-source]
name=Fedora $releasever - Source
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/E...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=fedora-source-$releasever...
enabled=0
metadata_expire=7d
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates]
name=Fedora $releasever - $basearch - Updates
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$b...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-released-f$releas...
enabled=1
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-debuginfo]
name=Fedora $releasever - $basearch - Updates - Debug
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$b...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-released-debug-f$...
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-source]
name=Fedora $releasever - Updates Source
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/SR...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-released-source-f...
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-testing]
name=Fedora $releasever - $basearch - Test Updates
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$relea...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f$release...
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-testing-debuginfo]
name=Fedora $releasever - $basearch - Test Updates Debug
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$relea...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-testing-debug-f$r...
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-testing-source]
name=Fedora $releasever - Test Updates Source
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$relea...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-testing-source-f$...
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[ovirt-nightly]
name=ovirt-nightly
baseurl=http://resources.ovirt.org/releases/nightly/rpm/Fedora/18/
enabled=1
gpgcheck=0
priority=1
protect=1
*Engine RPM's:*
[root@ovirt-manager2 ~]# rpm -qa | grep ovirt
ovirt-engine-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch
ovirt-log-collector-3.3.0-0.0.master.20130630.git2f67014.fc18.noarch
ovirt-engine-dbscripts-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch
ovirt-engine-tools-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch
ovirt-iso-uploader-3.3.0-0.0.master.20130618.gitc1a21ca.fc18.noarch
ovirt-host-deploy-1.1.0-0.0.master.20130629.gitb3e95a5.fc18.noarch
ovirt-host-deploy-java-1.1.0-0.0.master.20130629.gitb3e95a5.fc18.noarch
ovirt-engine-userportal-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch
ovirt-engine-setup-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch
ovirt-image-uploader-3.3.0-0.0.master.20130619.git6ec3569.fc18.noarch
ovirt-engine-sdk-3.3.0.3-1.20130621.git2bbf0b8.fc18.noarch
ovirt-engine-backend-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch
ovirt-engine-restapi-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch
ovirt-engine-webadmin-portal-3.3.0-0.2.master.20130629172827.git2c327d2.fc18.noarch
*Host repos:*
[root@ovirt001 yum.repos.d]# ll
total 24
-rw-r--r--. 1 root root 1145 Dec 20 2012 fedora.repo
-rw-r--r--. 1 root root 1105 Dec 20 2012 fedora-updates.repo
-rw-r--r--. 1 root root 1163 Dec 20 2012 fedora-updates-testing.repo
-rw-r--r--. 1 root root 782 Jun 4 2012 fedora-virt-preview.repo
-rw-r--r--. 1 root root 880 Jun 28 13:19 glusterfs-beta4-fedora.repo
-rw-r--r--. 1 root root 145 Jul 1 13:13 ovirt-nightly.repo
[root@ovirt001 yum.repos.d]# cat *
[fedora]
name=Fedora $releasever - $basearch
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/E...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=fedora-$releasever&ar...
enabled=1
#metadata_expire=7d
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[fedora-debuginfo]
name=Fedora $releasever - $basearch - Debug
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/E...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=fedora-debug-$releasever&...
enabled=0
metadata_expire=7d
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[fedora-source]
name=Fedora $releasever - Source
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/releases/$releasever/E...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=fedora-source-$releasever...
enabled=0
metadata_expire=7d
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates]
name=Fedora $releasever - $basearch - Updates
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$b...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-released-f$releas...
enabled=1
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-debuginfo]
name=Fedora $releasever - $basearch - Updates - Debug
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$b...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-released-debug-f$...
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-source]
name=Fedora $releasever - Updates Source
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/SR...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-released-source-f...
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-testing]
name=Fedora $releasever - $basearch - Test Updates
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$relea...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f$release...
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-testing-debuginfo]
name=Fedora $releasever - $basearch - Test Updates Debug
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$relea...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-testing-debug-f$r...
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
[updates-testing-source]
name=Fedora $releasever - Test Updates Source
failovermethod=priority
#baseurl=
http://download.fedoraproject.org/pub/fedora/linux/updates/testing/$relea...
mirrorlist=
https://mirrors.fedoraproject.org/metalink?repo=updates-testing-source-f$...
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-$basearch
# Place this file in your /etc/yum.repos.d/ directory
[fedora-virt-preview]
name=Virtualization packages from Rawhide built for latest Fedora
baseurl=
http://fedorapeople.org/groups/virt/virt-preview/fedora-$releasever/$base...
enabled=1
skip_if_unavailable=1
gpgcheck=0
[fedora-virt-preview-debuginfo]
name=Fedora $releasever - $basearch - Debug
name=Virtualization packages from Rawhide built for latest Fedora - Debug
baseurl=
http://fedorapeople.org/groups/virt/virt-preview/fedora-$releasever/debug...
enabled=0
skip_if_unavailable=1
gpgcheck=0
[fedora-virt-preview-source]
name=Virtualization packages from Rawhide built for latest Fedora - Source
baseurl=
http://fedorapeople.org/groups/virt/virt-preview/fedora-$releasever/SRPMS
enabled=0
skip_if_unavailable=1
gpgcheck=0
# Place this file in your /etc/yum.repos.d/ directory
[glusterfs-beta4-fedora]
name=GlusterFS is a clustered file-system capable of scaling to several
petabytes.
baseurl=
http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.4.0beta4/...
enabled=1
skip_if_unavailable=1
gpgcheck=0
[glusterfs-beta4-noarch-fedora]
name=GlusterFS is a clustered file-system capable of scaling to several
petabytes.
baseurl=
http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.4.0beta4/...
enabled=1
skip_if_unavailable=1
gpgcheck=0
[glusterfs-beta4-source-fedora]
name=GlusterFS is a clustered file-system capable of scaling to several
petabytes. - Source
baseurl=
http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.4.0beta4/...
enabled=0
skip_if_unavailable=1
gpgcheck=0
[ovirt-nightly]
name=ovirt-nightly
baseurl=http://resources.ovirt.org/releases/nightly/rpm/Fedora/18/
enabled=1
gpgcheck=0
priority=1
protect=1
*Host RPM's:*
[root@ovirt001 ~]# rpm -qa | grep gluster
glusterfs-rdma-3.4.0-0.8.beta4.fc18.x86_64
vdsm-gluster-4.11.0-60.git847f7c6.fc18.noarch
glusterfs-3.4.0-0.8.beta4.fc18.x86_64
glusterfs-fuse-3.4.0-0.8.beta4.fc18.x86_64
glusterfs-server-3.4.0-0.8.beta4.fc18.x86_64
[root@ovirt001 ~]# rpm -qa | grep vdsm
vdsm-cli-4.11.0-60.git847f7c6.fc18.noarch
vdsm-python-4.11.0-60.git847f7c6.fc18.x86_64
vdsm-xmlrpc-4.11.0-60.git847f7c6.fc18.noarch
vdsm-gluster-4.11.0-60.git847f7c6.fc18.noarch
vdsm-4.11.0-60.git847f7c6.fc18.x86_64
vdsm-python-cpopen-4.11.0-60.git847f7c6.fc18.x86_64
[root@ovirt001 ~]# rpm -qa | grep libvirt
libvirt-client-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-lxc-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-secret-1.0.6-3.fc18.x86_64
libvirt-daemon-config-nwfilter-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-uml-1.0.6-3.fc18.x86_64
libvirt-python-1.0.6-3.fc18.x86_64
libvirt-lock-sanlock-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-vbox-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-xen-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-network-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-nwfilter-1.0.6-3.fc18.x86_64
libvirt-daemon-config-network-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-interface-1.0.6-3.fc18.x86_64
libvirt-1.0.6-3.fc18.x86_64
libvirt-daemon-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-qemu-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-nodedev-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-libxl-1.0.6-3.fc18.x86_64
libvirt-daemon-driver-storage-1.0.6-3.fc18.x86_64
Steve Dainard
Infrastructure Manager
Miovision Technologies Inc.