<div dir="ltr"><div>Update on Glusterfs issue<br><br></div>I manage to recover lost volume after recretaing the same volume name with same bricks, whisch raised an error message, resolved by, on both nodes:<br><br><pre>setfattr -x trusted.glusterfs.volume-id $brick_path
setfattr -x trusted.gfid $brick_path<br><br></pre><br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Dec 18, 2013 at 12:12 PM, Gabi C <span dir="ltr"><<a href="mailto:gabicr@gmail.com" target="_blank">gabicr@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>node 1:<br><br>[root@virtual5 admin]# cat /config/files <br>/etc/fstab<br>/etc/shadow<br>/etc/default/ovirt<br>
/etc/ssh/ssh_host_key<br>/etc/ssh/ssh_host_key.pub<br>/etc/ssh/ssh_host_dsa_key<br>/etc/ssh/ssh_host_dsa_key.pub<br>
/etc/ssh/ssh_host_rsa_key<br>/etc/ssh/ssh_host_rsa_key.pub<br>/etc/rsyslog.conf<br>/etc/libvirt/libvirtd.conf<br>/etc/libvirt/passwd.db<br>/etc/passwd<br>/etc/sysconfig/network<br>/etc/collectd.conf<br>/etc/libvirt/qemu/networks<br>
/etc/ssh/sshd_config<br>/etc/pki<br>/etc/logrotate.d/ovirt-node<br>/var/lib/random-seed<br>/etc/iscsi/initiatorname.iscsi<br>/etc/libvirt/qemu.conf<br>/etc/sysconfig/libvirtd<br>/etc/logrotate.d/libvirtd<br>/etc/multipath.conf<br>
/etc/hosts<br>/etc/sysconfig/network-scripts/ifcfg-enp3s0<br>/etc/sysconfig/network-scripts/ifcfg-lo<br>/etc/ntp.conf<br>/etc/shadow<br>/etc/vdsm-reg/vdsm-reg.conf<br>/etc/shadow<br>/etc/shadow<br>/etc/sysconfig/network-scripts/ifcfg-ovirtmgmt<br>
/etc/sysconfig/network-scripts/route-ovirtmgmt<br>/etc/sysconfig/network-scripts/rule-ovirtmgmt<br>/root/.ssh/authorized_keys<br>/etc/vdsm/<a href="http://vdsm.id" target="_blank">vdsm.id</a><br>/etc/udev/rules.d/12-ovirt-iosched.rules<br>
/etc/vdsm/vdsm.conf<br>/etc/sysconfig/iptables<br>/etc/resolv.conf<br>/etc/sysconfig/network-scripts/ifcfg-VPO_IPPROXY<br>/etc/sysconfig/network-scripts/ifcfg-enp6s0<br>/etc/sysconfig/network-scripts/ifcfg-enp6s0.50<br>/etc/glusterfs/glusterd.vol<br>
/etc/selinux/config<br><br><br><br><br><br><br><br></div>node 2:<br><br><br>[root@virtual4 ~]# cat /config/files<br>/etc/fstab<br>/etc/shadow<br>/etc/default/ovirt<br>/etc/ssh/ssh_host_key<br>/etc/ssh/ssh_host_key.pub<br>
/etc/ssh/ssh_host_dsa_key<br>/etc/ssh/ssh_host_dsa_key.pub<br>/etc/ssh/ssh_host_rsa_key<br>/etc/ssh/ssh_host_rsa_key.pub<br>/etc/rsyslog.conf<br>/etc/libvirt/libvirtd.conf<br>/etc/libvirt/passwd.db<br>/etc/passwd<br>/etc/sysconfig/network<br>
/etc/collectd.conf<br>/etc/libvirt/qemu/networks<br>/etc/ssh/sshd_config<br>/etc/pki<br>/etc/logrotate.d/ovirt-node<br>/var/lib/random-seed<br>/etc/iscsi/initiatorname.iscsi<br>/etc/libvirt/qemu.conf<br>/etc/sysconfig/libvirtd<br>
/etc/logrotate.d/libvirtd<br>/etc/multipath.conf<br>/etc/hosts<br>/etc/sysconfig/network-scripts/ifcfg-enp3s0<br>/etc/sysconfig/network-scripts/ifcfg-lo<br>/etc/shadow<br>/etc/shadow<br>/etc/vdsm-reg/vdsm-reg.conf<br>/etc/sysconfig/network-scripts/ifcfg-ovirtmgmt<br>
/etc/sysconfig/network-scripts/route-ovirtmgmt<br>/etc/sysconfig/network-scripts/rule-ovirtmgmt<br>/root/.ssh/authorized_keys<br>/etc/shadow<br>/etc/shadow<br>/etc/vdsm/<a href="http://vdsm.id" target="_blank">vdsm.id</a><br>
/etc/udev/rules.d/12-ovirt-iosched.rules<br>
/etc/sysconfig/iptables<br>/etc/vdsm/vdsm.conf<br>/etc/shadow<br>/etc/resolv.conf<br>/etc/ntp.conf<br>/etc/sysconfig/network-scripts/ifcfg-VPO_IPPROXY<br>/etc/sysconfig/network-scripts/ifcfg-enp6s0<br>/etc/sysconfig/network-scripts/ifcfg-enp6s0.50<br>
/etc/glusterfs/glusterd.vol<br>/etc/selinux/config<br><br></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Dec 18, 2013 at 12:07 PM, Fabian Deutsch <span dir="ltr"><<a href="mailto:fabiand@redhat.com" target="_blank">fabiand@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Am Mittwoch, den 18.12.2013, 12:03 +0200 schrieb Gabi C:<br>
<div>> So here it is:<br>
><br>
><br>
> in tab volumes add new volume - Replicated, then added storage -<br>
> data/glusterfs. Then I impoerted Vm, ran them and at some point,<br>
> needing some space for a Redhat Satellite instance I decided to put<br>
> both node in maintenace stop them add new disk devices and restart,<br>
> but after restart the gluster volume defined under Volumes Tab<br>
> vanished!<br>
<br>
</div>Antoni,<br>
<br>
can you tell what log files to look at to find out why that storage<br>
domain vanished - from a Engine side?<br>
<br>
And do you know what files related to gluster are changed on the Node<br>
side?<br>
<br>
Gabi,<br>
<br>
could you please provide the contents of /config/files on the Node.<br>
<div><br>
> Glusterfs data goes under /data directory which was automatically<br>
> configured when I installed the node.<br>
<br>
</div>Yep, /data is on the Data LV - that should be good.<br>
<span><font color="#888888"><br>
- fabian<br>
</font></span><div><div><br>
><br>
><br>
> On Wed, Dec 18, 2013 at 11:45 AM, Fabian Deutsch <<a href="mailto:fabiand@redhat.com" target="_blank">fabiand@redhat.com</a>><br>
> wrote:<br>
> Am Mittwoch, den 18.12.2013, 11:42 +0200 schrieb Gabi C:<br>
> > Yes, it is the VM part..I just run into an issue. My setup<br>
> consist in<br>
> > 2 nodes with glusterfs and after adding supplemental hard<br>
> disk, after<br>
> > reboot I've lost glusterfs volumes!<br>
><br>
><br>
> Could you exactly explain what you configured?<br>
><br>
> ><br>
> > How can I persist any configuration on node and I refer here<br>
> to<br>
> > ''setenforce 0'' - for ssh login to work- and further<br>
><br>
><br>
> How changes can be persisted on Node can be found here:<br>
> <a href="http://www.ovirt.org/Node_Troubleshooting#Making_changes_on_the_host" target="_blank">http://www.ovirt.org/Node_Troubleshooting#Making_changes_on_the_host</a><br>
><br>
> Do you know into what path the glusterfs data goes? Or is it<br>
> written<br>
> directly onto a disk/LV?<br>
><br>
> - fabian<br>
><br>
> > "" <a href="http://www.ovirt.org/Features/GlusterFS_Storage_Domain" target="_blank">http://www.ovirt.org/Features/GlusterFS_Storage_Domain</a><br>
> > * option rpc-auth-allow-insecure on ==> in<br>
> glusterd.vol (ensure<br>
> > u restart glusterd service... for this to take<br>
> effect)<br>
><br>
> > * volume set <volname> server.allow-insecure on ==><br>
> (ensure u<br>
> > stop and start the volume.. for this to take<br>
> effect)''<br>
> ><br>
> ><br>
> > Thanks!<br>
> ><br>
> ><br>
> ><br>
> ><br>
> ><br>
> > On Wed, Dec 18, 2013 at 11:35 AM, Fabian Deutsch<br>
> <<a href="mailto:fabiand@redhat.com" target="_blank">fabiand@redhat.com</a>><br>
> > wrote:<br>
> > Am Mittwoch, den 18.12.2013, 08:34 +0200 schrieb<br>
> Gabi C:<br>
> > > Hello!<br>
> > ><br>
> > ><br>
> > > In order to increase disk space I want to add a<br>
> new disk<br>
> > drive to<br>
> > > ovirt node. After adding this should I proceed as<br>
> "normal" -<br>
> > pvcreate,<br>
> > > vgcreate, lvcreate and so on - or these<br>
> configuration will<br>
> > not<br>
> > > persist?<br>
> ><br>
> ><br>
> > Hey Gabi,<br>
> ><br>
> > basically plain LVM is used in Node - so yes<br>
> pvcreate and<br>
> > lvextend can<br>
> > be used.<br>
> > What storage part do you want to extend? The part<br>
> where the<br>
> > VMs reside?<br>
> > You will also need to take care to extend the<br>
> filesystem.<br>
> ><br>
> > - fabian<br>
> ><br>
> ><br>
> ><br>
><br>
><br>
><br>
><br>
<br>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>