--Apple-Mail=_6EA3CA6C-F1CA-43B1-A0ED-5EC9B2DD6690 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 I am having an issue in a Hosted Engine GlusterFS setup. I have 4 = hosts in a cluster, with the Engined being hosted on the Cluster. This = follows the pattern shown in the docs for a glusterized setup, except = that I have 4 hosts. I have engine, data, iso and export storage = domains all as glusterfs on a replica 3 glusterfs on the first 3 hosts. = These gluster volumes are running on an SSD Hardware Raid 6, which is = identical on all the hosts. All the hosts have a second Raid 6 Array = with Physical Hard Drives and I have created a second data storage = domain as a glusterfs across all 4 hosts as a stripe 2 replica 2 and = have added it to the Data Center. However if I use this second Storage = Domain as the boot disk for a VM, or as second disk for a VM that is = already running, the VM will become non-responsive as soon as the VM = starts using this disk. Happens during the OS install if the VM is = using this storage domain for its boot disk, or if I try copying = anything large to it when it is a second disk for a VM that has its boot = drive on the Master Data Storage Domain. =20 If I mount the gluster volume that is this second storage domain on one = of the hosts directly or any other machine on my local network, the = gluster volume works fine. It is only when it is used as a storage = domain (second data domain) on VMs in the cluster. Once the vm becomes non-responsive it cannot be stopped, removed or = destroyed without restarting the host machine that the VM is currently = running on. The 4 hosts are connected via 10gig ethernet, so should = not be a network issue. Any ideas? Gary ------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net = <mailto:gary@eraalaska.net> Systems Manager www.flyravn.com = <http://www.flyravn.com/> Ravn Alaska /\ 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving All of Alaska / \/ /\ \ \/\ =E2=80=9CLove your = neighbor as Really loving the record green up date! Summmer!! yourself=E2=80=9D = Matt 22:39 ------------------------------------------------------------------------ --Apple-Mail=_6EA3CA6C-F1CA-43B1-A0ED-5EC9B2DD6690 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">I am having an issue in a Hosted Engine GlusterFS setup. = I have 4 hosts in a cluster, with the Engined being hosted on the = Cluster. This follows the pattern shown in the docs for a = glusterized setup, except that I have 4 hosts. I have engine, = data, iso and export storage domains all as glusterfs on a replica 3 = glusterfs on the first 3 hosts. These gluster volumes are running = on an SSD Hardware Raid 6, which is identical on all the hosts. = All the hosts have a second Raid 6 Array with Physical Hard Drives = and I have created a second data storage domain as a glusterfs across = all 4 hosts as a stripe 2 replica 2 and have added it to the Data = Center. However if I use this second Storage Domain as the boot = disk for a VM, or as second disk for a VM that is already running, the = VM will become non-responsive as soon as the VM starts using this disk. = Happens during the OS install if the VM is using this storage = domain for its boot disk, or if I try copying anything large to it when = it is a second disk for a VM that has its boot drive on the Master Data = Storage Domain. <div class=3D""><br class=3D""></div><div = class=3D"">If I mount the gluster volume that is this second storage = domain on one of the hosts directly or any other machine on my local = network, the gluster volume works fine. It is only when it is used = as a storage domain (second data domain) on VMs in the = cluster.</div><div class=3D""><br class=3D""></div><div class=3D"">Once = the vm becomes non-responsive it cannot be stopped, removed or destroyed = without restarting the host machine that the VM is currently running on. = The 4 hosts are connected via 10gig ethernet, so should not be a = network issue.</div><div class=3D""><br class=3D""></div><div = class=3D""><br class=3D""></div><div class=3D"">Any ideas?</div><div = class=3D""><br class=3D""></div><div class=3D"">Gary</div><div = class=3D""><br class=3D""></div><div class=3D""><div class=3D""> <div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; orphans: = auto; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); font-size: 12px; letter-spacing: normal; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div><div class=3D"">Gary Pedretty = = <a = href=3D"mailto:gary@eraalaska.net" = class=3D"">gary@ravnalaska.net</a></div><div class=3D"">Systems Manager = = = <a href=3D"http://www.flyravn.com" = class=3D"">www.flyravn.com</a></div><div class=3D"">Ravn Alaska = = /\ = 907-450-7251</div><div class=3D"">5245 Airport Industrial = Road / \/\ = 907-450-7238 fax</div><div class=3D"">Fairbanks, Alaska = 99709 /\ / \ \ = Second greatest commandment</div></font><font face=3D"Monaco" = class=3D""><span style=3D"font-size: 12px;" class=3D"">Serving All of = Alaska / \/ /\ \ \/\ = =E2=80=9CLove your neighbor as</span></font><br = style=3D"font-family: Monaco;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px;" class=3D""><span style=3D"font-size: 12px;" class=3D"">Really = loving the record green up date! Summmer!! yourself=E2=80=9D M= att 22:39</span></font><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: Menlo;" = class=3D""></div><font face=3D"Menlo" style=3D"font-size: 12px;" = class=3D""></font><span style=3D"color: rgb(0, 0, 0); letter-spacing: = normal; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; font-size: 12px;" class=3D""><font = face=3D"Menlo" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div></font></span><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D""><font = face=3D"Menlo" style=3D"font-size: 12px;" class=3D""><br = class=3D""></font></div></div><span style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" = class=3D""><br class=3D"Apple-interchange-newline"></span></div><span = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; font-size: 12px;" class=3D""><br = class=3D"Apple-interchange-newline"></span></div><span style=3D"color: = rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: = 12px;" class=3D""><br class=3D"Apple-interchange-newline"></span></div><br= class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"><br = class=3D"Apple-interchange-newline"> </div> <br class=3D""></div></body></html>= --Apple-Mail=_6EA3CA6C-F1CA-43B1-A0ED-5EC9B2DD6690--