On Nov 6, 2016, at 6:28 AM, Maor Lipchuk <mlipchuk@redhat.com> wrote: =20 Hi Gary, =20 Do you have other disks on this storage domain? Have you tried to use other VMs with disks on this storage domain? Is this disk is preallocated? If not can you try to create a =
=20 Regards, Maor =20 =20 =20 On Sat, Nov 5, 2016 at 2:28 AM, Gary Pedretty <gary@ravnalaska.net = <mailto:gary@ravnalaska.net>> wrote: I am having an issue in a Hosted Engine GlusterFS setup. I have 4 = hosts in a cluster, with the Engined being hosted on the Cluster. This = follows the pattern shown in the docs for a glusterized setup, except =
--Apple-Mail=_06BC44F7-FB91-448D-94C1-8C5321567393 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 As a storage domain, this gluster volume will not work whether it is = preallocated or thin provision. It will work as a straight gluster = volume mounted directly to any VM on the ovirt Cluster, or any physical = machine, just not as a data storage domain in the Data Center. Are there restrictions to having more than one data storage domain that = has it gluster volumes on the same hosts that are also part of the Data = Center and Cluster? Gary ------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net = <mailto:gary@eraalaska.net> Systems Manager www.flyravn.com = <http://www.flyravn.com/> Ravn Alaska /\ 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving All of Alaska / \/ /\ \ \/\ =E2=80=9CLove your = neighbor as Really loving the record green up date! Summmer!! yourself=E2=80=9D = Matt 22:39 ------------------------------------------------------------------------ pre-allocate disk and re-try that I have 4 hosts. I have engine, data, iso and export storage = domains all as glusterfs on a replica 3 glusterfs on the first 3 hosts. = These gluster volumes are running on an SSD Hardware Raid 6, which is = identical on all the hosts. All the hosts have a second Raid 6 Array = with Physical Hard Drives and I have created a second data storage = domain as a glusterfs across all 4 hosts as a stripe 2 replica 2 and = have added it to the Data Center. However if I use this second Storage = Domain as the boot disk for a VM, or as second disk for a VM that is = already running, the VM will become non-responsive as soon as the VM = starts using this disk. Happens during the OS install if the VM is = using this storage domain for its boot disk, or if I try copying = anything large to it when it is a second disk for a VM that has its boot = drive on the Master Data Storage Domain.=20
=20 If I mount the gluster volume that is this second storage domain on = one of the hosts directly or any other machine on my local network, the = gluster volume works fine. It is only when it is used as a storage = domain (second data domain) on VMs in the cluster. =20 Once the vm becomes non-responsive it cannot be stopped, removed or = destroyed without restarting the host machine that the VM is currently = running on. The 4 hosts are connected via 10gig ethernet, so should = not be a network issue. =20 =20 Any ideas? =20 Gary
--Apple-Mail=_06BC44F7-FB91-448D-94C1-8C5321567393 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">As a storage domain, this gluster volume will not work = whether it is preallocated or thin provision. It will work as a = straight gluster volume mounted directly to any VM on the ovirt Cluster, = or any physical machine, just not as a data storage domain in the Data = Center.<div class=3D""><br class=3D""></div><div class=3D"">Are there = restrictions to having more than one data storage domain that has it = gluster volumes on the same hosts that are also part of the Data Center = and Cluster?<br class=3D""><div class=3D""><br class=3D""></div><div = class=3D""><br class=3D""></div><div class=3D"">Gary</div><div = class=3D""><br class=3D""></div><div class=3D""><br class=3D""><div = class=3D""> <div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; orphans: = auto; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); font-size: 12px; letter-spacing: normal; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div><div class=3D"">Gary Pedretty = = <a = href=3D"mailto:gary@eraalaska.net" = class=3D"">gary@ravnalaska.net</a></div><div class=3D"">Systems Manager = = = <a href=3D"http://www.flyravn.com" = class=3D"">www.flyravn.com</a></div><div class=3D"">Ravn Alaska = = /\ = 907-450-7251</div><div class=3D"">5245 Airport Industrial = Road / \/\ = 907-450-7238 fax</div><div class=3D"">Fairbanks, Alaska = 99709 /\ / \ \ = Second greatest commandment</div></font><font face=3D"Monaco" = class=3D""><span style=3D"font-size: 12px;" class=3D"">Serving All of = Alaska / \/ /\ \ \/\ = =E2=80=9CLove your neighbor as</span></font><br = style=3D"font-family: Monaco;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px;" class=3D""><span style=3D"font-size: 12px;" class=3D"">Really = loving the record green up date! Summmer!! yourself=E2=80=9D M= att 22:39</span></font><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: Menlo;" = class=3D""></div><font face=3D"Menlo" style=3D"font-size: 12px;" = class=3D""></font><span style=3D"color: rgb(0, 0, 0); letter-spacing: = normal; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; font-size: 12px;" class=3D""><font = face=3D"Menlo" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div></font></span><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D""><font = face=3D"Menlo" style=3D"font-size: 12px;" class=3D""><br = class=3D""></font></div></div><span style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" = class=3D""><br class=3D"Apple-interchange-newline"></span></div><span = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; font-size: 12px;" class=3D""><br = class=3D"Apple-interchange-newline"></span></div><span style=3D"color: = rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: = 12px;" class=3D""><br class=3D"Apple-interchange-newline"></span></div><br= class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"><br = class=3D"Apple-interchange-newline"> </div> <br class=3D""><div><blockquote type=3D"cite" class=3D""><div = class=3D"">On Nov 6, 2016, at 6:28 AM, Maor Lipchuk <<a = href=3D"mailto:mlipchuk@redhat.com" class=3D"">mlipchuk@redhat.com</a>>= wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><div = dir=3D"ltr" style=3D"font-family: LucidaGrande; font-size: 13px; = font-style: normal; font-variant-caps: normal; font-weight: normal; = letter-spacing: normal; orphans: auto; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; widows: auto; = word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D"">Hi = Gary,<div class=3D""><br class=3D""></div><div class=3D"">Do you have = other disks on this storage domain?</div><div class=3D"">Have you tried = to use other VMs with disks on this storage domain?</div><div = class=3D"">Is this disk is preallocated? If not can you try to create a = pre-allocate disk and re-try</div><div class=3D""><br = class=3D""></div><div class=3D"">Regards,</div><div = class=3D"">Maor</div><div class=3D""><br class=3D""></div><div = class=3D""><br class=3D""></div></div><div class=3D"gmail_extra" = style=3D"font-family: LucidaGrande; font-size: 13px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;"><br class=3D""><div = class=3D"gmail_quote">On Sat, Nov 5, 2016 at 2:28 AM, Gary Pedretty<span = class=3D"Apple-converted-space"> </span><span dir=3D"ltr" = class=3D""><<a href=3D"mailto:gary@ravnalaska.net" target=3D"_blank" = class=3D"">gary@ravnalaska.net</a>></span><span = class=3D"Apple-converted-space"> </span>wrote:<br = class=3D""><blockquote class=3D"gmail_quote" style=3D"margin: 0px 0px = 0px 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, = 204); border-left-style: solid; padding-left: 1ex;"><div = style=3D"word-wrap: break-word;" class=3D"">I am having an issue in a = Hosted Engine GlusterFS setup. I have 4 hosts in a cluster, with = the Engined being hosted on the Cluster. This follows the pattern = shown in the docs for a glusterized setup, except that I have 4 hosts. = I have engine, data, iso and export storage domains all as = glusterfs on a replica 3 glusterfs on the first 3 hosts. These = gluster volumes are running on an SSD Hardware Raid 6, which is = identical on all the hosts. All the hosts have a second Raid 6 = Array with Physical Hard Drives and I have created a second data storage = domain as a glusterfs across all 4 hosts as a stripe 2 replica 2 = and have added it to the Data Center. However if I use this second = Storage Domain as the boot disk for a VM, or as second disk for a VM = that is already running, the VM will become non-responsive as soon as = the VM starts using this disk. Happens during the OS install if = the VM is using this storage domain for its boot disk, or if I try = copying anything large to it when it is a second disk for a VM that has = its boot drive on the Master Data Storage Domain. <div = class=3D""><br class=3D""></div><div class=3D"">If I mount the gluster = volume that is this second storage domain on one of the hosts directly = or any other machine on my local network, the gluster volume works = fine. It is only when it is used as a storage domain (second data = domain) on VMs in the cluster.</div><div class=3D""><br = class=3D""></div><div class=3D"">Once the vm becomes non-responsive it = cannot be stopped, removed or destroyed without restarting the host = machine that the VM is currently running on. The 4 hosts are = connected via 10gig ethernet, so should not be a network = issue.</div><div class=3D""><br class=3D""></div><div class=3D""><br = class=3D""></div><div class=3D"">Any ideas?</div><div class=3D""><br = class=3D""></div><div = class=3D"">Gary</div></div></blockquote></div></div></div></blockquote></d= iv><br class=3D""></div></div></body></html>= --Apple-Mail=_06BC44F7-FB91-448D-94C1-8C5321567393--