glusterfs heal issues
--Apple-Mail=_B7D419EA-0EAE-41C9-87E3-583B5DAC7590 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 This is a self hosted Glusterized setup, with 3 hosts. I have had some = glusterfs data storage domains have some disk issues where healing was = required. The self heal seemed to startup and the Ovirt Management = portal showed healing taking place in the Volumes/Brick tab. Later it = showed everything ok. This is a replica 3 volume. I noticed however = that the brick tab was not showing even use of the 3 bricks and looking = on the actual hosts a df command also shows uneven use of the bricks. = However gluster volume heal (vol) info shows zero entries for all = bricks. There are no errors reported in the Data Center or Cluster, yet = I see this uneven use of the bricks across the 3 hosts. =20 Doing a gluster volume status (vol) detail indeed shows different free = disk space across the different bricks. However the Inode Count and = Free Inodes are identical across all bricks. =20 I thought replica 3 was supposed to be mirrored across all nodes. Any = idea why I am seeing the uneven use, or is this just something about = glusterfs that is different when it comes to free space vs Inode Count? Gary ------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net = <mailto:gary@eraalaska.net> Systems Manager www.flyravn.com = <http://www.flyravn.com/> Ravn Alaska /\ 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving All of Alaska / \/ /\ \ \/\ =E2=80=9CLove your = neighbor as Really loving the record green up date! Summmer!! yourself=E2=80=9D = Matt 22:39 ------------------------------------------------------------------------ --Apple-Mail=_B7D419EA-0EAE-41C9-87E3-583B5DAC7590 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">This is a self hosted Glusterized setup, with 3 hosts. = I have had some glusterfs data storage domains have some disk = issues where healing was required. The self heal seemed to startup = and the Ovirt Management portal showed healing taking place in the = Volumes/Brick tab. Later it showed everything ok. This is a = replica 3 volume. I noticed however that the brick tab was not = showing even use of the 3 bricks and looking on the actual hosts a df = command also shows uneven use of the bricks. However gluster = volume heal (vol) info shows zero entries for all bricks. There = are no errors reported in the Data Center or Cluster, yet I see this = uneven use of the bricks across the 3 hosts. <div class=3D""><br = class=3D""></div><div class=3D"">Doing a gluster volume status (vol) = detail indeed shows different free disk space across the different = bricks. However the Inode Count and Free Inodes are identical = across all bricks. </div><div class=3D""><br class=3D""></div><div = class=3D"">I thought replica 3 was supposed to be mirrored across all = nodes. Any idea why I am seeing the uneven use, or is this just = something about glusterfs that is different when it comes to free space = vs Inode Count?<div class=3D""><br class=3D""></div><div = class=3D"">Gary</div><div class=3D""><br class=3D""></div><div = class=3D""><br class=3D""><div class=3D""> <div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; orphans: = auto; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); font-size: 12px; letter-spacing: normal; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div><div class=3D"">Gary Pedretty = = <a = href=3D"mailto:gary@eraalaska.net" = class=3D"">gary@ravnalaska.net</a></div><div class=3D"">Systems Manager = = = <a href=3D"http://www.flyravn.com" = class=3D"">www.flyravn.com</a></div><div class=3D"">Ravn Alaska = = /\ = 907-450-7251</div><div class=3D"">5245 Airport Industrial = Road / \/\ = 907-450-7238 fax</div><div class=3D"">Fairbanks, Alaska = 99709 /\ / \ \ = Second greatest commandment</div></font><font face=3D"Monaco" = class=3D""><span style=3D"font-size: 12px;" class=3D"">Serving All of = Alaska / \/ /\ \ \/\ = =E2=80=9CLove your neighbor as</span></font><br = style=3D"font-family: Monaco;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px;" class=3D""><span style=3D"font-size: 12px;" class=3D"">Really = loving the record green up date! Summmer!! yourself=E2=80=9D M= att 22:39</span></font><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: Menlo;" = class=3D""></div><font face=3D"Menlo" style=3D"font-size: 12px;" = class=3D""></font><span style=3D"color: rgb(0, 0, 0); letter-spacing: = normal; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; font-size: 12px;" class=3D""><font = face=3D"Menlo" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div></font></span><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D""><font = face=3D"Menlo" style=3D"font-size: 12px;" class=3D""><br = class=3D""></font></div></div><span style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" = class=3D""><br class=3D"Apple-interchange-newline"></span></div><span = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; font-size: 12px;" class=3D""><br = class=3D"Apple-interchange-newline"></span></div><span style=3D"color: = rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: = 12px;" class=3D""><br class=3D"Apple-interchange-newline"></span></div><br= class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"><br = class=3D"Apple-interchange-newline"> </div> <br class=3D""></div></div></body></html>= --Apple-Mail=_B7D419EA-0EAE-41C9-87E3-583B5DAC7590--
On Jan 16, 2017, at 10:31 AM, Gary Pedretty <gary@ravnalaska.net> = wrote: =20 This is a self hosted Glusterized setup, with 3 hosts. I have had = some glusterfs data storage domains have some disk issues where healing = was required. The self heal seemed to startup and the Ovirt Management =
--Apple-Mail=_BAF15BEA-8FDA-4D03-BB2D-2DC2DF696E4C Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 I figured it out. I forgot that these gluster volumes as recommended by = the Ovirt Glusterized setup were created as Replica 3 Arbiter 1 = volumes, so now I understand what that truly means, One brick only = contains the directory and meta data and so will always be smaller = actual disk use. Sorry for the confusion.. Gary ------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net = <mailto:gary@eraalaska.net> Systems Manager www.flyravn.com = <http://www.flyravn.com/> Ravn Alaska /\ 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving All of Alaska / \/ /\ \ \/\ =E2=80=9CLove your = neighbor as Really loving the record green up date! Summmer!! yourself=E2=80=9D = Matt 22:39 ------------------------------------------------------------------------ portal showed healing taking place in the Volumes/Brick tab. Later it = showed everything ok. This is a replica 3 volume. I noticed however = that the brick tab was not showing even use of the 3 bricks and looking = on the actual hosts a df command also shows uneven use of the bricks. = However gluster volume heal (vol) info shows zero entries for all = bricks. There are no errors reported in the Data Center or Cluster, yet = I see this uneven use of the bricks across the 3 hosts. =20
=20 Doing a gluster volume status (vol) detail indeed shows different free = disk space across the different bricks. However the Inode Count and = Free Inodes are identical across all bricks. =20 =20 I thought replica 3 was supposed to be mirrored across all nodes. Any = idea why I am seeing the uneven use, or is this just something about = glusterfs that is different when it comes to free space vs Inode Count? =20 Gary =20 =20 =
Gary Pedretty = gary@ravnalaska.net <mailto:gary@eraalaska.net> Systems Manager = www.flyravn.com <http://www.flyravn.com/> Ravn Alaska /\ = 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 = fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest = commandment Serving All of Alaska / \/ /\ \ \/\ =E2=80=9CLove your = neighbor as Really loving the record green up date! Summmer!! yourself=E2=80=9D = Matt 22:39 =
=20 =20 =20 =20 =20 =20 =20 =20 =20 =20 =20 =20 _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--Apple-Mail=_BAF15BEA-8FDA-4D03-BB2D-2DC2DF696E4C Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">I figured it out. I forgot that these gluster volumes = as recommended by the Ovirt Glusterized setup were created as = Replica 3 Arbiter 1 volumes, so now I understand what that truly = means, One brick only contains the directory and meta data and so = will always be smaller actual disk use. Sorry for the = confusion..<div class=3D""><br class=3D""></div><div class=3D""><br = class=3D""></div><div class=3D"">Gary</div><div class=3D""><br = class=3D""></div><div class=3D""><br class=3D""><div class=3D""> <div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; orphans: = auto; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); font-size: 12px; letter-spacing: normal; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div><div class=3D"">Gary Pedretty = = <a = href=3D"mailto:gary@eraalaska.net" = class=3D"">gary@ravnalaska.net</a></div><div class=3D"">Systems Manager = = = <a href=3D"http://www.flyravn.com" = class=3D"">www.flyravn.com</a></div><div class=3D"">Ravn Alaska = = /\ = 907-450-7251</div><div class=3D"">5245 Airport Industrial = Road / \/\ = 907-450-7238 fax</div><div class=3D"">Fairbanks, Alaska = 99709 /\ / \ \ = Second greatest commandment</div></font><font face=3D"Monaco" = class=3D""><span style=3D"font-size: 12px;" class=3D"">Serving All of = Alaska / \/ /\ \ \/\ = =E2=80=9CLove your neighbor as</span></font><br = style=3D"font-family: Monaco;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px;" class=3D""><span style=3D"font-size: 12px;" class=3D"">Really = loving the record green up date! Summmer!! yourself=E2=80=9D M= att 22:39</span></font><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: Menlo;" = class=3D""></div><font face=3D"Menlo" style=3D"font-size: 12px;" = class=3D""></font><span style=3D"color: rgb(0, 0, 0); letter-spacing: = normal; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; font-size: 12px;" class=3D""><font = face=3D"Menlo" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div></font></span><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D""><font = face=3D"Menlo" style=3D"font-size: 12px;" class=3D""><br = class=3D""></font></div></div><span style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" = class=3D""><br class=3D"Apple-interchange-newline"></span></div><span = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; font-size: 12px;" class=3D""><br = class=3D"Apple-interchange-newline"></span></div><span style=3D"color: = rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: = 12px;" class=3D""><br class=3D"Apple-interchange-newline"></span></div><br= class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"><br = class=3D"Apple-interchange-newline"> </div> <br class=3D""><div><blockquote type=3D"cite" class=3D""><div = class=3D"">On Jan 16, 2017, at 10:31 AM, Gary Pedretty <<a = href=3D"mailto:gary@ravnalaska.net" class=3D"">gary@ravnalaska.net</a>>= wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><meta= http-equiv=3D"Content-Type" content=3D"text/html charset=3Dutf-8" = class=3D""><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: = space; -webkit-line-break: after-white-space;" class=3D"">This is a self = hosted Glusterized setup, with 3 hosts. I have had some glusterfs = data storage domains have some disk issues where healing was required. = The self heal seemed to startup and the Ovirt Management portal = showed healing taking place in the Volumes/Brick tab. Later it = showed everything ok. This is a replica 3 volume. I noticed = however that the brick tab was not showing even use of the 3 bricks and = looking on the actual hosts a df command also shows uneven use of the = bricks. However gluster volume heal (vol) info shows zero entries = for all bricks. There are no errors reported in the Data Center or = Cluster, yet I see this uneven use of the bricks across the 3 hosts. = <div class=3D""><br class=3D""></div><div class=3D"">Doing a = gluster volume status (vol) detail indeed shows different free disk = space across the different bricks. However the Inode Count and = Free Inodes are identical across all bricks. </div><div = class=3D""><br class=3D""></div><div class=3D"">I thought replica 3 was = supposed to be mirrored across all nodes. Any idea why I am seeing = the uneven use, or is this just something about glusterfs that is = different when it comes to free space vs Inode Count?<div class=3D""><br = class=3D""></div><div class=3D"">Gary</div><div class=3D""><br = class=3D""></div><div class=3D""><br class=3D""><div class=3D""> <div style=3D"letter-spacing: normal; orphans: auto; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; widows: = auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><font face=3D"Menlo" = style=3D"font-size: 12px; letter-spacing: normal; text-transform: none; = white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" = class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div><div class=3D"">Gary Pedretty = = <a = href=3D"mailto:gary@eraalaska.net" = class=3D"">gary@ravnalaska.net</a></div><div class=3D"">Systems Manager = = = <a href=3D"http://www.flyravn.com/" = class=3D"">www.flyravn.com</a></div><div class=3D"">Ravn Alaska = = /\ = 907-450-7251</div><div class=3D"">5245 Airport Industrial = Road / \/\ = 907-450-7238 fax</div><div class=3D"">Fairbanks, Alaska = 99709 /\ / \ \ = Second greatest commandment</div></font><font face=3D"Monaco" = class=3D""><span style=3D"font-size: 12px;" class=3D"">Serving All of = Alaska / \/ /\ \ \/\ = =E2=80=9CLove your neighbor as</span></font><br = style=3D"font-family: Monaco;" class=3D""><font face=3D"Menlo" = style=3D"letter-spacing: normal; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" = class=3D""><span style=3D"font-size: 12px;" class=3D"">Really loving the = record green up date! Summmer!! yourself=E2=80=9D Matt = 22:39</span></font><div style=3D"letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; font-family: Menlo;" class=3D""></div><font face=3D"Menlo" = style=3D"font-size: 12px;" class=3D""></font><span = style=3D"letter-spacing: normal; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: = 12px;" class=3D""><font face=3D"Menlo" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div></font></span><div style=3D"letter-spacing: normal; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><font face=3D"Menlo" = style=3D"font-size: 12px;" class=3D""><br = class=3D""></font></div></div><span style=3D"letter-spacing: normal; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; font-size: 12px;" class=3D""><br = class=3D"Apple-interchange-newline"></span></div><span = style=3D"letter-spacing: normal; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: = 12px;" class=3D""><br = class=3D"Apple-interchange-newline"></span></div><span = style=3D"letter-spacing: normal; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: = 12px;" class=3D""><br class=3D"Apple-interchange-newline"></span></div><br= class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"><br = class=3D"Apple-interchange-newline"> </div> <br = class=3D""></div></div></div>_____________________________________________= __<br class=3D"">Users mailing list<br class=3D""><a = href=3D"mailto:Users@ovirt.org" class=3D"">Users@ovirt.org</a><br = class=3D"">http://lists.ovirt.org/mailman/listinfo/users<br = class=3D""></div></blockquote></div><br class=3D""></div></body></html>= --Apple-Mail=_BAF15BEA-8FDA-4D03-BB2D-2DC2DF696E4C--
participants (1)
-
Gary Pedretty