Re: [ovirt-users] hosted_storage locked

It seems that the import of the storage domain failed since it was inaccessible: 2016-12-28 07:06:25,406 ERROR [org.ovirt.engine.core.bll.storage.domain.GetExistingStorageDomainListQuery] (org.ovirt.thread.pool-6-thread-46) [] Exception: org.ovirt.engine.core.common.errors.EngineException: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HSMGetStorageDomainInfoVDS, error = Domain is either partially accessible or entirely inaccessible: (u'247b250c-ccd3-4056-853f-f03a05369da9',), code = 379 (Failed with error StorageDomainAccessError and code 379) .... 2016-12-28 07:06:25,413 ERROR [org.ovirt.engine.core.bll.storage.domain.ImportHostedEngineStorageDomainCommand] (org.ovirt.thread.pool-6-thread-46) [] Failed query for all Storage Domains. The import command can not proceed without this info Once that happened the command was logged in the db as failed, and every engine restart the engine tries to run it again (compensate mechanism). However, since the import storage domain command is not "compensatable" this fails and the domain remains locked. 2016-12-28 07:09:02,643 ERROR [org.ovirt.engine.core.bll.CommandsFactory] (ServerService Thread Pool -- 56) [] CommandsFactory : Failed to get type information using reflection for Class 'org.ovirt.engine.core.bll.storage.domain.ImportHostedEngineStorageDomainCommand', Command Id '2ab30734-bbe4-4f50-897f-f1b393a31852': org.ovirt.engine.core.bll.storage.domain.ImportHostedEngineStorageDomainCommand.<init>(org.ovirt.engine.core.compat.Guid) 2016-12-28 07:09:02,643 ERROR [org.ovirt.engine.core.bll.CommandsFactory] (ServerService Thread Pool -- 56) [] Exception: java.lang.NoSuchMethodException: org.ovirt.engine.core.bll.storage.domain.ImportHostedEngineStorageDomainCommand.<init>(org.ovirt.engine.core.compat.Guid) .... 2016-12-28 07:09:02,646 ERROR [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 56) [] Failed to run compensation on startup for Command 'org.ovirt.engine.core.bll.storage.domain.ImportHostedEngineStorageDomainCommand', Command Id '2ab30734-bbe4-4f50-897f-f1b393a31852' I would suggest: 1. Verify the you can access the storage domain. 2. If you can access the domain, you can try removing it from the ui (I think the destroy option should be available). After the removal the engine will try to reimport it, and hopefully will succeed. Removing the storage domain may cause the engine and the ha-agent to restart. Jenny On Wed, Dec 28, 2016 at 6:29 PM, Gary Pedretty <gary@ravnalaska.net> wrote:
Here is the engine log from the engine vm.
Gary
------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net <gary@eraalaska.net> Systems Manager www.flyravn.com Ravn Alaska /\ 907-450-7251 <(907)%20450-7251> 5245 Airport Industrial Road / \/\ 907-450-7238 <(907)%20450-7238> fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving All of Alaska / \/ /\ \ \/\ “Love your neighbor as Really loving the record green up date! Summmer!! yourself” Matt 22:39 ------------------------------------------------------------------------
On Dec 28, 2016, at 1:12 AM, Evgenia Tokar <etokar@redhat.com> wrote:
Hi!
Can you attach the engine log from the hosted engine vm?
Thanks, Jenny
On Wed, Dec 28, 2016 at 10:56 AM, Gary Pedretty <gary@ravnalaska.net> wrote:
Just setup a new hosted-engine Data Center. With 3 hosts and gluster based storage domains. Used the latest installers. Everything went well, until I got the engine deployed and each host setup and went to the web interface for the first time.
After adding the master storage domain, the hosted_storage added itself like usual, but remained locked. Everything is working just fine with the exception of no listing of the engine as a VM under that tab or the icon on the current host. The Volumes tab does not show anything on the hosted_storage, but all the other volumes including the master data and a second data all show normal status for bricks. Error log is not reporting anything unusual either. All the gluster volumes including the engine (hosted_storage) show good status via command line in the hosts.
Going to let it run for a day or so before I add any VMs.
Any ideas?
Gary
------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net <gary@eraalaska.net> Systems Manager www.flyravn.com Ravn Alaska /\ 907-450-7251 <(907)%20450-7251> 5245 Airport Industrial Road / \/\ 907-450-7238 <(907)%20450-7238> fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving All of Alaska / \/ /\ \ \/\ “Love your neighbor as Really loving the record green up date! Summmer!! yourself” Matt 22:39 ------------------------------------------------------------------------
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

--Apple-Mail=_D3EDACCA-395D-489C-B4BF-AC71A61ECFBD Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Destroying it was going to be my next move, just wanted to make sure = that was the best option. Yes I can mount the gluster volume = =E2=80=9Cengine=E2=80=9D directly on one of the hosts without issue. = The engine is obviously accessing it ok or at least enough that it can = run as a VM image located on it. =20 I will shut down any other VMs before trying this, but it makes sense = that it should just re-import it. Thanks Gary ------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net = <mailto:gary@eraalaska.net> Systems Manager www.flyravn.com = <http://www.flyravn.com/> Ravn Alaska /\ 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving All of Alaska / \/ /\ \ \/\ =E2=80=9CLove your = neighbor as Really loving the record green up date! Summmer!! yourself=E2=80=9D = Matt 22:39 ------------------------------------------------------------------------
On Dec 29, 2016, at 12:38 AM, Evgenia Tokar <etokar@redhat.com> wrote: =20 =20 I would suggest: 1. Verify the you can access the storage domain.=20 2. If you can access the domain, you can try removing it from the ui = (I think the destroy option should be available).=20 After the removal the engine will try to reimport it, and = hopefully will succeed.=20 Removing the storage domain may cause the engine and the ha-agent = to restart.=20 =20 Jenny =20 =20
--Apple-Mail=_D3EDACCA-395D-489C-B4BF-AC71A61ECFBD Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">Destroying it was going to be my next move, just wanted to = make sure that was the best option. Yes I can mount the gluster = volume =E2=80=9Cengine=E2=80=9D directly on one of the hosts without = issue. The engine is obviously accessing it ok or at least enough = that it can run as a VM image located on it. <div class=3D""><br = class=3D""></div><div class=3D"">I will shut down any other VMs before = trying this, but it makes sense that it should just re-import = it.</div><div class=3D""><br class=3D""></div><div = class=3D"">Thanks</div><div class=3D""><br class=3D""></div><div = class=3D"">Gary</div><div class=3D""><br class=3D""></div><div = class=3D""><br class=3D""><div class=3D""> <div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; orphans: = auto; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); font-size: 12px; letter-spacing: normal; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div><div class=3D"">Gary Pedretty = = <a = href=3D"mailto:gary@eraalaska.net" = class=3D"">gary@ravnalaska.net</a></div><div class=3D"">Systems Manager = = = <a href=3D"http://www.flyravn.com" = class=3D"">www.flyravn.com</a></div><div class=3D"">Ravn Alaska = = /\ = 907-450-7251</div><div class=3D"">5245 Airport Industrial = Road / \/\ = 907-450-7238 fax</div><div class=3D"">Fairbanks, Alaska = 99709 /\ / \ \ = Second greatest commandment</div></font><font face=3D"Monaco" = class=3D""><span style=3D"font-size: 12px;" class=3D"">Serving All of = Alaska / \/ /\ \ \/\ = =E2=80=9CLove your neighbor as</span></font><br = style=3D"font-family: Monaco;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px;" class=3D""><span style=3D"font-size: 12px;" class=3D"">Really = loving the record green up date! Summmer!! yourself=E2=80=9D M= att 22:39</span></font><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: Menlo;" = class=3D""></div><font face=3D"Menlo" style=3D"font-size: 12px;" = class=3D""></font><span style=3D"color: rgb(0, 0, 0); letter-spacing: = normal; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; font-size: 12px;" class=3D""><font = face=3D"Menlo" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div></font></span><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D""><font = face=3D"Menlo" style=3D"font-size: 12px;" class=3D""><br = class=3D""></font></div></div><span style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" = class=3D""><br = class=3D"Apple-interchange-newline"></span></div></div></div></div></div><= /div></div></div><br class=3D"Apple-interchange-newline"> </div> <br class=3D""><div><blockquote type=3D"cite" class=3D""><div = class=3D"">On Dec 29, 2016, at 12:38 AM, Evgenia Tokar <<a = href=3D"mailto:etokar@redhat.com" class=3D"">etokar@redhat.com</a>> = wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><div = style=3D"font-family: LucidaGrande; font-size: 13px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><br = class=3D"Apple-interchange-newline">I would suggest:<br = class=3D""></div><div style=3D"font-family: LucidaGrande; font-size: = 13px; font-style: normal; font-variant-caps: normal; font-weight: = normal; letter-spacing: normal; orphans: auto; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; widows: = auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D"">1. = Verify the you can access the storage domain.<span = class=3D"Apple-converted-space"> </span><br class=3D""></div><div = style=3D"font-family: LucidaGrande; font-size: 13px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D"">2. If you can access the = domain, you can try removing it from the ui (I think the destroy option = should be available).<span = class=3D"Apple-converted-space"> </span><br = class=3D""> After the removal the engine will try to = reimport it, and hopefully will succeed.<span = class=3D"Apple-converted-space"> </span><br class=3D""></div><div = style=3D"font-family: LucidaGrande; font-size: 13px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""> Removing = the storage domain may cause the engine and the ha-agent to = restart.<span class=3D"Apple-converted-space"> </span><br = class=3D""></div><div style=3D"font-family: LucidaGrande; font-size: = 13px; font-style: normal; font-variant-caps: normal; font-weight: = normal; letter-spacing: normal; orphans: auto; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; widows: = auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D""><br = class=3D""></div><div style=3D"font-family: LucidaGrande; font-size: = 13px; font-style: normal; font-variant-caps: normal; font-weight: = normal; letter-spacing: normal; orphans: auto; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; widows: = auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" = class=3D"">Jenny<br class=3D""></div><div style=3D"font-family: = LucidaGrande; font-size: 13px; font-style: normal; font-variant-caps: = normal; font-weight: normal; letter-spacing: normal; orphans: auto; = text-align: start; text-indent: 0px; text-transform: none; white-space: = normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: = 0px;" class=3D""><br class=3D""></div><div dir=3D"rtl" = style=3D"font-family: LucidaGrande; font-size: 13px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""> <span = class=3D"Apple-converted-space"> </span></div></div></blockquote></di= v><br class=3D""></div></body></html>= --Apple-Mail=_D3EDACCA-395D-489C-B4BF-AC71A61ECFBD--

--Apple-Mail=_356D479E-52E2-4C32-A382-CD880D346AF4 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Ok so I tried destroying the storage domain. The system then tried to = import it automatically again but it failed with the following event = logged in the Manager Events Log Failed to attach Storage Domain hosted_storage to Data Center DOH. = (User: SYSTEM) I tried this twice and same thing each time. If I try to mount the gluster volume on one of the hosts, it will mount = just fine and I can see all the files and it is read/writeable by root. Nothing unusual in the glusterfs volume status etc. Gary ------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net = <mailto:gary@eraalaska.net> Systems Manager www.flyravn.com = <http://www.flyravn.com/> Ravn Alaska /\ 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving All of Alaska / \/ /\ \ \/\ =E2=80=9CLove your = neighbor as Really loving the record green up date! Summmer!! yourself=E2=80=9D = Matt 22:39 ------------------------------------------------------------------------
On Dec 29, 2016, at 12:38 AM, Evgenia Tokar <etokar@redhat.com> wrote: =20 =20 I would suggest: 1. Verify the you can access the storage domain.=20 2. If you can access the domain, you can try removing it from the ui = (I think the destroy option should be available).=20 After the removal the engine will try to reimport it, and = hopefully will succeed.=20 Removing the storage domain may cause the engine and the ha-agent = to restart.=20 =20 Jenny =20
--Apple-Mail=_356D479E-52E2-4C32-A382-CD880D346AF4 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">Ok so I tried destroying the storage domain. The system = then tried to import it automatically again but it failed with the = following event logged in the Manager Events Log<div class=3D""><br = class=3D""></div><div class=3D"">Failed to attach Storage Domain = hosted_storage to Data Center DOH. (User: SYSTEM)</div><div class=3D""><br= class=3D""></div><div class=3D"">I tried this twice and same thing each = time.</div><div class=3D""><br class=3D""></div><div class=3D""><br = class=3D""></div><div class=3D"">If I try to mount the gluster volume on = one of the hosts, it will mount just fine and I can see all the files = and it is read/writeable by root.</div><div class=3D""><br = class=3D""></div><div class=3D"">Nothing unusual in the glusterfs volume = status etc.</div><div class=3D""><br class=3D""></div><div class=3D""><br = class=3D""></div><div class=3D"">Gary</div><div class=3D""><br = class=3D""></div><div class=3D""><br class=3D""></div><div class=3D""><div= class=3D""> <div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; orphans: = auto; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><div style=3D"orphans: = auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: auto; text-align: = start; text-indent: 0px; widows: auto; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: auto; text-align: start; text-indent: = 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); font-size: 12px; letter-spacing: normal; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div><div class=3D"">Gary Pedretty = = <a = href=3D"mailto:gary@eraalaska.net" = class=3D"">gary@ravnalaska.net</a></div><div class=3D"">Systems Manager = = = <a href=3D"http://www.flyravn.com" = class=3D"">www.flyravn.com</a></div><div class=3D"">Ravn Alaska = = /\ = 907-450-7251</div><div class=3D"">5245 Airport Industrial = Road / \/\ = 907-450-7238 fax</div><div class=3D"">Fairbanks, Alaska = 99709 /\ / \ \ = Second greatest commandment</div></font><font face=3D"Monaco" = class=3D""><span style=3D"font-size: 12px;" class=3D"">Serving All of = Alaska / \/ /\ \ \/\ = =E2=80=9CLove your neighbor as</span></font><br = style=3D"font-family: Monaco;" class=3D""><font face=3D"Menlo" = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px;" class=3D""><span style=3D"font-size: 12px;" class=3D"">Really = loving the record green up date! Summmer!! yourself=E2=80=9D M= att 22:39</span></font><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: Menlo;" = class=3D""></div><font face=3D"Menlo" style=3D"font-size: 12px;" = class=3D""></font><span style=3D"color: rgb(0, 0, 0); letter-spacing: = normal; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; font-size: 12px;" class=3D""><font = face=3D"Menlo" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div></font></span><div style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D""><font = face=3D"Menlo" style=3D"font-size: 12px;" class=3D""><br = class=3D""></font></div></div><span style=3D"color: rgb(0, 0, 0); = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" = class=3D""><br class=3D"Apple-interchange-newline"></span></div><span = style=3D"color: rgb(0, 0, 0); letter-spacing: normal; text-transform: = none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; font-size: 12px;" class=3D""><br = class=3D"Apple-interchange-newline"></span></div><span style=3D"color: = rgb(0, 0, 0); letter-spacing: normal; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: = 12px;" class=3D""><br class=3D"Apple-interchange-newline"></span></div><br= class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"><br = class=3D"Apple-interchange-newline"> </div> <br class=3D""><div><blockquote type=3D"cite" class=3D""><div = class=3D"">On Dec 29, 2016, at 12:38 AM, Evgenia Tokar <<a = href=3D"mailto:etokar@redhat.com" class=3D"">etokar@redhat.com</a>> = wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><div = style=3D"font-family: LucidaGrande; font-size: 13px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><br = class=3D"Apple-interchange-newline">I would suggest:<br = class=3D""></div><div style=3D"font-family: LucidaGrande; font-size: = 13px; font-style: normal; font-variant-caps: normal; font-weight: = normal; letter-spacing: normal; orphans: auto; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; widows: = auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D"">1. = Verify the you can access the storage domain.<span = class=3D"Apple-converted-space"> </span><br class=3D""></div><div = style=3D"font-family: LucidaGrande; font-size: 13px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D"">2. If you can access the = domain, you can try removing it from the ui (I think the destroy option = should be available).<span = class=3D"Apple-converted-space"> </span><br = class=3D""> After the removal the engine will try to = reimport it, and hopefully will succeed.<span = class=3D"Apple-converted-space"> </span><br class=3D""></div><div = style=3D"font-family: LucidaGrande; font-size: 13px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""> Removing = the storage domain may cause the engine and the ha-agent to = restart.<span class=3D"Apple-converted-space"> </span><br = class=3D""></div><div style=3D"font-family: LucidaGrande; font-size: = 13px; font-style: normal; font-variant-caps: normal; font-weight: = normal; letter-spacing: normal; orphans: auto; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; widows: = auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=3D""><br = class=3D""></div><div style=3D"font-family: LucidaGrande; font-size: = 13px; font-style: normal; font-variant-caps: normal; font-weight: = normal; letter-spacing: normal; orphans: auto; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; widows: = auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" = class=3D"">Jenny<br class=3D""></div><br = class=3D"Apple-interchange-newline"></div></blockquote></div><br = class=3D""></div></body></html>= --Apple-Mail=_356D479E-52E2-4C32-A382-CD880D346AF4--

--Apple-Mail=_B90D7F8D-C894-461C-B7AB-E6150E9DE16E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 I tried one more thing. Not sure if this is what fixed it, but the = hosts and the engine were on different timezones. The hosts were all on = AKST -9 UTC and the engine was on the default of UTC. I changed the = timezone on the engine to match the hosts and destroyed the = hosted_storage domain again. This time it re-imported it without any = problems. Thanks Gary ------------------------------------------------------------------------ Gary Pedretty gary@ravnalaska.net Systems Manager www.flyravn.com Ravn Alaska /\ 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving Alaska's Interior / \/ /\ \ \/\ "Love your neighbor as Having a heatwave, its summer yourself=E2=80=9D = Matt 22:39 ------------------------------------------------------------------------
On Dec 29, 2016, at 3:13 PM, Gary Pedretty <gary@ravnalaska.net> = wrote: =20 Ok so I tried destroying the storage domain. The system then tried to = import it automatically again but it failed with the following event = logged in the Manager Events Log =20 Failed to attach Storage Domain hosted_storage to Data Center DOH. = (User: SYSTEM) =20 I tried this twice and same thing each time. =20 =20 If I try to mount the gluster volume on one of the hosts, it will = mount just fine and I can see all the files and it is read/writeable by = root. =20 Nothing unusual in the glusterfs volume status etc. =20 =20 Gary =20 =20
</span></div></span></div></span></div></span></div></span></div></span><= /div></span></div></span></div></span></div></span></div></span></div></sp= an></div></span></div></span></div></span></div></span></div></span></div>= </span></div></span></div></span></div></span></div></span></div></span><s=
</div></span></div></span></div></span></div></span></div></span></div></= span></div></span></div></span></div></span></div></span></div></span></di= v></span></div></span></div></span></div></span></div></span></div></span>= </div></span></div></span></div></span></div></span></div></span></div></s=
--Apple-Mail=_B90D7F8D-C894-461C-B7AB-E6150E9DE16E Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">I tried one more thing. Not sure if this is what fixed = it, but the hosts and the engine were on different timezones. The = hosts were all on AKST -9 UTC and the engine was on the default of UTC. = I changed the timezone on the engine to match the hosts and = destroyed the hosted_storage domain again. This time it = re-imported it without any problems.<div class=3D""><br = class=3D""></div><div class=3D"">Thanks</div><div class=3D""><br = class=3D""></div><div class=3D"">Gary</div><div class=3D""><br = class=3D""><div class=3D""> <div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; orphans: = auto; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); font-family: 'Lucida = Grande'; font-style: normal; font-variant: normal; font-weight: normal; = letter-spacing: normal; line-height: normal; orphans: 2; text-align: = -webkit-auto; text-indent: 0px; text-transform: none; white-space: = normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; = word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"color: rgb(0, 0, 0); = font-family: 'Lucida Grande'; font-style: normal; font-variant: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: = none; white-space: normal; widows: 2; word-spacing: 0px; = -webkit-text-stroke-width: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"color: rgb(0, 0, 0); font-family: Helvetica; = font-style: normal; font-variant: normal; font-weight: normal; = letter-spacing: normal; line-height: normal; orphans: 2; text-align: = -webkit-auto; text-indent: 0px; text-transform: none; white-space: = normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; = word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: 2; text-align: = -webkit-auto; text-indent: 0px; widows: 2; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: 2; text-align: -webkit-auto; = text-indent: 0px; widows: 2; word-wrap: break-word; -webkit-nbsp-mode: = space; -webkit-line-break: after-white-space;" class=3D""><div = style=3D"orphans: 2; text-align: -webkit-auto; text-indent: 0px; widows: = 2; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: 2; text-align: = -webkit-auto; text-indent: 0px; widows: 2; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: 2; text-align: -webkit-auto; = text-indent: 0px; widows: 2; word-wrap: break-word; -webkit-nbsp-mode: = space; -webkit-line-break: after-white-space;" class=3D""><div = style=3D"orphans: 2; text-align: -webkit-auto; text-indent: 0px; widows: = 2; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: 2; text-align: = -webkit-auto; text-indent: 0px; widows: 2; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div style=3D"orphans: 2; text-align: -webkit-auto; = text-indent: 0px; widows: 2; word-wrap: break-word; -webkit-nbsp-mode: = space; -webkit-line-break: after-white-space;" class=3D""><div = style=3D"orphans: 2; text-align: -webkit-auto; text-indent: 0px; widows: = 2; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><div style=3D"orphans: 2; text-align: = -webkit-auto; text-indent: 0px; widows: 2; word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-align: -webkit-auto; text-indent: 0px; = widows: 2; border-spacing: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; orphans: 2; text-indent: 0px; widows: 2; border-spacing: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px;"><div = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; orphans: = 2; text-indent: 0px; widows: 2; border-spacing: 0px; font-size: = 12px;"><div class=3D"AppleMailSignature" = id=3D"2393307F-E696-4D63-8DBB-654DCF9942AA"><div class=3D""><font = face=3D"Monaco" = class=3D"">---------------------------------------------------------------= ---------</font></div><div class=3D""><font face=3D"Monaco" = class=3D"">Gary Pedretty = = <a href=3D"mailto:gary@ravnalaska.net" = class=3D"">gary@ravnalaska.net</a></font></div><div class=3D""><font = face=3D"Monaco" class=3D"">Systems Manager = = <a = href=3D"http://www.flyravn.com" = class=3D"">www.flyravn.com</a></font></div><div class=3D""><font = face=3D"Monaco" class=3D"">Ravn Alaska = /\ = = 907-450-7251</font></div><div class=3D""><font face=3D"Monaco" = class=3D"">5245 Airport Industrial Road / = \/\ 907-450-7238 = fax</font></div><div class=3D""><font face=3D"Monaco" = class=3D"">Fairbanks, Alaska 99709 /\ = / \ \ Second greatest commandment</font></div><div = class=3D""><font face=3D"Monaco" class=3D"">Serving Alaska's Interior = / \/ /\ \ \/\ "Love your = neighbor as</font></div><font face=3D"Menlo" class=3D"" style=3D"orphans: = auto; widows: auto;">Having a heatwave, its summer = = yourself=E2=80=9D Matt 22:39</font><div class=3D"" style=3D"orphans: = auto; widows: auto; font-family: Menlo;"></div><font face=3D"Menlo" = class=3D"" style=3D"orphans: auto; widows: auto;"></font><div = style=3D"font-family: 'Lucida Grande';" class=3D""><span = style=3D"font-family: Monaco; text-align: -webkit-auto;" = class=3D"">---------------------------------------------------------------= ---------</span></div><div class=3D""><br = class=3D""></div></div></span></div></span></div></span></div></span></div= pan class=3D"Apple-style-span" style=3D"font-family: 'Lucida Grande'; = border-collapse: separate; border-spacing: 0px;"><div style=3D"word-wrap: = break-word; -webkit-nbsp-mode: space; -webkit-line-break: = after-white-space;" class=3D""><span class=3D"Apple-style-span" = style=3D"border-collapse: separate; color: rgb(0, 0, 0); font-style: = normal; font-variant: normal; font-weight: normal; letter-spacing: = normal; line-height: normal; orphans: 2; text-align: -webkit-auto; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"font-family: 'Lucida Grande'; = border-collapse: separate; color: rgb(0, 0, 0); font-style: normal; = font-variant: normal; font-weight: normal; letter-spacing: normal; = line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: = 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: = 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; font-variant: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: = none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: = 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; font-variant: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: = none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: = 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; font-variant: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: = none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: = 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; font-variant: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: = none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: = 0px; -webkit-text-decorations-in-effect: none; = -webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><span class=3D"Apple-style-span" style=3D"border-collapse: = separate; color: rgb(0, 0, 0); font-style: normal; font-variant: normal; = font-weight: normal; letter-spacing: normal; line-height: normal; = orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; = widows: 2; word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px;"><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; color: = rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; orphans: 2; = text-indent: 0px; text-transform: none; white-space: normal; widows: 2; = word-spacing: 0px; border-spacing: 0px; = -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: = 0px; font-size: 12px;"><div style=3D"font-family: 'Lucida Grande';" = class=3D""><br class=3D"khtml-block-placeholder"></div><br = class=3D"Apple-interchange-newline"></span><br = class=3D"Apple-interchange-newline"></div></span></div></span></div></span= pan></div></span></div></span></div></div></div></div></div></div></div></= div></div></div></div></div></div></div></div></div></div></div> </div> <br class=3D""><div><blockquote type=3D"cite" class=3D""><div = class=3D"">On Dec 29, 2016, at 3:13 PM, Gary Pedretty <<a = href=3D"mailto:gary@ravnalaska.net" class=3D"">gary@ravnalaska.net</a>>= wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><span= style=3D"font-family: Monaco; font-size: 12px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px; float: none; display: inline = !important;" class=3D"">Ok so I tried destroying the storage domain. = The system then tried to import it automatically again but it = failed with the following event logged in the Manager Events = Log</span><div class=3D"" style=3D"font-family: Monaco; font-size: 12px; = font-style: normal; font-variant-caps: normal; font-weight: normal; = letter-spacing: normal; orphans: auto; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; widows: auto; = word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br = class=3D""></div><div class=3D"" style=3D"font-family: Monaco; = font-size: 12px; font-style: normal; font-variant-caps: normal; = font-weight: normal; letter-spacing: normal; orphans: auto; text-align: = start; text-indent: 0px; text-transform: none; white-space: normal; = widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;">Failed = to attach Storage Domain hosted_storage to Data Center DOH. (User: = SYSTEM)</div><div class=3D"" style=3D"font-family: Monaco; font-size: = 12px; font-style: normal; font-variant-caps: normal; font-weight: = normal; letter-spacing: normal; orphans: auto; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; widows: = auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br = class=3D""></div><div class=3D"" style=3D"font-family: Monaco; = font-size: 12px; font-style: normal; font-variant-caps: normal; = font-weight: normal; letter-spacing: normal; orphans: auto; text-align: = start; text-indent: 0px; text-transform: none; white-space: normal; = widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;">I = tried this twice and same thing each time.</div><div class=3D"" = style=3D"font-family: Monaco; font-size: 12px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;"><br class=3D""></div><div class=3D"" = style=3D"font-family: Monaco; font-size: 12px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;"><br class=3D""></div><div class=3D"" = style=3D"font-family: Monaco; font-size: 12px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;">If I try to mount the gluster volume on = one of the hosts, it will mount just fine and I can see all the files = and it is read/writeable by root.</div><div class=3D"" = style=3D"font-family: Monaco; font-size: 12px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;"><br class=3D""></div><div class=3D"" = style=3D"font-family: Monaco; font-size: 12px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = orphans: auto; text-align: start; text-indent: 0px; text-transform: = none; white-space: normal; widows: auto; word-spacing: 0px; = -webkit-text-stroke-width: 0px;">Nothing unusual in the glusterfs volume = status etc.</div><div class=3D"" style=3D"font-family: Monaco; = font-size: 12px; font-style: normal; font-variant-caps: normal; = font-weight: normal; letter-spacing: normal; orphans: auto; text-align: = start; text-indent: 0px; text-transform: none; white-space: normal; = widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br = class=3D""></div><div class=3D"" style=3D"font-family: Monaco; = font-size: 12px; font-style: normal; font-variant-caps: normal; = font-weight: normal; letter-spacing: normal; orphans: auto; text-align: = start; text-indent: 0px; text-transform: none; white-space: normal; = widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br = class=3D""></div><div class=3D"" style=3D"font-family: Monaco; = font-size: 12px; font-style: normal; font-variant-caps: normal; = font-weight: normal; letter-spacing: normal; orphans: auto; text-align: = start; text-indent: 0px; text-transform: none; white-space: normal; = widows: auto; word-spacing: 0px; -webkit-text-stroke-width: = 0px;">Gary</div><div class=3D"" style=3D"font-family: Monaco; font-size: = 12px; font-style: normal; font-variant-caps: normal; font-weight: = normal; letter-spacing: normal; orphans: auto; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; widows: = auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br = class=3D""></div><br = class=3D"Apple-interchange-newline"></div></blockquote></div><br = class=3D""></div></body></html>= --Apple-Mail=_B90D7F8D-C894-461C-B7AB-E6150E9DE16E--
participants (2)
-
Evgenia Tokar
-
Gary Pedretty