From mjames at media-node.com Wed Jul 16 14:21:16 2014 Content-Type: multipart/mixed; boundary="===============1771267717724007683==" MIME-Version: 1.0 From: Maurice James To: users at ovirt.org Subject: [ovirt-users] Missing Storage domain Date: Wed, 16 Jul 2014 14:21:13 -0400 Message-ID: <1524840360.12516.1405534873680.JavaMail.zimbra@media-node.com> --===============1771267717724007683== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_12515_719070347.1405534873658 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit What do I do when a host in a cluster cant find a storage domain that "it t= hinks" doesnt exist? The storage domain is in the db and is online because = one of the other hosts is working just fine. I pulled this out of the vdsm.= log. I even tried rebooting = Thread-30::ERROR::2014-07-16 14:19:10,522::domainMonitor::239::Storage.Doma= inMonitorThread::(_monitorDomain) Error while collecting domain b7663d70-e6= 58-41fa-b9f0-8da83c9eddce monitoring information = Traceback (most recent call last): = File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomai= n = self.domain =3D sdCache.produce(self.sdUUID) = File "/usr/share/vdsm/storage/sdc.py", line 98, in produce = domain.getRealDomain() = File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain = return self._cache._realProduce(self._sdUUID) = File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce = domain =3D self._findDomain(sdUUID) = File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain = dom =3D findMethod(sdUUID) = File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain = raise se.StorageDomainDoesNotExist(sdUUID) = StorageDomainDoesNotExist: Storage domain does not exist: ('b7663d70-e658-4= 1fa-b9f0-8da83c9eddce',) = ------=3D_Part_12515_719070347.1405534873658 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable
What do I do when a host in a cl= =3D uster cant find a storage domain that "it thinks" doesnt exist? The storage= =3D domain is in the db and is online because one of the other hosts is workin= =3D g just fine. I pulled this out of the vdsm.log. I even tried rebooting
<= =3D /div>


Thread-30::ERROR::2014-07-16 14:19:= =3D 10,522::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) E= =3D rror while collecting domain b7663d70-e658-41fa-b9f0-8da83c9eddce monitorin= =3D g information
Traceback (most recent call last):
  File "/usr/sh= =3D are/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
 &n= =3D bsp;  self.domain =3D3D sdCache.produce(self.sdUUID)
  File "/= us=3D r/share/vdsm/storage/sdc.py", line 98, in produce
    dom= =3D ain.getRealDomain()
  File "/usr/share/vdsm/storage/sdc.py", line 5= =3D 2, in getRealDomain
    return self._cache._realProduce(s= =3D elf._sdUUID)
  File "/usr/share/vdsm/storage/sdc.py", line 122, in = =3D _realProduce
    domain =3D3D self._findDomain(sdUUID)&=3D nbsp; File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
&n= =3D bsp;   dom =3D3D findMethod(sdUUID)
  File "/usr/share/vd= sm=3D /storage/sdc.py", line 171, in _findUnfetchedDomain
    r= =3D aise se.StorageDomainDoesNotExist(sdUUID)
StorageDomainDoesNotExist: Sto= =3D rage domain does not exist: ('b7663d70-e658-41fa-b9f0-8da83c9eddce',)
------=3D_Part_12515_719070347.1405534873658-- --===============1771267717724007683== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzEyNTE1XzcxOTA3MDM0Ny4xNDA1NTM0ODczNjU4CkNvbnRlbnQtVHlwZTog dGV4dC9wbGFpbjsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3Yml0 CgpXaGF0IGRvIEkgZG8gd2hlbiBhIGhvc3QgaW4gYSBjbHVzdGVyIGNhbnQgZmluZCBhIHN0b3Jh Z2UgZG9tYWluIHRoYXQgIml0IHRoaW5rcyIgZG9lc250IGV4aXN0PyBUaGUgc3RvcmFnZSBkb21h aW4gaXMgaW4gdGhlIGRiIGFuZCBpcyBvbmxpbmUgYmVjYXVzZSBvbmUgb2YgdGhlIG90aGVyIGhv c3RzIGlzIHdvcmtpbmcganVzdCBmaW5lLiBJIHB1bGxlZCB0aGlzIG91dCBvZiB0aGUgdmRzbS5s b2cuIEkgZXZlbiB0cmllZCByZWJvb3RpbmcgCgoKVGhyZWFkLTMwOjpFUlJPUjo6MjAxNC0wNy0x NiAxNDoxOToxMCw1MjI6OmRvbWFpbk1vbml0b3I6OjIzOTo6U3RvcmFnZS5Eb21haW5Nb25pdG9y VGhyZWFkOjooX21vbml0b3JEb21haW4pIEVycm9yIHdoaWxlIGNvbGxlY3RpbmcgZG9tYWluIGI3 NjYzZDcwLWU2NTgtNDFmYS1iOWYwLThkYTgzYzllZGRjZSBtb25pdG9yaW5nIGluZm9ybWF0aW9u IApUcmFjZWJhY2sgKG1vc3QgcmVjZW50IGNhbGwgbGFzdCk6IApGaWxlICIvdXNyL3NoYXJlL3Zk c20vc3RvcmFnZS9kb21haW5Nb25pdG9yLnB5IiwgbGluZSAyMDQsIGluIF9tb25pdG9yRG9tYWlu IApzZWxmLmRvbWFpbiA9IHNkQ2FjaGUucHJvZHVjZShzZWxmLnNkVVVJRCkgCkZpbGUgIi91c3Iv c2hhcmUvdmRzbS9zdG9yYWdlL3NkYy5weSIsIGxpbmUgOTgsIGluIHByb2R1Y2UgCmRvbWFpbi5n ZXRSZWFsRG9tYWluKCkgCkZpbGUgIi91c3Ivc2hhcmUvdmRzbS9zdG9yYWdlL3NkYy5weSIsIGxp bmUgNTIsIGluIGdldFJlYWxEb21haW4gCnJldHVybiBzZWxmLl9jYWNoZS5fcmVhbFByb2R1Y2Uo c2VsZi5fc2RVVUlEKSAKRmlsZSAiL3Vzci9zaGFyZS92ZHNtL3N0b3JhZ2Uvc2RjLnB5IiwgbGlu ZSAxMjIsIGluIF9yZWFsUHJvZHVjZSAKZG9tYWluID0gc2VsZi5fZmluZERvbWFpbihzZFVVSUQp IApGaWxlICIvdXNyL3NoYXJlL3Zkc20vc3RvcmFnZS9zZGMucHkiLCBsaW5lIDE0MSwgaW4gX2Zp bmREb21haW4gCmRvbSA9IGZpbmRNZXRob2Qoc2RVVUlEKSAKRmlsZSAiL3Vzci9zaGFyZS92ZHNt L3N0b3JhZ2Uvc2RjLnB5IiwgbGluZSAxNzEsIGluIF9maW5kVW5mZXRjaGVkRG9tYWluIApyYWlz ZSBzZS5TdG9yYWdlRG9tYWluRG9lc05vdEV4aXN0KHNkVVVJRCkgClN0b3JhZ2VEb21haW5Eb2Vz Tm90RXhpc3Q6IFN0b3JhZ2UgZG9tYWluIGRvZXMgbm90IGV4aXN0OiAoJ2I3NjYzZDcwLWU2NTgt NDFmYS1iOWYwLThkYTgzYzllZGRjZScsKSAKCgotLS0tLS09X1BhcnRfMTI1MTVfNzE5MDcwMzQ3 LjE0MDU1MzQ4NzM2NTgKQ29udGVudC1UeXBlOiB0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgKQ29u dGVudC1UcmFuc2Zlci1FbmNvZGluZzogcXVvdGVkLXByaW50YWJsZQoKPGh0bWw+PGJvZHk+PGRp diBzdHlsZT0zRCJmb250LWZhbWlseTogdGltZXMgbmV3IHJvbWFuLCBuZXcgeW9yaywgdGltZXMs IHNlPQpyaWY7IGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6ICMwMDAwMDAiPjxkaXY+V2hhdCBkbyBJ IGRvIHdoZW4gYSBob3N0IGluIGEgY2w9CnVzdGVyIGNhbnQgZmluZCBhIHN0b3JhZ2UgZG9tYWlu IHRoYXQgIml0IHRoaW5rcyIgZG9lc250IGV4aXN0PyBUaGUgc3RvcmFnZT0KIGRvbWFpbiBpcyBp biB0aGUgZGIgYW5kIGlzIG9ubGluZSBiZWNhdXNlIG9uZSBvZiB0aGUgb3RoZXIgaG9zdHMgaXMg d29ya2luPQpnIGp1c3QgZmluZS4gSSBwdWxsZWQgdGhpcyBvdXQgb2YgdGhlIHZkc20ubG9nLiBJ IGV2ZW4gdHJpZWQgcmVib290aW5nPGJyPjw9Ci9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj48YnI+ PC9kaXY+PGRpdj5UaHJlYWQtMzA6OkVSUk9SOjoyMDE0LTA3LTE2IDE0OjE5Oj0KMTAsNTIyOjpk b21haW5Nb25pdG9yOjoyMzk6OlN0b3JhZ2UuRG9tYWluTW9uaXRvclRocmVhZDo6KF9tb25pdG9y RG9tYWluKSBFPQpycm9yIHdoaWxlIGNvbGxlY3RpbmcgZG9tYWluIGI3NjYzZDcwLWU2NTgtNDFm YS1iOWYwLThkYTgzYzllZGRjZSBtb25pdG9yaW49CmcgaW5mb3JtYXRpb248YnI+VHJhY2ViYWNr IChtb3N0IHJlY2VudCBjYWxsIGxhc3QpOjxicj4mbmJzcDsgRmlsZSAiL3Vzci9zaD0KYXJlL3Zk c20vc3RvcmFnZS9kb21haW5Nb25pdG9yLnB5IiwgbGluZSAyMDQsIGluIF9tb25pdG9yRG9tYWlu PGJyPiZuYnNwOyZuPQpic3A7Jm5ic3A7IHNlbGYuZG9tYWluID0zRCBzZENhY2hlLnByb2R1Y2Uo c2VsZi5zZFVVSUQpPGJyPiZuYnNwOyBGaWxlICIvdXM9CnIvc2hhcmUvdmRzbS9zdG9yYWdlL3Nk Yy5weSIsIGxpbmUgOTgsIGluIHByb2R1Y2U8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRvbT0KYWlu LmdldFJlYWxEb21haW4oKTxicj4mbmJzcDsgRmlsZSAiL3Vzci9zaGFyZS92ZHNtL3N0b3JhZ2Uv c2RjLnB5IiwgbGluZSA1PQoyLCBpbiBnZXRSZWFsRG9tYWluPGJyPiZuYnNwOyZuYnNwOyZuYnNw OyByZXR1cm4gc2VsZi5fY2FjaGUuX3JlYWxQcm9kdWNlKHM9CmVsZi5fc2RVVUlEKTxicj4mbmJz cDsgRmlsZSAiL3Vzci9zaGFyZS92ZHNtL3N0b3JhZ2Uvc2RjLnB5IiwgbGluZSAxMjIsIGluID0K X3JlYWxQcm9kdWNlPGJyPiZuYnNwOyZuYnNwOyZuYnNwOyBkb21haW4gPTNEIHNlbGYuX2ZpbmRE b21haW4oc2RVVUlEKTxicj4mPQpuYnNwOyBGaWxlICIvdXNyL3NoYXJlL3Zkc20vc3RvcmFnZS9z ZGMucHkiLCBsaW5lIDE0MSwgaW4gX2ZpbmREb21haW48YnI+Jm49CmJzcDsmbmJzcDsmbmJzcDsg ZG9tID0zRCBmaW5kTWV0aG9kKHNkVVVJRCk8YnI+Jm5ic3A7IEZpbGUgIi91c3Ivc2hhcmUvdmRz bT0KL3N0b3JhZ2Uvc2RjLnB5IiwgbGluZSAxNzEsIGluIF9maW5kVW5mZXRjaGVkRG9tYWluPGJy PiZuYnNwOyZuYnNwOyZuYnNwOyByPQphaXNlIHNlLlN0b3JhZ2VEb21haW5Eb2VzTm90RXhpc3Qo c2RVVUlEKTxicj5TdG9yYWdlRG9tYWluRG9lc05vdEV4aXN0OiBTdG89CnJhZ2UgZG9tYWluIGRv ZXMgbm90IGV4aXN0OiAoJ2I3NjYzZDcwLWU2NTgtNDFmYS1iOWYwLThkYTgzYzllZGRjZScsKTxi cj48Yj0Kcj48L2Rpdj48L2Rpdj48L2JvZHk+PC9odG1sPgotLS0tLS09X1BhcnRfMTI1MTVfNzE5 MDcwMzQ3LjE0MDU1MzQ4NzM2NTgtLQo= --===============1771267717724007683==-- From dron at redhat.com Thu Jul 17 02:53:50 2014 Content-Type: multipart/mixed; boundary="===============3759677340450913458==" MIME-Version: 1.0 From: Dafna Ron To: users at ovirt.org Subject: Re: [ovirt-users] Missing Storage domain Date: Thu, 17 Jul 2014 07:53:46 +0100 Message-ID: <53C772FA.4020408@redhat.com> In-Reply-To: 1524840360.12516.1405534873680.JavaMail.zimbra@media-node.com --===============3759677340450913458== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable even if the other hosts can see the domain, it doesn't mean that there = is no problem from that particular host. if you checked everything and you are positive that the host can see and = connect to the domain please restart vdsm to see that there is no cache = issue. Dafna On 07/16/2014 07:21 PM, Maurice James wrote: > What do I do when a host in a cluster cant find a storage domain that = > "it thinks" doesnt exist? The storage domain is in the db and is = > online because one of the other hosts is working just fine. I pulled = > this out of the vdsm.log. I even tried rebooting > > > Thread-30::ERROR::2014-07-16 = > 14:19:10,522::domainMonitor::239::Storage.DomainMonitorThread::(_monitorD= omain) = > Error while collecting domain b7663d70-e658-41fa-b9f0-8da83c9eddce = > monitoring information > Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in = > _monitorDomain > self.domain =3D sdCache.produce(self.sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 98, in produce > domain.getRealDomain() > File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain > return self._cache._realProduce(self._sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce > domain =3D self._findDomain(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom =3D findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) > StorageDomainDoesNotExist: Storage domain does not exist: = > ('b7663d70-e658-41fa-b9f0-8da83c9eddce',) > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users -- = Dafna Ron --===============3759677340450913458==-- From mjames at media-node.com Thu Jul 17 09:20:23 2014 Content-Type: multipart/mixed; boundary="===============6388305587246708528==" MIME-Version: 1.0 From: Maurice James To: users at ovirt.org Subject: Re: [ovirt-users] Missing Storage domain Date: Thu, 17 Jul 2014 09:20:16 -0400 Message-ID: <1826924876.12588.1405603216846.JavaMail.zimbra@media-node.com> In-Reply-To: 53C772FA.4020408@redhat.com --===============6388305587246708528== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable I ended putting the problematic storage domain into maintenance mode. That = allowed the other hosts to come online. I then rebooted that storage domain= host. That seemed to clear up the problem ----- Original Message ----- From: "Dafna Ron" To: "Maurice James" , "users" Sent: Thursday, July 17, 2014 2:53:46 AM Subject: Re: [ovirt-users] Missing Storage domain even if the other hosts can see the domain, it doesn't mean that there = is no problem from that particular host. if you checked everything and you are positive that the host can see and = connect to the domain please restart vdsm to see that there is no cache = issue. Dafna On 07/16/2014 07:21 PM, Maurice James wrote: > What do I do when a host in a cluster cant find a storage domain that = > "it thinks" doesnt exist? The storage domain is in the db and is = > online because one of the other hosts is working just fine. I pulled = > this out of the vdsm.log. I even tried rebooting > > > Thread-30::ERROR::2014-07-16 = > 14:19:10,522::domainMonitor::239::Storage.DomainMonitorThread::(_monitorD= omain) = > Error while collecting domain b7663d70-e658-41fa-b9f0-8da83c9eddce = > monitoring information > Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in = > _monitorDomain > self.domain =3D sdCache.produce(self.sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 98, in produce > domain.getRealDomain() > File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain > return self._cache._realProduce(self._sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce > domain =3D self._findDomain(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom =3D findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) > StorageDomainDoesNotExist: Storage domain does not exist: = > ('b7663d70-e658-41fa-b9f0-8da83c9eddce',) > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users -- = Dafna Ron --===============6388305587246708528==-- From dron at redhat.com Thu Jul 17 09:22:11 2014 Content-Type: multipart/mixed; boundary="===============2850572178516587544==" MIME-Version: 1.0 From: Dafna Ron To: users at ovirt.org Subject: Re: [ovirt-users] Missing Storage domain Date: Thu, 17 Jul 2014 14:22:07 +0100 Message-ID: <53C7CDFF.4040903@redhat.com> In-Reply-To: 1826924876.12588.1405603216846.JavaMail.zimbra@media-node.com --===============2850572178516587544== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable x10 :) thanks for letting us know it was resolved have a nice one. Dafna On 07/17/2014 02:20 PM, Maurice James wrote: > I ended putting the problematic storage domain into maintenance mode. Tha= t allowed the other hosts to come online. I then rebooted that storage doma= in host. That seemed to clear up the problem > > > > > ----- Original Message ----- > From: "Dafna Ron" > To: "Maurice James" , "users" > Sent: Thursday, July 17, 2014 2:53:46 AM > Subject: Re: [ovirt-users] Missing Storage domain > > even if the other hosts can see the domain, it doesn't mean that there > is no problem from that particular host. > if you checked everything and you are positive that the host can see and > connect to the domain please restart vdsm to see that there is no cache > issue. > > Dafna > > On 07/16/2014 07:21 PM, Maurice James wrote: >> What do I do when a host in a cluster cant find a storage domain that >> "it thinks" doesnt exist? The storage domain is in the db and is >> online because one of the other hosts is working just fine. I pulled >> this out of the vdsm.log. I even tried rebooting >> >> >> Thread-30::ERROR::2014-07-16 >> 14:19:10,522::domainMonitor::239::Storage.DomainMonitorThread::(_monitor= Domain) >> Error while collecting domain b7663d70-e658-41fa-b9f0-8da83c9eddce >> monitoring information >> Traceback (most recent call last): >> File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in >> _monitorDomain >> self.domain =3D sdCache.produce(self.sdUUID) >> File "/usr/share/vdsm/storage/sdc.py", line 98, in produce >> domain.getRealDomain() >> File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain >> return self._cache._realProduce(self._sdUUID) >> File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce >> domain =3D self._findDomain(sdUUID) >> File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain >> dom =3D findMethod(sdUUID) >> File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDom= ain >> raise se.StorageDomainDoesNotExist(sdUUID) >> StorageDomainDoesNotExist: Storage domain does not exist: >> ('b7663d70-e658-41fa-b9f0-8da83c9eddce',) >> >> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users > -- = Dafna Ron --===============2850572178516587544==--