From ofrenkel at redhat.com Sun Mar 10 05:18:17 2013 Content-Type: multipart/mixed; boundary="===============6412771782402274267==" MIME-Version: 1.0 From: Omer Frenkel To: users at ovirt.org Subject: Re: [Users] Cluster, hosts, everything down and totally stuck Date: Sun, 10 Mar 2013 05:18:14 -0400 Message-ID: <794861168.17656344.1362907094519.JavaMail.root@redhat.com> In-Reply-To: CAPNQp047n6QeophmRfYV774UEoopZoZQnpwqUqv_Hb4o37Ne7w@mail.gmail.com --===============6412771782402274267== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_17656343_1071169767.1362907094519 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit ----- Original Message ----- > From: "Matt ." > To: "users" > Sent: Thursday, March 7, 2013 12:03:02 PM > Subject: [Users] Cluster, hosts, everything down and totally stuck > My cluster is totally down and I'm completely stuck. > I cannot set a host in maintenance, stop a VM because it has a > unknown state, so also the host where this one is on. A new added > node cannot find the storage because all are down but the NFS is up. > On the node that is "unknown" all interfaces are up, on the new added > host all are down following ovirt, but are actually up. > Because of this I'm stuck between 2 or 4 walls and I'm not able to > fix this in some way. > What are my options ? I'm thinking of setting the VM that is stuck on > my existing host to off by editing the DB of ovirt. > I hope we can sort this out. > Cheers, > Matt Hi, = it sounds like your host in non-responsive, = can you ping from the engine host to that host? = does vdsm run ok on the host (you can check by running this in the host: vd= sClient 0 getVdsCapabilities) = > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users ------=3D_Part_17656343_1071169767.1362907094519 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable <=3D div style=3D3D'font-family: times new roman,new york,times,serif; font-size= : =3D 12pt; color: #000000'>

From: "Matt .= =3D " <yamakasi.014(a)gmail.com>
To: "users" <users(a)ovirt.= org&=3D gt;
Sent: Thursday, March 7, 2013 12:03:02 PM
Subject: = =3D [Users] Cluster, hosts, everything down and totally stuck

My cluster is totally down and I'm comp= le=3D tely stuck.

I cannot set a host in maintenance, stop a VM beca= =3D use it has a unknown state, so also the host where this one is on. A new ad= =3D ded node cannot find the storage because all are down but the NFS is up.
On the node that is "unknown" all interfaces are up, on the new added h= =3D ost all are down following ovirt, but are actually up.

Because= =3D of this I'm stuck between 2 or 4 walls and I'm not able to fix this in som= =3D e way.

What are my options ? I'm thinking of setting the VM that is stuc= =3D k on my existing host to off by editing the DB of ovirt.

I hop= =3D e we can sort this out.

Cheers,

Matt

Hi,
it sounds like your host in non-responsive,
can = =3D you ping from the engine host to that host?
does vdsm run ok on the host= =3D (you can check by running this in the host: vdsClient 0 getVdsCapabilities= =3D )

_______________________________________________
U= =3D sers mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/li= st=3D info/users

------=3D_Part_17656343_1071169767.1362907094519-- --===============6412771782402274267== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzE3NjU2MzQzXzEwNzExNjk3NjcuMTM2MjkwNzA5NDUxOQpDb250ZW50LVR5 cGU6IHRleHQvcGxhaW47IGNoYXJzZXQ9dXRmLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzog N2JpdAoKLS0tLS0gT3JpZ2luYWwgTWVzc2FnZSAtLS0tLQoKPiBGcm9tOiAiTWF0dCAuIiA8eWFt YWthc2kuMDE0QGdtYWlsLmNvbT4KPiBUbzogInVzZXJzIiA8dXNlcnNAb3ZpcnQub3JnPgo+IFNl bnQ6IFRodXJzZGF5LCBNYXJjaCA3LCAyMDEzIDEyOjAzOjAyIFBNCj4gU3ViamVjdDogW1VzZXJz XSBDbHVzdGVyLCBob3N0cywgZXZlcnl0aGluZyBkb3duIGFuZCB0b3RhbGx5IHN0dWNrCgo+IE15 IGNsdXN0ZXIgaXMgdG90YWxseSBkb3duIGFuZCBJJ20gY29tcGxldGVseSBzdHVjay4KCj4gSSBj YW5ub3Qgc2V0IGEgaG9zdCBpbiBtYWludGVuYW5jZSwgc3RvcCBhIFZNIGJlY2F1c2UgaXQgaGFz IGEKPiB1bmtub3duIHN0YXRlLCBzbyBhbHNvIHRoZSBob3N0IHdoZXJlIHRoaXMgb25lIGlzIG9u LiBBIG5ldyBhZGRlZAo+IG5vZGUgY2Fubm90IGZpbmQgdGhlIHN0b3JhZ2UgYmVjYXVzZSBhbGwg YXJlIGRvd24gYnV0IHRoZSBORlMgaXMgdXAuCgo+IE9uIHRoZSBub2RlIHRoYXQgaXMgInVua25v d24iIGFsbCBpbnRlcmZhY2VzIGFyZSB1cCwgb24gdGhlIG5ldyBhZGRlZAo+IGhvc3QgYWxsIGFy ZSBkb3duIGZvbGxvd2luZyBvdmlydCwgYnV0IGFyZSBhY3R1YWxseSB1cC4KCj4gQmVjYXVzZSBv ZiB0aGlzIEknbSBzdHVjayBiZXR3ZWVuIDIgb3IgNCB3YWxscyBhbmQgSSdtIG5vdCBhYmxlIHRv Cj4gZml4IHRoaXMgaW4gc29tZSB3YXkuCgo+IFdoYXQgYXJlIG15IG9wdGlvbnMgPyBJJ20gdGhp bmtpbmcgb2Ygc2V0dGluZyB0aGUgVk0gdGhhdCBpcyBzdHVjayBvbgo+IG15IGV4aXN0aW5nIGhv c3QgdG8gb2ZmIGJ5IGVkaXRpbmcgdGhlIERCIG9mIG92aXJ0LgoKPiBJIGhvcGUgd2UgY2FuIHNv cnQgdGhpcyBvdXQuCgo+IENoZWVycywKCj4gTWF0dAoKSGksIAppdCBzb3VuZHMgbGlrZSB5b3Vy IGhvc3QgaW4gbm9uLXJlc3BvbnNpdmUsIApjYW4geW91IHBpbmcgZnJvbSB0aGUgZW5naW5lIGhv c3QgdG8gdGhhdCBob3N0PyAKZG9lcyB2ZHNtIHJ1biBvayBvbiB0aGUgaG9zdCAoeW91IGNhbiBj aGVjayBieSBydW5uaW5nIHRoaXMgaW4gdGhlIGhvc3Q6IHZkc0NsaWVudCAwIGdldFZkc0NhcGFi aWxpdGllcykgCgo+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fCj4gVXNlcnMgbWFpbGluZyBsaXN0Cj4gVXNlcnNAb3ZpcnQub3JnCj4gaHR0cDovL2xpc3Rz Lm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzCgotLS0tLS09X1BhcnRfMTc2NTYzNDNf MTA3MTE2OTc2Ny4xMzYyOTA3MDk0NTE5CkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOyBjaGFyc2V0 PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IHF1b3RlZC1wcmludGFibGUKCjxodG1s PjxoZWFkPjxzdHlsZSB0eXBlPTNEJ3RleHQvY3NzJz5wIHsgbWFyZ2luOiAwOyB9PC9zdHlsZT48 L2hlYWQ+PGJvZHk+PD0KZGl2IHN0eWxlPTNEJ2ZvbnQtZmFtaWx5OiB0aW1lcyBuZXcgcm9tYW4s bmV3IHlvcmssdGltZXMsc2VyaWY7IGZvbnQtc2l6ZTogPQoxMnB0OyBjb2xvcjogIzAwMDAwMCc+ PGJyPjxicj48aHIgaWQ9M0QiendjaHIiPjxibG9ja3F1b3RlIGlkPTNEIkRXVDUwNTQiIHM9CnR5 bGU9M0QiYm9yZGVyLWxlZnQ6MnB4IHNvbGlkIHJnYigxNiwgMTYsIDI1NSk7bWFyZ2luLWxlZnQ6 NXB4O3BhZGRpbmctbGVmdD0KOjVweDtjb2xvcjojMDAwO2ZvbnQtd2VpZ2h0Om5vcm1hbDtmb250 LXN0eWxlOm5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9uZTtmPQpvbnQtZmFtaWx5OkhlbHZldGlj YSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGI+RnJvbTogPC9iPiJNYXR0IC49 CiIgJmx0O3lhbWFrYXNpLjAxNEBnbWFpbC5jb20mZ3Q7PGJyPjxiPlRvOiA8L2I+InVzZXJzIiAm bHQ7dXNlcnNAb3ZpcnQub3JnJj0KZ3Q7PGJyPjxiPlNlbnQ6IDwvYj5UaHVyc2RheSwgTWFyY2gg NywgMjAxMyAxMjowMzowMiBQTTxicj48Yj5TdWJqZWN0OiA8L2I+PQpbVXNlcnNdIENsdXN0ZXIs IGhvc3RzLCBldmVyeXRoaW5nIGRvd24gYW5kIHRvdGFsbHkgc3R1Y2s8YnI+PGJyPjxkaXYgZGly PQo9M0QibHRyIj48ZGl2PjxkaXY+PGRpdj48ZGl2PjxkaXY+TXkgY2x1c3RlciBpcyB0b3RhbGx5 IGRvd24gYW5kIEknbSBjb21wbGU9CnRlbHkgc3R1Y2suPGJyPjxicj48L2Rpdj5JIGNhbm5vdCBz ZXQgYSBob3N0IGluIG1haW50ZW5hbmNlLCBzdG9wIGEgVk0gYmVjYT0KdXNlIGl0IGhhcyBhIHVu a25vd24gc3RhdGUsIHNvIGFsc28gdGhlIGhvc3Qgd2hlcmUgdGhpcyBvbmUgaXMgb24uIEEgbmV3 IGFkPQpkZWQgbm9kZSBjYW5ub3QgZmluZCB0aGUgc3RvcmFnZSBiZWNhdXNlIGFsbCBhcmUgZG93 biBidXQgdGhlIE5GUyBpcyB1cC48YnI9Cj4KPGJyPk9uIHRoZSBub2RlIHRoYXQgaXMgInVua25v d24iIGFsbCBpbnRlcmZhY2VzIGFyZSB1cCwgb24gdGhlIG5ldyBhZGRlZCBoPQpvc3QgYWxsIGFy ZSBkb3duIGZvbGxvd2luZyBvdmlydCwgYnV0IGFyZSBhY3R1YWxseSB1cC48YnI+PGJyPjwvZGl2 PkJlY2F1c2U9CiBvZiB0aGlzIEknbSBzdHVjayBiZXR3ZWVuIDIgb3IgNCB3YWxscyBhbmQgSSdt IG5vdCBhYmxlIHRvIGZpeCB0aGlzIGluIHNvbT0KZSB3YXkuPGJyPgo8YnI+PC9kaXY+V2hhdCBh cmUgbXkgb3B0aW9ucyA/IEknbSB0aGlua2luZyBvZiBzZXR0aW5nIHRoZSBWTSB0aGF0IGlzIHN0 dWM9Cmsgb24gbXkgZXhpc3RpbmcgaG9zdCB0byBvZmYgYnkgZWRpdGluZyB0aGUgREIgb2Ygb3Zp cnQuPGJyPjxicj48L2Rpdj5JIGhvcD0KZSB3ZSBjYW4gc29ydCB0aGlzIG91dC48YnI+PGJyPkNo ZWVycyw8YnI+PGJyPjwvZGl2Pk1hdHQ8YnI+PGRpdj48ZGl2Pgo8ZGl2PjxkaXY+PGRpdj48YnI+ PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+Cjxicj48L2Jsb2NrcXVvdGU+SGks PGJyPml0IHNvdW5kcyBsaWtlIHlvdXIgaG9zdCBpbiBub24tcmVzcG9uc2l2ZSw8YnI+Y2FuID0K eW91IHBpbmcgZnJvbSB0aGUgZW5naW5lIGhvc3QgdG8gdGhhdCBob3N0Pzxicj5kb2VzIHZkc20g cnVuIG9rIG9uIHRoZSBob3N0PQogKHlvdSBjYW4gY2hlY2sgYnkgcnVubmluZyB0aGlzIGluIHRo ZSBob3N0OiB2ZHNDbGllbnQgMCBnZXRWZHNDYXBhYmlsaXRpZXM9Cik8YnI+PGJsb2NrcXVvdGUg c3R5bGU9M0QiYm9yZGVyLWxlZnQ6IDJweCBzb2xpZCByZ2IoMTYsIDE2LCAyNTUpOyBtYXJnaW4t bD0KZWZ0OiA1cHg7IHBhZGRpbmctbGVmdDogNXB4OyBjb2xvcjogcmdiKDAsIDAsIDApOyBmb250 LXdlaWdodDogbm9ybWFsOyBmb250PQotc3R5bGU6IG5vcm1hbDsgdGV4dC1kZWNvcmF0aW9uOiBu b25lOyBmb250LWZhbWlseTogSGVsdmV0aWNhLEFyaWFsLHNhbnMtc2U9CnJpZjsgZm9udC1zaXpl OiAxMnB0OyI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188 YnI+VT0Kc2VycyBtYWlsaW5nIGxpc3Q8YnI+VXNlcnNAb3ZpcnQub3JnPGJyPmh0dHA6Ly9saXN0 cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0PQppbmZvL3VzZXJzPGJyPjwvYmxvY2txdW90ZT48YnI+ PC9kaXY+PC9ib2R5PjwvaHRtbD4KLS0tLS0tPV9QYXJ0XzE3NjU2MzQzXzEwNzExNjk3NjcuMTM2 MjkwNzA5NDUxOS0tCg== --===============6412771782402274267==--