vm has been paused due to unknown storage

The VM = disk is in Thin provision Ovirt and gluter versions: Version 4.1.1.8-1.el7.centos glusterfs-cli-3.8.11-1.el7.x86_64 glusterfs-libs-3.8.11-1.el7.x86_64 glusterfs-3.8.11-1.el7.x86_64 glusterfs-client-xlators-3.8.11-1.el7.x86_64 glusterfs-fuse-3.8.11-1.el7.x86_64 glusterfs-api-3.8.11-1.el7.x86_64 glusterfs-server-3.8.11-1.el7.x86_64

=3D

message log:

May 26 11:18:16 node journal: vdsm root ERROR V= =3D M metrics collection failed#012Traceback (most recent call last):#012 = =3D ;File "/usr/lib/python2.7/site-packages/vdsm/virt/vmstats.py", line 221, in= =3D send_metrics#012 diskinfo['readOps']#012KeyError: 'readOps'

vdsm.log
2017-05-26 11:18= :1=3D 6,715+0100 ERROR (periodic/3) [root] VM metrics collection failed (vmstats:= =3D 264)
2017-05-26 11:19:39,369+0100 ERROR (tasks/5) [storage.Volume] Unexp= =3D ected error (fileVolume:456)
2017-05-26 11:19:39,373+0100 ERROR (tasks/5= =3D ) [storage.Volume] Unexpected error (volume:1107)
2017-05-26 11:19:39,37= =3D 4+0100 ERROR (tasks/5) [storage.TaskManager.Task] (Task=3D3D'5b2adb9a-e24e-= 48=3D fa-9f01-f21c23588aef') Unexpected error (task:870)

glusterfs
[2017-05-26 10:53:08.247219] W [MSGID:= 1=3D 14031] [client-rpc-fops.c:2933:client3_3_lookup_cbk] 0-gv2-client-0: remote= =3D operation failed. Path: /.shard/55b94942-dee5-4f69-8b0f-52e251ac6f5e.164 (= =3D 00000000-0000-0000-0000-000000000000) [No data available]
[2017-05-26 10= =3D :53:14.899499] W [MSGID: 114031] [client-rpc-fops.c:2933:client3_3_lookup_c= =3D bk] 0-gv2-client-0: remote operation failed. Path: /.shard/55b94942-dee5-4f= =3D 69-8b0f-52e251ac6f5e.167 (00000000-0000-0000-0000-000000000000) [No data av= =3D ailable]
[2017-05-26 10:53:14.899526] E [MSGID: 133010] [shard.c:1725:sh= =3D ard_common_lookup_shards_cbk] 0-gv2-shard: Lookup on shard 167 failed. Base= =3D file gfid =3D3D 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No data available]=3D [2017-05-26 10:53:19.712567] W [MSGID: 114031] [client-rpc-fops.c:2933:clie= =3D nt3_3_lookup_cbk] 0-gv2-client-0: remote operation failed. Path: /.shard/55= =3D b94942-dee5-4f69-8b0f-52e251ac6f5e.169 (00000000-0000-0000-0000-00000000000= =3D 0) [No data available]
[2017-05-26 10:53:19.712614] E [MSGID: 133010] [s= =3D hard.c:1725:shard_common_lookup_shards_cbk] 0-gv2-shard: Lookup on shard 16= =3D 9 failed. Base file gfid =3D3D 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No dat= a =3D available]
[2017-05-26 10:53:29.419317] W [MSGID: 114031] [client-rpc-fo= =3D ps.c:2933:client3_3_lookup_cbk] 0-gv2-client-0: remote operation failed. Pa= =3D th: /.shard/55b94942-dee5-4f69-8b0f-52e251ac6f5e.173 (00000000-0000-0000-00= =3D 00-000000000000) [No data available]
[2017-05-26 10:53:29.419369] E [MSG= =3D ID: 133010] [shard.c:1725:shard_common_lookup_shards_cbk] 0-gv2-shard: Look= =3D up on shard 173 failed. Base file gfid =3D3D 55b94942-dee5-4f69-8b0f-52e251= ac=3D 6f5e [No data available]

=3D

thanks

De= : "Sahina Bose" <sabose(a)redhat.com>
Para: suporte(a)logic= work=3D s.pt, "Krutika Dhananjay" <kdhananj(a)redhat.com>
Cc: "ovir= t =3D users" <users(a)ovirt.org>
Enviadas: Quinta-feira, 25 De Ma= io=3D de 2017 7:12:40
Assunto: Re: [ovirt-users] vm has been paused du= =3D e to unknown storage

The glusterfs logs contain below errors:
= [2=3D 017-05-22 18:12:50.941883] E [MSGID: 133010] [shard.c:1725:shard_common_loo= =3D kup_shards_cbk] 0-gv2-shard: Lookup on shard 50 failed. Base file gfid =3D3= D =3D 33f1fe3e-c626-49f2-861e-2259c972931d [No data available]
[2017-05-22 18:= =3D 12:50.945085] W [fuse-bridge.c:1291:fuse_err_cbk] 0-glusterfs-fuse: 6130671= =3D 3: FSYNC() ERR =3D3D> -1 (No data available)

Krutika, could= y=3D ou take a look?

On Thu, May 25, 2017 at 1:02 AM, <suporte(a)logicworks.pt> wrote:
Hi,
I setup an ovirt hosted enine, in only one server with local gluster= =3D bricks.

When running a MS SQL 2012 process to rebuild a = =3D data base, which take around 4 hours, after a while the VM is paused with t= =3D he error:
vm has been paused due to unknown storage
<= =3D br>The VM disk is in Thin provision Ovirt and gluter versions: Version 4.1.1.8-1.el7.centos glusterfs-cli-3.8.11-1.el7.x86_64 glusterfs-libs-3.8.11-1.el7.x86_64 glusterfs-3.8.11-1.el7.x86_64 glusterfs-client-xlators-3.8.11-1.el7.x86_64 glusterfs-fuse-3.8.11-1.el7.x86_64 glusterfs-api-3.8.11-1.el7.x86_64 glusterfs-server-3.8.11-1.el7.x86_64

I can find the rea= =3D son why
The logs are attached.

Any idea?

Thanks

=
--
Jose Ferradeira
http://www.logicworks.pt

___________= =3D ____________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/lis= =3D tinfo/users

------=3D_Part_3486718_1947228915.1495798063219-- --===============8414613524293191359== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzM0ODY3MThfMTk0NzIyODkxNS4xNDk1Nzk4MDYzMjE5CkNvbnRlbnQtVHlw ZTogdGV4dC9wbGFpbjsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3 Yml0CgpIaSwgCgpJIHVwZGF0ZWQgZ2x1c3RlcmZzOiAKZ2x1c3RlcmZzLWNsaWVudC14bGF0b3Jz LTMuOC4xMi0xLmVsNy54ODZfNjQgCmdsdXN0ZXJmcy1jbGktMy44LjEyLTEuZWw3Lng4Nl82NCAK Z2x1c3RlcmZzLWFwaS0zLjguMTItMS5lbDcueDg2XzY0IApnbHVzdGVyZnMtZnVzZS0zLjguMTIt MS5lbDcueDg2XzY0IApnbHVzdGVyZnMtc2VydmVyLTMuOC4xMi0xLmVsNy54ODZfNjQgCmdsdXN0 ZXJmcy1saWJzLTMuOC4xMi0xLmVsNy54ODZfNjQgCmdsdXN0ZXJmcy0zLjguMTItMS5lbDcueDg2 XzY0IAoKTm93IEkgY2Fubm90IGFkZCBhIHZvbHVtZSBkaXNrIHByZWFsbG9jYXRlZCwgYWZ0ZXIg YSB3aGlsZSBpdCBicmVha3MuIAoKbWVzc2FnZSBsb2c6IApNYXkgMjYgMTE6MTg6MTYgbm9kZSBq b3VybmFsOiB2ZHNtIHJvb3QgRVJST1IgVk0gbWV0cmljcyBjb2xsZWN0aW9uIGZhaWxlZCMwMTJU cmFjZWJhY2sgKG1vc3QgcmVjZW50IGNhbGwgbGFzdCk6IzAxMiBGaWxlICIvdXNyL2xpYi9weXRo b24yLjcvc2l0ZS1wYWNrYWdlcy92ZHNtL3ZpcnQvdm1zdGF0cy5weSIsIGxpbmUgMjIxLCBpbiBz ZW5kX21ldHJpY3MjMDEyIGRpc2tpbmZvWydyZWFkT3BzJ10jMDEyS2V5RXJyb3I6ICdyZWFkT3Bz JyAKCnZkc20ubG9nIAoyMDE3LTA1LTI2IDExOjE4OjE2LDcxNSswMTAwIEVSUk9SIChwZXJpb2Rp Yy8zKSBbcm9vdF0gVk0gbWV0cmljcyBjb2xsZWN0aW9uIGZhaWxlZCAodm1zdGF0czoyNjQpIAoy MDE3LTA1LTI2IDExOjE5OjM5LDM2OSswMTAwIEVSUk9SICh0YXNrcy81KSBbc3RvcmFnZS5Wb2x1 bWVdIFVuZXhwZWN0ZWQgZXJyb3IgKGZpbGVWb2x1bWU6NDU2KSAKMjAxNy0wNS0yNiAxMToxOToz OSwzNzMrMDEwMCBFUlJPUiAodGFza3MvNSkgW3N0b3JhZ2UuVm9sdW1lXSBVbmV4cGVjdGVkIGVy cm9yICh2b2x1bWU6MTEwNykgCjIwMTctMDUtMjYgMTE6MTk6MzksMzc0KzAxMDAgRVJST1IgKHRh c2tzLzUpIFtzdG9yYWdlLlRhc2tNYW5hZ2VyLlRhc2tdIChUYXNrPSc1YjJhZGI5YS1lMjRlLTQ4 ZmEtOWYwMS1mMjFjMjM1ODhhZWYnKSBVbmV4cGVjdGVkIGVycm9yICh0YXNrOjg3MCkgCgpnbHVz dGVyZnMgClsyMDE3LTA1LTI2IDEwOjUzOjA4LjI0NzIxOV0gVyBbTVNHSUQ6IDExNDAzMV0gW2Ns aWVudC1ycGMtZm9wcy5jOjI5MzM6Y2xpZW50M18zX2xvb2t1cF9jYmtdIDAtZ3YyLWNsaWVudC0w OiByZW1vdGUgb3BlcmF0aW9uIGZhaWxlZC4gUGF0aDogLy5zaGFyZC81NWI5NDk0Mi1kZWU1LTRm NjktOGIwZi01MmUyNTFhYzZmNWUuMTY0ICgwMDAwMDAwMC0wMDAwLTAwMDAtMDAwMC0wMDAwMDAw MDAwMDApIFtObyBkYXRhIGF2YWlsYWJsZV0gClsyMDE3LTA1LTI2IDEwOjUzOjE0Ljg5OTQ5OV0g VyBbTVNHSUQ6IDExNDAzMV0gW2NsaWVudC1ycGMtZm9wcy5jOjI5MzM6Y2xpZW50M18zX2xvb2t1 cF9jYmtdIDAtZ3YyLWNsaWVudC0wOiByZW1vdGUgb3BlcmF0aW9uIGZhaWxlZC4gUGF0aDogLy5z aGFyZC81NWI5NDk0Mi1kZWU1LTRmNjktOGIwZi01MmUyNTFhYzZmNWUuMTY3ICgwMDAwMDAwMC0w MDAwLTAwMDAtMDAwMC0wMDAwMDAwMDAwMDApIFtObyBkYXRhIGF2YWlsYWJsZV0gClsyMDE3LTA1 LTI2IDEwOjUzOjE0Ljg5OTUyNl0gRSBbTVNHSUQ6IDEzMzAxMF0gW3NoYXJkLmM6MTcyNTpzaGFy ZF9jb21tb25fbG9va3VwX3NoYXJkc19jYmtdIDAtZ3YyLXNoYXJkOiBMb29rdXAgb24gc2hhcmQg MTY3IGZhaWxlZC4gQmFzZSBmaWxlIGdmaWQgPSA1NWI5NDk0Mi1kZWU1LTRmNjktOGIwZi01MmUy NTFhYzZmNWUgW05vIGRhdGEgYXZhaWxhYmxlXSAKWzIwMTctMDUtMjYgMTA6NTM6MTkuNzEyNTY3 XSBXIFtNU0dJRDogMTE0MDMxXSBbY2xpZW50LXJwYy1mb3BzLmM6MjkzMzpjbGllbnQzXzNfbG9v a3VwX2Nia10gMC1ndjItY2xpZW50LTA6IHJlbW90ZSBvcGVyYXRpb24gZmFpbGVkLiBQYXRoOiAv LnNoYXJkLzU1Yjk0OTQyLWRlZTUtNGY2OS04YjBmLTUyZTI1MWFjNmY1ZS4xNjkgKDAwMDAwMDAw LTAwMDAtMDAwMC0wMDAwLTAwMDAwMDAwMDAwMCkgW05vIGRhdGEgYXZhaWxhYmxlXSAKWzIwMTct MDUtMjYgMTA6NTM6MTkuNzEyNjE0XSBFIFtNU0dJRDogMTMzMDEwXSBbc2hhcmQuYzoxNzI1OnNo YXJkX2NvbW1vbl9sb29rdXBfc2hhcmRzX2Nia10gMC1ndjItc2hhcmQ6IExvb2t1cCBvbiBzaGFy ZCAxNjkgZmFpbGVkLiBCYXNlIGZpbGUgZ2ZpZCA9IDU1Yjk0OTQyLWRlZTUtNGY2OS04YjBmLTUy ZTI1MWFjNmY1ZSBbTm8gZGF0YSBhdmFpbGFibGVdIApbMjAxNy0wNS0yNiAxMDo1MzoyOS40MTkz MTddIFcgW01TR0lEOiAxMTQwMzFdIFtjbGllbnQtcnBjLWZvcHMuYzoyOTMzOmNsaWVudDNfM19s b29rdXBfY2JrXSAwLWd2Mi1jbGllbnQtMDogcmVtb3RlIG9wZXJhdGlvbiBmYWlsZWQuIFBhdGg6 IC8uc2hhcmQvNTViOTQ5NDItZGVlNS00ZjY5LThiMGYtNTJlMjUxYWM2ZjVlLjE3MyAoMDAwMDAw MDAtMDAwMC0wMDAwLTAwMDAtMDAwMDAwMDAwMDAwKSBbTm8gZGF0YSBhdmFpbGFibGVdIApbMjAx Ny0wNS0yNiAxMDo1MzoyOS40MTkzNjldIEUgW01TR0lEOiAxMzMwMTBdIFtzaGFyZC5jOjE3MjU6 c2hhcmRfY29tbW9uX2xvb2t1cF9zaGFyZHNfY2JrXSAwLWd2Mi1zaGFyZDogTG9va3VwIG9uIHNo YXJkIDE3MyBmYWlsZWQuIEJhc2UgZmlsZSBnZmlkID0gNTViOTQ5NDItZGVlNS00ZjY5LThiMGYt NTJlMjUxYWM2ZjVlIFtObyBkYXRhIGF2YWlsYWJsZV0gCgoKdGhhbmtzIAoKCkRlOiAiU2FoaW5h IEJvc2UiIDxzYWJvc2VAcmVkaGF0LmNvbT4gClBhcmE6IHN1cG9ydGVAbG9naWN3b3Jrcy5wdCwg IktydXRpa2EgRGhhbmFuamF5IiA8a2RoYW5hbmpAcmVkaGF0LmNvbT4gCkNjOiAib3ZpcnQgdXNl cnMiIDx1c2Vyc0BvdmlydC5vcmc+IApFbnZpYWRhczogUXVpbnRhLWZlaXJhLCAyNSBEZSBNYWlv IGRlIDIwMTcgNzoxMjo0MCAKQXNzdW50bzogUmU6IFtvdmlydC11c2Vyc10gdm0gaGFzIGJlZW4g cGF1c2VkIGR1ZSB0byB1bmtub3duIHN0b3JhZ2UgCgpUaGUgZ2x1c3RlcmZzIGxvZ3MgY29udGFp biBiZWxvdyBlcnJvcnM6IApbMjAxNy0wNS0yMiAxODoxMjo1MC45NDE4ODNdIEUgW01TR0lEOiAx MzMwMTBdIFtzaGFyZC5jOjE3MjU6c2hhcmRfY29tbW9uX2xvb2t1cF9zaGFyZHNfY2JrXSAwLWd2 Mi1zaGFyZDogTG9va3VwIG9uIHNoYXJkIDUwIGZhaWxlZC4gQmFzZSBmaWxlIGdmaWQgPSAzM2Yx ZmUzZS1jNjI2LTQ5ZjItODYxZS0yMjU5Yzk3MjkzMWQgW05vIGRhdGEgYXZhaWxhYmxlXSAKWzIw MTctMDUtMjIgMTg6MTI6NTAuOTQ1MDg1XSBXIFtmdXNlLWJyaWRnZS5jOjEyOTE6ZnVzZV9lcnJf Y2JrXSAwLWdsdXN0ZXJmcy1mdXNlOiA2MTMwNjcxMzogRlNZTkMoKSBFUlIgPT4gLTEgKE5vIGRh dGEgYXZhaWxhYmxlKSAKCktydXRpa2EsIGNvdWxkIHlvdSB0YWtlIGEgbG9vaz8gCgpPbiBUaHUs IE1heSAyNSwgMjAxNyBhdCAxOjAyIEFNLCA8IHN1cG9ydGVAbG9naWN3b3Jrcy5wdCA+IHdyb3Rl OiAKCgoKSGksIAoKSSBzZXR1cCBhbiBvdmlydCBob3N0ZWQgZW5pbmUsIGluIG9ubHkgb25lIHNl cnZlciB3aXRoIGxvY2FsIGdsdXN0ZXIgYnJpY2tzLiAKCldoZW4gcnVubmluZyBhIE1TIFNRTCAy MDEyIHByb2Nlc3MgdG8gcmVidWlsZCBhIGRhdGEgYmFzZSwgd2hpY2ggdGFrZSBhcm91bmQgNCBo b3VycywgYWZ0ZXIgYSB3aGlsZSB0aGUgVk0gaXMgcGF1c2VkIHdpdGggdGhlIGVycm9yOiAKdm0g aGFzIGJlZW4gcGF1c2VkIGR1ZSB0byB1bmtub3duIHN0b3JhZ2UgCgpUaGUgVk0gZGlzayBpcyBp biBUaGluIHByb3Zpc2lvbgoKT3ZpcnQgYW5kIGdsdXRlciB2ZXJzaW9uczoKClZlcnNpb24gNC4x LjEuOC0xLmVsNy5jZW50b3MKCmdsdXN0ZXJmcy1jbGktMy44LjExLTEuZWw3Lng4Nl82NApnbHVz dGVyZnMtbGlicy0zLjguMTEtMS5lbDcueDg2XzY0CmdsdXN0ZXJmcy0zLjguMTEtMS5lbDcueDg2 XzY0CmdsdXN0ZXJmcy1jbGllbnQteGxhdG9ycy0zLjguMTEtMS5lbDcueDg2XzY0CmdsdXN0ZXJm cy1mdXNlLTMuOC4xMS0xLmVsNy54ODZfNjQKZ2x1c3RlcmZzLWFwaS0zLjguMTEtMS5lbDcueDg2 XzY0CmdsdXN0ZXJmcy1zZXJ2ZXItMy44LjExLTEuZWw3Lng4Nl82NCAKCkkgY2FuIGZpbmQgdGhl IHJlYXNvbiB3aHkgClRoZSBsb2dzIGFyZSBhdHRhY2hlZC4gCgpBbnkgaWRlYT8gCgpUaGFua3Mg CgotLSAKCkpvc2UgRmVycmFkZWlyYSAKaHR0cDovL3d3dy5sb2dpY3dvcmtzLnB0IAoKX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18gClVzZXJzIG1haWxpbmcg bGlzdCAKVXNlcnNAb3ZpcnQub3JnIApodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlz dGluZm8vdXNlcnMgCgoKCgoKCi0tLS0tLT1fUGFydF8zNDg2NzE4XzE5NDcyMjg5MTUuMTQ5NTc5 ODA2MzIxOQpDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD11dGYtOApDb250ZW50LVRy YW5zZmVyLUVuY29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgo8aHRtbD48Ym9keT48ZGl2IHN0eWxl PTNEImZvbnQtZmFtaWx5OiBUaW1lcyBOZXcgUm9tYW47IGZvbnQtc2l6ZTogMTBwdDsgY289Cmxv cjogIzAwMDAwMCI+PGRpdj5IaSw8L2Rpdj48ZGl2PjxiciBkYXRhLW1jZS1ib2d1cz0zRCIxIj48 L2Rpdj48ZGl2PkkgdXBkYT0KdGVkIGdsdXN0ZXJmczo8L2Rpdj48ZGl2PmdsdXN0ZXJmcy1jbGll bnQteGxhdG9ycy0zLjguMTItMS5lbDcueDg2XzY0PGJyPmdsPQp1c3RlcmZzLWNsaS0zLjguMTIt MS5lbDcueDg2XzY0PGJyPmdsdXN0ZXJmcy1hcGktMy44LjEyLTEuZWw3Lng4Nl82NDxicj5nbHU9 CnN0ZXJmcy1mdXNlLTMuOC4xMi0xLmVsNy54ODZfNjQ8YnI+Z2x1c3RlcmZzLXNlcnZlci0zLjgu MTItMS5lbDcueDg2XzY0PGJyPj0KZ2x1c3RlcmZzLWxpYnMtMy44LjEyLTEuZWw3Lng4Nl82NDxi cj5nbHVzdGVyZnMtMy44LjEyLTEuZWw3Lng4Nl82NDwvZGl2PjxkPQppdj48YnIgZGF0YS1tY2Ut Ym9ndXM9M0QiMSI+PC9kaXY+PGRpdj5Ob3cgSSBjYW5ub3QgYWRkIGEgdm9sdW1lIGRpc2sgcHJl YWw9CmxvY2F0ZWQsIGFmdGVyIGEgd2hpbGUgaXQgYnJlYWtzLjwvZGl2PjxkaXY+PGJyIGRhdGEt bWNlLWJvZ3VzPTNEIjEiPjwvZGl2Pj0KPGRpdj5tZXNzYWdlIGxvZzo8L2Rpdj48ZGl2Pk1heSAy NiAxMToxODoxNiBub2RlIGpvdXJuYWw6IHZkc20gcm9vdCBFUlJPUiBWPQpNIG1ldHJpY3MgY29s bGVjdGlvbiBmYWlsZWQjMDEyVHJhY2ViYWNrIChtb3N0IHJlY2VudCBjYWxsIGxhc3QpOiMwMTIg Jm5ic3A9CjtGaWxlICIvdXNyL2xpYi9weXRob24yLjcvc2l0ZS1wYWNrYWdlcy92ZHNtL3ZpcnQv dm1zdGF0cy5weSIsIGxpbmUgMjIxLCBpbj0KIHNlbmRfbWV0cmljcyMwMTIgJm5ic3A7ICZuYnNw O2Rpc2tpbmZvWydyZWFkT3BzJ10jMDEyS2V5RXJyb3I6ICdyZWFkT3BzJzwvPQpkaXY+PGRpdj48 YnIgZGF0YS1tY2UtYm9ndXM9M0QiMSI+PC9kaXY+PGRpdj52ZHNtLmxvZzxicj4yMDE3LTA1LTI2 IDExOjE4OjE9CjYsNzE1KzAxMDAgRVJST1IgKHBlcmlvZGljLzMpIFtyb290XSBWTSBtZXRyaWNz IGNvbGxlY3Rpb24gZmFpbGVkICh2bXN0YXRzOj0KMjY0KTxicj4yMDE3LTA1LTI2IDExOjE5OjM5 LDM2OSswMTAwIEVSUk9SICh0YXNrcy81KSBbc3RvcmFnZS5Wb2x1bWVdIFVuZXhwPQplY3RlZCBl cnJvciAoZmlsZVZvbHVtZTo0NTYpPGJyPjIwMTctMDUtMjYgMTE6MTk6MzksMzczKzAxMDAgRVJS T1IgKHRhc2tzLzU9CikgW3N0b3JhZ2UuVm9sdW1lXSBVbmV4cGVjdGVkIGVycm9yICh2b2x1bWU6 MTEwNyk8YnI+MjAxNy0wNS0yNiAxMToxOTozOSwzNz0KNCswMTAwIEVSUk9SICh0YXNrcy81KSBb c3RvcmFnZS5UYXNrTWFuYWdlci5UYXNrXSAoVGFzaz0zRCc1YjJhZGI5YS1lMjRlLTQ4PQpmYS05 ZjAxLWYyMWMyMzU4OGFlZicpIFVuZXhwZWN0ZWQgZXJyb3IgKHRhc2s6ODcwKTwvZGl2PjxkaXY+ PGJyIGRhdGEtbWNlLWI9Cm9ndXM9M0QiMSI+PC9kaXY+PGRpdj5nbHVzdGVyZnM8YnI+WzIwMTct MDUtMjYgMTA6NTM6MDguMjQ3MjE5XSBXIFtNU0dJRDogMT0KMTQwMzFdIFtjbGllbnQtcnBjLWZv cHMuYzoyOTMzOmNsaWVudDNfM19sb29rdXBfY2JrXSAwLWd2Mi1jbGllbnQtMDogcmVtb3RlPQog b3BlcmF0aW9uIGZhaWxlZC4gUGF0aDogLy5zaGFyZC81NWI5NDk0Mi1kZWU1LTRmNjktOGIwZi01 MmUyNTFhYzZmNWUuMTY0ICg9CjAwMDAwMDAwLTAwMDAtMDAwMC0wMDAwLTAwMDAwMDAwMDAwMCkg W05vIGRhdGEgYXZhaWxhYmxlXTxicj5bMjAxNy0wNS0yNiAxMD0KOjUzOjE0Ljg5OTQ5OV0gVyBb TVNHSUQ6IDExNDAzMV0gW2NsaWVudC1ycGMtZm9wcy5jOjI5MzM6Y2xpZW50M18zX2xvb2t1cF9j PQpia10gMC1ndjItY2xpZW50LTA6IHJlbW90ZSBvcGVyYXRpb24gZmFpbGVkLiBQYXRoOiAvLnNo YXJkLzU1Yjk0OTQyLWRlZTUtNGY9CjY5LThiMGYtNTJlMjUxYWM2ZjVlLjE2NyAoMDAwMDAwMDAt MDAwMC0wMDAwLTAwMDAtMDAwMDAwMDAwMDAwKSBbTm8gZGF0YSBhdj0KYWlsYWJsZV08YnI+WzIw MTctMDUtMjYgMTA6NTM6MTQuODk5NTI2XSBFIFtNU0dJRDogMTMzMDEwXSBbc2hhcmQuYzoxNzI1 OnNoPQphcmRfY29tbW9uX2xvb2t1cF9zaGFyZHNfY2JrXSAwLWd2Mi1zaGFyZDogTG9va3VwIG9u IHNoYXJkIDE2NyBmYWlsZWQuIEJhc2U9CiBmaWxlIGdmaWQgPTNEIDU1Yjk0OTQyLWRlZTUtNGY2 OS04YjBmLTUyZTI1MWFjNmY1ZSBbTm8gZGF0YSBhdmFpbGFibGVdPGJyPj0KWzIwMTctMDUtMjYg MTA6NTM6MTkuNzEyNTY3XSBXIFtNU0dJRDogMTE0MDMxXSBbY2xpZW50LXJwYy1mb3BzLmM6Mjkz MzpjbGllPQpudDNfM19sb29rdXBfY2JrXSAwLWd2Mi1jbGllbnQtMDogcmVtb3RlIG9wZXJhdGlv biBmYWlsZWQuIFBhdGg6IC8uc2hhcmQvNTU9CmI5NDk0Mi1kZWU1LTRmNjktOGIwZi01MmUyNTFh YzZmNWUuMTY5ICgwMDAwMDAwMC0wMDAwLTAwMDAtMDAwMC0wMDAwMDAwMDAwMD0KMCkgW05vIGRh dGEgYXZhaWxhYmxlXTxicj5bMjAxNy0wNS0yNiAxMDo1MzoxOS43MTI2MTRdIEUgW01TR0lEOiAx MzMwMTBdIFtzPQpoYXJkLmM6MTcyNTpzaGFyZF9jb21tb25fbG9va3VwX3NoYXJkc19jYmtdIDAt Z3YyLXNoYXJkOiBMb29rdXAgb24gc2hhcmQgMTY9CjkgZmFpbGVkLiBCYXNlIGZpbGUgZ2ZpZCA9 M0QgNTViOTQ5NDItZGVlNS00ZjY5LThiMGYtNTJlMjUxYWM2ZjVlIFtObyBkYXRhID0KYXZhaWxh YmxlXTxicj5bMjAxNy0wNS0yNiAxMDo1MzoyOS40MTkzMTddIFcgW01TR0lEOiAxMTQwMzFdIFtj bGllbnQtcnBjLWZvPQpwcy5jOjI5MzM6Y2xpZW50M18zX2xvb2t1cF9jYmtdIDAtZ3YyLWNsaWVu dC0wOiByZW1vdGUgb3BlcmF0aW9uIGZhaWxlZC4gUGE9CnRoOiAvLnNoYXJkLzU1Yjk0OTQyLWRl ZTUtNGY2OS04YjBmLTUyZTI1MWFjNmY1ZS4xNzMgKDAwMDAwMDAwLTAwMDAtMDAwMC0wMD0KMDAt MDAwMDAwMDAwMDAwKSBbTm8gZGF0YSBhdmFpbGFibGVdPGJyPlsyMDE3LTA1LTI2IDEwOjUzOjI5 LjQxOTM2OV0gRSBbTVNHPQpJRDogMTMzMDEwXSBbc2hhcmQuYzoxNzI1OnNoYXJkX2NvbW1vbl9s b29rdXBfc2hhcmRzX2Nia10gMC1ndjItc2hhcmQ6IExvb2s9CnVwIG9uIHNoYXJkIDE3MyBmYWls ZWQuIEJhc2UgZmlsZSBnZmlkID0zRCA1NWI5NDk0Mi1kZWU1LTRmNjktOGIwZi01MmUyNTFhYz0K NmY1ZSBbTm8gZGF0YSBhdmFpbGFibGVdPGJyPjwvZGl2PjxkaXY+PGJyIGRhdGEtbWNlLWJvZ3Vz PTNEIjEiPjwvZGl2PjxkaXY+PQo8YnIgZGF0YS1tY2UtYm9ndXM9M0QiMSI+PC9kaXY+PGRpdj50 aGFua3M8L2Rpdj48ZGl2Pjxicj48L2Rpdj48aHIgaWQ9M0Qienc9CmNociIgZGF0YS1tYXJrZXI9 M0QiX19ESVZJREVSX18iPjxkaXYgZGF0YS1tYXJrZXI9M0QiX19IRUFERVJTX18iPjxiPkRlOiA8 Lz0KYj4iU2FoaW5hIEJvc2UiICZsdDtzYWJvc2VAcmVkaGF0LmNvbSZndDs8YnI+PGI+UGFyYTog PC9iPnN1cG9ydGVAbG9naWN3b3JrPQpzLnB0LCAiS3J1dGlrYSBEaGFuYW5qYXkiICZsdDtrZGhh bmFuakByZWRoYXQuY29tJmd0Ozxicj48Yj5DYzogPC9iPiJvdmlydCA9CnVzZXJzIiAmbHQ7dXNl cnNAb3ZpcnQub3JnJmd0Ozxicj48Yj5FbnZpYWRhczogPC9iPlF1aW50YS1mZWlyYSwgMjUgRGUg TWFpbz0KIGRlIDIwMTcgNzoxMjo0MDxicj48Yj5Bc3N1bnRvOiA8L2I+UmU6IFtvdmlydC11c2Vy c10gdm0gaGFzIGJlZW4gcGF1c2VkIGR1PQplIHRvIHVua25vd24gc3RvcmFnZTxicj48L2Rpdj48 ZGl2Pjxicj48L2Rpdj48ZGl2IGRhdGEtbWFya2VyPTNEIl9fUVVPVEVEX1Q9CkVYVF9fIj48ZGl2 IGRpcj0zRCJsdHIiPjxkaXY+VGhlIGdsdXN0ZXJmcyBsb2dzIGNvbnRhaW4gYmVsb3cgZXJyb3Jz Ojxicj5bMj0KMDE3LTA1LTIyIDE4OjEyOjUwLjk0MTg4M10gRSBbTVNHSUQ6IDEzMzAxMF0gW3No YXJkLmM6MTcyNTpzaGFyZF9jb21tb25fbG9vPQprdXBfc2hhcmRzX2Nia10gMC1ndjItc2hhcmQ6 IExvb2t1cCBvbiBzaGFyZCA1MCBmYWlsZWQuIEJhc2UgZmlsZSBnZmlkID0zRCA9CjMzZjFmZTNl LWM2MjYtNDlmMi04NjFlLTIyNTljOTcyOTMxZCBbTm8gZGF0YSBhdmFpbGFibGVdPGJyPlsyMDE3 LTA1LTIyIDE4Oj0KMTI6NTAuOTQ1MDg1XSBXIFtmdXNlLWJyaWRnZS5jOjEyOTE6ZnVzZV9lcnJf Y2JrXSAwLWdsdXN0ZXJmcy1mdXNlOiA2MTMwNjcxPQozOiBGU1lOQygpIEVSUiA9M0QmZ3Q7IC0x IChObyBkYXRhIGF2YWlsYWJsZSk8YnI+PGJyPjwvZGl2PktydXRpa2EsIGNvdWxkIHk9Cm91IHRh a2UgYSBsb29rPzxicj48L2Rpdj48ZGl2IGNsYXNzPTNEImdtYWlsX2V4dHJhIj48YnI+PGRpdiBj bGFzcz0zRCJnbWFpbD0KX3F1b3RlIj5PbiBUaHUsIE1heSAyNSwgMjAxNyBhdCAxOjAyIEFNLCA8 c3BhbiBkaXI9M0QibHRyIj4mbHQ7PGEgaHJlZj0zRCJtPQphaWx0bzpzdXBvcnRlQGxvZ2ljd29y a3MucHQiIHRhcmdldD0zRCJfYmxhbmsiIGRhdGEtbWNlLWhyZWY9M0QibWFpbHRvOnN1cG89CnJ0 ZUBsb2dpY3dvcmtzLnB0Ij5zdXBvcnRlQGxvZ2ljd29ya3MucHQ8L2E+Jmd0Ozwvc3Bhbj4gd3Jv dGU6PGJyPjxibG9ja3F1bz0KdGUgY2xhc3M9M0QiZ21haWxfcXVvdGUiIHN0eWxlPTNEIm1hcmdp bjogMCAwIDAgLjhleDsgYm9yZGVyLWxlZnQ6IDFweCAjY2NjPQogc29saWQ7IHBhZGRpbmctbGVm dDogMWV4OyIgZGF0YS1tY2Utc3R5bGU9M0QibWFyZ2luOiAwIDAgMCAuOGV4OyBib3JkZXItbGU9 CmZ0OiAxcHggI2NjYyBzb2xpZDsgcGFkZGluZy1sZWZ0OiAxZXg7Ij48ZGl2PjxkaXYgc3R5bGU9 M0QiZm9udC1mYW1pbHk6IFRpbT0KZXMgTmV3IFJvbWFuOyBmb250LXNpemU6IDEwcHQ7IGNvbG9y OiAjMDAwMDAwOyIgZGF0YS1tY2Utc3R5bGU9M0QiZm9udC1mYW1pPQpseTogVGltZXMgTmV3IFJv bWFuOyBmb250LXNpemU6IDEwcHQ7IGNvbG9yOiAjMDAwMDAwOyI+PGRpdj5IaSw8YnI+PC9kaXY+ PGI9CnI+PGRpdj5JIHNldHVwIGFuIG92aXJ0IGhvc3RlZCBlbmluZSwgaW4gb25seSBvbmUgc2Vy dmVyIHdpdGggbG9jYWwgZ2x1c3Rlcj0KIGJyaWNrcy48YnI+PC9kaXY+PGJyPjxkaXY+V2hlbiBy dW5uaW5nIGEgTVMgU1FMIDIwMTIgcHJvY2VzcyB0byByZWJ1aWxkIGEgPQpkYXRhIGJhc2UsIHdo aWNoIHRha2UgYXJvdW5kIDQgaG91cnMsIGFmdGVyIGEgd2hpbGUgdGhlIFZNIGlzIHBhdXNlZCB3 aXRoIHQ9CmhlIGVycm9yOjxicj48L2Rpdj48ZGl2PjxwcmU+dm0gaGFzIGJlZW4gcGF1c2VkIGR1 ZSB0byB1bmtub3duIHN0b3JhZ2U8YnI+PD0KYnI+VGhlIFZNIGRpc2sgaXMgaW4gVGhpbiBwcm92 aXNpb24KCk92aXJ0IGFuZCBnbHV0ZXIgdmVyc2lvbnM6CgpWZXJzaW9uIDQuMS4xLjgtMS5lbDcu Y2VudG9zCgpnbHVzdGVyZnMtY2xpLTMuOC4xMS0xLmVsNy54ODZfNjQKZ2x1c3RlcmZzLWxpYnMt My44LjExLTEuZWw3Lng4Nl82NApnbHVzdGVyZnMtMy44LjExLTEuZWw3Lng4Nl82NApnbHVzdGVy ZnMtY2xpZW50LXhsYXRvcnMtMy44LjExLTEuZWw3Lng4Nl82NApnbHVzdGVyZnMtZnVzZS0zLjgu MTEtMS5lbDcueDg2XzY0CmdsdXN0ZXJmcy1hcGktMy44LjExLTEuZWw3Lng4Nl82NApnbHVzdGVy ZnMtc2VydmVyLTMuOC4xMS0xLmVsNy54ODZfNjQ8L3ByZT48L2Rpdj48YnI+PGRpdj5JIGNhbiBm aW5kIHRoZSByZWE9CnNvbiB3aHk8YnI+PC9kaXY+PGRpdj5UaGUgbG9ncyBhcmUgYXR0YWNoZWQu PGJyPjwvZGl2Pjxicj48ZGl2PkFueSBpZGVhPzxicj0KPjwvZGl2Pjxicj48ZGl2PlRoYW5rczxz cGFuIGNsYXNzPTNEIkhPRW5aYiI+PHNwYW4gY29sb3I9M0QiIzg4ODg4OCIgZGF0YS1tPQpjZS1z dHlsZT0zRCJjb2xvcjogIzg4ODg4ODsiIHN0eWxlPTNEImNvbG9yOiAjODg4ODg4OyI+PGJyPjwv c3Bhbj48L3NwYW4+PC89CmRpdj48c3BhbiBjbGFzcz0zRCJIT0VuWmIiPjxzcGFuIGNsYXNzPTNE IkhPRW5aYiI+PHNwYW4gY29sb3I9M0QiIzg4ODg4OCIgZD0KYXRhLW1jZS1zdHlsZT0zRCJjb2xv cjogIzg4ODg4ODsiIHN0eWxlPTNEImNvbG9yOiAjODg4ODg4OyI+PGJyPjwvc3Bhbj48L3NwPQph bj48L3NwYW4+PGRpdj4tLSA8YnI+PC9kaXY+PGRpdj48aHIgc3R5bGU9M0Qid2lkdGg6IDEwMCU7 IGhlaWdodDogMnB4OyIgZGE9CnRhLW1jZS1zdHlsZT0zRCJ3aWR0aDogMTAwJTsgaGVpZ2h0OiAy cHg7Ij5Kb3NlIEZlcnJhZGVpcmE8YnI+PGEgaHJlZj0zRCJodD0KdHA6Ly93d3cubG9naWN3b3Jr cy5wdCIgdGFyZ2V0PTNEIl9ibGFuayIgZGF0YS1tY2UtaHJlZj0zRCJodHRwOi8vd3d3LmxvZ2lj PQp3b3Jrcy5wdCI+aHR0cDovL3d3dy5sb2dpY3dvcmtzLnB0PC9hPjxicj48L2Rpdj48L2Rpdj48 L2Rpdj48YnI+X19fX19fX19fX189Cl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f Xzxicj4gVXNlcnMgbWFpbGluZyBsaXN0PGJyPiA8YSBocmVmPTNEIj0KbWFpbHRvOlVzZXJzQG92 aXJ0Lm9yZyIgdGFyZ2V0PTNEIl9ibGFuayIgZGF0YS1tY2UtaHJlZj0zRCJtYWlsdG86VXNlcnNA b3ZpPQpydC5vcmciPlVzZXJzQG92aXJ0Lm9yZzwvYT48YnI+IDxhIGhyZWY9M0QiaHR0cDovL2xp c3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2w9CmlzdGluZm8vdXNlcnMiIHJlbD0zRCJub3JlZmVycmVy IiB0YXJnZXQ9M0QiX2JsYW5rIiBkYXRhLW1jZS1ocmVmPTNEImh0dHA6Lz0KL2xpc3RzLm92aXJ0 Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIj5odHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxt YW4vbGlzPQp0aW5mby91c2VyczwvYT48YnI+IDxicj48L2Jsb2NrcXVvdGU+PC9kaXY+PC9kaXY+ PGJyPjwvZGl2PjwvZGl2PjwvYm9keT48L2g9CnRtbD4KLS0tLS0tPV9QYXJ0XzM0ODY3MThfMTk0 NzIyODkxNS4xNDk1Nzk4MDYzMjE5LS0K --===============8414613524293191359==-- From kdhananj at redhat.com Mon May 29 06:26:20 2017 Content-Type: multipart/mixed; boundary="===============7351259195495759140==" MIME-Version: 1.0 From: Krutika Dhananjay To: users at ovirt.org Subject: Re: [ovirt-users] vm has been paused due to unknown storage Date: Mon, 29 May 2017 11:56:19 +0530 Message-ID: In-Reply-To: 1948093299.3486719.1495798063219.JavaMail.zimbra@logicworks.pt --===============7351259195495759140== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi, Could you share your volume-info output and also the brick logs? -Krutika On Fri, May 26, 2017 at 4:57 PM, wrote: > Hi, > > I updated glusterfs: > glusterfs-client-xlators-3.8.12-1.el7.x86_64 > glusterfs-cli-3.8.12-1.el7.x86_64 > glusterfs-api-3.8.12-1.el7.x86_64 > glusterfs-fuse-3.8.12-1.el7.x86_64 > glusterfs-server-3.8.12-1.el7.x86_64 > glusterfs-libs-3.8.12-1.el7.x86_64 > glusterfs-3.8.12-1.el7.x86_64 > > Now I cannot add a volume disk preallocated, after a while it breaks. > > message log: > May 26 11:18:16 node journal: vdsm root ERROR VM metrics collection > failed#012Traceback (most recent call last):#012 File > "/usr/lib/python2.7/site-packages/vdsm/virt/vmstats.py", line 221, in > send_metrics#012 diskinfo['readOps']#012KeyError: 'readOps' > > vdsm.log > 2017-05-26 11:18:16,715+0100 ERROR (periodic/3) [root] VM metrics > collection failed (vmstats:264) > 2017-05-26 11:19:39,369+0100 ERROR (tasks/5) [storage.Volume] Unexpected > error (fileVolume:456) > 2017-05-26 11:19:39,373+0100 ERROR (tasks/5) [storage.Volume] Unexpected > error (volume:1107) > 2017-05-26 11:19:39,374+0100 ERROR (tasks/5) [storage.TaskManager.Task] > (Task=3D'5b2adb9a-e24e-48fa-9f01-f21c23588aef') Unexpected error (task:87= 0) > > glusterfs > [2017-05-26 10:53:08.247219] W [MSGID: 114031] [client-rpc-fops.c:2933:cl= ient3_3_lookup_cbk] > 0-gv2-client-0: remote operation failed. Path: /.shard/55b94942-dee5-4f69= -8b0f-52e251ac6f5e.164 > (00000000-0000-0000-0000-000000000000) [No data available] > [2017-05-26 10:53:14.899499] W [MSGID: 114031] [client-rpc-fops.c:2933:cl= ient3_3_lookup_cbk] > 0-gv2-client-0: remote operation failed. Path: /.shard/55b94942-dee5-4f69= -8b0f-52e251ac6f5e.167 > (00000000-0000-0000-0000-000000000000) [No data available] > [2017-05-26 10:53:14.899526] E [MSGID: 133010] [shard.c:1725:shard_common= _lookup_shards_cbk] > 0-gv2-shard: Lookup on shard 167 failed. Base file gfid =3D > 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No data available] > [2017-05-26 10:53:19.712567] W [MSGID: 114031] [client-rpc-fops.c:2933:cl= ient3_3_lookup_cbk] > 0-gv2-client-0: remote operation failed. Path: /.shard/55b94942-dee5-4f69= -8b0f-52e251ac6f5e.169 > (00000000-0000-0000-0000-000000000000) [No data available] > [2017-05-26 10:53:19.712614] E [MSGID: 133010] [shard.c:1725:shard_common= _lookup_shards_cbk] > 0-gv2-shard: Lookup on shard 169 failed. Base file gfid =3D > 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No data available] > [2017-05-26 10:53:29.419317] W [MSGID: 114031] [client-rpc-fops.c:2933:cl= ient3_3_lookup_cbk] > 0-gv2-client-0: remote operation failed. Path: /.shard/55b94942-dee5-4f69= -8b0f-52e251ac6f5e.173 > (00000000-0000-0000-0000-000000000000) [No data available] > [2017-05-26 10:53:29.419369] E [MSGID: 133010] [shard.c:1725:shard_common= _lookup_shards_cbk] > 0-gv2-shard: Lookup on shard 173 failed. Base file gfid =3D > 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No data available] > > > thanks > > ------------------------------ > *De: *"Sahina Bose" > *Para: *suporte(a)logicworks.pt, "Krutika Dhananjay" > *Cc: *"ovirt users" > *Enviadas: *Quinta-feira, 25 De Maio de 2017 7:12:40 > *Assunto: *Re: [ovirt-users] vm has been paused due to unknown storage > > The glusterfs logs contain below errors: > [2017-05-22 18:12:50.941883] E [MSGID: 133010] [shard.c:1725:shard_common= _lookup_shards_cbk] > 0-gv2-shard: Lookup on shard 50 failed. Base file gfid =3D > 33f1fe3e-c626-49f2-861e-2259c972931d [No data available] > [2017-05-22 18:12:50.945085] W [fuse-bridge.c:1291:fuse_err_cbk] > 0-glusterfs-fuse: 61306713: FSYNC() ERR =3D> -1 (No data available) > > Krutika, could you take a look? > > On Thu, May 25, 2017 at 1:02 AM, wrote: > >> Hi, >> >> I setup an ovirt hosted enine, in only one server with local gluster >> bricks. >> >> When running a MS SQL 2012 process to rebuild a data base, which take >> around 4 hours, after a while the VM is paused with the error: >> >> vm has been paused due to unknown storage >> >> The VM disk is in Thin provision >> >> Ovirt and gluter versions: >> >> Version 4.1.1.8-1.el7.centos >> >> glusterfs-cli-3.8.11-1.el7.x86_64 >> glusterfs-libs-3.8.11-1.el7.x86_64 >> glusterfs-3.8.11-1.el7.x86_64 >> glusterfs-client-xlators-3.8.11-1.el7.x86_64 >> glusterfs-fuse-3.8.11-1.el7.x86_64 >> glusterfs-api-3.8.11-1.el7.x86_64 >> glusterfs-server-3.8.11-1.el7.x86_64 >> >> >> I can find the reason why >> The logs are attached. >> >> Any idea? >> >> Thanks >> >> -- >> ------------------------------ >> Jose Ferradeira >> http://www.logicworks.pt >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> > --===============7351259195495759140== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2PkhpLDxicj48YnI+PC9kaXY+Q291bGQgeW91IHNoYXJl IHlvdXIgdm9sdW1lLWluZm8gb3V0cHV0IGFuZCBhbHNvIHRoZSBicmljayBsb2dzPzxicj48YnI+ PC9kaXY+LUtydXRpa2E8YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZXh0cmEiPjxicj48ZGl2 IGNsYXNzPSJnbWFpbF9xdW90ZSI+T24gRnJpLCBNYXkgMjYsIDIwMTcgYXQgNDo1NyBQTSwgIDxz cGFuIGRpcj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRvOnN1cG9ydGVAbG9naWN3b3Jrcy5wdCIg dGFyZ2V0PSJfYmxhbmsiPnN1cG9ydGVAbG9naWN3b3Jrcy5wdDwvYT4mZ3Q7PC9zcGFuPiB3cm90 ZTo8YnI+PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAw IC44ZXg7Ym9yZGVyLWxlZnQ6MXB4ICNjY2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+PGRpdj48 ZGl2IHN0eWxlPSJmb250LWZhbWlseTpUaW1lcyBOZXcgUm9tYW47Zm9udC1zaXplOjEwcHQ7Y29s b3I6IzAwMDAwMCI+PGRpdj5IaSw8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgdXBkYXRlZCBn bHVzdGVyZnM6PC9kaXY+PGRpdj5nbHVzdGVyZnMtY2xpZW50LXhsYXRvcnMtMy44Ljx3YnI+MTIt MS5lbDcueDg2XzY0PGJyPmdsdXN0ZXJmcy1jbGktMy44LjEyLTEuZWw3Ljx3YnI+eDg2XzY0PGJy PmdsdXN0ZXJmcy1hcGktMy44LjEyLTEuZWw3Ljx3YnI+eDg2XzY0PGJyPmdsdXN0ZXJmcy1mdXNl LTMuOC4xMi0xLmVsNy48d2JyPng4Nl82NDxicj5nbHVzdGVyZnMtc2VydmVyLTMuOC4xMi0xLmVs Ny48d2JyPng4Nl82NDxicj5nbHVzdGVyZnMtbGlicy0zLjguMTItMS5lbDcuPHdicj54ODZfNjQ8 YnI+Z2x1c3RlcmZzLTMuOC4xMi0xLmVsNy54ODZfNjQ8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2 Pk5vdyBJIGNhbm5vdCBhZGQgYSB2b2x1bWUgZGlzayBwcmVhbGxvY2F0ZWQsIGFmdGVyIGEgd2hp bGUgaXQgYnJlYWtzLjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+bWVzc2FnZSBsb2c6PC9kaXY+ PGRpdj5NYXkgMjYgMTE6MTg6MTYgbm9kZSBqb3VybmFsOiB2ZHNtIHJvb3QgRVJST1IgVk0gbWV0 cmljcyBjb2xsZWN0aW9uIGZhaWxlZCMwMTJUcmFjZWJhY2sgKG1vc3QgcmVjZW50IGNhbGwgbGFz dCk6IzAxMiDCoEZpbGUgJnF1b3Q7L3Vzci9saWIvcHl0aG9uMi43L3NpdGUtPHdicj5wYWNrYWdl cy92ZHNtL3ZpcnQvdm1zdGF0cy5weSZxdW90Ozx3YnI+LCBsaW5lIDIyMSwgaW4gc2VuZF9tZXRy aWNzIzAxMiDCoCDCoGRpc2tpbmZvWyYjMzk7cmVhZE9wcyYjMzk7XSM8d2JyPjAxMktleUVycm9y OiAmIzM5O3JlYWRPcHMmIzM5OzwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+dmRzbS5sb2c8YnI+ MjAxNy0wNS0yNiAxMToxODoxNiw3MTUrMDEwMCBFUlJPUiAocGVyaW9kaWMvMykgW3Jvb3RdIFZN IG1ldHJpY3MgY29sbGVjdGlvbiBmYWlsZWQgKHZtc3RhdHM6MjY0KTxicj4yMDE3LTA1LTI2IDEx OjE5OjM5LDM2OSswMTAwIEVSUk9SICh0YXNrcy81KSBbc3RvcmFnZS5Wb2x1bWVdIFVuZXhwZWN0 ZWQgZXJyb3IgKGZpbGVWb2x1bWU6NDU2KTxicj4yMDE3LTA1LTI2IDExOjE5OjM5LDM3MyswMTAw IEVSUk9SICh0YXNrcy81KSBbc3RvcmFnZS5Wb2x1bWVdIFVuZXhwZWN0ZWQgZXJyb3IgKHZvbHVt ZToxMTA3KTxicj4yMDE3LTA1LTI2IDExOjE5OjM5LDM3NCswMTAwIEVSUk9SICh0YXNrcy81KSBb c3RvcmFnZS5UYXNrTWFuYWdlci5UYXNrXSAoVGFzaz0mIzM5OzViMmFkYjlhLWUyNGUtNDhmYS08 d2JyPjlmMDEtZjIxYzIzNTg4YWVmJiMzOTspIFVuZXhwZWN0ZWQgZXJyb3IgKHRhc2s6ODcwKTwv ZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+Z2x1c3RlcmZzPGJyPlsyMDE3LTA1LTI2IDEwOjUzOjA4 LjI0NzIxOV0gVyBbTVNHSUQ6IDExNDAzMV0gW2NsaWVudC1ycGMtZm9wcy5jOjI5MzM6PHdicj5j bGllbnQzXzNfbG9va3VwX2Nia10gMC1ndjItY2xpZW50LTA6IHJlbW90ZSBvcGVyYXRpb24gZmFp bGVkLiBQYXRoOiAvLnNoYXJkLzU1Yjk0OTQyLWRlZTUtNGY2OS08d2JyPjhiMGYtNTJlMjUxYWM2 ZjVlLjE2NCAoMDAwMDAwMDAtMDAwMC0wMDAwLTAwMDAtPHdicj4wMDAwMDAwMDAwMDApIFtObyBk YXRhIGF2YWlsYWJsZV08YnI+WzIwMTctMDUtMjYgMTA6NTM6MTQuODk5NDk5XSBXIFtNU0dJRDog MTE0MDMxXSBbY2xpZW50LXJwYy1mb3BzLmM6MjkzMzo8d2JyPmNsaWVudDNfM19sb29rdXBfY2Jr XSAwLWd2Mi1jbGllbnQtMDogcmVtb3RlIG9wZXJhdGlvbiBmYWlsZWQuIFBhdGg6IC8uc2hhcmQv NTViOTQ5NDItZGVlNS00ZjY5LTx3YnI+OGIwZi01MmUyNTFhYzZmNWUuMTY3ICgwMDAwMDAwMC0w MDAwLTAwMDAtMDAwMC08d2JyPjAwMDAwMDAwMDAwMCkgW05vIGRhdGEgYXZhaWxhYmxlXTxicj5b MjAxNy0wNS0yNiAxMDo1MzoxNC44OTk1MjZdIEUgW01TR0lEOiAxMzMwMTBdIFtzaGFyZC5jOjE3 MjU6c2hhcmRfY29tbW9uXzx3YnI+bG9va3VwX3NoYXJkc19jYmtdIDAtZ3YyLXNoYXJkOiBMb29r dXAgb24gc2hhcmQgMTY3IGZhaWxlZC4gQmFzZSBmaWxlIGdmaWQgPSA1NWI5NDk0Mi1kZWU1LTRm NjktOGIwZi08d2JyPjUyZTI1MWFjNmY1ZSBbTm8gZGF0YSBhdmFpbGFibGVdPGJyPlsyMDE3LTA1 LTI2IDEwOjUzOjE5LjcxMjU2N10gVyBbTVNHSUQ6IDExNDAzMV0gW2NsaWVudC1ycGMtZm9wcy5j OjI5MzM6PHdicj5jbGllbnQzXzNfbG9va3VwX2Nia10gMC1ndjItY2xpZW50LTA6IHJlbW90ZSBv cGVyYXRpb24gZmFpbGVkLiBQYXRoOiAvLnNoYXJkLzU1Yjk0OTQyLWRlZTUtNGY2OS08d2JyPjhi MGYtNTJlMjUxYWM2ZjVlLjE2OSAoMDAwMDAwMDAtMDAwMC0wMDAwLTAwMDAtPHdicj4wMDAwMDAw MDAwMDApIFtObyBkYXRhIGF2YWlsYWJsZV08YnI+WzIwMTctMDUtMjYgMTA6NTM6MTkuNzEyNjE0 XSBFIFtNU0dJRDogMTMzMDEwXSBbc2hhcmQuYzoxNzI1OnNoYXJkX2NvbW1vbl88d2JyPmxvb2t1 cF9zaGFyZHNfY2JrXSAwLWd2Mi1zaGFyZDogTG9va3VwIG9uIHNoYXJkIDE2OSBmYWlsZWQuIEJh c2UgZmlsZSBnZmlkID0gNTViOTQ5NDItZGVlNS00ZjY5LThiMGYtPHdicj41MmUyNTFhYzZmNWUg W05vIGRhdGEgYXZhaWxhYmxlXTxicj5bMjAxNy0wNS0yNiAxMDo1MzoyOS40MTkzMTddIFcgW01T R0lEOiAxMTQwMzFdIFtjbGllbnQtcnBjLWZvcHMuYzoyOTMzOjx3YnI+Y2xpZW50M18zX2xvb2t1 cF9jYmtdIDAtZ3YyLWNsaWVudC0wOiByZW1vdGUgb3BlcmF0aW9uIGZhaWxlZC4gUGF0aDogLy5z aGFyZC81NWI5NDk0Mi1kZWU1LTRmNjktPHdicj44YjBmLTUyZTI1MWFjNmY1ZS4xNzMgKDAwMDAw MDAwLTAwMDAtMDAwMC0wMDAwLTx3YnI+MDAwMDAwMDAwMDAwKSBbTm8gZGF0YSBhdmFpbGFibGVd PGJyPlsyMDE3LTA1LTI2IDEwOjUzOjI5LjQxOTM2OV0gRSBbTVNHSUQ6IDEzMzAxMF0gW3NoYXJk LmM6MTcyNTpzaGFyZF9jb21tb25fPHdicj5sb29rdXBfc2hhcmRzX2Nia10gMC1ndjItc2hhcmQ6 IExvb2t1cCBvbiBzaGFyZCAxNzMgZmFpbGVkLiBCYXNlIGZpbGUgZ2ZpZCA9IDU1Yjk0OTQyLWRl ZTUtNGY2OS04YjBmLTx3YnI+NTJlMjUxYWM2ZjVlIFtObyBkYXRhIGF2YWlsYWJsZV08YnI+PC9k aXY+PGRpdj48YnI+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj50aGFua3M8L2Rpdj48ZGl2Pjxi cj48L2Rpdj48aHIgaWQ9Im1fLTM1MzMyNDgyOTQ2NTMyMzgwNjN6d2NociI+PGRpdj48Yj5EZTog PC9iPiZxdW90O1NhaGluYSBCb3NlJnF1b3Q7ICZsdDs8YSBocmVmPSJtYWlsdG86c2Fib3NlQHJl ZGhhdC5jb20iIHRhcmdldD0iX2JsYW5rIj5zYWJvc2VAcmVkaGF0LmNvbTwvYT4mZ3Q7PGJyPjxi PlBhcmE6IDwvYj48YSBocmVmPSJtYWlsdG86c3Vwb3J0ZUBsb2dpY3dvcmtzLnB0IiB0YXJnZXQ9 Il9ibGFuayI+c3Vwb3J0ZUBsb2dpY3dvcmtzLnB0PC9hPiwgJnF1b3Q7S3J1dGlrYSBEaGFuYW5q YXkmcXVvdDsgJmx0OzxhIGhyZWY9Im1haWx0bzprZGhhbmFuakByZWRoYXQuY29tIiB0YXJnZXQ9 Il9ibGFuayI+a2RoYW5hbmpAcmVkaGF0LmNvbTwvYT4mZ3Q7PGJyPjxiPkNjOiA8L2I+JnF1b3Q7 b3ZpcnQgdXNlcnMmcXVvdDsgJmx0OzxhIGhyZWY9Im1haWx0bzp1c2Vyc0BvdmlydC5vcmciIHRh cmdldD0iX2JsYW5rIj51c2Vyc0BvdmlydC5vcmc8L2E+Jmd0Ozxicj48Yj5FbnZpYWRhczogPC9i PlF1aW50YS1mZWlyYSwgMjUgRGUgTWFpbyBkZSAyMDE3IDc6MTI6NDA8YnI+PGI+QXNzdW50bzog PC9iPlJlOiBbb3ZpcnQtdXNlcnNdIHZtIGhhcyBiZWVuIHBhdXNlZCBkdWUgdG8gdW5rbm93biBz dG9yYWdlPGJyPjwvZGl2PjxkaXY+PGRpdiBjbGFzcz0iaDUiPjxkaXY+PGJyPjwvZGl2PjxkaXY+ PGRpdiBkaXI9Imx0ciI+PGRpdj5UaGUgZ2x1c3RlcmZzIGxvZ3MgY29udGFpbiBiZWxvdyBlcnJv cnM6PGJyPlsyMDE3LTA1LTIyIDE4OjEyOjUwLjk0MTg4M10gRSBbTVNHSUQ6IDEzMzAxMF0gW3No YXJkLmM6MTcyNTpzaGFyZF9jb21tb25fPHdicj5sb29rdXBfc2hhcmRzX2Nia10gMC1ndjItc2hh cmQ6IExvb2t1cCBvbiBzaGFyZCA1MCBmYWlsZWQuIEJhc2UgZmlsZSBnZmlkID0gMzNmMWZlM2Ut YzYyNi00OWYyLTg2MWUtPHdicj4yMjU5Yzk3MjkzMWQgW05vIGRhdGEgYXZhaWxhYmxlXTxicj5b MjAxNy0wNS0yMiAxODoxMjo1MC45NDUwODVdIFcgW2Z1c2UtYnJpZGdlLmM6MTI5MTpmdXNlX2Vy cl88d2JyPmNia10gMC1nbHVzdGVyZnMtZnVzZTogNjEzMDY3MTM6IEZTWU5DKCkgRVJSID0mZ3Q7 IC0xIChObyBkYXRhIGF2YWlsYWJsZSk8YnI+PGJyPjwvZGl2PktydXRpa2EsIGNvdWxkIHlvdSB0 YWtlIGEgbG9vaz88YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZXh0cmEiPjxicj48ZGl2IGNs YXNzPSJnbWFpbF9xdW90ZSI+T24gVGh1LCBNYXkgMjUsIDIwMTcgYXQgMTowMiBBTSwgPHNwYW4g ZGlyPSJsdHIiPiZsdDs8YSBocmVmPSJtYWlsdG86c3Vwb3J0ZUBsb2dpY3dvcmtzLnB0IiB0YXJn ZXQ9Il9ibGFuayI+c3Vwb3J0ZUBsb2dpY3dvcmtzLnB0PC9hPiZndDs8L3NwYW4+IHdyb3RlOjxi cj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MCAwIDAgLjhl eDtib3JkZXItbGVmdDoxcHggI2NjYyBzb2xpZDtwYWRkaW5nLWxlZnQ6MWV4Ij48ZGl2PjxkaXYg c3R5bGU9ImZvbnQtZmFtaWx5OlRpbWVzIE5ldyBSb21hbjtmb250LXNpemU6MTBwdDtjb2xvcjoj MDAwMDAwIj48ZGl2PkhpLDxicj48L2Rpdj48YnI+PGRpdj5JIHNldHVwIGFuIG92aXJ0IGhvc3Rl ZCBlbmluZSwgaW4gb25seSBvbmUgc2VydmVyIHdpdGggbG9jYWwgZ2x1c3RlciBicmlja3MuPGJy PjwvZGl2Pjxicj48ZGl2PldoZW4gcnVubmluZyBhIE1TIFNRTCAyMDEyIHByb2Nlc3MgdG8gcmVi dWlsZCBhIGRhdGEgYmFzZSwgd2hpY2ggdGFrZSBhcm91bmQgNCBob3VycywgYWZ0ZXIgYSB3aGls ZSB0aGUgVk0gaXMgcGF1c2VkIHdpdGggdGhlIGVycm9yOjxicj48L2Rpdj48ZGl2PjxwcmU+dm0g aGFzIGJlZW4gcGF1c2VkIGR1ZSB0byB1bmtub3duIHN0b3JhZ2U8YnI+PGJyPlRoZSBWTSBkaXNr IGlzIGluIFRoaW4gcHJvdmlzaW9uCgpPdmlydCBhbmQgZ2x1dGVyIHZlcnNpb25zOgoKVmVyc2lv biA0LjEuMS44LTEuZWw3LmNlbnRvcwoKZ2x1c3RlcmZzLWNsaS0zLjguMTEtMS5lbDcuPHdicj54 ODZfNjQKZ2x1c3RlcmZzLWxpYnMtMy44LjExLTEuZWw3Ljx3YnI+eDg2XzY0CmdsdXN0ZXJmcy0z LjguMTEtMS5lbDcueDg2XzY0CmdsdXN0ZXJmcy1jbGllbnQteGxhdG9ycy0zLjguPHdicj4xMS0x LmVsNy54ODZfNjQKZ2x1c3RlcmZzLWZ1c2UtMy44LjExLTEuZWw3Ljx3YnI+eDg2XzY0CmdsdXN0 ZXJmcy1hcGktMy44LjExLTEuZWw3Ljx3YnI+eDg2XzY0CmdsdXN0ZXJmcy1zZXJ2ZXItMy44LjEx LTEuZWw3Ljx3YnI+eDg2XzY0PC9wcmU+PC9kaXY+PGJyPjxkaXY+SSBjYW4gZmluZCB0aGUgcmVh c29uIHdoeTxicj48L2Rpdj48ZGl2PlRoZSBsb2dzIGFyZSBhdHRhY2hlZC48YnI+PC9kaXY+PGJy PjxkaXY+QW55IGlkZWE/PGJyPjwvZGl2Pjxicj48ZGl2PlRoYW5rczxzcGFuIGNsYXNzPSJtXy0z NTMzMjQ4Mjk0NjUzMjM4MDYzSE9FblpiIj48c3BhbiBjb2xvcj0iIzg4ODg4OCIgc3R5bGU9ImNv bG9yOiM4ODg4ODgiPjxicj48L3NwYW4+PC9zcGFuPjwvZGl2PjxzcGFuIGNsYXNzPSJtXy0zNTMz MjQ4Mjk0NjUzMjM4MDYzSE9FblpiIj48c3BhbiBjbGFzcz0ibV8tMzUzMzI0ODI5NDY1MzIzODA2 M0hPRW5aYiI+PHNwYW4gY29sb3I9IiM4ODg4ODgiIHN0eWxlPSJjb2xvcjojODg4ODg4Ij48YnI+ PC9zcGFuPjwvc3Bhbj48L3NwYW4+PGRpdj4tLSA8YnI+PC9kaXY+PGRpdj48aHIgc3R5bGU9Indp ZHRoOjEwMCU7aGVpZ2h0OjJweCI+Sm9zZSBGZXJyYWRlaXJhPGJyPjxhIGhyZWY9Imh0dHA6Ly93 d3cubG9naWN3b3Jrcy5wdCIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly93d3cubG9naWN3b3Jrcy5w dDwvYT48YnI+PC9kaXY+PC9kaXY+PC9kaXY+PGJyPl9fX19fX19fX19fX19fX19fX19fX19fX19f X19fXzx3YnI+X19fX19fX19fX19fX19fX188YnI+IFVzZXJzIG1haWxpbmcgbGlzdDxicj4gPGEg aHJlZj0ibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyIgdGFyZ2V0PSJfYmxhbmsiPlVzZXJzQG92aXJ0 Lm9yZzwvYT48YnI+IDxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0 aW5mby91c2VycyIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2xpc3Rz Lm92aXJ0Lm9yZy88d2JyPm1haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+PGJyPiA8YnI+PC9ibG9j a3F1b3RlPjwvZGl2PjwvZGl2Pjxicj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Js b2NrcXVvdGU+PC9kaXY+PGJyPjwvZGl2Pgo= --===============7351259195495759140==-- From suporte at logicworks.pt Wed May 31 09:16:39 2017 Content-Type: multipart/mixed; boundary="===============7916983776730090799==" MIME-Version: 1.0 From: suporte at logicworks.pt To: users at ovirt.org Subject: Re: [ovirt-users] vm has been paused due to unknown storage Date: Wed, 31 May 2017 10:16:16 +0100 Message-ID: <639134007.4068379.1496222176802.JavaMail.zimbra@logicworks.pt> In-Reply-To: 1948093299.3486719.1495798063219.JavaMail.zimbra@logicworks.pt --===============7916983776730090799== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_4068378_74557332.1496222176801 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit Hi, = I found the cause of this problem. I had to turn off sharding. = De: suporte(a)logicworks.pt = Para: "Sahina Bose" = Cc: "ovirt users" = Enviadas: Sexta-feira, 26 De Maio de 2017 12:27:43 = Assunto: Re: [ovirt-users] vm has been paused due to unknown storage = Hi, = I updated glusterfs: = glusterfs-client-xlators-3.8.12-1.el7.x86_64 = glusterfs-cli-3.8.12-1.el7.x86_64 = glusterfs-api-3.8.12-1.el7.x86_64 = glusterfs-fuse-3.8.12-1.el7.x86_64 = glusterfs-server-3.8.12-1.el7.x86_64 = glusterfs-libs-3.8.12-1.el7.x86_64 = glusterfs-3.8.12-1.el7.x86_64 = Now I cannot add a volume disk preallocated, after a while it breaks. = message log: = May 26 11:18:16 node journal: vdsm root ERROR VM metrics collection failed#= 012Traceback (most recent call last):#012 File "/usr/lib/python2.7/site-pac= kages/vdsm/virt/vmstats.py", line 221, in send_metrics#012 diskinfo['readOp= s']#012KeyError: 'readOps' = vdsm.log = 2017-05-26 11:18:16,715+0100 ERROR (periodic/3) [root] VM metrics collectio= n failed (vmstats:264) = 2017-05-26 11:19:39,369+0100 ERROR (tasks/5) [storage.Volume] Unexpected er= ror (fileVolume:456) = 2017-05-26 11:19:39,373+0100 ERROR (tasks/5) [storage.Volume] Unexpected er= ror (volume:1107) = 2017-05-26 11:19:39,374+0100 ERROR (tasks/5) [storage.TaskManager.Task] (Ta= sk=3D'5b2adb9a-e24e-48fa-9f01-f21c23588aef') Unexpected error (task:870) = glusterfs = [2017-05-26 10:53:08.247219] W [MSGID: 114031] [client-rpc-fops.c:2933:clie= nt3_3_lookup_cbk] 0-gv2-client-0: remote operation failed. Path: /.shard/55= b94942-dee5-4f69-8b0f-52e251ac6f5e.164 (00000000-0000-0000-0000-00000000000= 0) [No data available] = [2017-05-26 10:53:14.899499] W [MSGID: 114031] [client-rpc-fops.c:2933:clie= nt3_3_lookup_cbk] 0-gv2-client-0: remote operation failed. Path: /.shard/55= b94942-dee5-4f69-8b0f-52e251ac6f5e.167 (00000000-0000-0000-0000-00000000000= 0) [No data available] = [2017-05-26 10:53:14.899526] E [MSGID: 133010] [shard.c:1725:shard_common_l= ookup_shards_cbk] 0-gv2-shard: Lookup on shard 167 failed. Base file gfid = =3D 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No data available] = [2017-05-26 10:53:19.712567] W [MSGID: 114031] [client-rpc-fops.c:2933:clie= nt3_3_lookup_cbk] 0-gv2-client-0: remote operation failed. Path: /.shard/55= b94942-dee5-4f69-8b0f-52e251ac6f5e.169 (00000000-0000-0000-0000-00000000000= 0) [No data available] = [2017-05-26 10:53:19.712614] E [MSGID: 133010] [shard.c:1725:shard_common_l= ookup_shards_cbk] 0-gv2-shard: Lookup on shard 169 failed. Base file gfid = =3D 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No data available] = [2017-05-26 10:53:29.419317] W [MSGID: 114031] [client-rpc-fops.c:2933:clie= nt3_3_lookup_cbk] 0-gv2-client-0: remote operation failed. Path: /.shard/55= b94942-dee5-4f69-8b0f-52e251ac6f5e.173 (00000000-0000-0000-0000-00000000000= 0) [No data available] = [2017-05-26 10:53:29.419369] E [MSGID: 133010] [shard.c:1725:shard_common_l= ookup_shards_cbk] 0-gv2-shard: Lookup on shard 173 failed. Base file gfid = =3D 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No data available] = thanks = De: "Sahina Bose" = Para: suporte(a)logicworks.pt, "Krutika Dhananjay" = Cc: "ovirt users" = Enviadas: Quinta-feira, 25 De Maio de 2017 7:12:40 = Assunto: Re: [ovirt-users] vm has been paused due to unknown storage = The glusterfs logs contain below errors: = [2017-05-22 18:12:50.941883] E [MSGID: 133010] [shard.c:1725:shard_common_l= ookup_shards_cbk] 0-gv2-shard: Lookup on shard 50 failed. Base file gfid = =3D 33f1fe3e-c626-49f2-861e-2259c972931d [No data available] = [2017-05-22 18:12:50.945085] W [fuse-bridge.c:1291:fuse_err_cbk] 0-glusterf= s-fuse: 61306713: FSYNC() ERR =3D> -1 (No data available) = Krutika, could you take a look? = On Thu, May 25, 2017 at 1:02 AM, < suporte(a)logicworks.pt > wrote: = Hi, = I setup an ovirt hosted enine, in only one server with local gluster bricks= . = When running a MS SQL 2012 process to rebuild a data base, which take aroun= d 4 hours, after a while the VM is paused with the error: = vm has been paused due to unknown storage = The VM disk is in Thin provision Ovirt and gluter versions: Version 4.1.1.8-1.el7.centos glusterfs-cli-3.8.11-1.el7.x86_64 glusterfs-libs-3.8.11-1.el7.x86_64 glusterfs-3.8.11-1.el7.x86_64 glusterfs-client-xlators-3.8.11-1.el7.x86_64 glusterfs-fuse-3.8.11-1.el7.x86_64 glusterfs-api-3.8.11-1.el7.x86_64 glusterfs-server-3.8.11-1.el7.x86_64 = I can find the reason why = The logs are attached. = Any idea? = Thanks = -- = Jose Ferradeira = http://www.logicworks.pt = _______________________________________________ = Users mailing list = Users(a)ovirt.org = http://lists.ovirt.org/mailman/listinfo/users = _______________________________________________ = Users mailing list = Users(a)ovirt.org = http://lists.ovirt.org/mailman/listinfo/users = ------=3D_Part_4068378_74557332.1496222176801 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable

Hi,

= I =3D found the cause of this problem. I had to turn off sharding.

De: suporte(a)logicworks.pt
<= b>Pa=3D ra: "Sahina Bose" <sabose(a)redhat.com>
Cc: "ovirt user= s"=3D <users(a)ovirt.org>
Enviadas: Sexta-feira, 26 De Maio de 2= 01=3D 7 12:27:43
Assunto: Re: [ovirt-users] vm has been paused due to u= =3D nknown storage

Hi,

I updated glusterfs:

glusterfs-= =3D client-xlators-3.8.12-1.el7.x86_64
glusterfs-cli-3.8.12-1.el7.x86_64
= =3D glusterfs-api-3.8.12-1.el7.x86_64
glusterfs-fuse-3.8.12-1.el7.x86_64
= =3D glusterfs-server-3.8.12-1.el7.x86_64
glusterfs-libs-3.8.12-1.el7.x86_64<= =3D br>glusterfs-3.8.12-1.el7.x86_64

Now I cannot add a volume di= =3D sk preallocated, after a while it breaks.

message log:

<= =3D div>May 26 11:18:16 node journal: vdsm root ERROR VM metrics collection fai= =3D led#012Traceback (most recent call last):#012 File "/usr/lib/python2.= =3D 7/site-packages/vdsm/virt/vmstats.py", line 221, in send_metrics#012 = =3D diskinfo['readOps']#012KeyError: 'readOps'

vdsm.log2017-05-26 11:18:16,715+0100 ERROR (periodic/3) [root] VM metrics collecti= =3D on failed (vmstats:264)
2017-05-26 11:19:39,369+0100 ERROR (tasks/5) [st= =3D orage.Volume] Unexpected error (fileVolume:456)
2017-05-26 11:19:39,373+= =3D 0100 ERROR (tasks/5) [storage.Volume] Unexpected error (volume:1107)
201= =3D 7-05-26 11:19:39,374+0100 ERROR (tasks/5) [storage.TaskManager.Task] (Task= =3D =3D3D'5b2adb9a-e24e-48fa-9f01-f21c23588aef') Unexpected error (task:870)

glusterfs
[2017-05-26 10:53:08.247219] W [MSGID: 114031] [clie= =3D nt-rpc-fops.c:2933:client3_3_lookup_cbk] 0-gv2-client-0: remote operation f= =3D ailed. Path: /.shard/55b94942-dee5-4f69-8b0f-52e251ac6f5e.164 (00000000-000= =3D 0-0000-0000-000000000000) [No data available]
[2017-05-26 10:53:14.89949= =3D 9] W [MSGID: 114031] [client-rpc-fops.c:2933:client3_3_lookup_cbk] 0-gv2-cl= =3D ient-0: remote operation failed. Path: /.shard/55b94942-dee5-4f69-8b0f-52e2= =3D 51ac6f5e.167 (00000000-0000-0000-0000-000000000000) [No data available]
= =3D [2017-05-26 10:53:14.899526] E [MSGID: 133010] [shard.c:1725:shard_common_l= =3D ookup_shards_cbk] 0-gv2-shard: Lookup on shard 167 failed. Base file gfid = =3D =3D3D 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No data available]
[2017-05-= 26=3D 10:53:19.712567] W [MSGID: 114031] [client-rpc-fops.c:2933:client3_3_looku= =3D p_cbk] 0-gv2-client-0: remote operation failed. Path: /.shard/55b94942-dee5= =3D -4f69-8b0f-52e251ac6f5e.169 (00000000-0000-0000-0000-000000000000) [No data= =3D available]
[2017-05-26 10:53:19.712614] E [MSGID: 133010] [shard.c:1725= =3D :shard_common_lookup_shards_cbk] 0-gv2-shard: Lookup on shard 169 failed. B= =3D ase file gfid =3D3D 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No data available= ]<=3D br>[2017-05-26 10:53:29.419317] W [MSGID: 114031] [client-rpc-fops.c:2933:c= =3D lient3_3_lookup_cbk] 0-gv2-client-0: remote operation failed. Path: /.shard= =3D /55b94942-dee5-4f69-8b0f-52e251ac6f5e.173 (00000000-0000-0000-0000-00000000= =3D 0000) [No data available]
[2017-05-26 10:53:29.419369] E [MSGID: 133010]= =3D [shard.c:1725:shard_common_lookup_shards_cbk] 0-gv2-shard: Lookup on shard= =3D 173 failed. Base file gfid =3D3D 55b94942-dee5-4f69-8b0f-52e251ac6f5e [No = da=3D ta available]

thanks

<=3D b>De: "Sahina Bose" <sabose(a)redhat.com>
Para: suporte= (a)l=3D ogicworks.pt, "Krutika Dhananjay" <kdhananj(a)redhat.com>
Cc: <= /b=3D >"ovirt users" <users(a)ovirt.org>
Enviadas: Quinta-feira, = 25=3D De Maio de 2017 7:12:40
Assunto: Re: [ovirt-users] vm has been p= =3D aused due to unknown storage

The = gl=3D usterfs logs contain below errors:
[2017-05-22 18:12:50.941883] E [MSGID= =3D : 133010] [shard.c:1725:shard_common_lookup_shards_cbk] 0-gv2-shard: Lookup= =3D on shard 50 failed. Base file gfid =3D3D 33f1fe3e-c626-49f2-861e-2259c9729= 31=3D d [No data available]
[2017-05-22 18:12:50.945085] W [fuse-bridge.c:1291= =3D :fuse_err_cbk] 0-glusterfs-fuse: 61306713: FSYNC() ERR =3D3D> -1 (No dat= a =3D available)

Krutika, could you take a look?

On Thu, May 25, 2017 at= 1:0=3D 2 AM, <suporte(a)= logicwor=3D ks.pt> wrote:
Hi,

I setup an ovirt hosted enin= =3D e, in only one server with local gluster bricks.

When run= =3D ning a MS SQL 2012 process to rebuild a data base, which take around 4 hour= =3D s, after a while the VM is paused with the error:
vm has= =3D been paused due to unknown storage

The VM disk is in Thin provision Ovirt and gluter versions: Version 4.1.1.8-1.el7.centos glusterfs-cli-3.8.11-1.el7.x86_64 glusterfs-libs-3.8.11-1.el7.x86_64 glusterfs-3.8.11-1.el7.x86_64 glusterfs-client-xlators-3.8.11-1.el7.x86_64 glusterfs-fuse-3.8.11-1.el7.x86_64 glusterfs-api-3.8.11-1.el7.x86_64 glusterfs-server-3.8.11-1.el7.x86_64

I can find the rea= =3D son why
The logs are attached.

Any idea?

Thanks

--
<= hr=3D style=3D3D"width: 100%; height: 2px;" data-mce-style=3D3D"width: 100%; hei= ght:=3D 2px;">Jose Ferradeira
http://www.logicworks.pt=

_______________________________________________= =3D
Users mailing list
Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users

__________________________________________= =3D _____
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/= ma=3D ilman/listinfo/users