7:57 p.m.
------=_Part_207610_1010575880.1505217464112
Content-Type: text/plain; charset=GBK
Content-Transfer-Encoding: base64
SSBrbm93IHRoYXQsCgphZnRlciBuZnMgbW91bnRlZCBpbiBjbGllbnQsIGl0IHVzZWQgbmZzIHNl
cnZlcidzIHBlcm1pc3Npb24sIGFsdGhvdWdoIGkgZG9uJ3Qga25vdyB3aHkgaXQncyB0aGlzLCBi
dXQgaSBleGVjdXRlIGFzIGZvbGxvd3MgaW4gbmZzIHNlcnZlcjoKIyB1c2VyYWRkIHNhbmxvY2sg
LXUgMTE0CiMgdXNlcm1vZCAtYSAtRyBrdm0gc2FubG9jawoKCnRoZW4gaXQncyB3b3JrcyB3ZWxs
IQoKCnRoYW5rcyBhbnlob3chCgoKCgoKCkF0IDIwMTctMDktMTIgMTg6NDc6NTUsICJwZW5neWl4
aWFuZyIgPHl4cGVuZ2kzODZAMTYzLmNvbT4gd3JvdGU6CgpoZWxsbyBOaXIKICAgIEkganVzdCBk
byBhIHRlc3QsIGFzIGZvbGxvd3MsIGkgYWRkIGxpbnggdG8gZ3JvdXAga3ZtCgojIGNhdCAvZXRj
L2dyb3VwIHwgZ3JlcCAia3ZtIgprdm06eDoxMTI6cWVtdSx2ZHNtLGxpbngsc2FubG9jawoKCgph
bmQgaSBzZWUgdGhlIHBlcm1pc3Npb24gb2YgbGVhc2VzIG9mIG5mcyBzdG9yYWdlOgoKJCBscyAt
bCAvcmhldi9kYXRhLWNlbnRlci9tbnQvMTkyLjE2OC4xMS41NVw6X2hvbWVfZGF0YVN0b3JhZ2Uv
MTg0NWJlMjItMWFjNC00ZTQyLWJiY2ItN2JhOWNjZDZlNTY5L2RvbV9tZC9sZWFzZXMKLXJ3LXJ3
LS0tLSAxIHZkc20ga3ZtIDIwOTcxNTIgOdTCICAxMSAxOToyMSAvcmhldi9kYXRhLWNlbnRlci9t
bnQvMTkyLjE2OC4xMS41NTpfaG9tZV9kYXRhU3RvcmFnZS8xODQ1YmUyMi0xYWM0LTRlNDItYmJj
Yi03YmE5Y2NkNmU1NjkvZG9tX21kL2xlYXNlcwoKCgpzYW5sb2NrIGNhbm5vdCByZWFkIGl0CjQy
NTEzOCAgICAgcmVzb3VyY2UgPSBzYW5sb2NrLnJlYWRfcmVzb3VyY2UobGVhc2UucGF0aCwgbGVh
c2Uub2Zmc2V0KQo0MjUxMzkgU2FubG9ja0V4Y2VwdGlvbjogKDEzLCAnU2FubG9jayByZXNvdXJj
ZSByZWFkIGZhaWx1cmUnLCAnUGVybWlzc2lvbiBkZW5pZWQnKQoKCmFuZCBpIGNhbm5vdCBjaGFu
Z2UgdG8gc2FubG9jayBsaWtlIHRoYXQ6CiMgc3Ugc2FubG9jawpyb290QE5vZGU6fiMKCgpzbyBp
IGFkZCBhIHVzZXIgbGlueCB0byBncm91cCBrdm0sIGFuZCBhY2Nlc3MgdG8gYSBvNjYwIGZpbGUg
d2l0aCB2ZHNtOmt2bSBhcyBmb2xsb3dzOgoKJCBscyAtbArX3NPDwb8gMTYKLXJ3LXJ3LS0tLSAx
IHZkc20ga3ZtICAgICA2IDnUwiAgMTEgMjA6MDYgMS50eHQKZHJ3eHIteHIteCA5IGxpbnggbGlu
eCA0MDk2IDnUwiAgIDEgMTU6NTggbGlueC12aXJ0dWFsaXphdGlvbgpkcnctcnctLS0tIDMgbGlu
eCBsaW54IDQwOTYgOdTCICAxMSAyMDoxMyB0ZXN0MgpkcnctcnctLS0tIDIgbGlueCBsaW54IDQw
OTYgOdTCICAxMSAyMDoxOSB0ZXN0MwoKCnRoZW4gd2UgY2FuIHZpZXcgdGhlIGZpbGUgaW4gdXNl
ciAibGlueCI6CiQgY2F0IH4vMS50eHQKcGVuY2MKCgp0aGVuIGkgY3JlYXRlIDEudHh0IGFzIHNh
bWUgYXMgfi8xLnR4dCBpbiBuZnMgbW91bnQgcG9pbnQgbGlrZSB0aGF0IHdpdGggcGVybWlzc2lv
biBvNjY2IHZkc206a3ZtIDoKCi9yaGV2L2RhdGEtY2VudGVyL21udC8xOTIuMTY4LjExLjU1XDpf
aG9tZV9kYXRhU3RvcmFnZS8xODQ1YmUyMi0xYWM0LTRlNDItYmJjYi03YmE5Y2NkNmU1NjkvMS50
eHQKCgp0aGVuIGkgcmVhZCBpdCwgYnV0IGZhaWxlZCB0b28KClBlcm1pc3Npb24gZGVuaWVkCgoK
aWYgaSBjaGFuZ2UgMS50eHQncyBwZXJtaXNzaW9uIGluIG1vdW50IHBvaW50IHRvIG82NjYKCgoK
dGhlbiBpIGNhbiByZWFkIGl0IHN1Y2NlZWQuCgoKaSB0aGluaywgbWF5YmUgbmZzJ3MgbW91bnQg
Y2F1c2VkIGdyb3VwIHBlcm1pc3Npb24gZmFpbGVkLCBncm91cCBwZXJtaXNzaW9uIGFzIHRoZSBz
ZWNvbmQgJzYnIG9mIG82NjYKCgoKaSBjYW5ub3QgdW5kZXJzdGFuZCBpdCwgdGhpcyBteSBuZnMt
c2VydmVyJ3MgZXhwb3J0cyBjb25maWd1cmF0aW9uczoKL2hvbWUvZGF0YVN0b3JhZ2UgKihydyxz
eW5jLG5vX3N1YnRyZWVfY2hlY2spCgoKaGF2ZSBhbnkgIGlkZWFzPyBRQVEKCgoKCgrU2iAyMDE3
LTA5LTEyIDE4OjA2OjA4o6wiTmlyIFNvZmZlciIgPG5zb2ZmZXJAcmVkaGF0LmNvbT4g0LS1wKO6
CgoKCk9uIFR1ZSwgMTIgU2VwIDIwMTcsIDQ6NTIgcGVuZ3lpeGlhbmcgPHl4cGVuZ2kzODZAMTYz
LmNvbT4gd3JvdGU6CgpoZWxsbyxldmVyeW9uZQogICAgc2FubG9jayBmYWlsZWQgZHVlIHRvIGNh
bm5vdCByZWFkIG5mcyBzdG9yYWdlJ3MgZGF0YSAsIGkgdHJpZWQgdG8gY2htb2QgNzc3IC9yaGV2
L2RhdGEtY2VudGVyL21udC8xOTIuMTY4LjExLjU1XDpfaG9tZV9kYXRhU3RvcmFnZS8xODQ1YmUy
Mi0xYWM0LTRlNDItYmJjYi03YmE5Y2NkNmU1NjkvZG9tX21kLyooYWRkIG90aGVycyBwZXJtaXNz
aW9uKSwgdGhlbiBpdCdzIG9rCgoKICAgIHNhbmxvY2sncyBsb2c6CjQyNTEyMCBUcmFjZWJhY2sg
KG1vc3QgcmVjZW50IGNhbGwgbGFzdCk6CjQyNTEyMSAgIEZpbGUgIi91c3IvbGliL3B5dGhvbjIu
Ny9kaXN0LXBhY2thZ2VzL3Zkc20vc3RvcmFnZS90YXNrLnB5IiwgbGluZSA4NzgsIGluIF9ydW4K
NDI1MTIyICAgICByZXR1cm4gZm4oKmFyZ3MsICoqa2FyZ3MpCjQyNTEyMyAgIEZpbGUgIi91c3Iv
bGliL3B5dGhvbjIuNy9kaXN0LXBhY2thZ2VzL3Zkc20vbG9nVXRpbHMucHkiLCBsaW5lIDUyLCBp
biB3cmFwcGVyCjQyNTEyNCAgICAgcmVzID0gZigqYXJncywgKiprd2FyZ3MpCjQyNTEyNSAgIEZp
bGUgIi91c3Ivc2hhcmUvdmRzbS9zdG9yYWdlL2hzbS5weSIsIGxpbmUgNjE5LCBpbiBnZXRTcG1T
dGF0dXMKNDI1MTI2ICAgICBzdGF0dXMgPSBzZWxmLl9nZXRTcG1TdGF0dXNJbmZvKHBvb2wpCjQy
NTEyNyAgIEZpbGUgIi91c3Ivc2hhcmUvdmRzbS9zdG9yYWdlL2hzbS5weSIsIGxpbmUgNjEzLCBp
biBfZ2V0U3BtU3RhdHVzSW5mbwo0MjUxMjggICAgIChwb29sLnNwbVJvbGUsKSArIHBvb2wuZ2V0
U3BtU3RhdHVzKCkpKQo0MjUxMjkgICBGaWxlICIvdXNyL3NoYXJlL3Zkc20vc3RvcmFnZS9zcC5w
eSIsIGxpbmUgMTQxLCBpbiBnZXRTcG1TdGF0dXMKNDI1MTMwICAgICByZXR1cm4gc2VsZi5fYmFj
a2VuZC5nZXRTcG1TdGF0dXMoKQo0MjUxMzEgICBGaWxlICIvdXNyL3NoYXJlL3Zkc20vc3RvcmFn
ZS9zcGJhY2tlbmRzLnB5IiwgbGluZSA0MzMsIGluIGdldFNwbVN0YXR1cwo0MjUxMzIgICAgIGxW
ZXIsIHNwbUlkID0gc2VsZi5tYXN0ZXJEb21haW4uaW5xdWlyZUNsdXN0ZXJMb2NrKCkKNDI1MTMz
ICAgRmlsZSAiL3Vzci9zaGFyZS92ZHNtL3N0b3JhZ2Uvc2QucHkiLCBsaW5lIDgxNywgaW4gaW5x
dWlyZUNsdXN0ZXJMb2NrCjQyNTEzNCAgICAgcmV0dXJuIHNlbGYuX21hbmlmZXN0LmlucXVpcmVE
b21haW5Mb2NrKCkKNDI1MTM1ICAgRmlsZSAiL3Vzci9zaGFyZS92ZHNtL3N0b3JhZ2Uvc2QucHki
LCBsaW5lIDUyMiwgaW4gaW5xdWlyZURvbWFpbkxvY2sKNDI1MTM2ICAgICByZXR1cm4gc2VsZi5f
ZG9tYWluTG9jay5pbnF1aXJlKHNlbGYuZ2V0RG9tYWluTGVhc2UoKSkKNDI1MTM3ICAgRmlsZSAi
L3Vzci9saWIvcHl0aG9uMi43L2Rpc3QtcGFja2FnZXMvdmRzbS9zdG9yYWdlL2NsdXN0ZXJsb2Nr
LnB5IiwgbGluZSAzNzIsIGluIGkgICAgICAgbnF1aXJlCjQyNTEzOCAgICAgcmVzb3VyY2UgPSBz
YW5sb2NrLnJlYWRfcmVzb3VyY2UobGVhc2UucGF0aCwgbGVhc2Uub2Zmc2V0KQo0MjUxMzkgU2Fu
bG9ja0V4Y2VwdGlvbjogKDEzLCAnU2FubG9jayByZXNvdXJjZSByZWFkIGZhaWx1cmUnLCAnUGVy
bWlzc2lvbiBkZW5pZWQnKQoKCmkgdGVzdCBpdCwgYW5kIGluIG5vZGUsSSBhZGQgdXNlciAibGlu
eCIgdG8gZ3JvdXAgImt2bSIKCiQgY2F0IC9ldGMvZ3JvdXAgfCBncmVwICJrdm0iCmt2bTp4OjEx
MjpxZW11LHZkc20sbGlueCxzYW5sb2NrCgoKdGhlbiBpIGNyZWF0ZSBhIGZpbGUgaW4gJEhPTUU6
CiQgbHMgLWwK19zTw8G/IDE2Ci1ydy1ydy0tLS0gMSB2ZHNtIGt2bSAgICAgNiA51MIgIDExIDIw
OjA2IDEudHh0CmRyd3hyLXhyLXggOSBsaW54IGxpbnggNDA5NiA51MIgICAxIDE1OjU4IGxpbngt
dmlydHVhbGl6YXRpb24KZHJ3LXJ3LS0tLSAzIGxpbnggbGlueCA0MDk2IDnUwiAgMTEgMjA6MTMg
dGVzdDIKZHJ3LXJ3LS0tLSAyIGxpbnggbGlueCA0MDk2IDnUwiAgMTEgMjA6MTkgdGVzdDMKCgp0
aGVuIHdlIGNhbiB2aWV3IHRoZSBmaWxlIGluIHVzZXIgImxpbngiOgokIGNhdCAxLnR4dApwZW5j
YwoKCmxlYXNlcyBpZiB2ZHNtOmt2bSB0b286CiQgbHMgLWwgL3JoZXYvZGF0YS1jZW50ZXIvbW50
LzE5Mi4xNjguMTEuNTVcOl9ob21lX2RhdGFTdG9yYWdlLzE4NDViZTIyLTFhYzQtNGU0Mi1iYmNi
LTdiYTljY2Q2ZTU2OS9kb21fbWQvbGVhc2VzCi1ydy1ydy0tLS0gMSB2ZHNtIGt2bSAyMDk3MTUy
IDnUwiAgMTEgMTk6MjEgL3JoZXYvZGF0YS1jZW50ZXIvbW50LzE5Mi4xNjguMTEuNTU6X2hvbWVf
ZGF0YVN0b3JhZ2UvMTg0NWJlMjItMWFjNC00ZTQyLWJiY2ItN2JhOWNjZDZlNTY5L2RvbV9tZC9s
ZWFzZXMKCgpidXQgd2UgY2Fubm90IHJlYWQgdGhlIGZpbGUgaW4gdXNlciAibGlueCI6CiQgY2F0
IC9yaGV2L2RhdGEtY2VudGVyL21udC8xOTIuMTY4LjExLjU1XDpfaG9tZV9kYXRhU3RvcmFnZS8x
ODQ1YmUyMi0xYWM0LTRlNDItYmJjYi03YmE5Y2NkNmU1NjkvZG9tX21kL2xlYXNlcwpjYXQ6ICcv
cmhldi9kYXRhLWNlbnRlci9tbnQvMTkyLjE2OC4xMS41NTpfaG9tZV9kYXRhU3RvcmFnZS8xODQ1
YmUyMi0xYWM0LTRlNDItYmJjYi03YmE5Y2NkNmU1NjkvZG9tX21kL2xlYXNlcyc6IMioz96yu7m7
CgoKCndoeSBpcyB0aGlzPyBmb2xsb3dzIHRoZSBuZnMgc2VydmVyIGNvbmZpZ3VyZQojIGNhdCAv
ZXRjL2V4cG9ydHMKCi9ob21lL2RhdGFTdG9yYWdlIDE5Mi4xNjguMTEuKihydyxzeW5jKQovaG9t
ZS9kYXRhU3RvcmFnZTIgMTkyLjE2OC4xMS4qKHJ3LHN5bmMsbm9fcm9vdF9zcXVhc2gsbm9fc3Vi
dHJlZV9jaGVjaykKL2hvbWUvaXNvU3RvcmFnZSAxOTIuMTY4LjExLioocncsc3luYyxub19yb290
X3NxdWFzaCxub19zdWJ0cmVlX2NoZWNrKQoKCgpJcyBteSBuZnMtc2VydmVyIGNvbmZpZ3VyYXRp
b25zIG1pc3Mgc29tZSBhcmd1bWVudHM/IGhhdmUgYW55IGlkZWE/CgoKClRyeSB0byBzZXR1cCBh
IHN1cHBvcnRlZCBzeXN0ZW0gKGUuZyBjZW50b3MsIGZlZG9yYSkgYW5kIGNvbXBhcmUgdGhlIHNl
dHVwLgoKCkNhbiBleHBsYWluIHdoeSB1c2VyIGxpbnggbmVlZCBhY2Nlc3MgdG8gdmRzbS9zYW5s
b2NrL3FlbXUgZGF0YT8KCgpOaXIKCgoKCgoKCgoKCgoKCgoKCgoKIAoKCgoKCiAKCl9fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCkRldmVsIG1haWxpbmcgbGlz
dApEZXZlbEBvdmlydC5vcmcKaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZv
L2RldmVsCgoKCgog
------=_Part_207610_1010575880.1505217464112
Content-Type: text/html; charset=GBK
Content-Transfer-Encoding: base64
PGRpdiBzdHlsZT0ibGluZS1oZWlnaHQ6MS43O2NvbG9yOiMwMDAwMDA7Zm9udC1zaXplOjE0cHg7
Zm9udC1mYW1pbHk6QXJpYWwiPkkga25vdyB0aGF0LCA8YnI+PGRpdj5hZnRlciBuZnMgbW91bnRl
ZCBpbiBjbGllbnQsIGl0IHVzZWQgbmZzIHNlcnZlcidzIApwZXJtaXNzaW9uLCBhbHRob3VnaCBp
IGRvbid0IGtub3cgd2h5IGl0J3MgdGhpcywgYnV0IGkgZXhlY3V0ZSBhcyAKZm9sbG93cyBpbiBu
ZnMgc2VydmVyOjwvZGl2PjxkaXY+IyB1c2VyYWRkIHNhbmxvY2sgLXUgMTE0PGJyPiMgdXNlcm1v
ZCAtYSAtRyBrdm0gc2FubG9jazwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+dGhlbiBpdCdzIHdv
cmtzIHdlbGwhPC9kaXY+PGRpdj48YnI+PC9kaXY+dGhhbmtzIGFueWhvdyE8YnI+PGJyPjxicj48
YnI+PGJyPjxkaXYgc3R5bGU9InBvc2l0aW9uOnJlbGF0aXZlO3pvb206MSI+PC9kaXY+PGRpdiBp
ZD0iZGl2TmV0ZWFzZU1haWxDYXJkIj48L2Rpdj48YnI+QXQgMjAxNy0wOS0xMiAxODo0Nzo1NSwg
InBlbmd5aXhpYW5nIiAmbHQ7eXhwZW5naTM4NkAxNjMuY29tJmd0OyB3cm90ZTo8YnI+IDxibG9j
a3F1b3RlIGlkPSJpc1JlcGx5Q29udGVudCIgc3R5bGU9IlBBRERJTkctTEVGVDogMWV4OyBNQVJH
SU46IDBweCAwcHggMHB4IDAuOGV4OyBCT1JERVItTEVGVDogI2NjYyAxcHggc29saWQiPjxkaXYg
c3R5bGU9ImxpbmUtaGVpZ2h0OjEuNztjb2xvcjojMDAwMDAwO2ZvbnQtc2l6ZToxNHB4O2ZvbnQt
ZmFtaWx5OkFyaWFsIj48ZGl2PmhlbGxvIE5pcjwvZGl2PjxkaXY+Jm5ic3A7Jm5ic3A7Jm5ic3A7
IEkganVzdCBkbyBhIHRlc3QsIGFzIGZvbGxvd3MsIGkgYWRkIGxpbnggdG8gZ3JvdXAga3ZtIDxi
cj48L2Rpdj4jIGNhdCAvZXRjL2dyb3VwIHwgZ3JlcCAia3ZtIjxicj5rdm06eDoxMTI6cWVtdSx2
ZHNtLGxpbngsc2FubG9jazxicj48ZGl2Pjxicj48L2Rpdj48ZGl2PmFuZCBpIHNlZSB0aGUgcGVy
bWlzc2lvbiBvZiBsZWFzZXMgb2YgbmZzIHN0b3JhZ2U6PGJyPjwvZGl2PiQgbHMgLWwgL3JoZXYv
ZGF0YS1jZW50ZXIvbW50LzxhIGhyZWY9Imh0dHA6Ly8xOTIuMTY4LjExLjU1IiB0YXJnZXQ9Il9i
bGFuayI+MTkyLjE2OC4xMS41NTwvYT5cOl9ob21lX2RhdGFTdG9yYWdlLzE4NDViZTIyLTFhYzQt
NGU0Mi1iYmNiLTdiYTljY2Q2ZTU2OS9kb21fbWQvbGVhc2VzIDxicj4tcnctcnctLS0tCiAxIHZk
c20ga3ZtIDIwOTcxNTIgOdTCJm5ic3A7IDExIDE5OjIxIAovcmhldi9kYXRhLWNlbnRlci9tbnQv
MTkyLjE2OC4xMS41NTpfaG9tZV9kYXRhU3RvcmFnZS8xODQ1YmUyMi0xYWM0LTRlNDItYmJjYi03
YmE5Y2NkNmU1NjkvZG9tX21kL2xlYXNlczxicj48ZGl2Pjxicj48L2Rpdj48ZGl2PnNhbmxvY2sg
Y2Fubm90IHJlYWQgaXQ8L2Rpdj48ZGl2PjQyNTEzOCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBy
ZXNvdXJjZSA9IHNhbmxvY2sucmVhZF9yZXNvdXJjZShsZWFzZS5wYXRoLCBsZWFzZS5vZmZzZXQp
PGJyPjQyNTEzOSBTYW5sb2NrRXhjZXB0aW9uOiAoMTMsICdTYW5sb2NrIHJlc291cmNlIHJlYWQg
ZmFpbHVyZScsICdQZXJtaXNzaW9uIGRlbmllZCcpPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5h
bmQgaSBjYW5ub3QgY2hhbmdlIHRvIHNhbmxvY2sgbGlrZSB0aGF0OjwvZGl2PjxkaXY+IyBzdSBz
YW5sb2NrPGJyPnJvb3RATm9kZTp+IzwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+c28gaSBhZGQg
YSB1c2VyIGxpbnggdG8gZ3JvdXAga3ZtLCBhbmQgYWNjZXNzIHRvIGEgbzY2MCBmaWxlIHdpdGgg
dmRzbTprdm0gYXMgZm9sbG93czo8YnI+PC9kaXY+PGRpdj48ZGl2PiQgbHMgLWw8YnI+19zTw8G/
IDE2PGJyPi1ydy1ydy0tLS0gMSB2ZHNtIGt2bSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyA2IDnU
wiZuYnNwOyAxMSAyMDowNiAxLnR4dDxicj5kcnd4ci14ci14IDkgbGlueCBsaW54IDQwOTYgOdTC
Jm5ic3A7Jm5ic3A7IDEgMTU6NTggbGlueC12aXJ0dWFsaXphdGlvbjxicj5kcnctcnctLS0tIDMg
bGlueCBsaW54IDQwOTYgOdTCJm5ic3A7IDExIDIwOjEzIHRlc3QyPGJyPmRydy1ydy0tLS0gMiBs
aW54IGxpbnggNDA5NiA51MImbmJzcDsgMTEgMjA6MTkgdGVzdDM8L2Rpdj48ZGl2Pjxicj48L2Rp
dj48ZGl2PnRoZW4gd2UgY2FuIHZpZXcgdGhlIGZpbGUgaW4gdXNlciAibGlueCI6PC9kaXY+PGRp
dj4kIGNhdCB+LzEudHh0IDxicj5wZW5jYzwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+dGhlbiBp
IGNyZWF0ZSAxLnR4dCBhcyBzYW1lIGFzIH4vMS50eHQgaW4gbmZzIG1vdW50IHBvaW50IGxpa2Ug
dGhhdCB3aXRoIHBlcm1pc3Npb24gbzY2NiB2ZHNtOmt2bSA6PGJyPjwvZGl2PjxkaXY+IC9yaGV2
L2RhdGEtY2VudGVyL21udC88YSBocmVmPSJodHRwOi8vMTkyLjE2OC4xMS41NSIgdGFyZ2V0PSJf
YmxhbmsiPjE5Mi4xNjguMTEuNTU8L2E+XDpfaG9tZV9kYXRhU3RvcmFnZS8xODQ1YmUyMi0xYWM0
LTRlNDItYmJjYi03YmE5Y2NkNmU1NjkvMS50eHQ8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PnRo
ZW4gaSByZWFkIGl0LCBidXQgZmFpbGVkIHRvbzxicj48L2Rpdj48ZGl2PlBlcm1pc3Npb24gZGVu
aWVkPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5pZiBpIGNoYW5nZSAxLnR4dCdzIHBlcm1pc3Np
b24gaW4gbW91bnQgcG9pbnQgdG8gbzY2Njxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PnRo
ZW4gaSBjYW4gcmVhZCBpdCBzdWNjZWVkLjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+aSB0aGlu
aywgbWF5YmUgbmZzJ3MgbW91bnQgY2F1c2VkIGdyb3VwIHBlcm1pc3Npb24gZmFpbGVkLCBncm91
cCBwZXJtaXNzaW9uIGFzIHRoZSBzZWNvbmQgJzYnIG9mIG82PHNwYW4gc3R5bGU9ImNvbG9yOiBy
Z2IoMjU1LCAwLCAwKTsiPjY8L3NwYW4+Njxicj48L2Rpdj48L2Rpdj48ZGl2IHN0eWxlPSJwb3Np
dGlvbjpyZWxhdGl2ZTt6b29tOjEiPjwvZGl2PjxkaXY+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRp
dj5pIGNhbm5vdCB1bmRlcnN0YW5kIGl0LCB0aGlzIG15IG5mcy1zZXJ2ZXIncyBleHBvcnRzIGNv
bmZpZ3VyYXRpb25zOjwvZGl2PjxkaXY+L2hvbWUvZGF0YVN0b3JhZ2UgKihydyxzeW5jLG5vX3N1
YnRyZWVfY2hlY2spPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5oYXZlIGFueSZuYnNwOyBpZGVh
cz8gUUFRPGJyPjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+PGJyPjwvZGl2PtTaIDIwMTctMDkt
MTIgMTg6MDY6MDijrCJOaXIgU29mZmVyIiAmbHQ7PGEgaHJlZj0ibWFpbHRvOm5zb2ZmZXJAcmVk
aGF0LmNvbSI+bnNvZmZlckByZWRoYXQuY29tPC9hPiZndDsg0LS1wKO6PGJyPiA8YmxvY2txdW90
ZSBpZD0iaXNSZXBseUNvbnRlbnQiIHN0eWxlPSJQQURESU5HLUxFRlQ6IDFleDsgTUFSR0lOOiAw
cHggMHB4IDBweCAwLjhleDsgQk9SREVSLUxFRlQ6ICNjY2MgMXB4IHNvbGlkIj48YnI+PGJyPjxk
aXYgY2xhc3M9ImdtYWlsX3F1b3RlIj48ZGl2IGRpcj0ibHRyIj5PbiBUdWUsIDEyIFNlcCAyMDE3
LCA0OjUyIHBlbmd5aXhpYW5nICZsdDs8YSBocmVmPSJtYWlsdG86eXhwZW5naTM4NkAxNjMuY29t
Ij55eHBlbmdpMzg2QDE2My5jb208L2E+Jmd0OyB3cm90ZTo8YnI+PC9kaXY+PGJsb2NrcXVvdGUg
Y2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxlZnQ6
MXB4ICNjY2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+PGRpdiBzdHlsZT0ibGluZS1oZWlnaHQ6
MS43O2NvbG9yOiMwMDAwMDA7Zm9udC1zaXplOjE0cHg7Zm9udC1mYW1pbHk6QXJpYWwiPjxkaXY+
aGVsbG8sZXZlcnlvbmU8L2Rpdj48ZGl2PiZuYnNwOyZuYnNwOyZuYnNwOyBzYW5sb2NrIGZhaWxl
ZCBkdWUgdG8gY2Fubm90IHJlYWQgbmZzIHN0b3JhZ2UncyBkYXRhICwgaSB0cmllZCB0byBjaG1v
ZCA3NzcgL3JoZXYvZGF0YS1jZW50ZXIvbW50LzxhIGhyZWY9Imh0dHA6Ly8xOTIuMTY4LjExLjU1
IiB0YXJnZXQ9Il9ibGFuayI+MTkyLjE2OC4xMS41NTwvYT5cOl9ob21lX2RhdGFTdG9yYWdlLzE4
NDViZTIyLTFhYzQtNGU0Mi1iYmNiLTdiYTljY2Q2ZTU2OS9kb21fbWQvKihhZGQgb3RoZXJzIHBl
cm1pc3Npb24pLCB0aGVuIGl0J3Mgb2s8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2IGlkPSJtXzUx
MTI3MzAxMjExNzc5MjAyNTNpc0ZvcndhcmRDb250ZW50Ij48ZGl2IHN0eWxlPSJsaW5lLWhlaWdo
dDoxLjc7Y29sb3I6IzAwMDAwMDtmb250LXNpemU6MTRweDtmb250LWZhbWlseTpBcmlhbCI+PGRp
dj4mbmJzcDsmbmJzcDsmbmJzcDsgc2FubG9jaydzIGxvZzo8YnI+NDI1MTIwIFRyYWNlYmFjayAo
bW9zdCByZWNlbnQgY2FsbCBsYXN0KTo8YnI+NDI1MTIxJm5ic3A7Jm5ic3A7IEZpbGUgIi91c3Iv
bGliL3B5dGhvbjIuNy9kaXN0LXBhY2thZ2VzL3Zkc20vc3RvcmFnZS90YXNrLnB5IiwgbGluZSA4
NzgsIGluIF9ydW48YnI+NDI1MTIyJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IHJldHVybiBmbigq
YXJncywgKiprYXJncyk8YnI+NDI1MTIzJm5ic3A7Jm5ic3A7IEZpbGUgIi91c3IvbGliL3B5dGhv
bjIuNy9kaXN0LXBhY2thZ2VzL3Zkc20vbG9nVXRpbHMucHkiLCBsaW5lIDUyLCBpbiB3cmFwcGVy
PGJyPjQyNTEyNCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyByZXMgPSBmKCphcmdzLCAqKmt3YXJn
cyk8YnI+NDI1MTI1Jm5ic3A7Jm5ic3A7IEZpbGUgIi91c3Ivc2hhcmUvdmRzbS9zdG9yYWdlL2hz
bS5weSIsIGxpbmUgNjE5LCBpbiBnZXRTcG1TdGF0dXM8YnI+NDI1MTI2Jm5ic3A7Jm5ic3A7Jm5i
c3A7Jm5ic3A7IHN0YXR1cyA9IHNlbGYuX2dldFNwbVN0YXR1c0luZm8ocG9vbCk8YnI+NDI1MTI3
Jm5ic3A7Jm5ic3A7IEZpbGUgIi91c3Ivc2hhcmUvdmRzbS9zdG9yYWdlL2hzbS5weSIsIGxpbmUg
NjEzLCBpbiBfZ2V0U3BtU3RhdHVzSW5mbzxicj40MjUxMjgmbmJzcDsmbmJzcDsmbmJzcDsmbmJz
cDsgKHBvb2wuc3BtUm9sZSwpICsgcG9vbC5nZXRTcG1TdGF0dXMoKSkpPGJyPjQyNTEyOSZuYnNw
OyZuYnNwOyBGaWxlICIvdXNyL3NoYXJlL3Zkc20vc3RvcmFnZS9zcC5weSIsIGxpbmUgMTQxLCBp
biBnZXRTcG1TdGF0dXM8YnI+NDI1MTMwJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IHJldHVybiBz
ZWxmLl9iYWNrZW5kLmdldFNwbVN0YXR1cygpPGJyPjQyNTEzMSZuYnNwOyZuYnNwOyBGaWxlICIv
dXNyL3NoYXJlL3Zkc20vc3RvcmFnZS9zcGJhY2tlbmRzLnB5IiwgbGluZSA0MzMsIGluIGdldFNw
bVN0YXR1czxicj40MjUxMzImbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgbFZlciwgc3BtSWQgPSBz
ZWxmLm1hc3RlckRvbWFpbi5pbnF1aXJlQ2x1c3RlckxvY2soKTxicj40MjUxMzMmbmJzcDsmbmJz
cDsgRmlsZSAiL3Vzci9zaGFyZS92ZHNtL3N0b3JhZ2Uvc2QucHkiLCBsaW5lIDgxNywgaW4gaW5x
dWlyZUNsdXN0ZXJMb2NrPGJyPjQyNTEzNCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyByZXR1cm4g
c2VsZi5fbWFuaWZlc3QuaW5xdWlyZURvbWFpbkxvY2soKTxicj40MjUxMzUmbmJzcDsmbmJzcDsg
RmlsZSAiL3Vzci9zaGFyZS92ZHNtL3N0b3JhZ2Uvc2QucHkiLCBsaW5lIDUyMiwgaW4gaW5xdWly
ZURvbWFpbkxvY2s8YnI+NDI1MTM2Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IHJldHVybiBzZWxm
Ll9kb21haW5Mb2NrLmlucXVpcmUoc2VsZi5nZXREb21haW5MZWFzZSgpKTxicj40MjUxMzcmbmJz
cDsmbmJzcDsgRmlsZSAiL3Vzci9saWIvcHl0aG9uMi43L2Rpc3QtcGFja2FnZXMvdmRzbS9zdG9y
YWdlL2NsdXN0ZXJsb2NrLnB5IiwgbGluZSAzNzIsIGluIGkmbmJzcDsmbmJzcDsmbmJzcDsmbmJz
cDsmbmJzcDsmbmJzcDsgbnF1aXJlPGJyPjQyNTEzOCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBy
ZXNvdXJjZSA9IHNhbmxvY2sucmVhZF9yZXNvdXJjZShsZWFzZS5wYXRoLCBsZWFzZS5vZmZzZXQp
PGJyPjQyNTEzOSBTYW5sb2NrRXhjZXB0aW9uOiAoMTMsICdTYW5sb2NrIHJlc291cmNlIHJlYWQg
ZmFpbHVyZScsICdQZXJtaXNzaW9uIGRlbmllZCcpPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5p
IHRlc3QgaXQsIGFuZCBpbiBub2RlLEkgYWRkIHVzZXIgImxpbngiIHRvIGdyb3VwICJrdm0iPGJy
PjwvZGl2PjxkaXY+JCBjYXQgL2V0Yy9ncm91cCB8IGdyZXAgImt2bSI8YnI+a3ZtOng6MTEyOnFl
bXUsdmRzbSw8c3BhbiBzdHlsZT0iY29sb3I6cmdiKDI1NSwwLDApIj5saW54PC9zcGFuPixzYW5s
b2NrPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj50aGVuIGkgY3JlYXRlIGEgZmlsZSBpbiAkSE9N
RTo8L2Rpdj48ZGl2PiQgbHMgLWw8YnI+19zTw8G/IDE2PGJyPi1ydy1ydy0tLS0gMSB2ZHNtIGt2
bSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyA2IDnUwiZuYnNwOyAxMSAyMDowNiAxLnR4dDxicj5k
cnd4ci14ci14IDkgbGlueCBsaW54IDQwOTYgOdTCJm5ic3A7Jm5ic3A7IDEgMTU6NTggbGlueC12
aXJ0dWFsaXphdGlvbjxicj5kcnctcnctLS0tIDMgbGlueCBsaW54IDQwOTYgOdTCJm5ic3A7IDEx
IDIwOjEzIHRlc3QyPGJyPmRydy1ydy0tLS0gMiBsaW54IGxpbnggNDA5NiA51MImbmJzcDsgMTEg
MjA6MTkgdGVzdDM8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PnRoZW4gd2UgY2FuIHZpZXcgdGhl
IGZpbGUgaW4gdXNlciAibGlueCI6PC9kaXY+PGRpdj4kIGNhdCAxLnR4dCA8YnI+cGVuY2M8L2Rp
dj48ZGl2Pjxicj48L2Rpdj48ZGl2PmxlYXNlcyBpZiB2ZHNtOmt2bSB0b286PC9kaXY+PGRpdj4k
IGxzIC1sIC9yaGV2L2RhdGEtY2VudGVyL21udC88YSBocmVmPSJodHRwOi8vMTkyLjE2OC4xMS41
NSIgdGFyZ2V0PSJfYmxhbmsiPjE5Mi4xNjguMTEuNTU8L2E+XDpfaG9tZV9kYXRhU3RvcmFnZS8x
ODQ1YmUyMi0xYWM0LTRlNDItYmJjYi03YmE5Y2NkNmU1NjkvZG9tX21kL2xlYXNlcyA8YnI+LXJ3
LXJ3LS0tLSAxIHZkc20ga3ZtIDIwOTcxNTIgOdTCJm5ic3A7IDExIDE5OjIxIC9yaGV2L2RhdGEt
Y2VudGVyL21udC8xOTIuMTY4LjExLjU1Ol9ob21lX2RhdGFTdG9yYWdlLzE4NDViZTIyLTFhYzQt
NGU0Mi1iYmNiLTdiYTljY2Q2ZTU2OS9kb21fbWQvbGVhc2VzPC9kaXY+PGRpdj48YnI+PC9kaXY+
PGRpdj5idXQgd2UgY2Fubm90IHJlYWQgdGhlIGZpbGUgaW4gdXNlciAibGlueCI6PC9kaXY+PGRp
dj4kIGNhdCAvcmhldi9kYXRhLWNlbnRlci9tbnQvPGEgaHJlZj0iaHR0cDovLzE5Mi4xNjguMTEu
NTUiIHRhcmdldD0iX2JsYW5rIj4xOTIuMTY4LjExLjU1PC9hPlw6X2hvbWVfZGF0YVN0b3JhZ2Uv
MTg0NWJlMjItMWFjNC00ZTQyLWJiY2ItN2JhOWNjZDZlNTY5L2RvbV9tZC9sZWFzZXM8YnI+Y2F0
OiAnL3JoZXYvZGF0YS1jZW50ZXIvbW50LzE5Mi4xNjguMTEuNTU6X2hvbWVfZGF0YVN0b3JhZ2Uv
MTg0NWJlMjItMWFjNC00ZTQyLWJiY2ItN2JhOWNjZDZlNTY5L2RvbV9tZC9sZWFzZXMnOiDIqM/e
sru5uzxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PndoeSBpcyB0aGlzPyBmb2xsb3dzIHRo
ZSBuZnMgc2VydmVyIGNvbmZpZ3VyZTwvZGl2PjxkaXY+IyBjYXQgL2V0Yy9leHBvcnRzIDxicj48
YnI+L2hvbWUvZGF0YVN0b3JhZ2UgMTkyLjE2OC4xMS4qKHJ3LHN5bmMpPGJyPi9ob21lL2RhdGFT
dG9yYWdlMiAxOTIuMTY4LjExLioocncsc3luYyxub19yb290X3NxdWFzaCxub19zdWJ0cmVlX2No
ZWNrKTxicj4vaG9tZS9pc29TdG9yYWdlIDE5Mi4xNjguMTEuKihydyxzeW5jLG5vX3Jvb3Rfc3F1
YXNoLG5vX3N1YnRyZWVfY2hlY2spPGJyPjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+SXMgbXkg
bmZzLXNlcnZlciBjb25maWd1cmF0aW9ucyBtaXNzIHNvbWUgYXJndW1lbnRzPyBoYXZlIGFueSBp
ZGVhPzxicj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Jsb2NrcXVvdGU+PC9kaXY+PGRpdj48
YnI+PC9kaXY+PGRpdj5UcnkgdG8gc2V0dXAgYSBzdXBwb3J0ZWQgc3lzdGVtIChlLmcgY2VudG9z
LCBmZWRvcmEpIGFuZCBjb21wYXJlIHRoZSBzZXR1cC48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2
PkNhbiBleHBsYWluIHdoeSB1c2VyIGxpbnggbmVlZCBhY2Nlc3MgdG8gdmRzbS9zYW5sb2NrL3Fl
bXUgZGF0YT88L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pk5pcjwvZGl2PjxkaXYgY2xhc3M9Imdt
YWlsX3F1b3RlIj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46
MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBzb2xpZDtwYWRkaW5nLWxlZnQ6MWV4Ij48
ZGl2IHN0eWxlPSJsaW5lLWhlaWdodDoxLjc7Y29sb3I6IzAwMDAwMDtmb250LXNpemU6MTRweDtm
b250LWZhbWlseTpBcmlhbCI+PGRpdiBpZD0ibV81MTEyNzMwMTIxMTc3OTIwMjUzaXNGb3J3YXJk
Q29udGVudCI+PGRpdiBzdHlsZT0ibGluZS1oZWlnaHQ6MS43O2NvbG9yOiMwMDAwMDA7Zm9udC1z
aXplOjE0cHg7Zm9udC1mYW1pbHk6QXJpYWwiPjxkaXY+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRp
dj48YnI+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj48YnI+PC9kaXY+
PGRpdj48YnI+PC9kaXY+PGRpdj48YnI+PC9kaXY+PC9kaXY+PGJyPjxicj48c3BhbiB0aXRsZT0i
bmV0ZWFzZWZvb3RlciI+PHA+Jm5ic3A7PC9wPjwvc3Bhbj48L2Rpdj48L2Rpdj48YnI+PGJyPjxz
cGFuIHRpdGxlPSJuZXRlYXNlZm9vdGVyIj48cD4mbmJzcDs8L3A+PC9zcGFuPl9fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPGJyPgpEZXZlbCBtYWlsaW5nIGxp
c3Q8YnI+CjxhIGhyZWY9Im1haWx0bzpEZXZlbEBvdmlydC5vcmciIHRhcmdldD0iX2JsYW5rIj5E
ZXZlbEBvdmlydC5vcmc8L2E+PGJyPgo8YSBocmVmPSJodHRwOi8vbGlzdHMub3ZpcnQub3JnL21h
aWxtYW4vbGlzdGluZm8vZGV2ZWwiIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0
dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby9kZXZlbDwvYT48L2Jsb2NrcXVv
dGU+PC9kaXY+CjwvYmxvY2txdW90ZT48L2Rpdj48YnI+PGJyPjxzcGFuIHRpdGxlPSJuZXRlYXNl
Zm9vdGVyIj48cD4mbmJzcDs8L3A+PC9zcGFuPjwvYmxvY2txdW90ZT48L2Rpdj48YnI+PGJyPjxz
cGFuIHRpdGxlPSJuZXRlYXNlZm9vdGVyIj48cD4mbmJzcDs8L3A+PC9zcGFuPg==
------=_Part_207610_1010575880.1505217464112--
7:08 a.m.
New subject: ovirt nfs mount caused sanlock failed to access data storage
On Tue, Sep 12, 2017 at 2:58 PM pengyixiang <yxpengi386(a)163.com> wrote:
I know that,
after nfs mounted in client, it used nfs server's permission, although i
don't know why it's this, but i execute as follows in nfs server:
# useradd sanlock -u 114
# usermod -a -G kvm sanlock
then it's works well!
thanks anyhow!
You don't need to add sanlock on the nfs server.
This setup is documented here:
https://ovirt.org/documentation/admin-guide/chap-Storage/#preparing-and-a...
Nir
At 2017-09-12 18:47:55, "pengyixiang" <yxpengi386(a)163.com> wrote:
hello Nir
I just do a test, as follows, i add linx to group kvm
# cat /etc/group | grep "kvm"
kvm:x:112:qemu,vdsm,linx,sanlock
and i see the permission of leases of nfs storage:
$ ls -l
/rhev/data-center/mnt/192.168.11.55\:_home_dataStorage/1845be22-1ac4-4e42-bbcb-7ba9ccd6e569/dom_md/leases
-rw-rw---- 1 vdsm kvm 2097152 9月 11 19:21
/rhev/data-center/mnt/192.168.11.55:
_home_dataStorage/1845be22-1ac4-4e42-bbcb-7ba9ccd6e569/dom_md/leases
sanlock cannot read it
425138 resource = sanlock.read_resource(lease.path, lease.offset)
425139 SanlockException: (13, 'Sanlock resource read failure', 'Permission
denied')
and i cannot change to sanlock like that:
# su sanlock
root@Node:~#
so i add a user linx to group kvm, and access to a o660 file with vdsm:kvm
as follows:
$ ls -l
总用量 16
-rw-rw---- 1 vdsm kvm 6 9月 11 20:06 1.txt
drwxr-xr-x 9 linx linx 4096 9月 1 15:58 linx-virtualization
drw-rw---- 3 linx linx 4096 9月 11 20:13 test2
drw-rw---- 2 linx linx 4096 9月 11 20:19 test3
then we can view the file in user "linx":
$ cat ~/1.txt
pencc
then i create 1.txt as same as ~/1.txt in nfs mount point like that with
permission o666 vdsm:kvm :
/rhev/data-center/mnt/192.168.11.55
\:_home_dataStorage/1845be22-1ac4-4e42-bbcb-7ba9ccd6e569/1.txt
then i read it, but failed too
Permission denied
if i change 1.txt's permission in mount point to o666
then i can read it succeed.
i think, maybe nfs's mount caused group permission failed, group
permission as the second '6' of o666
i cannot understand it, this my nfs-server's exports configurations:
/home/dataStorage *(rw,sync,no_subtree_check)
have any ideas? QAQ
在 2017-09-12 18:06:08，"Nir Soffer" <nsoffer(a)redhat.com> 写道：
On Tue, 12 Sep 2017, 4:52 pengyixiang <yxpengi386(a)163.com> wrote:
> hello,everyone
> sanlock failed due to cannot read nfs storage's data , i tried to
> chmod 777
/rhev/data-center/mnt/192.168.11.55\:_home_dataStorage/1845be22-1ac4-4e42-bbcb-7ba9ccd6e569/dom_md/*(add
> others permission), then it's ok
>
> sanlock's log:
> 425120 Traceback (most recent call last):
> 425121 File "/usr/lib/python2.7/dist-packages/vdsm/storage/task.py",
> line 878, in _run
> 425122 return fn(*args, **kargs)
> 425123 File "/usr/lib/python2.7/dist-packages/vdsm/logUtils.py", line
> 52, in wrapper
> 425124 res = f(*args, **kwargs)
> 425125 File "/usr/share/vdsm/storage/hsm.py", line 619, in getSpmStatus
> 425126 status = self._getSpmStatusInfo(pool)
> 425127 File "/usr/share/vdsm/storage/hsm.py", line 613, in
> _getSpmStatusInfo
> 425128 (pool.spmRole,) + pool.getSpmStatus()))
> 425129 File "/usr/share/vdsm/storage/sp.py", line 141, in getSpmStatus
> 425130 return self._backend.getSpmStatus()
> 425131 File "/usr/share/vdsm/storage/spbackends.py", line 433, in
> getSpmStatus
> 425132 lVer, spmId = self.masterDomain.inquireClusterLock()
> 425133 File "/usr/share/vdsm/storage/sd.py", line 817, in
> inquireClusterLock
> 425134 return self._manifest.inquireDomainLock()
> 425135 File "/usr/share/vdsm/storage/sd.py", line 522, in
> inquireDomainLock
> 425136 return self._domainLock.inquire(self.getDomainLease())
> 425137 File
> "/usr/lib/python2.7/dist-packages/vdsm/storage/clusterlock.py", line 372,
> in i nquire
> 425138 resource = sanlock.read_resource(lease.path, lease.offset)
> 425139 SanlockException: (13, 'Sanlock resource read failure',
> 'Permission denied')
>
> i test it, and in node,I add user "linx" to group "kvm"
> $ cat /etc/group | grep "kvm"
> kvm:x:112:qemu,vdsm,linx,sanlock
>
> then i create a file in $HOME:
> $ ls -l
> 总用量 16
> -rw-rw---- 1 vdsm kvm 6 9月 11 20:06 1.txt
> drwxr-xr-x 9 linx linx 4096 9月 1 15:58 linx-virtualization
> drw-rw---- 3 linx linx 4096 9月 11 20:13 test2
> drw-rw---- 2 linx linx 4096 9月 11 20:19 test3
>
> then we can view the file in user "linx":
> $ cat 1.txt
> pencc
>
> leases if vdsm:kvm too:
> $ ls -l
/rhev/data-center/mnt/192.168.11.55\:_home_dataStorage/1845be22-1ac4-4e42-bbcb-7ba9ccd6e569/dom_md/leases
>
> -rw-rw---- 1 vdsm kvm 2097152 9月 11 19:21
> /rhev/data-center/mnt/192.168.11.55:
> _home_dataStorage/1845be22-1ac4-4e42-bbcb-7ba9ccd6e569/dom_md/leases
>
> but we cannot read the file in user "linx":
> $ cat /rhev/data-center/mnt/192.168.11.55
> \:_home_dataStorage/1845be22-1ac4-4e42-bbcb-7ba9ccd6e569/dom_md/leases
> cat:
'/rhev/data-center/mnt/192.168.11.55:_home_dataStorage/1845be22-1ac4-4e42-bbcb-7ba9ccd6e569/dom_md/leases':
> 权限不够
>
> why is this? follows the nfs server configure
> # cat /etc/exports
>
> /home/dataStorage 192.168.11.*(rw,sync)
> /home/dataStorage2 192.168.11.*(rw,sync,no_root_squash,no_subtree_check)
> /home/isoStorage 192.168.11.*(rw,sync,no_root_squash,no_subtree_check)
>
> Is my nfs-server configurations miss some arguments? have any idea?
>
Try to setup a supported system (e.g centos, fedora) and compare the setup.
Can explain why user linx need access to vdsm/sanlock/qemu data?
Nir
>
>
>
>
>
>
>
>
>
>
>
>
>
> _______________________________________________
> Devel mailing list
> Devel(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/devel
2436
days inactive
2435
days old
1 comments
2 participants
participants (2)
-
Nir Soffer -
pengyixiang