Users
Threads by month
- ----- 2026 -----
- February
- January
- ----- 2025 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2024 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2023 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2022 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2021 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2020 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2019 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2018 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2017 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2016 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2015 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2014 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2013 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2012 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2011 -----
- December
- November
- October
- 6 participants
- 19176 discussions
--_000_BN1PR09MB0289E063FD0949DD7A39161987CF0BN1PR09MB0289namp_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
I was moving some virtual disks from one storage server to another. Now, I =
have a couple servers that have the auto-generated snapshot, without disks,=
and I cannot delete them. The VM will not start and there is the complaint=
that the disks are illegal.
Any help would be appreciated. I'm going to bed for now, but will try to wa=
ke up earlier.
--_000_BN1PR09MB0289E063FD0949DD7A39161987CF0BN1PR09MB0289namp_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Diso-8859-=
1">
<style type=3D"text/css" style=3D"display:none;"><!-- P {margin-top:0;margi=
n-bottom:0;} --></style>
</head>
<body dir=3D"ltr">
<div id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font=
-family:Calibri,Helvetica,sans-serif;" dir=3D"ltr">
<p style=3D"margin-top:0;margin-bottom:0">I was moving some virtual disks f=
rom one storage server to another. Now, I have a couple servers that have t=
he auto-generated snapshot, without disks, and I cannot delete them. The VM=
will not start and there is the complaint
that the disks are illegal.</p>
<p style=3D"margin-top:0;margin-bottom:0">Any help would be appreciated. I'=
m going to bed for now, but will try to wake up earlier.<br>
</p>
</div>
</body>
</html>
--_000_BN1PR09MB0289E063FD0949DD7A39161987CF0BN1PR09MB0289namp_--
2
1
--_000_DCB28C19FFF840AC897ED97221D26A2Cactivevideocom_
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
RGVhciBvVmlydCwNCg0KQWZ0ZXIgc2V0dGluZyBhbGwgcGFyYW1ldGVycyBmb3IgbmV3IFZNIGFu
ZCBjbGlja2luZyBvbiDigJxDcmVhdGXigJ0gYnV0dG9uLCBubyBwcm9ncmVzcyBzdGF0dXMgb3Ig
dGhhdCBhY3Rpb24gaXMgYWNjZXB0ZWQgaXMgc2VlbiBmcm9tIHdlYnVpLg0KSW4gYWRkaXRpb24s
IHdoZW4gY2xvc2luZyB0aGUgYWRkIFZNIHNlY3Rpb24sIEkgYW0gYXNrZWQgaWYgSSBhbSBzdXJl
LCBkdWUgdG8gY2hhbmdlcyBtYWRlLg0KDQpJcyB0aGlzIGV4cGVjdGVkIGJlaGF2aW91cj8gQ2Fu
IHNvbWV0aGluZyBiZSBkb25lIGFib3V0Pw0KDQpLaW5kbHkgYXdhaXRpbmcgeW91ciByZXBseS4N
Cg0KLS0NCk1ldCB2cmllbmRlbGlqa2UgZ3JvZXQgLyBCZXN0IHJlZ2FyZHMsDQpNYXJrbyBWcmdv
dGljDQpTeXN0ZW0gRW5naW5lZXIvQ3VzdG9tZXIgQ2FyZQ0KQWN0aXZlVmlkZW8NCg0K
--_000_DCB28C19FFF840AC897ED97221D26A2Cactivevideocom_
Content-Type: text/html; charset="utf-8"
Content-ID: <B57959ED133FE44B8D66555EBE087783(a)namprd08.prod.outlook.com>
Content-Transfer-Encoding: base64
PGh0bWwgeG1sbnM6bz0idXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTpvZmZpY2U6b2ZmaWNlIiB4
bWxuczp3PSJ1cm46c2NoZW1hcy1taWNyb3NvZnQtY29tOm9mZmljZTp3b3JkIiB4bWxuczptPSJo
dHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL29mZmljZS8yMDA0LzEyL29tbWwiIHhtbG5zPSJo
dHRwOi8vd3d3LnczLm9yZy9UUi9SRUMtaHRtbDQwIj4NCjxoZWFkPg0KPG1ldGEgaHR0cC1lcXVp
dj0iQ29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgiPg0KPG1l
dGEgbmFtZT0iVGl0bGUiIGNvbnRlbnQ9IiI+DQo8bWV0YSBuYW1lPSJLZXl3b3JkcyIgY29udGVu
dD0iIj4NCjxtZXRhIG5hbWU9IkdlbmVyYXRvciIgY29udGVudD0iTWljcm9zb2Z0IFdvcmQgMTUg
KGZpbHRlcmVkIG1lZGl1bSkiPg0KPHN0eWxlPjwhLS0NCi8qIEZvbnQgRGVmaW5pdGlvbnMgKi8N
CkBmb250LWZhY2UNCgl7Zm9udC1mYW1pbHk6IkNhbWJyaWEgTWF0aCI7DQoJcGFub3NlLTE6MiA0
IDUgMyA1IDQgNiAzIDIgNDt9DQpAZm9udC1mYWNlDQoJe2ZvbnQtZmFtaWx5OkNhbGlicmk7DQoJ
cGFub3NlLTE6MiAxNSA1IDIgMiAyIDQgMyAyIDQ7fQ0KQGZvbnQtZmFjZQ0KCXtmb250LWZhbWls
eTotd2Via2l0LXN0YW5kYXJkO30NCi8qIFN0eWxlIERlZmluaXRpb25zICovDQpwLk1zb05vcm1h
bCwgbGkuTXNvTm9ybWFsLCBkaXYuTXNvTm9ybWFsDQoJe21hcmdpbjowY207DQoJbWFyZ2luLWJv
dHRvbTouMDAwMXB0Ow0KCWZvbnQtc2l6ZToxMi4wcHQ7DQoJZm9udC1mYW1pbHk6Q2FsaWJyaTsN
Cgltc28tZmFyZWFzdC1sYW5ndWFnZTpFTi1VUzt9DQphOmxpbmssIHNwYW4uTXNvSHlwZXJsaW5r
DQoJe21zby1zdHlsZS1wcmlvcml0eTo5OTsNCgljb2xvcjojMDU2M0MxOw0KCXRleHQtZGVjb3Jh
dGlvbjp1bmRlcmxpbmU7fQ0KYTp2aXNpdGVkLCBzcGFuLk1zb0h5cGVybGlua0ZvbGxvd2VkDQoJ
e21zby1zdHlsZS1wcmlvcml0eTo5OTsNCgljb2xvcjojOTU0RjcyOw0KCXRleHQtZGVjb3JhdGlv
bjp1bmRlcmxpbmU7fQ0Kc3Bhbi5FbWFpbFN0eWxlMTcNCgl7bXNvLXN0eWxlLXR5cGU6cGVyc29u
YWwtY29tcG9zZTsNCglmb250LWZhbWlseTpDYWxpYnJpOw0KCWNvbG9yOndpbmRvd3RleHQ7fQ0K
c3Bhbi5tc29JbnMNCgl7bXNvLXN0eWxlLXR5cGU6ZXhwb3J0LW9ubHk7DQoJbXNvLXN0eWxlLW5h
bWU6IiI7DQoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTsNCgljb2xvcjp0ZWFsO30NCi5Nc29D
aHBEZWZhdWx0DQoJe21zby1zdHlsZS10eXBlOmV4cG9ydC1vbmx5Ow0KCWZvbnQtZmFtaWx5OkNh
bGlicmk7DQoJbXNvLWZhcmVhc3QtbGFuZ3VhZ2U6RU4tVVM7fQ0KQHBhZ2UgV29yZFNlY3Rpb24x
DQoJe3NpemU6NTk1LjBwdCA4NDIuMHB0Ow0KCW1hcmdpbjo3Mi4wcHQgNzIuMHB0IDcyLjBwdCA3
Mi4wcHQ7fQ0KZGl2LldvcmRTZWN0aW9uMQ0KCXtwYWdlOldvcmRTZWN0aW9uMTt9DQotLT48L3N0
eWxlPg0KPC9oZWFkPg0KPGJvZHkgYmdjb2xvcj0id2hpdGUiIGxhbmc9IkVOLUdCIiBsaW5rPSIj
MDU2M0MxIiB2bGluaz0iIzk1NEY3MiI+DQo8ZGl2IGNsYXNzPSJXb3JkU2VjdGlvbjEiPg0KPHAg
Y2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQiPkRlYXIgb1Zp
cnQsPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5
bGU9ImZvbnQtc2l6ZToxMS4wcHQiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNs
YXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0Ij5BZnRlciBzZXR0
aW5nIGFsbCBwYXJhbWV0ZXJzIGZvciBuZXcgVk0gYW5kIGNsaWNraW5nIG9uIOKAnENyZWF0ZeKA
nSBidXR0b24sIG5vIHByb2dyZXNzIHN0YXR1cyBvciB0aGF0IGFjdGlvbiBpcyBhY2NlcHRlZCBp
cyBzZWVuIGZyb20gd2VidWkuPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05v
cm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQiPkluIGFkZGl0aW9uLCB3aGVuIGNs
b3NpbmcgdGhlIGFkZCBWTSBzZWN0aW9uLCBJIGFtIGFza2VkIGlmIEkgYW0gc3VyZSwgZHVlIHRv
IGNoYW5nZXMgbWFkZS48bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs
Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdCI+PG86cD4mbmJzcDs8L286cD48L3NwYW4+
PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQi
PklzIHRoaXMgZXhwZWN0ZWQgYmVoYXZpb3VyPyBDYW4gc29tZXRoaW5nIGJlIGRvbmUgYWJvdXQ/
PG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9
ImZvbnQtc2l6ZToxMS4wcHQiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNz
PSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0Ij5LaW5kbHkgYXdhaXRp
bmcgeW91ciByZXBseS48bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs
Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdCI+PG86cD4mbmJzcDs8L286cD48L3NwYW4+
PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMC41cHQ7
Zm9udC1mYW1pbHk6LXdlYmtpdC1zdGFuZGFyZDtjb2xvcjpibGFjazttc28tZmFyZWFzdC1sYW5n
dWFnZTpFTi1HQiI+LS08bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs
Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEwLjVwdDtmb250LWZhbWlseTotd2Via2l0LXN0YW5k
YXJkO2NvbG9yOmJsYWNrO21zby1mYXJlYXN0LWxhbmd1YWdlOkVOLUdCIj5NZXQgdnJpZW5kZWxp
amtlIGdyb2V0IC8gQmVzdCByZWdhcmRzLDxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNz
PSJNc29Ob3JtYWwiPjxzcGFuIGxhbmc9IkVOLVVTIiBzdHlsZT0iZm9udC1zaXplOjEwLjVwdDtm
b250LWZhbWlseTotd2Via2l0LXN0YW5kYXJkO2NvbG9yOmJsYWNrO21zby1mYXJlYXN0LWxhbmd1
YWdlOkVOLUdCIj5NYXJrbyBWcmdvdGljPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9
Ik1zb05vcm1hbCI+PHNwYW4gbGFuZz0iRU4tVVMiIHN0eWxlPSJmb250LXNpemU6MTAuNXB0O2Zv
bnQtZmFtaWx5Oi13ZWJraXQtc3RhbmRhcmQ7Y29sb3I6YmxhY2s7bXNvLWZhcmVhc3QtbGFuZ3Vh
Z2U6RU4tR0IiPlN5c3RlbSBFbmdpbmVlci9DdXN0b21lciBDYXJlPG86cD48L286cD48L3NwYW4+
PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gbGFuZz0iRU4tVVMiIHN0eWxlPSJmb250
LXNpemU6MTAuNXB0O2ZvbnQtZmFtaWx5Oi13ZWJraXQtc3RhbmRhcmQ7Y29sb3I6YmxhY2s7bXNv
LWZhcmVhc3QtbGFuZ3VhZ2U6RU4tR0IiPkFjdGl2ZVZpZGVvPG86cD48L286cD48L3NwYW4+PC9w
Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PG86cD4mbmJzcDs8L286cD48L3A+DQo8L2Rpdj4NCjwv
Ym9keT4NCjwvaHRtbD4NCg==
--_000_DCB28C19FFF840AC897ED97221D26A2Cactivevideocom_--
2
7
20 Feb '18
------=_Part_2010355_281080504.1519108987392
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Sorry can't attached log file it's too big file
VDSM.log for node 1
2766', 'lastCheck': '4.9', 'valid': True}} from=3Dinternal, task_id=3D645d4=
56e-f59f-4b1c-9e97-fc82d19a36b1 (api:52)
2018-02-20 14:38:47,222+0800 INFO=C2=A0 (jsonrpc/3) [vdsm.api] START repoSt=
ats(options=3DNone) from=3D::ffff:10.10.43.1,60554, flow_id=3D3b2e802e, tas=
k_id=3D28c795d1-1639-4e68-a9fe-a00006be268f (api:46)
2018-02-20 14:38:47,222+0800 INFO=C2=A0 (jsonrpc/3) [vdsm.api] FINISH repoS=
tats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual'=
: True, 'version': 4, 'acquired': True, 'delay': '0.000119109', 'lastCheck'=
: '6.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0=
, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000195263', '=
lastCheck': '6.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': =
{'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000=
22988', 'lastCheck': '6.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f4=
40a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay=
': '0.000270206', 'lastCheck': '5.9', 'valid': True}, '42e591b7-f86c-4b67-a=
3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tr=
ue, 'delay': '0.000272766', 'lastCheck': '6.0', 'valid': True}} from=3D::ff=
ff:10.10.43.1,60554, flow_id=3D3b2e802e, task_id=3D28c795d1-1639-4e68-a9fe-=
a00006be268f (api:52)
2018-02-20 14:38:47,226+0800 INFO=C2=A0 (jsonrpc/3) [jsonrpc.JsonRpcServer]=
RPC call Host.getStats succeeded in 0.00 seconds (__init__:539)
2018-02-20 14:38:55,252+0800 INFO=C2=A0 (jsonrpc/4) [jsonrpc.JsonRpcServer]=
RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2018-02-20 14:38:58,566+0800 INFO=C2=A0 (jsonrpc/2) [jsonrpc.JsonRpcServer]=
RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2018-02-20 14:39:01,093+0800 INFO=C2=A0 (periodic/1) [vdsm.api] START repoS=
tats(options=3DNone) from=3Dinternal, task_id=3D04f55ded-5841-44ae-a376-4f6=
e723e4b10 (api:46)
2018-02-20 14:39:01,093+0800 INFO=C2=A0 (periodic/1) [vdsm.api] FINISH repo=
Stats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual=
': True, 'version': 4, 'acquired': True, 'delay': '9.3888e-05', 'lastCheck'=
: '9.9', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0=
, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000197535', '=
lastCheck': '9.8', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': =
{'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000=
191456', 'lastCheck': '9.8', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f=
440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'dela=
y': '0.00026365', 'lastCheck': '9.8', 'valid': True}, '42e591b7-f86c-4b67-a=
3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tr=
ue, 'delay': '0.000243658', 'lastCheck': '0.0', 'valid': True}} from=3Dinte=
rnal, task_id=3D04f55ded-5841-44ae-a376-4f6e723e4b10 (api:52)
2018-02-20 14:39:02,295+0800 INFO=C2=A0 (jsonrpc/6) [vdsm.api] START repoSt=
ats(options=3DNone) from=3D::ffff:10.10.43.1,60554, flow_id=3D13149d6e, tas=
k_id=3D5f19d76a-d343-4dc4-ad09-024ec27f7443 (api:46)
2018-02-20 14:39:02,295+0800 INFO=C2=A0 (jsonrpc/6) [vdsm.api] FINISH repoS=
tats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual'=
: True, 'version': 4, 'acquired': True, 'delay': '9.4759e-05', 'lastCheck':=
'1.1', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0,=
'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000183158', 'l=
astCheck': '1.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': {=
'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.0002=
22609', 'lastCheck': '1.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f4=
40a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay=
': '0.000211253', 'lastCheck': '1.0', 'valid': True}, '42e591b7-f86c-4b67-a=
3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tr=
ue, 'delay': '0.000243658', 'lastCheck': '1.1', 'valid': True}} from=3D::ff=
ff:10.10.43.1,60554, flow_id=3D13149d6e, task_id=3D5f19d76a-d343-4dc4-ad09-=
024ec27f7443 (api:52)
2018-02-20 14:39:02,300+0800 INFO=C2=A0 (jsonrpc/6) [jsonrpc.JsonRpcServer]=
RPC call Host.getStats succeeded in 0.01 seconds (__init__:539)
2018-02-20 14:39:10,270+0800 INFO=C2=A0 (jsonrpc/1) [jsonrpc.JsonRpcServer]=
RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2018-02-20 14:39:13,631+0800 INFO=C2=A0 (jsonrpc/0) [vdsm.api] START connec=
tStorageServer(domType=3D1, spUUID=3Du'00000000-0000-0000-0000-000000000000=
', conList=3D[{u'id': u'5e4c94f1-f3b9-4fbd-a6c7-e732d0fe3123', u'connection=
': u'dev2node1.lares.com.ph:/run/media/root/Slave1Data/dataNode1', u'iqn': =
u'', u'user': u'', u'tpgt': u'1', u'protocol_version': u'auto', u'password'=
: '********', u'port': u''}], options=3DNone) from=3D::ffff:10.10.43.1,6055=
4, flow_id=3D15b57417, task_id=3Dbfce1e70-ef4a-4e13-aaaa-7a66aaf44429 (api:=
46)
2018-02-20 14:39:13,633+0800 INFO=C2=A0 (jsonrpc/0) [vdsm.api] FINISH conne=
ctStorageServer return=3D{'statuslist': [{'status': 0, 'id': u'5e4c94f1-f3b=
9-4fbd-a6c7-e732d0fe3123'}]} from=3D::ffff:10.10.43.1,60554, flow_id=3D15b5=
7417, task_id=3Dbfce1e70-ef4a-4e13-aaaa-7a66aaf44429 (api:52)
2018-02-20 14:39:13,634+0800 INFO=C2=A0 (jsonrpc/0) [jsonrpc.JsonRpcServer]=
RPC call StoragePool.connectStorageServer succeeded in 0.00 seconds (__ini=
t__:539)
2018-02-20 14:39:13,806+0800 INFO=C2=A0 (jsonrpc/7) [vdsm.api] START connec=
tStoragePool(spUUID=3Du'5a865884-0366-0330-02b8-0000000002d4', hostID=3D1, =
msdUUID=3Du'f3e372e3-1251-4195-a4b9-1027e40059df', masterVersion=3D65, doma=
insMap=3D{u'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': u'active', u'4bf2ba2f-f5=
7a-4d9f-b42a-fb78f440a358': u'active', u'225e1975-8121-4370-b317-86e964ae32=
6f': u'attached', u'f3e372e3-1251-4195-a4b9-1027e40059df': u'active', u'65c=
a2e2d-b472-4bee-85b4-09a161464b20': u'active', u'42e591b7-f86c-4b67-a3d2-40=
cc007f7662': u'active'}, options=3DNone) from=3D::ffff:10.10.43.1,60554, fl=
ow_id=3D15b57417, task_id=3D927a5d9a-4304-4776-b5c9-22ba5d0cb853 (api:46)
2018-02-20 14:39:13,807+0800 INFO=C2=A0 (jsonrpc/7) [storage.StoragePoolMem=
oryBackend] new storage pool master version 65 and domains map {u'e83d0d46-=
6ea6-4aa3-80bf-6e95c66b0454': u'Active', u'4bf2ba2f-f57a-4d9f-b42a-fb78f440=
a358': u'Active', u'225e1975-8121-4370-b317-86e964ae326f': u'Attached', u'f=
3e372e3-1251-4195-a4b9-1027e40059df': u'Active', u'65ca2e2d-b472-4bee-85b4-=
09a161464b20': u'Active', u'42e591b7-f86c-4b67-a3d2-40cc007f7662': u'Active=
'} (spbackends:450)
VDSM.log 22018-02-20 14:41:14,598+0800 INFO=C2=A0 (periodic/3) [vdsm.api] F=
INISH repoStats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': =
0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000252423', =
'lastCheck': '6.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454':=
{'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '7.55=
67e-05', 'lastCheck': '6.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a16=
1464b20': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'dela=
y': '8.2433e-05', 'lastCheck': '6.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b=
42a-fb78f440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': Tr=
ue, 'delay': '0.000237247', 'lastCheck': '5.9', 'valid': True}, '42e591b7-f=
86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acq=
uired': True, 'delay': '8.4376e-05', 'lastCheck': '6.0', 'valid': True}} fr=
om=3Dinternal, task_id=3D6213712b-9903-4db8-9836-3baf85cd63e4 (api:52)
2018-02-20 14:41:18,074+0800 INFO=C2=A0 (jsonrpc/6) [jsonrpc.JsonRpcServer]=
RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2018-02-20 14:41:24,333+0800 INFO=C2=A0 (jsonrpc/4) [vdsm.api] START repoSt=
ats(options=3DNone) from=3D::ffff:10.10.43.1,56540, flow_id=3D73f86113, tas=
k_id=3De8231ecb-3543-4d8f-af54-4cf2b06ee98a (api:46)
2018-02-20 14:41:24,334+0800 INFO=C2=A0 (jsonrpc/4) [vdsm.api] FINISH repoS=
tats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual'=
: True, 'version': 4, 'acquired': True, 'delay': '0.000172953', 'lastCheck'=
: '5.7', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0=
, 'actual': True, 'version': 0, 'acquired': True, 'delay': '7.701e-05', 'la=
stCheck': '5.7', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': {'=
code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.00011=
7677', 'lastCheck': '5.7', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f44=
0a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay'=
: '0.000185146', 'lastCheck': '5.7', 'valid': True}, '42e591b7-f86c-4b67-a3=
d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tru=
e, 'delay': '9.1467e-05', 'lastCheck': '5.8', 'valid': True}} from=3D::ffff=
:10.10.43.1,56540, flow_id=3D73f86113, task_id=3De8231ecb-3543-4d8f-af54-4c=
f2b06ee98a (api:52)
2018-02-20 14:41:24,338+0800 INFO=C2=A0 (jsonrpc/4) [jsonrpc.JsonRpcServer]=
RPC call Host.getStats succeeded in 0.00 seconds (__init__:539)
2018-02-20 14:41:27,087+0800 INFO=C2=A0 (jsonrpc/0) [jsonrpc.JsonRpcServer]=
RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2018-02-20 14:41:29,607+0800 INFO=C2=A0 (periodic/1) [vdsm.api] START repoS=
tats(options=3DNone) from=3Dinternal, task_id=3Df14b7aab-b64a-4903-9368-d66=
5e39b49d1 (api:46)
2018-02-20 14:41:29,608+0800 INFO=C2=A0 (periodic/1) [vdsm.api] FINISH repo=
Stats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual=
': True, 'version': 4, 'acquired': True, 'delay': '0.000246237', 'lastCheck=
': '1.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': =
0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '8.8773e-05', '=
lastCheck': '1.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': =
{'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '9.714=
5e-05', 'lastCheck': '1.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f4=
40a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay=
': '0.000218729', 'lastCheck': '0.9', 'valid': True}, '42e591b7-f86c-4b67-a=
3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tr=
ue, 'delay': '9.1035e-05', 'lastCheck': '1.0', 'valid': True}} from=3Dinter=
nal, task_id=3Df14b7aab-b64a-4903-9368-d665e39b49d1 (api:52)
2018-02-20 14:41:33,079+0800 INFO=C2=A0 (jsonrpc/7) [jsonrpc.JsonRpcServer]=
RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2018-02-20 14:41:40,456+0800 INFO=C2=A0 (jsonrpc/2) [vdsm.api] START repoSt=
ats(options=3DNone) from=3D::ffff:10.10.43.1,56540, flow_id=3D3be8150c, tas=
k_id=3D1b0c86a8-6fd8-4882-a742-fbd56ccb4037 (api:46)
2018-02-20 14:41:40,457+0800 INFO=C2=A0 (jsonrpc/2) [vdsm.api] FINISH repoS=
tats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual'=
: True, 'version': 4, 'acquired': True, 'delay': '0.000174027', 'lastCheck'=
: '1.8', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0=
, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.00011454', 'l=
astCheck': '1.8', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': {=
'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.0001=
45955', 'lastCheck': '1.8', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f4=
40a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay=
': '0.000209871', 'lastCheck': '1.8', 'valid': True}, '42e591b7-f86c-4b67-a=
3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tr=
ue, 'delay': '9.5744e-05', 'lastCheck': '1.9', 'valid': True}} from=3D::fff=
f:10.10.43.1,56540, flow_id=3D3be8150c, task_id=3D1b0c86a8-6fd8-4882-a742-f=
bd56ccb4037 (api:52)
2018-02-20 14:41:40,461+0800 INFO=C2=A0 (jsonrpc/2) [jsonrpc.JsonRpcServer]=
RPC call Host.getStats succeeded in 0.01 seconds (__init__:539)
2018-02-20 14:41:42,106+0800 INFO=C2=A0 (jsonrpc/3) [jsonrpc.JsonRpcServer]=
RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2018-02-20 14:41:44,622+0800 INFO=C2=A0 (periodic/3) [vdsm.api] START repoS=
tats(options=3DNone) from=3Dinternal, task_id=3D20e0b29b-d3cd-4e44-b92c-213=
f9c984ab2 (api:46)
2018-02-20 14:41:44,622+0800 INFO=C2=A0 (periodic/3) [vdsm.api] FINISH repo=
Stats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual=
': True, 'version': 4, 'acquired': True, 'delay': '0.000174027', 'lastCheck=
': '6.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': =
0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.00011454', '=
lastCheck': '6.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': =
{'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000=
145955', 'lastCheck': '6.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f=
440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'dela=
y': '0.000209871', 'lastCheck': '5.9', 'valid': True}, '42e591b7-f86c-4b67-=
a3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': T=
rue, 'delay': '9.5744e-05', 'lastCheck': '6.0', 'valid': True}} from=3Dinte=
rnal, task_id=3D20e0b29b-d3cd-4e44-b92c-213f9c984ab2 (api:52)
2018-02-20 14:41:49,083+0800 INFO=C2=A0 (jsonrpc/1) [jsonrpc.JsonRpcServer]=
RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
Engine log
skId '404ccecc-aa7f-45ea-89e4-726956269bc9' task status 'finished'
2018-02-20 14:42:21,966+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb=
roker.SpmStartVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9] spm=
Start polling ended, spm status: SPM
2018-02-20 14:42:21,967+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb=
roker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9]=
START, HSMClearTaskVDSCommand(HostName =3D Node1, HSMTaskGuidBaseVDSComman=
dParameters:{runAsync=3D'true', hostId=3D'7dee35bb-8c97-4f6a-b6cd-abc425854=
0e4', taskId=3D'404ccecc-aa7f-45ea-89e4-726956269bc9'}), log id: 71688f70
2018-02-20 14:42:22,922+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb=
roker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9]=
FINISH, HSMClearTaskVDSCommand, log id: 71688f70
2018-02-20 14:42:22,923+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb=
roker.SpmStartVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9] FIN=
ISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentit=
ies.SpmStatusResult@78332453, log id: 3ea35d5
2018-02-20 14:42:22,935+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb=
roker.IrsProxy] (org.ovirt.thread.pool-7-thread-38) [29528f9] Initialize Ir=
s proxy from vds: dev2node1.lares.com.ph
2018-02-20 14:42:22,951+08 INFO=C2=A0 [org.ovirt.engine.core.dal.dbbroker.a=
uditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-38) [2952=
8f9] EVENT_ID: IRS_HOSTED_ON_VDS(204), Correlation ID: null, Call Stack: nu=
ll, Custom ID: null, Custom Event ID: -1, Message: Storage Pool Manager run=
s on Host Node1 (Address: dev2node1.lares.com.ph).
2018-02-20 14:42:22,952+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb=
roker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29=
528f9] -- executeIrsBrokerCommand: Attempting on storage pool '5a865884-036=
6-0330-02b8-0000000002d4'
2018-02-20 14:42:22,952+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb=
roker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29=
528f9] START, HSMGetAllTasksInfoVDSCommand(HostName =3D Node1, VdsIdVDSComm=
andParametersBase:{runAsync=3D'true', hostId=3D'7dee35bb-8c97-4f6a-b6cd-abc=
4258540e4'}), log id: 1bdbea9d
2018-02-20 14:42:22,955+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb=
roker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-7) [295=
28f9] START, SPMGetAllTasksInfoVDSCommand( IrsBaseVDSCommandParameters:{run=
Async=3D'true', storagePoolId=3D'5a865884-0366-0330-02b8-0000000002d4', ign=
oreFailoverLimit=3D'false'}), log id: 5c2422d6
2018-02-20 14:42:23,956+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb=
roker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29=
528f9] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 1bdbea9d
2018-02-20 14:42:23,956+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb=
roker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29=
528f9] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 58cbe7b7
2018-02-20 14:42:23,956+08 INFO=C2=A0 [org.ovirt.engine.core.bll.tasks.Asyn=
cTaskManager] (org.ovirt.thread.pool-7-thread-38) [29528f9] Discovered no t=
asks on Storage Pool 'UnsecuredEnv'
2018-02-20 14:42:24,936+08 INFO=C2=A0 [org.ovirt.vdsm.jsonrpc.client.reacto=
rs.ReactorClient] (SSL Stomp Reactor) [] Connecting to dev2node1.lares.com.=
ph/10.10.43.2
2018-02-20 14:42:27,012+08 WARN=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb=
roker.IrsProxy] (org.ovirt.thread.pool-7-thread-43) [] Master domain is not=
in sync between DB and VDSM. Domain Node1Container marked as master in DB =
and not in the storage
2018-02-20 14:42:27,026+08 WARN=C2=A0 [org.ovirt.engine.core.dal.dbbroker.a=
uditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-43) [] EV=
ENT_ID: SYSTEM_MASTER_DOMAIN_NOT_IN_SYNC(990), Correlation ID: null, Call S=
tack: null, Custom ID: null, Custom Event ID: -1, Message: Sync Error on Ma=
ster Domain between Host Node1 and oVirt Engine. Domain: Node1Container is =
marked as Master in oVirt Engine database but not on the Storage side. Plea=
se consult with Support on how to fix this issue.
2018-02-20 14:42:27,103+08 INFO=C2=A0 [org.ovirt.engine.core.bll.storage.po=
ol.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-thread-43) [3e5=
965ca] Running command: ReconstructMasterDomainCommand internal: true. Enti=
ties affected :=C2=A0 ID: f3e372e3-1251-4195-a4b9-1027e40059df Type: Storag=
e
2018-02-20 14:42:27,137+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb=
roker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-43) [3e5965ca] ST=
ART, ResetIrsVDSCommand( ResetIrsVDSCommandParameters:{runAsync=3D'true', s=
toragePoolId=3D'5a865884-0366-0330-02b8-0000000002d4', ignoreFailoverLimit=
=3D'false', vdsId=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4', ignoreStopFaile=
d=3D'true'}), log id: 3e0a239d
2018-02-20 14:42:27,140+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb=
roker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-43) [3e5965ca] STA=
RT, SpmStopVDSCommand(HostName =3D Node1, SpmStopVDSCommandParameters:{runA=
sync=3D'true', hostId=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4', storagePool=
Id=3D'5a865884-0366-0330-02b8-0000000002d4'}), log id: 7c67bf06
2018-02-20 14:42:28,144+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb=
roker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-43) [3e5965ca] Spm=
StopVDSCommand::Stopping SPM on vds 'Node1', pool id '5a865884-0366-0330-02=
b8-0000000002d4'
=20
On Tuesday, February 20, 2018 2:33 PM, michael pagdanganan <mhke_aj5566=
@yahoo.com> wrote:
=20
Thanks for quick response,
see attachment.
=20
On Tuesday, February 20, 2018 2:10 PM, Eyal Shenitzky <eshenitz(a)redhat.=
com> wrote:
=20
Hi,=C2=A0
Can you please attach full Engine and VDSM logs?
Thanks,
On Tue, Feb 20, 2018 at 2:59 AM, michael pagdanganan <mhke_aj5566(a)yahoo.com=
> wrote:
My storage pool has 2 Master Domain(Stored2 on Node2,Node1Container on Node=
1). and my old master domain (DATANd01 on Node1 ) hung on preparing for mai=
ntenance. When I tried to activate my old master domain (DATANd01 on Node1 =
) all=C2=A0 storage domain goes down and up master keep on rotating.
Ovirt Version (oVirt Engine Version: 4.1.9.1.el7.centos)
Event Error:Sync Error on Master Domain between Host Node2 and oVirt Engine=
. Domain Stored2 is marked as master in ovirt engine Database but not on st=
orage side Please consult with support
VDSM Node2 command ConnectStoragePoolVDS failed: Wrong Master domain or it'=
s version: u'SD=3Df3e372e3-1251-4195-a4b9- 1027e40059df, pool=3D5a865884-03=
66-0330-02b8- 0000
VDSM Node2 command HSMGetAllTastsStatusesVDS failed: Not SPM: ()
Failed to deactivate Storage Domain DATANd01 (Data Center UnsecuredEnv)
Here's logs from engine:
------------------------------ ------------------------------ -------------=
----------------- -------------[root@dev2engine ~]# tail /var/log/messages
Feb 20 07:01:01 dev2engine systemd: Starting Session 20 of user root.
Feb 20 07:01:01 dev2engine systemd: Removed slice User Slice of root.
Feb 20 07:01:01 dev2engine systemd: Stopping User Slice of root.
Feb 20 07:58:52 dev2engine systemd: Created slice User Slice of root.
Feb 20 07:58:52 dev2engine systemd: Starting User Slice of root.
Feb 20 07:58:52 dev2engine systemd-logind: New session 21 of user root.
Feb 20 07:58:52 dev2engine systemd: Started Session 21 of user root.
Feb 20 07:58:52 dev2engine systemd: Starting Session 21 of user root.
Feb 20 08:01:01 dev2engine systemd: Started Session 22 of user root.
Feb 20 08:01:01 dev2engine systemd: Starting Session 22 of user root.
------------------------------ ------------------------------ -------------=
----------------- -------------[root@dev2engine ~]# tail /var/log/ovirt-eng=
ine/engine. log
2018-02-20 08:01:16,062+08 INFO=C2=A0 [org.ovirt.engine.core.bll. eventqueu=
e.EventQueueMonitor] (org.ovirt.thread.pool-7- thread-32) [102e9d3c] Finish=
ed reconstruct for pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing e=
vent queue
2018-02-20 08:01:27,825+08 WARN=C2=A0 [org.ovirt.engine.core. vdsbroker.irs=
broker.IrsProxy] (org.ovirt.thread.pool-7- thread-23) [] Master domain is n=
ot in sync between DB and VDSM. Domain Stored2 marked as master in DB and n=
ot in the storage
2018-02-20 08:01:27,862+08 WARN=C2=A0 [org.ovirt.engine.core.bll. storage.p=
ool. ReconstructMasterDomainCommand ] (org.ovirt.thread.pool-7- thread-23) =
[213f42b9] Validation of action 'ReconstructMasterDomain' failed for user S=
YSTEM. Reasons: VAR__ACTION__RECONSTRUCT_ MASTER,VAR__TYPE__STORAGE__ DOMAI=
N,ACTION_TYPE_FAILED_ STORAGE_DOMAIN_STATUS_ ILLEGAL2,$status PreparingForM=
aintenance
2018-02-20 08:01:27,882+08 INFO=C2=A0 [org.ovirt.engine.core.bll. eventqueu=
e.EventQueueMonitor] (org.ovirt.thread.pool-7- thread-20) [929330e] Finishe=
d reconstruct for pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing ev=
ent queue
2018-02-20 08:01:40,106+08 WARN=C2=A0 [org.ovirt.engine.core. vdsbroker.irs=
broker.IrsProxy] (org.ovirt.thread.pool-7- thread-17) [] Master domain is n=
ot in sync between DB and VDSM. Domain Stored2 marked as master in DB and n=
ot in the storage
2018-02-20 08:01:40,197+08 WARN=C2=A0 [org.ovirt.engine.core.bll. storage.p=
ool. ReconstructMasterDomainCommand ] (org.ovirt.thread.pool-7- thread-17) =
[7af552c1] Validation of action 'ReconstructMasterDomain' failed for user S=
YSTEM. Reasons: VAR__ACTION__RECONSTRUCT_ MASTER,VAR__TYPE__STORAGE__ DOMAI=
N,ACTION_TYPE_FAILED_ STORAGE_DOMAIN_STATUS_ ILLEGAL2,$status PreparingForM=
aintenance
2018-02-20 08:01:40,246+08 INFO=C2=A0 [org.ovirt.engine.core.bll. eventqueu=
e.EventQueueMonitor] (org.ovirt.thread.pool-7- thread-22) [73673040] Finish=
ed reconstruct for pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing e=
vent queue
2018-02-20 08:01:51,809+08 WARN=C2=A0 [org.ovirt.engine.core. vdsbroker.irs=
broker.IrsProxy] (org.ovirt.thread.pool-7- thread-26) [] Master domain is n=
ot in sync between DB and VDSM. Domain Stored2 marked as master in DB and n=
ot in the storage
2018-02-20 08:01:51,846+08 WARN=C2=A0 [org.ovirt.engine.core.bll. storage.p=
ool. ReconstructMasterDomainCommand ] (org.ovirt.thread.pool-7- thread-26) =
[20307cbe] Validation of action 'ReconstructMasterDomain' failed for user S=
YSTEM. Reasons: VAR__ACTION__RECONSTRUCT_ MASTER,VAR__TYPE__STORAGE__ DOMAI=
N,ACTION_TYPE_FAILED_ STORAGE_DOMAIN_STATUS_ ILLEGAL2,$status PreparingForM=
aintenance
2018-02-20 08:01:51,866+08 INFO=C2=A0 [org.ovirt.engine.core.bll. eventqueu=
e.EventQueueMonitor] (org.ovirt.thread.pool-7- thread-49) [2c11a866] Finish=
ed reconstruct for pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing e=
vent queue
______________________________ _________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/ mailman/listinfo/users
--=20
Regards,Eyal Shenitzky
=20
=20
------=_Part_2010355_281080504.1519108987392
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<html><head></head><body><div style=3D"color:#000; background-color:#fff; f=
ont-family:Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font=
-size:10px"><div id=3D"yui_3_16_0_ym19_1_1519085807369_70843">Sorry can't a=
ttached log file it's too big file<br></div><div id=3D"yui_3_16_0_ym19_1_15=
19085807369_70846"><br></div><div><br></div><div>VDSM.log for node 1</div><=
div id=3D"yui_3_16_0_ym19_1_1519085807369_70844"><br></div><div id=3D"yui_3=
_16_0_ym19_1_1519085807369_70530" dir=3D"ltr">2766', 'lastCheck': '4.9', 'v=
alid': True}} from=3Dinternal, task_id=3D645d456e-f59f-4b1c-9e97-fc82d19a36=
b1 (api:52)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70565">2018-02-20 14:3=
8:47,222+0800 INFO (jsonrpc/3) [vdsm.api] START repoStats(options=3DN=
one) from=3D::ffff:10.10.43.1,60554, flow_id=3D3b2e802e, task_id=3D28c795d1=
-1639-4e68-a9fe-a00006be268f (api:46)<br id=3D"yui_3_16_0_ym19_1_1519085807=
369_70566">2018-02-20 14:38:47,222+0800 INFO (jsonrpc/3) [vdsm.api] F=
INISH repoStats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': =
0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000119109', =
'lastCheck': '6.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454':=
{'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.00=
0195263', 'lastCheck': '6.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a1=
61464b20': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'del=
ay': '0.00022988', 'lastCheck': '6.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-=
b42a-fb78f440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': T=
rue, 'delay': '0.000270206', 'lastCheck': '5.9', 'valid': True}, '42e591b7-=
f86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'ac=
quired': True, 'delay': '0.000272766', 'lastCheck': '6.0', 'valid': True}} =
from=3D::ffff:10.10.43.1,60554, flow_id=3D3b2e802e, task_id=3D28c795d1-1639=
-4e68-a9fe-a00006be268f (api:52)<br id=3D"yui_3_16_0_ym19_1_1519085807369_7=
0567">2018-02-20 14:38:47,226+0800 INFO (jsonrpc/3) [jsonrpc.JsonRpcS=
erver] RPC call Host.getStats succeeded in 0.00 seconds (__init__:539)<br i=
d=3D"yui_3_16_0_ym19_1_1519085807369_70568">2018-02-20 14:38:55,252+0800 IN=
FO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats su=
cceeded in 0.00 seconds (__init__:539)<br id=3D"yui_3_16_0_ym19_1_151908580=
7369_70569">2018-02-20 14:38:58,566+0800 INFO (jsonrpc/2) [jsonrpc.Js=
onRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init_=
_:539)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70570">2018-02-20 14:39:01,=
093+0800 INFO (periodic/1) [vdsm.api] START repoStats(options=3DNone)=
from=3Dinternal, task_id=3D04f55ded-5841-44ae-a376-4f6e723e4b10 (api:46)<b=
r id=3D"yui_3_16_0_ym19_1_1519085807369_70571">2018-02-20 14:39:01,093+0800=
INFO (periodic/1) [vdsm.api] FINISH repoStats return=3D{'f3e372e3-12=
51-4195-a4b9-1027e40059df': {'code': 0, 'actual': True, 'version': 4, 'acqu=
ired': True, 'delay': '9.3888e-05', 'lastCheck': '9.9', 'valid': True}, 'e8=
3d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0, 'actual': True, 'version':=
0, 'acquired': True, 'delay': '0.000197535', 'lastCheck': '9.8', 'valid': =
True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': {'code': 0, 'actual': True, =
'version': 4, 'acquired': True, 'delay': '0.000191456', 'lastCheck': '9.8',=
'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': {'code': 0, 'actua=
l': True, 'version': 0, 'acquired': True, 'delay': '0.00026365', 'lastCheck=
': '9.8', 'valid': True}, '42e591b7-f86c-4b67-a3d2-40cc007f7662': {'code': =
0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000243658', =
'lastCheck': '0.0', 'valid': True}} from=3Dinternal, task_id=3D04f55ded-584=
1-44ae-a376-4f6e723e4b10 (api:52)<br id=3D"yui_3_16_0_ym19_1_1519085807369_=
70572">2018-02-20 14:39:02,295+0800 INFO (jsonrpc/6) [vdsm.api] START=
repoStats(options=3DNone) from=3D::ffff:10.10.43.1,60554, flow_id=3D13149d=
6e, task_id=3D5f19d76a-d343-4dc4-ad09-024ec27f7443 (api:46)<br id=3D"yui_3_=
16_0_ym19_1_1519085807369_70573">2018-02-20 14:39:02,295+0800 INFO (j=
sonrpc/6) [vdsm.api] FINISH repoStats return=3D{'f3e372e3-1251-4195-a4b9-10=
27e40059df': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'd=
elay': '9.4759e-05', 'lastCheck': '1.1', 'valid': True}, 'e83d0d46-6ea6-4aa=
3-80bf-6e95c66b0454': {'code': 0, 'actual': True, 'version': 0, 'acquired':=
True, 'delay': '0.000183158', 'lastCheck': '1.0', 'valid': True}, '65ca2e2=
d-b472-4bee-85b4-09a161464b20': {'code': 0, 'actual': True, 'version': 4, '=
acquired': True, 'delay': '0.000222609', 'lastCheck': '1.0', 'valid': True}=
, '4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': {'code': 0, 'actual': True, 'vers=
ion': 0, 'acquired': True, 'delay': '0.000211253', 'lastCheck': '1.0', 'val=
id': True}, '42e591b7-f86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': T=
rue, 'version': 4, 'acquired': True, 'delay': '0.000243658', 'lastCheck': '=
1.1', 'valid': True}} from=3D::ffff:10.10.43.1,60554, flow_id=3D13149d6e, t=
ask_id=3D5f19d76a-d343-4dc4-ad09-024ec27f7443 (api:52)<br id=3D"yui_3_16_0_=
ym19_1_1519085807369_70574">2018-02-20 14:39:02,300+0800 INFO (jsonrp=
c/6) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 secon=
ds (__init__:539)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70575">2018-02-2=
0 14:39:10,270+0800 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call=
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br id=3D"yui_3=
_16_0_ym19_1_1519085807369_70576">2018-02-20 14:39:13,631+0800 INFO (=
jsonrpc/0) [vdsm.api] START connectStorageServer(domType=3D1, spUUID=3Du'00=
000000-0000-0000-0000-000000000000', conList=3D[{u'id': u'5e4c94f1-f3b9-4fb=
d-a6c7-e732d0fe3123', u'connection': u'dev2node1.lares.com.ph:/run/media/ro=
ot/Slave1Data/dataNode1', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'proto=
col_version': u'auto', u'password': '********', u'port': u''}], options=3DN=
one) from=3D::ffff:10.10.43.1,60554, flow_id=3D15b57417, task_id=3Dbfce1e70=
-ef4a-4e13-aaaa-7a66aaf44429 (api:46)<br id=3D"yui_3_16_0_ym19_1_1519085807=
369_70577">2018-02-20 14:39:13,633+0800 INFO (jsonrpc/0) [vdsm.api] F=
INISH connectStorageServer return=3D{'statuslist': [{'status': 0, 'id': u'5=
e4c94f1-f3b9-4fbd-a6c7-e732d0fe3123'}]} from=3D::ffff:10.10.43.1,60554, flo=
w_id=3D15b57417, task_id=3Dbfce1e70-ef4a-4e13-aaaa-7a66aaf44429 (api:52)<br=
id=3D"yui_3_16_0_ym19_1_1519085807369_70578">2018-02-20 14:39:13,634+0800 =
INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call StoragePool.connect=
StorageServer succeeded in 0.00 seconds (__init__:539)<br id=3D"yui_3_16_0_=
ym19_1_1519085807369_70579">2018-02-20 14:39:13,806+0800 INFO (jsonrp=
c/7) [vdsm.api] START connectStoragePool(spUUID=3Du'5a865884-0366-0330-02b8=
-0000000002d4', hostID=3D1, msdUUID=3Du'f3e372e3-1251-4195-a4b9-1027e40059d=
f', masterVersion=3D65, domainsMap=3D{u'e83d0d46-6ea6-4aa3-80bf-6e95c66b045=
4': u'active', u'4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': u'active', u'225e19=
75-8121-4370-b317-86e964ae326f': u'attached', u'f3e372e3-1251-4195-a4b9-102=
7e40059df': u'active', u'65ca2e2d-b472-4bee-85b4-09a161464b20': u'active', =
u'42e591b7-f86c-4b67-a3d2-40cc007f7662': u'active'}, options=3DNone) from=
=3D::ffff:10.10.43.1,60554, flow_id=3D15b57417, task_id=3D927a5d9a-4304-477=
6-b5c9-22ba5d0cb853 (api:46)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70580=
">2018-02-20 14:39:13,807+0800 INFO (jsonrpc/7) [storage.StoragePoolM=
emoryBackend] new storage pool master version 65 and domains map {u'e83d0d4=
6-6ea6-4aa3-80bf-6e95c66b0454': u'Active', u'4bf2ba2f-f57a-4d9f-b42a-fb78f4=
40a358': u'Active', u'225e1975-8121-4370-b317-86e964ae326f': u'Attached', u=
'f3e372e3-1251-4195-a4b9-1027e40059df': u'Active', u'65ca2e2d-b472-4bee-85b=
4-09a161464b20': u'Active', u'42e591b7-f86c-4b67-a3d2-40cc007f7662': u'Acti=
ve'} (spbackends:450)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70581"></div=
><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_70649"><br></div><d=
iv dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_70648">VDSM.log 2</div=
><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_70650">2018-02-20 1=
4:41:14,598+0800 INFO (periodic/3) [vdsm.api] FINISH repoStats return=
=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual': True, 've=
rsion': 4, 'acquired': True, 'delay': '0.000252423', 'lastCheck': '6.0', 'v=
alid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0, 'actual':=
True, 'version': 0, 'acquired': True, 'delay': '7.5567e-05', 'lastCheck': =
'6.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': {'code': 0, =
'actual': True, 'version': 4, 'acquired': True, 'delay': '8.2433e-05', 'las=
tCheck': '6.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': {'c=
ode': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000237=
247', 'lastCheck': '5.9', 'valid': True}, '42e591b7-f86c-4b67-a3d2-40cc007f=
7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay':=
'8.4376e-05', 'lastCheck': '6.0', 'valid': True}} from=3Dinternal, task_id=
=3D6213712b-9903-4db8-9836-3baf85cd63e4 (api:52)<br id=3D"yui_3_16_0_ym19_1=
_1519085807369_70683">2018-02-20 14:41:18,074+0800 INFO (jsonrpc/6) [=
jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 second=
s (__init__:539)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70684">2018-02-20=
14:41:24,333+0800 INFO (jsonrpc/4) [vdsm.api] START repoStats(option=
s=3DNone) from=3D::ffff:10.10.43.1,56540, flow_id=3D73f86113, task_id=3De82=
31ecb-3543-4d8f-af54-4cf2b06ee98a (api:46)<br id=3D"yui_3_16_0_ym19_1_15190=
85807369_70685">2018-02-20 14:41:24,334+0800 INFO (jsonrpc/4) [vdsm.a=
pi] FINISH repoStats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'co=
de': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.0001729=
53', 'lastCheck': '5.7', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0=
454': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': =
'7.701e-05', 'lastCheck': '5.7', 'valid': True}, '65ca2e2d-b472-4bee-85b4-0=
9a161464b20': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, '=
delay': '0.000117677', 'lastCheck': '5.7', 'valid': True}, '4bf2ba2f-f57a-4=
d9f-b42a-fb78f440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired=
': True, 'delay': '0.000185146', 'lastCheck': '5.7', 'valid': True}, '42e59=
1b7-f86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4,=
'acquired': True, 'delay': '9.1467e-05', 'lastCheck': '5.8', 'valid': True=
}} from=3D::ffff:10.10.43.1,56540, flow_id=3D73f86113, task_id=3De8231ecb-3=
543-4d8f-af54-4cf2b06ee98a (api:52)<br id=3D"yui_3_16_0_ym19_1_151908580736=
9_70686">2018-02-20 14:41:24,338+0800 INFO (jsonrpc/4) [jsonrpc.JsonR=
pcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:539)<b=
r id=3D"yui_3_16_0_ym19_1_1519085807369_70687">2018-02-20 14:41:27,087+0800=
INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats=
succeeded in 0.00 seconds (__init__:539)<br id=3D"yui_3_16_0_ym19_1_151908=
5807369_70688">2018-02-20 14:41:29,607+0800 INFO (periodic/1) [vdsm.a=
pi] START repoStats(options=3DNone) from=3Dinternal, task_id=3Df14b7aab-b64=
a-4903-9368-d665e39b49d1 (api:46)<br id=3D"yui_3_16_0_ym19_1_1519085807369_=
70689">2018-02-20 14:41:29,608+0800 INFO (periodic/1) [vdsm.api] FINI=
SH repoStats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, =
'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000246237', 'la=
stCheck': '1.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'=
code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '8.8773e=
-05', 'lastCheck': '1.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a16146=
4b20': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay':=
'9.7145e-05', 'lastCheck': '1.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a=
-fb78f440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True,=
'delay': '0.000218729', 'lastCheck': '0.9', 'valid': True}, '42e591b7-f86c=
-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquir=
ed': True, 'delay': '9.1035e-05', 'lastCheck': '1.0', 'valid': True}} from=
=3Dinternal, task_id=3Df14b7aab-b64a-4903-9368-d665e39b49d1 (api:52)<br id=
=3D"yui_3_16_0_ym19_1_1519085807369_70690">2018-02-20 14:41:33,079+0800 INF=
O (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats suc=
ceeded in 0.00 seconds (__init__:539)<br id=3D"yui_3_16_0_ym19_1_1519085807=
369_70691">2018-02-20 14:41:40,456+0800 INFO (jsonrpc/2) [vdsm.api] S=
TART repoStats(options=3DNone) from=3D::ffff:10.10.43.1,56540, flow_id=3D3b=
e8150c, task_id=3D1b0c86a8-6fd8-4882-a742-fbd56ccb4037 (api:46)<br id=3D"yu=
i_3_16_0_ym19_1_1519085807369_70692">2018-02-20 14:41:40,457+0800 INFO =
; (jsonrpc/2) [vdsm.api] FINISH repoStats return=3D{'f3e372e3-1251-4195-a4b=
9-1027e40059df': {'code': 0, 'actual': True, 'version': 4, 'acquired': True=
, 'delay': '0.000174027', 'lastCheck': '1.8', 'valid': True}, 'e83d0d46-6ea=
6-4aa3-80bf-6e95c66b0454': {'code': 0, 'actual': True, 'version': 0, 'acqui=
red': True, 'delay': '0.00011454', 'lastCheck': '1.8', 'valid': True}, '65c=
a2e2d-b472-4bee-85b4-09a161464b20': {'code': 0, 'actual': True, 'version': =
4, 'acquired': True, 'delay': '0.000145955', 'lastCheck': '1.8', 'valid': T=
rue}, '4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': {'code': 0, 'actual': True, '=
version': 0, 'acquired': True, 'delay': '0.000209871', 'lastCheck': '1.8', =
'valid': True}, '42e591b7-f86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual=
': True, 'version': 4, 'acquired': True, 'delay': '9.5744e-05', 'lastCheck'=
: '1.9', 'valid': True}} from=3D::ffff:10.10.43.1,56540, flow_id=3D3be8150c=
, task_id=3D1b0c86a8-6fd8-4882-a742-fbd56ccb4037 (api:52)<br id=3D"yui_3_16=
_0_ym19_1_1519085807369_70693">2018-02-20 14:41:40,461+0800 INFO (jso=
nrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 se=
conds (__init__:539)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70694">2018-0=
2-20 14:41:42,106+0800 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC c=
all Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br id=3D"yu=
i_3_16_0_ym19_1_1519085807369_70695">2018-02-20 14:41:44,622+0800 INFO =
; (periodic/3) [vdsm.api] START repoStats(options=3DNone) from=3Dinternal, =
task_id=3D20e0b29b-d3cd-4e44-b92c-213f9c984ab2 (api:46)<br id=3D"yui_3_16_0=
_ym19_1_1519085807369_70696">2018-02-20 14:41:44,622+0800 INFO (perio=
dic/3) [vdsm.api] FINISH repoStats return=3D{'f3e372e3-1251-4195-a4b9-1027e=
40059df': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'dela=
y': '0.000174027', 'lastCheck': '6.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-=
80bf-6e95c66b0454': {'code': 0, 'actual': True, 'version': 0, 'acquired': T=
rue, 'delay': '0.00011454', 'lastCheck': '6.0', 'valid': True}, '65ca2e2d-b=
472-4bee-85b4-09a161464b20': {'code': 0, 'actual': True, 'version': 4, 'acq=
uired': True, 'delay': '0.000145955', 'lastCheck': '6.0', 'valid': True}, '=
4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': {'code': 0, 'actual': True, 'version=
': 0, 'acquired': True, 'delay': '0.000209871', 'lastCheck': '5.9', 'valid'=
: True}, '42e591b7-f86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': True=
, 'version': 4, 'acquired': True, 'delay': '9.5744e-05', 'lastCheck': '6.0'=
, 'valid': True}} from=3Dinternal, task_id=3D20e0b29b-d3cd-4e44-b92c-213f9c=
984ab2 (api:52)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70697">2018-02-20 =
14:41:49,083+0800 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call H=
ost.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br id=3D"yui_3_1=
6_0_ym19_1_1519085807369_70698"></div><div dir=3D"ltr"><br></div><div dir=
=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_70767"><br></div><div dir=3D=
"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_70768">Engine log</div><div dir=
=3D"ltr"><br></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_7=
0769">skId '404ccecc-aa7f-45ea-89e4-726956269bc9' task status 'finished'<br=
id=3D"yui_3_16_0_ym19_1_1519085807369_70808">2018-02-20 14:42:21,966+08 IN=
FO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (or=
g.ovirt.thread.pool-7-thread-38) [29528f9] spmStart polling ended, spm stat=
us: SPM<br id=3D"yui_3_16_0_ym19_1_1519085807369_70809">2018-02-20 14:42:21=
,967+08 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskV=
DSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9] START, HSMClearTas=
kVDSCommand(HostName =3D Node1, HSMTaskGuidBaseVDSCommandParameters:{runAsy=
nc=3D'true', hostId=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4', taskId=3D'404=
ccecc-aa7f-45ea-89e4-726956269bc9'}), log id: 71688f70<br id=3D"yui_3_16_0_=
ym19_1_1519085807369_70810">2018-02-20 14:42:22,922+08 INFO [org.ovir=
t.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread=
.pool-7-thread-38) [29528f9] FINISH, HSMClearTaskVDSCommand, log id: 71688f=
70<br id=3D"yui_3_16_0_ym19_1_1519085807369_70811">2018-02-20 14:42:22,923+=
08 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand=
] (org.ovirt.thread.pool-7-thread-38) [29528f9] FINISH, SpmStartVDSCommand,=
return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7833=
2453, log id: 3ea35d5<br id=3D"yui_3_16_0_ym19_1_1519085807369_70812">2018-=
02-20 14:42:22,935+08 INFO [org.ovirt.engine.core.vdsbroker.irsbroker=
.IrsProxy] (org.ovirt.thread.pool-7-thread-38) [29528f9] Initialize Irs pro=
xy from vds: dev2node1.lares.com.ph<br id=3D"yui_3_16_0_ym19_1_151908580736=
9_70813">2018-02-20 14:42:22,951+08 INFO [org.ovirt.engine.core.dal.d=
bbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-=
38) [29528f9] EVENT_ID: IRS_HOSTED_ON_VDS(204), Correlation ID: null, Call =
Stack: null, Custom ID: null, Custom Event ID: -1, Message: Storage Pool Ma=
nager runs on Host Node1 (Address: dev2node1.lares.com.ph).<br id=3D"yui_3_=
16_0_ym19_1_1519085807369_70814">2018-02-20 14:42:22,952+08 INFO [org=
.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.o=
virt.thread.pool-7-thread-38) [29528f9] -- executeIrsBrokerCommand: Attempt=
ing on storage pool '5a865884-0366-0330-02b8-0000000002d4'<br id=3D"yui_3_1=
6_0_ym19_1_1519085807369_70815">2018-02-20 14:42:22,952+08 INFO [org.=
ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ov=
irt.thread.pool-7-thread-38) [29528f9] START, HSMGetAllTasksInfoVDSCommand(=
HostName =3D Node1, VdsIdVDSCommandParametersBase:{runAsync=3D'true', hostI=
d=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4'}), log id: 1bdbea9d<br id=3D"yui=
_3_16_0_ym19_1_1519085807369_70816">2018-02-20 14:42:22,955+08 INFO [=
org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (or=
g.ovirt.thread.pool-7-thread-7) [29528f9] START, SPMGetAllTasksInfoVDSComma=
nd( IrsBaseVDSCommandParameters:{runAsync=3D'true', storagePoolId=3D'5a8658=
84-0366-0330-02b8-0000000002d4', ignoreFailoverLimit=3D'false'}), log id: 5=
c2422d6<br id=3D"yui_3_16_0_ym19_1_1519085807369_70817">2018-02-20 14:42:23=
,956+08 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTask=
sInfoVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9] FINISH, HSMG=
etAllTasksInfoVDSCommand, return: [], log id: 1bdbea9d<br id=3D"yui_3_16_0_=
ym19_1_1519085807369_70818">2018-02-20 14:42:23,956+08 INFO [org.ovir=
t.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.=
thread.pool-7-thread-38) [29528f9] FINISH, SPMGetAllTasksInfoVDSCommand, re=
turn: [], log id: 58cbe7b7<br id=3D"yui_3_16_0_ym19_1_1519085807369_70819">=
2018-02-20 14:42:23,956+08 INFO [org.ovirt.engine.core.bll.tasks.Asyn=
cTaskManager] (org.ovirt.thread.pool-7-thread-38) [29528f9] Discovered no t=
asks on Storage Pool 'UnsecuredEnv'<br id=3D"yui_3_16_0_ym19_1_151908580736=
9_70820">2018-02-20 14:42:24,936+08 INFO [org.ovirt.vdsm.jsonrpc.clie=
nt.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to dev2node1.l=
ares.com.ph/10.10.43.2<br id=3D"yui_3_16_0_ym19_1_1519085807369_70821">2018=
-02-20 14:42:27,012+08 WARN [org.ovirt.engine.core.vdsbroker.irsbroke=
r.IrsProxy] (org.ovirt.thread.pool-7-thread-43) [] Master domain is not in =
sync between DB and VDSM. Domain Node1Container marked as master in DB and =
not in the storage<br id=3D"yui_3_16_0_ym19_1_1519085807369_70822">2018-02-=
20 14:42:27,026+08 WARN [org.ovirt.engine.core.dal.dbbroker.auditlogh=
andling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-43) [] EVENT_ID: =
SYSTEM_MASTER_DOMAIN_NOT_IN_SYNC(990), Correlation ID: null, Call Stack: nu=
ll, Custom ID: null, Custom Event ID: -1, Message: Sync Error on Master Dom=
ain between Host Node1 and oVirt Engine. Domain: Node1Container is marked a=
s Master in oVirt Engine database but not on the Storage side. Please consu=
lt with Support on how to fix this issue.<br id=3D"yui_3_16_0_ym19_1_151908=
5807369_70823">2018-02-20 14:42:27,103+08 INFO [org.ovirt.engine.core=
.bll.storage.pool.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-=
thread-43) [3e5965ca] Running command: ReconstructMasterDomainCommand inter=
nal: true. Entities affected : ID: f3e372e3-1251-4195-a4b9-1027e40059=
df Type: Storage<br id=3D"yui_3_16_0_ym19_1_1519085807369_70824">2018-02-20=
14:42:27,137+08 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.Rese=
tIrsVDSCommand] (org.ovirt.thread.pool-7-thread-43) [3e5965ca] START, Reset=
IrsVDSCommand( ResetIrsVDSCommandParameters:{runAsync=3D'true', storagePool=
Id=3D'5a865884-0366-0330-02b8-0000000002d4', ignoreFailoverLimit=3D'false',=
vdsId=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4', ignoreStopFailed=3D'true'}=
), log id: 3e0a239d<br id=3D"yui_3_16_0_ym19_1_1519085807369_70825">2018-02=
-20 14:42:27,140+08 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.S=
pmStopVDSCommand] (org.ovirt.thread.pool-7-thread-43) [3e5965ca] START, Spm=
StopVDSCommand(HostName =3D Node1, SpmStopVDSCommandParameters:{runAsync=3D=
'true', hostId=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4', storagePoolId=3D'5=
a865884-0366-0330-02b8-0000000002d4'}), log id: 7c67bf06<br id=3D"yui_3_16_=
0_ym19_1_1519085807369_70826">2018-02-20 14:42:28,144+08 INFO [org.ov=
irt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.po=
ol-7-thread-43) [3e5965ca] SpmStopVDSCommand::Stopping SPM on vds 'Node1', =
pool id '5a865884-0366-0330-02b8-0000000002d4'<br></div><div id=3D"yui_3_16=
_0_ym19_1_1519085807369_70529"><span></span></div> <div class=3D"qtdSeparat=
eBR"><br><br></div><div class=3D"yahoo_quoted" style=3D"display: block;"> <=
div style=3D"font-family: Helvetica Neue, Helvetica, Arial, Lucida Grande, =
sans-serif; font-size: 10px;"> <div style=3D"font-family: HelveticaNeue, He=
lvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;=
"> <div dir=3D"ltr"><font size=3D"2" face=3D"Arial"> On Tuesday, February 2=
0, 2018 2:33 PM, michael pagdanganan <mhke_aj5566(a)yahoo.com> wrote:<b=
r></font></div> <br><br> <div class=3D"y_msg_container"><div id=3D"yiv0115=
319588"><div><div style=3D"color:#000;background-color:#fff;font-family:Hel=
vetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:10px;"><=
div id=3D"yiv0115319588yui_3_16_0_ym19_1_1519085807369_60672"><font size=3D=
"3">Thanks for quick response,</font></div><div id=3D"yiv0115319588yui_3_16=
_0_ym19_1_1519085807369_62803"><font size=3D"3"><br clear=3D"none"></font><=
/div><div id=3D"yiv0115319588yui_3_16_0_ym19_1_1519085807369_64423"><font s=
ize=3D"3">see attachment.<br clear=3D"none"></font></div><div id=3D"yiv0115=
319588yui_3_16_0_ym19_1_1519085807369_60552"><span></span></div> <div class=
=3D"yiv0115319588qtdSeparateBR"><br clear=3D"none"><br clear=3D"none"></div=
><div class=3D"yiv0115319588yahoo_quoted" style=3D"display:block;"> <div st=
yle=3D"font-family:Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-se=
rif;font-size:10px;"> <div style=3D"font-family:HelveticaNeue, Helvetica Ne=
ue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px;"> <div clas=
s=3D"yiv0115319588yqt2980525560" id=3D"yiv0115319588yqtfd88886"><div dir=3D=
"ltr"><font size=3D"2" face=3D"Arial"> On Tuesday, February 20, 2018 2:10 P=
M, Eyal Shenitzky <eshenitz(a)redhat.com> wrote:<br clear=3D"none"></fo=
nt></div> <br clear=3D"none"><br clear=3D"none"> <div class=3D"yiv01153195=
88y_msg_container"><div id=3D"yiv0115319588"><div><div dir=3D"ltr">Hi, =
;<div><br clear=3D"none"></div><div>Can you please attach full Engine and V=
DSM logs?</div><div><br clear=3D"none"></div><div>Thanks,</div></div><div c=
lass=3D"yiv0115319588gmail_extra"><br clear=3D"none"><div class=3D"yiv01153=
19588gmail_quote">On Tue, Feb 20, 2018 at 2:59 AM, michael pagdanganan <spa=
n dir=3D"ltr"><<a rel=3D"nofollow" shape=3D"rect" ymailto=3D"mailto:mhke=
_aj5566(a)yahoo.com" target=3D"_blank" href=3D"mailto:mhke_aj5566@yahoo.com">=
mhke_aj5566(a)yahoo.com</a>></span> wrote:<br clear=3D"none"><blockquote c=
lass=3D"yiv0115319588gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex;"><div class=3D"yiv0115319588yqt7135196070" i=
d=3D"yiv0115319588yqt29383"><div><div style=3D"color:#000;background-color:=
#fff;font-family:Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-seri=
f;font-size:10px;"><div dir=3D"ltr" id=3D"yiv0115319588m_-46053014922747698=
28yui_3_16_0_ym19_1_1519085807369_10542"><font id=3D"yiv0115319588m_-460530=
1492274769828yui_3_16_0_ym19_1_1519085807369_15967" size=3D"3">My storage p=
ool has 2 Master Domain(</font><font id=3D"yiv0115319588m_-4605301492274769=
828yui_3_16_0_ym19_1_1519085807369_16063" size=3D"3"><font id=3D"yiv0115319=
588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_15968" size=3D"3">=
Stored2 on Node2,Node1Container on Node1)</font>. and my old master domain =
</font><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151=
9085807369_15934" size=3D"3"><font id=3D"yiv0115319588m_-460530149227476982=
8yui_3_16_0_ym19_1_1519085807369_16064" size=3D"3">(</font><font id=3D"yiv0=
115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_16065" size=
=3D"3"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151=
9085807369_16066" size=3D"3">DATANd01 on Node1 )</font></font> hung on prep=
aring for maintenance. When I tried to activate my old master domain (</fon=
t><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_15190858=
07369_10517" size=3D"3"><font id=3D"yiv0115319588m_-4605301492274769828yui_=
3_16_0_ym19_1_1519085807369_15935" size=3D"3">DATANd01 on Node1 )</font> al=
l storage domain goes down and up master keep on rotating.</font></di=
v><div id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908580=
7369_10905"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_=
1_1519085807369_10517" size=3D"3"><br clear=3D"none"></font></div><div id=
=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_1069=
2"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085=
807369_10517" size=3D"3"><br clear=3D"none"></font></div><div dir=3D"ltr" i=
d=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_107=
10"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908=
5807369_10517" size=3D"3">Ovirt Version (oVirt Engine Version: 4.1.9.1.el7.=
centos)<br clear=3D"none"></font></div><div dir=3D"ltr" id=3D"yiv0115319588=
m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_14202"><font id=3D"yi=
v0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10517" siz=
e=3D"3"><br clear=3D"none"></font></div><div dir=3D"ltr" id=3D"yiv011531958=
8m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_12604"><font id=3D"y=
iv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10517" si=
ze=3D"3"><br clear=3D"none"></font></div><div dir=3D"ltr" id=3D"yiv01153195=
88m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_14203"><font id=3D"=
yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10517" s=
ize=3D"3">Event Error:</font></div><div dir=3D"ltr" id=3D"yiv0115319588m_-4=
605301492274769828yui_3_16_0_ym19_1_1519085807369_14215"><font id=3D"yiv011=
5319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10517" size=3D=
"3">Sync Error on Master Domain between Host Node2 and oVirt Engine. Domain=
Stored2 is marked as master in ovirt engine Database but not on storage si=
de Please consult with support<br id=3D"yiv0115319588m_-4605301492274769828=
yui_3_16_0_ym19_1_1519085807369_12607" clear=3D"none"></font></div><div dir=
=3D"ltr" id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085=
807369_14204"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym1=
9_1_1519085807369_10517" size=3D"3"><br clear=3D"none"></font></div><div di=
r=3D"ltr" id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908=
5807369_15891"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym=
19_1_1519085807369_10517" size=3D"3">VDSM Node2 command ConnectStoragePoolV=
DS failed: Wrong Master domain or it's version: u'SD=3Df3e372e3-1251-4195-a=
4b9- 1027e40059df, pool=3D5a865884-0366-0330-02b8- 0000</font></div><div di=
r=3D"ltr" id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908=
5807369_15895"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym=
19_1_1519085807369_10517" size=3D"3"><br clear=3D"none"></font></div><div d=
ir=3D"ltr" id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_15190=
85807369_15896"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_y=
m19_1_1519085807369_10517" size=3D"3">VDSM Node2 command HSMGetAllTastsStat=
usesVDS failed: Not SPM: ()<br id=3D"yiv0115319588m_-4605301492274769828yui=
_3_16_0_ym19_1_1519085807369_15901" clear=3D"none"><br id=3D"yiv0115319588m=
_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_15902" clear=3D"none">=
Failed to deactivate Storage Domain DATANd01 (Data Center UnsecuredEnv)<br =
clear=3D"none"></font></div><div id=3D"yiv0115319588m_-4605301492274769828y=
ui_3_16_0_ym19_1_1519085807369_10545"><font id=3D"yiv0115319588m_-460530149=
2274769828yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><br clear=3D"no=
ne"></font></div><div id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_y=
m19_1_1519085807369_10551"><font id=3D"yiv0115319588m_-4605301492274769828y=
ui_3_16_0_ym19_1_1519085807369_10517" size=3D"3">Here's logs from engine:</=
font></div><div id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_=
1519085807369_10620"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_1=
6_0_ym19_1_1519085807369_10517" size=3D"3"><br clear=3D"none"></font></div>=
<div id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_15190858073=
69_10573"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_=
1519085807369_10517" size=3D"3">------------------------------ ------------=
------------------ ------------------------------ -------------</font></div=
><div dir=3D"ltr" id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_=
1_1519085807369_10588"><font id=3D"yiv0115319588m_-4605301492274769828yui_3=
_16_0_ym19_1_1519085807369_10517" size=3D"3">[root@dev2engine ~]# tail /var=
/log/messages<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1=
_1519085807369_10609" clear=3D"none">Feb 20 07:01:01 dev2engine systemd: St=
arting Session 20 of user root.<br id=3D"yiv0115319588m_-460530149227476982=
8yui_3_16_0_ym19_1_1519085807369_10610" clear=3D"none">Feb 20 07:01:01 dev2=
engine systemd: Removed slice User Slice of root.<br id=3D"yiv0115319588m_-=
4605301492274769828yui_3_16_0_ym19_1_1519085807369_10611" clear=3D"none">Fe=
b 20 07:01:01 dev2engine systemd: Stopping User Slice of root.<br id=3D"yiv=
0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10612" clea=
r=3D"none">Feb 20 07:58:52 dev2engine systemd: Created slice User Slice of =
root.<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085=
807369_10613" clear=3D"none">Feb 20 07:58:52 dev2engine systemd: Starting U=
ser Slice of root.<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_y=
m19_1_1519085807369_10614" clear=3D"none">Feb 20 07:58:52 dev2engine system=
d-logind: New session 21 of user root.<br id=3D"yiv0115319588m_-46053014922=
74769828yui_3_16_0_ym19_1_1519085807369_10615" clear=3D"none">Feb 20 07:58:=
52 dev2engine systemd: Started Session 21 of user root.<br id=3D"yiv0115319=
588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10616" clear=3D"no=
ne">Feb 20 07:58:52 dev2engine systemd: Starting Session 21 of user root.<b=
r id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_=
10617" clear=3D"none">Feb 20 08:01:01 dev2engine systemd: Started Session 2=
2 of user root.<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19=
_1_1519085807369_10618" clear=3D"none">Feb 20 08:01:01 dev2engine systemd: =
Starting Session 22 of user root.</font></div><div dir=3D"ltr" id=3D"yiv011=
5319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10619"><font i=
d=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_105=
17" size=3D"3"><br clear=3D"none"></font></div><div dir=3D"ltr" id=3D"yiv01=
15319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10623"><br cl=
ear=3D"none"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19=
_1_1519085807369_10517" size=3D"3"><font id=3D"yiv0115319588m_-460530149227=
4769828yui_3_16_0_ym19_1_1519085807369_10626" size=3D"3">------------------=
------------ ------------------------------ ------------------------------ =
-------------</font></font></div><div dir=3D"ltr" id=3D"yiv0115319588m_-460=
5301492274769828yui_3_16_0_ym19_1_1519085807369_10654"><font id=3D"yiv01153=
19588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3=
"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_15190858=
07369_10626" size=3D"3">[root@dev2engine ~]# tail /var/log/ovirt-engine/eng=
ine. log<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519=
085807369_10677" clear=3D"none">2018-02-20 08:01:16,062+08 INFO [org.=
ovirt.engine.core.bll. eventqueue.EventQueueMonitor] (org.ovirt.thread.pool=
-7- thread-32) [102e9d3c] Finished reconstruct for pool '5a865884-0366-0330=
-02b8- 0000000002d4'. Clearing event queue<br id=3D"yiv0115319588m_-4605301=
492274769828yui_3_16_0_ym19_1_1519085807369_10678" clear=3D"none">2018-02-2=
0 08:01:27,825+08 WARN [org.ovirt.engine.core. vdsbroker.irsbroker.Ir=
sProxy] (org.ovirt.thread.pool-7- thread-23) [] Master domain is not in syn=
c between DB and VDSM. Domain Stored2 marked as master in DB and not in the=
storage<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519=
085807369_10679" clear=3D"none">2018-02-20 08:01:27,862+08 WARN [org.=
ovirt.engine.core.bll. storage.pool. ReconstructMasterDomainCommand ] (org.=
ovirt.thread.pool-7- thread-23) [213f42b9] Validation of action 'Reconstruc=
tMasterDomain' failed for user SYSTEM. Reasons: VAR__ACTION__RECONSTRUCT_ M=
ASTER,VAR__TYPE__STORAGE__ DOMAIN,ACTION_TYPE_FAILED_ STORAGE_DOMAIN_STATUS=
_ ILLEGAL2,$status PreparingForMaintenance<br id=3D"yiv0115319588m_-4605301=
492274769828yui_3_16_0_ym19_1_1519085807369_10680" clear=3D"none">2018-02-2=
0 08:01:27,882+08 INFO [org.ovirt.engine.core.bll. eventqueue.EventQu=
eueMonitor] (org.ovirt.thread.pool-7- thread-20) [929330e] Finished reconst=
ruct for pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing event queue=
<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908580736=
9_10681" clear=3D"none">2018-02-20 08:01:40,106+08 WARN [org.ovirt.en=
gine.core. vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-7- thread-1=
7) [] Master domain is not in sync between DB and VDSM. Domain Stored2 mark=
ed as master in DB and not in the storage<br id=3D"yiv0115319588m_-46053014=
92274769828yui_3_16_0_ym19_1_1519085807369_10682" clear=3D"none">2018-02-20=
08:01:40,197+08 WARN [org.ovirt.engine.core.bll. storage.pool. Recon=
structMasterDomainCommand ] (org.ovirt.thread.pool-7- thread-17) [7af552c1]=
Validation of action 'ReconstructMasterDomain' failed for user SYSTEM. Rea=
sons: VAR__ACTION__RECONSTRUCT_ MASTER,VAR__TYPE__STORAGE__ DOMAIN,ACTION_T=
YPE_FAILED_ STORAGE_DOMAIN_STATUS_ ILLEGAL2,$status PreparingForMaintenance=
<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908580736=
9_10683" clear=3D"none">2018-02-20 08:01:40,246+08 INFO [org.ovirt.en=
gine.core.bll. eventqueue.EventQueueMonitor] (org.ovirt.thread.pool-7- thre=
ad-22) [73673040] Finished reconstruct for pool '5a865884-0366-0330-02b8- 0=
000000002d4'. Clearing event queue<br id=3D"yiv0115319588m_-460530149227476=
9828yui_3_16_0_ym19_1_1519085807369_10684" clear=3D"none">2018-02-20 08:01:=
51,809+08 WARN [org.ovirt.engine.core. vdsbroker.irsbroker.IrsProxy] =
(org.ovirt.thread.pool-7- thread-26) [] Master domain is not in sync betwee=
n DB and VDSM. Domain Stored2 marked as master in DB and not in the storage=
<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908580736=
9_10685" clear=3D"none">2018-02-20 08:01:51,846+08 WARN [org.ovirt.en=
gine.core.bll. storage.pool. ReconstructMasterDomainCommand ] (org.ovirt.th=
read.pool-7- thread-26) [20307cbe] Validation of action 'ReconstructMasterD=
omain' failed for user SYSTEM. Reasons: VAR__ACTION__RECONSTRUCT_ MASTER,VA=
R__TYPE__STORAGE__ DOMAIN,ACTION_TYPE_FAILED_ STORAGE_DOMAIN_STATUS_ ILLEGA=
L2,$status PreparingForMaintenance<br id=3D"yiv0115319588m_-460530149227476=
9828yui_3_16_0_ym19_1_1519085807369_10686" clear=3D"none">2018-02-20 08:01:=
51,866+08 INFO [org.ovirt.engine.core.bll. eventqueue.EventQueueMonit=
or] (org.ovirt.thread.pool-7- thread-49) [2c11a866] Finished reconstruct fo=
r pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing event queue<br id=
=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_1068=
7" clear=3D"none"><br clear=3D"none"></font></font></div></div></div></div>=
<br clear=3D"none">______________________________ _________________<br clea=
r=3D"none">
Users mailing list<br clear=3D"none">
<a rel=3D"nofollow" shape=3D"rect" ymailto=3D"mailto:Users@ovirt.org" targe=
t=3D"_blank" href=3D"mailto:Users@ovirt.org">Users(a)ovirt.org</a><br clear=
=3D"none">
<a rel=3D"nofollow" shape=3D"rect" target=3D"_blank" href=3D"http://lists.o=
virt.org/mailman/listinfo/users">http://lists.ovirt.org/ mailman/listinfo/u=
sers</a><br clear=3D"none">
<br clear=3D"none"></blockquote></div><br clear=3D"none"><br clear=3D"all">=
<div><br clear=3D"none"></div>-- <br clear=3D"none"><div class=3D"yiv011531=
9588gmail_signature"><div dir=3D"ltr">Regards,<div>Eyal Shenitzky</div></di=
v></div>
</div></div></div><br clear=3D"none"><br clear=3D"none"></div> </div></div=
><div class=3D"yiv0115319588yqt2980525560" id=3D"yiv0115319588yqtfd94549"> =
</div></div><div class=3D"yiv0115319588yqt2980525560" id=3D"yiv0115319588yq=
tfd67072"> </div></div></div></div></div><br><br></div> </div> </div> </=
div></div></body></html>
------=_Part_2010355_281080504.1519108987392--
2
7
------=_Part_1848497_1716892283.1519088345205
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
My storage pool has 2 Master Domain(Stored2 on Node2,Node1Container on Node=
1). and my old master domain (DATANd01 on Node1 ) hung on preparing for mai=
ntenance. When I tried to activate my old master domain (DATANd01 on Node1 =
) all=C2=A0 storage domain goes down and up master keep on rotating.
Ovirt Version (oVirt Engine Version: 4.1.9.1.el7.centos)
Event Error:Sync Error on Master Domain between Host Node2 and oVirt Engine=
. Domain Stored2 is marked as master in ovirt engine Database but not on st=
orage side Please consult with support
VDSM Node2 command ConnectStoragePoolVDS failed: Wrong Master domain or it'=
s version: u'SD=3Df3e372e3-1251-4195-a4b9-1027e40059df, pool=3D5a865884-036=
6-0330-02b8-0000
VDSM Node2 command HSMGetAllTastsStatusesVDS failed: Not SPM: ()
Failed to deactivate Storage Domain DATANd01 (Data Center UnsecuredEnv)
Here's logs from engine:
---------------------------------------------------------------------------=
----------------------------[root@dev2engine ~]# tail /var/log/messages
Feb 20 07:01:01 dev2engine systemd: Starting Session 20 of user root.
Feb 20 07:01:01 dev2engine systemd: Removed slice User Slice of root.
Feb 20 07:01:01 dev2engine systemd: Stopping User Slice of root.
Feb 20 07:58:52 dev2engine systemd: Created slice User Slice of root.
Feb 20 07:58:52 dev2engine systemd: Starting User Slice of root.
Feb 20 07:58:52 dev2engine systemd-logind: New session 21 of user root.
Feb 20 07:58:52 dev2engine systemd: Started Session 21 of user root.
Feb 20 07:58:52 dev2engine systemd: Starting Session 21 of user root.
Feb 20 08:01:01 dev2engine systemd: Started Session 22 of user root.
Feb 20 08:01:01 dev2engine systemd: Starting Session 22 of user root.
---------------------------------------------------------------------------=
----------------------------[root@dev2engine ~]# tail /var/log/ovirt-engine=
/engine.log
2018-02-20 08:01:16,062+08 INFO=C2=A0 [org.ovirt.engine.core.bll.eventqueue=
.EventQueueMonitor] (org.ovirt.thread.pool-7-thread-32) [102e9d3c] Finished=
reconstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clearing even=
t queue
2018-02-20 08:01:27,825+08 WARN=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb=
roker.IrsProxy] (org.ovirt.thread.pool-7-thread-23) [] Master domain is not=
in sync between DB and VDSM. Domain Stored2 marked as master in DB and not=
in the storage
2018-02-20 08:01:27,862+08 WARN=C2=A0 [org.ovirt.engine.core.bll.storage.po=
ol.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-thread-23) [213=
f42b9] Validation of action 'ReconstructMasterDomain' failed for user SYSTE=
M. Reasons: VAR__ACTION__RECONSTRUCT_MASTER,VAR__TYPE__STORAGE__DOMAIN,ACTI=
ON_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL2,$status PreparingForMaintenan=
ce
2018-02-20 08:01:27,882+08 INFO=C2=A0 [org.ovirt.engine.core.bll.eventqueue=
.EventQueueMonitor] (org.ovirt.thread.pool-7-thread-20) [929330e] Finished =
reconstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clearing event=
queue
2018-02-20 08:01:40,106+08 WARN=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb=
roker.IrsProxy] (org.ovirt.thread.pool-7-thread-17) [] Master domain is not=
in sync between DB and VDSM. Domain Stored2 marked as master in DB and not=
in the storage
2018-02-20 08:01:40,197+08 WARN=C2=A0 [org.ovirt.engine.core.bll.storage.po=
ol.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-thread-17) [7af=
552c1] Validation of action 'ReconstructMasterDomain' failed for user SYSTE=
M. Reasons: VAR__ACTION__RECONSTRUCT_MASTER,VAR__TYPE__STORAGE__DOMAIN,ACTI=
ON_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL2,$status PreparingForMaintenan=
ce
2018-02-20 08:01:40,246+08 INFO=C2=A0 [org.ovirt.engine.core.bll.eventqueue=
.EventQueueMonitor] (org.ovirt.thread.pool-7-thread-22) [73673040] Finished=
reconstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clearing even=
t queue
2018-02-20 08:01:51,809+08 WARN=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb=
roker.IrsProxy] (org.ovirt.thread.pool-7-thread-26) [] Master domain is not=
in sync between DB and VDSM. Domain Stored2 marked as master in DB and not=
in the storage
2018-02-20 08:01:51,846+08 WARN=C2=A0 [org.ovirt.engine.core.bll.storage.po=
ol.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-thread-26) [203=
07cbe] Validation of action 'ReconstructMasterDomain' failed for user SYSTE=
M. Reasons: VAR__ACTION__RECONSTRUCT_MASTER,VAR__TYPE__STORAGE__DOMAIN,ACTI=
ON_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL2,$status PreparingForMaintenan=
ce
2018-02-20 08:01:51,866+08 INFO=C2=A0 [org.ovirt.engine.core.bll.eventqueue=
.EventQueueMonitor] (org.ovirt.thread.pool-7-thread-49) [2c11a866] Finished=
reconstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clearing even=
t queue
------=_Part_1848497_1716892283.1519088345205
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<html><head></head><body><div style=3D"color:#000; background-color:#fff; f=
ont-family:Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font=
-size:10px"><div id=3D"yui_3_16_0_ym19_1_1519085807369_10542" dir=3D"ltr"><=
font id=3D"yui_3_16_0_ym19_1_1519085807369_15967" size=3D"3">My storage poo=
l has 2 Master Domain(</font><font id=3D"yui_3_16_0_ym19_1_1519085807369_16=
063" size=3D"3"><font id=3D"yui_3_16_0_ym19_1_1519085807369_15968" size=3D"=
3">Stored2 on Node2,Node1Container on Node1)</font>. and my old master doma=
in </font><font id=3D"yui_3_16_0_ym19_1_1519085807369_15934" size=3D"3"><fo=
nt id=3D"yui_3_16_0_ym19_1_1519085807369_16064" size=3D"3">(</font><font id=
=3D"yui_3_16_0_ym19_1_1519085807369_16065" size=3D"3"><font id=3D"yui_3_16_=
0_ym19_1_1519085807369_16066" size=3D"3">DATANd01 on Node1 )</font></font> =
hung on preparing for maintenance. When I tried to activate my old master d=
omain (</font><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"=
><font id=3D"yui_3_16_0_ym19_1_1519085807369_15935" size=3D"3">DATANd01 on =
Node1 )</font> all storage domain goes down and up master keep on rot=
ating.</font></div><div id=3D"yui_3_16_0_ym19_1_1519085807369_10905"><font =
id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><br></font></div><d=
iv id=3D"yui_3_16_0_ym19_1_1519085807369_10692"><font id=3D"yui_3_16_0_ym19=
_1_1519085807369_10517" size=3D"3"><br></font></div><div id=3D"yui_3_16_0_y=
m19_1_1519085807369_10710" dir=3D"ltr"><font id=3D"yui_3_16_0_ym19_1_151908=
5807369_10517" size=3D"3">Ovirt Version (oVirt Engine Version: 4.1.9.1.el7.=
centos)<br></font></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807=
369_14202"><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><b=
r></font></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_12604=
"><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><br></font>=
</div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_14203"><font i=
d=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3">Event Error:</font><=
/div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_14215"><font id=
=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3">Sync Error on Master =
Domain between Host Node2 and oVirt Engine. Domain Stored2 is marked as mas=
ter in ovirt engine Database but not on storage side Please consult with su=
pport<br id=3D"yui_3_16_0_ym19_1_1519085807369_12607"></font></div><div dir=
=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_14204"><font id=3D"yui_3_16_=
0_ym19_1_1519085807369_10517" size=3D"3"><br></font></div><div dir=3D"ltr" =
id=3D"yui_3_16_0_ym19_1_1519085807369_15891"><font id=3D"yui_3_16_0_ym19_1_=
1519085807369_10517" size=3D"3">VDSM Node2 command ConnectStoragePoolVDS fa=
iled: Wrong Master domain or it's version: u'SD=3Df3e372e3-1251-4195-a4b9-1=
027e40059df, pool=3D5a865884-0366-0330-02b8-0000</font></div><div dir=3D"lt=
r" id=3D"yui_3_16_0_ym19_1_1519085807369_15895"><font id=3D"yui_3_16_0_ym19=
_1_1519085807369_10517" size=3D"3"><br></font></div><div dir=3D"ltr" id=3D"=
yui_3_16_0_ym19_1_1519085807369_15896"><font id=3D"yui_3_16_0_ym19_1_151908=
5807369_10517" size=3D"3">VDSM Node2 command HSMGetAllTastsStatusesVDS fail=
ed: Not SPM: ()<br id=3D"yui_3_16_0_ym19_1_1519085807369_15901"><br id=3D"y=
ui_3_16_0_ym19_1_1519085807369_15902">Failed to deactivate Storage Domain D=
ATANd01 (Data Center UnsecuredEnv)<br></font></div><div id=3D"yui_3_16_0_ym=
19_1_1519085807369_10545"><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517=
" size=3D"3"><br></font></div><div id=3D"yui_3_16_0_ym19_1_1519085807369_10=
551"><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3">Here's l=
ogs from engine:</font></div><div id=3D"yui_3_16_0_ym19_1_1519085807369_106=
20"><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><br></fon=
t></div><div id=3D"yui_3_16_0_ym19_1_1519085807369_10573"><font id=3D"yui_3=
_16_0_ym19_1_1519085807369_10517" size=3D"3">------------------------------=
-------------------------------------------------------------------------</=
font></div><div id=3D"yui_3_16_0_ym19_1_1519085807369_10588" dir=3D"ltr"><f=
ont id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3">[root@dev2engin=
e ~]# tail /var/log/messages<br id=3D"yui_3_16_0_ym19_1_1519085807369_10609=
">Feb 20 07:01:01 dev2engine systemd: Starting Session 20 of user root.<br =
id=3D"yui_3_16_0_ym19_1_1519085807369_10610">Feb 20 07:01:01 dev2engine sys=
temd: Removed slice User Slice of root.<br id=3D"yui_3_16_0_ym19_1_15190858=
07369_10611">Feb 20 07:01:01 dev2engine systemd: Stopping User Slice of roo=
t.<br id=3D"yui_3_16_0_ym19_1_1519085807369_10612">Feb 20 07:58:52 dev2engi=
ne systemd: Created slice User Slice of root.<br id=3D"yui_3_16_0_ym19_1_15=
19085807369_10613">Feb 20 07:58:52 dev2engine systemd: Starting User Slice =
of root.<br id=3D"yui_3_16_0_ym19_1_1519085807369_10614">Feb 20 07:58:52 de=
v2engine systemd-logind: New session 21 of user root.<br id=3D"yui_3_16_0_y=
m19_1_1519085807369_10615">Feb 20 07:58:52 dev2engine systemd: Started Sess=
ion 21 of user root.<br id=3D"yui_3_16_0_ym19_1_1519085807369_10616">Feb 20=
07:58:52 dev2engine systemd: Starting Session 21 of user root.<br id=3D"yu=
i_3_16_0_ym19_1_1519085807369_10617">Feb 20 08:01:01 dev2engine systemd: St=
arted Session 22 of user root.<br id=3D"yui_3_16_0_ym19_1_1519085807369_106=
18">Feb 20 08:01:01 dev2engine systemd: Starting Session 22 of user root.</=
font></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_10619"><f=
ont id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><br></font></di=
v><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_10623"><br><font i=
d=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><font id=3D"yui_3_16=
_0_ym19_1_1519085807369_10626" size=3D"3">---------------------------------=
----------------------------------------------------------------------</fon=
t></font></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_10654=
"><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><font id=3D=
"yui_3_16_0_ym19_1_1519085807369_10626" size=3D"3">[root@dev2engine ~]# tai=
l /var/log/ovirt-engine/engine.log<br id=3D"yui_3_16_0_ym19_1_1519085807369=
_10677">2018-02-20 08:01:16,062+08 INFO [org.ovirt.engine.core.bll.ev=
entqueue.EventQueueMonitor] (org.ovirt.thread.pool-7-thread-32) [102e9d3c] =
Finished reconstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clear=
ing event queue<br id=3D"yui_3_16_0_ym19_1_1519085807369_10678">2018-02-20 =
08:01:27,825+08 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsPr=
oxy] (org.ovirt.thread.pool-7-thread-23) [] Master domain is not in sync be=
tween DB and VDSM. Domain Stored2 marked as master in DB and not in the sto=
rage<br id=3D"yui_3_16_0_ym19_1_1519085807369_10679">2018-02-20 08:01:27,86=
2+08 WARN [org.ovirt.engine.core.bll.storage.pool.ReconstructMasterDo=
mainCommand] (org.ovirt.thread.pool-7-thread-23) [213f42b9] Validation of a=
ction 'ReconstructMasterDomain' failed for user SYSTEM. Reasons: VAR__ACTIO=
N__RECONSTRUCT_MASTER,VAR__TYPE__STORAGE__DOMAIN,ACTION_TYPE_FAILED_STORAGE=
_DOMAIN_STATUS_ILLEGAL2,$status PreparingForMaintenance<br id=3D"yui_3_16_0=
_ym19_1_1519085807369_10680">2018-02-20 08:01:27,882+08 INFO [org.ovi=
rt.engine.core.bll.eventqueue.EventQueueMonitor] (org.ovirt.thread.pool-7-t=
hread-20) [929330e] Finished reconstruct for pool '5a865884-0366-0330-02b8-=
0000000002d4'. Clearing event queue<br id=3D"yui_3_16_0_ym19_1_151908580736=
9_10681">2018-02-20 08:01:40,106+08 WARN [org.ovirt.engine.core.vdsbr=
oker.irsbroker.IrsProxy] (org.ovirt.thread.pool-7-thread-17) [] Master doma=
in is not in sync between DB and VDSM. Domain Stored2 marked as master in D=
B and not in the storage<br id=3D"yui_3_16_0_ym19_1_1519085807369_10682">20=
18-02-20 08:01:40,197+08 WARN [org.ovirt.engine.core.bll.storage.pool=
.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-thread-17) [7af55=
2c1] Validation of action 'ReconstructMasterDomain' failed for user SYSTEM.=
Reasons: VAR__ACTION__RECONSTRUCT_MASTER,VAR__TYPE__STORAGE__DOMAIN,ACTION=
_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL2,$status PreparingForMaintenance=
<br id=3D"yui_3_16_0_ym19_1_1519085807369_10683">2018-02-20 08:01:40,246+08=
INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (org.o=
virt.thread.pool-7-thread-22) [73673040] Finished reconstruct for pool '5a8=
65884-0366-0330-02b8-0000000002d4'. Clearing event queue<br id=3D"yui_3_16_=
0_ym19_1_1519085807369_10684">2018-02-20 08:01:51,809+08 WARN [org.ov=
irt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-7-thre=
ad-26) [] Master domain is not in sync between DB and VDSM. Domain Stored2 =
marked as master in DB and not in the storage<br id=3D"yui_3_16_0_ym19_1_15=
19085807369_10685">2018-02-20 08:01:51,846+08 WARN [org.ovirt.engine.=
core.bll.storage.pool.ReconstructMasterDomainCommand] (org.ovirt.thread.poo=
l-7-thread-26) [20307cbe] Validation of action 'ReconstructMasterDomain' fa=
iled for user SYSTEM. Reasons: VAR__ACTION__RECONSTRUCT_MASTER,VAR__TYPE__S=
TORAGE__DOMAIN,ACTION_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL2,$status Pr=
eparingForMaintenance<br id=3D"yui_3_16_0_ym19_1_1519085807369_10686">2018-=
02-20 08:01:51,866+08 INFO [org.ovirt.engine.core.bll.eventqueue.Even=
tQueueMonitor] (org.ovirt.thread.pool-7-thread-49) [2c11a866] Finished reco=
nstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clearing event que=
ue<br id=3D"yui_3_16_0_ym19_1_1519085807369_10687"><br></font></font></div>=
</div></body></html>
------=_Part_1848497_1716892283.1519088345205--
2
1
Hi, i try to install ovirt-guest-agent on a Clearlinux vm (already up and running in our ovirt test cluster).
The usual fedora / el7 rpm's do not work.
Is it possible to install ovirt-guest-agent from a tarball? Or do i have to rebuild a src rpm?
And where do i find the latest tarball and src rpm of this package / these packages?
Any help appreciated, thx in advance
Oli
___________________________________________________________
Oliver Dietzel
RTO GmbH
Hanauer Landstraße 439
60314 Frankfurt
1
0
--_000_151873643674288456smithsdetectioncom_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
?Hello,
How do you move a VM to another cluster within the same data center? I hav=
e a cluster running ovirt 3.5 nodes. I created another cluster with hosts =
running CentOS 7 (ovirt 3.6 version) and want to move VMs to this cluster.=
The compatibility mode for everything is 3.5.
I tried shutting down a VM, but I cannot select the other cluster. Also li=
ve migration fails as well to the new cluster.
Thanks,
Chris
______________________________________________________________________
This email has been scanned by the Boundary Defense for Email Security Sys=
tem. For more information please visit http://www.apptix.com/email-securit=
y/antispam-virus
______________________________________________________________________
--_000_151873643674288456smithsdetectioncom_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Diso-8859=
-1">
<style type=3D"text/css" style=3D"display:none"><!-- p { margin-top: 0px; =
margin-bottom: 0px; }--></style>
</head>
<body dir=3D"ltr" style=3D"font-size:12pt;color:#000000;background-color:#=
FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<p>​Hello,<br>
</p>
<p><br>
</p>
<p>How do you move a VM to another cluster within the same data center? I =
have a cluster running ovirt 3.5 nodes. I created another cluster with hos=
ts running CentOS 7 (ovirt 3.6 version) and want to move VMs to this clust=
er. The compatibility mode for everything
is 3.5.</p>
<p><br>
</p>
<p>I tried shutting down a VM, but I cannot select the other cluster. Also=
live migration fails as well to the new cluster.<br>
</p>
<p><br>
</p>
<p>Thanks,<br>
</p>
<p>Chris<br>
</p>
<br clear=3D"both">
______________________________________________________________________<BR>=
This email has been scanned by the Boundary Defense for Email Security Sys=
tem. For more information please visit http://www.apptix.com/email-securit=
y/antispam-virus<BR>
______________________________________________________________________<BR>=
</body>
</html>
--_000_151873643674288456smithsdetectioncom_--
2
2
Thanks a lot, Simone!
This is clearly shows a problem:
[root@ov-eng ovirt-engine]# sudo -u postgres psql -d engine -c 'select
vds_name, vds_spm_id from vds'
vds_name | vds_spm_id
-----------------+------------
ovirt1.local | 2
ovirt2.local | 1
(2 rows)
While hosted-engine.conf on ovirt1.local have host_id=1, and ovirt2.local
host_id=2. So totally opposite values.
So how to get this fixed in the simple way? Update the engine DB?
Regards,
Artem
On Mon, Feb 19, 2018 at 5:37 PM, Simone Tiraboschi <stirabos(a)redhat.com>
wrote:
>
>
> On Mon, Feb 19, 2018 at 12:13 PM, Artem Tambovskiy <
> artem.tambovskiy(a)gmail.com> wrote:
>
>> Hello,
>>
>> Last weekend my cluster suffered form a massive power outage due to human
>> mistake.
>> I'm using SHE setup with Gluster, I managed to bring the cluster up
>> quickly, but once again I have a problem with duplicated host_id (
>> https://bugzilla.redhat.com/show_bug.cgi?id=1543988) on second host and
>> due to this second host is not capable to run HE.
>>
>> I manually updated file hosted_engine.conf with correct host_id and
>> restarted agent & broker - no effect. Than I rebooted the host itself -
>> still no changes. How to fix this issue?
>>
>
> I'd suggest to run this command on the engine VM:
> sudo -u postgres scl enable rh-postgresql95 -- psql -d engine -c 'select
> vds_name, vds_spm_id from vds'
> (just sudo -u postgres psql -d engine -c 'select vds_name, vds_spm_id
> from vds' if still on 4.1) and check /etc/ovirt-hosted-engine/hosted-engine.conf
> on all the involved host.
> Maybe you can also have a leftover configuration file on undeployed host.
>
> When you find a conflict you should manually bring down sanlock
> In doubt a reboot of both the hosts will solve for sure.
>
>
>
>>
>> Regards,
>> Artem
>>
>> _______________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>>
>
3
3
How to specify a logical network for ovirt live migration traffic
by simone.sannaï¼ trssistemi.com 19 Feb '18
by simone.sannaï¼ trssistemi.com 19 Feb '18
19 Feb '18
Hello to everyone,
I have founded the article "How to specify a logical network for RHEV
live migration traffic" at https://access.redhat.com/solutions/70412 but
i can't read it because i not have an "active Red Hat subscription".
It is there an article as "How to specify a logical network for ovirt
live migration traffic" or similar?
It is possible to do that (for example to specify a nic ethX for live
migration traffic between two host)?
Many thanks for your replies,
Simone
2
1
Hello,
Last weekend my cluster suffered form a massive power outage due to human
mistake.
I'm using SHE setup with Gluster, I managed to bring the cluster up
quickly, but once again I have a problem with duplicated host_id (
https://bugzilla.redhat.com/show_bug.cgi?id=1543988) on second host and due
to this second host is not capable to run HE.
I manually updated file hosted_engine.conf with correct host_id and
restarted agent & broker - no effect. Than I rebooted the host itself -
still no changes. How to fix this issue?
Regards,
Artem
3
2
--_004_9D6F18D2AC0D5245BE068C2BEBC06946284F62msli01202res01ads_
Content-Type: multipart/alternative;
boundary="_000_9D6F18D2AC0D5245BE068C2BEBC06946284F62msli01202res01ads_"
--_000_9D6F18D2AC0D5245BE068C2BEBC06946284F62msli01202res01ads_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Hi!
When configuring Powermanagement respectively Fence Agent I get following e=
rror:
Any idea on this?
2018-02-19 15:01:26,625+01 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker=
.FenceVdsVDSCommand] (default task-14) [7ab055b8-7afa-4495-a287-b3b66fd6a81=
e] START, FenceVdsVDSCommand(HostName =3D VIGT01-101.res01.ads.ooe.local, F=
enceVdsVDSCommandParameters:{hostId=3D'1210495a-0680-4f5a-bcd0-345b9debf48c=
', targetVdsId=3D'169e902e-9993-42c2-ad06-0925d3f217d6', action=3D'STATUS',=
agent=3D'FenceAgent:{id=3D'null', hostId=3D'null', order=3D'1', type=3D'ip=
milan', ip=3D'10.1.46.115', port=3D'623', user=3D's.oVirt', password=3D'***=
', encryptOptions=3D'false', options=3D''}', policy=3D'null'}), log id: 727=
4de5a
2018-02-19 15:01:26,732+01 WARN [org.ovirt.engine.core.dal.dbbroker.auditl=
oghandling.AuditLogDirector] (default task-14) [7ab055b8-7afa-4495-a287-b3b=
66fd6a81e] EVENT_ID: VDS_ALERT_FENCE_TEST_FAILED(9,001), Power Management t=
est failed for Host VIRZ01-101.res01.ads.ooe.local.Internal JSON-RPC error
[cid:image001.png@01D3A993.2380B300]
--_000_9D6F18D2AC0D5245BE068C2BEBC06946284F62msli01202res01ads_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.E-MailFormatvorlage17
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.E-MailFormatvorlage18
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.E-MailFormatvorlage19
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang=3D"DE-AT" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal"><span style=3D"color:black">Hi!<o:p></o:p></span></p=
>
<p class=3D"MsoNormal"><span style=3D"color:black"><o:p> </o:p></span>=
</p>
<p class=3D"MsoNormal"><span style=3D"color:black">When configuring Powerma=
nagement respectively Fence Agent I get following error:<o:p></o:p></span><=
/p>
<p class=3D"MsoNormal"><span lang=3D"DE" style=3D"color:black">Any idea on =
this?<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"DE" style=3D"color:#1F497D"><o:p> =
;</o:p></span></p>
<p class=3D"MsoNormal" style=3D"margin-left:35.4pt"><span lang=3D"DE">2018-=
02-19 15:01:26,625+01 INFO [org.ovirt.engine.core.vdsbroker.vdsbr=
oker.FenceVdsVDSCommand] (default task-14) [7ab055b8-7afa-4495-a287-b3b66fd=
6a81e] START, FenceVdsVDSCommand(HostName =3D VIGT01-101.res01.ads.ooe.loca=
l,
FenceVdsVDSCommandParameters:{hostId=3D'1210495a-0680-4f5a-bcd0-345b9debf4=
8c', targetVdsId=3D'169e902e-9993-42c2-ad06-0925d3f217d6', action=3D'STATUS=
', agent=3D'FenceAgent:{id=3D'null', hostId=3D'null', order=3D'1', type=3D'=
ipmilan', ip=3D'10.1.46.115', port=3D'623', user=3D's.oVirt',
password=3D'***', encryptOptions=3D'false', options=3D''}', policy=3D'null=
'}), log id: 7274de5a<o:p></o:p></span></p>
<p class=3D"MsoNormal" style=3D"margin-left:35.4pt"><span lang=3D"DE">2018-=
02-19 15:01:26,732+01 WARN [org.ovirt.engine.core.dal.dbbroker.au=
ditloghandling.AuditLogDirector] (default task-14) [7ab055b8-7afa-4495-a287=
-b3b66fd6a81e] EVENT_ID: VDS_ALERT_FENCE_TEST_FAILED(9,001),
Power Management test failed for Host VIRZ01-101.res01.ads.ooe.local.Inter=
nal JSON-RPC error<o:p></o:p></span></p>
<p class=3D"MsoNormal" style=3D"margin-left:35.4pt"><span lang=3D"DE"><o:p>=
</o:p></span></p>
<p class=3D"MsoNormal" style=3D"margin-left:35.4pt"><span lang=3D"DE"><o:p>=
</o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"DE"><o:p> </o:p></span></p>
<p class=3D"MsoNormal" style=3D"margin-left:35.4pt"><span style=3D"mso-fare=
ast-language:DE-AT"><img width=3D"499" height=3D"498" id=3D"Grafik_x0020_1"=
src=3D"cid:image001.png@01D3A993.2380B300"></span><span lang=3D"DE"><o:p><=
/o:p></span></p>
</div>
</body>
</html>
--_000_9D6F18D2AC0D5245BE068C2BEBC06946284F62msli01202res01ads_--
--_004_9D6F18D2AC0D5245BE068C2BEBC06946284F62msli01202res01ads_
Content-Type: image/png; name="image001.png"
Content-Description: image001.png
Content-Disposition: inline; filename="image001.png"; size=16035;
creation-date="Mon, 19 Feb 2018 14:05:54 GMT";
modification-date="Mon, 19 Feb 2018 14:05:54 GMT"
Content-ID: <image001.png(a)01D3A993.2380B300>
Content-Transfer-Encoding: base64
iVBORw0KGgoAAAANSUhEUgAAAfMAAAHyCAIAAABwMbC5AAAAAXNSR0IArs4c6QAAAAlwSFlzAAAO
xAAADsQBlSsOGwAAPkhJREFUeF7tnQuYFOWZ7xdWDWLWDVFg0GxWxOCuyE1gJkYzXOSmEtk8JxKD
DCEqaJRoDrdsEtFdyUYDyPECWRE3Em5u4NlnQ0S5ZhYQdZgYueWychSz2RgHUMwuihwUOX94j9+p
dDc91dPVX3VV/+qBfqq/+r738vtq/vX1WzU9rbZu3frOO+/8Sdzb3r17P/WpT7U4ijlz5kyaNCn/
8DB9ZOTrX//6Jz/5STP129/+dvr06T/84Q9ffPHFNWvWfOtb37IWO3rhhRfmbNEh2enatevzzz+v
/bPOOkuutbN8+XK9jho1Sq+PPPJIxlEXvA59/OMff+qpp6xlxowZFo+GZzd++ctfVng66naCEV59
9dUaYh20bdiw4eWXX77lllucL+X14IMP2ts77rjjkksuyeklmI5lHeymgTKrmJ9++uk333zT7Hz3
u9996aWXguk7hsFpUkiLFy8OBuAGqtFFrn21X3DBBY6AO+RIuv5uEg2FxeOm0liZR/Gx6dCQq666
SpFYdi5CtX/60582p+qsV9u/9NJLDWOQQ11d3eDBg5VmY2Pj7t27hSLoIrunJWWUbLO5llMb67y4
8KxRHAxaMNqcSbmT0HoGaVu0wblgP00EWtXX19fU1KQpJXKBAAQgUOEEWld4/qQPAQhAIH0EUPb0
zSkZQQAClU4AZa/0M4D8IQCB9BFA2dM3p2QEAQhUOgGUvdLPAPKHAATSRwBlT9+ckhEEIFDpBFD2
Sj8DyB8CEEgfAZQ9fXNKRhCAQKUTQNkr/QwgfwhAIH0EUPb0zSkZQQAClU4AZa/0M4D8IQCB9BFA
2dM3p2QEAQhUOoHWbdu2rXQG5A8BCEAgXQRYs6drPskGAhBIIAH73uaMrZjvV0fZE3gWEDIEIJAi
Aq+99trMmTPt7ze4TY333HPPz3/+85YlWlplf/TRRwcOHKhXBbdkyRLt/+u//muzgarPiBEj1Pm6
66574403mu1PBwhAAAJJJ/DMM884cZesP/TQQ4cOHWpxUkUpu/5ajfTXbabgJ9s6dOjQsWPHM844
wzpIvnOqvKRcKeljyMiRIwcNGnT22We3OLfyGag/OSQ4ei2fkIgEAhAoEwLnnnvu7bffrlueJu5O
1seNG9enT5+WBVmUspvLK6644ksntm7duuUJYujQof/8z/+sV+vzT//0Txs3bszub388rEePHvqr
dRMmTGhZVuU2qqGh4YknntBfBCy3wIgHAhAoBwJBcb/vvvu0Wi9G1pVRK4lO9+7dW5ab1uw7d+78
zne+c9lllzkLO3bs+MEPfqB2rdD1NyRXrlwp0ZdGa9EqddO+VuIPP/ywOtgQibj7U5xa1d55551O
Ad3An/zkJ1rFy+ANN9xg1wa5VrcvfvGLP/rRj7QjIzrUs2dPHVq3bp0uIa+++qr2FcC9996rHXnP
NuJill9daXbt2mVeFKFdVIKmrLOFpHblKL/6CHLNNddY55OFpDKU4nE3QzJwtYw8oyAAgfQRUFV9
4cKFyuuv//qvb7311mISjGDNLk2UqGmTpisUk3VJrVRVf1E3Z3Dt27dXuzRUQjlgwIBgn4svvtgd
0ocAux6okqOe+rQimX722Wetv4RVruWlc+fO8ij1VKOOqs++fftUzNGHCbkwWT+ZETOlPxmsi6T+
4K+8vP322+psuVipS1qsdr2VQYm4uVA3NeqiqM6uDJUzJKn/Rz/6URuuIRYSGwQgAIEgARVhrM4u
ofv1r3+dcUO1UFYRKLtWxxJWbRI7Vcm1Iy3TMlzlFN0CzQ5IMqrSvMm3hPLzn/+865NxSB8F9JFC
R3XZUM8bb7xR+7/85S9df7XIi46qxe42/OxnP9Or1tFq1/Jfr3qb34hZs4DlRWP1duvWrVJwW8Ir
DCs07d+/37lQaupsHwjyh6QETc2VtYYox0Inif4QgEC6CQRr68Gae4uzjkDZtaT9txObFNCq5F26
dLGAtJpucWQ20Ioq0lzJopTatdhRreX1akWYYP+Min9+IxqoFfo3v/lNeyBHa3AzpXR0iXrllVck
8XbB6NevnwtAHxfs1rFa1McFkB1SkQQYDgEIpJtAxi3TYM39ySefbFnuESh70PGFF14YVDqT1GI2
uzZIdnX9sC3n5wDnwvoHF9F626wRLb21rpdl2VfNxFnTxVPLdl1RVFZSeWfMmDHOmuoqLiSFV0yO
jIUABCqZwMc+9jE9BBi8ZWrirsZLLrmkZWQiUHZXZ9dTjApFFXapoSokDzzwgNW+szerO2upqwp1
/mcldTNTPWVHYq1Nnwzy52nLat0slXcpr2lus0ZUR1I3lZLkwko3tj311FN2M0AlGqVmjy3aOl0u
LCQt51XWzx+VfYXDqlWrFJVV8NkgAAEIGAHVBqZOnZrxgKPE/e6779ZryyhFoOyuzm5laD2jInFX
tV0SaZXx7E31Ey2BdQFQ6SP/0/haJsuI+qintj179rgn4nNaVglF1zpdOfRMzk9/+lNbrTdrRC5k
VkOk1BpuliX0utOrm6LmWhcwFYUk7gpe1wxVXaxdaeYPSab0aUBXCPUMXjZaNmGMggAEINAsgaKe
emzWeqI7SL51bdAq2+r4enhR4i7dD97yTXSCBA8BCKSVQARr9rSisSfQ9ZC77qCq0FRfX6+3LX72
P62UyAsCEChDAqzZTzopqsbcf//9Vj9RvUWarodngr+TVYbTSUgQgAAERABl5zSAAAQgkDYCVGPS
NqPkAwEIQABl5xyAAAQgkDYCKHvaZpR8IAABCKDsnAMQgAAE0kYAZU/bjJIPBCAAAZSdcwACEIBA
2gig7GmbUfKBAAQggLJzDkAAAhBIGwGUPW0zSj4QgAAEUHbOAQhAAAJpI4Cyp21GyQcCEIAAys45
AAEIQCBtBI5/I1hNTU3a0iIfCEAAAhVMgDV7BU8+qUMAAiklgLKndGJJCwIQqGACKHsFTz6pQwAC
KSWAsqd0YkkLAhCoYAIoewVPPqlDAAIpJYCyp3RiSQsCEKhgAih7BU8+qUMAAiklgLKndGJJCwIQ
qGACKHsFTz6pQwACKSWAsqd0YkkLAhCoYAIoewVPPqlDAAIpJYCyp3RiSQsCEKhgAih7BU8+qUMA
AiklgLKndGJJCwIQqGACKHsFTz6pQwACKSWAsqd0YkkLAhCoYAIoewVPPqlDAAIpJYCyp3RiSQsC
EKhgAih7BU8+qUMAAiklgLKndGJJCwIQqGACrQ8dOlTB6ZM6BCAAgRQSaN22bdsUpkVKEIAABCqY
ANWYCp58UocABFJKAGVP6cSSFgQgUMEEWjU0NNTU1FQwAVKHQCgCO3bs2L9/f6iudIJALgLt2rXr
06ePHzYoux/OeEk8gQ0bNlRXVyc+DRKIj0BjY+PgwYP9+EfZ/XDGS+IJSNkHDBiQ+DRIID4CGzdu
RNnjw49nCOQiIGX39mPJDKSSgM9TiDuoqTyFSAoCEKhoAvEo+/jx45cvX34y8H379s0+NH369DxD
KnoOSR4CEIDAHxOIoc6+e/fuSZMmderUacGCBTmnQ8r+wgsvZBySsnfv3n3UqFHMIARKQeDRE1sp
LGOzBQQmnNhaMLCch6S8GrNu3bqxY8dqAiTx5TwNxAYBCEAgoQRiqMasWbNGS+8hQ4ZI4h011We0
VNemtblrVPnFGoP1GfXcvHlzsNH1mTt3ro11LSNGjNBb1z/DfkLnjLAhAAEI5CfgW9klsr1791ZM
EndJvAVniqwKjDaVXKxRK/qZM2cuW7bM2levXu0yUbs1qkVCP2fOHHsrg7Iva9OmTbOWVatWqc/i
xYudnRkzZnBOQAACEEg3Ad/Kvn79emm0rambmpokxOK7d+9eLeENtKuk66iuAV27drX2K6+80s2E
hNvtb9u2TVV7Z1CjJk6cKOkPLvPr6upGjx6ta0C655LsIAABCBgB38ouIbbVtDattSX0xc+EM6gd
uzBYi8Td1Ly2tlZvpe9qcRWb4v1iAQIQgEB5EvCq7KqbDx8+3IGQ4FqNpWPHjk7i3aONVVVVugy4
u6zBakwQpdb1JxNrqfnrr7/uLMidajKuBFSe80FUEIAABIon4FXZFy1a1KNHj2DQqrFIl1U/UaNV
VHbt2iVN11vVYVR1URXF2seNG5czWz06KbF2t0yl4zLo3upCIjvu9qysBSs5xePDAgQgAIEyJBDD
8+xlSIGQIMDz7GV1DvA8e5HT4XXNXmSsDIcABCAAgTAEUPYwlOgDAQhAIEkEUPYkzRaxQgACEAhD
AGUPQ4k+EIAABJJEAGVP0mwRKwQgAIEwBFD2MJToAwEIQCBJBHjqMUmzRawxEvD5Fawxponr0hHw
eQqxZi/dPGIZAhCAQDwEUPZ4uOMVAhCAQOkIoOylY4tlCEAAAvEQoM4eD3e8Jo7A1q1bDx48mLiw
Cbh8CLRv375nz55+4kHZ/XDGCwQgAAF/BKjG+GONJwhAAAJ+CKDsfjjjBQIQgIA/Aii7P9Z4ggAE
IOCHAMruhzNeIAABCPgjgLL7Y40nCEAAAn4IoOx+OOMFAhCAgD8CKLs/1niCAAQg4IcAyu6HM14g
AAEI+COAsvtjjScIQAACfgig7H444wUCEICAPwIouz/WeIIABCDghwDK7oczXiAAAQj4I4Cy+2ON
JwhAAAJ+CKDsfjjjBQIQgIA/AnyLrz/WeEo0gR07duzfvz/RKRB8vATatWvXp08fPzGg7H444yXx
BPTniaurqxOfBgnER6CxsXHw4MF+/KPsfjjjJfEEpOz9+/dPfBokEB+BTZs2oezx4cczBHIRkLJ7
+7FkBlJJwOcpxB3UVJ5CJAUBCFQ0Ad/KPmLEiN27dzvky5cvnz59evEzICOyHLST4ah4F1iAAAQg
kBQCrQ8dOpSUWJuNc+7cuc32oQMEIACB1BNo3bZt23QkOXbs2IULFwY/EKQjL7KAAAQgUCgB39WY
k8UnRe774TZ+/Hjrph1rC7Zs3rzZGrNNTZs2bdasWRntKvg4y7aoly8ZVAHH2q0iZPtu1R+MRx0K
xUp/CJyMwM0337xixYrg0ZqaGlYknDDREigXZV+8ePGcOXNeOLEtWLBASUpke/bsaS1VVVVOc2fO
nGmN2SBGjRqlxgwhVqP117ZmzRobtW3btu7du6tFTmXQ9pctW6ZVv3WYNGmS3toodeAHL9rTrpKt
6QGbXbt2OQJS+V69enXt2jVb8SuZErkXSaBclL2urk5iGrwLql/5k87aUnr16tV79+61VLUwz5Pz
1KlTJcTBDm6NLztNTU12SJcKuwzU1tbq1fb106V2ibg29Rw9erT7cOAGFomb4RC49tpr165d6zhI
5e1hyvnz5+tQNh9Jf8YaH4YQaJZAuSi7VNVW0BJT97SMW8Xr0IwZM5pNxtT5yiuvlIVOnTrprTQ6
uPoOY8FJv1vpa8cuAGwQyElg5MiRqqjYltFBouwOaZFhR4cNG+bEWipvgq41u3W46667tGOjdNrP
PrFp3w1nFiDQLAHfyj58+PBgKVzr6yFDhrgoTd+1QleLSjEq0TSbQHYH/TDIguotTqNlVvvhy+WF
9m9BkAxJDQFp9NChQ7d+uAXz0sJCouwO6QOllfVU/dMvrWjHSjHZKNTTRmmNosvAlClTtM/yIjXn
jIdEfCv7xIkTVfFwtzS1Krfz1d3D1CGrt2T0DK/LGusqNtLo3r17mzt97JXrkExXrVqlq46LM+Qo
ulUgAa24161bl/MuqCqK0mXHRPtq0VsN2b59u3ZcKSaDm6S8AkmScpQEGhoajrFBAALNEVi/fn3+
Ltec2IJ97LEr16J9tdhb29dXjLmjEyZM0PeKuEM5RzUXI8fLmkCzp1CE0ftes0d5UcIWBMqJwMqV
K/WhUNVwq5IrNFUUVUa3Coxeta8WC1kFmSVLlgRX9OWUCrEkngDKnvgpJIF4CQTvkXbs2DFYDVcx
UHeV9NyXhF6v2rdbOFaQ0QNX0vdmg9eTM9xBbZYSHTII8C2+nBIQCEXA5xf1hQqITkkj4PMUYs2e
tLODeCEAAQg0RwBlb44QxyEAAQgkjQDKnrQZI14IQAACzRFA2ZsjxHEIQAACSSOAsidtxogXAhCA
QHMEUPbmCHEcAhCAQNIIoOxJmzHihQAEINAcAZ5nb44QxyFwgoC+k+vgwYPAgECLCbRv3979EnKL
jYQciLKHBEU3CEAAAokhQDUmMVNFoBCAAARCEkDZQ4KiGwQgAIHEEEDZEzNVBAoBCEAgJAGUPSQo
ukEAAhBIDAGUPTFTRaAQgAAEQhJA2UOCohsEIACBxBBA2RMzVQQKAQhAICQBlD0kKLpBAAIQSAwB
lD0xU0WgEIAABEISQNlDgqIbBCAAgcQQQNkTM1UECgEIQCAkAZQ9JCi6QQACEEgMAZQ9MVNFoBCA
AARCEkDZQ4KiGwQgAIHEEOBbfBMzVQQaL4EdO3bs378/3hjwnmgC7dq169Onj58UUHY/nPGSeAIb
Nmyorq5OfBokEB+BxsbGwYMH+/GPsvvhjJfEE5CyDxgwIPFpkEB8BDZu3Iiyx4cfzxDIRUDK7u3H
khlIJQGfpxB3UFN5CpEUBCBQ0QR8K/uIESP6frjNnTu3fNgrsN27d5dPPEQCAQhAoMUEfCu7Ap0z
Z84LJ7Y1a9YsX768xaEzEAIQgAAEchKIQdldHGPHjt21axcTAwEIQAAC0RKIU9n37dtnyWjlnl2i
cS2qk6jP5s2bXcv06dM1RK82XDvjx493+1bkUaPrb4dUbFE3HVW7jXV93PBo4WINAhCAQDwEGhoa
jnncrr766k2bNplDPbTv9l0I6qD9hx9++Ec/+lEwrptuuumll14Ktmi4vdUQbXbUdjRW/e2oXJhN
tWuILFu7+li79dGhDPseqeAqAQTWr1+fgCgJsYwJ+DyFYlizT5o0yVbT06ZNq62tzViPNzU1qWXi
xIkzZ85UH3e5q6urGz16dHBx3bt3by3ktXjXzvDhw7dv3263QLt27aoiz5AhQ2ysubBDVVVVsmzt
+sSgUa6PDsVzacUrBCAAgagJxKDs7g7qqFGjTHOl9cuWLbPbqi5BeytxNzWXQOut9F0tVm/p2bPn
zp07TcR79Oih66HE3Yl11KCwB4F8BEaOHFlzYgs+YXXXXXdZ44oVK9xg7VujjrpGjbJG2Qm6KZFZ
5jL1BGJQ9mymWi9roa327EdlpOavv/66+2mRvusaoIdq1Hno0KH6Ko9t27apUZu6SeUl8TrUvXv3
RYsWmSOzafaDW4cOHcyONq397bMCGwRaQODmm292548WH2Zh3rx5a9eutf3Zs2frHLMzTfvWqKPq
Y/tulOzImjWWyGwLEmRI4gjEr+zSXJVTrD4jabaqiN3ntE3LcPXRyt3eqiajMo76qFFqrrEGXd1W
r15ttRd9GtBb66+qzqpVq7InRn2c38WLFzs7iZtCAo6dgD4sBmMwEdcHymCjPQaW8TCY9bH+bnPW
SmQ2dlwE4IEA3xvjATIu0kAgz6+Ga3EdVOGtW7cqYa3H3QdHvZ01a5aWHRLxqVOnOhx68Pe2227T
W9VhXGOvXr3mz5+vtyUym4bJSGYOfLtAMueNqCuVwOTJk13qU6ZMsX1JtrstP2zYMPs0qVftWwcd
NVnX5kZp31krkdlKnaXKyrtVfX39wIEDKytpsoVA4QR8LrgKj44RCSDg8xRq3bZt2wQgIUQIQAAC
EAhNIP47qKFDpSMEIAABCIQigLKHwkQnCEAAAgkigLInaLIIFQIQgEAoAih7KEx0ggAEIJAgAih7
giaLUCEAAQiEIoCyh8JEJwhAAAIJIoCyJ2iyCBUCEIBAKAJ8u0AoTHSCgL4z4ODBg3CAQIsJtG/f
Xt9Q2+LhBQ1E2QvCRWcIQAACCSBANSYBk0SIEIAABAoigLIXhIvOEIAABBJAAGVPwCQRIgQgAIGC
CKDsBeGiMwQgAIEEEEDZEzBJhAgBCECgIAIoe0G46AwBCEAgAQRQ9gRMEiFCAAIQKIgAyl4QLjpD
AAIQSAABlD0Bk0SIEIAABAoigLIXhIvOEIAABBJAAGVPwCQRIgQgAIGCCKDsBeGiMwQgAIEEEEDZ
EzBJhAgBCECgIAIoe0G46AwBCEAgAQT4Ft8ETBIhxk7g2LFj27ZtO3DgQOyREEByCZx55pn9+vVr
1aqVhxRQdg+QcZFsApJ1bfX19bW1tcnOhOhjJbB58+ZBgwZJ2T2IO9WYWKca5wkhcPTo0YRESphl
TcDbiYSyl/V5QHDlQEAL9g8++ECR2OKdDQItI6BTSCeSxno4q1F2D5BxkXgCfn4aE4+JBJoj4O1E
8qrsI0aM6PvH29y5c5tDwXEIlAuBlq3UGAUBI+DzPPaq7KtWrXrhhRfmzJlTVVWlHW0TJ070mS2+
IAABCFQCAa/KXglAyTHFBFh7QqAYAj5/NGJWdj0GpBKNS1jFGW1qnD59uivduIqN2l0tR/s+MeEL
AicjMG78bSuffLoYPt+57/77H5wnC1uea/jimBv0Wow1xkJABGJWdj0g3KlTJyfTa9asGTp0qMJa
vXq1ijZWsVm4cKF1mDRpkrUsW7ZM+8wfBDwTONl67fTT2xSzlNPY09sct+DSKdIaw8uTgM/TNWZl
V6p1dXXr16/XjuRbKt+1a1ft9+7d23a0XXnllU1NTSbutmYfPXq09nfv3u2TFL4gkJPAwgXzhlwx
sBg4d/7t5K9OuKEYC4yFQAaB+JVdy3b93rZkWvoulc8zQ5J7W7Pb5qSfSYWAHwI5V4LX1d34+KKl
OnTn3/2D6ip6Vcutt0/Ztn2nGlVaUbnmHx/9gV7Vrh11dvtmUEP0zz0+YTvqJiMaYtUeazQL1j5p
2rfNBVtcBPbtf0MTp1cXgKpqmvGTxePnLDUv8Su7ghg+fPi6deuk7+63t03rbWGuykyvXr3sAkB5
3efJga9CCbz8yp7+n/3MxK+Ob9PmIwt+sMiGHz58+NC77970lbphQwZteubZ137f5PaffX7ryVx8
6oIu428Y+8Six4YPveKJ5f/iuv3vl18Zfd0X5OLAW3+o3/RMoRHSP0IC7c8+q1+f3vfN+l/733hT
Zuc89H29XnZpTYQuWmyqLJRdzz6qmC59d2loea5KuhVepk2bZstzK69bQSZ437XFyTMQAgURyLkW
Mwt2qPvFF10xsP9nPl0tOT7w1lsSequeD6y9XI0XdDlf+5J+7X95zJfcqKBZ1ygF17XhS2Nv2vzM
c65RO/36XqLh+nfuOZ0OHHgrruUqfo3A564e3v+zl0ncTdb/59e+modMQSdbkZ1jUHatvvVge3bc
du/Ubfbwu7ZRo0ZZo/TdlWJyWiiSBcMhkJ/AyZTdFVLeffew62NybAZ79rjY7QdlOtgn2OEnq1av
XV+vpf3ShY+O/NyVwSGfOPcc5y7ntQHN9UxgxFXDdOHWXHx94i35Xfv8+YpB2bPT03ONwVumPvPH
FwQiJKBF+ob6jc81NEqXP96uXZfzO7fM+LuHD9vAV/a8KlMtM8IobwS0cpese3MXxlHMym6PqKsU
s2DBgjDh0gcC5UxA9RYJ8bxHHjt8+P9oxd3iUAcNqNVVYeachx54+BGVX1psh4EVS4DvZ6/YqSfx
sAT0/XxHjhzZsmVLdXV1njF3z7ivy/nnjb3+urB26VdhBBobGy+//PLTTjutdeuSL6lL7qDC5o50
00wgTBXVc5EXdwki4PNnA2X3SRtfEIAABHwQoBrjgzI+Ek3AVWN0TyjRiRB8vAT0aB/VmHinAO8Q
gAAEEkyAakyCJ4/QPRNIUEmXUMuQgM/TFWX3SRtfEIAABHwQQNl9UMYHBCAAAZ8EuIPqkza+EknA
7qC++OKLhw4dSmQCBF0eBNq1a9etWzc/z7O3qq+vHziwqG+XLg9oRAGBUhGQsr/33nv6yka9aj/4
BS+lconddBFo1aqVfjvp1FNPbdOmjV49/KYSa/Z0nUFkUwICkvL3339fy3a9Br+NqwSuMJlOAlJ2
baeccooW7HrVfqnzRNlLTRj7iScgNddS3TYW7ImfzpgSsGW7bSh7TJOAWwj8MQETdGSd86IYAibo
HmT9uJeGhoaamrL4IyDFIGMsBCAAAQg4Ajz1yMkAAQhAIG0EUPa0zSj5QAACEEDZOQcgAAEIpI0A
yp62GSUfCEAAAig75wAEIACBtBFA2dM2o+QDAQhAAGXnHIAABCCQNgIoe9pmlHwgAAEIoOycAxCA
AATSRgBlT9uMkg8EIAABvl2AcwACoQjs2LFj//79obrSCQK5COj72fv06eOHDcruhzNeEk9gw4YN
1dXViU+DBOIj0NjYOHjwYD/+UXY/nPGSeAJS9gEDBiQ+DRKIj8DGjRtR9vjw4xkCuQhI2b39WDID
qSTg8xTiDmoqTyGSggAEKppADMq+fPnyvh9u48ePr2j8JA8BCECgBAR8K/vcuXNnzpz5wodbz549
R4wYET4vXRF2794dvj89IQABCFQgAd/KvnDhwmXLljnQEydO7NSpk1bxedAH1/W6InTt2rUC54mU
IQABCIQn4FXZN2/eXFVVlSHNWrbv2rVLEU+fPl0releosbW53m7btk2vpu/asdxkyvV0Fwb1CVrI
7ikX4dHQEwIQgEBCCXhVdjHSCj2DVIcOHVyLfhnE6jTTpk2bNGmS2rXA18VALQsWLAgO1FEdss6L
Fi2S0NtRZ2HcuHGm44sXL3Y9Z8yYkdB5ImwIQAAC4Qn4VvbXX389I7h9+/a5liFDhtj+qFGjmpqa
TpaGdLx3795u7T98+PCdO3da57q6OttxFwy1jB49mlu14c8JekIAAkkn4FXZa2trpdcZt0C1yu7e
vXvpOMqp1vXSd1VvVKspnSMsQwACECgTAl6VXTmrSKIVtEteUqtVvFbo1rJ+/XrbUbtW5SdjJLFW
8d1VYHRXtkePHvmBaohqMmvWrCkT7oQBAQhAoHQEfCu7HoZRDd3d/NSCfdWqVS49ldTtkMTaCusq
uag07+6gup6SaZXarbMMSrhPxkh1GOumK4p6lg4lliEAAQiUCYEy+t4Y3fBUWcat38sEEGFAwAj4
/NVwmKeSgM9TyPeaPZUTRlIQgAAEyooAyl5W00EwEIAABCIgUEbKrofNKcVEMKWYgAAEKp5AGSl7
xc8FACAAAQhEQwBlj4YjViAAAQiUDwGUvXzmgkggAAEIREMAZY+GI1YgAAEIlA8BlL185oJIIAAB
CERDAGWPhiNWIAABCJQPAZS9fOaCSCAAAQhEQ6CMvl0gmoSwAoHSENi6devBgwdLYxurFUGgffv2
+kNDflJF2f1wxgsEIAABfwSoxvhjjScIQAACfgig7H444wUCEICAPwIouz/WeIIABCDghwDK7ocz
XiAAAQj4I4Cy+2ONJwhAAAJ+CKDsfjjjBQIQgIA/Aii7P9Z4ggAEIOCHAMruhzNeIAABCPgjgLL7
Y40nCEAAAn4IoOx+OOMFAhCAgD8CKLs/1niCAAQg4IcAyu6HM14gAAEI+COAsvtjjScIQAACfgig
7H444wUCEICAPwIouz/WeIIABCDghwDK7oczXiAAAQj4I4Cy+2ONJwhAAAJ+CKDsfjjjBQIQgIA/
Aii7P9Z4ggAEIOCHgG9lHzlyZM2H27x58yzJm2++efPmzX4Sxku8BHQC7N69OxhD5LO/YsUKO8Wc
I51d8iKnOuXcWeeNQ3bKzbpuwZBmbdKhogj4VnbBnTVrlv4MvLZ169bph7CicJNsHgIS30jOh9mz
Zy9evFgnWNeuXZ27jh07Jgt+MPhkRU605UAgBmV3aY8ZM2bXrl3lQIEYiiFgy+Hit/nz51977bU5
7dx1110ZK/087qqqqjJkUS3JUvaePXsWzxMLlUwgTmXft29fNvrsWo1+ql2jFW306lp01Iy4Oo9r
ccaDn/e1KrQOhRrRp3jnNHtpGbRmQQbDtkikTYrEtVskZtOVCJSFKyboqNt36ulagqNcpnLhgnRD
tGONwZZgOm64G6swrNHQWbveZkNQ+/bt253xbA5BFPmvAW6aMryofe3atXV1dRZDcHOTbpbNe1NT
UwYcCf1tt90WHGg9bR4zUKgxGKfNQnA2LdmMbtaSk7/zG6yxBOtC2RN0zz33VLIqkXsEBBoaGo55
3K655ppNmzaZw+rqatufMGFCxo4agz2tv/pMnz7d+r/00kvBqNW+fPlya9FRt+9anFMdapkR506u
5SKDmXIJhiQvro9cKxf1Vwd1s9jU6Pat3Qyqp4VnfNx+Ng3rnBGG+rtM7dDcE5vt66jtKzZnWS3Z
6Tg7OpTtxXKxUdoJdnCJuKSUr+tgWWfMXfbsZ3tUS8aoYDqWpmWUEU8GH6NhYdgh7bv03awF3bme
GaaMv0WV06k7S123oFk3LzknKNsXLRAoiEAMa/apU6faGnDKlCm1tbXBq5NWf+6oVl579+4NLql0
yFquv/56reCCC6sdO3aoumpmZSTnp4GMy2ChRtxiWa4VW8YCsFevXsEKgKpMgwcPtj6WoxUTVBaw
goM12r4Gqt1VG1SksoGy6Yzo47nlHlwUWxhuOalDGitKbsWtozt37ly0aJGR0crXjGhzlocMGeLS
cUvgYM/Jkye7ZPNAsNj0ar5EybLWXAwdOtShUKbNrkfUP2PRnXOIJl3B2yHt6G2zlg2IEKkKb501
U/aZQ5tOIUMhjOvXr9eO8h02bFgQsvW0c09xWje9uhytg52HGedJzvBONkFhcqEPBE5GIAZld3dQ
cxZV7eaqbeqgHy3daLW3GugEQm8lzcGff7tpZlvGR++cyUtbwxuRZunH3ozLUVznk4RSquQytTD0
yd0CU0a6SBgokXFVKQdch/J8zJdaSZ7MlMlZxhYGgq5Gbha007LbgJo+jZV3ZVGKh6a0pAiW7MaO
HetiXrlypfzqxNPlUDsbNmywC62DbD11S8AuJzo5taNXu8bo0ijj1kcoQp4nIScopDW6QUAEYlD2
PNz1w5D9UJq7m6Qfs+BYCZk0zn601GfJkiV5LLu1aka38EbcD6ot0zIi0QIteIuve/fuzpEVc1um
cdkZuduDeR4jMX3XulvDe/TosXTp0mw7DqbidIQVtvW0sdlbHgjqLJjikKHFHTp0sDnSpkNhlrHW
WfoulcyY9GBIwUkPZpH/B1tAbElhZ5pSNhHP2HRtsw55Jk6HFIO66dV1M5g6GYQi26xL3zk92QTl
z4KjEMhPoLyUXUshqYD7PKsfD/0Q6lO2tbjHG9wdJ33kt1qBllTSbjcwQ1zUx9Vq3KfmgoxY8cTs
5wSqZZfd4rNlpsK2koJ9xreVYPGbSYmZVRkhu7IRvNEnWTR9FDdHJng9sEbhtYW8PgO5UpiWsdnR
5oRgpSTZsQKFrrXOiBWFhMLFrGtMmJWsi1boLDbBzL6DGpx0zX5Bdx3VWWeacCkpgXIe3VpeS3WJ
r6tZnWzu1CHYTaMsTkHI/tyj8zCbcJ4JKv6EwULFEmilO6gnU6uKhZL6xKXC0vGMmxypz7qgBLWq
kEZbUYgNAokjUF5r9sThI+C0ElB5J+fNhrTmS14pI4Cyp2xCSadYAvb8jytSFWuO8RCIgwDVmDio
4xMCEIBAKQmwZi8lXWxDAAIQiIMAyh4HdXxCAAIQKCUBlL2UdLENAQhAIA4C/urs+tKDbdu2HThw
wFuaZ555Zr9+/Vq1auXNI44gAAEIlAMBT8pu32VTX1/v8xlq/cbQoEGDpOyIezmcasQAAQh4I+Cv
GnP06FFvWTlHsTj1nyYeIQABCAQJeFJ2Ldg/+OADOS7oiyiL7Cx3ciojTDkEIACBiiLgSdlN0/2T
jcWp/zTxCAEIQCCGNbtzWeQyvKDhzDQEIACByiTgb81emXzJGgIQgIB/Ar6VvaBFd5Gd/dPEIwQg
AIFyIODpqUfdyTxy5MiWLVsuu+yyjLS/ffd3Xn5lT7Dxgi7n/8Pf31k8nWefffbyyy8/7bTTWrf2
fQErPngsQAACEGgxAd+Sl70M/8Lnr/narRP+5pqrlYN29E8tRa7WbXiLoTAQAhCAQKIJ+Fb2bFi9
ena/7NKav/jEuTqkHf1TS0imWuxfV3djyM50gwAEIFAhBHwre57FuIgHjz6+aOm48bdJuCdN+/a2
7TuPfznB9p3aV4v+3f/gPL39zn33a5S1ZFuukCkkTQhAAAIZBHwre8gJ2FC/cdMzz930lbonFj3W
/eKLHpx3/E/FP7Xm+J+WVsuMu79V06+Plvb9P/sZa9G/kJbpBgEIQCD1BHwre8g1+85f/Orw4cNz
/3HBl8betHZ9vfY1sLpv7wNv/WHyN+781a9f+tQFXVwl/WQ2Uz95JAgBCEAgJ4FyUXYLzmm09s/p
VLV04aPunw5dMbD/9/7h7/r1vURa/73ZD7jbpCg7JzcEIACBIAHfyh6S/sUX/dXvX29a/i8/fuPN
Azt2/kLFGQ3U62uv/X7U//iboYMH6qhazj2nk16fa2hUn5CW6QYBCEAg9QTKVNkHDxow8nNXPbPl
+Tsm/+1D33/0lT2/0Uy89vvXtX/9uAk/fvJpHVVLr549upzfed4jjz32+OLUTxUJQgACEAhJwPdv
KlVXV4eMrPhujY2N/KZS8RixAAEIJI6A7zV7JL+CFNJI4iaDgCEAAQhEQsC3skcSNEYgAAEIQCAP
Ad/KHnK5HUk3Jh4CEIBAZRLwreyVSZmsIQABCPgk4FvZI1mMhzTikyO+IAABCJQPAd/KXj6ZEwkE
IACBtBJA2dM6s+QFAQhULgGvz7O/+OKLhw4d8ga7Xbt23bp14y9veAOOIwhAoEwI+FP29957T1/s
pVf9faVS/1mMVq1a6e8onXrqqW3atNErf1OpTM42woAABPwQ8KTskvL3339ffzBPrx7+4JGUXdsp
p5yiBbtete+HJl4gAAEIlAMBf8qupbptpV6wG1ZbttuGspfDqUYMEICANwKelF35mKD7kXUn7ibx
3mjiCAIQgEA5EPD3bIxVSNw62sOOeSwHysQAAQhAwCcBf8qurEaOHFnzx9u8efOKzFYWzGR+Ozff
fPPmzZvD+LrrrrtWrFiRs6csKIUwRiLvkx2/glSo5khHHVcX/O7du4OwXUjKQu1BGmKYPRGyExzu
+gcbg6Ay3IWkHTkoDEIAAiLgVdlXrly5devWWbNmVVVVaUfbbbfdVsw0SE0WLVpkpnLakeSdTKaL
8VtWYyXKHTt2NAjarr32WoUnYa2rqxNqa9SOFFm4LHLxv//+438cPP/Wq1cvN3zq1Kmu8+LFi619
9uzZpuAZ7nSotra2OfMchwAESkXAq7IXk4T0K+cyUOqTx+z8+fNN6fxsirD4TyGFhrp3797u3btn
jFq6dOmUKVOcvGpn7NixS5Ysccres2fP8KFquC4G7sLgfMnmrl279DbDXaEp0B8CEIiWQFkou6oK
9hnf1TpcjUWNVnbQ2lzLxuDCU+1alm7fvt36BKsBWqobppxFGFdPcNIWrDw4vnLqyh3Z0BWqC9vc
yYgiVJwWj1qy81KLFUMsEQ0MZuq8uAjDFH8k61o7Z8iusEi7g2Gr244dO1zLPffco1CzxTrn6WXX
1K5du2Yc1UVFLTIid/mvoEHC5lQtyt3qSLavV6vXmTtXu3OzmTEk2p8ErEEgTQTiV3YTQft0P3To
UBPTdevWBcsLkiGtza224PRFUqIWqxhoX+1uiMlNznmSTLgahbxIRNRTyugqDGvXrg0zwU1NTa4G
YjqlGLSG1Wbx5MxLPaX+FqclsnPnTnurge5C4hKROjdbsJYvBa+LnLuiWPwZQqxFd0ZeWtTnr8nY
VVObuqmSljFc3MRqyJAhas82Huysnvq4kF3Y0aXl+uuvdxUkzYJNjT4iCIVOBhvSo0cPRyZjSJiZ
og8EKpBA/Mquj/MSCFMQ/dzaMlA/1XobvlxgM+eWupIkKW/O6dQhW/trUx+506suD04Hhw0bZgN1
OdGW55xwNwkk8dndcualbtLTYGdJm73t0KGDa3fLVZExIPk3d1WTgDpoGde2bCC2yg7eh3B+zZ1d
NaW2Gd7tKmJ1fON2Mto2UJ8V1MGYC77rLNTBcryubW4WNMSuGdq04z5tZAxpDgzHIVChBOJXdhM7
t0pVZVwtEk21aMd9Nm92fqRKzk7+4rvz5VaLzRpvWYfsvMLY0acKt1x1l5kwA9VnzJgxdiUQgWDt
RS260mTUZ9So64pWyu6iYre4jbzbrMgevAC4zzemy5LjjA7Z0SqRIPaQ6dANAhBoGYH4lV31X3dn
LyMH6bvEccOGDSFzM+Wysu/JhkjyMj4KSJXU361wXTUmf5292ZDy5BVmrPUJWRpyBiXf9gHCJNtV
crSjz0PS/QzXkmZprnrmD0nWTjZHNlCWs2v9zqbmRYmErOnbKA1xHrWTfU1qliEdIFDJBOJXdtUE
rPZim8mueyu9sJLI4MGDM+6gZkybxMWqBOqWZ6mrzwQqrzv7khstOXX9sLHaVBNo8QmhuoG7g5oz
rzCWJaOuXhQmmODD7LJvNSJJtlbWzo4V97Nvgapn/oqTBWzL9jz3k+2eh2MojMFM5Td41N0RzUND
UenDh82IdsIEGYYtfSBQIQT8fbtAhQD1lqZ0VsvzIn8hwFu0OIIABHwSiH/N7jPbdPiyByVVRkfW
0zGhZAGByAmwZo8cKQYhAAEIxEyANXvME4B7CEAAApETQNkjR4pBCEAAAjETQNljngDcQwACEIic
AMoeOVIMQgACEIiZAMoe8wTgHgIQgEDkBFD2yJFiEAIQgEDMBFD2mCcA9xCAAAQiJ4CyR44UgxCA
AARiJoCyxzwBuIcABCAQOQGUPXKkGIQABCAQMwGUPeYJwD0EIACByAmg7JEjxSAEIACBmAmg7DFP
AO4hAAEIRE4AZY8cKQYhAAEIxEwAZY95AnAPAQhAIHICKHvkSDEIAQhAIGYCKHvME4B7CEAAApET
QNkjR4pBCEAAAjETQNljngDcQwACEIicAMoeOVIMQgACEIiZAMoe8wTgHgIQgEDkBFD2yJFiEAIQ
gEDMBFD2mCcA9xCAAAQiJ4CyR44UgxCAAARiJoCyxzwBuIcABCAQOQGUPXKkGIQABCAQMwGUPeYJ
wD0EIACByAmg7JEjxSAEIACBmAmg7DFPAO4hAAEIRE4AZY8cKQYhAAEIxEwAZY95AnAPAQhAIHIC
KHvkSDEIAQhAIGYCKHvME4B7CEAAApETQNkjR4pBCEAAAjETQNljngDcQwACEIicAMoeOVIMQgAC
EIiZAMoe8wTgHgIQgEDkBFD2yJFiEAIQgEDMBFD2mCcA9xCAAAQiJ4CyR44UgxCAAARiJoCyxzwB
uIcABCAQOQGUPXKkGIQABCAQMwGUPeYJwD0EIACByAmg7JEjxSAEIACBmAmg7DFPAO4hAAEIRE4A
ZY8cKQYhAAEIxEwAZY95AnAPAQhAIHICKHvkSDEIAQhAIGYCKHvME4B7CEAAApETQNkjR4pBCEAA
AjETQNljngDcQwACEIicAMoeOVIMQgACEIiZAMoe8wTgHgIQgEDkBFD2yJFiEAIQgEDMBFD2mCcA
9xCAAAQiJ4CyR44UgxCAAARiJoCyxzwBuIcABCAQOQGUPXKkGIQABCAQMwGUPeYJwD0EIACByAmg
7JEjxSAEIACBmAmg7DFPAO4hAAEIRE4AZY8cKQYhAAEIxEwAZY95AnAPAQhAIHICKHvkSDEIAQhA
IGYCKHvME4B7CEAAApETQNkjR4pBCEAAAjETQNljngDcQwACEIicAMoeOVIMQgACEIiZAMoe8wTg
HgIQgEDkBFD2yJFiEAIQgEDMBFD2mCcA9xCAAAQiJ4CyR44UgxCAAARiJoCyxzwBuIcABCAQOQGU
PXKkGIQABCAQMwGUPeYJwD0EIACByAmg7JEjxSAEIACBmAmg7DFPAO4hAAEIRE4AZY8cKQYhAAEI
xEwAZY95AnAPAQhAIHICKHvkSDEIAQhAIGYCKHvME4B7CEAAApETQNkjR4pBCEAAAjETQNljngDc
QwACEIicAMoeOVIMQgACEIiZAMoe8wTgHgIQgEDkBFD2yJFiEAIQgEDMBFD2mCcA9xCAAAQiJ4Cy
R44UgxCAAARiJoCyxzwBuIcABCAQOQGUPXKkGIQABCAQMwGUPeYJwD0EIACByAmg7JEjxSAEIACB
mAmg7DFPAO4hAAEIRE4AZY8cKQYhAAEIxEwAZY95AnAPAQhAIHICKHvkSDEIAQhAIGYCKHvME4B7
CEAAApETQNkjR4pBCEAAAjETQNljngDcQwACEIicAMoeOVIMQgACEIiZAMoe8wTgHgIQgEDkBFD2
yJFiEAIQgEDMBFD2mCcA9xCAAAQiJ4CyR44UgxCAAARiJtCqoaHh9NNPjzkK3EMAAhCAQHQEjit7
TU1NdAaxBAEIQAACMROgGhPzBOAeAhCAQOQEUPbIkWIQAhCAQMwEUPaYJwD3EIAABCIngLJHjhSD
EIAABGImgLLHPAG4hwAEIBA5AZQ9cqQYhAAEIBAzAZQ95gnAPQQgAIHICaDskSPFIAQgAIGYCaDs
MU8A7iEAAQhETgBljxwpBiEAAQjETABlj3kCcA8BCEAgcgIoe+RIMQgBCEAgZgIoe8wTgHsIQAAC
kRPgux4jR4pBCEAgMgLHjh3ree/Tu37TFJnFPzZ0XtVZe/5+ZKtWrdQsX9u2bTtw4ECJfBVj9swz
z+zXr5/FGWZD2cNQog8EIBADAUmttj+95fG/uOTSc8/8SOQR7HvnyJ6fPXf0ka84Za+vr+/fv3/k
joo3uGnTpkGDBinOkOJONaZ45liAAARKReDo0aMy/cGxPzl67Fjk/2RWm7lwO3Y5KbctGGcY1ih7
GEr0gQAEYiAgef3ggw/k+MRO9P+OnVB2uTAdd77KTdYVj4sz5DSg7CFB0Q0CEIiBgIma/h89vmyP
+J8U3S4blpjbiSHPEC4LCg9lD0GULhCAQKwEpL0lWUfHmlRJnaPsJcWLcQhAIAICJVqzf7hY/6MI
S3IJKdpooRBR9kKJ0R8CEPBNQGWTUtTZrRqTsRUtwiUxUChxlL1QYvSHAAR8E5ACR15kl8Gca3bf
uZXGH8peGq5YhQAEoiOgpfXxZXvWv+Gd/2zl58/79xsv1L+GMRfceWkH12fNFzrPG3yuvVW7Oqhz
toWQa/Z9+9+4/8F5X77p1i+OueGrX5u88smnS7Ey3/Jcg+zrNdt4oSxR9kKJ0R8CEPBNQEqXvWav
OuPUe2ur/vwjfzr3xTfueX7vC03vjrmo3cwB51hPbVadH975TLUv+uVbT77y3xlGctRicmW2/403
750553e/e+36677wtVsn1H72M6ef3sY3ggL9oewFAqM7BCDgnYB+pSi7zj6p79mnn9L69p++dv/P
9j++88D4Nf+5be+7w877qPU8Ie3HOp1xyvf6Vz372jt3b2nKUanPJe3Z6+Wf/tum37/e9NUJNwwe
NOAzn67+4hc+r51SrNn/3yOeuUwXihxlL5QY/SEAAd8ETqy+M38HtWeH01/9ryMNv3/HHdr8u7el
9Ved/2dq0RD9WzHyL5veef9LT/5Hzt9fDfmE+C9++esLupyvfxlpb6jfOPkbd35p7E3698iCx+3o
9L//7pyHvm/tt90x9SerVlv7wsXLvjJhojW+/MqeYIs6b9+xK1qmKHu0PLEGAQhET+DE8+yZ/8xN
sP3Au8e/J0Arebs1evknzuh0xqkZfTLsZMcafjF+3l9+cvjQK5b9cMG0SbdveuZZVx/f9Ytfqf22
W25q1+5ja9fXy6D0XTvDhgxSo167nN95vT4IPPPcjePGaHj3iy96cN5883si2hxboUxR9kKJ0R8C
EPBN4ESdPfOfBRFs/1ibP1XL3kPvq1E7v/mvI9O3NHX+89MeuELF9xwWjn9xQRHbq7/5jzXrfjr6
y+Mfe3xx0IxW9yrXXHZpzQVdOh946y0dennPq+d0qlIZR42fu3q4Wnb98teHDx+e98hjGi7R134R
geQYirJHyxNrEIBA9ASOPxuT9b0xP286JNXuV9XWHar9xBnvvv/Bj3f/4cQ3wfzJb//7vQXb33jm
d29fdf6ZwW6uf85qTPaCucv5572y51XdRw0eUkXlBz9c2q/vJUsXPnr3nd+wnM3gOZ06up6u0XaC
7dJ6jXX/gsHwbEz05xAWIQCBciNw4rseM/999/m90vF/HPqJqTUdbuhx1sKr/7JPVdtVHz4Ac1xJ
Tzwbc8eG1959/9i9tZ2yLdh91ma3q68c1qZNm+/NfkCF9ecaGp98ao1e3377HRv4xpsHljyxPL+R
Lp3P0z3Y5f/yYw2UEV0nLr7or6xFw3fs/IUamw2joA6s2QvCRWcIQCAGAqqxZz+K/h//feRrG373
1uGjk/t1+G5tpx7t28xu3HfL2v+0nrZE1o66zdq696Kz23yj5v8/7W59Qq7Zz/p4u699dXy7du0e
X7RM9ZN1G/7t0KFDPbp3q738M3qw/Rvf/rvT27TRAtwVyt3y3C3kR1w1bOjggaq6aPjKJ1er5xUD
+18z4spntjx/x+S/fej7j76y5zfR1tn5yxsxnKa4hAAEwhDQ1+oeOXLk9NuXtrmw70dOiX4ZeuTo
B+/++wvvPnT9aaedpnjka8uWLdXV1WFi89ynsbHx8ssvV5ytW4fiEKqT5xxwBwEIQCBIQEvwUnxv
DN8IxmkGAQhAIDYCeoilFN8bk7POHv6pR589C0XPmr1QYvSHAAR8EyidhvrOxJc/lN0XafxAAAIt
JVCq73psaTzlPw5lL/85IkIIVDqBnM+zR1B5D/e9MaX7xBDecqFnAMpeKDH6QwACvgnk/B3UnL9W
WlBjyKcew+tv6XoWSpynHgslRn8IQMATAXvq8by7frL3DwdL5LJzp7N/9c1h7qnHF198Uc+ql8hX
MWb1NH23bt3CP/WIshdDm7EQgEAJCUjZ33vvPX2nil61n3OJ3WL3rVq10rPhp556qn6/VK+yUzpf
LQ5SAzPiDPk8O8peDHPGQgACJSQgKX///fe1bNdr8Dc8I3EpxdR2yimnaCGsV9ksna9iAs6IU2/D
WEPZw1CiDwQgEAOB418P8OEW7YLdkrHlsG16W1JfxeALxomyF0OSsRCAQFkQMEEvhaw7cTeJd15K
56sYoBZhSFk/3rOhoaGmpqYYl4yFAAQgAIGyIsBTj2U1HQQDAQhAIAICKHsEEDEBAQhAoKwIoOxl
NR0EAwEIQCACAih7BBAxAQEIQKCsCKDsZTUdBAMBCEAgAgIoewQQMQEBCECgrAig7GU1HQQDAQhA
IAICKHsEEDEBAQhAoKwIoOxlNR0EAwEIQCACAih7BBAxAQEIQKCsCKDsZTUdBAMBCEAgAgL/F5Em
oZWk3jwlAAAAAElFTkSuQmCC
--_004_9D6F18D2AC0D5245BE068C2BEBC06946284F62msli01202res01ads_--
2
1