February 2018 - Users - oVirt List Archives

oVirt 4.2 with cheph
by Christoph Köhler 20 Feb '18

20 Feb '18

Hello, does someone have experience with cephfs as a vm-storage domain? I think about that but without any hints... Thanks for pointing me... -- Christoph Köhler Leibniz Universität IT Services Schloßwender Straße 5, 30159 Hannover Tel.: +49 511 762 794721 koehler(a)luis.uni-hannover.de http://www.luis.uni-hannover.de/scientific_computing.html

3 2

Console button greyed out (4.2)
by nicolas＠devels.es 20 Feb '18

20 Feb '18

--=_e39231c6e7557ffafe2fcaabdd9c46db Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=UTF-8; format=flowed Hi, We upgraded one of our infrastructures to 4.2.0 recently and since then some of our machines have the "Console" button greyed-out in the Admin UI, like they were disabled. I changed their compatibility to 4.2 but with no luck, as they're still disabled. Is there a way to know why is that, and how to solve it? I'm attaching a screenshot. Thanks. --=_e39231c6e7557ffafe2fcaabdd9c46db Content-Transfer-Encoding: base64 Content-Type: image/png; name="Captura de pantalla de 2018-02-15 13-47-13.png" Content-Disposition: attachment; filename="Captura de pantalla de 2018-02-15 13-47-13.png"; size=1280 iVBORw0KGgoAAAANSUhEUgAAAG4AAAA1CAIAAAAvcEmYAAAAA3NCSVQICAjb4U/gAAAAGXRFWHRT b2Z0d2FyZQBnbm9tZS1zY3JlZW5zaG907wO/PgAABJNJREFUeJztm99PWlccwL/u3nCSQyDFQEID kalTNBVqtY2ztZbawdZUnS1tbGq37MG3/T176WuzpE7X2KzdKloVf05nM6VuIAYsiaQYjNdAvMm5 uTf2AZiuyrW449zq+bxww+F77vd+cr7n3HtyKdre3gYGDT467gQ+HJhKajCV1GAqqcFUUoOppAZT SQ2mkhpMJTWYSmowldRgKqnBVFKDqaQGU0kNppIafOYjFApJknS8qfwfQQjZ7fbMcValJEnV1dXH l9KREwwGj+ICg8HgX8eswKnBVFKDqaQGU0kNppIavHqzTIii0sxxiD+gh5NDfhGyMNnb9ydBnFq4 opia7t2o0FLP60BItOfBL/B5d2cl+vdPvi8qYyr1RqnouO8yqfxEjvU9WhHlCu3Ob+SN8PTYbCgm SAAaQ0lNyxeN1v/KxR4tlMtzY77/4fiaruxTd6OBE4V4AuGT4REoqySxyak1rsTTmSt5uyPXkljw Dc1GBQk0pyovetwOE0+iPQ/8+vqSVDCUEEFjPONpd5VrAeRkYMA3Gd2UgMPGKne762PtfuG7T5tc 8A1MRwWF05U0fOa5cExVQHMFl4WVVYWz1pa+O3WSmO/xRAzXtd7xttbjyGj/4CoBAAAxHJRr27/p vttUvP7H8GxSBiBR/0gUnDfvfXW3rbm2tFirEp7tfPjxxKquydvldVuEqWcvXhM4BCT2on8sthNK 4v4nA5GtAnqgejMkiwogPd7zdSIQU3QNrvpys7n8vKtBJ0UWEjIAABjqG+0mrdb0icMIYjKtAADC HKRfLycIttirbXrV8EznEUnnvFxjLTbbL9YZpXgwKb+bwXuALHVlwnDPSGwLAEjc3+tL2upshayn qgW+FZ8bH8cqS7iyKci6XZ0hDsjWnkFBRFEBrM+mhfUYlJRIAAFAbirludxZkO1ap2vCNzX8w6Lf WOPpuFoG+cNznafnvv9uLnc6pHb7lh/e4LzRAc/6e55XWddDQk2rt1Ztxd2nA7VGaTO8uHlAB/jM rmRKTRBaXYwTq233dIUw5kBIbQEgABBTInAGjCDfFSOT41qXo+nNvO/Hcd9YRbdbNRxhzIHu3J0O R7YaOIQPuwBkbf4crirYI6gWuP604eB4zmjZyRyVXDqrk5af9gwuLEVikfDib3PLKQDeXFepSc+M vowkEpG50Zm0przWnC9Rklj8PRxPbog8xgg44A8I583Ock06MLOyQRSZpJPxtULmtz3wBueXXbfP F+wR1EYlb7h0/9sGOTPvKKn5vofTmRGqqb75dYs5U5D83x92+NPNXi/2+19OPA8BgMZQ1mgHAGRp uXVFGZp+2vsraE6VXW5rsSHItzjI669G/GMSAGDLWU+zmQdQDUc2960rg0PTTx5NAHA6y4W2isI1 0KAo8wJ1IBBQ3RklqyM/+eNEAQAOmeqvX688hgecf8LRbf06nc7M8XsOZGS9eruLeiIfFmxniBpM JTWYSmowldRgKqmRvRlaWloi5FDbACeb3a8UFLE/5tGCFTg1mEpqMJXUYCqpwVRSg6mkBlNJDaaS GkwlNd4CGF/UiSluffUAAAAASUVORK5CYII= --=_e39231c6e7557ffafe2fcaabdd9c46db--

5 10

Cannot delete auto-generated snapshot
by Langley, Robert 20 Feb '18

20 Feb '18

--_000_BN1PR09MB0289E063FD0949DD7A39161987CF0BN1PR09MB0289namp_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable I was moving some virtual disks from one storage server to another. Now, I = have a couple servers that have the auto-generated snapshot, without disks,= and I cannot delete them. The VM will not start and there is the complaint= that the disks are illegal. Any help would be appreciated. I'm going to bed for now, but will try to wa= ke up earlier. --_000_BN1PR09MB0289E063FD0949DD7A39161987CF0BN1PR09MB0289namp_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Diso-8859-= 1"> <style type=3D"text/css" style=3D"display:none;"></style> </head> <body dir=3D"ltr"> <div id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font= -family:Calibri,Helvetica,sans-serif;" dir=3D"ltr"> <p style=3D"margin-top:0;margin-bottom:0">I was moving some virtual disks f= rom one storage server to another. Now, I have a couple servers that have t= he auto-generated snapshot, without disks, and I cannot delete them. The VM= will not start and there is the complaint that the disks are illegal.</p> <p style=3D"margin-top:0;margin-bottom:0">Any help would be appreciated. I'= m going to bed for now, but will try to wake up earlier.<br> </p> </div> </body> </html> --_000_BN1PR09MB0289E063FD0949DD7A39161987CF0BN1PR09MB0289namp_--

2 1

4.2 VM Portal -Create- VM section issue
by Vrgotic, Marko 20 Feb '18

20 Feb '18

--_000_DCB28C19FFF840AC897ED97221D26A2Cactivevideocom_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 RGVhciBvVmlydCwNCg0KQWZ0ZXIgc2V0dGluZyBhbGwgcGFyYW1ldGVycyBmb3IgbmV3IFZNIGFu ZCBjbGlja2luZyBvbiDigJxDcmVhdGXigJ0gYnV0dG9uLCBubyBwcm9ncmVzcyBzdGF0dXMgb3Ig dGhhdCBhY3Rpb24gaXMgYWNjZXB0ZWQgaXMgc2VlbiBmcm9tIHdlYnVpLg0KSW4gYWRkaXRpb24s IHdoZW4gY2xvc2luZyB0aGUgYWRkIFZNIHNlY3Rpb24sIEkgYW0gYXNrZWQgaWYgSSBhbSBzdXJl LCBkdWUgdG8gY2hhbmdlcyBtYWRlLg0KDQpJcyB0aGlzIGV4cGVjdGVkIGJlaGF2aW91cj8gQ2Fu IHNvbWV0aGluZyBiZSBkb25lIGFib3V0Pw0KDQpLaW5kbHkgYXdhaXRpbmcgeW91ciByZXBseS4N Cg0KLS0NCk1ldCB2cmllbmRlbGlqa2UgZ3JvZXQgLyBCZXN0IHJlZ2FyZHMsDQpNYXJrbyBWcmdv dGljDQpTeXN0ZW0gRW5naW5lZXIvQ3VzdG9tZXIgQ2FyZQ0KQWN0aXZlVmlkZW8NCg0K --_000_DCB28C19FFF840AC897ED97221D26A2Cactivevideocom_ Content-Type: text/html; charset="utf-8" Content-ID: <B57959ED133FE44B8D66555EBE087783(a)namprd08.prod.outlook.com> Content-Transfer-Encoding: base64 PGh0bWwgeG1sbnM6bz0idXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTpvZmZpY2U6b2ZmaWNlIiB4 bWxuczp3PSJ1cm46c2NoZW1hcy1taWNyb3NvZnQtY29tOm9mZmljZTp3b3JkIiB4bWxuczptPSJo dHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL29mZmljZS8yMDA0LzEyL29tbWwiIHhtbG5zPSJo dHRwOi8vd3d3LnczLm9yZy9UUi9SRUMtaHRtbDQwIj4NCjxoZWFkPg0KPG1ldGEgaHR0cC1lcXVp dj0iQ29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgiPg0KPG1l dGEgbmFtZT0iVGl0bGUiIGNvbnRlbnQ9IiI+DQo8bWV0YSBuYW1lPSJLZXl3b3JkcyIgY29udGVu dD0iIj4NCjxtZXRhIG5hbWU9IkdlbmVyYXRvciIgY29udGVudD0iTWljcm9zb2Z0IFdvcmQgMTUg KGZpbHRlcmVkIG1lZGl1bSkiPg0KPHN0eWxlPjwhLS0NCi8qIEZvbnQgRGVmaW5pdGlvbnMgKi8N CkBmb250LWZhY2UNCgl7Zm9udC1mYW1pbHk6IkNhbWJyaWEgTWF0aCI7DQoJcGFub3NlLTE6MiA0 IDUgMyA1IDQgNiAzIDIgNDt9DQpAZm9udC1mYWNlDQoJe2ZvbnQtZmFtaWx5OkNhbGlicmk7DQoJ cGFub3NlLTE6MiAxNSA1IDIgMiAyIDQgMyAyIDQ7fQ0KQGZvbnQtZmFjZQ0KCXtmb250LWZhbWls eTotd2Via2l0LXN0YW5kYXJkO30NCi8qIFN0eWxlIERlZmluaXRpb25zICovDQpwLk1zb05vcm1h bCwgbGkuTXNvTm9ybWFsLCBkaXYuTXNvTm9ybWFsDQoJe21hcmdpbjowY207DQoJbWFyZ2luLWJv dHRvbTouMDAwMXB0Ow0KCWZvbnQtc2l6ZToxMi4wcHQ7DQoJZm9udC1mYW1pbHk6Q2FsaWJyaTsN Cgltc28tZmFyZWFzdC1sYW5ndWFnZTpFTi1VUzt9DQphOmxpbmssIHNwYW4uTXNvSHlwZXJsaW5r DQoJe21zby1zdHlsZS1wcmlvcml0eTo5OTsNCgljb2xvcjojMDU2M0MxOw0KCXRleHQtZGVjb3Jh dGlvbjp1bmRlcmxpbmU7fQ0KYTp2aXNpdGVkLCBzcGFuLk1zb0h5cGVybGlua0ZvbGxvd2VkDQoJ e21zby1zdHlsZS1wcmlvcml0eTo5OTsNCgljb2xvcjojOTU0RjcyOw0KCXRleHQtZGVjb3JhdGlv bjp1bmRlcmxpbmU7fQ0Kc3Bhbi5FbWFpbFN0eWxlMTcNCgl7bXNvLXN0eWxlLXR5cGU6cGVyc29u YWwtY29tcG9zZTsNCglmb250LWZhbWlseTpDYWxpYnJpOw0KCWNvbG9yOndpbmRvd3RleHQ7fQ0K c3Bhbi5tc29JbnMNCgl7bXNvLXN0eWxlLXR5cGU6ZXhwb3J0LW9ubHk7DQoJbXNvLXN0eWxlLW5h bWU6IiI7DQoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTsNCgljb2xvcjp0ZWFsO30NCi5Nc29D aHBEZWZhdWx0DQoJe21zby1zdHlsZS10eXBlOmV4cG9ydC1vbmx5Ow0KCWZvbnQtZmFtaWx5OkNh bGlicmk7DQoJbXNvLWZhcmVhc3QtbGFuZ3VhZ2U6RU4tVVM7fQ0KQHBhZ2UgV29yZFNlY3Rpb24x DQoJe3NpemU6NTk1LjBwdCA4NDIuMHB0Ow0KCW1hcmdpbjo3Mi4wcHQgNzIuMHB0IDcyLjBwdCA3 Mi4wcHQ7fQ0KZGl2LldvcmRTZWN0aW9uMQ0KCXtwYWdlOldvcmRTZWN0aW9uMTt9DQotLT48L3N0 eWxlPg0KPC9oZWFkPg0KPGJvZHkgYmdjb2xvcj0id2hpdGUiIGxhbmc9IkVOLUdCIiBsaW5rPSIj MDU2M0MxIiB2bGluaz0iIzk1NEY3MiI+DQo8ZGl2IGNsYXNzPSJXb3JkU2VjdGlvbjEiPg0KPHAg Y2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQiPkRlYXIgb1Zp cnQsPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZToxMS4wcHQiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNs YXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0Ij5BZnRlciBzZXR0 aW5nIGFsbCBwYXJhbWV0ZXJzIGZvciBuZXcgVk0gYW5kIGNsaWNraW5nIG9uIOKAnENyZWF0ZeKA nSBidXR0b24sIG5vIHByb2dyZXNzIHN0YXR1cyBvciB0aGF0IGFjdGlvbiBpcyBhY2NlcHRlZCBp cyBzZWVuIGZyb20gd2VidWkuPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05v cm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQiPkluIGFkZGl0aW9uLCB3aGVuIGNs b3NpbmcgdGhlIGFkZCBWTSBzZWN0aW9uLCBJIGFtIGFza2VkIGlmIEkgYW0gc3VyZSwgZHVlIHRv IGNoYW5nZXMgbWFkZS48bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdCI+PG86cD4mbmJzcDs8L286cD48L3NwYW4+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQi PklzIHRoaXMgZXhwZWN0ZWQgYmVoYXZpb3VyPyBDYW4gc29tZXRoaW5nIGJlIGRvbmUgYWJvdXQ/ PG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZToxMS4wcHQiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0Ij5LaW5kbHkgYXdhaXRp bmcgeW91ciByZXBseS48bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdCI+PG86cD4mbmJzcDs8L286cD48L3NwYW4+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMC41cHQ7 Zm9udC1mYW1pbHk6LXdlYmtpdC1zdGFuZGFyZDtjb2xvcjpibGFjazttc28tZmFyZWFzdC1sYW5n dWFnZTpFTi1HQiI+LS08bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEwLjVwdDtmb250LWZhbWlseTotd2Via2l0LXN0YW5k YXJkO2NvbG9yOmJsYWNrO21zby1mYXJlYXN0LWxhbmd1YWdlOkVOLUdCIj5NZXQgdnJpZW5kZWxp amtlIGdyb2V0IC8gQmVzdCByZWdhcmRzLDxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiPjxzcGFuIGxhbmc9IkVOLVVTIiBzdHlsZT0iZm9udC1zaXplOjEwLjVwdDtm b250LWZhbWlseTotd2Via2l0LXN0YW5kYXJkO2NvbG9yOmJsYWNrO21zby1mYXJlYXN0LWxhbmd1 YWdlOkVOLUdCIj5NYXJrbyBWcmdvdGljPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCI+PHNwYW4gbGFuZz0iRU4tVVMiIHN0eWxlPSJmb250LXNpemU6MTAuNXB0O2Zv bnQtZmFtaWx5Oi13ZWJraXQtc3RhbmRhcmQ7Y29sb3I6YmxhY2s7bXNvLWZhcmVhc3QtbGFuZ3Vh Z2U6RU4tR0IiPlN5c3RlbSBFbmdpbmVlci9DdXN0b21lciBDYXJlPG86cD48L286cD48L3NwYW4+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gbGFuZz0iRU4tVVMiIHN0eWxlPSJmb250 LXNpemU6MTAuNXB0O2ZvbnQtZmFtaWx5Oi13ZWJraXQtc3RhbmRhcmQ7Y29sb3I6YmxhY2s7bXNv LWZhcmVhc3QtbGFuZ3VhZ2U6RU4tR0IiPkFjdGl2ZVZpZGVvPG86cD48L286cD48L3NwYW4+PC9w Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PG86cD4mbmJzcDs8L286cD48L3A+DQo8L2Rpdj4NCjwv Ym9keT4NCjwvaHRtbD4NCg== --_000_DCB28C19FFF840AC897ED97221D26A2Cactivevideocom_--

2 7

Re: [ovirt-users] 2 Master on Storage Pool [Event Error]
by michael pagdanganan 20 Feb '18

20 Feb '18

------=_Part_2010355_281080504.1519108987392 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Sorry can't attached log file it's too big file VDSM.log for node 1 2766', 'lastCheck': '4.9', 'valid': True}} from=3Dinternal, task_id=3D645d4= 56e-f59f-4b1c-9e97-fc82d19a36b1 (api:52) 2018-02-20 14:38:47,222+0800 INFO=C2=A0 (jsonrpc/3) [vdsm.api] START repoSt= ats(options=3DNone) from=3D::ffff:10.10.43.1,60554, flow_id=3D3b2e802e, tas= k_id=3D28c795d1-1639-4e68-a9fe-a00006be268f (api:46) 2018-02-20 14:38:47,222+0800 INFO=C2=A0 (jsonrpc/3) [vdsm.api] FINISH repoS= tats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual'= : True, 'version': 4, 'acquired': True, 'delay': '0.000119109', 'lastCheck'= : '6.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0= , 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000195263', '= lastCheck': '6.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': = {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000= 22988', 'lastCheck': '6.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f4= 40a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay= ': '0.000270206', 'lastCheck': '5.9', 'valid': True}, '42e591b7-f86c-4b67-a= 3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tr= ue, 'delay': '0.000272766', 'lastCheck': '6.0', 'valid': True}} from=3D::ff= ff:10.10.43.1,60554, flow_id=3D3b2e802e, task_id=3D28c795d1-1639-4e68-a9fe-= a00006be268f (api:52) 2018-02-20 14:38:47,226+0800 INFO=C2=A0 (jsonrpc/3) [jsonrpc.JsonRpcServer]= RPC call Host.getStats succeeded in 0.00 seconds (__init__:539) 2018-02-20 14:38:55,252+0800 INFO=C2=A0 (jsonrpc/4) [jsonrpc.JsonRpcServer]= RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2018-02-20 14:38:58,566+0800 INFO=C2=A0 (jsonrpc/2) [jsonrpc.JsonRpcServer]= RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2018-02-20 14:39:01,093+0800 INFO=C2=A0 (periodic/1) [vdsm.api] START repoS= tats(options=3DNone) from=3Dinternal, task_id=3D04f55ded-5841-44ae-a376-4f6= e723e4b10 (api:46) 2018-02-20 14:39:01,093+0800 INFO=C2=A0 (periodic/1) [vdsm.api] FINISH repo= Stats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual= ': True, 'version': 4, 'acquired': True, 'delay': '9.3888e-05', 'lastCheck'= : '9.9', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0= , 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000197535', '= lastCheck': '9.8', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': = {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000= 191456', 'lastCheck': '9.8', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f= 440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'dela= y': '0.00026365', 'lastCheck': '9.8', 'valid': True}, '42e591b7-f86c-4b67-a= 3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tr= ue, 'delay': '0.000243658', 'lastCheck': '0.0', 'valid': True}} from=3Dinte= rnal, task_id=3D04f55ded-5841-44ae-a376-4f6e723e4b10 (api:52) 2018-02-20 14:39:02,295+0800 INFO=C2=A0 (jsonrpc/6) [vdsm.api] START repoSt= ats(options=3DNone) from=3D::ffff:10.10.43.1,60554, flow_id=3D13149d6e, tas= k_id=3D5f19d76a-d343-4dc4-ad09-024ec27f7443 (api:46) 2018-02-20 14:39:02,295+0800 INFO=C2=A0 (jsonrpc/6) [vdsm.api] FINISH repoS= tats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual'= : True, 'version': 4, 'acquired': True, 'delay': '9.4759e-05', 'lastCheck':= '1.1', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0,= 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000183158', 'l= astCheck': '1.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': {= 'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.0002= 22609', 'lastCheck': '1.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f4= 40a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay= ': '0.000211253', 'lastCheck': '1.0', 'valid': True}, '42e591b7-f86c-4b67-a= 3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tr= ue, 'delay': '0.000243658', 'lastCheck': '1.1', 'valid': True}} from=3D::ff= ff:10.10.43.1,60554, flow_id=3D13149d6e, task_id=3D5f19d76a-d343-4dc4-ad09-= 024ec27f7443 (api:52) 2018-02-20 14:39:02,300+0800 INFO=C2=A0 (jsonrpc/6) [jsonrpc.JsonRpcServer]= RPC call Host.getStats succeeded in 0.01 seconds (__init__:539) 2018-02-20 14:39:10,270+0800 INFO=C2=A0 (jsonrpc/1) [jsonrpc.JsonRpcServer]= RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2018-02-20 14:39:13,631+0800 INFO=C2=A0 (jsonrpc/0) [vdsm.api] START connec= tStorageServer(domType=3D1, spUUID=3Du'00000000-0000-0000-0000-000000000000= ', conList=3D[{u'id': u'5e4c94f1-f3b9-4fbd-a6c7-e732d0fe3123', u'connection= ': u'dev2node1.lares.com.ph:/run/media/root/Slave1Data/dataNode1', u'iqn': = u'', u'user': u'', u'tpgt': u'1', u'protocol_version': u'auto', u'password'= : '********', u'port': u''}], options=3DNone) from=3D::ffff:10.10.43.1,6055= 4, flow_id=3D15b57417, task_id=3Dbfce1e70-ef4a-4e13-aaaa-7a66aaf44429 (api:= 46) 2018-02-20 14:39:13,633+0800 INFO=C2=A0 (jsonrpc/0) [vdsm.api] FINISH conne= ctStorageServer return=3D{'statuslist': [{'status': 0, 'id': u'5e4c94f1-f3b= 9-4fbd-a6c7-e732d0fe3123'}]} from=3D::ffff:10.10.43.1,60554, flow_id=3D15b5= 7417, task_id=3Dbfce1e70-ef4a-4e13-aaaa-7a66aaf44429 (api:52) 2018-02-20 14:39:13,634+0800 INFO=C2=A0 (jsonrpc/0) [jsonrpc.JsonRpcServer]= RPC call StoragePool.connectStorageServer succeeded in 0.00 seconds (__ini= t__:539) 2018-02-20 14:39:13,806+0800 INFO=C2=A0 (jsonrpc/7) [vdsm.api] START connec= tStoragePool(spUUID=3Du'5a865884-0366-0330-02b8-0000000002d4', hostID=3D1, = msdUUID=3Du'f3e372e3-1251-4195-a4b9-1027e40059df', masterVersion=3D65, doma= insMap=3D{u'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': u'active', u'4bf2ba2f-f5= 7a-4d9f-b42a-fb78f440a358': u'active', u'225e1975-8121-4370-b317-86e964ae32= 6f': u'attached', u'f3e372e3-1251-4195-a4b9-1027e40059df': u'active', u'65c= a2e2d-b472-4bee-85b4-09a161464b20': u'active', u'42e591b7-f86c-4b67-a3d2-40= cc007f7662': u'active'}, options=3DNone) from=3D::ffff:10.10.43.1,60554, fl= ow_id=3D15b57417, task_id=3D927a5d9a-4304-4776-b5c9-22ba5d0cb853 (api:46) 2018-02-20 14:39:13,807+0800 INFO=C2=A0 (jsonrpc/7) [storage.StoragePoolMem= oryBackend] new storage pool master version 65 and domains map {u'e83d0d46-= 6ea6-4aa3-80bf-6e95c66b0454': u'Active', u'4bf2ba2f-f57a-4d9f-b42a-fb78f440= a358': u'Active', u'225e1975-8121-4370-b317-86e964ae326f': u'Attached', u'f= 3e372e3-1251-4195-a4b9-1027e40059df': u'Active', u'65ca2e2d-b472-4bee-85b4-= 09a161464b20': u'Active', u'42e591b7-f86c-4b67-a3d2-40cc007f7662': u'Active= '} (spbackends:450) VDSM.log 22018-02-20 14:41:14,598+0800 INFO=C2=A0 (periodic/3) [vdsm.api] F= INISH repoStats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': = 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000252423', = 'lastCheck': '6.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454':= {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '7.55= 67e-05', 'lastCheck': '6.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a16= 1464b20': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'dela= y': '8.2433e-05', 'lastCheck': '6.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b= 42a-fb78f440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': Tr= ue, 'delay': '0.000237247', 'lastCheck': '5.9', 'valid': True}, '42e591b7-f= 86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acq= uired': True, 'delay': '8.4376e-05', 'lastCheck': '6.0', 'valid': True}} fr= om=3Dinternal, task_id=3D6213712b-9903-4db8-9836-3baf85cd63e4 (api:52) 2018-02-20 14:41:18,074+0800 INFO=C2=A0 (jsonrpc/6) [jsonrpc.JsonRpcServer]= RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2018-02-20 14:41:24,333+0800 INFO=C2=A0 (jsonrpc/4) [vdsm.api] START repoSt= ats(options=3DNone) from=3D::ffff:10.10.43.1,56540, flow_id=3D73f86113, tas= k_id=3De8231ecb-3543-4d8f-af54-4cf2b06ee98a (api:46) 2018-02-20 14:41:24,334+0800 INFO=C2=A0 (jsonrpc/4) [vdsm.api] FINISH repoS= tats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual'= : True, 'version': 4, 'acquired': True, 'delay': '0.000172953', 'lastCheck'= : '5.7', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0= , 'actual': True, 'version': 0, 'acquired': True, 'delay': '7.701e-05', 'la= stCheck': '5.7', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': {'= code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.00011= 7677', 'lastCheck': '5.7', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f44= 0a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay'= : '0.000185146', 'lastCheck': '5.7', 'valid': True}, '42e591b7-f86c-4b67-a3= d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tru= e, 'delay': '9.1467e-05', 'lastCheck': '5.8', 'valid': True}} from=3D::ffff= :10.10.43.1,56540, flow_id=3D73f86113, task_id=3De8231ecb-3543-4d8f-af54-4c= f2b06ee98a (api:52) 2018-02-20 14:41:24,338+0800 INFO=C2=A0 (jsonrpc/4) [jsonrpc.JsonRpcServer]= RPC call Host.getStats succeeded in 0.00 seconds (__init__:539) 2018-02-20 14:41:27,087+0800 INFO=C2=A0 (jsonrpc/0) [jsonrpc.JsonRpcServer]= RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2018-02-20 14:41:29,607+0800 INFO=C2=A0 (periodic/1) [vdsm.api] START repoS= tats(options=3DNone) from=3Dinternal, task_id=3Df14b7aab-b64a-4903-9368-d66= 5e39b49d1 (api:46) 2018-02-20 14:41:29,608+0800 INFO=C2=A0 (periodic/1) [vdsm.api] FINISH repo= Stats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual= ': True, 'version': 4, 'acquired': True, 'delay': '0.000246237', 'lastCheck= ': '1.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': = 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '8.8773e-05', '= lastCheck': '1.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': = {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '9.714= 5e-05', 'lastCheck': '1.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f4= 40a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay= ': '0.000218729', 'lastCheck': '0.9', 'valid': True}, '42e591b7-f86c-4b67-a= 3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tr= ue, 'delay': '9.1035e-05', 'lastCheck': '1.0', 'valid': True}} from=3Dinter= nal, task_id=3Df14b7aab-b64a-4903-9368-d665e39b49d1 (api:52) 2018-02-20 14:41:33,079+0800 INFO=C2=A0 (jsonrpc/7) [jsonrpc.JsonRpcServer]= RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2018-02-20 14:41:40,456+0800 INFO=C2=A0 (jsonrpc/2) [vdsm.api] START repoSt= ats(options=3DNone) from=3D::ffff:10.10.43.1,56540, flow_id=3D3be8150c, tas= k_id=3D1b0c86a8-6fd8-4882-a742-fbd56ccb4037 (api:46) 2018-02-20 14:41:40,457+0800 INFO=C2=A0 (jsonrpc/2) [vdsm.api] FINISH repoS= tats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual'= : True, 'version': 4, 'acquired': True, 'delay': '0.000174027', 'lastCheck'= : '1.8', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0= , 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.00011454', 'l= astCheck': '1.8', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': {= 'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.0001= 45955', 'lastCheck': '1.8', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f4= 40a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay= ': '0.000209871', 'lastCheck': '1.8', 'valid': True}, '42e591b7-f86c-4b67-a= 3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': Tr= ue, 'delay': '9.5744e-05', 'lastCheck': '1.9', 'valid': True}} from=3D::fff= f:10.10.43.1,56540, flow_id=3D3be8150c, task_id=3D1b0c86a8-6fd8-4882-a742-f= bd56ccb4037 (api:52) 2018-02-20 14:41:40,461+0800 INFO=C2=A0 (jsonrpc/2) [jsonrpc.JsonRpcServer]= RPC call Host.getStats succeeded in 0.01 seconds (__init__:539) 2018-02-20 14:41:42,106+0800 INFO=C2=A0 (jsonrpc/3) [jsonrpc.JsonRpcServer]= RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2018-02-20 14:41:44,622+0800 INFO=C2=A0 (periodic/3) [vdsm.api] START repoS= tats(options=3DNone) from=3Dinternal, task_id=3D20e0b29b-d3cd-4e44-b92c-213= f9c984ab2 (api:46) 2018-02-20 14:41:44,622+0800 INFO=C2=A0 (periodic/3) [vdsm.api] FINISH repo= Stats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual= ': True, 'version': 4, 'acquired': True, 'delay': '0.000174027', 'lastCheck= ': '6.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': = 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.00011454', '= lastCheck': '6.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': = {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000= 145955', 'lastCheck': '6.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f= 440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'dela= y': '0.000209871', 'lastCheck': '5.9', 'valid': True}, '42e591b7-f86c-4b67-= a3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': T= rue, 'delay': '9.5744e-05', 'lastCheck': '6.0', 'valid': True}} from=3Dinte= rnal, task_id=3D20e0b29b-d3cd-4e44-b92c-213f9c984ab2 (api:52) 2018-02-20 14:41:49,083+0800 INFO=C2=A0 (jsonrpc/1) [jsonrpc.JsonRpcServer]= RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) Engine log skId '404ccecc-aa7f-45ea-89e4-726956269bc9' task status 'finished' 2018-02-20 14:42:21,966+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb= roker.SpmStartVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9] spm= Start polling ended, spm status: SPM 2018-02-20 14:42:21,967+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb= roker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9]= START, HSMClearTaskVDSCommand(HostName =3D Node1, HSMTaskGuidBaseVDSComman= dParameters:{runAsync=3D'true', hostId=3D'7dee35bb-8c97-4f6a-b6cd-abc425854= 0e4', taskId=3D'404ccecc-aa7f-45ea-89e4-726956269bc9'}), log id: 71688f70 2018-02-20 14:42:22,922+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb= roker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9]= FINISH, HSMClearTaskVDSCommand, log id: 71688f70 2018-02-20 14:42:22,923+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb= roker.SpmStartVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9] FIN= ISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentit= ies.SpmStatusResult@78332453, log id: 3ea35d5 2018-02-20 14:42:22,935+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb= roker.IrsProxy] (org.ovirt.thread.pool-7-thread-38) [29528f9] Initialize Ir= s proxy from vds: dev2node1.lares.com.ph 2018-02-20 14:42:22,951+08 INFO=C2=A0 [org.ovirt.engine.core.dal.dbbroker.a= uditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-38) [2952= 8f9] EVENT_ID: IRS_HOSTED_ON_VDS(204), Correlation ID: null, Call Stack: nu= ll, Custom ID: null, Custom Event ID: -1, Message: Storage Pool Manager run= s on Host Node1 (Address: dev2node1.lares.com.ph). 2018-02-20 14:42:22,952+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb= roker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29= 528f9] -- executeIrsBrokerCommand: Attempting on storage pool '5a865884-036= 6-0330-02b8-0000000002d4' 2018-02-20 14:42:22,952+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb= roker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29= 528f9] START, HSMGetAllTasksInfoVDSCommand(HostName =3D Node1, VdsIdVDSComm= andParametersBase:{runAsync=3D'true', hostId=3D'7dee35bb-8c97-4f6a-b6cd-abc= 4258540e4'}), log id: 1bdbea9d 2018-02-20 14:42:22,955+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb= roker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-7) [295= 28f9] START, SPMGetAllTasksInfoVDSCommand( IrsBaseVDSCommandParameters:{run= Async=3D'true', storagePoolId=3D'5a865884-0366-0330-02b8-0000000002d4', ign= oreFailoverLimit=3D'false'}), log id: 5c2422d6 2018-02-20 14:42:23,956+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb= roker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29= 528f9] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 1bdbea9d 2018-02-20 14:42:23,956+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb= roker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29= 528f9] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 58cbe7b7 2018-02-20 14:42:23,956+08 INFO=C2=A0 [org.ovirt.engine.core.bll.tasks.Asyn= cTaskManager] (org.ovirt.thread.pool-7-thread-38) [29528f9] Discovered no t= asks on Storage Pool 'UnsecuredEnv' 2018-02-20 14:42:24,936+08 INFO=C2=A0 [org.ovirt.vdsm.jsonrpc.client.reacto= rs.ReactorClient] (SSL Stomp Reactor) [] Connecting to dev2node1.lares.com.= ph/10.10.43.2 2018-02-20 14:42:27,012+08 WARN=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb= roker.IrsProxy] (org.ovirt.thread.pool-7-thread-43) [] Master domain is not= in sync between DB and VDSM. Domain Node1Container marked as master in DB = and not in the storage 2018-02-20 14:42:27,026+08 WARN=C2=A0 [org.ovirt.engine.core.dal.dbbroker.a= uditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-43) [] EV= ENT_ID: SYSTEM_MASTER_DOMAIN_NOT_IN_SYNC(990), Correlation ID: null, Call S= tack: null, Custom ID: null, Custom Event ID: -1, Message: Sync Error on Ma= ster Domain between Host Node1 and oVirt Engine. Domain: Node1Container is = marked as Master in oVirt Engine database but not on the Storage side. Plea= se consult with Support on how to fix this issue. 2018-02-20 14:42:27,103+08 INFO=C2=A0 [org.ovirt.engine.core.bll.storage.po= ol.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-thread-43) [3e5= 965ca] Running command: ReconstructMasterDomainCommand internal: true. Enti= ties affected :=C2=A0 ID: f3e372e3-1251-4195-a4b9-1027e40059df Type: Storag= e 2018-02-20 14:42:27,137+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb= roker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-43) [3e5965ca] ST= ART, ResetIrsVDSCommand( ResetIrsVDSCommandParameters:{runAsync=3D'true', s= toragePoolId=3D'5a865884-0366-0330-02b8-0000000002d4', ignoreFailoverLimit= =3D'false', vdsId=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4', ignoreStopFaile= d=3D'true'}), log id: 3e0a239d 2018-02-20 14:42:27,140+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb= roker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-43) [3e5965ca] STA= RT, SpmStopVDSCommand(HostName =3D Node1, SpmStopVDSCommandParameters:{runA= sync=3D'true', hostId=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4', storagePool= Id=3D'5a865884-0366-0330-02b8-0000000002d4'}), log id: 7c67bf06 2018-02-20 14:42:28,144+08 INFO=C2=A0 [org.ovirt.engine.core.vdsbroker.vdsb= roker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-43) [3e5965ca] Spm= StopVDSCommand::Stopping SPM on vds 'Node1', pool id '5a865884-0366-0330-02= b8-0000000002d4' =20 On Tuesday, February 20, 2018 2:33 PM, michael pagdanganan <mhke_aj5566= @yahoo.com> wrote: =20 Thanks for quick response, see attachment. =20 On Tuesday, February 20, 2018 2:10 PM, Eyal Shenitzky <eshenitz(a)redhat.= com> wrote: =20 Hi,=C2=A0 Can you please attach full Engine and VDSM logs? Thanks, On Tue, Feb 20, 2018 at 2:59 AM, michael pagdanganan <mhke_aj5566(a)yahoo.com= > wrote: My storage pool has 2 Master Domain(Stored2 on Node2,Node1Container on Node= 1). and my old master domain (DATANd01 on Node1 ) hung on preparing for mai= ntenance. When I tried to activate my old master domain (DATANd01 on Node1 = ) all=C2=A0 storage domain goes down and up master keep on rotating. Ovirt Version (oVirt Engine Version: 4.1.9.1.el7.centos) Event Error:Sync Error on Master Domain between Host Node2 and oVirt Engine= . Domain Stored2 is marked as master in ovirt engine Database but not on st= orage side Please consult with support VDSM Node2 command ConnectStoragePoolVDS failed: Wrong Master domain or it'= s version: u'SD=3Df3e372e3-1251-4195-a4b9- 1027e40059df, pool=3D5a865884-03= 66-0330-02b8- 0000 VDSM Node2 command HSMGetAllTastsStatusesVDS failed: Not SPM: () Failed to deactivate Storage Domain DATANd01 (Data Center UnsecuredEnv) Here's logs from engine: ------------------------------ ------------------------------ -------------= ----------------- -------------[root@dev2engine ~]# tail /var/log/messages Feb 20 07:01:01 dev2engine systemd: Starting Session 20 of user root. Feb 20 07:01:01 dev2engine systemd: Removed slice User Slice of root. Feb 20 07:01:01 dev2engine systemd: Stopping User Slice of root. Feb 20 07:58:52 dev2engine systemd: Created slice User Slice of root. Feb 20 07:58:52 dev2engine systemd: Starting User Slice of root. Feb 20 07:58:52 dev2engine systemd-logind: New session 21 of user root. Feb 20 07:58:52 dev2engine systemd: Started Session 21 of user root. Feb 20 07:58:52 dev2engine systemd: Starting Session 21 of user root. Feb 20 08:01:01 dev2engine systemd: Started Session 22 of user root. Feb 20 08:01:01 dev2engine systemd: Starting Session 22 of user root. ------------------------------ ------------------------------ -------------= ----------------- -------------[root@dev2engine ~]# tail /var/log/ovirt-eng= ine/engine. log 2018-02-20 08:01:16,062+08 INFO=C2=A0 [org.ovirt.engine.core.bll. eventqueu= e.EventQueueMonitor] (org.ovirt.thread.pool-7- thread-32) [102e9d3c] Finish= ed reconstruct for pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing e= vent queue 2018-02-20 08:01:27,825+08 WARN=C2=A0 [org.ovirt.engine.core. vdsbroker.irs= broker.IrsProxy] (org.ovirt.thread.pool-7- thread-23) [] Master domain is n= ot in sync between DB and VDSM. Domain Stored2 marked as master in DB and n= ot in the storage 2018-02-20 08:01:27,862+08 WARN=C2=A0 [org.ovirt.engine.core.bll. storage.p= ool. ReconstructMasterDomainCommand ] (org.ovirt.thread.pool-7- thread-23) = [213f42b9] Validation of action 'ReconstructMasterDomain' failed for user S= YSTEM. Reasons: VAR__ACTION__RECONSTRUCT_ MASTER,VAR__TYPE__STORAGE__ DOMAI= N,ACTION_TYPE_FAILED_ STORAGE_DOMAIN_STATUS_ ILLEGAL2,$status PreparingForM= aintenance 2018-02-20 08:01:27,882+08 INFO=C2=A0 [org.ovirt.engine.core.bll. eventqueu= e.EventQueueMonitor] (org.ovirt.thread.pool-7- thread-20) [929330e] Finishe= d reconstruct for pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing ev= ent queue 2018-02-20 08:01:40,106+08 WARN=C2=A0 [org.ovirt.engine.core. vdsbroker.irs= broker.IrsProxy] (org.ovirt.thread.pool-7- thread-17) [] Master domain is n= ot in sync between DB and VDSM. Domain Stored2 marked as master in DB and n= ot in the storage 2018-02-20 08:01:40,197+08 WARN=C2=A0 [org.ovirt.engine.core.bll. storage.p= ool. ReconstructMasterDomainCommand ] (org.ovirt.thread.pool-7- thread-17) = [7af552c1] Validation of action 'ReconstructMasterDomain' failed for user S= YSTEM. Reasons: VAR__ACTION__RECONSTRUCT_ MASTER,VAR__TYPE__STORAGE__ DOMAI= N,ACTION_TYPE_FAILED_ STORAGE_DOMAIN_STATUS_ ILLEGAL2,$status PreparingForM= aintenance 2018-02-20 08:01:40,246+08 INFO=C2=A0 [org.ovirt.engine.core.bll. eventqueu= e.EventQueueMonitor] (org.ovirt.thread.pool-7- thread-22) [73673040] Finish= ed reconstruct for pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing e= vent queue 2018-02-20 08:01:51,809+08 WARN=C2=A0 [org.ovirt.engine.core. vdsbroker.irs= broker.IrsProxy] (org.ovirt.thread.pool-7- thread-26) [] Master domain is n= ot in sync between DB and VDSM. Domain Stored2 marked as master in DB and n= ot in the storage 2018-02-20 08:01:51,846+08 WARN=C2=A0 [org.ovirt.engine.core.bll. storage.p= ool. ReconstructMasterDomainCommand ] (org.ovirt.thread.pool-7- thread-26) = [20307cbe] Validation of action 'ReconstructMasterDomain' failed for user S= YSTEM. Reasons: VAR__ACTION__RECONSTRUCT_ MASTER,VAR__TYPE__STORAGE__ DOMAI= N,ACTION_TYPE_FAILED_ STORAGE_DOMAIN_STATUS_ ILLEGAL2,$status PreparingForM= aintenance 2018-02-20 08:01:51,866+08 INFO=C2=A0 [org.ovirt.engine.core.bll. eventqueu= e.EventQueueMonitor] (org.ovirt.thread.pool-7- thread-49) [2c11a866] Finish= ed reconstruct for pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing e= vent queue ______________________________ _________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/ mailman/listinfo/users --=20 Regards,Eyal Shenitzky =20 =20 ------=_Part_2010355_281080504.1519108987392 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <html><head></head><body><div style=3D"color:#000; background-color:#fff; f= ont-family:Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font= -size:10px"><div id=3D"yui_3_16_0_ym19_1_1519085807369_70843">Sorry can't a= ttached log file it's too big file<br></div><div id=3D"yui_3_16_0_ym19_1_15= 19085807369_70846"><br></div><div><br></div><div>VDSM.log for node 1</div><= div id=3D"yui_3_16_0_ym19_1_1519085807369_70844"><br></div><div id=3D"yui_3= _16_0_ym19_1_1519085807369_70530" dir=3D"ltr">2766', 'lastCheck': '4.9', 'v= alid': True}} from=3Dinternal, task_id=3D645d456e-f59f-4b1c-9e97-fc82d19a36= b1 (api:52)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70565">2018-02-20 14:3= 8:47,222+0800 INFO  (jsonrpc/3) [vdsm.api] START repoStats(options=3DN= one) from=3D::ffff:10.10.43.1,60554, flow_id=3D3b2e802e, task_id=3D28c795d1= -1639-4e68-a9fe-a00006be268f (api:46)<br id=3D"yui_3_16_0_ym19_1_1519085807= 369_70566">2018-02-20 14:38:47,222+0800 INFO  (jsonrpc/3) [vdsm.api] F= INISH repoStats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': = 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000119109', = 'lastCheck': '6.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454':= {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.00= 0195263', 'lastCheck': '6.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a1= 61464b20': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'del= ay': '0.00022988', 'lastCheck': '6.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-= b42a-fb78f440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': T= rue, 'delay': '0.000270206', 'lastCheck': '5.9', 'valid': True}, '42e591b7-= f86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'ac= quired': True, 'delay': '0.000272766', 'lastCheck': '6.0', 'valid': True}} = from=3D::ffff:10.10.43.1,60554, flow_id=3D3b2e802e, task_id=3D28c795d1-1639= -4e68-a9fe-a00006be268f (api:52)<br id=3D"yui_3_16_0_ym19_1_1519085807369_7= 0567">2018-02-20 14:38:47,226+0800 INFO  (jsonrpc/3) [jsonrpc.JsonRpcS= erver] RPC call Host.getStats succeeded in 0.00 seconds (__init__:539)<br i= d=3D"yui_3_16_0_ym19_1_1519085807369_70568">2018-02-20 14:38:55,252+0800 IN= FO  (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats su= cceeded in 0.00 seconds (__init__:539)<br id=3D"yui_3_16_0_ym19_1_151908580= 7369_70569">2018-02-20 14:38:58,566+0800 INFO  (jsonrpc/2) [jsonrpc.Js= onRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init_= _:539)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70570">2018-02-20 14:39:01,= 093+0800 INFO  (periodic/1) [vdsm.api] START repoStats(options=3DNone)= from=3Dinternal, task_id=3D04f55ded-5841-44ae-a376-4f6e723e4b10 (api:46)<b= r id=3D"yui_3_16_0_ym19_1_1519085807369_70571">2018-02-20 14:39:01,093+0800= INFO  (periodic/1) [vdsm.api] FINISH repoStats return=3D{'f3e372e3-12= 51-4195-a4b9-1027e40059df': {'code': 0, 'actual': True, 'version': 4, 'acqu= ired': True, 'delay': '9.3888e-05', 'lastCheck': '9.9', 'valid': True}, 'e8= 3d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0, 'actual': True, 'version':= 0, 'acquired': True, 'delay': '0.000197535', 'lastCheck': '9.8', 'valid': = True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': {'code': 0, 'actual': True, = 'version': 4, 'acquired': True, 'delay': '0.000191456', 'lastCheck': '9.8',= 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': {'code': 0, 'actua= l': True, 'version': 0, 'acquired': True, 'delay': '0.00026365', 'lastCheck= ': '9.8', 'valid': True}, '42e591b7-f86c-4b67-a3d2-40cc007f7662': {'code': = 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000243658', = 'lastCheck': '0.0', 'valid': True}} from=3Dinternal, task_id=3D04f55ded-584= 1-44ae-a376-4f6e723e4b10 (api:52)<br id=3D"yui_3_16_0_ym19_1_1519085807369_= 70572">2018-02-20 14:39:02,295+0800 INFO  (jsonrpc/6) [vdsm.api] START= repoStats(options=3DNone) from=3D::ffff:10.10.43.1,60554, flow_id=3D13149d= 6e, task_id=3D5f19d76a-d343-4dc4-ad09-024ec27f7443 (api:46)<br id=3D"yui_3_= 16_0_ym19_1_1519085807369_70573">2018-02-20 14:39:02,295+0800 INFO  (j= sonrpc/6) [vdsm.api] FINISH repoStats return=3D{'f3e372e3-1251-4195-a4b9-10= 27e40059df': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'd= elay': '9.4759e-05', 'lastCheck': '1.1', 'valid': True}, 'e83d0d46-6ea6-4aa= 3-80bf-6e95c66b0454': {'code': 0, 'actual': True, 'version': 0, 'acquired':= True, 'delay': '0.000183158', 'lastCheck': '1.0', 'valid': True}, '65ca2e2= d-b472-4bee-85b4-09a161464b20': {'code': 0, 'actual': True, 'version': 4, '= acquired': True, 'delay': '0.000222609', 'lastCheck': '1.0', 'valid': True}= , '4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': {'code': 0, 'actual': True, 'vers= ion': 0, 'acquired': True, 'delay': '0.000211253', 'lastCheck': '1.0', 'val= id': True}, '42e591b7-f86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': T= rue, 'version': 4, 'acquired': True, 'delay': '0.000243658', 'lastCheck': '= 1.1', 'valid': True}} from=3D::ffff:10.10.43.1,60554, flow_id=3D13149d6e, t= ask_id=3D5f19d76a-d343-4dc4-ad09-024ec27f7443 (api:52)<br id=3D"yui_3_16_0_= ym19_1_1519085807369_70574">2018-02-20 14:39:02,300+0800 INFO  (jsonrp= c/6) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 secon= ds (__init__:539)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70575">2018-02-2= 0 14:39:10,270+0800 INFO  (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call= Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br id=3D"yui_3= _16_0_ym19_1_1519085807369_70576">2018-02-20 14:39:13,631+0800 INFO  (= jsonrpc/0) [vdsm.api] START connectStorageServer(domType=3D1, spUUID=3Du'00= 000000-0000-0000-0000-000000000000', conList=3D[{u'id': u'5e4c94f1-f3b9-4fb= d-a6c7-e732d0fe3123', u'connection': u'dev2node1.lares.com.ph:/run/media/ro= ot/Slave1Data/dataNode1', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'proto= col_version': u'auto', u'password': '********', u'port': u''}], options=3DN= one) from=3D::ffff:10.10.43.1,60554, flow_id=3D15b57417, task_id=3Dbfce1e70= -ef4a-4e13-aaaa-7a66aaf44429 (api:46)<br id=3D"yui_3_16_0_ym19_1_1519085807= 369_70577">2018-02-20 14:39:13,633+0800 INFO  (jsonrpc/0) [vdsm.api] F= INISH connectStorageServer return=3D{'statuslist': [{'status': 0, 'id': u'5= e4c94f1-f3b9-4fbd-a6c7-e732d0fe3123'}]} from=3D::ffff:10.10.43.1,60554, flo= w_id=3D15b57417, task_id=3Dbfce1e70-ef4a-4e13-aaaa-7a66aaf44429 (api:52)<br= id=3D"yui_3_16_0_ym19_1_1519085807369_70578">2018-02-20 14:39:13,634+0800 = INFO  (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call StoragePool.connect= StorageServer succeeded in 0.00 seconds (__init__:539)<br id=3D"yui_3_16_0_= ym19_1_1519085807369_70579">2018-02-20 14:39:13,806+0800 INFO  (jsonrp= c/7) [vdsm.api] START connectStoragePool(spUUID=3Du'5a865884-0366-0330-02b8= -0000000002d4', hostID=3D1, msdUUID=3Du'f3e372e3-1251-4195-a4b9-1027e40059d= f', masterVersion=3D65, domainsMap=3D{u'e83d0d46-6ea6-4aa3-80bf-6e95c66b045= 4': u'active', u'4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': u'active', u'225e19= 75-8121-4370-b317-86e964ae326f': u'attached', u'f3e372e3-1251-4195-a4b9-102= 7e40059df': u'active', u'65ca2e2d-b472-4bee-85b4-09a161464b20': u'active', = u'42e591b7-f86c-4b67-a3d2-40cc007f7662': u'active'}, options=3DNone) from= =3D::ffff:10.10.43.1,60554, flow_id=3D15b57417, task_id=3D927a5d9a-4304-477= 6-b5c9-22ba5d0cb853 (api:46)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70580= ">2018-02-20 14:39:13,807+0800 INFO  (jsonrpc/7) [storage.StoragePoolM= emoryBackend] new storage pool master version 65 and domains map {u'e83d0d4= 6-6ea6-4aa3-80bf-6e95c66b0454': u'Active', u'4bf2ba2f-f57a-4d9f-b42a-fb78f4= 40a358': u'Active', u'225e1975-8121-4370-b317-86e964ae326f': u'Attached', u= 'f3e372e3-1251-4195-a4b9-1027e40059df': u'Active', u'65ca2e2d-b472-4bee-85b= 4-09a161464b20': u'Active', u'42e591b7-f86c-4b67-a3d2-40cc007f7662': u'Acti= ve'} (spbackends:450)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70581"></div= ><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_70649"><br></div><d= iv dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_70648">VDSM.log 2</div= ><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_70650">2018-02-20 1= 4:41:14,598+0800 INFO  (periodic/3) [vdsm.api] FINISH repoStats return= =3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, 'actual': True, 've= rsion': 4, 'acquired': True, 'delay': '0.000252423', 'lastCheck': '6.0', 'v= alid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'code': 0, 'actual':= True, 'version': 0, 'acquired': True, 'delay': '7.5567e-05', 'lastCheck': = '6.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a161464b20': {'code': 0, = 'actual': True, 'version': 4, 'acquired': True, 'delay': '8.2433e-05', 'las= tCheck': '6.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': {'c= ode': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000237= 247', 'lastCheck': '5.9', 'valid': True}, '42e591b7-f86c-4b67-a3d2-40cc007f= 7662': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay':= '8.4376e-05', 'lastCheck': '6.0', 'valid': True}} from=3Dinternal, task_id= =3D6213712b-9903-4db8-9836-3baf85cd63e4 (api:52)<br id=3D"yui_3_16_0_ym19_1= _1519085807369_70683">2018-02-20 14:41:18,074+0800 INFO  (jsonrpc/6) [= jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 second= s (__init__:539)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70684">2018-02-20= 14:41:24,333+0800 INFO  (jsonrpc/4) [vdsm.api] START repoStats(option= s=3DNone) from=3D::ffff:10.10.43.1,56540, flow_id=3D73f86113, task_id=3De82= 31ecb-3543-4d8f-af54-4cf2b06ee98a (api:46)<br id=3D"yui_3_16_0_ym19_1_15190= 85807369_70685">2018-02-20 14:41:24,334+0800 INFO  (jsonrpc/4) [vdsm.a= pi] FINISH repoStats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'co= de': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.0001729= 53', 'lastCheck': '5.7', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0= 454': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': = '7.701e-05', 'lastCheck': '5.7', 'valid': True}, '65ca2e2d-b472-4bee-85b4-0= 9a161464b20': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, '= delay': '0.000117677', 'lastCheck': '5.7', 'valid': True}, '4bf2ba2f-f57a-4= d9f-b42a-fb78f440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired= ': True, 'delay': '0.000185146', 'lastCheck': '5.7', 'valid': True}, '42e59= 1b7-f86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4,= 'acquired': True, 'delay': '9.1467e-05', 'lastCheck': '5.8', 'valid': True= }} from=3D::ffff:10.10.43.1,56540, flow_id=3D73f86113, task_id=3De8231ecb-3= 543-4d8f-af54-4cf2b06ee98a (api:52)<br id=3D"yui_3_16_0_ym19_1_151908580736= 9_70686">2018-02-20 14:41:24,338+0800 INFO  (jsonrpc/4) [jsonrpc.JsonR= pcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:539)<b= r id=3D"yui_3_16_0_ym19_1_1519085807369_70687">2018-02-20 14:41:27,087+0800= INFO  (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats= succeeded in 0.00 seconds (__init__:539)<br id=3D"yui_3_16_0_ym19_1_151908= 5807369_70688">2018-02-20 14:41:29,607+0800 INFO  (periodic/1) [vdsm.a= pi] START repoStats(options=3DNone) from=3Dinternal, task_id=3Df14b7aab-b64= a-4903-9368-d665e39b49d1 (api:46)<br id=3D"yui_3_16_0_ym19_1_1519085807369_= 70689">2018-02-20 14:41:29,608+0800 INFO  (periodic/1) [vdsm.api] FINI= SH repoStats return=3D{'f3e372e3-1251-4195-a4b9-1027e40059df': {'code': 0, = 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000246237', 'la= stCheck': '1.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-80bf-6e95c66b0454': {'= code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '8.8773e= -05', 'lastCheck': '1.0', 'valid': True}, '65ca2e2d-b472-4bee-85b4-09a16146= 4b20': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay':= '9.7145e-05', 'lastCheck': '1.0', 'valid': True}, '4bf2ba2f-f57a-4d9f-b42a= -fb78f440a358': {'code': 0, 'actual': True, 'version': 0, 'acquired': True,= 'delay': '0.000218729', 'lastCheck': '0.9', 'valid': True}, '42e591b7-f86c= -4b67-a3d2-40cc007f7662': {'code': 0, 'actual': True, 'version': 4, 'acquir= ed': True, 'delay': '9.1035e-05', 'lastCheck': '1.0', 'valid': True}} from= =3Dinternal, task_id=3Df14b7aab-b64a-4903-9368-d665e39b49d1 (api:52)<br id= =3D"yui_3_16_0_ym19_1_1519085807369_70690">2018-02-20 14:41:33,079+0800 INF= O  (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats suc= ceeded in 0.00 seconds (__init__:539)<br id=3D"yui_3_16_0_ym19_1_1519085807= 369_70691">2018-02-20 14:41:40,456+0800 INFO  (jsonrpc/2) [vdsm.api] S= TART repoStats(options=3DNone) from=3D::ffff:10.10.43.1,56540, flow_id=3D3b= e8150c, task_id=3D1b0c86a8-6fd8-4882-a742-fbd56ccb4037 (api:46)<br id=3D"yu= i_3_16_0_ym19_1_1519085807369_70692">2018-02-20 14:41:40,457+0800 INFO&nbsp= ; (jsonrpc/2) [vdsm.api] FINISH repoStats return=3D{'f3e372e3-1251-4195-a4b= 9-1027e40059df': {'code': 0, 'actual': True, 'version': 4, 'acquired': True= , 'delay': '0.000174027', 'lastCheck': '1.8', 'valid': True}, 'e83d0d46-6ea= 6-4aa3-80bf-6e95c66b0454': {'code': 0, 'actual': True, 'version': 0, 'acqui= red': True, 'delay': '0.00011454', 'lastCheck': '1.8', 'valid': True}, '65c= a2e2d-b472-4bee-85b4-09a161464b20': {'code': 0, 'actual': True, 'version': = 4, 'acquired': True, 'delay': '0.000145955', 'lastCheck': '1.8', 'valid': T= rue}, '4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': {'code': 0, 'actual': True, '= version': 0, 'acquired': True, 'delay': '0.000209871', 'lastCheck': '1.8', = 'valid': True}, '42e591b7-f86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual= ': True, 'version': 4, 'acquired': True, 'delay': '9.5744e-05', 'lastCheck'= : '1.9', 'valid': True}} from=3D::ffff:10.10.43.1,56540, flow_id=3D3be8150c= , task_id=3D1b0c86a8-6fd8-4882-a742-fbd56ccb4037 (api:52)<br id=3D"yui_3_16= _0_ym19_1_1519085807369_70693">2018-02-20 14:41:40,461+0800 INFO  (jso= nrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 se= conds (__init__:539)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70694">2018-0= 2-20 14:41:42,106+0800 INFO  (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC c= all Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br id=3D"yu= i_3_16_0_ym19_1_1519085807369_70695">2018-02-20 14:41:44,622+0800 INFO&nbsp= ; (periodic/3) [vdsm.api] START repoStats(options=3DNone) from=3Dinternal, = task_id=3D20e0b29b-d3cd-4e44-b92c-213f9c984ab2 (api:46)<br id=3D"yui_3_16_0= _ym19_1_1519085807369_70696">2018-02-20 14:41:44,622+0800 INFO  (perio= dic/3) [vdsm.api] FINISH repoStats return=3D{'f3e372e3-1251-4195-a4b9-1027e= 40059df': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'dela= y': '0.000174027', 'lastCheck': '6.0', 'valid': True}, 'e83d0d46-6ea6-4aa3-= 80bf-6e95c66b0454': {'code': 0, 'actual': True, 'version': 0, 'acquired': T= rue, 'delay': '0.00011454', 'lastCheck': '6.0', 'valid': True}, '65ca2e2d-b= 472-4bee-85b4-09a161464b20': {'code': 0, 'actual': True, 'version': 4, 'acq= uired': True, 'delay': '0.000145955', 'lastCheck': '6.0', 'valid': True}, '= 4bf2ba2f-f57a-4d9f-b42a-fb78f440a358': {'code': 0, 'actual': True, 'version= ': 0, 'acquired': True, 'delay': '0.000209871', 'lastCheck': '5.9', 'valid'= : True}, '42e591b7-f86c-4b67-a3d2-40cc007f7662': {'code': 0, 'actual': True= , 'version': 4, 'acquired': True, 'delay': '9.5744e-05', 'lastCheck': '6.0'= , 'valid': True}} from=3Dinternal, task_id=3D20e0b29b-d3cd-4e44-b92c-213f9c= 984ab2 (api:52)<br id=3D"yui_3_16_0_ym19_1_1519085807369_70697">2018-02-20 = 14:41:49,083+0800 INFO  (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call H= ost.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br id=3D"yui_3_1= 6_0_ym19_1_1519085807369_70698"></div><div dir=3D"ltr"><br></div><div dir= =3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_70767"><br></div><div dir=3D= "ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_70768">Engine log</div><div dir= =3D"ltr"><br></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_7= 0769">skId '404ccecc-aa7f-45ea-89e4-726956269bc9' task status 'finished'<br= id=3D"yui_3_16_0_ym19_1_1519085807369_70808">2018-02-20 14:42:21,966+08 IN= FO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (or= g.ovirt.thread.pool-7-thread-38) [29528f9] spmStart polling ended, spm stat= us: SPM<br id=3D"yui_3_16_0_ym19_1_1519085807369_70809">2018-02-20 14:42:21= ,967+08 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskV= DSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9] START, HSMClearTas= kVDSCommand(HostName =3D Node1, HSMTaskGuidBaseVDSCommandParameters:{runAsy= nc=3D'true', hostId=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4', taskId=3D'404= ccecc-aa7f-45ea-89e4-726956269bc9'}), log id: 71688f70<br id=3D"yui_3_16_0_= ym19_1_1519085807369_70810">2018-02-20 14:42:22,922+08 INFO  [org.ovir= t.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread= .pool-7-thread-38) [29528f9] FINISH, HSMClearTaskVDSCommand, log id: 71688f= 70<br id=3D"yui_3_16_0_ym19_1_1519085807369_70811">2018-02-20 14:42:22,923+= 08 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand= ] (org.ovirt.thread.pool-7-thread-38) [29528f9] FINISH, SpmStartVDSCommand,= return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7833= 2453, log id: 3ea35d5<br id=3D"yui_3_16_0_ym19_1_1519085807369_70812">2018-= 02-20 14:42:22,935+08 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker= .IrsProxy] (org.ovirt.thread.pool-7-thread-38) [29528f9] Initialize Irs pro= xy from vds: dev2node1.lares.com.ph<br id=3D"yui_3_16_0_ym19_1_151908580736= 9_70813">2018-02-20 14:42:22,951+08 INFO  [org.ovirt.engine.core.dal.d= bbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-= 38) [29528f9] EVENT_ID: IRS_HOSTED_ON_VDS(204), Correlation ID: null, Call = Stack: null, Custom ID: null, Custom Event ID: -1, Message: Storage Pool Ma= nager runs on Host Node1 (Address: dev2node1.lares.com.ph).<br id=3D"yui_3_= 16_0_ym19_1_1519085807369_70814">2018-02-20 14:42:22,952+08 INFO  [org= .ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.o= virt.thread.pool-7-thread-38) [29528f9] -- executeIrsBrokerCommand: Attempt= ing on storage pool '5a865884-0366-0330-02b8-0000000002d4'<br id=3D"yui_3_1= 6_0_ym19_1_1519085807369_70815">2018-02-20 14:42:22,952+08 INFO  [org.= ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ov= irt.thread.pool-7-thread-38) [29528f9] START, HSMGetAllTasksInfoVDSCommand(= HostName =3D Node1, VdsIdVDSCommandParametersBase:{runAsync=3D'true', hostI= d=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4'}), log id: 1bdbea9d<br id=3D"yui= _3_16_0_ym19_1_1519085807369_70816">2018-02-20 14:42:22,955+08 INFO  [= org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (or= g.ovirt.thread.pool-7-thread-7) [29528f9] START, SPMGetAllTasksInfoVDSComma= nd( IrsBaseVDSCommandParameters:{runAsync=3D'true', storagePoolId=3D'5a8658= 84-0366-0330-02b8-0000000002d4', ignoreFailoverLimit=3D'false'}), log id: 5= c2422d6<br id=3D"yui_3_16_0_ym19_1_1519085807369_70817">2018-02-20 14:42:23= ,956+08 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTask= sInfoVDSCommand] (org.ovirt.thread.pool-7-thread-38) [29528f9] FINISH, HSMG= etAllTasksInfoVDSCommand, return: [], log id: 1bdbea9d<br id=3D"yui_3_16_0_= ym19_1_1519085807369_70818">2018-02-20 14:42:23,956+08 INFO  [org.ovir= t.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.= thread.pool-7-thread-38) [29528f9] FINISH, SPMGetAllTasksInfoVDSCommand, re= turn: [], log id: 58cbe7b7<br id=3D"yui_3_16_0_ym19_1_1519085807369_70819">= 2018-02-20 14:42:23,956+08 INFO  [org.ovirt.engine.core.bll.tasks.Asyn= cTaskManager] (org.ovirt.thread.pool-7-thread-38) [29528f9] Discovered no t= asks on Storage Pool 'UnsecuredEnv'<br id=3D"yui_3_16_0_ym19_1_151908580736= 9_70820">2018-02-20 14:42:24,936+08 INFO  [org.ovirt.vdsm.jsonrpc.clie= nt.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to dev2node1.l= ares.com.ph/10.10.43.2<br id=3D"yui_3_16_0_ym19_1_1519085807369_70821">2018= -02-20 14:42:27,012+08 WARN  [org.ovirt.engine.core.vdsbroker.irsbroke= r.IrsProxy] (org.ovirt.thread.pool-7-thread-43) [] Master domain is not in = sync between DB and VDSM. Domain Node1Container marked as master in DB and = not in the storage<br id=3D"yui_3_16_0_ym19_1_1519085807369_70822">2018-02-= 20 14:42:27,026+08 WARN  [org.ovirt.engine.core.dal.dbbroker.auditlogh= andling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-43) [] EVENT_ID: = SYSTEM_MASTER_DOMAIN_NOT_IN_SYNC(990), Correlation ID: null, Call Stack: nu= ll, Custom ID: null, Custom Event ID: -1, Message: Sync Error on Master Dom= ain between Host Node1 and oVirt Engine. Domain: Node1Container is marked a= s Master in oVirt Engine database but not on the Storage side. Please consu= lt with Support on how to fix this issue.<br id=3D"yui_3_16_0_ym19_1_151908= 5807369_70823">2018-02-20 14:42:27,103+08 INFO  [org.ovirt.engine.core= .bll.storage.pool.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-= thread-43) [3e5965ca] Running command: ReconstructMasterDomainCommand inter= nal: true. Entities affected :  ID: f3e372e3-1251-4195-a4b9-1027e40059= df Type: Storage<br id=3D"yui_3_16_0_ym19_1_1519085807369_70824">2018-02-20= 14:42:27,137+08 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.Rese= tIrsVDSCommand] (org.ovirt.thread.pool-7-thread-43) [3e5965ca] START, Reset= IrsVDSCommand( ResetIrsVDSCommandParameters:{runAsync=3D'true', storagePool= Id=3D'5a865884-0366-0330-02b8-0000000002d4', ignoreFailoverLimit=3D'false',= vdsId=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4', ignoreStopFailed=3D'true'}= ), log id: 3e0a239d<br id=3D"yui_3_16_0_ym19_1_1519085807369_70825">2018-02= -20 14:42:27,140+08 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.S= pmStopVDSCommand] (org.ovirt.thread.pool-7-thread-43) [3e5965ca] START, Spm= StopVDSCommand(HostName =3D Node1, SpmStopVDSCommandParameters:{runAsync=3D= 'true', hostId=3D'7dee35bb-8c97-4f6a-b6cd-abc4258540e4', storagePoolId=3D'5= a865884-0366-0330-02b8-0000000002d4'}), log id: 7c67bf06<br id=3D"yui_3_16_= 0_ym19_1_1519085807369_70826">2018-02-20 14:42:28,144+08 INFO  [org.ov= irt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.po= ol-7-thread-43) [3e5965ca] SpmStopVDSCommand::Stopping SPM on vds 'Node1', = pool id '5a865884-0366-0330-02b8-0000000002d4'<br></div><div id=3D"yui_3_16= _0_ym19_1_1519085807369_70529"><span></span></div> <div class=3D"qtdSeparat= eBR"><br><br></div><div class=3D"yahoo_quoted" style=3D"display: block;"> <= div style=3D"font-family: Helvetica Neue, Helvetica, Arial, Lucida Grande, = sans-serif; font-size: 10px;"> <div style=3D"font-family: HelveticaNeue, He= lvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;= "> <div dir=3D"ltr"><font size=3D"2" face=3D"Arial"> On Tuesday, February 2= 0, 2018 2:33 PM, michael pagdanganan <mhke_aj5566(a)yahoo.com> wrote:<b= r></font></div> <br><br> <div class=3D"y_msg_container"><div id=3D"yiv0115= 319588"><div><div style=3D"color:#000;background-color:#fff;font-family:Hel= vetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:10px;"><= div id=3D"yiv0115319588yui_3_16_0_ym19_1_1519085807369_60672"><font size=3D= "3">Thanks for quick response,</font></div><div id=3D"yiv0115319588yui_3_16= _0_ym19_1_1519085807369_62803"><font size=3D"3"><br clear=3D"none"></font><= /div><div id=3D"yiv0115319588yui_3_16_0_ym19_1_1519085807369_64423"><font s= ize=3D"3">see attachment.<br clear=3D"none"></font></div><div id=3D"yiv0115= 319588yui_3_16_0_ym19_1_1519085807369_60552"><span></span></div> <div class= =3D"yiv0115319588qtdSeparateBR"><br clear=3D"none"><br clear=3D"none"></div= ><div class=3D"yiv0115319588yahoo_quoted" style=3D"display:block;"> <div st= yle=3D"font-family:Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-se= rif;font-size:10px;"> <div style=3D"font-family:HelveticaNeue, Helvetica Ne= ue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px;"> <div clas= s=3D"yiv0115319588yqt2980525560" id=3D"yiv0115319588yqtfd88886"><div dir=3D= "ltr"><font size=3D"2" face=3D"Arial"> On Tuesday, February 20, 2018 2:10 P= M, Eyal Shenitzky <eshenitz(a)redhat.com> wrote:<br clear=3D"none"></fo= nt></div> <br clear=3D"none"><br clear=3D"none"> <div class=3D"yiv01153195= 88y_msg_container"><div id=3D"yiv0115319588"><div><div dir=3D"ltr">Hi,&nbsp= ;<div><br clear=3D"none"></div><div>Can you please attach full Engine and V= DSM logs?</div><div><br clear=3D"none"></div><div>Thanks,</div></div><div c= lass=3D"yiv0115319588gmail_extra"><br clear=3D"none"><div class=3D"yiv01153= 19588gmail_quote">On Tue, Feb 20, 2018 at 2:59 AM, michael pagdanganan <spa= n dir=3D"ltr"><<a rel=3D"nofollow" shape=3D"rect" ymailto=3D"mailto:mhke= _aj5566(a)yahoo.com" target=3D"_blank" href=3D"mailto:mhke_aj5566@yahoo.com">= mhke_aj5566(a)yahoo.com</a>></span> wrote:<br clear=3D"none"><blockquote c= lass=3D"yiv0115319588gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p= x #ccc solid;padding-left:1ex;"><div class=3D"yiv0115319588yqt7135196070" i= d=3D"yiv0115319588yqt29383"><div><div style=3D"color:#000;background-color:= #fff;font-family:Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-seri= f;font-size:10px;"><div dir=3D"ltr" id=3D"yiv0115319588m_-46053014922747698= 28yui_3_16_0_ym19_1_1519085807369_10542"><font id=3D"yiv0115319588m_-460530= 1492274769828yui_3_16_0_ym19_1_1519085807369_15967" size=3D"3">My storage p= ool has 2 Master Domain(</font><font id=3D"yiv0115319588m_-4605301492274769= 828yui_3_16_0_ym19_1_1519085807369_16063" size=3D"3"><font id=3D"yiv0115319= 588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_15968" size=3D"3">= Stored2 on Node2,Node1Container on Node1)</font>. and my old master domain = </font><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151= 9085807369_15934" size=3D"3"><font id=3D"yiv0115319588m_-460530149227476982= 8yui_3_16_0_ym19_1_1519085807369_16064" size=3D"3">(</font><font id=3D"yiv0= 115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_16065" size= =3D"3"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151= 9085807369_16066" size=3D"3">DATANd01 on Node1 )</font></font> hung on prep= aring for maintenance. When I tried to activate my old master domain (</fon= t><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_15190858= 07369_10517" size=3D"3"><font id=3D"yiv0115319588m_-4605301492274769828yui_= 3_16_0_ym19_1_1519085807369_15935" size=3D"3">DATANd01 on Node1 )</font> al= l  storage domain goes down and up master keep on rotating.</font></di= v><div id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908580= 7369_10905"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_= 1_1519085807369_10517" size=3D"3"><br clear=3D"none"></font></div><div id= =3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_1069= 2"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085= 807369_10517" size=3D"3"><br clear=3D"none"></font></div><div dir=3D"ltr" i= d=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_107= 10"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908= 5807369_10517" size=3D"3">Ovirt Version (oVirt Engine Version: 4.1.9.1.el7.= centos)<br clear=3D"none"></font></div><div dir=3D"ltr" id=3D"yiv0115319588= m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_14202"><font id=3D"yi= v0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10517" siz= e=3D"3"><br clear=3D"none"></font></div><div dir=3D"ltr" id=3D"yiv011531958= 8m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_12604"><font id=3D"y= iv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10517" si= ze=3D"3"><br clear=3D"none"></font></div><div dir=3D"ltr" id=3D"yiv01153195= 88m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_14203"><font id=3D"= yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10517" s= ize=3D"3">Event Error:</font></div><div dir=3D"ltr" id=3D"yiv0115319588m_-4= 605301492274769828yui_3_16_0_ym19_1_1519085807369_14215"><font id=3D"yiv011= 5319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10517" size=3D= "3">Sync Error on Master Domain between Host Node2 and oVirt Engine. Domain= Stored2 is marked as master in ovirt engine Database but not on storage si= de Please consult with support<br id=3D"yiv0115319588m_-4605301492274769828= yui_3_16_0_ym19_1_1519085807369_12607" clear=3D"none"></font></div><div dir= =3D"ltr" id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085= 807369_14204"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym1= 9_1_1519085807369_10517" size=3D"3"><br clear=3D"none"></font></div><div di= r=3D"ltr" id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908= 5807369_15891"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym= 19_1_1519085807369_10517" size=3D"3">VDSM Node2 command ConnectStoragePoolV= DS failed: Wrong Master domain or it's version: u'SD=3Df3e372e3-1251-4195-a= 4b9- 1027e40059df, pool=3D5a865884-0366-0330-02b8- 0000</font></div><div di= r=3D"ltr" id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908= 5807369_15895"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym= 19_1_1519085807369_10517" size=3D"3"><br clear=3D"none"></font></div><div d= ir=3D"ltr" id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_15190= 85807369_15896"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_y= m19_1_1519085807369_10517" size=3D"3">VDSM Node2 command HSMGetAllTastsStat= usesVDS failed: Not SPM: ()<br id=3D"yiv0115319588m_-4605301492274769828yui= _3_16_0_ym19_1_1519085807369_15901" clear=3D"none"><br id=3D"yiv0115319588m= _-4605301492274769828yui_3_16_0_ym19_1_1519085807369_15902" clear=3D"none">= Failed to deactivate Storage Domain DATANd01 (Data Center UnsecuredEnv)<br = clear=3D"none"></font></div><div id=3D"yiv0115319588m_-4605301492274769828y= ui_3_16_0_ym19_1_1519085807369_10545"><font id=3D"yiv0115319588m_-460530149= 2274769828yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><br clear=3D"no= ne"></font></div><div id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_y= m19_1_1519085807369_10551"><font id=3D"yiv0115319588m_-4605301492274769828y= ui_3_16_0_ym19_1_1519085807369_10517" size=3D"3">Here's logs from engine:</= font></div><div id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_= 1519085807369_10620"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_1= 6_0_ym19_1_1519085807369_10517" size=3D"3"><br clear=3D"none"></font></div>= <div id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_15190858073= 69_10573"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_= 1519085807369_10517" size=3D"3">------------------------------ ------------= ------------------ ------------------------------ -------------</font></div= ><div dir=3D"ltr" id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_= 1_1519085807369_10588"><font id=3D"yiv0115319588m_-4605301492274769828yui_3= _16_0_ym19_1_1519085807369_10517" size=3D"3">[root@dev2engine ~]# tail /var= /log/messages<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1= _1519085807369_10609" clear=3D"none">Feb 20 07:01:01 dev2engine systemd: St= arting Session 20 of user root.<br id=3D"yiv0115319588m_-460530149227476982= 8yui_3_16_0_ym19_1_1519085807369_10610" clear=3D"none">Feb 20 07:01:01 dev2= engine systemd: Removed slice User Slice of root.<br id=3D"yiv0115319588m_-= 4605301492274769828yui_3_16_0_ym19_1_1519085807369_10611" clear=3D"none">Fe= b 20 07:01:01 dev2engine systemd: Stopping User Slice of root.<br id=3D"yiv= 0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10612" clea= r=3D"none">Feb 20 07:58:52 dev2engine systemd: Created slice User Slice of = root.<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085= 807369_10613" clear=3D"none">Feb 20 07:58:52 dev2engine systemd: Starting U= ser Slice of root.<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_y= m19_1_1519085807369_10614" clear=3D"none">Feb 20 07:58:52 dev2engine system= d-logind: New session 21 of user root.<br id=3D"yiv0115319588m_-46053014922= 74769828yui_3_16_0_ym19_1_1519085807369_10615" clear=3D"none">Feb 20 07:58:= 52 dev2engine systemd: Started Session 21 of user root.<br id=3D"yiv0115319= 588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10616" clear=3D"no= ne">Feb 20 07:58:52 dev2engine systemd: Starting Session 21 of user root.<b= r id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_= 10617" clear=3D"none">Feb 20 08:01:01 dev2engine systemd: Started Session 2= 2 of user root.<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19= _1_1519085807369_10618" clear=3D"none">Feb 20 08:01:01 dev2engine systemd: = Starting Session 22 of user root.</font></div><div dir=3D"ltr" id=3D"yiv011= 5319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10619"><font i= d=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_105= 17" size=3D"3"><br clear=3D"none"></font></div><div dir=3D"ltr" id=3D"yiv01= 15319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10623"><br cl= ear=3D"none"><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19= _1_1519085807369_10517" size=3D"3"><font id=3D"yiv0115319588m_-460530149227= 4769828yui_3_16_0_ym19_1_1519085807369_10626" size=3D"3">------------------= ------------ ------------------------------ ------------------------------ = -------------</font></font></div><div dir=3D"ltr" id=3D"yiv0115319588m_-460= 5301492274769828yui_3_16_0_ym19_1_1519085807369_10654"><font id=3D"yiv01153= 19588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3= "><font id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_15190858= 07369_10626" size=3D"3">[root@dev2engine ~]# tail /var/log/ovirt-engine/eng= ine. log<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519= 085807369_10677" clear=3D"none">2018-02-20 08:01:16,062+08 INFO  [org.= ovirt.engine.core.bll. eventqueue.EventQueueMonitor] (org.ovirt.thread.pool= -7- thread-32) [102e9d3c] Finished reconstruct for pool '5a865884-0366-0330= -02b8- 0000000002d4'. Clearing event queue<br id=3D"yiv0115319588m_-4605301= 492274769828yui_3_16_0_ym19_1_1519085807369_10678" clear=3D"none">2018-02-2= 0 08:01:27,825+08 WARN  [org.ovirt.engine.core. vdsbroker.irsbroker.Ir= sProxy] (org.ovirt.thread.pool-7- thread-23) [] Master domain is not in syn= c between DB and VDSM. Domain Stored2 marked as master in DB and not in the= storage<br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519= 085807369_10679" clear=3D"none">2018-02-20 08:01:27,862+08 WARN  [org.= ovirt.engine.core.bll. storage.pool. ReconstructMasterDomainCommand ] (org.= ovirt.thread.pool-7- thread-23) [213f42b9] Validation of action 'Reconstruc= tMasterDomain' failed for user SYSTEM. Reasons: VAR__ACTION__RECONSTRUCT_ M= ASTER,VAR__TYPE__STORAGE__ DOMAIN,ACTION_TYPE_FAILED_ STORAGE_DOMAIN_STATUS= _ ILLEGAL2,$status PreparingForMaintenance<br id=3D"yiv0115319588m_-4605301= 492274769828yui_3_16_0_ym19_1_1519085807369_10680" clear=3D"none">2018-02-2= 0 08:01:27,882+08 INFO  [org.ovirt.engine.core.bll. eventqueue.EventQu= eueMonitor] (org.ovirt.thread.pool-7- thread-20) [929330e] Finished reconst= ruct for pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing event queue= <br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908580736= 9_10681" clear=3D"none">2018-02-20 08:01:40,106+08 WARN  [org.ovirt.en= gine.core. vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-7- thread-1= 7) [] Master domain is not in sync between DB and VDSM. Domain Stored2 mark= ed as master in DB and not in the storage<br id=3D"yiv0115319588m_-46053014= 92274769828yui_3_16_0_ym19_1_1519085807369_10682" clear=3D"none">2018-02-20= 08:01:40,197+08 WARN  [org.ovirt.engine.core.bll. storage.pool. Recon= structMasterDomainCommand ] (org.ovirt.thread.pool-7- thread-17) [7af552c1]= Validation of action 'ReconstructMasterDomain' failed for user SYSTEM. Rea= sons: VAR__ACTION__RECONSTRUCT_ MASTER,VAR__TYPE__STORAGE__ DOMAIN,ACTION_T= YPE_FAILED_ STORAGE_DOMAIN_STATUS_ ILLEGAL2,$status PreparingForMaintenance= <br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908580736= 9_10683" clear=3D"none">2018-02-20 08:01:40,246+08 INFO  [org.ovirt.en= gine.core.bll. eventqueue.EventQueueMonitor] (org.ovirt.thread.pool-7- thre= ad-22) [73673040] Finished reconstruct for pool '5a865884-0366-0330-02b8- 0= 000000002d4'. Clearing event queue<br id=3D"yiv0115319588m_-460530149227476= 9828yui_3_16_0_ym19_1_1519085807369_10684" clear=3D"none">2018-02-20 08:01:= 51,809+08 WARN  [org.ovirt.engine.core. vdsbroker.irsbroker.IrsProxy] = (org.ovirt.thread.pool-7- thread-26) [] Master domain is not in sync betwee= n DB and VDSM. Domain Stored2 marked as master in DB and not in the storage= <br id=3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_151908580736= 9_10685" clear=3D"none">2018-02-20 08:01:51,846+08 WARN  [org.ovirt.en= gine.core.bll. storage.pool. ReconstructMasterDomainCommand ] (org.ovirt.th= read.pool-7- thread-26) [20307cbe] Validation of action 'ReconstructMasterD= omain' failed for user SYSTEM. Reasons: VAR__ACTION__RECONSTRUCT_ MASTER,VA= R__TYPE__STORAGE__ DOMAIN,ACTION_TYPE_FAILED_ STORAGE_DOMAIN_STATUS_ ILLEGA= L2,$status PreparingForMaintenance<br id=3D"yiv0115319588m_-460530149227476= 9828yui_3_16_0_ym19_1_1519085807369_10686" clear=3D"none">2018-02-20 08:01:= 51,866+08 INFO  [org.ovirt.engine.core.bll. eventqueue.EventQueueMonit= or] (org.ovirt.thread.pool-7- thread-49) [2c11a866] Finished reconstruct fo= r pool '5a865884-0366-0330-02b8- 0000000002d4'. Clearing event queue<br id= =3D"yiv0115319588m_-4605301492274769828yui_3_16_0_ym19_1_1519085807369_1068= 7" clear=3D"none"><br clear=3D"none"></font></font></div></div></div></div>= <br clear=3D"none">______________________________ _________________<br clea= r=3D"none"> Users mailing list<br clear=3D"none"> <a rel=3D"nofollow" shape=3D"rect" ymailto=3D"mailto:Users@ovirt.org" targe= t=3D"_blank" href=3D"mailto:Users@ovirt.org">Users(a)ovirt.org</a><br clear= =3D"none"> <a rel=3D"nofollow" shape=3D"rect" target=3D"_blank" href=3D"http://lists.o= virt.org/mailman/listinfo/users">http://lists.ovirt.org/ mailman/listinfo/u= sers</a><br clear=3D"none"> <br clear=3D"none"></blockquote></div><br clear=3D"none"><br clear=3D"all">= <div><br clear=3D"none"></div>-- <br clear=3D"none"><div class=3D"yiv011531= 9588gmail_signature"><div dir=3D"ltr">Regards,<div>Eyal Shenitzky</div></di= v></div> </div></div></div><br clear=3D"none"><br clear=3D"none"></div> </div></div= ><div class=3D"yiv0115319588yqt2980525560" id=3D"yiv0115319588yqtfd94549"> = </div></div><div class=3D"yiv0115319588yqt2980525560" id=3D"yiv0115319588yq= tfd67072"> </div></div></div></div></div><br><br></div> </div> </div> </= div></div></body></html> ------=_Part_2010355_281080504.1519108987392--

2 7

2 Master on Storage Pool [Event Error]
by michael pagdanganan 20 Feb '18

20 Feb '18

------=_Part_1848497_1716892283.1519088345205 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable My storage pool has 2 Master Domain(Stored2 on Node2,Node1Container on Node= 1). and my old master domain (DATANd01 on Node1 ) hung on preparing for mai= ntenance. When I tried to activate my old master domain (DATANd01 on Node1 = ) all=C2=A0 storage domain goes down and up master keep on rotating. Ovirt Version (oVirt Engine Version: 4.1.9.1.el7.centos) Event Error:Sync Error on Master Domain between Host Node2 and oVirt Engine= . Domain Stored2 is marked as master in ovirt engine Database but not on st= orage side Please consult with support VDSM Node2 command ConnectStoragePoolVDS failed: Wrong Master domain or it'= s version: u'SD=3Df3e372e3-1251-4195-a4b9-1027e40059df, pool=3D5a865884-036= 6-0330-02b8-0000 VDSM Node2 command HSMGetAllTastsStatusesVDS failed: Not SPM: () Failed to deactivate Storage Domain DATANd01 (Data Center UnsecuredEnv) Here's logs from engine: ---------------------------------------------------------------------------= ----------------------------[root@dev2engine ~]# tail /var/log/messages Feb 20 07:01:01 dev2engine systemd: Starting Session 20 of user root. Feb 20 07:01:01 dev2engine systemd: Removed slice User Slice of root. Feb 20 07:01:01 dev2engine systemd: Stopping User Slice of root. Feb 20 07:58:52 dev2engine systemd: Created slice User Slice of root. Feb 20 07:58:52 dev2engine systemd: Starting User Slice of root. Feb 20 07:58:52 dev2engine systemd-logind: New session 21 of user root. Feb 20 07:58:52 dev2engine systemd: Started Session 21 of user root. Feb 20 07:58:52 dev2engine systemd: Starting Session 21 of user root. Feb 20 08:01:01 dev2engine systemd: Started Session 22 of user root. Feb 20 08:01:01 dev2engine systemd: Starting Session 22 of user root. ---------------------------------------------------------------------------= ----------------------------[root@dev2engine ~]# tail /var/log/ovirt-engine= /engine.log 2018-02-20 08:01:16,062+08 INFO=C2=A0 [org.ovirt.engine.core.bll.eventqueue= .EventQueueMonitor] (org.ovirt.thread.pool-7-thread-32) [102e9d3c] Finished= reconstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clearing even= t queue 2018-02-20 08:01:27,825+08 WARN=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb= roker.IrsProxy] (org.ovirt.thread.pool-7-thread-23) [] Master domain is not= in sync between DB and VDSM. Domain Stored2 marked as master in DB and not= in the storage 2018-02-20 08:01:27,862+08 WARN=C2=A0 [org.ovirt.engine.core.bll.storage.po= ol.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-thread-23) [213= f42b9] Validation of action 'ReconstructMasterDomain' failed for user SYSTE= M. Reasons: VAR__ACTION__RECONSTRUCT_MASTER,VAR__TYPE__STORAGE__DOMAIN,ACTI= ON_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL2,$status PreparingForMaintenan= ce 2018-02-20 08:01:27,882+08 INFO=C2=A0 [org.ovirt.engine.core.bll.eventqueue= .EventQueueMonitor] (org.ovirt.thread.pool-7-thread-20) [929330e] Finished = reconstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clearing event= queue 2018-02-20 08:01:40,106+08 WARN=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb= roker.IrsProxy] (org.ovirt.thread.pool-7-thread-17) [] Master domain is not= in sync between DB and VDSM. Domain Stored2 marked as master in DB and not= in the storage 2018-02-20 08:01:40,197+08 WARN=C2=A0 [org.ovirt.engine.core.bll.storage.po= ol.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-thread-17) [7af= 552c1] Validation of action 'ReconstructMasterDomain' failed for user SYSTE= M. Reasons: VAR__ACTION__RECONSTRUCT_MASTER,VAR__TYPE__STORAGE__DOMAIN,ACTI= ON_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL2,$status PreparingForMaintenan= ce 2018-02-20 08:01:40,246+08 INFO=C2=A0 [org.ovirt.engine.core.bll.eventqueue= .EventQueueMonitor] (org.ovirt.thread.pool-7-thread-22) [73673040] Finished= reconstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clearing even= t queue 2018-02-20 08:01:51,809+08 WARN=C2=A0 [org.ovirt.engine.core.vdsbroker.irsb= roker.IrsProxy] (org.ovirt.thread.pool-7-thread-26) [] Master domain is not= in sync between DB and VDSM. Domain Stored2 marked as master in DB and not= in the storage 2018-02-20 08:01:51,846+08 WARN=C2=A0 [org.ovirt.engine.core.bll.storage.po= ol.ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-thread-26) [203= 07cbe] Validation of action 'ReconstructMasterDomain' failed for user SYSTE= M. Reasons: VAR__ACTION__RECONSTRUCT_MASTER,VAR__TYPE__STORAGE__DOMAIN,ACTI= ON_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL2,$status PreparingForMaintenan= ce 2018-02-20 08:01:51,866+08 INFO=C2=A0 [org.ovirt.engine.core.bll.eventqueue= .EventQueueMonitor] (org.ovirt.thread.pool-7-thread-49) [2c11a866] Finished= reconstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clearing even= t queue ------=_Part_1848497_1716892283.1519088345205 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <html><head></head><body><div style=3D"color:#000; background-color:#fff; f= ont-family:Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font= -size:10px"><div id=3D"yui_3_16_0_ym19_1_1519085807369_10542" dir=3D"ltr"><= font id=3D"yui_3_16_0_ym19_1_1519085807369_15967" size=3D"3">My storage poo= l has 2 Master Domain(</font><font id=3D"yui_3_16_0_ym19_1_1519085807369_16= 063" size=3D"3"><font id=3D"yui_3_16_0_ym19_1_1519085807369_15968" size=3D"= 3">Stored2 on Node2,Node1Container on Node1)</font>. and my old master doma= in </font><font id=3D"yui_3_16_0_ym19_1_1519085807369_15934" size=3D"3"><fo= nt id=3D"yui_3_16_0_ym19_1_1519085807369_16064" size=3D"3">(</font><font id= =3D"yui_3_16_0_ym19_1_1519085807369_16065" size=3D"3"><font id=3D"yui_3_16_= 0_ym19_1_1519085807369_16066" size=3D"3">DATANd01 on Node1 )</font></font> = hung on preparing for maintenance. When I tried to activate my old master d= omain (</font><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"= ><font id=3D"yui_3_16_0_ym19_1_1519085807369_15935" size=3D"3">DATANd01 on = Node1 )</font> all  storage domain goes down and up master keep on rot= ating.</font></div><div id=3D"yui_3_16_0_ym19_1_1519085807369_10905"><font = id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><br></font></div><d= iv id=3D"yui_3_16_0_ym19_1_1519085807369_10692"><font id=3D"yui_3_16_0_ym19= _1_1519085807369_10517" size=3D"3"><br></font></div><div id=3D"yui_3_16_0_y= m19_1_1519085807369_10710" dir=3D"ltr"><font id=3D"yui_3_16_0_ym19_1_151908= 5807369_10517" size=3D"3">Ovirt Version (oVirt Engine Version: 4.1.9.1.el7.= centos)<br></font></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807= 369_14202"><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><b= r></font></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_12604= "><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><br></font>= </div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_14203"><font i= d=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3">Event Error:</font><= /div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_14215"><font id= =3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3">Sync Error on Master = Domain between Host Node2 and oVirt Engine. Domain Stored2 is marked as mas= ter in ovirt engine Database but not on storage side Please consult with su= pport<br id=3D"yui_3_16_0_ym19_1_1519085807369_12607"></font></div><div dir= =3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_14204"><font id=3D"yui_3_16_= 0_ym19_1_1519085807369_10517" size=3D"3"><br></font></div><div dir=3D"ltr" = id=3D"yui_3_16_0_ym19_1_1519085807369_15891"><font id=3D"yui_3_16_0_ym19_1_= 1519085807369_10517" size=3D"3">VDSM Node2 command ConnectStoragePoolVDS fa= iled: Wrong Master domain or it's version: u'SD=3Df3e372e3-1251-4195-a4b9-1= 027e40059df, pool=3D5a865884-0366-0330-02b8-0000</font></div><div dir=3D"lt= r" id=3D"yui_3_16_0_ym19_1_1519085807369_15895"><font id=3D"yui_3_16_0_ym19= _1_1519085807369_10517" size=3D"3"><br></font></div><div dir=3D"ltr" id=3D"= yui_3_16_0_ym19_1_1519085807369_15896"><font id=3D"yui_3_16_0_ym19_1_151908= 5807369_10517" size=3D"3">VDSM Node2 command HSMGetAllTastsStatusesVDS fail= ed: Not SPM: ()<br id=3D"yui_3_16_0_ym19_1_1519085807369_15901"><br id=3D"y= ui_3_16_0_ym19_1_1519085807369_15902">Failed to deactivate Storage Domain D= ATANd01 (Data Center UnsecuredEnv)<br></font></div><div id=3D"yui_3_16_0_ym= 19_1_1519085807369_10545"><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517= " size=3D"3"><br></font></div><div id=3D"yui_3_16_0_ym19_1_1519085807369_10= 551"><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3">Here's l= ogs from engine:</font></div><div id=3D"yui_3_16_0_ym19_1_1519085807369_106= 20"><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><br></fon= t></div><div id=3D"yui_3_16_0_ym19_1_1519085807369_10573"><font id=3D"yui_3= _16_0_ym19_1_1519085807369_10517" size=3D"3">------------------------------= -------------------------------------------------------------------------</= font></div><div id=3D"yui_3_16_0_ym19_1_1519085807369_10588" dir=3D"ltr"><f= ont id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3">[root@dev2engin= e ~]# tail /var/log/messages<br id=3D"yui_3_16_0_ym19_1_1519085807369_10609= ">Feb 20 07:01:01 dev2engine systemd: Starting Session 20 of user root.<br = id=3D"yui_3_16_0_ym19_1_1519085807369_10610">Feb 20 07:01:01 dev2engine sys= temd: Removed slice User Slice of root.<br id=3D"yui_3_16_0_ym19_1_15190858= 07369_10611">Feb 20 07:01:01 dev2engine systemd: Stopping User Slice of roo= t.<br id=3D"yui_3_16_0_ym19_1_1519085807369_10612">Feb 20 07:58:52 dev2engi= ne systemd: Created slice User Slice of root.<br id=3D"yui_3_16_0_ym19_1_15= 19085807369_10613">Feb 20 07:58:52 dev2engine systemd: Starting User Slice = of root.<br id=3D"yui_3_16_0_ym19_1_1519085807369_10614">Feb 20 07:58:52 de= v2engine systemd-logind: New session 21 of user root.<br id=3D"yui_3_16_0_y= m19_1_1519085807369_10615">Feb 20 07:58:52 dev2engine systemd: Started Sess= ion 21 of user root.<br id=3D"yui_3_16_0_ym19_1_1519085807369_10616">Feb 20= 07:58:52 dev2engine systemd: Starting Session 21 of user root.<br id=3D"yu= i_3_16_0_ym19_1_1519085807369_10617">Feb 20 08:01:01 dev2engine systemd: St= arted Session 22 of user root.<br id=3D"yui_3_16_0_ym19_1_1519085807369_106= 18">Feb 20 08:01:01 dev2engine systemd: Starting Session 22 of user root.</= font></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_10619"><f= ont id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><br></font></di= v><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_10623"><br><font i= d=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><font id=3D"yui_3_16= _0_ym19_1_1519085807369_10626" size=3D"3">---------------------------------= ----------------------------------------------------------------------</fon= t></font></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1519085807369_10654= "><font id=3D"yui_3_16_0_ym19_1_1519085807369_10517" size=3D"3"><font id=3D= "yui_3_16_0_ym19_1_1519085807369_10626" size=3D"3">[root@dev2engine ~]# tai= l /var/log/ovirt-engine/engine.log<br id=3D"yui_3_16_0_ym19_1_1519085807369= _10677">2018-02-20 08:01:16,062+08 INFO  [org.ovirt.engine.core.bll.ev= entqueue.EventQueueMonitor] (org.ovirt.thread.pool-7-thread-32) [102e9d3c] = Finished reconstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clear= ing event queue<br id=3D"yui_3_16_0_ym19_1_1519085807369_10678">2018-02-20 = 08:01:27,825+08 WARN  [org.ovirt.engine.core.vdsbroker.irsbroker.IrsPr= oxy] (org.ovirt.thread.pool-7-thread-23) [] Master domain is not in sync be= tween DB and VDSM. Domain Stored2 marked as master in DB and not in the sto= rage<br id=3D"yui_3_16_0_ym19_1_1519085807369_10679">2018-02-20 08:01:27,86= 2+08 WARN  [org.ovirt.engine.core.bll.storage.pool.ReconstructMasterDo= mainCommand] (org.ovirt.thread.pool-7-thread-23) [213f42b9] Validation of a= ction 'ReconstructMasterDomain' failed for user SYSTEM. Reasons: VAR__ACTIO= N__RECONSTRUCT_MASTER,VAR__TYPE__STORAGE__DOMAIN,ACTION_TYPE_FAILED_STORAGE= _DOMAIN_STATUS_ILLEGAL2,$status PreparingForMaintenance<br id=3D"yui_3_16_0= _ym19_1_1519085807369_10680">2018-02-20 08:01:27,882+08 INFO  [org.ovi= rt.engine.core.bll.eventqueue.EventQueueMonitor] (org.ovirt.thread.pool-7-t= hread-20) [929330e] Finished reconstruct for pool '5a865884-0366-0330-02b8-= 0000000002d4'. Clearing event queue<br id=3D"yui_3_16_0_ym19_1_151908580736= 9_10681">2018-02-20 08:01:40,106+08 WARN  [org.ovirt.engine.core.vdsbr= oker.irsbroker.IrsProxy] (org.ovirt.thread.pool-7-thread-17) [] Master doma= in is not in sync between DB and VDSM. Domain Stored2 marked as master in D= B and not in the storage<br id=3D"yui_3_16_0_ym19_1_1519085807369_10682">20= 18-02-20 08:01:40,197+08 WARN  [org.ovirt.engine.core.bll.storage.pool= .ReconstructMasterDomainCommand] (org.ovirt.thread.pool-7-thread-17) [7af55= 2c1] Validation of action 'ReconstructMasterDomain' failed for user SYSTEM.= Reasons: VAR__ACTION__RECONSTRUCT_MASTER,VAR__TYPE__STORAGE__DOMAIN,ACTION= _TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL2,$status PreparingForMaintenance= <br id=3D"yui_3_16_0_ym19_1_1519085807369_10683">2018-02-20 08:01:40,246+08= INFO  [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (org.o= virt.thread.pool-7-thread-22) [73673040] Finished reconstruct for pool '5a8= 65884-0366-0330-02b8-0000000002d4'. Clearing event queue<br id=3D"yui_3_16_= 0_ym19_1_1519085807369_10684">2018-02-20 08:01:51,809+08 WARN  [org.ov= irt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-7-thre= ad-26) [] Master domain is not in sync between DB and VDSM. Domain Stored2 = marked as master in DB and not in the storage<br id=3D"yui_3_16_0_ym19_1_15= 19085807369_10685">2018-02-20 08:01:51,846+08 WARN  [org.ovirt.engine.= core.bll.storage.pool.ReconstructMasterDomainCommand] (org.ovirt.thread.poo= l-7-thread-26) [20307cbe] Validation of action 'ReconstructMasterDomain' fa= iled for user SYSTEM. Reasons: VAR__ACTION__RECONSTRUCT_MASTER,VAR__TYPE__S= TORAGE__DOMAIN,ACTION_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL2,$status Pr= eparingForMaintenance<br id=3D"yui_3_16_0_ym19_1_1519085807369_10686">2018-= 02-20 08:01:51,866+08 INFO  [org.ovirt.engine.core.bll.eventqueue.Even= tQueueMonitor] (org.ovirt.thread.pool-7-thread-49) [2c11a866] Finished reco= nstruct for pool '5a865884-0366-0330-02b8-0000000002d4'. Clearing event que= ue<br id=3D"yui_3_16_0_ym19_1_1519085807369_10687"><br></font></font></div>= </div></body></html> ------=_Part_1848497_1716892283.1519088345205--

2 1

Setup ovirt-guest-agent from tarball possible?
by Oliver Dietzel 19 Feb '18

19 Feb '18

Hi, i try to install ovirt-guest-agent on a Clearlinux vm (already up and running in our ovirt test cluster). The usual fedora / el7 rpm's do not work. Is it possible to install ovirt-guest-agent from a tarball? Or do i have to rebuild a src rpm? And where do i find the latest tarball and src rpm of this package / these packages? Any help appreciated, thx in advance Oli ___________________________________________________________ Oliver Dietzel RTO GmbH Hanauer Landstraße 439 60314 Frankfurt

1 0

Moving VMs to another cluster
by Yeun, Chris (DNWK) 19 Feb '18

19 Feb '18

--_000_151873643674288456smithsdetectioncom_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable ?Hello, How do you move a VM to another cluster within the same data center? I hav= e a cluster running ovirt 3.5 nodes. I created another cluster with hosts = running CentOS 7 (ovirt 3.6 version) and want to move VMs to this cluster.= The compatibility mode for everything is 3.5. I tried shutting down a VM, but I cannot select the other cluster. Also li= ve migration fails as well to the new cluster. Thanks, Chris ______________________________________________________________________ This email has been scanned by the Boundary Defense for Email Security Sys= tem. For more information please visit http://www.apptix.com/email-securit= y/antispam-virus ______________________________________________________________________ --_000_151873643674288456smithsdetectioncom_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Diso-8859= -1"> <style type=3D"text/css" style=3D"display:none"></style> </head> <body dir=3D"ltr" style=3D"font-size:12pt;color:#000000;background-color:#= FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;"> <p>Hello,<br> </p> <p><br> </p> <p>How do you move a VM to another cluster within the same data center? I = have a cluster running ovirt 3.5 nodes. I created another cluster with hos= ts running CentOS 7 (ovirt 3.6 version) and want to move VMs to this clust= er. The compatibility mode for everything is 3.5.</p> <p><br> </p> <p>I tried shutting down a VM, but I cannot select the other cluster. Also= live migration fails as well to the new cluster.<br> </p> <p><br> </p> <p>Thanks,<br> </p> <p>Chris<br> </p> <br clear=3D"both"> ______________________________________________________________________<BR>= This email has been scanned by the Boundary Defense for Email Security Sys= tem. For more information please visit http://www.apptix.com/email-securit= y/antispam-virus<BR> ______________________________________________________________________<BR>= </body> </html> --_000_151873643674288456smithsdetectioncom_--

2 2

Fwd: why host is not capable to run HE?
by Artem Tambovskiy 19 Feb '18

19 Feb '18

Thanks a lot, Simone! This is clearly shows a problem: [root@ov-eng ovirt-engine]# sudo -u postgres psql -d engine -c 'select vds_name, vds_spm_id from vds' vds_name | vds_spm_id -----------------+------------ ovirt1.local | 2 ovirt2.local | 1 (2 rows) While hosted-engine.conf on ovirt1.local have host_id=1, and ovirt2.local host_id=2. So totally opposite values. So how to get this fixed in the simple way? Update the engine DB? Regards, Artem On Mon, Feb 19, 2018 at 5:37 PM, Simone Tiraboschi <stirabos(a)redhat.com> wrote: > > > On Mon, Feb 19, 2018 at 12:13 PM, Artem Tambovskiy < > artem.tambovskiy(a)gmail.com> wrote: > >> Hello, >> >> Last weekend my cluster suffered form a massive power outage due to human >> mistake. >> I'm using SHE setup with Gluster, I managed to bring the cluster up >> quickly, but once again I have a problem with duplicated host_id ( >> https://bugzilla.redhat.com/show_bug.cgi?id=1543988) on second host and >> due to this second host is not capable to run HE. >> >> I manually updated file hosted_engine.conf with correct host_id and >> restarted agent & broker - no effect. Than I rebooted the host itself - >> still no changes. How to fix this issue? >> > > I'd suggest to run this command on the engine VM: > sudo -u postgres scl enable rh-postgresql95 -- psql -d engine -c 'select > vds_name, vds_spm_id from vds' > (just sudo -u postgres psql -d engine -c 'select vds_name, vds_spm_id > from vds' if still on 4.1) and check /etc/ovirt-hosted-engine/hosted-engine.conf > on all the involved host. > Maybe you can also have a leftover configuration file on undeployed host. > > When you find a conflict you should manually bring down sanlock > In doubt a reboot of both the hosts will solve for sure. > > > >> >> Regards, >> Artem >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> >

3 3

How to specify a logical network for ovirt live migration traffic
by simone.sanna＠trssistemi.com 19 Feb '18

19 Feb '18

Hello to everyone, I have founded the article "How to specify a logical network for RHEV live migration traffic" at https://access.redhat.com/solutions/70412 but i can't read it because i not have an "active Red Hat subscription". It is there an article as "How to specify a logical network for ovirt live migration traffic" or similar? It is possible to do that (for example to specify a nic ethX for live migration traffic between two host)? Many thanks for your replies, Simone

2 1