During network testing last night I put one compute node into main= =3D tenance mode and changed it's network from legacy to OVS, this caused issue= =3D s and I changed it back. When I changed it back SPM contention starte= =3D d and neither became SPM, the logs are filled with this error message:

2016-09-06 14:43:38,720 ERROR [org.ovirt.engine.core.vdsbroker.vd= =3D sbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler5) [] Command 'SpmStatu= =3D sVDSCommand(HostName =3D3D ovirttest1, SpmStatusVDSCommandParameters:{runAs= yn=3D c=3D3D'true', hostId=3D3D'd84ebe29-5acd-4e4b-9bee-041b27a2f9f9', storagePoo= lId=3D =3D3D'00000001-0001-0001-0001-0000000000d8'})' execution failed: VDSGeneric= Ex=3D ception: VDSErrorException: Failed to SpmStatusVDS, error =3D3D (13, 'Sanlo= ck=3D resource read failure', 'Permission denied'), code =3D3D 100

<=3D br>

I've put all but the master data domain into maitenance mode = =3D and the permissions on it are vdsm/kvm. The permissions on the nfs sh= =3D are have not been modified, but I re-exported the share anyway, the share c= =3D an be seen on the compute node and I can even mount it on that compute node= =3D , as can vdsm:

nfs-se= rv=3D er:/rbd/it/ovirt-nfs 293G 111G 183G 38% /rhev/data-center/mnt/nfs-server:_r= =3D bd_it_ovirt-nfs

I'm not rea= ll=3D y sure where to go beyond this point..

<=3D /div>

Regards,
Logan

<=3D /html> ------=3D_Part_52954813_1884487966.1473191351932-- --===============7725850020368589518== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzUyOTU0ODEzXzE4ODQ0ODc5NjYuMTQ3MzE5MTM1MTkzMgpDb250ZW50LVR5 cGU6IHRleHQvcGxhaW47IGNoYXJzZXQ9dXRmLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzog N2JpdAoKRHVyaW5nIG5ldHdvcmsgdGVzdGluZyBsYXN0IG5pZ2h0IEkgcHV0IG9uZSBjb21wdXRl IG5vZGUgaW50byBtYWludGVuYW5jZSBtb2RlIGFuZCBjaGFuZ2VkIGl0J3MgbmV0d29yayBmcm9t IGxlZ2FjeSB0byBPVlMsIHRoaXMgY2F1c2VkIGlzc3VlcyBhbmQgSSBjaGFuZ2VkIGl0IGJhY2su IFdoZW4gSSBjaGFuZ2VkIGl0IGJhY2sgU1BNIGNvbnRlbnRpb24gc3RhcnRlZCBhbmQgbmVpdGhl ciBiZWNhbWUgU1BNLCB0aGUgbG9ncyBhcmUgZmlsbGVkIHdpdGggdGhpcyBlcnJvciBtZXNzYWdl OiAKCjIwMTYtMDktMDYgMTQ6NDM6MzgsNzIwIEVSUk9SIFtvcmcub3ZpcnQuZW5naW5lLmNvcmUu dmRzYnJva2VyLnZkc2Jyb2tlci5TcG1TdGF0dXNWRFNDb21tYW5kXSAoRGVmYXVsdFF1YXJ0elNj aGVkdWxlcjUpIFtdIENvbW1hbmQgJ1NwbVN0YXR1c1ZEU0NvbW1hbmQoSG9zdE5hbWUgPSBvdmly dHRlc3QxLCBTcG1TdGF0dXNWRFNDb21tYW5kUGFyYW1ldGVyczp7cnVuQXN5bmM9J3RydWUnLCBo b3N0SWQ9J2Q4NGViZTI5LTVhY2QtNGU0Yi05YmVlLTA0MWIyN2EyZjlmOScsIHN0b3JhZ2VQb29s SWQ9JzAwMDAwMDAxLTAwMDEtMDAwMS0wMDAxLTAwMDAwMDAwMDBkOCd9KScgZXhlY3V0aW9uIGZh aWxlZDogVkRTR2VuZXJpY0V4Y2VwdGlvbjogVkRTRXJyb3JFeGNlcHRpb246IEZhaWxlZCB0byBT cG1TdGF0dXNWRFMsIGVycm9yID0gKDEzLCAnU2FubG9jayByZXNvdXJjZSByZWFkIGZhaWx1cmUn LCAnUGVybWlzc2lvbiBkZW5pZWQnKSwgY29kZSA9IDEwMCAKCkkndmUgcHV0IGFsbCBidXQgdGhl IG1hc3RlciBkYXRhIGRvbWFpbiBpbnRvIG1haXRlbmFuY2UgbW9kZSBhbmQgdGhlIHBlcm1pc3Np b25zIG9uIGl0IGFyZSB2ZHNtL2t2bS4gVGhlIHBlcm1pc3Npb25zIG9uIHRoZSBuZnMgc2hhcmUg aGF2ZSBub3QgYmVlbiBtb2RpZmllZCwgYnV0IEkgcmUtZXhwb3J0ZWQgdGhlIHNoYXJlIGFueXdh eSwgdGhlIHNoYXJlIGNhbiBiZSBzZWVuIG9uIHRoZSBjb21wdXRlIG5vZGUgYW5kIEkgY2FuIGV2 ZW4gbW91bnQgaXQgb24gdGhhdCBjb21wdXRlIG5vZGUsIGFzIGNhbiB2ZHNtOiAKCm5mcy1zZXJ2 ZXI6L3JiZC9pdC9vdmlydC1uZnMgMjkzRyAxMTFHIDE4M0cgMzglIC9yaGV2L2RhdGEtY2VudGVy L21udC9uZnMtc2VydmVyOl9yYmRfaXRfb3ZpcnQtbmZzIAoKSSdtIG5vdCByZWFsbHkgc3VyZSB3 aGVyZSB0byBnbyBiZXlvbmQgdGhpcyBwb2ludC4uIAoKUmVnYXJkcywgCkxvZ2FuIAoKLS0tLS0t PV9QYXJ0XzUyOTU0ODEzXzE4ODQ0ODc5NjYuMTQ3MzE5MTM1MTkzMgpDb250ZW50LVR5cGU6IHRl eHQvaHRtbDsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiBxdW90ZWQt cHJpbnRhYmxlCgo8aHRtbD48Ym9keT48ZGl2IHN0eWxlPTNEImZvbnQtZmFtaWx5OiBBcmlhbDsg Zm9udC1zaXplOiAxMnB0OyBjb2xvcjogIzAwMDA9CjAwIj48ZGl2PkR1cmluZyBuZXR3b3JrIHRl c3RpbmcgbGFzdCBuaWdodCBJIHB1dCBvbmUgY29tcHV0ZSBub2RlIGludG8gbWFpbj0KdGVuYW5j ZSBtb2RlIGFuZCBjaGFuZ2VkIGl0J3MgbmV0d29yayBmcm9tIGxlZ2FjeSB0byBPVlMsIHRoaXMg Y2F1c2VkIGlzc3VlPQpzIGFuZCBJIGNoYW5nZWQgaXQgYmFjay4gJm5ic3A7V2hlbiBJIGNoYW5n ZWQgaXQgYmFjayBTUE0gY29udGVudGlvbiBzdGFydGU9CmQgYW5kIG5laXRoZXIgYmVjYW1lIFNQ TSwgdGhlIGxvZ3MgYXJlIGZpbGxlZCB3aXRoIHRoaXMgZXJyb3IgbWVzc2FnZTo8L2Rpdj0KPjxk aXY+PGJyPjIwMTYtMDktMDYgMTQ6NDM6MzgsNzIwIEVSUk9SIFtvcmcub3ZpcnQuZW5naW5lLmNv cmUudmRzYnJva2VyLnZkPQpzYnJva2VyLlNwbVN0YXR1c1ZEU0NvbW1hbmRdIChEZWZhdWx0UXVh cnR6U2NoZWR1bGVyNSkgW10gQ29tbWFuZCAnU3BtU3RhdHU9CnNWRFNDb21tYW5kKEhvc3ROYW1l ID0zRCBvdmlydHRlc3QxLCBTcG1TdGF0dXNWRFNDb21tYW5kUGFyYW1ldGVyczp7cnVuQXN5bj0K Yz0zRCd0cnVlJywgaG9zdElkPTNEJ2Q4NGViZTI5LTVhY2QtNGU0Yi05YmVlLTA0MWIyN2EyZjlm OScsIHN0b3JhZ2VQb29sSWQ9Cj0zRCcwMDAwMDAwMS0wMDAxLTAwMDEtMDAwMS0wMDAwMDAwMDAw ZDgnfSknIGV4ZWN1dGlvbiBmYWlsZWQ6IFZEU0dlbmVyaWNFeD0KY2VwdGlvbjogVkRTRXJyb3JF eGNlcHRpb246IEZhaWxlZCB0byBTcG1TdGF0dXNWRFMsIGVycm9yID0zRCAoMTMsICdTYW5sb2Nr PQogcmVzb3VyY2UgcmVhZCBmYWlsdXJlJywgJ1Blcm1pc3Npb24gZGVuaWVkJyksIGNvZGUgPTNE IDEwMDxicj48L2Rpdj48ZGl2Pjw9CmJyPjwvZGl2PjxkaXY+SSd2ZSBwdXQgYWxsIGJ1dCB0aGUg bWFzdGVyIGRhdGEgZG9tYWluIGludG8gbWFpdGVuYW5jZSBtb2RlID0KYW5kIHRoZSBwZXJtaXNz aW9ucyBvbiBpdCBhcmUgdmRzbS9rdm0uICZuYnNwO1RoZSBwZXJtaXNzaW9ucyBvbiB0aGUgbmZz IHNoPQphcmUgaGF2ZSBub3QgYmVlbiBtb2RpZmllZCwgYnV0IEkgcmUtZXhwb3J0ZWQgdGhlIHNo YXJlIGFueXdheSwgdGhlIHNoYXJlIGM9CmFuIGJlIHNlZW4gb24gdGhlIGNvbXB1dGUgbm9kZSBh bmQgSSBjYW4gZXZlbiBtb3VudCBpdCBvbiB0aGF0IGNvbXB1dGUgbm9kZT0KLCBhcyBjYW4gdmRz bTombmJzcDs8L2Rpdj48ZGl2PjxiciBkYXRhLW1jZS1ib2d1cz0zRCIxIj48L2Rpdj48ZGl2Pm5m cy1zZXJ2PQplcjovcmJkL2l0L292aXJ0LW5mcyAyOTNHIDExMUcgMTgzRyAzOCUgL3JoZXYvZGF0 YS1jZW50ZXIvbW50L25mcy1zZXJ2ZXI6X3I9CmJkX2l0X292aXJ0LW5mczwvZGl2PjxkaXY+PGJy IGRhdGEtbWNlLWJvZ3VzPTNEIjEiPjwvZGl2PjxkaXY+SSdtIG5vdCByZWFsbD0KeSBzdXJlIHdo ZXJlIHRvIGdvIGJleW9uZCB0aGlzIHBvaW50Li48L2Rpdj48ZGl2PjxiciBkYXRhLW1jZS1ib2d1 cz0zRCIxIj48PQovZGl2PjxkaXYgZGF0YS1tYXJrZXI9M0QiX19TSUdfUFJFX18iPlJlZ2FyZHMs PGJyPkxvZ2FuPC9kaXY+PC9kaXY+PC9ib2R5Pjw9Ci9odG1sPgotLS0tLS09X1BhcnRfNTI5NTQ4 MTNfMTg4NDQ4Nzk2Ni4xNDczMTkxMzUxOTMyLS0K --===============7725850020368589518==--