'Sanlock lockspace add failure' when trying to set up hosted engine 4.2 on existing gluster cluster
--_000_CB113C990D3AAA4B835B7604246296154416B456RTOS2010Ertode_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Install from node iso on gluster works fine, the hosted engine vm installs = on gluster, but after installation is finished and rebooted the gluster clu= ster is not added as data storage. Hosted engine is able to boot from gluster but not able to use it. Looks li= ke HE doesnt use the gluster volume it booted from, but tries to add the sa= me gluster volume a second time. Is there a workaround? Error message in web gui: VDSM ovirt-gluster.rto.de command CreateStoragePoolVDS failed: Cannot acqui= re host id: (u'e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb', SanlockException(22, = 'Sanlock lockspace add failure', 'Invalid argument')) Error message in sanlock.log: [root@ovirt-gluster ~]# tail /var/log/sanlock.log 2018-03-09 09:37:05 812 [1082]: s5 host 1 2 791 f571ebc1-2572-4689-b64e-699= 9433f0597.ovirt-glus 2018-03-09 09:37:05 812 [1082]: s5 host 250 1 0 f571ebc1-2572-4689-b64e-699= 9433f0597.ovirt-glus 2018-03-09 09:37:20 828 [1093]: s5:r4 resource e6d008f7-e5e8-4064-9f6a-6ab7= c8723eeb:e555168d-719d-4f73-8541-62395c97c1ff:/rhev/data-center/mnt/gluster= SD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/images/7b6675f7-f739= -40b8-a554-b19795fe57c0/e555168d-719d-4f73-8541-62395c97c1ff.lease:0 for 3,= 12,5566 2018-03-09 09:40:58 1046 [1093]: s6 lockspace hosted-engine:1:/var/run/vdsm= /storage/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/3b22b2fe-f4d5-4d0c-995a-03b28= 50b674b/eb7218ff-bdbc-49c5-af17-a62a7385d299:0 2018-03-09 09:41:20 1067 [1082]: s6 host 1 1 1046 f571ebc1-2572-4689-b64e-6= 999433f0597.ovirt-glus 2018-03-09 09:42:23 1130 [1093]: s5:r5 resource e6d008f7-e5e8-4064-9f6a-6ab= 7c8723eeb:e555168d-719d-4f73-8541-62395c97c1ff:/rhev/data-center/mnt/gluste= rSD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/images/7b6675f7-f73= 9-40b8-a554-b19795fe57c0/e555168d-719d-4f73-8541-62395c97c1ff.lease:0 for 2= ,9,11635 2018-03-09 09:44:30 1258 [1093]: add_lockspace e6d008f7-e5e8-4064-9f6a-6ab7= c8723eeb:250:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e5e8-4= 064-9f6a-6ab7c8723eeb/dom_md/ids:0 conflicts with name of list1 s5 e6d008f7= -e5e8-4064-9f6a-6ab7c8723eeb:1:/rhev/data-center/mnt/glusterSD/gluster01:_g= v0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 2018-03-09 09:44:37 1264 [1093]: s7 lockspace hosted-engine:1:/var/run/vdsm= /storage/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/3b22b2fe-f4d5-4d0c-995a-03b28= 50b674b/eb7218ff-bdbc-49c5-af17-a62a7385d299:0 2018-03-09 09:44:58 1285 [1082]: s7 host 1 2 1264 f571ebc1-2572-4689-b64e-6= 999433f0597.ovirt-glus 2018-03-09 09:46:42 1389 [1093]: add_lockspace e6d008f7-e5e8-4064-9f6a-6ab7= c8723eeb:250:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e5e8-4= 064-9f6a-6ab7c8723eeb/dom_md/ids:0 conflicts with name of list1 s5 e6d008f7= -e5e8-4064-9f6a-6ab7c8723eeb:1:/rhev/data-center/mnt/glusterSD/gluster01:_g= v0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 ___________________________________________________________ Oliver Dietzel RTO GmbH Hanauer Landstra=DFe 439 60314 Frankfurt --_000_CB113C990D3AAA4B835B7604246296154416B456RTOS2010Ertode_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Diso-8859-= 1"> <meta name=3D"Generator" content=3D"Microsoft Exchange Server"> <!-- converted from rtf --> <style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left:= #800000 2px solid; } --></style> </head> <body> <font face=3D"Calibri" size=3D"2"><span style=3D"font-size:11pt;"> <div>Install from node iso on gluster works fine, the hosted engine vm inst= alls on gluster, but after installation is finished and rebooted the gluste= r cluster is not added as data storage.</div> <div>Hosted engine is able to boot from gluster but not able to use it. Loo= ks like HE doesnt use the gluster volume it booted from, but tries to add t= he same gluster volume a second time.</div> <div> </div> <div>Is there a workaround?</div> <div> </div> <div>Error message in web gui:</div> <div>VDSM ovirt-gluster.rto.de command CreateStoragePoolVDS failed: Cannot = acquire host id: (u'e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb', SanlockException= (22, 'Sanlock lockspace add failure', 'Invalid argument'))</div> <div> </div> <div>Error message in sanlock.log:</div> <div> </div> <div>[root@ovirt-gluster ~]# tail /var/log/sanlock.log</div> <div>2018-03-09 09:37:05 812 [1082]: s5 host 1 2 791 f571ebc1-2572-4689-b64= e-6999433f0597.ovirt-glus</div> <div>2018-03-09 09:37:05 812 [1082]: s5 host 250 1 0 f571ebc1-2572-4689-b64= e-6999433f0597.ovirt-glus</div> <div>2018-03-09 09:37:20 828 [1093]: s5:r4 resource e6d008f7-e5e8-4064-9f6a= -6ab7c8723eeb:e555168d-719d-4f73-8541-62395c97c1ff:/rhev/data-center/mnt/gl= usterSD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/images/7b6675f7= -f739-40b8-a554-b19795fe57c0/e555168d-719d-4f73-8541-62395c97c1ff.lease:0 for 3,12,5566</div> <div>2018-03-09 09:40:58 1046 [1093]: s6 lockspace hosted-engine:1:/var/run= /vdsm/storage/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/3b22b2fe-f4d5-4d0c-995a-= 03b2850b674b/eb7218ff-bdbc-49c5-af17-a62a7385d299:0</div> <div>2018-03-09 09:41:20 1067 [1082]: s6 host 1 1 1046 f571ebc1-2572-4689-b= 64e-6999433f0597.ovirt-glus</div> <div>2018-03-09 09:42:23 1130 [1093]: s5:r5 resource e6d008f7-e5e8-4064-9f6= a-6ab7c8723eeb:e555168d-719d-4f73-8541-62395c97c1ff:/rhev/data-center/mnt/g= lusterSD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/images/7b6675f= 7-f739-40b8-a554-b19795fe57c0/e555168d-719d-4f73-8541-62395c97c1ff.lease:0 for 2,9,11635</div> <div>2018-03-09 09:44:30 1258 [1093]: add_lockspace e6d008f7-e5e8-4064-9f6a= -6ab7c8723eeb:250:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e= 5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 conflicts with name of list1 s5 e6d= 008f7-e5e8-4064-9f6a-6ab7c8723eeb:1:/rhev/data-center/mnt/glusterSD/gluster= 01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0</div> <div>2018-03-09 09:44:37 1264 [1093]: s7 lockspace hosted-engine:1:/var/run= /vdsm/storage/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/3b22b2fe-f4d5-4d0c-995a-= 03b2850b674b/eb7218ff-bdbc-49c5-af17-a62a7385d299:0</div> <div>2018-03-09 09:44:58 1285 [1082]: s7 host 1 2 1264 f571ebc1-2572-4689-b= 64e-6999433f0597.ovirt-glus</div> <div>2018-03-09 09:46:42 1389 [1093]: add_lockspace e6d008f7-e5e8-4064-9f6a= -6ab7c8723eeb:250:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e= 5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 conflicts with name of list1 s5 e6d= 008f7-e5e8-4064-9f6a-6ab7c8723eeb:1:/rhev/data-center/mnt/glusterSD/gluster= 01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0</div> <div><font color=3D"#8EAADB">______________________________________________= _____________</font></div> <table width=3D"40" style=3D"width:24pt;margin-left:5.4pt;"> <col width=3D"40" style=3D"width:24pt;"> <tr> <td><font face=3D"Verdana" size=3D"1" color=3D"#595959"><span style=3D"font= -size:8pt;">Oliver Dietzel</span></font></td> </tr> <tr> <td><font color=3D"#A0A0A0"></font></td> </tr> <tr> <td><font face=3D"Verdana" size=3D"1" color=3D"#A0A0A0"><span style=3D"font= -size:8pt;">RTO GmbH</span></font></td> </tr> </table> <div><font face=3D"Verdana" size=3D"1" color=3D"#A0A0A0"><span style=3D"fon= t-size:8pt;">Hanauer Landstra=DFe 439<br> 60314 Frankfurt</span></font></div> <div> </div> </span></font> </body> </html> --_000_CB113C990D3AAA4B835B7604246296154416B456RTOS2010Ertode_--
Hi Oliver, which version of oVirt are you running? The issue seems to be that correctly deployed hosted engine does not have any storage available in the webadmin If I understand you correctly. Is that right? We used to require two separate storage domains in 4.1 and older releases. One for hosted engine and one for the rest of the VMs. 4.2.1 changed that. So if you are running 4.1, just add another storage domain [1] and the engine will finish the hosted engine initialization automatically after that. [1] https://www.ovirt.org/documentation/self-hosted/chap-Deploying_Self-Hosted_E... See the paragraph: "Important: Log in as the admin@internal user to continue configuring the Engine and add further resources. You must create another data domain for the data center to be initialized to host regular virtual machine data, and for the Engine virtual machine to be visible. See "Storage" in the Administration Guide for different storage options and on how to add a data storage domain." Best regards Martin Sivak On Fri, Mar 9, 2018 at 10:08 AM, Oliver Dietzel <O.Dietzel@rto.de> wrote:
Install from node iso on gluster works fine, the hosted engine vm installs on gluster, but after installation is finished and rebooted the gluster cluster is not added as data storage. Hosted engine is able to boot from gluster but not able to use it. Looks like HE doesnt use the gluster volume it booted from, but tries to add the same gluster volume a second time.
Is there a workaround?
Error message in web gui: VDSM ovirt-gluster.rto.de command CreateStoragePoolVDS failed: Cannot acquire host id: (u'e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb', SanlockException(22, 'Sanlock lockspace add failure', 'Invalid argument'))
Error message in sanlock.log:
[root@ovirt-gluster ~]# tail /var/log/sanlock.log 2018-03-09 09:37:05 812 [1082]: s5 host 1 2 791 f571ebc1-2572-4689-b64e-6999433f0597.ovirt-glus 2018-03-09 09:37:05 812 [1082]: s5 host 250 1 0 f571ebc1-2572-4689-b64e-6999433f0597.ovirt-glus 2018-03-09 09:37:20 828 [1093]: s5:r4 resource e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:e555168d-719d-4f73-8541-62395c97c1ff:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/images/7b6675f7-f739-40b8-a554-b19795fe57c0/e555168d-719d-4f73-8541-62395c97c1ff.lease:0 for 3,12,5566 2018-03-09 09:40:58 1046 [1093]: s6 lockspace hosted-engine:1:/var/run/vdsm/storage/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/3b22b2fe-f4d5-4d0c-995a-03b2850b674b/eb7218ff-bdbc-49c5-af17-a62a7385d299:0 2018-03-09 09:41:20 1067 [1082]: s6 host 1 1 1046 f571ebc1-2572-4689-b64e-6999433f0597.ovirt-glus 2018-03-09 09:42:23 1130 [1093]: s5:r5 resource e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:e555168d-719d-4f73-8541-62395c97c1ff:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/images/7b6675f7-f739-40b8-a554-b19795fe57c0/e555168d-719d-4f73-8541-62395c97c1ff.lease:0 for 2,9,11635 2018-03-09 09:44:30 1258 [1093]: add_lockspace e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:250:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 conflicts with name of list1 s5 e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:1:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 2018-03-09 09:44:37 1264 [1093]: s7 lockspace hosted-engine:1:/var/run/vdsm/storage/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/3b22b2fe-f4d5-4d0c-995a-03b2850b674b/eb7218ff-bdbc-49c5-af17-a62a7385d299:0 2018-03-09 09:44:58 1285 [1082]: s7 host 1 2 1264 f571ebc1-2572-4689-b64e-6999433f0597.ovirt-glus 2018-03-09 09:46:42 1389 [1093]: add_lockspace e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:250:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 conflicts with name of list1 s5 e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:1:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 ___________________________________________________________ Oliver Dietzel RTO GmbH Hanauer Landstraße 439 60314 Frankfurt
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Thanks a lot, we already did this a couple of minutes ago, worked! -----Ursprüngliche Nachricht----- Von: Martin Sivak [mailto:msivak@redhat.com] Gesendet: Freitag, 9. März 2018 11:13 An: Oliver Dietzel <O.Dietzel@rto.de> Cc: users@ovirt.org Betreff: Re: [ovirt-users] 'Sanlock lockspace add failure' when trying to set up hosted engine 4.2 on existing gluster cluster Hi Oliver, which version of oVirt are you running? The issue seems to be that correctly deployed hosted engine does not have any storage available in the webadmin If I understand you correctly. Is that right? We used to require two separate storage domains in 4.1 and older releases. One for hosted engine and one for the rest of the VMs. 4.2.1 changed that. So if you are running 4.1, just add another storage domain [1] and the engine will finish the hosted engine initialization automatically after that. [1] https://www.ovirt.org/documentation/self-hosted/chap-Deploying_Self-Hosted_E... See the paragraph: "Important: Log in as the admin@internal user to continue configuring the Engine and add further resources. You must create another data domain for the data center to be initialized to host regular virtual machine data, and for the Engine virtual machine to be visible. See "Storage" in the Administration Guide for different storage options and on how to add a data storage domain." Best regards Martin Sivak On Fri, Mar 9, 2018 at 10:08 AM, Oliver Dietzel <O.Dietzel@rto.de> wrote:
Install from node iso on gluster works fine, the hosted engine vm installs on gluster, but after installation is finished and rebooted the gluster cluster is not added as data storage. Hosted engine is able to boot from gluster but not able to use it. Looks like HE doesnt use the gluster volume it booted from, but tries to add the same gluster volume a second time.
Is there a workaround?
Error message in web gui: VDSM ovirt-gluster.rto.de command CreateStoragePoolVDS failed: Cannot acquire host id: (u'e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb', SanlockException(22, 'Sanlock lockspace add failure', 'Invalid argument'))
Error message in sanlock.log:
[root@ovirt-gluster ~]# tail /var/log/sanlock.log 2018-03-09 09:37:05 812 [1082]: s5 host 1 2 791 f571ebc1-2572-4689-b64e-6999433f0597.ovirt-glus 2018-03-09 09:37:05 812 [1082]: s5 host 250 1 0 f571ebc1-2572-4689-b64e-6999433f0597.ovirt-glus 2018-03-09 09:37:20 828 [1093]: s5:r4 resource e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:e555168d-719d-4f73-8541-62395c97c 1ff:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e5e8-4064- 9f6a-6ab7c8723eeb/images/7b6675f7-f739-40b8-a554-b19795fe57c0/e555168d -719d-4f73-8541-62395c97c1ff.lease:0 for 3,12,5566 2018-03-09 09:40:58 1046 [1093]: s6 lockspace hosted-engine:1:/var/run/vdsm/storage/e6d008f7-e5e8-4064-9f6a-6ab7c872 3eeb/3b22b2fe-f4d5-4d0c-995a-03b2850b674b/eb7218ff-bdbc-49c5-af17-a62a 7385d299:0 2018-03-09 09:41:20 1067 [1082]: s6 host 1 1 1046 f571ebc1-2572-4689-b64e-6999433f0597.ovirt-glus 2018-03-09 09:42:23 1130 [1093]: s5:r5 resource e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:e555168d-719d-4f73-8541-62395c97c 1ff:/rhev/data-center/mnt/glusterSD/gluster01:_gv0/e6d008f7-e5e8-4064- 9f6a-6ab7c8723eeb/images/7b6675f7-f739-40b8-a554-b19795fe57c0/e555168d -719d-4f73-8541-62395c97c1ff.lease:0 for 2,9,11635 2018-03-09 09:44:30 1258 [1093]: add_lockspace e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:250:/rhev/data-center/mnt/gluster SD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 conflicts with name of list1 s5 e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:1:/rhev/data-center/mnt/glusterSD /gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 2018-03-09 09:44:37 1264 [1093]: s7 lockspace hosted-engine:1:/var/run/vdsm/storage/e6d008f7-e5e8-4064-9f6a-6ab7c872 3eeb/3b22b2fe-f4d5-4d0c-995a-03b2850b674b/eb7218ff-bdbc-49c5-af17-a62a 7385d299:0 2018-03-09 09:44:58 1285 [1082]: s7 host 1 2 1264 f571ebc1-2572-4689-b64e-6999433f0597.ovirt-glus 2018-03-09 09:46:42 1389 [1093]: add_lockspace e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:250:/rhev/data-center/mnt/gluster SD/gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 conflicts with name of list1 s5 e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb:1:/rhev/data-center/mnt/glusterSD /gluster01:_gv0/e6d008f7-e5e8-4064-9f6a-6ab7c8723eeb/dom_md/ids:0 ___________________________________________________________ Oliver Dietzel RTO GmbH Hanauer Landstraße 439 60314 Frankfurt
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
participants (2)
-
Martin Sivak -
Oliver Dietzel