can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi, I have one testing ovirt cluster with one glusterfs storage (Distributed replicated) and 3 HV nodes...it's all working fine...but when i try to add another glusterfs datastorage (replicateX3),i am not able to add the datastore to ovirt and it failed with the following error :- 2015-07-29 10:05:55,194 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-8-thread-32) [751c5f25] IrsBroker::Failed::AttachStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Cannot acquire host id: (u'd0e76dd4-c34a-456e-b7f6-02dc173a3cc1', SanlockException(90, 'Sanlock lockspace add failure', 'Message too long')), code = 661 Engine logs :- http://paste.ubuntu.com/11957076/ Screen shots attached... Thanks, Punit
Hi Punit, Which oVirt version and VDSM version are you using? The exception looks very similar to the scenario described here: http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 Does it helps ? Regards, Maor ----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Wednesday, July 29, 2015 5:22:57 AM Subject: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi,
I have one testing ovirt cluster with one glusterfs storage (Distributed replicated) and 3 HV nodes...it's all working fine...but when i try to add another glusterfs datastorage (replicateX3),i am not able to add the datastore to ovirt and it failed with the following error :-
2015-07-29 10:05:55,194 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-8-thread-32) [751c5f25] IrsBroker::Failed::AttachStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Cannot acquire host id: (u'd0e76dd4-c34a-456e-b7f6-02dc173a3cc1', SanlockException(90, 'Sanlock lockspace add failure', 'Message too long')), code = 661
Engine logs :- http://paste.ubuntu.com/11957076/
Screen shots attached...
Thanks, Punit
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Maor, Ovirt Version :- 3.5.2.1-1.el7.centos VDSM :- vdsm-4.16.20-0.el7.centos Glusterfs version :- glusterfs-3.6.3-1.el7 http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 All are there but still i am facing the same issue.. ------------------------ [root@stor1 ~]# gluster volume info 3TB Volume Name: 3TB Type: Replicate Volume ID: 78d1f376-178d-4b01-90c0-5dac90b50a6c Status: Started Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: stor1:/bricks/b/vol2 Brick2: stor2:/bricks/b/vol2 Brick3: stor3:/bricks/b/vol2 Options Reconfigured: storage.owner-gid: 36 storage.owner-uid: 36 cluster.server-quorum-type: server cluster.quorum-type: auto network.remote-dio: enable cluster.eager-lock: enable performance.stat-prefetch: off performance.io-cache: off performance.read-ahead: off performance.quick-read: off auth.allow: * user.cifs: enable nfs.disable: off [root@stor1 ~]# ------------------------ [image: Inline image 1] On Wed, Jul 29, 2015 at 11:04 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
Hi Punit,
Which oVirt version and VDSM version are you using? The exception looks very similar to the scenario described here: http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 Does it helps ?
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Wednesday, July 29, 2015 5:22:57 AM Subject: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi,
I have one testing ovirt cluster with one glusterfs storage (Distributed replicated) and 3 HV nodes...it's all working fine...but when i try to add another glusterfs datastorage (replicateX3),i am not able to add the datastore to ovirt and it failed with the following error :-
2015-07-29 10:05:55,194 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-8-thread-32) [751c5f25] IrsBroker::Failed::AttachStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Cannot acquire host id: (u'd0e76dd4-c34a-456e-b7f6-02dc173a3cc1', SanlockException(90, 'Sanlock lockspace add failure', 'Message too long')), code = 661
Engine logs :- http://paste.ubuntu.com/11957076/
Screen shots attached...
Thanks, Punit
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Thanks Punit, I will take a look. meanwhile can you please also add the sanlock log and the /var/log/messages log Regards, Maor ----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Thursday, July 30, 2015 4:15:17 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Ovirt Version :- 3.5.2.1-1.el7.centos VDSM :- vdsm-4.16.20-0.el7.centos Glusterfs version :- glusterfs-3.6.3-1.el7
http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 All are there but still i am facing the same issue..
------------------------ [root@stor1 ~]# gluster volume info 3TB
Volume Name: 3TB Type: Replicate Volume ID: 78d1f376-178d-4b01-90c0-5dac90b50a6c Status: Started Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: stor1:/bricks/b/vol2 Brick2: stor2:/bricks/b/vol2 Brick3: stor3:/bricks/b/vol2 Options Reconfigured: storage.owner-gid: 36 storage.owner-uid: 36 cluster.server-quorum-type: server cluster.quorum-type: auto network.remote-dio: enable cluster.eager-lock: enable performance.stat-prefetch: off performance.io-cache: off performance.read-ahead: off performance.quick-read: off auth.allow: * user.cifs: enable nfs.disable: off [root@stor1 ~]# ------------------------
[image: Inline image 1]
On Wed, Jul 29, 2015 at 11:04 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
Hi Punit,
Which oVirt version and VDSM version are you using? The exception looks very similar to the scenario described here: http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 Does it helps ?
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Wednesday, July 29, 2015 5:22:57 AM Subject: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi,
I have one testing ovirt cluster with one glusterfs storage (Distributed replicated) and 3 HV nodes...it's all working fine...but when i try to add another glusterfs datastorage (replicateX3),i am not able to add the datastore to ovirt and it failed with the following error :-
2015-07-29 10:05:55,194 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-8-thread-32) [751c5f25] IrsBroker::Failed::AttachStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Cannot acquire host id: (u'd0e76dd4-c34a-456e-b7f6-02dc173a3cc1', SanlockException(90, 'Sanlock lockspace add failure', 'Message too long')), code = 661
Engine logs :- http://paste.ubuntu.com/11957076/
Screen shots attached...
Thanks, Punit
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
----- Original Message -----
From: "Maor Lipchuk" <mlipchuk@redhat.com> To: "Punit Dambiwal" <hypunit@gmail.com> Cc: users@ovirt.org Sent: Thursday, July 30, 2015 10:56:02 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Thanks Punit, I will take a look. meanwhile can you please also add the sanlock log and the /var/log/messages log
Also, please attach the full engine and vdsm logs as well
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Thursday, July 30, 2015 4:15:17 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Ovirt Version :- 3.5.2.1-1.el7.centos VDSM :- vdsm-4.16.20-0.el7.centos Glusterfs version :- glusterfs-3.6.3-1.el7
http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 All are there but still i am facing the same issue..
------------------------ [root@stor1 ~]# gluster volume info 3TB
Volume Name: 3TB Type: Replicate Volume ID: 78d1f376-178d-4b01-90c0-5dac90b50a6c Status: Started Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: stor1:/bricks/b/vol2 Brick2: stor2:/bricks/b/vol2 Brick3: stor3:/bricks/b/vol2 Options Reconfigured: storage.owner-gid: 36 storage.owner-uid: 36 cluster.server-quorum-type: server cluster.quorum-type: auto network.remote-dio: enable cluster.eager-lock: enable performance.stat-prefetch: off performance.io-cache: off performance.read-ahead: off performance.quick-read: off auth.allow: * user.cifs: enable nfs.disable: off [root@stor1 ~]# ------------------------
[image: Inline image 1]
On Wed, Jul 29, 2015 at 11:04 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
Hi Punit,
Which oVirt version and VDSM version are you using? The exception looks very similar to the scenario described here: http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 Does it helps ?
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Wednesday, July 29, 2015 5:22:57 AM Subject: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi,
I have one testing ovirt cluster with one glusterfs storage (Distributed replicated) and 3 HV nodes...it's all working fine...but when i try to add another glusterfs datastorage (replicateX3),i am not able to add the datastore to ovirt and it failed with the following error :-
2015-07-29 10:05:55,194 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-8-thread-32) [751c5f25] IrsBroker::Failed::AttachStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Cannot acquire host id: (u'd0e76dd4-c34a-456e-b7f6-02dc173a3cc1', SanlockException(90, 'Sanlock lockspace add failure', 'Message too long')), code = 661
Engine logs :- http://paste.ubuntu.com/11957076/
Screen shots attached...
Thanks, Punit
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Maor, Please find the below logs :- 1. Engine logs :- http://paste.ubuntu.com/11971901/ 2. Sanlock lock (HV1) :- http://paste.ubuntu.com/11971916/ 3. VDSM Logs (HV1) :- http://paste.ubuntu.com/11971926/ 4. Sanlock lock (HV2) :- http://paste.ubuntu.com/11971950/ 5. VDSM Logs (HV2) :- http://paste.ubuntu.com/11971955/ 6. Var Messages (HV1) :- http://paste.ubuntu.com/11971967/ 7. Var Messages (HV2) :- http://paste.ubuntu.com/11971977/ The storage can be mount but in the ovirt it's failed to attached... [image: Inline image 1] On Thu, Jul 30, 2015 at 3:59 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
----- Original Message -----
From: "Maor Lipchuk" <mlipchuk@redhat.com> To: "Punit Dambiwal" <hypunit@gmail.com> Cc: users@ovirt.org Sent: Thursday, July 30, 2015 10:56:02 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Thanks Punit, I will take a look. meanwhile can you please also add the sanlock log and the /var/log/messages log
Also, please attach the full engine and vdsm logs as well
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar
<iheim@redhat.com> Sent: Thursday, July 30, 2015 4:15:17 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Ovirt Version :- 3.5.2.1-1.el7.centos VDSM :- vdsm-4.16.20-0.el7.centos Glusterfs version :- glusterfs-3.6.3-1.el7
http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 All are there but still i am facing the same issue..
------------------------ [root@stor1 ~]# gluster volume info 3TB
Volume Name: 3TB Type: Replicate Volume ID: 78d1f376-178d-4b01-90c0-5dac90b50a6c Status: Started Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: stor1:/bricks/b/vol2 Brick2: stor2:/bricks/b/vol2 Brick3: stor3:/bricks/b/vol2 Options Reconfigured: storage.owner-gid: 36 storage.owner-uid: 36 cluster.server-quorum-type: server cluster.quorum-type: auto network.remote-dio: enable cluster.eager-lock: enable performance.stat-prefetch: off performance.io-cache: off performance.read-ahead: off performance.quick-read: off auth.allow: * user.cifs: enable nfs.disable: off [root@stor1 ~]# ------------------------
[image: Inline image 1]
On Wed, Jul 29, 2015 at 11:04 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
Hi Punit,
Which oVirt version and VDSM version are you using? The exception looks very similar to the scenario described here: http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 Does it helps ?
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Wednesday, July 29, 2015 5:22:57 AM Subject: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi,
I have one testing ovirt cluster with one glusterfs storage (Distributed replicated) and 3 HV nodes...it's all working fine...but when i
add
another glusterfs datastorage (replicateX3),i am not able to add
Heim" try to the
datastore to ovirt and it failed with the following error :-
2015-07-29 10:05:55,194 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-8-thread-32) [751c5f25] IrsBroker::Failed::AttachStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Cannot acquire host id: (u'd0e76dd4-c34a-456e-b7f6-02dc173a3cc1', SanlockException(90, 'Sanlock lockspace add failure', 'Message too long')), code = 661
Engine logs :- http://paste.ubuntu.com/11957076/
Screen shots attached...
Thanks, Punit
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Punit, Thanks for the logs, I didn't found the origin of the problem, perhaps you can try to see if stopping the VDSM service and restart the sanlock service can help. Ala, I know you handled some Gluster issues recently, do you have any insight about this? Have you encountered something similar? Regards, Maor ----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: users@ovirt.org Sent: Friday, July 31, 2015 11:48:41 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Please find the below logs :-
1. Engine logs :- http://paste.ubuntu.com/11971901/ 2. Sanlock lock (HV1) :- http://paste.ubuntu.com/11971916/ 3. VDSM Logs (HV1) :- http://paste.ubuntu.com/11971926/ 4. Sanlock lock (HV2) :- http://paste.ubuntu.com/11971950/ 5. VDSM Logs (HV2) :- http://paste.ubuntu.com/11971955/ 6. Var Messages (HV1) :- http://paste.ubuntu.com/11971967/ 7. Var Messages (HV2) :- http://paste.ubuntu.com/11971977/
The storage can be mount but in the ovirt it's failed to attached...
[image: Inline image 1]
On Thu, Jul 30, 2015 at 3:59 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
----- Original Message -----
From: "Maor Lipchuk" <mlipchuk@redhat.com> To: "Punit Dambiwal" <hypunit@gmail.com> Cc: users@ovirt.org Sent: Thursday, July 30, 2015 10:56:02 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Thanks Punit, I will take a look. meanwhile can you please also add the sanlock log and the /var/log/messages log
Also, please attach the full engine and vdsm logs as well
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar
<iheim@redhat.com> Sent: Thursday, July 30, 2015 4:15:17 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Ovirt Version :- 3.5.2.1-1.el7.centos VDSM :- vdsm-4.16.20-0.el7.centos Glusterfs version :- glusterfs-3.6.3-1.el7
http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 All are there but still i am facing the same issue..
------------------------ [root@stor1 ~]# gluster volume info 3TB
Volume Name: 3TB Type: Replicate Volume ID: 78d1f376-178d-4b01-90c0-5dac90b50a6c Status: Started Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: stor1:/bricks/b/vol2 Brick2: stor2:/bricks/b/vol2 Brick3: stor3:/bricks/b/vol2 Options Reconfigured: storage.owner-gid: 36 storage.owner-uid: 36 cluster.server-quorum-type: server cluster.quorum-type: auto network.remote-dio: enable cluster.eager-lock: enable performance.stat-prefetch: off performance.io-cache: off performance.read-ahead: off performance.quick-read: off auth.allow: * user.cifs: enable nfs.disable: off [root@stor1 ~]# ------------------------
[image: Inline image 1]
On Wed, Jul 29, 2015 at 11:04 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
Hi Punit,
Which oVirt version and VDSM version are you using? The exception looks very similar to the scenario described here: http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 Does it helps ?
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Wednesday, July 29, 2015 5:22:57 AM Subject: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi,
I have one testing ovirt cluster with one glusterfs storage (Distributed replicated) and 3 HV nodes...it's all working fine...but when i
add
another glusterfs datastorage (replicateX3),i am not able to add
Heim" try to the
datastore to ovirt and it failed with the following error :-
2015-07-29 10:05:55,194 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-8-thread-32) [751c5f25] IrsBroker::Failed::AttachStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Cannot acquire host id: (u'd0e76dd4-c34a-456e-b7f6-02dc173a3cc1', SanlockException(90, 'Sanlock lockspace add failure', 'Message too long')), code = 661
Engine logs :- http://paste.ubuntu.com/11957076/
Screen shots attached...
Thanks, Punit
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Maor, Already tired with vdsm and sanlock service restart but nothing help... Yes...i was facing some gluster issues earlier but those all resolved...but now i am stuck in Ovirt part...please help to solve this issue.. On Sun, Aug 2, 2015 at 4:22 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
Hi Punit,
Thanks for the logs, I didn't found the origin of the problem, perhaps you can try to see if stopping the VDSM service and restart the sanlock service can help.
Ala, I know you handled some Gluster issues recently, do you have any insight about this? Have you encountered something similar?
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: users@ovirt.org Sent: Friday, July 31, 2015 11:48:41 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Please find the below logs :-
1. Engine logs :- http://paste.ubuntu.com/11971901/ 2. Sanlock lock (HV1) :- http://paste.ubuntu.com/11971916/ 3. VDSM Logs (HV1) :- http://paste.ubuntu.com/11971926/ 4. Sanlock lock (HV2) :- http://paste.ubuntu.com/11971950/ 5. VDSM Logs (HV2) :- http://paste.ubuntu.com/11971955/ 6. Var Messages (HV1) :- http://paste.ubuntu.com/11971967/ 7. Var Messages (HV2) :- http://paste.ubuntu.com/11971977/
The storage can be mount but in the ovirt it's failed to attached...
[image: Inline image 1]
On Thu, Jul 30, 2015 at 3:59 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
----- Original Message -----
From: "Maor Lipchuk" <mlipchuk@redhat.com> To: "Punit Dambiwal" <hypunit@gmail.com> Cc: users@ovirt.org Sent: Thursday, July 30, 2015 10:56:02 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace
add
failure', 'Message too long'
Thanks Punit, I will take a look. meanwhile can you please also add the sanlock log and the
/var/log/messages
log
Also, please attach the full engine and vdsm logs as well
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar
<iheim@redhat.com> Sent: Thursday, July 30, 2015 4:15:17 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Ovirt Version :- 3.5.2.1-1.el7.centos VDSM :- vdsm-4.16.20-0.el7.centos Glusterfs version :- glusterfs-3.6.3-1.el7
http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 All are there but still i am facing the same issue..
------------------------ [root@stor1 ~]# gluster volume info 3TB
Volume Name: 3TB Type: Replicate Volume ID: 78d1f376-178d-4b01-90c0-5dac90b50a6c Status: Started Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: stor1:/bricks/b/vol2 Brick2: stor2:/bricks/b/vol2 Brick3: stor3:/bricks/b/vol2 Options Reconfigured: storage.owner-gid: 36 storage.owner-uid: 36 cluster.server-quorum-type: server cluster.quorum-type: auto network.remote-dio: enable cluster.eager-lock: enable performance.stat-prefetch: off performance.io-cache: off performance.read-ahead: off performance.quick-read: off auth.allow: * user.cifs: enable nfs.disable: off [root@stor1 ~]# ------------------------
[image: Inline image 1]
On Wed, Jul 29, 2015 at 11:04 PM, Maor Lipchuk < mlipchuk@redhat.com> wrote:
Hi Punit,
Which oVirt version and VDSM version are you using? The exception looks very similar to the scenario described here: http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 Does it helps ?
Regards, Maor
----- Original Message ----- > From: "Punit Dambiwal" <hypunit@gmail.com> > To: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar Heim" <iheim@redhat.com> > Sent: Wednesday, July 29, 2015 5:22:57 AM > Subject: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long' > > Hi, > > I have one testing ovirt cluster with one glusterfs storage > (Distributed > replicated) and 3 HV nodes...it's all working fine...but when i
add > another glusterfs datastorage (replicateX3),i am not able to add
Heim" try to the
> datastore to ovirt and it failed with the following error :- > > 2015-07-29 10:05:55,194 ERROR > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] > (org.ovirt.thread.pool-8-thread-32) [751c5f25] > IrsBroker::Failed::AttachStorageDomainVDS due to: IRSErrorException: > IRSGenericException: IRSErrorException: Failed to > AttachStorageDomainVDS, > error = Cannot acquire host id: > (u'd0e76dd4-c34a-456e-b7f6-02dc173a3cc1', > SanlockException(90, 'Sanlock lockspace add failure', 'Message too long')), > code = 661 > > Engine logs :- http://paste.ubuntu.com/11957076/ > > Screen shots attached... > > Thanks, > Punit > > _______________________________________________ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users >
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Can you please open a bug at https://bugzilla.redhat.com/enter_bug.cgi?product=oVirt with all the relevant logs so we can track this Thanks, Maor ----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: "Ala Hino" <ahino@redhat.com>, users@ovirt.org Sent: Monday, August 3, 2015 5:42:42 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Already tired with vdsm and sanlock service restart but nothing help...
Yes...i was facing some gluster issues earlier but those all resolved...but now i am stuck in Ovirt part...please help to solve this issue..
On Sun, Aug 2, 2015 at 4:22 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
Hi Punit,
Thanks for the logs, I didn't found the origin of the problem, perhaps you can try to see if stopping the VDSM service and restart the sanlock service can help.
Ala, I know you handled some Gluster issues recently, do you have any insight about this? Have you encountered something similar?
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: users@ovirt.org Sent: Friday, July 31, 2015 11:48:41 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Please find the below logs :-
1. Engine logs :- http://paste.ubuntu.com/11971901/ 2. Sanlock lock (HV1) :- http://paste.ubuntu.com/11971916/ 3. VDSM Logs (HV1) :- http://paste.ubuntu.com/11971926/ 4. Sanlock lock (HV2) :- http://paste.ubuntu.com/11971950/ 5. VDSM Logs (HV2) :- http://paste.ubuntu.com/11971955/ 6. Var Messages (HV1) :- http://paste.ubuntu.com/11971967/ 7. Var Messages (HV2) :- http://paste.ubuntu.com/11971977/
The storage can be mount but in the ovirt it's failed to attached...
[image: Inline image 1]
On Thu, Jul 30, 2015 at 3:59 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
----- Original Message -----
From: "Maor Lipchuk" <mlipchuk@redhat.com> To: "Punit Dambiwal" <hypunit@gmail.com> Cc: users@ovirt.org Sent: Thursday, July 30, 2015 10:56:02 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace
add
failure', 'Message too long'
Thanks Punit, I will take a look. meanwhile can you please also add the sanlock log and the
/var/log/messages
log
Also, please attach the full engine and vdsm logs as well
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar
<iheim@redhat.com> Sent: Thursday, July 30, 2015 4:15:17 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Ovirt Version :- 3.5.2.1-1.el7.centos VDSM :- vdsm-4.16.20-0.el7.centos Glusterfs version :- glusterfs-3.6.3-1.el7
http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 All are there but still i am facing the same issue..
------------------------ [root@stor1 ~]# gluster volume info 3TB
Volume Name: 3TB Type: Replicate Volume ID: 78d1f376-178d-4b01-90c0-5dac90b50a6c Status: Started Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: stor1:/bricks/b/vol2 Brick2: stor2:/bricks/b/vol2 Brick3: stor3:/bricks/b/vol2 Options Reconfigured: storage.owner-gid: 36 storage.owner-uid: 36 cluster.server-quorum-type: server cluster.quorum-type: auto network.remote-dio: enable cluster.eager-lock: enable performance.stat-prefetch: off performance.io-cache: off performance.read-ahead: off performance.quick-read: off auth.allow: * user.cifs: enable nfs.disable: off [root@stor1 ~]# ------------------------
[image: Inline image 1]
On Wed, Jul 29, 2015 at 11:04 PM, Maor Lipchuk < mlipchuk@redhat.com> wrote:
> Hi Punit, > > Which oVirt version and VDSM version are you using? > The exception looks very similar to the scenario described here: > http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 > Does it helps ? > > Regards, > Maor > > > ----- Original Message ----- > > From: "Punit Dambiwal" <hypunit@gmail.com> > > To: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar > Heim" <iheim@redhat.com> > > Sent: Wednesday, July 29, 2015 5:22:57 AM > > Subject: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add > failure', 'Message too long' > > > > Hi, > > > > I have one testing ovirt cluster with one glusterfs storage > > (Distributed > > replicated) and 3 HV nodes...it's all working fine...but when i
> add > > another glusterfs datastorage (replicateX3),i am not able to add
Heim" try to the
> > datastore to ovirt and it failed with the following error :- > > > > 2015-07-29 10:05:55,194 ERROR > > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] > > (org.ovirt.thread.pool-8-thread-32) [751c5f25] > > IrsBroker::Failed::AttachStorageDomainVDS due to: IRSErrorException: > > IRSGenericException: IRSErrorException: Failed to > > AttachStorageDomainVDS, > > error = Cannot acquire host id: > > (u'd0e76dd4-c34a-456e-b7f6-02dc173a3cc1', > > SanlockException(90, 'Sanlock lockspace add failure', 'Message too > long')), > > code = 661 > > > > Engine logs :- http://paste.ubuntu.com/11957076/ > > > > Screen shots attached... > > > > Thanks, > > Punit > > > > _______________________________________________ > > Users mailing list > > Users@ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users > > >
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Maor, I submitted the bug here :- https://bugzilla.redhat.com/show_bug.cgi?id=1249851 Thanks, Punit On Mon, Aug 3, 2015 at 4:08 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
Can you please open a bug at https://bugzilla.redhat.com/enter_bug.cgi?product=oVirt with all the relevant logs so we can track this
Thanks, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: "Ala Hino" <ahino@redhat.com>, users@ovirt.org Sent: Monday, August 3, 2015 5:42:42 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Already tired with vdsm and sanlock service restart but nothing help...
Yes...i was facing some gluster issues earlier but those all resolved...but now i am stuck in Ovirt part...please help to solve this issue..
On Sun, Aug 2, 2015 at 4:22 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
Hi Punit,
Thanks for the logs, I didn't found the origin of the problem, perhaps you can try to see if stopping the VDSM service and restart the sanlock service can help.
Ala, I know you handled some Gluster issues recently, do you have any insight about this? Have you encountered something similar?
Regards, Maor
----- Original Message -----
From: "Punit Dambiwal" <hypunit@gmail.com> To: "Maor Lipchuk" <mlipchuk@redhat.com> Cc: users@ovirt.org Sent: Friday, July 31, 2015 11:48:41 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add failure', 'Message too long'
Hi Maor,
Please find the below logs :-
1. Engine logs :- http://paste.ubuntu.com/11971901/ 2. Sanlock lock (HV1) :- http://paste.ubuntu.com/11971916/ 3. VDSM Logs (HV1) :- http://paste.ubuntu.com/11971926/ 4. Sanlock lock (HV2) :- http://paste.ubuntu.com/11971950/ 5. VDSM Logs (HV2) :- http://paste.ubuntu.com/11971955/ 6. Var Messages (HV1) :- http://paste.ubuntu.com/11971967/ 7. Var Messages (HV2) :- http://paste.ubuntu.com/11971977/
The storage can be mount but in the ovirt it's failed to attached...
[image: Inline image 1]
On Thu, Jul 30, 2015 at 3:59 PM, Maor Lipchuk <mlipchuk@redhat.com> wrote:
----- Original Message -----
From: "Maor Lipchuk" <mlipchuk@redhat.com> To: "Punit Dambiwal" <hypunit@gmail.com> Cc: users@ovirt.org Sent: Thursday, July 30, 2015 10:56:02 AM Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock
lockspace add
failure', 'Message too long'
Thanks Punit, I will take a look. meanwhile can you please also add the sanlock log and the
/var/log/messages
log
Also, please attach the full engine and vdsm logs as well
Regards, Maor
----- Original Message ----- > From: "Punit Dambiwal" <hypunit@gmail.com> > To: "Maor Lipchuk" <mlipchuk@redhat.com> > Cc: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>,
> <iheim@redhat.com> > Sent: Thursday, July 30, 2015 4:15:17 AM > Subject: Re: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add > failure', 'Message too long' > > Hi Maor, > > Ovirt Version :- 3.5.2.1-1.el7.centos > VDSM :- vdsm-4.16.20-0.el7.centos > Glusterfs version :- glusterfs-3.6.3-1.el7 > > http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 All are > there but still i am facing the same issue.. > > ------------------------ > [root@stor1 ~]# gluster volume info 3TB > > Volume Name: 3TB > Type: Replicate > Volume ID: 78d1f376-178d-4b01-90c0-5dac90b50a6c > Status: Started > Number of Bricks: 1 x 3 = 3 > Transport-type: tcp > Bricks: > Brick1: stor1:/bricks/b/vol2 > Brick2: stor2:/bricks/b/vol2 > Brick3: stor3:/bricks/b/vol2 > Options Reconfigured: > storage.owner-gid: 36 > storage.owner-uid: 36 > cluster.server-quorum-type: server > cluster.quorum-type: auto > network.remote-dio: enable > cluster.eager-lock: enable > performance.stat-prefetch: off > performance.io-cache: off > performance.read-ahead: off > performance.quick-read: off > auth.allow: * > user.cifs: enable > nfs.disable: off > [root@stor1 ~]# > ------------------------ > > [image: Inline image 1] > > > > On Wed, Jul 29, 2015 at 11:04 PM, Maor Lipchuk < mlipchuk@redhat.com> wrote: > > > Hi Punit, > > > > Which oVirt version and VDSM version are you using? > > The exception looks very similar to the scenario described here: > > http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/19732 > > Does it helps ? > > > > Regards, > > Maor > > > > > > ----- Original Message ----- > > > From: "Punit Dambiwal" <hypunit@gmail.com> > > > To: users@ovirt.org, "Dan Kenigsberg" <danken@redhat.com>, "Itamar > > Heim" <iheim@redhat.com> > > > Sent: Wednesday, July 29, 2015 5:22:57 AM > > > Subject: [ovirt-users] can't add Datastorge | 'Sanlock lockspace add > > failure', 'Message too long' > > > > > > Hi, > > > > > > I have one testing ovirt cluster with one glusterfs storage > > > (Distributed > > > replicated) and 3 HV nodes...it's all working fine...but when i
> > add > > > another glusterfs datastorage (replicateX3),i am not able to add
"Itamar Heim" try to the
> > > datastore to ovirt and it failed with the following error :- > > > > > > 2015-07-29 10:05:55,194 ERROR > > > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] > > > (org.ovirt.thread.pool-8-thread-32) [751c5f25] > > > IrsBroker::Failed::AttachStorageDomainVDS due to: IRSErrorException: > > > IRSGenericException: IRSErrorException: Failed to > > > AttachStorageDomainVDS, > > > error = Cannot acquire host id: > > > (u'd0e76dd4-c34a-456e-b7f6-02dc173a3cc1', > > > SanlockException(90, 'Sanlock lockspace add failure', 'Message too > > long')), > > > code = 661 > > > > > > Engine logs :- http://paste.ubuntu.com/11957076/ > > > > > > Screen shots attached... > > > > > > Thanks, > > > Punit > > > > > > _______________________________________________ > > > Users mailing list > > > Users@ovirt.org > > > http://lists.ovirt.org/mailman/listinfo/users > > > > > > _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
participants (2)
-
Maor Lipchuk -
Punit Dambiwal