5:06 a.m.
Hi,
I try to add gluster volume but it failed...
Ovirt :- 3.5
VDSM :- vdsm-4.16.7-1.gitdb83943.el7
KVM :- 1.5.3 - 60.el7_0.2
libvirt-1.1.1-29.el7_0.4
Glusterfs :- glusterfs-3.5.3-1.el7
Engine Logs :-
2015-01-08 09:57:52,569 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-08 09:57:52,609 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-08 09:57:55,582 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-08 09:57:55,591 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-08 09:57:55,596 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-08 09:57:55,633 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
^C
10:20 a.m.
Hi Punit,
can you please provide also errors from /var/log/vdsm/vdsm.log and
/var/log/vdsm/vdsmd.log
it would be really helpful if you provided exact steps how to reproduce the problem.
regards
Martin Pavlik - rhev QE
On 08 Jan 2015, at 03:06, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
Hi,
I try to add gluster volume but it failed...
Ovirt :- 3.5
VDSM :- vdsm-4.16.7-1.gitdb83943.el7
KVM :- 1.5.3 - 60.el7_0.2
libvirt-1.1.1-29.el7_0.4
Glusterfs :- glusterfs-3.5.3-1.el7
Engine Logs :-
2015-01-08 09:57:52,569 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock EngineLock
[exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-08 09:57:52,609 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock EngineLock
[exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-08 09:57:55,582 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock EngineLock
[exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-08 09:57:55,591 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock EngineLock
[exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-08 09:57:55,596 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock EngineLock
[exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-08 09:57:55,633 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock EngineLock
[exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
^C
11:55 a.m.
Hi Martin,
The steps are below :-
1. Step the ovirt engine on the one server...
2. Installed centos 7 on 4 host node servers..
3. I am using host node (compute+storage)....now i have added all 4 nodes
to engine...
4. Create the gluster volume from GUI...
Network :-
eth0 :- public network (1G)
eth1+eth2=bond0= VM public network (1G)
eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
every hostnode has 24 bricks=24*4(distributed replicated)
Thanks,
Punit
On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík <mpavlik(a)redhat.com> wrote:
Hi Punit,
can you please provide also errors from /var/log/vdsm/vdsm.log and
/var/log/vdsm/vdsmd.log
it would be really helpful if you provided exact steps how to reproduce
the problem.
regards
Martin Pavlik - rhev QE
> On 08 Jan 2015, at 03:06, Punit Dambiwal <hypunit(a)gmail.com> wrote:
>
> Hi,
>
> I try to add gluster volume but it failed...
>
> Ovirt :- 3.5
> VDSM :- vdsm-4.16.7-1.gitdb83943.el7
> KVM :- 1.5.3 - 60.el7_0.2
> libvirt-1.1.1-29.el7_0.4
> Glusterfs :- glusterfs-3.5.3-1.el7
>
> Engine Logs :-
>
> 2015-01-08 09:57:52,569 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
> , sharedLocks= ]
> 2015-01-08 09:57:52,609 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
> , sharedLocks= ]
> 2015-01-08 09:57:55,582 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
> , sharedLocks= ]
> 2015-01-08 09:57:55,591 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
> , sharedLocks= ]
> 2015-01-08 09:57:55,596 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
> , sharedLocks= ]
> 2015-01-08 09:57:55,633 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
> , sharedLocks= ]
> ^C
>
>
1:05 p.m.
This is a multi-part message in MIME format.
--------------060508090800030806070903
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 8bit
Do you see any errors in the UI?
Also please provide the engine.log and vdsm.log when the failure occured.
Thanks,
Kanagaraj
On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
Hi Martin,
The steps are below :-
1. Step the ovirt engine on the one server...
2. Installed centos 7 on 4 host node servers..
3. I am using host node (compute+storage)....now i have added all 4
nodes to engine...
4. Create the gluster volume from GUI...
Network :-
eth0 :- public network (1G)
eth1+eth2=bond0= VM public network (1G)
eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
every hostnode has 24 bricks=24*4(distributed replicated)
Thanks,
Punit
On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík <mpavlik(a)redhat.com
<mailto:mpavlik@redhat.com>> wrote:
Hi Punit,
can you please provide also errors from /var/log/vdsm/vdsm.log and
/var/log/vdsm/vdsmd.log
it would be really helpful if you provided exact steps how to
reproduce the problem.
regards
Martin Pavlik - rhev QE
> On 08 Jan 2015, at 03:06, Punit Dambiwal <hypunit(a)gmail.com
<mailto:hypunit@gmail.com>> wrote:
>
> Hi,
>
> I try to add gluster volume but it failed...
>
> Ovirt :- 3.5
> VDSM :- vdsm-4.16.7-1.gitdb83943.el7
> KVM :- 1.5.3 - 60.el7_0.2
> libvirt-1.1.1-29.el7_0.4
> Glusterfs :- glusterfs-3.5.3-1.el7
>
> Engine Logs :-
>
> 2015-01-08 09:57:52,569 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
> , sharedLocks= ]
> 2015-01-08 09:57:52,609 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
> , sharedLocks= ]
> 2015-01-08 09:57:55,582 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
> , sharedLocks= ]
> 2015-01-08 09:57:55,591 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
> , sharedLocks= ]
> 2015-01-08 09:57:55,596 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
> , sharedLocks= ]
> 2015-01-08 09:57:55,633 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
> , sharedLocks= ]
> ^C
>
>
--------------060508090800030806070903
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Do you see any errors in the UI?<br>
<br>
Also please provide the engine.log and vdsm.log when the failure
occured.<br>
<br>
Thanks,<br>
Kanagaraj<br>
<br>
<div class="moz-cite-prefix">On 01/08/2015 02:25 PM, Punit Dambiwal
wrote:<br>
</div>
<blockquote
cite="mid:CAGZcrBmKFSwHz_MT+bynx2=WEtZfMY0N8mL5BfEBxiW1q3KN9Q@mail.gmail.com"
type="cite">
<div dir="ltr">Hi Martin,
<div><br>
</div>
<div>The steps are below :- </div>
<div><br>
</div>
<div>1. Step the ovirt engine on the one server...</div>
<div>2. Installed centos 7 on 4 host node servers..</div>
<div>3. I am using host node (compute+storage)....now i have
added all 4 nodes to engine...</div>
<div>4. Create the gluster volume from GUI...</div>
<div><br>
</div>
<div>Network :- </div>
<div>eth0 :- public network (1G)</div>
<div>eth1+eth2=bond0= VM public network (1G)</div>
<div>eth3+eth4=bond1=ovirtmgmt+storage (10G private network)</div>
<div><br>
</div>
<div>every hostnode has 24 bricks=24*4(distributed replicated)</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Punit</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Thu, Jan 8, 2015 at 3:20 PM, Martin
Pavlík <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:mpavlik@redhat.com"
target="_blank">mpavlik(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Punit,<br>
<br>
can you please provide also errors from
/var/log/vdsm/vdsm.log and /var/log/vdsm/vdsmd.log<br>
<br>
it would be really helpful if you provided exact steps how
to reproduce the problem.<br>
<br>
regards<br>
<br>
Martin Pavlik - rhev QE<br>
<div class="HOEnZb">
<div class="h5">> On 08 Jan 2015, at 03:06, Punit
Dambiwal <<a moz-do-not-send="true"
href="mailto:hypunit@gmail.com">hypunit@gmail.com</a>>
wrote:<br>
><br>
> Hi,<br>
><br>
> I try to add gluster volume but it failed...<br>
><br>
> Ovirt :- 3.5<br>
> VDSM :- vdsm-4.16.7-1.gitdb83943.el7<br>
> KVM :- 1.5.3 - 60.el7_0.2<br>
> libvirt-1.1.1-29.el7_0.4<br>
> Glusterfs :- glusterfs-3.5.3-1.el7<br>
><br>
> Engine Logs :-<br>
><br>
> 2015-01-08 09:57:52,569 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br>
> , sharedLocks= ]<br>
> 2015-01-08 09:57:52,609 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br>
> , sharedLocks= ]<br>
> 2015-01-08 09:57:55,582 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br>
> , sharedLocks= ]<br>
> 2015-01-08 09:57:55,591 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br>
> , sharedLocks= ]<br>
> 2015-01-08 09:57:55,596 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br>
> , sharedLocks= ]<br>
> 2015-01-08 09:57:55,633 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br>
> , sharedLocks= ]<br>
> ^C<br>
><br>
><br>
<br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</body>
</html>
--------------060508090800030806070903--
1:13 p.m.
Hi Kanagaraj,
Please find the attached logs :-
Engine Logs :- http://ur1.ca/jdopt
VDSM Logs :- http://ur1.ca/jdoq9
On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
Do you see any errors in the UI?
Also please provide the engine.log and vdsm.log when the failure occured.
Thanks,
Kanagaraj
On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
Hi Martin,
The steps are below :-
1. Step the ovirt engine on the one server...
2. Installed centos 7 on 4 host node servers..
3. I am using host node (compute+storage)....now i have added all 4 nodes
to engine...
4. Create the gluster volume from GUI...
Network :-
eth0 :- public network (1G)
eth1+eth2=bond0= VM public network (1G)
eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
every hostnode has 24 bricks=24*4(distributed replicated)
Thanks,
Punit
On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík <mpavlik(a)redhat.com> wrote:
> Hi Punit,
>
> can you please provide also errors from /var/log/vdsm/vdsm.log and
> /var/log/vdsm/vdsmd.log
>
> it would be really helpful if you provided exact steps how to reproduce
> the problem.
>
> regards
>
> Martin Pavlik - rhev QE
> > On 08 Jan 2015, at 03:06, Punit Dambiwal <hypunit(a)gmail.com> wrote:
> >
> > Hi,
> >
> > I try to add gluster volume but it failed...
> >
> > Ovirt :- 3.5
> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
> > KVM :- 1.5.3 - 60.el7_0.2
> > libvirt-1.1.1-29.el7_0.4
> > Glusterfs :- glusterfs-3.5.3-1.el7
> >
> > Engine Logs :-
> >
> > 2015-01-08 09:57:52,569 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-08 09:57:52,609 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-08 09:57:55,582 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-08 09:57:55,591 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-08 09:57:55,596 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-08 09:57:55,633 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> > , sharedLocks= ]
> > ^C
> >
> >
>
>
2:19 p.m.
--Apple-Mail=_109729C8-42C5-4952-9855-76A598BFB1A1
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8
Hi Punit,
can you verify that nodes contain cluster packages from the following =
log?
Thread-14::DEBUG::2015-01-09 =
18:06:28,823::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,825::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-object',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,826::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-plugin',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-account',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-proxy',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-doc',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-container',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('glusterfs-geo-replication',) not found
M.
On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
=20
Hi Kanagaraj,
=20
Please find the attached logs :-=20
=20
Engine Logs :- http://ur1.ca/jdopt <http://ur1.ca/jdopt>
VDSM Logs :- http://ur1.ca/jdoq9 <http://ur1.ca/jdoq9>
=20
=20
=20
On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com =
<mailto:kmayilsa@redhat.com>> wrote:
Do you see any errors in the UI?
=20
Also please provide the engine.log and vdsm.log when the failure =
occured.
=20
Thanks,
Kanagaraj
=20
=20
On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
> Hi Martin,
>=20
> The steps are below :-=20
>=20
> 1. Step the ovirt engine on the one server...
> 2. Installed centos 7 on 4 host node servers..
> 3. I am using host node (compute+storage)....now i have added all 4 =
nodes to
engine...
> 4. Create the gluster volume from GUI...
>=20
> Network :-=20
> eth0 :- public network (1G)
> eth1+eth2=3Dbond0=3D VM public network (1G)
> eth3+eth4=3Dbond1=3Dovirtmgmt+storage (10G private network)
>=20
> every hostnode has 24 bricks=3D24*4(distributed replicated)
>=20
> Thanks,
> Punit
>=20
>=20
> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavl=C3=ADk =
<mpavlik(a)redhat.com
<mailto:mpavlik@redhat.com>> wrote:
> Hi Punit,
>=20
> can you please provide also errors from /var/log/vdsm/vdsm.log and =
/var/log/vdsm/vdsmd.log
>=20
> it would be really helpful if you provided exact steps how to =
reproduce the
problem.
>=20
> regards
>=20
> Martin Pavlik - rhev QE
> > On 08 Jan 2015, at 03:06, Punit Dambiwal <hypunit(a)gmail.com =
<mailto:hypunit@gmail.com>> wrote:
> >
> > Hi,
> >
> > I try to add gluster volume but it failed...
> >
> > Ovirt :- 3.5
> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
> > KVM :- 1.5.3 - 60.el7_0.2
> > libvirt-1.1.1-29.el7_0.4
> > Glusterfs :- glusterfs-3.5.3-1.el7
> >
> > Engine Logs :-
> >
> > 2015-01-08 09:57:52,569 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
> > , sharedLocks=3D ]
> > 2015-01-08 09:57:52,609 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
> > , sharedLocks=3D ]
> > 2015-01-08 09:57:55,582 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
> > , sharedLocks=3D ]
> > 2015-01-08 09:57:55,591 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
> > , sharedLocks=3D ]
> > 2015-01-08 09:57:55,596 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
> > , sharedLocks=3D ]
> > 2015-01-08 09:57:55,633 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
> > , sharedLocks=3D ]
> > ^C
> >
> >
>=20
>=20
=20
=20
<216 09-Jan-15.jpg><217 09-Jan-15.jpg>
--Apple-Mail=_109729C8-42C5-4952-9855-76A598BFB1A1
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=utf-8
<html><head><meta http-equiv=3D"Content-Type"
content=3D"text/html =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><pre style=3D"word-wrap: break-word; white-space:
pre-wrap;" =
class=3D"">Hi Punit,</pre><pre style=3D"word-wrap: break-word;
=
white-space: pre-wrap;" class=3D"">can you verify that nodes contain =
cluster packages from the following log?</pre><pre style=3D"word-wrap: =
break-word; white-space: pre-wrap;" =
class=3D"">Thread-14::DEBUG::2015-01-09 =
18:06:28,823::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,825::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-object',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,826::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-plugin',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-account',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-proxy',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-doc',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-container',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('glusterfs-geo-replication',) not found</pre><div
class=3D""><br =
class=3D""></div><div class=3D"">M.</div><div
class=3D""><br =
class=3D""></div><div><blockquote type=3D"cite"
class=3D""><div =
class=3D"">On 09 Jan 2015, at 11:13, Punit Dambiwal <<a =
href=3D"mailto:hypunit@gmail.com"
class=3D"">hypunit(a)gmail.com</a>&gt; =
wrote:</div><br class=3D"Apple-interchange-newline"><div
class=3D""><div =
dir=3D"ltr" class=3D"">Hi Kanagaraj,<div
class=3D""><br =
class=3D""></div><div class=3D"">Please find the
attached logs =
:- </div><div class=3D""><br
class=3D""></div><div class=3D"">Engine =
Logs :- <a href=3D"http://ur1.ca/jdopt" =
class=3D"">http://ur1.ca/jdopt</a></div><div
class=3D"">VDSM Logs =
:- <a href=3D"http://ur1.ca/jdoq9" =
class=3D"">http://ur1.ca/jdoq9</a></div><div
class=3D""><br =
class=3D""></div><div class=3D""><br
class=3D""></div></div><div =
class=3D"gmail_extra"><br class=3D""><div
class=3D"gmail_quote">On Thu, =
Jan 8, 2015 at 6:05 PM, Kanagaraj <span dir=3D"ltr"
class=3D""><<a =
href=3D"mailto:kmayilsa@redhat.com" target=3D"_blank" =
class=3D"">kmayilsa(a)redhat.com</a>&gt;</span> wrote:<br =
class=3D""><blockquote class=3D"gmail_quote"
style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex">
=20
=20
=20
<div bgcolor=3D"#FFFFFF" text=3D"#000000"
class=3D"">
Do you see any errors in the UI?<br class=3D"">
<br class=3D"">
Also please provide the engine.log and vdsm.log when the failure
occured.<br class=3D"">
<br class=3D"">
Thanks,<br class=3D"">
Kanagaraj<div class=3D""><div class=3D"h5"><br
class=3D"">
<br class=3D"">
<div class=3D"">On 01/08/2015 02:25 PM, Punit Dambiwal
wrote:<br class=3D"">
</div>
<blockquote type=3D"cite" class=3D"">
<div dir=3D"ltr" class=3D"">Hi Martin,
<div class=3D""><br class=3D"">
</div>
<div class=3D"">The steps are below :- </div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">1. Step the ovirt engine on the one =
server...</div>
<div class=3D"">2. Installed centos 7 on 4 host node =
servers..</div>
<div class=3D"">3. I am using host node (compute+storage)....now
=
i have
added all 4 nodes to engine...</div>
<div class=3D"">4. Create the gluster volume from
GUI...</div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">Network :- </div>
<div class=3D"">eth0 :- public network (1G)</div>
<div class=3D"">eth1+eth2=3Dbond0=3D VM public network =
(1G)</div>
<div class=3D"">eth3+eth4=3Dbond1=3Dovirtmgmt+storage (10G =
private network)</div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">every hostnode has 24 bricks=3D24*4(distributed =
replicated)</div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">Thanks,</div>
<div class=3D"">Punit</div>
<div class=3D""><br class=3D"">
</div>
</div>
<div class=3D"gmail_extra"><br class=3D"">
<div class=3D"gmail_quote">On Thu, Jan 8, 2015 at 3:20 PM, =
Martin
Pavl=C3=ADk <span dir=3D"ltr" class=3D""><<a
=
href=3D"mailto:mpavlik@redhat.com" target=3D"_blank" =
class=3D"">mpavlik(a)redhat.com</a>&gt;</span>
wrote:<br class=3D"">
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Punit,<br
class=3D"">=
<br class=3D"">
can you please provide also errors from
/var/log/vdsm/vdsm.log and /var/log/vdsm/vdsmd.log<br =
class=3D"">
<br class=3D"">
it would be really helpful if you provided exact steps how
to reproduce the problem.<br class=3D"">
<br class=3D"">
regards<br class=3D"">
<br class=3D"">
Martin Pavlik - rhev QE<br class=3D"">
<div class=3D"">
<div class=3D"">> On 08 Jan 2015, at 03:06, Punit
Dambiwal <<a href=3D"mailto:hypunit@gmail.com" =
target=3D"_blank" class=3D"">hypunit(a)gmail.com</a>&gt;
wrote:<br class=3D"">
><br class=3D"">
> Hi,<br class=3D"">
><br class=3D"">
> I try to add gluster volume but it failed...<br =
class=3D"">
><br class=3D"">
> Ovirt :- 3.5<br class=3D"">
> VDSM :- vdsm-4.16.7-1.gitdb83943.el7<br
class=3D"">
> KVM :- 1.5.3 - 60.el7_0.2<br class=3D"">
> libvirt-1.1.1-29.el7_0.4<br class=3D"">
> Glusterfs :- glusterfs-3.5.3-1.el7<br
class=3D"">
><br class=3D"">
> Engine Logs :-<br class=3D"">
><br class=3D"">
> 2015-01-08 09:57:52,569 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:52,609 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,582 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,591 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,596 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,633 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> ^C<br class=3D"">
><br class=3D"">
><br class=3D"">
<br class=3D"">
</div>
</div>
</blockquote>
</div>
<br class=3D"">
</div>
</blockquote>
<br class=3D"">
</div></div></div>
</blockquote></div><br class=3D""></div>
<span =
id=3D"cid:37D3CD71-8728-4D0B-90EA-FFC26B17BDFD@brq.redhat.com"><216 =
09-Jan-15.jpg></span><span =
id=3D"cid:87D63ABB-B570-46F7-A5B2-B83469B28C81@brq.redhat.com"><217 =
09-Jan-15.jpg></span></div></blockquote></div><br =
class=3D""></body></html>=
--Apple-Mail=_109729C8-42C5-4952-9855-76A598BFB1A1--
6:35 a.m.
Hi Martin,
I installed gluster from ovirt repo....is it require to install those
packages manually ??
On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík <mpavlik(a)redhat.com> wrote:
Hi Punit,
can you verify that nodes contain cluster packages from the following log?
Thread-14::DEBUG::2015-01-09 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-object',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-plugin',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-account',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-proxy',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-doc',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-container',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
('glusterfs-geo-replication',) not found
M.
On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com> wrote:
Hi Kanagaraj,
Please find the attached logs :-
Engine Logs :- http://ur1.ca/jdopt
VDSM Logs :- http://ur1.ca/jdoq9
On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
> Do you see any errors in the UI?
>
> Also please provide the engine.log and vdsm.log when the failure occured.
>
> Thanks,
> Kanagaraj
>
>
> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>
> Hi Martin,
>
> The steps are below :-
>
> 1. Step the ovirt engine on the one server...
> 2. Installed centos 7 on 4 host node servers..
> 3. I am using host node (compute+storage)....now i have added all 4 nodes
> to engine...
> 4. Create the gluster volume from GUI...
>
> Network :-
> eth0 :- public network (1G)
> eth1+eth2=bond0= VM public network (1G)
> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
>
> every hostnode has 24 bricks=24*4(distributed replicated)
>
> Thanks,
> Punit
>
>
> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík <mpavlik(a)redhat.com> wrote:
>
>> Hi Punit,
>>
>> can you please provide also errors from /var/log/vdsm/vdsm.log and
>> /var/log/vdsm/vdsmd.log
>>
>> it would be really helpful if you provided exact steps how to reproduce
>> the problem.
>>
>> regards
>>
>> Martin Pavlik - rhev QE
>> > On 08 Jan 2015, at 03:06, Punit Dambiwal <hypunit(a)gmail.com> wrote:
>> >
>> > Hi,
>> >
>> > I try to add gluster volume but it failed...
>> >
>> > Ovirt :- 3.5
>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>> > KVM :- 1.5.3 - 60.el7_0.2
>> > libvirt-1.1.1-29.el7_0.4
>> > Glusterfs :- glusterfs-3.5.3-1.el7
>> >
>> > Engine Logs :-
>> >
>> > 2015-01-08 09:57:52,569 INFO
>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> value: GLUSTER
>> > , sharedLocks= ]
>> > 2015-01-08 09:57:52,609 INFO
>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> value: GLUSTER
>> > , sharedLocks= ]
>> > 2015-01-08 09:57:55,582 INFO
>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> value: GLUSTER
>> > , sharedLocks= ]
>> > 2015-01-08 09:57:55,591 INFO
>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> value: GLUSTER
>> > , sharedLocks= ]
>> > 2015-01-08 09:57:55,596 INFO
>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> value: GLUSTER
>> > , sharedLocks= ]
>> > 2015-01-08 09:57:55,633 INFO
>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> value: GLUSTER
>> > , sharedLocks= ]
>> > ^C
>> >
>> >
>>
>>
>
>
<216 09-Jan-15.jpg><217 09-Jan-15.jpg>
1:46 p.m.
--Apple-Mail=_5F83B64B-BAF6-4C9E-B4FE-7E356A618B31
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8
Hi Punit,
unfortunately I=E2=80=99am not that with the gluster, I was just =
following the obvious clue from the log. Could you try on the nodes if =
the packages are even available for installation=20
yum install gluster-swift gluster-swift-object gluster-swift-plugin =
gluster-swift-account gluster-swift-proxy gluster-swift-doc =
gluster-swift-container glusterfs-geo-replication
if not you could try to get them in official gluster repo. =
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs-=
epel.repo
HTH
M.
On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
=20
Hi Martin,
=20
I installed gluster from ovirt repo....is it require to install those =
packages
manually ??
=20
On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavl=C3=ADk <mpavlik(a)redhat.com =
<mailto:mpavlik@redhat.com>> wrote:
Hi Punit,
can you verify that nodes contain cluster packages from the following =
log?
Thread-14::DEBUG::2015-01-09 =
18:06:28,823::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,825::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-object',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,826::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-plugin',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-account',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-proxy',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-doc',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-container',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('glusterfs-geo-replication',) not found
=20
M.
=20
> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com =
<mailto:hypunit@gmail.com>> wrote:
>=20
> Hi Kanagaraj,
>=20
> Please find the attached logs :-=20
>=20
> Engine Logs :- http://ur1.ca/jdopt <http://ur1.ca/jdopt>
> VDSM Logs :- http://ur1.ca/jdoq9 <http://ur1.ca/jdoq9>
>=20
>=20
>=20
> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com =
<mailto:kmayilsa@redhat.com>> wrote:
> Do you see any errors in the UI?
>=20
> Also please provide the engine.log and vdsm.log when the failure =
occured.
>=20
> Thanks,
> Kanagaraj
>=20
>=20
> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>> Hi Martin,
>>=20
>> The steps are below :-=20
>>=20
>> 1. Step the ovirt engine on the one server...
>> 2. Installed centos 7 on 4 host node servers..
>> 3. I am using host node (compute+storage)....now i have added all 4 =
nodes
to engine...
>> 4. Create the gluster volume from GUI...
>>=20
>> Network :-=20
>> eth0 :- public network (1G)
>> eth1+eth2=3Dbond0=3D VM public network (1G)
>> eth3+eth4=3Dbond1=3Dovirtmgmt+storage (10G private network)
>>=20
>> every hostnode has 24 bricks=3D24*4(distributed replicated)
>>=20
>> Thanks,
>> Punit
>>=20
>>=20
>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavl=C3=ADk =
<mpavlik(a)redhat.com
<mailto:mpavlik@redhat.com>> wrote:
>> Hi Punit,
>>=20
>> can you please provide also errors from /var/log/vdsm/vdsm.log and =
/var/log/vdsm/vdsmd.log
>>=20
>> it would be really helpful if you provided exact steps how to =
reproduce
the problem.
>>=20
>> regards
>>=20
>> Martin Pavlik - rhev QE
>> > On 08 Jan 2015, at 03:06, Punit Dambiwal <hypunit(a)gmail.com =
<mailto:hypunit@gmail.com>> wrote:
>> >
>> > Hi,
>> >
>> > I try to add gluster volume but it failed...
>> >
>> > Ovirt :- 3.5
>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>> > KVM :- 1.5.3 - 60.el7_0.2
>> > libvirt-1.1.1-29.el7_0.4
>> > Glusterfs :- glusterfs-3.5.3-1.el7
>> >
>> > Engine Logs :-
>> >
>> > 2015-01-08 09:57:52,569 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > 2015-01-08 09:57:52,609 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > 2015-01-08 09:57:55,582 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > 2015-01-08 09:57:55,591 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > 2015-01-08 09:57:55,596 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > 2015-01-08 09:57:55,633 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > ^C
>> >
>> >
>>=20
>>=20
>=20
>=20
> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
=20
=20
--Apple-Mail=_5F83B64B-BAF6-4C9E-B4FE-7E356A618B31
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=utf-8
<html><head><meta http-equiv=3D"Content-Type"
content=3D"text/html =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D"">Hi Punit,<div class=3D""><br
class=3D""></div><div =
class=3D"">unfortunately I=E2=80=99am not that with the gluster, I was =
just following the obvious clue from the log. Could you try on the nodes =
if the packages are even available for installation </div><div =
class=3D""><br class=3D""></div><div
class=3D"">yum install <span =
style=3D"white-space: pre-wrap;" class=3D"">gluster-swift
</span><span =
style=3D"white-space: pre-wrap;" class=3D"">gluster-swift-object =
</span><span style=3D"white-space: pre-wrap;" =
class=3D"">gluster-swift-plugin </span><span
style=3D"white-space: =
pre-wrap;" class=3D"">gluster-swift-account </span><span =
style=3D"white-space: pre-wrap;" class=3D"">gluster-swift-proxy =
</span><span style=3D"white-space: pre-wrap;"
class=3D"">gluster-swift-doc=
</span><span style=3D"white-space: pre-wrap;" =
class=3D"">gluster-swift-container </span><span
style=3D"white-space: =
pre-wrap;"
class=3D"">glusterfs-geo-replication</span></div><div =
class=3D""><span style=3D"white-space: pre-wrap;"
class=3D""><br =
class=3D""></span></div><div class=3D""><span
style=3D"white-space: =
pre-wrap;" class=3D"">if not you could try to get them in official =
gluster repo. </span><span style=3D"font-family: Verdana, Geneva, =
sans-serif; font-size: x-small; line-height: 14px; background-color: =
rgb(255, 255, 255);" class=3D""><a =
href=3D"http://download.gluster.org/pub/gluster/glusterfs/LATEST/Cen...
usterfs-epel.repo" =
class=3D"">http://download.gluster.org/pub/gluster/glusterfs...
/glusterfs-epel.repo</a></span></div><div
class=3D""><span =
style=3D"white-space: pre-wrap;" class=3D""><br =
class=3D""></span></div><div class=3D""><span
style=3D"white-space: =
pre-wrap;" class=3D"">HTH</span></div><div
class=3D""><span =
style=3D"white-space: pre-wrap;" class=3D""><br =
class=3D""></span></div><div class=3D""><span
style=3D"white-space: =
pre-wrap;" class=3D"">M.</span><div
class=3D""><br class=3D""></div><div =
class=3D""><br class=3D""></div><div
class=3D""><br class=3D""></div><div =
class=3D""><br
class=3D""></div><div><blockquote type=3D"cite" =
class=3D""><div class=3D"">On 10 Jan 2015, at 04:35, Punit
Dambiwal =
<<a href=3D"mailto:hypunit@gmail.com" =
class=3D"">hypunit(a)gmail.com</a>&gt; wrote:</div><br =
class=3D"Apple-interchange-newline"><div class=3D""><div
dir=3D"ltr" =
class=3D"">Hi Martin,<div class=3D""><br
class=3D""></div><div =
class=3D"">I installed gluster from ovirt repo....is it require to =
install those packages manually ??</div></div><div =
class=3D"gmail_extra"><br class=3D""><div
class=3D"gmail_quote">On Fri, =
Jan 9, 2015 at 7:19 PM, Martin Pavl=C3=ADk <span dir=3D"ltr" =
class=3D""><<a href=3D"mailto:mpavlik@redhat.com"
target=3D"_blank" =
class=3D"">mpavlik(a)redhat.com</a>&gt;</span> wrote:<br =
class=3D""><blockquote class=3D"gmail_quote"
style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div =
style=3D"word-wrap:break-word" class=3D""><pre =
style=3D"word-wrap:break-word;white-space:pre-wrap" class=3D"">Hi
=
Punit,</pre><pre style=3D"word-wrap:break-word;white-space:pre-wrap" =
class=3D"">can you verify that nodes contain cluster packages from the =
following log?</pre><pre =
style=3D"word-wrap:break-word;white-space:pre-wrap" =
class=3D"">Thread-14::DEBUG::2015-01-09 =
18:06:28,823::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,825::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-object',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,826::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-plugin',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-account',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-proxy',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-doc',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-container',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('glusterfs-geo-replication',) not found</pre><div
class=3D""><br =
class=3D""></div><div class=3D"">M.</div><div
class=3D""><br =
class=3D""></div><div class=3D""><blockquote
type=3D"cite" class=3D""><div=
class=3D""><div class=3D"h5"><div
class=3D"">On 09 Jan 2015, at 11:13, =
Punit Dambiwal <<a href=3D"mailto:hypunit@gmail.com"
target=3D"_blank" =
class=3D"">hypunit(a)gmail.com</a>&gt; wrote:</div><br =
class=3D""></div></div><div class=3D""><div
class=3D""><div =
class=3D"h5"><div dir=3D"ltr" class=3D"">Hi
Kanagaraj,<div class=3D""><br =
class=3D""></div><div class=3D"">Please find the
attached logs =
:- </div><div class=3D""><br
class=3D""></div><div class=3D"">Engine =
Logs :- <a href=3D"http://ur1.ca/jdopt" target=3D"_blank"
=
class=3D"">http://ur1.ca/jdopt</a></div><div
class=3D"">VDSM Logs =
:- <a href=3D"http://ur1.ca/jdoq9" target=3D"_blank" =
class=3D"">http://ur1.ca/jdoq9</a></div><div
class=3D""><br =
class=3D""></div><div class=3D""><br
class=3D""></div></div><div =
class=3D"gmail_extra"><br class=3D""><div
class=3D"gmail_quote">On Thu, =
Jan 8, 2015 at 6:05 PM, Kanagaraj <span dir=3D"ltr"
class=3D""><<a =
href=3D"mailto:kmayilsa@redhat.com" target=3D"_blank" =
class=3D"">kmayilsa(a)redhat.com</a>&gt;</span> wrote:<br =
class=3D""><blockquote class=3D"gmail_quote"
style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex">
=20
=20
=20
<div bgcolor=3D"#FFFFFF" text=3D"#000000"
class=3D"">
Do you see any errors in the UI?<br class=3D"">
<br class=3D"">
Also please provide the engine.log and vdsm.log when the failure
occured.<br class=3D"">
<br class=3D"">
Thanks,<br class=3D"">
Kanagaraj<div class=3D""><div class=3D""><br
class=3D"">
<br class=3D"">
<div class=3D"">On 01/08/2015 02:25 PM, Punit Dambiwal
wrote:<br class=3D"">
</div>
<blockquote type=3D"cite" class=3D"">
<div dir=3D"ltr" class=3D"">Hi Martin,
<div class=3D""><br class=3D"">
</div>
<div class=3D"">The steps are below :- </div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">1. Step the ovirt engine on the one =
server...</div>
<div class=3D"">2. Installed centos 7 on 4 host node =
servers..</div>
<div class=3D"">3. I am using host node (compute+storage)....now
=
i have
added all 4 nodes to engine...</div>
<div class=3D"">4. Create the gluster volume from
GUI...</div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">Network :- </div>
<div class=3D"">eth0 :- public network (1G)</div>
<div class=3D"">eth1+eth2=3Dbond0=3D VM public network =
(1G)</div>
<div class=3D"">eth3+eth4=3Dbond1=3Dovirtmgmt+storage (10G =
private network)</div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">every hostnode has 24 bricks=3D24*4(distributed =
replicated)</div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">Thanks,</div>
<div class=3D"">Punit</div>
<div class=3D""><br class=3D"">
</div>
</div>
<div class=3D"gmail_extra"><br class=3D"">
<div class=3D"gmail_quote">On Thu, Jan 8, 2015 at 3:20 PM, =
Martin
Pavl=C3=ADk <span dir=3D"ltr" class=3D""><<a
=
href=3D"mailto:mpavlik@redhat.com" target=3D"_blank" =
class=3D"">mpavlik(a)redhat.com</a>&gt;</span>
wrote:<br class=3D"">
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Punit,<br
class=3D"">=
<br class=3D"">
can you please provide also errors from
/var/log/vdsm/vdsm.log and /var/log/vdsm/vdsmd.log<br =
class=3D"">
<br class=3D"">
it would be really helpful if you provided exact steps how
to reproduce the problem.<br class=3D"">
<br class=3D"">
regards<br class=3D"">
<br class=3D"">
Martin Pavlik - rhev QE<br class=3D"">
<div class=3D"">
<div class=3D"">> On 08 Jan 2015, at 03:06, Punit
Dambiwal <<a href=3D"mailto:hypunit@gmail.com" =
target=3D"_blank" class=3D"">hypunit(a)gmail.com</a>&gt;
wrote:<br class=3D"">
><br class=3D"">
> Hi,<br class=3D"">
><br class=3D"">
> I try to add gluster volume but it failed...<br =
class=3D"">
><br class=3D"">
> Ovirt :- 3.5<br class=3D"">
> VDSM :- vdsm-4.16.7-1.gitdb83943.el7<br
class=3D"">
> KVM :- 1.5.3 - 60.el7_0.2<br class=3D"">
> libvirt-1.1.1-29.el7_0.4<br class=3D"">
> Glusterfs :- glusterfs-3.5.3-1.el7<br
class=3D"">
><br class=3D"">
> Engine Logs :-<br class=3D"">
><br class=3D"">
> 2015-01-08 09:57:52,569 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:52,609 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,582 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,591 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,596 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,633 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> ^C<br class=3D"">
><br class=3D"">
><br class=3D"">
<br class=3D"">
</div>
</div>
</blockquote>
</div>
<br class=3D"">
</div>
</blockquote>
<br class=3D"">
</div></div></div>
</blockquote></div><br class=3D""></div>
</div></div><span class=3D""><216
09-Jan-15.jpg></span><span =
class=3D""><217
09-Jan-15.jpg></span></div></blockquote></div><br =
class=3D""></div></blockquote></div><br
class=3D""></div>
</div></blockquote></div><br
class=3D""></div></body></html>=
--Apple-Mail=_5F83B64B-BAF6-4C9E-B4FE-7E356A618B31--
1:48 p.m.
--Apple-Mail=_85F39CB7-E7A3-490B-8F0F-71B4F0A5A05C
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8
Hi Punit,
unfortunately I=E2=80=99am not that good with the gluster, I was just =
following the obvious clue from the log. Could you try on the nodes if =
the packages are even available for installation=20
yum install gluster-swift gluster-swift-object gluster-swift-plugin =
gluster-swift-account gluster-swift-proxy gluster-swift-doc =
gluster-swift-container glusterfs-geo-replication
if not you could try to get them in official gluster repo. =
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs-=
epel.repo =
<http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs=
-epel.repo>
HTH
M.
On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com =
<mailto:hypunit@gmail.com>> wrote:
=20
Hi Martin,
=20
I installed gluster from ovirt repo....is it require to install those =
packages
manually ??
=20
On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavl=C3=ADk <mpavlik(a)redhat.com =
<mailto:mpavlik@redhat.com>> wrote:
Hi Punit,
can you verify that nodes contain cluster packages from the following =
log?
Thread-14::DEBUG::2015-01-09 =
18:06:28,823::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,825::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-object',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,826::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-plugin',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-account',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-proxy',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-doc',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-container',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('glusterfs-geo-replication',) not found
=20
M.
=20
> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com =
<mailto:hypunit@gmail.com>> wrote:
>=20
> Hi Kanagaraj,
>=20
> Please find the attached logs :-=20
>=20
> Engine Logs :- http://ur1.ca/jdopt <http://ur1.ca/jdopt>
> VDSM Logs :- http://ur1.ca/jdoq9 <http://ur1.ca/jdoq9>
>=20
>=20
>=20
> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com =
<mailto:kmayilsa@redhat.com>> wrote:
> Do you see any errors in the UI?
>=20
> Also please provide the engine.log and vdsm.log when the failure =
occured.
>=20
> Thanks,
> Kanagaraj
>=20
>=20
> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>> Hi Martin,
>>=20
>> The steps are below :-=20
>>=20
>> 1. Step the ovirt engine on the one server...
>> 2. Installed centos 7 on 4 host node servers..
>> 3. I am using host node (compute+storage)....now i have added all 4 =
nodes
to engine...
>> 4. Create the gluster volume from GUI...
>>=20
>> Network :-=20
>> eth0 :- public network (1G)
>> eth1+eth2=3Dbond0=3D VM public network (1G)
>> eth3+eth4=3Dbond1=3Dovirtmgmt+storage (10G private network)
>>=20
>> every hostnode has 24 bricks=3D24*4(distributed replicated)
>>=20
>> Thanks,
>> Punit
>>=20
>>=20
>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavl=C3=ADk =
<mpavlik(a)redhat.com
<mailto:mpavlik@redhat.com>> wrote:
>> Hi Punit,
>>=20
>> can you please provide also errors from /var/log/vdsm/vdsm.log and =
/var/log/vdsm/vdsmd.log
>>=20
>> it would be really helpful if you provided exact steps how to =
reproduce
the problem.
>>=20
>> regards
>>=20
>> Martin Pavlik - rhev QE
>> > On 08 Jan 2015, at 03:06, Punit Dambiwal <hypunit(a)gmail.com =
<mailto:hypunit@gmail.com>> wrote:
>> >
>> > Hi,
>> >
>> > I try to add gluster volume but it failed...
>> >
>> > Ovirt :- 3.5
>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>> > KVM :- 1.5.3 - 60.el7_0.2
>> > libvirt-1.1.1-29.el7_0.4
>> > Glusterfs :- glusterfs-3.5.3-1.el7
>> >
>> > Engine Logs :-
>> >
>> > 2015-01-08 09:57:52,569 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > 2015-01-08 09:57:52,609 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > 2015-01-08 09:57:55,582 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > 2015-01-08 09:57:55,591 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > 2015-01-08 09:57:55,596 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > 2015-01-08 09:57:55,633 INFO =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager] =
(DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock =
EngineLock [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 =
value: GLUSTER
>> > , sharedLocks=3D ]
>> > ^C
>> >
>> >
>>=20
>>=20
>=20
>=20
> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
=20
=20
--Apple-Mail=_85F39CB7-E7A3-490B-8F0F-71B4F0A5A05C
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=utf-8
<html><head><meta http-equiv=3D"Content-Type"
content=3D"text/html =
charset=3Dutf-8"><meta http-equiv=3D"Content-Type"
content=3D"text/html =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D"">Hi Punit,<div class=3D""><br
class=3D""></div><div =
class=3D"">unfortunately I=E2=80=99am not that good with the gluster, I =
was just following the obvious clue from the log. Could you try on the =
nodes if the packages are even available for =
installation </div><div class=3D""><br
class=3D""></div><div =
class=3D"">yum install <span style=3D"white-space:
pre-wrap;" =
class=3D"">gluster-swift </span><span style=3D"white-space:
pre-wrap;" =
class=3D"">gluster-swift-object </span><span
style=3D"white-space: =
pre-wrap;" class=3D"">gluster-swift-plugin </span><span =
style=3D"white-space: pre-wrap;" class=3D"">gluster-swift-account
=
</span><span style=3D"white-space: pre-wrap;" =
class=3D"">gluster-swift-proxy </span><span
style=3D"white-space: =
pre-wrap;" class=3D"">gluster-swift-doc </span><span
style=3D"white-space:=
pre-wrap;" class=3D"">gluster-swift-container </span><span =
style=3D"white-space: pre-wrap;" =
class=3D"">glusterfs-geo-replication</span></div><div
class=3D""><span =
style=3D"white-space: pre-wrap;" class=3D""><br =
class=3D""></span></div><div class=3D""><span
style=3D"white-space: =
pre-wrap;" class=3D"">if not you could try to get them in official =
gluster repo. </span><span style=3D"font-family: Verdana, Geneva, =
sans-serif; font-size: x-small; line-height: 14px; background-color: =
rgb(255, 255, 255);" class=3D""><a =
href=3D"http://download.gluster.org/pub/gluster/glusterfs/LATEST/Cen...
usterfs-epel.repo" =
class=3D"">http://download.gluster.org/pub/gluster/glusterfs...
/glusterfs-epel.repo</a></span></div><div
class=3D""><span =
style=3D"white-space: pre-wrap;" class=3D""><br =
class=3D""></span></div><div class=3D""><span
style=3D"white-space: =
pre-wrap;" class=3D"">HTH</span></div><div
class=3D""><span =
style=3D"white-space: pre-wrap;" class=3D""><br =
class=3D""></span></div><div class=3D""><span
style=3D"white-space: =
pre-wrap;" class=3D"">M.</span><div
class=3D""><br class=3D""></div><div =
class=3D""><br class=3D""></div><div
class=3D""><br class=3D""></div><div =
class=3D""><br class=3D""></div><div
class=3D""><blockquote type=3D"cite" =
class=3D""><div class=3D"">On 10 Jan 2015, at 04:35, Punit
Dambiwal =
<<a href=3D"mailto:hypunit@gmail.com" =
class=3D"">hypunit(a)gmail.com</a>&gt; wrote:</div><br =
class=3D"Apple-interchange-newline"><div class=3D""><div
dir=3D"ltr" =
class=3D"">Hi Martin,<div class=3D""><br
class=3D""></div><div =
class=3D"">I installed gluster from ovirt repo....is it require to =
install those packages manually ??</div></div><div =
class=3D"gmail_extra"><br class=3D""><div
class=3D"gmail_quote">On Fri, =
Jan 9, 2015 at 7:19 PM, Martin Pavl=C3=ADk <span dir=3D"ltr" =
class=3D""><<a href=3D"mailto:mpavlik@redhat.com"
target=3D"_blank" =
class=3D"">mpavlik(a)redhat.com</a>&gt;</span> wrote:<br =
class=3D""><blockquote class=3D"gmail_quote"
style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div =
style=3D"word-wrap:break-word" class=3D""><pre =
style=3D"word-wrap:break-word;white-space:pre-wrap" class=3D"">Hi
=
Punit,</pre><pre style=3D"word-wrap:break-word;white-space:pre-wrap" =
class=3D"">can you verify that nodes contain cluster packages from the =
following log?</pre><pre =
style=3D"word-wrap:break-word;white-space:pre-wrap" =
class=3D"">Thread-14::DEBUG::2015-01-09 =
18:06:28,823::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,825::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-object',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,826::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-plugin',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-account',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-proxy',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-doc',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('gluster-swift-container',) not found
Thread-14::DEBUG::2015-01-09 =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package =
('glusterfs-geo-replication',) not found</pre><div
class=3D""><br =
class=3D""></div><div class=3D"">M.</div><div
class=3D""><br =
class=3D""></div><div class=3D""><blockquote
type=3D"cite" class=3D""><div=
class=3D""><div class=3D"h5"><div
class=3D"">On 09 Jan 2015, at 11:13, =
Punit Dambiwal <<a href=3D"mailto:hypunit@gmail.com"
target=3D"_blank" =
class=3D"">hypunit(a)gmail.com</a>&gt; wrote:</div><br =
class=3D""></div></div><div class=3D""><div
class=3D""><div =
class=3D"h5"><div dir=3D"ltr" class=3D"">Hi
Kanagaraj,<div class=3D""><br =
class=3D""></div><div class=3D"">Please find the
attached logs =
:- </div><div class=3D""><br
class=3D""></div><div class=3D"">Engine =
Logs :- <a href=3D"http://ur1.ca/jdopt" target=3D"_blank"
=
class=3D"">http://ur1.ca/jdopt</a></div><div
class=3D"">VDSM Logs =
:- <a href=3D"http://ur1.ca/jdoq9" target=3D"_blank" =
class=3D"">http://ur1.ca/jdoq9</a></div><div
class=3D""><br =
class=3D""></div><div class=3D""><br
class=3D""></div></div><div =
class=3D"gmail_extra"><br class=3D""><div
class=3D"gmail_quote">On Thu, =
Jan 8, 2015 at 6:05 PM, Kanagaraj <span dir=3D"ltr"
class=3D""><<a =
href=3D"mailto:kmayilsa@redhat.com" target=3D"_blank" =
class=3D"">kmayilsa(a)redhat.com</a>&gt;</span> wrote:<br =
class=3D""><blockquote class=3D"gmail_quote"
style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex">
=20
=20
=20
<div bgcolor=3D"#FFFFFF" text=3D"#000000"
class=3D"">
Do you see any errors in the UI?<br class=3D"">
<br class=3D"">
Also please provide the engine.log and vdsm.log when the failure
occured.<br class=3D"">
<br class=3D"">
Thanks,<br class=3D"">
Kanagaraj<div class=3D""><div class=3D""><br
class=3D"">
<br class=3D"">
<div class=3D"">On 01/08/2015 02:25 PM, Punit Dambiwal
wrote:<br class=3D"">
</div>
<blockquote type=3D"cite" class=3D"">
<div dir=3D"ltr" class=3D"">Hi Martin,
<div class=3D""><br class=3D"">
</div>
<div class=3D"">The steps are below :- </div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">1. Step the ovirt engine on the one =
server...</div>
<div class=3D"">2. Installed centos 7 on 4 host node =
servers..</div>
<div class=3D"">3. I am using host node (compute+storage)....now
=
i have
added all 4 nodes to engine...</div>
<div class=3D"">4. Create the gluster volume from
GUI...</div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">Network :- </div>
<div class=3D"">eth0 :- public network (1G)</div>
<div class=3D"">eth1+eth2=3Dbond0=3D VM public network =
(1G)</div>
<div class=3D"">eth3+eth4=3Dbond1=3Dovirtmgmt+storage (10G =
private network)</div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">every hostnode has 24 bricks=3D24*4(distributed =
replicated)</div>
<div class=3D""><br class=3D"">
</div>
<div class=3D"">Thanks,</div>
<div class=3D"">Punit</div>
<div class=3D""><br class=3D"">
</div>
</div>
<div class=3D"gmail_extra"><br class=3D"">
<div class=3D"gmail_quote">On Thu, Jan 8, 2015 at 3:20 PM, =
Martin
Pavl=C3=ADk <span dir=3D"ltr" class=3D""><<a
=
href=3D"mailto:mpavlik@redhat.com" target=3D"_blank" =
class=3D"">mpavlik(a)redhat.com</a>&gt;</span>
wrote:<br class=3D"">
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Punit,<br
class=3D"">=
<br class=3D"">
can you please provide also errors from
/var/log/vdsm/vdsm.log and /var/log/vdsm/vdsmd.log<br =
class=3D"">
<br class=3D"">
it would be really helpful if you provided exact steps how
to reproduce the problem.<br class=3D"">
<br class=3D"">
regards<br class=3D"">
<br class=3D"">
Martin Pavlik - rhev QE<br class=3D"">
<div class=3D"">
<div class=3D"">> On 08 Jan 2015, at 03:06, Punit
Dambiwal <<a href=3D"mailto:hypunit@gmail.com" =
target=3D"_blank" class=3D"">hypunit(a)gmail.com</a>&gt;
wrote:<br class=3D"">
><br class=3D"">
> Hi,<br class=3D"">
><br class=3D"">
> I try to add gluster volume but it failed...<br =
class=3D"">
><br class=3D"">
> Ovirt :- 3.5<br class=3D"">
> VDSM :- vdsm-4.16.7-1.gitdb83943.el7<br
class=3D"">
> KVM :- 1.5.3 - 60.el7_0.2<br class=3D"">
> libvirt-1.1.1-29.el7_0.4<br class=3D"">
> Glusterfs :- glusterfs-3.5.3-1.el7<br
class=3D"">
><br class=3D"">
> Engine Logs :-<br class=3D"">
><br class=3D"">
> 2015-01-08 09:57:52,569 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:52,609 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,582 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,591 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,596 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> 2015-01-08 09:57:55,633 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait lock EngineLock [exclusiveLocks=3D key:
00000001-0001-0001-0001-000000000300 value: GLUSTER<br =
class=3D"">
> , sharedLocks=3D ]<br class=3D"">
> ^C<br class=3D"">
><br class=3D"">
><br class=3D"">
<br class=3D"">
</div>
</div>
</blockquote>
</div>
<br class=3D"">
</div>
</blockquote>
<br class=3D"">
</div></div></div>
</blockquote></div><br class=3D""></div>
</div></div><span class=3D""><216
09-Jan-15.jpg></span><span =
class=3D""><217
09-Jan-15.jpg></span></div></blockquote></div><br =
class=3D""></div></blockquote></div><br
class=3D""></div>
</div></blockquote></div><br
class=3D""></div></body></html>=
--Apple-Mail=_85F39CB7-E7A3-490B-8F0F-71B4F0A5A05C--
7:54 a.m.
Hi,
Is there any one from gluster can help me here :-
Engine logs :-
2015-01-12 12:50:33,841 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:34,725 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,824 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,853 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,866 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:37,751 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,849 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,878 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,890 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:40,776 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,878 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,903 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,916 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:43,771 INFO
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
(ajp--127.0.0.1-8702-1) [330ace48] FINISH, CreateGlusterVolumeVDSCommand,
log id: 303e70a4
2015-01-12 12:50:43,780 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event ID:
-1, Message: Creation of Gluster Volume vol01 failed.
2015-01-12 12:50:43,785 INFO
[org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
(ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
[exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
[image: Inline image 2]
On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík <mpavlik(a)redhat.com> wrote:
Hi Punit,
unfortunately I’am not that good with the gluster, I was just following
the obvious clue from the log. Could you try on the nodes if the packages
are even available for installation
yum install gluster-swift gluster-swift-object gluster-swift-plugin
gluster-swift-account
gluster-swift-proxy gluster-swift-doc gluster-swift-container
glusterfs-geo-replication
if not you could try to get them in official gluster repo.
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
HTH
M.
On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com> wrote:
Hi Martin,
I installed gluster from ovirt repo....is it require to install those
packages manually ??
On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík <mpavlik(a)redhat.com> wrote:
> Hi Punit,
>
> can you verify that nodes contain cluster packages from the following log?
>
> Thread-14::DEBUG::2015-01-09 18:06:28,823::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,825::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-object',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,826::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-plugin',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-account',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-proxy',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-doc',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-container',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages) rpm
package ('glusterfs-geo-replication',) not found
>
>
> M.
>
> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com> wrote:
>
> Hi Kanagaraj,
>
> Please find the attached logs :-
>
> Engine Logs :- http://ur1.ca/jdopt
> VDSM Logs :- http://ur1.ca/jdoq9
>
>
>
> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
>
>> Do you see any errors in the UI?
>>
>> Also please provide the engine.log and vdsm.log when the failure occured.
>>
>> Thanks,
>> Kanagaraj
>>
>>
>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>>
>> Hi Martin,
>>
>> The steps are below :-
>>
>> 1. Step the ovirt engine on the one server...
>> 2. Installed centos 7 on 4 host node servers..
>> 3. I am using host node (compute+storage)....now i have added all 4
>> nodes to engine...
>> 4. Create the gluster volume from GUI...
>>
>> Network :-
>> eth0 :- public network (1G)
>> eth1+eth2=bond0= VM public network (1G)
>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
>>
>> every hostnode has 24 bricks=24*4(distributed replicated)
>>
>> Thanks,
>> Punit
>>
>>
>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík <mpavlik(a)redhat.com>
>> wrote:
>>
>>> Hi Punit,
>>>
>>> can you please provide also errors from /var/log/vdsm/vdsm.log and
>>> /var/log/vdsm/vdsmd.log
>>>
>>> it would be really helpful if you provided exact steps how to reproduce
>>> the problem.
>>>
>>> regards
>>>
>>> Martin Pavlik - rhev QE
>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
>>> >
>>> > Hi,
>>> >
>>> > I try to add gluster volume but it failed...
>>> >
>>> > Ovirt :- 3.5
>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>>> > KVM :- 1.5.3 - 60.el7_0.2
>>> > libvirt-1.1.1-29.el7_0.4
>>> > Glusterfs :- glusterfs-3.5.3-1.el7
>>> >
>>> > Engine Logs :-
>>> >
>>> > 2015-01-08 09:57:52,569 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> > , sharedLocks= ]
>>> > 2015-01-08 09:57:52,609 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> > , sharedLocks= ]
>>> > 2015-01-08 09:57:55,582 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> > , sharedLocks= ]
>>> > 2015-01-08 09:57:55,591 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> > , sharedLocks= ]
>>> > 2015-01-08 09:57:55,596 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> > , sharedLocks= ]
>>> > 2015-01-08 09:57:55,633 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> > , sharedLocks= ]
>>> > ^C
>>> >
>>> >
>>>
>>>
>>
>>
> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>
>
>
8:02 a.m.
This is a multi-part message in MIME format.
--------------000904060502090707080709
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Looks like there are some failures in gluster.
Can you send the log output from glusterd log file from the relevant hosts?
Thanks,
Kanagaraj
On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
Hi,
Is there any one from gluster can help me here :-
Engine logs :-
2015-01-12 12:50:33,841 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:34,725 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,824 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,853 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,866 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:37,751 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,849 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,878 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,890 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:40,776 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,878 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,903 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,916 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:43,771 INFO
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
(ajp--127.0.0.1-8702-1) [330ace48] FINISH,
CreateGlusterVolumeVDSCommand, log id: 303e70a4
2015-01-12 12:50:43,780 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event
ID: -1, Message: Creation of Gluster Volume vol01 failed.
2015-01-12 12:50:43,785 INFO
[org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
(ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
[exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
Inline image 2
On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík <mpavlik(a)redhat.com
<mailto:mpavlik@redhat.com>> wrote:
Hi Punit,
unfortunately I’am not that good with the gluster, I was just
following the obvious clue from the log. Could you try on the
nodes if the packages are even available for installation
yum install gluster-swift gluster-swift-object
gluster-swift-plugin gluster-swift-account gluster-swift-proxy
gluster-swift-doc gluster-swift-container glusterfs-geo-replication
if not you could try to get them in official gluster repo.
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
HTH
M.
> On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com
> <mailto:hypunit@gmail.com>> wrote:
>
> Hi Martin,
>
> I installed gluster from ovirt repo....is it require to install
> those packages manually ??
>
> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík <mpavlik(a)redhat.com
> <mailto:mpavlik@redhat.com>> wrote:
>
> Hi Punit,
>
> can you verify that nodes contain cluster packages from the following log?
>
> Thread-14::DEBUG::2015-01-09 18:06:28,823::caps::716::root::(_getKeyPackages)
rpm package ('gluster-swift',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,825::caps::716::root::(_getKeyPackages)
rpm package ('gluster-swift-object',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,826::caps::716::root::(_getKeyPackages)
rpm package ('gluster-swift-plugin',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages)
rpm package ('gluster-swift-account',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages)
rpm package ('gluster-swift-proxy',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages)
rpm package ('gluster-swift-doc',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages)
rpm package ('gluster-swift-container',) not found
> Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages)
rpm package ('glusterfs-geo-replication',) not found
>
>
> M.
>
>> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com
>> <mailto:hypunit@gmail.com>> wrote:
>>
>> Hi Kanagaraj,
>>
>> Please find the attached logs :-
>>
>> Engine Logs :- http://ur1.ca/jdopt
>> VDSM Logs :- http://ur1.ca/jdoq9
>>
>>
>>
>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj
>> <kmayilsa(a)redhat.com <mailto:kmayilsa@redhat.com>> wrote:
>>
>> Do you see any errors in the UI?
>>
>> Also please provide the engine.log and vdsm.log when the
>> failure occured.
>>
>> Thanks,
>> Kanagaraj
>>
>>
>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>>> Hi Martin,
>>>
>>> The steps are below :-
>>>
>>> 1. Step the ovirt engine on the one server...
>>> 2. Installed centos 7 on 4 host node servers..
>>> 3. I am using host node (compute+storage)....now i have
>>> added all 4 nodes to engine...
>>> 4. Create the gluster volume from GUI...
>>>
>>> Network :-
>>> eth0 :- public network (1G)
>>> eth1+eth2=bond0= VM public network (1G)
>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
>>>
>>> every hostnode has 24 bricks=24*4(distributed replicated)
>>>
>>> Thanks,
>>> Punit
>>>
>>>
>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík
>>> <mpavlik(a)redhat.com <mailto:mpavlik@redhat.com>>
wrote:
>>>
>>> Hi Punit,
>>>
>>> can you please provide also errors from
>>> /var/log/vdsm/vdsm.log and /var/log/vdsm/vdsmd.log
>>>
>>> it would be really helpful if you provided exact
>>> steps how to reproduce the problem.
>>>
>>> regards
>>>
>>> Martin Pavlik - rhev QE
>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
>>> <hypunit(a)gmail.com <mailto:hypunit@gmail.com>>
wrote:
>>> >
>>> > Hi,
>>> >
>>> > I try to add gluster volume but it failed...
>>> >
>>> > Ovirt :- 3.5
>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>>> > KVM :- 1.5.3 - 60.el7_0.2
>>> > libvirt-1.1.1-29.el7_0.4
>>> > Glusterfs :- glusterfs-3.5.3-1.el7
>>> >
>>> > Engine Logs :-
>>> >
>>> > 2015-01-08 09:57:52,569 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
>>> Failed to acquire lock and wait lock EngineLock
>>> [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300 value: GLUSTER
>>> > , sharedLocks= ]
>>> > 2015-01-08 09:57:52,609 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
>>> Failed to acquire lock and wait lock EngineLock
>>> [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300 value: GLUSTER
>>> > , sharedLocks= ]
>>> > 2015-01-08 09:57:55,582 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
>>> Failed to acquire lock and wait lock EngineLock
>>> [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300 value: GLUSTER
>>> > , sharedLocks= ]
>>> > 2015-01-08 09:57:55,591 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
>>> Failed to acquire lock and wait lock EngineLock
>>> [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300 value: GLUSTER
>>> > , sharedLocks= ]
>>> > 2015-01-08 09:57:55,596 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
>>> Failed to acquire lock and wait lock EngineLock
>>> [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300 value: GLUSTER
>>> > , sharedLocks= ]
>>> > 2015-01-08 09:57:55,633 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
>>> Failed to acquire lock and wait lock EngineLock
>>> [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300 value: GLUSTER
>>> > , sharedLocks= ]
>>> > ^C
>>> >
>>> >
>>>
>>>
>>
>>
>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>
>
--------------000904060502090707080709
Content-Type: multipart/related;
boundary="------------010504030303090109000601"
--------------010504030303090109000601
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta content="text/html; charset=utf-8"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Looks like there are some failures in gluster. <br>
Can you send the log output from glusterd log file from the relevant
hosts?<br>
<br>
Thanks,<br>
Kanagaraj<br>
<br>
<div class="moz-cite-prefix">On 01/12/2015 10:24 AM, Punit Dambiwal
wrote:<br>
</div>
<blockquote
cite="mid:CAGZcrBm9T3p6k_xVzMYuGVJ_Q=z+RqTEneFf0+fiuBtGgg=QNg@mail.gmail.com"
type="cite">
<div dir="ltr">Hi,
<div><br>
</div>
<div>Is there any one from gluster can help me here :- </div>
<div><br>
</div>
<div>Engine logs :- </div>
<div><br>
</div>
<div>
<div>2015-01-12 12:50:33,841 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:34,725 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:36,824 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:36,853 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:36,866 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:37,751 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:39,849 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:39,878 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:39,890 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:40,776 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:42,878 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:42,903 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:42,916 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock
and wait lock EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
<div>2015-01-12 12:50:43,771 INFO
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
(ajp--127.0.0.1-8702-1) [330ace48] FINISH,
CreateGlusterVolumeVDSCommand, log id: 303e70a4</div>
<div>2015-01-12 12:50:43,780 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48,
Job ID: 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack:
null, Custom Event ID: -1, Message: Creation of Gluster
Volume vol01 failed.</div>
<div>2015-01-12 12:50:43,785 INFO
[org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
(ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object
EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300 value: GLUSTER</div>
<div>, sharedLocks= ]</div>
</div>
<div><br>
</div>
<div><img src="cid:part1.02060703.06090409@redhat.com"
alt="Inline image 2" height="456"
width="558"><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Jan 11, 2015 at 6:48 PM, Martin
Pavlík <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:mpavlik@redhat.com"
target="_blank">mpavlik(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">Hi Punit,
<div><br>
</div>
<div>unfortunately I’am not that good with the gluster, I
was just following the obvious clue from the log. Could
you try on the nodes if the packages are even available
for installation </div>
<span class="">
<div><br>
</div>
<div>yum install <span
style="white-space:pre-wrap">gluster-swift
</span><span
style="white-space:pre-wrap">gluster-swift-object
</span><span
style="white-space:pre-wrap">gluster-swift-plugin
</span><span
style="white-space:pre-wrap">gluster-swift-account
</span><span
style="white-space:pre-wrap">gluster-swift-proxy
</span><span
style="white-space:pre-wrap">gluster-swift-doc
</span><span
style="white-space:pre-wrap">gluster-swift-container
</span><span
style="white-space:pre-wrap">glusterfs-geo-replication</span></div>
<div><span style="white-space:pre-wrap"><br>
</span></div>
<div><span style="white-space:pre-wrap">if not you
could
try to get them in official gluster repo. </span><span
style="font-family:Verdana,Geneva,sans-serif;font-size:x-small;line-height:14px;background-color:rgb(255,255,255)"><a
moz-do-not-send="true"
href="http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentO...
target="_blank">http://download.gluster.org/pub/gluster/glus...
<div><span style="white-space:pre-wrap"><br>
</span></div>
<div><span
style="white-space:pre-wrap">HTH</span></div>
<div><span style="white-space:pre-wrap"><br>
</span></div>
</span>
<div><span class="HOEnZb"><font
color="#888888"><span
style="white-space:pre-wrap">M.</span></font></span>
<div>
<div class="h5">
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>
<blockquote type="cite">
<div>On 10 Jan 2015, at 04:35, Punit Dambiwal
<<a moz-do-not-send="true"
href="mailto:hypunit@gmail.com"
target="_blank">hypunit(a)gmail.com</a>&gt;
wrote:</div>
<br>
<div>
<div dir="ltr">Hi Martin,
<div><br>
</div>
<div>I installed gluster from ovirt
repo....is it require to install those
packages manually ??</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Fri, Jan 9, 2015
at 7:19 PM, Martin Pavlík <span
dir="ltr"><<a
moz-do-not-send="true"
href="mailto:mpavlik@redhat.com"
target="_blank">mpavlik(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote"
style="margin:0 0 0 .8ex;border-left:1px
#ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">
<pre
style="word-wrap:break-word;white-space:pre-wrap">Hi Punit,</pre>
<pre
style="word-wrap:break-word;white-space:pre-wrap">can you verify that nodes
contain cluster packages from the following log?</pre>
<pre
style="word-wrap:break-word;white-space:pre-wrap">Thread-14::DEBUG::2015-01-09
18:06:28,823::caps::716::root::(_getKeyPackages) rpm package ('gluster-swift',)
not found
Thread-14::DEBUG::2015-01-09 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-object',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-plugin',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-account',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-proxy',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-doc',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
('gluster-swift-container',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
('glusterfs-geo-replication',) not found</pre>
<div><br>
</div>
<div>M.</div>
<div><br>
</div>
<div>
<blockquote type="cite">
<div>
<div>
<div>On 09 Jan 2015, at 11:13,
Punit Dambiwal <<a
moz-do-not-send="true"
href="mailto:hypunit@gmail.com"
target="_blank">hypunit(a)gmail.com</a>&gt;
wrote:</div>
<br>
</div>
</div>
<div>
<div>
<div>
<div dir="ltr">Hi Kanagaraj,
<div><br>
</div>
<div>Please find the
attached logs :- </div>
<div><br>
</div>
<div>Engine Logs :- <a
moz-do-not-send="true"
href="http://ur1.ca/jdopt"
target="_blank">http://ur1.ca/jdopt</a></div>
<div>VDSM Logs :- <a
moz-do-not-send="true"
href="http://ur1.ca/jdoq9"
target="_blank">http://ur1.ca/jdoq9</a></div>
<div><br>
</div>
<div><br>
</div>
</div>
<div
class="gmail_extra"><br>
<div class="gmail_quote">On
Thu, Jan 8, 2015 at 6:05
PM, Kanagaraj <span
dir="ltr"><<a
moz-do-not-send="true"
href="mailto:kmayilsa@redhat.com"
target="_blank">kmayilsa(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0 0 0
.8ex;border-left:1px
#ccc
solid;padding-left:1ex">
<div bgcolor="#FFFFFF"
text="#000000"> Do
you see any errors
in the UI?<br>
<br>
Also please provide
the engine.log and
vdsm.log when the
failure occured.<br>
<br>
Thanks,<br>
Kanagaraj
<div>
<div><br>
<br>
<div>On
01/08/2015
02:25 PM,
Punit Dambiwal
wrote:<br>
</div>
<blockquote
type="cite">
<div
dir="ltr">Hi
Martin,
<div><br>
</div>
<div>The steps
are below :- </div>
<div><br>
</div>
<div>1. Step
the ovirt
engine on the
one server...</div>
<div>2.
Installed
centos 7 on 4
host node
servers..</div>
<div>3. I am
using host
node
(compute+storage)....now
i have added
all 4 nodes to
engine...</div>
<div>4. Create
the gluster
volume from
GUI...</div>
<div><br>
</div>
<div>Network
:- </div>
<div>eth0 :-
public network
(1G)</div>
<div>eth1+eth2=bond0=
VM public
network (1G)</div>
<div>eth3+eth4=bond1=ovirtmgmt+storage
(10G private
network)</div>
<div><br>
</div>
<div>every
hostnode has
24
bricks=24*4(distributed
replicated)</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Punit</div>
<div><br>
</div>
</div>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">On
Thu, Jan 8,
2015 at 3:20
PM, Martin
Pavlík <span
dir="ltr"><<a
moz-do-not-send="true" href="mailto:mpavlik@redhat.com"
target="_blank">mpavlik(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0
0 0
.8ex;border-left:1px
#ccc
solid;padding-left:1ex">Hi
Punit,<br>
<br>
can you please
provide also
errors from
/var/log/vdsm/vdsm.log
and
/var/log/vdsm/vdsmd.log<br>
<br>
it would be
really helpful
if you
provided exact
steps how to
reproduce the
problem.<br>
<br>
regards<br>
<br>
Martin Pavlik
- rhev QE<br>
<div>
<div>> On
08 Jan 2015,
at 03:06,
Punit Dambiwal
<<a
moz-do-not-send="true"
href="mailto:hypunit@gmail.com"
target="_blank">hypunit(a)gmail.com</a>&gt;
wrote:<br>
><br>
> Hi,<br>
><br>
> I try to
add gluster
volume but it
failed...<br>
><br>
> Ovirt :-
3.5<br>
> VDSM :-
vdsm-4.16.7-1.gitdb83943.el7<br>
> KVM :-
1.5.3 -
60.el7_0.2<br>
>
libvirt-1.1.1-29.el7_0.4<br>
> Glusterfs
:-
glusterfs-3.5.3-1.el7<br>
><br>
> Engine
Logs :-<br>
><br>
>
2015-01-08
09:57:52,569
INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
Failed to
acquire lock
and wait lock
EngineLock
[exclusiveLocks=
key:
00000001-0001-0001-0001-000000000300
value: GLUSTER<br>
> ,
sharedLocks= ]<br>
>
2015-01-08
09:57:52,609
INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
Failed to
acquire lock
and wait lock
EngineLock
[exclusiveLocks=
key:
00000001-0001-0001-0001-000000000300
value: GLUSTER<br>
> ,
sharedLocks= ]<br>
>
2015-01-08
09:57:55,582
INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
Failed to
acquire lock
and wait lock
EngineLock
[exclusiveLocks=
key:
00000001-0001-0001-0001-000000000300
value: GLUSTER<br>
> ,
sharedLocks= ]<br>
>
2015-01-08
09:57:55,591
INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
Failed to
acquire lock
and wait lock
EngineLock
[exclusiveLocks=
key:
00000001-0001-0001-0001-000000000300
value: GLUSTER<br>
> ,
sharedLocks= ]<br>
>
2015-01-08
09:57:55,596
INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
Failed to
acquire lock
and wait lock
EngineLock
[exclusiveLocks=
key:
00000001-0001-0001-0001-000000000300
value: GLUSTER<br>
> ,
sharedLocks= ]<br>
>
2015-01-08
09:57:55,633
INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-16)
Failed to
acquire lock
and wait lock
EngineLock
[exclusiveLocks=
key:
00000001-0001-0001-0001-000000000300
value: GLUSTER<br>
> ,
sharedLocks= ]<br>
> ^C<br>
><br>
><br>
<br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
<span><216
09-Jan-15.jpg></span><span><217
09-Jan-15.jpg></span></div>
</blockquote>
</div>
<br>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</body>
</html>
--------------010504030303090109000601
Content-Type: image/png
Content-Transfer-Encoding: base64
Content-ID: <part1.02060703.06090409(a)redhat.com>
iVBORw0KGgoAAAANSUhEUgAAArYAAAI3CAYAAABu7xiRAAAgAElEQVR4AezdB5wmRdE/8N5L
3JGRnI8cJIhkgVdQUAmKCUEUE38UA6ioYEDECCqCgoi+ir4qIihJUFARBEEQQTJIEDhyOuJx
3B2X/vPth1oe1rvbC7vchqrPzs5Md3V1dXVN9W96eubpOOSQQ6bff//9ZfXVVy/Tpk0r1157
bdlqq63KE088UcaNG1de9rKXlUUXXbRcffXVZd111y1Tp04tDzzwQFlyySXLwgsvXP7xj3+U
zTffvIwYMaJMnjy53H333WX06NGV76mnnir33ntv6ejoKBMmTCjDhg0rq666all++eVr2qRJ
k8r06dPLDTfcUGXQY+jQoVW2/dixY8uUKVPq5nyFFVaoOg4ZMqRMnDixDB8+vJBxxx13VN1u
vfXWssYaa1RdSkNXXXVVeeUrX1kef/zxqo96tRHfOuusU/WlkzR723PPPVd1Jfu+++4rI0eO
LMsuu2zVkSxp+JZeeumqOxuNHz++1knO4osvXnnYzzn96bvyyitX/cllJ/WQo11sithJnrRn
n3223HbbbZWHHdl6iSWWKMsss0x55plnavvpxQ6PPPJIWWuttao9brnllqqD/rnmmmvK+uuv
X9tw2WWXle23376Wvf7668smm2xSdZa+7bbbVhvdc889ZYMNNqg6qJvMhx56qCyyyCK1fnqx
6UYbbVTPnx43voxaeJHy8MMPF31Hd37ENs9NeLbqrn9r28q0uo9/Hc+fTy9DIin3aYG0QFog
LZAWSAukBebJAsMWW2yxCvQAEOAUUASqFlxwwQpgV1xxxQr0gDMgD0ANAKbmhRZaqCqgzF13
3VVWW221CvhGjRpVnn766QrmADLnQB6wB4whQMlGpnqBPnJCPkAHoAGOygKD9gsssEDlwUcv
bQDA1BMAmyz5+KNeeyAyypHjnA6AKNAKtGk7e2gvvfEDlnS3f/LJJyuIU5c2Kq9N5AGrSy21
VOVzU0CWNklXl3aSSbYy6iFXO8jBR3dp5G244Ya13fLpLw+wxUcGXVZaaaUql00BX/ZUHtDE
H7LVrQ512uOTpw1kaZs09erXsDs5bIC0STvoPmrBBcqEZ8bX+umkrqh/WCNXPUlpgbRAWiAt
kBZIC6QFXioLDAOMgCQzdGb3gBNgDNgBwAL4AVWAkTygCUkDepBZU8DTjCHQAxDb7rzzzjqj
ByQBTKusskoFu4CSNODHjKA90ESfK664ogIvM390aAdWwCQCzOjhnE633357nWEkR5kAd2ZQ
H3300Spf/doDMNNzdDOzjPADxcCZmekA2UAaYK2dgO91111XbUSemW12U06bHnvssWozoFaa
WWGz10AtwGgmWfvozD5hZ3WxhY3uNvXZpGm7emxIPhlRxt6MrZlwZegB6AdIlq8O5eW3y2I7
fOzHXhWsNrbAw07Artl6OuCzmf1mF3kTJk2s9jdrPbqxJd0mT5xQRgztHtTmTG3tzvyXFkgL
pAXSAmmBtEAPWqDjS1/60nTgB7ABaAAWAAgYAgQd2we4cQ5YmdEDfiKdDHnAD4ADJAVgBXgR
IBXADk/IN2soD0ACRMm0AX+IbgGs6Eiec0QePvUpCxiThy/0INsGZOJVBg8iR13OHWsDG9AF
4JMnjTxl7QOM0kNatDtkAuzKsknIIlu+uqXb009apNNHuk0dAKtH++QrE7wPPvhgLQtgAuU3
3nhjtRE+oDaWWQDplokod+mll9YlB9pz5ZVXls0226zKvPzyy2s6nS0xWW+99aot3eisvfba
texNN91U07QB0DVD7JhOIxYYVZ6ZMLHTVtOnTK5t1h/RB9oVSw8cJ6UF0gJpgbRAWiAtkBbo
DQt0HHbYYfV5cYAws5aAFdApzd4MJdAIOAGZZiABFwTgIMARaFK2Ap7mHDgDqoLkIbzS8QM/
AaqVwyMdILTHCwDa1I/fXr026fiURfZ4gG6kPF2DV14AU20LcKpe4E69yDle+yhLpvqcI8fR
PsfyAU3yyQGklcdDD3rja9dPPnCsLD55IbtdT+XIIwfRgTxbzLhG2bCB9uCTzkb4tFc96sMX
bYs06SEHrxlgdtLn6Oabb67rcOmjjZOea934qEta3AyE3RLQVrPlv7RAWiAtkBZIC6QFXgIL
NBhmWAV+gA1w0g6yAE6bR+hAFZ6YqQ0QA8AAV8Aj0AUsyQOK4lg7ACjl8QYQBaICmJFPF2Uq
YGrAIZBELp3Ug8iIWVL1BIBSltyoQ30hvxZ8/p/68ABrgKPywWeGOc7lq5tcZZBySL10UB5J
V077Q6ZzRE7IVy7aKN8xoivdpWm/+uyDVx4iX730km+TppyNHGUdq1PdeJyTpRyiB4o8+cpF
ffou6jIrbNmGduHxEhwd6GQjSp66wvZk4yE3KS2QFkgLpAXSAmmBtMBLZYHOGduXqsKs56W1
AHAZNxXALlALgAK1SBpqT3OuHN7gkzYjmtla2ZypnZG1Mi0tkBZIC/QdC8QEUEx20EzsNx7I
y8mJvtNXqcnsW6A1ZTj7/MnZzywgQCEANoKUfQBWwUtQk2YfYFY5W5SZWbObEjPJmln6TNgz
OS2QFkgLpAVeUgvE08AAsu1P8YwZMU68pEplZWmBebRAAtt5NGB/KB7gVPDqGqgEL+mxLEJ7
AuDay5s7mttyc1dblkoLpAXSAmmBObOAJWPGAMvMbCgmN7qOFXMmObnTAvPPAgls55/tX5Ka
BSkkSJmdRQJZBC/ngK+gFrzAbGx4k9ICaYG0QFpg4FnAOzRIvDdGdAWzMSYMvJZniwayBRLY
DuTebdoWgcoegI0tglgEtAC9zBE8QG37TO4AN1U2Ly2QFkgLDCoLxAvDGi3ei/0oxod6kv/S
Av3MAgls+1mHzam6MTNrL2gJWIIZQItipla+NAA3wC7+vGOfU4snf1ogLZAW6B8W8EWbiPk0
bge0Gfv7Rx+mlv9tgQS2/22TAZUiOAlWQY4FMnfnPv8l36/MjR07tv64hUA3J9T16wcz+0rC
nMhM3rRAWiAtkBbofQv4pKbND+/4cR+fvPTpRuOCF8tiAqT3Ncka0gI9Z4EG2Jq58/hhMO57
zpDzV9LM+6+jwwxsC9jGHbhZWj/E4Vfa7rnnnvodWoDWDK3Z3FiWEI+lZtW2BLazsk7mpQXS
AmmBvmsBP5FuE/N9o95PwvspewD3v5ehzeyF4JmPP4MTV6Q95ne/D3thhi2cdmDtp0/3U7R+
/nVo86MRE+vd6JQpfjwi2tl3g86caRbtefF+yNDmp4WbG5fJzY8uuBOfMGF8/bng++67rwLb
+CWy5ZZbriyxxBJ1aUKsrTW76zgpLZAWSAukBfqfBbo+rYvJjWiJGVlP7kx0PPzww/WHmPzS
qB/m8XPuCzQ/mW7SY1jz9QRjafxA0LBhrZ+7nz4diEMvHnfyPO0xP/1imF/8GsjkQnZx24C4
yZOnVrDmgm7lhQP2VyvM+nuxZl21dUjH9PorcuPHj6s/kSyIuSP3S2IbbLBBWWeddeodOyuw
lXJmdv/7rr2/2in1TgukBdICg8sCEcu12jggrpusMEPr1yXFeOc33nhjueuuu8rdd99dwe1D
Dz1Ux4uVVlqlzt6OH9/6esK0aa1f3Xx2/KRafuo0v4o56zFocFk8W9sXLDDMbOZAJxc3Mkvb
aq9Z3BawHehtr6C2aaslAx45PfbYo832WLOeapGy/vrrl80226KusRLggF1367fffnu58847
6518LEsY6HbK9qUF0gJpgYFqgRjvgNhRo0aV1VZbrc7IrrjiihW4brLJJuUVr3hFufXWW8uF
F15YxwrvXtx3//1l9OjRDYgdWU1jKDVrO2Vy60VkcpPSAn3NAg2wHRyOaXY2HsMAunGh97UO
6Wl9tFlbJzbfK2wB28fq3fqmm25abB41jRkzpvzrX/+qYBa/wNW+72mdUl5aIC2QFkgLvDQW
iHcl4v0JSwtuu+22OkNrLFxyySXLNttsU5/eWX5gGcLvfve7+v7Fc80TzpEjRzZ5q9YnecYG
Tz4tawOSBwt+eGl6KmvpKQsMmzYIllC2HsdML1OntDbn05vNY5UBTR2t5QQdHcPLE088UTeP
n9Zdd93iDh1ddtll5aabbqqztQKYQDVu3LiaJ3glpQXSAmmBtED/tAAgCoB6ImcT3z2FM3EB
4PrygfHw/PPPr0vSXvWqV5WXvexl5c1vfnM5/fTTy8OPjK1jwyKLLFbT8dtGLDSyyps+CPBD
/+z5wa31oJmxdfHaXNixd3E7Hrg0pHmENKQGtscfe7IuLVhrrTXK5ptvXh8/AbVXXXVVTW//
xMvCCy9cgx+AKzAmpQXSAmmBtED/s4CXwkxY2ABS4Na4Z/bW5lNflqaJ+TfccEON+xtvvHF9
32L77bcv5/z+3Pqk75FHHileMJ40qTVbSwbKGdv+5xODQeNh8ZhiIDcWeNXO2FyMcdz/ge2s
lpI0n+8aPqTO1FovJZBZU+WO3KOo66+/vrPb426ebdzJs0uC2k7z5EFaIC2QFuh3FrCe1ljn
ywfIGCDGm8W1WVbg+7V+WtcYYEmaJ3rKebF4+eWXr+OH75wbQ0aOHFXL41U+KS3QFy0w4Gds
Y1bWxdx1c8FL6980a/0t8n/qqafqXbpvFC6//Io1IFl+4E596tTpdb0UOwlUlioAtQJXPMbq
3/ZJ7dMCaYG0wOC0gLhui7HPmAfMxsSFPF9GMmNrPPD92r/85S9l5513rmlAri8kPP30M/XF
4lVWWbWODcOGjsiJj8HpUv2i1cN8m25gU7Oetnlq4ju2rbYCgkOaixOoHdaAucn1AnWBu9hd
9AHonAN71iQJDB7lyIvjsJs0ee6GBQ6gsOvXBMiKtU14yZBmU7d64hi4dIdtj4I/5ONH9tLM
sOKNc2VbOrdmqt1pk+8lAW/DPvnk4/XLB3RA9EXK4ItjbUH0Yhe/TuPRlnNLF+gV6fbOyQg5
+Mj2uGv8+PH18ZaZAXKjbVFHtEl9YV8fDNe2SMMTNopj+oYu6iVPHhkBzqUpZ49Hvk1ZMxMC
e/Rr2EK+x3fy6EF/Ooe+Iau9DjLYQZoyyuqfpLRAWiAt0BsWEIfEKXFVzANMxSlxzV5MEkPx
2ftRHjFKPIxYj0d5MUsMv/feeyuvc8D2iiuuaOL+s/XXKVdbbfUqS4xrxdKBjh96o9dSZm9b
YNbTfb1dex+QHxc4MGgDRKS5cAUKF70twGU8ssHjwkYChSCBxwZoyQtQE2DKmlV1CBgBkCLI
BJBSZ4A1PNKVlx71hF7kSxPY8Dqmn/PgHT6iBfbI1KbpzWp/M7j0p2t3dMghhxQbUCsossW+
++5bPvGJT9T2aYsX05BASlebIKoOaXSSpj56so8ND73IRGFre4F51113LZ/73Ofq0gl8ZCjv
hyQ++9nPlne9612d7dA28tgGn/arY++99y4f//jHa3rYiyx8dAP68ZFLhjw2V38s3yCLTOk2
5waQduCqbepH7B+61IT8lxZIC6QFesEC4liMW/GzuOKc2OTTjX5Z8sEHH6wvBIt3ntqZnRWb
gxxHbJMmBlp6EHEy8p2Lk0hau4yamP/SAn3EAg2w5aiDdwuQCEwBJAF+zDIG8ANwXPh4BAcb
cCPNxS0dv72NjADKeAQEJKioz+wfHvIBJhuZgG8AogBJysvHC2yFTuQ7HjbMTPKkRpep9XjU
KJ9hIbcFKtUNkKoXIKSvZQj0p8PskpleIFb7BE0U4B8wJB/RW52CJ93xyFfOOTvhZVP2jnQB
k12UxSdfYNZOPx4hzTGyJgyfb+2yG3nq0x7HZKkndPH5GraVhyfazQZsYi+PneljUz8ZSBvU
Ty4+A4jAv/jii1c98JNJJ20lL46rgPyXFkgLpAV6wQLiERITxSEx1GcdxXwTGM5NLJh88J1y
5+K4G3MxDXUFqGKXH2qIeIfHsXT74G+VH7zYYTDjpr7e9kE1YxsXsgs1jl2oLnbnLlwbkCIo
AF7Ao6ARs3DAj8fxQA3A41zgAPZc8OQ5FnAAI3LxAFmCC+BDPvATgI88+eoQcOggTzlEB7LV
YzmBc/IDTAlo8oNHeYBvwsRWuxZfvAGCzS/EWEOlnDt49eHpjuhge8tb3lLbS1fn6rYHNkOO
+smP5Qpkh03lsYt2KxNtD50BU8AdP7s6v+666zqDsDayD54111yz2vaaa66ptiCTbcjSLno5
D9D7wAMPdPZXgE666RsAFr969Z2NfdWFnIecmtD8i69F8BvtVRedAd4A7NLVlZQWSAukBXrT
AmKieCneGLfEMvE14nHETjHKGITP2BQ37l11E/PM9CIyUMTGetL8kx5jaKTlPi3QVyww+1N2
fUXjHtbjrN+dUYHMO9/5znqhjhv3VPnnP/9ZAcpuu+1Who9o1h81ANGFLXjcd9995Re/+EV5
//vfX0FmA4fLAiNbwBJ47BjSzOI2Og4d2jwOmvBMBUXPTZ5YFl9i0Qqg8QBSypXmO7NTG7mW
CwBPAsW4Z56qd95Dm8Dxy1/+st55B7BV7jWveU1d92RGdtq0KbU+Xz54ZvyzFYBPn2jGs1kW
MaUFbgUzQBMBzdphJhQwJbc7AkJ9BsZs81prrVVnSQXNAIgCnGPLFejvJuCOO+4oJ554Yq1j
v/32K8suu2z5+te/XpcU+H7ujjvuWE477bRy88031zJf+MIXCvB58sknV/0EYsEZYBRgN9xw
w3LeeedVECl9s802q2W1hU3e/e53lxVWWKHajQ5f/epXKwCmO4AJpEpX9tOf/nQN7ieddFJN
32uvvcqqq65avva1r1X7HHDAAeXqq6+u7VhjjTUqCP/DH/5Qdtlll1qXQURZMxpI2w899NAa
6B37LI5+058BsruzceanBdICaYG5sYC4FhMoMcngSwZi9P3Nr4aJ/eLfSiutVMX72VzgV4w1
OSPGogCw9jazvvbkt+fHsW/AyxNfk9ICfc0Cg8or4+LVCXHs17eA1Zi1Bf58Bsu3/AAhG/Ak
OJhxBGzagZILOwAUoOhiD8AoeDiPQFEBbXMumAhGysmTrh5AyGMioMi5NaS777575dljjz0K
kDh6tJ83bD1+B6SQGUSgWxsENPLsyRsypKMCTPXQlT7RHvV3R+Sqz/dut95666qXcuQDluR+
+ctfri8cHH/88eWggw6qgP+DH/xgFW3WFQ9QTD+zmvTdaqutaj7wCGT7rfKwRbudgF/5L3/5
y2u+pQPaIUBrH6AKOB933HGdelh/qw/CjvijH7Un+kwae+gPdcrzCG+LLbYop556ajn22GNr
3W9605sqWD3mmGPqT07qi7gx0HY/QXzkkUeWb37zmxVg77nnnrVv+UlSWiAtkBboLQuIX8YS
MUw8dC7uAK0Artho79x4hMS9iIdirjIxNsiXZmyxj3PHcR5pNTP/pQX6oAUG/Yyt77oCq2bg
rOUEcl3UPkZ96aWX1vWoExpAu3Xziyzbb799XadkFlQwAK7OOuus8vnPf74GFbOUr3/96ysA
Pvfcc8sqq6xSH/v7DW7LAMxK+oas2WGB5K9//Wu5tnmcvlgTdADsbbfdtt5NA03IHtC1B9LO
PPPMsv7669ff+L788str2uqrr1Z+//vf18BFd98e9KsxZk4vvviiOrMJFC6y8IKdSwTIe+aZ
8c0M5aK1rbPyS3f87AFg+tnF1Zq1tnQX5Oz9BCOgGzMBlkpccskl5dWvfnVdv+oNW+Wtc/3P
f/5TNtpoo/oNXUCXDZdeeukalM0uRPDEj/SL+skHOgVm9QPI5ALFSD8pA5xefPHFdTbdjYkb
FOBbe8mwdx6AHL822OiiLjc23gJGUcbvp8fLFAYN/G5y1l577VrGLC2fAPZ9KocPmEE225zg
tpoy/6UF0gK9ZAFxxxID8VNsNM44bn3ecflaq6d0xjgxTdxz4w8Q4xMPIwZiluY8yLkNiZNx
HPvgy31aoK9YYNADW2DHms0xY8ZUoPTvf/+7vOENb6igBDD66Ec/Wi/mH/zgBzUQADMuaHfI
wCawJagAMO6YBQ4ACSjbYYcdap7H6B5lA3set5vhE4D8SMKnP/OZWu6EE06oM50AH5BGrrtq
dZELOAGRygKqgKalEn4JRn1vf/vbm/JL1ZnLG264seqsLWZOb775xvJkoyNwKDDZ6E5ud8GJ
fQRO7TOrCkzSjY7kmEG1f+1rX1vbF46tnFkCyxKAQuUAW+lnnHFGOfjggyvYZXuPvYBDFLLt
6acNgLrlCMA8YO8mQaA2E4GUZ/eYTY81sNHOAJ2CdehND+lsHHUZCCLos4vgj99NQgDksJl8
NynKmsn2U5TkOcdLFzcl5CelBdICaYHeskCMEeK0OCgeAq1ma8Uo8VCa9f/ivphm/HHzHUSG
uIUci4NdSTyNraPjBeDblS/P0wLz2wKDHthOfm5qefn6G5ZTTjmlvP51O5ebbvx32eDlG9WP
Ui+/3IplWoNLhg8fUdOeeLx5y/SZCcXHqRdacJEaLDqmNy9xDWm+bVua2b9mi+OhHc1s66iF
y7inninDG/4lFntZweu3tW1jH3msWZHfUY7//gkV/JD54AMPlzXXWLtMb9Kfm/T8dwKb46GN
fHpsvtmW5bK//6PceceYymPdlLvzJhQ14GvxMqSpc9NNNiuPPjy2AqyO5hvFJxz/g7LFlptV
QPnIIw81ujSfM2uWTU1p2i3INe/6z9IHBbi4y7/yyisrIJUGxNkD1QDg3//+93LhhRdW8CxA
AoBmP4FJgNgHv80mu4FQb8y4ApN+2hcBm4CgMmSQ79iv4VibKxBr8x//+McaYAVsQRiAtNHJ
Jk2QF8AjWMdNAuApOEdd6sCjHu2U59gWZch0jqrNGh5lAGx5Zomty5UWgBk/uzhPSgukBdIC
vWUBMUtci8kWMc2TM0+VkBglFseaWvFRXMLv2+6+8e6HenzX3Xsb5HUYJJqxYcxdd5Rnxzdf
lGnOm+d0ZWgDaJsSNTbW2NnwJqUF+poFBv1tlwvcY3J3uOecc05dguBcIABcBAwXsJlDs5Nm
LgEYC/CVEQTM2FqbCcgANDF7S7byAgvQBBQBXMpY6iD4fOADHygHHnhg3VuOAIypz4wfeY6V
BdzI9sHsa6+9tq5ZbcJMlSnvP7ffWQHdZZf9oyyz9HIVAApkZNNXwNKmCHahR3cOCdxphzbY
AFg6SQNezWqbCTbTzB50fsc73lG++MUvVhuRb5ZZ+k477VRnDci09MAsJ5t6RKZt9NR+ugm+
7CRtTAOGpZmpFoz9Eg4ZPveFx6N/MxDKWB9Lj4suuqhzxpRspEws16C72QxLIdTB3trhmByb
9uozNlNWmr5wrI+Bc7Y36ywPr69HeBlOWTxJaYG0QFqgtywgtomJYo1YKA65+fcug3TLqMzW
GguMOeJ2jC9454ial52T0gL9wQKDHtgCI8DMlltuWQGW5QPAy+jmJS3rOb/73e+Wo446qmyw
wQZlvfXWq6AG0AES66OcJjicdvrp5S8XXFCGNIDvuQbATWrAmW1oE0ScL9AEnRENMHP8dDPL
OLypc+Nm3a0vIliXq44///nPNSgBcECaDdACkAA1QFogAmyBQiCP3oIXfYC8733ve2WNBmRt
uPFGdb2wAOaFrgCiZlcXGNUsmZjc+s6qIDc7BJwHAalAoQ0oZYfDDjusgkQvclliwHZsRm/E
nrHuyzd0A2Cq32wusOk49JGPtNexZRfsEEBY+wVx7frGN75RbeOFsc80yzos1zj88MMrEGZD
gZ+M6GfLGZz7coIX2NyUAN3SDADBy670p7ulCPpFHiCLn+2BcACeH7DBhz70obru9ogjjqi6
40lKC6QF0gK9ZQExU/wXl9yci5linUkZS928+2DiwNMt8cgmnsc401t6pdy0wPy0QMfBBx82
aJ4lAHYCQIAdwAg4cXcLwAAzAJQAITjE3bBgId1eUCDDulHAJwCOvCBBg2xg1Kyg9aB4AygB
ZchdtnqBROSuOmZs1SNgRaCyPgqIvOWWW+qj+Pe+971Vj/sfuLecffbZ5cP7f7TKmDix9cML
w5sfblhooVENcHu8/OvqKxu5E+v61Le+9a3l6KOPrssg6DF9Nu7CtRGYUz9dtQ3IYxPHgitb
aYu201nb2QlpkzRAvYLrhkdZ9lAWuNRex+oKuY7DRvqDPdSDz6a/7Nt1cywNH5n0JY9e2ktv
OtMVX4DVkKUMfSMv2q6sPPyALrk2+mmb8upQDqCmb6RVI+S/tEBaIC3QwxYQj8Qg7xt4agjQ
irPiVcRRMVFsEsvELPFLbDamjB/f+v43fjGzfkKyiWeWInzqU59qQPG9xYvQTz/dLKlr4t9W
W25T452lC+LotKZcUlqgr1lg9qbs+prWPagPABIvf7nYgRppwAoQBnwBKvJc/NIFEMFEIJAG
8CmHAvQpK4AAUJY2ADnk4HWsnE2wUIZcMshURhAK+dLJ8skt6zn/53/+p86WClw2cvCQha+W
bQITcOlcULNeShAU5PB3CGJTm8fuVeuZ/8MvULKDdtvTC9G5ynpedzbBTyfLLOyd00GbzRoo
H+1kDzzyBVmy2IL8kK2MdoU9tIV9kH7SJmXIV5d+UpZsafjNLFu+4IaFLHUqG/UoF7KUC1Ab
NqVztFNZfasOfNLpGH0FfCPn7CE/KS2QFkgL9IYFxCExUGwWj8Rd8TEmRSIe24tjJlrEOrGx
Fau6GwF6Q+uUmRboXQsMKmArCATFsT0AEoBHPvACLEkPUGkvHWABngQTwQEfci5dGmpfvO8u
WT0CjwCDF+AiE2BTD7kCTYAoMqIMcCTPp7IsiSAjQKu1rX4sgjx86lLPc81yA/oAjOpQXh34
6Ljooq2fg1XPrIhuwB77KEsWvckKYEc2cIpPnhlwadqJh67kCKjK09Ne+4BN7cFno3+ATHU4
tm/p3PqRC7KUUZ5OArl+cAx0KmMjjx6ApxsK5QwACFgnA6lT+9RjH0S3Tns27UJRH/31FZ8g
K9oTdqGT+pPSAmmBtEBvWSDilRgrxhl3xFMaQDgAACAASURBVCIxTwyKsUbcEhPFTDHSJg7n
1w16q2dS7vy0QI68z1sfcBIQgB/BAGAJsONYHvDk2CZouPu1D2AE2AE2AFHcQTsXQIAcMhC5
Aow8AUd9AbLIRgEK6UUn4CmO6UFWldcsJaDHs+Nbv7IVgWpko4NfTFtksUXr46LWcovWbKIZ
zKeeas2E1spm8S/aHQA+QKg2aLs2AHgBnNVDd/w2fM4RXvIiwJLlXJu1Maidn4wAq7EPOyjv
OGzHzmxvD2CTQ6462NvMPF2d6zNEF/zqoZ9yzkNX6VE+0rRJGiIXf/QbHvrQg32UT0oLpAXS
Ar1hAfEqbqBNYjg3oSHOeVIoTtmki5ViqL24JfZNntyKzb2hW8pMC8wvCwx6YAuEuMABkiAX
vQ0wki4oIGAFSQc03SXLF1gApQBnAG7IBHhCtrrwkk1m+x4AUgYYAnYFI4BJkJKmTvyCkvyo
00/4Iufqwg9kWisVPH7Gd8pzrXVWeAXAkSNbANDP786K6GCjr702OtYW+tjUKy90aG8nWyjT
zq890kK29pBBroAc5bVZOrurh3x5gCXeKBcgMuzjHA/5+GdkV23WL/pNOfbGi/Aj5wFMow/p
Qw8U7VYPGcopg5d++OQlpQXSAmmB3rCAGCiGiT3ipWN7a23FIfErYpJzeRHTjBPDh1umlpQW
GFgWGPDAFuAIcBF7XRjHLnIX+8wIXwQCYAUJEIJFABygqH1msj0dL1JHpLfLrJnNP2kBmvBG
uXZwhZeM0Jde05oZ26lNWV8XlCewtfQFjFvgmKwAyuwB+E2Y0AqGSnZH1uMiCzkmT2lmP5vv
HYJr0itsazJ8EaJZslu5hg7zfVxtavRtAueU5kUDZZD0rmnyGwnN1yIaANzIL813FSNNHS25
eNTZqnvI0KYP8DblJj3XvNjXpOMjo1WWtg3wbsrja9dJur9pjch2vchErfKtvFbdUp+3QejT
6Fg1IkpVDYXukU5+rcguKS2QFkgL9LAFxJwhQ5v3Bp6PoeKa44iT7cc1ljVxqxWXWnHYuGDc
sLchIHl88+1aY0X7+BnH9saUGEN7uEkpLi0wzxYY8MA2Lr7Yt1tsRmnt+QPhGOAuzQ9DxOym
NrlTH9EAwArqn5+lHAhtzTakBdICaYG0wOxbwBgAqAK1JkxGjmy9B+E4nlx1ldYaN5+/m++a
medpgT5ggUEDbF28tqCeArXND4PNEz2/kmCeZCjcVY+QawZX0OoY0gSv5nbeN2wXXnSRMnVy
64Uy39dNSgukBdICaYHBZwHLwgBYT/E8kXRunIz3JmZmkc7xs21MnRlvpqcFXmoLDOt00Je6
5peovnYw215lAN14/NKeNyfH9WnznBTowutx/bxQswL2+eIv3rf6dXoNWmZtxz87rs7QWhu8
//7715/+NYs7uVkzmpQWSAukBdICg88CizUv+3qpFgG43s2wzGDChNaXcGZkkdaY2prRye/Y
zshCmTa/LTBsZsBvfivWU/VH+wC9dhAfwDby57a+eb1hnccJ37ZZ6JDU2jfz03Xxp0dK1u4G
tV4cG1nuvGNM54takZf7tEBaIC2QFhg8Fri7+blyyxGMjSZAJk1qfcJyzTVXr+9rdLVEjJvx
7kCMOl358jwtMD8tMOCXIszKuO1Ad1Z8/TmvdRfe+sSWlwScC07uypdaaqnOl9T6cxtT97RA
WiAtkBaYcwtMayY+fP82Ptfoh3z8BK8lCV5c7kovTBAlpO1qmzzvOxYY8EsR2sFr3G1Km9cl
CNGFsQAgzud031tLEaZaomCWulk3pb2T2gKVT4YBtpYi9JQd5rTdyZ8WSAukBdIC89cCw5rZ
WmtrPdkzFnh5LMZJn45spwC1rX3rCwrzOv61y8/jtEBPWWDYtOkvPKbuKaF9SY6LEIhzsZbm
01h1axScXpoLufkc1jxTc2WT4mNQc7pX9zxr0Fl/87kWejRfQIg21lY236m1rvaxxyfUz7qE
Ley9WGaflBZIC6QF0gKDzwKArR9t8MuRlqzFy8Z1MqQZH7qST0hOa74XFhMy03PitquJ8rwP
WGDYQgsOnrfiR41c7AWTL9BzqzDctbq+53T/gjLzdtS13hekNd84BGAnNh/iHjqsDO1ovgk7
pQH6Hc3P1y7Q+oU1yxN8LyEpLZAWSAukBQaXBfxAT0cHoDq1mbV9YelBR/O929aI1rIHHtMw
Cy3c+mGfwWWlbG1/s0CD7hLUzGunxU3rnO7ntd5WeT/NgHzM6wUKsOqb2+6+28kjJ78INmXK
c2XKRHfl6QPt9snjtEBaIC0wGCxgYgNZlmYSxNb6gZ9mVDB4tFFrHJH24vGkjSUP0wJ9wgI9
N23ZJ5ozGJV4cfDpaoH24BTLMuIt2PoNwyHuzJPSAmmBtEBaYLBZwBhgPDBOALX2MWYEwB1s
Nsn29n8LJLDt/304yxbEiwCYvCAA3ApYPu3im4XT6u8szhocz7KCzEwLpAXSAmmBfmmBkSNH
1vdPYrLD+BDAtr6X0i9blUoPdgsksB3gHiA4uRO3F7S8IBB35hXkNnlJaYG0QFogLTD4LGA8
iJlZ4wKyNzaYCElKC/RHCySw7Y+9Ngc6C1A2JGBF8HIO7OaMLUskpQXSAmmBwWkBM7QBYo0P
xoXYBqdFstX93QIJbPt5D8bnVupLqzNpi8AF3Apa8chJ4PIth9jPpGgmpwXSAmmBtMAAtUA7
kI1ZWnvjQszkDtCmZ7MGsAUS2A7gztW0+jkvM7PPvxQgaL1whz6t+NhXUlogLZAWSAsMPgvE
UgRAtv1pnnHClpQW6I8WSGDbH3ttDnQGYhGA67g1Q1vq3bgPbeeXW+bAmMnaJy3gU0VPPPFE
/SGSeKQas005OPfJLkulZtMCATyxO47Pcvn1yNn95UjlgFab60M5X0MwJrQ/wYtrBZ/jGCtC
1a7nkZ77tEBfs0AC277WI6lPWiAtMEcW8JOgfv7TgGyg9utJBm5f/khKC/RnC/DhAJm+YDBu
3LjmZ29HVlAKsHYHNpWNSQ12iKd10l0vMfExOzZSJikt0B8skMC2P/TSLHSc1draWRTLrLTA
gLCAwdYAb7B/9tlny4gRI+qAbTA3MzV58gu/pjQgGpyNGFQWcNMWN2z2Cy64YG2/G7jZ8W3A
1bWAlHd9BCkfTzYiLfdpgYFggQS2A6EXsw1pgUFqATNWQG08bmUGg7dBG9CNQX2Qmieb3c8t
YMYWIOXfTz31VFlsscXK008/XW/a+HYsvZlZMwFX4Nb1YO9mT5lRo0bNFjCemdxMTwv0ZQsk
sO3LvZO6pQXSArO0gIHbz0P/85//rGtsgVlg12YABwqS0gL91QIBTAFbN2z82lMKILX9Zm5m
7cMHHNvM/irj+JWvfGW9IczlBTOzXKb3ZwsksO3PvZe6pwUGuQUM3AZ8s7a77LJL57pagCBm
uga5ibL5/dgCZlr5d/jyscceWxZZZJFOUAvozoqAWC9Wolius9RSS9U16bHMYVblMy8t0B8t
kMC2P/Za6pwWSAtUC8TAbpD2mBUAcGwmKmdr00n6uwWsqeXPvoKwxBJL1KUIe++9dwW73S1D
0PaYsXU94D/55JPry5VkystrpL97SOo/IwsksJ2RVTItLZAW6BcWiBdgrDeMR7Nma+ORbb9o
RCqZFpiJBQBaM62Aqa992Pg6YBr+PpOinclRdtFFF63Ldl72spd1Lk3oZMqDtMAAskAC237f
mbGGsPW92jltjjt2d+42LyX87Gc/67yLlyaI7rrrrmX11Vev6e7646UF4AGwiBcSnnzyyfLT
n/60fPrTn+58qSHkeyQmSAMd+CNgq4PMu+++u5x99tlVDwF7pZVWKu985ztrnepQV8zOxTE+
xwJ3gBmBP9aijR07tvz85z8vn/jEJ6ocdeGlk82x8iFHu5SX5/NRPq0jLanvWkD/xONa/Yv0
vzT9iPQzkh4zVcCCY8R3+KAyBn/rdMnis4gcPqKuqMNeOv9RDi8Z6opy5JOdlBaYWwvwH77H
19p9jq/J42+RHn7OJ+WH/8vHK51vOm/Pn13dlE9KC/QHC+So3R96qRd1NCgvuODICjQFOwP+
Bz7wgfrWrEAG6P3whz8sb3zjG8uqq65aNREYDdqCJJBKRlAEYkHWY7T4EPgzzzxTFl988Xru
2Fu58vBfd9115ZJLLikHHnhgDdTSLrjggvrYDLhFEZzJFbCVJYPOdIiXhqw/A0jJAETwB/iJ
c2XoDOgg8uSREbMj5Gcgr+bp0//0JT/gU/qLjz322GO1H8MXpTv2kpn+1ddurOxR8Nnrd/7A
p8I/+YUbHT7fDhb4v+tD/QGS5QMifCv8rU8bMJXrVxYQz8RCm2O+xv8idvFHFDdufN/WXka5
uaG5LTc3dWWZtMC8WCCB7bxYr0+UnbuZ2lDd4AscGJAFQIO/T8rYI4O3NV3nnXdeBbb4H3nk
kfLb3/62ggNl3vKWt5SVV165AlEB9IQTTigHHXRQueOOO8ppp51WgYN04NjMr0DsPOq88MIL
K5h2LjADGK9+9avL6aefXsaMGVPrVeY73/lOBRvA67777lv1ffzxx8v5559fllxyyXLrrbdW
gEGf9ddfv3zrW9+qAf6YY44pBxxwQAWzP/jBD2q71A9Ia7uZakBa2kMPPVR1pwdwIi2pb1sg
ZlP5D1AbINSThhNPPLEsu+yynaD24YcfLh/84AfLqaeeWvv39a9/fTnjjDM6fRJA2GOPPaoP
nnnmmRU83HLLLeXQQw+tRgAYVlxxxerjfMTN26OPPloB9TXXXFP+9re/lY997GMvAs5923qp
XV+2gPjaTs4jDdAUn92kSxOrxEk3bW60xK+YdEhQ2m7FPB7oFojn2AO9ndm+mVgAGDDDaQ9Q
Aq4xWyloSgcagVnfURRALTd4xzveUT7+8Y9XQPr73/++BtU999yz1vKRj3ykyrS0YJ999imf
/OQnKzh2DkiSoS7y77vvvrLccsvVOgRf6fLlARiAsNkz4GOrrbYqn//858uGG25YLr744hq8
BfP777+/eNMX2N1rr73KpZdeWgHyhz/84dqej370o1WuMq95zWvKfvvtV7bbbrvy17/+tXNm
jR5bb7111VX7c7ZtJg7Tx5L5J5+yGdT5itlbgzo/MsADvmZy288B0vB7vhYzru9+97vLe97z
nsKn8fPZk046qZx77rnlnHPOKb/61a+qb3o7PQCEG8Gzzjqrgl8+zHfIz5uiPuYs/Vwd/sjf
bY6DgFc+7Brg064DxKfb+RzHOT9NsBsWzP1As0AC24HWo3PYHoEOCAAoBUaDsYAoUAqYQJ7N
MoTIM3tlMBdgY7kBQIEM6sg5QAlwkge8ygvgQSZ56rCeFkhwjIcuATroZBbtrrvuKuuss04F
rNtvv3254YYbav2CuDKbb755nalTFgBXxrHgHXIteVh66aUryNl0003Ltdde29lmdlhllVWq
HmQGYKqNyX991gIBaPmSfudf8RhW3/NjfsDf+FgM7GZbzfwrF35ihvdd73pX3eQDxD/5yU/q
kwI+xCcWXnjhcvTRR1fgy8fweWLgqcNhhx1WQQWdpONPSgv0tAX4NR/jk2Kr+G3P38L3o04+
bMOfQDaskvuBboFcijDQe7ib9gl6BnYDMVAACAiOwKJgaSAXQP/zn/+U173udVWaR/dXXHFF
ufrqq2swjdkCj4DJca6sQHrRRRfVNbQKAhECrM/WAAUCsZm0v//972WnnXaq9QTYJQsIcU4e
3h//+Me1/gAn9FCfNgDCAjx9yQa4PXamg/bgodMpp5xS98ArXcxEx3chCaebGT82iXpqpfmv
T1qAz+pvPqLP9R2fccyH9THSl3zN0hXHNr5jz7+/8IUvlP/3//5ffUoQs17XX399XT5DBvmA
MR9z/oc//KH6kfotm9l5553LlVdeWZc8hM/yN36UlBboKQsEqOVbsXk5VnxD/C18nv//6Ec/
6qw60iOB7yelBQaiBRLY9vNenf58bOqYu/cBngehEzvv/gXLCJIGc4P+bbfdVtZcc80KFphL
sLSOdZtttqkf/7YWNmbEDPyOAccjjzyyAoXXvva1nV9cEFwBEXuBFxAFGO65556ywgor1LJA
LLCpHoDX+l0g9pBDDqlApL3LAiCTA6ioG9ggP2YyHJOJx1pbgwO+mLEDgIFfbVUPvfBk4G+3
dN88jhsp/WXT9/bhxx/60Ieq4uHLTvgFngCdn/nMZ6qP63eztkCxvre2lhy8rgk+oj5+FC+i
AbHk8GHHytEBX/hU37RcatVfLcDP4kadj4mTbsr4qY0PRvzlv0j8k4cyrlUz5L8BbIF8VjaA
O3d2mmZARpYWIIN7BEHBE9j705/+VDbeeOMKCAA/gdXyAQDBIO4RMF4BE4gEIqx7FVxXW221
miZPOTNq6lBOGftNNtmkvngm8AINgIW1jWZtYwmDpQaWH5Bz7733Vn7HAIb6AFUAg+5Rl/rU
RQ8Bfu21166zzHT0azzWCktXHznq1iZ6xSBQjZL/+qwFApyG/9nbwo8N+n/84x/ri4h8Kvo8
wK1+3nHHHev6WWA01ovze+u75fNRPuUphXXfXjhzY3fVVVdV/yEr/AbQcE3hJy8pLdBTFuBT
sfFLGz8Vf/m52CfmSffibLuPS0PKJ6UFBroFcsZ2oPdwN+0DAIYO7aizqIIekGgNYYBCwCG+
YwsQelS/7bbbFi/PCJaAJ/AKKJpZtYb1+9//fn3z3Izud7/73SrLR8EBBW+QA5DAgjqAkC22
2KLKPe644yrwBWiXWWaZEi+jCd5mfb/3ve/VF77U6yUf+pIDSNCbrmQCFI49evYG+ze+8Y1i
Vu4Nb3hDOeKII6oMAARIIUN5cmJ2o2WToXXQMFgk9V0L8AU+ZBDXf+FX+pQP6F/+g8I/4jiA
55ve9Kbq/5/61Kfqi4Vu2txI2b70pS/Vr2cos+WWW9aXxFwHli6QS6Zz9URd0vgjHdJ/WC5p
bi3Av8U0fhTAVXzi8/L4HF/z5Aq49WKsOCmNf0c+GY6jDH2k8dXZJeWT0gL9wQIJbPtDL/Wi
joKVICnIAZPve9/76uytcwO2wRsIRI4FV0B0s802q2l4YvB2/P73v78CDGkbbbRRnY0N4GFW
FPAQmMkK2QKw2VQvbwnIQIqZYUEYRVD2GSWBWHoEZMsJLFFQB/IFB+eh19ve9rbOgK4MgGuv
TnXRRRmf/kLKIXXKj/OamP/6nAX4WQzWZt7Dl/kF/9LX+pCfOwYAzODzLzdbiF/6YQa+cPjh
h5evfvWrxU3W8ssvX1+A3G233eoThPAZTx1uuumm+qUPZTwtsOe36uA71umSr76ktMDcWkAM
4seI//Ev53zaMX93ztf43FFHHVV9MeKW68MNX1wnseevrhu+OrsU8Xh2+ZMvLTC/LJDAdn5Z
vofqndu1tVG9wLjAAsMriBMAzaZ2nbmMgCoYxuAu4JqRAhIM3soBCJEf+wjKgIUygmMEWiDX
eQRhssjEa9ZWukDs3DF++jonV2CPPHtBuj1YR92AuTqBGXKlq4vMWMJAdgAUckNPx0l91wL8
g8/oUz4Xfav/9J00fa3/Y7mJNL7s6QHiH3yY/5il9SKYT9aZ3ffCJNCw++67V5/Ar06f90Jk
AcX2/Itc9QLW0vAmpQXm1gJ8KJYURIzjX2JX3HiLXV6K5L+eqAG4KGJXgFfn4mfENvLSP+e2
Z7JcX7ZAAtu+3DsvkW6CpGAn6BnkBUKbdCTNsXwDt2MbwAAMCrACsDwEXMSxPLKUFUQjOEtT
Jzlm2uJckFYekRGy1AV8SMNLLrDinBx7sqRHGXU593KYgG+AwCOdPuQgdfqwPwAjPQB7zcx/
fdoC4Yd8lH+5wbLm0LmXGvU5v8EHbPIT6fwJIPV1A/4SvsGfvWC4//7713S+5fvGv/vd76ov
yecv/CR8DZAgd4cddqi86grfDnDRp42YyvVZC0TM5GN8lq/ai2HxBAwP/5PG9xGeiM18kD8i
e/6LlEtKCwxECySwHYi9OgdtagHJSRXkCY4BQIlwLBDGnb60mPGMGS5lgAIB1T6Cr3IBMAFI
gz0gIPhGoMXjXLrA7Zz8ALnSkXPyQ3aAEIAYCNUGwJosOtMpgLbg7lu6ZIQ8upMVoEMeHul4
BPzQrSqQ//qsBfQ5P3OTEz7gRUh92fLtFmjVp/j0q77HCxjwJWk2fR8zu/wwfEnj5SmD8PJn
FKDCubLqtAes6RA+VpnzX1pgDi3Av/g4f+KrNn5rmQwfFd/4Iz6+FjGc7yJ50sJnlefH/DXS
51ClZE8L9HkLJLDt813UuwoahJvwV4OioBdfLRD0YhZMkBRcBUdBFRnoBUfBVJog6/jJJ5+s
g7vyMahHABV8I+BWIc0/MgMIqINMGwIMlLUpG18vkA+kkE9nfMAKPsfkOQdYlbOPWTXpwAcZ
0snAL41u9mTSK6nvW0D/urnhj/yVX+hHx5GuL6UH6Xe+Fv3MJwLkKofIIBOvPDzq4mPynPOb
kC0dAQ3KKRP61Iz8lxaYCwvEzVT4M3/z63cALX8MHxXPIpbFDT8f5Zd8EfF5Puuphjyyw2/n
QrUskhbosxZIYNtnu+alUczgPmXKcxXoGbCdC5gCpXN755EeAEGaQT8AgL28AIbxOF8gFXzl
K4MEWMeCNLkx6xDp0hwrI1gHCB07dmwFC9LIJJsOAnUAWvJ9DcG5PLIEdo+hyaFj6G6wENzt
1WWmjy7kCvjqUCap71pA/1lCos/89G2QPuYnfEzf8gVp0ff2fCx8iw/5soc+5w/8QBkAQHm8
ZNmiDD48zvmZPP4VvilNflJaYG4tEL7Et/iic77I5/mWdHv+a1JC/EVeiHVt8Eexjy+6RsLv
xcfgnVvdslxaoK9aIIFtX+2Zl0gvga+JkzVYGsAFwAACgiiyxxf5AQgCJMRMgYHeIG8DDAVS
gRcFGHAcwVWa4Es+GeqQJ13ZAJzS2oFmgAnpygEhgrTy9pYtkKkM+dLw4pNGp9DZXrvsAWB7
AwgdbEl92wL62Utb1sHyF/2tf/Uzf0D63sZvo5/NaoXv6X99rd+VlR6+zA+lS1PWhl+90tSD
lFcWL9DgCYanBK6npLTA3FqA/7lRF9P4mlgmLWIwudIjtvHLiI/S+aUyYlv4ousijvlsUlpg
oFkggW2/79F4AWDuZoYESEsRDPzIoI0M4AKkdMHRvj0YKicoSo+BHh+SLr8lu/UyWQRc/PKj
bPCTETKlqUv9kYa/nUJ2yAkdBW11IeW1AxkMAoQ4Vy5kh07BG+3Al9T3LRCDfQBN/Rf+En3q
3MYn+BZ/a/fx8GOt5SdxHfCl4JVHNr+JtKhHeRR+Rpe4XmpG/ksLzIUF+JAbpYhp/Avxu/C5
8GnpEbvkSbdFTAwf5782eXNCyiSlBfqDBQIV9QddU8e0QFogLfAiCwCYNoOuwd4gbsB2nsDy
RabKk0FoAddAgFjXhmvEeVw3c2KSuImbkzLJmxaYHxbIGdv5YfUerXPO7rp7tOoUlhaYzxYw
u2rANYADtAFy53Q2aj43I6tPC/SKBdpncF0nrhczt0Bu+xOsXqk8haYF5pMFcsZ2Phk+q00L
pAV6xgIGaRtQa/C2xMCsVFJaIC3Qen/CNeHacI3E9ZK2SQsMVAvkjO1A7dlsV1pgEFjAgG39
ISBr4EaxxrY9bRCYIpuYFvgvC7gGPL2IawODNNeMaydmdP+rYCakBfqxBRLY9uPOS9XTAoPd
Al6s8SUCg7dHqwbteGvcsS0pLTCYLQDUuj4s14ljoDY/+TWYvWJgtz2BbT/v3+nPj9sdL/5o
QD9vVaqfFpg9CwCzvorw+OOP1xkon/EyiMdb5O0zVbMnMbnSAgPHAm7sYk2tY98XN0vrO7iW
JCSlBQaiBRLYDsRezTalBQaJBQzaPkx/ww03dH4/1jc7gV0ANyktMNgt4Brx+TnfVnZtuPnb
dNNNOz8XNtjtk+0feBZIYDvw+nSOWmTwnz79hV9OUtgsl7v7WKsoMDo2OxZpHmu545fmhQTk
8RZSPj4KbuZMHbYoT57ygqzHyD4urqx0ZfGZWYhHZ6GLdHLooFx8dFy+x8/4EX3Ikx7n9jPS
L+qVL/jHR/4DGKkzfgBCPn6bOsiPuv1qmQ/yx3pP+jjOGUOW7T1iX/3BF9/73vd2zk5Jk6cP
+IlzAzsQ3N4v4XP8CtnLD39ybuMHKPpTfcra+AKwwE/wOg7/Df8IPZ2HDPKUV0Z6+J98m3T5
8vi84yijfm2STt8g6XEdkCcvdMTvWHrIIhs/fUNHfNF+csPXHbODOvGE3s5t5IRe6m3//qqy
SXNugegLdtdnxx13XO0DcUqfyZ8Vydd/SP+6FvSNrb1fZyUj8vhKUlqgP1gggW1/6KVe1BGA
mzRpQh2UgUXBMgY9wU9AFQz9ZKM85zaDOD6DGzKoGQwjza9BCb5IQFSPwU/ak08+WYOq+qSR
p3wMuGTHI2Vlpcs3UCpPLzqRiejl0ZrH0fJj0KWLYI5mpp/61WEfP82rbuc2sgEi7SRXnTE4
0DsGFrpF2w3uysSAUhXIf71igRhs2Vp/6Q97/a7PHesn/cY/3IDgla9Po1/tY8DXj+TwZ6QO
/Po1+lj/RlpcN+pST4BC/HjIUg5FnfWk+Rc6q4NM/oYn/Cf4lbe5NvCGj4b/xfXA/4F3+QFe
wibO5fFzNiCP34aO7BT1kRPtxUeGPPxkx7WOx0+20pt859pER7ZQJmnuLSD2sWP4El/be++9
6409O+u7WRGe6Et9/qtf/aqyh9w56Z/u6pqVHpmXFngpLZDA9qW0di/UNa9rawVMgxAQYHD0
840CYAywBlIBTZqBS7qBTrAUNG0Gvcg38MVvk2uudDxIEHW86KKL1uMYHMmXRxd62KSRRXYM
uHRTxibA40fqe+KJJ+oAEMGXrvjQrPTTFnz0RO2DgAElAEb7wE2/4DdLGzzqiY1NyaVHUu9Z
IPqPnfkJn4l+4xPSnQN0SyyxRL1Japj6ZAAAIABJREFUMqjrM74SvqffHPN3fqWMNDL1MTCn
3+XxPWn6GNGB/wKMyriO+HnwyydbmjLO2/dkqhc/2fL8hCp5ymhD6CyPrPBZspTht9FOezx8
lN7arr101B6kTmVdU1E3Pjqow42pm4CoR5qy6pJGrnbiZwu8Dz/8cFl66aWrzvqBTknzZgF9
ry/1lS38wE1a9El3NehX/S3uimP2+jL8sbvymZ8W6G8WyO/Y9rce62F9DVIGK8HznHPOKdde
e23n4C3wmV394x//WNMMgAZIg7dy8g1q3/3ud2t5MuTHwC6IohjgDKwGRHx4YrA1AAu8zoOU
pVcMpMoabA2Y+AL0Sv/Pf/5TfvCDH5Sjjz66Pqo79dRTXzTozkq/GOyBCGTgMIAYULTRoPDg
gw9WuaGLdjumt30AIOnKkJkDe/Rk7+7ZG7jSZwZ6vqEf+Io0vqYv+B1e5wH8+DNe/SjNsb40
+0+m9JBPtn5VHh9+fc+341w9AKl6lQ95ypClfOgpLWTxfQDT3obXzZq622VFvj1Z2qR+9dIv
npIogwd44b/2zgPARh79XYdkRZ72kxX6uA7UQRfy6ezcdc/W8pUhk93oEvZwLSXNmwX0hVho
z/b8Sl841//dUZTjr0hf6Rfp+j0pLTAQLZAztgOxV+egTYKjwU/gW2ONNWrQFEADDNx88811
FsbgKKgKsngFRYOZQczgJlAakO3xkWHgE4TJwmMzkJKlXoOjQGu2R7rBNQZhMpDyjm3qAkAF
ZuXQjTfeWP72t7+VAw88sOpFh9///vfl7LPPLnvssUe3+gW4IUsd2kd3crTTsYHcno4BNOil
Pc6VoU/kkckOtqTetUD4hf4KP+NDfMINTdyoxCD+hS98oWy33XY1nS/px+hDe3wAnL4nm1zp
9uHnu+66a/VTaW6oVl555epnfJq8q666qlx++eXl4x//ePUbMvlClFdOmo1v/etf/ypf+tKX
Og21zjrrlG9961s1j/477rhj9Wd62MjSRn6H6EmW641sefyVT5K/++67l9/85jedfqy8vLje
lFVGWdeYNjjHs/POO9c6yHHjOHr06FqvfPa+8sor683wvvvuW3ULOewXcaIKyH9zZQF9w476
Qn/rH/3ElwKgzkpw9CW/UTZ8hX/EtTOr8pmXFuiPFsgZ2/7Yaz2osyAZA+aqq65agaKBL0Dp
NddcUzbaaKM62AEKxxxzTB3gBFvBUYA1wJFhdld+pHk06WUHQdmA99vf/rbcdNNN5Tvf+U75
3ve+V99kv+eee+qgfvzxx5frr7++yjSICsLf/OY3KzjBqw5ARHAX7OWTazbZS0OCtECPdtll
lzoY3HbbbZ26zEw/9QIk8v/9738X5wZwbTUoAO//+7//W+XFixsAgXbajjrqqKqHeqX/8Ic/
rO386U9/2qmPvKTesQB/CBDGBxzzjf/5n/8pZ555Zn0K8ac//al8/vOfrwoAtXzeBsDypSA+
wKf4A18iJ4CFvbo+85nPlC9/+cvltNNOK1/72tcqsA2wIP8Pf/hD+cpXvlL9KW5wAmS6rtRr
7/pR7qSTTqryzjjjjELPP//5z2X55ZcvALjyriUUwEZZaWaGyQjfxase/kp315C0hx56qKa5
nrUn2hR6kCfN3sYGrjPHn/70p6tuv/vd78ohhxxSr2V2oLcZ5bPOOqscccQRtbz6lJFHLzet
7bYNG+d+ziygn/SJWMSu/NueraWx8aw2vsJ3xM/oZ32lrC0pLTAQLZDAdiD26hy0SdATPAW5
pZZaqg5MAKkgaOC3HsvgeeGFF5Ytt9yyglDA8cQTT6zpBlKBF38EXAN8rOMiV3my1EO2AfNd
73pXufTSS8sdd9xRQYcXIsyyCdhk/uUvf6kA1Uzsq1/96ppnxlS+YE0+kLzeeutVEG4wp4d8
gd4s1frrr19ldaefsnQ200s32w477FAuvvjiOijss88+VfdPfOITtZ1m47beeuty0EEHle23
37789a9/rQMO/bSXnd7//vfXsnPQFck6FxaIR/bsHn0P4CHAji/o3yOPPLJ8/etfr/0XN1O/
/OUvy5ve9KbqK+eff37n04QxY8bU2f43vvGN5W1ve1txgwQM8F116F/n6667bpV955131uuG
/wCnhx9+eK0XmMQf+tDFNeCa45OuiVNOOaWCY/LkAYSf+tSnqv6xLIi/a8Njjz1WdttttwpS
POUg7/Wvf325++676zXAb+n71re+td6YuR7deAFDr3vd6+q1cP/995c3v/nN5S1veUttu7Ku
T8t53JR97GMfq3W4oSX/Fa94Rb3efB6KHvfdd1+V8/Of/7xcffXVta1sr430Z3Obtqs3ad4s
YLlI3LCEjdnbpj+6I7FUP/I5Nx3OwwedJ6UFBqIFEtgOxF6djTYNmd6s92vG/6lTW2vxIuit
ttpq5dFHH62Dp0HP7JEB0ndCt9pqqzoYA4yPPPJIHehVZVA2gAu2SMB1DOwKqECjgRhtttlm
NdAC0TYDpkDrGMUXE8yerrDCClXWJptsUmeSBXa6kAsAGJCdG0DpL4DTQ50GV/xoVvrRFb8B
hFwzXGRsvPHG5TWveU2VoQ4kna4GdDbAjw/ABjzoYGZkdPO4VpmovxbOf71iAb7F7nyAvfUn
0MgX9Lu873//+/Vxfjx5wGMJC5+zZMVNGh43S/px//33L4cddlidfTVbD+wBBICt68MNjHP+
t+aaa1afUbebKeCQj6iDLHrYguhms/wHmFx99dWrn/MlG53xA6RAJV51RXr4t+tLnc610Yzv
csstV84999zaJgDbkoiPfvSjVS7Qzc8//OEP15tTM84/+clPykc+8pFO+WabzRT/+te/rrza
Gu1QlnzXvfqAYzcKdI3rAy++6AvtT5o3C0QcNYuO2FefB4V/zWyPXz8ogyf2+oqfJqUFBqIF
8pa6j/dqBLEASbEPtSM/zmPfvEdbD4c0AS0GwJrQfLO2NNvQJntqE9g6moEzBi97g5nZ0gCT
ZmfN8hisoi7B1rpC5wZj58o6liaA4hc4navfJl96BFhlYqCPIIvfIC4Ye0yrTPADswbV4DEr
5O1gMoLPMVn4Iq07/QAH5Qz6liIYRMaOHVtnZIGXIHwAMAJ4tCXqBna00Xm01Z6uSb1ngfAn
A7h+Z3N9r6/4jTWgZmMtS3AefqqfAFHlllxyyQpQ3ci5sTEL+spXvrIq7YUoa2rJwRvyySLD
dtddd5Utttiiyue36oh8/e+cPnR1Tkbo4XpD0vgr3ZWNa4d8FHt8oUfIdDO1yiqrVKB6wAEH
VB/1Iig5rl2k7ksuuaQ+BTHjrMyyyy5b3vCGN9S2uZ7drLEF+crS1Z6ucQ15kdJNIzCrfnvX
JflxDSsTddI3ae4twPbszf78I2KbGwz9xO7ve9/7agV8Bx+K/rAkSj+huAHhS/olfDF8Slky
nONRn0094X/O9S++8FGyyZoRtaeTa0PkhX/NqFympQXmxQIJbOfFei9B2QgEUVUEmDjvmh/p
sY/BRkDCay9YkuO8fRCSZxbL3gAmeBn8yJBmLzgavOUrG2v3BF9ypeEB9JwHKQMwCp72gmUE
bHKBWXmCsD0AaaYM0TWCNt4I9vGJISDUW9zSlcd/8skn1xlms0x0n5l++NXNFmR7nCvgkmlt
oSUS8kJ28B588MGVTxn5No+WlcXr3LF9Uu9ZQN/yJf5lWYKZUMcGdnnWw5qR1ReRxj/5qTQ8
KGb/LVMw23nBBRdUf+BL+FwHnl4op0/j+lF29OjR1WfJ4E+2kM2X6aUc3+Ev9JMvTX38hR70
MwPN9wFP8vBrH98KYBLXED3kKweIe1nNEoMgM7DK0JX/A0PSbGSrg2xr61dcccWqA10B1Wgj
WXFMX5/zIi9sSYY0egeFbZRLmjcLhA31k1iL+A/iZ+KsmXcz85HO/vzixz/+ceeTLf4lhiL9
qCzfsMeP1IFPncrzUXl49C/fUEY+GVFO2dDT8eyQ8kgdSWmBnrZAy6N7WmrK6zELuPBjI1RA
EHxsEXwif0Z7A5B0QcjA6tjAaBPoyJNmjxd5vOprCGaBzGAJZmZzYs0fUGuQ911QgVW+sh7l
Iuvw1Ge2qD2gGpyjTkHUMT57wZN+kWbtrPrw3X777cWaPjpqs72BGSCwPOIXv/hFbYO65ZmZ
Emg95u1OvwjS1vp6nKt+aYCtNpFHB4FdfQCCR8RXXHFFPX7ggQfqi0R4ABJ2Ndgrl9T7FtBf
+sReH4X/6EPLAsxgugHiX/qIP+KLQVkfS+cngAGQZwnKeeedVzdLFXw+bs8996zruc3O6uMA
nZYTuHkCOuK64sehE58gWx1e+AK8panXUxHXGZnqlkZ/PIcffnitl78j9YVMfkim61Y7ydYe
6769TGk5grW4p59+em23NpNtVtYTGMDd+mIA10y29bdk4fEERF2AvGtCWSTPdWiG2fUeT0/k
h6+TERS62ec29zbgF+wX/mPPJ+JmiK/hiZdY+YH+4Pv2+lIf8U3EX/BIV448hEe6LfxJnztX
l80xH3T9uJ5m1a8hqwp//h/+SI+y7fl5nBboKQsksO0pS/aSHMHJJiBFgBNwbIJN5M9sTy1B
yxaDu+AieEkz6AtWZAt0eNZaa626Pg+Ytc7Vh+4NiJYo+EKBrxsY6OmElI+A6dNEZkuPPfbY
CvDUJajS14CuzqhLGXrLd6xuJG2nnXYqF110Ufn2t79dAYb6yQIg1IfXHgjxqNhnl3xtAT9g
7eW0CNqz0g+QQCuttFJtq7e8fe3AjJ020pXeo5tZOTMgzr3MBtiqE0AIYKAd5Bn41a3epN61
AH+KmawAga4LgNRLXfxRnwTA5Gd8vt3v+L18fWtJgZcG3djgwf+5z32uAkD16Fcvk7kmfMVD
X7sB1Nf4nTsmT1k68Vvp4Rvqke6asMbVS4h0BhiUsR4W4PUiGJ64ZgBoPuZmSnnLDXwaDLne
zEyrCzCmA9BjJjbixOabb15Br7J00JZDDz20Xl+hq1k5dbjuyfISGb35O10sVVCeTHZjE4Ad
D342oK9j5Dy3ubcBO+uTiN1s6twkgf7TB8ixeMTWJ5xwQt3zAX0pTX/g1e/hZ9LCF/WpfLyO
2/d8w0YHPsCXbXhiC56qTPPPeTu156vTlpQW6C0L5FKE3rJsD8ltDwCCg0CCInAIaLMiQcqg
Y5BrD1aCmkDlZS355Egz22g5gs8aCXRmhiLfAG/QEjDVL8gZAD/72c9WWfQAhs1ECaiCspfF
tEE5j0nVoazACDiq17m92TV1ObdZFmAfgdaxNihLJvkG1bXXXrvOMrcHasf07E4/L3/RTb0+
BQUIRfvIsMn3TdwYGKTtt99+Fbwox0bSDPKf/OQnq44Gj3gZaVb9k3nzZoEYkPli+Lh+Ak7N
OFpHKw+fPrKOmr/wHwBBP/EnhMdm/bRPyLk++Bzwad2t8h75+lIHn0A/+tGPan/ji2tIffLp
EbJdV+q0me1E+N2U8ZvwL+kbbLBBnU0Nv1IvvfC95z3vqUt0yLFMxjXgmvjgBz9Yl124yUKu
NV/2oJfvU/v6g3aZyXMc+pNndheQD1nkkQ9w83NEV20ljz7OgXfXeQAv7Q4bKB+8VUD+mysL
sGH8qiKbhi/zB/6OpPE1G1AbsVdfSOM34cv8UT9Ll0+mPVlRTp3S7NWjrD5H9sqGrzgnA8Xe
sbK2dppRWnuZdt48TgvMiwU6mrd/X+x98yIty/a4BQSOrgGivZJZ5QWfb2MKUGZizWQa1Cwx
kCawkGEvsBmsBC7n6pbmsZV9HBv4HAN1jg3A1riSG4Oisogc8iKgGuAFzeCTD0gGABCk5SlD
hg0/2Y7xxmwYvaUFbwRjadpGpqA8K/3wCtJmQNSNyFFOunrbBwIDAF6DBV1CX3LoHWXxAU3K
JvWeBdidL5pR3GuvveqxNdzSzVzyXXv9wNdi4x/8R/8FL4AW/qXv9CX+6H99Lp1vkEsG/9DX
ZPFDZZB0sukW+crJJ4+v4LGRS8fwazrQCR9+QDj8iU/LUzf59FOva1E5+dIcm5kmX760aE9c
7/bSlLEEQX10pAf91EGuNOXVKx0/mWyhDtdXXA/y8YbuZCTNvQXYnK35tL1Z2Q996EP1HQd9
qw/1D3sj9ucr4qw05fHYLM0ys7/MMsvUJxP6iUw+4GYv/NPSGE8h5Hv65V0DEyD6ffvtt++M
/copE4RfPSj2eFDkhS418fn0OM59WqCnLJAztj1lyV6SI3ihCBSOBQkBa3bI4BeDu8AUgFRA
EgRjoHJOZgQ3stVpkDNIqjOAbAyGBi3pHpHGrIL6pLfXI8CSJTgGIFAX3gja2kk+HvINlGSQ
bwAVrMmRFrrRXV1AtUAOHFj3qw14Dbhkzko/9QIOBo6wR9iXbBu7kSdfPWwiPfSRz0b08IIO
gIS0Q5mk3rOAvuYr4b+O9VH4Pd/RP/zNpp/4hDR9rx/5ltn1kBVAMvqXj5IXNzTKxADNF3we
z9cT8ER/63t+RLZlNEj9KHgsl1CHepUNgIhHWfrRl286tsdLdsQD566p9vzw2XZATz6Z2qb9
jhH5NnqQw3ZkOVeH600bAd9YhoAfjyc7Znrjp3SVCRuwGT2cJ829BdiZb4qv+sGm79g3fICN
+RZf0Af6OPoPX/hGXAvK6Rs8cW3oUzLw81mkHB8K+fjl00GeY76IyLTRLTbpeJTHRz4e/h88
cS3gTUoL9JQFcsa2pyzZS3IEBQFLgBCYbI6lRYCYVdUCEBKUIvAZ2ARKINDAJcgJZu2BCq+g
pw6bwESWgCQ4IWnylBe06Eo/wI4svMiePAOnfOXwRn3KkkEWPfBGWXWSZ8mBNDLoTAflyBLI
ARpEDpJn604/8rWTLuyi7miX8vQEOOilTnWHXZRl12i/uvArB6Ab8PEn9a4F2F3f6UO21z8A
mr6Rxzf4iH6Vr0/wy9On0vW7AdsAH35Aa/ztpAy5yoX/qo8POOef9tLIIpvfhr8q71w6/yHf
NQG04nGs/tCJP+Gjc8hWRro6Q39y8UW76EgPhF+d8snly66n8GkybKGXclEHuTY25NPk2hCb
OQ4e8umFHEdeTch/c2WB6Jv2/uZb/EFfBukLfR/xDw9f0gf6Nfxav+pfZcMvyCIfr2N951rA
J03ZyFPOcXvfh450IdMW8o0x9AqfDl462ZwnpQV62gIJbHvaonMoTxAQJCIYxCBhLzi4YxZg
zAoJPgYk6fJjEOlaZXuwEDxmRrPKm1mZTE8L9CULtPt6X9IrdUkL9AcLdDcGdHd9yTd2IWOS
8wCsALKbsZh0MMPv2PhlzDN+4cEfY1pMEjiPvP5gx9Sxb1kgnxPN5/4IgOpCd5cNuHqk7S7Z
Olh7d95moKyN8mKJfMFAXgSVGTUjgsyM8iKtu8AWfLlPC/RFC3Q38PZFnVOntEBfsUB38b+7
60t+bGQBq0ApgGr21xc8/PDJas1n4nyz2dgF4LaPW8obB5F0crqrt6/YL/XomxZIYDuf+8Vd
qUeC9gKBlzGs0/T428VuyYAPoPvp2dc0n7byOSLU/ihoXprQXWCbF9lZNi3Q2xbIAbC3LZzy
B7IFuov/3V1fMwKo7TL/8Y9/lIuazzb6RF4subGkBcA1hgHBAWzJCnnS2uUM5D7ItvW8BXIp
Qs/bdI4kusONNUxxl2s9oDTLD/xYwj777FOBLcHSkYCAIhDUkxn8m1FgyoAxA0NlUlogLZAW
6GMWmFH8bldxfsdyY5axyDgUAJV+AVJDv3/+85/lN7/5TbnlllvquwfW6frGcoxfJnHwtsuJ
su3tzeO0wOxYIGdsZ8dKvchjltbC+liKYPlBLD0wS+tnZT26iWUHMbPr4/A33XRT+dvf/vZf
2nUXDP+rQCakBdICaYG0QL+zwLyCv+7Giu7kW0PrayHGMb9W57vgft559OjR9WsOxjbkx0EA
Wd9Svuqqq+qYdu+999YfxjG5A9DGcgQ62bqru991Vir8klkgZ2xfMlPPuCKA1Wd0rK11bO8n
a31zsPnGcM2LC903BX2A2894CgaCiWUM7dQ1UEVw6JreXiaP0wJpgbRAWiAtMKcWMAaZfTUe
mb2NLy5YUme5gYmZ+CaumV3LEIxrxjJfuzFpY2+citlfY5UJHDJz3JrTHkl+Fhja/Dzo4WmK
+WcBwFQwQC52wNbPu/qFI3e9LnYX+FlnnVWOP/74+kKZoCFd2bjLjRbMbiAIvgC+UT73aYH+
ZIHw4/6kc+qaFphdC/T1+OyFZzq6Ds26Arn2xjQzufFEcb311qsvQPsm78orr1xuvPHG+v4I
Xp8WM8YBs2S1y5tdOyVfWqDdArkUod0a8+EYMAVSLUXw2MYdrR8U8NO0voQg7eSTT66/547P
XbBPgAkkXYNeR/NJwGHTmyDTfOGr+XXwZmsShsQPBDSfZJnWfLNzWpPe0aR1NIv27fMzgvOh
17PKnrJA12ugp+SmnLRAWqB7CwCjxqIAtnFsdtbm/IwzzqhjlZ95Bnh92Wf55ZcvDz/8cH1J
2rgWSxbUmNd093ZPjllb4MVfH581b+b2ggUAW3e97m59CcGjmZ122qnWJN2nUv70pz/VmVkX
v8DgwnenW2l685H30pw32/AGtC7Q/D7ByKlNUJk+osGszQtmzd+U6ZPLhKbcyJELlqFTG97J
Tc6wJr+C29avxkQwEWRQ/LqMO+mYFRao8DmPQOYO3XnoIz3063oHLl0aXpu6gledyqpPurrw
2jvH7zjqYgvpNnZyY0CWdHJiTTJ5HpfJC93URV60S3572/CSGeXUETMR6lE22kFm6OQ42oyH
HNTO45xc+aFDzFZEW+1DDtkhJ8ra0wePfPKDyLJGmx3khe6hG9nt8qNc7tMCaYG0QFcLiBsR
fxyLHc7FHue2mJSJNHEHiT1inZjkZ3lvv/32GleVee1rX1t/IEiZxx57rMolO2RGbOyqT56n
BWbHAglsZ8dKvcgTFzIg5iL3a1Vma5GZ2Z///OcV8LrQgVqb4wBz+IY0wHWBKePLglOeqtuI
yeOaidoWQJ36XOuTKoDquKfHN0Gp9TO5zz7b+uEH5YEkQUj9+JBPjqlDfQITArzVLQAFwIuf
XFRewFPeTLMyePGRG+UCcAHyllTIV055xB70iXrl2fCxkeUXgqV68QUvXdVDR0Q2WUCeNVzy
ED3oR56y5EVZOsgnX13S2/WRH/bxoXE6hn5ka7P2qUtwV4fyeMiVL92vTDlXB34600Ue3qiH
nPaBJOQr68sZoTue0JtO2q4N0ulJPpn46YQn9KR3UlogLZAWmJEFxBCxRHxC4qk05+KRvVgi
3bEtYp2YI0+cEwd/+ctf1rgt3Qtmnj6KcREvZ1R/pqUF5sYCuRRhbqzWC2UED5ugAJgAOQCY
Lx8IFoIDcowCBFlSMHTqM2XxqU+WhaY920zQTivjO5rffDeH2+yHleZncSc3gG1oM6M7opkJ
bOZxJ05+ppnfnVaWa37wYewjj5YFFhpR6xWw1OlNVwA7AJC6/TRi1AkcCVjy8QpUAJkAJU/A
slZYnuAXcgKMqidemAuAhQ9FkIt2Rlkgk2425QFMdUW9dMMjLYCfPbInV3BVD/0cA3wAonPH
ZIa8WrD5py79Qk91q8M5fuvFyNF+JB+QpIM+pDt5dCPHMhOglh2csw9ZACf9AkjT0UChbNgv
9I82Aet0cG7DSx59yIy+Upd05/Rq96WQVZXPf2mBtEBaoIsFxAwxyF7MNi6Ik2KWWGOCAnk/
JOJRxCAxU1wSH8Uan/oyLliGIE7Klye2RXwjSxky7JPSAnNjgQS2c2O1HiwTFzHg4WK2R0DR
mDFjagABRoAiAQUgEmSAFwHHutoFp04rKzw3rizVMa4pOa080szgjhu6aHmuY1SZOsXbpc1v
gEeAmtbM7o5qZhXHTywPP/hQ/U7uUUcd1Ql61H3QQQfVX4mJgEZHPxQhEAFcAQQFK/raAC06
SgswShZdlRe4BEWB0LkgSJ4243GMnCuvDoA66jjwwAPrp2Te+c53dtaBnz3IswW/dLoDioju
MbsZoFI5drWxJdv6EsXhhx9edZVO57333rvqhkcwVh4v/bRF2+moDTEjCtQK4Pi1JdrgHNFL
Op1RyIhZ2Ajy+MnB/+1vf7usscYaZY899qiDAXuzGRnK46WPdoUfSSOLXb71rW+VVVddtbz3
ve+tfYVXG0OHqkj+SwukBdICbRYQY8QvMQ0gFQfvuOOOzplbsdDLzl4O88tilhWIKcqIQ4Br
HaeaNDfYd955Z5Uj3SZ22fCijEdtxs/DubZALkWYa9P1TEEXsos6gkGAMYHBG6UAENAkHQ+Q
EoHCutqOaU3AaALEypPGl/UnNluzX3XC+LJIU2bo1CZYDGmAT+1lj7lbwFl9Q5rj7bZ9VQFq
f/azn1XA8/a3v7384he/KEcffXR5xSteUYOTwKY+QQnRQfBC0skCptpBGcAUIA+PfO0AprTL
pj1Al2M8AYDJF0TNhu67776d8p3LUy4ee0VADBnybUiaGVT60UVdyikf4C+CNjk77rhj+cpX
vlKOOeaY8oEPfKDstdde9bNqp556al33TC4+epAFxEszA2uvDnt56gU89VWATzrRhQ50w4/P
cYBoNnbMFnQMEE1naWQbSMiMsnTC69zeOZlsCNDHwCKdfnQiVzvwJaUF0gJpgZlZQPzwtM5s
7V133VX+9a9/1dgnFtl8d13arbfeWmPhCiusUGMVefLFHTFNjBej/v73v3dOynSNP+KTLaj9
ONJynxaYHQvkyDY7VupFHoEDILFFsFAd8GIZgou/6+zeiy74BiwNb0DPUg1wXLHZr/jclOa4
WU/ZbB3TmjWaw5s1o1Ob2d0Rwxtg1XocD1wBXp846OPl5ptvLH/+859rsAGszjvvvHLdddeV
Qw89tAYld+h0AIjUGzOF9AW2BCx6RxucC2ahs2NtMXsI2AFp5AHC0WZypSPHwOJxxx1XwZ+y
9D3kkEPqbKXgCBSSFTOSykUGB9F8AAAgAElEQVR96qcz0h56o6jXcfCaNQ77v+997yt/+ctf
ip+AlE63L37xi+Ud73hHfXvXObnKahMd1IVXHdLoJIhrH9s4pq+65bETwEmOfPpJJ9OeLmFn
dlCHcxtZ0tQH3OKPOpVzLJ+e8oBXs8rS5YdedMHDpvRJSgukBdICM7OAWOxJj5eYH3jggTo7
68mb2Cdu+XSX79SarQVyl2mWt7lpFnfEQTHJccTkf//73zVdffJsXUn8SkoLzIsFcinCvFiv
h8sKAAFuXfACB/ADHEkXKAA9x3Hx4xvWrF4Y/lwzmze0mYltYsICzdKEYSObmdFmxe2zUxrQ
NKw5amZuJ0xsXgJoAtKIEaPKKqNXbdKGlmuvvbbKEqhCrjtwvyBj1vbqq6+unxuzPkr+y1/+
8tpqs5vSgC4AzIsBwBJ9/YDEZz/72ZpulvaUU04pN9xwQ9lwww1rkAMW11lnnfLNb36ztklb
tOPDH/5wfWnt4IMPrnzbbbdd2XbbbetygCOOOKKsttpqxVIEQI0dPvnJT1YdQwfLBgJsn3TS
SXUWYezYsWWbbbapgZgM7aUjGfYoXta74oorqj7aw+by6UYmMCjAH3nkkRUkSmcP7fSDGtru
szba7nHbDjvsUPksIWBP7QM0f/zjH3cGfTcRJ554YrWTfDY0AGibx32f+9zn6rFz+uj/WKPr
mF0Rv1EnIE4O8nUNdQOyF154YS0vna3cENgHCJaelBZIC6QFuloAUHWT7GXitdZaq+yyyy71
G7SXX355jY2Wb0k3flhna8JCnBQHxUdxKsYVN+Tim7gTaeKVWBpjgPq7nnfVKc/TAt1ZIGds
u7NQL+ebSXORA08AjIvfhS8ACBYCBR5pAIxAYB+gpHl3rPkurZe3mq8XTPfKWLM1x83HVpoX
xqxBbX3xAEgGaIY05+MbkARYojHNOl4gDwCKu2qP2ZE1VXQQaNZdd91y7rnnlj333LN+tsWv
xwh68n25wWMqSwesAV1zzTXL1772tSrXDCV9gdoDDjigglR1AYgXXXRRBapk0gGQ0y7LIwRE
M6jAqjRAjBy6sNOvfvWrCmrVt99++xUzAcAsHvnKA+FnnnlmrUN73va2t1X7mfWkQ8xaxuOz
mBWli2N9wm5kSQMUBXT6Wqqg7ZYt2KtT3dp+zjnnVFs4f/Ob39ypN1B7UdNm5b/+9a+XnXfe
uearB6i97bbbyvuamWOyzYR84xvfoHYFpQBtHKvrt7/9be0HvPvss08ZPXp0+epXv1r1ZKtj
jz22zqK8+93vLqeffnpdA0cf7Y42BQiugvNfWiAtkBboYgFP6MR2s7SPPvpojVEmPUwWuHk3
+WEm15hhHDNrKz65EY94Ku6YJACQI5aK6QFqVRlg1j4pLTCvFkhgO68WnMfy7Rd03MUKBMCS
veAgPQh/AJIG5pVJzTKDKUObF7SGN4+WhzVfVhjePOYeOb7ZTyoTpzXLCKY3s7VTvWSmq5u7
5+YHG6Y2h3E+fGjrpS1gR7ARlAQgpC6gS32WRVxzzTU1MAGLgJ4fkvAb4MpedtlltQx9gTR3
8vGygWB2880318BIPpkAnOUGwNhvfvObWtYjLbzRPns64Ufy2MQHvpF6EPv4ZTb5u+66a9VN
OqAo6KrT8dprr1153TwAtUBed0QmsgdIf/jDH9a1uNbeIrO9bghseHyr0Swxm1h3ZjZDOwB7
ZKkDG5kJB9rPPvvsakN5V155ZdVdG9kESGbD0EE72UP78QDZQYA+fr/X/qpXvaomX3LJJVUv
a23N6OozxLfIavermpH/0gJpgbRAmwXESBMBES8uuOCC+qSu+cXSsvXWW9cJhfPPP78CW0+6
TMS4CVdOTFQuZIg7YqEtxpUY58Q46caciHdtauRhWmCOLJBLEebIXL3H7KJ2QQMu9oCLi7w7
qvzN3fDT0xYvD/shseZJ9DMdS5TpCzYvWzVfQ5gytZkJbpYijGiOBaihw4eVhUctXG659faG
eUhZapmlK/Ajx1038GM2V1Byhy4d2dNHvqAkIJnpdO5u3MxgzGLixwuouttHsV40gpeX1Byb
7TVTawYSCYwAKGKD2CvvnB7kovvvv78zGMoDJkN+2BC/dOd0DVAnXdAFMoFfe+2it+NYihDg
DxAG6J3/9Kc/LYc3X0/49a9/Xe2EP0gdZKhPQFe3ukY3M6ry6BnLAdhYnmUDyBINNpSGBy29
9NIVKMdsh/ZZkkHWe97znrrRmw5kewzoZQ9pAK324rU5RmTTL24yamL+SwukBdICXSwg3sTy
J/Eq4oxYI77JF2vM7MozxkTMi/gm9kSscSyG+tUx8WlGJH4mpQXmxQIJbOfFej1Q1kUsOAAa
AI397JJPfZXmywdPT1mw3DR9mXLf5IWbn8wdWp4avngZN7n5+HXzFdvho5pZ3SnNR7WnNS9u
DW8el09qZmGbH20Yc/e95bnmZbJtttu2/rIZPQAiAM6jJrpYF0u3IDyCmaCGxjTLGMx+ClSA
qpfQ5AGFliCQ5UUC5fA4BtA8whIMLTmw5jWAoXVZHnl5nIXoIFAKmmSxjXJeZFCPGWM8ABsZ
dFOPgIocK9NuU/z0QdomCGsn2nLLLas+6tQueQIynT16Q9YFW/ZAD2RdWXxmqyY0/9QngNOD
TupjK+l0NVCEjvJihve0006rL+/RWzpdyaGnmwd7aW4W6AVgW6driUn7khWf3mEPgJmsaLP6
ndNJGoBrn5QWSAukBWZkAbFQLBJPxJlNN9203lj7uoEY7OmRmOKFY1/L8cRI3JQnRsmzORbL
Qtbjjz9e02dUpzR8SWmBubXA7KOoua0hy82RBdqB5OwUHNLh3qQBn81P6DY/KNu8Lta8PW/Z
QbMNGdJ8IaB+x9bj/wYgNW+WDW3Q8KhRC1QgdPR3v1dGNzOJ+++/fw06wKN1qB6ff+c736nA
RzBC1thusskmNc1MoXQvOF111VU1CHnJC9Hf43rrXQUzIFca2cCcNEDRfquttqoB0PIBZCYW
YFRGYFTOTK3AGOAXwAOGgTR64APqdttttyoDuA5edQiy5JABVAYgVS6Aprz/+7//q5/8opMA
Ls0yCeDRI37ngCCAq+277757rdsMKQBJtmBsr744/v/s3Qe8ZkV5P/ADgmKkKUFjKC5dQEFA
mgKuVFFAiiVRjPQqCFhi9K/hk3w+xkQpghBEBATsCgjSBSkKCBoVkCK9KBYUIyAiKP/zncvv
3eHN7t675d7dlXk+99w5M/P0mfPMc+ac933ZrE3gJ2+77bYrvvAKg9cZttpqq/KKh2TT+2ro
0JDt9QI0AE9y6eCVEMDn2uH7YJwPk7GLLHgZE3zzTjV+/Ava4lHc0P41DzQPTMMD4qcYZ3fV
ZoVY6HUrr0F9+9vfLq94aROngVenxHoxTwwCYo74KVY51ydOodEGUpZK+9c8MIseaDu2s+jA
WSV3QUswcrjgxwpeO/hL/20Hz+t3YFd/4vfdivM/3H8DwuPdrU/+vvvlfAt1v53/77r5/rxQ
/2GyPun6y8jPGv752f0vcy3Q79L1O7dXX3Zld+gDv+0/Tf+hbvLkyUWsYOST/vfee2+pSw7p
5hsQ/AyiH2+QOPrBBDuVEs1dd921vO/q0Tz9Bba3v/3thV7CBuxSCm5o7ZB6V4vMTTfdtCRs
EstddtmlBEavBnhvS9Knf7/99it88ZEU22X0oTEf5pIc4ps2+kpe6Zyk0u5r6vrpRw+JYoKt
D6p5D/XQQw8d6ImvVyzQ2E327QabbLJJ59sa8PMerFcH8Oc3fEF48kUtb//99++OOeaY8tqF
vssuu6zYSQ/fIWzHVjIbe7RZCBxZLPjbLopvh+DvvJ+MxqsMWSx8a4XjC1/4QvnuyBtuuKF8
mI5cO+d8ZIFp0DzQPNA8MC0PeHpmV9bNuydFPkDslTVxREyX4Pr8hK/7Wmqppcp6IPEF4hYQ
a8UbdXETbYPmgfH0wHz9p9vbnv94engU3klsfdBIcrTGGmuUhESyI6kaDf7SZ7fLPPJAt9lD
t3WrzPf77okFHutu6p7bXfE3K3f3PXfp/uNii3RP9l//teACf+6/J+HR7sln9R8u619LePKx
BbsX/e2Luwd//5s+kRp5rC4pEoAkSYKRQOSO3fuvHr9LlCSq2XGFQ2e6SrjgSuQELgFMu3rw
8bdbKBHMKwbkJQGVnKpHNj3whw8HPeAzPOkCR6KGH3kAvn6vVki+6QM3gVVCJzj7+q2U6NHh
TSZch3O0dKKDfvzoErvIpIcdDb8UloQxwTx19GRIUvlLyWY+AvjFdr6MfXD4ky7lmy16vexS
46WP3frpRg9y8dSHHzl4ATqwCyjbIlNc0f41DzQPTMUD4oldWK+IufEX3xK7lGKN+CMG+zwA
sCmSmJs4JnaJRWKU19auu+667vjjjx98oDifqxDHxCVyE/emolZrah6YrgdGVrjporTO8faA
izngwh879I915u8Trmct1N2zwCLddf1P6DruXnDh7uFn/035aq/uif6nXnueBvrxx/vvtO3f
vF1ooZFE6pe//lUJIgKJoCNI0UUiJhCpa0+Q0iehgi9ZEnzgJhDpF8iAc+0SKXf2gG34Jdgp
8dCPT+RrQwf0OZdICqCSP/oIpErBT7CFkw8wSJ71e49LW4BO4S1QS2aVsZM+zvENSCTJyON7
7ZJGfkgffAefkMF3bJV4sle7fjbo45fogh9e2smxWLCT3cr4H7/4Aq5zEH5o4dONTeRpk9iT
S2Z22PkgOhcm7V/zQPNA88BUPCAe+Q5bh00XrzWJSdrFEDHON754micWSWrFHfEqa4F4I76L
eUAfnNQjVnsNw/11XztvHpieB9qzyOl5ZwL6XLwu6PqYEbF/7pOZR/vvpv35cxbtftf/vO6f
53+8+33/AwyPzvecPtHpvz9wgf4F/v5HGh57/I/dIosv0j3y2MPdY3/www/9h8uekOiNPI4X
hASpJJcSpyR6deKaXUQJY3YYtWVXkD0OQU8wA84FwySH5OCdAJidTz6Ah06QREcf7QlyaCWx
gqV2gI9A6z0wySYcsrRJ5rSRxw6HBBAPsshxjgY/fCWHSV7h1HrpT6DGh4540sE5Ov3a+ES7
Nj6SwDqXaGbnAw09w1M7HHbjET3pTxd86EwnJVo4cPHFxy60czTGKb6MH/gsesav2ho0DzQP
NA/UHhBHxRYxxSsGnnL5vIV4KdY4bCD4OkjxTVwS0xLbsxaIXeKRvuC02FN7up3PTg+0xHZ2
enMmeAkAEpP6gsdG0iQAKJMgahcMBBOwYP9zufYW/9i/Q3v/c5fod2UX7Wt9Mth/aOzP8y/U
f1Csf/T8ZP8Cfz/Kz+qTRb881n/JU//OLf52RH134MhdtMATmX1H0Yl8+nmPFCQgKeksOQLo
0LMhIBjGJjo7YkeStrSjdR6aJGrhRYfYDE8d0CMlmiR22uCQj3fkaQ99rWuSPP10gCMIxz7t
gJ0B/OFFB+cgbcPjVvOTaOYGAU1sQxOZ4VPbATd82RQe8Uf0w4N92uEpHdHReXDxbNA80DzQ
PDA1D4gVQDxx0+0YC4g1dbwRn8V/8VW8w895DcFPm9g63Ja+VjYPTM8DLbGdnncmoC8JTy74
JH+SExe2wKJMMNCfxMVFL7f7c4/z8LNGfh62VrkPC332l5Z+V7j/zoSng2RsgPD0rlZrHmge
aB5oHmgemAUPWKMktXZ43dBbv6xnNhwaNA+MlwdaYjtenh0jXwmtC90drCCQ3bTUlfr1OXeA
nA/f9Y5RbENrHmgeaB5oHmgeGFcP2ITxdMhrWTmX3Ep2rWkNmgfGwwMtsR0Pr84ATxe5XVsJ
rSTVB5q0eYScR9RJfrN7m4CQR/gzIK6hNg80DzQPNA80D0yIB7yj691+a5kEV3Jr5zZr2YQo
0YQ84zzQEts5POQS2HwAyM6sD/tIdCWzvqNUEpsjCW52bdX7b+5q0DzQPNA80DzQPDDXeaBf
0vrdWQmtb0XwpNFTyf4zGo/3nxOZb/jVuLlO/abQPOqBltjO4YHLYxl3sBJYO7b5UJC6ZNfh
jjf1ktA+9UqCwNGgeaB5oHmgeaB5YG70gKQW/Kn/ISHrnM91+KBv+wBrcUv7Nw4eaIntODh1
RlgmSbULK3GV6AIXvVcN/DyqIABPmxJk17bd9RZ3tH/NA80DzQPNA3OZB2zISGY9hfT92r7a
0c97p30uU7ep81figZbYzuGBdMH7xKiE1Qv1goCkVVKbVxP88ovXFSS+AkKSX6q3NxHm8AA2
8c0DzQPNA80DU/VAv2T169hI15///GT5BUvr28jO7VRJWmPzwCx74OlfJDfL7BqDGfVAXkXI
TmxeN3DxS2wlu5JaoJ6kFl6D5oHmgeaB5oHmgbnVA0lq6Td//wXqEtps3rQ1bG4dtXlfr5bY
zvtj2CxoHmgeaB5oHmgeaB5oHmge6D3QEts2DZoHmgeaB5oHmgeaB5oHmgf+KjzQEtu/imFs
RjQPNA80DzQPNA80DzQPNA+0D4/N43OgfdvXPD6ATf3mgeaB5oFnhAf6r6/s+s+OVMczwuxm
5IR7oO3YTrjLm8DmgeaB5oHmgeaB5oHmgeaB8fBAS2zHw6uNZ/NA80DzQPNA80DzQPNA88CE
e6AlthPu8iaweaB5oHmgeaB5oHmgeaB5YDw80BLb8fDqLPB8sv+iCm8ijZR+gEF95IcYpvbN
tY8//vhAmh9vGAv4jtyJ/A7BWlbOoytdAvPiTyyyJwc7hu2LbeNZxm/xqXqtR3yc/lrfsegV
/inRhKfz8HUOavkjLdP+Hz2VNZ16LWNaHIZxUq918iMoAM+0w4vsafFOe+wOba1ncEYrIys8
1NMW/r6zOpC22FNf58FJX+rjUQ7rGP3J0jesQ10PbcrYhLbmoz4vQ+yKTeqxeax2hQf82q+1
P8Nf24zyD9/oMzP0oZ2ZcmQNy7pmTRs5ZoZXo5m7POC79afMWSllP7ZP9mPdH/PN96xy+HEO
7b6vH64fUH3Ws3xCyPo/taNvfhqM8B35Iq/6/GlIgwqMBvOwB/xCWQLe8K+5JHjpt2hmcTS5
/NjDRICATZZSQE6gzg9SpIyuKf/4xz9OhHqzLINtOfg39hmL+HuWhYzCID7jSzIFmowvPbTD
iU7O0z8K60KHn/FTxiY8JYyRXfMhB/86Uav76/P4S1nrbc5mbtT4w+fB+cMf/lC6wo8Ogec8
5zlPu0bYgm5GfIAXmmH/Rsb0SjSRRS9+UWejg93g2c9+dvGz8/g6dOp8DR84j+2lYZz+kZ+x
Md7xq+szNhD96KOPFg2iU+aFsrYBEn74xJZCOA//i60zOz/4MnOAb/gLL/MEb/On9r3+2vfT
cx366Gfex+e5TqZH2/qaB0bzQNZ1c0ycVZq3z3ve88p1br651v26qnkMH8DJ+WgyZqa/JbYz
47W5jEaQM2kCOU9AM7EsmpLggL4EubSNR5kFWSlYZ2EUWB3RgQ1wlCb8Qgst9DSbxkO32cGz
vljpH/skWrW/Z4esafEgx3jynQPwbR08LIza4BoHfs/8mBZf7eyDxzbjEpu0CWTk4RdcMgLm
3GgQf6VMsBuLbnjDIzO/zkdPkEQr1wL+8PCPrII4hn/T8+9o5LUdfG4c4sPoigc8uqUNLjz+
pXfGlu7w8Mm1M5oOs9JPRuaL8c4Np+sTRF8LF6Brjuis3VwE7HTgO6PjUBjMhf9mZX4YxzrW
8V3A9cNHDr43lzPmfDgW/2X+4ElPNGQo8RhvGNmpHW8pjf+c8oDr3pw0z6x55qn5/NGPfrT7
xS9+UeaaOe76T5/49bznLdLTTNl8mKJ/dmOntIycZVd3uH3q9ZbYTt0v80yrBdzCk8VS8Eui
oUxiEoMEswTPsQTG0M1smUmvrBdjsqMn3iZ7Fr/oF5tmVvZE0NHR4s42emexSKI1ETqQIbCY
C0rAtxbG+FiwcZ6EL+NSkKfzL8kpfHYqATnOjZlz84wv+CB9GcfpsB90ZceVDDzHOvZksSt6
JfFKooVP2owN3OhH57ECmqn5dzR6dLUtgrs2vjHncw1qc4C0synzKe18w0d4hrYQjdO/yIhu
tS1Eaq91zHxDR3+2ADqD8NGf6710zOP/2DUz8yPXF7+aE/yk5DulI37iW34b9vlorsuYGAvX
QuoZi9HoW3/zwLQ8YD6Zs5m3YoF5przmmmu6//3f/x3MV3PaNWI3N/F+Wnxntb0ltrPqwTlM
bwEX/IBJlgUvwVBdAIOTCSewTVRQE4jJVVrUlfWCpy7BcGEI8vRUopkXwAUsqY1ttV/rBX+8
bIkMPjUX+FNb/Gesc06HzJex+th44I0vSOmcrer6zbMkXfrIzQKqPj1A50aALHMhi/30aIb7
opcEHh/Abr7Ijpg5Fn/Ap/NoMJp/R6PXHx5KB73oEZ35zxxSV9ITqOfaVc814lx7+KqPJ9Av
sugUv2ZuRBdjB1cdwI0tGRPt6Z+ZcUY/N0H8wu6pXX+j6RpfwMv1giffqes3fzM/9PGlvsge
TYZxQWMs8AJox0o/Gv/W/8z1gHmY+ZWEVVxd4FnP7i44/6LuvHMv6O7/+S8HMX3BBZ/Tz+Wn
v1oz4r1p7dQO+3ZsO7ctsR322zxYN7kELkFLkmDhsWgIXCYdgCOwKQMTFdjq4E0/QdsR+c61
gyyAdGXH3A5sk9SypT7i9/HWP/6KL9UtsvznXHvtf32ZA3BGg8wbdMZICSy0+oxdZCZRUScT
zlggCSafOUfvPDZNjwd9zJPMe7j0UmcfPeDgS5+a71j40wUEN7bGv6VzlH/hEX2U+IUnH2oD
5lLt47AOLlvZwMaJuD7IoJ+D/9RjR8Y/OmqHF13p6QD6oq/+7KKHdl4tM7axeUbnR+iNeXax
4kNtmb/mBVx1B3nKscKwfuEzVvqG1zwwNQ+Yl2Kt+eSatkHxyCOPlPn54hcvWXZtL7vssu7O
O+8cxDZzcYkllngqHkzJR6bGf2bbxofrzGrT6GbKAwKepMLksmuwyCLeXxl5RPurX/2qe/jh
hwd84SaYwhlvuOWWWwY7Y9EzFwL50TP6Z4FPYjLe+s0O/mywaMcWPJOszQ7+0+MhuQD8JrCo
R7bzJBtJMpM0oanP1acGSUwstsZIefbZZ3eLLrposZfNG2+88SChISc6CXpjATzyfhb86J25
MD0e9IFHNyV9v/Wtb5XrAF/H5ptvXtrpwzd5TSTXwfT4xxa8p+bf6dHqI4OOOedz9SOOOOJp
yam2c845p+jr3PynL3yyLQYO53xvvmWcC/Nx+kdeElL6qEenT3ziE4PElZ8BG+hvcaOfAz4e
4aX/BS94wYB2nFSfELazOj/it0033bSM61FHHVXG2fjzE1DmusqcNhdCO5qhuW7RAGNyxx13
jOn6H413639me0BMlHO4vpVJbvNk4PnPX6y7+OKLu2uv+UF35x13l2vefH788SmvKfURfyac
OP2d25nhOBNKNJLx8oBgJbhaQAVDi8hvfvObEhy1vehFL+oWXnjhgfg6ICbQDTrH4STBGWuB
mE5ZkF0M6lMDwXheAIk7G9kkqYp/2TXWhWdW7IwM4y6Y3H333YUdPRxJTJNk8mvasihPT37G
ij1kHHPMMd12221X3pWKjFe84hXdhhtuWNhEjrk4FsADSDbxB8p77rlnmnOjID31LzThc9xx
x3Uf/OAHC4/ozN7999+/UGgz77TVc7PmWZ+P5t8ad2rnfJybCrzIPPPMM7szzjij2JdEkf7/
+Z//2V144YWFTeZ/xggt3YHFA11sLo3j+I+s2EAMuRJYdmTea6fjv/3bv3UXXHBBeY8u8ww+
HiCxyrt2Y/F/IZqL/83q/Aj95ZdfXubkgQceWKx1HZmnGWN15zkyL0ZzDfxcI3DRaVOOlcdo
Mlr/M9cD9XxyTYtb4pSNin6a9XOs65ZZ5u+78847r7viiiu6Bx54oODYbHvuc583bo5rie24
uXZiGAuMAiCwyAha2ZGysJh4t99+e1nYJR8WmEsuuaTbZZdduo022qj0S87uuuuusjAJoHje
fPPNhedtt93W7b333gVXuzv9wJ577tkdffTRg0RJf3Yc6PHJT36yyHX+qU99qixkFjPJkTa6
kFcvmnir0xk/+islOuzJ4p7Hdj/96U9LP14O+grkkydP7tZff/1BULerqA7ghG940wdvi3L6
lCC66M8igQ6f3XffvbTBZZsSDj+9+tWv7vbZZ5+in7E58sgji91knXvuuUVffPCAe+uttxZ5
+QePf+EIGPjzb3TAQx+7JbXa3/a2txXy2KAvYEzDS+nxEJuU/LPHHnsMdLUbF4ADn/x3vetd
3Q033FDsNO/I/O///u/Sd9FFFxVfmS/40YGP2IU+h7FEh685gq8+uh522GGl/o53vKOI184P
Evbg4Zv5qc28gEcfiYEPLaDRBvc73/lO95nPfKa79957n3atGFcy4TpAzduY4MG3u+22W+l/
61vfWkrjyQa+g2N88HItacd733337V71qleV65EPtINtt9226JRrCb3z7373u91rXvOagsNv
2slJP1sfeuihIou+ZJMZvgjhuibId31/85vfLG3aQfRVdx6gN9vj45tuuql04aUtibYxI3Ny
f31deeWVRQ4djYEx4vstt9yyjK1xJqe2gQwH0MduJb5A0k6eeEQn/rMoRjdy+IYO6OAA/nCe
diXd45uML1w+wS+6acNTPBMj9dH9xhtvLDjwHPEXXe24x1dkuU5B5m341/7Gg73RKTZrz/wx
h/FCr03pmtcePZTDMK3xg+e6RIPXXnvtVfR24zk1PsN8W715YCweMLdc5+apa801ETBdl1xy
yZLYfueKK8vOrc0263zmNHqA1rlrJG3hMyPlCLcZoWi4c5UHBCiTSIJoUTBRBEyTJoGRwsce
e2x3yimnlIkzadKk7tRTT+1OO+20MoFMyOWXX767/vrrCw/Bd/XVVy+B3ELy2c9+tjvppJPK
pIWXwHzIIYd0n//858+vKRQAACAASURBVMuEtoiAL3zhC4PJ+qUvfamDY4K6m6OXhOSAAw4Y
BFX86a6kh4mtvsoqq3Tnn39+kXXfffd1L3nJSwofvNgmeYe72mqrlUfP6L///e8XOguOx9ES
ErpbhFxw3/ve94qOK620Ugn26NmKt35y7Eb+6Ec/Krw//vGPD5JjPia7vtj4+uSTTy5tfJ9+
7XSw8K+44oqF13XXXde9973vLXZLciQ3EkQ68DXdndODn5xLXCVqzj3aNT4HHXRQ4W0h3mab
bYo/+eNjH/tYN7lPNowpPdCED54SlXXWWacs4OqSvBVWWKG7q08g+E7ypx+dBf1DH/pQ8b2+
2GyXTuJFX3OAT9hJDvo88j/hhBO6r371q2Wc+PblL395d9ZZZxXeEi5tGSPzAy+HxIiPgGQZ
0MdhzvIHPP5bY401Sj9bop/5wl9w6B3gHzyWWmqpck2k3bUDN9cMGnOPXebMqquuWvgY2698
5SslITLfQa4714NHbXCMJ9/EJ3aPXXNw+RrfyKQnf9KL/nZw3eC4ZiVD5qi5yT5184jdXjOi
Jzol/QNwyWaDMZEo8xlcN1Xs/Md//MdSd6P5lre8pZDSae211y72uU5dB64rvOmhjBy8HGTs
0t8cSxKBa5cNkkNAdzpLuOC77vngJz/5SemnJ33YwH4HGa5Zurtx5Ytrr722+/KXv1za3Gy5
7t/5zncWvxx++OHFZ5J9vOjsNRnyyHnZy15W/FEE9v/YKWF94xvfWJJe/vr3f//3cgMAx7z9
+te/Xl7dMlc8ibCDzifsiS8k2h/+8IfLmEeWeYyfOMkW7ewxP9wsqxtHPmA7gAf00Q39pZde
2r373e8u9qq7bl3z5o761GB64+ea2nrrrct1T47rhl7OGzQPzC4PDM8n12P/V+BPf/Kq5Pzd
C1/4gvKUxzrsWhBDnnhi5Amaue0YoZuvPPGpX6GcUT1bYjujHpvL8AV/YGHNe4/aLBB2nCwS
Fo/Xvva1JTBnUbQT8uIXv7j0WwwsqhYCE+vv//7vu1133bUkI/jY6RTU0QIBWbJg4Ydvkt7V
J0h22yxEwGPKddddt5vUJyTgfe97X6GXsNoVkZjVgdrCiD9+Fkg7ZFtttVWh9aK5nYZvf/vb
pe6CABIDi+tmm21W7LAQ2SUjGx+LjN3D97///SUBR/ONb3yj22+//Yo/XIzLLrts4S0JkOyz
WyIGLFYuwiwEkkt8QRYnOjvnc19twt8ONNolauzkK/pZWPmbfS996UuLzeRILNhlAcuC94Y3
vKEsQGTwj4WbzpIFCQtd+ZOcgw8+uNwRkwWH/PDBU6L/pje9qZvUj4f2pZdeutgtMdHv4Duy
lltuuW699dZ72m4cu+FYmI09mewkDz90SonHWmutVfwK39MBerIFSGqNyemnn95tscUWZd5G
V2MB3AR4Xws9kBQbM4kzGXT4h3/4h+JHOHSRfJiHEiK6Gg86Ab4DaPkGjaBZv6KjD15uUIzN
5z73uYEOXu9xIxFe7DaOXnGY3N9Q8AUaO3bmJbBjKrmjH/7AucPcduNHV7T88eY3v7mcuymQ
3BgjvpnUj5nr05hLYtiAXw51+rDLwQZ4ziWwzvFTv+qqq4oMY/DDH/6w6CTxovfrX//6wtPu
isTbjQL96IAWOE8bfZN06qO3G0Mg+TOfVl555bLLbJ4aQ/OQPnSv51H8Xoj7f2IZPHad3N88
stEcJ9+HUYAbZDvEkn02SHglcYBc9YwFnR387MmEhNM4fOADHyjXjWtPnHv+859f5jD9/+mf
/qnMUX2uiV36WEOOufzb3/52MBfMR/a48aAnvmyzU8oHYi8wv/nAvDHmAbYD+rlxxAPgaU5p
l6gbg4yDea4fTG/8xDs60BE4xyMxtDS2f80DM+0B83hkIybz1nwNmMoLLjgyT4Vj15E4cdWV
I8ntSJwf+XyQb1VA60bV9SMGTBtG5E6rf0TitHpb+1zvAYE+C7jF2kLgEDgla4KfQ1IGTD6T
R3CTtArCcC08+tAKehIb54KuEsAPPRwLjx0PE1UAtZjYsRFo1S0AZKGBKylQAnITpPWDJA2/
/OUvuxNPPLHQarNwHX/88WVHLLqwWyJjRzb2KO1M243Ef5lllimJhwXOQsZPPkxnJ02/w4WF
t0VeAi0BBeTgByRJ5LnwABvU+S0JFBsWW2yxYhO7gqNdXSmRkoCxac011yz0zsnC+8EHHxz4
OvyVr3vd6wa+IN940l2ijG+SSn3qDv2ZF2Squ9FAyy66211Up6u6YEIf+pKrD2gD+Eqqsyiq
hx/+eKAzT5yTY5eZv9GoS3yNrXFQ5z8JoPMciy+++EAn/HzRt3HFN/LchPzsZz8r85NuxnHS
pEmFBxw2e28RT7op81ievzMWsVF//MUfEiRzu9aJHH2A3nbDvFbDX+xT2qG1K01vtMFX4k8X
IIl00wTXrhz9JUB8ykfmK7/Dx8vNApkOwL+ADHId+CdZNJ+iAxr+wBu+dvhKcFd/U/rpT3+6
9NGDnz3+NtaAv8hzRD69+EiibDeTDXwp+YfvEFOUrl+yJfnhQVc+w4edZEY3Mt0kRhbf6cOL
jNgem+G7UXYjC88BTz1PkvAgR7sbxNhDLwdfkMd+IElNDNKGTqyxm00PuHlVJXM7PsdLG9me
PMCNrebx/fffX2Tknz5jTic2ARsPsUW7RR7fHPADo42fZCLA3xtssEGZl3g1aB6YVQ+4fkDK
ml9/KfbzWAwZKeUTbthtVngtwXVrTqJNjBKbZ3VutsS2HoV58NykSDAUQNVNCkHRIpcgrA8o
9f/+978v9QR1Cywa9AKpR+P4mmQWBAuRdjgBuJv2n+a1Q/rjH/+4JGsWZHWLvnft4JDpSOC2
UJjgZOMNnJOhtKu38847l3M2pD27TmyCJwn1zmfq+FvA7OSw0Y4JvSxIdrvYY5da8o0m+HSx
G6T0GB7AJQMOGwLqbNFvsQvkQqQrYGMWpuC4ubCIkU0v9OjwYqeEjkygze6WBcwjV+14Z4yc
e/SNPj50rl2SQIZ2utPFDpPFOoCPnVFAj9rO+LMea7yNp5ulJAuh1Td58uTyuJsdbIwf7H57
z1gdX/PObpM2Y0JGXpFhY+3z6GRhtmOf5DB4doLZSj5cr3d4l5af2Wxuaofvnd/4id5JlvSD
+KvGsZtXyzIOgm9wzHVzzQ4DHdiutNsJB09zBQ9l6LQDrzu4Aby0f/wsITTmxss89DoMoCd6
8yU+hMNv8MkLaNPH/3yAThsemY9w63mrPmnSpLKLCZ8NDueeJJCJHxqHdpDx9YqDVzE8st9h
hx1KH73gupacs5ce5k3oC+JTfPBKe3xWzyG+A7FXPTT4AjbYDcXHwS/GynUdnvDc/NMDL7QO
urLZvAR4S37tbuJlPDKPvMPuQzDoMm/JIgNvfOHyuadc4YF3dDNvyUTn0J4dWH7U52lB8OnE
FmMLlPoyd9luF1rb8PjBF4vpE/DaEP3DL+2tbB6YWQ+Ye8Og6bHHxF/XlOvjkT4O+hDkyBOZ
L37xi+Xm3gbVAgvIXUbWK3PV/EyMeTrf6e/UBnfKypyWVs5THhAYBTjBUHAF2oDFQfCqg5rJ
YpHTl6DqkaKEIB8usuOpLlEQ1LOYJ5CGP97keoVBwuMVBu/w2f2xm2Nyki3YRkf4v/vd70qf
fjqnLEr3/9B+/ql3GeEDO8gWUWDxcEhWPGpFTyelZMZuE90kC5ITj1Sze6yNfgnqLkgJmyTD
u3fsluQDibGdk0n9wiEpsVDTxysXdlyBR3zk0idAFzaDjAkcPPhhxx13LAsXf9PDY88sNsFB
Z7fTKwuRlQQXX4987TQbK+Dx5iabbFJ2YY0ZfdiWsfKomV8s6nSQ5NrR8hoHmfEpGuf0DdAl
Y+2DLR6PGtf40BgYf4kQOvLNL3L4lr/NO/ja7Uz+13/9V9npk+BKACzsdrPQSxS18TU5Htuz
FeBBR69u2FFjH7zoy0d2zgE87WyWjNArbZKjyMiuAdvsgtNRoiCZxp8dfIBGos4W7eYpGjt1
cOhmZzXzLzrRhR2ZC/zrmjKGbgIFeNdaEivz0I60HVMy7fCZl/yQcSVPws929gG6uE7sdua1
JHLxAORHTz427oAd5OnHT7vH8n4W03nsDT0aegBPE+jmlQSvusRf22+/fRmzu/rdYH5gi537
vKqA1lh4yqPfKzpoT+5fO/AeqDay6RO/0SOQOQqPTa5v84e96uhcD8YCTniIT/Bcy+SJDXYw
jbmbJEAuX8MD+BkvTxb4yQ2h+eGJECAD8LndKPGVz/nVji07zQ26Te5vAPkriap2ugJ49DLv
zE368Rkwx9gAB/BF9J3e+LnxJy9zRJwDmROl0v41D8wGD7jOHMA87S+b/rpyAzdSd12JO+KT
uW2TSQy/sv8sSuKUG3JzHX14zYxqLbGdGa/NRTQCo8NEMHFMBrusmWReCxDETJzgWEDhJqi+
8IUvLIlO3pmd1Cdy7qKycJpoErUsZngLzECA9SEUuxD4/d3f/V2Rs9NOO5XSY0iQ4O1cQB4O
1NEHbwHco03n6JQSPEG6BouRBA0/urFTUmDHDI2dWQuvRcq5NiChzMJILv29K+kdOLuIFhW2
oLv66quL7yRMeQdZn+TJgsd+CyPe2RHlZ681KMnJokpffnQD8LWvfW3Azxh5rGnHB6Aj4z3v
eU9Z2PhAHUgKJbEWUIsyXcmWVEguQb79IgmbNuNiTCWldFJKNow5G8h0AHZFZ+exQZtElL5s
iQ+9iqLPYQxCm7GzWGtPnb+992w3K6+FmA9AQuUVAiB5tWNNbzwyv5W77LJLeVeXX9hPJv19
0CavHKQvr9mYG3DRx2YfSJJc0U1b9PdBIgmMugNv8y/jbc55BE83POmvlPCYf64PdSCI41GD
5Mf1ZT7Q3WP6PF42pm5qjA0fm5fGkh3AmGQ+mJd2F8kiA77r31yi87BcdqJ3XbIl4xv/Zowk
gL42zZymF3n6Ijf+oxOZ7PHVgmyF5/yuPqlloz46qrMTbcYGvtc5JvUxBx+xydziE7qxCw7I
+DvX7kZFmXnrJg9teNtdNWap40cfNxNuYNglKXSNk4FPZBmXjC16PvVet3eTHT6kiZ6t7PFu
LL5wJeb0MH/slsan/CDhl7jqB2gBO4C5Y+6pGztJwOQ+GXbjwD+hY0t8pH1a40efH/zgB+WD
ofh5yoM3P+PRoHlgdngg8ze8XEv9Xx8Hn+jn2qPdXf21n/hhPm+55VZlXttwMS/hjyS3C/XJ
7yPl2jK/p8DYdmqDP99HPvKRkdUsLa2ccA8YVAuIYLP2Ouv2n7j9f32AlVDM3yd4ko9VBjqN
hL+R5CeTSTAWwFKaECaRAwhgzskZptE/tfa0hTZ4ZAikoO4rDdW/0OdOLEE0OgnoFiqQ85pf
fY6XOhvhkq8tNuHBrshkvzp8kPaUbEAbGvjRJXKV8VVKeGQPl/F7Edb/Qwtia6n0/9Luwy+S
Bu8nAouSnUB8a/8Oy4EbfzoP1HaxWT18IpMuwzalHvvU41Ntw/VhecNya3zndElb7XN8JA5Z
pNXhwTEOSpDxU885nziPztGhEPT/Ii/19MdveGnLHIZX889cTBtcR8Yy/IKHPuOUvuiQdjjT
4pO+2EMuiO/QxXbtNU9yQHRzDl97aKJL9NUP8MmcV695waEPn/GT81o/55FJ35zXONE/fXg6
Uq/tqH2NR+r0it7wAb5w3DhIFEFsDM/oXzr7f2lPXYkGXu0nfIdtqHVBF14pI0s9uqUNfn2u
DqJvyszN8EwZ2hovY0bP4IWnkn9Dhy/82FTrCDd4zscL6uSid3e/qXBLuUGT9NvN/s0DvyqJ
jZtLQCc2xO/qDeYND8w335T19uijjul8VuaJJ0Y+I+Fmzw2sjSZPQW0Gucmc/1lT4lXG3nx9
7LFHy4aVOTsC07oJG8lxhj009dZhrFafqz2Q4JzSYpQFhOI5T4DTFlznU2tPW2iDVycEdZ/+
GkKfHSO4NX4CNJqc1/31OV7RN4E6/foiKyUdg49/2lPqy7ky8uGGr1Jf8PTF9uGylhUe4WNR
CmhTt+vqkXX4S2p96lk9vAT2YTn4xJ/hqYyOoVUPLZnRRRmZ6FJ3DoIXfsP1Eawp8oIXuTX+
cJt68PGpk1p1tBkHuKHXV5+zq+ZTn4ePMpD++A2v+CY4Nf9aB/3oY1fqyuA5D7/ICn7a4UyL
T/qUgC7RB5+cj/ROkaWuP7LST05Nk/7oq9+ReuhqXvoBn2lPXRve4Zl6eKqDyK/x4NT12jfB
j5zU8Yqe8B3BSVILJ3zDMzj6QNpHaiP/0dRy1Gu69KUMbXilDI16zlOiqc/DI/qmzNwMz5Sh
rfG0pT14+MIJXvrxzTmcWkf1uk99PMBMymbMePBvPOesB8whX9lV3pGdf8HukYcf7Z7z7Of2
NybeM3+87NR60vm2t+3c/fM//0vBPeWU07pLL718cG33U7e/oXFD7wOqNndGNq+mJLVslKpO
7dD3f6Eltv/XJ62leWC2eSCLTRjmYvXDBO5QHXalvBrgfCRQjOw4h6aVzQPNA80DzQPNA3Ob
B558cuQHbP746MhnCPxUttdnbFz4Nhvv/PvaPK/f6fNajK8TXGzR5/evW418p/V42NQS2/Hw
auPZPPCUB+zQJoHV5N3MPBJUl9RKfrVlB8XOynBCDLdB80DzQPPAvOQBLxK0lwnmpRGbMV2t
Wd51X/DZ/WsI8/2l++Njf+gWW3yR/jMoi/Yfel6j/BLm3/7t35ZXCzbYYL3BtxiddPJn+1fx
Rj4TMmMSx4Y95aPcY8NvWM0DzQMz4IEkqBJXSa7Hg3mEqM2j1rwv6PUDia7kt0HzQPNA80Dz
QPPA3OwBiW3WOKXPTljffPg0mzo+ZOnbDpbr36n1uaEH+veqn/OckW9mGi/bWmI7Xp5tfJsH
Kg8kmXWxAwEhbXlfUJukNh+ckPgGp2LVTpsHmgeaB5oHmgfmuAceeeSh8v3r1qrHHx/5sKL1
6y9P9mvXgiPfs/3gg78tX4X36KN/6Hbaacf+FwH/qa8v1v+q3+bjpn9LbMfNtY1x88CIB7yK
ACSuzn0gRSBQ+uSy95HyCWZ4kl93vy2p5Y0GzQPNA80DzQNzowf8BLUf3bG2Wccee2zk2448
mbSO2ajRZ32znjn3tXk2c/rv7ikfFBsPu9o7tuPh1cazeeApD3i1wMXsAClzkQsGcPIJZomv
1xMEhezuPsWqFc0DzQPNA80DzQNzjQcefvj3fUK7YL9+2Z31409+Ot0v4D3ar19+afJ3/XfS
9q/W9e/f/vkv/fdXL9B/z/4if9M99qdHy7o3Xoa0xHa8PNv4Ng/0HsjXFXk8A+zE2q3NLq7k
NV8pBEfim7a8u1QI27/mgeaB5oHmgeaBucgD2aCxZlm/rFnOldY1PwTjWxKc54PTeQ93PNe3
ltjORZNkVlSx1Q/s/plYQAJVg4lXt6k7AnVffY5noD6PnPwKGZyaLjTK0EnoQkd2zuv2JH3D
JT5pi73aQPikrPtDkz7409I57Wjgxx76h0/68AHw6r60lc7qX3wgGIRvAgG07OZqq8dFn2BQ
6++TqCByh/HTF5nqcIIfO6NHeA+X6ILjPPR1m/b4IPRpUwY3fdE1Y5T26JqyxgsOfiA8ndd2
qQe0T40ufPGILOexDU3oUtbytIWOrOBErjLj49zYBWq6tEXu1Pqia3AjKzTah8/reuhmVzk1
HYd1iny6D+s/rAfcGj/9oQvvzBW4aYM7rE/w4IRvjVOPc2SNVkbeMJ/Q1e3RWx+6YdroVOPV
c6XWO7jho163sSV8Uk5PpxpnmFf4pozeNU1412XNp8atz2v8dv7X5wFzxdplXfvTn/wa4MiP
bGh3bYy8liDW+mCZlNO1OfK9tePljZbYjpdnJ4hvFlyTR1C3Qygxyl2RNkHGJHPXZPIBAUnd
AfwEZ/rwdG5Sos2jcXjOE4hzx0U2fD8yEB5w8Yl+4UEPdHiQ7TwXhotDu58P9SMG2kESPufw
JWVk1sEzi0utE3ry4Sn1JRB7x8cvvfmePT+H+vGPf7zI1k4HMuGzJ/LQRn99sc15rWOtM3xy
2Epnv9keHvTCMz7DJwAHGEd4XlnQH/3xgkOufvz5IPZq08fvaPTByXk+sEZ2fGOuRIfYRA4e
d/U/iQjI9Ct52tDi6Sd2gx/68EyJVl9sVs8YhgZPvlcCvOkEDw5eDhDZbHRuzrANxHcXXnhh
+YndJPFkhw5f52SZt34imY/wiJ54+VlVv5RDFwBHPzpycujDP3W7E8b9oosu6g444ADdA9vI
jq74scE4x2426scvcvXX4+McsAFeAB1+swr4xNfxpzod45/IzdiQS6/g0z26wEV/zz33lF8d
iv36Yy984w+cw8EbxDfhVxqfao8vgp8SbvxKhoO/tMOJnuE1tTI+R5OfTc75kUceWXjSzUF3
etfziP546I+/yIkO9DBXAtodATrGB+ljh7bMZTzIBbEp/rr99ttL7AgOWhBezvGqZaa/Lmd2
/PBo0Dww0R6YspJOtOQmb7Z4QHBLYJcA1ImQIKZN0BO4BCeBL0etgN9CDyTI4Z2gqsQ7gVjp
0IY/XMlXAmsWEe1pwyP8BHMLAIAbHO2C8oMPPjgI1nAsGvQnU1KGhlx1QDbAM/7Ak/wc+mtZ
vobkxz/+cUnq3/e+9w0WmCw04YOeHLqjB+Roh5M27Vm84m805MAxFnTSR/daf/3hk8UYP3bB
y2KJ1hFfxidw+Y1ONW9645uFDl18hmd8hD72OH/FK17RnX/++eVrWr71rW91b3nLW4oOeK++
+uqFhzGhq59JtIBmfqDPeOIZmeRFN3o71GMDPfleiRfgs4ceeqic4+UAG2+8cfeNb3yj6HHu
ued2e+65Z/GL8SDvE5/4RLfNNtuUx2DmCxk1xB9s8LhMEkpWxi39GXfttR/xyxhEJ7YEXzJ9
6qmn9r+JvmVp0842dJFDn9Aqa5/pwy9t5gE69PRQl3SrhzY68fOsAnvDFy881clkS8bROX0y
jnR0rg1k7LXhaVyDqx89X+sDfMRmtgD98YE253hmfmTc6BedoxN6+gC6kwvwgRuZpXEa/2p6
cwst/uR/5Stf6S6++OJCyd7EDQ140xUNHmgctcz63DzEQ1t855ytAbwAPgAe+wN0Cz4c/eqx
V8kPgG5w8Iw87XAA2eEHb2bHrzBr/54BHjBP62POmjzlqpmzejTps+ABQchOoABqV8FCcccd
d5Qgdsstt3R777132SWRYNlB2muvvbpNN920BD0JyfXXX18CGT6Ou57andMHVxKh/Tvf+U6R
IRAGNwmlQJ9kIAHULjCgA3xBlY52/IJvt09iIXDqF2gtUosvvvjAI35Xmu4JrjrY++pXv7ro
F952XSPjm9/8ZpGljw1w6aEfnyyEWXjwPProo4ue7LAg+C1zkIUXTRa62Or3sPmAnCQb8IAd
Q+2OAw88cJAYZqG2mJFDL7QWRrh4gti4++67lz56+8UywMf4xG+SO7wiD85NN91U7D322GMH
ffELmRI+NPTFiw533313kWsHc6uttiq2b7bZZqU0LyS5vqMwY0z+5MmTuxtuuKHQ42Ns4yd4
Rx111GBcyHNcfvnlZZfV3Hrve99b2viUrsaILnZh2fOiF72olHb78KOHOShxBVtssUWRefPN
Nxe5fpP8zDPP7M4+++zBPMrinIUcX8DnxgEcd9xxxU7y6QwXXsYTDn31azd3lXywyy67lJ1d
/gN4nXLKKeV6Ywv5vssRbsY//KObaxa/8LSTzFfrr79+kYWvPvYrjUPa4OEN+LFOeErjDP6j
k2sGTzHl3e9+d9H7TW96U+EUmw477LBuiSWWKHryC98bf+fmJD3pFpu0qyvJ2GijjUqfc2ML
9KujcUgetZlTjsxV473ooosWHc3lG2+8sdCbJ/iST3+xwxhLyvEj27XlfKyQ5A8N3QD/k5m6
NmN6//33D+SIbXDQ0eWII44oc44O2nI986ebIG3GT7xgJ97iMLvh8MOvf/3r8hQJD7ah4bs6
3sDXz27nuQbhGiN8nI8lfgWX/niqK+k22vjxSYPmgYn2QEtsJ9rjs1me4CcQrrLKKiWQ2ykS
8FdYYYUiSTA8/vjjyyJrwVlmmWW6k08+ufvc5z5XFmwBUeIo0CeIrrjiiqWO94knnljwLe5e
DxAo60BOiLogqQ+NAGghsAuM78tf/vKikzYJ0Morr1yCvwXabp9dUzzsspHBHrrCf+UrX9l9
6EMfGgR58uhsIbvqqqsKbzLJgUcPifO2225bFgR8/Vb19773vcJXP1vIQCfo85lF0GIC3+Jk
MTnooIOIK/iCORp9NSy77LIlgUJnAWMb++nz+te/vuiiz3go8dEPJFWSNz+nK4lhL7qXvOQl
RT5dr7zyym7dddctNsOhEz54JBHQvtNOOxUe+j71qU9166yzTrlhYKNFCC5Z/CLhxVufdnbR
K3wlvXZl6QPHWBgH7ZtvvnmZO7EBn0svvbSMA17ateGFXt2NFZ9rk3ACCyLfu1mSuJLD5/vv
v385h7PSSiuVcXGDRHd+wc/8XnPNNQt/MtjHXgkNGXhccsklRY/f/e53WBUcZRZ8eCA64utD
DmzF/+CDDy648JIYmZv/8i9+7/yJMq7ZqWb3Wmut1V199dWD+bHvvvt23/3ud8vcMr/4V4II
nLOXLkr+4ttVV111kCi52bRrzicf/vCHu7POOqvQ+nfOOed0HoN//vOfL210pANQRufSMJP/
3GCIKXjZMXeTJ3H66le/WjiyyU2SJx0///nPC57E8V3veldJwCTpb3jDG4qf6GROmsd8p66U
OP/rv/7rwAfa+QNkPooREj5jot/Nqxst14k5qnTD4NpTJ9c1eu2113Zf//rXCz/+c6O26667
Fj3dwLpZZNtoQCYwVsBYOYB4IbaljVx45qmbKraId/QCbuYOOeSQ8oRIrDS25hk8/hUHyKMX
f4lJ+sRj14122msYcwAAIABJREFU82SppZYq8Q/P+Awv17brBB4/bbjhhuXahsPf2l37Xo3J
OIwlfqGf2fGjY4O/Zg9kl3busrEltnPXeMyUNgKghdRCIUmRXNml9CjZzs0mm2xSFinMJVOS
lBe/+MUlSbAbIimSRAjMyy+/fElEBFLJo4RBUiZ4W2wkAGRIVARdNPq0q0syUsKxq7XbbrsN
5Fss99tvv6Lbl770pbLACOhoBPkrrriiJMgScomEHQ47c4IyOdkpyAJgIdW+XP+rJhYZC915
551X/CFo08ECZFGVtNCX/vjhoc4nklBt9MDPDQB7JY3wAXwLF1uBBIN8O4Zg0qRJxe+SKjp4
PG5RwvM973lP8Scd1MkFHqdLxPhAm3GwAJ9xxhkDOfigk/i85jWvGSTL0Ys8u0f68cbPb3Jb
8PlLYhkf8b1de+3scwTYpx1fugTHWEj6LJrxGRqyzDlJlnnDL/zNR+ShB87Jkfi88Y1vLCUZ
cOF84AMfKHjG0E2WRZpvzeGtt966yDEHLcjaoxt56I2bRMuiLWEASUQkpYH4XJ0dIPTq//zP
/1z0NEfNe/zoiCc93DiZJ0CSx6/GnHw7mkkk+MWcAnTMuWQCP8Af8JTazJd3vvOdZQzVJUPm
gXY75xLNzFlJrnng+gRJnJ3zdW2ntpkB185pp51WSPEkWyIfoLdESnsSdjcoQDJ6+umnl2vQ
/Ge3sZRswgeS00MPPbTYgT//Z8xip3bJ6R577DGIH+b2t7/97bKL6zfozRn+NT9ci+YHesdn
P/vZIsvNCJ+IdXwOzw1j5kBBmsa/XOvo2UynlJJR8x+QZ06Ld2Jxnia4nvfZZ58S78wPeOYc
W10zzt2I8zd+eAPXOx740dc5ffkTP9cwneiHxjwxH8Ut4Fpx00hfNpufZIszngDYVQ7v0eLX
rIxfUab9ax6YYA9MWdUmWHATN3s8IKhJGARFj70EModdWnf3FnYBUVATCAVfwTCLiD67X0Cb
ICYYe8Rnp8biaWFHUz/exIdsNAInOvIB+QAOEIzJJwuuxAEvC6KdLqBPMMfTwm7hkaBLyvWF
JzkWgyw48PHS78ui1clgA5zoQIYd5OgLH58A/fCePHnywD/4eCWCXvodgD5AEm0ng6/C76ST
TiqvdvC1GwhAJ3XJknNHfE0Hi3Lw6LD22muXcSOfDfAll+RKYoxpxkIbf/kQnHO4SrrCs4jR
TV2fREBpTOHpA7Vt2skjH8DFy40DffQD5zvuuGNZNEtD/4+/0TnoxW624rHzzjuXxXRSnwyq
w2UvXPLpApd+ktsTTjihtMHT5xFqPadrOjR25s3X6KfE3/gBvMnRFru1q2cuxC/mJvvY7SZB
wiC5BZkPq622WqnjpQ2P2KGDfDoCvtDv0KaPzkr0/C2Z1cde/NRzzUpmJC8eHdsRtJvrZgMt
m5UZQ7zQzQpIYg8//PCn8RcP6E/vmr+5R75dUf0Zc9dvztnEt/DsbPOdhD268jVcvAF8vsm8
4xc+MYauAf50PeHnnO3iChl4ZJ6iCUR3OPDVxwL440cHOirR2/XNzUX0l6SKxfTKIRa7SaI7
2rzapd/cY6vd7fqVocxj14EYgz96OnvNhRx1PnJI7m1WaKMj/OhEjnMloIOnINaN0eLXrI7f
WPzbcJoHZrcHWmI7uz06wfwENYmjXVFBUsBNoHeXbhFIgBX0BLQsHlQV+AVPdA4B0OM8u31Z
dARNvC0yeAP1AP4Cbj7kkwCKH7x77723BFO8yRbknQuwdnGA4E6eNgmohduOi50egRzoQ6+0
OJGZxU/529/+tvDF26PcAD3Y7hdSAnjUIGkgn8wsXmRJHrTjQZ4y9lm47SbxMX76JJx2ni1M
Xn+IHLQeTbMzi238IUHWBsfx/e9/f+Bn9OER/NwUaNeGJxrndFDSMckvO6KzBVEinV22+CB2
8SO7vB4SXxt/j1TtKhnPvEPIZ3ai+SuAniy0bMlC+/73v7/bYYcdymNluHhmLsF14ONALwG3
U00vPJX87FEuPSSbsRONOTWpT5hjP95kw8m80uegl/b4lf/YpY9e5GU88JZAeV/WTpx3IvED
5hi90WpTxv7oQY5xICN97NOurqRPXrdAB/BjU+YL33n07ynHW9/61qK7Pvi53uN3bWyfFcCb
vXTkA0nc5/tXHzLX8acP/b/whS8UPNckfPbQyesD8Go/s8vTE0mcpwfe/YSDLjqzA+CNZ/yM
Fi/XFv65xulKpjkLh/3GAr16/KwExjh+Lg3T+YcP/qF1DtRzbq7QiyzXlpiFvwOeww6qXX46
uflNP1455+8k3e94xztKguw64Cc84l+y4KLDzyFO/epXv8KutCvpRUf+jAy04jgavEeLX7M6
fvRo0Dww0R5oie1Ee3w2yxOgPNbzziwQiAX5PCIWbC0CAprgKKg7F+yUHicKtHbCtElyLTp2
4gD+QGCEL1AmoJaO/h/+5AqY+gBZ+G233XYlMbXIAY+zJaoeSXu85pPjZAOJkq9WSiDWJiGy
KAA86SCZoId69FOyle2b9h+M8xgVX/p4BOn9Nv0BtIAsQC8LkpsEvOxWkVXTwMMvNnosbVcx
7Uo7zN4V9vjw5JNPLv7UbhcHSGDCk2y7VvDsngB6GEt+ix/ow7+AfQ4QGzxKlHhJWoEF1Dus
fCS59qoAne/qHxHbPbLzKDnEH43xM+YelQI+wNt48LWSfLvgZFu8PfK1qwcvix9/4enQnpJM
yZ0kGE4guPFnxhCOefnpT3+6oJINxzy3w2RBNo/zHuOl/Tu++umFJ/zMU7pJxtihL7Iwjv9S
6gdJsIIbXvR30wKfD71/brz4hM89ZcjYxk48owP74iNyIo+c7bffvowBfkDJfjt55Hu32Xz+
2te+VuYMGuMUwKuWaUxnBewQS574DV86SJTsigLyzVl4dpDhmUMB1zf93SSDXNv04g8+5EuH
xJlvtDky18k1D1xj9913X7l2PII33103bkITV8xteK5JvjAmeAWcR0b8pE97xlk958FBU0Pw
tcOlqzHPuXlhvgNt/CKR/8xnPtNdd911xae5vsxl/XjyNV9mTuDPV8ZfvMwY4CtGusEKLnof
6vPusPhNHzcd5kxshuugL15485VYI2EOr8n9Eyuvf7m2ze+xjB+e8RNdANudu6JGrqrS3P41
D0yIB1piOyFuHn8hAprgZDdDaYfHB40SeAVQoE/AEdy02Z3zaDAfgrBwWUQ81tKfBdLCZucV
vQNfgI+FSmCbNGlSodFvR1CCJ9mws+LdSe2SIwuixVBy5V1ej5D1CbR0wTOP4jwCTsC3WJFD
Nt0ET4stYJO6IO0Rrnfz1lhjjYL35S9/uTz+Cy5a9gBy0XkP1wKCvzY2SVLzYSdt8VkhfOqf
XTX8JFpwvK/sU/6A3fypHR54wQteUHTOGIzmf7zhsj27ZfTQxga640FPpUXNou/9OgkDX9FD
+3J9QmieADr5gAn99MWn2h1uDCQVzo2LnUJyfQqej9JHBzjee1TCAXBSfvGLX+xO7pN3Nrj5
gefGIWOozg40dv3VjeNdfbKiDQ3cN7/5zeXJBJmSB76OvRIHPmEHOUDdh8fMpQA+wLzGh0+N
nXM3HTWEl6cXdDJfvceIv3nsXVfvLOqTcLoxMMfYog3Er3QwHoH4KTi5LsJP3U1H3vWGZ1w9
yQDxr3dtzVUJXni6iUh/QZ6Jf64Fu/TswIvungDxm0fp/OhDXZLZvOJDrqTL+7WT+lggmXX9
85eb2DzBwEubBE9CZwwBOQ595JCRmyh+WHLJJcsNBb5iBv8kbpnbbgbgG0t+xyvzCn9jow1f
R8aGjeYBcI4G8Kc6PHMEoKv76Rq/O9fHb7EFvd1XMUxccIMLz8EPXuNwUyQpFSOMJRr0kn7n
PhiXdnU79mJ75ML1vq75KAbAcX36vAIZ/KGkGz5K15Trg671q1SuKXLxo9do47f7U69j4I8f
XfgyNhSntX/NAxPsgfk+8pGPjFzFEyy4iZviAYFGkLYwrL3Ouv2noP9fHyR8EMtje5+WHtkl
QZG7XzSCRyBBxYKgXeAMSBISTIOnT2AUqOs2fPEQAC0EWXTgC14JjGTAxUMwq/u1WQzgBtTh
C7L4KwPhqx6dnNd4dCSTvtpBeAzTSLL+4z/+o7zPSQeLvmQXD8DPAjudQO0rdfzAsA30F7TR
ph8tfEf4wHPQNcBG/XVb+sbi/xondPwQmZkL8ZnSo8mll1666Jb++IptaOmZPvPEAl63RVba
okfqKcM3+PDYSo5xUqrX9qMNHR3COzyU6Y+t0VXf1GwIfk3rnKyMXXwU+lquPjwy72Nf5qg6
HE8AfCjpmmuuKf5z/frwHp6gvua04ZnrITwLYvUvtMaltiP6Qo2ubgC80x4bwqamS9uMltPi
MS29o9O05KS/5osXYBu/6INnrkQO26Y1Z+CIO+ZD/FPPX7SJDxm76DdcNy/ceNT+D278i4Yu
ud7q9mmNa+yla+zEN/Y5Dx/nZOCfayR6xn/BIU8bPtEnsVo74JvQp6zp47OC3P+LDPrEr2lL
GXvQkA20Jf6rRw/nZCxQxXkkN998S7mZtnstyf/NA78q4y8hB/iyPzIjp3S2f80DY/TAlJV3
jAQNbe7zgIs/AUAwT7ATpIBkRVuCUHD1OU9g0q+eQG1xF2C0KbMAwQugFcCAgKRPCVd7+uqA
TcfwjTwlgJ9zeJGVhCY2ZdGCGxzn5NhJsuOQnQhJbV53EHiTmMINX7LpBLTFBjzRpD07N3DR
0xeuI/QWWPUAnflDW3yijd74T8//+kFw1NE5+ICuDnzpGb8o/chF+i1uAbh0B9HZeZ3UsgFE
fvCiBx760s+2yFKyF252S8mLj9iODh6cjOkwb+3xWWxlR/DxxEc9+sFPv/PMDbJ8uFBJJ7Jy
XTiX3MDFMz7kA/jaM5/VnXvdxYf8XCPaLMx23DJXwhuP2M6feNMLTX2wC57DDjGc2Bp9tNOV
zfmgJjwQXtFHfWYhPlMa52HQHp9n/INT19HCDT86hZ9SnS/xordzbRlr4xT7jC8++vnA4Rxt
/MPn4astczg86IgPOTnHwwdE8SMPHfzQaicXjbEZBu1kshuvADmRqz0yjWn8gQZP9Nqch4Zd
aODQATiPPG3wyYn/4OAT/NAr4YHwj8/oA0KDJ321K/GLvup0BfFz6Epj/8840hNERqm0f80D
E+iBKavvBAptomafBwQdAUdAAgk8diW1JSgJNglq8FN3nuCWYKxPsFQXuPQngOHhSD/+Ahi5
0SEytTvCP/LRkusIrtKRwAgHhCZyycBTf4KrNjqjxxN4344PtLPDY2RJB/6RBY9d6vEH3PCI
nmgkPuygB9zg0MUiqD0+SjIHD0Q/5/DVHXg44p+p+R9NIPbGF/ABOfjSE8R3HtcGx+IG2Ao3
5/SATwe4eDkkCSB2wsvcwiOLJV0A36KDo8RLWxK9+JiPYntk0Sc+KMz6f+TCg6MfPSA3ftYH
9Gsz3gBdIPqpG0NjxV7ndCMX7yRR5EZWfBB/kuOcXHy9QyrZjG1eHzAG0QNeeEQnO63a46fQ
xiZ6eo2HnPiKL+mdD/xlTOGCmp/XKdRjg/76XH00oCsZbGQzX4Hw0e6gH39Fd3KjG/3Rhoc6
em3wMh/xxSP+UGZMnIP4olT6f9rR4BO/4m088Qd4DPveuNAVfc2Db+mNRolXaCMnPGMfu8iP
TOf0xAPEJ5lv2vDN/HXuAPEjnnztiF3hBzfnsZFstBkvvJzThVwl/dHizebg0hV9xgFv+AHt
aBzkTW/8IgstPAeIr0ql/WsemEAPtMR2Ap09HqIELiBoAYFOILMrKVAJTCDBJsFL3bkywS0B
E090eOFrsa6DlH4B0hH+CX6pkxlZNV9toaMnGYKqEl/9wRF4QcosOnSO/OCHF3z9sSE0bEzi
R8fYg945fAc+QLAmA/CBxAcP52jwIAfEf2iA9vBJHQ1AHzuVcENf+wl/PgkdHdNfGPX/0o8n
IBNe9NZGBv/h49CnRJOxCj5+2uCHV+zFK2OcNriRzbfGkbwAfDxBxqT2C9zg80FsjZ0ZF/S1
LDSSlNAnkcz4xr7IyrjgERx6xd7gsTv+C42+jA89+Irc2J16ZMLJtQcvNmUOS5giAw9+yfxH
q44GLf3Ir/XWpx5c59oyhrEPPb7onc8oRLYky9ynKz50B9Eh9ehMDzYoyaYD0IYnwMeYoYnt
+uOX8NJGLlnxA3rzI/poB3Bie+ro9eMHjAsZ6B3DNtQy4KvDzziZB7FBPzsyN6J76vq1Ge/4
P3roi+zYp805XzvgomeTuRj72OQA+vgPbsZLO3mRywZ1Bx5o4Rof9GQAdTh45V1zuKONH1qy
yAHhUyrtX/PAHPJAS2znkONnl9gEoyQDdaAUbBIE9QtS8EHwBaIEbu1oHIKgoBc8fVmcnSeZ
SADWhpd2tNoD+KROfoJgyiwG+ur+BO4EYAEZnywuwVdqswBktyPytOsH7E+gZhf5+pyjQ+Oc
P9KPjj0B7Vkg2Itf7BXgQYJ75NIhPJzH7uBOz/94xOaMZej5NfrjRQb+IIkZ3vwHL/rU45ox
NQbksIcdeIV36HylENsyHnD4I4AH+WSSET31Z4zjh4yDvuhADhq0YNgWsjKuFv+AhAUP+LVP
yFLPuGTOhre+4CvZFR6hwYNMNpER+bGbzuZOfIU3G+CD2IR3/BG78HDwDfkg/oGTuYVHLcc5
MBYgNHaPA2jxDW3aZ7Ss/UwOvfggPoktsTfXH1vhZ9zjz/gmyX/66RVesUfJP8q0xYfa6aBd
mWsjfuQbR+jw1xe/4hM74sfYBjf6azN2cCJDP75w+NfXCNIH8AO+AI5xiF0p8YGnHtlo8Igf
1fWTEd/hCd8RO/kPDr+Tl3kC13xNm3otj17oopN+gMaHAQHajE90QEPHjB9b4tf4B8+0FUbt
X/PABHtgyoo9wYKbuNnrgQREQTggyNWBU5BK8EnwhSugBq8OhOhBgnB4C34CmyAHB03wtIP0
CaB4w4vsgtD/i8zU0STAa3OewJogr8Qr9sJzTifBN7sdcMgWYCMbr2EfkEEvdPAsEPwROQnQ
8PAD8OlOX/wiA05siEy6OQf6+crhPDA9/4cP3Pg5/OiIT+pw6OLgCyXe9I28jAdcbcY044IP
noDe5LHHAXwBP8A3uqiH3jlcPMJHW2Q7jw8zrmgzr5zXfCM3i2r4KNOHJ33CIz7RD08dX+eZ
m6GPninxMo/CAx7gF34kg1/SXjr7f+YOHYA+R+YFPWJTrTM+IG3xIVzy1OMjePDJ0a6fDDIj
Fx+vKii10RcM61oax/CPH+iCHs/w005+3eYmKrrSUR/a6EZn52nHK+f4O4ZjQeZfeEzNjvhB
GXpjh3cAnX6Qkq7xs7bMSTih1e/cEbrIyFjBB97lTxvbcq6PrPAPP3zgsRFv7fF1/Jx69MAL
hDea1NnM74C9OTdfp+Y3ePFB/Bt5udbif7hkTmv82BIb4h91/Bo0D8wpD0x5GW1OadDkzrIH
BM4s7GEmoNXBRbDRlkCXOnwLUwKauqCWwKeeYJsATJZgJ5Dhh1fw0MLPAoMPSLvzBNEE1fDR
ji9+6JWRWcvBIzppT3DVbuFNAhLZ2mtekUdG+pR0zKIQfeNDeoQferqHPiUZjgC8Guq+8K37
cx684MTW1NMPvz5Xjy71ea1HbNAf2ro/9MMy4QeCk3pNHx315TxytNXy1WvanId/6OGBmk9w
tNfnwatxw1cf0Ff3j7SO/M91NK3+Yf1DGx3Q5TxlcGo9hv0buVPD1Rb88Kjl6I+vUmoDw/WR
1tH/Rx9yal+kvbatjh21zOBE51pq9Kp5p19b7A2P4IWuxs15yhondPrq9uAq6zGNPO3Two89
dX/a0EX3yA7/Gr/GS3vw9YHU068tciIjdX0gNCO1/1tPe8ra3po2/OENy9BW61Sf6wM1r5GW
9r95YOI80G6rJs7X4yYpi43kK3f0w4FF8qtNwKp/IQx+vTBJ6ARiCWIST211gskQwS7Jpn64
DvzxdAh44aEdDyCRpgsejuisTx0d3qHVDic26csuiDYHHZLUwq8DtjqcBGC4eATg0o2OaXdO
Prp8Gh1+9ApNeLSyeaB5oHmgeaB5oHlgznugJbZzfgxmSQOJVhJaiVsSziR+kjiQXQPn+aog
tPBDL5FTB5LlJIKSuJzDHT7QwHEkAdXmXBu+ZIVHEmn90UECCbyv5tyBVj/AL7ZoY0/6JMoS
UTonGSZLvzq61PGCq66PDiB0SWS1RXePePXn5kB7g+aB5oHmgeaB5oHmgbnPAy2xnfvGZIY0
kohJ0urET1sSWe1AcichTXKYJE1f6CVsaOFJCpUSP/3oJHdw1B051x6+2hxoI1sd3wDe+Op3
Hlrvt3pfDTgHaAMS0kB2lMlOokwmiO7q6NGRR4ckqPD0RUf1QL5uCX30hhuf4kUGHzRoHmge
aB5oHmgeaB6YezzQVua5ZyxmSpMkcRIwiZZ6IImeenYpkxxK0iR5DiBZc44GHz/VKek78sgj
Cy06yR05tYwkqOGLh0QVj/D307To8KoTanLhhTal9nwIxTkZ9IqtaCSzfvqXTrEBrj6ytOnD
E71z9Ep20aO2A786eYeDlwM9yKfq9aHFo0HzQPNA80DzQPNA88Dc44Gnf7pl7tGraTJGD0iw
JF9A0ga0JblLsigxdEjKJHBwg5/ktBA/9c/vjCfxO/DAA0srOglgklslfiC4qWsL/6uvvrrI
hg8knfCSfNp9ZQNdtUkYJbbagotuWE/61O/V6pewp+32229/Gk3a8c3uK774kElfdsSW6Bdd
86n6fNiu5oFPg+aB5oHmgeaB5oHmgTnrgbZjO2f9P8vSJV9J6JTqfj5Wkig5lEyqS+YkaGec
cUZJ6iRle+65Z7fhhht299xzT0ns0IMkw0lEvbsqKdYuqSND32233VZKCSH+P/3pTwu9/uyw
wpM46geSTQmiduWtt95a3o21+7r33nuXnWLvANNZgpnk+Pzzzy/y6b377rsXfvrpdtdddxV+
XiFQv/vuu4tP3vGOdxSZseOkk04qdOoS9COOOKLYwi6+wY/eZHoVQvmqV72q8NafBD8JLdwG
zQPNA80DzQPNA80Dc48HWmI794zFTGmSpCyPxe+///7u5S9/efc///M/JbmTSK666qol6bzx
xhu7N7/5zSUhlcSuttpqnd1UiahkLcldvgUgO5cUk5iikRQm2Vx55ZU7Caf2O++8s8hJ0ptE
NjyUEuEVV1yxu+6660oSqcQDrd3U448/vjvttNNK8rzKKqsUWWRLcrfeeuuSsPpw2VprrVXo
I2O55ZbrLrzwwpJA/+AHPyh6sOWUU05BXnDPOeecbt999y220oV/DjnkkGJL7Ipt6m4KvDrB
l/AlsUcffXR39tlnF1+oR34R0v41DzQPNA80DzQPNA/McQ+0xHaOD8GsKSDBknhJspRnnXVW
t9tuu3Wrr756Ybz88st3u+66a3fuued2F198cTlfYYUVyg7twQcf3G2wwQaDBBJBktzsumZX
UrInWQSSaInkXnvt1W211VaFZtllly07wJdccklJApPgwk8CSLd99tmnk7TaxVW+853v7C64
4IKCs/7663eTJk16mj7oJZPoyLDTuv/++w9sPu+884q9m2++OdTuZS97WdGDvdFdu8SYfwDZ
knpgd1d7+rRFX/p95jOf0VSATdtuu205z42ECtrISqkNfoPmgeaB5oFnqge8fDblY8PPVC80
uyfaAy2xnWiPz2Z5Eig7jQ67tz7gJCGTnEm+JFrrrLNO2Zl0noTXDq0ET6Lo9YIkdkleqYmH
I7vCcBxof/KTn3Sf/vSni9zFF1+88LfjevPNN5cEOLu6ZNBNYowX3QCeQGKdn2oNDXwgMUTn
1YSVVlqpnGvXv9566xXbvP5w6qmnFvleRdBHL7vAtS38wh8bbbTR4FUIuH4XPbokEeUnx5Zb
btkddthhhSfd8woCPH6Lfvjopyuw+6wt9pTG9q95oHmgeaB5oHmgeWDcPdAS23F38fgKkDxJ
pJKUqXv9IAmohOvaa68tOBK466+/fpDEqkv4JGwSMZDkzDkeXktQapfsJbmTaNpF1ffggw+W
0vkBBxxQzpP0keFckknGTTfdhHXhRW+vDkhI8aY7faKLukNyfMMNNxQe9MDvhz/8YZFDj7e/
/e2F/je/+U3Rkx52deMTvL164PWCE088sfDTBy9JLZ3UAZlJTO1q5wbB7vInP/nJggMXXmTQ
i438XX+fbkFu/5oHmgeaB56BHhBRp3xPzzPQAc3kOeKBltjOEbfPXqESKUmVndcddtihO/bY
Y8t7qaRIck8++eRu++23L68N+ADVHXfcURTw3qnEUsKHFuCTZE1yl+901S6Rk+Tp32abbbrj
jjtukBxK9NZdd93uqKOOGiSFaGrYYostynu05OP9wAMPdCeccELRS0Iogc03D0hGs9vr3Vjv
3qLD85hjjil9ktLXve51ZceWHLuodNx44427j370o2WXlxy8r7nmmvLaQ3aMDz/88IIrUZe8
g+jLPnR77LFHSd7poq5fAuvcoZ3v+SS0eIW+MG3/mgeaB5oHmgeaB5oHJswDLbGdMFePjyDJ
FZBwSey8h+rDVt4hleT5sJb3SH3Ayru13j3VJjE788wzu7XXXrsktWglaECSqj87mKWx+oev
pFOiKWmEK7HzLQS+OcDjfQCn5uFDbPfee2/RA/7SSy9dvhXBris8CWGSSDyzm0qeD5rR37nd
W/2SSPLzrQ/aHDvttFP3wQ9+sMj3yoK27bbbrnyYTCKqLqH1jQf8IXkP0CGvGXi/1g73wgsv
XGjQHXTQQUUmfLLh40V/uuNFR30NmgeaB5oHmgeaB5oHJtYDT99Sm1jZTdps9IDESiIpGfRN
A84lWEDCJdE6/fTTOzuVSTbzjQkSXSBB83qA5E9yKpED8POoHV8gMV1qqaVKn34JnjbnEkFA
Ph5JmJ07lHuhAAAgAElEQVQvscQSA/na6YvWh9zsqgL6kkOP2LTMMssUOjT0tFuc5BEtvZMI
4wfI960PATbYmZa4Al8vRmcy4hM0Xq2I7y6//PLSBy+Aj35ygsc2dTrhRU/6N2geaB5oHmge
aB5oHpg4D7RtpYnz9bhKkgwmsXMu4ZKAOZKg7rjjjt2aa6452H2UANsJrUFShsYrAUn26gQO
rkQQTwmmPudJMtWB0oFHkj/tkr3goEerX0luknB9aNmk3U4oOu1AWxLm4NELpIxO3tsNJEHF
iy61bujIl/jGdv01DT50wtvP/yrpXvsAD7zDI7Jb2TzQPNA80DzQPNA8ML4eaInt+Pp33LlL
rCRpSomUhM85kJA5JF2SLeD9VHgOdC996UtLf2gldZI5fNCBJH/a8JPYoU0fWjLTn3Z46dOW
pBU/5/qil6QS7+gOX38N0UubBDdJbmiiZ14lgCf5rd/bJYPu0YH82KMMxHZ1dgE0dEKvfOih
h0qZNno4jx6xrRC3f80DzQPNA80DzQPNA+PugSnPV8ddVBMwXh5IIiUZk7hNDZL8Ta1PW01b
nwd/uC0yQ6ucmuxa7tTO8QV1UqmuPX013/ocXg01/+iX5Bde+tOXur6ptWkHtcxar9DACa/o
rK3uV2/QPNA80DzQPNA80Dwwvh5oO7bj69/GvXmgeaB5oHmgeaB5oHmgeWCCPNAS2wlydBPT
PNA80DzQPNA80DzQPNA8ML4eaInt+Pq3cW8eaB5oHmgeaB5oHmgeaB6YIA+0xHaCHN3ENA80
DzQPNA80DzQPNA80D4yvB1piO77+bdybB5oHmgeaB5oHmgeaB5oHJsgDLbGdIEc3Mc0DzQPN
A80DzQPNA80DzQPj64GW2I6vfxv35oHmgeaB5oHmgeaB5oHmgQnyQEtsJ8jR4y3G96fedttt
5QcCyPJDAaD+kYD8sEDpGPqXHxnQfNNNN3UbbbRRoa3p82MGdVt+qAG9I335UQP86nP1/GKY
81e96lXl+2o/9alPqQ5++CH6p2RfePte2chNWYif+le31bLxuOuuuwa+CU2NExn6yA6v6BEa
Jdy6f5i2xs2voaWtxg2vyIg+9HX4wYlbbrll4Mf0X3DBBeVngcNTGR7DZfSEE/rgpC04xmcY
B250Dt7s0I/sm2++efCdxWSHv7477rij22CDDZwOgC7ByVyiW3ROG4JvfvOb3V577TWgDZ2f
Vgap1+MTPiFSj69Shi7fX1zLpEvwwmNmy8hBH578HhiWm/bQoYk99Lr77ru7DTfcMGgDnsHR
ETnOaz7xUUr9gbRljmivZatPDUf7WCBzTen7of3oyic+8YlCSk7tE42RFd7D45322Proo4+m
aVDySezBr/ZR2gfIT50Yj7rP/KWbtsiCmnFLm58EB7XefK8/cvEYHr/Iyjjh4Tz+SH/aI099
GMKjphnGmdG6mTplts4odcNvHpg5D7TEdub8Ns9QJcAJmBYEdQGsDqACp4CnX8B97nOfWwKx
RVuQS8BTt0AM8+QMbQ44+IVGX37gwE/b4udHEyL/qquuKrKTfNABPV5wIotcvOlZB97onIBN
bo5h2XCzwOljK9zoRy4ZIDqgsehEj9iFFq7+Rx55pOCr000ffOdZsPLrZoV5/w8u+8ihuzoa
+Hhuuumm3dlnn136vva1r3V77LHHQDf6HnbYYd3rXve6sJtmGb1jB/3Jio5kO/CEwz/GRz04
Fn180MXPbkjOPffcWdaPj8JTSTY96KnOP+Zj/J6xgAPg049udOZTbYCPdthhh8H4xrfK/Gxy
+Bgf7ejDBw/y1ZWAH+iFTtIS3cmMjhnL1AvhTP6Lfsjp5qbTzzXTFZDLh/QjFzgPHX3pD0d/
ncBFdzRwcm2knf74kItPfkRFqQ0oHemDB8iL7PCNfko0cEaD0MKjl4NeDz74YLlpcXM3zIf9
0Sf0xhuwB496PLWbY+Z7PWbxW+yr50Hwan+Kb8YjdsIJrTb+yM9704Pe0SP6pkQLJz6Ei0ct
L+MUu8Jbe3TPeNAj/KIXOoB3rg205NCr5j+C2f43D8wbHmiJ7bwxTrOkpd0+i6Eg5/jFL34x
CL5nnXVWCeoJegKzxUBdABQgJ0+eXOhSx+PGG2/stthii7IbJhgLhocffnhZHNBcdtllA3n7
7LNPt/7663e//vWvCx7+aBJ00ZJ79NFHl7b0nXjiicVuQff5z39+OUcj4IbWLrVFCQ9t9913
X+FF//POO6+0af/ABz5QzuMHwTyL0E9/+tNCH7l2ENkgcbFz/a53vavQajvuuOOKX9ACujzv
ec/rrrzyymITuYsttljxod3hRRZZpDvyyCMH9HRCY0wWXnjhIie2KH/+858XuQ8//HD3hje8
oeC+/vWvL4vPL3/5y7JQ2qmS9Bq70cACdcQRR5Txt7g72HnppZd29Hv1q189sI8Pjz/++MFi
e8899xS92cOuJHK33npr8d2WW245y/rRn4+An3vmA2OUn36mUxZlJZnGwbmkBj76XXfdtez+
8x8wF7/85S93bgr4wHjjaw4rgTZHgH/14W98b7/99nL+mte8pvgLnuThzjvvLPPlLW95S8Gj
QxKBmp9x/sY3vhH2M1zaqcbbse+++xZZu+++e0lCkpibW8Ymc9fcoL8k7fzzzx/Q6weuFXoB
vsgTE3U82cHnAF/gWnYeXbSp84Prkq/0uY6U/LbJJpsM5EemazU8+HosQCcQm5yzzTjtuOOO
JQ7RBZ44wSbXb/yx6KKLlnlrvgD+yvjS5aijjir+QOd6iy177rnnIJbZJYXLL+RkXuDHtsAV
V1wxsA9+/KefHG2LL7545+mUPvx+9rOflXZ1/XhH14suumjAbyzjZxfb/GNfPY7Ti//nnHNO
sYkdu+22W4nT7KUbfWYVzLSn/zD6rHJs9M0Do3ugJbaj+2iexrirT15e+tKXDl5TkJAuvfTS
ZVGSqNjREvgsdhZFi6kgZxdSsFWXFFpM1AV+QdPCYsFbffXVu4ceeqgsau973/tKv12lbbfd
trRZMOBce+21hQdnZrHKAoufAHvQQQcVPbRLqiTEgjxZdirokLpzsNJKK5WdGzQW2kmTJpX2
H/3oR90222xTdNC38sorF70lJoK/wB2aVVZZpSwodL333nu7l73sZWVnzEL53e9+t1tzzTUL
rgVTkssPAD7g48l98k8mnh/72Me6rbfeuuhKX/ay0cJOJ4mhhYoN8EESInj8R6aFRT9dV1tt
te573/teoXvve9/bXXjhhQM/FgbT+GeRO/DAA0uijdcZZ5xRZEkQjbEdcz7TZx68+93vLgsj
ffjW4mp89a2wwgpFJzcP5hQ/zKp+bMtOU/zxgx/8oOihDxgH4EbKHDMX7r///rJjLZniM/66
5pprik/pzmZ1Nx38mPEujPp/ZNE/Mtj3kpe8pPvJT35S+owR+43ZwQcf3H3xi18sciQPbirc
hGnDh378nISCDOOu/sY3vjEiZ7hcZ511in/dCLqhskN+0kknDfzuNYv3vOc9ZTwzfvwDjJE5
yA7++eQnP9m98pWvLPrmGn7ta1/bfeQjHykyMv/oDNTNb/bzO7+QITEUE8SO5Zdfvlwf2o1D
4gx6182ZZ545kM3XnsrApYvrIL6HPz3gXzbQm05KYK66runKR+IEOeutt1731a9+tciil3nr
erv44ovLWBozNGzCg04ST9cBWeqnnnpqd8kllxS57HITRQfzZMUVVxwkfXCBdk9QxAJtH//4
xwc3DejMB7q7tg844IByDm+55ZYr1zL9xTy86WrzwTU6I+PHptqn5NEn40LecPw3DuIa2jXW
WKPEMLrgo61B88C86IGW2M6LozYDOktk7PIstdRShWrVVVft9ttvv7JIWnj0WdCBRdKCBOyC
WcAOPfTQzo6hYCvQWRQsfgnoFgaJm0UuC54FZOeddy5BWoAUyC2qQJAH+IAkF3ZL0idxWWaZ
ZUpwlWgGLGj0sPiQSX+JpgWabhYmj+wlyZIa55ITIEmW4NglTfBXt6O29957l2Rf+5JLLll2
Lr71rW8VWWTmNQl+sntnUbdo0B0PCQb+EnjAJ3wA9Nv9gYue7y2SFg83EPTmyyTszpP48wed
4uv4Ak09BkXQNP7hGz0lKW448MGDfH2SIXW+Mk5uECTO/LLxxhuXhMGCq8639DIGYFb1w4MO
4JBDDimlGwvvgd5www2lTzJpZ/n9739/t9VWW5VxOf3008u40Jk+bookgrGVfyTM9GQbPxgL
/Xyf5EifsbS7yT43OWxir/ljV3z77bfvTjnllEHiahfYqyLmIsArj4jDl5zM54I0E/+OPfbY
cp1I2OgoUWWXc9ePsYwMbZI8ciVD5rV5myTMdeKpAh+w2bUqqcUTbcYx12V85QmD+Ss5Iguf
q6++usSPXXbZZXDTR465LenHD0jG6bP//vuXukTROLjpuP7660vbaP/Mffazm7+VeNJPki1u
gIwFu8UeYwaWXXbZoj87zCn80AOxENihdON4wgknFP7aHnjggZKourFzbYsxfCQR5QN2gvjT
9a5d/ABuPvk7uoqtoZ/c3wS7FvE2RptttlmxUcwzB8UHMcX8G2388jQn45f5QAeyR4v/YjOb
0LmG1lprraJLklt8GjQPzGseaIntvDZiM6ivgLf22msPghXySX0CaIGRQLlLT+KkL4vS5Zdf
XoL9/2fvTsAtu8oyAe9AnFoUVESDIYQwhHkSlEEwSBglOIvQEoIoY8LcPE0/Df202toqAsEw
hIQhDNr9tGgzGJRJhIjS0ChTRoEwiSgoY3fLlL7vqnw3m8utureqTtWpc+v769l3r73Wv/7/
X9/ae63vrL3OKROfiZCY9EzcyIIB3WFAdEgjStIGRT7lRUxIOeSxI4b4i55XmEi1yYxfBz22
iTQRM4LmtZ7XjZlAEBATuxhMVtEVF3KkDeqGmIkRIYUT4RdZyuRHP5MmHddiTrk6SE0mSWVi
pAtfr3qjq/3HrmGvTfyKMXHzG1ytpGYyZ0u8qcufuuynDfJ2J2IXE58PetCDxvYMH3LUlxf8
XcMofWhl56yzzhorntrB55lnnjkmZPHYnkB/f+Ob+0+c2iIe9wFy6l7UR0iM9lhBhpt7l8BG
LAhw+le+awJL9egQ7dEG7eeHLWXuF9cEtje72c1GXXGdfPLJg4hcurYChvzq79yL9OGm3wjb
7Ihrf8SqsFjFl/tEPxDPj7hce2b4kpanvdrmAwKR71odOPjw6vm0IkjSDnp0iDQsHXM74mBL
vg8SwVSbEWv52h6fdNXhV75zSFP8Doe7+cMO0S719Iu0uj5ASkf4surpvlUPJny/4AUvGB9G
cz/AK+XObJx44oljFT44XuMa1xj9aDXzuc997sAl9ow57gNtTV+LzbgRH2IJNsErcbp/9Svb
tv6wC3ex2H7l2fNGAskk8tnYXf+Jg2grWwTW6Ys9jf/HXj4ezeupL75KEVhVBEpsV7Xnthm3
we5v/uZvxiCbwcqKo0HSwOd1HJ1MEPJNHlZ0DLL2XVk5IuqrY+I0oJMM9gbfz33uc+sDq1dz
GdgzgRlsSa5NcvwZtK20sG9SQhBC2vihhzyKMXWkrSJZTbEflR479Ex4fJs4iDK2TejSYtUG
Oq69HoRB4rLPzURFLwM+XTpEzHQd6osJjmKi45poAxtsiY14NWoVBmlTN5Jy9REqWzdiG25W
L02cJH0VP7Gx2Tm6VmZ+5md+ZqxCJaa0Rz2+tJUv+Uijfatid7BDx6rOsWuToVW7tHV/4ksM
2i89v0f0pQ8tPhxY/bNyaL8w7LTBfU3SN876NffOPD99S19afb74db9ZyYexNspj5z3vec+w
5dqHAnt2raT9wi/8wtCjm/uXjm0PYmabb3n7I1Y6xQp7q3del+f5Yzd7yF/+8pePeJS5zz2H
2uYZJPJdi0lf+oCHUHm24akOSdsTt7Yhau985ztHmf5Rlj7yfLlngqXr+T3BXnTFQE99/qT3
5v5li+08e3ku2XfAydmbo2x5cB8EP3uUveHh18ose/BwJuKy4ipOeT7IwNsHmIesvdWSx54z
XeOOWCLsul/yvNERI//uJWn+xAhT/SBWdugaw5z5t/Xl+7//+6d3vetdw/ye+s9e8vRffPND
xAezPY3/xiM64iHaIWaxxN4o6J8isEIIlNiuUGftS6j2UBnIfUmBIHFW3rzCsgKGMHgVZ3Dz
es2kZ8IxwBkg/8N/+A/j1aG6mQScDdDOBr/kG2ANwr5UY7XJ6gnxWt9ezgyY7KvjyKDtyyT3
v//9x2qYicCAzYc4ImLM4C9tlUX8BnCx0vVlLysqXmsrM7mzY18ff9JsEDZ8AcWKjFeD4jLQ
w8urTHqxS1dbnbWDbnCyjxJRsFJMvNb2wcBk9ra115G+CMWvWKwewf2oo44a8YZ8wAv2bJvw
+PFKknidSBB5kkl9OxMPO/zThUnq6KtMgHAJzvkAccIJJ4z9nPGl3EqXfdgme21HrMj+xDfv
C+nEJ2796v5AKOD35Cc/eX27gtVGH7xgLkb32HnnnTfalNV9dUj6yzX7Yif8yUNIT1hrr77R
//KsmrGvb+nrT8+Otnp1zM7GFUo48s2umOJ/ONuHP0gPHPRTbNkvChPiA5hX11638+0DKIKi
PeLW79rjeXIveZ2uH8VO/ylPecp4ZZ7rlPGl3KGtv//7vz988QlnXwT1IYl9H5LF5/nxHP3c
z/3ciIFNsbMRkY5tfTIvi87GMxtEPXXY1R8wdog5dpV7tjyL0urqB/F6voyBSG/6TfyEjmcD
0U9M6rNt36wP2/LTF8YYedotBgJv+5+Dx5//+Z+PrQ+wz/3LD/GMef6MzcYo4l7nz4c4HzZO
WLsfX/ziF2/Zf9lGlPhy7yWurcZ/c4FnSJy2H/nAKg54B/sRYP8UgRVCYNfIv0IBN9SvRyAD
mFwDtgHJAOowmNvXaeC6zto+KgOW162uTZDHrq28+UJK9nHd9773Haua9DJA0rNiIW9+xC9/
jkwIBmgTrRVYK4zq2A+JtIkp9eSbpCImnHPOOWfoG1CV2xNnsDURsKsuXyT1tUXaZOcw4WZP
nxUkr7CV29OXOF3HBnxM/rCTT189X7CbD+zKXCMV/Mxjhy0cET4Tlu0bSBYRc2JETBGm5CPb
8kwq7Dky+SHXPnzwiXwjWZFgCHNtMglHQlbnZ1+kYU8bxOfsyy3aIe1gi13+YO0a6VYmj5/7
3e9+YzWcLyTQpLm/8SV+dubiWrvgbduDM5ytXKqjv6ye2hYgRveY+0XZXLRDO4MVu9IkZ2l2
EFf9Qd994IOZ+5/AxL2V+yl++NR/7qHgmLJRcT/+uFfEKx5i1d21L0eJB+lKv8rXf/ZEe/bc
1/ZDe97FRde39t0X6so7du35twrunsv9kvsv18HZs6xdiKM3H/rCcwIf8dGDAb9zXPlxXzs7
SJ4d17mXnef1kMGIfOXpR/mxpUzaOTjpR30i3/HABz5w3Lf2ALtvtUM5MS5ZyTVWIufarw6M
rOASz+883wd3tuTB3b3pw6j7EQ7i8MHLh/m0L3jmGedDOs9Y7Ptwb8WWne30n5VlH2TYgoG2
8enMp34y9qX/3L/w0W/yLGa457XDhzZ4qJ+4BwD9UwRWDIEj1r5AcMVH6hULfqeEa0AyeNpP
eOsfvO3aSsp/XBuorPpcaW0QumiNMB2/3tRdU8OuSdngSEJsMrDLMzG4NsARKzkZzOkbuAnf
ZG7LIKcevaTpGCgzkLM1r0s3/pG8X/u1XxsDu3raZqAWE7/sGMjnwpYYnGNXDAZsPuexZNBN
2+hIpw3qx0fsKjMB8T8f+OWzP7exUc81+4lZP3mdKCZ5iZEtfol8E2Xa7Vq5ePjnM3HEX/BI
vmu21eM/+LuOz+gGM2WROWbyopvy2GY398NcT/kcV2Vi1c/8qOfs2Nf4cs/48JKV1o14zO8t
bdBWq+K/+Zu/OT5AuLYVxJ5P91iwmbcT3vTEyj6Z34spkx+cEse8zLYFRGIufHoe5njHxlxv
b9OxAWf3zzyO+IxOynLezFf6K/f7HBP6wS33hT5lT730k3EEbso2CrzgG1316EV33sfqwkvZ
PB75aZMzSX2+fTBLuTLxiTf4zGNVTtKP0soJffnOsR9MlcfH/N6TPxe22Jjvq2VrXieYqjdP
z3XiK33nnDx4RvhzPceLnrzo0dGmuS/16UXE6Noz5AOu8dqz54OJD3j8L0rmlpi98MKLhg/b
Nqzwf/pT/zjuJ+Mk4Vt8iX+RsSyqTbVz6CPwjaPToR9zI9yAgIkkk4kBk5hoM2AbJLJSZwCk
a0A2CGZglDaIKMvAkkEfkSMZMNlOvVGw9kc9vvmy0pjVWv4MllZ3Qp7YIfTZcc7ArD7/id15
Hpe41Um+dCZodUna6Bw79OI/g2Xapx4bEXr0o8dGYpafiSyYK0v80g54OhKLeomPr1ybTPnT
rvhLHOrT5R8pSAzJZ2PePmkHnw79lL5iM/bVJ7E9x0U8bCBwytmJfkiNPHsCxRMb+xofW+Iy
sQYf8cjLvSwebSXSfFo5NBmqLw6k9t3vfvemEyJ9th109Z+9u+rOnws+tJUPkjjEktjUTZqu
foMxW87suy/4dOyPJI744yOSe4+OcmVicXadI33uOv0lbrFpb3BVT3udEXe60o74YgNe8clO
+shZfbriIOqmDa6zTUOaLbrBjk+68ceG69TXDr75Scxs0BcroZNYXSsn4mJPedqV/NhXLhb2
1Us+e7GTdmk3Ycv9wK5DHc9PYpCXe0BdabbUj908b3S1hTjTdZZP1ONP/rz/+Exc9OIjtlKf
Xo749AsjVm6zZ904bbuG8T712KwUgVVDoMR21XpsQ7wZdA1GBnwDpoFrLvNBzqDomt58kM9A
qh5buWYzgzdf8iOu2aJjIGQzA6tfJ5DnMFkYNEkmBSSJvsHW2eAsbjFlcpGX2OMzceda/c98
5jPDTmILJs5iY4Men4ReyHrK5NPPJCGfnvjVjSQesaZ9ysQ8b5t2aHNiYMuR+mm3yZRol1gj
4mCDyM9qpvqOxMV+Jjp5dOcHwsmXPP7pssu+tHzCjiPxzFcl6dNDLCK+bEWfKNvX+BIzO9Kx
KQ2TtE0bxCyfwN/2jNRxfZ21167aSNQjYmNTvnYg7MrcM+q6J5z1Hx8OEj/pr2DnOj6ckSb2
xMaXI19mhP12Rb1I0mJw6BPnub2U0RWH+MWSuvLEKja6c0n88qSDK5zowogvaXYjue9cwwme
6SNnoq44SPywK655HMrElnFLvejQZyP6Ypn3A7/KYl+M6kZHe+I/eLCXcuc5Lu6d+NOu2FWX
LdfOaRf/JH7iQ15wkBZjdFKXb/VzT+rbtI8dcUW0ax5n8hOfa7Gzoa40+9K5j9Nm/mI79xM7
trKkD8Rr24/xXr3gH789F4FVQeCKGXtVIm6cX4eAwcmAZTDKAGvgIpmUDFIGNpJBWZ6B0ABo
8E05G2wpI7FpkKOTgTITgDzp5CMK0hnQ5/XZy6AekpTB38Avbm0xObCZyUBe4mGbzdhn0//m
k7a6ZtORCUCajfgUszZGErvY4lMZPb7EIk3SHnrqpUzMwTYrS8rFRScxsRFbYmLPNV2HvLQ9
dVzTy6Fdc5KedsY2O+rCSEyxo5wtMYlfGV3Chuv4kCdNxKceSV7SbO9PfNrrIIknGCTPmZ9g
ru3ulTmOdHL/iFF/aL/YtC33i3z1ci+kXfKJ69gdGZfn8Sk+whYfsHOWrz5cxSmOxDsq7OEP
UsNf+oFq8JSXuKXz4YEfbZJHly/+g5syNpXJj15wdi1u5QSuiZ0t9bWBqC+P0FfXdWzIpy8P
Rj4QOSfueb15HGKBW/qU7cQgNkJfnnYn9sSiDHbRTWz02STS8tOfYlJfHmGDaGvIpbbMbbLl
Ojal2Usee2m/PLYTq7R64iBz3yPj8j/al7GYrQjst+q/3PNsp8+kxZI+0DZ24Z1YtD3l0sFi
Po+wUSkCq4hAie0q9tosZoNPBiUDVwigwdWg6Fq5gc3ZdQasDIQGX3WJSYkoo5eJIYO0QXMu
7Koj36CJMNDNAJ10BlRxxb88MSV+E0YmoeQZfLUjA3jaK2Y6sRt9sWlLrvkXW+JRHh+wSHuT
Nx/s1Um9tNt1JlR59FMmPyJmkrN2R48N9cSZ+OhKy7N6RbQh7UhfJD6TYXCky7Yj+s6ZVKXT
jvSHOkQZDNL+2FGW2JzjSzq62hZ/+xqf9qZvE788on+CKfvKnd1j8NQmedFXZ57WfjaINBF/
YmbDNfHbohHl0cn9ESLMH1vqufdSX93EHzu5N3O92Vk/5jlQDltH7OcZZTuSeypt0w4yj4UN
WNFxaA9s0h66uZeCIR3p2IU9O/LiX/1gMz+nX8QBq3k/0Ev/KU+ZPBL7+pOu2OJXW6XVgRMd
Z3mwoxsd+dJpV/LV4Uu/zWPmO21lK8K2IxJ85fGXOJWzJ372E7dY/eQagaE4lKsfW2yQvDka
F2t/gpW2kO30X2Kir+25P3PPz9sW7MWR8sSX+yQYJUZ2K0VglRAosV2l3tokVoNaBkHFBikD
lAHMQBqCqswA7DoDvzx15/V9Yjfo0WHbMZcMeqnDpolMPt8mPoO4QTF+Moi6Fhc94sxOzupk
IleuzODLB1EuHr4So7qxy68jon4mYnXYiU31+QpJSj3+lNGFXyYevuU5TBSuldPXJn4ygczj
YIvwGyznr2uVqR+s1M02AHUy8fKnTLx8RdRL2+TFhzT9YC3WCB1xxTab7BPtS1od18E79WOL
/djY1/jYJ8GAL/a1Xf/AlI6Y+Uv7gmv02VCevnMtPb+fUift55MfYp9h2pWY5MMm14lLvnSw
DQa5d9gUV8rp704SY3yLDZby1Y9t9nKPxJa28UXPPRFslNN3TceR+zj3uzYlvtxDbKUOG7nP
0x556iNr6vMBc7GLWV5ilO/Ivao8ZezAni/tTKyug0Py6RK22CCJW1z02FUmX1o/0FeWOny4
JvxxyqIAACAASURBVPN82NAl2iXNjlgi6Ve2El/ssSWtPST+7OGGBwzZjE7uc7ryjbfaIQ76
8vhOG7fTf/TdJ2IRqxjZcSReZe4BcfAXkU/YSOwwVLdSBFYVgSue3lVtQeMekw0YDEgGKINh
BnsDm8GMGKwMniYnomzjIK6ewdcASehnwMuAmHrKYjtlbItBWWy45juDrrIMuPzHXgbTTIYZ
3OeTe+qxGfuxGz/ijk3xxK58Nl1rkziSji/X80kqr+a0U1nObMUfO/MJUn7KYosdAqcQV/WI
szYoSz0TjpjYjY4ykv5zHQzYEFsmKuno515QVxvSxth2rT7/4g0JghEb6sePvkhandiQjr+9
jU9chC3x8ysOcelHZ+1xEL7Sr9LpS/7Vi16wFz9xTT9pZxjz4YgdZ9eRpOWn7WkrnfhJmh6J
r3Gxmz+JN3XEDoPYhIn2k9yj0nne5EkH85TJVy91c/8pj22+tC19KD92c6avXFuCYz7AKSNi
jx/4pE9gJK7ck7ETPJ35zDVbwTUxJU8+u/zQ59OhfvpbuXY7k7RTHTrx5Zx46cVmSGjyYidx
yuczOLATm8mjk/YmLXb+6cAVRnymTWzy5UhblLtOnLvrPz7YhFewY0/aIU2cY2Met7T68zbO
bY3K/VMEVgyBXR8zVyzohnsFAhkgnTMoKp0PctFW7sjEQEc9g17sZGLKQDe3GTv0DYYmkdjK
ABo76hmYDfL0DOps05MffTalY0cZPZK8eQzKSWJ3jj3ntHtjncRFR1nKcx5GL7crPc+PzcSc
65xTd15H3sZyebCIRD/nlKm3se7G69jIObGZqDZK8JS/mZ3kxX8mwNiZ158Tjvjcnd3Ud47u
xvjS9uimXP7GssSZ/Fyrmzzpeb7refxzPWUksUmnfJ6XmJRHoud6rus6/uc68rcrG/1tZi99
xeY8Pb9Ovc38JrZ57PJiK+fUVbYZjvGRM/3YTt15e5TF58bzZnXnedGP3fhMrHO/83T01IuN
ed48vqSjN68Tv3McUj7Xjw0xJE1vXi/+6STWnOnOy11vlLlu2p86G3Vdz/WTTsypv1m9/c3b
9VF07UPe/hpq/SKwFwh0xXYvwDoUVTOYORugEE5iQEUMEbkcrudE1gCX+uooI/TVR0pjT132
56up9AyOIY1W+thz7bUe++qE1LKtLAOra8JPBtnEpH7ykCn18hNTu2rtGvzFpY5YnB3szdul
LbmOPhvSlSJQBIpAESgCRWDnIFBiuwP6EkFDQBHIObkNMUT6iDIEj36IXohrCCW9ED6EMDai
n1fAfKlDlCGT85U+r/WQUxL/yKkjIj+EVJ4ydvlP/dTlw09MRS+2R8baH7HElrij56yNXqGz
mzL5aZt0pQgUgSJQBBaLgJmnq7WLxbTWtkagxHZrjA55DaTvbne729jP5v8/Rz4RRKLMgfgh
dvIRuuxbRXYJUhjSecIJJwx9/82kuvLVR16JdF6rWcFVd04Y+ZCXPWtWXNXxX5RGb06oxUOf
L7rSbKgvTehL80fPl31cq8t2yulqp2t6YtZGdudEVt20V51KESgCRaAIFIEisPoIfOOGvNVv
02HVAsQNWTzvvPPWieujHvWodWKrDBlE/ubkThp5RFBjA9lDeN/+9revE8qUZbVTecgnm/Mv
rdBFJuWxRUIukUpbFZBJeSHUsY+I/sM//MOoI2b+Up+t6Md2yHP0lMenPO3iiy35Ibpz23Oi
O5z1TxEoAkWgCBSBIrDSCHTFdqW7b9deWgQTmbMVAOl0nRVVxBEZlP+BD3xglCl3WEGNIH/y
2EhaGZ3kW0FNnb/7u7+bHvrQh063ve1tR/mll146SCTSSt7whjeMfHE85jGPGfHZSqD8ve99
7yhDRtkUF5L5gAc8YNRFPl0/4xnPWPctht/93d8d5dqqrjy6bIrZ4b9W9asDyh7+8IcPv9Li
oEvod7V2QNE/RaAIFIEiUAR2FAIltjugOxE9RDD7TpFFhHYjebve9a43vepVrxoE8P3vf/90
k5vcZKzaInzIn1XQ1EMSL7744vF/iX/oQx+a/uVf/mU6//zzpxvc4AbTRRddNPydddZZ0x/9
0R+N1dBjjjlmIMnnBRdcMN3rXvca9cXEr/h8+Yvc5ja3GXFYRX3f+963Xv7Sl750lFsVfu1r
Xzs9/vGPH7H6sfOPfexj05Oe9KRRzta8bdLiFw9iS1/8rt/0pjet/1g6nLSRLmLMf6UIFIEi
UASKQBHYOQiU2K54XyJrViCdCbKGTGYlM817zWteMz3ykY+cTjrppEFeb3zjG08nn3zy2MKg
DnKYVVB1EEN1Hvawh01Iq5Xca17zmmMV1GosAny7291uOuqoo4avEE2xvO51r5t+6Zd+abr+
9a8/CO3jHve4EZ9VU4T1F3/xF0cc6tAR16tf/ephk2/E9R73uMeIIdf80Ee2CT8kcYv3+77v
+6aXvexlY3Vavjx7j/Nj6a6zkq3N2lspAkWgCBSBIlAEdg4CJbYr3pdZvQy5dXYgdnOxyvqc
5zxnrFbalqDe2WefPVZMpdWxkhmRZuP4448fZYgsUogQI4iuEUP1SPwpU/emN71pTA1SiwTT
sYXhhS984SDD/CLg4vrwhz+8ri/BLlt3vvOdR6z06FvNZd+hnB6SKv2TP/mT02/8xm8MPboO
wi99NiKJO9c9F4EiUASKQBEoAquPQInt6vfhIG3IW8hciJymIXRI6M1vfvOx2ooAIocO6Uc/
+tGDHKrjNX3EtVVahJgghWy9613vGkTRftn8QoF6WQllU13bEawiuxaXL6Qh1Mcee+z0iEc8
YnyRTJnYnK0MI5u2UbB37rnnjuvnP//5o5xN9r7ru75rxCMtHqRWbCGqvjjHnuMhD3nI2Kc7
J7+j8tqfrHDnuuciUASKQBEoAkVg9REosV39PhwETzOQPwdB+giCh/h5Jf+85z1v5IWk2uvq
C1pIHvKXFc6htPbn7ne/+3TmmWdO9tj6RQNf8jrnnHNGPkJKX12klh95/D/2sY8dvnyhTP6z
nvWscaZrK4Q4Eh+Cfac73Wnsh73uda87tlGwhxifeuqp0w1veMMRzumnnz7OyDQ/hA2rxq7Z
Pu200ybbHkLa03a6aXPquq4UgSJQBIpAESgCOwuBEtsV788QWcR0fmiWshBIxM/+VNcOvxzw
4Ac/eBBBBJWu+hHpa1/72hNy6gtjfjfWl8BsJTjuuOMGqUUO4z8rp/KQ4EsuuWToW6VFUvlA
SgmCbDVYHFe/+tWn+973vmPFFhG94x3vOOL46Z/+6emMM85Yj5dd2xJe+cpXrpNU+oQd9p/+
9KdP73jHO0bbQlzt3yWJUx3kdt7WodA/RaAIFIEiUASKwMoj0GWrFe9CBA1pzUqk5mQFM4Q1
eb6oFTIoz5fMQvLm+ewRq6FHH3309PnPf/7rfq9W2TWucY3prW99q+QgjdmK4BppRYLZDqHM
/l5+fuAHfmBsIUjMIaHq+j1eOurNY6Jrm0FEjAjtF7/4xaHrWry2PBAk2s+cxT8s2KATURfB
rxSBIlAEikARKAI7A4ES2x3Qj8gtkheRzookcujayinyh+DlFwHsZyUIH3IZXWd5dHPQy15a
ZakrP+Q6cSCT0vO66ohDHhJMZ05o+ZSnnG4IqDSJrm0GytI+xHRej546SK2z6zk2w9jlf/is
FIEiUASKQBEoAjsHgSvePe+cNh12LQlxQ1wdJHk5I39JI4YIorxsIXBWnu0CIYTshQAipMit
MnXluyYIaST6rhOTOvJTxh9hJ7GxIS0+9cQoT10kVRmCHhuxLe7EJS+kNzHFrzM7uWavUgSK
QBEoAkWgCOwcBEpsd0hfImuInEN6LiFwCJ/X7wRBdI1EInvOyKaVTvmpM7cnD7llP+RRPRJ9
aXVcz2OSj4CGXGfrAjuJFykl4mBDjPRdI7d06SiLjjSdrAJLR086ttkVE/3kpQ3KKkWgCBSB
IlAEisDqI1Biu+J9GEIZsuZ6I6FD4ELidrenNK/4A0f0XYdwJi/2nR1EWdKbXctDKiNzXTGH
sCqfl7lGaok2JobkjYLL/yhLeXzFlrr8BJ/Ym9dfVlpsOcSAtM9F2UbZmJc6sbOxfGP9vbne
aDO+5jbgupnI36if+4l+4kyeszrJpzO3nXRW3pVvR1IvfvKmYTt1t6OTNm7EKv7Snrkeu4kr
+blWpk6ug8tGe/S2kviOrbQ9traqf6iUJ27xzNNp30aM0t5DJf70sTgT83Zii27ak7anvWxE
x3MRORT61+xwxSa5RNZzETiwCJTYHlh8D7j1DHYInW0EIXIczwe53QWiPpJodZQguBkkpUlW
ZdmLzQzSQ2E//vCPhIaIGoxDWvlXnjYpy2AtL23fk3tt8SsN9NlNPXZid0/1D3QZPMVhsko8
8BZ38E7M8hzBJOXy0kdzW+mr/WnDVvHlHkmMfCVPnO5LsUknf97X6rmX5OWsDn33s37KhxVf
YkxZ+nI7beNXvXmf543BdurvSQc+e8Jfu/SttmkTLNQRS/BxhgMRZ54tduk52FEWnNXZjnhD
M7fNlrbH5nZsLFsn26PyVkZ/pg1ig0UwhBGsgtuyY88zKD597wu74st9v1V82+0/9uDiudj4
nG3lo+VFYKchUGK74j1qIMtEaRtBJkUDnbKtxESQgdCgO3/9L51JhR324s/EEl9b+dhTOf8O
k7g4DPpEOrGYpEj8S8vLhO16T+JXGtIOdfjbbt092V1EmTbBUVth8IUvfGGYTf8p11YxZwKX
lhc80hZ12WCLTeX7K1vFxxdJjHBOXvLTV/Kls+IkbtcmfPGG9Em7D9zPzj6YED85R7SfDXW3
Es9G/LKlLpnHsZWNPZXDZ0/48+9ZcSTu9Jtr5c7y0r8hQPKlCUyIuOVvV/KGJvc/DObP2Xbt
LEsvhDD+4aA/4aYtEZjkfghWwS46yzjr17n40m36eWPZXC/prfpPu9nLfa6edudDUews6+xd
0ze+b1pWNPV7uCCw/RHycEFkxdppUDNAZpCfr2SEsG7VpEwAiAR7JgZ5JkN5zlbLiLJMrDlv
ZX9P5ZmMkAMTVmxmcJZvkHZkQsh1CMWe7NMJuaDHHwIfP3uqe7DKtIeIzf/o5lqM83xpfeyQ
Dm5zXXXn+YuKfx7HxvhSBk/94/4jwVi8ytKPaQOdef/p79zLuR/dv0itDybuuxBidflhaytJ
fO6B3D9sqZtYt7Kxp/Kt8N9IXjb6nJcHJ3HmV0fgKFaY6FvnkDrt2ErEl+eYrg8/nrNVEZjM
+zCxw03705cwmWMEM9gdCiJ+7dB/7un08/z+312c2+k/9uDhWYFDMNuO/d35bX4RWGUESmxX
ufcujz0DfyY6g7oBNJPAnpoYIkQnA6EJwuQaoutstSzEw8CJZPCzv8KGuENatEU6g38mcbHJ
S756yrYSOqlLl32kwVl7li3aHrITkiNmMaY/5EuL2SEdXWm6wSL5bOZ+2J82bhUf/3BM3zi7
p9wzBKkSc9LO6XN1pZWnz5WnLe5fpJa4J9O29FvsDoXd/FHPhM9WYtxoZzdVt5W9J/y3ZWCD
Envzfsu9Sk0ZET/Spm1biTrRg5cPJpH5s5+8Q+0sRu3Vh/qP5AO7djlgkT4NRtoKu2WLezUx
udfdh+KXl/t4TzFu1X95Vjw/nhU4yMu9vifbLSsCOxWBEtsV71kDWIhBJjBNMoBuZ8XCYEvY
mE8eGTDlk6w0ZDAOGRuF+/knExQzBnKDcyZd6UwMczfRm+dtllY/REpbXJsEtCMT5Wb1Dlae
tosr7XWWJ0Z9kElKPNocLMSecrrqzG2wKW9/Zav42BdL7jV+HeKEcT4c0QvRSBvlEbruJ+1B
6tL/aY97TxvTZvp0g8UuK5v/ZW++4pvYaOde3rzm9nLFsRn+26u9uZZnN7HBIO0NHtoQLDe3
cEWu2HL/JxeePnDk2U/+oXhOjPpQ/+tP+MxlTv5hlHsjeM11l5Gef1ARU+LXnq1kq/7zrJA8
P9Ly9O/cr/xKEThcEPj6DUCHS6t3UDsNlAb/DHC53u7kF4JHP6tj4MmEknMG41wbNBdBnPg1
eGcyF//cbtojJhMW2djWkbmbP6lvEgkRMglkwthNtYOaLS7x6YvgO//gIB9OKdMmdYJDglWe
/kxbU7Y/5z3Fl1iQC/0jBnEFdyRK3yqT775J3PN20Zcvj6StSafO/Jy2jgq7+eNeoje/p+Ij
tnZTdVvZcxvBfx77toxsUHJvinfe5+4Px3xbwXban/so7Vcnz/IGt4fsZQiaNqQd7quk82wH
m/Tv/vbDIgBJv+nLeX/q4/TNnvxEJ23drP/ybM3vxbwx2ZPtlhWBnYrA1h8Zd2rLd1i7DOIX
XnjhIAQG0O2KgZd+iJBB8u/+7u+mu9zlLoOMGEiRjkj05oNoyvbl/CM/8iPTVa961em3f/u3
x8TNbiYBvjM58avMkRhStie/dGJHvQ9+8INj9dmEIX/ZMu8rfSEmfUDE6zCpfehDH1oPVVpe
yhWooy4bkbnt5O3teW5js/jgCONLLrlkvW+C92te85rpsY997Igr/Zq4rfCyp677NmRLXoiM
Nl100UXTj/3Yj633FduO7cqrX/3q6dGPfvS4h1MvuM3btl17G/XYIpvhv1F3O9dPe9rT1vtW
fGJ2hgsfCAufyduOzTy/yOCll1463elOdxr1t1N32Tra755xn8FA291LPoQ/+9nPHnmwkA8b
GNELdsuO/wMf+MD6czq/t/dm/NlT/2knPIg0gVnuy5HRP0XgMEPgilnwMGv4TmuuQdNBMtBL
G+jn541pg+Z8ELSSEEE6lDmTTLLSVkciGVDjS740fTI/Z5CWr97b3va2Yetxj3ucrPVJIDHF
D93YURafOasbn8nLObjQ0ZaQLHbYTNz0UyfkSp15zK4JkhDZrDw26SRuenMfytJOZ9iLVYwI
/7nnnjv0X/nKV06nnHIK9SEPeMADxocP9ujQVSexB5/YTn7qu077ErsY53FGN/lsabP41L/D
He4wve51rxt23vjGN04PfOAD123SedaznjWddNJJw2bwT1xsz1eU+Ag2yhAZok3SsIxf59jL
WTy5b9MGdc4444zpJ37iJ9ZX5+nxI47EEv3hcPaHroMEq/iQx74PSRGxiid4Jn9vz09+8pOn
1772tcN32pcY3beIPhE/SZyJVV705UmLjbDHhrzdxZk20lE/enP7sTuM7uaPeqkTG1FNfq73
dA4G2pu4YS/O//bf/tv0J3/yJ+tYsJO20k9d+RtjSJ8qIynnwzHP4y8yT0dvnhc70Z/3E/3E
BAPp1J3XU5ZrddIm+hv7L/b5k2YvPtSN/ZzpzdPpC7qO+KU3T7uuFIFVQaDEdlV6ajdxzgem
DHLzAc1A+L73vW99FYjOxz/+8TG4qfvnf/7nY0CU73WylRADWvZMykdinA2Yzsr/+Z//ebrN
bW4zPfKRjxyDrbJnPOMZI0pkFNmxCkefDl2rFwbpkEJ1XNNBYNTPtfPznve8dQIU//O4tPPD
H/7wqK/cF9yQDWmC9Ek7fumXfmm0TWzxIV8MH/nIR4ZOVoU++tGPjnguvvji6Y53vOOIP3ZO
P/30YTsrjDBk78/+7M+GjdiGu5Vv18985jOHH/giLWxdcMEFIy+TiYn2ale72lj5TD0rlbD+
8R//8WFHHW3SR9e5znVG/etf//rT29/+9nXfI7i1P3yw7RBz4kqb/+Iv/mKsAv/oj/7o9LCH
PWz0FbL5O7/zO0OXHf2lndqi3ic+8YnxIeSTn/zksHviiSeOGGCk/GMf+9hw/1//638dpOMN
b3jDuN7THwSFXz7Eyc48rf0ht+wg8a7l/+mf/um6/hOf+MTpzne+86TPCFL78pe/fPKhgE34
wsBB1Nf3DqIfzz///PW2isHqJmEXgXJ/0LM6rQ/uf//7j3K67JHYHxf78Mf9ee9733vEa2WV
T/Yf/vCHD2unrH3A0X5t0rdZtcyzBMO0yQeP9Dsb8j0/6rkmt7/97YctaRjxR+jwof6rXvWq
0UeucyiHda7d2yHd7lP3rv5Xn01+3U/S4nCPb0eCK9zTZ+qx+/M///Pj+Z/riIdtPhJb4lTv
t37rt0a+Z025Z5NI62d2Hb/yK78yzvy672PL85B28sF3+h/e2hdddt3f+ssHPXoO9yasYWis
oQ8/Z7adxeCNh7Nr9bbqP77oRei73tP4z0eev1NPPXWM9d4IscV3pQisIgIltqvYa7OYDVwm
Q4OfgYxkEJQ2Cd/qVrcaA6jB1KB/3HHHDRKi7G53u9sggwbw//Sf/tMgcgbvDKhIy1Oe8pT1
1Rf5Dj7/5m/+Zjr22GPH4P7e97536PGJXFope8973jPKbnzjG4+0+PiZk0ITgzyE7/GPf/zQ
d832ox71qDEBuM6EawJwbVJg7wY3uMHkdbO8d73rXROiR0yi97nPfcZrbmU/+IM/OL4cBxt1
s2oBjxve8IbT+9///uFL7Mccc8z6tg4ryje60Y2GfbperRM22XDwdc973nMQIe1B0OHGj4PQ
Q5yQVL5MrGwQeJr8TP7y+Dn++OMHTtqob8VgEuTnzW9+88BJXcTth37ohySHmJD0M1HXYcIK
ziYyGNz1rncdk9df/uVfTje5yU0GNvrwSU960qgrjutd73rTH//xH4822C6ATJsE9at7ik0i
9pvf/OaDrGvvv//3/36sxOe/bx5Ku/mjX8WsHp8OvoJz7kM6yNJTn/rU8ZNVSDQsYS+Oo48+
enrrW9864mPL9oO/+qu/mr7zO79z4CFGkv7YGI7J/7a3ve3wzZc+ci/pC88Fcic2glCHvLv2
E1owJcF+XOzDH+3Vnuc+97mjzz1njhe+8IXjPn/JS14yrGqHZ+YJT3jC+KAoZvducPOBz72C
KInbPWl7kfuBD3LrW996+s//+T+PcvdnMJLWntj8yZ/8yfFssYOg+XABl1vc4hbjw5F8+HmO
9Idn9C1vecv4cKMtv/u7vzv64SEPecj02c9+dtjwQXM7kljpBpvU01b3pOdD7OIlxptXvOIV
o115lrT7TW9602RFXLzuTXjlTZEPCJ45ZY6zzz57fTXYeICky3fvsy9NxKR/tPse97jHGG+1
+elPf/oYA8TlnuBfn7m3jXOuHcav17/+9SN2BJxt+COX973vffeq/zJG8ueDlwWErcb/n/3Z
nx3PCZ83velNp//1v/7XuP9iazSyf4rAiiFQYrtiHbYxXIMYsmGAzaSNIBk0iUn45JNPnr73
e793TFbXve51xzXCYoXBStC1r33toYuQnHfeeYPkGJCt5iC1BuyIQZvwyx8iJI0cOQzIBmqv
ppExcZx22mmDWBo8I5mETErk7ne/+5gs5DsQJXWtLtORF9/0lZnYTZbIuVj4Q4YR3f/5P//n
SJus1JNP4BRsXNNjI5PVsWtE/RGPeMRYLTG4860uTGGHHJgs5TvgBEt1rnWta402mHCRrEwO
mch8oEAyrWYjQ8rnscReiIX45Pm1CmfEOPpWxdTXPy960YuoDgzkicnECzOTbkiXSRXZN9nB
JB8wkEA6sLJKiNRZgX7oQx86thOIR9ljHvOYMcG71ufqOIsJ/ib3xOfa5LodSXzuE4JQi0Oc
4mfLPQhHhFzcf/iHfzg9+MEPHsRGHfehFbfEIw5t/Kd/+qd1wpatFPLhSdiHE4JvBRaJgR+S
9qAHPWgQWgTx+c9//qij3n//7/99Qghiz/PHBszV3V/xDLkfzzrrrIGx9rJva4f+1UZ9gNi7
N9LnnmPtVv9//I//Md40IE7aCFtvZ2Apztvd7nZjdd6KPdEH8mGT/mAXoTdGwIN4++LeRvTg
5Z5Xx7PhOfqjP/qjcQ2nF7zgBSNWz4N4+Ud6xcKGWLYS9YhYtE1sbDusfGZsggmcvNGwkvtT
P/VTo564PJvGCveHWOMXKSbIP7yRWQIvWMDXSr03Gj5UqWuMs5prXHXNr/43lmqXZ1w+wuyt
CDuEDWnP0S1vecuxsGCcco+dcMIJo8wHqVPWVuR9KIAjPLfqP3XJvP/cg9oAj63G/1/+5V8e
H1Jhq13ezgXzvFkbDvqnCKwQAiW2K9RZm4WaidRglAHJ5JHB2cBrUjLIEROk1bZMkAbTkADl
Jgz1EVx6XovKi226bFsJIwhfYlDPtYnDak5EfYTSObb4JwZ7MSkXK5Lqtzb5YYc9+YTOXBAp
2xWsfmbCs/Ji5UN7tU3cmcisooaA0DcBmZQyaYstk5c2WdURn7S2sZWfREvM9PlCiMSciUyc
dEIcXNOlR7RFOUn71BUrO/xEEES+EffoioeOFTCTpRXMtJMdbYFxSBdbiIgJ+Ng18k7Yojf3
ZTJTB3lH5uCk/fS85v7bv/3bkSemYONML20bxtf+bGdi1C62xc4GQfph4HAvIEHIgBUsuKmj
zIqjukT99I14tI3u1a9+9RG/6zwD6qgvT1vh9C//8i/DR+5LZXy65g+5Q/Lcc/AOAeZXv9Jj
l+7+CjLiXnUvJ9a0UxvTJ/Hjw5Zyh3jEoO1IkXtMG+Ur15dWst1LtpLAZB6zeiR9p210k+86
frwFke+Q781B7lV5fPMXUY/M75uU7e6cOmxpg7o5fOBMP9Kj4779/d///YGRPIfVbx/q4Oba
M5m0azEirsHblibxw8CHK4SXH3Xkn3nmmdOla9tUpNM+41Tuf3nGSPrquc59pZ3y/Yc3PrRb
gVcuz3HOOeeMVVP94sP9Vv3HLuyJtoiJwIq4j/c0/ofcizdxqKd+nhfXlSKwSgiU2K5Sb+0m
VoMXQXYyyBmUDHQGPgMoHYOpaysUBmKDrolgPlmZNAzoVmsN9FYaskczE4uJEhGIT+f4RXj5
9Vqb/nzSHBXW/ig3kBIDsZi8Ind+8YtfPAhK2oTYGHAzYGcAVtfqiNWYz3zmM8O/2LXL61m+
xWCyUJ/YVgCXuW/xWQk1gRD673jHO0Ys4iHRh5c8dZzVkceXVTKSa2d+P/e5z61jw7b9EuSi
fgAAIABJREFUvFYk4aVN6tJjUznsEarYY5N/q6gmKHsCrbJYiVJfXSuuL3vZy0b99EOIifpi
1Y+OE9ZWePjkS4xsICP6JPcEm1b/kDl24Co+Z3tZ4f6///f/HvcU+/J9mED4IrGd692dxTEX
/a7PETht0XZbBLzaRWScxeweFAPfhD/3v2ttiSD++kmbSPpMWh368tR1vxBtpe++0H4x2lqD
cFoR/Lmf+7nRdn5ywJRsbM/I3Ms/YtInWeVD9PVxfjEhvhBtfevDnTqJFT7apk+UE9eJ1bNt
ld+Kd/Z+wkC5MwmpgQNSqC/Yjz0Y2S7kTMTkA4hr/ulHN88PPf3Kj36mt5XQiQ+67PIlFqLd
YtU+/tyb7hMfSukqV98Kavbcv3htjJEXu2IRk7FErGxbmUaIreTaNiFutuJf30gT8bh/kODY
dH8qd52xLPgqo2/7jDdbiZFf+t6cObsfg+Ge+g9GwdgzTHK/q7+n8T9vRcRExMCemCpFYFUR
KLFd1Z67PG4DkEEsg5uzAdUganA8YY3ImLzsubMSgTAZsL2StgLmdWe+yOT1s9WM2GPb62ev
eQ3eBtcMwgbC+BSKtEHVBIAEWO2zh81E75WbV70GWbHRzcCfyYGuV9/Hrq0myjP5EPYMttoj
n40MulaTTersKSe2NCDiXvnbl2jgJvb5qZdJCDauYSDWfPEJgfyDP/iDsYKTyV6s9OMj/uEk
zx5ENhAAdbxy9arXZONDhA8I/CqHvbjz2li7tes5z3nOIHAm6e///u8fWCJS6lk9h6MVoX/3
7/7d9NKXvnSQlsRhBe4XfuEXRjthIZ8d2BF4wBBRFbN0hH3+xW2yha96XnsHW7r6Xpvs1bQS
SO/Na3t9if5V3wp5YspEOxT28If/CAIgPmf2tUG7kTz5uRdh7j5F5t3PbMAKsVLGN319lgmb
D7Hl/hFv7ht5Xl3rQ/a01cqsa1sO6NqOYLWaT9sh2Eei2KTPl2PenrRrb8/3ute9xocXzwP7
2o+owcOHovjwTNOBO3FviUF/egbdU7n/kWAruz7cwsg9YH8twhe82YCFaz74Fgs7cOHf1h2r
yZ6bF689o54b+vZ/2x7i9T1RN8ImrIm2RMS5lYjTPSBmNsUFb7Foq3x5bDmMa7Yo8EmP2BPs
voUFQupDoXvEymtsIsOeD3bV+/SnPz3uHeOJMdKzwb54bJNxb/AdyXaVfMHSM2FFXLvFQsQr
rQ/ELFZjFImtEy4frz1//G6n/2KXncSpT7Qt9vY0/n/qU58a8SD+vogKb3GLsVIEVhGBr18u
WcUWHOYxG7wcBt2b3exmY/A0MBuUDOb2tyGuVtPkKbMSYPVPPROVbQMZxJxN6tFFYqwQmsj5
IAY9h2vEgS5b3/7t3z78q2NvmrN8E4b9bYivevIc0pl8rEhJ25fHrtitLNnLZ9IxeNMn0onP
qhrCHiJlErZXjC1EUgxin39ZhW+DNzl2jUhrr8mOyH/3u9898JJPTBJsECQn6UyqCKcPBVZ3
TFwmPzGa9JHErLzwizgTen67FylhT1q72dROryjt53Mt35dzkvYFFq+HgyNSpx30gin/IRH2
hFqF9pqTwMbKb/YmqxPbsUHPaj5dfsToC1P5sg0SJQairnaxQ5fv3BdDYZt/+IgvNmAde+LS
Rw9Z23coJv3vC0Ly+Ne/yK56yAnRl67TX+okRvizqS5717zmNcd9gKymrnsr+8/lIbnuqdjT
z0geG4hDXkUPA/vxB3l1HyNVYhOz1VV7OOHhWeJT/yD7PoDQs6IrHvtJPTPuC/d/BBZ///d/
P+5nGB111FHTKaecMu4T93juc+2DFR/uT/byLMNUu/lzT3qVHQzdA2IXV3CGsTrOEX4Ina1E
nIigs5hyj8CB3Yh8MfHjw6J0xAdLY5A8PhFa4gM/vHypTNr9oy3EuGnc49M4wD783DeeA2Xx
IRbtNua5B4KH8c4HAvXmOCCfkfkzJk+s7nHtzRga3d31n3FXn4hVLMFVHL4QtqfxHwG3T5po
kw8/njvxxk7891wEVgWBI9a+ZXzFR+tViXqHxWkw8skcCbr1D9527QtB/3FtYPG6+Eprg9JF
awTiile8u4bdXSsiGYSXCYfY53EYXH3yN/hbaTRAGtxNjMocmRDm6WW2YX99awcMHPM2eRWM
/GUFkR+Tk/Y7QiQW4Z89tjPZJ46c5z7id2PfzXUWmU4M+xKfOHJ/ZbIVvy/g/fqv//r4oo22
w9qHNb7iL2cTdYisyTpxbCyf4yHtYHs7EptzG9upd6jozOMXUzA/WPHBLX4Ty8HyfTj4yX2Z
s7nGWzSr9nnT4e2S8cpzkTFiUdjoXV184YUXjUUDH859OP70p/5xPJv5ACY+z1ye9dwXi4qj
dg4PBLY3ah8eWLSV+4GAASgrOV6x+eKDydHKg9ViKxMZtAycBq7tkob9COugVJ23Qxsd2mhl
JuRJIAgW4imPjlWgRUhICPImzQcCJx0f+oaIIXniOBiyP/Glblb7M+F69eu+SjutTLnHfIhI
fzjDeU5q2bOa7AwnZ/vCTfQRGMl3bEfE5q0B/fjeTr1DRWdj/J7ZvWn//rQjfviEnWtYiqmy
GAQ8A3Aleea9zbHy77kJ7j4Y+g4AHWOEepUisIoIlNiuYq8dQjFnwBSSyYkgrbYSGBitvrj2
ik6ahHCMixX/k4kiOGSScPaNfBg4YIBg0Q+hQtIWIWzC1plN6fgM/umb+evFeXoRcezOxv7E
BzfiQwJyHlKOiNq2op3yXdtGkD218pQR57RVGkbOiQsZDtmVzwe/6dNhZA9/9CciFtz3oHpI
Fm2MH7EPPgc6YH3AV3zCEJZiqiwGAfcxnCOwJsYEq6bBXj8Ys4xdnp/t3v+xu9l5rNRuVtC8
InAAESixPYDgHg6mDYYmI4MgMuAaiQiRCjExUYWUGGQNnvPBdqdgNZ8MkDF4aDtMYKHdkZCt
XO/rmc0QAf6CuVgc8iJ8Bnf9djBkf+ITr0mWZOVVOvuHtUG+9iOs2uZw/+WenPcJLOYYsR8c
4BbMtts3bOW+nmMrxlWQzeKHHyyUHWhJX6TfgjtMD4b/A92+ZduHK8kzAF/PC3Hfz/tfn+eD
YXSGYv8UgRVD4IpZdsUCb7iHDgIZPA2a+RKX6BCNTFTyDaR0EZ0QiEOnFfsWyZyoBgeWQi5N
HPIdwSJ687r75n3Xz/Nk0oI3QhA/8R3Sy4fVMH6t0szz99X/VvXmKz/7Ep948yFJO7WNHZKV
vRAgbdc2R7YWaCO80x/qKY8ddek4Bzc6mfSl9yRiyj3PB9urJJvFH3wORlvmvqTTTzDNfb1K
eB5qsQZPWErnWRGn+x7meZ4Su3uffj5QJr/nIrAqCKzWKLwqqB5GcRoAfbo3ERk4841fA2hW
suRLh0iF2B0OE5eJQzszgZgspBHL4LA/twvSFxIHY1hnouInPvSPdPoHiZtPcvsTw57q7m98
4oXVfFLWTm1Upk0mYuVzyYquNjpCWqWDCTv6hn3l7Ogfttyr27k/6VrlUjc+xCGf3UNdlh1/
+jY4pR9gKrbK/iHgHo+4n93/cJ2TVjquYa8/3PuekXygTP2ei8CqIFBiuyo9dYjGGeJgIjIw
GhCz2qKMGEiVGTyVh+whAztBMgHPiZD2Eu2VT8cEYrLQbh8G5vr7gwOCB3PCLz988J0PE/yG
XMuntyj/W8W+P/HBDVaJN/eM2HMvaa/yOUnaeO+pxxYMHPkwIPa8doUVnNhiOzb21D66JNhG
V37sJu9QPC87/vRtsPGBBZYksaWs531DwHPhXs69P783UxYSm3uW7nbu/32LqLWKwIFFoMT2
wOK7460jGFkhRB4MiAZJxEBZiIky+chDVgt24sSlvUT7Q7zgo61pNwxMKIsglsF5vsLFHx/6
QjzRkUYC+T1Yk1Z872t8mWDnuIpd+9KGkN2QJLraKJ8egf/8fkO2SezCTKxz2W7/5L6HrZhi
M3HNbR6K6WXGH4xgBjsY6vPkH4p4rVpMnoE888E1z06IrDbJ8wykbLv3/6rh0Xh3PgIltjuk
j+cD0u6aZFDL5J0BLqRUnbmNrADKz0AnnUl7nocwyA/ZYCeDojLXyuITwZWOzkabbCePT4II
RtKGXMeu/JDHlM115zZTJ3r7cw5h0p6kTc4OYrImWRWRnk8orvdV4kP9+I6/5EUn5eIM9vvq
d7v14juxOO9NfIk1scMtsScv5DUxbZafOtHJdXRDqFI+jzt5uzvP/bMbm/P83dU9FPLncR7s
+OMbZukTmCT/UMBn1WPIvQzf4Jo8bQvuzvJzvertbvyHLwIltive9yFoBiTpELnkz4mrQS16
mXxN6CGx6hjUEEArbK6zrSD25gMi6Phjy4FUqp9JKgRVHTYzqOZLP/JSny3k1TUbGVxdOxCa
EFP2QmDFxW7qIY8h3c7s0HGkzXQ3toP/ShEoAkWgCBSBIrDaCJTYrnb/rZO129zmNuO/tPVf
MiKrIXEIKpkTXNchjshkdEIe/d/q6vuNw5Qhj4hi7CCHJARRPlIZ8hniGT9XucpVxn/tSC+v
gVM/+x3VD/llPwSUDXbF9JnPfGb49d9IEvrKHSG0sZd8OolfXGKek+NhqH+KQBEoAkWgCBSB
lUegv4K94l2IvJF3v/vd66/r/Z/f8kMOlbvO6iaShyjKyytxpFA5UvzXf/3X63XZsGrrW+bR
R4bVm9dRjyCf6iCpIaZ8scFvCDcbqYPouv7EJz6xTk5DRIfRtT8h0Fe72tVGFoLsYENcDtfi
Qnq1Jfni5Ne1uJSxJ10pAkWgCBSBIlAEdg4CXbHdAX2JsCFrIZ/f/d3fPUge8oboWaVEFC+9
9NJB6Ogjkx/84AdHvZDAkESQWKml9+EPf3j8l6PSDjbofeADH5ge9rCHTSeeeOLI99+ZfvGL
Xxxo8vvHf/zH66upj3jEI4ZOVlQvvvjiYV9sbLIl/TM/8zOjvjyk+FnPetYoZ8/x9Kc/fX1F
2HWIcey6vv3tbz/qSD/qUY8a9ZBabcyWC1jwUSkCRaAIFIEiUAR2FgIltjugPxE7RM8reCuf
Vi4jrrNK6f8C/8M//MOxKopMXv/61x/kE9FTx97XkEQk9UMf+tD4b0ovueSSQQwvuOCC6TrX
uc6ExLJ51llnjcOK7PWud72xUirN9k//9E+PrQfs3fzmNx92kWlx3vjGN55e9apXTV/4wheG
7g1ucINBOl/xilcMsqrOm970pumxj33sqOdaLE94whPWV3y1D1mdy3Oe85zp1re+9XqdM888
c3r9618/ff7znx/tFLP4ImlrrnsuAkWgCBSBIlAEVhuBEtvV7r91omaF0yqklU/kzYqlPGcr
lYjir/zKrwzCKf+oo46aHvrQhw6CiSA65ntfkd1XvvKV00Me8pBBZq16IsZsnHvuudNnP/vZ
6cd+7McmpBRZVR9RpKf84Q9/+CiTd+qppw6UEczXvva108knnzzd5z73GeT42te+9vTIRz5y
euMb3zjIJ4It/rvc5S7DnrQV52OOOWas8r7vfe8btvgUI/sIqzOijtySxHO3u91t+o7v+I6R
54/4CP2u2g4o+qcIFIEiUASKwI5BoMR2xbsyRC3NQNgiyB+iaFvBhRdeOD3vec8bZE4dZPD5
z3/+2GqAICK16iKRIXzq3+IWtxjmlDluectbjjMCbYUYgSRspJ6V35vc5Cbr9SR++Id/eJBu
K68vetGLhi59xNsX3qwKZ6uA+NIuBFdsrpX7ElpiCZkXszwk9vd+7/eGbXbFRLJKy586rrWt
UgSKQBEoAkWgCOwsBDq776z+XCeXG5tlq4A9sQhgyB2Cd9ppp30d8cvqp/rKs0KKFKr73ve+
d50UIo4O9oizAxFVjz4CiZC+853vHPaue93rjlXfrKjyQS/bDoahtT9Wffl8yUteMurTIakX
2yNz7Q9dh321ysRhtfn0008fpDj1xIMk81spAkWgCBSBA4eAbzL02wwHDt9a3hyBEtvNcVmp
XEQOWbM665AOEQwhvde97jX2wypP2Z3vfOfpjDPOWL/O6muI38/+7M+OOh/5yEfG3t2Pfexj
Y9X3pJNOGviE0M7BQhxtLbC/1RfP2HzhC1+4TjbvcY97TGefffY6ORbf7W53u+k3f/M3xz7d
tINP2x6uda1rjZVeK7FINEK62WorO7/4i7+4vu2BX6u2dK0sq0tnvio8j7vpIlAEikARKAJF
YPURKLFd/T4chA3hQ+Qc0kgcQWKlHRdddNF4lW9V1vVP/dRPjRXOrLo6+7KZ+gim/a/nn3/+
OFuFde2LY0cfffTY3oA8IsrI45zkStM77rjjxi81WK2V52e4nN///veP+onrgQ984PTkJz95
xOs3dG1zOOGEEwaplo7eD/3QD02ve93rvm61dU50X/aylw3b9NVDYq3g+rUIeiRtlQ7Bl64U
gSJQBIrAYhHwnu2KzXGLtV1rRWB3CPR3bHeHzIrlI2khl3PCljzNQUjtR0VeEb+5IKdIqvzY
kucLY/QR5nk9Pyn29re/fZig76BP6NpykDicrdoS8dzoRjcacczLk0Zc1UdO5TmkxW0lOCRa
vjwkHWkVO9LqS3KJYzhc+2PFdv4fTcifE+Lo9VwEikARKAJFoAisNgJdsV3t/lsns5qRlc00
CYkMQZQXcicvhDfbD5SHvEorV4YAypdGHCNWX5FJ+bHnHEl955BWuiGm0VOHD2dHVmiVJ18a
gVU3tuSFnPu1hTkZVkaPP3LVq1517PuND2dtca4UgSJQBIpAESgCOweBEtsV70tkDwEkIW7S
8pRZ1ZwTOKuXSGAIZl7N0yOuQ2Kls1839hBVhJawo1yeNMlKKvvzg026kRDU1A0JVW5lWL64
pZXN28iu39lVzs7857zUI87iF6vDf8XLBn1lOYZy/xSBIlAEikARKAI7AoES2xXvRgQNYQzx
0xzpEE4rncghQersN1WHIHwhmPSShxAm7YxAhrgmPSefdNhkTzlbCDQCipQ62AyZlB/CLU3i
k05WbZVJa0tIsbbxbcWY8CcvBFacab/y2LVHOL60Wb1c06sUgSJQBIpAESgCq49Aie2K92GI
aYif5iStDKnMK3uEjyB0yCECGoKX/w43BBfBDJmVDglkj4R8IpTKHPFLH4Em8kMulfNHElPi
V0eafghy8pyJcjbmfkJixZp42Yi+c9otLX7laYe8ShEoAkWgCBSBIrAzECixXfF+RPIQwazK
ak7IojRSGWIXgokoJk1H/fxigevoS5NsU2AXeYx9JNW1+nORP9eZl8V2yKcyuuqE9CaPjrLo
Khe7Nic/JDcxxG9sskUn+ASPefvpVIpAESgCRaAIFIHVR6DEdvX7cJBLK6BII4IXghhCiNgh
hCF38h3yHMipM3Gmn7rseY2vLrt8hDxa9UR6s1Iav+wk7axu6iCUWS1lS7kjhJd/OqknjrSL
Xdfz+tJsz2NIrMrY0Yb5CnHIcHyyWykCRaAIFIEiUARWH4ES2xXvQ+TNflZkDmELWcuKZVZb
EcKQO01OuXxk0tkhPzbYDmEMIeUDWaQnz9aFjXWUE/+1rjJ+Q5zlq+c3ZkMwQ2bFKgb1+VaP
Hn35RDtd01E/aWVf+MIXhj8xIbPKiDaw51BPXCRxjov+KQJFoAgUgSJQBFYegRLbFe9C5M1+
ViQQYctPeoVIZs8sUicPaXUgdQ7EE2lEGIlrhDEEEmkmdPgKQRyZl/8JSWWPDhsOK718IZls
Jq2aOF0TtsWWNshjC9FNe0KC6RD21XcOgb7KVa6yblM+YVdaXA7X4gqJHkr9UwSKQBEoAkWg
COwIBEpsV7wbkcYIwhZCl7MyZA5RRCBDMOUjr/KR1RBG5I/QUw9pzqqvfDasgKoXH/wSBJcg
nGwS9rLqy2ZIrLpsELryXacNrkPK44deCLh67KXO3J8y7YFN7MojrueY7crt3yJQBIpAESgC
RWAnIFBiu+K9GNIY8hmyiFAihEicAwlE/hxXu9rVBkFE/lyHzIICcURoEUAHyXYD9rLKKj+E
U1p+VlfFIK7ExIc0uyG3dGJfXmwgx2yp77/l5UM9Qi8EPLGwLWb6ic1ZuTx16UT+7M/+bDrt
tNNGm7IlIWU9F4EiUASKQBEoAquNQIntavffOplD4iJzwiZ/vuf00ksvHa/uQxBDalMn+Ygn
gpjVTdfS7CGNOfhEHkM+kcisivLrmg9p+bY2pK4zH2wTZ+SYvvzYRWhdRxBZtujTTcz01EkZ
fWn56jz3uc+d7nnPe66T96w0x27PRaAIFIEiUASKwGojUGK72v03SNsHPvCB6WEPe9h0hzvc
YZC9T3ziE9Mll1yyTvAQQHmI5MknnzxajKDSQfqspobk0f3oRz86ffCDH5we+tCHTne9612H
zXPPPXek+UEWHWecccYgrtIhyM50EVS2Qjo5veiii8ZqcerzwT957WtfO9Lq8EvUVS5O8arn
/JGPfGSQUySdPkGgQ2pHxtof7SV0nv/8508vetGLhp/YQnYrRaAIFIEiUASKwM5BoMR2B/Ql
YvriF794evnLXz5WVY877rjphje84fSa17xmkLsLL7xwOvbYYwfBO/vss8fZ6isiiPQhjATR
c40QSrPpcH388cdPb3vb26ab3OQmY8UX+X3sYx+7XjcrqkjoT/zET0wXXHDBIJvPfOYzpx/5
kR+ZxHDTm950eve73z1iREqvd73rje0G6px00kkjLSa+xMSmOG92s5utt+Xiiy+ebnCDGwwi
rZ1iUwehVgfBTRty1raHP/zh09vf/vavW/lFcCtFoAgUgSJwYBCw7LBr6eHA2K/VIrAZAiW2
m6GyQnmInV8DuO1tbzsdc8wxg+C98pWvHCu497rXvUZLEEUrtfaXXvWqVx1kUAFihzw6I4dW
SJFBpFbebW5zm+noo48eNrIi+uhHP3qsxl796lef7njHO04IKhuIpTMfD3zgAwf5tNpqhfe8
886bXv/610+nnHLKdKMb3WjosqvsT/7kT0aZ+K573esO/094whNGPHy+5S1vme53v/uNLQRi
TL2Qdnkh5rDIyrF0iLoGyNe2eRtdV4pAESgCRaAIFIGdg0CJ7Yr3JXL2+c9/fpC7vNb3iv/M
M88c5FQ54nfOOeeMrQCf/vSn11tspdfe16yMKkAUHeoht9lKQC9EkL58ZBF55BeRdFbXyizb
RD1ib62VV4Kw0qdnRdZ/54uYy2eb3OlOdxr+3/ve904veclLxv+Mxj6/Z5111tiOQC8xSSf2
Bz3oQYPs+9/UkGc+2FUuXnGH1KtXKQJFoAgUgcUjYDPYrg1hi7ddi0VgdwiU2O4OmRXKR9JC
8HwJ7MY3vvGE3CFzCCSS6Wy19Xu+53tGy5A8RFGZMwIaMuonvvw6AZuIIHFmg9BHlv2HCNKE
Ln9I5Cc/+clBHl0jq/KsKp9//vkjjVg6kFZE1SryO97xjpE3jK39+cu//Mvh0yruox71qPX/
fCE+Tj311HWyqg4fiQuJR5YdtkLAR5kYpdO2xB6fPReBIlAEikARKAKrjUCJ7Wr33yBpSCkC
SXwJ7IQTTphe+tKXrq9gInO3v/3tp2c84xnT933f9w09xNReVWf7VomVUfthET/EE/mdr9jS
QSDlE2WO/CcOiOKJJ544/c7v/M708Y9/fJBJ2xCsvtoW4QtcvuhG7Kt1fY973GN8WcwXu3y5
TDxPf/rThw8E297bZz/72aOOP8pPWGvf0572tGGfT23XRiI2BxIrtnwpDmmXZ3UbXvN2jIr9
UwSKQBEoAkWgCKw8AiW2K96Ffn0gZC7kFsl7z3ves078ELp/+2//7fS4xz1uEFZ7YxFEWxZO
P/308WUtOlY4rcwqYyMrtCBShijSU04PQXRGQAn9W9ziFuOXB469/Mtqd7nLXcaXzlwjs1aT
2bANwe/U2v8r7o997GMjj21Emy8+EdJL1/bxxjeieu9733t64hOfOPLZQsJJYmdDLMEFiRUr
UT9toFcpAkWgCBSBIlAEdg4CRzz1qU/tFpgl9ycShvRZ+bz1D952espT/uPaa3bf9L/S2q8L
XLT2havj1yPM153UQdCQNiQ0Z6/qN75iTx6iNxc2HCGGymJHOvWkyfw6tpBDK7z5zxmQ1Kz2
Kou9ed1d1q7wJQYEFnkl6iGpuZ6nkV17Z/lXL22d25fvWhzScKLvnLTrebsTU89FoAgUgSKw
GATm5GJtKF77dZyLxmKGhRe/K/7pT/3jGOe9PSTGa+N/xnPXlSKwtwh0yWpvETvE9LOy6kwQ
N4NBVm8ROOTPQKHMoEGc5YfcKSfy1EnaGenMNZJJ1I+tkFp+2eNbmWtxZZBSL36kldEVV2zE
pnLCBoIrJmmklqgnVnmOeVp52hU82JVObMrnsahTKQJFoAgUgSJQBFYbgV3vcFe7DYd99Ahb
JMQwxC7XiF8kebl2TvlmZXmNTy+rqNIbJXHEd65jm/487Tq60nPf8RMb8zK6G8vlRVd6LvP8
ub+NsczrNF0EikARKAJFoAisHgJdsV29PmvERaAIFIEiUASKQBEoApsgUGK7CSjNKgJFoAgU
gSJQBIpAEVg9BEpsV6/PGnERKAJFoAgUgSJQBIrAJgiU2G4CSrOKQBEoAkWgCBSBIlAEVg+B
EtvV67NGXASKQBEoAkWgCBSBIrAJAiW2m4DSrCJQBIpAESgCRaAIFIHVQ6DEdvX6rBEXgSJQ
BIpAESgCRaAIbIJAie0moDSrCBSBIlAEikAR2D8E/ML6Fb+yvn+2WrsIbBeBEtvtIlW9IlAE
ikARKAJFoAgUgUMagf7PY4d09zS4IlAEikARKAKricBlqxl2o15xBLpiu+Id2PCLQBEoAkWg
CBSBIlAEdiFQYts7oQgUgSJQBIpAESgCRWBHIFBiuyO6sY0oAkWgCBSBIlAEikARKLHtPVAE
ikARKAJFoAgUgSKwIxAosd0R3dhGFIEiUASKQBEoAkWgCJTY9h4oAkWgCBSBIlAathCSAAAg
AElEQVQEikAR2BEIlNjuiG5sI4pAESgCRaAIFIEiUARKbHsPFIEiUASKQBEoAkWgCOwIBEps
d0Q3thFFoAgUgSJQBIpAESgCJba9B4pAESgCRaAIFIEiUAR2BAIltjuiG9uIIlAEikARKAJF
oAgUgRLb3gNFoAgUgSJQBIpAESgCOwKBEtsd0Y1tRBEoAkWgCBSBIlAEikCJbe+BIlAEikAR
KAJFYOEIHLFm0VEpAgcTgRLbg4l2fRWBIlAEikARKAJFoAgcMASOPGCWa7gIFIEiUASKQBE4
bBG47LBteRu+TAS6YrtM9Ou7CBSBIlAEikARKAJFYGEIlNguDMoaKgJFoAgUgSJQBIpAEVgm
AiW2y0S/votAESgCRaAIFIEiUAQWhkCJ7cKgrKEiUASKQBEoAkWgCBSBZSJQYrtM9Ou7CBSB
IlAEikARKAJFYGEIlNguDMoaKgJFoAgUgSJQBIpAEVgmAiW2y0S/votAESgCRaAIFIEiUAQW
hkCJ7cKgrKEiUASKQBEoAkWgCBSBZSJQYrtM9Ou7CBSBIlAEikARKAJFYGEIlNguDMoaKgJF
oAgUgSJQBIpAEVgmAiW2y0S/votAESgCRaAIFIEiUAQWhkCJ7cKgrKEiUASKQBEoAkWgCBSB
ZSJQYrtM9Ou7CBSBIlAEikARKAJFYGEIlNguDMoaKgJFoAgUgSJQBILAEWsJR6UIHEwESmwP
Jtr1VQSKQBEoAkWgCBSBInDAEDjygFmu4SJQBIpAESgCReCwReCyw7blbfgyEeiK7TLRr+8i
UASKQBEoAkWgCBSBhSFQYrswKGuoCBSBIlAEikARKAJFYJkIlNguE/36LgJFoAgUgSJQBIpA
EVgYAiW2C4OyhopAESgCRaAIFIEiUASWiUCJ7TLRr+8iUASKQBEoAkWgCBSBhSFQYrswKGuo
CBSBIlAEikARKAJFYJkIlNguE/36LgJFoAgUgSJQBIpAEVgYAiW2C4OyhopAESgCRaAIFIEi
UASWiUCJ7TLRr+8iUASKQBEoAkWgCBSBhSFQYrswKGuoCBSBIlAEikARKAJFYJkIlNguE/36
LgJFoAgUgSJQBIpAEVgYAiW2C4OyhopAESgCRaAIFIEiUASWiUCJ7TLRr+8iUASKQBEoAkWg
CBSBhSFQYrswKGuoCBSBIlAEikARCAJHrCUclSJwMBEosT2YaNdXESgCRaAIFIEiUASKwAFD
4MgDZrmGi0ARKAJFoAgUgcMWgcsO25a34ctEoCu2y0S/votAESgCRaAIFIEiUAQWhkCJ7cKg
rKEiUASKQBEoAkWgCBSBZSJQYrtM9Ou7CBSBIlAEikARKAJFYGEIlNguDMoaKgJFoAgUgSJQ
BIpAEVgmAiW2y0S/votAESgCRaAIFIEiUAQWhkCJ7cKgrKEiUASKQBEoAkWgCBSBZSJQYrtM
9Ou7CBSBIlAEikARKAJFYGEIlNguDMoaKgJFoAgUgSJQBIpAEVgmAiW2y0S/votAESgCRaAI
FIEiUAQWhkCJ7cKgrKEiUASKQBEoAkWgCBSBZSJQYrtM9Ou7CBSBIlAEikARKAJFYGEIlNgu
DMoaKgJFoAgUgSJQBIpAEVgmAiW2y0S/votAESgCRaAIFIEiUAQWhkCJ7cKgrKEiUASKQBEo
AkUgCByxlnBUisDBRKDE9mCiXV9FoAgUgSJQBIpAESgCBwyBIw+Y5RouAkWgCBSBIlAEDlsE
LjtsW96GLxOBrtguE/36LgJFoAgUgSJQBIpAEVgYAiW2C4OyhopAESgCRaAIFIEiUASWiUCJ
7TLRr+8iUASKQBEoAkWgCBSBhSFQYrswKGuoCBSBIlAEikARKAJFYJkIlNguE/36LgJFoAgU
gSJQBIpAEVgYAiW2C4OyhopAESgCRaAIFIEiUASWiUCJ7TLRr+8iUASKQBEoAkWgCBSBhSFQ
YrswKGuoCBSBIlAEikARKAJFYJkIlNguE/36LgJFoAgUgSJQBIpAEVgYAiW2C4OyhopAESgC
RaAIFIEiUASWiUCJ7TLRr+8iUASKQBEoAkWgCBSBhSFQYrswKGuoCBSBIlAEikARKAJFYJkI
lNguE/36LgJFoAgUgSJQBIpAEVgYAiW2C4OyhopAESgCRaAIFIEgcMRawlEpAgcTgRLbg4l2
fRWBIlAEikARKAJFoAgcMASOPGCWa7gIFIEiUASKQBE4bBG47LBteRu+TAS6YrtM9Ou7CBSB
IlAEikARKAJFYGEIlNguDMoaKgJFoAgUgSJQBIpAEVgmAiW2y0S/votAESgCRaAIFIEiUAQW
hkCJ7cKgrKEiUASKQBEoAkWgCBSBZSJQYrtM9Ou7CBSBIlAEikARKAJFYGEIlNguDMoaKgJF
oAgUgSJQBIpAEVgmAiW2y0S/votAESgCRaAIFIEiUAQWhkCJ7cKgrKEiUASKQBEoAkWgCBSB
ZSJQYrtM9Ou7CBSBIlAEikARKAJFYGEIlNguDMoaKgJFoAgUgSJQBIpAEVgmAiW2y0S/votA
ESgCRaAIFIEiUAQWhkCJ7cKgrKEiUASKQBEoAkWgCBSBZSJQYrtM9Ou7CBSBIlAEikARKAJF
YGEIlNguDMoaKgJFoAgUgSJQBILAEWsJR6UIHEwESmwPJtr1VQSKQBEoAkWgCBSBInDAEDjy
gFmu4SJQBIpAESgCReCwReCyw7blbfgyEeiK7TLRr+8iUASKQBEoAkWgCBSBhSFQYrswKGuo
CBSBIlAEikARKAJFYJkIlNguE/36LgJFoAgUgSJQBIpAEVgYAiW2C4OyhopAESgCRaAIFIEi
UASWiUCJ7TLRr+8iUASKQBEoAkWgCBSBhSFQYrswKGuoCBSBIlAEikARKAJFYJkIlNguE/36
LgJFoAgUgSJQBIpAEVgYAiW2C4OyhopAESgCRaAIFIEiUASWiUCJ7TLRr+8iUASKQBEoAkWg
CBSBhSFQYrswKGuoCBSBIlAEikARKAJFYJkIlNguE/36LgJFoAgUgSJQBIpAEVgYAiW2C4Oy
hopAESgCRaAIFIEiUASWiUCJ7TLR38T3EZvkNasIFIEiUASKQBEoAkVgawSO3FqlGgcSgSMu
W7O+dozzcPS16YiR8bW1q7XPHUc4XyHUK0WgCBSBIlAElo7Axglpw8rM11+a6Nbms/mx9AY0
gJ2IQFdsD6FevYLcHkJBNZQiUASKQBEoAkWgCKwIAl2xXZGOaphFoAgUgSJQBA5JBL5+afYb
QrSwe9kWOt9QqRlFYB8R6IrtPgLXakWgCBSBIlAEikARKAKHFgJdsT20+qPRFIEiUASKQBFY
DQS6Crsa/XSYRdkV28Osw9vcIlAEikARKAJFoAjsVAS6YrtTe7btKgJFoAgUgSKwBAQ2/ljC
EkKoy8MYga7YHsad36YXgSJQBIpAESgCRWAnIdAV20O8N7/2tV2/Y3vZ2m/bHrH2j+xK7wq8
n4x34dC/RaAIFIEicHAR2M4W28xd5q+vfvWrI8CvXrY2nx2xndoHtz31tjMQ6IrtId6P3/RN
3zQiRHC/dtkukrtOcNcGh0oRKAJFoAgUgUMZAeSWXLY2Z13piCsNUvvly0nuoRx3Y1tNBLpi
e4j3G0JrULjSlb7xM4hBop96D/EObHhFoAgUgR2OwO6WWEJoLclYn3V2HHnkkdOVr3zltVSl
CCwegW9kS4v3UYv7gcBXvvKVCbm1SpuVWuYQ2s3I7n64atUiUASKQBEoAgtFYD53mcu+9OUv
TeY1CzOVInAgEOiK7YFAdYE2v+3bvm0Q2ytfaden2y9/5cvjk+5lX/3a+NTbsWGBYNdUESgC
RaAIbBuBy7b4f+DzVvErX/3KWIgxn1mQ6aLMtiGu4j4gUGK7D6AdzCqf+9znpksvvXRsujdI
OL75m795+vK/fmnX4HBEX+cczP6oryJQBIpAEbgcgSN2fe9jd3h8+ctfHvOU/bRXucpVxvyV
t5C7q9P8IrC/CJTY7i+CB7j+rW55q+Hhq1/76th+YAuCf19de5Vjj5LfSqgUgSJQBIpAETjo
CGy1Ynv5/GTF1txlK8I3HflNI92tCAe9tw4bhyW2h3hX23w/qKw9tWvfJo3kFU+uey4CRaAI
FIEicHAR2PPCyldtQbjykdM3rx1fWftVn29ZI7VfWsv72trCzJGbfCH64MZebzsVgRLbJffs
ZWvjgi304zwbI3wQdonUkivPSK3r/AzYrIrsShEoAkWgCOxABLIVzf5Uvwd7KPyqQOKYL7TY
aiA2K7TftEZo/a6PeWwsy6xtpbvyWv6RvjPytX55bAfepodEk65YAjwkwmkQRaAIFIEiUASK
AAQQRq/vyfyXcA4FUismcdhHK0ZnMrbLrZHXSHYrbDynvOcisGgESmwXjWjtFYEiUASKQBFY
AAJzMhtzVkSRSOdlC0KL3Dq8Rfy///f/jvSXvvSl6f/9v/+37PDq/zBFoFsRDtOOb7OLQBEo
AkVgdRDI6u3/+T//Z/zSQK6X2QKENmT2N37jN6anPe1pg3T75Z5KEVgWAiW2y0K+fotAESgC
RaAI7AUCiCRBHBHbXO+FiYWqWrH91m/91vGb6laR7bnNb9QqS3qhTmusCGyBQIntFgC1uAgU
gSJQBIrAshGwLYEgtF77OydvWbEhrg7bDvKlMbHYitBV22X1Sv2W2PYeKAJFoAgUgSJwCCIw
J69JI5BWQ10vW8SAxH7Lt3zL9F3f9V3Tv/7rv450frVn2fHV/+GJQInt4dnvbXURKAJFoAgc
4giEzM7DDKFFbpe9YisuJNY2hM985jOD1MqzJeHII0svYFE5+Aj0VxEOPub1WASKQBEoAkVg
SwQ2I65WR62SIrhZubVSaiUXmVQm7VA/184IKCJKX11H9JwRUnalldGz1UB+6udaXurT/7Zv
+7ZxrVEltVt2bRUOIAIltgcQ3JouAkWgCBSBIrCvCGxGbJFJpNKBqLr2JTJk8gEPeMD03d/9
3dO/+Tf/ZvqO7/iO6RWveMVYRX32s589nX322UPvs5/97MhDWtVX94tf/OIgwWwiqcQZifYr
DHR9SQzplVaWGJzFoMxRKQLLRqDvCpbdA/VfBIpAESgCRWCbCCCPIZJIpRVUebe73e2mBz3o
QdMLXvCC8RNcVmavcY1rTBdddNEgpX6Wy4EAx0ZIbfKQWGnEmA/6dL/92799kF8h8qfMl8MQ
Y5J4xkX/FIElI9AV2yV3QN0XgSJQBIpAEdgbBBBJpDbk8v3vf/8gpCeffPL4hQKk1mrv3//9
30+nnXbaSCOoiOxjHvOYsRJ71FFHjbTVV2T2Dne4w3TccceNFd8HP/jB69sdnvOc54ztC9/z
Pd8znXrqqevbE5DerNqKh2SFma9KEVgWAiW2y0K+fotAESgCRaAI7AGBOUEMaaQuH6m079U2
gje+8Y3TTW960/XtA0hn/ucvJBd5Vec1r3nNdMEFF0yf+tSnpo985CPT3/7t305vfvObp1e/
+tXTrW51q+mSSy6ZPv3pT08f/vCHp9e97nXTG97whrHi+/nPf36QZFsT6LPNHkI7X62dx7iH
ZrWoCBxQBEpsDyi8NV4EikARKAJFYLEIZMUWwbRN4EY3utEgr7YGIKbf+Z3fOQinazr2xapz
7rnnTo9//OOHrtXeJz3pSYPUHn300dNLXvKSyfmZz3zm0Lvzne88WQk+55xzxn5d2xrs00WM
sx0hcSDZiG6J7WL7udb2DYES233DrbWKQBEoAkWgCBx0BOZk0mqs1dTv/d7vnd7znvcMwml/
rBVZ2w7oIptIbNLILmKqHsKr/Pjjjx+rtB/96EfH/tqrXe1q01vf+taxBeGpT33qsPfJT35y
cpxyyimDGOfXFqwGs43YVorAoYBAie2h0AuNoQgUgSJQBIrABgQ2WwHNFgCrpL7sRa5znetM
N7/5zdf3zNKxHeGkk06a7JG1aosEn3jiidMznvGM9X2yfi3hR3/0R6fnPve50xOe8IRhC3G9
3/3uN7YlWMG1yovEIsFWe1/2spdNX/jCF4YuQptDRsntgKV/loxAie2SO8CgQAxg+XardPKX
HF7dF4EiUASKwJIQCFG0KkrMC1ZiQ3jNGcqsyP7qr/7qIKPXvva1J8cxxxwz3fve955++Zd/
eXw5DNG9+93vPvKuda1rTY573vOeg/ze//73Hyu217zmNSdfKvNLCurd9a53HeXyr3/96w/i
SveqV73qILviyYptVohdJ745bNoi33mu4zpl2eIwr9d0EdhbBI5Ye83Q9wd7i9oB0L/44ovH
qyF7pf7Lf/kv49O1h9+n7EoRKAJFoAgcnghYmQ1ptI3A6uk//dM/rc8Nrv2qAdJID4F1dsjL
1gM62XrgN2mTZh8xpouo5oxsKvMfL5iLXLNlTkpMiChxbSX49NNPH9fxyVZ05os1bD3lKU+Z
zj///GEfaaYnP1KSGyR63lsEumK7t4gtWN+D7zAIGTA8/M7ySmoXDHbNFYEiUARWDAFzAXH2
qwTmCAcyiQhm/6xtCfIRWKI8uuYSRBZZZONzn/vcOuF07ZcVYs82A77Yps+uMof/9IGYr0i2
KPCDAPNB+KMTsqo8RBXpVTaPN22MTzbmJNd1pQhsF4ES2+0idQD1PMAGAgOUgcL/DONTd6UI
FIEiUAQOXwRC9LJiCglzA5JozpDOT2/5wpe5A0kM8URG6dILWTXHWLFlE8l0ZFVWnl9ZIHw7
EGXEVH1fOGNrIynljx3+IuIi8sVA2DDP/eM//uPwr55Y5BP+cuazUgT2BYES231BbcF1PNQZ
THzr9LzzzhuDlk+/edAX7LLmikARKAJF4BBHIIQvZ+EisOYGJBMpRHARSqQWQUUkkU8E1qFu
VkwRTHmuQ2hDQJFMxFZ58tg1B9HNXGSuQk7ZUs6+Our6RQZnIrb4dU1XGf23vOUtY5WYHTFX
isAiEeh/qbtINPfBVh58r3i8HrJ3CrG9z33uMwaADCZMzwc318o25smvFIEiUASKwOojECKY
FVhj/hOf+MTxv4PZMmD+sKIqH3FEJpFM17YYmB+Q3EjyQ0oRWOQSUeYDMZUOSbUyq5wdeVl5
5ZfwSZDT2BQPu65DgOmo71o873znO8dPh/ltXHGKaz6XSTvkV4rA3iJQYru3iB0AfYOEh9uP
atvr9PGPf3z6i7/4i+mHf/iHx6dxLucPves88DnLqxSBIlAEisDOQSD7ZbXIqinyecYZZwzy
GcKpDMFUlrM5JUR0boOuOQP5NedslBBVtujwEZnbDsGdl8nLfJQ9tikXO1vK3/a2t03//M//
PEg4Io2My88cJ+2Y24udnovAdhDoVoTtoHQAdQwgxKDhU+9VrnKV8YnW//DyiU98YpR5yMnu
zqOwf4pAESgCRWBHIYAQEiQVWUT2pLPKmZVT84j8CD1EMqu5KQtpVF+eawSWsIVcsiV/TmrF
EaKZGOZ1M4/Fjmv2El/Ol1566fgfzv5/e3cCbFlVnn180TPzjBhQQVREASfEwmgUNWQwQY0a
h0RiBs1gTKLRqIkDmjLGMs5RKY1VcaAsTdQM4FeJBqdgYkCKgMiMTALKjAI997d/6/p2Hxok
9O176XPOfRa1e++9hne969mXtf/nPWvvY42tbylBrX70Owq2Vb87ln+iwBYqsHh4OfPxW9gm
1edQgZpoTAQ1CfkaB+h+85vf7L8I4+sa/9ObgGrCMLnck//5tatP2iYnfWhXx/pPigJRIApE
gfFToGDSPF73ijoub0fzq6zyan6v/NE28mx1T1HXsftM3SfkqSOVDXkFt9W2/BzNV7/uNUDa
Ky29Eky01reTAjl77LHHxvvYaF9lr/zNPgpsiQIB2y1Ra57q1v/Q/mc2UdTkYH3TGWec0dc9
+clEX9uYLEw86tjuSWJ/tA+f1NmpSeme2EidKBAFokAUmD4F3Atso6nOBUUk+7ovOVcOfqW6
j6gDZAuKrdUVZXb+pS99qZ1wwgnt+uuv75Fa+X70ISkKzIcCWWM7H6puoc1RQPXVTJ37ZGu9
7ac//en+QNmRRx7ZnvCEJ/RPu+DWr8PUxPOTugS0JhERWpMO2/UVk0X8ypKiQBSIAlFg4Sng
/iC5L7g/jIKp/AJc+e4b7jfyQKu2oBa4OrcXhfWrZyK06n/lK19pJ598crvmmmv6PUi+vvbd
d1/mk6LAvCgQsJ0XWbfMqInCJDEKnl7pYmIQpb3xxhvblVde2S666KL2xS9+scOouqMv2f6/
ejQhmXREa+urJhPR/wXG/5fdlEeBKBAFosBkKuC+U4DqXuDYfUcgxH3JfabgVpn7h/LReu4j
8tUFupYZOLakToTWa8jcxwCtZXXKBXDcv4BuUhSYawUCtnOt6BbaK6g1UUi1N3n4n96kYUKo
yePSYfE9MFV+T8C0JhsTD9sitOw5rnW2W+hyqkeBKBAFosAUKFD3n4JY9wab+0bdL9xvACvw
df/wTZ8IrXPt1Fde9URn5bm/eOftrrvu2vbaa69+P5PPrvuRQIt+kqLAXCsQsJ1rRbfQnomh
PikXxNa5Mp9uTQ4mCWtuvbvQpGJCkGdyuLtkEpF8YjYh2dena0+lspEUBaJAFIgCC08B9xj3
iNrcg9xnCjqVi7w6twe2tezAvaTuX8BWqgCMMse23XffvQdilKtffYjaJkWB+VAgYDsfqm6B
TROK/9ltUoFoTTQg16dcEwrA9Towx8rrE/PddWfC+fd///f+afrwww9vz3rWs/rEdN111/V1
TjUh3Z2NlEWBKBAFosD0KSBAUlFUx+4tXjNpyYB7zOWXX96Xv/mm0L3CMx7uQ+oCXHUKVuse
Vvcl52zby5OqzubHvTD/RIE5UiBgO0dCztaMicH//JLJYvOJQp5NMrGo69xEYRKqsl7hLv5h
Tzt1fRJX33HZuosmyYoCUSAKRIEFokCBbQ3XfaLuQ/JEaiX3DEvgnANUkVfJsW/+2PFtoCV0
BbLsVFkBr/sPO1WnG8k/UWAOFQjYzqGYszXlf37JBFGfaEeBtfLsq65JZqZOvfLrjmuVhmX/
3eaGDVU+8+Rr227m5durVg8v8x6OB5zu9fJPFIgCUSAKLCwFKlBi1HV/cW+p48ofPddGqnuR
vTZSBVvUl9yjqn7VCdB2afLPPCqwiXrmsZOYHj8F1m83RH773JM/gfG7OvEoCkSBKDBeChTI
jpdX8SYK3FmBRGzvrMmE5STiOmEXLO5GgSgQBaJAFIgC86RAwnXzJGzMRoEoEAWiQBSIAlEg
Cty7CgRs712901sUiAJRIApEgSgQBaLAPCkQsJ0nYWM2CkSBKBAFokAUiAJR4N5VIGB77+o9
571tGB4AsyVFgSgQBaJAFIgCUWChKxCwXeh/ARl/FIgCUSAKRIEoEAWmRIGA7ZRcyAwjCkSB
KBAFosB8KVDvpp0v+7EbBeZKgYDtXCkZO1EgCkSBKBAFplSBvMd2Si/sFA4r77Gd8Iu63cyP
lk34KOJ+FIgCUSAKRIEoEAW2XoFEbLdew1iIAlEgCkSBKBAFokAUGAMFArZjcBHiQhSIAlEg
CkSBKBAFosDWKxCw3XoNYyEKRIEoEAWiQBSIAlFgDBQI2I7BRYgLUSAKRIEoEAWiQBSIAluv
QB4e23oNYyEKRIEJVWC7DZs+22/Ybn3zMGZ+8GRCL2bcjgJRIAoMCmya1SPHhCrgEs7+Mq5f
v77ZKtUrXeR5b6HzJUuWtHXr1m2st3Tp0rZmzZpmr44y+6pnP2pTmW3t2rXVTS8fzV++fHkv
W7RoUa+3ePHiXkf/daxC+VV75dUXe5L6fFLG3sqVK9uyZcv6Mb+laq/eaH1jkviqrXr26sir
vuyNU9JP1eeDMv3JKx/0W/WVl6/K2S49nSvTZ5XZK5dfZfbsKCs/2ZHnXF/6X3ip/n+Y2S9a
tGTQbt3wt+rva8hbP2jbFg/7DW3DuuHarR30b8N1HI6XLl7WFg+6blg3A7iL2qD3AL4z8Ft2
S1H/z2z6/6Zys48C06qAOScpCkyCAmbrpAWsABgCQQVSq1ev7lBGEpCk/Pbbb+8Qu+uuuzbl
dX7bbbf1OmBw1apVvcyxOkC1gKxs6af60h/bJksQ+KMf/ajDmz532GGHjVBWcCe/6hbM2dtG
IZL9W265pffPF3C32267tR/+8If9mF/lA6jlB2hcsWJF/yswtrJfkKhf49t+++17PePeaaed
ug4FnLvvvnsfQ+l566239n7Y4gNfHLNZ9mv8/DBmdpU5Z1eipXo777xzP5anTvmsjE32jUVf
thqb+gs50UaiY2lCO7q55nVd/A2tvn1l/xtbPIRtlat/Z3jNlNkFzT8LTgHzTlIUmAQFMktP
wlW6Wx+3LnJUIASKpD333LNHOE1idXO3V37jjTd2qAJZzoGepFweYChwY5cNAFhA4Vz0FMCB
ChA5Aw+tw6m66sgHkyDUHpSAUba1l7TXh8QXgFLl++yzTwfRUQAHjuVH2dCO7+zox14/bLEP
ZuUXCLHnGCgbg3pgX/5NN93U4VS5xBe2CtL1Yxz6ZFsC8/rkl3byjV8bSXsaqwPMwRc7/Fem
39JUfT6pow2bFQVXtnDSnf9/oOfSpYv7tnjpEIUfwrPrNvhbuq2t3bC2rVo7/E0tHj5wLB7y
h/82LBo+MA37RUNg17KEu16a4P+XTJ8L5+8qI40CUWBSFMjMPClXap78LFgCXWDshhtu6DBX
kawCMeUFTSALOAEu9QCavIJi0AXAQCHYktjWHoipB8rUY99xQSm7jtmt/AJcZeDPXp8ATnvR
0epPHzfffHM/32WXXbqNglR2tOVX9V0gqY1yddkGjwXl8tUD72DX5lzio3L+ssl3ffBNPbbA
L3vq8JdWfNhxxx17vdJFHccizvxgq8bGF9fAONmp/kpP/utTvjbaqr/Qkw8MtHCd6OGcxq4V
YF26fFnbbgDYlauGDyrLLd+Y0dh+/XofnH4MytbiblyPG6hd6H9XGX8UiPWEHmIAACAASURB
VALjq0DAdnyvzb3imRs+GJJEtoDX17/+9fbHf/zH7U//9E/bK17xivY///M/HaiAQcGlNiAB
3IIusPDd7363/fmf/3mve9VVV7VXvvKV/RhEqF99ATeAJmkPyICeOqDvta99bQdBwMju97//
/b5Xr2yAFVDHX3UKWApclb/lLW/ptr70pS9tHKNy4wTcjqs+yOQLGGWP7Xe84x3tkksu6b7w
T1RW/3/7t3/brrnmmva6171uYxSW7/Qx1uuuu67rJs84jcmer+D1DW94Q3vZy17W/uiP/qj9
7u/+bveBFoCU5uryzxjY4JfxOVaHDmxK8tXda6+9+jH/6Vaa9koL8p8ZIN1+++WDLqu6dq67
SO3a9eva6rXDcoSlS4b9qrZoyfC3OFzf7Ybrs93iRUPe6rZih+GDxRC3vVPaCLdKMn3eSZ9k
RIEoEAW2sQJ5K8I2vgDbuns3exBnA03f/OY321lnndXe9a53daACWUBT2VOe8pQOUQV5e+yx
Rz8HbKAOgIEvoGU5wDvf+c4OaaPRyh4pG/pSH0BWNJUOIA0kv+c97+mACez0JeKpf/UlNgpO
K7LJf+35oN7111/fAZMP7Ej2fBVF1c7Y1OefsrKvT2VHHHFEu/TSS9tDHvKQ3l756aef3h79
6Ef38f3VX/1V9wUcGzOgBJZSfQjgK1ts6vfVr351e/nLX94OOOCAPoavfvWrXevXvOY1va12
xma82vIPdANZ/fPbcfkPYPlv7Prnh77ooX2NvTu1AP+hyxe+8IV+PdqimQ9P/kZ9QBn4tuu0
dMWw5GV4kgwAL18+rBdfvbI989hndj3Xrpn522nDGxM2RWwXoJAZchSIAlFgQhQI2E7IhfpJ
btb6P68pmk0CUDvttMNG6Pvnf/7nBtjAEcACViKv8o466qgOaX/wB3/Qnvvc57Z/+Id/6PWO
P/74tvfee/doLTADaa9//evb2972tvY3f/M3HbBEOR/zmMe0j3/84x0YfuVXfqVHGd/97nc3
gPyLv/iL7ad/+qc7gABp7T7zmc/06HHBIdD8tV/7tQ596vCRf+973/t61FM9QAcA9Q0k+f6m
N72pj0UbZfLf//73d5AEiXwCnyLOgB4MOge0fHja0562ERRPPfXUdtxxx3UbxmhcIPqTn/xk
h0vRZT5pTwdRYw+WiVKDTpo+7GEP6+MEwY973OPav/zLv7SLL764R4hB7O/93u/18RvLq171
qg6uxvahD32o+8wW7Y3jiiuuaB/84Af7+P/kT/5kI8i+973v3RiNns3fxeS0qajpjwF0szcV
rB/odcmSRe1pxzy9X5fhI0tbvW5mLfWyZcNaZ/8DDcC78nbXZtkAtbe3L37x39riJcPDZMPb
FPobFEoMcHuHtPn5HQpzEgWiQBSIAttAgborbIOu0+U4KACkAJfIn+gkyBQNBFUg1X7//fdv
D37wg9u5557bYRJQnnnmmQ2UgrC/+Iu/6EAF5ETDQCmArKglewDa8oQPf/jDvT6YO+ecc9rf
//3f9ygmUOOLeqJswPA5z3lOB1BR1wc84AHtyU9+coeTz3/+8+0Zz3hGB8FnPvOZHfJoqT/9
Aj/LBEAkwLM2FrCr+5d/+Zd9mQWwVRfEWm5wzDHH9PFU5NO4RZ3Z9NCcej/4wQ+6TXqASuOS
b7vsssvaL/3SL3WfADQQBdfGpK7xsOcDwNvf/vZ+ro4o65vf/OYO0ccPHxBcCxFr1+PEE09s
T3/609tHPvKR9vu///vdtr74dsEFF/T+PvCBD3TwpZ8PB0D72GOPbZ/61Kd6dHoc/sa2pQ+u
sQ8vournn3dh+/a532nf+c55g34XtdO/dWa76OIr2jdOPb2d/IV/a9ddf0tbsnhYw73Wq9Ss
TphZLnNn/wFtoPbOuiQnCkSBKLDtFQjYbvtrsE09KIh04wdxBwxfkUsAytf2kgjkvvvu24FK
Pkh76lOf2uHtkEMOaQ960IPa1Vdf3c+VAza2tFe31n1ayiDfetD99tuvHX300b0f59qIdoK2
asc3EO3r+kMPPbTd73736/X/67/+qx1++OEdgNlQzn8QY69PfjjWt3yRVnXZO/jgg9tFF13U
H5RTB1w+9KEP7fYKdqtvUeazzz67+3X++ef3fumhnjp85bs8NvRtDJK+HCsDqnwRgf2FX/iF
vpbWeto//MM/7Jr4alw9sKwd/61tprMyUV7RWet3JXYf/vCHd5vg2bro0sQHAEtK2FhoaYi/
Dm+f9Q8yHdbTjmjqWu+xx15tz732brvsulvba5992373e2A7+5wL2ncvubJdc/UNQ/DW+26H
5SOLhnXnfT2t/wdGp8mC2trrLCkKTL8C5qWkKDAJCmQpwiRcpXn00WS1aHivEeiaOZ55S4F1
rSKfoE0CnYcddlivo57II0hVLpqq/P73v38HPcCnDHzZwJ821oJ6I4Jj7YCXes4BoXJg51iU
01sNvve977XTTjutR3lFc5Wx5wEsEVnQBxpFVb2GC6Taql91rrzyyt6OXyLK+j7wwAM3fsVf
kMo2+NFWO5oAStFPUA6Of/u3f7v7y45UYygb2jo2JhuwYst4KjoO0kWhjd1bKCxpeOtb39rH
1dd+DroAWL6wwZ5jHy74yH/5xsNmvYbNw240VEdiw3VayIlWt946PCC5ZFj/vHa4tgP2Llux
/XA9bmv32ec+7dtnn9tWrVw7HN9v+GbifoN+w1sRhh918JnAtaTzpjQCs7Us4Q4Pk22qmaMo
MG0K+P8hKQpMggIB20m4Snfj42zX1pZJk9Xi4UlwcGhN6Uc/+tH2ghe8YOMrswAVQPJVu3Ln
gAzQgSogBhyf9KQndXgrkCuArMkQIACuiiIWtAFZ0AdAHLNtA9byrV19yUte0iGOzyCRDWCo
Pjv6qMgpGHUOivkC/gAhm5J66lh+wJb2wNAxcAaR6lgS4NjyAXVES/lYYF4AWeCpH+OjybXX
XtuBVXu+8ANsi8Bax2t9svrKRa4f//jHt0uHZSCOXQc2Aak2fDIWPrgGdHVsDHymPx0cW+JQ
/fFFXX0vxFT/X9DDGmearl/nQ8eKtuPOuw/UurTtsOOuw/Ka8wcNV7WffcpjB+Rd3CO1fo1s
Sf/FsuHhxR8Ha/3c7miqW/wo9o6W5zgKRIEoEAW2jQKj37FtGw/S6zZVACS6+dvbrF319Tgw
AlngSiTQus0CNEDmq29QZa2n9pYTqKsd6ANfYAIkAiy2AZi6EtBkRz1tlLOnjfqAztfpj3jE
IzqY6Ft7dTxEZo0vOLTu1zpT7dhiU5/gssPMYJf9Jz7xid1e+fzIRz6yj48vfNKW//oAtY7Z
l//Yxz62Wf5w5JFH9nLAXdCorbGAXsei3Np6u4P2yvjDjrcpfO1rX+u+l5YA9YwzzuhQW/3x
Sb7+vKGCDeO0zrlgvKK/dDNmyxJOOeWUPqbzzjuvr7VlY6En2t10y83D31dr97nvvsOrvhYN
a2vPGOB2l2E5yiX9Q40PEQ895OB24xA9Xz78kIMfZ/DQ2eIlha13hNoZTTdforDQlc74o0AU
iALjoUAituNxHbaZF2AMiFWEUuRVhOvP/uzPOpiBQw8uHXTQQXf4gQLA4NVV2nt3LcASWbR+
Vb4HqABuRT8BJZhjD2gCQyBnA2bK5UsgUbt//Md/7Mce/JKnT9Fkmz68sYBNbz3ghw3M8YNN
8KedHy940Yte1F760pe2z372s90vD5UVcIoO80N7OgB6vtjkWYJhuYBxgtqqz7YEhrXXTv/g
07pj7wKutxPQmP8eWvP2An6DXbp540RFZenndWAnnHBCe/azn91tfOxjH+vjYav6A/405J9x
eFODd+LSit03vvGNXeveYMH9swlE/R3ssL0PGX5aeY/22c+dNLyndl172CGP7K9uW79+TTvq
cY8eHhrzzcWwnnzd8CMZw6+TrV0zEwn3zltpYwS4h3A32V9w0mbAUSAKRIExV2C74QZY36qN
uatxb0sUGL547dUH7Glf/vKXO0hZV/q857+ww9Dl37tqWBO7f1uxxC+H3dIhCFx5dZVoIziy
gTUQBeY8XS6BPK/REqUFqgALxFrjqj3gkwcM2QBfbLID7iRvKmCPfXkFaQBQvjaO2VWHHX0B
yIJOEFpQWZFM9fQPlNlQrj2b2oNAfZU9gFkJZBonEJavrTYFq471qX/lzvULdgGUemC66htX
tdemQLr6oQdfjUkyXhFfOhboayPRQV/qas+uTXnV5Tv/jLvK1Z3uVF86GeegSx9sjXn4+dzh
dV4nnfz/2lOe9nPtiiuvGR4Yu2/7wAc/3JYuG34OetBprz13ay8+7oVt9aDvbbff0vbcbcf2
T//0ufacZz9r0NCHpR9HbX+8ltZpZemqgLd3m3+iwIQrYN6w5MmDuuaRyy+/vJ100kl9jjOH
eQBXflIUGGcF6q4wzj7Gt3lUAOABqoqaitYCMsAF0oAUKC0IVQ9k2QNEEyF4Ao+gTD4AA1zs
FEBaGiBVX7WuVdva1K+v+dkxgYI1dk2qzsGmBCyBOD/V1Y4vbKhnHAWgytTjr8R/dQsI1eev
cq/0Uhd4l+/yQShorDEbo7EU1BZAs+24fpq4tBnVyTF7yiTn+qy6yoxPnvG4BvrTv2Rcyvin
jf74W8svtJWUL5QEMGvhwOiYXS8PigHUdcMa26VLl7dHPeoxg37DkpVBx8MOO2RoOLx9Y5Ft
7fB34PfG1gzlg7UhWrto+KWyRXe4jw9TJsjNQ2OjMuc4CkSBKDA2CmQpwthcim3jCGjyAnsQ
VAAHFCWABaKqDAiCXQ9ugTrQpQ0wBF3KgJZ2wEtb0Aa0gJlUwAZKQaA6+itA44/+5Il8lt2C
NW30CUSVaV/Ay0b5A8TZUI9N7ZWNJuf6UqcgEiCqW75pqw911Sn/AS2Yp8PomI2XTVHXaks3
vsgvzdTTr7bynRuHVPBu/PKds8EHvrCrLn/s+URzGqtf42Rb/QWTwObGh7xmPrPTauedLUlx
vr7deP217bFHPHLQCQmvb4cfeki75eYbhmu5fPhuY+Zv1wc518n1UW09Yh72o5HarmmH24oO
LxiVM9AoEAWiwFgrELAd68tzT5ybuYG7ac8mzYDhzDtrARYoAku2UUBi27kbPqBSV1vwJAE3
ECFVu7IDEBxLBXOj0FU2ABowszkehTJ5UsGc/h1LykbtOx7tR/mor44LJruB4R++q1f5ZbN8
Hy1Tp4C2+mdTv9VPjUnd0pQtSb3y1/noOJwbu1T1ac6uxF7ll40qq/JecfhnNL/ypm8/8/e3
CTrr/4eZvT+bdWuHbw7WrGwPfuDM16vr129oP3v0kV3HDcOvkK1YOnwIGwh2px127Nr7Gd1F
i5f14yXDG0Ms59kUDq7lDtOnZEYUBe5OAXNgUhSYBAUCtpNwleJjFIgCW6BAwe1MEx8EvvqV
U3pU27EPYT54+ABRkXTnPiiIevustnr1zI9q1IeMLeg8VaPAVCpQH6SncnAZ1FQpELCd+Ms5
u0jtxA87A4gC90ABIOvnkkXFQWwlwKrMXkS9IvSi41IttVEnKQpEgSgQBSZHgczak3Ot4mkU
iAJbqIClG9bMFsQCV8tORGjBLNgVibKm2rl68pwHardQ7FSPAlEgCoyBAonYjsFFiAtRIArM
jwLWGXsIr9ZmV3RWpBb0Alx1RkG31jHLd5wUBaJAFIgCk6NAwHZyrlU8jQJRYAsVEIUVobW0
AODWUgOgKyILXitqq1wSwZUHdpOiQBSIAlFgshQI2E7W9bqTt/U0uNcSJUWBKHBHBUBqRV5F
awti5RfkaqEOCJZqD4jrjRW9IP9EgSgQBaLA2CsQsB37SxQHo0AUmK0C4NR7gO0Bq6UFFZEF
uqK2ABfYyrfJt1QhUDtb1dMuCkSBKLDtFAjYbjvt03MUiALzrABgBakVhXUu1TIDoFt56hT8
Vv15di/mo8DEKJD/JybmUi14R/NWhAX/JxABokAUiAJRIArcvQK+zUiKApOgQCK2k3CV7sbH
rK29G3FSFAWiQBSIAlEgCiwoBRKxXVCXO4ONAlEgCkSBKBAFosD0KhCwnd5rm5FFgSgQBaJA
FIgCUWBBKRCwXVCXO4ONAlEgCkSBKBAFosD0KhCwnd5rm5FFgSgQBaJAFIgCUWBBKRCwXVCX
e9NgF21Y3xb1h1zz60qbVMlRFIgCUSAKRIEoMMkKBGwn+erdje8b2qJm8w5PL6GXvIdw0fAa
he3a+rZ0yZC3Yd3dWEhRFIgCUSAKTLMC9T5nY3Tsvc6Se8bm763d/LxXzD9RYAwVyOu+xvCi
zKVLfkXJhGTS2nzLewnnUunYigJRIApMlgJ+Xa+AFczWPQHgjkKvUVXZZI0w3i5EBQK2U37V
TVomJJuJq346VH4dT7kEGV4UiAJRIArchQJ+alpyP3B/qEhtHd9Fk2RFgbFXIEsRxv4SbZ2D
PnWD2tGJi8V8+t46XdM6CkSBKDDpCixbtqxV1LaCIHXPmPSxxf+Fq0Aitgvg2puwatKy5tZW
yxK2W5Q/gQXwJ5AhRoEoEAXupID7gGUHo9/q1bGypCgwiQqEaibxqm2hz6BWqk/iliDYfN20
9scPC2yhyVSPAlEgCkSBCVdg8fCdrftAJceey3B/EABJigKTqEDAdhKv2hb4PPqp2ydxE1eB
7urVq9vSZSu2wFqqRoEoEAWiwLQo4A057gfuE/UGnVqmNnrvmJbxZhwLQ4GA7QK4zgWyhmrS
MmHdfvvt7YYbbmgrV808PLAAZMgQo0AUiAJRYFSB4ZWP9RCx+8L222/f7w3uE/KTosAkKhCw
ncSrtgU+i9BaQwVuRwH3oIMO6ufedZsUBaJAFBhHBQCWr8ZXrlzZQcscJs+8BsRG57TZ+M+G
B6i8HaD6YdMDVfqR1NGfc2WjfVed2fR9b7Thq7GB1FWrVrVddtmln8tT5r3mm6e9995741hH
y7ZW61FbOY4C86lAwHY+1Y3tKBAFokAUmLUCwPG2225ru+66a48kMgQ6f/jDH7bdd9+9w9qs
jQ8NwZ1vr+z1tWLFig5+FQzQlzIJ4KpTe3njDrZ8NYZ6n/mtt97K7X4uf+2aVf38nvwz7mO9
J2NInYWhQMB2YVznjDIKRIEoMHEKgMqdd9653XTTTT3q6Ktya0F32mmnDrxb+3W5KCT7N998
c4/Gsr3DDjv0Y88giGyqU9HKglx7ecBxnFP90IJxLF++vGsIaPn+ox/9qK1YvnSc3Y9vUWBW
CgRsZyVbGkWBKBAFosB8KwDMbAW0oqvA09IEgLa1YCkKCfB8Re+r+h133LFHcNmuBGLVK7jl
jzx9V17VHbe9ZRZ8BLb8tRknyKXphvV588G4XbP4s/UKbPq/d+ttxcIEKuCp2KQoEAWiwDgq
sHzZkrZq5W3dNdAJQtesXtnMW4sXDQ83DcC5NQmgrls7/HzsujX9a3lfzVuOIK1ePbPudtGi
7QYYXL1xScJAg23JsGZ1Xa+1df13E/P4j/F0SB8eElu/fkPbcYfth3Gt3rgEwfiTosC0KRCw
nbYrmvFEgSgQBaZIgU984hPty1/+ch9RvVtV1PaWW27pD35tzVArGmzNriimCOfb3va2ts8+
+/R1qCKcop3eIGNvE/G0ZrW/LnHYj3Pir+UaAJbP1iXvueeefQxZMzvOVy6+bY0CAdutUS9t
o0AUiAJRYN4UALIitR/+8If7EgQd+WrdA2XWxgK3rUngrqKW+hIRftGLXtQ+//nP97W8YFC5
KK51vaKf2vgaH9iOOxwW1NLpuuuua+edd1479NBD+zh8ODCGpCgwbQoEbKftimY8USAKRIEp
UQBIWk8LMEVV7cEkuK0HyrZmqGyJyorUAtt6QwL7tTbVXj2AawOJNnW1G+fETz4bAy1pBmiN
ma7KkqLAtCmQv+ppu6IZTxSIAlFgahQAZYsHEPOKquV9P7ykawCyJQOoLesRR1FJoFbgWSBn
Lx/Q2UsVYS2gs1duSUK9YUHdUZh1DHq1Va/OZyDbe229ZcBP0Hod2My5/bp1Gzaer169tvvL
d2VVXxvjsFfGTVvVccyO/eLFSwegtrLXu8mB9pLuM58KvIGsY77x2fhqrOrJt5cqv5/cg3+M
OykKTIICAdtJuErxMQpEgSiwABUoEAVjBa8FmMDNcgR7SwUsTxCFBGDqyrd8QJ5k+UBB4KiU
1UftR8t+0rG65Yc1t1L1W0sUQCQ/wCY/+VERaPVFe63r9W5Zx3wryK4lAs4BaI2fTfb0JU89
QO7YVkArmiy//NySsfHtrtJc2Lgru8mLAnOtQMB2rhWNvSgQBaJAFJgTBUajp2WwAAu4WZ5w
8sknt2OPPba9+MUvbr/5m7/Z/vM//7MDpbW5Z511Vl8zC/p8De+HHgDva17zmnbCCSd08GN3
FADLfvVX+9E6lQc8bWeeeWZ73vOe117wghf0/Zve9KYOoFVeP4xgDS/IBcMAVb5zUF4RVJDL
d9DqATk2AGsBumO+FOhXpFn9a665ph133HEdcsveTxpPjSH7KDBtCmSN7bRd0YwnCkSBKDAl
CgBS4AbSCiwBHbgTtfzXf/239q1vfat96lOf6nXU+9Vf/dUOuUcffXTbbbfdOkAWDALFN7zh
De35z39+e9SjHtXhkFRsszea6rz6rbICRXuR0a997Wv94bZPf/rTPXIMnN/97ne3N7/5ze2N
b3zjxoiqta0VWXYMbgGsH4cokDU27esNDaLMFYXmT+lQ0LpmeJ0XP8AwsK2tHm7Txrb5GGos
2UeBaVQgYDuNVzVjigJRIApMgQIFl4BPqnPwJ9rpVWCf+cxnOrwCYPXe8573tFe84hXtl3/5
l3vEU7uC0de+9rU9ovmQhzyktylALPCretpsnu6qjvZ/93d/1z7wgQ/0visSKyL86le/up19
9tntsMMOa9dff3174Qtf2E0aw6te9ap2xBFHtCuuuKK3ve9979sBmf+vf/3r2yGHHNLhnT1R
4ALad73rXe3+979/913+4sUzSxJoIAFcEd5RGOY3uzW20rA3yD9RYAoVyFKEKbyoGVIUiAJR
YBoUAKuArB6KMiZgBvhA4UEHHbQRUMEfoAN+++23XzvttNN6WQHv8ccf337913+9PehBD+qR
U3YKVtmt4wLA6steqvKZs5nzCy+8sPe31157dZsAUrRUZNhyBK/WKpAVxf3c5z7X3v/+97d3
vOMdPSoL0M8///x2wAEHtI9//OMdyD/72c92ONXfW9/61g7B8oDyRz7ykR7R/dCHPtRe8pKX
NFFiSw/kq29JA5sAt2C4/K49/wO3dRWzn0YFArbTeFUzpigQBaLAVCgg0jjzFL/hgDYJmIHH
BzzgAf24opSWHIDgAsoC49e97nXtnHPOaaeeemoHSl/ZVyrgs/9JqcpG6zoGkuBa/9b78k8+
qOSL/q2r/djHPtZ+6qd+qtfZe++9e5l87dR/xjOe0esaz3e+850+pssuu6x9+9vfbkcddVS3
8YhHPKLDsvF94xvfaKLOxnHMMce0U045pduxhliyhKO0Yj8pCiwkBbIUYSFd7Yw1CkSBKDBB
CoiASgAQLIrUOgaNBYUg11pXefWVuygoEAR48p7whCe0t7/97e25z31u23///fvDZmWLffC3
eRRz8/O7qgNWL7300t4PiLV21hIJxwDU3psZ+OBhNWBdUM1fx/b1kJhIq8Q3tsCrY/n8MR4R
YdBqucMgST9W5gcY6ECnWptcPt8V3FZZ7zD/RIEpUiAR2ym6mHc1FBOcibP2daOo/eaT913Z
SF4UiAJRYFsoYH4CfwV1YNbc5fzhD394+4//+I8OpR62sgxB+ZVXXtkuueSSdvjhh3e4VPbz
P//zvfx973tf/8r/qquu6jYqqgkc9QMKpYI+86a+nLPt3HEtjbA29uKLL25XX311h9gCSz6+
5S1vaWeccUa362G1Jz7xiX3JgHWy+lGHTbbAqmNRX2WOjeeCCy7odtW16b/0OPHEE5vtk5/8
ZN/vu+++vZ16NR62+Q+wtat8fchXt8bqvJI8ZZL82vTPlnJbUhQYRwUCtuN4VebQJ5OQyag2
pk1q8mtSm8PuYioKRIEoMGcKmKNAnz0IFb00l0k+sL/0pS/tbzgQ8dxll1165FMk87d+67d6
vXq1lnbsWAur7J3vfOdGsDMXAkrwNmobFOqjIFT/ygGdNuCTXx4Ke+UrX9kBlQ35HigDkuD6
xhtv7DYOPPDAHoUFl9p9//vf7/CqDf+ArCgt+/q2Tth64P/93//t9QG7NcJ8eupTn9pOOumk
7o+lC9bz6q/8Mh5AL1oMtmssFU1mQ94o4PJJ4k/dI0bvGwWy6qmTFAXGVYEsRRjXKzNHfpmA
TEgmqtFJzOSbFAWiQBQYZwX82pZf2QJnoA8UAkxrW81tj3/84zvAvexlL+tgaCzefPDQhz60
A2aBnNdpaQPonvzkJ7evf/3r7fjhYbJ63yxbbANDCbw5B39SgZw5VOKDMr8g5h26ljf8xm/8
Rm+nDoj967/+617nPve5T4dvD3tpZx2tNcBAVbvqU3/Gab4GlHwV9fVwmHbA3ANoXg/2O7/z
O93miSd+ovvz3ve+t/uorbpeKwZ0K4otH+hK+qELewXqvWDkH/Vt7PDPMQ1sdRzAHREsh2Ol
wHbDe/byfcJYXZK5dcYk5IXlIgK+uvMKHBMfsK3Jem57jLUoEAWiwNwoAGq9LaAerjJ31Qd0
oOY9rgCwoFWv5jqRWpBojgNgAM3DWgCXDW3Uk8yFjtWxTvXlL3/58H7cf+0Apy9z6A9+8IMO
hOzJq3w/8ys6ChLZraRN9VM+68cxsBTFtXSAj+BTHptAE0jyT5ljAK1c2xpLge/Klbd1/8tG
jaVgmR+SfD/ecO211/YPAzNQvmmJgXHZ1LfppzavVBNdNsaf+Zmf6fnlq31SFBg3BfJXOW5X
ZB78qUnTxFUTZ01g89BdTEaBKBAF5kQBQAbyQKw5C0gBLPlgFnyN9ydZ2wAAB7FJREFUQppz
81zttXUMCrUDsPLAqHmRHXOiaHDBYUFegZ59RS0Nij1tRERFPtnRtiBPP1JFSPVXeWVr9913
7xDNTs3P7Dk2HmOT9AW4azzy2KtobPmqnToFnAW2xqeOMmP062uO+caOVDYcF9Q6ZqMitvzU
psaoXLukKDCOCuT76HG8KnPok4lI9MJEbrMWzetmTPQmsUxOcyh2TEWBKDCnCoAwgCXCCazM
V+DM3CV/zZqZCKj5DBDKU+bresdAtuY5deTdcMMN/RfJRHABm3J77QtG1R0FPoOSV2AHJGfm
zplIJz/BpnKRUet91WdbAqraqGMDjGBXu1G7jvnCTxuf5KnvuMavH9C6du0MXLMFrtU1hopG
a6NfZXzZc889u4980J4dNpXVVuNWJlLLljz3kRqPvbykKDCOCgRsx/GqzLFPHpgwQfn1Gy81
9zOTmZjmWOSYiwJRYM4VAGU+jFtrCmgrygi6pHXr1nRAK0AEW+qY3+SBtwIzwAfopIJeeTbg
rJ3tox/9aAe+6ksbPlimABALgAHo7bevat4dqz916id89aF/+ezba8ef8quWTxiLMv3xFcQC
VGOxB60VwfUwmGN908Yvj9VY2dW2osgFngW78r0Tt+pZ6sBG+clnvpQ97fxymg8Aor177LFH
Lyu76idFgXFUIGA7jldlDn0ySfnay+Rq4vWaGy8Ud14T9xx2F1NRIApEgTlTAOhZ8wquAB6g
KzAEXsCuwAysAjPwWcfmP5v5zjdW9srAqmNlQBGQ2oM2eYDPOXv69cCXXzQzZ1b/MxC6Q68n
H7TqW1t+jkJitSn7da6vAmVlbGpXkFsgzOcap3J1Z7SYiSIrp4dkXPzQVtJH9efcsbr6qDL7
0kw5n9jwKjM+gdoCeH2rY58UBcZRgcVPetKTjh9Hx+LT3Chg8jFp2UzsPqWb+HwlZeIzSdbN
Qt2atNSXMnnNzXWIlSgQBbZcAey0bh2AFUn0OipfgYM1YDVjr+YtZwVoNW9VWYGdc3UKOh2b
B4Fe1bVXv0DP/Civ2uhHufP16y0bED0Gj2CW/fLNHDrjr3zHtfG9xlNtqr2yOq72VVeZvOqD
DzWm8r98U9O4Ruf50Xnd+JyDfDCuPYh1LAjy3//93+3yyy/vYO9BN3ALhksrfSdFgXFUIBHb
cbwqc+hTTeiittad2c4999w+QT3wgQ/sk1ZN2jUxbv5Jfw7diakoEAWiQBS4lxQAqUC0YLfg
vCKyli6AVeWScm9OOOuss/oyBHmCIJ7LUKadva2AX52kKDBOCgRsx+lqzIMvPpEDVg8z+JUc
Xy9ZZyvf8cEHH9xfgWMCNGmZBH2Sr0/z8+BSTEaBKBAFosC9pABoreiz+R2U1jIM0doqU89r
zU477bR24YUX9nz3De/htQxBeUVr675yLw0h3USBLVIgYLtFck1eZZNWwaqHyBwDWw+TWZrg
gYhaP1YvQNdGMumZBJOiQBSIAlFg8hQQVQWh5nEBDseSvTXE5nwBjUuGnyA+77zz+k8D11sn
wOwBBxzQ34ZQdnybB3Cdu0+UvclTJh5PswIB22m+usPYTGaSichXTvV74n7b3JPAp59+ervs
ssv6+ikPSXilCwD2Sd1kCISTokAUiAJRYPIUMIcD19GorGNvSPAgsT3A9XCe5y9s7hm+3QO1
lio4Z8NeW3tAW/vJUyUeT7sCAdspv8ImIJNRfY3kE7f1UpYeeBLYzzpaknDppZd2iAW/fp1n
dEKccokyvCgQBaLAVCpgHjf3g1B79wNzv2/jvM9XMENZRWQ9IHbg8HPAorXuC/LdM2yObWxW
5HYqRcugJl6BgO3EX8K7H4CJzERkq4kJ6HqYTHR2n3326e+H9MCAB8t8MvfpXaqJ8O57SGkU
iAJRIAqMqwLAVar53PwPTL0TV5k9oLUBXfeKukeI6BbcsuFYG1sBs/ykKDBOCgRsx+lqzJMv
JiDJhCXVeX0S93WTr55MZpLlBwXENSn2gvwTBaJAFIgCE6NABTTM+eZ754IXALXehmAvz5zv
oTLzv9d+jUZ3DbiitNq6VyjP/WFi/hQWlKMB2wV1ue84WBOTVJOTCavOK6/q9IL8EwWiQBSI
AhOjQM3pgBbc2sztILXAFMjKswFcyXIFqYDYMVtVT9sKlChLigLjpEAeeR+nqxFfokAUiAJR
IApEgSgQBWatQMB21tKlYRSIAlEgCkSBKBAFosA4KRCwHaerEV+iQBSIAlEgCkSBKBAFZq1A
wHbW0qVhFIgCUSAKRIEoEAWiwDgpELAdp6sRX6JAFIgCUSAKRIEoEAVmrUDAdtbSpWEUiAJR
IApEgSgQBaLAOCkQsB2nqxFfokAUiAJRIApEgSgQBWatQMB21tKlYRSIAlEgCkSBKBAFosA4
KRCwHaerEV+iQBSIAlEgCkSBKBAFZq1AwHbW0qVhFIgCUSAKRIEoEAWiwDgpELAdp6sRX6JA
FIgCUSAKRIEoEAVmrUDAdtbSpWEUiAJRIApEgSgQBaLAOCkQsB2nqxFfokAUiAJRIApEgSgQ
BWatQMB21tKlYRSIAlEgCkSBKBAFosA4KRCwHaerEV+iQBSIAlEgCkSBKBAFZq1AwHbW0qVh
FIgCUSAKRIEoEAWiwDgp8P8BG+b7h23iQTUAAAAASUVORK5CYII=
--------------010504030303090109000601--
--------------000904060502090707080709--
1:06 p.m.
Hi Kanagaraj,
Please find the logs from here :- http://ur1.ca/jeszc
[image: Inline image 1]
[image: Inline image 2]
On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
Looks like there are some failures in gluster.
Can you send the log output from glusterd log file from the relevant hosts?
Thanks,
Kanagaraj
On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
Hi,
Is there any one from gluster can help me here :-
Engine logs :-
2015-01-12 12:50:33,841 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:34,725 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,824 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,853 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,866 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:37,751 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,849 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,878 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,890 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:40,776 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,878 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,903 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,916 INFO
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:43,771 INFO
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
(ajp--127.0.0.1-8702-1) [330ace48] FINISH, CreateGlusterVolumeVDSCommand,
log id: 303e70a4
2015-01-12 12:50:43,780 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event ID:
-1, Message: Creation of Gluster Volume vol01 failed.
2015-01-12 12:50:43,785 INFO
[org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
(ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
[exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
[image: Inline image 2]
On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík <mpavlik(a)redhat.com> wrote:
> Hi Punit,
>
> unfortunately I’am not that good with the gluster, I was just following
> the obvious clue from the log. Could you try on the nodes if the packages
> are even available for installation
>
> yum install gluster-swift gluster-swift-object gluster-swift-plugin
gluster-swift-account
> gluster-swift-proxy gluster-swift-doc gluster-swift-container
> glusterfs-geo-replication
>
> if not you could try to get them in official gluster repo.
> http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
>
> HTH
>
> M.
>
>
>
>
> On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com> wrote:
>
> Hi Martin,
>
> I installed gluster from ovirt repo....is it require to install those
> packages manually ??
>
> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík <mpavlik(a)redhat.com> wrote:
>
>> Hi Punit,
>>
>> can you verify that nodes contain cluster packages from the following log?
>>
>> Thread-14::DEBUG::2015-01-09 18:06:28,823::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift',) not found
>> Thread-14::DEBUG::2015-01-09 18:06:28,825::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-object',) not found
>> Thread-14::DEBUG::2015-01-09 18:06:28,826::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-plugin',) not found
>> Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-account',) not found
>> Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-proxy',) not found
>> Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-doc',) not found
>> Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages) rpm
package ('gluster-swift-container',) not found
>> Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages) rpm
package ('glusterfs-geo-replication',) not found
>>
>>
>> M.
>>
>> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com> wrote:
>>
>> Hi Kanagaraj,
>>
>> Please find the attached logs :-
>>
>> Engine Logs :- http://ur1.ca/jdopt
>> VDSM Logs :- http://ur1.ca/jdoq9
>>
>>
>>
>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
>>
>>> Do you see any errors in the UI?
>>>
>>> Also please provide the engine.log and vdsm.log when the failure
>>> occured.
>>>
>>> Thanks,
>>> Kanagaraj
>>>
>>>
>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>>>
>>> Hi Martin,
>>>
>>> The steps are below :-
>>>
>>> 1. Step the ovirt engine on the one server...
>>> 2. Installed centos 7 on 4 host node servers..
>>> 3. I am using host node (compute+storage)....now i have added all 4
>>> nodes to engine...
>>> 4. Create the gluster volume from GUI...
>>>
>>> Network :-
>>> eth0 :- public network (1G)
>>> eth1+eth2=bond0= VM public network (1G)
>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
>>>
>>> every hostnode has 24 bricks=24*4(distributed replicated)
>>>
>>> Thanks,
>>> Punit
>>>
>>>
>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík <mpavlik(a)redhat.com>
>>> wrote:
>>>
>>>> Hi Punit,
>>>>
>>>> can you please provide also errors from /var/log/vdsm/vdsm.log and
>>>> /var/log/vdsm/vdsmd.log
>>>>
>>>> it would be really helpful if you provided exact steps how to
>>>> reproduce the problem.
>>>>
>>>> regards
>>>>
>>>> Martin Pavlik - rhev QE
>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
>>>> >
>>>> > Hi,
>>>> >
>>>> > I try to add gluster volume but it failed...
>>>> >
>>>> > Ovirt :- 3.5
>>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>>>> > KVM :- 1.5.3 - 60.el7_0.2
>>>> > libvirt-1.1.1-29.el7_0.4
>>>> > Glusterfs :- glusterfs-3.5.3-1.el7
>>>> >
>>>> > Engine Logs :-
>>>> >
>>>> > 2015-01-08 09:57:52,569 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> > , sharedLocks= ]
>>>> > 2015-01-08 09:57:52,609 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> > , sharedLocks= ]
>>>> > 2015-01-08 09:57:55,582 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> > , sharedLocks= ]
>>>> > 2015-01-08 09:57:55,591 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> > , sharedLocks= ]
>>>> > 2015-01-08 09:57:55,596 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> > , sharedLocks= ]
>>>> > 2015-01-08 09:57:55,633 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> > , sharedLocks= ]
>>>> > ^C
>>>> >
>>>> >
>>>>
>>>>
>>>
>>>
>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>>
>>
>>
>
>
5:53 p.m.
I can see the failures in glusterd log.
Can someone from glusterfs dev pls help on this?
Thanks,
Kanagaraj
----- Original Message -----
From: "Punit Dambiwal" <hypunit(a)gmail.com>
To: "Kanagaraj" <kmayilsa(a)redhat.com>
Cc: "Martin Pavlík" <mpavlik(a)redhat.com>, "Vijay Bellur"
<vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
users(a)ovirt.org, gluster-users(a)gluster.org
Sent: Monday, January 12, 2015 3:36:43 PM
Subject: Re: Failed to create volume in OVirt with gluster
Hi Kanagaraj,
Please find the logs from here :- http://ur1.ca/jeszc
[image: Inline image 1]
[image: Inline image 2]
On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
> Looks like there are some failures in gluster.
> Can you send the log output from glusterd log file from the relevant hosts?
>
> Thanks,
> Kanagaraj
>
>
> On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
>
> Hi,
>
> Is there any one from gluster can help me here :-
>
> Engine logs :-
>
> 2015-01-12 12:50:33,841 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:34,725 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:36,824 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:36,853 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:36,866 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:37,751 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:39,849 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:39,878 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:39,890 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:40,776 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:42,878 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:42,903 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:42,916 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks= ]
> 2015-01-12 12:50:43,771 INFO
> [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
> (ajp--127.0.0.1-8702-1) [330ace48] FINISH, CreateGlusterVolumeVDSCommand,
> log id: 303e70a4
> 2015-01-12 12:50:43,780 ERROR
> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
> (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
> 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event ID:
> -1, Message: Creation of Gluster Volume vol01 failed.
> 2015-01-12 12:50:43,785 INFO
> [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
> (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
> [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
> , sharedLocks= ]
>
> [image: Inline image 2]
>
>
> On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík <mpavlik(a)redhat.com> wrote:
>
>> Hi Punit,
>>
>> unfortunately I’am not that good with the gluster, I was just following
>> the obvious clue from the log. Could you try on the nodes if the packages
>> are even available for installation
>>
>> yum install gluster-swift gluster-swift-object gluster-swift-plugin
>> gluster-swift-account
>> gluster-swift-proxy gluster-swift-doc gluster-swift-container
>> glusterfs-geo-replication
>>
>> if not you could try to get them in official gluster repo.
>>
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
>>
>> HTH
>>
>> M.
>>
>>
>>
>>
>> On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com> wrote:
>>
>> Hi Martin,
>>
>> I installed gluster from ovirt repo....is it require to install those
>> packages manually ??
>>
>> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík <mpavlik(a)redhat.com> wrote:
>>
>>> Hi Punit,
>>>
>>> can you verify that nodes contain cluster packages from the following
>>> log?
>>>
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-object',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-plugin',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-account',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-proxy',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-doc',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-container',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>> ('glusterfs-geo-replication',) not found
>>>
>>>
>>> M.
>>>
>>> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
>>>
>>> Hi Kanagaraj,
>>>
>>> Please find the attached logs :-
>>>
>>> Engine Logs :- http://ur1.ca/jdopt
>>> VDSM Logs :- http://ur1.ca/jdoq9
>>>
>>>
>>>
>>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com>
wrote:
>>>
>>>> Do you see any errors in the UI?
>>>>
>>>> Also please provide the engine.log and vdsm.log when the failure
>>>> occured.
>>>>
>>>> Thanks,
>>>> Kanagaraj
>>>>
>>>>
>>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>>>>
>>>> Hi Martin,
>>>>
>>>> The steps are below :-
>>>>
>>>> 1. Step the ovirt engine on the one server...
>>>> 2. Installed centos 7 on 4 host node servers..
>>>> 3. I am using host node (compute+storage)....now i have added all 4
>>>> nodes to engine...
>>>> 4. Create the gluster volume from GUI...
>>>>
>>>> Network :-
>>>> eth0 :- public network (1G)
>>>> eth1+eth2=bond0= VM public network (1G)
>>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
>>>>
>>>> every hostnode has 24 bricks=24*4(distributed replicated)
>>>>
>>>> Thanks,
>>>> Punit
>>>>
>>>>
>>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>>>> wrote:
>>>>
>>>>> Hi Punit,
>>>>>
>>>>> can you please provide also errors from /var/log/vdsm/vdsm.log and
>>>>> /var/log/vdsm/vdsmd.log
>>>>>
>>>>> it would be really helpful if you provided exact steps how to
>>>>> reproduce the problem.
>>>>>
>>>>> regards
>>>>>
>>>>> Martin Pavlik - rhev QE
>>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com> wrote:
>>>>> >
>>>>> > Hi,
>>>>> >
>>>>> > I try to add gluster volume but it failed...
>>>>> >
>>>>> > Ovirt :- 3.5
>>>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>>>>> > KVM :- 1.5.3 - 60.el7_0.2
>>>>> > libvirt-1.1.1-29.el7_0.4
>>>>> > Glusterfs :- glusterfs-3.5.3-1.el7
>>>>> >
>>>>> > Engine Logs :-
>>>>> >
>>>>> > 2015-01-08 09:57:52,569 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks= ]
>>>>> > 2015-01-08 09:57:52,609 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks= ]
>>>>> > 2015-01-08 09:57:55,582 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks= ]
>>>>> > 2015-01-08 09:57:55,591 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks= ]
>>>>> > 2015-01-08 09:57:55,596 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks= ]
>>>>> > 2015-01-08 09:57:55,633 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait
lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks= ]
>>>>> > ^C
>>>>> >
>>>>> >
>>>>>
>>>>>
>>>>
>>>>
>>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>>>
>>>
>>>
>>
>>
>
>
5:18 a.m.
Hi,
Please find the more details on this ....can anybody from gluster will help
me here :-
Gluster CLI Logs :- /var/log/glusterfs/cli.log
[2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs: got
RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072012] T [cli-quotad-client.c:94:cli_quotad_notify]
0-glusterfs: got RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler]
0-transport: disconnecting now
[2015-01-13 02:06:23.072055] T [cli-quotad-client.c:100:cli_quotad_notify]
0-glusterfs: got RPC_CLNT_DISCONNECT
[2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record]
0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2015-01-13 02:06:23.072176] T
[rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen
128, payload: 64, rpc hdr: 64
[2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (-->
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420] (-->
/usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a4293]
(--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] (-->
/usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (-->
/usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs: connect
() called on transport already connected
[2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit]
0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers: 2,
Proc: 27) to rpc-transport (glusterfs)
[2015-01-13 02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping]
0-glusterfs: ping timeout is 0, returning
[2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init]
0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI,
ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
[2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk]
0-cli: Received response to status cmd
[2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli:
Returning 0
[2015-01-13 02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume]
0-cli: Returning: 0
[2015-01-13 02:06:23.076192] D [cli-xml-output.c:84:cli_begin_xml_output]
0-cli: Returning 0
[2015-01-13 02:06:23.076244] D [cli-xml-output.c:131:cli_xml_output_common]
0-cli: Returning 0
[2015-01-13 02:06:23.076256] D
[cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning 0
[2015-01-13 02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output]
0-cli: Returning 0
[2015-01-13 02:06:23.076459] D
[cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning 0
[2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: 0
Command log :- /var/log/glusterfs/.cmd_log_history
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:10:35.836676] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:16:25.956514] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:17:36.977833] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:21:07.048053] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:26:57.168661] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:28:07.194428] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:34:58.350748] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:36:08.375326] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking failed
on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:45:10.550659] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
[2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
[2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
[2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
[2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
[2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
[2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
[2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
[2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
[2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
[2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
[2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
[2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <kmayilsa(a)redhat.com>
wrote:
I can see the failures in glusterd log.
Can someone from glusterfs dev pls help on this?
Thanks,
Kanagaraj
----- Original Message -----
> From: "Punit Dambiwal" <hypunit(a)gmail.com>
> To: "Kanagaraj" <kmayilsa(a)redhat.com>
> Cc: "Martin Pavlík" <mpavlik(a)redhat.com>, "Vijay Bellur"
<
vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
> users(a)ovirt.org, gluster-users(a)gluster.org
> Sent: Monday, January 12, 2015 3:36:43 PM
> Subject: Re: Failed to create volume in OVirt with gluster
>
> Hi Kanagaraj,
>
> Please find the logs from here :- http://ur1.ca/jeszc
>
> [image: Inline image 1]
>
> [image: Inline image 2]
>
> On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
>
> > Looks like there are some failures in gluster.
> > Can you send the log output from glusterd log file from the relevant
hosts?
> >
> > Thanks,
> > Kanagaraj
> >
> >
> > On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
> >
> > Hi,
> >
> > Is there any one from gluster can help me here :-
> >
> > Engine logs :-
> >
> > 2015-01-12 12:50:33,841 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:34,725 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:36,824 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:36,853 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:36,866 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:37,751 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:39,849 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:39,878 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:39,890 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:40,776 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:42,878 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:42,903 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:42,916 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:43,771 INFO
> >
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
> > (ajp--127.0.0.1-8702-1) [330ace48] FINISH,
CreateGlusterVolumeVDSCommand,
> > log id: 303e70a4
> > 2015-01-12 12:50:43,780 ERROR
> > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
> > (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
> > 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event
ID:
> > -1, Message: Creation of Gluster Volume vol01 failed.
> > 2015-01-12 12:50:43,785 INFO
> > [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
> > (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
> > [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value:
GLUSTER
> > , sharedLocks= ]
> >
> > [image: Inline image 2]
> >
> >
> > On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík <mpavlik(a)redhat.com>
wrote:
> >
> >> Hi Punit,
> >>
> >> unfortunately I’am not that good with the gluster, I was just
following
> >> the obvious clue from the log. Could you try on the nodes if the
packages
> >> are even available for installation
> >>
> >> yum install gluster-swift gluster-swift-object gluster-swift-plugin
> >> gluster-swift-account
> >> gluster-swift-proxy gluster-swift-doc gluster-swift-container
> >> glusterfs-geo-replication
> >>
> >> if not you could try to get them in official gluster repo.
> >>
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
> >>
> >> HTH
> >>
> >> M.
> >>
> >>
> >>
> >>
> >> On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
> >>
> >> Hi Martin,
> >>
> >> I installed gluster from ovirt repo....is it require to install those
> >> packages manually ??
> >>
> >> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík <mpavlik(a)redhat.com>
wrote:
> >>
> >>> Hi Punit,
> >>>
> >>> can you verify that nodes contain cluster packages from the following
> >>> log?
> >>>
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-object',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-plugin',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-account',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-proxy',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-doc',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-container',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
> >>> ('glusterfs-geo-replication',) not found
> >>>
> >>>
> >>> M.
> >>>
> >>> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
> >>>
> >>> Hi Kanagaraj,
> >>>
> >>> Please find the attached logs :-
> >>>
> >>> Engine Logs :- http://ur1.ca/jdopt
> >>> VDSM Logs :- http://ur1.ca/jdoq9
> >>>
> >>>
> >>>
> >>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com>
wrote:
> >>>
> >>>> Do you see any errors in the UI?
> >>>>
> >>>> Also please provide the engine.log and vdsm.log when the failure
> >>>> occured.
> >>>>
> >>>> Thanks,
> >>>> Kanagaraj
> >>>>
> >>>>
> >>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
> >>>>
> >>>> Hi Martin,
> >>>>
> >>>> The steps are below :-
> >>>>
> >>>> 1. Step the ovirt engine on the one server...
> >>>> 2. Installed centos 7 on 4 host node servers..
> >>>> 3. I am using host node (compute+storage)....now i have added all
4
> >>>> nodes to engine...
> >>>> 4. Create the gluster volume from GUI...
> >>>>
> >>>> Network :-
> >>>> eth0 :- public network (1G)
> >>>> eth1+eth2=bond0= VM public network (1G)
> >>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
> >>>>
> >>>> every hostnode has 24 bricks=24*4(distributed replicated)
> >>>>
> >>>> Thanks,
> >>>> Punit
> >>>>
> >>>>
> >>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík
<mpavlik(a)redhat.com>
> >>>> wrote:
> >>>>
> >>>>> Hi Punit,
> >>>>>
> >>>>> can you please provide also errors from /var/log/vdsm/vdsm.log
and
> >>>>> /var/log/vdsm/vdsmd.log
> >>>>>
> >>>>> it would be really helpful if you provided exact steps how to
> >>>>> reproduce the problem.
> >>>>>
> >>>>> regards
> >>>>>
> >>>>> Martin Pavlik - rhev QE
> >>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com>
wrote:
> >>>>> >
> >>>>> > Hi,
> >>>>> >
> >>>>> > I try to add gluster volume but it failed...
> >>>>> >
> >>>>> > Ovirt :- 3.5
> >>>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
> >>>>> > KVM :- 1.5.3 - 60.el7_0.2
> >>>>> > libvirt-1.1.1-29.el7_0.4
> >>>>> > Glusterfs :- glusterfs-3.5.3-1.el7
> >>>>> >
> >>>>> > Engine Logs :-
> >>>>> >
> >>>>> > 2015-01-08 09:57:52,569 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:52,609 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,582 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,591 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,596 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,633 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > ^C
> >>>>> >
> >>>>> >
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
> >>>
> >>>
> >>>
> >>
> >>
> >
> >
>
7:37 a.m.
New subject: [Gluster-users] Failed to create volume in OVirt with gluster
Punit,
cli log wouldn't help much here. To debug this issue further can you
please let us know the following:
1. gluster peer status output
2. gluster volume status output
3. gluster --version output.
4. Which command got failed
5. glusterd log file of all the nodes
~Atin
On 01/13/2015 07:48 AM, Punit Dambiwal wrote:
Hi,
Please find the more details on this ....can anybody from gluster will help
me here :-
Gluster CLI Logs :- /var/log/glusterfs/cli.log
[2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs: got
RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072012] T [cli-quotad-client.c:94:cli_quotad_notify]
0-glusterfs: got RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler]
0-transport: disconnecting now
[2015-01-13 02:06:23.072055] T [cli-quotad-client.c:100:cli_quotad_notify]
0-glusterfs: got RPC_CLNT_DISCONNECT
[2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record]
0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2015-01-13 02:06:23.072176] T
[rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen
128, payload: 64, rpc hdr: 64
[2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (-->
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420] (-->
/usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a4293]
(--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] (-->
/usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (-->
/usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs: connect
() called on transport already connected
[2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit]
0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers: 2,
Proc: 27) to rpc-transport (glusterfs)
[2015-01-13 02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping]
0-glusterfs: ping timeout is 0, returning
[2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init]
0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI,
ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
[2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk]
0-cli: Received response to status cmd
[2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli:
Returning 0
[2015-01-13 02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume]
0-cli: Returning: 0
[2015-01-13 02:06:23.076192] D [cli-xml-output.c:84:cli_begin_xml_output]
0-cli: Returning 0
[2015-01-13 02:06:23.076244] D [cli-xml-output.c:131:cli_xml_output_common]
0-cli: Returning 0
[2015-01-13 02:06:23.076256] D
[cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning 0
[2015-01-13 02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output]
0-cli: Returning 0
[2015-01-13 02:06:23.076459] D
[cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning 0
[2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: 0
Command log :- /var/log/glusterfs/.cmd_log_history
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:10:35.836676] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:16:25.956514] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:17:36.977833] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:21:07.048053] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:26:57.168661] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:28:07.194428] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:34:58.350748] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:36:08.375326] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking failed
on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:45:10.550659] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
[2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
[2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
[2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
[2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
[2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
[2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
[2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
[2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
[2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
[2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
[2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
[2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <kmayilsa(a)redhat.com>
wrote:
> I can see the failures in glusterd log.
>
> Can someone from glusterfs dev pls help on this?
>
> Thanks,
> Kanagaraj
>
> ----- Original Message -----
>> From: "Punit Dambiwal" <hypunit(a)gmail.com>
>> To: "Kanagaraj" <kmayilsa(a)redhat.com>
>> Cc: "Martin Pavlík" <mpavlik(a)redhat.com>, "Vijay
Bellur" <
> vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
>> users(a)ovirt.org, gluster-users(a)gluster.org
>> Sent: Monday, January 12, 2015 3:36:43 PM
>> Subject: Re: Failed to create volume in OVirt with gluster
>>
>> Hi Kanagaraj,
>>
>> Please find the logs from here :- http://ur1.ca/jeszc
>>
>> [image: Inline image 1]
>>
>> [image: Inline image 2]
>>
>> On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
>>
>>> Looks like there are some failures in gluster.
>>> Can you send the log output from glusterd log file from the relevant
> hosts?
>>>
>>> Thanks,
>>> Kanagaraj
>>>
>>>
>>> On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
>>>
>>> Hi,
>>>
>>> Is there any one from gluster can help me here :-
>>>
>>> Engine logs :-
>>>
>>> 2015-01-12 12:50:33,841 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:34,725 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:36,824 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:36,853 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:36,866 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:37,751 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:39,849 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:39,878 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:39,890 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:40,776 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:42,878 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:42,903 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:42,916 INFO
>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>> value: GLUSTER
>>> , sharedLocks= ]
>>> 2015-01-12 12:50:43,771 INFO
>>>
> [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
>>> (ajp--127.0.0.1-8702-1) [330ace48] FINISH,
> CreateGlusterVolumeVDSCommand,
>>> log id: 303e70a4
>>> 2015-01-12 12:50:43,780 ERROR
>>> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
>>> (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
>>> 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event
> ID:
>>> -1, Message: Creation of Gluster Volume vol01 failed.
>>> 2015-01-12 12:50:43,785 INFO
>>> [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
>>> (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
>>> [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value:
> GLUSTER
>>> , sharedLocks= ]
>>>
>>> [image: Inline image 2]
>>>
>>>
>>> On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík <mpavlik(a)redhat.com>
> wrote:
>>>
>>>> Hi Punit,
>>>>
>>>> unfortunately I’am not that good with the gluster, I was just
> following
>>>> the obvious clue from the log. Could you try on the nodes if the
> packages
>>>> are even available for installation
>>>>
>>>> yum install gluster-swift gluster-swift-object gluster-swift-plugin
>>>> gluster-swift-account
>>>> gluster-swift-proxy gluster-swift-doc gluster-swift-container
>>>> glusterfs-geo-replication
>>>>
>>>> if not you could try to get them in official gluster repo.
>>>>
> http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
>>>>
>>>> HTH
>>>>
>>>> M.
>>>>
>>>>
>>>>
>>>>
>>>> On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
>>>>
>>>> Hi Martin,
>>>>
>>>> I installed gluster from ovirt repo....is it require to install those
>>>> packages manually ??
>>>>
>>>> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík <mpavlik(a)redhat.com>
> wrote:
>>>>
>>>>> Hi Punit,
>>>>>
>>>>> can you verify that nodes contain cluster packages from the
following
>>>>> log?
>>>>>
>>>>> Thread-14::DEBUG::2015-01-09
>>>>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
>>>>> ('gluster-swift',) not found
>>>>> Thread-14::DEBUG::2015-01-09
>>>>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
>>>>> ('gluster-swift-object',) not found
>>>>> Thread-14::DEBUG::2015-01-09
>>>>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
>>>>> ('gluster-swift-plugin',) not found
>>>>> Thread-14::DEBUG::2015-01-09
>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>>>> ('gluster-swift-account',) not found
>>>>> Thread-14::DEBUG::2015-01-09
>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>>>> ('gluster-swift-proxy',) not found
>>>>> Thread-14::DEBUG::2015-01-09
>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>>>> ('gluster-swift-doc',) not found
>>>>> Thread-14::DEBUG::2015-01-09
>>>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>>>> ('gluster-swift-container',) not found
>>>>> Thread-14::DEBUG::2015-01-09
>>>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>>>> ('glusterfs-geo-replication',) not found
>>>>>
>>>>>
>>>>> M.
>>>>>
>>>>> On 09 Jan 2015, at 11:13, Punit Dambiwal
<hypunit(a)gmail.com>
> wrote:
>>>>>
>>>>> Hi Kanagaraj,
>>>>>
>>>>> Please find the attached logs :-
>>>>>
>>>>> Engine Logs :- http://ur1.ca/jdopt
>>>>> VDSM Logs :- http://ur1.ca/jdoq9
>>>>>
>>>>>
>>>>>
>>>>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj
<kmayilsa(a)redhat.com>
> wrote:
>>>>>
>>>>>> Do you see any errors in the UI?
>>>>>>
>>>>>> Also please provide the engine.log and vdsm.log when the failure
>>>>>> occured.
>>>>>>
>>>>>> Thanks,
>>>>>> Kanagaraj
>>>>>>
>>>>>>
>>>>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>>>>>>
>>>>>> Hi Martin,
>>>>>>
>>>>>> The steps are below :-
>>>>>>
>>>>>> 1. Step the ovirt engine on the one server...
>>>>>> 2. Installed centos 7 on 4 host node servers..
>>>>>> 3. I am using host node (compute+storage)....now i have added all
4
>>>>>> nodes to engine...
>>>>>> 4. Create the gluster volume from GUI...
>>>>>>
>>>>>> Network :-
>>>>>> eth0 :- public network (1G)
>>>>>> eth1+eth2=bond0= VM public network (1G)
>>>>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
>>>>>>
>>>>>> every hostnode has 24 bricks=24*4(distributed replicated)
>>>>>>
>>>>>> Thanks,
>>>>>> Punit
>>>>>>
>>>>>>
>>>>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Punit,
>>>>>>>
>>>>>>> can you please provide also errors from
/var/log/vdsm/vdsm.log and
>>>>>>> /var/log/vdsm/vdsmd.log
>>>>>>>
>>>>>>> it would be really helpful if you provided exact steps how
to
>>>>>>> reproduce the problem.
>>>>>>>
>>>>>>> regards
>>>>>>>
>>>>>>> Martin Pavlik - rhev QE
>>>>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com>
> wrote:
>>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I try to add gluster volume but it failed...
>>>>>>>>
>>>>>>>> Ovirt :- 3.5
>>>>>>>> VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>>>>>>>> KVM :- 1.5.3 - 60.el7_0.2
>>>>>>>> libvirt-1.1.1-29.el7_0.4
>>>>>>>> Glusterfs :- glusterfs-3.5.3-1.el7
>>>>>>>>
>>>>>>>> Engine Logs :-
>>>>>>>>
>>>>>>>> 2015-01-08 09:57:52,569 INFO
>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
> lock
>>>>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
>>>>>>> value: GLUSTER
>>>>>>>> , sharedLocks= ]
>>>>>>>> 2015-01-08 09:57:52,609 INFO
>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
> lock
>>>>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
>>>>>>> value: GLUSTER
>>>>>>>> , sharedLocks= ]
>>>>>>>> 2015-01-08 09:57:55,582 INFO
>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
> lock
>>>>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
>>>>>>> value: GLUSTER
>>>>>>>> , sharedLocks= ]
>>>>>>>> 2015-01-08 09:57:55,591 INFO
>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
> lock
>>>>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
>>>>>>> value: GLUSTER
>>>>>>>> , sharedLocks= ]
>>>>>>>> 2015-01-08 09:57:55,596 INFO
>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
> lock
>>>>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
>>>>>>> value: GLUSTER
>>>>>>>> , sharedLocks= ]
>>>>>>>> 2015-01-08 09:57:55,633 INFO
>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
> lock
>>>>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
>>>>>>> value: GLUSTER
>>>>>>>> , sharedLocks= ]
>>>>>>>> ^C
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>
>
_______________________________________________
Gluster-users mailing list
Gluster-users(a)gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users
9:42 a.m.
New subject: [Gluster-users] Failed to create volume in OVirt with gluster
Hi Atin,
Please find the output from here :- http://ur1.ca/jf4bs
On Tue, Jan 13, 2015 at 12:37 PM, Atin Mukherjee <amukherj(a)redhat.com>
wrote:
Punit,
cli log wouldn't help much here. To debug this issue further can you
please let us know the following:
1. gluster peer status output
2. gluster volume status output
3. gluster --version output.
4. Which command got failed
5. glusterd log file of all the nodes
~Atin
On 01/13/2015 07:48 AM, Punit Dambiwal wrote:
> Hi,
>
> Please find the more details on this ....can anybody from gluster will
help
> me here :-
>
>
> Gluster CLI Logs :- /var/log/glusterfs/cli.log
>
> [2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs:
got
> RPC_CLNT_CONNECT
> [2015-01-13 02:06:23.072012] T [cli-quotad-client.c:94:cli_quotad_notify]
> 0-glusterfs: got RPC_CLNT_CONNECT
> [2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler]
> 0-transport: disconnecting now
> [2015-01-13 02:06:23.072055] T
[cli-quotad-client.c:100:cli_quotad_notify]
> 0-glusterfs: got RPC_CLNT_DISCONNECT
> [2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record]
> 0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
> [2015-01-13 02:06:23.072176] T
> [rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request
fraglen
> 128, payload: 64, rpc hdr: 64
> [2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (-->
> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420]
(-->
>
/usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a4293]
> (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] (-->
> /usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (-->
> /usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs:
connect
> () called on transport already connected
> [2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit]
> 0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers:
2,
> Proc: 27) to rpc-transport (glusterfs)
> [2015-01-13 02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping]
> 0-glusterfs: ping timeout is 0, returning
> [2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init]
> 0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI,
> ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
> [2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk]
> 0-cli: Received response to status cmd
> [2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli:
> Returning 0
> [2015-01-13 02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume]
> 0-cli: Returning: 0
> [2015-01-13 02:06:23.076192] D [cli-xml-output.c:84:cli_begin_xml_output]
> 0-cli: Returning 0
> [2015-01-13 02:06:23.076244] D
[cli-xml-output.c:131:cli_xml_output_common]
> 0-cli: Returning 0
> [2015-01-13 02:06:23.076256] D
> [cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning
0
> [2015-01-13 02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output]
> 0-cli: Returning 0
> [2015-01-13 02:06:23.076459] D
> [cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning 0
> [2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: 0
>
> Command log :- /var/log/glusterfs/.cmd_log_history
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> [2015-01-13 01:10:35.836676] : volume status all tasks : FAILED :
Staging
> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
> details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> [2015-01-13 01:16:25.956514] : volume status all tasks : FAILED :
Staging
> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
> details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> [2015-01-13 01:17:36.977833] : volume status all tasks : FAILED :
Staging
> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
> details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> [2015-01-13 01:21:07.048053] : volume status all tasks : FAILED :
Staging
> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
> details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> [2015-01-13 01:26:57.168661] : volume status all tasks : FAILED :
Staging
> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
> details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> [2015-01-13 01:28:07.194428] : volume status all tasks : FAILED :
Staging
> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
> details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> [2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking
> failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
> details.
> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
> details.
> [2015-01-13 01:34:58.350748] : volume status all tasks : FAILED :
Staging
> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
> details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> [2015-01-13 01:36:08.375326] : volume status all tasks : FAILED :
Staging
> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
> details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> [2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking
> failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
> details.
> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
> details.
> [2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking
failed
> on cpu02.zne01.hkg1.stack.com. Please check log file for details.
> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
> details.
> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
> details.
> [2015-01-13 01:45:10.550659] : volume status all tasks : FAILED :
Staging
> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
> details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
> [2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
> [2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
> [2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
> [2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
> [2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
> [2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
> [2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
> [2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
> [2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
> [2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
> [2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
> [2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
> [2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
>
>
> On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <
kmayilsa(a)redhat.com>
> wrote:
>
>> I can see the failures in glusterd log.
>>
>> Can someone from glusterfs dev pls help on this?
>>
>> Thanks,
>> Kanagaraj
>>
>> ----- Original Message -----
>>> From: "Punit Dambiwal" <hypunit(a)gmail.com>
>>> To: "Kanagaraj" <kmayilsa(a)redhat.com>
>>> Cc: "Martin Pavlík" <mpavlik(a)redhat.com>, "Vijay
Bellur" <
>> vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
>>> users(a)ovirt.org, gluster-users(a)gluster.org
>>> Sent: Monday, January 12, 2015 3:36:43 PM
>>> Subject: Re: Failed to create volume in OVirt with gluster
>>>
>>> Hi Kanagaraj,
>>>
>>> Please find the logs from here :- http://ur1.ca/jeszc
>>>
>>> [image: Inline image 1]
>>>
>>> [image: Inline image 2]
>>>
>>> On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com>
wrote:
>>>
>>>> Looks like there are some failures in gluster.
>>>> Can you send the log output from glusterd log file from the relevant
>> hosts?
>>>>
>>>> Thanks,
>>>> Kanagaraj
>>>>
>>>>
>>>> On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
>>>>
>>>> Hi,
>>>>
>>>> Is there any one from gluster can help me here :-
>>>>
>>>> Engine logs :-
>>>>
>>>> 2015-01-12 12:50:33,841 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:34,725 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:36,824 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:36,853 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:36,866 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:37,751 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:39,849 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:39,878 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:39,890 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:40,776 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:42,878 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:42,903 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:42,916 INFO
>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
lock
>>>> EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>>>> value: GLUSTER
>>>> , sharedLocks= ]
>>>> 2015-01-12 12:50:43,771 INFO
>>>>
>> [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
>>>> (ajp--127.0.0.1-8702-1) [330ace48] FINISH,
>> CreateGlusterVolumeVDSCommand,
>>>> log id: 303e70a4
>>>> 2015-01-12 12:50:43,780 ERROR
>>>> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
>>>> (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
>>>> 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event
>> ID:
>>>> -1, Message: Creation of Gluster Volume vol01 failed.
>>>> 2015-01-12 12:50:43,785 INFO
>>>> [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
>>>> (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
>>>> [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value:
>> GLUSTER
>>>> , sharedLocks= ]
>>>>
>>>> [image: Inline image 2]
>>>>
>>>>
>>>> On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>> wrote:
>>>>
>>>>> Hi Punit,
>>>>>
>>>>> unfortunately I’am not that good with the gluster, I was just
>> following
>>>>> the obvious clue from the log. Could you try on the nodes if the
>> packages
>>>>> are even available for installation
>>>>>
>>>>> yum install gluster-swift gluster-swift-object
gluster-swift-plugin
>>>>> gluster-swift-account
>>>>> gluster-swift-proxy gluster-swift-doc gluster-swift-container
>>>>> glusterfs-geo-replication
>>>>>
>>>>> if not you could try to get them in official gluster repo.
>>>>>
>>
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
>>>>>
>>>>> HTH
>>>>>
>>>>> M.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On 10 Jan 2015, at 04:35, Punit Dambiwal
<hypunit(a)gmail.com>
wrote:
>>>>>
>>>>> Hi Martin,
>>>>>
>>>>> I installed gluster from ovirt repo....is it require to install
those
>>>>> packages manually ??
>>>>>
>>>>> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>> wrote:
>>>>>
>>>>>> Hi Punit,
>>>>>>
>>>>>> can you verify that nodes contain cluster packages from the
following
>>>>>> log?
>>>>>>
>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
>>>>>> ('gluster-swift',) not found
>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
>>>>>> ('gluster-swift-object',) not found
>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
>>>>>> ('gluster-swift-plugin',) not found
>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>>>>> ('gluster-swift-account',) not found
>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>>>>> ('gluster-swift-proxy',) not found
>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>>>>> ('gluster-swift-doc',) not found
>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>>>>> ('gluster-swift-container',) not found
>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>>>>> ('glusterfs-geo-replication',) not found
>>>>>>
>>>>>>
>>>>>> M.
>>>>>>
>>>>>> On 09 Jan 2015, at 11:13, Punit Dambiwal
<hypunit(a)gmail.com>
>> wrote:
>>>>>>
>>>>>> Hi Kanagaraj,
>>>>>>
>>>>>> Please find the attached logs :-
>>>>>>
>>>>>> Engine Logs :- http://ur1.ca/jdopt
>>>>>> VDSM Logs :- http://ur1.ca/jdoq9
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj
<kmayilsa(a)redhat.com>
>> wrote:
>>>>>>
>>>>>>> Do you see any errors in the UI?
>>>>>>>
>>>>>>> Also please provide the engine.log and vdsm.log when the
failure
>>>>>>> occured.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Kanagaraj
>>>>>>>
>>>>>>>
>>>>>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>>>>>>>
>>>>>>> Hi Martin,
>>>>>>>
>>>>>>> The steps are below :-
>>>>>>>
>>>>>>> 1. Step the ovirt engine on the one server...
>>>>>>> 2. Installed centos 7 on 4 host node servers..
>>>>>>> 3. I am using host node (compute+storage)....now i have
added all 4
>>>>>>> nodes to engine...
>>>>>>> 4. Create the gluster volume from GUI...
>>>>>>>
>>>>>>> Network :-
>>>>>>> eth0 :- public network (1G)
>>>>>>> eth1+eth2=bond0= VM public network (1G)
>>>>>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
>>>>>>>
>>>>>>> every hostnode has 24 bricks=24*4(distributed replicated)
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Punit
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Punit,
>>>>>>>>
>>>>>>>> can you please provide also errors from
/var/log/vdsm/vdsm.log and
>>>>>>>> /var/log/vdsm/vdsmd.log
>>>>>>>>
>>>>>>>> it would be really helpful if you provided exact steps
how to
>>>>>>>> reproduce the problem.
>>>>>>>>
>>>>>>>> regards
>>>>>>>>
>>>>>>>> Martin Pavlik - rhev QE
>>>>>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com>
>> wrote:
>>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> I try to add gluster volume but it failed...
>>>>>>>>>
>>>>>>>>> Ovirt :- 3.5
>>>>>>>>> VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>>>>>>>>> KVM :- 1.5.3 - 60.el7_0.2
>>>>>>>>> libvirt-1.1.1-29.el7_0.4
>>>>>>>>> Glusterfs :- glusterfs-3.5.3-1.el7
>>>>>>>>>
>>>>>>>>> Engine Logs :-
>>>>>>>>>
>>>>>>>>> 2015-01-08 09:57:52,569 INFO
>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>> lock
>>>>>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>>>>>>>> value: GLUSTER
>>>>>>>>> , sharedLocks= ]
>>>>>>>>> 2015-01-08 09:57:52,609 INFO
>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>> lock
>>>>>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>>>>>>>> value: GLUSTER
>>>>>>>>> , sharedLocks= ]
>>>>>>>>> 2015-01-08 09:57:55,582 INFO
>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>> lock
>>>>>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>>>>>>>> value: GLUSTER
>>>>>>>>> , sharedLocks= ]
>>>>>>>>> 2015-01-08 09:57:55,591 INFO
>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>> lock
>>>>>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>>>>>>>> value: GLUSTER
>>>>>>>>> , sharedLocks= ]
>>>>>>>>> 2015-01-08 09:57:55,596 INFO
>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>> lock
>>>>>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>>>>>>>> value: GLUSTER
>>>>>>>>> , sharedLocks= ]
>>>>>>>>> 2015-01-08 09:57:55,633 INFO
>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>> lock
>>>>>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>>>>>>>> value: GLUSTER
>>>>>>>>> , sharedLocks= ]
>>>>>>>>> ^C
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users(a)gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>
10 a.m.
New subject: [Gluster-users] Failed to create volume in OVirt with gluster
On 01/13/2015 12:12 PM, Punit Dambiwal wrote:
Hi Atin,
Please find the output from here :- http://ur1.ca/jf4bs
Looks like http://review.gluster.org/#/c/9269/ should solve this issue.
Please note this patch has not been taken in 3.6 release. Would you be
able to apply this patch on the source and re-test?
~Atin
On Tue, Jan 13, 2015 at 12:37 PM, Atin Mukherjee
<amukherj(a)redhat.com>
wrote:
> Punit,
>
> cli log wouldn't help much here. To debug this issue further can you
> please let us know the following:
>
> 1. gluster peer status output
> 2. gluster volume status output
> 3. gluster --version output.
> 4. Which command got failed
> 5. glusterd log file of all the nodes
>
> ~Atin
>
>
> On 01/13/2015 07:48 AM, Punit Dambiwal wrote:
>> Hi,
>>
>> Please find the more details on this ....can anybody from gluster will
> help
>> me here :-
>>
>>
>> Gluster CLI Logs :- /var/log/glusterfs/cli.log
>>
>> [2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs:
> got
>> RPC_CLNT_CONNECT
>> [2015-01-13 02:06:23.072012] T [cli-quotad-client.c:94:cli_quotad_notify]
>> 0-glusterfs: got RPC_CLNT_CONNECT
>> [2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler]
>> 0-transport: disconnecting now
>> [2015-01-13 02:06:23.072055] T
> [cli-quotad-client.c:100:cli_quotad_notify]
>> 0-glusterfs: got RPC_CLNT_DISCONNECT
>> [2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record]
>> 0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
>> [2015-01-13 02:06:23.072176] T
>> [rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request
> fraglen
>> 128, payload: 64, rpc hdr: 64
>> [2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (-->
>> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420]
> (-->
>>
> /usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a4293]
>> (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] (-->
>> /usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (-->
>> /usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs:
> connect
>> () called on transport already connected
>> [2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit]
>> 0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers:
> 2,
>> Proc: 27) to rpc-transport (glusterfs)
>> [2015-01-13 02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping]
>> 0-glusterfs: ping timeout is 0, returning
>> [2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init]
>> 0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI,
>> ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
>> [2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk]
>> 0-cli: Received response to status cmd
>> [2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli:
>> Returning 0
>> [2015-01-13 02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume]
>> 0-cli: Returning: 0
>> [2015-01-13 02:06:23.076192] D [cli-xml-output.c:84:cli_begin_xml_output]
>> 0-cli: Returning 0
>> [2015-01-13 02:06:23.076244] D
> [cli-xml-output.c:131:cli_xml_output_common]
>> 0-cli: Returning 0
>> [2015-01-13 02:06:23.076256] D
>> [cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning
> 0
>> [2015-01-13 02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output]
>> 0-cli: Returning 0
>> [2015-01-13 02:06:23.076459] D
>> [cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning 0
>> [2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: 0
>>
>> Command log :- /var/log/glusterfs/.cmd_log_history
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> [2015-01-13 01:10:35.836676] : volume status all tasks : FAILED :
> Staging
>> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
>> details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> [2015-01-13 01:16:25.956514] : volume status all tasks : FAILED :
> Staging
>> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
>> details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> [2015-01-13 01:17:36.977833] : volume status all tasks : FAILED :
> Staging
>> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
>> details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> [2015-01-13 01:21:07.048053] : volume status all tasks : FAILED :
> Staging
>> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
>> details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> [2015-01-13 01:26:57.168661] : volume status all tasks : FAILED :
> Staging
>> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
>> details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> [2015-01-13 01:28:07.194428] : volume status all tasks : FAILED :
> Staging
>> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
>> details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> [2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking
>> failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
>> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
>> details.
>> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
>> details.
>> [2015-01-13 01:34:58.350748] : volume status all tasks : FAILED :
> Staging
>> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
>> details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> [2015-01-13 01:36:08.375326] : volume status all tasks : FAILED :
> Staging
>> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
>> details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> [2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking
>> failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
>> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
>> details.
>> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
>> details.
>> [2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking
> failed
>> on cpu02.zne01.hkg1.stack.com. Please check log file for details.
>> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
>> details.
>> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
>> details.
>> [2015-01-13 01:45:10.550659] : volume status all tasks : FAILED :
> Staging
>> failed on 00000000-0000-0000-0000-000000000000. Please check log file for
>> details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>> [2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
>> [2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
>> [2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
>> [2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
>> [2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
>> [2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
>> [2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
>> [2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
>> [2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
>> [2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
>> [2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
>> [2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
>> [2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
>>
>>
>> On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <
> kmayilsa(a)redhat.com>
>> wrote:
>>
>>> I can see the failures in glusterd log.
>>>
>>> Can someone from glusterfs dev pls help on this?
>>>
>>> Thanks,
>>> Kanagaraj
>>>
>>> ----- Original Message -----
>>>> From: "Punit Dambiwal" <hypunit(a)gmail.com>
>>>> To: "Kanagaraj" <kmayilsa(a)redhat.com>
>>>> Cc: "Martin Pavlík" <mpavlik(a)redhat.com>, "Vijay
Bellur" <
>>> vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
>>>> users(a)ovirt.org, gluster-users(a)gluster.org
>>>> Sent: Monday, January 12, 2015 3:36:43 PM
>>>> Subject: Re: Failed to create volume in OVirt with gluster
>>>>
>>>> Hi Kanagaraj,
>>>>
>>>> Please find the logs from here :- http://ur1.ca/jeszc
>>>>
>>>> [image: Inline image 1]
>>>>
>>>> [image: Inline image 2]
>>>>
>>>> On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com>
> wrote:
>>>>
>>>>> Looks like there are some failures in gluster.
>>>>> Can you send the log output from glusterd log file from the relevant
>>> hosts?
>>>>>
>>>>> Thanks,
>>>>> Kanagaraj
>>>>>
>>>>>
>>>>> On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
>>>>>
>>>>> Hi,
>>>>>
>>>>> Is there any one from gluster can help me here :-
>>>>>
>>>>> Engine logs :-
>>>>>
>>>>> 2015-01-12 12:50:33,841 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:34,725 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:36,824 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:36,853 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:36,866 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:37,751 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:39,849 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:39,878 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:39,890 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:40,776 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:42,878 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:42,903 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:42,916 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> , sharedLocks= ]
>>>>> 2015-01-12 12:50:43,771 INFO
>>>>>
>>> [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
>>>>> (ajp--127.0.0.1-8702-1) [330ace48] FINISH,
>>> CreateGlusterVolumeVDSCommand,
>>>>> log id: 303e70a4
>>>>> 2015-01-12 12:50:43,780 ERROR
>>>>>
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
>>>>> (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
>>>>> 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event
>>> ID:
>>>>> -1, Message: Creation of Gluster Volume vol01 failed.
>>>>> 2015-01-12 12:50:43,785 INFO
>>>>> [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
>>>>> (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
>>>>> [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value:
>>> GLUSTER
>>>>> , sharedLocks= ]
>>>>>
>>>>> [image: Inline image 2]
>>>>>
>>>>>
>>>>> On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>>> wrote:
>>>>>
>>>>>> Hi Punit,
>>>>>>
>>>>>> unfortunately I’am not that good with the gluster, I was just
>>> following
>>>>>> the obvious clue from the log. Could you try on the nodes if the
>>> packages
>>>>>> are even available for installation
>>>>>>
>>>>>> yum install gluster-swift gluster-swift-object
gluster-swift-plugin
>>>>>> gluster-swift-account
>>>>>> gluster-swift-proxy gluster-swift-doc gluster-swift-container
>>>>>> glusterfs-geo-replication
>>>>>>
>>>>>> if not you could try to get them in official gluster repo.
>>>>>>
>>>
> http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
>>>>>>
>>>>>> HTH
>>>>>>
>>>>>> M.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 10 Jan 2015, at 04:35, Punit Dambiwal
<hypunit(a)gmail.com>
> wrote:
>>>>>>
>>>>>> Hi Martin,
>>>>>>
>>>>>> I installed gluster from ovirt repo....is it require to install
> those
>>>>>> packages manually ??
>>>>>>
>>>>>> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>>> wrote:
>>>>>>
>>>>>>> Hi Punit,
>>>>>>>
>>>>>>> can you verify that nodes contain cluster packages from the
> following
>>>>>>> log?
>>>>>>>
>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
>>>>>>> ('gluster-swift',) not found
>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
>>>>>>> ('gluster-swift-object',) not found
>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
>>>>>>> ('gluster-swift-plugin',) not found
>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>>>>>> ('gluster-swift-account',) not found
>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>>>>>> ('gluster-swift-proxy',) not found
>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>>>>>> ('gluster-swift-doc',) not found
>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>>>>>> ('gluster-swift-container',) not found
>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>>>>>> ('glusterfs-geo-replication',) not found
>>>>>>>
>>>>>>>
>>>>>>> M.
>>>>>>>
>>>>>>> On 09 Jan 2015, at 11:13, Punit Dambiwal
<hypunit(a)gmail.com>
>>> wrote:
>>>>>>>
>>>>>>> Hi Kanagaraj,
>>>>>>>
>>>>>>> Please find the attached logs :-
>>>>>>>
>>>>>>> Engine Logs :- http://ur1.ca/jdopt
>>>>>>> VDSM Logs :- http://ur1.ca/jdoq9
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj
<kmayilsa(a)redhat.com>
>>> wrote:
>>>>>>>
>>>>>>>> Do you see any errors in the UI?
>>>>>>>>
>>>>>>>> Also please provide the engine.log and vdsm.log when the
failure
>>>>>>>> occured.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Kanagaraj
>>>>>>>>
>>>>>>>>
>>>>>>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>>>>>>>>
>>>>>>>> Hi Martin,
>>>>>>>>
>>>>>>>> The steps are below :-
>>>>>>>>
>>>>>>>> 1. Step the ovirt engine on the one server...
>>>>>>>> 2. Installed centos 7 on 4 host node servers..
>>>>>>>> 3. I am using host node (compute+storage)....now i have
added all 4
>>>>>>>> nodes to engine...
>>>>>>>> 4. Create the gluster volume from GUI...
>>>>>>>>
>>>>>>>> Network :-
>>>>>>>> eth0 :- public network (1G)
>>>>>>>> eth1+eth2=bond0= VM public network (1G)
>>>>>>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
>>>>>>>>
>>>>>>>> every hostnode has 24 bricks=24*4(distributed
replicated)
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Punit
>>>>>>>>
>>>>>>>>
>>>>>>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Punit,
>>>>>>>>>
>>>>>>>>> can you please provide also errors from
/var/log/vdsm/vdsm.log and
>>>>>>>>> /var/log/vdsm/vdsmd.log
>>>>>>>>>
>>>>>>>>> it would be really helpful if you provided exact
steps how to
>>>>>>>>> reproduce the problem.
>>>>>>>>>
>>>>>>>>> regards
>>>>>>>>>
>>>>>>>>> Martin Pavlik - rhev QE
>>>>>>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com>
>>> wrote:
>>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> I try to add gluster volume but it failed...
>>>>>>>>>>
>>>>>>>>>> Ovirt :- 3.5
>>>>>>>>>> VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>>>>>>>>>> KVM :- 1.5.3 - 60.el7_0.2
>>>>>>>>>> libvirt-1.1.1-29.el7_0.4
>>>>>>>>>> Glusterfs :- glusterfs-3.5.3-1.el7
>>>>>>>>>>
>>>>>>>>>> Engine Logs :-
>>>>>>>>>>
>>>>>>>>>> 2015-01-08 09:57:52,569 INFO
>>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>>> lock
>>>>>>>>> EngineLock [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>> value: GLUSTER
>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>> 2015-01-08 09:57:52,609 INFO
>>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>>> lock
>>>>>>>>> EngineLock [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>> value: GLUSTER
>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>> 2015-01-08 09:57:55,582 INFO
>>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>>> lock
>>>>>>>>> EngineLock [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>> value: GLUSTER
>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>> 2015-01-08 09:57:55,591 INFO
>>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>>> lock
>>>>>>>>> EngineLock [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>> value: GLUSTER
>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>> 2015-01-08 09:57:55,596 INFO
>>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>>> lock
>>>>>>>>> EngineLock [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>> value: GLUSTER
>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>> 2015-01-08 09:57:55,633 INFO
>>>>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and wait
>>> lock
>>>>>>>>> EngineLock [exclusiveLocks= key:
>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>> value: GLUSTER
>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>> ^C
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>>
>>
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users(a)gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-users
>>
>
1:15 p.m.
New subject: [Gluster-users] Failed to create volume in OVirt with gluster
Hi Atin,
What about if i will use glusterfs 3.5 ?? is this bug will affect 3.5 also
??
On Tue, Jan 13, 2015 at 3:00 PM, Atin Mukherjee <amukherj(a)redhat.com> wrote:
On 01/13/2015 12:12 PM, Punit Dambiwal wrote:
> Hi Atin,
>
> Please find the output from here :- http://ur1.ca/jf4bs
>
Looks like http://review.gluster.org/#/c/9269/ should solve this issue.
Please note this patch has not been taken in 3.6 release. Would you be
able to apply this patch on the source and re-test?
~Atin
> On Tue, Jan 13, 2015 at 12:37 PM, Atin Mukherjee <amukherj(a)redhat.com>
> wrote:
>
>> Punit,
>>
>> cli log wouldn't help much here. To debug this issue further can you
>> please let us know the following:
>>
>> 1. gluster peer status output
>> 2. gluster volume status output
>> 3. gluster --version output.
>> 4. Which command got failed
>> 5. glusterd log file of all the nodes
>>
>> ~Atin
>>
>>
>> On 01/13/2015 07:48 AM, Punit Dambiwal wrote:
>>> Hi,
>>>
>>> Please find the more details on this ....can anybody from gluster will
>> help
>>> me here :-
>>>
>>>
>>> Gluster CLI Logs :- /var/log/glusterfs/cli.log
>>>
>>> [2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs:
>> got
>>> RPC_CLNT_CONNECT
>>> [2015-01-13 02:06:23.072012] T
[cli-quotad-client.c:94:cli_quotad_notify]
>>> 0-glusterfs: got RPC_CLNT_CONNECT
>>> [2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler]
>>> 0-transport: disconnecting now
>>> [2015-01-13 02:06:23.072055] T
>> [cli-quotad-client.c:100:cli_quotad_notify]
>>> 0-glusterfs: got RPC_CLNT_DISCONNECT
>>> [2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record]
>>> 0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
>>> [2015-01-13 02:06:23.072176] T
>>> [rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request
>> fraglen
>>> 128, payload: 64, rpc hdr: 64
>>> [2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (-->
>>> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420]
>> (-->
>>>
>>
/usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a4293]
>>> (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98]
(-->
>>> /usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (-->
>>> /usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs:
>> connect
>>> () called on transport already connected
>>> [2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit]
>>> 0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers:
>> 2,
>>> Proc: 27) to rpc-transport (glusterfs)
>>> [2015-01-13 02:06:23.072633] D
[rpc-clnt-ping.c:231:rpc_clnt_start_ping]
>>> 0-glusterfs: ping timeout is 0, returning
>>> [2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init]
>>> 0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI,
>>> ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
>>> [2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk]
>>> 0-cli: Received response to status cmd
>>> [2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli:
>>> Returning 0
>>> [2015-01-13 02:06:23.076049] D
[cli-rpc-ops.c:6811:gf_cli_status_volume]
>>> 0-cli: Returning: 0
>>> [2015-01-13 02:06:23.076192] D
[cli-xml-output.c:84:cli_begin_xml_output]
>>> 0-cli: Returning 0
>>> [2015-01-13 02:06:23.076244] D
>> [cli-xml-output.c:131:cli_xml_output_common]
>>> 0-cli: Returning 0
>>> [2015-01-13 02:06:23.076256] D
>>> [cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli:
Returning
>> 0
>>> [2015-01-13 02:06:23.076437] D
[cli-xml-output.c:108:cli_end_xml_output]
>>> 0-cli: Returning 0
>>> [2015-01-13 02:06:23.076459] D
>>> [cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning
0
>>> [2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting
with: 0
>>>
>>> Command log :- /var/log/glusterfs/.cmd_log_history
>>>
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> [2015-01-13 01:10:35.836676] : volume status all tasks : FAILED :
>> Staging
>>> failed on 00000000-0000-0000-0000-000000000000. Please check log file
for
>>> details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> [2015-01-13 01:16:25.956514] : volume status all tasks : FAILED :
>> Staging
>>> failed on 00000000-0000-0000-0000-000000000000. Please check log file
for
>>> details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> [2015-01-13 01:17:36.977833] : volume status all tasks : FAILED :
>> Staging
>>> failed on 00000000-0000-0000-0000-000000000000. Please check log file
for
>>> details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> [2015-01-13 01:21:07.048053] : volume status all tasks : FAILED :
>> Staging
>>> failed on 00000000-0000-0000-0000-000000000000. Please check log file
for
>>> details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> [2015-01-13 01:26:57.168661] : volume status all tasks : FAILED :
>> Staging
>>> failed on 00000000-0000-0000-0000-000000000000. Please check log file
for
>>> details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> [2015-01-13 01:28:07.194428] : volume status all tasks : FAILED :
>> Staging
>>> failed on 00000000-0000-0000-0000-000000000000. Please check log file
for
>>> details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> [2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking
>>> failed on cpu02.zne01.hkg1.stack.com. Please check log file for
details.
>>> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file
for
>>> details.
>>> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file
for
>>> details.
>>> [2015-01-13 01:34:58.350748] : volume status all tasks : FAILED :
>> Staging
>>> failed on 00000000-0000-0000-0000-000000000000. Please check log file
for
>>> details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> [2015-01-13 01:36:08.375326] : volume status all tasks : FAILED :
>> Staging
>>> failed on 00000000-0000-0000-0000-000000000000. Please check log file
for
>>> details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> [2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking
>>> failed on cpu02.zne01.hkg1.stack.com. Please check log file for
details.
>>> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file
for
>>> details.
>>> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file
for
>>> details.
>>> [2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking
>> failed
>>> on cpu02.zne01.hkg1.stack.com. Please check log file for details.
>>> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file
for
>>> details.
>>> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file
for
>>> details.
>>> [2015-01-13 01:45:10.550659] : volume status all tasks : FAILED :
>> Staging
>>> failed on 00000000-0000-0000-0000-000000000000. Please check log file
for
>>> details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check
log
>>> file for details.
>>> [2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
>>> [2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
>>> [2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
>>> [2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
>>> [2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
>>> [2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
>>> [2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
>>> [2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
>>> [2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
>>> [2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
>>> [2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
>>> [2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
>>> [2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
>>>
>>>
>>> On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <
>> kmayilsa(a)redhat.com>
>>> wrote:
>>>
>>>> I can see the failures in glusterd log.
>>>>
>>>> Can someone from glusterfs dev pls help on this?
>>>>
>>>> Thanks,
>>>> Kanagaraj
>>>>
>>>> ----- Original Message -----
>>>>> From: "Punit Dambiwal" <hypunit(a)gmail.com>
>>>>> To: "Kanagaraj" <kmayilsa(a)redhat.com>
>>>>> Cc: "Martin Pavlík" <mpavlik(a)redhat.com>,
"Vijay Bellur" <
>>>> vbellur(a)redhat.com>, "Kaushal M"
<kshlmster(a)gmail.com>,
>>>>> users(a)ovirt.org, gluster-users(a)gluster.org
>>>>> Sent: Monday, January 12, 2015 3:36:43 PM
>>>>> Subject: Re: Failed to create volume in OVirt with gluster
>>>>>
>>>>> Hi Kanagaraj,
>>>>>
>>>>> Please find the logs from here :- http://ur1.ca/jeszc
>>>>>
>>>>> [image: Inline image 1]
>>>>>
>>>>> [image: Inline image 2]
>>>>>
>>>>> On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj
<kmayilsa(a)redhat.com>
>> wrote:
>>>>>
>>>>>> Looks like there are some failures in gluster.
>>>>>> Can you send the log output from glusterd log file from the
relevant
>>>> hosts?
>>>>>>
>>>>>> Thanks,
>>>>>> Kanagaraj
>>>>>>
>>>>>>
>>>>>> On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> Is there any one from gluster can help me here :-
>>>>>>
>>>>>> Engine logs :-
>>>>>>
>>>>>> 2015-01-12 12:50:33,841 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:34,725 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:36,824 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:36,853 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:36,866 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:37,751 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:39,849 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:39,878 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:39,890 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:40,776 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:42,878 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:42,903 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:42,916 INFO
>>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and
wait
>> lock
>>>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
>>>>>> value: GLUSTER
>>>>>> , sharedLocks= ]
>>>>>> 2015-01-12 12:50:43,771 INFO
>>>>>>
>>>>
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
>>>>>> (ajp--127.0.0.1-8702-1) [330ace48] FINISH,
>>>> CreateGlusterVolumeVDSCommand,
>>>>>> log id: 303e70a4
>>>>>> 2015-01-12 12:50:43,780 ERROR
>>>>>>
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
>>>>>> (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job
ID:
>>>>>> 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom
Event
>>>> ID:
>>>>>> -1, Message: Creation of Gluster Volume vol01 failed.
>>>>>> 2015-01-12 12:50:43,785 INFO
>>>>>> [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
>>>>>> (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object
EngineLock
>>>>>> [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
value:
>>>> GLUSTER
>>>>>> , sharedLocks= ]
>>>>>>
>>>>>> [image: Inline image 2]
>>>>>>
>>>>>>
>>>>>> On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>>>> wrote:
>>>>>>
>>>>>>> Hi Punit,
>>>>>>>
>>>>>>> unfortunately I’am not that good with the gluster, I was
just
>>>> following
>>>>>>> the obvious clue from the log. Could you try on the nodes if
the
>>>> packages
>>>>>>> are even available for installation
>>>>>>>
>>>>>>> yum install gluster-swift gluster-swift-object
gluster-swift-plugin
>>>>>>> gluster-swift-account
>>>>>>> gluster-swift-proxy gluster-swift-doc
gluster-swift-container
>>>>>>> glusterfs-geo-replication
>>>>>>>
>>>>>>> if not you could try to get them in official gluster repo.
>>>>>>>
>>>>
>>
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
>>>>>>>
>>>>>>> HTH
>>>>>>>
>>>>>>> M.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On 10 Jan 2015, at 04:35, Punit Dambiwal
<hypunit(a)gmail.com>
>> wrote:
>>>>>>>
>>>>>>> Hi Martin,
>>>>>>>
>>>>>>> I installed gluster from ovirt repo....is it require to
install
>> those
>>>>>>> packages manually ??
>>>>>>>
>>>>>>> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>>>> wrote:
>>>>>>>
>>>>>>>> Hi Punit,
>>>>>>>>
>>>>>>>> can you verify that nodes contain cluster packages from
the
>> following
>>>>>>>> log?
>>>>>>>>
>>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm
package
>>>>>>>> ('gluster-swift',) not found
>>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm
package
>>>>>>>> ('gluster-swift-object',) not found
>>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm
package
>>>>>>>> ('gluster-swift-plugin',) not found
>>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm
package
>>>>>>>> ('gluster-swift-account',) not found
>>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm
package
>>>>>>>> ('gluster-swift-proxy',) not found
>>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm
package
>>>>>>>> ('gluster-swift-doc',) not found
>>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm
package
>>>>>>>> ('gluster-swift-container',) not found
>>>>>>>> Thread-14::DEBUG::2015-01-09
>>>>>>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm
package
>>>>>>>> ('glusterfs-geo-replication',) not found
>>>>>>>>
>>>>>>>>
>>>>>>>> M.
>>>>>>>>
>>>>>>>> On 09 Jan 2015, at 11:13, Punit Dambiwal
<hypunit(a)gmail.com>
>>>> wrote:
>>>>>>>>
>>>>>>>> Hi Kanagaraj,
>>>>>>>>
>>>>>>>> Please find the attached logs :-
>>>>>>>>
>>>>>>>> Engine Logs :- http://ur1.ca/jdopt
>>>>>>>> VDSM Logs :- http://ur1.ca/jdoq9
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj
<kmayilsa(a)redhat.com>
>>>> wrote:
>>>>>>>>
>>>>>>>>> Do you see any errors in the UI?
>>>>>>>>>
>>>>>>>>> Also please provide the engine.log and vdsm.log when
the failure
>>>>>>>>> occured.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Kanagaraj
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>>>>>>>>>
>>>>>>>>> Hi Martin,
>>>>>>>>>
>>>>>>>>> The steps are below :-
>>>>>>>>>
>>>>>>>>> 1. Step the ovirt engine on the one server...
>>>>>>>>> 2. Installed centos 7 on 4 host node servers..
>>>>>>>>> 3. I am using host node (compute+storage)....now i
have added
all 4
>>>>>>>>> nodes to engine...
>>>>>>>>> 4. Create the gluster volume from GUI...
>>>>>>>>>
>>>>>>>>> Network :-
>>>>>>>>> eth0 :- public network (1G)
>>>>>>>>> eth1+eth2=bond0= VM public network (1G)
>>>>>>>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private
network)
>>>>>>>>>
>>>>>>>>> every hostnode has 24 bricks=24*4(distributed
replicated)
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Punit
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík <
mpavlik(a)redhat.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Punit,
>>>>>>>>>>
>>>>>>>>>> can you please provide also errors from
/var/log/vdsm/vdsm.log
and
>>>>>>>>>> /var/log/vdsm/vdsmd.log
>>>>>>>>>>
>>>>>>>>>> it would be really helpful if you provided exact
steps how to
>>>>>>>>>> reproduce the problem.
>>>>>>>>>>
>>>>>>>>>> regards
>>>>>>>>>>
>>>>>>>>>> Martin Pavlik - rhev QE
>>>>>>>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com>
>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>> I try to add gluster volume but it
failed...
>>>>>>>>>>>
>>>>>>>>>>> Ovirt :- 3.5
>>>>>>>>>>> VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>>>>>>>>>>> KVM :- 1.5.3 - 60.el7_0.2
>>>>>>>>>>> libvirt-1.1.1-29.el7_0.4
>>>>>>>>>>> Glusterfs :- glusterfs-3.5.3-1.el7
>>>>>>>>>>>
>>>>>>>>>>> Engine Logs :-
>>>>>>>>>>>
>>>>>>>>>>> 2015-01-08 09:57:52,569 INFO
>>>>>>>>>>
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to
acquire lock and
wait
>>>> lock
>>>>>>>>>> EngineLock [exclusiveLocks= key:
>>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>>> value: GLUSTER
>>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>>> 2015-01-08 09:57:52,609 INFO
>>>>>>>>>>
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to
acquire lock and
wait
>>>> lock
>>>>>>>>>> EngineLock [exclusiveLocks= key:
>>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>>> value: GLUSTER
>>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>>> 2015-01-08 09:57:55,582 INFO
>>>>>>>>>>
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to
acquire lock and
wait
>>>> lock
>>>>>>>>>> EngineLock [exclusiveLocks= key:
>>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>>> value: GLUSTER
>>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>>> 2015-01-08 09:57:55,591 INFO
>>>>>>>>>>
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to
acquire lock and
wait
>>>> lock
>>>>>>>>>> EngineLock [exclusiveLocks= key:
>>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>>> value: GLUSTER
>>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>>> 2015-01-08 09:57:55,596 INFO
>>>>>>>>>>
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to
acquire lock and
wait
>>>> lock
>>>>>>>>>> EngineLock [exclusiveLocks= key:
>>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>>> value: GLUSTER
>>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>>> 2015-01-08 09:57:55,633 INFO
>>>>>>>>>>
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>>>>>>> (DefaultQuartzScheduler_Worker-16) Failed to
acquire lock and
wait
>>>> lock
>>>>>>>>>> EngineLock [exclusiveLocks= key:
>>>> 00000001-0001-0001-0001-000000000300
>>>>>>>>>> value: GLUSTER
>>>>>>>>>>> , sharedLocks= ]
>>>>>>>>>>> ^C
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Gluster-users mailing list
>>> Gluster-users(a)gluster.org
>>> http://www.gluster.org/mailman/listinfo/gluster-users
>>>
>>
>
8:50 p.m.
This is a multipart message in MIME format.
------=_NextPart_000_00B5_01D02F1E.B7FDC3D0
Content-Type: text/plain;
charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Are you using ctdb??? and did you specify Lock=3DFalse in =
/etc/nfsmount.conf
=20
Can you give a full run down of topology, and has this ever been working =
or is it a new deployment?
=20
Donny D
=20
From: users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] On Behalf =
Of Punit Dambiwal
Sent: Monday, January 12, 2015 7:18 PM
To: Kanagaraj Mayilsamy
Cc: gluster-users(a)gluster.org; Kaushal M; users(a)ovirt.org
Subject: Re: [ovirt-users] Failed to create volume in OVirt with gluster
=20
Hi,
=20
Please find the more details on this ....can anybody from gluster will =
help me here :-=20
=20
=20
Gluster CLI Logs :- /var/log/glusterfs/cli.log
=20
[2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs: =
got RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072012] T =
[cli-quotad-client.c:94:cli_quotad_notify] 0-glusterfs: got =
RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler] =
0-transport: disconnecting now
[2015-01-13 02:06:23.072055] T =
[cli-quotad-client.c:100:cli_quotad_notify] 0-glusterfs: got =
RPC_CLNT_DISCONNECT
[2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record] =
0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2015-01-13 02:06:23.072176] T =
[rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request =
fraglen 128, payload: 64, rpc hdr: 64
[2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (--> =
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420] =
(--> =
/usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a429=
3] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] =
(--> /usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (--> =
/usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs: =
connect () called on transport already connected
[2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit] =
0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers: =
2, Proc: 27) to rpc-transport (glusterfs)
[2015-01-13 02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping] =
0-glusterfs: ping timeout is 0, returning
[2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init] =
0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI, =
ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
[2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk] =
0-cli: Received response to status cmd
[2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli: =
Returning 0
[2015-01-13 02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume] =
0-cli: Returning: 0
[2015-01-13 02:06:23.076192] D =
[cli-xml-output.c:84:cli_begin_xml_output] 0-cli: Returning 0
[2015-01-13 02:06:23.076244] D =
[cli-xml-output.c:131:cli_xml_output_common] 0-cli: Returning 0
[2015-01-13 02:06:23.076256] D =
[cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning =
0
[2015-01-13 02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output] =
0-cli: Returning 0
[2015-01-13 02:06:23.076459] D =
[cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning 0
[2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: =
0
=20
Command log :- /var/log/glusterfs/.cmd_log_history
=20
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:10:35.836676] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:16:25.956514] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:17:36.977833] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:21:07.048053] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:26:57.168661] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:28:07.194428] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking =
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for =
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for =
details.
[2015-01-13 01:34:58.350748] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:36:08.375326] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking =
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for =
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for =
details.
[2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking =
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for =
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for =
details.
[2015-01-13 01:45:10.550659] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
[2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
[2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
[2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
[2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
[2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
[2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
[2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
[2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
[2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
[2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
[2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
[2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
=20
=20
On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy =
<kmayilsa(a)redhat.com> wrote:
I can see the failures in glusterd log.
Can someone from glusterfs dev pls help on this?
Thanks,
Kanagaraj
----- Original Message -----
From: "Punit Dambiwal" <hypunit(a)gmail.com>
To: "Kanagaraj" <kmayilsa(a)redhat.com>
Cc: "Martin Pavl=C3=ADk" <mpavlik(a)redhat.com>, "Vijay Bellur" =
<vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
users(a)ovirt.org, gluster-users(a)gluster.org
Sent: Monday, January 12, 2015 3:36:43 PM
Subject: Re: Failed to create volume in OVirt with gluster
Hi Kanagaraj,
Please find the logs from here :- http://ur1.ca/jeszc
[image: Inline image 1]
[image: Inline image 2]
On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com> =
wrote:
> Looks like there are some failures in gluster.
> Can you send the log output from glusterd log file from the relevant =
hosts?
>
> Thanks,
> Kanagaraj
>
>
> On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
>
> Hi,
>
> Is there any one from gluster can help me here :-
>
> Engine logs :-
>
> 2015-01-12 12:50:33,841 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:34,725 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:36,824 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:36,853 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:36,866 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:37,751 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:39,849 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:39,878 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:39,890 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:40,776 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:42,878 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:42,903 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:42,916 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:43,771 INFO
> =
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
> (ajp--127.0.0.1-8702-1) [330ace48] FINISH, =
CreateGlusterVolumeVDSCommand,
> log id: 303e70a4
> 2015-01-12 12:50:43,780 ERROR
> =
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
> (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job
ID:
> 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event =
ID:
> -1, Message: Creation of Gluster Volume vol01 failed.
> 2015-01-12 12:50:43,785 INFO
> [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
> (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
> [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 value: =
GLUSTER
> , sharedLocks=3D ]
>
> [image: Inline image 2]
>
>
> On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavl=C3=ADk =
<mpavlik(a)redhat.com> wrote:
>
>> Hi Punit,
>>
>> unfortunately I=E2=80=99am not that good with the gluster, I was =
just
following
>> the obvious clue from the log. Could you try on the nodes if
the =
packages
>> are even available for installation
>>
>> yum install gluster-swift gluster-swift-object =
gluster-swift-plugin
>> gluster-swift-account
>> gluster-swift-proxy gluster-swift-doc gluster-swift-container
>> glusterfs-geo-replication
>>
>> if not you could try to get them in official gluster repo.
>> =
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs=
-epel.repo
>>
>> HTH
>>
>> M.
>>
>>
>>
>>
>> On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com> =
wrote:
>>
>> Hi Martin,
>>
>> I installed gluster from ovirt repo....is it require to install =
those
>> packages manually ??
>>
>> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavl=C3=ADk =
<mpavlik(a)redhat.com> wrote:
>>
>>> Hi Punit,
>>>
>>> can you verify that nodes contain cluster packages from the =
following
>>> log?
>>>
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-object',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-plugin',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-account',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-proxy',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-doc',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-container',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>> ('glusterfs-geo-replication',) not found
>>>
>>>
>>> M.
>>>
>>> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com> =
wrote:
>>>
>>> Hi Kanagaraj,
>>>
>>> Please find the attached logs :-
>>>
>>> Engine Logs :- http://ur1.ca/jdopt
>>> VDSM Logs :- http://ur1.ca/jdoq9
>>>
>>>
>>>
>>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com> =
wrote:
>>>
>>>> Do you see any errors in the UI?
>>>>
>>>> Also please provide the engine.log and vdsm.log when the failure
>>>> occured.
>>>>
>>>> Thanks,
>>>> Kanagaraj
>>>>
>>>>
>>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>>>>
>>>> Hi Martin,
>>>>
>>>> The steps are below :-
>>>>
>>>> 1. Step the ovirt engine on the one server...
>>>> 2. Installed centos 7 on 4 host node servers..
>>>> 3. I am using host node (compute+storage)....now i have added all =
4
>>>> nodes to engine...
>>>> 4. Create the gluster volume from GUI...
>>>>
>>>> Network :-
>>>> eth0 :- public network (1G)
>>>> eth1+eth2=3Dbond0=3D VM public network (1G)
>>>> eth3+eth4=3Dbond1=3Dovirtmgmt+storage (10G private network)
>>>>
>>>> every hostnode has 24 bricks=3D24*4(distributed replicated)
>>>>
>>>> Thanks,
>>>> Punit
>>>>
>>>>
>>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavl=C3=ADk =
<mpavlik(a)redhat.com>
>>>> wrote:
>>>>
>>>>> Hi Punit,
>>>>>
>>>>> can you please provide also errors from /var/log/vdsm/vdsm.log =
and
>>>>> /var/log/vdsm/vdsmd.log
>>>>>
>>>>> it would be really helpful if you provided exact steps how to
>>>>> reproduce the problem.
>>>>>
>>>>> regards
>>>>>
>>>>> Martin Pavlik - rhev QE
>>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com> =
wrote:
>>>>> >
>>>>> > Hi,
>>>>> >
>>>>> > I try to add gluster volume but it failed...
>>>>> >
>>>>> > Ovirt :- 3.5
>>>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>>>>> > KVM :- 1.5.3 - 60.el7_0.2
>>>>> > libvirt-1.1.1-29.el7_0.4
>>>>> > Glusterfs :- glusterfs-3.5.3-1.el7
>>>>> >
>>>>> > Engine Logs :-
>>>>> >
>>>>> > 2015-01-08 09:57:52,569 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > 2015-01-08 09:57:52,609 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > 2015-01-08 09:57:55,582 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > 2015-01-08 09:57:55,591 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > 2015-01-08 09:57:55,596 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > 2015-01-08 09:57:55,633 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > ^C
>>>>> >
>>>>> >
>>>>>
>>>>>
>>>>
>>>>
>>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>>>
>>>
>>>
>>
>>
>
>
=20
------=_NextPart_000_00B5_01D02F1E.B7FDC3D0
Content-Type: text/html;
charset="utf-8"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta =
http-equiv=3DContent-Type content=3D"text/html; charset=3Dutf-8"><meta =
name=3DGenerator content=3D"Microsoft Word 14 (filtered =
medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-US
link=3Dblue =
vlink=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Are you using ctdb??? and did you specify Lock=3DFalse in =
/etc/nfsmount.conf<o:p></o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p> </o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Can you give a full run down of topology, and has this ever been =
working or is it a new deployment?<o:p></o:p></span></p><p =
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p> </o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Donny D<o:p></o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p> </o:p></span></p><p
class=3DMsoNormal><b><span =
style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span>=
</b><span
style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'>
=
users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] <b>On Behalf Of =
</b>Punit Dambiwal<br><b>Sent:</b> Monday, January 12, 2015 7:18
=
PM<br><b>To:</b> Kanagaraj Mayilsamy<br><b>Cc:</b> =
gluster-users(a)gluster.org; Kaushal M; users@ovirt.org<br><b>Subject:</b>
=
Re: [ovirt-users] Failed to create volume in OVirt with =
gluster<o:p></o:p></span></p><p =
class=3DMsoNormal><o:p> </o:p></p><div><p =
class=3DMsoNormal>Hi,<o:p></o:p></p><div><p =
class=3DMsoNormal><o:p> </o:p></p></div><div><p
=
class=3DMsoNormal>Please find the more details on this ....can anybody =
from gluster will help me here
:- <o:p></o:p></p><div><p =
class=3DMsoNormal><o:p> </o:p></p></div><div><p
=
class=3DMsoNormal><o:p> </o:p></p></div><div><p
=
class=3DMsoNormal>Gluster CLI Logs =
:- /var/log/glusterfs/cli.log<o:p></o:p></p></div><div><p
=
class=3DMsoNormal><o:p> </o:p></p></div><div><div><p
=
class=3DMsoNormal>[2015-01-13 02:06:23.071969] T =
[cli.c:264:cli_rpc_notify] 0-glusterfs: got =
RPC_CLNT_CONNECT<o:p></o:p></p></div><div><p =
class=3DMsoNormal>[2015-01-13 02:06:23.072012] T =
[cli-quotad-client.c:94:cli_quotad_notify] 0-glusterfs: got =
RPC_CLNT_CONNECT<o:p></o:p></p></div><div><p =
class=3DMsoNormal>[2015-01-13 02:06:23.072024] I =
[socket.c:2344:socket_event_handler] 0-transport: disconnecting =
now<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.072055] T [cli-quotad-client.c:100:cli_quotad_notify] =
0-glusterfs: got
RPC_CLNT_DISCONNECT<o:p></o:p></p></div><div><p =
class=3DMsoNormal>[2015-01-13 02:06:23.072131] T =
[rpc-clnt.c:1381:rpc_clnt_record] 0-glusterfs: Auth Info: pid: 0, uid: =
0, gid: 0, owner:<o:p></o:p></p></div><div><p =
class=3DMsoNormal>[2015-01-13 02:06:23.072176] T =
[rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request =
fraglen 128, payload: 64, rpc hdr:
64<o:p></o:p></p></div><div><p =
class=3DMsoNormal>[2015-01-13 02:06:23.072572] T =
[socket.c:2863:socket_connect] (--> =
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420] =
(--> =
/usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a429=
3] (--> =
/usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] (--> =
/usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (--> =
/usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs: =
connect () called on transport already =
connected<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit] 0-rpc-clnt: =
submitted request (XID: 0x1 Program: Gluster CLI, ProgVers: 2, Proc: 27) =
to rpc-transport (glusterfs)<o:p></o:p></p></div><div><p
=
class=3DMsoNormal>[2015-01-13 02:06:23.072633] D =
[rpc-clnt-ping.c:231:rpc_clnt_start_ping] 0-glusterfs: ping timeout is =
0, returning<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init] 0-glusterfs: =
received rpc message (RPC XID: 0x1 Program: Gluster CLI, ProgVers: 2, =
Proc: 27) from rpc-transport
(glusterfs)<o:p></o:p></p></div><div><p =
class=3DMsoNormal>[2015-01-13 02:06:23.075976] D =
[cli-rpc-ops.c:6548:gf_cli_status_cbk] 0-cli: Received response to =
status cmd<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli: Returning =
0<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume] 0-cli: =
Returning: 0<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.076192] D [cli-xml-output.c:84:cli_begin_xml_output] 0-cli: =
Returning 0<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.076244] D [cli-xml-output.c:131:cli_xml_output_common] 0-cli: =
Returning 0<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.076256] D =
[cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning =
0<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output] 0-cli: =
Returning 0<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.076459] D [cli-xml-output.c:1398:cli_xml_output_vol_status_end] =
0-cli: Returning 0<o:p></o:p></p></div><div><p =
class=3DMsoNormal>[2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] =
0-: Exiting with:
0<o:p></o:p></p></div></div><div><p =
class=3DMsoNormal><o:p> </o:p></p></div></div><div><p
=
class=3DMsoNormal>Command log =
:- /var/log/glusterfs/.cmd_log_history<o:p></o:p></p></div><div><p
=
class=3DMsoNormal><o:p> </o:p></p></div><div><div><p
=
class=3DMsoNormal>Staging failed on =
00000000-0000-0000-0000-000000000000. Please check log file for =
details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging failed on =
00000000-0000-0000-0000-000000000000. Please check log file for =
details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:10:35.836676] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:16:25.956514] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:17:36.977833] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:21:07.048053] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:26:57.168661] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:28:07.194428] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:30:27.256667] : volume status vol01 : FAILED : Locking failed =
on <a =
href=3D"http://cpu02.zne01.hkg1.stack.com">cpu02.zne01.hkg1.stack.com</a>=
. Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>Locking failed on <a =
href=3D"http://cpu03.zne01.hkg1.stack.com">cpu03.zne01.hkg1.stack.com</a>=
. Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>Locking failed on <a =
href=3D"http://cpu04.zne01.hkg1.stack.com">cpu04.zne01.hkg1.stack.com</a>=
. Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>[2015-01-13 01:34:58.350748] : volume status all =
tasks : FAILED : Staging failed on 00000000-0000-0000-0000-000000000000. =
Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>Staging failed on =
00000000-0000-0000-0000-000000000000. Please check log file for =
details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging failed on =
00000000-0000-0000-0000-000000000000. Please check log file for =
details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:36:08.375326] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:36:08.386470] : volume status vol01 : FAILED : Locking failed =
on <a =
href=3D"http://cpu02.zne01.hkg1.stack.com">cpu02.zne01.hkg1.stack.com</a>=
. Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>Locking failed on <a =
href=3D"http://cpu03.zne01.hkg1.stack.com">cpu03.zne01.hkg1.stack.com</a>=
. Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>Locking failed on <a =
href=3D"http://cpu04.zne01.hkg1.stack.com">cpu04.zne01.hkg1.stack.com</a>=
. Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>[2015-01-13 01:42:59.524215] : volume stop vol01 =
: FAILED : Locking failed on <a =
href=3D"http://cpu02.zne01.hkg1.stack.com">cpu02.zne01.hkg1.stack.com</a>=
. Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>Locking failed on <a =
href=3D"http://cpu03.zne01.hkg1.stack.com">cpu03.zne01.hkg1.stack.com</a>=
. Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>Locking failed on <a =
href=3D"http://cpu04.zne01.hkg1.stack.com">cpu04.zne01.hkg1.stack.com</a>=
. Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>[2015-01-13 01:45:10.550659] : volume status all =
tasks : FAILED : Staging failed on 00000000-0000-0000-0000-000000000000. =
Please check log file for
details.<o:p></o:p></p></div><div><p =
class=3DMsoNormal>Staging failed on =
00000000-0000-0000-0000-000000000000. Please check log file for =
details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>Staging failed on =
00000000-0000-0000-0000-000000000000. Please check log file for =
details.<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:46:10.656802] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:51:02.796031] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:52:02.897804] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:55:25.841070] : system:: uuid get : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:55:26.752084] : system:: uuid get : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:55:32.499049] : system:: uuid get : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:55:38.716907] : system:: uuid get : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:56:52.905899] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
01:58:53.109613] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:03:26.769430] : system:: uuid get : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:04:22.859213] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:05:22.970393] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p
class=3DMsoNormal>[2015-01-13 =
02:06:23.075823] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div></div><div><p =
class=3DMsoNormal><o:p> </o:p></p></div></div><div><p
=
class=3DMsoNormal><o:p> </o:p></p><div><p
class=3DMsoNormal>On Mon, =
Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <<a =
href=3D"mailto:kmayilsa@redhat.com" =
target=3D"_blank">kmayilsa(a)redhat.com</a>&gt;
wrote:<o:p></o:p></p><p =
class=3DMsoNormal>I can see the failures in glusterd log.<br><br>Can =
someone from glusterfs dev pls help on =
this?<br><br>Thanks,<br>Kanagaraj<o:p></o:p></p><div><div><p
=
class=3DMsoNormal><br>----- Original Message -----<br>> From: =
"Punit Dambiwal" <<a =
href=3D"mailto:hypunit@gmail.com">hypunit@gmail.com</a>><br>>
To: =
"Kanagaraj" <<a =
href=3D"mailto:kmayilsa@redhat.com">kmayilsa@redhat.com</a>><br>>
=
Cc: "Martin Pavl=C3=ADk" <<a =
href=3D"mailto:mpavlik@redhat.com">mpavlik@redhat.com</a>>, =
"Vijay Bellur" <<a =
href=3D"mailto:vbellur@redhat.com">vbellur@redhat.com</a>>, =
"Kaushal M" <<a =
href=3D"mailto:kshlmster@gmail.com">kshlmster@gmail.com</a>>,<br>>
=
<a href=3D"mailto:users@ovirt.org">users@ovirt.org</a>, <a =
href=3D"mailto:gluster-users@gluster.org">gluster-users@gluster.org</a><b=
r>> Sent: Monday, January 12, 2015 3:36:43 PM<br>> Subject: Re: =
Failed to create volume in OVirt with gluster<br>><br>> Hi =
Kanagaraj,<br>><br>> Please find the logs from here :- <a =
href=3D"http://ur1.ca/jeszc" =
target=3D"_blank">http://ur1.ca/jeszc</a><br>><br>>
[image: Inline =
image 1]<br>><br>> [image: Inline image
2]<br>><br>> On Mon, =
Jan 12, 2015 at 1:02 PM, Kanagaraj <<a =
href=3D"mailto:kmayilsa@redhat.com">kmayilsa@redhat.com</a>> =
wrote:<br>><br>> > Looks like there are some
failures in =
gluster.<br>> > Can you send the log output from glusterd log file =
from the relevant hosts?<br>> ><br>> >
Thanks,<br>> > =
Kanagaraj<br>> ><br>> ><br>> >
On 01/12/2015 10:24 AM, =
Punit Dambiwal wrote:<br>> ><br>> >
Hi,<br>> ><br>> =
> Is there any one from gluster can help me here :-<br>> =
><br>> > Engine logs :-<br>>
><br>> > =
2015-01-12 12:50:33,841 INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:34,725 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:36,824 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:36,853 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:36,866 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:37,751 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:39,849 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:39,878 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:39,890 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:40,776 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:42,878 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:42,903 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:42,916 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:43,771 =
INFO<br>> > =
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]<b=
r>> > (ajp--127.0.0.1-8702-1) [330ace48] FINISH, =
CreateGlusterVolumeVDSCommand,<br>> > log id:
303e70a4<br>> =
> 2015-01-12 12:50:43,780 ERROR<br>> > =
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]<br=
> > (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID:
330ace48, =
Job ID:<br>> > 896a69b3-a678-40a7-bceb-3635e4062aa0,
Call Stack: =
null, Custom Event ID:<br>> > -1, Message: Creation of Gluster =
Volume vol01 failed.<br>> > 2015-01-12 12:50:43,785
INFO<br>> =
> =
[org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]<br>> =
> (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object =
EngineLock<br>> > [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300 value: GLUSTER<br>> > , =
sharedLocks=3D ]<br>> ><br>> > [image:
Inline image =
2]<br>> ><br>> ><br>> > On
Sun, Jan 11, 2015 at 6:48 =
PM, Martin Pavl=C3=ADk <<a =
href=3D"mailto:mpavlik@redhat.com">mpavlik@redhat.com</a>> =
wrote:<br>> ><br>> >> Hi
Punit,<br>> >><br>> =
>> unfortunately I=E2=80=99am not that good with the =
gluster, I was just following<br>> >> the obvious clue from the
=
log. Could you try on the nodes if the packages<br>> >> are =
even available for installation<br>> >><br>>
>> =
yum install gluster-swift gluster-swift-object =
gluster-swift-plugin<br>> >> =
gluster-swift-account<br>> >> gluster-swift-proxy =
gluster-swift-doc gluster-swift-container<br>> >> =
glusterfs-geo-replication<br>> >><br>>
>> if not =
you could try to get them in official gluster repo.<br>> >>
<a =
href=3D"http://download.gluster.org/pub/gluster/glusterfs/LATEST/Cen...
lusterfs-epel.repo" =
target=3D"_blank">http://download.gluster.org/pub/gluster/gl...
T/CentOS/glusterfs-epel.repo</a><br>>
>><br>> >> =
HTH<br>> >><br>> >>
M.<br>> >><br>> =
>><br>> >><br>>
>><br>> >> =
On 10 Jan 2015, at 04:35, Punit Dambiwal <<a =
href=3D"mailto:hypunit@gmail.com">hypunit@gmail.com</a>> =
wrote:<br>> >><br>> >> Hi
Martin,<br>> =
>><br>> >> I installed gluster from
ovirt =
repo....is it require to install those<br>> >> packages =
manually ??<br>> >><br>> >> On Fri,
Jan 9, 2015 at =
7:19 PM, Martin Pavl=C3=ADk <<a =
href=3D"mailto:mpavlik@redhat.com">mpavlik@redhat.com</a>> =
wrote:<br>> >><br>>
>>> Hi Punit,<br>> =
>>><br>> >>> can you verify that
nodes contain =
cluster packages from the following<br>> >>>
log?<br>> =
>>><br>> >>>
Thread-14::DEBUG::2015-01-09<br>> =
>>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm =
package<br>> >>> ('gluster-swift',) not
found<br>> =
>>> Thread-14::DEBUG::2015-01-09<br>>
>>> =
18:06:28,825::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-object',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,826::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-plugin',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-account',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-proxy',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-doc',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-container',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('glusterfs-geo-replication',) not
found<br>> =
>>><br>> >>><br>>
>>> M.<br>> =
>>><br>> >>>
On 09 Jan 2015, at 11:13, =
Punit Dambiwal <<a =
href=3D"mailto:hypunit@gmail.com">hypunit@gmail.com</a>> =
wrote:<br>> >>><br>>
>>> Hi =
Kanagaraj,<br>> >>><br>>
>>> Please find =
the attached logs :-<br>> >>><br>>
>>> =
Engine Logs :- <a href=3D"http://ur1.ca/jdopt" =
target=3D"_blank">http://ur1.ca/jdopt</a><br>>
>>> VDSM Logs =
:- <a href=3D"http://ur1.ca/jdoq9" =
target=3D"_blank">http://ur1.ca/jdoq9</a><br>>
>>><br>> =
>>><br>> >>><br>>
>>> On Thu, Jan 8, =
2015 at 6:05 PM, Kanagaraj <<a =
href=3D"mailto:kmayilsa@redhat.com">kmayilsa@redhat.com</a>> =
wrote:<br>> >>><br>>
>>>> Do you see =
any errors in the UI?<br>> >>>><br>>
>>>> =
Also please provide the engine.log and vdsm.log when the failure<br>> =
>>>> occured.<br>>
>>>><br>> =
>>>> Thanks,<br>>
>>>> Kanagaraj<br>> =
>>>><br>>
>>>><br>> >>>> On =
01/08/2015 02:25 PM, Punit Dambiwal wrote:<br>> =
>>>><br>> >>>> Hi
Martin,<br>> =
>>>><br>>
>>>> The steps are below =
:-<br>> >>>><br>>
>>>> 1. Step the =
ovirt engine on the one server...<br>> >>>> 2.
Installed =
centos 7 on 4 host node servers..<br>> >>>> 3. I
am using =
host node (compute+storage)....now i have added all 4<br>> =
>>>> nodes to engine...<br>>
>>>> 4. Create =
the gluster volume from GUI...<br>>
>>>><br>> =
>>>> Network :-<br>>
>>>> eth0 :- =
public network (1G)<br>> >>>>
eth1+eth2=3Dbond0=3D VM =
public network (1G)<br>> >>>> =
eth3+eth4=3Dbond1=3Dovirtmgmt+storage (10G private network)<br>> =
>>>><br>>
>>>> every hostnode has 24 =
bricks=3D24*4(distributed replicated)<br>>
>>>><br>> =
>>>> Thanks,<br>>
>>>> Punit<br>> =
>>>><br>>
>>>><br>> >>>> On =
Thu, Jan 8, 2015 at 3:20 PM, Martin Pavl=C3=ADk <<a =
href=3D"mailto:mpavlik@redhat.com">mpavlik@redhat.com</a>><br>>
=
>>>> wrote:<br>>
>>>><br>> =
>>>>> Hi Punit,<br>>
>>>>><br>> =
>>>>> can you please provide also errors from =
/var/log/vdsm/vdsm.log and<br>> >>>>> =
/var/log/vdsm/vdsmd.log<br>>
>>>>><br>> =
>>>>> it would be really helpful if you provided exact
=
steps how to<br>> >>>>> reproduce the
problem.<br>> =
>>>>><br>>
>>>>> regards<br>> =
>>>>><br>>
>>>>> Martin Pavlik - rhev =
QE<br>> >>>>> > On 08 Jan
2015, at 03:06, =
Punit Dambiwal <<a =
href=3D"mailto:hypunit@gmail.com">hypunit@gmail.com</a>> =
wrote:<br>> >>>>>
><br>> >>>>> =
> Hi,<br>> >>>>>
><br>> >>>>> =
> I try to add gluster volume but it failed...<br>> =
>>>>> ><br>>
>>>>> > Ovirt :- =
3.5<br>> >>>>> > VDSM :- =
vdsm-4.16.7-1.gitdb83943.el7<br>> >>>>>
> KVM :- =
1.5.3 - 60.el7_0.2<br>> >>>>> > =
libvirt-1.1.1-29.el7_0.4<br>> >>>>>
> Glusterfs :- =
glusterfs-3.5.3-1.el7<br>> >>>>>
><br>> =
>>>>> > Engine Logs :-<br>>
>>>>> =
><br>> >>>>> > 2015-01-08
09:57:52,569 =
INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
2015-01-08 =
09:57:52,609 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
2015-01-08 =
09:57:55,582 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
2015-01-08 =
09:57:55,591 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
2015-01-08 =
09:57:55,596 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
2015-01-08 =
09:57:55,633 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
^C<br>> =
>>>>> ><br>>
>>>>> ><br>> =
>>>>><br>>
>>>>><br>> =
>>>><br>>
>>>><br>> >>> =
<216 09-Jan-15.jpg><217
09-Jan-15.jpg><br>> =
>>><br>> >>><br>>
>>><br>> =
>><br>> >><br>>
><br>> =
><br>><o:p></o:p></p></div></div></div><p
=
class=3DMsoNormal><o:p> </o:p></p></div></div></body></html>
------=_NextPart_000_00B5_01D02F1E.B7FDC3D0--
4:41 a.m.
Hi Donny,
No I am not using CTDB....it's totally new deployment...
On Wed, Jan 14, 2015 at 1:50 AM, Donny Davis <donny(a)cloudspin.me> wrote:
Are you using ctdb??? and did you specify Lock=False in
/etc/nfsmount.conf
Can you give a full run down of topology, and has this ever been working
or is it a new deployment?
Donny D
*From:* users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] *On
Behalf Of *Punit Dambiwal
*Sent:* Monday, January 12, 2015 7:18 PM
*To:* Kanagaraj Mayilsamy
*Cc:* gluster-users(a)gluster.org; Kaushal M; users(a)ovirt.org
*Subject:* Re: [ovirt-users] Failed to create volume in OVirt with gluster
Hi,
Please find the more details on this ....can anybody from gluster will
help me here :-
Gluster CLI Logs :- /var/log/glusterfs/cli.log
[2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs: got
RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072012] T [cli-quotad-client.c:94:cli_quotad_notify]
0-glusterfs: got RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler]
0-transport: disconnecting now
[2015-01-13 02:06:23.072055] T [cli-quotad-client.c:100:cli_quotad_notify]
0-glusterfs: got RPC_CLNT_DISCONNECT
[2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record]
0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2015-01-13 02:06:23.072176] T
[rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen
128, payload: 64, rpc hdr: 64
[2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (-->
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420] (-->
/usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a4293]
(--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] (-->
/usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (-->
/usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs: connect
() called on transport already connected
[2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit]
0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers: 2,
Proc: 27) to rpc-transport (glusterfs)
[2015-01-13 02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping]
0-glusterfs: ping timeout is 0, returning
[2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init]
0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI,
ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
[2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk]
0-cli: Received response to status cmd
[2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli:
Returning 0
[2015-01-13 02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume]
0-cli: Returning: 0
[2015-01-13 02:06:23.076192] D [cli-xml-output.c:84:cli_begin_xml_output]
0-cli: Returning 0
[2015-01-13 02:06:23.076244] D
[cli-xml-output.c:131:cli_xml_output_common] 0-cli: Returning 0
[2015-01-13 02:06:23.076256] D
[cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning 0
[2015-01-13 02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output]
0-cli: Returning 0
[2015-01-13 02:06:23.076459] D
[cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning 0
[2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: 0
Command log :- /var/log/glusterfs/.cmd_log_history
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:10:35.836676] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:16:25.956514] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:17:36.977833] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:21:07.048053] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:26:57.168661] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:28:07.194428] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:34:58.350748] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:36:08.375326] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:45:10.550659] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
[2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
[2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
[2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
[2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
[2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
[2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
[2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
[2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
[2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
[2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
[2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
[2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <kmayilsa(a)redhat.com>
wrote:
I can see the failures in glusterd log.
Can someone from glusterfs dev pls help on this?
Thanks,
Kanagaraj
----- Original Message -----
> From: "Punit Dambiwal" <hypunit(a)gmail.com>
> To: "Kanagaraj" <kmayilsa(a)redhat.com>
> Cc: "Martin Pavlík" <mpavlik(a)redhat.com>, "Vijay Bellur"
<
vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
> users(a)ovirt.org, gluster-users(a)gluster.org
> Sent: Monday, January 12, 2015 3:36:43 PM
> Subject: Re: Failed to create volume in OVirt with gluster
>
> Hi Kanagaraj,
>
> Please find the logs from here :- http://ur1.ca/jeszc
>
> [image: Inline image 1]
>
> [image: Inline image 2]
>
> On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
>
> > Looks like there are some failures in gluster.
> > Can you send the log output from glusterd log file from the relevant
hosts?
> >
> > Thanks,
> > Kanagaraj
> >
> >
> > On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
> >
> > Hi,
> >
> > Is there any one from gluster can help me here :-
> >
> > Engine logs :-
> >
> > 2015-01-12 12:50:33,841 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:34,725 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:36,824 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:36,853 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:36,866 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:37,751 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:39,849 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:39,878 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:39,890 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:40,776 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:42,878 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:42,903 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:42,916 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:43,771 INFO
> >
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
> > (ajp--127.0.0.1-8702-1) [330ace48] FINISH,
CreateGlusterVolumeVDSCommand,
> > log id: 303e70a4
> > 2015-01-12 12:50:43,780 ERROR
> > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
> > (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
> > 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event
ID:
> > -1, Message: Creation of Gluster Volume vol01 failed.
> > 2015-01-12 12:50:43,785 INFO
> > [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
> > (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
> > [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value:
GLUSTER
> > , sharedLocks= ]
> >
> > [image: Inline image 2]
> >
> >
> > On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík <mpavlik(a)redhat.com>
wrote:
> >
> >> Hi Punit,
> >>
> >> unfortunately I’am not that good with the gluster, I was just
following
> >> the obvious clue from the log. Could you try on the nodes if the
packages
> >> are even available for installation
> >>
> >> yum install gluster-swift gluster-swift-object gluster-swift-plugin
> >> gluster-swift-account
> >> gluster-swift-proxy gluster-swift-doc gluster-swift-container
> >> glusterfs-geo-replication
> >>
> >> if not you could try to get them in official gluster repo.
> >>
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
> >>
> >> HTH
> >>
> >> M.
> >>
> >>
> >>
> >>
> >> On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
> >>
> >> Hi Martin,
> >>
> >> I installed gluster from ovirt repo....is it require to install those
> >> packages manually ??
> >>
> >> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík <mpavlik(a)redhat.com>
wrote:
> >>
> >>> Hi Punit,
> >>>
> >>> can you verify that nodes contain cluster packages from the following
> >>> log?
> >>>
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-object',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-plugin',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-account',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-proxy',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-doc',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-container',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
> >>> ('glusterfs-geo-replication',) not found
> >>>
> >>>
> >>> M.
> >>>
> >>> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
> >>>
> >>> Hi Kanagaraj,
> >>>
> >>> Please find the attached logs :-
> >>>
> >>> Engine Logs :- http://ur1.ca/jdopt
> >>> VDSM Logs :- http://ur1.ca/jdoq9
> >>>
> >>>
> >>>
> >>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com>
wrote:
> >>>
> >>>> Do you see any errors in the UI?
> >>>>
> >>>> Also please provide the engine.log and vdsm.log when the failure
> >>>> occured.
> >>>>
> >>>> Thanks,
> >>>> Kanagaraj
> >>>>
> >>>>
> >>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
> >>>>
> >>>> Hi Martin,
> >>>>
> >>>> The steps are below :-
> >>>>
> >>>> 1. Step the ovirt engine on the one server...
> >>>> 2. Installed centos 7 on 4 host node servers..
> >>>> 3. I am using host node (compute+storage)....now i have added all
4
> >>>> nodes to engine...
> >>>> 4. Create the gluster volume from GUI...
> >>>>
> >>>> Network :-
> >>>> eth0 :- public network (1G)
> >>>> eth1+eth2=bond0= VM public network (1G)
> >>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
> >>>>
> >>>> every hostnode has 24 bricks=24*4(distributed replicated)
> >>>>
> >>>> Thanks,
> >>>> Punit
> >>>>
> >>>>
> >>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík
<mpavlik(a)redhat.com>
> >>>> wrote:
> >>>>
> >>>>> Hi Punit,
> >>>>>
> >>>>> can you please provide also errors from /var/log/vdsm/vdsm.log
and
> >>>>> /var/log/vdsm/vdsmd.log
> >>>>>
> >>>>> it would be really helpful if you provided exact steps how to
> >>>>> reproduce the problem.
> >>>>>
> >>>>> regards
> >>>>>
> >>>>> Martin Pavlik - rhev QE
> >>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com>
wrote:
> >>>>> >
> >>>>> > Hi,
> >>>>> >
> >>>>> > I try to add gluster volume but it failed...
> >>>>> >
> >>>>> > Ovirt :- 3.5
> >>>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
> >>>>> > KVM :- 1.5.3 - 60.el7_0.2
> >>>>> > libvirt-1.1.1-29.el7_0.4
> >>>>> > Glusterfs :- glusterfs-3.5.3-1.el7
> >>>>> >
> >>>>> > Engine Logs :-
> >>>>> >
> >>>>> > 2015-01-08 09:57:52,569 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:52,609 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,582 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,591 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,596 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,633 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > ^C
> >>>>> >
> >>>>> >
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
> >>>
> >>>
> >>>
> >>
> >>
> >
> >
>
4:47 a.m.
This is a multipart message in MIME format.
------=_NextPart_000_0137_01D02F61.6F1BCB10
Content-Type: text/plain;
charset="utf-8"
Content-Transfer-Encoding: quoted-printable
And=20
=20
rpcbind is running
=20
can you do a regular nfs mount of the gluster volume?
gluster volume info {your volume name here}
=20
=20
Just gathering intel to hopefully provide a solution. I just deployed =
gluster with hosted engine today, and I did get some of the same errors =
as you when I was bringing everything up
Did you follow a guide, or are you craving your own?
Are you using swift for anything=E2=80=A6 that is usually for openstack =
to my knowledge? I guess you could use it for ovirt, but I =
didn=E2=80=99t
=20
Donny D
=20
From: Punit Dambiwal [mailto:hypunit@gmail.com]=20
Sent: Tuesday, January 13, 2015 6:41 PM
To: Donny Davis
Cc: users(a)ovirt.org
Subject: Re: [ovirt-users] Failed to create volume in OVirt with gluster
=20
Hi Donny,
=20
No I am not using CTDB....it's totally new deployment...
=20
On Wed, Jan 14, 2015 at 1:50 AM, Donny Davis <donny(a)cloudspin.me> wrote:
Are you using ctdb??? and did you specify Lock=3DFalse in =
/etc/nfsmount.conf
=20
Can you give a full run down of topology, and has this ever been working =
or is it a new deployment?
=20
Donny D
=20
From: users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] On Behalf =
Of Punit Dambiwal
Sent: Monday, January 12, 2015 7:18 PM
To: Kanagaraj Mayilsamy
Cc: gluster-users(a)gluster.org; Kaushal M; users(a)ovirt.org
Subject: Re: [ovirt-users] Failed to create volume in OVirt with gluster
=20
Hi,
=20
Please find the more details on this ....can anybody from gluster will =
help me here :-=20
=20
=20
Gluster CLI Logs :- /var/log/glusterfs/cli.log
=20
[2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs: =
got RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072012] T =
[cli-quotad-client.c:94:cli_quotad_notify] 0-glusterfs: got =
RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler] =
0-transport: disconnecting now
[2015-01-13 02:06:23.072055] T =
[cli-quotad-client.c:100:cli_quotad_notify] 0-glusterfs: got =
RPC_CLNT_DISCONNECT
[2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record] =
0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2015-01-13 02:06:23.072176] T =
[rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request =
fraglen 128, payload: 64, rpc hdr: 64
[2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (--> =
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420] =
(--> =
/usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a429=
3] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] =
(--> /usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (--> =
/usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs: =
connect () called on transport already connected
[2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit] =
0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers: =
2, Proc: 27) to rpc-transport (glusterfs)
[2015-01-13 02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping] =
0-glusterfs: ping timeout is 0, returning
[2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init] =
0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI, =
ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
[2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk] =
0-cli: Received response to status cmd
[2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli: =
Returning 0
[2015-01-13 02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume] =
0-cli: Returning: 0
[2015-01-13 02:06:23.076192] D =
[cli-xml-output.c:84:cli_begin_xml_output] 0-cli: Returning 0
[2015-01-13 02:06:23.076244] D =
[cli-xml-output.c:131:cli_xml_output_common] 0-cli: Returning 0
[2015-01-13 02:06:23.076256] D =
[cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning =
0
[2015-01-13 02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output] =
0-cli: Returning 0
[2015-01-13 02:06:23.076459] D =
[cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning 0
[2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: =
0
=20
Command log :- /var/log/glusterfs/.cmd_log_history
=20
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:10:35.836676] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:16:25.956514] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:17:36.977833] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:21:07.048053] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:26:57.168661] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:28:07.194428] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking =
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for =
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for =
details.
[2015-01-13 01:34:58.350748] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:36:08.375326] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking =
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for =
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for =
details.
[2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking =
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for =
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for =
details.
[2015-01-13 01:45:10.550659] : volume status all tasks : FAILED : =
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log =
file for details.
[2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
[2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
[2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
[2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
[2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
[2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
[2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
[2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
[2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
[2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
[2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
[2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
[2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
=20
=20
On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy =
<kmayilsa(a)redhat.com> wrote:
I can see the failures in glusterd log.
Can someone from glusterfs dev pls help on this?
Thanks,
Kanagaraj
----- Original Message -----
From: "Punit Dambiwal" <hypunit(a)gmail.com>
To: "Kanagaraj" <kmayilsa(a)redhat.com>
Cc: "Martin Pavl=C3=ADk" <mpavlik(a)redhat.com>, "Vijay Bellur" =
<vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
users(a)ovirt.org, gluster-users(a)gluster.org
Sent: Monday, January 12, 2015 3:36:43 PM
Subject: Re: Failed to create volume in OVirt with gluster
Hi Kanagaraj,
Please find the logs from here :- http://ur1.ca/jeszc
[image: Inline image 1]
[image: Inline image 2]
On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com> =
wrote:
> Looks like there are some failures in gluster.
> Can you send the log output from glusterd log file from the relevant =
hosts?
>
> Thanks,
> Kanagaraj
>
>
> On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
>
> Hi,
>
> Is there any one from gluster can help me here :-
>
> Engine logs :-
>
> 2015-01-12 12:50:33,841 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:34,725 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:36,824 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:36,853 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:36,866 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:37,751 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:39,849 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:39,878 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:39,890 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:40,776 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:42,878 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:42,903 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:42,916 INFO
> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock
> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
> value: GLUSTER
> , sharedLocks=3D ]
> 2015-01-12 12:50:43,771 INFO
> =
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
> (ajp--127.0.0.1-8702-1) [330ace48] FINISH, =
CreateGlusterVolumeVDSCommand,
> log id: 303e70a4
> 2015-01-12 12:50:43,780 ERROR
> =
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
> (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job
ID:
> 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event =
ID:
> -1, Message: Creation of Gluster Volume vol01 failed.
> 2015-01-12 12:50:43,785 INFO
> [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
> (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
> [exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300 value: =
GLUSTER
> , sharedLocks=3D ]
>
> [image: Inline image 2]
>
>
> On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavl=C3=ADk =
<mpavlik(a)redhat.com> wrote:
>
>> Hi Punit,
>>
>> unfortunately I=E2=80=99am not that good with the gluster, I was =
just
following
>> the obvious clue from the log. Could you try on the nodes if
the =
packages
>> are even available for installation
>>
>> yum install gluster-swift gluster-swift-object =
gluster-swift-plugin
>> gluster-swift-account
>> gluster-swift-proxy gluster-swift-doc gluster-swift-container
>> glusterfs-geo-replication
>>
>> if not you could try to get them in official gluster repo.
>> =
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs=
-epel.repo
>>
>> HTH
>>
>> M.
>>
>>
>>
>>
>> On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com> =
wrote:
>>
>> Hi Martin,
>>
>> I installed gluster from ovirt repo....is it require to install =
those
>> packages manually ??
>>
>> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavl=C3=ADk =
<mpavlik(a)redhat.com> wrote:
>>
>>> Hi Punit,
>>>
>>> can you verify that nodes contain cluster packages from the =
following
>>> log?
>>>
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-object',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-plugin',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-account',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-proxy',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-doc',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>> ('gluster-swift-container',) not found
>>> Thread-14::DEBUG::2015-01-09
>>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>>> ('glusterfs-geo-replication',) not found
>>>
>>>
>>> M.
>>>
>>> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com> =
wrote:
>>>
>>> Hi Kanagaraj,
>>>
>>> Please find the attached logs :-
>>>
>>> Engine Logs :- http://ur1.ca/jdopt
>>> VDSM Logs :- http://ur1.ca/jdoq9
>>>
>>>
>>>
>>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com> =
wrote:
>>>
>>>> Do you see any errors in the UI?
>>>>
>>>> Also please provide the engine.log and vdsm.log when the failure
>>>> occured.
>>>>
>>>> Thanks,
>>>> Kanagaraj
>>>>
>>>>
>>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>>>>
>>>> Hi Martin,
>>>>
>>>> The steps are below :-
>>>>
>>>> 1. Step the ovirt engine on the one server...
>>>> 2. Installed centos 7 on 4 host node servers..
>>>> 3. I am using host node (compute+storage)....now i have added all =
4
>>>> nodes to engine...
>>>> 4. Create the gluster volume from GUI...
>>>>
>>>> Network :-
>>>> eth0 :- public network (1G)
>>>> eth1+eth2=3Dbond0=3D VM public network (1G)
>>>> eth3+eth4=3Dbond1=3Dovirtmgmt+storage (10G private network)
>>>>
>>>> every hostnode has 24 bricks=3D24*4(distributed replicated)
>>>>
>>>> Thanks,
>>>> Punit
>>>>
>>>>
>>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavl=C3=ADk =
<mpavlik(a)redhat.com>
>>>> wrote:
>>>>
>>>>> Hi Punit,
>>>>>
>>>>> can you please provide also errors from /var/log/vdsm/vdsm.log =
and
>>>>> /var/log/vdsm/vdsmd.log
>>>>>
>>>>> it would be really helpful if you provided exact steps how to
>>>>> reproduce the problem.
>>>>>
>>>>> regards
>>>>>
>>>>> Martin Pavlik - rhev QE
>>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com> =
wrote:
>>>>> >
>>>>> > Hi,
>>>>> >
>>>>> > I try to add gluster volume but it failed...
>>>>> >
>>>>> > Ovirt :- 3.5
>>>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>>>>> > KVM :- 1.5.3 - 60.el7_0.2
>>>>> > libvirt-1.1.1-29.el7_0.4
>>>>> > Glusterfs :- glusterfs-3.5.3-1.el7
>>>>> >
>>>>> > Engine Logs :-
>>>>> >
>>>>> > 2015-01-08 09:57:52,569 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > 2015-01-08 09:57:52,609 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > 2015-01-08 09:57:55,582 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > 2015-01-08 09:57:55,591 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > 2015-01-08 09:57:55,596 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > 2015-01-08 09:57:55,633 INFO
>>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and =
wait lock
>>>>> EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300
>>>>> value: GLUSTER
>>>>> > , sharedLocks=3D ]
>>>>> > ^C
>>>>> >
>>>>> >
>>>>>
>>>>>
>>>>
>>>>
>>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>>>
>>>
>>>
>>
>>
>
>
=20
=20
------=_NextPart_000_0137_01D02F61.6F1BCB10
Content-Type: text/html;
charset="utf-8"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta =
http-equiv=3DContent-Type content=3D"text/html; charset=3Dutf-8"><meta =
name=3DGenerator content=3D"Microsoft Word 14 (filtered =
medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-US
link=3Dblue =
vlink=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>And <o:p></o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p> </o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>rpcbind is running<o:p></o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p> </o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>can you do a regular nfs mount of the gluster =
volume?<o:p></o:p></span></p><p class=3DMsoNormal><span
=
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>gluster volume info {your volume name
here}<o:p></o:p></span></p><p =
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p> </o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p> </o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Just gathering intel to hopefully provide a solution. I just deployed =
gluster with hosted engine today, and I did get some of the same errors =
as you when I was bringing everything
up<o:p></o:p></span></p><p =
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Did you follow a guide, or are you craving your =
own?<o:p></o:p></span></p><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Are you using swift for anything=E2=80=A6 that is usually for =
openstack to my knowledge? I guess you could use it for ovirt, but I =
didn=E2=80=99t<o:p></o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p> </o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Donny D<o:p></o:p></span></p><p
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p> </o:p></span></p><p
class=3DMsoNormal><b><span =
style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span>=
</b><span
style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'>
=
Punit Dambiwal [mailto:hypunit@gmail.com] <br><b>Sent:</b> Tuesday, =
January 13, 2015 6:41 PM<br><b>To:</b> Donny
Davis<br><b>Cc:</b> =
users@ovirt.org<br><b>Subject:</b> Re: [ovirt-users] Failed to create =
volume in OVirt with gluster<o:p></o:p></span></p><p =
class=3DMsoNormal><o:p> </o:p></p><div><p
class=3DMsoNormal>Hi =
Donny,<o:p></o:p></p><div><p =
class=3DMsoNormal><o:p> </o:p></p></div><div><p
=
class=3DMsoNormal>No I am not using CTDB....it's totally new =
deployment...<o:p></o:p></p></div></div><div><p =
class=3DMsoNormal><o:p> </o:p></p><div><p
class=3DMsoNormal>On Wed, =
Jan 14, 2015 at 1:50 AM, Donny Davis <<a =
href=3D"mailto:donny@cloudspin.me" =
target=3D"_blank">donny(a)cloudspin.me</a>&gt; =
wrote:<o:p></o:p></p><div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Are you using ctdb??? and did you specify Lock=3DFalse in =
/etc/nfsmount.conf</span><o:p></o:p></p><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'> </span><o:p></o:p></p><p class=3DMsoNormal
=
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Can you give a full run down of topology, and has this ever been =
working or is it a new deployment?</span><o:p></o:p></p><p =
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'> </span><o:p></o:p></p><p class=3DMsoNormal
=
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Donny D</span><o:p></o:p></p><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497=
D'> </span><o:p></o:p></p><p class=3DMsoNormal
=
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span
=
style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span>=
</b><span
style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'>
=
<a href=3D"mailto:users-bounces@ovirt.org" =
target=3D"_blank">users-bounces(a)ovirt.org</a> [mailto:<a =
href=3D"mailto:users-bounces@ovirt.org" =
target=3D"_blank">users-bounces(a)ovirt.org</a>] <b>On Behalf Of
</b>Punit =
Dambiwal<br><b>Sent:</b> Monday, January 12, 2015 7:18
PM<br><b>To:</b> =
Kanagaraj Mayilsamy<br><b>Cc:</b> <a =
href=3D"mailto:gluster-users@gluster.org" =
target=3D"_blank">gluster-users(a)gluster.org</a>; Kaushal M; <a =
href=3D"mailto:users@ovirt.org" =
target=3D"_blank">users@ovirt.org</a><br><b>Subject:</b>
Re: =
[ovirt-users] Failed to create volume in OVirt with =
gluster</span><o:p></o:p></p><div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p><=
/o:p></p><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Hi,<o:p></o:=
p></p><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p><=
/o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Please find =
the more details on this ....can anybody from gluster will help me here =
:- <o:p></o:p></p><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p><=
/o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p><=
/o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Gluster CLI =
Logs
:- /var/log/glusterfs/cli.log<o:p></o:p></p></div><div><p
=
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p><=
/o:p></p></div><div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs: got =
RPC_CLNT_CONNECT<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.072012] T [cli-quotad-client.c:94:cli_quotad_notify] =
0-glusterfs: got
RPC_CLNT_CONNECT<o:p></o:p></p></div><div><p =
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.072024] I [socket.c:2344:socket_event_handler] 0-transport: =
disconnecting now<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.072055] T [cli-quotad-client.c:100:cli_quotad_notify] =
0-glusterfs: got
RPC_CLNT_DISCONNECT<o:p></o:p></p></div><div><p =
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record] 0-glusterfs: Auth =
Info: pid: 0, uid: 0, gid: 0,
owner:<o:p></o:p></p></div><div><p =
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.072176] T [rpc-clnt.c:1238:rpc_clnt_record_build_header] =
0-rpc-clnt: Request fraglen 128, payload: 64, rpc hdr: =
64<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.072572] T [socket.c:2863:socket_connect] (--> =
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420] =
(--> =
/usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a429=
3] (--> =
/usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] (--> =
/usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (--> =
/usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs: =
connect () called on transport already =
connected<o:p></o:p></p></div><div><p class=3DMsoNormal
=
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit] 0-rpc-clnt: =
submitted request (XID: 0x1 Program: Gluster CLI, ProgVers: 2, Proc: 27) =
to rpc-transport (glusterfs)<o:p></o:p></p></div><div><p
=
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping] =
0-glusterfs: ping timeout is 0,
returning<o:p></o:p></p></div><div><p =
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init] 0-glusterfs: =
received rpc message (RPC XID: 0x1 Program: Gluster CLI, ProgVers: 2, =
Proc: 27) from rpc-transport
(glusterfs)<o:p></o:p></p></div><div><p =
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk] 0-cli: =
Received response to status
cmd<o:p></o:p></p></div><div><p =
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli: Returning =
0<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume] 0-cli: =
Returning: 0<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.076192] D [cli-xml-output.c:84:cli_begin_xml_output] 0-cli: =
Returning 0<o:p></o:p></p></div><div><p class=3DMsoNormal
=
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.076244] D [cli-xml-output.c:131:cli_xml_output_common] 0-cli: =
Returning 0<o:p></o:p></p></div><div><p class=3DMsoNormal
=
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.076256] D =
[cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning =
0<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output] 0-cli: =
Returning 0<o:p></o:p></p></div><div><p class=3DMsoNormal
=
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.076459] D [cli-xml-output.c:1398:cli_xml_output_vol_status_end] =
0-cli: Returning 0<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: =
0<o:p></o:p></p></div></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p><=
/o:p></p></div></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Command log =
:- /var/log/glusterfs/.cmd_log_history<o:p></o:p></p></div><div><p
=
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p><=
/o:p></p></div><div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:10:35.836676] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:16:25.956514] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:17:36.977833] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:21:07.048053] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:26:57.168661] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:28:07.194428] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:30:27.256667] : volume status vol01 : FAILED : Locking failed =
on <a href=3D"http://cpu02.zne01.hkg1.stack.com" =
target=3D"_blank">cpu02.zne01.hkg1.stack.com</a>. Please check log file
=
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Locking =
failed on <a href=3D"http://cpu03.zne01.hkg1.stack.com" =
target=3D"_blank">cpu03.zne01.hkg1.stack.com</a>. Please check log file
=
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Locking =
failed on <a href=3D"http://cpu04.zne01.hkg1.stack.com" =
target=3D"_blank">cpu04.zne01.hkg1.stack.com</a>. Please check log file
=
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:34:58.350748] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:36:08.375326] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:36:08.386470] : volume status vol01 : FAILED : Locking failed =
on <a href=3D"http://cpu02.zne01.hkg1.stack.com" =
target=3D"_blank">cpu02.zne01.hkg1.stack.com</a>. Please check log file
=
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Locking =
failed on <a href=3D"http://cpu03.zne01.hkg1.stack.com" =
target=3D"_blank">cpu03.zne01.hkg1.stack.com</a>. Please check log file
=
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Locking =
failed on <a href=3D"http://cpu04.zne01.hkg1.stack.com" =
target=3D"_blank">cpu04.zne01.hkg1.stack.com</a>. Please check log file
=
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:42:59.524215] : volume stop vol01 : FAILED : Locking failed on =
<a href=3D"http://cpu02.zne01.hkg1.stack.com" =
target=3D"_blank">cpu02.zne01.hkg1.stack.com</a>. Please check log file
=
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Locking =
failed on <a href=3D"http://cpu03.zne01.hkg1.stack.com" =
target=3D"_blank">cpu03.zne01.hkg1.stack.com</a>. Please check log file
=
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Locking =
failed on <a href=3D"http://cpu04.zne01.hkg1.stack.com" =
target=3D"_blank">cpu04.zne01.hkg1.stack.com</a>. Please check log file
=
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:45:10.550659] : volume status all tasks : FAILED : Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Staging =
failed on 00000000-0000-0000-0000-000000000000. Please check log file =
for details.<o:p></o:p></p></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:46:10.656802] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:51:02.796031] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:52:02.897804] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:55:25.841070] : system:: uuid get : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:55:26.752084] : system:: uuid get : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:55:32.499049] : system:: uuid get : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:55:38.716907] : system:: uuid get : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:56:52.905899] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
01:58:53.109613] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:03:26.769430] : system:: uuid get : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:04:22.859213] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:05:22.970393] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>[2015-01-13 =
02:06:23.075823] : volume status all tasks : =
SUCCESS<o:p></o:p></p></div></div><div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p><=
/o:p></p></div></div><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p><=
/o:p></p><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>On Mon, Jan =
12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <<a =
href=3D"mailto:kmayilsa@redhat.com" =
target=3D"_blank">kmayilsa(a)redhat.com</a>&gt;
wrote:<o:p></o:p></p><p =
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>I can see =
the failures in glusterd log.<br><br>Can someone from glusterfs dev pls =
help on
this?<br><br>Thanks,<br>Kanagaraj<o:p></o:p></p><div><div><p
=
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><br>----- =
Original Message -----<br>> From: "Punit Dambiwal"
<<a =
href=3D"mailto:hypunit@gmail.com" =
target=3D"_blank">hypunit(a)gmail.com</a>&gt;<br>&gt; To:
=
"Kanagaraj" <<a href=3D"mailto:kmayilsa@redhat.com"
=
target=3D"_blank">kmayilsa(a)redhat.com</a>&gt;<br>&gt; Cc:
"Martin =
Pavl=C3=ADk" <<a href=3D"mailto:mpavlik@redhat.com" =
target=3D"_blank">mpavlik(a)redhat.com</a>&gt;, "Vijay
Bellur" =
<<a href=3D"mailto:vbellur@redhat.com" =
target=3D"_blank">vbellur(a)redhat.com</a>&gt;, "Kaushal
M" =
<<a href=3D"mailto:kshlmster@gmail.com" =
target=3D"_blank">kshlmster(a)gmail.com</a>&gt;,<br>&gt;
<a =
href=3D"mailto:users@ovirt.org"
target=3D"_blank">users(a)ovirt.org</a>, =
<a href=3D"mailto:gluster-users@gluster.org" =
target=3D"_blank">gluster-users(a)gluster.org</a><br>&gt; Sent:
Monday, =
January 12, 2015 3:36:43 PM<br>> Subject: Re: Failed to create volume =
in OVirt with gluster<br>><br>> Hi
Kanagaraj,<br>><br>> =
Please find the logs from here :- <a href=3D"http://ur1.ca/jeszc" =
target=3D"_blank">http://ur1.ca/jeszc</a><br>><br>>
[image: Inline =
image 1]<br>><br>> [image: Inline image
2]<br>><br>> On Mon, =
Jan 12, 2015 at 1:02 PM, Kanagaraj <<a =
href=3D"mailto:kmayilsa@redhat.com" =
target=3D"_blank">kmayilsa(a)redhat.com</a>&gt;
wrote:<br>><br>> =
> Looks like there are some failures in gluster.<br>>
> =
Can you send the log output from glusterd log file from the relevant =
hosts?<br>> ><br>> > Thanks,<br>>
> Kanagaraj<br>> =
><br>> ><br>> > On 01/12/2015 10:24 AM,
Punit Dambiwal =
wrote:<br>> ><br>> > Hi,<br>>
><br>> > Is =
there any one from gluster can help me here :-<br>>
><br>> =
> Engine logs :-<br>> ><br>>
> 2015-01-12 =
12:50:33,841 INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:34,725 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:36,824 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:36,853 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:36,866 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:37,751 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:39,849 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:39,878 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:39,890 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:40,776 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:42,878 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:42,903 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:42,916 =
INFO<br>> > =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> > =
(DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait =
lock<br>> > EngineLock [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300<br>> > value:
GLUSTER<br>> =
> , sharedLocks=3D ]<br>> > 2015-01-12 12:50:43,771 =
INFO<br>> > =
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]<b=
r>> > (ajp--127.0.0.1-8702-1) [330ace48] FINISH, =
CreateGlusterVolumeVDSCommand,<br>> > log id:
303e70a4<br>> =
> 2015-01-12 12:50:43,780 ERROR<br>> > =
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]<br=
> > (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID:
330ace48, =
Job ID:<br>> > 896a69b3-a678-40a7-bceb-3635e4062aa0,
Call Stack: =
null, Custom Event ID:<br>> > -1, Message: Creation of Gluster =
Volume vol01 failed.<br>> > 2015-01-12 12:50:43,785
INFO<br>> =
> =
[org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]<br>> =
> (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object =
EngineLock<br>> > [exclusiveLocks=3D key: =
00000001-0001-0001-0001-000000000300 value: GLUSTER<br>> > , =
sharedLocks=3D ]<br>> ><br>> > [image:
Inline image =
2]<br>> ><br>> ><br>> > On
Sun, Jan 11, 2015 at 6:48 =
PM, Martin Pavl=C3=ADk <<a href=3D"mailto:mpavlik@redhat.com" =
target=3D"_blank">mpavlik(a)redhat.com</a>&gt;
wrote:<br>> ><br>> =
>> Hi Punit,<br>> >><br>>
>> unfortunately =
I=E2=80=99am not that good with the gluster, I was just =
following<br>> >> the obvious clue from the log. Could you try
=
on the nodes if the packages<br>> >> are even available for =
installation<br>> >><br>>
>> yum install =
gluster-swift gluster-swift-object gluster-swift-plugin<br>> =
>> gluster-swift-account<br>> >> =
gluster-swift-proxy gluster-swift-doc gluster-swift-container<br>> =
>> glusterfs-geo-replication<br>>
>><br>> =
>> if not you could try to get them in official gluster =
repo.<br>> >> <a =
href=3D"http://download.gluster.org/pub/gluster/glusterfs/LATEST/Cen...
lusterfs-epel.repo" =
target=3D"_blank">http://download.gluster.org/pub/gluster/gl...
T/CentOS/glusterfs-epel.repo</a><br>>
>><br>> >> =
HTH<br>> >><br>> >>
M.<br>> >><br>> =
>><br>> >><br>>
>><br>> >> =
On 10 Jan 2015, at 04:35, Punit Dambiwal <<a =
href=3D"mailto:hypunit@gmail.com" =
target=3D"_blank">hypunit(a)gmail.com</a>&gt;
wrote:<br>> =
>><br>> >> Hi Martin,<br>>
>><br>> =
>> I installed gluster from ovirt repo....is it require to =
install those<br>> >> packages manually ??<br>> =
>><br>> >> On Fri, Jan 9, 2015 at 7:19 PM, Martin
=
Pavl=C3=ADk <<a href=3D"mailto:mpavlik@redhat.com" =
target=3D"_blank">mpavlik(a)redhat.com</a>&gt;
wrote:<br>> =
>><br>> >>> Hi
Punit,<br>> =
>>><br>> >>> can you verify that
nodes contain =
cluster packages from the following<br>> >>>
log?<br>> =
>>><br>> >>>
Thread-14::DEBUG::2015-01-09<br>> =
>>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm =
package<br>> >>> ('gluster-swift',) not
found<br>> =
>>> Thread-14::DEBUG::2015-01-09<br>>
>>> =
18:06:28,825::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-object',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,826::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-plugin',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-account',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-proxy',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,829::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-doc',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('gluster-swift-container',) not found<br>>
>>> =
Thread-14::DEBUG::2015-01-09<br>> >>> =
18:06:28,830::caps::716::root::(_getKeyPackages) rpm package<br>> =
>>> ('glusterfs-geo-replication',) not
found<br>> =
>>><br>> >>><br>>
>>> M.<br>> =
>>><br>> >>>
On 09 Jan 2015, at 11:13, =
Punit Dambiwal <<a href=3D"mailto:hypunit@gmail.com" =
target=3D"_blank">hypunit(a)gmail.com</a>&gt;
wrote:<br>> =
>>><br>> >>>
Hi Kanagaraj,<br>> =
>>><br>> >>> Please find
the attached logs =
:-<br>> >>><br>>
>>> Engine Logs :- <a =
href=3D"http://ur1.ca/jdopt" =
target=3D"_blank">http://ur1.ca/jdopt</a><br>>
>>> VDSM Logs =
:- <a href=3D"http://ur1.ca/jdoq9" =
target=3D"_blank">http://ur1.ca/jdoq9</a><br>>
>>><br>> =
>>><br>> >>><br>>
>>> On Thu, Jan 8, =
2015 at 6:05 PM, Kanagaraj <<a href=3D"mailto:kmayilsa@redhat.com" =
target=3D"_blank">kmayilsa(a)redhat.com</a>&gt;
wrote:<br>> =
>>><br>> >>>> Do
you see any errors in the =
UI?<br>> >>>><br>>
>>>> Also please =
provide the engine.log and vdsm.log when the failure<br>> =
>>>> occured.<br>>
>>>><br>> =
>>>> Thanks,<br>>
>>>> Kanagaraj<br>> =
>>>><br>>
>>>><br>> >>>> On =
01/08/2015 02:25 PM, Punit Dambiwal wrote:<br>> =
>>>><br>> >>>> Hi
Martin,<br>> =
>>>><br>>
>>>> The steps are below =
:-<br>> >>>><br>>
>>>> 1. Step the =
ovirt engine on the one server...<br>> >>>> 2.
Installed =
centos 7 on 4 host node servers..<br>> >>>> 3. I
am using =
host node (compute+storage)....now i have added all 4<br>> =
>>>> nodes to engine...<br>>
>>>> 4. Create =
the gluster volume from GUI...<br>>
>>>><br>> =
>>>> Network :-<br>>
>>>> eth0 :- =
public network (1G)<br>> >>>>
eth1+eth2=3Dbond0=3D VM =
public network (1G)<br>> >>>> =
eth3+eth4=3Dbond1=3Dovirtmgmt+storage (10G private network)<br>> =
>>>><br>>
>>>> every hostnode has 24 =
bricks=3D24*4(distributed replicated)<br>>
>>>><br>> =
>>>> Thanks,<br>>
>>>> Punit<br>> =
>>>><br>>
>>>><br>> >>>> On =
Thu, Jan 8, 2015 at 3:20 PM, Martin Pavl=C3=ADk <<a =
href=3D"mailto:mpavlik@redhat.com" =
target=3D"_blank">mpavlik(a)redhat.com</a>&gt;<br>&gt;
>>>> =
wrote:<br>> >>>><br>>
>>>>> Hi =
Punit,<br>> >>>>><br>>
>>>>> can you =
please provide also errors from /var/log/vdsm/vdsm.log and<br>> =
>>>>> /var/log/vdsm/vdsmd.log<br>> =
>>>>><br>>
>>>>> it would be really =
helpful if you provided exact steps how to<br>>
>>>>> =
reproduce the problem.<br>>
>>>>><br>> =
>>>>> regards<br>>
>>>>><br>> =
>>>>> Martin Pavlik - rhev QE<br>> =
>>>>> > On 08 Jan 2015, at 03:06,
Punit Dambiwal =
<<a href=3D"mailto:hypunit@gmail.com" =
target=3D"_blank">hypunit(a)gmail.com</a>&gt;
wrote:<br>> =
>>>>> ><br>>
>>>>> > Hi,<br>> =
>>>>> ><br>>
>>>>> > I try to add =
gluster volume but it failed...<br>> >>>>>
=
><br>> >>>>> > Ovirt :-
3.5<br>> =
>>>>> > VDSM :-
vdsm-4.16.7-1.gitdb83943.el7<br>> =
>>>>> > KVM :- 1.5.3 -
60.el7_0.2<br>> =
>>>>> >
libvirt-1.1.1-29.el7_0.4<br>> =
>>>>> > Glusterfs :-
glusterfs-3.5.3-1.el7<br>> =
>>>>> ><br>>
>>>>> > Engine Logs =
:-<br>> >>>>> ><br>>
>>>>> > =
2015-01-08 09:57:52,569 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
2015-01-08 =
09:57:52,609 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
2015-01-08 =
09:57:55,582 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
2015-01-08 =
09:57:55,591 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
2015-01-08 =
09:57:55,596 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
2015-01-08 =
09:57:55,633 INFO<br>> >>>>> =
[org.ovirt.engine.core.bll.lock.InMemoryLockManager]<br>> =
>>>>> (DefaultQuartzScheduler_Worker-16) Failed to =
acquire lock and wait lock<br>> >>>>>
EngineLock =
[exclusiveLocks=3D key: 00000001-0001-0001-0001-000000000300<br>> =
>>>>> value: GLUSTER<br>>
>>>>> > , =
sharedLocks=3D ]<br>> >>>>> >
^C<br>> =
>>>>> ><br>>
>>>>> ><br>> =
>>>>><br>>
>>>>><br>> =
>>>><br>>
>>>><br>> >>> =
<216 09-Jan-15.jpg><217
09-Jan-15.jpg><br>> =
>>><br>> >>><br>>
>>><br>> =
>><br>> >><br>>
><br>> =
><br>><o:p></o:p></p></div></div></div><p
class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p><=
/o:p></p></div></div></div></div></div></div><p
=
class=3DMsoNormal><o:p> </o:p></p></div></div></body></html>
------=_NextPart_000_0137_01D02F61.6F1BCB10--
10:25 a.m.
Hi Donny,
I am not using gluster for the NFS mount...no volume has been created
because of those errors....
On Wed, Jan 14, 2015 at 9:47 AM, Donny Davis <donny(a)cloudspin.me> wrote:
And
rpcbind is running
can you do a regular nfs mount of the gluster volume?
gluster volume info {your volume name here}
Just gathering intel to hopefully provide a solution. I just deployed
gluster with hosted engine today, and I did get some of the same errors as
you when I was bringing everything up
Did you follow a guide, or are you craving your own?
Are you using swift for anything… that is usually for openstack to my
knowledge? I guess you could use it for ovirt, but I didn’t
Donny D
*From:* Punit Dambiwal [mailto:hypunit@gmail.com]
*Sent:* Tuesday, January 13, 2015 6:41 PM
*To:* Donny Davis
*Cc:* users(a)ovirt.org
*Subject:* Re: [ovirt-users] Failed to create volume in OVirt with gluster
Hi Donny,
No I am not using CTDB....it's totally new deployment...
On Wed, Jan 14, 2015 at 1:50 AM, Donny Davis <donny(a)cloudspin.me> wrote:
Are you using ctdb??? and did you specify Lock=False in /etc/nfsmount.conf
Can you give a full run down of topology, and has this ever been working
or is it a new deployment?
Donny D
*From:* users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] *On
Behalf Of *Punit Dambiwal
*Sent:* Monday, January 12, 2015 7:18 PM
*To:* Kanagaraj Mayilsamy
*Cc:* gluster-users(a)gluster.org; Kaushal M; users(a)ovirt.org
*Subject:* Re: [ovirt-users] Failed to create volume in OVirt with gluster
Hi,
Please find the more details on this ....can anybody from gluster will
help me here :-
Gluster CLI Logs :- /var/log/glusterfs/cli.log
[2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs: got
RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072012] T [cli-quotad-client.c:94:cli_quotad_notify]
0-glusterfs: got RPC_CLNT_CONNECT
[2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler]
0-transport: disconnecting now
[2015-01-13 02:06:23.072055] T [cli-quotad-client.c:100:cli_quotad_notify]
0-glusterfs: got RPC_CLNT_DISCONNECT
[2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record]
0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2015-01-13 02:06:23.072176] T
[rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen
128, payload: 64, rpc hdr: 64
[2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (-->
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420] (-->
/usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a4293]
(--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] (-->
/usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (-->
/usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs: connect
() called on transport already connected
[2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit]
0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers: 2,
Proc: 27) to rpc-transport (glusterfs)
[2015-01-13 02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping]
0-glusterfs: ping timeout is 0, returning
[2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init]
0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI,
ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
[2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk]
0-cli: Received response to status cmd
[2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli:
Returning 0
[2015-01-13 02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume]
0-cli: Returning: 0
[2015-01-13 02:06:23.076192] D [cli-xml-output.c:84:cli_begin_xml_output]
0-cli: Returning 0
[2015-01-13 02:06:23.076244] D
[cli-xml-output.c:131:cli_xml_output_common] 0-cli: Returning 0
[2015-01-13 02:06:23.076256] D
[cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning 0
[2015-01-13 02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output]
0-cli: Returning 0
[2015-01-13 02:06:23.076459] D
[cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning 0
[2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: 0
Command log :- /var/log/glusterfs/.cmd_log_history
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:10:35.836676] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:16:25.956514] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:17:36.977833] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:21:07.048053] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:26:57.168661] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:28:07.194428] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:34:58.350748] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:36:08.375326] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking
failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
details.
Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
details.
[2015-01-13 01:45:10.550659] : volume status all tasks : FAILED : Staging
failed on 00000000-0000-0000-0000-000000000000. Please check log file for
details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
file for details.
[2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
[2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
[2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
[2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
[2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
[2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
[2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
[2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
[2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
[2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
[2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
[2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
[2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <kmayilsa(a)redhat.com>
wrote:
I can see the failures in glusterd log.
Can someone from glusterfs dev pls help on this?
Thanks,
Kanagaraj
----- Original Message -----
> From: "Punit Dambiwal" <hypunit(a)gmail.com>
> To: "Kanagaraj" <kmayilsa(a)redhat.com>
> Cc: "Martin Pavlík" <mpavlik(a)redhat.com>, "Vijay Bellur"
<
vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
> users(a)ovirt.org, gluster-users(a)gluster.org
> Sent: Monday, January 12, 2015 3:36:43 PM
> Subject: Re: Failed to create volume in OVirt with gluster
>
> Hi Kanagaraj,
>
> Please find the logs from here :- http://ur1.ca/jeszc
>
> [image: Inline image 1]
>
> [image: Inline image 2]
>
> On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
>
> > Looks like there are some failures in gluster.
> > Can you send the log output from glusterd log file from the relevant
hosts?
> >
> > Thanks,
> > Kanagaraj
> >
> >
> > On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
> >
> > Hi,
> >
> > Is there any one from gluster can help me here :-
> >
> > Engine logs :-
> >
> > 2015-01-12 12:50:33,841 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:34,725 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:36,824 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:36,853 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:36,866 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:37,751 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:39,849 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:39,878 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:39,890 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:40,776 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:42,878 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:42,903 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:42,916 INFO
> > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock
> > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > value: GLUSTER
> > , sharedLocks= ]
> > 2015-01-12 12:50:43,771 INFO
> >
[org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
> > (ajp--127.0.0.1-8702-1) [330ace48] FINISH,
CreateGlusterVolumeVDSCommand,
> > log id: 303e70a4
> > 2015-01-12 12:50:43,780 ERROR
> > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
> > (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
> > 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event
ID:
> > -1, Message: Creation of Gluster Volume vol01 failed.
> > 2015-01-12 12:50:43,785 INFO
> > [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
> > (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
> > [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value:
GLUSTER
> > , sharedLocks= ]
> >
> > [image: Inline image 2]
> >
> >
> > On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík <mpavlik(a)redhat.com>
wrote:
> >
> >> Hi Punit,
> >>
> >> unfortunately I’am not that good with the gluster, I was just
following
> >> the obvious clue from the log. Could you try on the nodes if the
packages
> >> are even available for installation
> >>
> >> yum install gluster-swift gluster-swift-object gluster-swift-plugin
> >> gluster-swift-account
> >> gluster-swift-proxy gluster-swift-doc gluster-swift-container
> >> glusterfs-geo-replication
> >>
> >> if not you could try to get them in official gluster repo.
> >>
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
> >>
> >> HTH
> >>
> >> M.
> >>
> >>
> >>
> >>
> >> On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
> >>
> >> Hi Martin,
> >>
> >> I installed gluster from ovirt repo....is it require to install those
> >> packages manually ??
> >>
> >> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík <mpavlik(a)redhat.com>
wrote:
> >>
> >>> Hi Punit,
> >>>
> >>> can you verify that nodes contain cluster packages from the following
> >>> log?
> >>>
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-object',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-plugin',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-account',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-proxy',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-doc',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
> >>> ('gluster-swift-container',) not found
> >>> Thread-14::DEBUG::2015-01-09
> >>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
> >>> ('glusterfs-geo-replication',) not found
> >>>
> >>>
> >>> M.
> >>>
> >>> On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit(a)gmail.com>
wrote:
> >>>
> >>> Hi Kanagaraj,
> >>>
> >>> Please find the attached logs :-
> >>>
> >>> Engine Logs :- http://ur1.ca/jdopt
> >>> VDSM Logs :- http://ur1.ca/jdoq9
> >>>
> >>>
> >>>
> >>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa(a)redhat.com>
wrote:
> >>>
> >>>> Do you see any errors in the UI?
> >>>>
> >>>> Also please provide the engine.log and vdsm.log when the failure
> >>>> occured.
> >>>>
> >>>> Thanks,
> >>>> Kanagaraj
> >>>>
> >>>>
> >>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
> >>>>
> >>>> Hi Martin,
> >>>>
> >>>> The steps are below :-
> >>>>
> >>>> 1. Step the ovirt engine on the one server...
> >>>> 2. Installed centos 7 on 4 host node servers..
> >>>> 3. I am using host node (compute+storage)....now i have added all
4
> >>>> nodes to engine...
> >>>> 4. Create the gluster volume from GUI...
> >>>>
> >>>> Network :-
> >>>> eth0 :- public network (1G)
> >>>> eth1+eth2=bond0= VM public network (1G)
> >>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
> >>>>
> >>>> every hostnode has 24 bricks=24*4(distributed replicated)
> >>>>
> >>>> Thanks,
> >>>> Punit
> >>>>
> >>>>
> >>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík
<mpavlik(a)redhat.com>
> >>>> wrote:
> >>>>
> >>>>> Hi Punit,
> >>>>>
> >>>>> can you please provide also errors from /var/log/vdsm/vdsm.log
and
> >>>>> /var/log/vdsm/vdsmd.log
> >>>>>
> >>>>> it would be really helpful if you provided exact steps how to
> >>>>> reproduce the problem.
> >>>>>
> >>>>> regards
> >>>>>
> >>>>> Martin Pavlik - rhev QE
> >>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com>
wrote:
> >>>>> >
> >>>>> > Hi,
> >>>>> >
> >>>>> > I try to add gluster volume but it failed...
> >>>>> >
> >>>>> > Ovirt :- 3.5
> >>>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
> >>>>> > KVM :- 1.5.3 - 60.el7_0.2
> >>>>> > libvirt-1.1.1-29.el7_0.4
> >>>>> > Glusterfs :- glusterfs-3.5.3-1.el7
> >>>>> >
> >>>>> > Engine Logs :-
> >>>>> >
> >>>>> > 2015-01-08 09:57:52,569 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:52,609 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,582 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,591 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,596 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > 2015-01-08 09:57:55,633 INFO
> >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and
wait
lock
> >>>>> EngineLock [exclusiveLocks= key:
00000001-0001-0001-0001-000000000300
> >>>>> value: GLUSTER
> >>>>> > , sharedLocks= ]
> >>>>> > ^C
> >>>>> >
> >>>>> >
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
> >>>
> >>>
> >>>
> >>
> >>
> >
> >
>
9:58 a.m.
Hi,
Can any one help me here ??
On Wed, Jan 14, 2015 at 3:25 PM, Punit Dambiwal <hypunit(a)gmail.com> wrote:
Hi Donny,
I am not using gluster for the NFS mount...no volume has been created
because of those errors....
On Wed, Jan 14, 2015 at 9:47 AM, Donny Davis <donny(a)cloudspin.me> wrote:
> And
>
>
>
> rpcbind is running
>
>
>
> can you do a regular nfs mount of the gluster volume?
>
> gluster volume info {your volume name here}
>
>
>
>
>
> Just gathering intel to hopefully provide a solution. I just deployed
> gluster with hosted engine today, and I did get some of the same errors as
> you when I was bringing everything up
>
> Did you follow a guide, or are you craving your own?
>
> Are you using swift for anything… that is usually for openstack to my
> knowledge? I guess you could use it for ovirt, but I didn’t
>
>
>
> Donny D
>
>
>
> *From:* Punit Dambiwal [mailto:hypunit@gmail.com]
> *Sent:* Tuesday, January 13, 2015 6:41 PM
> *To:* Donny Davis
> *Cc:* users(a)ovirt.org
>
> *Subject:* Re: [ovirt-users] Failed to create volume in OVirt with
> gluster
>
>
>
> Hi Donny,
>
>
>
> No I am not using CTDB....it's totally new deployment...
>
>
>
> On Wed, Jan 14, 2015 at 1:50 AM, Donny Davis <donny(a)cloudspin.me> wrote:
>
> Are you using ctdb??? and did you specify Lock=False in /etc/nfsmount.conf
>
>
>
> Can you give a full run down of topology, and has this ever been working
> or is it a new deployment?
>
>
>
> Donny D
>
>
>
> *From:* users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] *On
> Behalf Of *Punit Dambiwal
> *Sent:* Monday, January 12, 2015 7:18 PM
> *To:* Kanagaraj Mayilsamy
> *Cc:* gluster-users(a)gluster.org; Kaushal M; users(a)ovirt.org
> *Subject:* Re: [ovirt-users] Failed to create volume in OVirt with
> gluster
>
>
>
> Hi,
>
>
>
> Please find the more details on this ....can anybody from gluster will
> help me here :-
>
>
>
>
>
> Gluster CLI Logs :- /var/log/glusterfs/cli.log
>
>
>
> [2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs:
> got RPC_CLNT_CONNECT
>
> [2015-01-13 02:06:23.072012] T [cli-quotad-client.c:94:cli_quotad_notify]
> 0-glusterfs: got RPC_CLNT_CONNECT
>
> [2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler]
> 0-transport: disconnecting now
>
> [2015-01-13 02:06:23.072055] T
> [cli-quotad-client.c:100:cli_quotad_notify] 0-glusterfs: got
> RPC_CLNT_DISCONNECT
>
> [2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record]
> 0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
>
> [2015-01-13 02:06:23.072176] T
> [rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen
> 128, payload: 64, rpc hdr: 64
>
> [2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (-->
> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420] (-->
> /usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a4293]
> (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] (-->
> /usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (-->
> /usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs: connect
> () called on transport already connected
>
> [2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit]
> 0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers: 2,
> Proc: 27) to rpc-transport (glusterfs)
>
> [2015-01-13 02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping]
> 0-glusterfs: ping timeout is 0, returning
>
> [2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init]
> 0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI,
> ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
>
> [2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk]
> 0-cli: Received response to status cmd
>
> [2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli:
> Returning 0
>
> [2015-01-13 02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume]
> 0-cli: Returning: 0
>
> [2015-01-13 02:06:23.076192] D [cli-xml-output.c:84:cli_begin_xml_output]
> 0-cli: Returning 0
>
> [2015-01-13 02:06:23.076244] D
> [cli-xml-output.c:131:cli_xml_output_common] 0-cli: Returning 0
>
> [2015-01-13 02:06:23.076256] D
> [cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning 0
>
> [2015-01-13 02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output]
> 0-cli: Returning 0
>
> [2015-01-13 02:06:23.076459] D
> [cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning 0
>
> [2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: 0
>
>
>
> Command log :- /var/log/glusterfs/.cmd_log_history
>
>
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> [2015-01-13 01:10:35.836676] : volume status all tasks : FAILED :
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> [2015-01-13 01:16:25.956514] : volume status all tasks : FAILED :
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> [2015-01-13 01:17:36.977833] : volume status all tasks : FAILED :
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> [2015-01-13 01:21:07.048053] : volume status all tasks : FAILED :
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> [2015-01-13 01:26:57.168661] : volume status all tasks : FAILED :
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> [2015-01-13 01:28:07.194428] : volume status all tasks : FAILED :
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> [2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking
> failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
>
> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
> details.
>
> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
> details.
>
> [2015-01-13 01:34:58.350748] : volume status all tasks : FAILED :
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> [2015-01-13 01:36:08.375326] : volume status all tasks : FAILED :
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> [2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking
> failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
>
> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
> details.
>
> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
> details.
>
> [2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking
> failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
>
> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
> details.
>
> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
> details.
>
> [2015-01-13 01:45:10.550659] : volume status all tasks : FAILED :
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
> file for details.
>
> [2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
>
> [2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
>
> [2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
>
> [2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
>
> [2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
>
> [2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
>
> [2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
>
> [2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
>
> [2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
>
> [2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
>
> [2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
>
> [2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
>
> [2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
>
>
>
>
>
> On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <
> kmayilsa(a)redhat.com> wrote:
>
> I can see the failures in glusterd log.
>
> Can someone from glusterfs dev pls help on this?
>
> Thanks,
> Kanagaraj
>
>
> ----- Original Message -----
> > From: "Punit Dambiwal" <hypunit(a)gmail.com>
> > To: "Kanagaraj" <kmayilsa(a)redhat.com>
> > Cc: "Martin Pavlík" <mpavlik(a)redhat.com>, "Vijay
Bellur" <
> vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
> > users(a)ovirt.org, gluster-users(a)gluster.org
> > Sent: Monday, January 12, 2015 3:36:43 PM
> > Subject: Re: Failed to create volume in OVirt with gluster
> >
> > Hi Kanagaraj,
> >
> > Please find the logs from here :- http://ur1.ca/jeszc
> >
> > [image: Inline image 1]
> >
> > [image: Inline image 2]
> >
> > On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com> wrote:
> >
> > > Looks like there are some failures in gluster.
> > > Can you send the log output from glusterd log file from the relevant
> hosts?
> > >
> > > Thanks,
> > > Kanagaraj
> > >
> > >
> > > On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
> > >
> > > Hi,
> > >
> > > Is there any one from gluster can help me here :-
> > >
> > > Engine logs :-
> > >
> > > 2015-01-12 12:50:33,841 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:34,725 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:36,824 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:36,853 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:36,866 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:37,751 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:39,849 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:39,878 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:39,890 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:40,776 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:42,878 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:42,903 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:42,916 INFO
> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
> lock
> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
> > > value: GLUSTER
> > > , sharedLocks= ]
> > > 2015-01-12 12:50:43,771 INFO
> > >
> [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
> > > (ajp--127.0.0.1-8702-1) [330ace48] FINISH,
> CreateGlusterVolumeVDSCommand,
> > > log id: 303e70a4
> > > 2015-01-12 12:50:43,780 ERROR
> > > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
> > > (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
> > > 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event
> ID:
> > > -1, Message: Creation of Gluster Volume vol01 failed.
> > > 2015-01-12 12:50:43,785 INFO
> > > [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
> > > (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
> > > [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value:
> GLUSTER
> > > , sharedLocks= ]
> > >
> > > [image: Inline image 2]
> > >
> > >
> > > On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík <mpavlik(a)redhat.com>
> wrote:
> > >
> > >> Hi Punit,
> > >>
> > >> unfortunately I’am not that good with the gluster, I was just
> following
> > >> the obvious clue from the log. Could you try on the nodes if the
> packages
> > >> are even available for installation
> > >>
> > >> yum install gluster-swift gluster-swift-object gluster-swift-plugin
> > >> gluster-swift-account
> > >> gluster-swift-proxy gluster-swift-doc gluster-swift-container
> > >> glusterfs-geo-replication
> > >>
> > >> if not you could try to get them in official gluster repo.
> > >>
> http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
> > >>
> > >> HTH
> > >>
> > >> M.
> > >>
> > >>
> > >>
> > >>
> > >> On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit(a)gmail.com>
> wrote:
> > >>
> > >> Hi Martin,
> > >>
> > >> I installed gluster from ovirt repo....is it require to install
> those
> > >> packages manually ??
> > >>
> > >> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík
<mpavlik(a)redhat.com>
> wrote:
> > >>
> > >>> Hi Punit,
> > >>>
> > >>> can you verify that nodes contain cluster packages from the
> following
> > >>> log?
> > >>>
> > >>> Thread-14::DEBUG::2015-01-09
> > >>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
> > >>> ('gluster-swift',) not found
> > >>> Thread-14::DEBUG::2015-01-09
> > >>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
> > >>> ('gluster-swift-object',) not found
> > >>> Thread-14::DEBUG::2015-01-09
> > >>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
> > >>> ('gluster-swift-plugin',) not found
> > >>> Thread-14::DEBUG::2015-01-09
> > >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> > >>> ('gluster-swift-account',) not found
> > >>> Thread-14::DEBUG::2015-01-09
> > >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> > >>> ('gluster-swift-proxy',) not found
> > >>> Thread-14::DEBUG::2015-01-09
> > >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
> > >>> ('gluster-swift-doc',) not found
> > >>> Thread-14::DEBUG::2015-01-09
> > >>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
> > >>> ('gluster-swift-container',) not found
> > >>> Thread-14::DEBUG::2015-01-09
> > >>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
> > >>> ('glusterfs-geo-replication',) not found
> > >>>
> > >>>
> > >>> M.
> > >>>
> > >>> On 09 Jan 2015, at 11:13, Punit Dambiwal
<hypunit(a)gmail.com>
> wrote:
> > >>>
> > >>> Hi Kanagaraj,
> > >>>
> > >>> Please find the attached logs :-
> > >>>
> > >>> Engine Logs :- http://ur1.ca/jdopt
> > >>> VDSM Logs :- http://ur1.ca/jdoq9
> > >>>
> > >>>
> > >>>
> > >>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj
<kmayilsa(a)redhat.com>
> wrote:
> > >>>
> > >>>> Do you see any errors in the UI?
> > >>>>
> > >>>> Also please provide the engine.log and vdsm.log when the
failure
> > >>>> occured.
> > >>>>
> > >>>> Thanks,
> > >>>> Kanagaraj
> > >>>>
> > >>>>
> > >>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
> > >>>>
> > >>>> Hi Martin,
> > >>>>
> > >>>> The steps are below :-
> > >>>>
> > >>>> 1. Step the ovirt engine on the one server...
> > >>>> 2. Installed centos 7 on 4 host node servers..
> > >>>> 3. I am using host node (compute+storage)....now i have added
all 4
> > >>>> nodes to engine...
> > >>>> 4. Create the gluster volume from GUI...
> > >>>>
> > >>>> Network :-
> > >>>> eth0 :- public network (1G)
> > >>>> eth1+eth2=bond0= VM public network (1G)
> > >>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
> > >>>>
> > >>>> every hostnode has 24 bricks=24*4(distributed replicated)
> > >>>>
> > >>>> Thanks,
> > >>>> Punit
> > >>>>
> > >>>>
> > >>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík
<mpavlik(a)redhat.com>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi Punit,
> > >>>>>
> > >>>>> can you please provide also errors from
/var/log/vdsm/vdsm.log and
> > >>>>> /var/log/vdsm/vdsmd.log
> > >>>>>
> > >>>>> it would be really helpful if you provided exact steps how
to
> > >>>>> reproduce the problem.
> > >>>>>
> > >>>>> regards
> > >>>>>
> > >>>>> Martin Pavlik - rhev QE
> > >>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com>
> wrote:
> > >>>>> >
> > >>>>> > Hi,
> > >>>>> >
> > >>>>> > I try to add gluster volume but it failed...
> > >>>>> >
> > >>>>> > Ovirt :- 3.5
> > >>>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
> > >>>>> > KVM :- 1.5.3 - 60.el7_0.2
> > >>>>> > libvirt-1.1.1-29.el7_0.4
> > >>>>> > Glusterfs :- glusterfs-3.5.3-1.el7
> > >>>>> >
> > >>>>> > Engine Logs :-
> > >>>>> >
> > >>>>> > 2015-01-08 09:57:52,569 INFO
> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock
and
> wait lock
> > >>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
> > >>>>> value: GLUSTER
> > >>>>> > , sharedLocks= ]
> > >>>>> > 2015-01-08 09:57:52,609 INFO
> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock
and
> wait lock
> > >>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
> > >>>>> value: GLUSTER
> > >>>>> > , sharedLocks= ]
> > >>>>> > 2015-01-08 09:57:55,582 INFO
> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock
and
> wait lock
> > >>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
> > >>>>> value: GLUSTER
> > >>>>> > , sharedLocks= ]
> > >>>>> > 2015-01-08 09:57:55,591 INFO
> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock
and
> wait lock
> > >>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
> > >>>>> value: GLUSTER
> > >>>>> > , sharedLocks= ]
> > >>>>> > 2015-01-08 09:57:55,596 INFO
> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock
and
> wait lock
> > >>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
> > >>>>> value: GLUSTER
> > >>>>> > , sharedLocks= ]
> > >>>>> > 2015-01-08 09:57:55,633 INFO
> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire lock
and
> wait lock
> > >>>>> EngineLock [exclusiveLocks= key:
> 00000001-0001-0001-0001-000000000300
> > >>>>> value: GLUSTER
> > >>>>> > , sharedLocks= ]
> > >>>>> > ^C
> > >>>>> >
> > >>>>> >
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
> > >>>
> > >>>
> > >>>
> > >>
> > >>
> > >
> > >
> >
>
>
>
>
>
11:20 a.m.
Hi Atin,
It seems glusterfs is not a good and stable product for storage use....i am
still facing the same issue...in the ovirt wiki it says ovirt has native
support with glusterfs but even i am tring to use it from ovirt it failed
and i am keep try to make it work from last 7 days...but still fail and no
one in the community has clue about the same....may be it's bug in the
gluster 3.6.1 but even i try with gluster 3.5.3....it same....
Hope someone from gluster help me to get rid of those errors and make it
work..
Thanks,
Punit
On Thu, Jan 15, 2015 at 2:58 PM, Punit Dambiwal <hypunit(a)gmail.com> wrote:
Hi,
Can any one help me here ??
On Wed, Jan 14, 2015 at 3:25 PM, Punit Dambiwal <hypunit(a)gmail.com> wrote:
> Hi Donny,
>
> I am not using gluster for the NFS mount...no volume has been created
> because of those errors....
>
> On Wed, Jan 14, 2015 at 9:47 AM, Donny Davis <donny(a)cloudspin.me> wrote:
>
>> And
>>
>>
>>
>> rpcbind is running
>>
>>
>>
>> can you do a regular nfs mount of the gluster volume?
>>
>> gluster volume info {your volume name here}
>>
>>
>>
>>
>>
>> Just gathering intel to hopefully provide a solution. I just deployed
>> gluster with hosted engine today, and I did get some of the same errors as
>> you when I was bringing everything up
>>
>> Did you follow a guide, or are you craving your own?
>>
>> Are you using swift for anything… that is usually for openstack to my
>> knowledge? I guess you could use it for ovirt, but I didn’t
>>
>>
>>
>> Donny D
>>
>>
>>
>> *From:* Punit Dambiwal [mailto:hypunit@gmail.com]
>> *Sent:* Tuesday, January 13, 2015 6:41 PM
>> *To:* Donny Davis
>> *Cc:* users(a)ovirt.org
>>
>> *Subject:* Re: [ovirt-users] Failed to create volume in OVirt with
>> gluster
>>
>>
>>
>> Hi Donny,
>>
>>
>>
>> No I am not using CTDB....it's totally new deployment...
>>
>>
>>
>> On Wed, Jan 14, 2015 at 1:50 AM, Donny Davis <donny(a)cloudspin.me> wrote:
>>
>> Are you using ctdb??? and did you specify Lock=False in
>> /etc/nfsmount.conf
>>
>>
>>
>> Can you give a full run down of topology, and has this ever been working
>> or is it a new deployment?
>>
>>
>>
>> Donny D
>>
>>
>>
>> *From:* users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] *On
>> Behalf Of *Punit Dambiwal
>> *Sent:* Monday, January 12, 2015 7:18 PM
>> *To:* Kanagaraj Mayilsamy
>> *Cc:* gluster-users(a)gluster.org; Kaushal M; users(a)ovirt.org
>> *Subject:* Re: [ovirt-users] Failed to create volume in OVirt with
>> gluster
>>
>>
>>
>> Hi,
>>
>>
>>
>> Please find the more details on this ....can anybody from gluster will
>> help me here :-
>>
>>
>>
>>
>>
>> Gluster CLI Logs :- /var/log/glusterfs/cli.log
>>
>>
>>
>> [2015-01-13 02:06:23.071969] T [cli.c:264:cli_rpc_notify] 0-glusterfs:
>> got RPC_CLNT_CONNECT
>>
>> [2015-01-13 02:06:23.072012] T
>> [cli-quotad-client.c:94:cli_quotad_notify] 0-glusterfs: got RPC_CLNT_CONNECT
>>
>> [2015-01-13 02:06:23.072024] I [socket.c:2344:socket_event_handler]
>> 0-transport: disconnecting now
>>
>> [2015-01-13 02:06:23.072055] T
>> [cli-quotad-client.c:100:cli_quotad_notify] 0-glusterfs: got
>> RPC_CLNT_DISCONNECT
>>
>> [2015-01-13 02:06:23.072131] T [rpc-clnt.c:1381:rpc_clnt_record]
>> 0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
>>
>> [2015-01-13 02:06:23.072176] T
>> [rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen
>> 128, payload: 64, rpc hdr: 64
>>
>> [2015-01-13 02:06:23.072572] T [socket.c:2863:socket_connect] (-->
>> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7fed02f15420] (-->
>> /usr/lib64/glusterfs/3.6.1/rpc-transport/socket.so(+0x7293)[0x7fed001a4293]
>> (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit+0x468)[0x7fed0266df98] (-->
>> /usr/sbin/gluster(cli_submit_request+0xdb)[0x40a9bb] (-->
>> /usr/sbin/gluster(cli_cmd_submit+0x8e)[0x40b7be] ))))) 0-glusterfs: connect
>> () called on transport already connected
>>
>> [2015-01-13 02:06:23.072616] T [rpc-clnt.c:1573:rpc_clnt_submit]
>> 0-rpc-clnt: submitted request (XID: 0x1 Program: Gluster CLI, ProgVers: 2,
>> Proc: 27) to rpc-transport (glusterfs)
>>
>> [2015-01-13 02:06:23.072633] D [rpc-clnt-ping.c:231:rpc_clnt_start_ping]
>> 0-glusterfs: ping timeout is 0, returning
>>
>> [2015-01-13 02:06:23.075930] T [rpc-clnt.c:660:rpc_clnt_reply_init]
>> 0-glusterfs: received rpc message (RPC XID: 0x1 Program: Gluster CLI,
>> ProgVers: 2, Proc: 27) from rpc-transport (glusterfs)
>>
>> [2015-01-13 02:06:23.075976] D [cli-rpc-ops.c:6548:gf_cli_status_cbk]
>> 0-cli: Received response to status cmd
>>
>> [2015-01-13 02:06:23.076025] D [cli-cmd.c:384:cli_cmd_submit] 0-cli:
>> Returning 0
>>
>> [2015-01-13 02:06:23.076049] D [cli-rpc-ops.c:6811:gf_cli_status_volume]
>> 0-cli: Returning: 0
>>
>> [2015-01-13 02:06:23.076192] D
>> [cli-xml-output.c:84:cli_begin_xml_output] 0-cli: Returning 0
>>
>> [2015-01-13 02:06:23.076244] D
>> [cli-xml-output.c:131:cli_xml_output_common] 0-cli: Returning 0
>>
>> [2015-01-13 02:06:23.076256] D
>> [cli-xml-output.c:1375:cli_xml_output_vol_status_begin] 0-cli: Returning 0
>>
>> [2015-01-13 02:06:23.076437] D [cli-xml-output.c:108:cli_end_xml_output]
>> 0-cli: Returning 0
>>
>> [2015-01-13 02:06:23.076459] D
>> [cli-xml-output.c:1398:cli_xml_output_vol_status_end] 0-cli: Returning 0
>>
>> [2015-01-13 02:06:23.076490] I [input.c:36:cli_batch] 0-: Exiting with: 0
>>
>>
>>
>> Command log :- /var/log/glusterfs/.cmd_log_history
>>
>>
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> [2015-01-13 01:10:35.836676] : volume status all tasks : FAILED :
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> [2015-01-13 01:16:25.956514] : volume status all tasks : FAILED :
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> [2015-01-13 01:17:36.977833] : volume status all tasks : FAILED :
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> [2015-01-13 01:21:07.048053] : volume status all tasks : FAILED :
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> [2015-01-13 01:26:57.168661] : volume status all tasks : FAILED :
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> [2015-01-13 01:28:07.194428] : volume status all tasks : FAILED :
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> [2015-01-13 01:30:27.256667] : volume status vol01 : FAILED : Locking
>> failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
>>
>> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
>> details.
>>
>> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
>> details.
>>
>> [2015-01-13 01:34:58.350748] : volume status all tasks : FAILED :
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> [2015-01-13 01:36:08.375326] : volume status all tasks : FAILED :
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> [2015-01-13 01:36:08.386470] : volume status vol01 : FAILED : Locking
>> failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
>>
>> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
>> details.
>>
>> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
>> details.
>>
>> [2015-01-13 01:42:59.524215] : volume stop vol01 : FAILED : Locking
>> failed on cpu02.zne01.hkg1.stack.com. Please check log file for details.
>>
>> Locking failed on cpu03.zne01.hkg1.stack.com. Please check log file for
>> details.
>>
>> Locking failed on cpu04.zne01.hkg1.stack.com. Please check log file for
>> details.
>>
>> [2015-01-13 01:45:10.550659] : volume status all tasks : FAILED :
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> Staging failed on 00000000-0000-0000-0000-000000000000. Please check log
>> file for details.
>>
>> [2015-01-13 01:46:10.656802] : volume status all tasks : SUCCESS
>>
>> [2015-01-13 01:51:02.796031] : volume status all tasks : SUCCESS
>>
>> [2015-01-13 01:52:02.897804] : volume status all tasks : SUCCESS
>>
>> [2015-01-13 01:55:25.841070] : system:: uuid get : SUCCESS
>>
>> [2015-01-13 01:55:26.752084] : system:: uuid get : SUCCESS
>>
>> [2015-01-13 01:55:32.499049] : system:: uuid get : SUCCESS
>>
>> [2015-01-13 01:55:38.716907] : system:: uuid get : SUCCESS
>>
>> [2015-01-13 01:56:52.905899] : volume status all tasks : SUCCESS
>>
>> [2015-01-13 01:58:53.109613] : volume status all tasks : SUCCESS
>>
>> [2015-01-13 02:03:26.769430] : system:: uuid get : SUCCESS
>>
>> [2015-01-13 02:04:22.859213] : volume status all tasks : SUCCESS
>>
>> [2015-01-13 02:05:22.970393] : volume status all tasks : SUCCESS
>>
>> [2015-01-13 02:06:23.075823] : volume status all tasks : SUCCESS
>>
>>
>>
>>
>>
>> On Mon, Jan 12, 2015 at 10:53 PM, Kanagaraj Mayilsamy <
>> kmayilsa(a)redhat.com> wrote:
>>
>> I can see the failures in glusterd log.
>>
>> Can someone from glusterfs dev pls help on this?
>>
>> Thanks,
>> Kanagaraj
>>
>>
>> ----- Original Message -----
>> > From: "Punit Dambiwal" <hypunit(a)gmail.com>
>> > To: "Kanagaraj" <kmayilsa(a)redhat.com>
>> > Cc: "Martin Pavlík" <mpavlik(a)redhat.com>, "Vijay
Bellur" <
>> vbellur(a)redhat.com>, "Kaushal M" <kshlmster(a)gmail.com>,
>> > users(a)ovirt.org, gluster-users(a)gluster.org
>> > Sent: Monday, January 12, 2015 3:36:43 PM
>> > Subject: Re: Failed to create volume in OVirt with gluster
>> >
>> > Hi Kanagaraj,
>> >
>> > Please find the logs from here :- http://ur1.ca/jeszc
>> >
>> > [image: Inline image 1]
>> >
>> > [image: Inline image 2]
>> >
>> > On Mon, Jan 12, 2015 at 1:02 PM, Kanagaraj <kmayilsa(a)redhat.com>
>> wrote:
>> >
>> > > Looks like there are some failures in gluster.
>> > > Can you send the log output from glusterd log file from the relevant
>> hosts?
>> > >
>> > > Thanks,
>> > > Kanagaraj
>> > >
>> > >
>> > > On 01/12/2015 10:24 AM, Punit Dambiwal wrote:
>> > >
>> > > Hi,
>> > >
>> > > Is there any one from gluster can help me here :-
>> > >
>> > > Engine logs :-
>> > >
>> > > 2015-01-12 12:50:33,841 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:34,725 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:36,824 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:36,853 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:36,866 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:37,751 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:39,849 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:39,878 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:39,890 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:40,776 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:42,878 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:42,903 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:42,916 INFO
>> > > [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > > (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait
>> lock
>> > > EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300
>> > > value: GLUSTER
>> > > , sharedLocks= ]
>> > > 2015-01-12 12:50:43,771 INFO
>> > >
>> [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand]
>> > > (ajp--127.0.0.1-8702-1) [330ace48] FINISH,
>> CreateGlusterVolumeVDSCommand,
>> > > log id: 303e70a4
>> > > 2015-01-12 12:50:43,780 ERROR
>> > >
>> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
>> > > (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID:
>> > > 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event
>> ID:
>> > > -1, Message: Creation of Gluster Volume vol01 failed.
>> > > 2015-01-12 12:50:43,785 INFO
>> > > [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
>> > > (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock
>> > > [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value:
>> GLUSTER
>> > > , sharedLocks= ]
>> > >
>> > > [image: Inline image 2]
>> > >
>> > >
>> > > On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>> wrote:
>> > >
>> > >> Hi Punit,
>> > >>
>> > >> unfortunately I’am not that good with the gluster, I was just
>> following
>> > >> the obvious clue from the log. Could you try on the nodes if the
>> packages
>> > >> are even available for installation
>> > >>
>> > >> yum install gluster-swift gluster-swift-object
gluster-swift-plugin
>> > >> gluster-swift-account
>> > >> gluster-swift-proxy gluster-swift-doc gluster-swift-container
>> > >> glusterfs-geo-replication
>> > >>
>> > >> if not you could try to get them in official gluster repo.
>> > >>
>>
http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs...
>> > >>
>> > >> HTH
>> > >>
>> > >> M.
>> > >>
>> > >>
>> > >>
>> > >>
>> > >> On 10 Jan 2015, at 04:35, Punit Dambiwal
<hypunit(a)gmail.com>
>> wrote:
>> > >>
>> > >> Hi Martin,
>> > >>
>> > >> I installed gluster from ovirt repo....is it require to install
>> those
>> > >> packages manually ??
>> > >>
>> > >> On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík
<mpavlik(a)redhat.com>
>> wrote:
>> > >>
>> > >>> Hi Punit,
>> > >>>
>> > >>> can you verify that nodes contain cluster packages from the
>> following
>> > >>> log?
>> > >>>
>> > >>> Thread-14::DEBUG::2015-01-09
>> > >>> 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package
>> > >>> ('gluster-swift',) not found
>> > >>> Thread-14::DEBUG::2015-01-09
>> > >>> 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package
>> > >>> ('gluster-swift-object',) not found
>> > >>> Thread-14::DEBUG::2015-01-09
>> > >>> 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package
>> > >>> ('gluster-swift-plugin',) not found
>> > >>> Thread-14::DEBUG::2015-01-09
>> > >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>> > >>> ('gluster-swift-account',) not found
>> > >>> Thread-14::DEBUG::2015-01-09
>> > >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>> > >>> ('gluster-swift-proxy',) not found
>> > >>> Thread-14::DEBUG::2015-01-09
>> > >>> 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package
>> > >>> ('gluster-swift-doc',) not found
>> > >>> Thread-14::DEBUG::2015-01-09
>> > >>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>> > >>> ('gluster-swift-container',) not found
>> > >>> Thread-14::DEBUG::2015-01-09
>> > >>> 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package
>> > >>> ('glusterfs-geo-replication',) not found
>> > >>>
>> > >>>
>> > >>> M.
>> > >>>
>> > >>> On 09 Jan 2015, at 11:13, Punit Dambiwal
<hypunit(a)gmail.com>
>> wrote:
>> > >>>
>> > >>> Hi Kanagaraj,
>> > >>>
>> > >>> Please find the attached logs :-
>> > >>>
>> > >>> Engine Logs :- http://ur1.ca/jdopt
>> > >>> VDSM Logs :- http://ur1.ca/jdoq9
>> > >>>
>> > >>>
>> > >>>
>> > >>> On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj
<kmayilsa(a)redhat.com>
>> wrote:
>> > >>>
>> > >>>> Do you see any errors in the UI?
>> > >>>>
>> > >>>> Also please provide the engine.log and vdsm.log when the
failure
>> > >>>> occured.
>> > >>>>
>> > >>>> Thanks,
>> > >>>> Kanagaraj
>> > >>>>
>> > >>>>
>> > >>>> On 01/08/2015 02:25 PM, Punit Dambiwal wrote:
>> > >>>>
>> > >>>> Hi Martin,
>> > >>>>
>> > >>>> The steps are below :-
>> > >>>>
>> > >>>> 1. Step the ovirt engine on the one server...
>> > >>>> 2. Installed centos 7 on 4 host node servers..
>> > >>>> 3. I am using host node (compute+storage)....now i have
added all
>> 4
>> > >>>> nodes to engine...
>> > >>>> 4. Create the gluster volume from GUI...
>> > >>>>
>> > >>>> Network :-
>> > >>>> eth0 :- public network (1G)
>> > >>>> eth1+eth2=bond0= VM public network (1G)
>> > >>>> eth3+eth4=bond1=ovirtmgmt+storage (10G private network)
>> > >>>>
>> > >>>> every hostnode has 24 bricks=24*4(distributed replicated)
>> > >>>>
>> > >>>> Thanks,
>> > >>>> Punit
>> > >>>>
>> > >>>>
>> > >>>> On Thu, Jan 8, 2015 at 3:20 PM, Martin Pavlík
<mpavlik(a)redhat.com
>> >
>> > >>>> wrote:
>> > >>>>
>> > >>>>> Hi Punit,
>> > >>>>>
>> > >>>>> can you please provide also errors from
/var/log/vdsm/vdsm.log
>> and
>> > >>>>> /var/log/vdsm/vdsmd.log
>> > >>>>>
>> > >>>>> it would be really helpful if you provided exact steps
how to
>> > >>>>> reproduce the problem.
>> > >>>>>
>> > >>>>> regards
>> > >>>>>
>> > >>>>> Martin Pavlik - rhev QE
>> > >>>>> > On 08 Jan 2015, at 03:06, Punit Dambiwal
<hypunit(a)gmail.com>
>> wrote:
>> > >>>>> >
>> > >>>>> > Hi,
>> > >>>>> >
>> > >>>>> > I try to add gluster volume but it failed...
>> > >>>>> >
>> > >>>>> > Ovirt :- 3.5
>> > >>>>> > VDSM :- vdsm-4.16.7-1.gitdb83943.el7
>> > >>>>> > KVM :- 1.5.3 - 60.el7_0.2
>> > >>>>> > libvirt-1.1.1-29.el7_0.4
>> > >>>>> > Glusterfs :- glusterfs-3.5.3-1.el7
>> > >>>>> >
>> > >>>>> > Engine Logs :-
>> > >>>>> >
>> > >>>>> > 2015-01-08 09:57:52,569 INFO
>> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and
>> wait lock
>> > >>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>> > >>>>> value: GLUSTER
>> > >>>>> > , sharedLocks= ]
>> > >>>>> > 2015-01-08 09:57:52,609 INFO
>> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and
>> wait lock
>> > >>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>> > >>>>> value: GLUSTER
>> > >>>>> > , sharedLocks= ]
>> > >>>>> > 2015-01-08 09:57:55,582 INFO
>> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and
>> wait lock
>> > >>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>> > >>>>> value: GLUSTER
>> > >>>>> > , sharedLocks= ]
>> > >>>>> > 2015-01-08 09:57:55,591 INFO
>> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and
>> wait lock
>> > >>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>> > >>>>> value: GLUSTER
>> > >>>>> > , sharedLocks= ]
>> > >>>>> > 2015-01-08 09:57:55,596 INFO
>> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and
>> wait lock
>> > >>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>> > >>>>> value: GLUSTER
>> > >>>>> > , sharedLocks= ]
>> > >>>>> > 2015-01-08 09:57:55,633 INFO
>> > >>>>> [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
>> > >>>>> (DefaultQuartzScheduler_Worker-16) Failed to acquire
lock and
>> wait lock
>> > >>>>> EngineLock [exclusiveLocks= key:
>> 00000001-0001-0001-0001-000000000300
>> > >>>>> value: GLUSTER
>> > >>>>> > , sharedLocks= ]
>> > >>>>> > ^C
>> > >>>>> >
>> > >>>>> >
>> > >>>>>
>> > >>>>>
>> > >>>>
>> > >>>>
>> > >>> <216 09-Jan-15.jpg><217 09-Jan-15.jpg>
>> > >>>
>> > >>>
>> > >>>
>> > >>
>> > >>
>> > >
>> > >
>> >
>>
>>
>>
>>
>>
>
>
3438
days inactive
3445
days old
23 comments
6 participants
participants (6)
-
Atin Mukherjee -
Donny Davis -
Kanagaraj -
Kanagaraj Mayilsamy
-
Martin Pavlík -
Punit Dambiwal