8:23 p.m.
Hello,
I have one cluster with two hosts with power management correctly
configured and one virtual machine with HostedEngine over shared
storage with FiberChannel.
When i shutdown the network of host with HostedEngine VM, it should be
possible the HostedEngine VM migrate automatically to another host?
What is the expected behaviour on this HA scenario?
Regards,
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
2:22 p.m.
On 12 August 2016 at 20:23, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
Hello,
I have one cluster with two hosts with power management correctly
configured and one virtual machine with HostedEngine over shared
storage with FiberChannel.
When i shutdown the network of host with HostedEngine VM, it should be
possible the HostedEngine VM migrate automatically to another host?
migrate on which network?
What is the expected behaviour on this HA scenario?
After a few minutes your vm will be shutdown by the High Availability
agent, as it can't see network, and started on another host.
Regards,
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
1:53 p.m.
On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
On 12 August 2016 at 20:23, Carlos Rodrigues <cmar(a)eurotux.com>
wrote:
> Hello,
>
> I have one cluster with two hosts with power management correctly
> configured and one virtual machine with HostedEngine over shared
> storage with FiberChannel.
>
> When i shutdown the network of host with HostedEngine VM, it
> should be
> possible the HostedEngine VM migrate automatically to another host?
>
migrate on which network?
> What is the expected behaviour on this HA scenario?
After a few minutes your vm will be shutdown by the High Availability
agent, as it can't see network, and started on another host.
I'm testing this scenario and after shutdown network, it should be
expected that agent shutdown ha and started on another host, but after
couple minutes nothing happens and on host with network we getting the
following messages:
Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-agent[2779]:
ovirt-ha-agent
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR
Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf
I think the HA agent its trying to get vm configuration but some how it
can't get vm.conf to start VM.
Regards,
Carlos Rodrigues
>
> Regards,
>
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
12:06 p.m.
Anyone can help me to build HA on HostedEngine VM?
How can i guarantee that if host with HostedEngine VM goes down, the
HostedEngine VM moves to another host?
Regards,
Carlos Rodrigues
On Tue, 2016-08-16 at 11:53 +0100, Carlos Rodrigues wrote:
On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
>
>
>
> On 12 August 2016 at 20:23, Carlos Rodrigues <cmar(a)eurotux.com>
> wrote:
> >
> > Hello,
> >
> > I have one cluster with two hosts with power management correctly
> > configured and one virtual machine with HostedEngine over shared
> > storage with FiberChannel.
> >
> > When i shutdown the network of host with HostedEngine VM, it
> > should be
> > possible the HostedEngine VM migrate automatically to another
> > host?
> >
> migrate on which network?
>
> >
> > What is the expected behaviour on this HA scenario?
>
> After a few minutes your vm will be shutdown by the High
> Availability
> agent, as it can't see network, and started on another host.
I'm testing this scenario and after shutdown network, it should be
expected that agent shutdown ha and started on another host, but
after
couple minutes nothing happens and on host with network we getting
the
following messages:
Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-
agent[2779]:
ovirt-ha-agent
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR
Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf
I think the HA agent its trying to get vm configuration but some how
it
can't get vm.conf to start VM.
Regards,
Carlos Rodrigues
>
> >
> >
> > Regards,
> >
> > --
> > Carlos Rodrigues
> >
> > Engenheiro de Software Sénior
> >
> > Eurotux Informática, S.A. | www.eurotux.com
> > (t) +351 253 680 300 (m) +351 911 926 110
> >
> > _______________________________________________
> > Users mailing list
> > Users(a)ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/users
> >
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
4:59 p.m.
Hi Carlos,
If you're using shared storage across the nodes/hypervisors, the
HostedEngine VM should already be HA.
Sometimes this allows the engine to drop while restarting it on another
node. Usually when this happens the rest of the nodes running VMs stay
up, and things resync when the downed node comes back.
IE the only one to lose pings is the Hosted-Engine. Unless ofcourse
there were VM's on the same node, in which case, if they were HA VMs
they will be restarted/resumed depending on your settings.
Thanks,
Hanson
On 08/17/2016 05:06 AM, Carlos Rodrigues wrote:
Anyone can help me to build HA on HostedEngine VM?
How can i guarantee that if host with HostedEngine VM goes down, the
HostedEngine VM moves to another host?
Regards,
Carlos Rodrigues
On Tue, 2016-08-16 at 11:53 +0100, Carlos Rodrigues wrote:
> On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
>>
>>
>> On 12 August 2016 at 20:23, Carlos Rodrigues <cmar(a)eurotux.com>
>> wrote:
>>> Hello,
>>>
>>> I have one cluster with two hosts with power management correctly
>>> configured and one virtual machine with HostedEngine over shared
>>> storage with FiberChannel.
>>>
>>> When i shutdown the network of host with HostedEngine VM, it
>>> should be
>>> possible the HostedEngine VM migrate automatically to another
>>> host?
>>>
>> migrate on which network?
>>
>>> What is the expected behaviour on this HA scenario?
>> After a few minutes your vm will be shutdown by the High
>> Availability
>> agent, as it can't see network, and started on another host.
>
> I'm testing this scenario and after shutdown network, it should be
> expected that agent shutdown ha and started on another host, but
> after
> couple minutes nothing happens and on host with network we getting
> the
> following messages:
>
> Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-
> agent[2779]:
> ovirt-ha-agent
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR
> Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf
>
> I think the HA agent its trying to get vm configuration but some how
> it
> can't get vm.conf to start VM.
>
> Regards,
> Carlos Rodrigues
>
>
>>>
>>> Regards,
>>>
>>> --
>>> Carlos Rodrigues
>>>
>>> Engenheiro de Software Sénior
>>>
>>> Eurotux Informática, S.A. | www.eurotux.com
>>> (t) +351 253 680 300 (m) +351 911 926 110
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users(a)ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/users
>>>
9:54 a.m.
On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
>
>
> On 12 August 2016 at 20:23, Carlos Rodrigues <cmar(a)eurotux.com>
> wrote:
> > Hello,
> >
> > I have one cluster with two hosts with power management correctly
> > configured and one virtual machine with HostedEngine over shared
> > storage with FiberChannel.
> >
> > When i shutdown the network of host with HostedEngine VM, it
> > should be
> > possible the HostedEngine VM migrate automatically to another host?
> >
> migrate on which network?
>
> > What is the expected behaviour on this HA scenario?
>
> After a few minutes your vm will be shutdown by the High Availability
> agent, as it can't see network, and started on another host.
I'm testing this scenario and after shutdown network, it should be
expected that agent shutdown ha and started on another host, but after
couple minutes nothing happens and on host with network we getting the
following messages:
Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-agent[2779]:
ovirt-ha-agent
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR
Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf
I think the HA agent its trying to get vm configuration but some how it
can't get vm.conf to start VM.
No, this is a different issues.
In 3.6 we added a feature to let the engine manage also the engine VM
itself; ovirt-ha-agent will pickup the latest engine VM configuration
from the OVF_STORE which is managed by the engine.
If something goes wrong, ovirt-ha-agent could fallback to the initial
(bootstrap time) vm.conf. This will normally happen till you add your
first regular storage domain and the engine imports the engine VM.
Regards,
Carlos Rodrigues
> >
> > Regards,
> >
> > --
> > Carlos Rodrigues
> >
> > Engenheiro de Software Sénior
> >
> > Eurotux Informática, S.A. | www.eurotux.com
> > (t) +351 253 680 300 (m) +351 911 926 110
> >
> > _______________________________________________
> > Users mailing list
> > Users(a)ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/users
> >
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
11:22 a.m.
On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote:
On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues
<cmar(a)eurotux.com>
wrote:
>
> On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
> >
> >
> >
> > On 12 August 2016 at 20:23, Carlos Rodrigues <cmar(a)eurotux.com>
> > wrote:
> > >
> > > Hello,
> > >
> > > I have one cluster with two hosts with power management
> > > correctly
> > > configured and one virtual machine with HostedEngine over
> > > shared
> > > storage with FiberChannel.
> > >
> > > When i shutdown the network of host with HostedEngine VM, it
> > > should be
> > > possible the HostedEngine VM migrate automatically to another
> > > host?
> > >
> > migrate on which network?
> >
> > >
> > > What is the expected behaviour on this HA scenario?
> >
> > After a few minutes your vm will be shutdown by the High
> > Availability
> > agent, as it can't see network, and started on another host.
>
>
> I'm testing this scenario and after shutdown network, it should be
> expected that agent shutdown ha and started on another host, but
> after
> couple minutes nothing happens and on host with network we getting
> the
> following messages:
>
> Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-
> agent[2779]:
> ovirt-ha-agent
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config
> ERROR
> Unable to get vm.conf from OVF_STORE, falling back to initial
> vm.conf
>
> I think the HA agent its trying to get vm configuration but some
> how it
> can't get vm.conf to start VM.
No, this is a different issues.
In 3.6 we added a feature to let the engine manage also the engine VM
itself; ovirt-ha-agent will pickup the latest engine VM configuration
from the OVF_STORE which is managed by the engine.
If something goes wrong, ovirt-ha-agent could fallback to the initial
(bootstrap time) vm.conf. This will normally happen till you add your
first regular storage domain and the engine imports the engine VM.
But i already have my first storage domain and storage engine domain
and already imported engine VM.
I'm using 4.0 version.
>
> Regards,
> Carlos Rodrigues
>
>
> >
> > >
> > >
> > > Regards,
> > >
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> > >
> > > _______________________________________________
> > > Users mailing list
> > > Users(a)ovirt.org
> > > http://lists.ovirt.org/mailman/listinfo/users
> > >
> >
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
11:27 a.m.
On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote:
> On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues <cmar(a)eurotux.com>
> wrote:
> >
> > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
> > >
> > >
> > >
> > > On 12 August 2016 at 20:23, Carlos Rodrigues <cmar(a)eurotux.com>
> > > wrote:
> > > >
> > > > Hello,
> > > >
> > > > I have one cluster with two hosts with power management
> > > > correctly
> > > > configured and one virtual machine with HostedEngine over
> > > > shared
> > > > storage with FiberChannel.
> > > >
> > > > When i shutdown the network of host with HostedEngine VM, it
> > > > should be
> > > > possible the HostedEngine VM migrate automatically to another
> > > > host?
> > > >
> > > migrate on which network?
> > >
> > > >
> > > > What is the expected behaviour on this HA scenario?
> > >
> > > After a few minutes your vm will be shutdown by the High
> > > Availability
> > > agent, as it can't see network, and started on another host.
> >
> >
> > I'm testing this scenario and after shutdown network, it should be
> > expected that agent shutdown ha and started on another host, but
> > after
> > couple minutes nothing happens and on host with network we getting
> > the
> > following messages:
> >
> > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-
> > agent[2779]:
> > ovirt-ha-agent
> > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config
> > ERROR
> > Unable to get vm.conf from OVF_STORE, falling back to initial
> > vm.conf
> >
> > I think the HA agent its trying to get vm configuration but some
> > how it
> > can't get vm.conf to start VM.
>
> No, this is a different issues.
> In 3.6 we added a feature to let the engine manage also the engine VM
> itself; ovirt-ha-agent will pickup the latest engine VM configuration
> from the OVF_STORE which is managed by the engine.
> If something goes wrong, ovirt-ha-agent could fallback to the initial
> (bootstrap time) vm.conf. This will normally happen till you add your
> first regular storage domain and the engine imports the engine VM.
But i already have my first storage domain and storage engine domain
and already imported engine VM.
I'm using 4.0 version.
This seams an issue, can you please share your
/var/log/ovirt-hosted-engine-ha/agent.log ?
> > Regards,
> > Carlos Rodrigues
> >
> >
> > >
> > > >
> > > >
> > > > Regards,
> > > >
> > > > --
> > > > Carlos Rodrigues
> > > >
> > > > Engenheiro de Software Sénior
> > > >
> > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > >
> > > > _______________________________________________
> > > > Users mailing list
> > > > Users(a)ovirt.org
> > > > http://lists.ovirt.org/mailman/listinfo/users
> > > >
> > >
> > --
> > Carlos Rodrigues
> >
> > Engenheiro de Software Sénior
> >
> > Eurotux Informática, S.A. | www.eurotux.com
> > (t) +351 253 680 300 (m) +351 911 926 110
> >
> > _______________________________________________
> > Users mailing list
> > Users(a)ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/users
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
11:36 a.m.
On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues
<cmar(a)eurotux.com>
wrote:
>
> On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote:
> >
> > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues <cmar@eurotux.
> > com>
> > wrote:
> > >
> > >
> > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
> > > >
> > > >
> > > >
> > > >
> > > > On 12 August 2016 at 20:23, Carlos Rodrigues <cmar(a)eurotux.co
> > > > m>
> > > > wrote:
> > > > >
> > > > >
> > > > > Hello,
> > > > >
> > > > > I have one cluster with two hosts with power management
> > > > > correctly
> > > > > configured and one virtual machine with HostedEngine over
> > > > > shared
> > > > > storage with FiberChannel.
> > > > >
> > > > > When i shutdown the network of host with HostedEngine
> > > > > VM, it
> > > > > should be
> > > > > possible the HostedEngine VM migrate automatically to
> > > > > another
> > > > > host?
> > > > >
> > > > migrate on which network?
> > > >
> > > > >
> > > > >
> > > > > What is the expected behaviour on this HA scenario?
> > > >
> > > > After a few minutes your vm will be shutdown by the High
> > > > Availability
> > > > agent, as it can't see network, and started on another host.
> > >
> > >
> > > I'm testing this scenario and after shutdown network, it should
> > > be
> > > expected that agent shutdown ha and started on another host,
> > > but
> > > after
> > > couple minutes nothing happens and on host with network we
> > > getting
> > > the
> > > following messages:
> > >
> > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-
> > > agent[2779]:
> > > ovirt-ha-agent
> > > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config
> > > ERROR
> > > Unable to get vm.conf from OVF_STORE, falling back to initial
> > > vm.conf
> > >
> > > I think the HA agent its trying to get vm configuration but
> > > some
> > > how it
> > > can't get vm.conf to start VM.
> >
> > No, this is a different issues.
> > In 3.6 we added a feature to let the engine manage also the
> > engine VM
> > itself; ovirt-ha-agent will pickup the latest engine VM
> > configuration
> > from the OVF_STORE which is managed by the engine.
> > If something goes wrong, ovirt-ha-agent could fallback to the
> > initial
> > (bootstrap time) vm.conf. This will normally happen till you add
> > your
> > first regular storage domain and the engine imports the engine
> > VM.
>
> But i already have my first storage domain and storage engine
> domain
> and already imported engine VM.
>
> I'm using 4.0 version.
This seams an issue, can you please share your
/var/log/ovirt-hosted-engine-ha/agent.log ?
I sent it in attachment.
>
> >
> > >
> > > Regards,
> > > Carlos Rodrigues
> > >
> > >
> > > >
> > > >
> > > > >
> > > > >
> > > > >
> > > > > Regards,
> > > > >
> > > > > --
> > > > > Carlos Rodrigues
> > > > >
> > > > > Engenheiro de Software Sénior
> > > > >
> > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > >
> > > > > _______________________________________________
> > > > > Users mailing list
> > > > > Users(a)ovirt.org
> > > > > http://lists.ovirt.org/mailman/listinfo/users
> > > > >
> > > >
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> > >
> > > _______________________________________________
> > > Users mailing list
> > > Users(a)ovirt.org
> > > http://lists.ovirt.org/mailman/listinfo/users
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
12:04 p.m.
On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote:
> On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues <cmar(a)eurotux.com>
> wrote:
> >
> > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote:
> > >
> > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues <cmar@eurotux.
> > > com>
> > > wrote:
> > > >
> > > >
> > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On 12 August 2016 at 20:23, Carlos Rodrigues <cmar(a)eurotux.co
> > > > > m>
> > > > > wrote:
> > > > > >
> > > > > >
> > > > > > Hello,
> > > > > >
> > > > > > I have one cluster with two hosts with power management
> > > > > > correctly
> > > > > > configured and one virtual machine with HostedEngine over
> > > > > > shared
> > > > > > storage with FiberChannel.
> > > > > >
> > > > > > When i shutdown the network of host with HostedEngine
> > > > > > VM, it
> > > > > > should be
> > > > > > possible the HostedEngine VM migrate automatically to
> > > > > > another
> > > > > > host?
> > > > > >
> > > > > migrate on which network?
> > > > >
> > > > > >
> > > > > >
> > > > > > What is the expected behaviour on this HA scenario?
> > > > >
> > > > > After a few minutes your vm will be shutdown by the High
> > > > > Availability
> > > > > agent, as it can't see network, and started on another host.
> > > >
> > > >
> > > > I'm testing this scenario and after shutdown network, it should
> > > > be
> > > > expected that agent shutdown ha and started on another host,
> > > > but
> > > > after
> > > > couple minutes nothing happens and on host with network we
> > > > getting
> > > > the
> > > > following messages:
> > > >
> > > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-
> > > > agent[2779]:
> > > > ovirt-ha-agent
> > > > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config
> > > > ERROR
> > > > Unable to get vm.conf from OVF_STORE, falling back to initial
> > > > vm.conf
> > > >
> > > > I think the HA agent its trying to get vm configuration but
> > > > some
> > > > how it
> > > > can't get vm.conf to start VM.
> > >
> > > No, this is a different issues.
> > > In 3.6 we added a feature to let the engine manage also the
> > > engine VM
> > > itself; ovirt-ha-agent will pickup the latest engine VM
> > > configuration
> > > from the OVF_STORE which is managed by the engine.
> > > If something goes wrong, ovirt-ha-agent could fallback to the
> > > initial
> > > (bootstrap time) vm.conf. This will normally happen till you add
> > > your
> > > first regular storage domain and the engine imports the engine
> > > VM.
> >
> > But i already have my first storage domain and storage engine
> > domain
> > and already imported engine VM.
> >
> > I'm using 4.0 version.
>
> This seams an issue, can you please share your
> /var/log/ovirt-hosted-engine-ha/agent.log ?
>
I sent it in attachment.
Nothing strange here;
do you see a couple of disks with alias OVF_STORE on the hosted-engine
storage domain if you check it from the engine?
> > >
> > > >
> > > > Regards,
> > > > Carlos Rodrigues
> > > >
> > > >
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > >
> > > > > > --
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > Engenheiro de Software Sénior
> > > > > >
> > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > >
> > > > > > _______________________________________________
> > > > > > Users mailing list
> > > > > > Users(a)ovirt.org
> > > > > > http://lists.ovirt.org/mailman/listinfo/users
> > > > > >
> > > > >
> > > > --
> > > > Carlos Rodrigues
> > > >
> > > > Engenheiro de Software Sénior
> > > >
> > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > >
> > > > _______________________________________________
> > > > Users mailing list
> > > > Users(a)ovirt.org
> > > > http://lists.ovirt.org/mailman/listinfo/users
> > --
> > Carlos Rodrigues
> >
> > Engenheiro de Software Sénior
> >
> > Eurotux Informática, S.A. | www.eurotux.com
> > (t) +351 253 680 300 (m) +351 911 926 110
> >
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
12:25 p.m.
On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues
<cmar(a)eurotux.com>
wrote:
>
> On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote:
> >
> > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues <cmar@eurotux.
> > com>
> > wrote:
> > >
> > >
> > > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote:
> > > >
> > > >
> > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues <cmar@euro
> > > > tux.
> > > > com>
> > > > wrote:
> > > > >
> > > > >
> > > > >
> > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On 12 August 2016 at 20:23, Carlos Rodrigues
<cmar@eurotu
> > > > > > x.co
> > > > > > m>
> > > > > > wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Hello,
> > > > > > >
> > > > > > > I have one cluster with two hosts with power
management
> > > > > > > correctly
> > > > > > > configured and one virtual machine with HostedEngine
> > > > > > > over
> > > > > > > shared
> > > > > > > storage with FiberChannel.
> > > > > > >
> > > > > > > When i shutdown the network of host with HostedEngine
> > > > > > > VM, it
> > > > > > > should be
> > > > > > > possible the HostedEngine VM migrate automatically to
> > > > > > > another
> > > > > > > host?
> > > > > > >
> > > > > > migrate on which network?
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > What is the expected behaviour on this HA scenario?
> > > > > >
> > > > > > After a few minutes your vm will be shutdown by the High
> > > > > > Availability
> > > > > > agent, as it can't see network, and started on another
> > > > > > host.
> > > > >
> > > > >
> > > > > I'm testing this scenario and after shutdown network, it
> > > > > should
> > > > > be
> > > > > expected that agent shutdown ha and started on another
> > > > > host,
> > > > > but
> > > > > after
> > > > > couple minutes nothing happens and on host with network we
> > > > > getting
> > > > > the
> > > > > following messages:
> > > > >
> > > > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-
> > > > > agent[2779]:
> > > > > ovirt-ha-agent
> > > > > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.con
> > > > > fig
> > > > > ERROR
> > > > > Unable to get vm.conf from OVF_STORE, falling back to
> > > > > initial
> > > > > vm.conf
> > > > >
> > > > > I think the HA agent its trying to get vm configuration but
> > > > > some
> > > > > how it
> > > > > can't get vm.conf to start VM.
> > > >
> > > > No, this is a different issues.
> > > > In 3.6 we added a feature to let the engine manage also the
> > > > engine VM
> > > > itself; ovirt-ha-agent will pickup the latest engine VM
> > > > configuration
> > > > from the OVF_STORE which is managed by the engine.
> > > > If something goes wrong, ovirt-ha-agent could fallback to the
> > > > initial
> > > > (bootstrap time) vm.conf. This will normally happen till you
> > > > add
> > > > your
> > > > first regular storage domain and the engine imports the
> > > > engine
> > > > VM.
> > >
> > > But i already have my first storage domain and storage engine
> > > domain
> > > and already imported engine VM.
> > >
> > > I'm using 4.0 version.
> >
> > This seams an issue, can you please share your
> > /var/log/ovirt-hosted-engine-ha/agent.log ?
> >
>
> I sent it in attachment.
Nothing strange here;
do you see a couple of disks with alias OVF_STORE on the hosted-
engine
storage domain if you check it from the engine?
Do you mean any disk label?
I don't have it anyone:
[root@ied-blade11 ~]# ls /dev/disk/by-label/
ls: cannot access /dev/disk/by-label/: No such file or directory
>
> >
> > >
> > > >
> > > >
> > > > >
> > > > >
> > > > > Regards,
> > > > > Carlos Rodrigues
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Regards,
> > > > > > >
> > > > > > > --
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > > Engenheiro de Software Sénior
> > > > > > >
> > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > >
> > > > > > > _______________________________________________
> > > > > > > Users mailing list
> > > > > > > Users(a)ovirt.org
> > > > > > > http://lists.ovirt.org/mailman/listinfo/users
> > > > > > >
> > > > > >
> > > > > --
> > > > > Carlos Rodrigues
> > > > >
> > > > > Engenheiro de Software Sénior
> > > > >
> > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > >
> > > > > _______________________________________________
> > > > > Users mailing list
> > > > > Users(a)ovirt.org
> > > > > http://lists.ovirt.org/mailman/listinfo/users
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> > >
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
12:42 p.m.
On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote:
> On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues <cmar(a)eurotux.com>
> wrote:
> >
> > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote:
> > >
> > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues <cmar@eurotux.
> > > com>
> > > wrote:
> > > >
> > > >
> > > > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote:
> > > > >
> > > > >
> > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues <cmar@euro
> > > > > tux.
> > > > > com>
> > > > > wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On 12 August 2016 at 20:23, Carlos Rodrigues
<cmar@eurotu
> > > > > > > x.co
> > > > > > > m>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Hello,
> > > > > > > >
> > > > > > > > I have one cluster with two hosts with power
management
> > > > > > > > correctly
> > > > > > > > configured and one virtual machine with
HostedEngine
> > > > > > > > over
> > > > > > > > shared
> > > > > > > > storage with FiberChannel.
> > > > > > > >
> > > > > > > > When i shutdown the network of host with
HostedEngine
> > > > > > > > VM, it
> > > > > > > > should be
> > > > > > > > possible the HostedEngine VM migrate automatically
to
> > > > > > > > another
> > > > > > > > host?
> > > > > > > >
> > > > > > > migrate on which network?
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > What is the expected behaviour on this HA
scenario?
> > > > > > >
> > > > > > > After a few minutes your vm will be shutdown by the
High
> > > > > > > Availability
> > > > > > > agent, as it can't see network, and started on
another
> > > > > > > host.
> > > > > >
> > > > > >
> > > > > > I'm testing this scenario and after shutdown network,
it
> > > > > > should
> > > > > > be
> > > > > > expected that agent shutdown ha and started on another
> > > > > > host,
> > > > > > but
> > > > > > after
> > > > > > couple minutes nothing happens and on host with network we
> > > > > > getting
> > > > > > the
> > > > > > following messages:
> > > > > >
> > > > > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-
> > > > > > agent[2779]:
> > > > > > ovirt-ha-agent
> > > > > > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.con
> > > > > > fig
> > > > > > ERROR
> > > > > > Unable to get vm.conf from OVF_STORE, falling back to
> > > > > > initial
> > > > > > vm.conf
> > > > > >
> > > > > > I think the HA agent its trying to get vm configuration but
> > > > > > some
> > > > > > how it
> > > > > > can't get vm.conf to start VM.
> > > > >
> > > > > No, this is a different issues.
> > > > > In 3.6 we added a feature to let the engine manage also the
> > > > > engine VM
> > > > > itself; ovirt-ha-agent will pickup the latest engine VM
> > > > > configuration
> > > > > from the OVF_STORE which is managed by the engine.
> > > > > If something goes wrong, ovirt-ha-agent could fallback to the
> > > > > initial
> > > > > (bootstrap time) vm.conf. This will normally happen till you
> > > > > add
> > > > > your
> > > > > first regular storage domain and the engine imports the
> > > > > engine
> > > > > VM.
> > > >
> > > > But i already have my first storage domain and storage engine
> > > > domain
> > > > and already imported engine VM.
> > > >
> > > > I'm using 4.0 version.
> > >
> > > This seams an issue, can you please share your
> > > /var/log/ovirt-hosted-engine-ha/agent.log ?
> > >
> >
> > I sent it in attachment.
>
> Nothing strange here;
> do you see a couple of disks with alias OVF_STORE on the hosted-
> engine
> storage domain if you check it from the engine?
>
Do you mean any disk label?
I don't have it anyone:
[root@ied-blade11 ~]# ls /dev/disk/by-label/
ls: cannot access /dev/disk/by-label/: No such file or directory
No I mean: go to the engine web-ui, select the hosted-engine storage
domain, check the disks there.
> > > > > > Regards,
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > >
> > > > > > > > --
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > Engenheiro de Software Sénior
> > > > > > > >
> > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > >
> > > > > > > > _______________________________________________
> > > > > > > > Users mailing list
> > > > > > > > Users(a)ovirt.org
> > > > > > > > http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > >
> > > > > > >
> > > > > > --
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > Engenheiro de Software Sénior
> > > > > >
> > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > >
> > > > > > _______________________________________________
> > > > > > Users mailing list
> > > > > > Users(a)ovirt.org
> > > > > > http://lists.ovirt.org/mailman/listinfo/users
> > > > --
> > > > Carlos Rodrigues
> > > >
> > > > Engenheiro de Software Sénior
> > > >
> > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > >
> > --
> > Carlos Rodrigues
> >
> > Engenheiro de Software Sénior
> >
> > Eurotux Informática, S.A. | www.eurotux.com
> > (t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
12:50 p.m.
--=-mZqFwwB7NvS3OE0tdKkP
Content-Type: multipart/alternative; boundary="=-RZOPZm+KrtAoAmdrmH24"
--=-RZOPZm+KrtAoAmdrmH24
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote:
> > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues
<cmar(a)eurotux.com>
wrote:
>
> On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote:
> >
> > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues
<cmar(a)eurotux.com>
> > wrote:
> > >
> > >
> > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote:
> > > >
> > > >
> > > > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos
Rodrigues
<cmar@eurotux.
> > > > com>
> > > > wrote:
> > > > >
> > > > >
> > > > >
> > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > > > > > > > > > On Tue, Aug 16, 2016 at
12:53 PM, Carlos Rodrigues
<cmar@euro
> > > > > > tux.
> > > > > > com>
> > > > > > wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > On
12 August 2016 at 20:23, Carlos Rodrigues
<cmar@eurotu
> > > > > > > > x.co
> > > > > > > > m>
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Hello,
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> I have one cluster with two hosts with power
management
> > > > > > > > > correctly
> > > > > > > > > > > > > > > > > >
> configured and one virtual machine with
HostedEngine
> > > > > > > > > over
> > > > > > > > > shared
> > > > > > > > > storage with FiberChannel.
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> When i shutdown the network of host with
HostedEngine
> > > > > > > > > VM, it
> > > > > > > > > should be
> > > > > > > > > > > > > > > > > >
> possible the HostedEngine VM migrate automatically
to
> > > > > > > > > another
> > > > > > > > > host?
> > > > > > > > >
> > > > > > > > migrate on which network?
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > What is the expected behaviour on this HA
scenario?
> > > > > > > >
> > > > > > > > > > > > > > > > >
After a few minutes your vm will be shutdown by the
High
> > > > > > > > Availability
> > > > > > > > > > > > > > > > >
agent, as it can't see network, and started on
another
> > > > > > > > host.
> > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > I'm
testing this scenario and after shutdown network,
it
> > > > > > > should
> > > > > > > be
> > > > > > > expected that agent shutdown ha and started on
another
> > > > > > > host,
> > > > > > > but
> > > > > > > after
> > > > > > > > > > > > > > > couple minutes
nothing happens and on host with network
we
> > > > > > > getting
> > > > > > > the
> > > > > > > following messages:
> > > > > > >
> > > > > > > > > > > > > > > Aug 16
11:44:08 ied-blade11.install.eurotux.local
ovirt-ha-
> > > > > > > agent[2779]:
> > > > > > > ovirt-ha-agent
> > > > > > > > > > > > > > >
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine
.con
> > > > > > > fig
> > > > > > > ERROR
> > > > > > > Unable to get vm.conf from OVF_STORE, falling back to
> > > > > > > initial
> > > > > > > vm.conf
> > > > > > >
> > > > > > > > > > > > > > > I think the HA
agent its trying to get vm configuration
but
> > > > > > > some
> > > > > > > how it
> > > > > > > can't get vm.conf to start VM.
> > > > > >
> > > > > > No, this is a different issues.
> > > > > > > > > > > > > In 3.6 we added a
feature to let the engine manage also
the
> > > > > > engine VM
> > > > > > itself; ovirt-ha-agent will pickup the latest engine VM
> > > > > > configuration
> > > > > > from the OVF_STORE which is managed by the engine.
> > > > > > > > > > > > > If something goes wrong,
ovirt-ha-agent could fallback to
the
> > > > > > initial
> > > > > > > > > > > > > (bootstrap time)
vm.conf. This will normally happen till
you
> > > > > > add
> > > > > > your
> > > > > > first regular storage domain and the engine imports the
> > > > > > engine
> > > > > > VM.
> > > > >
> > > > > > > > > > > But i already have my first
storage domain and storage
engine
> > > > > domain
> > > > > and already imported engine VM.
> > > > >
> > > > > I'm using 4.0 version.
> > > >
> > > > This seams an issue, can you please share your
> > > > /var/log/ovirt-hosted-engine-ha/agent.log ?
> > > >
> > >
> > > I sent it in attachment.
> >
> > Nothing strange here;
> > do you see a couple of disks with alias OVF_STORE on the hosted-
> > engine
> > storage domain if you check it from the engine?
> >
>
> Do you mean any disk label?
> I don't have it anyone:
>
> > > [root@ied-blade11 ~]# ls /dev/disk/by-label/
> ls: cannot access /dev/disk/by-label/: No such file or directory
No I mean: go to the engine web-ui, select the hosted-engine storage
domain, check the disks there.
No, the alias is virtio-disk0.
>
> >
> > >
> > > >
> > > > >
> > > > > >
> > > > > > >
> > > > > > > Regards,
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Regards,
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Carlos Rodrigues
> > > > > > > > >
> > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > >
> > > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > > >
> > > > > > > > >
_______________________________________________
> > > > > > > > > Users mailing list
> > > > > > > > > Users(a)ovirt.org
> > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > >
> > > > > > > >
> > > > > > > --
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > > Engenheiro de Software Sénior
> > > > > > >
> > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > >
> > > > > > > _______________________________________________
> > > > > > > Users mailing list
> > > > > > > Users(a)ovirt.org
> > > > > > > http://lists.ovirt.org/mailman/listinfo/users
> > > > > --
> > > > > Carlos Rodrigues
> > > > >
> > > > > Engenheiro de Software Sénior
> > > > >
> > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > >
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--=-RZOPZm+KrtAoAmdrmH24
Content-Type: text/html; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
<html><head></head><body><div>On Thu, 2016-08-18 at 11:42
+0200, Simone Tir=
aboschi wrote:</div><blockquote type=3D"cite"><div>On Thu, Aug
18, 2016 at =
11:25 AM, Carlos Rodrigues <<a
href=3D"mailto:cmar@eurotux.com">cmar@eur=
otux.com</a>> wrote:</div><blockquote
type=3D"cite"><div><br></div><div>=
On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote:</div><blockquot=
e type=3D"cite"><div><br></div><div>On Thu, Aug 18,
2016 at 10:36 AM, Carlo=
s Rodrigues
<cmar@eurotux.com></div><div>wrote:</div><blockquote
type=
=3D"cite"><div><br></div><div><br></div><div>On
Thu, 2016-08-18 at 10:27 +0=
200, Simone Tiraboschi wrote:</div><blockquote
type=3D"cite"><div><br></div=
<div><br></div><div>On Thu, Aug 18, 2016 at
10:22 AM, Carlos Rodrigues <=
;cmar@eurotux.</div><div>com></div><div>wrote:</div><blockquote
type=3D"=
cite"><div><br></div><div><br></div><div><br></div><div>On
Thu, 2016-08-18 =
at 08:54 +0200, Simone Tiraboschi wrote:</div><blockquote
type=3D"cite"><di=
v><br></div><div><br></div><div><br></div><div>On
Tue, Aug 16, 2016 at 12:5=
3 PM, Carlos Rodrigues
&lt;cmar(a)euro</div><div>tux.</div><div>com&gt;</div>=
<div>wrote:</div><blockquote
type=3D"cite"><div><br></div><div><br></div><d=
iv><br></div><div><br></div><div>On Sun, 2016-08-14
at 14:22 +0300, Roy Gol=
an wrote:</div><blockquote
type=3D"cite"><div><br></div><div><br></div><div=
<br></div><div><br></div><div><br></div><div><br></div><div>On
12 August 2=
016 at 20:23, Carlos Rodrigues
&lt;cmar(a)eurotu</div><div>x.co</div><div>m&g=
t;</div><div>wrote:</div><blockquote
type=3D"cite"><div><br></div><div><br>=
</div><div><br></div><div><br></div><div>Hello,</div><div><br></div><div>I
=
have one cluster with two hosts with power
management</div><div>correctly</=
div><div>configured and one virtual machine with
HostedEngine</div><div>ove=
r</div><div>shared</div><div>storage with
FiberChannel.</div><div><br></div=
<div>When i shutdown the network of host with
HostedEngine</div><div>VM,&n=
bsp; it</div><div>should be</div><div>possible the
HostedEngine VM mig=
rate automatically
to</div><div>another</div><div>host?</div><div><br></div=
</blockquote><div>migrate on which
network?</div><div><br></div><blockquot=
e
type=3D"cite"><div><br></div><div><br></div><div><br></div><div><br></div=
<div>What is the expected behaviour on this HA
scenario?</div></blockquote=
<div><br></div><div>After a few minutes your vm will be shutdown
by the Hi=
gh</div><div>Availability</div><div>agent, as it
can't see network, and sta=
rted on
another</div><div>host.</div></blockquote><div><br></div><div><br><=
/div><div>I'm testing this scenario and after shutdown network,
it</div><di=
v>should</div><div>be</div><div>expected that agent shutdown ha
and started=
on
another</div><div>host,</div><div>but</div><div>after</div><div>couple
=
minutes nothing happens and on host with network
we</div><div>getting</div>=
<div>the</div><div>following
messages:</div><div><br></div><div>Aug 16 11:4=
4:08 ied-blade11.install.eurotux.local
ovirt-ha-</div><div>agent[2779]:</di=
v><div>ovirt-ha-agent</div><div>ovirt_hosted_engine_ha.agent.hosted_engine.=
HostedEngine.con</div><div>fig</div><div>ERROR</div><div>Unable
to get vm.c=
onf from OVF_STORE, falling back
to</div><div>initial</div><div>vm.conf</di=
v><div><br></div><div>I think the HA agent its trying to get vm
configurati=
on but</div><div>some</div><div>how
it</div><div>can't get vm.conf to start=
VM.</div></blockquote><div><br></div><div>No, this is
a different issues.<=
/div><div>In 3.6 we added a feature to let the engine manage also
the</div>=
<div>engine VM</div><div>itself; ovirt-ha-agent will pickup the latest
engi=
ne VM</div><div>configuration</div><div>from the OVF_STORE which
is managed=
by the engine.</div><div>If something goes wrong, ovirt-ha-agent could fal=
lback to the</div><div>initial</div><div>(bootstrap time) vm.conf.
This wil=
l normally happen till
you</div><div>add</div><div>your</div><div>first reg=
ular storage domain and the engine imports
the</div><div>engine</div><div>V=
M.</div></blockquote><div><br></div><div>But i already
have my first storag=
e domain and storage engine</div><div>domain</div><div>and already
imported=
engine VM.</div><div><br></div><div>I'm using 4.0
version.</div></blockquo=
te><div><br></div><div>This seams an issue, can you please
share your</div>=
<div>/var/log/ovirt-hosted-engine-ha/agent.log
?</div><div><br></div></bloc=
kquote><div><br></div><div>I sent it in
attachment.</div></blockquote><div>=
<br></div><div>Nothing strange here;</div><div>do you see a
couple of disks=
with alias OVF_STORE on the
hosted-</div><div>engine</div><div>storage dom=
ain if you check it from the
engine?</div><div><br></div></blockquote><div>=
<br></div><div>Do you mean any disk label?</div><div>I
don't have it anyone=
:</div><div><br></div><div>[<a
href=3D"mailto:root@ied-blade11">root@ied-bl=
ade11</a> ~]# ls /dev/disk/by-label/</div><div>ls:
cannot access=
/dev/disk/by-label/: No such file or
directory</div></blockquote><div><br>=
</div><div>No I mean: go to the engine web-ui, select the hosted-engine sto=
rage</div><div>domain, check the disks
there.</div></blockquote><div><br></=
div><div>No, the alias is
virtio-disk0.</div><div><br></div><div><img src=
=3D"cid:1471513843.2273.10.camel@eurotux.com">=E2=80=8B<br></div><blockquot=
e type=3D"cite"><div><br></div><blockquote
type=3D"cite"><div><br></div><bl=
ockquote type=3D"cite"><div><br></div><blockquote
type=3D"cite"><div><br></=
div><blockquote
type=3D"cite"><div><br></div><blockquote
type=3D"cite"><div=
<br></div><blockquote
type=3D"cite"><div><br></div><blockquote
type=3D"cit=
e"><div><br></div><div>Regards,</div><div>Carlos
Rodrigues</div><div><br></=
div><div><br></div><blockquote
type=3D"cite"><div><br></div><div><br></div>=
<div><br></div><div><br></div><blockquote
type=3D"cite"><div><br></div><div=
<br></div><div><br></div><div><br></div><div><br></div><div>Regards,</div>=
<div><br></div><div>--</div><div>Carlos
Rodrigues</div><div><br></div><div>=
Engenheiro de Software
S=C3=A9nior</div><div><br></div><div>Eurotux Inform=
=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com">www.eurotux.com</a></div><di=
v>(t) +351 253 680 300 (m) +351 911 926
110</div><div><br></div><div>______=
_________________________________________</div><div>Users mailing
list</div=
<div><a
href=3D"mailto:Users@ovirt.org">Users@ovirt.org</a></div><div><a
h=
ref=3D"http://lists.ovirt.org/mailman/listinfo/users">http:/...
g/mailman/listinfo/users</a></div><div><br></div></blockquote><div><br></di=
v></blockquote><div>--</div><div>Carlos
Rodrigues</div><div><br></div><div>=
Engenheiro de Software
S=C3=A9nior</div><div><br></div><div>Eurotux Inform=
=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com">www.eurotux.com</a></div><di=
v>(t) +351 253 680 300 (m) +351 911 926
110</div><div><br></div><div>______=
_________________________________________</div><div>Users mailing
list</div=
<div><a
href=3D"mailto:Users@ovirt.org">Users@ovirt.org</a></div><div><a
h=
ref=3D"http://lists.ovirt.org/mailman/listinfo/users">http:/...
g/mailman/listinfo/users</a></div></blockquote></blockquote><div>--</div><d=
iv>Carlos Rodrigues</div><div><br></div><div>Engenheiro
de Software S=C3=A9=
nior</div><div><br></div><div>Eurotux Inform=C3=A1tica, S.A.
| <a href=3D"w=
ww.eurotux.com">www.eurotux.com</a></div><div>(t) +351 253 680
300 (m) +351=
911 926
110</div><div><br></div></blockquote></blockquote><div>--</div><di=
v>Carlos Rodrigues</div><div><br></div><div>Engenheiro de
Software S=C3=A9n=
ior</div><div><br></div><div>Eurotux Inform=C3=A1tica, S.A.
| <a href=3D"ww=
w.eurotux.com">www.eurotux.com</a></div><div>(t) +351 253 680
300 (m) +351 =
911 926
110</div></blockquote></blockquote><div>--</div><div>Carlos
Rodrigu=
es</div><div><br></div><div>Engenheiro de Software
S=C3=A9nior</div><div><b=
r></div><div>Eurotux Inform=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com">w=
ww.eurotux.com</a></div><div>(t) +351 253 680 300 (m) +351 911 926
110</div=
<div><br></div></blockquote></blockquote><div><span><pre>--
<br></pre><div=
Carlos Rodrigues <br><br>Engenheiro de Software
S=C3=A9nior<br><br>Eu=
rotux Inform=C3=A1tica, S.A. | <a
href=3D"http://www.eurotux.com/">www=
.eurotux.com</a><br>(t) +351 253 680 300 (m) +351 911 926
110<br><br></div>=
</span></div></body></html>
--=-RZOPZm+KrtAoAmdrmH24--
--=-mZqFwwB7NvS3OE0tdKkP
Content-ID: <1471513843.2273.10.camel(a)eurotux.com>
Content-Disposition: inline; filename="unknown-30I7LY"
Content-Type: image/png; name="unknown-30I7LY"
Content-Transfer-Encoding: base64
iVBORw0KGgoAAAANSUhEUgAABR4AAAGGCAYAAAAdJZ16AAAABHNCSVQICAgIfAhkiAAAIABJREFU
eJzs3Xd4VFX+x/H31PReSWihSUc6iEpzXRvqT1HUBV3XhnXVFeuqy4qFVVdXXV3A3gsWmmtjEQRF
TEApoQcMJYH03md+fwwZUmaSSTJJSPy8niePcufOPeee+73n3PudWwwzZ86044Ld7nKyuGEwGNq7
CiIiIiIiIiIiIieE0047DbOrD6qTjna7XQnIRhgMBgwGA3a7XclHERERERERERGRY+olHqsTjTab
rVYCUuqrmXA0Go1KPoqIiIiIiIiIiBzj8opHm81G9+7deeKJJ9q6Ph3SvffeS2pqKkajsb2rIiIi
IiIiIiIickKolymrvr36kksuaY/6dEiXXHKJbksXERERERERERGpwWXiEWDkyJFtXpmOqrqtlHgU
ERERERERERFxcHlvsBJoTac2ExERERERERERccgqrHCdeBQRERERERERERFprrTcciUeRURERERE
RERExLuO5FW4fqt1S+1NTePVD74kefev5BcWExwYwGmjBzF75nn4+/kAsGPvAXbvO8S0M8a1RhVE
RERERERERESknWQUlns/8VhSWsYdf/8PdpudP1w4hYjwYH5ISmbpN+spLa/g/psvA+CtT1aSkZ2n
xKOIiIiIiIiIiEgnk11U6f3E45HMXPILijl19GAuO38SAFMnDGfkkH50jY0EYNYd/+DA4QwAJs2Y
wycLHqKktIznX1/Cz8l7AQODT+rJTbPOo1f3LhzNyuXSmx7lnMmjSc/IITu3gNefvovvk5J5+f0v
OJSeSURYMLMumsrZk0YDsGbDFp579TMKi0s587QR5OYXsWbDFla8/ggBfr7s2HuAl95ezq6UQwQG
+HLlRWcoCSoiIiIiIiIiIuIFBSVV3n/GY1xMBBFhwaxL3MbcZ9/m81U/cfBwBudOGcOwgb0A+Nvt
M7GYTXSPj+bFebfgY7Xw57n/IXl3KndeezF3XHsR23enct8/XqOiohKzyQTA6vVb6Nsznhv+cC5Z
Ofk8/MxbmE1Gnp97EzGRoTz5n49IPXSUnLxCHnnuXapsdh645XJCQwL5YWMyABazmZy8Au58ZAFZ
Ofn86+HZnDFhOE8v+pidKQe93RwiIiIiIiIiIiK/OUXlVd6/4tFqMfOvh2/ktY++YsPPO1j1wy8A
xMdGcvs1/8foof3o3SMODAZ8fawM7NuDVT/8QmZ2HrMumsqZp48EYOfeA3zyxTqStu6hX0I8AFER
Idw46zwAikvKeGnerYQGBxAZHsL4EQPZtG0ve35No8pWRUVFJedNHcNpYwZz2pjBfP3dRtKOZgPw
w8YdFJeUMfPCqfTr1ZUeXWP4YNlqvvj2J07q1dXbTSIiIiIiIiIiIvKbUl5ha52Xy3TtEsmDt12B
3W7n10NH+T4xmdcXf8XcZ9/m0wUPYbHULjYjKw+A6IhQ57SoY/+fkZXrTDx2iQ6v9b33ln7LT5t3
Ulxchh07AFVVVeTmFwIQGRbinLdLdLgz8ZhfUATAa4u/4s1PvgHAZrdz6EiWdxpARERERERERETk
N87riceNW/ewct3PnHn6CIYN6EXPrjH07BrDxm17SNy8i7zCYiLDgmt9JzrSkWQ8mpXrnHY0MweA
mMgw5zSj8fid4R+tWMPKdZu4cdZ5XHLu6by/5FsWvvc5AEGB/gBk5uQ75z+SeXzZ0ceWedm0SZw1
caRzuo/V0rKVFxEREREREREREawWo/cTj36+Vr5Y/RPrErdy3tRxhIcG8euhI2zcuoe4mAhn0tHH
auHwkSzWJW5jaP8EoiJCWPLVD/TuEUd5eQVfrkmiW5cohg/uQ0Fhcb1yikvKAMgvKOaX5BRWrtsE
wL6D6Zw9cTQmk5HlK9fTt2cce3497ExkAowe1o/gIH++27CF4YN6k3r4KEu/Xs9l0yY6b/UWERER
ERERERGR5gmwmjANHTr0bzUn2u127HY706dPb9ZCo8JDGNS3BwfTs1i/aTtrf9rGkYxcThk5kPtu
mkFQgB8AZeUVbN6ewvpNOzhr0ijOPH0kKalpLP78O378eScjh/TlwVuvIDjIn5LScj5YvprucdFM
nXAyAN3jo9m261e++2kr+w6kcc+Nl5K8O5UfkrZzysgBjBjUhw0/72TNhi106xKFj4+VtKPZXHnR
Gfj5+jB8UB9+2b6PxZ9/x/Y9qYwfMYBLzj0dk7F579tZvHgxBoOh1lWZIiIiIiIiIiIiv0W5xggM
M2fOtNecWFVVhc1m4/3332+venlFWXkFRcWlhIcGAXDN3c+QnpHNitceaZXyLrvsMoxGI6Zjb+AW
ERERERERERH5rTpkPal1Xi7T3kpKy7h49iNYzGbm3jmLQ+lZpKSmMXn8sPaumoiIiIiIiIiISKcX
FWjtnIlHP18f5t11FQve+Zx7Hn+FAH9ffj9xJDfNnNbeVRMREREREREREen0YkIsnTPxCDBicF8W
PP7n9q6GiIiIiIiIiIjIb06XUCt6E4qIiIiIiIiIiIh4VUSgRYlHERERERERERER8T4lHkVERERE
RERERMTrlHgUERERERERERERr3OZeDQYDG1djw5PbSYiIiIiIiIiInKcITc3115zwn/+859aMxQU
FLRphURERERERERERKRj6969O+bGZpo3b15b1EVEREREREREREQ6iYULF+oZjyIiIiIiIiIiIuJ9
SjyKiIiIiIiIiIiI1ynxKCIiIiIiIiIiIl5nDgkJae86iIiIiIiIiIiISCdjnj9/fnvXQURERERE
RERERDqZRt9qLSIiIiIiIiIiIu3ncPpRcnJzm/39sNBQ4mKjW32ZdSnxKCIiIiIiIiIicoKqThD2
TujX7GXs3bcLwJkobI1luqKXy4iIiIiIiIiIiJygWpogBOid0K/W1Y2tsUxXlHgUERERERERERER
r3MmHu+5554WLywrK4tRo0axZMmSWtOnTZtGcXFxi5dfXcaYMWO4+OKLufjii7nssst45plnvLZ8
VzZu3Mj999/v1WWOGTOmVetc1xdffFFvWmdoy+qYe++992pNT0pKYtSoUWzYsMFrZbVEZ2jr4uJi
Fi1axAcffOD8++STTzh8+LDXyhARERERERFpyKG8Cv65tpC7/5vPu0kFFJVVtXeVTgiHDu51/p1I
yzKCd5KO1eLj43nllVfIz8/32jLrCgoK4uOPP+bjjz/mlVdeobCwkLvuuqvVyhsxYgSPPfZYqy2/
tZWWlvL222+7/KwztGVcXBzLly+vNW3FihXExcV5tZyW6gxtbbVamTFjhvNvwoQJfPPNN9jtdq+W
IyIiIiIiIlLX9qNlXPxhEYuTYc1BP97ZFcTtywrILqigpLyKotLKWvM/vCyznWratmomCOO79m7x
8mouo6XJR7M3k47gSK6ceeaZvPTSSy4Tmm+++SZr166lqqqKXr16MWfOHKZPn84777xDUFAQ99xz
DwEBATz00ENkZWVx00038cEHH7gtLyAggPvuu4+LL76Ybdu2MWjQIBYsWMCGDRswm8306NGDOXPm
8Msvv/Daa6/Rs2dPfv31V6KiokhISGDv3r2kpqbyzDPPEBQUxGOPPUZqaiqVlZUMHDiQOXPmsGHD
Bt59911mzpzJ66+/Tvfu3cnLyyMzM5NnnnkGf3//ZrdXYmJio/XasWMHr776Kl27dqWkpITS0lLm
zZtHQECA23V98803KS8v55xzziExMZHU1FQefvhh5s6d2+naMjAwEH9/f3bu3MlJJ51EaWkpP//8
MwMGDACgqqrKZV0SExNd1sHHx8fl/DabjXnz5pGSkkJYWBh+fn6MGzeO888/32VcW63WTtfWdcXE
xGCz2SgpKcHf359ffvmF1NRUbDYbYWFhTJgwgSNHjrBp0yZCQ0PJy8vD39+fsLAwsrOzycvL46yz
zsLX15fExEQOHTqE0WgkNDSUU045haVLl3LKKacQExMDOBLKQ4cOpVu3bi7LMplMLV4nERERERER
OTElHihh6WWBRAeZWb2ngJcSK6iyhvKv1Zn4UIXRbuPeaV2c8xsNnf8iGW8nHWsuq3rZhw7ubfay
vf6MR5vNxhVXXEFSUhI7d+6s9dnGjRtJTExk4cKFvPLKKxiNRlasWMHo0aP5+eefsdvt5OTkcPDg
QcCRlBs3blyjZZrNZoYOHcqePXtITEzk+++/Z9GiRSxYsIDCwkI+//xzzGYzKSkp3HHHHTz33HOs
XLmSfv36MXfuXPr27cvatWvJzc2lT58+LFq0iNdee41Nmzaxa9euWuXs2rWL2267jUcffZTIyEi+
//77FrWXJ/UyGo3s2bOHOXPm8PjjjxMbG8uSJUsaXNetW7fyj3/8g/PPP58//elPdO3atcGkY0dv
y7PPPpulS5cCsGrVqlpJKHd1cVcHd/OvXbuWw4cP89prrzF37lwSExMxGAxu47qztnVN+/btw9fX
Fz8/P9LS0jh8+DDTpk3jggsuwGAwsGvXLoxGIzk5OYwfP56zzz6bffv2ERERweTJk4mIiCA1NZXD
hw9z4MABzj//fKZNm0Z5eTm7d++mT58+pKSkAFBSUkJOTg7x8fFuyxIREREREZHOa9bIUKKDzABM
7BPENUMqiPGtwD8kDEtYFPFhljrfqJ326nvGLLd/LZGSksKDDz7IDTfcQGFhoct5bDYb7777Lnfc
cQd33HEHL7/8MuXl5S0qt7WSjq6W2dwrH83z58/36q3W4Eh03HXXXcyfP59XXnnFOT0pKYl9+/Zx
/fXXA45EQmhoKGPHjmXTpk3ExsbSs2dPCgoKOHLkCImJiUydOtWjMgsLCzGZTGzdupVRo0ZhNDqC
a8SIEWzbto0ePXqQkJCA2ewI0JCQEPr1c7y9JzQ0lIKCAsLCwsjLy+Pmm2/G19eXzMxMcuu8nSch
IQFfX18AwsPDvXJLeWP1io6Opn///vj5+QHQv39/Nm/eTHl5udt17dWrF8HBwc2qT0dsyzPOOINF
ixZx++23s3z5cm6++Wbn7eXu6mK1Wl3Wwd38u3fvZvjw4RgMBoKDgxk1ahTgPq47Y1uXl5fz8ccf
A45nPoaEhPD73/8eg8HA4cOHycnJYdmyZQBUVFTg6+tLWFgYYWFhznXz8fEhIiICAF9fX8rKyigu
LiYuLg6DwQBAly5dyMjIYOTIkSxZsoTx48eTkpJC7969MRqNbssSERERERGRzml7ZilhvmZiAx3n
x3Y7FFXYsVaVEBMUjMkI0ZUNX+H4n0fuZPaD/3Q5vbkOHDjA888/T9euXTl69Kjb+VatWsWaNWuY
OXMmFRUVvP/++yQkJHic96qrtZOONZfdkisfzQCtkXwcM2YMixcvZsWKFc5kgtVqZerUqdx+++21
5s3Ly+P9998nKiqKESNGkJ+fT1JSElu2bGHOnDmNllVWVsa2bdu49dZbWbNmTb3Pq8uvextmdSIE
wG63s2LFCnbt2sXzzz+P0Wh0JpJqqrsMbzzbrrF6gSMzXs1msznXqa6abd0cHbUtg4ODGTJkCJ99
9hkZGRkMHDjQ+VlDdXFVB3fz12336u+6i+vGdMS2tlqtXHzxxQDs3buX5ORkZ5LVZDLRq1evelcp
p6en14tXd/Fbl7+/P8HBwRw9epSUlBTnst2VJSIiIiIiIp3P1vRSdmabSS+0k5JVRH5hGU+fG8y3
O0sI8LVSUlgEGBgeXzsXYrfXfvHM1PHDuWXWhbzw1mfOabfMupCp44c3u27+/v789a9/5eeff27w
TryJEydy2mmnYTab2bdvH+B4XGFztFXSsWYZzU0+OjMY8+fP93rF7rzzThYuXEhlpePhnieffDLr
1q1zXkr61ltvsX37dkJCQgD4/vvvGTlyJMOHD+frr78mMjKy0QRaWVkZjz/+OMOGDaNXr14MHTqU
pKQkZ6Lup59+YsiQIR7VNyMjg549ezpvbd69ezcVFRXNXX2v2rlzp/Ny3Y0bN9KvXz+P19VoNDq3
QUM6eluec845vPTSS5x55pktqou7+Xv27MnWrVsBKCgoIDExEXAf1w3p6G0N0Lt3bywWC9u2bQMg
NjaW1NRUqqocHfsvv/xCRkaGR8uKiYkhLS3NmRA9dOiQ87mOffr0YefOnZSWlhIVFdXiskRERERE
RKRjSS+0YTWb8bda8DMbOKe/mSA/M8/O6MKjF0Rwfj8DU7pXMjghpNb3jEZzvWX9+aqLmTzuZAAm
jzuZP191cYvqFhER4byrryFmsxmr1coTTzzBk08+yZQpUxgzZkyzyvTmy1880ZJEZ/0t4EWxsbFc
cMEFvPTSSwAMGzaMc889l+uuuw4fHx9iY2OZMWMG4Li19H//+x9RUVFERkayZcsW/vjHP7pcbkFB
AZdeeil2u53i4mImTpzIvffe61zOKaecwuzZszEajSQkJHDOOeewefPmRut71llnMWfOHG666SZ6
9+7N1Vdfzb/+9S+uvfZa7zRIC/Tp04cnn3ySjIwMfH19mTZtGn5+fh6ta2xsLHa7neuuu45FixbV
+qwzteWECRMwGAycffbZHtXl5ptvblLd//3vf/Pll1/ypz/9idjYWIYPH47JZGowrmvqTG1d7dRT
T+XTTz+lW7duxMbG0q9fP5YuXYrZbCYwMJDBgwd7lBDs0qUL3bp1Y/ny5RgMBkJDQ+nbty/guE38
+++/5+STT3bO764sERERERER6XyyCivJKrdRUgmVWAm0VFLzRrr4aNcvT62qcfdoTQvn/YW+Z8xi
4by/tEZ1AccFR9UXBfn7+zvvXrz66qvZs2cP7777LvHx8Zx66qnNWr63Xv7SmJZeXWl44oknGrzn
0tu3YEvTVb+d+Nlnn23vqvym5ebmsn79es466yzsdjvXXHMNd911V63bukVERERERETEu55amUWF
3UiFzciBshAKioq58eQKJvYP4UhOKcs3HOGa3/eo972Hl2Uyd1pkm9Rx5cqVfPjhhzz99NMEBgby
4YcfsnLlSsCRWyssLCQrK4vJkycD8MADD9CtWzdmz57d6LK37dhF74R+Lj9rSmJw775dDOrfr9Fl
NmXZNZdZ18KFC1v3ikeRziQwMJB169bxzjvvYDabGT16tJKOIiIiIiIiIq3sxlNDMBqNlJRVcc8X
ueRUhXLvd+VUfZWFoayE169wfauzp+8XaImysjLy8vKcj8fLzMykoqKCSZMmOe/ci4uLY+XKlSxb
tgyj0YjFYiE7O7vZt1rX1FpXPnrrOZJKPHYAY8aM8UowSsuYzWYeeeSR9q6GiIiIiIiIyG9KgI8j
feVnMfLstCA+SsrhpwNVdOtm4MrREcRF+Ln83t/Oa/zZiy21fft25yMGAR5//HG6du3Kgw8+SHR0
tHP6mWeeSXZ2NsuWLaOqqopRo0Zx1llneaUO3k4+evPlNQZ7ndfb1n3JjG61FhERERERERERaR+e
3Bbtiabeat3UZda1cOHC42+1FhEREREREREREfEWJR5FREREREREREROUGGhoezdt6tFy9i7bxdh
oaGtukxX9IxHERERERERERGRE1RcrONZkS1JFIaFhjqX01rLdEWJRxERERERERERkRNYXGx0o0m+
E2GZdelWaxEREREREREREfE6JR5FRERERERERETE68zJycntXQcRERERERERERHpZMwDBw6sNWHZ
smXtVBURERERERERERHpLHSrtYiIiIiIiIiIiHidEo8iIiIiIiIiIiLidUo8ioiIiIiIiIiIiNeZ
G5vhYHZJW9RDREREREREREREOpFGE49BFr+2qAdph1LpEt+9Tco6EcqVzk1x5Tm1lbQGxZW0BsWV
NIXiRaTltB8JKA7EQXHQcelWaxEREREREREREfE6JR5FRERERERERETE65R4FBEREREREREREa9T
4lFERERERERERES8zlhUWtnedRAREREREREREZFOxvj81xntXQcRERERERERERHpZIzxYZb2roOI
iIiIiIiIiIh0MsZof3t710FEREREREREREQ6kd1pRzHGh1nbux4npHVrV5PQI5yEHuH06xPDlEmj
efihu8nPz2v1shN/Wk9Cj3BWr17p8Xeq63veuZOw2x3J5M2bN5HQI5zNmze1VlWlGVJT93Pj7KsY
NiSBASfFc8G0qaxc+WV7V8tj//18KTu2b2v1cjraPnjqKcOc9a3598D9d7ZiTaU53nv3DaZOHkP/
fl0YObwvt992PUVFhUDbxbenFFcdQ83+qubfV1+uaPO6nGgxLK6dCMcCLRlnmxNnrbHO3oh3b4wJ
2u/aXnPHR0+2VUPHgQ3Fi7S9thx/te1PXO113tiUc8aafU9zzjU7OuPghJD2rsMJ7frr7+GZZ97n
d7+bzgfvv82smZdgs7XuVaJDhg5n1bc/07f3BMrLm/bd5G1b+OC9j2tNy8uBSr1D6IRQUVHBVbOm
8+P6ddxyywPMm7eQkJBoZl8/i6SkjpEg/vvf72frlm1UtVFMdZR98Pl/v8LChUu59NJrAZg790UW
LFjK9ItvRsckJ47du3Zw/313MHHi73nnnVXcccejLF/+Kf986mns9raP78YorjqW66+/hwULljr/
evcaR3lZ29bhRIthqe9EOxZozjjb1DhrrXVuabx7a0zQftf2mjs+NmVbFeRR6ziwsXiR9tPa46+2
fcfQ1ueNTTlnrNn3tCTf0xGVZKRjbO9KnOh69x7A5CmTuevue7jtzw+w+ZdEvv5yNQAfL36PKZNG
M7B/Vy6YNpWkpA0ArP9hLQk9wnn2mfmMGtGPcWMHsfKbL7jw/DMYPLA7Lzz/NADl5eXce8+fGT6s
N8OGJPDwQ3djt9vZsnkTkyedzK7d69iY5FjWi/9+hvHjBjPi5D4s/uhdt/WdMOF3vPDCYxQWVtSa
7q4sT+sK8MrLLzJ2zECGD+vNXX+5mbLSUm83d6f3zdf/Zf/+FO699ymmT7+Wc887lwUL32bOnEfx
tUZSWdnyuGrpNq3+vquYm3T6SNLTDjNnzmxefPHZNmmzjrIPDh8+islTT6VPnwQABg0aycRJp/Kv
f93P+dPGOue7+aarmXjaCOcvc3MfvpfJE0cxeuRJfPThO875tL+1jrT0wwCEhcXRf0B/Lr/iUtas
TebGGx9yGd+NxdgTj/+NQQO6cfBgqstYstlsPPjXuxgyqAdnn3Uad8+5lQEnxTvr09h2Vlx1LL17
D+DU005l8hTHX/ceEZgtnsfRkiWLW9R3tUcfLU3X2LHAurW14+LokXS3MVReXs7dc27l5KG9GNi/
Kzfd+EcKCvLdTnfF3TjraZy5m68p61xZ6Z1jkoaWUbM9qzVlTPC0Pb76cgUJPcJJ3rYFgL/PvZ+B
/bs2uL2k6dyNj4OH9Obzz13vL82J3ZoaipdV/1vjdvxtqJx33n6NiaeNYPDA7tw4+ypnPGi8bhpX
429iUv193127Ntbe2vYdQ0Pnja7ataE+2dX2qTuefPP1f53njIk/uY+Dun1PzXNNqwfHiZ7mgk5k
Sjx6wGwGiwWmTp0MwI4d29i4cRNz7rqF88+fwZIliQQEhHH9tbMoKCjBbDYDsC/lIB8t/pbcnBzm
3HUbzz3/BpMmncPzzz1Ffl4FKXt3YzKaWLDwE/7xjzd4842X+d/KNc5yCwvAbncs6+dNW1i2bD39
+g3h8cfmUuam/7nyytvIzEznrTdeq/XrS0qK67I8rev369Yw75G/8vRTL/PpZ0msW/sdixa9DPqF
p0n27NkFwMknn0JAIPj6gZ+/ietnX0fvvt3YtrXlcdXSbWo2uY+51974EICHHnqeGZfeSklx27Rb
R9kHzWY41nyOf1tg1pVXk5Kym01Ju6isrOS7NauYNu1yyst8AMjMLGDZsg2MHTuZhx68m6zMAu1v
rWjs2AkMGjSMf/7zAaZOGcTtt1/DxqS1hEXA62/Wju+fNjQeY5t/2cb7H3zDr/uyMbqIpW+//Ya3
33qV666/k8cfe53v1qzGYDCQlYHH21lx1XHYbDagEoPR8WexwlYP+vXqOPK1xgDN77vaq4+Wpmns
WMBirR0XydtS3cbQmtUr+ejDd3jr7S9ZunQT2H34acNmVn/rerq7nIqrcXbXTs/iLHlbw2OpJ+u8
fn3Lj0lW/a/hZVS3J/YI7DZHvZoyJrhbz7r1qL7KKjeHWlfVZWXgdnvpiqnmcTU+bt+xiXvudr2/
NCd2a2ooXoKDHY8vczX+uuuzN21K5K8P/IU/zLyed9/9lg0/ruepJ59kncbrJnM1/lottff9nzYk
u2xXT46PtO07Dlfj2Zo1rtt1jZuxctNG19vHVGc8MZsiAMc5o8HgPg7q9j3V55GFBZDkwTmtp7mg
E5m58VmkWlVVFQAmk4lvV32D3W7ngguuJSY2lMsvv4LbbruWjYlbCQh0zD9x4jlERcXRo0cCkVHx
BAXGM3rMKFas+JCjR3KJio4lKzuLOXddg+VYx3jwwGEC/BPqlX3WWdPx8QlkwqkT+PHH1eTllhMd
W//5nFFRsVz1xxtYtOgpBg5+1Tk9upGyGqvr2rWOXwpuvPEKDAbHLTNbNm+itNRx8CieMRoduX6b
rQpznRfK+/rC6tUtj6vqg9fmbtPhw0cBrmPOYnFU2my2EBJqwse39duspo6wD9Y1ecqZxMV15Ztv
llNSOobCwgLOOedysnMOAjBlyjQwGDnzrN+xYsWHbNu6m/U/an9rLT4+Pny29Bu++mIVP/ywmu+/
/4blyz7lqj8mcu11NwDH4/uHDxqPsQsumEnPHidRUpZF9tv1YykrKxWAc8+ZSVx8BFOnnsknn7wP
wLp1zd/OiqsT0333/Yn77jv+7+Wfr/aor6qOo6LiHKD5fVfvXo6+q736aPFMY8cCRoPj/6vjYuXK
J93GUK/efbFafZh9wyWcMuE0LrzoQsaMPpXDaXtcTq+sAEsDQ1fNcTYiwrM4M1tdz1dRfrysxtb5
h+9bfkySmNjwMqrb0y8AONbGTRkT3K1n3faw+rhvX3fbq7HtIp5rqM+/3aKPAAAgAElEQVTt3dfx
405j29TVcSA0HC/nnTcNcD3+DhrSw2U5W7ccAuD3Z15BTGwwGxJ3kp8LL730CKDxuilcjb/Vqvf9
zz93JH/qtmtBQY7L6TXbW9u+46k5nq1zc957xtSzXPbJr7zyFFB/+2zdth6of9xWk6s4SOgdCbg+
Plvjwfl/c89DTyRKPDbBd9+tAmDw4JFs3PStc7qfP9g49tMpRiorHUFutVrx8QGT2YTVasVsBrPZ
BIDNZufFfz/Dt6u+5utvtpJxNIOLLx7vuDXPxS8aVqsPPj44s95VVXbsdjAY6s87+8bbef+9N3jr
jZed0xa81HBZjdXVeuwoavnyzQQFBQNgt+vZkU110kkDAEhMXEu/ky4BHB3fo4/8lYumX1Zr3ubG
VXX4NHebbktef+z7rmPOyUXstbaOsg/WZDQamXHZLL78YjklpbmMH386MTFdKSx2JIjsdhs+PlB5
bGcyGAxYLNrfWsvhwwfZvXsn55x3BmeceQblZX/nylnnsvKbL7jiihuOz1hnu7qLsYCAQHx84V/P
uY6l6n3GYDA4DjIMx4OrJf2q4urEdNttf2PUqNOc/w4L6Yvd9oXz343F0bHuyTt9Vzv00eIZT48F
quPCWOP+pLox1K1bH75euYGlny1nw4Y13HjDLO699xGuu+FGt9MbUnOcXbjAszhzG4+247M1ts7e
OCZpbBnO/azG2U9TxgRP9zvDsQMD+7HLKktLS5wf9+rlfnuJ99Xrc2s+icrTbVpDQ/Eydaoj+eRq
/H3xBdflVI8BdrsdH18oLS3Gx89OQKDG66ZyNf4WFvwMHN/3fX1dt+urr/3D5fSa7a1t3/HUHM+S
Njr+v267+vjisk+243r7+B1L/tY9bqvJVRwcy4E6NHB85v6ctnnnoScS3WrdiP37d/HTT9+zaOEL
PPPME0yefBZDhoxm0uQzMBgMfPTRyxw9ks5HH75DbGwcffsOqhVMtcatOoGRn5+H0WiktLSKFSve
xGQyUVRU4L4yHgZWcHAIN950O6tWLW9SWQ3Vdey4CQAsWfI2BUX7uenmaaz74WMCgzyrkzhMmfp7
BgwYwvz5c3j55Zf46ssVzL5+Fu+88xp5OWWcdnrL46qm5mxTf3/336nu7Pbv31XrQLo1dcR9sK7L
LpvF7t3bWLb0Iy648A9YrMevaFm+/H2OHj3CsiUfExAQSELCSYwdq/2ttXzz9Rf88cpLmP/EPLZs
2cC6dSs4eDCFPn36Y7fVjm9PYwyD+1gaNGgYAJ9++ib7UvbUeoPruBb2q4qrE098fE9GjR7O+AmO
v+hYXyZP8TyOampO31V9C1Bb9tHSdI0dC1TWOUFpqC/6dtWXPPP0PC674lKeevo/9OjRh1279vLF
f11PdxUW7sbZgkLP4syTsbSxdR49uuXHJO761IaW0ZQxwdP9LjomFoD161eRfiSNNav/5yxv5UrP
t4s0T0P7i9nS9NitqaF4qU5quhp/3ZUzbvzpACxd+g7796cwfuxgHp33oMbrZnA1/ppqZjoM7o+7
Tj+98fbWtu8Y3I1n7rb9jxtc98mjR7nePp5chOMqDho6hz59YvOOEzsaJR4b8dJLjzHzD+fx0ovP
Mu28S/jb3AVYrDBixHAee/w5Vqz4gCmTR1NaWsq//vUufv6+mD1s1VlXXktERBQXXzSG+K7dmXrG
eTz33N/Ym7K7xfW++k83EBUV6/z3zFktK2vs2AncffffePvtFzjvnIlER8Uydsw5lLXx2zo7OqPR
yBtvfcTpp/+eF//9FH++7XoyMjJ47rl3GTRoHEMGtzyuPOVum5ZXuP9OdHQsY8dO4K23XuDN1xd6
t0JudNR9sKbomFjGjTuV0tISJp4+rdbl9TEx8Vxw/ulsS97Cgw/+E39/f06ZoP2ttcy68hpuvuUe
lnz2EZfPmMacu25h1KhTuP/+fxITWzu+hw71PMauvMp1LMV368nF0//AK688xW23XsewYSMxH7vP
cOy4lm1nxdWJyWTi2BWKjr+hw7zfr7vruwoKC9q8j5ama+xYoO6zvBrqi4YPH0F2Tg6nnzqMyZMG
07VrPNdeeycDB7qeXuuqi2PcjbN/vNqzOHPX/+3de3wsbWydx4xp+TGJuz61oWU0ZUxwt55122PY
sBFc+H8zePnlJ7lp9pVMmvQ758skhg3zfLtI8zS0v8R18WybujsObChejMeufHI1/l7lZl8KC4vk
vvvn8e67L3H+eZM5ZcJErrv2IYYM0XjdHHXHX1cXXbhq15OHN97e2vYdg7vxbMKprtt1wADXffLJ
w8e73D6evOfHVRzExbk/hx4ypO3O/9uTwV7n1V3z58+vNcPsm+5pk4qkHUqlS3z3NinL03IryiE/
7/i/jUbH81cCAo9f1lpWCiXFYLM5Ojj/AMeDjSsrIC8XgkLAanU8YNpkgqBgKC2BokIIi3B8ryDP
camvX4DjexXljjIKCxzfNxpqL6ukGIqLIDyy9uW11fUNDXeUZbc7yrVVQUiYY57Gymqorkajo+yS
EsDumDcwuHW2S0fXWDzbbFBcCOXlju1hNju2ifXYoxpaHFdVns3nbpvWLaduzOXlOh6Y7ufv+Gut
tupo+2C16uWHhkNxcT67d+/kqlnTueSSq7nllr8RFgFJieu5ZPo5PP/8R0yZMtV5QOEfCD7Hng+l
/a35GtsHi4scsVM9AlbHldFYP749jbHKyvqxlJ52lP/+900GDBzFSf1GcsstF2G1+rBw4XLCHY97
8Xg7K67anyf9VVAwLp/x5nEctbDvCg51zOOtPlqaryXHAnXjANzHkM0GRQWO5RgMjs8CgwCD6+nG
GreGNTbOuurXXMWZxep6vpAwR/x6ss7gnWMST5ZRl6djgrv1dLXfFeZDWdmxJIjFsf9GRLnfXkYX
t+yJZ+eINcfH6nhzt7+AZ9u07vlRTa7iZfuO9cy4xP34625fCglz/LekBOw2x7ICgxyxofH6uOaO
v672fXft6kl7a9u3r5aeN7pq14b65NKS+tunqtL1cduu3eu54vKGj8Fr9T2W2svx9DixsfPQE9ED
992iZzw2xGJ1HCA0xMcXlw9vN1tqfzc07Pj/+/odfzis0eg4gXCq8dDYmsutuSx3JxJ162swQFh4
7Xk8KctdXRsqW5rGaGx4APFGXHkyH7jepnXLqTtPSKj7untTR9sHXS1/yWeLmffIA4weM4Frrrkb
X7/6g4TZ6hiU6tL+1nr8Axx/rtSNb09jzGyuH0v+ARFk52Ryz93XUVJSzOAhw7j/vqdrvYXT0+2s
uDqxNdZfeRxHXui72qqPlpZp6FigbhyA+xgyGh0nJK64m16tsbh11a9Vqxtn7uarqbHjH28ck3iy
jLqaMiZ42h6BwVCzC65+SUBD20uap+6xLbjfX8Dzberu+67ixVhjDHY1/ja0L5lc1B80XnuqoX7M
1b7vrl09aW9t+xOXJ+eNrtq1oT7ZVd/i7rjNsr/GNDfH4HX7nprL8fQ4saPGhq54bKdypXNTXHnu
t9BWpSWOX6bMZsdVEdUauwJDmu9Ei6viQseVLzab4wAiILD2Cw6aQ3HV9k60uJITm+JFpOU60n6k
8bf1nOhxoG3fNhQHHZOueBQRaQOufi2Dxq/AkM7DP9D1L58tobgSERE5cWj8/e3SthdQHDSkEz2u
UkRERERERERERE4USjyKiIiIiIiIiIiI1ynxKCIiIiIiIiIiIl6nxKOIiIiIiIiIiIh4nXntunXt
XQcRERERERERERHpZHTFo4iIiIiIiIiIiHidEo8iIiIiIiIiIiLidUo8ioiIiIiIiIiIiNcZvlu7
1l5zwrq1a2vNMOGsy9q0QiIiIiIiIiIiItKxvb/oSV3xKCIiIiIiIiIiIt6nxKOIiIiIiIiIiIh4
nRKPIiIiIiIiIiIi4nVKPIqIiIiIiIiIiIjXKfEoIiIiIiIiIiIiXqfEo4iIiIiIiIiIiHidub0r
cKKymk2MGdSVH7akUmWze225kaEB5BaUUFlla/J3h/WNJS2zgKM5Re1SvkhbGze4Gyajgeo9sLSs
kqy8Yg4ezfNov1S8iyvjBnfDbDJirxNCKYezyckvYdSAeNZt/hUfi9n5/3Xn9YbIEH/io4Lx97MC
dopLKziUkU9mbnGrjUHN4Wtt3XboDAb3jqGguIxf03LrfTayfxyHMgpIzyogLMiPnl1C8bGaqayy
cSgjn7TMgnaosZwoenYJIzYikO37MsgrKvX4ezXHN+2j8ltnNhkZflIcOfnF7DmYDUBIgC8JcWH4
+pipqKwi5VAOOQUlbpcRGeJPXFQwAX5WDEBpeSUZuUUcPJqP/diOVeu41A7llVWkZxVw8Gh+66+k
NMpVHLiibS3S9pR4bGM9Y0PZWlLWbomQ9i5fpKmS92WQU1CCyWgg0M+HHl1CCQvyY/OedGyNnGEp
3sWdbSlHXZ6AGAywYdvBVj95j4sMokdsKCmHc8jILcKAgfAQP/p2jcBkNJKT7/7kSE486VkF9IoL
JzU9t1bshAT4YrWYycgpwmox0b9nFDv2O/q0QH8rQ3vHUlBcRmFxeftVXtqNwWAgKtSf/Wk5xEYE
NinxWHN8K6uobJN+S+RElRAX5kwYAVjMJgYkRLHnYBaZucWEB/vRv2cUSTsOUV5RVe/7cZFBdI8N
JeVQNll5xdjtEOhvpVd8OH4+FnalZjrnrT4uBQgO8GFQrxgKSyrIbSCpKW2jbhy4om0t0j68nni8
4UhPFsTs9/Zi2014iD/dokPwsZrIyitxdkYhgb4kdAnDZDJgtztOOg4fu2qhV3w44cF+YIdKm429
h7IpKCqjf88ofH3MDO4Vw/60XDJziwjy96FXfBhmkwmAg0fzOJJdCEBMeCDdYkKw2+3kFHh+MNqU
8t2th6/VzIiT4kg9kkt8VDCbdqUR4GulZ5dQTCbHHfoHjtSua4/YUKpsNrLySgjyt3Iku5CjOQ2v
o4inqmx28opK2br3CCP7xxEdHljrCqK6cekq3t3NK1Kt5lWO1WLCAomPDsFsMpCZW0zK4Wx8LPX7
SB+L2aO+zmQ00KNLKCmHcmp8bicjp4iKiqpaCXV3Y5C7WPaxmhnZP469B7OJCPHH12qmqKScnamZ
DX4GqK9ugay8EnrHQ3iwP1l5xc7pMRGBZOQUUmWzYTKZ2J2a6TyJKSwup6S8An8fixKPv1ERIf4U
FJdzNLuI7jGhmE3GWj+UhQb6khAfjtVspLS8kpRDORQU1z+eKywuc/ZbQ/vEkpFT5DwmNRhgzMCu
7EzNJLegVPu5dDrhwX74+1o4ml2I1eKI6+AAH8orqsjMdfTH2fklFJaUERHsT1pW7avMq8fkvQez
a91Vll9Uxta9RxosO7+ojJLSCvx8zOTq4vV25SoO6tK2Fmk/Xk083nCkJ8lnwg1fdZ7kY4CvlY07
D2MxGxnZP57QQF8KS8oZ0DOKXamZZOeX4GMxMbxfHMWlFWAwEB7kx8Ydh7HZ7YQH+xEV4k9BURk7
f80gcmgPtqYcobSsEovZyODe0ew+4Pg1ztdq5uR+XSgodvyC3adrOL/sSaewuJyIEH+6RAQBDfd0
oUF+HpdvNhndrkdxWQVGowGDwcCP2w5iNBgcV2r8mkFOfgkhgb4M7hVDdn4JRgP06RrBL3vSKCwu
p0tEEHFRQRzJLmxwHYtLK9pmI0qnYrPbycwrJizIl6PHEoyu4rJuvDcUwxWV9X/9Fqnm72shacch
rBYTJ/ftQl5RKflFZbX6yKb0dYH+PpiMRjJy6z82I7fQ8SOT1ew4aHY1BuUf+yHJVSzb7XaMBgNm
k5HkfUcxGgyMHuj4XnFZhdvPikrL3dbf1s63encEdrudI9mFxIQHOhOPZpORyBB/Nu9JB3CcBB/7
zGCAiGB/rGYzeYWe/7AonUuXiEAOHM1zjmsx4YEcynDcxmc2GxmQEMX2fRnkFpYSHRbAgJ5R/LT9
YL3xzdd6/HD+aE4RUaEBzsRjSKAvdjvkFpTqmEw6HbPJSK/4cJL3HSUixL/WZwZD7XkrK234+dQ/
9a0ek6uTlLW+08gdMyGBvvhYzbpLoZ01FAc1aVuLtB+vJR6rk45Ap0o+Vj97qaLSRklZBT5WM2az
kYrKKrKPdTxlx04mwkP8OZJViMViJDosgKz8ErKP/bkSFuRHRaXN2fmVlleSnV9CVGgAxWUVlJRV
Oq+CyMorptyD5EhFRZXH5YcG+bpdj+IjeQBkHPs1yGa381PyQWennFdYit1ux9dqxs/HTElZhbOu
aVkF9IgNbXQdf02v/ywsEU9UVNoI9DM2GJeFJbX3l4bmVeLxt2dQr+h606pP4uuqPoEvr6gip8CR
6MsvLAOO95FN6essx65q8iSh52oMshWWuo3lsnJH/auTmja7ndLySnysZmdiwdVnVovJbf11NZRn
0rMKGdk/DqvFRHlFFVFhARSVllNYUvtqxqjQAE7qEUlFpY09B7Moc3Hbn3R+fj4WfKxmco/d0XIk
q4CTekQ5E49hgX6UlVc5f4w4mlNETkEpdnv9hEpNmblF9IoLOx6HoQHOK3t0TCadTe/4cNKzCigu
rSAi5Pj0vKJSrGYT0WEBZOQWERLgS0igL5kufvCzmIxUVtpq3W3Qp2t4rQTWL7vTKT02vvbvGeX4
kc9owICB1PRc52fSPtzFQV3a1iLtY+jQod5JPNZMOlbrLMnHyqrjJwR2OxhwPDekotJWbz4fq5mi
0nK278ugS2QQPePCKCmrYN/hHPKLyuot22wyYrWYGD0g3jnNaHTcymepc7sN4FFypCnlN7Qex8s8
/nl0WABRoQGORsDxbKLq9ahbt7KKykbXUaS5fKwm5zN63MWlK02ZVzo3d894rHnlULWaz4OqqLTh
azXV+jc0ra+rqLJhNhkxGY1U2Rr+hd3VGASNx3JVjfGj5vfcfWZSX91ipeWV5BaWEhMeyIEjecSE
B7p8cUxGbhGZeY7HkJzUPRKg1u3Z8tsQGxGI1WJi3OBuzmkmo5GQAF/yihxXJzbnOLCi0kZOQSmR
If6kZRUSUeOqWx2TSWcSEeKPr4+ZXQcy631WWWkjeX8GCV3C6BkXRm5BqduXDZZXVmE2GzEaDc4f
BPen5ZKa7rgIY9TA+FqDaPVzegF8LCZ6xYfTt1sEuw9ktcJaSmMaioO6tK1F2k+LE4+uko7VOkvy
sa6KiiosZmOtaRbz8URIbmEpuYWlGAwG4iKDGNAzih+3Hay3nLKKKkrKKtm083C9z6LDAjCbapfh
7nkVdXlafmPr4eDolCNC/OkWE8LPu9MpK6/EYIDxQ7oDjmfvmdzUtaF1FGkOi9lEVGiA8zl17uKy
rqbMK1KTxWJyXkloMRvr/GDj6COb0tdVP04jNuL4bZXVwoP98POxOK+kdKU1Yrmh+rtKxopr6VmF
JMSFkZ1Xgq/VXOt2en9fC34+FufD7POLysguKCE82E+Jx98Yo8FATFggG3ccrnX1TFxkkPMlM+WV
VVjMtY/7/H0tlJRVUt3vuJORU0SXyCBKyispLa90Xu2sYzLpTKJC/R3PZe7vSKSbTEYMBgO+Pha2
7j1CXmEpP+9Oc84//KQuLpPshcXlVFbZiAkLdD7/0dOXEpZVVJGeXchJ3SOVjGonjcVBTdrWIu3H
2Pgs7jWUdKyWfKZjvs4kt7AUi9lEWJAfAD5WMxEhjgfKx4QH0qdrOAaD45lPRTVusbLbHX9mo6PZ
8wpL8amxHJPRQJ9uEQT6WckvKsPPx0KgvxWAqLAALKbGN1dTym9oPepyXNVoc558d40KAbujzvlF
ZQT4WvH3tQAQGxGEyYN1FGkKg8FAkL8PgxKiKSopJzOvqMG4rBvvDc0r0pDY8EDAkXQMC/Jz3vpY
U1P6OpvNzv60XHp0CSUuMshx9aPJ8YiMft0jnTHqTmvEsvpq78jOL8ZoMNAzLpSMnKJat9ObTUb6
dY8kOMAHcCR0w4L89GKZ36DIUH9KjyUFa8rMKyYixB+zyUhuQSlWi9F5C2BkqD9DescA9nrjW11Z
+cX4+1qICQ+s9QIF7efSmez4NZMNyQf5afshftp+iEMZ+WTkFLJ17xFMRgOjBsQT5O/ob7tEOMba
bBd3OtjsdvYdzqFnXBhdIh3nMAaDgUA/KwN6RlFRUUVlpevklNlkJCY8UM9IbUcNxUFd2tYi7afZ
lzHccKQnyRFAUuPzJkd0rrddV1bZ2L4vg55xofSKD8Nuh/1pjtuZi0orCA30ZdSArtjtdiqrbM43
hoLj2TtDeseQeiSPQxn5bNt3lF7xYfTuGg52yMwrcj4PKuVwNgN6RmG3O97G5up26boy84qbVL67
9bDW+ZU9M7eYqNAARg2Ip7LSxsGMPI7mFtGveyRbU46wPy2HQQnRVNrsZOYWUVRajv1YWzW0jiKN
GZgQhR3HnQ9lFVVk5BRx4EgednvjcVkz3tOzChucVwcSUo/BcZBaVlHJ8H5dMJtNZOYWkZVXXK+P
bGpfl55VQEVlFV2jg+nZJQzbsR+Kdux3vEii7vJraijud6U2fquRKw3VX1c8es5uh/TsQrrHhLDx
cO2ryvKLykg5lE2/7pFYzCaqqmxk5BaRnq3XY/7WxEYEuXy5VHlFFYUl5USHB3I4I5/klAx6dw2n
T9cIyioqSd6fQfWjyWqOb3V/MLbZ7M5nN+49mO2crmMy+a2ostn5NT2X/j0iMZmMlJRVkJxy1O2z
lY9kF1JeUT0mh2LAQGl5JVl5xew+kFXrqrjq41KAqio7eYUl7Nif0QZrJd6gbS3SPgzfrV1bqwde
t3ZtrRkmnHVZm1ZIOibHFZbH/z2yfzwph7JdPkNNREREREREREQ6t+Qfv2zZrdYi4Hgw+dhB3Zy3
7oQG+mK1mPQLuoiIiIiIiIjIb5jun+pg/H0tzrdguvJrei7Z+W17laHNZmf3gSx6xYdhNIRTZbOz
89cMj96+KCIiIiIiIiIinZMSjx1McWkFm3alNT5jG8vKK9ZbOUVERERERERExEm3WouIiIiIiIiI
iIjXKfEoIiIiIiIiIiIiXqfEo4iIiIiIiIiIiHidEo8iIiIiIiIiIiLidUo8ioiIiIiIiIiIiNc1
+lbrgd1D26IeIiIiIiIiIiIi0kkk/+hB4tHqF9AWdREREREREREREZFORLdai4iIiIiIiIiIiNcp
8SgiIiIiIiIiIiJep8SjiIiIiIiIiIiIeJ0SjyIiIiIiIiIiIuJ1SjyKiIiIiIiIiIiI1ynxKCIi
IiIiIiIiIl6nxKMbqb/+SpCfhcrKyiZ/d/LpE3j/vXdcfjb/8UfpHhfDX++7p6VVrOXjxR+Sk5Pt
1WV6U0xECJGhgbX+9uzeDUBSUiKTT59Aj/hYhg8dyIcfvOf8XkOfASz57BN+N2UisVFhxESEMHrE
UJ6c/zgVFRVtun7SOuJjIwkP9icyNJCosCBGDR/CI3MfprioyKPvt3S/WLP6W8aPGUFxcTHxsZGM
GDao3jzFxcV0iQ7nd1MmNrucas2t7/33zGHOX25vcfm/FfGxkYQE+BAa6Fvrb9GC/9Tq+1syDnji
s08/Zuqk04iJDKVLdDhTJp7Kp58sBuDIkXSC/CwUFRa2StlN0drt0Bmcd/aZzH34QZefDR86kFdf
XgTA1199ySljR9I1Noqhg05i0YL/tGU15QT00F/vp2tsFOvWftek79UcL7SPym9dfl4e/fsk8Odb
b3JOW7f2OyadOp6usVEMHzqQr778wqPPXPHkfKPmMWt0eDBDBvbj2X8+5f2VFbeaGgcNnZ+6ojgQ
aT4lHt2I79qVPfsPYDabvbrcxR99wLPPv8C8x+d7dbl//9tD5GTneHWZ3lJRUUFxcTHbd6eQmVvo
/OvTty/l5eVccel0rr3uBvYfTOP1t97ljj/fyp7duxv8DODFF57n5tk3cPU115Ky/yCph4/ywosL
WPLpJ9xy4w3tvNbiLR8s/pTM3EJ+PZjOv55/kdXfruLsM6dSVlbW6Hdbsl/k5+Xxp6tmseiVN/D3
9wegpLiE9T98X2u+JZ99QlBgULPKqKu59Z077zHWrP6WL7/4r1fq8Vuw+NOl5BaW1vq77obZrdb3
1/XSv1/gptnXc/WfrmVf6mF27/2V2TfdzM033sDbb77RqmWL911z3fW8/eYb9RI/69Z+R1paGpfO
uIy0tMPMvGIGf/v7oxxMz+D1t97lgfvuJikpsZ1qLe2tvLycxR9+wCOPPu5MTnuq5njRVv2WyInq
7jl3YrFanP/OzMzg0un/x5/v/AsH0o7y2OP/YNYfLiM9Pa3Bz1xpyvlG9TFremYui155nccfm8fK
b75u1XWX45oSBw2dn7qiOBBpGa8nHseusTQ+Uwdw6OBB+vTs5jyJ+GnDj0yZeConDxnAyUMG8NYb
rzvnffvNNxg8oC8jTx7MPXPuxG63u1zm5ZdOJ2XvXu6/524efvABAL5d9T/GjR5Or+7xTDrtFJIS
f3L5XZvNxpy/3M6Qgf0YNrg/p58ylg0/rgdg5uUzSNm7lwumnc3Hiz8EYO13a5h06nhGDBvEmJHD
ePGF5wHHr+IxESE8+8+nSOgWR3p6Gl99+QWnjB3JoP59GDKwX62T3nfeepO+Cd0ZPnQgDz5wH+ee
9Tvee/ftRtukpry8XABCQkLrffbdmtVYfaz8YdaVGAwGhg07mXPOOY/FH33Q4GdFhYU88veHeeqZ
Z7niD7PwDwjAx8eHsePGs/yLr5j/1NMu6yIdl39AABNOPY3l//2KzMxM3nnrTQC38etqv2go1ut6
8d/Pc9rpExk8ZIhz2u9+/3veeP3VWvO989abTP3d72pNc1dOU/djd/tY3f04KyuTe+57gLkP/7W5
zSvH1O37wbGNTx4ygIRucfzljtuoqqpy2Zd62icWFRby97kPMf8fTzPzyqvw9/cnMCiIS2dcznsf
LKZ3nz7OeZcvX8qo4UPoEh3O9ddcjc1mA9zHWGrqr0SFBfHWG93VjjkAACAASURBVK8z45KLGDNy
GNdefRU2m63Bz8DzPl3qO2/aBdhsNr787+e1pr/x2qvMuOxyAoOCsNvtLHz5Vc78/VkAjBgxkt59
+rBr5472qLKcAJYt/YxRo8dwxcxZrFn9bb0r3t0dI9YdL2r2W1MmnspL/37BuYyqqip69+jKqv+t
BLSfS+fz5X8/Z8f27Vzxh1nOaet/+J4uXbrwfxdNx2AwcPa55zF8+AiWL13a4Gd1Nfd8w2g0Mm78
KfQ/qT979+xptXWX45oaBw2dn9alOBBpOa8mHseusZB8ZudJPlbLysrk/PPO5tY/387PW7bz2dLP
ue+eOWxPTubw4UP8+dabePOd90n6eSunnT6RnzdtdLmc9z5cTI+ePXn2uReY+8ijZGdncfmM6cx/
8p+kpB7i+tk3cvml013eKrPqfyv56ssvSNy0hV+27uCBBx/mk8UfAfD6W47bupcs+y8XT7+UnJxs
ZlxyEfc98CAbf9nGp0tXMP/xR/l21f+w+lgpKSmhvLyclNRDhIaGceXMy3l47jy27djDSwte5tab
Z5OZmcGhQwe55aYb+ODjT9m0OZkePXry4/ofMBgMDbZJXbk5uZjNZq6/5moG9uvNuNHDeXnhAgB2
7dxJ/wEDa83ft18/ticnN/hZUlIixUVF/N9F0+uVFxoaRmhomAdbVjoiX19fzr/gQlZ+8zWlpaVu
47fuftHQvK589OH7XHzJJbWmzbjsCpZ89imFBQWAI8mzPTmZKVPPcM7TUDlN2Y8b2sfq7sexsV04
59xp7Nm9m107d3q9zX/rtidvY9PmZH74KYmln33Gks8+qbcNLBaLx31iUlIiRYWFTL90Rr3PJk6a
zPhTJjj/vWXzZjYk/cLW7btYsWIZa1Z/22CMWa1WSktLycnN4YOPPuG77zew8puvWbP62wY/a0qf
LvVZLBZmXfVHXq/xw0R+Xh6fffoxf7r2egDi4uK54MKLAEcyaMlnn5B2OI3TJ05qjyrLCeCVRQv5
45+uwcfHhwsvuoh33n7L+VlDx4h1x4uaLrv8D85HNoDjkSFms5mJkyZrP5dOJzc3h/9n777jorjz
/4G/dulLWToI2FBs2CUWwNhbLLF3k2jUGGMul1z83V2SuySXnku+XnqMLRpjRRPj2UtEsYsdVMAG
CFKkSK/z+4PbCbtshWV3WV7Px2Mfys7MzmfenzI7753yl9dewcpVa2FjY6M0TfVEEA8PTyQlJuic
Vlt9jzeqq6txPPoY7t+/L/7YRI2nPu1A2/GpKrYDooYzWuJRkXQEYHXJx0MHD8DT01McbNq0bYun
xo7DjqhtiDlxHG2Dg9G7dx8ANWc9+Pu30Otzjxw+hKCgIAwaPARAzZfFU+cu1BkwAcDPzx+ZmZnY
sulnZGZmYNSYp/Dxv9X/unLs96Pw9/fHqDFPAQACA4MwYeJE7Nv7X0gkEgiCgBkzZ0MikcDR0REJ
SffEwTBy4JOws7PD/Xv3cDz6GDp07Chu24KFi+Ds7KIzJqrsHewxc/YcLF32MuJuJeHLr7/DO/98
C3t2/4bi4iI4OTopze8kk6GouEjrtNzcHLi7e8DBwUGc9srLS9GudZD4Sr5/X3clUJPk7eODvLxc
re1XlSHz5uXlIuHWLfTrP0Dp/RYtAhAeHoEd/0sWbtr4E6bPmAk7uz/GO23rMaQfa+tjqv1Ysd6e
vXqLZ1CSdpOfHgdXJzull+KMIFVLl/0JEokE/v4tMHL0aJw4Hl2nDgwZExXjl5OTU51pqpYsfQlS
qRReXt7o0KEjUlNStLYxRXuY9r+kpoODA9oGByM1JUXrNEPKT+oteH4Rjhw6iLS0BwCArVs2o0to
V/To0VNpvu3btsDTTYZXlr2Eb75bicDAIHMUl8wsKTERycn3MWToMADAc/MX4se1q8XphnxHrG3K
tGmIvXAe6elpAGpu8TN95ixIpVL2c7I6r7/6Zyxc9AI6duqk9H54RCTS09OxedNGVFVVIfrY7zgZ
cwKlZaVap6ky9Hhj7uwZCPT3hp+XHE+PG4Nlf3oFrVq3brwAEID6tQNtx6eq2A6IGs4oicfaSUcF
a0o+5uXmIePhQ4R2bC++jhw+hJycR8h5lAMPD0+l+b29vQEAG35ch9aB/mgd6I8Z0ybX+dxH2Y+U
fiGRSqXw9vaBRCKps2zXbt2wZdsOHDywH726h2LIkxE4dTJGbXkzMzLh7e2j9J6npxcyMzLFv728
vMT/b/p5I4YPeRKDB4ZjyJMRKC8vR3V1NfJy8+Dl5a1UvsCgQJ0xUS17q1at8d3K1ejbrz8kEgn6
9uuPGbNmYc+e3XB2dkFxSbFSWYsKC+Hi7KJ1mo+PL3Jzc1Bc/Mf0997/CKfOXcCpcxeQn5/Hm6xb
sdTUFDHBr6n9qqPvvFmZWbCxsVFq/wrznn0O639cC0EQsOnnnzBn3rN6r8eQfqytjynU7sdAzQ8U
GRkPNQeORDt3/RcFJRVKL0UCQJWvn5/4f09PL6X7cCrqQJ/6+mMZb+Tm5ohnzmrjUWsfYWtri6qq
KgC627Kbq5v4fxsbG3E5TdMMKT+p16p1awweMlS87H39ujV4/n9nO9Y2bfpM5DwuxtaonVj+l1fx
265fTF1UsgBrVq1ExsOHCGrhg0B/b4wcPhhJiYniQ2a0fUfUxsvLG0OGDcevO3eioqICu3ftEi89
ZD8na/Lf3btw585tvPzKq3WmeXp6Ycu2Hfj+m6/RsV0bbNr4E4YOGw53dw+t01QZeryxcdNWPHiY
jazcAly/mYiLsbF4+aUljRMAAlD/dqDt+FQV2wFRwzX4LtTqko4K8SOBfgftcPbJpv2E4cCgQLQP
CcGZ85fqTNuy+WfxHhEKDx/WHPhPnT4Do8aMAQDY29vXWdbXzxdZWX8kAwVBwI34eIR06KB22UGD
h2DQ4CEoLy/H9999U3OPn+QHdT7Xv4W/0ucCNTfX9ff3F/9WfHH9bdcv+PTjD3Es5hRatWqNqqoq
+HvX3OvCzc0NBY8fK5UvPS1dZ0yKi4uVyp6ZmYEHDx6gV6/e4jwVFRWwt7dHp86d8fVX/1FaPu76
dXTv0UPrtN59wuDu7oFNG3/CwsU1N/R1k8vhJpfXKQ9Zl+zsLERt24b/++JLre1XlSHzKqg7wHtq
7Hj8+eVl2LL5Z8jd5OjarRuSkv64PEfXevTtx9r6mCK5qK58ug5KyXBZWZlo2bIVgJpbb3h5/5Hw
VcRbW32p6t0nDG5yOX78cS2WvfyK0rT9e/cgITEBM2bO0rh8fdqyLtrKz7PH9ff8wsX4+9+W46mx
43H33l1MmfbHZbA3b9zA7aREjB0/ATY2NujXfwBGjRmDA/v3YcLTk8xYajK10tJSbPp5I85fvIo2
bduK73/79VdYt2Y1IiIHav2OqGucnzFzFlb/sBLB7dqhVatW6Nyl5rY1hoxTRJYuats2pCQno3uX
jgCA/Px8VFZV4nZSEv677yCeHDQY0Sf/uApkQN/emDRlCgBonVZbQ443AgOD8Oz8BVjw3Dx8890P
DdpW0qy+7UDb8akqtgOihmvQGY/ako4K1nDm46BBQ5Celo5DBw8AAIqLirBs6Qu4fPkSwsMjkZiQ
gIsXYwEA27ZuFn85lslk8PPzh5+ff52zIgFg2PARyMjIEE/p/vWXHRj/1ChIJJI6y274cR1eeXkp
KisrYW9vj+7de4j3rJBKpbCxsUH+4/ya8g4egsyMTLG8ycn38duvv2L80xPrlCEvNw+eXp4ICmoJ
QRCw4vN/QyKRoKioCP36D8C1a1cRHxcHAFi3ZjWKigp1xkS17Hdu38aYkcPES0BjL5xH1PZteHri
ZEQOfBJCtYBVK79HdXU1ThyPxpEjhzBt+kyt0xwdHfHhx5/izTf+ilUrv0dhQQEqKipw6dJFzJw+
Bb6+fvD0qhtzarrKy8tx4fw5THl6PLr36IHJU6Zpbb+q/ULbvKp8fH1QVVWl9v6PdnZ2mDFzFt76
+98w95nn6kzXth6D+rGWPqZJRsZD+Pr6aZxO9bN+Xc19+x49ysahAwcweMjQOvMYUl8ymQzvvf8R
3v3nW/j266+Qn5+HgsePsXnTRjy/4Fm01nE5jiFtWV/1aW9U1+inxqKstAz/ePNvmDV7DmQymTgt
Pz8PC+Y/I57lnHz/Pg4fOohevfqYq7hkJr/sjELbtm2Vko4AMGnKFOz+7Vfk5uZo/Y6our9QNXbc
BMRdv46NG9Zj1tw/HrTAfk7W5Meffkbi3WTE3UpC3K0k/OnPr2LGzFn4776DKCosRGin9oi9cB7V
1dVY/cNK5OXmYeSoMVqnqWrI8UZubk7NA0i7dlM7nYyjvu1A2/GpKrYDooard+Kx33E7xHsBiNX9
ivdq2slHN7kcUb/swkcfvIfuoR0xoF8feHl5o3v3HmjVujU+/WwF5syYhtBO7XH+3Fn06z9A45Ot
a5PL3RG1cxfe/uebaBPUAp9/+gk2b4uCrW3dE1EnTZ6CosIidO0Ugm5dOuCtv/8Va9fX3IRcKpVi
6rQZGDt6BL768j9wd/fA1qid+OC9d9G7RyimTpqA9z74COERkXU+d/KUqQgICET30I4YHDkA7dq3
x/SZs7D4+fmoqKjAvz74CFMnTUD/J3ohOzsLoV27QSKRaI2Jqv4DwvHvz1Zg0fPPIdDfG4sXzse/
P1uBIUOHwdbWFpu378CWzT+jVYAf/vLqn/DD6rVo07at1mkAMPeZZ/HTz1uwc8d2hLRrjUA/Lyx+
/jmEhnbFqXMX+IAZKzFj6iR4u7ughY8H5j87F8NHjsKOX3fDxsZGa/u9dfOmUr/QNq/qjfXd3T3Q
oWNHnDuj/n6J856dj7y8XEyfObPONG3r6dS5s9792JA+BgBlZWW4fOki+vbr38CIk0JlZSUcHBwQ
GBiE8H59ENHvCUyZOg1jx02oM6+h9bVg4SKs+XEDorZvRYfg1ujUIRg/rf8Rm7ZsV/ultzZD2rK+
DC0/qWdjY4Nn5y/A4UMH8fzCF5Sm9es/AP+34ku8sGgB/H08MGLoIDz99CTMf36hmUpL5rJ29SpM
nja9zvstWgSgR89e2PTzRq3fEVX3F6pkMhmeGjsO/929C9Nn/LGfYj+n5sLZxQVvv/senpkzCy0D
fLHp558Q9ctvcHJy0jpNHUOONxTfWb3dXdCrWyhsbGyw4efNJtpqUqWtrrUdn6rDdkBUf3nFJZCc
iIlRypCdjFG+39hLr/zFpIUiy1JVVaV0I/Oe3Trj089W8MlcZPU++uA9JCUmYs2PG8xdFL38+ssO
fPLRBzh97qK5i0JERERERESEb7//xnhPtSbrU1xcjLYtA8RLcqKP/Y709HT06t1bx5JETd/SZS/j
2O9HcfPGDXMXRaeqqip8+vGHePud98xdFCIiIiIiIiIRE4+kkUwmw3crV+Gvy19Dlw7tsPwvf8a6
H3+Cj4+vuYtG1Ojkcnes+XEDnn9untJT7CzR2/94E+ERkRj91FhzF4WIiIiIiIhIxEutiYiIiIiI
iIiIyKh4qTURERERERERERE1CiYeiYiIiIiIiIiIyOiYeCQiIiIiIiIiIiLjkjDxSERERERERERE
RMYmMPFIRERERERERERExiYBbHXNU15SZIqiEBERERERERERkbUQ9Eg8enrITVEUIiIiIiIiIiIi
sha8xyMRERERERERERE1BiYeiYiIiIiIiIiIyOiYeCQiIiIiIiIiIiKjY+KRiIiIiIiIiIiIjI6J
RyIiIiIiIiIiIjI6Jh6JiIiIiIiIiIjI6Jh41CIsLAzff/+9+PeDBw8wZ84cBAYGwtvbG61atcKS
JUtQWFiotNy2bdsQHh4OFxcXyGQy9O7dG6tWrdJ7ve7u7rC3t4ejoyOcnJzQpUsX/OMf/0BRUZHB
63F3d0enTp3qrKO4uBhubm6IjIysM+1vf/sbPDw8cPz4cZ0xcXd3R0REBARBUJovMjISUVFRem8z
kTrm6oNk3fQZt9zd3WFjYwNbW1ul17fffgtA/7ZIzcOwYcPw5ptvqp3WsWNHrFy5Uvz7hx9+gIuL
C77++mtTFY8skOr+rTFs3boVOTk5AIB79+5BIpGgsrKyUddJZEr79+9Hz5494eHhgfbt24v7aABw
dnaGo6Oj0ishIUHjZ+3YsQORkZFwdXWFs7MzQkND8cEHH6CiokKcp/YxmkwmQ7t27fDpp5826jaS
btragbZp6rAdNF3M3Vh27oaJRwNMnjwZXl5eSExMRHZ2Ns6cOYO4uDi88sor4jyff/45lixZgiVL
liAzMxO5ubn4xz/+gX/+859Yvny53uv67bffUFpaiuzsbHz//fc4evQoBg8ejLKyMoPXU1xcjJMn
Tyq9t2PHDri6utZZb3l5OTZv3oxPPvlE6UBJm/T0dL3nJWoIU/ZBsm76jFt79uxBZWWl0mvp0qUA
9GuL1HwsWbIE69atq5PUOX78ONLS0jB79mwAwIsvvojo6GiEhoaao5jUzLz11lti4rFly5ZIT0+H
ra2tmUtFZBxpaWmYOnUqPvroI+Tm5mLLli14/fXXcf78eVRUVKC4uBjJyckoLS0VXx06dFD7WV98
8QUWLlyIxYsX4+HDh8jJycGqVauwY8cOLFy4UGlexTFaYWEhNmzYgH/96184ePCgKTaZ1NDWDrRN
U4ftwLowd6Oe2XI3J2JihNqvjz/+WOmlyUpAuNCnj96vlYDGz7JUffr0Eb777jvxbzc3N+HAgQNK
82RlZQkPHz4UBEEQcnNzBZlMJmzdurXOZx09elSQSqXC3bt3da5XLpcL+/btU3qvpKREaN26tfD9
998btB65XC4sXrxYmD9/vtJ8Q4cOFebPny9EREQovb9lyxZh2rRpQmlpqdCiRQvh0aNHStNVYyKX
y4WoqCjB09NTSE9PF9+PiIgQtm/frnNbibQxVx8k66bPuKVuHK5NV1uk5qW8vFzw8/MTfv31V6X3
582bJ7zwwgvi3+fOnRMEQRCGDRsmfPXVVyYtI1mW2vu3e/fuCY6OjsKaNWuECRMmCKGhocKcOXOE
qqoqQRAEYe/evUKPHj2ENm3aCMHBwcLatWvFzzl8+LDQrVs3wdfXV+jbt69w9uxZQRAEYcqUKQIA
ITg4WNiyZYtw9+5dAYBQUVEh9O/fX/jiiy/Ez6isrBT8/PyEQ4cOCYIgCKdPnxb69+8vhISECCEh
IcKaNWtMFRYivaWmpgpRUVFK73Xv3l3YsGGDkJmZKQAQysrKdH5OQUGB4OrqKvz00091puXk5Ag5
OTni3+q+G4SFhQlff/11PbeCGkpbO9A2TRXbQdPH3I3l5m4++c9/hHqf8bhYEBAbG4s+erxiY2Ox
WOV0zqZo1qxZWLBgAVasWIGrV6+iuroa3t7e8PPzAwCcPHkSVVVVmDp1ap1lhwwZgoCAABw5cqRe
63Z0dMTkyZNx8OBBg9czZ84c7NixAwUFBQCA+/fvIy4uDiNGjKiz/Pfff49FixbBwcEBU6dOxfr1
63WWrWfPnpg7dy7P9KFGZ84+SNaloeOWrrZIzYudnR0WLFiA1atXi+/l5+cjKioKL7zwgvjeE088
YY7ikYWzt7dHaWkpcnNzsWvXLsTGxuLgwYP4/fffUVpaiunTp+PDDz/E3bt3sXbtWixevBhZWVl4
9OgRJk2ahP/85z/IyMjASy+9hEmTJqGyshJbtmwBABw4cAAzZsxQWt/cuXOxfft28e/ff/8dtra2
GDp0KLKzszFy5Ei89tprSEhIwP79+/GXv/wFcXFxJo0JkS6BgYGYMmUKAKCqqgo7duxAWloahgwZ
gtzcXNja2uKZZ55B69at0b17d3z33XdqP+f8+fMoKirCtGnT6kzz8PCAh4eH2uWqq6vx+++/4969
exgzZozxNowMoq0daJumiu3A+jB3o565cjcNutR6sSDgBx3z/PC/+azBt99+i08//RQxMTEYMWIE
vLy8sGDBAqSnpwMAsrOz4efnB6lUfVgDAgLw6NGjeq/fx8cHubm5Bq8nICAAkZGR2Lp1KwBg/fr1
mD17Nuzs7JSWS0hIwP379zF8+HAAwKJFi/S6v4EgCHj//fdx6tQp7N27t76bR6STufsgWQ99xq0x
Y8ZAIpEovQ4fPgxAd1uk5mfx4sU4cOAAHjx4AAD4+eef0a1bN/Tq1cvMJSNLJ5FIANQcJAGAg4MD
2rVrh+TkZDg6OiI1NVU8oB00aBDs7Oxw9+5dHDx4EC1btsTQoUMB1CQUL1++DBsbG63rmzFjBs6d
O4e0tDQAwJYtWzBnzhxIpVLs378fXl5e4sF3cHAwxo8fL36HJLI0mzdvhr29PZYsWYLVq1cjKCgI
Dg4OmDdvHl555RXcu3cPK1euxBtvvIFdu3bVWT4nJwceHh5wcHAQ31uyZAn8/f3F171798RpU6dO
hbu7O5ydnTFy5Ei8+uqraNOmjQm2lLRR1w70mabAdmB9zH3cyNyNsgbf41Fb8tGako4AIJVKMXv2
bOzYsQMZGRk4fvw4srOzxS+Dvr6+ePjwIaqqqtQun5aWBl9f33qvPyUlBS1atKjXehYsWIA1a9ZA
EARs2LABzz33XJ3lvv/+e6Snp8PDwwPu7u4YOHAgEhIS1N6oVJWrqyu+/PJLLF26FMXFxfXaPiJd
zN0HybroGrf27dsHQRCUXoqdu662SM1PmzZtMGzYMKxbtw4AsHr1aqWzHYl0cXNzE/9vY2Mj7ss2
bNiAiIgI9OvXD/3790d5eTmqq6uRnZ2tdBaOVCqFj4+PmMjUxNvbGyNGjEBUVBQqKirwyy+/4Jln
ngEA5ObmIj09HW3atBFfBw8e5I92ZLFmzZqF8vJy7Nq1C3/605+wc+dOtG7dGmvXrsWAAQMgkUgw
YMAAzJkzB7/99lud5X19fZGTk6P0PeCTTz7B5cuXcfnyZeTl5SndvzcqKgp5eXkoKSnB3bt3ceHC
BSxevNgk20qaqWsH+kxTYDuwPuY+bmTuRplRHi6jLvlobUnH9PR08bIVhW7duuGdd97BlStXUFpa
ioiICNjZ2WHTpk11lo+OjsbDhw/Fg1ZDZWVlYcuWLRg3bly91jNhwgTcvn0bGzduhFwuR/fu3ZWm
l5aWYsOGDYiLi0NeXp74+vzzz/HDD7rOa60xadIk9OzZE2+//XadjDxRQ5m7D5J1qs+4pU9bpOZp
yZIl+PHHH3H16lXcuXMHM2fONHeRqInbuXMn3n//fWzevBlnz57FyZMnxbHKz88PmZmZ4ryCIOD6
9etKT1/VZM6cOYiKisKhQ4fQunVr8YFHQUFB6NChA+7duye+Hj58iG+++aZxNpConuLj48UzGG1s
bBAeHo6xY8di7969yMjIQGxsrNL8FRUVsLe3r/M5TzzxBDw8PJQuUZTL5eJZbtoEBQVh4cKFjf40
WNJMWzvQNk0V24F1MfdxI3M3dRntqda1k4/WlnQEau7fsGjRInz++efio9EzMzPxxRdfoE+fPnB0
dISbmxs++OADLFu2DOvXr0dxcTHKysqwa9cuzJw5E2+88YbaU7u1KS8vx9mzZ/HUU0+hZ8+emD59
er3WY2dnhzlz5mD58uWYP39+nfVs374dwcHBCA4OVnp/2rRp+OWXX8SnIury1VdfYfXq1UhOTjZo
O4l0MVcfJOtn6LilT1uk5mncuHEoLS3F//t//w/z5s2DTCYzd5GoicvNzYWXlxdatmwJQRDwySef
QCKRoKioCCNHjsTDhw/FA+uoqCgMHz4cEokEUqkUNjY2yM/PV/u5Tz/9NK5du4Z169aJZzsCwNCh
Q5GWlob9+/cDAIqKirBo0SJcvHix8TeWyAB5eXmYM2cOTpw4AQC4d+8eDhw4gD59+iApKQmDBw/G
6dOnAQDnzp3Dli1bxPv91ebo6IjPPvsMy5cvx7fffouCggJUVFQgNjYWEydOhJ+fH7y8vNSWIScn
B+vWrauTFCDT0dYOtE1TxXZgXZi7scDcTX2faq1JU3x6tSaqTwE6f/68MHbsWMHX11dwc3MT/P39
hWeeeUZITU1VWm779u1C//79BZlMJjg5OQl9+vQRfvzxR73XK5fLBTs7O8HBwUGwt7cXgoODhbfe
eksoKSkxeD1yuVxITEwUBEEQrl69Ktjb24tPO9q+fbv4ZKSIiAjhs88+U1ueyMhIYcWKFWpjUvvz
FVasWCEA4FOtqcHM1QfJuukzbul6qrW+bZGan7ffflsAIFy/fl3p/crKSsHBwUFwcHAQpFKpYGtr
Kzg4OAjLli0zU0nJnGrv39LT0wUAQkFBgTg9IiJCWLVqlfD48WNh+PDhQtu2bYWwsDBh27ZtwsKF
C4WAgADh+vXrQnR0tNC5c2fB29tb6NWrl3Dq1CnxM+bMmSO4ubkJn3/+udJTrRXmzZsn2NraChkZ
GUplUzzVul27dkL79u2Fv/3tb+ITtoksybp164Tg4GDBxcVFCAwMFF5//XWhsrJSEARBWLNmjdC+
fXtBLpcLnTp1EtatW6f1s/bu3SsMGjRIcHV1FZycnIQuXboIb731Vp2nGSuO0RwcHARvb29hxowZ
Sk+HJdPT1g60TVOH7aDpYu6mhiXmbj75z38EyYmYGKVTE0/GxCglJv/61782fvaTiIiIiIiIiIiI
rManX3xhvEutiYiIiIiIiIiIiBRszV2A5iY+Ph6zZ8/WOP1f//oXJkyYYMISERERERERERGRAnM3
xsPEo4l16dIFly9fNncxiIiIiIiIiIhIDeZujEMCIz7VmoiIiIiIiIiIiAgABDDxSERERERERERE
RI2AiUciIiIiIiIiIiIyOiYeiYiIiIiIiIiIyKh4j0ciIiIiIiIiIiJqFDqfap2Tm2+KchARERER
EREREZEV0Zl49PSQm6IcREREREREREREZEV4qTUREREREREREREZHROPREREREREREREZHRMPBIR
EREREREREZHRMfFIRERERERERERERsfEIxERERERERERTyJFEQAAIABJREFUERkdE49ERERERERE
RERkdEw8EhERERERERERkdEx8UhERERERERERERGx8QjERERERERERERGR0Tj0RERERERERERGR0
TDwSERERERERERGR0THxSEREREREREREREbHxCMREREREREREREZHROPREREREREREREZHRMPBIR
EREREREREZHRMfFIRERERERERERERsfEIxERERERERERERkdE49ERERERERERERkdEw8EhERERER
ERERkVFJwMQjERERERERERERNQImHomIiIiIiIiIiMjomHgkIiIiIiIiIiIio2PikYiIiIiIiIiI
iIyOiUciIiIiIiIiIiIyOiYeiYiIiIiIiIiIyOiYeCQiIiIiIiIiIiKjY+KRiIiIiIiIiIiIjI6J
RyIiIiIiIiIiIjI6Jh6JiIiIiIiIiIjI6Jh4JCIiIiIiIiIiIqNj4pGIiIiIiIiIiIiMjolHIiIi
IiIiIiIiMjpbXTOsXfuDKcpBREREREREREREVkRn4rFDx1BTlIOIiIiIiIiIiIisxJkLF3ipNRER
ERERERERERkfE49ERERERERERERkdDovtVansLAQ0TEncT/5PsrLK4xdJiIiIiIiIiIiambs7e3Q
KqglIsIHwMPd3dzFoQaTGJ54LCwsxMYtW1FaWtoYJSIiIiIiIiIiomaovLwCSXfuIDUtDXNnzoCL
i4u5i0QNZPCl1tExJ5l0JCIiIiIiIiKiRlFaWoromBhzF4OMwODE4/3k+41RDiIiIiIiIiIiIgDA
/eQUcxeBjIAPlyEiIiIiIiIiIssikZi7BGQEBiceW7Vs2RjlICIiIiIiIiIiAgC0CgoydxHICAxO
PEYMGABHR8fGKAsRERERERERETVzjo6OiAwfYO5ikBEYnHj0cHfH3JkzENK+Hezt7RujTERERERE
RERE1MzY29ujfbt2mDltKtzlcnMXh4zAtj4Lubi4YOzo0cYuCxEREREREREREVkJPlyGiIiIiIiI
iIiIjI6JRyIiIiIiIiIiIjI6Jh6JiIiIiIiIiIjI6HTe4/FkTIwpykFERERETUBlZSWys7NRUlIC
Gxsb2NnZwdbWFj4+PuYuGhERERFZEBtHp/o9XIaIiIiImqfc3FyUlZXB1dUVvr6+sLe3R3Z2NkpL
S+Ho6Gju4hERERGRBWHikYiIiIj0JggCXF1dERISAn9/f9ja1nydLC4uNnPJiIiIiMjSMPFIRERE
RHpzcHCAg4MD/P394e7uDqDm8mtbW1tUV1ebuXREREREZCkkEj0Sj7179xb/LwiC0r+kTCKRKP2r
ivEzHsba+BhT68c6Ni3Gu3lprvVdVFQEAOjatavRPrO5xtJYGD/rwzq1HKwLy6CuHjTVCZGx1e7f
7PPaSSQSXLt5U/8zHqurqyEIAgRB4K/ZGkilUkgkEkgkEkilyg8MZ/yMi7E2PsbU+rGOTYvxbl5Y
38bDWDYM42d9WKeWg3VhGbTVA5GpsM/rpuifeiUeq6urlV7M5qpXXV0NqVQqBlfxL+NnfIy18TGm
1o91bFqMd/PC+jYexrJhGD/rwzq1HKwLy6CpHohMhX1eP4qErM7EoyKQMpkMXbp0gYeHBzu2BtXV
1cjNzUV8fLzSDdYZP+NjrI2PMbV+rGPTYrybF9a38eiK5aBBg8xYuqYjOjqabdFKcHyxHKwLy6Cu
HmxsbMxcKmoumCPTX3V1NRK+/VZ34lFx2mhwcDBsbGzw+PFjU5SvybKxsUFwcDCuXr0q3meC8Wsc
jLXxMabWj3VsWox388L6Nh5tsST9sC1aF44vloN1YRnU1QORKTBHZjidaVlFUJ2dnU1RHqvg7Oxc
53p/xq9xMNbGx5haP9axaTHezQvr23jUxbJly5bmLlaT0bJlS7ZFK8PxxXKwLixD7XogMhX2ecPp
dcajIAj8FcFAirgp/s/4NR7G2vgYU+vHOjYtxrt5YX0bj2osyTBsi9aHdWo5WBeWoXY9EJkCc2SG
0yvxWPtf0p+6x6xT42CsjY8xtX6sY9NivJsX1rfxMH4Nw7ZofVinloN1YRkYezIl5sgMp9cdMBlQ
w3EnZDqMtfExptaPdWxajHfzwvo2HsayYRg/68M6tRysC8vA2JM5sN0ZRucZj8Zy4cIFnD17FpmZ
mRAEAR4eHujZsyeefPJJi3oCVWFhIT744AN07twZzzzzjMnWm5ubi08//VT829bWFu7u7ggNDcXg
wYPh6Oio8zNSU1ORlpaGvn37Grx+QRBw5swZnD9/HllZWbCzs4Ovry8GDhyI0NBQgz/PmGUztjVr
1iApKQnLli1DYGCg+P6BAwdw7NgxTJ48Ge3btxfrY9CgQRg9erQ434YNG3Djxg3Y29vj3XffrfP5
iroMDg7GokWLGn+D9NSYdfDZZ5/h0aNHaqcFBgZi2bJlRl+nOob23/rGpDnWsT5jlCHxN2Te5hhv
fcapzp076xVDY5VTV53VbiOGjpvGKoO59uEN1dzGUEvzMCsXM5d9KP5tZ2cLfx8PRIaFYu6kYXCW
OSInrwCTX/gXIsJC8cHy57R+niHzWhpzjvUAkJ6ejkOHDiE5ORklJSWQyWQIDQ3FmDFj4ODg0ODt
qy9jjC3m6i+WsP+uzcXFBW3atMG4ceMgl8vrvV2XLl3C3r17UV5ejtGjR+O3334Ty2Sp+4LGjIe+
jBUbS40xUVOjblxQcHFxwZtvvtmo6zfVvskkicc9e/YgJiYGbm5u6N27NxwdHZGQkICDBw/iwYMH
mDt3rimK0SR4eXlhwIABKCkpQWJiIqKjo3Hjxg0sXbpU5xeuo0eP4vHjx/VqNLt378bp06fh4eGB
fv36wcbGBlevXsXGjRsxdepU9OnTp76b1OCyGVvv3r2RlJSE69evKx3Qx8fHw9bWFt26dUNJSQmA
mqelXb9+XTyArqysRFJSEqRSvU4WtiiNWQdDhgxBaWkpAGDv3r2ws7PDiBEjANQMmJbKktqlMZhi
e7SNUY6Ojpg3bx5cXV0bbf2WpDHjrc84ZWtrq1e8Td3OzTluNtU2yDHUMgT4eWHy6AgUFpXg3JUE
bP7tGE7FxuO7D/4EV2cnvP/6s/DycDN3MU3CHGN9eXk5Vq9eDUEQMHjwYLi6uuLmzZs4e/YsysvL
MX36dKOuz9TM3V/Muf/29PREv379IAgC0tLScPXqVeTm5uKll16q9z3Szp07h8LCQrzzzjuwsbGB
XC5vMmN/Y8RDX8aq66a6vyWyVIoxujY7O7tGX6+p9k2NnnjMycnByZMn4eLigldeeQUymQwAMHLk
SERHR8PDwwPV1dWQSqVITU3Fvn37kJqaCicnJwwdOhR9+/ZFfn4+Pv74Y/Tt2xc2NjaIjY2Fs7Mz
xo0bhy5dugCAzmXDwsKQm5uLgoICvPrqq7hx4wYOHjyI7OxsyOVyDBkypMHJNWOQy+WIiIgAAAwb
Ngzbtm3D5cuXcfr0aQwePFhjuT///HNkZ2cDAP7+97/jzTffREpKil7b+OjRI5w5cwZubm54+eWX
4eTkBKDmjJWNGzeioKAAgO4Ya6ofdWXLy8szqL6MqWvXrvj1118RFxeHUaNGAQCys7ORmZmJbt26
wdHRUUw8+vv748GDB8jIyICfnx8SEhJQUVGBgIAAcZt0qb1NVVVVuHbtGry8vDBr1iwcPXoU8fHx
8Pf3x9y5cyGXy5GXl4dPPvkEXbt2hY2NDeLj4+Hk5ISJEyeic+fOYp3t3r0bd+7cgUQiQatWrTB2
7Fj4+/urjWF1dXWdOjDmwWztdrV//37Y2dmJ7RjQr38aKzaqDOkzmtqlLs2hjhW0jVFhYWH46aef
lH79vnDhAqKjo5GXlweZTIY+ffpg+PDhdT735s2b2LBhA3r37o2pU6dqLUNziLc+41RhYaFSvPUp
5/z587Fu3Tr069cPEydOBACsWrUKd+7cwXvvvQdbW9sG7x/1HTe1rSc9PR179uxBamoqHB0d0atX
LzERB9QkNw8cOIDTp09DJpOJ+5vS0lK1ManP9wdAc/s1dhK1OYyhpoplQ/h4yTH1qYEAgGenjsAH
X2/G4ZhL2Lk/Bk8N6Yu3PluvdBbjnqPnsGX3MTzMyoXc1RljBodh/rSRdT73zMUbeOPTdRg1KAx/
fXG6xuUsKRbmGOtzc3NRXFyMLl264MknnwQA9OzZEyEhIfD09AQAvfq0pjarT/vXtR2axh5A+35E
XX+5efOmSfuEOfff7u7uYp0CNXWdkpKCnJwc2Nraqv3ury2e3377LVJSUgAA77zzDsaMGYN9+/Zp
PfvOEsZ6feLh5eVl0HHtggULDNoPqO4ndW2/pmnqPkef71La+m5T2E8QNZbaY7Sqb7/9FqmpqXjj
jTfE443PP/8cjx8/xltvvYWMjAyj5Wkaa9/U6L347t27EAQBPXv2FJOOZWVlKCoqQlhYGNq1a4fq
6moUFhZi9erVyM/Px+LFi9GzZ0/88ssvePDggXgp9uXLl+Hp6YmZM2eiqKgIO3bs0HvZa9euISAg
AKNHj0ZBQQE2bdoEqVSKJUuWQC6XY8eOHcjKymrscBhEIpEgMjISAJCYmKi13LNnz4atrS18fHzw
4osvorKyUu9trF1HiqQjAMhkMixevBiDBw9uUP2olq2qqsqg+jI2Ozs7dO3aFVlZWcjMzAQAxMXF
AQB69eqlNG+rVq1ga2uL69evi/P5+vrCzU3/Mx5qb1NISAgiIyORkZGBH374AR06dMCgQYOQmpqK
6OhoADWXwAA1ZzZ16tQJixcvhiAI2LJlC8rKylBRUYEffvgBKSkpmDRpEiZOnIiUlBRs2LABlZWV
amOoWge167mx6ds/jREbVYb0GW3tUpfmWseqY5SqR48eYceOHWjZsiVeeOEFDBw4EKdOncKtW7eU
5ktPT8fmzZsREhKCyZMn61xvc4i3IeOUurhoKqdiP6yJMfaP+oyb2tZTXl6OtWvXIisrC9OnT0fX
rl1x7NgxnDhxQlz+7t27KCkpweDBg5Gfny/ubzTFpD7fH/Rtv43NGsZQS4mlISQSCaaPrUkMnL+a
UGf6g4fZ+PfK7ejUriW+encppo99Ejv2xeD0xRtK891OTse7X/yMsB4d8PriqXovZ0lMNdZ7eXnB
1dUVN27cwObNm3HhwgVkZ2cjLCwMwcHBAHT3aW1tVlf712c7NI09uvYjqv2luLjYrH3CXPtvBcW+
qKqqSu2+S1c8p0yZAj8/PwDAiy++iI4dO2pdn6WP9bXjYehxraH7AVXatt+Q2Oj7XUpT37WEeiAy
p4qKCuTm5iq9FCdD9ezZE4Ig4MaNmu8KmZmZyM7ORteuXVFWVma0PE1j7pv0PuOxvqd9K4Ill8vF
z9i3bx/Onj0rzjNv3jyUlJSgrKwMQ4YMQVBQEPz9/XH8+HHExsZi2LBhAABvb28MHFjzS3S7du1w
48YNFBYWIjExUeeycrkcY8eOBVCT+Fy6dClcXFzg5uaGLl264M6dO3j48KH4xUYikRj1VHddn1V7
eu3/u7u7AwCKi4vh4OCgsdzdu3cHADg4OKB169Zat9HX11dp3YrLu1xdXTWW89atW/Wun4CAAKWy
XbhwwaD6MpQ+9da7d29cvHgRcXFx8PPzQ1xcHFxcXNCpUyelure3t0dISAji4uIwdOhQ3Lp1C337
9kV6errGdanWpeJvHx8f9O7dGwUFBTh27Bjc3d0RFhaGkpISHDlyBFlZWUrzBwQEiAmGHj16ICYm
Bvfu3UN5eTkeP36MoUOHonfv3gBqfsU9deoU7ty5I16WqS6GijowVH36gmIZfdqOsWITFBQkrlsi
kRjUZ7S1S8XnqotHc6ljfcYoxfuKbVTcdDkrKwtZWVno2rWrOEYUFhYCAIqKirB+/Xq4ublh7ty5
au/52xzjDeg/Tin+r/hbWznT0tI0lkFXn9G1fzRk3NS2noyMDBQWFmLEiBEIDQ1Fx44dERwcDBcX
F3EdTk5OmDRpEgDgzp07SExMRGFhodh+VGNSn+8P4eHhANS3X0M19zHUmLE0JR+vmvGtoLCkzrSq
qppEd0paFpIfZOLJft0wfVxNojInr+ZKkdz8Qvz947Xw8nDFu6/Og42NVOtypmDJY72dnR1eeOEF
HDp0CAkJCbh69SqAmv779NNPIyQkRGefdnR01DmGaWr/Xl5eOrdD09hz//59rfsRRWJM0V8UP+aY
YnyxhP13RUUF8vLyIAgCUlJScPv2bXh4eMDHxwfFxcUAlPddV69e1RlPe3t7AEDr1q3FMqmO/Yr/
axtHTTnW6xOPixcvGnScpNh2Q/cD+tS1tnaqGvObN2/q9V1KU9/VVg4iS2WMfJHiM1JSUurc63Ho
0KEYOXIkevTogT179uDGjRvo27cv4uPjAdQcKxgzT2PMfZOqRr/UWvELTn5+vvheREQEQkNDcfPm
TZw6dQoAxJ3O4cOHcfToUQA1DzypfbN1xQ4SgPiwlYqKCr2WVXyZUIiOjhYPOBQDXVVVlRG22Lhy
c3MB/HGPJ0PKre+86upIQXEZfEPqR1V96svY2rVrB7lcjvj4eISFhSE1NRUDBgxQewpxaGgooqKi
cPXqVRQVFSE0NFQ8gDaE4mwfxb06FXWq+Fv1bJ3a90xxdnYGULOTVySKa8dbcTPq/Px8ccfe2DHU
lz71bazYqKNvP9CnnLo0xzpWHaNq8/Hxwbhx43Ds2DFs27YNABAUFIQ5c+aI9yxJTk4Wz0IpKCgw
aJusPd6GjFO1NbScxtg/6jNualpPUVERgD/qy9bWVnzImaKf1/4BTVHvFRUVGh9WV5/vD9rar4eH
h0HxaAhrGEMtJZaGepiVAwDwdK97D7NWgb5Y9uwEbNr1Oz78ZgsAoFO7lnj31Xmws/vfmXWJ92Fn
ZwsJapKQTo4OWpfz87HcWJhqrPf29sasWbMgCAKysrIQHx+Pw4cPY9OmTUo32NfUpx0dHXW2WU3t
v1OnTjq3Q9PY8/jx4zrlqr0fMSRmpuoTptx/p6Sk4JNPPhH/dnFxwfTp05X2Z7WXNzSeulja+KQt
HvU9TjJ0P6Cgbfv1aQcKuupM8V1KU9+1hD5BZE5+fn4YOVL5di0+Pj4AavpzcHAwEhMTUVlZibi4
OLi5uaFdu3biFUHGyNM0Xj+U6J94rO/jwoODgyGVSnHx4kUMGjQILi4u8PHxgY+Pj9IljIqBaeDA
gUr3OrKzsxPXLQiC2nLos2ztbThx4gSuXLmCp556CpGRkYiOjsaBAweUPl/TuupL12epK6cgCDh+
/DgAoFOnTgaVW595Fdq1awepVIrLly9j8ODB4pew4uJifP3112jVqpV474361I/qdEPry1D6Lter
Vy9ER0fjwoULEAQBvXv3ViqrQufOnSGVSnHo0CF4eHgoPehB2/Yq/q+6/Zqmq/6t+CUU+ONLlouL
i/gLb25urjhd8eVRLpdrjWF923VDljGkbzc0NvXpB4a2S9V4NJc61meMUjcWhIeHIzw8HDk5OYiP
j8fevXvx+++/i/fra926NSZMmIBvvvkGu3btwvz583WuuznEW0GfcUpTHNSVU3GQV/uAPC8vT5yn
IftHQ8ZNbetRHCw9fvxYXNeZM2fg6uqKNm3a6FUG1Zhoml9Xv9fUfhVnPOmLY6jxYmkqgiBg6+6a
SxP79+qkdp4pYyIxZUwk0jIeIeZCHL776b/Y+OtR8T6PXTu0wZ+fn4TFf/8CK9b8gn+/sVDrcn9Z
NMUk26XvdFOP9bdv38aVK1fQq1cvtG3bFj4+Phg0aBCSkpKQlJSEoqIicQzT1Kf1abPa2r+u7dC0
XkXSR9d+RJ+YGXt8sYT9d+0DagcHB7Rs2RL29vYa9136xlO1zJrGfksZ6/WJh6HHSfXdD+jbFvXt
E/XpA6qxaWr7CaL6fL/T9BnOzs5izkXd9J49eyIpKQnnz59HamqqeJ/YhuTRGnPfpKrRz3h0d3dH
ZGQkjh8/ji+++AJdu3aFs7MzUlJSkJiYCEdHR3h6ekIul0MmkyEuLg7t2rVDZmYmzp07hyeffBIh
ISFa1xESEmLQsor7GBUXF+Pu3bvipRyZmZlo1aqV8YNggLy8PBw/fhwVFRVISkrCvXv3EBAQgH79
+uHgwYMA1Je7vLwcdnZ2yMnJwY0bN8RfnTTNqzjQBmoa65NPPoljx47hq6++QmhoKGxtbXH16lXk
5eVh8ODBBsdYVe2ytWrVqkGfZSy9evXCsWPHcPz4cfj4+CgdGNcmk8nQtm1b3L59W+MNXxtDZmYm
oqOj4eXlhStXrsDR0RFt27YFUFNnZ8+eRYsWLVBZWYlLly7B29sbwcHB4tlbqmrXQXBwsM6npBtL
Q9uOOppiU15erjSftr6u2me0tUtN99RrqKZYx9rGKNVyKe7TNWzYMHTo0AEeHh6QSCR17iWrWP70
6dO4fv06unbtavRyA00z3vqOU9rULmdQUBDs7OyQkJCApKQkpKamKp3pZqz9o65xU9t6BgwYAJlM
hrNnzyIgIAAPHjzAkSNHMGLECDHxaCzaxidHR0ed7dcUrGEMtZRY6pL1KB9bd0ejtKwcF64l4trN
uwhpE4jxw/ujqFh5HDh5IQ7vffkznp06En17dEALH09IJRK4yBzFeeRuzmjfJgBPjxyAX/afRPSZ
q7C1tdG5nCUwx1hvb2+P2NhY3LhxA2FhYXBzc0NmZibu3LkDLy8vuLm5aTwzV0GfMUxT+9dnOzTp
2LGj1v0IoDwWl5aW4pdffjFpnzDn/lvTAbUm+sTTEJY21muLR2OM+dpoq2tD+oSuOtP0XUqfchA1
B4oxWlVYWBhkMpn44MkDBw4AqElEAg0fM0y1b2r0xCMAjBkzBt7e3jh79ixiY2MBAB4eHoiIiMDA
gQPFX0jmz5+PPXv2YMOGDXBwcEC3bt3QrVs3nQOVk5OTQcuGh4fj3r17iImJQVJSEqZNm4aoqCjE
xMTUuf+hqeXk5GDfvn2QSCRwc3NDeHg4RowYAVtbW63lbt++PcLDwxEdHY2oqCjMmTMH6enpGudt
166d0npHjRoFLy8vnDlzBufOnYOtrS18fX0xduxY8UtEfesHgFLZli5d2qDPMhZfX18EBgbiwYMH
GDRokNZ5u3btitu3b4uX+5lChw4dkJGRgcOHD8PZ2RmTJ08WE8YLFy7E7t27sW3bNkilUrRv3x7j
xo0TL3lRR7UOTJV4NLR/6kNTbFQPmg3pM9raZWNpinWsbYxS1bFjR4SHh+P06dM4dOgQnJyc8MQT
T2Do0KF16mrEiBG4cuUKdu/ejZCQkEYpe1OMtyHjlCaq5Zw0aRL279+PjRs3om/fvujUqROuXr2K
6upqo+4ftY2buvrmggULsGfPHmzduhUODg4YNGgQBg8eLF6CZizaxiepVKqx/ZqSNYyhlhJLXdIy
HuG7jf+FVCKBl6cbpoyJxILpo+Bgb1cn8di/V2dMHh2JnftjsGbLfri5yvDU0L54duoIFJcoP6hn
wfRROHLyEr5a/xvWffYXjctZEnOM9S1btsT8+fNx7NgxnD9/HiUlJZDJZOjWrVudy8800WcM09T+
DdkOVfb29jr3I7X7y4svvmjyPtGU9t/6xNMQTWGs16esjXGcpK2uFcef+rSDhtaZtnIQNQeKMVpV
586dIZPJ4ODggI4dOyIuLg7+/v5o0aIFgIaPGabaN0lOxMQonXN5MiZGaYauXbuisrJSfPIZ6Scm
JkYcZBm/xmVtsS4sLMSHH36Izp07Y968eWYpg6XG1BJiYwyWsB2WWseNgfEmU7PU+raEvmAo1Vg+
/fTTZi5R07Jr1y6LbIvm0BTbvzqWOr40R6wLy6CoB1OdVEFUVlbGPm+AH3/e1Pj3eKQajJ/pNPVY
a7tPm7lYYjkspUz1YYnbYSnlaAyMN5mbpdS3JfYFMq3mXO/W2v6taVuaOtYFUfPCPq8/vROPmp6E
Rfph/EynqcdaUX5BECxmWyytHJYUm/qwxO2wlHI0BsabzM1S6tsS+wKZVnOud2tt/9a0LU0d64Ko
eWGf15/eiceqqqrGLIfVY/xMp6nH2snJCe+88w4Ay9kWSymHJcamPixxOyylHI2B8SZzs5T6tsS+
QKbVnOvdWtu/NW1LU8e6IGpe2Of1xzMeTYTxMx3G2vgYU+vHOjYtxrt5YX2TpWBbtD6sU8vBuiBq
Xtjn9SOBAYnHioqKRiyK9WP8TIexNj7G1Pqxjk2L8W5eWN9kKdgWrQ/r1HKwLoiaF/Z5/THxaCKM
n+kw1sbHmFo/1rFpMd7NC+ubLAXbovVhnVoO1gVR88I+rz+diUeJRAKJRILKykpTlMdqKOKm+D/j
13gYa+NjTK0f69i0GO/mhfVtPKqxJMOwLVof1qnlYF1Yhtr1QGQKzJEZTu/EI69fN4zqjojxazyM
tfExptaPdWxajHfzwvo2HiYeG4Zt0fqwTi0H68IyMPFIpsYcmeH0SjxKpVJmcw0klUrFAZDxa1yM
tfExptaPdWxajHfzwvo2HtVYkmHYFq0P69RysC4sQ+16IDIF5sgMpzPxGBMTY4pyEBERERFpdfr0
aXMXgYiIiIj05Onnrzvx+P7775uiLERERERERERERGQl/u+rr8FrVoiIiIiIiIiIiMjo6pzxWFlZ
idzcXFRVVcHe3t4cZSIiIiIiIiIiIqImrk7iMTs7GyUlJbCxsYEgCOYoExERERERERERETVxdRKP
ZWVlcHV1ha+vL894JCIiIiIiIiIionqpk3h0dXVFSEgI/P39YWur89kzRERERERERERERHXUySzK
ZDL4+/vD3d3dHOUhIiIiIiIiIiIiK1An8SiVSpGQkAAXFxcUFhYiMjLSHOUiIiIiIiIiIiKiJkyq
+oa9vT2qq6tRWlpqjvIQERERERERERGRFVB7E8eqqiqUlJSYuixERERERERERERkJeqc8UhERERE
RERERETUUEw8EhERERERERERkdEx8UhERERERETQXYCPAAAgAElEQVRERERGx8QjERERERERERER
GR0Tj0RERERERERERGR0Rk08Pnr0CH379sWUKVMwZcoUTJ48GXPnzkVsbKwxV2NS9+7dw/jx4+u8
P2zYMDx69EjjcufOncOf//znBq//ww8/xO7du+u1bFlZGaKjo/Hzzz9jy5Yt2LlzJ+7du9fgMunj
wYMH2L9/v9J7eXl52LRpU515169fj+LiYoM+qz5OnDiBW7duGbxccXExVq1aha1bt4qvI0eOoKys
rMFlMoQ1xW/nzp1IS0trcJkaQ1ONMxEREREREZGlsTX2B7q6umLHjh3i39euXcNrr72GAwcOQCrl
CZamdPjwYXh6emLWrFmQSqXIzs7Gvn374OzsDB8fH3MXr0mxt7fHjBkzAACCICAmJgaXLl1C//79
zVyypqF2/AAgIyMDBw4cwLx58yCRSMxYMiIiIiIiIiJqLEZPPKrq1q0bKisrkZOTA29vb2zYsAEx
MTGoqqpCcHAwli9fjqtXr2LdunVo06YN7t+/Dx8fH7Rt2xa3b99GcnIyVqxYAXd3d6xcuRLnzp2D
ra0tWrdujeXLl+P555/H66+/ju7duwMAli5dirlz5yI8PFztuuzt7Y26fWfOnMHatWsRFBSEkpIS
lJaW4v3331eaR125pVIpPvzwQyQnJ6OyshJdunTB8uXLUV1djXfeeQcpKSnw8vJCdXV1vcqVlZWF
x48f46mnnhITO97e3pgyZQqcnJxQXV2NEydOID8/H9XV1fDx8UFERATS0tJw+fJlyOVylJaWori4
GKNHj4adnR3Onz+P5ORkSCQSdO7cGZ07dwYAXLlyBcnJyaiuroaHhwciIiLqVebU1FRcunQJbm5u
qKioQGVlJYYOHao0z4ULF/DgwQNIpVK4u7sjPDwcEolE7bYIgoBjx44hPz8fMpkMgiDUq1yqJBIJ
goKCcOvWLY1xTElJQXx8PEaNGgUAiI6ORkBAAIKCgnD06FFUV1ejsrISHTt2RJcuXQCoj6ONjY3V
xQ8A/Pz8UF1djZKSEshkMrXbXl5erjZWmmLr7OyMS5cuwd3dXSyzh4cHcnJykJ+fj9GjR8PR0bFZ
xZmIiIiIiIjInBr9FMTff/8dcrkcnp6euHjxIi5cuIAffvgBa9asgVQqxZ49e2Bra4s7d+7g1Vdf
xZdffokjR46gQ4cOePfddxESEoKYmBhcuHABp06dwqpVq7By5UoUFhZi7969GD16NA4fPgwAyMnJ
wd27d9GvXz+N6zI2qVSKpKQkLF++HB999BH8/f2xa9cucbqmcufl5aF9+/ZYtWoV1q1bh0uXLiEh
IQEnT55EZmYm1q1bhw8//BBJSUn1Kldubi58fX3rnE0mk8kgkUhQWloKT09PTJgwARMnTsTDhw/x
6NEjSKVSPHr0CP369cOwYcMgk8mQkpKC1NRUpKenY/LkyRg/fjxu376NiooKpKenIy0tDePHj8fT
Tz8NiUSChISEepVZIpEgJycH4eHhGD58OFxcXJQuOU1LS0NKSgomTJiA8ePHo7y8HImJiRq3JTk5
GUVFRZg4cSKGDRuGnJycepVLVXV1Ne7evQs/Pz+N69bk7t278PT0xPjx4zFhwgRUVVUBgFHi2FTi
p4iDo6MjnJycNG67plhpIpVKkZubiwEDBmDMmDG4e/cuvLy8MGTIEHh5eSE5ObnZxZmIiIiIiIjI
nIx+xmNBQQFmz54NAMjOzkbr1q2xYsUKSKVSxMbG4u7du1i8eDEAoKSkBO7u7mjbti3atm0LW9ua
4sjlcnTo0AEA4O7ujoKCAmRnZyMsLEy8XLt3796Ii4vDCy+8gPnz5+O1117DkSNHMGLECNjY2Ghc
lzEpknqdOnWCk5OT+P+rV6+iffv2AIDr16+rLff48eORn5+Pl156CY6OjsjOzkZeXh4SExPFszft
7e3Ro0ePepdP29mSTk5OKCsrExO/xcXFKC0thY2NDdzd3cW6UMyXl5eHFi1aQCKRwM7ODuPGjQNQ
k2TJzc0V70NZUVEBR0dHuLm5GVTW2mdl2tnZif/PyMiAp6cnACAzMxMBAQHivC1atEBWVhY6duyo
dltycnLg5+cHALCxsRH/Xx/l5eXiLQQEQUBgYCC6d+8OqVSqdt2aBAYG4tq1aygvL0dQUJB4tqOm
OOqrKcWvuLgYcrkco0aNgkQi0bjtHTp0UBsrbTw8PMS+5uDgAC8vLwCAo6MjysrKUFBQYNVxJiIi
IiIiIrIkjXKPR8WDGQ4ePIioqCi0adMGQE0ibdiwYXUeunL58uU6lzrWvh+kpksPJRIJvLy8EBQU
hLi4OBw6dAivvvqq1nUZSiaTIS8vD4IgiImE8vJyFBYWQiaTAVBO8FVXV+u8Z51EIsGePXuQkJCA
r776ClKpVEyQ1l4PAJ1neWni6emJ8+fPo6qqSim22dnZ4lmMjx49Ei/Frv0AG9V7caqWqTYbGxsE
BwfXudfhgwcP6sxrZ2eH0tJSpc+rqqpCeXm5mMSpXdfa1ltbQkKC2m1RbTcNuYTV3t4eU6ZMqfP+
rVu3NMZR3brlcjmmTp2K9PR03LlzB1euXMGkSZM0xrE2a4nf7du3ER8fL/4QoG3b1cVKVe1yqW6v
6t/WHmciIiIiIiIiS9Kol1qPHDkSMpkMW7duBQD07NkTJ0+eRHl5OQDgp59+wo0bN/T6rO7duyM2
NlZM8p0/fx7dunUDAIwZMwa7du1Cfn6+eN/BhqyrNl9fX4SEhCAqKgpATWJx1apVGDRokHim1K1b
t1BYWAgAuHjxoni2prZyZ2VloU2bNuKl2omJiaioqEBwcDCuXbsGoOYszStXrhhcZqDmLCxPT0/E
xMSgoqICQM19Hw8ePIji4mL8//buOzyO6lwD+Du7s0W7q7Lq1bIsuTfcbWwwtsGhGXJDryG5dAi5
ycVACCGkw4WEQAIEQhotEEIAY7odbCODK457l1zUu7S9zv1jpbV2tTO7K6/6+3sePyBpdubMnG/O
OfPNmVm73Y60tLTgY6PNzc2KSc6cnBxUVVVBkiT4fD68++67cLlcyM3NxYkTJ4Kf3blzJxobGyOu
w2g0IiMjA/v27QMQSLBs374do0ePDs6wbGpqCtZZbW1tcMZaVxlqa2uDiZnq6mrk5OTI7ovZbEZD
QwOAwMy2urq6Xh1LJXLb1mq1wZmPkiQFj0llZSWam5tRWFiIs846CzabDV6vN6bjOFyOX2lpKTQa
Dfbu3QsAsvsud6zkjm0sRtJxJiIiIiIiIhpoff7lMg888ABuvPFGLFy4ENOnT8dFF12EW265BTqd
Drm5ubjqqquCF/hKZs6ciTPPPBO33347VCoVSkpKcOGFFwIAli5discffxw33XRTcHm5bfXGo48+
iscffxxvvPEGBEHA1KlT8dBDDwX/XlZWhscffxyNjY3Q6/VYsWJFMHkoV+66ujqsXLkSd955J0pL
S/Gtb30LTz31FP7whz/g008/xU033YTs7GxMmzat1zOgzjvvPGzevBmvv/46NBoNDAYDlixZgszM
TOh0OnzyySdoamqC2WzGjBkzsHnzZsyZMyfiurq+GOWdd96BJEmYMGFC8LiOGzcOq1atgiiKMJlM
mDJlimzy5Nxzz8XGjRuDSaecnBycffbZwb+np6dj48aNsNvtEEUR48aNCyZl8vLyUFRUhNWrV0MQ
BKSlpWHs2LGwWq0R9+Xiiy9GRUUF3nnnHRiNxj55hLWsrEx221qtFp9++il0Ol1wdl9aWho2bNgA
lUoFv9+PadOmQaPRyB7H4Xr8Fi1ahLfffhtFRUWy+y6KYsRjlZ2dHfHYxmKkHWciIiIiIiKigSIA
ED4vLw/Jam0sLw9Z6P777+/PMg05W7ZswWuvvYbf/va3A12UIa+6uhq7d+/G+eefP9BFGZJ4/PoH
jzMRERERERFRdL/53e/7/lutiYiIiIiIiIiIaGQR0A+PWg93c+fOxdy5cwe6GMNCQUEBCgoKBroY
QxaPX//gcSYiIiIiIiKKDWc8EhERERERERERUcIx8UhEREREREREREQJx8QjERERERERERERJRwT
j0RERERERERERJRwTDwSERERERERERFRYglMPBIREREREREREVGiSUw8EhERERERERERUaJxxiMR
ERERERERERH1BSYeiYiIiIiIiIiIKOGYeCQiIiIiIiIiIqKEY+KRiIiIiIiIiIiIEo6JRyIiIiIi
IiIiIko4Jh6JiIiIiIiIiIgo4cRoC1S1OPqjHERERERERERERDSMRE08JmuS+qMcI05t9QnkFYzi
dmlAsD4IYBxQAOOAhgLGKfUVjo2pL7B+hzfW7+DC+jg9/XH8+Kg1ERERERERERERJRwTj0RERERE
RERERJRwTDwSERERERERERFRwjHxSERERERERERERAnHxCMRERERERERERElHBOPRERERERERERE
lHDiQBeAovP5vaipq8fJ6ho4vF643CLUfgF6PVBUmIui/Fxo1KxKIiIiIiIiIiIaLAQmHge71o52
VJw8gZQUA86YMhZ60QBJrYXb7kGHzYZjVU04fmI3pkwqQZY5baCLS0REREREREREBOA0HrU+dqwC
JcXpKBuThaamxuDvt23dhJLidKxfvzbk/yl+bR3tqKmrxuSyQsyeVAqzOQ0uSQuvE5D8GqTo0zBp
dBny00uw50AVGlvbB7rIcbv6qhVYuGBayO/+77GforQkEx+8/65i/Hz4wSoc2L+319tWis+/v/Y3
LFsyFxPG5WHWjLH4n3tuhc1mHTExLXd+K2F9DD8D3c53j6lEb2dj+XqUFKcH/02dXIxv33QVqqtP
Kn5upPVxcucecPrnfKJ1r9NxZTlYes4c/Pjh+9DR0fd940iIhcHuxIljuOP2b2L61BJMHF+AS1cs
w9q1Hyds/f3VHsUbu4PtPKTEURqLhdf76cRBIuL5pz95EJMmFPb4/aIzp4f0tV3/fvjg93u9reFi
oMdYicI2qKdEjJ14XBODbdDpSeTYuteJx1XvvgWNRgO/348333gXfn/o3y3twISJM/DZuv9gbOlC
uN293dLI5PN7cby2GuNLipCTaQYAiAIAF+C1A1Yr4LAAHjeQaU5DTloRdu+vhMfnHdiCx+nSSy9H
TU0VNn+5J/i7NWs+wty5izDjjPPx78/k4+enP30Qe3bvxenusqUdIes/fOgAHvzB97B48dfw6quf
4Xvf+wVWr34bv3ni15gydWTEdLTzOxLWx/ATSzvv8Zz6/0TXQfeYmjqtb+r61lvvx/PPr8LKlY9h
8+YvsfJ//yemeB8JfZzSuSdJiTvnE+3WW+/Hk0++jvPOuxxvvP4Kbrj+Cvj9Up9us6/ik2Lj8Xjw
zRsux+ZNG3H33T/Ez3/+AlJTs3H7rTdg+/YdCdlGf7VH8cbuYD0P6fQp9cHh9Z6IOEhEP94cdq/6
d8/8CS+8sApXXnkzAOAnP3kWzz+/Cpdfdhc68zAj1nC5lmYbFCpRYyce18RgG5QYiRhb9zrxuHr1
25g372xMmTILn3zyL7hdPZfZvWsHlpxzBg4d3ghIbjxw/3cxY3oppk8twY8fvg+SJMHtduO+ld/B
GdPGYNKEQtx5x02wWDp6W6xho6a+GXqdDhnpyThe24jn/7UGr374OUSNAxlZQF4+sG7/Fvxh9bvY
dHAnJo1PhkFvRE19fa+29+SvHwn+608XXHgJNBoN1q//CD4vcPLkcRw+dADLv3YZDh3egaVLAvHz
1fZylBSn49FfPYLJE4swYXw+6mprsHLl7Xj22d/ik4/fR0lxOvbt3Q0g9M6r2x059uTU1tUAAMzm
fEyYOAHXXHslNpTvwx13PIxtW0/F9N9f+2PInZNpU0YH1/GnF5/FvLmTMGN6Ke7937vgcjr77iD2
AaXz+9VX/oLFZ83ElEmjcMft34TF0oFzzp7F+hiGYmnnw731z79j6TlzMGlCIS5dsQzbt28J/i1S
7MjFQ3hMde9PtBr57Wz6MtBWPPvMk1gwfwpmnlGGf775mmx5S0snYtFZi3DNtVdj0aIl2L9/J6wd
yvvRJbxMkfbv2zddhXOXzgt+5q47v4XFZ81UjPnBQuncC68fIHqddLXfVVUnIta53+/Hjx66F1Mn
F+OC88/CfSu/g4njC4LlifU8Li2diCVLl+De++7HPd/9IXbt3IZPP14fUxl/++RjmD1zHObPm4y1
az7C1y85F1MmjcLvf/drAPLtV/dY6OqvYo1BOn1rPv0Qx45V4IEHnsDll9+Miy6+CM+/8ApWrvwF
9NpMbCwPjcGG+rqI8TQY2qNIsRtruQD2d8OJXB8cXu/hPyuNsyL1U1327QuMu8PjNFJM+f1+/Pjh
+zB1cjEuunAxamurI+7DjBmzsWTZIpSVlQAAJk+ehcXnLMKUqaX44IPo/exwFu+1tKiW7yOV2ppY
+zcgcl0rrTtSGzTSxTN2irVtj3ZdxVyKPLk26KmnHsQlK3qOz7tm+P3kxw9gyeLZmDNrPN78x6vB
5UZqH6s0tpYbT3WPS6CXicdDB/fj8KEDOPe8r+P88/8LO3duxokTNbLLWy3AwYOHoVap8fwL/8L/
/d/f8NLfXsS/127AhvVr8eY/XsXLr3yMVat2AJIOW7fswhC4JutTJ6o6MG1cEf6xZhNu++WL8Pkl
bN1/GCuf/QsEvRerv9yIdbu2YGypCa+t+RDrd27H4nklqK5r7dX2Zs2ahVmzZqG4uBipJ96Get8b
0KjtqDuxB3vWv4H95W9hf/lbqD2+W3YdqY3lSG0sj2u7aWlmnHX2UmzY8BFcrsBsR41Gg3MWr4BG
E1jGagEkKfA60l079+L1N9bglZc/AwA8/PDvcNWV3wl21m2tCLkz1NwIVByNHHty5s1biMmTp+M3
v/khli2djP/5n//GV9vLYc4A9PpTZfr6f12Hdev34C9/+QRJSQacc87FaGkCvti4AT//2UP49RMv
4u13tmNj+ef44x9fBIZITCud3zt2bMNDP/xfXHf9rXjttXXYsnkTnnj8cfz5r/8AwPoYTuJt5wFg
9+4dWHnv3bjkkqvw7rvbYDSacevNN8BiccjGzlGZePjL30JjytXZr1stwPav5LcjioG24j87duO9
9zZh3Lip+NUvfxL8fDi/3w/Ai7r649i95yuUjBmnuB+RWC3A1q2R9+/a676Fo0cPY8f2Q/B6vfh8
w2dYseIatLcKvaiV/qV07v31pdD62bolep10td/HK1ugilDn69atwSsv/xm33Pp9/OqXf8XnG9ZD
EAQ0N8Z/HosioNEAy5YtAQAcOLAXX8UQN5UVVXjzn+vQ1tqKlffeg6d/9zecc86F+N3TT6Cj3RO1
/ereX8Uag3T6jhw5BAA444wzYTQB+iQgyaDGrbffgtKxRdBoQ2Nw65Z9EeNJrn77qz0CIsfuIZkx
dHi5Pvs3+7vhQqkPDq/35/4Q+vO+vZHjRa4f7rrm2rHjSzzxxJ+Qm1sUjFO5tnf9urV46W8v4q67
f4DHHn0Zu3bulN0XUQS6fwemqAH2H9iB+++LvZ8dbnpzLb1mrXwfqdTWxNq/ydW1qJZfd3gsOux9
fOCGgHjGTnLnavhxVbquYi4lukht0A03fgsVFT3H526XDgDQ1GTBe+9twbx5S/Dwj+5Dc5NlxF9T
RhqfbNgQ+ZhsWBcWl+jlt1qvWvUWRFHEmQuWQy068MQTD+HDD95GWdldsp/Jzs5Fc0szVt7739Bo
AputOlmDBWfOgVarw+23XYEzF56Fr3/j65g7ZxG8HkCj7U3phoeWVh+cHjf+uXYTrjxvPr59SaCC
L/n+/+GjL3bi4LEaqAQVbrxoMcYV5UMlCNDrRTjdvZuP7XK5gjNQN+xqhi4jC9L6DwEAC8+cCKgN
gFaPTes2o3HfNmizilBQNg6px7eiKm08mmurIHmcgEaPaVnxbfuSSy/D9757G+pqG7B2zUdYtGgZ
UlPT0NTcc9lLL70eo4vHo7n1BABAFDVITVNDq5Nff3ZO5NgzGkoiLq/T6fDOqjX45KPP8OWX6/HF
F2uw+r238c2btuHii1cEl0tKMsBg0OD73/s2ioqKcf/9j0OrAzZuDGT/77jjWghC4BGw3bt2wOkM
XAwNdkrnd/nn6wAAX1t+LXJyU7Bl20F0tAGNTayP4aY37fyG9WsgSRIuvfRm5OSm4ZprrsU999yM
r7btwa7dgXoIjx2bvTliPJSOCcRDV0zp9LFtx2gKLHP++ZdDpzNh4aKF2Lx5Pdrb3MjO7dmp/OAH
38YPfhD4/7y8Atx776+wsfyTqOsPt3Hjuoj7J2r8yM8vxJo1q+FwzoXVasGFF16jeI4MFkrn3s23
3AbgVP18+Ub0Oulqvx2uZrS80rPOm5sD7chFF16P/IIMLFu2HP/61+sAen8e+3w+AIBarca6z6KX
cfHiC5GVlY/i4hJkZhUg2VSAOXNn4/33/4GG+jZkyYxlIrVfscYgnT6VKnAf3e/3QdSE/k2vB1Sd
ef6uGPzgg8BFXXg8XXbZNQPaHnXXPXYzMiLHXXi5tm1jfzdcKPXBms4781317vaG/ixqI8fLnt2B
WYnh/dSevZsAAN/4xk2YNHEWzlt+AZ5+6lG0t7kV2l4bAGD5eVcivyAdS5edh7f++feY90+pPV68
ZE5iDuIg1psx1u5dgYv3SH1kl0htTZdo/Vt5eeS6njFjtuy6w2Oxe9s4UsUzdpI7V8PbdqUx45jS
scyl9MKSpcsjjs9bWqsAAEuXrgAEFZaffx7ef/8f2LvnMDZtZh8LhI5PNsq0G+cuOz8kLidOndC7
xOPq996G1+vF8uXjg7/75JN/4bbb5RvL559/Eus++xSfrtmDxoZGXHbZAkiShOLiMny6dgtWvbMa
W7ZswB233YAHHvgZbrntjt4UbdhQCT54vD5AkjBhdH7w99PHjcaRk7W444qv4aZHnkHxxXdj/tSx
eOK71wMAHE5Pr7bn8XggSRK8Xi90uaWYl22BT2WCWi0BjbWAqAPUasyfVgCIowGbA472I/ACmGho
A0pNAExYv7ch7m0vX34hdDo9PvroXWzd8iV++rNnIGoAIcKEIKPRBJ0+kHEPEgChc2FJCrwgxek8
dcf02Wcix57cawlqaqpw+PBBXHjxuTh3+blwu36KG2+4CGvXfIRly1aELPvorx7BgQN78fe/fwaj
KQmmZEDb2TusXr0LyckpneUCvEPkHR1K53dXQyNJEnR6wOm0Q5ckwWDstgLWx7DQm3a+uyQD4EfX
C4tU8Hgix84zz8YQDwqTA8O34/UGtqPV6qDTnbrT7/NJkKSe7co99zyC2bPPgsmUgsLCEogaFbZs
+STq+sPJnhsGI666+gZ8/NFqOJxtWLDgbOTkFA6JAYrSuXfttbedWjDsmMods672+6mnI9d51915
QRACFy/CqSDo7Xn8+eeB2fFTpszCVzvWRS2jVquFTgeoRTW0Wi1EERBFNQDA75fiar9ijUE6fePH
TwQAbNtWjnHjrwAQGNf84mcP4RuXXx1crisG9frI8fT00w8NaHvUXffYfUFmDB1eLvZ3w0fMfXB4
DAny46yueAzvp5I6+6OkJAP0SYBeH8hW+HySbEz96c+PBTep1QWS/r3Vc7yA4FNPw9XpjLEi9ZFd
5NqawN+U+ze5ut67b1PUdQcKFtchGLbiGTvFNKaIcl01ZgxzKb2hUqkijs+t9kDiUZL80OkAb2cH
KggCNBr2sUDo+GT7V4H/Dz8mOj1C4nLStF48ar1r1w4cP16J2267Dy+9tBYvvbQW119/F/bt24Ej
hytlP9fR0Q6VSgWn04f3338JarUaNpsF6z77GE/++ue4+tor8cSv/4Di4jIcOnQUzpEx016WOVsF
tUoNURRR3XDq8enPd+xHljkVe4+exMs/uRsn338GRTnp+OPba+H2eiC5e5VLhtvthsfjgdfrhdRW
g4aGVqhtzYDHATit8LfUoO3gLlgO7obr6AF4m2vxn/L1sNss2LSzAhuPWtCUPB5nnPONuLedlGTA
ecsvwF//+iRUKjUWLbxA+Y6ZgOC0/2PHDsHpdCA7JxcAsGnTZ6irr8WG9f8OLi4Xe3LWfPoRbrrx
Cjz26M+xe/cWbNz4PqqqKlBWNgHebnndTz9ZjT//6TncddcD0GoNsNlr4PF4MH/+QgDAu+++Aovt
GO68awU2fvkWTMlxH5p+F+38XrjwbADAqlWv4tixCiyYNwW/+PmPoGZ9DCu9befPXnwuBEHAm2++
iIb6Orz5j1eRm5uPsWMn48wzI8eOXDyEx1Ss2wkZ+MYwCC4oGI3Zc2Zg6vRSpGeqYE4Hli6Lcf3d
LJDZP0kCrr76Bhw+vBfvrXoTl379Omi0gKrXb1juP0rnnuQPrZ9zlsReJ3J1PnnydADA22+/hMqK
IyHfSBzPeXzs2CFs3foF/vjC7/Hkk49iyZLzMXXqnJjLGHIpF1bf8bZfvBDrH0uXfQ0TJ07FY4+t
xIsvPodPPn4ft996A1599S9ob3Uh5H6BIB9PDufAtkdysWuxxlYu9nfDQ7Q+OHwMHP6zXDs1f4F8
PxUUFqfz5kWOqVmzzzi1rsqjcX+DvFJ7PNxvzvR2jDV5inwfGULh+Cn1b/Nk2g+DQf4zXUnISG3j
SBXP2CnWMbDSddXatcyl9FbE8XlnjK9e/ToaGurx3rtvwWg0oaRkvGx7OBL6WLnxidy4Y/OW0LiU
pF4kHt9b9S9otVpceeVtmD1nBhYsnIFbb78dKpUKH3zwL/hkvg30uutvRkZGFi77xlwUFI7CsnMv
xtNPPwKDMRktra04e9F0LDlnCgoLC3Dzzd+Hr/c3zoYFk04PrajFsrmT8ea/v8SHX3yFJ197HxCA
ixfNwJtrN+GHz72O/ZXVMCebkJ5qgtXmRWqaMfrKI6isrERlZSVqa2uDv2uwOFFXXY+Ko8dx7GQd
rF4VLF4BTVY7tm7fAyGnFDvsBpQtugBT5oZ+wdMAAB+5SURBVF8AjT7OZ6y7ufTSy9HYWIezzz4f
er0BuiiPIWbn5GLevIV4+eXf46W/voDp02fi6/91FV588XHcefuNOOec84Iv0r7xm5Fj72jF4Yjr
vuHG/8Zdd9+Pd995E9dctQIr770bs2efiQcf/A1U6lPLffLxewCAxx//ES64YAoWnTkFBw8cwNx5
C3HffY/glVd+j4svXIzsrFzMm3shXDF8McdAi3Z+z5y1AD948Od47bXncMnFS3DmwsW45eaHYTKy
PoaT3rbzU6fOwC9/9TTef/8NLF0yB06nE0899RqSDHrMnx85dq64InI8WKyWkJiKdTtiLxJ6anXn
+18642natPjXP3t25P2z2wLt1fz5i+B0OrD47BVD5lEkpXMvJzf0nI/nmMm1AQVFo3HZ5dfhT396
Avd85xZMnz4LYudzs/Pmx34eP/fcL3H9dRfjuWd/ixUXX4FHfvI8NFpg5szTj5sbboyv/aL+oVKp
8LeX38TZZ38Nzz7zBL57z61obGzE00+/hsmT5/d4/5JcPF19zcC2R3Kxe9O3YitXPOcJDV7R+uCM
zND2N3xMLNfGms2ZEfsppe9GkIupBQvOxWWXX4cXXngM37n7ZixYcHZwZlAsFPsMdfTPD2W9HWMt
XnyebB+ZCPNkxstuhYfpsrNzZdvGkSqesZPcuRretitdV02fPpO5lF5SGp/n5BTg0kvOxt59u/Gj
H/0GBoMBZy4cuX2s3Phk4aLIx2TixNC4FARA+Ly8PGQ4trE89MtBbr/z/h4btlkBlxMwZ5x6TMTv
A1pbAIMxMD2+vQ1ITg1kjYP/rwIs7YHpl0lGwOsBPG4gJRVw2AG3O7A+UQRMyQhJKgw3tdUnkFcw
SvbvdY0taGi2Y0JxJv66+gt8secoUoxa3HrRQiycXoZjjc14ftWnqGpoRkGWGXdesRxVtQ6kmHQo
ys2Oe7vf++63g///5FN/Rqr/COo2r4GltS1kuWRzGnILctA+6r8Sur9AIBY62gNTc7vuHHg9kWNJ
2/nOiva2wEt2kwyBf9YOwOUKxJCoAZwOICMrMAU6UuwZTYEXNndfZxe7LRDnXXeCNdrA8n7fqXK4
nejR2KSZAy+wddgBhwOAFFi3KSWuQ9anlOoj2vmdZAgcV4cDkPyB42JKDizL+hhaTicO5Np5rTbw
OYcd8PsDdW8wIvjetUix4/PJ9A1pgXJ0xVT3bSptp3u7odUGlrHbgPTM0Ecbu9qc5BREfH9OLOsP
3/fw/ZPQgSNHDuKbN1yOK674Fu6++5GQYzoYRGuf5c49larnOR9rnURqA+pqG/Dhhy9h4qTZGD9u
Fu6++xvQanV44YXVSM8MbDvaedxVp11UqlPl7TrmsZaxrTWQjE5OCdSrzRo4H/z+6O1XeFzIxSDF
LpZxhN8P2K2B8aQkBeo3ydgZc56eY4hI8STXP/VXe9QlPHZjLVeSgf1dvGKJrf7ebixjsfD2t/vP
Gm3keEk1B/7box/2KsepXExZLej8ApNAe+l2I9heh+tqR9PST93oUxovDHWJHmO5PA14658vYcKE
yH2kUlsTXr9y/ZtKJdMuRmnHwmNxJEjU2EnuXI3UtstdV/n9gM0ysnIp4WJpx7u3QXZ7Bw4f7jk+
375tE664/EL87ndvYunSZcHrSoMJwYlRw7GPVTp+sYytIx2T7nG56sNnepd4pNMX7eTw+Lz4z57j
yE7Kg05ngEsEjBogWQjMclcnA+ndJhh2WB3YffgEJo4phVol/7j1YBxcUf9jfRDAOOgPr7z8Z/z8
Zz/EnLkL8eivXoI53RD6TtRBYLDEgc/nw89++kOsevctOBx2TJk6HQ/+4EmMKR2P1LSBLh0NtMES
pzT8cGxMfSHR9cs+cnDh+Tu4xFsfcuPzbVtPJR6Xn7+sx0SY4aqv4/kvLz3Tuy+Xob6nUYsYW5KL
ioom6IUMGNXGQLZZBFQioHMBrg5AZwJarTacrG/GqLx8xaQjERH1r+tv+DYuv/zbsNtOzeagyNRq
NR75yaO4b+WjcLk6Z8BoIPtN4kRERCMF+0iixJEbn8+eMx+Hj7SgvU358xQ/ZqkGsbQUI8aMEXD4
eAPcnnbkpKfAYEqCKUkNv+CDxefA0WMdsDucyMnIQYqRV7RERIONPglD4lusBwuDKfCPiIiIQrGP
JEoMufG5qAk8wk6JxcTjIJeWYsDMSYVoaGlHbUMtjlR7APih06lg0ovIMJsxpjCbMx2JiIiIiIiI
iGhQYbZqCFCrReRlZSAvK2Ogi0JERERERERERBQT1UAXgIiIiIiIiIiIiIYfJh6JiIiIiIiIiIgo
4Zh4JCIiIiIiIiIiooRj4pGIiIiIiIiIiIgSjolHIiIiIhpSUpMHugREREREFAsmHomIiIiIiIiI
iCjhhM/Ly6Xuv9hYXh6ywMLzr+7XAhEREREREREREdHQtq18NWc8EhERERERERERUeIx8UhERERE
REREREQJx8QjERERERERERERJRwTj0RERERERERERJRwTDwSERERERERERFRwjHxSERERERERER0
mhZNL0ayQdfj9zPH5yM33dTv5dFrRSyaXgxB6L9tTh+bi2yzsf82SIOemKgV6bUiZk8swMZdxyFJ
Pf+emWZEm8UBr88fddl4TB+bi9omCzpsrpjWGW3bJoMWpQXpSNJq4PH5cKK+HY2tttMrJMVEVKsw
Y3w+WjvsOFLVAiD++shMNSA/KwXGJC0EAE63F41tNlQ1dEDqrPD5U4qgVgmQAEAC3F4f6potqGro
6PudHEJYHyNbSL0A8Hr9aLU4UFnTCq/Pn7DtdG+TdZrE9Q1yuvdF8erqbxpGSJ+gFdWYO7kQX+4+
AZ8/cRUy0HVwOtunwW90nhm5GSbsr2xEu83ZZ9vJzTChJD8dx2pbUdtkCf4+xahDSb4ZSToNfD4/
aposqG6MrT9T+my0/leuPKJahdLCdJiTkyBJEuqarThe16ZYjkj9fzzLmpOTMDovDTqtCK/Pj+rG
jpAyhZMre6pRj5J8M/Q6ER6vDxXVrWi1OBTL05cObG6M+zMT5mX1alvzpxTh4PGmHvs7d1IhKqpb
0NRu79V6gcS1wfOnFEFUq3r01063B9sP1PS6fIm8ThysFk0vxs7DdbDYXSG/nzk+HzWNHahrscp+
diQcH0osl8eLLXurRmy8nDEuD3XNVtQ1y/dD1PcSlniMFtCjc9Owx+GC1+fvk+BPxDoFQcCk0dk4
XteG+hYrTElaTCnNgdXuhsPlSVxhKaKSfHMwGQXEXx/5mckYlZuGiuoWNLfbIUmBgfqYgnQk6TQ4
dKIpuOy+ysbgYC7FqMPkMTmwOjxoG8AB7WDD+qDu9aLTihg/KhMl+WYcPtk8wCXrve59EQ2Mga6D
gd4+9R1BEJCVZsCx2lbkZpj6LPFYVpgOtUoFu9Md8ntRrcKkkmxU1LSiobOfnFqWC4vdhQ6bS2Zt
0T9rsbsV+1+58gTKmgGf348t+6qgUasxYXQmmtq0sEVYtkt4/68kfFmtRo0Jo7Nw4Fig/zAZtJhW
GtgPqz1S+SKXXSOqMbEkC0eqmtHUZkd6ShImjM7C9gPVcHt8MZWtLyw7Lx/7D1bAoNdDUAkATu27
3w/4fT54fT5IfmDtmgOYMG/ZgJVVTiLbwL0VDQlPBo/0JAkNfzqtiFkT8nG0qgUZqQbotSJsDjcO
dl4bdd28UasDD6eerG9HfWcyekxBOtJTkgAJ8Pr9OFrdAktn/yL3t/Ab+znpJhTnpsHn96O53YFk
gxb1LVa021yK5Uo26DCmwAxRrQYAVDWcKldOuglFOamQJAmtlr676UdDV1yJx+ljc9HYakNN591I
QQjceTt4oglOlzdk1srM8fk4Ud+GgqwUOFxe6HUipozJwbHaNljtobMTU016lOSZoVYLkCSgrtkS
3EY4uaAOP6GUTsru8jKTkZeRjF1H62BK0sEvScETyOpwo6XDgaw0A07Ut8dzqChO6SlJMOg1aGix
QqsJNGapJn3M9aFWCSjOS8PRqpaQmTAdNhf2HK1X3HaHzQWH04MknYg23ggBwPqgnlxuL6oa2jG2
KANA4I5793Z+x6Fa6DSi7IBEaRAlR6lvSDPpUVKQDq2ogtPtRUV1a3DmgNy2JozOCumLmtpsHETF
ID3VgKLsVOi0ajS3O4I3DZTqR64P7q86iGf7cvsRKcaNeq1sHMsN5BtalfeREicj1QCL3Y2GFhtG
5aRBVKuCyZUknQazJuSjfOfx4PIzxuXhZH07mtrtivUXrq7FCqvdjSmlOSG/FwQBlZ2JQyDQT9oc
biTpNFETj0qfValUiv2vXHlEUYX01CRs3VcFv1+Cy+/FzsN1iuWI1P93Hau6FmvIjES5ZQ+fODVT
z2p3w+H2wKDTwGp391iPXNlTjDq4PT40tQVm9rV0OGB1uJCRYkDtAM5aOXzkOD7/fDtEUQ2NRsTD
D92Ojz/5Ahs2bIPP54fP74PD7sLFF53T52UZzG0wED25InfOdX+KTatRXsdwbVujHbvuul/LqlUq
xc/JxcyciQU4eKIJHTYX1CoV5k8pQmVNSzCeZo7PR01TB8YUpMdUJlImSRJUggBRrcK+ygaoBAFz
JhUgzaRHR+d5euB4I1o7HEg16TFlTA5aOhwwJmmRnpyErw7UwC9JSE9JQlaqARabC2nJSbJ/606n
UaOsMAM7j9TCancjLyMZ+VnJqG+xKpbL5nRjSmk2Dp8M3AzSa0WcMS4PFnvgJkZZYTp2HqmD1e5G
RqoBeRnJAAbfhVzXuVVR3Yr0lCQY9RpUN3ZApRKQatIjSacJto2A8vULx32xExBn4rGh1YasNGOw
EUo16SFJQJvFCb321Kr8kgSVSoAgCNi8twqCACycVow9FfVwurwhy4pqFSaOzsKhE01o6XBAp1Fj
xrh82J0etFlDOzitRh1TUMd64mWkGlCQlYLdR+rg9fph0ImwO0NnbjlcHhj12ngOE8VJVKswpiAd
+yobkJFqCP4+nvowGXRQq1TBAWp30e7oppr00GlFtHZwdh3A+iB5giCg64nb8HZeI6pkByROl1d2
ECVHqW+wOt2YWJKF/ZWNaLM6kW02YuLoLGzdXwUBguy2Dh5vRGa3vkipzENpENXXjHotvjpYA42o
wqwJgQGo1eGWrR8Igmwf3B91oDQGCN++UpzZXZ6QGFcJ8rGlEiA7kFfax/A2lU5PXoYJJxva4Zek
YDIxlseclS7EIok0cw8APF5fyGd0GhEGvQYdMcy8VPqsOTlJsf+VK49Jr4Xb40NuRjKyzabOR63l
b+7L9f8AUFnbCqfLG3VZt8cXfAxYEICMFAO0ooj2zjF9+Hrkyt71+e68Xj+SdAl7WKtXJL8PbqcH
dp8DHm9gP762/EykpBjxzzc/RWtHO3weP7xeb5Q1nR6ltmug2+AuSkmMwEzd6OdcbxMhQ71tVdpv
p/tUbIVfy6o0guznlPrtVqsTKcZA0ivVpIPV7kKqSY+aJgs0ohp6rYg2i1N23eHX7BRF51i6sTO5
5ZckON1e6LQi/FYntu6rCl4vtVudkCQJeq0Ij8cHjUaFbLMRzR0OtHT+A6D4t+5SO8+/rra3ttmC
4ty0qOXSatTweP3Bazun29t5A8wIu8sDh8sbXGdzux1u78DNTFfSdW5JkoR9lQ0wJydhUkk2Dp9s
wt6KQH82Os+MpjYbx30JFlfv3dRmw5h8M7QaNdweH7LSjJHfs9QVtDG8gyktWQ+P1xc8MVydA5b0
VEOPRixwokQP6lhOvBSDHmPyzdhT0QBX5yMbKpUK/rD3WPn9gYtr6julBemoa7bA7vQgI/XU7+Op
D41aBa/XD3+35zLKCtNDBsM7D9cFO+sJo7MCDY9KgAABJ+raQjrykYz1QZHoNGoUZKUE7wCGt/Pm
5CTZAcnxujb5QZTMwESpb9CIarjcvmAf0dBqQ6vFCUkCJEiy27I6QrelVOahNIjqa10zkzxePxwu
D3RaEaKokq2f+mZrTINfoG/qINbBN6AcZ/bOmdxdMe6X5GMrSSfKDuSjnRuUGEk6DXSdF8cAUN9s
wfjirJgSj4oXYr2k1agxaUw2TtS1weGKrz8L/2xGau/Gp6JaBZ1GhM/nx/YD1TDoNZhamhOMwXBy
/T+A4HGNZVkAyEozYnxxJjxeP45UNQfH2uHrkdNuc0IrqpFtNqKxzYZUox6pJv2pPmiA2B0udFht
8Hl9IcnFBfOnY8OG7aiubYCoUcPlUp7hGovxxZk9HnnXiIHZM0ptV3+2wZNKshD+RPTx2rbAeRcl
iRHTOdfLRMiQb1sV9rtrfBzpWlbpc0r9dpvFgZx0E6oaAu1hbYsVxTmBEzvVpEO7zRlsgyKtm3qK
9EUugiCEnC++bpMxJCkwKwwAss1GZKUZg78QOldmc7qxv7IReZnJGJ1vhsPlQWVNKzpsLsW/dSeq
VT3G3i5PaB8VqVxqtQpajRpzJhYE/6ZSCWhqsweu+8ImlsiN7wdcZwW0dATaDYfLA0EItG9dP+s6
Z/Bz3JdYcbUUHq8frRYnMlMNqG22IiPVgF1H5B/Z8HijvztEI6p7LOf1+aDTishJN6EkzwwA6LC7
Ir4IOVJQx3LidXXm3T/v9/t7DOLUKgF+P98D1VcyUg3Q60QcOtlzmn489eH2+iCKKqhUQrBjPFbb
hhN1gQvH2ZMKTrXmQPDdQ0AgoTKmIB1jizKG9LvrEoH1Qd11JYQFAB6fH83t9h4dZlf7LSoMSAD5
QZQcpb5BIyoPcGLdllKZh9Qgqo95faf2u2sAqlQ/sQ5+gb6pg3i2r7Qfp7Z56u9ysaU0kI92blBi
5GaYoNWoMX9KUfB3apUKqUZ91Hc9xnIhFg+TQYuJxVk4EcMrJWL5bG/Hp15f4AZg1wxHu9ODpjY7
zMlJPRJRSv1/uFiWbWyzoak98LjZ+FGZAE5d2MXC6/Vj37FGlOSZMTrfjDaLc1B8KZTT6YTd7oDf
74evW9v40589h/37K6HTagIJGefpJx6PVrUEZ4p2OWNcHoDB0wZ3fxe0HLkkRjznXLyJkKHgdBJT
QORrWaXPKcVMm8WJssIMCELgVTbVjR3ITjPAmKRFqkkf8hSSUpkowOXx9XjFhqhWQa8V4YoysSIj
1YCinFT853AdXG4vBAFYMHVU8O9tVifarE4IgoD8zGRMHJ2FzXurov6ti88vBR8b7tL9VRlK++Rw
ebHjYM8vjso2GyH2Yp0DyecLvWXS9SWKkoSQoOa4L3HivkXR2GpDXmYyHG4vnG5vlOmi0d8K7PH4
oBFDA1UjBmZUNrbZgg1d16MCsQZ1tBNvT0U9CrNTMbYoA/uPBb6lzu70ID8rJWQ9hiQtbA75x0Do
9GSlGQLv55wQODHVahUEQYBep0FVfXvM9WG1u+H1+ZFjNgXf/RPr4NTl8aGuxYrxozJHfKKL9UHd
dU8Iywu080oDkmiDqEiU+ga31xec9dHFoNfA4fIiPSUp5m0Nt0FUf1KqHyC2wS/Qd3UQ6/aj7UdA
IMaV4lhpIK+0j5QYKkFAjtmErw7UhMyWz89M7vYlMz3HpF111tsLsUiSDTpM6HycMTxp1NvP9nZ8
6nR7oRIEqFVCyDfTRxqdK/X/4e9mVlq2oroFSTpN8EvlOmwutFgcSE9JiivxCARml/zncG3w5xnj
8wb8ws3hcMIZdtxvvvXH6OgIzAJzOF2BZJDn9B+n8/r8srO8B3sbHE0izrmh3LaeTmKqS6RrWSVK
MeP1BZ5oSDMlQaUS4Pb40G5zIdWoQ5pJj5rGkfeamdNR09iBUTmpsHfOiOuaVGGxu9Buc0Kjlo/1
QELLH4yDwqxUQArcbMpJNyHZoMXR6hZIkhTSByj9rbsOmwtlhRkw6DWwOz3IzUiGWqWKuGx37VYn
dKIa5uQktFocUKsElBSko67Jgg6bC0k6DUwGLax2N7LMRmjU0dc52HHcl1hxJx6bO+woLUxHTrop
8mPWEUhS4J8YIajbrE6UdQtinVZERqoB+yob4PdLcPtPdbixBnUsJ57D5cHRqmacMS4feZnJqG2y
oN3mhAAEf0416WE26XGspjX2A0RxOXA89G55UU4qdBo1jlS1QBAQc334JQmVNa0YU5AOCEBDiw1+
SYJRr0FRTio8Hh+8MjNwRbUKOemmEf3OhS6sD+otpQGJ0iBKrpaV+ga704OxRSpkpBrQ3G5HZpoB
pQXp2LKvSnFb4X3RSBxEJYpS/Sj1wf1RB/FsX2k/winFltJAXmkfrbyxmRCZaQY4O2+Id9fUbsfo
PDNEtQpujw+ShGAdpRh10GkCw+DeXoiFU6kETCjOlE06ZqQa4HB5IvZvSp/t7fjU6fai3epAcW4a
KmtbodeKyEwz4NCJnjf1lPp/IPD4pavzGCstm2LUYdyoTOytqEeHzQW9VoQ5OQnVDR091qNErRIw
Y3w+Dh5vgsXuQl5GMkS1Ci2dN8M0ohoZKUmo65wVqlIJyE4zoqHNFnzSIjfdhOYOR0JnqxePysXy
5fOg0YhQCSr87aV3cNaiGQAC7w6DBPilvp+VOZjb4Fgk4pwbym3r6SSmukS6llUSrb9rszhRlJMa
bH/arU6MzjNDEAQ4XB5oRd58jVV1Ywf8koSxhRmB1wr5fGhpd+BQfVvUb2tvarMjK82I2RML4PX6
UdXYjoY2G8aNysT+441IM+kxe2IhJEmC1+cPfrlPU7td9m/dOVweHKttxeSSbHj9EprabLA53VGn
i3l9fuytbMCYAjNKC9MBCWhqtwXPtYqaFkwcnQVJCnwZWLQvVBsKOO5LrLgTj36/FHxG/WjnYCQW
TW02TC3NwYn69pA7nl6fH/srGzE6Pw1jCsyQJOBYbeTHAZxub0xBHeuJ5/NLOHi8EVNLc9BhDbwb
Yd+xRpQVpKM4Nw1ujw+HTjbzXXMDRJIQV33Ut1jh9vhQmJ2C0XlpECDA6faiud2OwyebQ2bcdX8n
jc8nod3qwIEY7haOZKwPUqI0IHG4vLKDqCNVkWe1Rusb9lU0orQwHWWFGXB5vNh3rBGSpDxg21NR
H9IXVTd2jLhBVKIo1Y/N6VHsg/u6DqKNAcK3L7cf4RdZ0WJLbiAfbbBOpy83Izn43rHu3B4frA43
stNNqGnswPG6VkwcnQWX2wurw4MOuxMQ4rsQ6z7jQSUISDXqUZJvRn2zNXCxoRUxeUx2yGfqmiyo
qGlFUU4qGlqsEROP6clJip+V63+VynO0ugWHTjZjbFEG5k0ugtfnx8n69hhmsvc0Jt/c41utI+mw
uVBR3YJxozKhEdXw+fxobLOhrsXSYz3Ryn68rg0TijOhVqvgcHmwr6IhmFRM0okoK8oIJh41ahXK
ijLQanHA1TlpoawoA/YjdQlNPH704cGEret0DJY2ePKY7IiJlK37qxQffOtt8iP8GAzVtvV0ElPd
hV/LKsV6tHFVq8WBopzU4DlutbthMmjRMIK/ifd01DZZZNtLt9eH8p3HQ37X/fV1eypCZ5l3n+l9
UGYc5JPJdwCBHEr37dU0dYS8/zjbbILX649aLovdhZ2HI79mT2l/hyqO+xJL+Ly8PKR521heHrLA
wvOv7tcCEREREQ01goCQC8ZZEwpQUd3SqyQP9b/+qL8ssxGQEDFJSkPTp2//Ba0trdDr9bjkujsH
ujhDCttMov6nUgmYO6kQB483odXiQJpJj4kl2di2v3rEvsu8t9iGxW57+er4ZzwSERER0SmRBvJa
jXrE390eKvqr/iQJaO0Y2S+XHy72fPkhXG4XUpNTkG5OhwQJ29e9g5SUFIyduXSgizfosc0kGhh+
v4TDJ5sxpsAMlZAenDXLpGN82IbFj4lHIiIiGjIMek3wW3IjOV7X1uMbe/saB/JDW3/VXxNnOg4b
UxZcMNBFGNLYZhINnOZ2e9xf9kWh2IbFj4lHIiIiGjLsTg92HKqNvmA/40B+aGP9EfUvnnNENJSx
DYsPv6KTiIiIiIiIiIiIEo6JRyIiIiIiIiIiIko4Jh6JiIiIiIiIiIgo4Zh4JCIiIiIiIiIiooRj
4pGIiIiIiIiIiIgSLuq3Wk8aldYf5SAiIiIiIiIiIqJhYjtiSDymm1P7oShEREREREREREQ0nPBR
ayIiIiIiIiIiIko4Jh6JiIiIiIiIiIgo4Zh4JCIiIiIiIiIiooRj4pGIiIiIiIiIiIgSjolHIiIi
IiIiIiIiSjgmHomIiIiIiIiIiCjhmHgkIiIiIiIiIiKihGPikYiIiIiIiIiIiBKOiUciIiIiIiIi
IiJKOCYeiYiIiIiIiIiIKOGYeCQiIiIiIiIiIqKEY+KRiIiIiIiIiIiIEo6JRyIiIiIiIiIiIko4
Jh6JiIiIiIiIiIgo4Zh4JCIiIiIiIiIiooRj4pGIiIiIiIiIiIgSjolHIiIiIiIiIiIiSjgmHomI
iIiIiIiIiCjhmHgkIiIiIiIiIiKihGPikYiIiIiIiIiIiBKOiUciIiIiIiIiIiJKOCYeiYiIiIiI
iIiIKOGYeCQiIiIiIiIiIqKEY+KRiIiIiIiIiIiIEo6JRyIiIiIiIiIiIkooAUw8EhERERERERER
UYJJYOKRiIiIiIiIiIiI+gATj0RERERERERERJRQfNSaiIiIiIiIiIiI+gQTj0RERERERERERJRw
TDwSERERERERERFRwjHxSERERERERERERAnHxCMRERERERERERElHBOPRERERERERERElHBMPBIR
EREREREREVHCMfFIRERERERERERECcfEIxERERERERERESUcE49ERERERERERESUcEw8EhERERER
ERERUcIx8UhEREREREREREQJx8QjERERERERERERJRwTj0RERERERERERJRwTDwSERERERERERFR
wv0//hoFB2Kq+uAAAAAASUVORK5CYII=
--=-mZqFwwB7NvS3OE0tdKkP--
12:53 p.m.
On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues <cmar(a)eurotux.com>
wrote:
On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues <cmar(a)eurotux.com>
wrote:
On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues <cmar@eurotux.
com>
wrote:
On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote:
On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues <cmar@euro
tux.
com>
wrote:
On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote:
On 12 August 2016 at 20:23, Carlos Rodrigues <cmar@eurotu
x.co
m>
wrote:
Hello,
I have one cluster with two hosts with power management
correctly
configured and one virtual machine with HostedEngine
over
shared
storage with FiberChannel.
When i shutdown the network of host with HostedEngine
VM, it
should be
possible the HostedEngine VM migrate automatically to
another
host?
migrate on which network?
What is the expected behaviour on this HA scenario?
After a few minutes your vm will be shutdown by the High
Availability
agent, as it can't see network, and started on another
host.
I'm testing this scenario and after shutdown network, it
should
be
expected that agent shutdown ha and started on another
host,
but
after
couple minutes nothing happens and on host with network we
getting
the
following messages:
Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-
agent[2779]:
ovirt-ha-agent
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.con
fig
ERROR
Unable to get vm.conf from OVF_STORE, falling back to
initial
vm.conf
I think the HA agent its trying to get vm configuration but
some
how it
can't get vm.conf to start VM.
No, this is a different issues.
In 3.6 we added a feature to let the engine manage also the
engine VM
itself; ovirt-ha-agent will pickup the latest engine VM
configuration
from the OVF_STORE which is managed by the engine.
If something goes wrong, ovirt-ha-agent could fallback to the
initial
(bootstrap time) vm.conf. This will normally happen till you
add
your
first regular storage domain and the engine imports the
engine
VM.
But i already have my first storage domain and storage engine
domain
and already imported engine VM.
I'm using 4.0 version.
This seams an issue, can you please share your
/var/log/ovirt-hosted-engine-ha/agent.log ?
I sent it in attachment.
Nothing strange here;
do you see a couple of disks with alias OVF_STORE on the hosted-
engine
storage domain if you check it from the engine?
Do you mean any disk label?
I don't have it anyone:
[root@ied-blade11 ~]# ls /dev/disk/by-label/
ls: cannot access /dev/disk/by-label/: No such file or directory
No I mean: go to the engine web-ui, select the hosted-engine storage
domain, check the disks there.
No, the alias is virtio-disk0.
And this is the engine VM disk, so the issue is why the engine has still to
create the OVF_STORE.
Can you please share your engine.log from the engine VM?
Regards,
Carlos Rodrigues
Regards,
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
1:11 p.m.
On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues <cmar(a)eurotux.com>
wrote:
> On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote:
> > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues <cmar@eurotux.
> > com> wrote:
> > >
> > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote:
> > > >
> > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues <cmar@euro
> > > > tux.com>
> > > > wrote:
> > > > >
> > > > >
> > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote:
> > > > > >
> > > > > >
> > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues
<cmar@
> > > > > > eurotux.
> > > > > > com>
> > > > > > wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos
Rodrigues <c
> > > > > > > > mar@euro
> > > > > > > > tux.
> > > > > > > > com>
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan
wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On 12 August 2016 at 20:23, Carlos
Rodrigues <cma
> > > > > > > > > > r@eurotu
> > > > > > > > > > x.co
> > > > > > > > > > m>
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Hello,
> > > > > > > > > > >
> > > > > > > > > > > I have one cluster with two hosts
with power
> > > > > > > > > > > management
> > > > > > > > > > > correctly
> > > > > > > > > > > configured and one virtual machine
with
> > > > > > > > > > > HostedEngine
> > > > > > > > > > > over
> > > > > > > > > > > shared
> > > > > > > > > > > storage with FiberChannel.
> > > > > > > > > > >
> > > > > > > > > > > When i shutdown the network of
host with
> > > > > > > > > > > HostedEngine
> > > > > > > > > > > VM, it
> > > > > > > > > > > should be
> > > > > > > > > > > possible the HostedEngine VM
migrate
> > > > > > > > > > > automatically to
> > > > > > > > > > > another
> > > > > > > > > > > host?
> > > > > > > > > > >
> > > > > > > > > > migrate on which network?
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > What is the expected behaviour on
this HA
> > > > > > > > > > > scenario?
> > > > > > > > > >
> > > > > > > > > > After a few minutes your vm will be
shutdown by
> > > > > > > > > > the High
> > > > > > > > > > Availability
> > > > > > > > > > agent, as it can't see network, and
started on
> > > > > > > > > > another
> > > > > > > > > > host.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I'm testing this scenario and after
shutdown
> > > > > > > > > network, it
> > > > > > > > > should
> > > > > > > > > be
> > > > > > > > > expected that agent shutdown ha and started
on
> > > > > > > > > another
> > > > > > > > > host,
> > > > > > > > > but
> > > > > > > > > after
> > > > > > > > > couple minutes nothing happens and on host
with
> > > > > > > > > network we
> > > > > > > > > getting
> > > > > > > > > the
> > > > > > > > > following messages:
> > > > > > > > >
> > > > > > > > > Aug 16 11:44:08
ied-blade11.install.eurotux.local
> > > > > > > > > ovirt-ha-
> > > > > > > > > agent[2779]:
> > > > > > > > > ovirt-ha-agent
> > > > > > > > >
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEn
> > > > > > > > > gine.con
> > > > > > > > > fig
> > > > > > > > > ERROR
> > > > > > > > > Unable to get vm.conf from OVF_STORE,
falling back
> > > > > > > > > to
> > > > > > > > > initial
> > > > > > > > > vm.conf
> > > > > > > > >
> > > > > > > > > I think the HA agent its trying to get vm
> > > > > > > > > configuration but
> > > > > > > > > some
> > > > > > > > > how it
> > > > > > > > > can't get vm.conf to start VM.
> > > > > > > >
> > > > > > > > No, this is a different issues.
> > > > > > > > In 3.6 we added a feature to let the engine
manage
> > > > > > > > also the
> > > > > > > > engine VM
> > > > > > > > itself; ovirt-ha-agent will pickup the latest
engine
> > > > > > > > VM
> > > > > > > > configuration
> > > > > > > > from the OVF_STORE which is managed by the
engine.
> > > > > > > > If something goes wrong, ovirt-ha-agent could
> > > > > > > > fallback to the
> > > > > > > > initial
> > > > > > > > (bootstrap time) vm.conf. This will normally
happen
> > > > > > > > till you
> > > > > > > > add
> > > > > > > > your
> > > > > > > > first regular storage domain and the engine
imports
> > > > > > > > the
> > > > > > > > engine
> > > > > > > > VM.
> > > > > > >
> > > > > > > But i already have my first storage domain and
storage
> > > > > > > engine
> > > > > > > domain
> > > > > > > and already imported engine VM.
> > > > > > >
> > > > > > > I'm using 4.0 version.
> > > > > >
> > > > > > This seams an issue, can you please share your
> > > > > > /var/log/ovirt-hosted-engine-ha/agent.log ?
> > > > > >
> > > > >
> > > > > I sent it in attachment.
> > > >
> > > > Nothing strange here;
> > > > do you see a couple of disks with alias OVF_STORE on the
> > > > hosted-
> > > > engine
> > > > storage domain if you check it from the engine?
> > > >
> > >
> > > Do you mean any disk label?
> > > I don't have it anyone:
> > >
> > > [root@ied-blade11 ~]# ls /dev/disk/by-label/
> > > ls: cannot access /dev/disk/by-label/: No such file or
> > > directory
> >
> > No I mean: go to the engine web-ui, select the hosted-engine
> > storage
> > domain, check the disks there.
>
> No, the alias is virtio-disk0.
>
And this is the engine VM disk, so the issue is why the engine has
still to create the OVF_STORE.
Can you please share your engine.log from the engine VM?
Go in attachment.
>
>
> >
> > >
> > > >
> > > > >
> > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > > Regards,
> > > > > > > > > Carlos Rodrigues
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Regards,
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > >
> > > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > > >
> > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > (t) +351 253 680 300 (m) +351 911
926 110
> > > > > > > > > > >
> > > > > > > > > > >
_______________________________________________
> > > > > > > > > > > Users mailing list
> > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Carlos Rodrigues
> > > > > > > > >
> > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > >
> > > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > > >
> > > > > > > > >
_______________________________________________
> > > > > > > > > Users mailing list
> > > > > > > > > Users(a)ovirt.org
> > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > --
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > > Engenheiro de Software Sénior
> > > > > > >
> > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > >
> > > > > --
> > > > > Carlos Rodrigues
> > > > >
> > > > > Engenheiro de Software Sénior
> > > > >
> > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> > >
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
>
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
1:34 p.m.
On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote:
>
>
> On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues <cmar(a)eurotux.com>
> wrote:
> > On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote:
> > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues <cmar@eurotux.
> > > com> wrote:
> > > >
> > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote:
> > > > >
> > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues <cmar@euro
> > > > > tux.com>
> > > > > wrote:
> > > > > >
> > > > > >
> > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote:
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues
<cmar@
> > > > > > > eurotux.
> > > > > > > com>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone
Tiraboschi
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos
Rodrigues <c
> > > > > > > > > mar@euro
> > > > > > > > > tux.
> > > > > > > > > com>
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy
Golan wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On 12 August 2016 at 20:23, Carlos
Rodrigues <cma
> > > > > > > > > > > r@eurotu
> > > > > > > > > > > x.co
> > > > > > > > > > > m>
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Hello,
> > > > > > > > > > > >
> > > > > > > > > > > > I have one cluster with two
hosts with power
> > > > > > > > > > > > management
> > > > > > > > > > > > correctly
> > > > > > > > > > > > configured and one virtual
machine with
> > > > > > > > > > > > HostedEngine
> > > > > > > > > > > > over
> > > > > > > > > > > > shared
> > > > > > > > > > > > storage with FiberChannel.
> > > > > > > > > > > >
> > > > > > > > > > > > When i shutdown the network of
host with
> > > > > > > > > > > > HostedEngine
> > > > > > > > > > > > VM, it
> > > > > > > > > > > > should be
> > > > > > > > > > > > possible the HostedEngine VM
migrate
> > > > > > > > > > > > automatically to
> > > > > > > > > > > > another
> > > > > > > > > > > > host?
> > > > > > > > > > > >
> > > > > > > > > > > migrate on which network?
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > What is the expected behaviour
on this HA
> > > > > > > > > > > > scenario?
> > > > > > > > > > >
> > > > > > > > > > > After a few minutes your vm will be
shutdown by
> > > > > > > > > > > the High
> > > > > > > > > > > Availability
> > > > > > > > > > > agent, as it can't see network,
and started on
> > > > > > > > > > > another
> > > > > > > > > > > host.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > I'm testing this scenario and after
shutdown
> > > > > > > > > > network, it
> > > > > > > > > > should
> > > > > > > > > > be
> > > > > > > > > > expected that agent shutdown ha and
started on
> > > > > > > > > > another
> > > > > > > > > > host,
> > > > > > > > > > but
> > > > > > > > > > after
> > > > > > > > > > couple minutes nothing happens and on
host with
> > > > > > > > > > network we
> > > > > > > > > > getting
> > > > > > > > > > the
> > > > > > > > > > following messages:
> > > > > > > > > >
> > > > > > > > > > Aug 16 11:44:08
ied-blade11.install.eurotux.local
> > > > > > > > > > ovirt-ha-
> > > > > > > > > > agent[2779]:
> > > > > > > > > > ovirt-ha-agent
> > > > > > > > > >
ovirt_hosted_engine_ha.agent.hosted_engine.HostedEn
> > > > > > > > > > gine.con
> > > > > > > > > > fig
> > > > > > > > > > ERROR
> > > > > > > > > > Unable to get vm.conf from OVF_STORE,
falling back
> > > > > > > > > > to
> > > > > > > > > > initial
> > > > > > > > > > vm.conf
> > > > > > > > > >
> > > > > > > > > > I think the HA agent its trying to get
vm
> > > > > > > > > > configuration but
> > > > > > > > > > some
> > > > > > > > > > how it
> > > > > > > > > > can't get vm.conf to start VM.
> > > > > > > > >
> > > > > > > > > No, this is a different issues.
> > > > > > > > > In 3.6 we added a feature to let the engine
manage
> > > > > > > > > also the
> > > > > > > > > engine VM
> > > > > > > > > itself; ovirt-ha-agent will pickup the latest
engine
> > > > > > > > > VM
> > > > > > > > > configuration
> > > > > > > > > from the OVF_STORE which is managed by the
engine.
> > > > > > > > > If something goes wrong, ovirt-ha-agent
could
> > > > > > > > > fallback to the
> > > > > > > > > initial
> > > > > > > > > (bootstrap time) vm.conf. This will normally
happen
> > > > > > > > > till you
> > > > > > > > > add
> > > > > > > > > your
> > > > > > > > > first regular storage domain and the engine
imports
> > > > > > > > > the
> > > > > > > > > engine
> > > > > > > > > VM.
> > > > > > > >
> > > > > > > > But i already have my first storage domain and
storage
> > > > > > > > engine
> > > > > > > > domain
> > > > > > > > and already imported engine VM.
> > > > > > > >
> > > > > > > > I'm using 4.0 version.
> > > > > > >
> > > > > > > This seams an issue, can you please share your
> > > > > > > /var/log/ovirt-hosted-engine-ha/agent.log ?
> > > > > > >
> > > > > >
> > > > > > I sent it in attachment.
> > > > >
> > > > > Nothing strange here;
> > > > > do you see a couple of disks with alias OVF_STORE on the
> > > > > hosted-
> > > > > engine
> > > > > storage domain if you check it from the engine?
> > > > >
> > > >
> > > > Do you mean any disk label?
> > > > I don't have it anyone:
> > > >
> > > > [root@ied-blade11 ~]# ls /dev/disk/by-label/
> > > > ls: cannot access /dev/disk/by-label/: No such file or
> > > > directory
> > >
> > > No I mean: go to the engine web-ui, select the hosted-engine
> > > storage
> > > domain, check the disks there.
> >
> > No, the alias is virtio-disk0.
> >
>
> And this is the engine VM disk, so the issue is why the engine has
> still to create the OVF_STORE.
> Can you please share your engine.log from the engine VM?
>
Go in attachment.
The creation of the OVF_STORE disk failed but it's not that clear why:
2016-08-17 08:43:33,538 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStorageDomainCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStorageDomainCommand'
with failure.
2016-08-17 08:43:33,540 ERROR
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] Ending command
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with failure.
2016-08-17 08:43:33,541 WARN
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] VmCommand::EndVmCommand: Vm is
null - not performing endAction on Vm
2016-08-17 08:43:33,553 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(DefaultQuartzScheduler6) [6f1f1fd4] Correlation ID: 6f1f1fd4, Call
Stack: null, Custom Event ID: -1, Message: Add-Disk operation failed
to complete.
2016-08-17 08:43:33,557 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(DefaultQuartzScheduler6) [] Correlation ID: 19ac5bda, Call Stack:
null, Custom Event ID: -1, Message: Failed to create OVF store disk
for Storage Domain hosted_storage.
OVF data won't be updated meanwhile for that domain.
2016-08-17 08:43:33,585 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(DefaultQuartzScheduler6) [5f5a8daf] Command
'ProcessOvfUpdateForStorageDomain' (id:
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting on child command id:
'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
type:'CreateOvfVolumeForStorageDomain' to complete
2016-08-17 08:43:33,595 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStorageDomainCommand]
(DefaultQuartzScheduler6) [5d314e49] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStorageDomainCommand'
with failure.
2016-08-17 08:43:33,596 ERROR
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [5d314e49] Ending command
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with failure.
2016-08-17 08:43:33,596 WARN
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [5d314e49] VmCommand::EndVmCommand: Vm is
null - not performing endAction on Vm
2016-08-17 08:43:33,602 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(DefaultQuartzScheduler6) [5d314e49] Correlation ID: 5d314e49, Call
Stack: null, Custom Event ID: -1, Message: Add-Disk operation failed
to complete.
2016-08-17 08:43:33,605 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(DefaultQuartzScheduler6) [] Correlation ID: 5f5a8daf, Call Stack:
null, Custom Event ID: -1, Message: Failed to create OVF store disk
for Storage Domain hosted_storage.
OVF data won't be updated meanwhile for that domain.
2016-08-17 08:43:36,460 INFO
[org.ovirt.engine.core.bll.scheduling.HaReservationHandling]
(DefaultQuartzScheduler7) [5d314e49] HA reservation status for cluster
'Default' is 'OK'
2016-08-17 08:43:36,662 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(DefaultQuartzScheduler4) [5f5a8daf] Command
'ProcessOvfUpdateForStorageDomain' id:
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child commands
'[84959a4b-6a10-4d22-b37e-6c154e17a0da,
eb2e6f1a-c756-4ccd-85a1-60d97d6880de]' executions were completed,
status 'FAILED'
2016-08-17 08:43:37,691 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand]
(DefaultQuartzScheduler6) [5f5a8daf] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand'
with failure.
Can you please check vdsm logs for that time frame on the SPM host?
It seams that you also have an issue in the SPM election procedure:
2016-08-17 18:04:31,053 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] SPM Init: could not find reported vds or
not up - pool: 'Default' vds_spm_id: '2'
2016-08-17 18:04:31,076 INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] SPM selection - vds seems as spm
'hosted_engine_2'
2016-08-17 18:04:31,076 WARN
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] spm vds is non responsive, stopping spm
selection.
2016-08-17 18:04:31,539 INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher]
(DefaultQuartzScheduler7) [] Fetched 1 VMs from VDS
'06372186-572c-41ad-916f-7cbb0aba5302'
probably due to:
2016-08-17 18:02:33,569 ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
(DefaultQuartzScheduler6) [] Failure to refresh Vds runtime info:
VDSGenericException: VDSNetworkException: Message timeout which can be
caused by communication issues
2016-08-17 18:02:33,569 ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
(DefaultQuartzScheduler6) [] Exception:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
VDSGenericException: VDSNetworkException: Message timeout which can be
caused by communication issues
can you please check if the engine VM could correctly resolve and
reach each host?
> > > > > > > > > > Regards,
> > > > > > > > > > Carlos Rodrigues
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Regards,
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > >
> > > > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > > > >
> > > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > (t) +351 253 680 300 (m) +351
911 926 110
> > > > > > > > > > > >
> > > > > > > > > > > >
_______________________________________________
> > > > > > > > > > > > Users mailing list
> > > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Carlos Rodrigues
> > > > > > > > > >
> > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > >
> > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > (t) +351 253 680 300 (m) +351 911 926
110
> > > > > > > > > >
> > > > > > > > > >
_______________________________________________
> > > > > > > > > > Users mailing list
> > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > --
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > Engenheiro de Software Sénior
> > > > > > > >
> > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > >
> > > > > > --
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > Engenheiro de Software Sénior
> > > > > >
> > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > --
> > > > Carlos Rodrigues
> > > >
> > > > Engenheiro de Software Sénior
> > > >
> > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > >
> > --
> > Carlos Rodrigues
> >
> > Engenheiro de Software Sénior
> >
> > Eurotux Informática, S.A. | www.eurotux.com
> > (t) +351 253 680 300 (m) +351 911 926 110
> >
> >
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
2:14 p.m.
On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues
<cmar(a)eurotux.com>
wrote:
>
> On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote:
> >
> >
> >
> > On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues <cmar@eurotux.
> > com>
> > wrote:
> > >
> > > On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote:
> > > >
> > > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues <cmar@euro
> > > > tux.
> > > > com> wrote:
> > > > >
> > > > >
> > > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote:
> > > > > >
> > > > > >
> > > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues
<cmar@
> > > > > > euro
> > > > > > tux.com>
> > > > > > wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos
Rodrigues
> > > > > > > > <cmar@
> > > > > > > > eurotux.
> > > > > > > > com>
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone
> > > > > > > > > Tiraboschi
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM,
Carlos
> > > > > > > > > > Rodrigues <c
> > > > > > > > > > mar@euro
> > > > > > > > > > tux.
> > > > > > > > > > com>
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Sun, 2016-08-14 at 14:22 +0300,
Roy Golan
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On 12 August 2016 at 20:23,
Carlos Rodrigues
> > > > > > > > > > > > <cma
> > > > > > > > > > > > r@eurotu
> > > > > > > > > > > > x.co
> > > > > > > > > > > > m>
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Hello,
> > > > > > > > > > > > >
> > > > > > > > > > > > > I have one cluster with
two hosts with
> > > > > > > > > > > > > power
> > > > > > > > > > > > > management
> > > > > > > > > > > > > correctly
> > > > > > > > > > > > > configured and one
virtual machine with
> > > > > > > > > > > > > HostedEngine
> > > > > > > > > > > > > over
> > > > > > > > > > > > > shared
> > > > > > > > > > > > > storage with
FiberChannel.
> > > > > > > > > > > > >
> > > > > > > > > > > > > When i shutdown the
network of host with
> > > > > > > > > > > > > HostedEngine
> > > > > > > > > > > > > VM, it
> > > > > > > > > > > > > should be
> > > > > > > > > > > > > possible the
HostedEngine VM migrate
> > > > > > > > > > > > > automatically to
> > > > > > > > > > > > > another
> > > > > > > > > > > > > host?
> > > > > > > > > > > > >
> > > > > > > > > > > > migrate on which network?
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > What is the expected
behaviour on this HA
> > > > > > > > > > > > > scenario?
> > > > > > > > > > > >
> > > > > > > > > > > > After a few minutes your vm
will be shutdown
> > > > > > > > > > > > by
> > > > > > > > > > > > the High
> > > > > > > > > > > > Availability
> > > > > > > > > > > > agent, as it can't see
network, and started
> > > > > > > > > > > > on
> > > > > > > > > > > > another
> > > > > > > > > > > > host.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > I'm testing this scenario and
after shutdown
> > > > > > > > > > > network, it
> > > > > > > > > > > should
> > > > > > > > > > > be
> > > > > > > > > > > expected that agent shutdown ha
and started on
> > > > > > > > > > > another
> > > > > > > > > > > host,
> > > > > > > > > > > but
> > > > > > > > > > > after
> > > > > > > > > > > couple minutes nothing happens and
on host with
> > > > > > > > > > > network we
> > > > > > > > > > > getting
> > > > > > > > > > > the
> > > > > > > > > > > following messages:
> > > > > > > > > > >
> > > > > > > > > > > Aug 16 11:44:08 ied-
> > > > > > > > > > > blade11.install.eurotux.local
> > > > > > > > > > > ovirt-ha-
> > > > > > > > > > > agent[2779]:
> > > > > > > > > > > ovirt-ha-agent
> > > > > > > > > > >
ovirt_hosted_engine_ha.agent.hosted_engine.Host
> > > > > > > > > > > edEn
> > > > > > > > > > > gine.con
> > > > > > > > > > > fig
> > > > > > > > > > > ERROR
> > > > > > > > > > > Unable to get vm.conf from
OVF_STORE, falling
> > > > > > > > > > > back
> > > > > > > > > > > to
> > > > > > > > > > > initial
> > > > > > > > > > > vm.conf
> > > > > > > > > > >
> > > > > > > > > > > I think the HA agent its trying to
get vm
> > > > > > > > > > > configuration but
> > > > > > > > > > > some
> > > > > > > > > > > how it
> > > > > > > > > > > can't get vm.conf to start
VM.
> > > > > > > > > >
> > > > > > > > > > No, this is a different issues.
> > > > > > > > > > In 3.6 we added a feature to let the
engine
> > > > > > > > > > manage
> > > > > > > > > > also the
> > > > > > > > > > engine VM
> > > > > > > > > > itself; ovirt-ha-agent will pickup the
latest
> > > > > > > > > > engine
> > > > > > > > > > VM
> > > > > > > > > > configuration
> > > > > > > > > > from the OVF_STORE which is managed by
the
> > > > > > > > > > engine.
> > > > > > > > > > If something goes wrong, ovirt-ha-agent
could
> > > > > > > > > > fallback to the
> > > > > > > > > > initial
> > > > > > > > > > (bootstrap time) vm.conf. This will
normally
> > > > > > > > > > happen
> > > > > > > > > > till you
> > > > > > > > > > add
> > > > > > > > > > your
> > > > > > > > > > first regular storage domain and the
engine
> > > > > > > > > > imports
> > > > > > > > > > the
> > > > > > > > > > engine
> > > > > > > > > > VM.
> > > > > > > > >
> > > > > > > > > But i already have my first storage domain
and
> > > > > > > > > storage
> > > > > > > > > engine
> > > > > > > > > domain
> > > > > > > > > and already imported engine VM.
> > > > > > > > >
> > > > > > > > > I'm using 4.0 version.
> > > > > > > >
> > > > > > > > This seams an issue, can you please share your
> > > > > > > > /var/log/ovirt-hosted-engine-ha/agent.log ?
> > > > > > > >
> > > > > > >
> > > > > > > I sent it in attachment.
> > > > > >
> > > > > > Nothing strange here;
> > > > > > do you see a couple of disks with alias OVF_STORE on the
> > > > > > hosted-
> > > > > > engine
> > > > > > storage domain if you check it from the engine?
> > > > > >
> > > > >
> > > > > Do you mean any disk label?
> > > > > I don't have it anyone:
> > > > >
> > > > > [root@ied-blade11 ~]# ls /dev/disk/by-label/
> > > > > ls: cannot access /dev/disk/by-label/: No such file or
> > > > > directory
> > > >
> > > > No I mean: go to the engine web-ui, select the hosted-engine
> > > > storage
> > > > domain, check the disks there.
> > >
> > > No, the alias is virtio-disk0.
> > >
> >
> > And this is the engine VM disk, so the issue is why the engine
> > has
> > still to create the OVF_STORE.
> > Can you please share your engine.log from the engine VM?
> >
>
> Go in attachment.
The creation of the OVF_STORE disk failed but it's not that clear
why:
2016-08-17 08:43:33,538 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStorage
DomainCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStorage
DomainCommand'
with failure.
2016-08-17 08:43:33,540 ERROR
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] Ending command
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with failure.
2016-08-17 08:43:33,541 WARN
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] VmCommand::EndVmCommand: Vm is
null - not performing endAction on Vm
2016-08-17 08:43:33,553 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector
]
(DefaultQuartzScheduler6) [6f1f1fd4] Correlation ID: 6f1f1fd4, Call
Stack: null, Custom Event ID: -1, Message: Add-Disk operation failed
to complete.
2016-08-17 08:43:33,557 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector
]
(DefaultQuartzScheduler6) [] Correlation ID: 19ac5bda, Call Stack:
null, Custom Event ID: -1, Message: Failed to create OVF store disk
for Storage Domain hosted_storage.
OVF data won't be updated meanwhile for that domain.
2016-08-17 08:43:33,585 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(DefaultQuartzScheduler6) [5f5a8daf] Command
'ProcessOvfUpdateForStorageDomain' (id:
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting on child command id:
'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
type:'CreateOvfVolumeForStorageDomain' to complete
2016-08-17 08:43:33,595 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStorage
DomainCommand]
(DefaultQuartzScheduler6) [5d314e49] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStorage
DomainCommand'
with failure.
2016-08-17 08:43:33,596 ERROR
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [5d314e49] Ending command
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with failure.
2016-08-17 08:43:33,596 WARN
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [5d314e49] VmCommand::EndVmCommand: Vm is
null - not performing endAction on Vm
2016-08-17 08:43:33,602 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector
]
(DefaultQuartzScheduler6) [5d314e49] Correlation ID: 5d314e49, Call
Stack: null, Custom Event ID: -1, Message: Add-Disk operation failed
to complete.
2016-08-17 08:43:33,605 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector
]
(DefaultQuartzScheduler6) [] Correlation ID: 5f5a8daf, Call Stack:
null, Custom Event ID: -1, Message: Failed to create OVF store disk
for Storage Domain hosted_storage.
OVF data won't be updated meanwhile for that domain.
2016-08-17 08:43:36,460 INFO
[org.ovirt.engine.core.bll.scheduling.HaReservationHandling]
(DefaultQuartzScheduler7) [5d314e49] HA reservation status for
cluster
'Default' is 'OK'
2016-08-17 08:43:36,662 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(DefaultQuartzScheduler4) [5f5a8daf] Command
'ProcessOvfUpdateForStorageDomain' id:
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child commands
'[84959a4b-6a10-4d22-b37e-6c154e17a0da,
eb2e6f1a-c756-4ccd-85a1-60d97d6880de]' executions were completed,
status 'FAILED'
2016-08-17 08:43:37,691 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorag
eDomainCommand]
(DefaultQuartzScheduler6) [5f5a8daf] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorag
eDomainCommand'
with failure.
Can you please check vdsm logs for that time frame on the SPM host?
I sent in attachment the vdsm logs from both hosts, but i think the SPM
host on this time frame it was ied-blade13
It seams that you also have an issue in the SPM election procedure:
2016-08-17 18:04:31,053 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] SPM Init: could not find reported vds or
not up - pool: 'Default' vds_spm_id: '2'
2016-08-17 18:04:31,076 INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] SPM selection - vds seems as spm
'hosted_engine_2'
2016-08-17 18:04:31,076 WARN
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] spm vds is non responsive, stopping spm
selection.
2016-08-17 18:04:31,539 INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher]
(DefaultQuartzScheduler7) [] Fetched 1 VMs from VDS
'06372186-572c-41ad-916f-7cbb0aba5302'
probably due to:
2016-08-17 18:02:33,569 ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
(DefaultQuartzScheduler6) [] Failure to refresh Vds runtime info:
VDSGenericException: VDSNetworkException: Message timeout which can
be
caused by communication issues
2016-08-17 18:02:33,569 ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
(DefaultQuartzScheduler6) [] Exception:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
VDSGenericException: VDSNetworkException: Message timeout which can
be
caused by communication issues
This messages maybe cause by connection issues from yesterday at 6pm.
can you please check if the engine VM could correctly resolve and
reach each host?
Now i can read engine VM from both hosts
[root@ied-blade11 ~]# ping ied-hosted-engine
PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84) bytes
of data.
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=1 ttl=64 time=0.179 ms
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=2 ttl=64 time=0.141 ms
^C
--- ied-hosted-engine.install.eurotux.local ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.141/0.160/0.179/0.019 ms
[root@ied-blade13 ~]# ping ied-hosted-engine
PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84) bytes
of data.
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=1 ttl=64 time=0.172 ms
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=2 ttl=64 time=0.169 ms
^C
--- ied-hosted-engine.install.eurotux.local ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1000ms
rtt min/avg/max/mdev = 0.169/0.170/0.172/0.013 ms
I have a message critical of low disk space on hosted_storage domain.
I have 50G of disk and i created i VM with 40G. Do i need more space of
OVF_STORAGE?
What is the minimum requirements of disk space for deploy engine VM?
Regards,
Carlos
>
> >
> > >
> > > >
> > > > >
> > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Regards,
> > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Regards,
> > > > > > > > > > > > >
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > >
> > > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > > >
> > > > > > > > > > > > > Eurotux Informática,
S.A. | www.eurotux.com
> > > > > > > > > > > > > (t) +351 253 680 300 (m)
+351 911 926 110
> > > > > > > > > > > > >
> > > > > > > > > > > > >
___________________________________________
> > > > > > > > > > > > > ____
> > > > > > > > > > > > > Users mailing list
> > > > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/use
> > > > > > > > > > > > > rs
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > >
> > > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > > >
> > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > (t) +351 253 680 300 (m) +351 911
926 110
> > > > > > > > > > >
> > > > > > > > > > >
_______________________________________________
> > > > > > > > > > > Users mailing list
> > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > > --
> > > > > > > > > Carlos Rodrigues
> > > > > > > > >
> > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > >
> > > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > > >
> > > > > > > --
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > > Engenheiro de Software Sénior
> > > > > > >
> > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > --
> > > > > Carlos Rodrigues
> > > > >
> > > > > Engenheiro de Software Sénior
> > > > >
> > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > >
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> > >
> > >
> >
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
6:43 p.m.
I increase hosted_engine disk space to 160G. How do i force to create
OVF_STORE.
Regards,
Carlos Rodrigues
On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote:
On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote:
>
> On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues <cmar(a)eurotux.co
> m>
> wrote:
> >
> >
> > On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote:
> > >
> > >
> > >
> > >
> > > On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues <cmar@eurotu
> > > x.
> > > com>
> > > wrote:
> > > >
> > > >
> > > > On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote:
> > > > >
> > > > >
> > > > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues <cmar@eu
> > > > > ro
> > > > > tux.
> > > > > com> wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi
> > > > > > wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues
> > > > > > > <cmar@
> > > > > > > euro
> > > > > > > tux.com>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone
Tiraboschi
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos
Rodrigues
> > > > > > > > > <cmar@
> > > > > > > > > eurotux.
> > > > > > > > > com>
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, 2016-08-18 at 08:54 +0200,
Simone
> > > > > > > > > > Tiraboschi
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM,
Carlos
> > > > > > > > > > > Rodrigues <c
> > > > > > > > > > > mar@euro
> > > > > > > > > > > tux.
> > > > > > > > > > > com>
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Sun, 2016-08-14 at 14:22
+0300, Roy Golan
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On 12 August 2016 at
20:23, Carlos
> > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > <cma
> > > > > > > > > > > > > r@eurotu
> > > > > > > > > > > > > x.co
> > > > > > > > > > > > > m>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Hello,
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > I have one cluster
with two hosts with
> > > > > > > > > > > > > > power
> > > > > > > > > > > > > > management
> > > > > > > > > > > > > > correctly
> > > > > > > > > > > > > > configured and one
virtual machine with
> > > > > > > > > > > > > > HostedEngine
> > > > > > > > > > > > > > over
> > > > > > > > > > > > > > shared
> > > > > > > > > > > > > > storage with
FiberChannel.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > When i shutdown the
network of host with
> > > > > > > > > > > > > > HostedEngine
> > > > > > > > > > > > > > VM, it
> > > > > > > > > > > > > > should be
> > > > > > > > > > > > > > possible the
HostedEngine VM migrate
> > > > > > > > > > > > > > automatically to
> > > > > > > > > > > > > > another
> > > > > > > > > > > > > > host?
> > > > > > > > > > > > > >
> > > > > > > > > > > > > migrate on which
network?
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > What is the
expected behaviour on this HA
> > > > > > > > > > > > > > scenario?
> > > > > > > > > > > > >
> > > > > > > > > > > > > After a few minutes your
vm will be
> > > > > > > > > > > > > shutdown
> > > > > > > > > > > > > by
> > > > > > > > > > > > > the High
> > > > > > > > > > > > > Availability
> > > > > > > > > > > > > agent, as it can't
see network, and started
> > > > > > > > > > > > > on
> > > > > > > > > > > > > another
> > > > > > > > > > > > > host.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > I'm testing this scenario
and after shutdown
> > > > > > > > > > > > network, it
> > > > > > > > > > > > should
> > > > > > > > > > > > be
> > > > > > > > > > > > expected that agent shutdown
ha and started
> > > > > > > > > > > > on
> > > > > > > > > > > > another
> > > > > > > > > > > > host,
> > > > > > > > > > > > but
> > > > > > > > > > > > after
> > > > > > > > > > > > couple minutes nothing
happens and on host
> > > > > > > > > > > > with
> > > > > > > > > > > > network we
> > > > > > > > > > > > getting
> > > > > > > > > > > > the
> > > > > > > > > > > > following messages:
> > > > > > > > > > > >
> > > > > > > > > > > > Aug 16 11:44:08 ied-
> > > > > > > > > > > >
blade11.install.eurotux.local
> > > > > > > > > > > > ovirt-ha-
> > > > > > > > > > > > agent[2779]:
> > > > > > > > > > > > ovirt-ha-agent
> > > > > > > > > > > >
ovirt_hosted_engine_ha.agent.hosted_engine.Ho
> > > > > > > > > > > > st
> > > > > > > > > > > > edEn
> > > > > > > > > > > > gine.con
> > > > > > > > > > > > fig
> > > > > > > > > > > > ERROR
> > > > > > > > > > > > Unable to get vm.conf from
OVF_STORE, falling
> > > > > > > > > > > > back
> > > > > > > > > > > > to
> > > > > > > > > > > > initial
> > > > > > > > > > > > vm.conf
> > > > > > > > > > > >
> > > > > > > > > > > > I think the HA agent its
trying to get vm
> > > > > > > > > > > > configuration but
> > > > > > > > > > > > some
> > > > > > > > > > > > how it
> > > > > > > > > > > > can't get vm.conf to
start VM.
> > > > > > > > > > >
> > > > > > > > > > > No, this is a different issues.
> > > > > > > > > > > In 3.6 we added a feature to let
the engine
> > > > > > > > > > > manage
> > > > > > > > > > > also the
> > > > > > > > > > > engine VM
> > > > > > > > > > > itself; ovirt-ha-agent will pickup
the latest
> > > > > > > > > > > engine
> > > > > > > > > > > VM
> > > > > > > > > > > configuration
> > > > > > > > > > > from the OVF_STORE which is
managed by the
> > > > > > > > > > > engine.
> > > > > > > > > > > If something goes wrong,
ovirt-ha-agent could
> > > > > > > > > > > fallback to the
> > > > > > > > > > > initial
> > > > > > > > > > > (bootstrap time) vm.conf. This
will normally
> > > > > > > > > > > happen
> > > > > > > > > > > till you
> > > > > > > > > > > add
> > > > > > > > > > > your
> > > > > > > > > > > first regular storage domain and
the engine
> > > > > > > > > > > imports
> > > > > > > > > > > the
> > > > > > > > > > > engine
> > > > > > > > > > > VM.
> > > > > > > > > >
> > > > > > > > > > But i already have my first storage
domain and
> > > > > > > > > > storage
> > > > > > > > > > engine
> > > > > > > > > > domain
> > > > > > > > > > and already imported engine VM.
> > > > > > > > > >
> > > > > > > > > > I'm using 4.0 version.
> > > > > > > > >
> > > > > > > > > This seams an issue, can you please share
your
> > > > > > > > > /var/log/ovirt-hosted-engine-ha/agent.log ?
> > > > > > > > >
> > > > > > > >
> > > > > > > > I sent it in attachment.
> > > > > > >
> > > > > > > Nothing strange here;
> > > > > > > do you see a couple of disks with alias OVF_STORE on
> > > > > > > the
> > > > > > > hosted-
> > > > > > > engine
> > > > > > > storage domain if you check it from the engine?
> > > > > > >
> > > > > >
> > > > > > Do you mean any disk label?
> > > > > > I don't have it anyone:
> > > > > >
> > > > > > [root@ied-blade11 ~]# ls /dev/disk/by-label/
> > > > > > ls: cannot access /dev/disk/by-label/: No such file or
> > > > > > directory
> > > > >
> > > > > No I mean: go to the engine web-ui, select the hosted-
> > > > > engine
> > > > > storage
> > > > > domain, check the disks there.
> > > >
> > > > No, the alias is virtio-disk0.
> > > >
> > >
> > > And this is the engine VM disk, so the issue is why the engine
> > > has
> > > still to create the OVF_STORE.
> > > Can you please share your engine.log from the engine VM?
> > >
> >
> > Go in attachment.
>
> The creation of the OVF_STORE disk failed but it's not that clear
> why:
>
> 2016-08-17 08:43:33,538 ERROR
> [org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
> ge
> DomainCommand]
> (DefaultQuartzScheduler6) [6f1f1fd4] Ending command
> 'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
> ge
> DomainCommand'
> with failure.
> 2016-08-17 08:43:33,540 ERROR
> [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> (DefaultQuartzScheduler6) [6f1f1fd4] Ending command
> 'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with
> failure.
> 2016-08-17 08:43:33,541 WARN
> [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> (DefaultQuartzScheduler6) [6f1f1fd4] VmCommand::EndVmCommand: Vm is
> null - not performing endAction on Vm
> 2016-08-17 08:43:33,553 ERROR
> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
> or
> ]
> (DefaultQuartzScheduler6) [6f1f1fd4] Correlation ID: 6f1f1fd4, Call
> Stack: null, Custom Event ID: -1, Message: Add-Disk operation
> failed
> to complete.
> 2016-08-17 08:43:33,557 WARN
> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
> or
> ]
> (DefaultQuartzScheduler6) [] Correlation ID: 19ac5bda, Call Stack:
> null, Custom Event ID: -1, Message: Failed to create OVF store disk
> for Storage Domain hosted_storage.
> OVF data won't be updated meanwhile for that domain.
> 2016-08-17 08:43:33,585 INFO
> [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
> (DefaultQuartzScheduler6) [5f5a8daf] Command
> 'ProcessOvfUpdateForStorageDomain' (id:
> '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting on child command
> id:
> 'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> type:'CreateOvfVolumeForStorageDomain' to complete
> 2016-08-17 08:43:33,595 ERROR
> [org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
> ge
> DomainCommand]
> (DefaultQuartzScheduler6) [5d314e49] Ending command
> 'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
> ge
> DomainCommand'
> with failure.
> 2016-08-17 08:43:33,596 ERROR
> [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> (DefaultQuartzScheduler6) [5d314e49] Ending command
> 'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with
> failure.
> 2016-08-17 08:43:33,596 WARN
> [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> (DefaultQuartzScheduler6) [5d314e49] VmCommand::EndVmCommand: Vm is
> null - not performing endAction on Vm
> 2016-08-17 08:43:33,602 ERROR
> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
> or
> ]
> (DefaultQuartzScheduler6) [5d314e49] Correlation ID: 5d314e49, Call
> Stack: null, Custom Event ID: -1, Message: Add-Disk operation
> failed
> to complete.
> 2016-08-17 08:43:33,605 WARN
> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
> or
> ]
> (DefaultQuartzScheduler6) [] Correlation ID: 5f5a8daf, Call Stack:
> null, Custom Event ID: -1, Message: Failed to create OVF store disk
> for Storage Domain hosted_storage.
> OVF data won't be updated meanwhile for that domain.
> 2016-08-17 08:43:36,460 INFO
> [org.ovirt.engine.core.bll.scheduling.HaReservationHandling]
> (DefaultQuartzScheduler7) [5d314e49] HA reservation status for
> cluster
> 'Default' is 'OK'
> 2016-08-17 08:43:36,662 INFO
> [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
> (DefaultQuartzScheduler4) [5f5a8daf] Command
> 'ProcessOvfUpdateForStorageDomain' id:
> '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child commands
> '[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> eb2e6f1a-c756-4ccd-85a1-60d97d6880de]' executions were completed,
> status 'FAILED'
> 2016-08-17 08:43:37,691 ERROR
> [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStor
> ag
> eDomainCommand]
> (DefaultQuartzScheduler6) [5f5a8daf] Ending command
> 'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStor
> ag
> eDomainCommand'
> with failure.
>
> Can you please check vdsm logs for that time frame on the SPM host?
>
I sent in attachment the vdsm logs from both hosts, but i think the
SPM
host on this time frame it was ied-blade13
>
>
> It seams that you also have an issue in the SPM election procedure:
>
> 2016-08-17 18:04:31,053 ERROR
> [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> (DefaultQuartzScheduler1) [] SPM Init: could not find reported vds
> or
> not up - pool: 'Default' vds_spm_id: '2'
> 2016-08-17 18:04:31,076 INFO
> [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> (DefaultQuartzScheduler1) [] SPM selection - vds seems as spm
> 'hosted_engine_2'
> 2016-08-17 18:04:31,076 WARN
> [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> (DefaultQuartzScheduler1) [] spm vds is non responsive, stopping
> spm
> selection.
> 2016-08-17 18:04:31,539 INFO
> [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher]
> (DefaultQuartzScheduler7) [] Fetched 1 VMs from VDS
> '06372186-572c-41ad-916f-7cbb0aba5302'
>
> probably due to:
> 2016-08-17 18:02:33,569 ERROR
> [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
> (DefaultQuartzScheduler6) [] Failure to refresh Vds runtime info:
> VDSGenericException: VDSNetworkException: Message timeout which can
> be
> caused by communication issues
> 2016-08-17 18:02:33,569 ERROR
> [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
> (DefaultQuartzScheduler6) [] Exception:
> org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
> VDSGenericException: VDSNetworkException: Message timeout which can
> be
> caused by communication issues
>
This messages maybe cause by connection issues from yesterday at 6pm.
>
> can you please check if the engine VM could correctly resolve and
> reach each host?
Now i can read engine VM from both hosts
[root@ied-blade11 ~]# ping ied-hosted-engine
PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84)
bytes
of data.
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=1 ttl=64 time=0.179 ms
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=2 ttl=64 time=0.141 ms
^C
--- ied-hosted-engine.install.eurotux.local ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.141/0.160/0.179/0.019 ms
[root@ied-blade13 ~]# ping ied-hosted-engine
PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84)
bytes
of data.
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=1 ttl=64 time=0.172 ms
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=2 ttl=64 time=0.169 ms
^C
--- ied-hosted-engine.install.eurotux.local ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1000ms
rtt min/avg/max/mdev = 0.169/0.170/0.172/0.013 ms
I have a message critical of low disk space on hosted_storage domain.
I have 50G of disk and i created i VM with 40G. Do i need more space
of
OVF_STORAGE?
What is the minimum requirements of disk space for deploy engine VM?
Regards,
Carlos
>
>
>
> >
> >
> > >
> > >
> > > >
> > > >
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Regards,
> > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Regards,
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > --
> > > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurotux.c
> > > > > > > > > > > > > > om
> > > > > > > > > > > > > > (t) +351 253 680
300 (m) +351 911 926 110
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
_________________________________________
> > > > > > > > > > > > > > __
> > > > > > > > > > > > > > ____
> > > > > > > > > > > > > > Users mailing list
> > > > > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/u
> > > > > > > > > > > > > > se
> > > > > > > > > > > > > > rs
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > >
> > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > >
> > > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > (t) +351 253 680 300 (m) +351
911 926 110
> > > > > > > > > > > >
> > > > > > > > > > > >
_____________________________________________
> > > > > > > > > > > > __
> > > > > > > > > > > > Users mailing list
> > > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > > > --
> > > > > > > > > > Carlos Rodrigues
> > > > > > > > > >
> > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > >
> > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > (t) +351 253 680 300 (m) +351 911 926
110
> > > > > > > > > >
> > > > > > > > --
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > Engenheiro de Software Sénior
> > > > > > > >
> > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > --
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > Engenheiro de Software Sénior
> > > > > >
> > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > >
> > > > --
> > > > Carlos Rodrigues
> > > >
> > > > Engenheiro de Software Sénior
> > > >
> > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > >
> > > >
> > >
> > --
> > Carlos Rodrigues
> >
> > Engenheiro de Software Sénior
> >
> > Eurotux Informática, S.A. | www.eurotux.com
> > (t) +351 253 680 300 (m) +351 911 926 110
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
6:45 p.m.
On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
I increase hosted_engine disk space to 160G. How do i force to
create
OVF_STORE.
I think that restarting the engine on the engine VM will trigger it
although I'm not sure that it was a size issue.
Regards,
Carlos Rodrigues
On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote:
> On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote:
> >
> > On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues <cmar(a)eurotux.co
> > m>
> > wrote:
> > >
> > >
> > > On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote:
> > > >
> > > >
> > > >
> > > >
> > > > On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues <cmar@eurotu
> > > > x.
> > > > com>
> > > > wrote:
> > > > >
> > > > >
> > > > > On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote:
> > > > > >
> > > > > >
> > > > > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues
<cmar@eu
> > > > > > ro
> > > > > > tux.
> > > > > > com> wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos
Rodrigues
> > > > > > > > <cmar@
> > > > > > > > euro
> > > > > > > > tux.com>
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone
Tiraboschi
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos
Rodrigues
> > > > > > > > > > <cmar@
> > > > > > > > > > eurotux.
> > > > > > > > > > com>
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Thu, 2016-08-18 at 08:54 +0200,
Simone
> > > > > > > > > > > Tiraboschi
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Tue, Aug 16, 2016 at 12:53
PM, Carlos
> > > > > > > > > > > > Rodrigues <c
> > > > > > > > > > > > mar@euro
> > > > > > > > > > > > tux.
> > > > > > > > > > > > com>
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Sun, 2016-08-14 at
14:22 +0300, Roy Golan
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On 12 August 2016 at
20:23, Carlos
> > > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > > <cma
> > > > > > > > > > > > > > r@eurotu
> > > > > > > > > > > > > > x.co
> > > > > > > > > > > > > > m>
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Hello,
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > I have one
cluster with two hosts with
> > > > > > > > > > > > > > > power
> > > > > > > > > > > > > > > management
> > > > > > > > > > > > > > > correctly
> > > > > > > > > > > > > > > configured and
one virtual machine with
> > > > > > > > > > > > > > > HostedEngine
> > > > > > > > > > > > > > > over
> > > > > > > > > > > > > > > shared
> > > > > > > > > > > > > > > storage with
FiberChannel.
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > When i shutdown
the network of host with
> > > > > > > > > > > > > > > HostedEngine
> > > > > > > > > > > > > > > VM, it
> > > > > > > > > > > > > > > should be
> > > > > > > > > > > > > > > possible the
HostedEngine VM migrate
> > > > > > > > > > > > > > > automatically
to
> > > > > > > > > > > > > > > another
> > > > > > > > > > > > > > > host?
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > migrate on which
network?
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > What is the
expected behaviour on this HA
> > > > > > > > > > > > > > > scenario?
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > After a few minutes
your vm will be
> > > > > > > > > > > > > > shutdown
> > > > > > > > > > > > > > by
> > > > > > > > > > > > > > the High
> > > > > > > > > > > > > > Availability
> > > > > > > > > > > > > > agent, as it
can't see network, and started
> > > > > > > > > > > > > > on
> > > > > > > > > > > > > > another
> > > > > > > > > > > > > > host.
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > I'm testing this
scenario and after shutdown
> > > > > > > > > > > > > network, it
> > > > > > > > > > > > > should
> > > > > > > > > > > > > be
> > > > > > > > > > > > > expected that agent
shutdown ha and started
> > > > > > > > > > > > > on
> > > > > > > > > > > > > another
> > > > > > > > > > > > > host,
> > > > > > > > > > > > > but
> > > > > > > > > > > > > after
> > > > > > > > > > > > > couple minutes nothing
happens and on host
> > > > > > > > > > > > > with
> > > > > > > > > > > > > network we
> > > > > > > > > > > > > getting
> > > > > > > > > > > > > the
> > > > > > > > > > > > > following messages:
> > > > > > > > > > > > >
> > > > > > > > > > > > > Aug 16 11:44:08 ied-
> > > > > > > > > > > > >
blade11.install.eurotux.local
> > > > > > > > > > > > > ovirt-ha-
> > > > > > > > > > > > > agent[2779]:
> > > > > > > > > > > > > ovirt-ha-agent
> > > > > > > > > > > > >
ovirt_hosted_engine_ha.agent.hosted_engine.Ho
> > > > > > > > > > > > > st
> > > > > > > > > > > > > edEn
> > > > > > > > > > > > > gine.con
> > > > > > > > > > > > > fig
> > > > > > > > > > > > > ERROR
> > > > > > > > > > > > > Unable to get vm.conf
from OVF_STORE, falling
> > > > > > > > > > > > > back
> > > > > > > > > > > > > to
> > > > > > > > > > > > > initial
> > > > > > > > > > > > > vm.conf
> > > > > > > > > > > > >
> > > > > > > > > > > > > I think the HA agent its
trying to get vm
> > > > > > > > > > > > > configuration but
> > > > > > > > > > > > > some
> > > > > > > > > > > > > how it
> > > > > > > > > > > > > can't get vm.conf to
start VM.
> > > > > > > > > > > >
> > > > > > > > > > > > No, this is a different
issues.
> > > > > > > > > > > > In 3.6 we added a feature to
let the engine
> > > > > > > > > > > > manage
> > > > > > > > > > > > also the
> > > > > > > > > > > > engine VM
> > > > > > > > > > > > itself; ovirt-ha-agent will
pickup the latest
> > > > > > > > > > > > engine
> > > > > > > > > > > > VM
> > > > > > > > > > > > configuration
> > > > > > > > > > > > from the OVF_STORE which is
managed by the
> > > > > > > > > > > > engine.
> > > > > > > > > > > > If something goes wrong,
ovirt-ha-agent could
> > > > > > > > > > > > fallback to the
> > > > > > > > > > > > initial
> > > > > > > > > > > > (bootstrap time) vm.conf. This
will normally
> > > > > > > > > > > > happen
> > > > > > > > > > > > till you
> > > > > > > > > > > > add
> > > > > > > > > > > > your
> > > > > > > > > > > > first regular storage domain
and the engine
> > > > > > > > > > > > imports
> > > > > > > > > > > > the
> > > > > > > > > > > > engine
> > > > > > > > > > > > VM.
> > > > > > > > > > >
> > > > > > > > > > > But i already have my first storage
domain and
> > > > > > > > > > > storage
> > > > > > > > > > > engine
> > > > > > > > > > > domain
> > > > > > > > > > > and already imported engine VM.
> > > > > > > > > > >
> > > > > > > > > > > I'm using 4.0 version.
> > > > > > > > > >
> > > > > > > > > > This seams an issue, can you please
share your
> > > > > > > > > >
/var/log/ovirt-hosted-engine-ha/agent.log ?
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > I sent it in attachment.
> > > > > > > >
> > > > > > > > Nothing strange here;
> > > > > > > > do you see a couple of disks with alias OVF_STORE
on
> > > > > > > > the
> > > > > > > > hosted-
> > > > > > > > engine
> > > > > > > > storage domain if you check it from the engine?
> > > > > > > >
> > > > > > >
> > > > > > > Do you mean any disk label?
> > > > > > > I don't have it anyone:
> > > > > > >
> > > > > > > [root@ied-blade11 ~]# ls /dev/disk/by-label/
> > > > > > > ls: cannot access /dev/disk/by-label/: No such file or
> > > > > > > directory
> > > > > >
> > > > > > No I mean: go to the engine web-ui, select the hosted-
> > > > > > engine
> > > > > > storage
> > > > > > domain, check the disks there.
> > > > >
> > > > > No, the alias is virtio-disk0.
> > > > >
> > > >
> > > > And this is the engine VM disk, so the issue is why the engine
> > > > has
> > > > still to create the OVF_STORE.
> > > > Can you please share your engine.log from the engine VM?
> > > >
> > >
> > > Go in attachment.
> >
> > The creation of the OVF_STORE disk failed but it's not that clear
> > why:
> >
> > 2016-08-17 08:43:33,538 ERROR
> > [org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
> > ge
> > DomainCommand]
> > (DefaultQuartzScheduler6) [6f1f1fd4] Ending command
> > 'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
> > ge
> > DomainCommand'
> > with failure.
> > 2016-08-17 08:43:33,540 ERROR
> > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > (DefaultQuartzScheduler6) [6f1f1fd4] Ending command
> > 'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with
> > failure.
> > 2016-08-17 08:43:33,541 WARN
> > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > (DefaultQuartzScheduler6) [6f1f1fd4] VmCommand::EndVmCommand: Vm is
> > null - not performing endAction on Vm
> > 2016-08-17 08:43:33,553 ERROR
> > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
> > or
> > ]
> > (DefaultQuartzScheduler6) [6f1f1fd4] Correlation ID: 6f1f1fd4, Call
> > Stack: null, Custom Event ID: -1, Message: Add-Disk operation
> > failed
> > to complete.
> > 2016-08-17 08:43:33,557 WARN
> > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
> > or
> > ]
> > (DefaultQuartzScheduler6) [] Correlation ID: 19ac5bda, Call Stack:
> > null, Custom Event ID: -1, Message: Failed to create OVF store disk
> > for Storage Domain hosted_storage.
> > OVF data won't be updated meanwhile for that domain.
> > 2016-08-17 08:43:33,585 INFO
> > [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
> > (DefaultQuartzScheduler6) [5f5a8daf] Command
> > 'ProcessOvfUpdateForStorageDomain' (id:
> > '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting on child command
> > id:
> > 'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > type:'CreateOvfVolumeForStorageDomain' to complete
> > 2016-08-17 08:43:33,595 ERROR
> > [org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
> > ge
> > DomainCommand]
> > (DefaultQuartzScheduler6) [5d314e49] Ending command
> > 'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
> > ge
> > DomainCommand'
> > with failure.
> > 2016-08-17 08:43:33,596 ERROR
> > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > (DefaultQuartzScheduler6) [5d314e49] Ending command
> > 'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with
> > failure.
> > 2016-08-17 08:43:33,596 WARN
> > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > (DefaultQuartzScheduler6) [5d314e49] VmCommand::EndVmCommand: Vm is
> > null - not performing endAction on Vm
> > 2016-08-17 08:43:33,602 ERROR
> > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
> > or
> > ]
> > (DefaultQuartzScheduler6) [5d314e49] Correlation ID: 5d314e49, Call
> > Stack: null, Custom Event ID: -1, Message: Add-Disk operation
> > failed
> > to complete.
> > 2016-08-17 08:43:33,605 WARN
> > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
> > or
> > ]
> > (DefaultQuartzScheduler6) [] Correlation ID: 5f5a8daf, Call Stack:
> > null, Custom Event ID: -1, Message: Failed to create OVF store disk
> > for Storage Domain hosted_storage.
> > OVF data won't be updated meanwhile for that domain.
> > 2016-08-17 08:43:36,460 INFO
> > [org.ovirt.engine.core.bll.scheduling.HaReservationHandling]
> > (DefaultQuartzScheduler7) [5d314e49] HA reservation status for
> > cluster
> > 'Default' is 'OK'
> > 2016-08-17 08:43:36,662 INFO
> > [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
> > (DefaultQuartzScheduler4) [5f5a8daf] Command
> > 'ProcessOvfUpdateForStorageDomain' id:
> > '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child commands
> > '[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > eb2e6f1a-c756-4ccd-85a1-60d97d6880de]' executions were completed,
> > status 'FAILED'
> > 2016-08-17 08:43:37,691 ERROR
> > [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStor
> > ag
> > eDomainCommand]
> > (DefaultQuartzScheduler6) [5f5a8daf] Ending command
> > 'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStor
> > ag
> > eDomainCommand'
> > with failure.
> >
> > Can you please check vdsm logs for that time frame on the SPM host?
> >
>
> I sent in attachment the vdsm logs from both hosts, but i think the
> SPM
> host on this time frame it was ied-blade13
>
> >
> >
> > It seams that you also have an issue in the SPM election procedure:
> >
> > 2016-08-17 18:04:31,053 ERROR
> > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> > (DefaultQuartzScheduler1) [] SPM Init: could not find reported vds
> > or
> > not up - pool: 'Default' vds_spm_id: '2'
> > 2016-08-17 18:04:31,076 INFO
> > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> > (DefaultQuartzScheduler1) [] SPM selection - vds seems as spm
> > 'hosted_engine_2'
> > 2016-08-17 18:04:31,076 WARN
> > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> > (DefaultQuartzScheduler1) [] spm vds is non responsive, stopping
> > spm
> > selection.
> > 2016-08-17 18:04:31,539 INFO
> > [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher]
> > (DefaultQuartzScheduler7) [] Fetched 1 VMs from VDS
> > '06372186-572c-41ad-916f-7cbb0aba5302'
> >
> > probably due to:
> > 2016-08-17 18:02:33,569 ERROR
> > [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
> > (DefaultQuartzScheduler6) [] Failure to refresh Vds runtime info:
> > VDSGenericException: VDSNetworkException: Message timeout which can
> > be
> > caused by communication issues
> > 2016-08-17 18:02:33,569 ERROR
> > [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
> > (DefaultQuartzScheduler6) [] Exception:
> > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
> > VDSGenericException: VDSNetworkException: Message timeout which can
> > be
> > caused by communication issues
> >
>
> This messages maybe cause by connection issues from yesterday at 6pm.
>
> >
> > can you please check if the engine VM could correctly resolve and
> > reach each host?
>
> Now i can read engine VM from both hosts
>
> [root@ied-blade11 ~]# ping ied-hosted-engine
> PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84)
> bytes
> of data.
> 64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
> icmp_seq=1 ttl=64 time=0.179 ms
> 64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
> icmp_seq=2 ttl=64 time=0.141 ms
> ^C
> --- ied-hosted-engine.install.eurotux.local ping statistics ---
> 2 packets transmitted, 2 received, 0% packet loss, time 999ms
> rtt min/avg/max/mdev = 0.141/0.160/0.179/0.019 ms
> [root@ied-blade13 ~]# ping ied-hosted-engine
> PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84)
> bytes
> of data.
> 64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
> icmp_seq=1 ttl=64 time=0.172 ms
> 64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
> icmp_seq=2 ttl=64 time=0.169 ms
> ^C
> --- ied-hosted-engine.install.eurotux.local ping statistics ---
> 2 packets transmitted, 2 received, 0% packet loss, time 1000ms
> rtt min/avg/max/mdev = 0.169/0.170/0.172/0.013 ms
>
>
> I have a message critical of low disk space on hosted_storage domain.
> I have 50G of disk and i created i VM with 40G. Do i need more space
> of
> OVF_STORAGE?
> What is the minimum requirements of disk space for deploy engine VM?
>
> Regards,
> Carlos
>
> >
> >
> >
> > >
> > >
> > > >
> > > >
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Regards,
> > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Regards,
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurotux.c
> > > > > > > > > > > > > > > om
> > > > > > > > > > > > > > > (t) +351 253
680 300 (m) +351 911 926 110
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
_________________________________________
> > > > > > > > > > > > > > > __
> > > > > > > > > > > > > > > ____
> > > > > > > > > > > > > > > Users mailing
list
> > > > > > > > > > > > > > >
Users(a)ovirt.org
> > > > > > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/u
> > > > > > > > > > > > > > > se
> > > > > > > > > > > > > > > rs
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > >
> > > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > > >
> > > > > > > > > > > > > Eurotux Informática, S.A.
| www.eurotux.com
> > > > > > > > > > > > > (t) +351 253 680 300 (m)
+351 911 926 110
> > > > > > > > > > > > >
> > > > > > > > > > > > >
_____________________________________________
> > > > > > > > > > > > > __
> > > > > > > > > > > > > Users mailing list
> > > > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > > > > --
> > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > >
> > > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > > >
> > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > (t) +351 253 680 300 (m) +351 911
926 110
> > > > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Carlos Rodrigues
> > > > > > > > >
> > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > >
> > > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > --
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > > Engenheiro de Software Sénior
> > > > > > >
> > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > >
> > > > > --
> > > > > Carlos Rodrigues
> > > > >
> > > > > Engenheiro de Software Sénior
> > > > >
> > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > >
> > > > >
> > > >
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
7:38 p.m.
--=-c3iGRn1xmIN62/k5uKWa
Content-Type: multipart/alternative; boundary="=-PNqkdmkgzkScJoTZyDpl"
--=-PNqkdmkgzkScJoTZyDpl
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote:
> > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues
<cmar(a)eurotux.com>
wrote:
>
> > > I increase hosted_engine disk space to 160G. How do i force to
create
> OVF_STORE.
I think that restarting the engine on the engine VM will trigger it
although I'm not sure that it was a size issue.
I found to OVF_STORE on another storage domain with "Domain Type" "Data
(Master)"
>
> Regards,
> Carlos Rodrigues
>
> On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote:
> >
> > On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote:
> > >
> > >
> > > > > > > On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues
<cmar(a)eurotux.co
> > > m>
> > > wrote:
> > > >
> > > >
> > > >
> > > > On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote:
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > > > > > > > On Thu, Aug 18, 2016 at 11:50 AM,
Carlos Rodrigues
<cmar@eurotu
> > > > > x.
> > > > > com>
> > > > > wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > > > > > > > > > On Thu, 2016-08-18 at
11:42 +0200, Simone Tiraboschi
wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > On Thu, Aug
18, 2016 at 11:25 AM, Carlos Rodrigues
<cmar@eu
> > > > > > > ro
> > > > > > > tux.
> > > > > > > com> wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, 2016-08-18 at 11:04 +0200, Simone
Tiraboschi
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos
Rodrigues
> > > > > > > > > <cmar@
> > > > > > > > > euro
> > > > > > > > > tux.com>
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > On Thu, 2016-08-18 at 10:27 +0200, Simone
Tiraboschi
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos
Rodrigues
> > > > > > > > > > > <cmar@
> > > > > > > > > > > eurotux.
> > > > > > > > > > > com>
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, 2016-08-18 at 08:54
+0200, Simone
> > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Tue, Aug 16, 2016 at
12:53 PM, Carlos
> > > > > > > > > > > > > Rodrigues <c
> > > > > > > > > > > > > mar@euro
> > > > > > > > > > > > > tux.
> > > > > > > > > > > > > com>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > On Sun, 2016-08-14 at 14:22 +0300,
Roy
Golan
> > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On 12 August
2016 at 20:23, Carlos
> > > > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > > > <cma
> > > > > > > > > > > > > > > r@eurotu
> > > > > > > > > > > > > > > x.co
> > > > > > > > > > > > > > > m>
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Hello,
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > I have one
cluster with two hosts
with
> > > > > > > > > > > > > >
> > power
> > > > > > > > > > > > > > > >
management
> > > > > > > > > > > > > > > >
correctly
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > configured and
one virtual machine
with
> > > > > > > > > > > > > >
> > HostedEngine
> > > > > > > > > > > > > > > > over
> > > > > > > > > > > > > > > > shared
> > > > > > > > > > > > > > > > storage
with FiberChannel.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > When i shutdown
the network of host
with
> > > > > > > > > > > > > >
> > HostedEngine
> > > > > > > > > > > > > > > > VM, it
> > > > > > > > > > > > > > > > should
be
> > > > > > > > > > > > > > > > possible
the HostedEngine VM migrate
> > > > > > > > > > > > > > > >
automatically to
> > > > > > > > > > > > > > > > another
> > > > > > > > > > > > > > > > host?
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > migrate on
which network?
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > What is the
expected behaviour on
this HA
> > > > > > > > > > > > > >
> > scenario?
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > After a few
minutes your vm will be
> > > > > > > > > > > > > > > shutdown
> > > > > > > > > > > > > > > by
> > > > > > > > > > > > > > > the High
> > > > > > > > > > > > > > > Availability
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > agent, as it can't
see network, and
started
> > > > > > > > > > > > > >
> on
> > > > > > > > > > > > > > > another
> > > > > > > > > > > > > > > host.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > I'm testing this scenario and
after
shutdown
> > > > > > > > > > > > > >
network, it
> > > > > > > > > > > > > > should
> > > > > > > > > > > > > > be
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > expected that agent shutdown ha and
started
> > > > > > > > > > > > > >
on
> > > > > > > > > > > > > > another
> > > > > > > > > > > > > > host,
> > > > > > > > > > > > > > but
> > > > > > > > > > > > > > after
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > couple minutes nothing happens and
on
host
> > > > > > > > > > > > > >
with
> > > > > > > > > > > > > > network we
> > > > > > > > > > > > > > getting
> > > > > > > > > > > > > > the
> > > > > > > > > > > > > > following
messages:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Aug 16 11:44:08
ied-
> > > > > > > > > > > > > >
blade11.install.eurotux.local
> > > > > > > > > > > > > > ovirt-ha-
> > > > > > > > > > > > > > agent[2779]:
> > > > > > > > > > > > > > ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
ovirt_hosted_engine_ha.agent.hosted_engin
e.Ho
> > > > > > > > > > > > > >
st
> > > > > > > > > > > > > > edEn
> > > > > > > > > > > > > > gine.con
> > > > > > > > > > > > > > fig
> > > > > > > > > > > > > > ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > Unable to get vm.conf from
OVF_STORE,
falling
> > > > > > > > > > > > > >
back
> > > > > > > > > > > > > > to
> > > > > > > > > > > > > > initial
> > > > > > > > > > > > > > vm.conf
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > I think the HA
agent its trying to get vm
> > > > > > > > > > > > > > configuration but
> > > > > > > > > > > > > > some
> > > > > > > > > > > > > > how it
> > > > > > > > > > > > > > can't get
vm.conf to start VM.
> > > > > > > > > > > > >
> > > > > > > > > > > > > No, this is a different
issues.
> > > > > > > > > > > > > In 3.6 we added a
feature to let the engine
> > > > > > > > > > > > > manage
> > > > > > > > > > > > > also the
> > > > > > > > > > > > > engine VM
> > > > > > > > > > > > > > > > > >
> > > > > > > > > itself; ovirt-ha-agent will pickup the
latest
> > > > > > > > > > > > >
engine
> > > > > > > > > > > > > VM
> > > > > > > > > > > > > configuration
> > > > > > > > > > > > > from the OVF_STORE which
is managed by the
> > > > > > > > > > > > > engine.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > If something goes wrong, ovirt-ha-agent
could
> > > > > > > > > > > > >
fallback to the
> > > > > > > > > > > > > initial
> > > > > > > > > > > > > > > > > >
> > > > > > > > > (bootstrap time) vm.conf. This will
normally
> > > > > > > > > > > > >
happen
> > > > > > > > > > > > > till you
> > > > > > > > > > > > > add
> > > > > > > > > > > > > your
> > > > > > > > > > > > > first regular storage
domain and the engine
> > > > > > > > > > > > > imports
> > > > > > > > > > > > > the
> > > > > > > > > > > > > engine
> > > > > > > > > > > > > VM.
> > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > But i already have my first storage domain
and
> > > > > > > > > > > > storage
> > > > > > > > > > > > engine
> > > > > > > > > > > > domain
> > > > > > > > > > > > and already imported engine
VM.
> > > > > > > > > > > >
> > > > > > > > > > > > I'm using 4.0 version.
> > > > > > > > > > >
> > > > > > > > > > > This seams an issue, can you
please share your
> > > > > > > > > > >
/var/log/ovirt-hosted-engine-ha/agent.log ?
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > I sent it in attachment.
> > > > > > > > >
> > > > > > > > > Nothing strange here;
> > > > > > > > > > > > > > > > > >
> do you see a couple of disks with alias OVF_STORE
on
> > > > > > > > > the
> > > > > > > > > hosted-
> > > > > > > > > engine
> > > > > > > > > storage domain if you check it from the
engine?
> > > > > > > > >
> > > > > > > >
> > > > > > > > Do you mean any disk label?
> > > > > > > > I don't have it anyone:
> > > > > > > >
> > > > > > > > > > > > > > > > >
[root@ied-blade11 ~]# ls /dev/disk/by-label/
> > > > > > > > > > > > > > > > > ls:
cannot access /dev/disk/by-label/: No such file
or
> > > > > > > > directory
> > > > > > >
> > > > > > > No I mean: go to the engine web-ui, select the
hosted-
> > > > > > > engine
> > > > > > > storage
> > > > > > > domain, check the disks there.
> > > > > >
> > > > > > No, the alias is virtio-disk0.
> > > > > >
> > > > >
> > > > > > > > > > > And this is the engine VM disk, so
the issue is why the
engine
> > > > > has
> > > > > still to create the OVF_STORE.
> > > > > Can you please share your engine.log from the engine VM?
> > > > >
> > > >
> > > > Go in attachment.
> > >
> > > > > > > The creation of the OVF_STORE disk failed but it's
not that
clear
> > > why:
> > >
> > > 2016-08-17 08:43:33,538 ERROR
> > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForS
tora
> > > ge
> > > DomainCommand]
> > > (DefaultQuartzScheduler6) [6f1f1fd4] Ending command
> > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForS
tora
> > > ge
> > > DomainCommand'
> > > with failure.
> > > 2016-08-17 08:43:33,540 ERROR
> > > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > (DefaultQuartzScheduler6) [6f1f1fd4] Ending command
> > > 'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with
> > > failure.
> > > 2016-08-17 08:43:33,541 WARN
> > > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4]
VmCommand::EndVmCommand:
Vm is
> > > null - not performing endAction on Vm
> > > 2016-08-17 08:43:33,553 ERROR
> > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDi
rect
> > > or
> > > ]
> > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Correlation ID:
6f1f1fd4,
Call
> > > Stack: null, Custom Event ID: -1, Message: Add-Disk
operation
> > > failed
> > > to complete.
> > > 2016-08-17 08:43:33,557 WARN
> > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDi
rect
> > > or
> > > ]
> > > > > > > (DefaultQuartzScheduler6) [] Correlation ID: 19ac5bda,
Call
Stack:
> > > > > > > null, Custom Event ID: -1,
Message: Failed to create OVF store
disk
> > > for Storage Domain hosted_storage.
> > > OVF data won't be updated meanwhile for that domain.
> > > 2016-08-17 08:43:33,585 INFO
> > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback
]
> > > (DefaultQuartzScheduler6) [5f5a8daf] Command
> > > 'ProcessOvfUpdateForStorageDomain' (id:
> > > > > > > '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0')
waiting on child
command
> > > id:
> > > 'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > > type:'CreateOvfVolumeForStorageDomain' to complete
> > > 2016-08-17 08:43:33,595 ERROR
> > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForS
tora
> > > ge
> > > DomainCommand]
> > > (DefaultQuartzScheduler6) [5d314e49] Ending command
> > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForS
tora
> > > ge
> > > DomainCommand'
> > > with failure.
> > > 2016-08-17 08:43:33,596 ERROR
> > > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > (DefaultQuartzScheduler6) [5d314e49] Ending command
> > > 'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with
> > > failure.
> > > 2016-08-17 08:43:33,596 WARN
> > > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > > > > > (DefaultQuartzScheduler6) [5d314e49]
VmCommand::EndVmCommand:
Vm is
> > > null - not performing endAction on Vm
> > > 2016-08-17 08:43:33,602 ERROR
> > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDi
rect
> > > or
> > > ]
> > > > > > > (DefaultQuartzScheduler6) [5d314e49] Correlation ID:
5d314e49,
Call
> > > Stack: null, Custom Event ID: -1, Message: Add-Disk
operation
> > > failed
> > > to complete.
> > > 2016-08-17 08:43:33,605 WARN
> > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDi
rect
> > > or
> > > ]
> > > > > > > (DefaultQuartzScheduler6) [] Correlation ID: 5f5a8daf,
Call
Stack:
> > > > > > > null, Custom Event ID: -1,
Message: Failed to create OVF store
disk
> > > for Storage Domain hosted_storage.
> > > OVF data won't be updated meanwhile for that domain.
> > > 2016-08-17 08:43:36,460 INFO
> > > [org.ovirt.engine.core.bll.scheduling.HaReservationHandling]
> > > (DefaultQuartzScheduler7) [5d314e49] HA reservation status for
> > > cluster
> > > 'Default' is 'OK'
> > > 2016-08-17 08:43:36,662 INFO
> > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback
]
> > > (DefaultQuartzScheduler4) [5f5a8daf] Command
> > > 'ProcessOvfUpdateForStorageDomain' id:
> > > '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child commands
> > > '[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > > > > > > eb2e6f1a-c756-4ccd-85a1-60d97d6880de]' executions
were
completed,
> > > status 'FAILED'
> > > 2016-08-17 08:43:37,691 ERROR
> > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateFor
Stor
> > > ag
> > > eDomainCommand]
> > > (DefaultQuartzScheduler6) [5f5a8daf] Ending command
> > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateFor
Stor
> > > ag
> > > eDomainCommand'
> > > with failure.
> > >
> > > > > > > Can you please check vdsm logs for that time frame on
the SPM
host?
> > >
> >
> > > > > I sent in attachment the vdsm logs from both hosts, but i think
the
> > SPM
> > host on this time frame it was ied-blade13
> >
> > >
> > >
> > >
> > > > > > > It seams that you also have an issue in the SPM
election
procedure:
> > >
> > > 2016-08-17 18:04:31,053 ERROR
> > > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> > > > > > > (DefaultQuartzScheduler1) [] SPM Init: could not find
reported
vds
> > > or
> > > not up - pool: 'Default' vds_spm_id: '2'
> > > 2016-08-17 18:04:31,076 INFO
> > > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> > > (DefaultQuartzScheduler1) [] SPM selection - vds seems as spm
> > > 'hosted_engine_2'
> > > 2016-08-17 18:04:31,076 WARN
> > > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> > > > > > > (DefaultQuartzScheduler1) [] spm vds is non
responsive,
stopping
> > > spm
> > > selection.
> > > 2016-08-17 18:04:31,539 INFO
> > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetche
r]
> > > (DefaultQuartzScheduler7) [] Fetched 1 VMs from VDS
> > > '06372186-572c-41ad-916f-7cbb0aba5302'
> > >
> > > probably due to:
> > > 2016-08-17 18:02:33,569 ERROR
> > > [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
> > > > > > > (DefaultQuartzScheduler6) [] Failure to refresh Vds
runtime
info:
> > > > > > > VDSGenericException:
VDSNetworkException: Message timeout which
can
> > > > be
> > > > caused by communication issues
> > > > 2016-08-17 18:02:33,569 ERROR
> > > > [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
> > > > (DefaultQuartzScheduler6) [] Exception:
> > > > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
> > > > > > > VDSGenericException:
VDSNetworkException: Message timeout which
can
> > > be
> > > caused by communication issues
> > >
> >
> > > > > This messages maybe cause by connection issues from yesterday at
6pm.
> >
> > >
> > >
> > > > > > > can you please check if the engine VM could correctly
resolve
and
> > > reach each host?
> >
> > Now i can read engine VM from both hosts
> >
> > > > > [root@ied-blade11 ~]# ping ied-hosted-engine
> > PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84)
> > bytes
> > of data.
> > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
(10.10.4.115):
> > icmp_seq=1 ttl=64 time=0.179 ms
> > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
(10.10.4.115):
> > icmp_seq=2 ttl=64 time=0.141 ms
> > ^C
> > --- ied-hosted-engine.install.eurotux.local ping statistics ---
> > 2 packets transmitted, 2 received, 0% packet loss, time 999ms
> > rtt min/avg/max/mdev = 0.141/0.160/0.179/0.019 ms
> > > > > [root@ied-blade13 ~]# ping ied-hosted-engine
> > PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84)
> > bytes
> > of data.
> > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
(10.10.4.115):
> > icmp_seq=1 ttl=64 time=0.172 ms
> > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
(10.10.4.115):
> > icmp_seq=2 ttl=64 time=0.169 ms
> > ^C
> > --- ied-hosted-engine.install.eurotux.local ping statistics ---
> > 2 packets transmitted, 2 received, 0% packet loss, time 1000ms
> > rtt min/avg/max/mdev = 0.169/0.170/0.172/0.013 ms
> >
> >
> > > > > I have a message critical of low disk space on hosted_storage
domain.
> > > > > I have 50G of disk and i created i VM with
40G. Do i need more
space
> > of
> > OVF_STORAGE?
> > > > > What is the minimum requirements of disk space for deploy engine
VM?
> >
> > Regards,
> > Carlos
> >
> > >
> > >
> > >
> > >
> > > >
> > > >
> > > >
> > > > >
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Regards,
> > > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Regards,
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Eurotux
Informática, S.A. |
www.eurotux.c
> > > > > > > > > > > > > >
> > om
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > (t) +351 253
680 300 (m) +351 911 926
110
> > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
_____________________________________
____
> > > > > > > > > > > > > >
> > __
> > > > > > > > > > > > > > > > ____
> > > > > > > > > > > > > > > > Users
mailing list
> > > > > > > > > > > > > > > >
Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
http://lists.ovirt.org/mailman/listin
fo/u
> > > > > > > > > > > > > >
> > se
> > > > > > > > > > > > > > > > rs
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > --
> > > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > > >
(t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
_________________________________________
____
> > > > > > > > > > > > > >
__
> > > > > > > > > > > > > > Users mailing list
> > > > > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/u
sers
> > > > > > > > > > > > --
> > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > >
> > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > >
> > > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > (t) +351 253 680 300 (m) +351
911 926 110
> > > > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Carlos Rodrigues
> > > > > > > > > >
> > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > >
> > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > (t) +351 253 680 300 (m) +351 911 926
110
> > > > > > > > --
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > Engenheiro de Software Sénior
> > > > > > > >
> > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > >
> > > > > > --
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > Engenheiro de Software Sénior
> > > > > >
> > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > >
> > > > > >
> > > > >
> > > > --
> > > > Carlos Rodrigues
> > > >
> > > > Engenheiro de Software Sénior
> > > >
> > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > (t) +351 253 680 300 (m) +351 911 926 110
> > _______________________________________________
> > Users mailing list
> > Users(a)ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/users
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--=-PNqkdmkgzkScJoTZyDpl
Content-Type: text/html; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
<html><head></head><body><div>On Thu, 2016-08-18 at 17:45
+0200, Simone Tir=
aboschi wrote:</div><blockquote type=3D"cite"><div>On Thu, Aug
18, 2016 at =
5:43 PM, Carlos Rodrigues <<a
href=3D"mailto:cmar@eurotux.com">cmar@euro=
tux.com</a>> wrote:</div><blockquote
type=3D"cite"><div><br></div><div>I=
increase hosted_engine disk space to 160G. How do i force to create</div><=
div>OVF_STORE.</div></blockquote><div><br></div><div>I
think that restartin=
g the engine on the engine VM will trigger it</div><div>although I'm not
su=
re that it was a size
issue.</div><div><br></div></blockquote><div><br></di=
v><div>I found to OVF_STORE on another storage domain with "Domain
Type" "D=
ata (Master)"</div><div><br></div><div><img
src=3D"cid:1471538309.2273.30.c=
amel@eurotux.com">=E2=80=8B<br></div><div><br></div><div><br></div><blockqu=
ote type=3D"cite"><blockquote
type=3D"cite"><div><br></div><div>Regards,</d=
iv><div>Carlos
Rodrigues</div><div><br></div><div>On Thu, 2016-08-18 at
12:=
14 +0100, Carlos Rodrigues wrote:</div><blockquote
type=3D"cite"><div><br><=
/div><div>On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi
wrote:</div>=
<blockquote
type=3D"cite"><div><br></div><div><br></div><div>On
Thu, Aug 18=
, 2016 at 12:11 PM, Carlos Rodrigues
&lt;cmar(a)eurotux.co</div><div>m&gt;</d=
iv><div>wrote:</div><blockquote
type=3D"cite"><div><br></div><div><br></div=
<div><br></div><div>On Thu, 2016-08-18 at
11:53 +0200, Simone Tiraboschi w=
rote:</div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><br=
</div><div><br></div><div><br></div><div>On
Thu, Aug 18, 2016 at 11:50 AM,=
Carlos Rodrigues
&lt;cmar(a)eurotu</div><div>x.</div><div>com&gt;</div><div>=
wrote:</div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><b=
r></div><div>On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi
wrote:</d=
iv><blockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div><=
div>On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues
<cmar@eu</div><di=
v>ro</div><div>tux.</div><div>com>
wrote:</div><blockquote type=3D"cite"=
<div><br></div><div><br></div><div><br></div><div><br></div><div>On
Thu, 2=
016-08-18 at 11:04 +0200, Simone
Tiraboschi</div><div>wrote:</div><blockquo=
te
type=3D"cite"><div><br></div><div><br></div><div><br></div><div><br></di=
v><div>On Thu, Aug 18, 2016 at 10:36 AM, Carlos
Rodrigues</div><div><cma=
r@</div><div>euro</div><div>tux.com></div><div>wrote:</div><blockquote
t=
ype=3D"cite"><div><br></div><div><br></div><div><br></div><div><br></div><d=
iv><br></div><div>On Thu, 2016-08-18 at 10:27 +0200, Simone
Tiraboschi</div=
<div>wrote:</div><blockquote
type=3D"cite"><div><br></div><div><br></div><=
div><br></div><div><br></div><div><br></div><div>On
Thu, Aug 18, 2016 at 10=
:22 AM, Carlos
Rodrigues</div><div>&lt;cmar(a)</div><div>eurotux.</div><div>c=
om></div><div>wrote:</div><blockquote
type=3D"cite"><div><br></div><div>=
<br></div><div><br></div><div><br></div><div><br></div><div><br></div><div>=
On Thu, 2016-08-18 at 08:54 +0200,
Simone</div><div>Tiraboschi</div><div>wr=
ote:</div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><br>=
</div><div><br></div><div><br></div><div><br></div><div>On
Tue, Aug 16, 201=
6 at 12:53 PM, Carlos</div><div>Rodrigues
<c</div><div><a href=3D"mailto=
:mar@euro">mar@euro</a></div><div>tux.</div><div>com></div><div>wrote:</=
div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div>=
<div><br></div><div><br></div><div><br></div><div><br></div><div>On
Sun, 20=
16-08-14 at 14:22 +0300, Roy Golan</div><div>wrote:</div><blockquote
type=
=3D"cite"><div><br></div><div><br></div><div><br></div><div><br></div><div>=
<br></div><div><br></div><div><br></div><div><br></div><div><br></div><div>=
On 12 August 2016 at 20:23,
Carlos</div><div>Rodrigues</div><div><cma</d=
iv><div><a
href=3D"mailto:r@eurotu">r@eurotu</a></div><div>x.co</div><div>m=
></div><div>wrote:</div><blockquote
type=3D"cite"><div><br></div><div><b=
r></div><div><br></div><div><br></div><div><br></div><div><br></div><div><b=
r></div><div>Hello,</div><div><br></div><div>I
have one cluster with two ho=
sts
with</div><div>power</div><div>management</div><div>correctly</div><div=
configured and one virtual machine
with</div><div>HostedEngine</div><div>o=
ver</div><div>shared</div><div>storage with
FiberChannel.</div><div><br></d=
iv><div>When i shutdown the network of host
with</div><div>HostedEngine</di=
v><div>VM, it</div><div>should
be</div><div>possible the HostedE=
ngine VM migrate</div><div>automatically
to</div><div>another</div><div>hos=
t?</div><div><br></div></blockquote><div>migrate on
which network?</div><di=
v><br></div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><b=
r></div><div><br></div><div><br></div><div><br></div><div><br></div><div>Wh=
at is the expected behaviour on this
HA</div><div>scenario?</div></blockquo=
te><div><br></div><div>After a few minutes your vm will
be</div><div>shutdo=
wn</div><div>by</div><div>the
High</div><div>Availability</div><div>agent, =
as it can't see network, and
started</div><div>on</div><div>another</div><d=
iv>host.</div></blockquote><div><br></div><div><br></div><div>I'm
testing t=
his scenario and after shutdown</div><div>network,
it</div><div>should</div=
<div>be</div><div>expected that agent shutdown ha
and started</div><div>on=
</div><div>another</div><div>host,</div><div>but</div><div>after</div><div>=
couple minutes nothing happens and on
host</div><div>with</div><div>network=
we</div><div>getting</div><div>the</div><div>following
messages:</div><div=
<br></div><div>Aug 16 11:44:08
ied-</div><div>blade11.install.eurotux.loca=
l</div><div>ovirt-ha-</div><div>agent[2779]:</div><div>ovirt-ha-agent</div>=
<div>ovirt_hosted_engine_ha.agent.hosted_engine.Ho</div><div>st</div><div>e=
dEn</div><div>gine.con</div><div>fig</div><div>ERROR</div><div>Unable
to ge=
t vm.conf from OVF_STORE,
falling</div><div>back</div><div>to</div><div>ini=
tial</div><div>vm.conf</div><div><br></div><div>I
think the HA agent its tr=
ying to get vm</div><div>configuration
but</div><div>some</div><div>how it<=
/div><div>can't get vm.conf to start
VM.</div></blockquote><div><br></div><=
div>No, this is a different issues.</div><div>In 3.6 we added a feature to
=
let the engine</div><div>manage</div><div>also
the</div><div>engine VM</div=
<div>itself; ovirt-ha-agent will pickup the
latest</div><div>engine</div><=
div>VM</div><div>configuration</div><div>from the
OVF_STORE which is manage=
d by the</div><div>engine.</div><div>If something goes wrong,
ovirt-ha-agen=
t could</div><div>fallback to
the</div><div>initial</div><div>(bootstrap ti=
me) vm.conf. This will normally</div><div>happen</div><div>till
you</div><d=
iv>add</div><div>your</div><div>first regular storage domain
and the engine=
</div><div>imports</div><div>the</div><div>engine</div><div>VM.</div></bloc=
kquote><div><br></div><div>But i already have my first storage
domain and</=
div><div>storage</div><div>engine</div><div>domain</div><div>and
already im=
ported engine VM.</div><div><br></div><div>I'm using 4.0
version.</div></bl=
ockquote><div><br></div><div>This seams an issue, can you
please share your=
</div><div>/var/log/ovirt-hosted-engine-ha/agent.log
?</div><div><br></div>=
</blockquote><div><br></div><div>I sent it in
attachment.</div></blockquote=
<div><br></div><div>Nothing strange
here;</div><div>do you see a couple of=
disks with alias OVF_STORE
on</div><div>the</div><div>hosted-</div><div>en=
gine</div><div>storage domain if you check it from the
engine?</div><div><b=
r></div></blockquote><div><br></div><div>Do you
mean any disk label?</div><=
div>I don't have it
anyone:</div><div><br></div><div>[<a
href=3D"mailto:roo=
t@ied-blade11">root@ied-blade11</a> ~]# ls
/dev/disk/by-label/</=
div><div>ls: cannot access /dev/disk/by-label/: No such file
or</div><div>d=
irectory</div></blockquote><div><br></div><div>No I
mean: go to the engine =
web-ui, select the
hosted-</div><div>engine</div><div>storage</div><div>dom=
ain, check the disks
there.</div></blockquote><div><br></div><div>No, the
a=
lias is
virtio-disk0.</div><div><br></div></blockquote><div><br></div><div>=
And this is the engine VM disk, so the issue is why the engine</div><div>ha=
s</div><div>still to create the OVF_STORE.</div><div>Can you
please share y=
our engine.log from the engine
VM?</div><div><br></div></blockquote><div><b=
r></div><div>Go in
attachment.</div></blockquote><div><br></div><div>The
cr=
eation of the OVF_STORE disk failed but it's not that
clear</div><div>why:<=
/div><div><br></div><div>2016-08-17 08:43:33,538
ERROR</div><div>[org.ovirt=
.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora</div><div>ge</div=
<div>DomainCommand]</div><div>(DefaultQuartzScheduler6)
[6f1f1fd4] Ending =
command</div><div>'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolu=
meForStora</div><div>ge</div><div>DomainCommand'</div><div>with
failure.</d=
iv><div>2016-08-17 08:43:33,540
ERROR</div><div>[org.ovirt.engine.core.bll.=
storage.disk.AddDiskCommand]</div><div>(DefaultQuartzScheduler6) [6f1f1fd4]=
Ending
command</div><div>'org.ovirt.engine.core.bll.storage.disk.AddDiskCo=
mmand' with</div><div>failure.</div><div>2016-08-17
08:43:33,541 WARN</div>=
<div>[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]</div><div>(Def=
aultQuartzScheduler6) [6f1f1fd4] VmCommand::EndVmCommand: Vm is</div><div>n=
ull - not performing endAction on Vm</div><div>2016-08-17 08:43:33,553 ERRO=
R</div><div>[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDi=
rect</div><div>or</div><div>]</div><div>(DefaultQuartzScheduler6)
[6f1f1fd4=
] Correlation ID: 6f1f1fd4, Call</div><div>Stack: null, Custom Event ID: -1=
, Message: Add-Disk operation</div><div>failed</div><div>to
complete.</div>=
<div>2016-08-17 08:43:33,557
WARN</div><div>[org.ovirt.engine.core.dal.dbbr=
oker.auditloghandling.AuditLogDirect</div><div>or</div><div>]</div><div>(De=
faultQuartzScheduler6) [] Correlation ID: 19ac5bda, Call Stack:</div><div>n=
ull, Custom Event ID: -1, Message: Failed to create OVF store disk</div><di=
v>for Storage Domain hosted_storage.</div><div> OVF data won't
be upda=
ted meanwhile for that domain.</div><div>2016-08-17 08:43:33,585
INFO</div>=
<div>[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]</div>=
<div>(DefaultQuartzScheduler6) [5f5a8daf]
Command</div><div>'ProcessOvfUpda=
teForStorageDomain'
(id:</div><div>'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') =
waiting on child
command</div><div>id:</div><div>'eb2e6f1a-c756-4ccd-85a1-6=
0d97d6880de'</div><div>type:'CreateOvfVolumeForStorageDomain' to
complete</=
div><div>2016-08-17 08:43:33,595
ERROR</div><div>[org.ovirt.engine.core.bll=
.storage.ovfstore.CreateOvfVolumeForStora</div><div>ge</div><div>DomainComm=
and]</div><div>(DefaultQuartzScheduler6) [5d314e49] Ending
command</div><di=
v>'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora</div>=
<div>ge</div><div>DomainCommand'</div><div>with
failure.</div><div>2016-08-=
17 08:43:33,596 ERROR</div><div>[org.ovirt.engine.core.bll.storage.disk.Add=
DiskCommand]</div><div>(DefaultQuartzScheduler6) [5d314e49] Ending
command<=
/div><div>'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand'
with</div=
<div>failure.</div><div>2016-08-17 08:43:33,596
WARN</div><div>[org.ovirt.=
engine.core.bll.storage.disk.AddDiskCommand]</div><div>(DefaultQuartzSchedu=
ler6) [5d314e49] VmCommand::EndVmCommand: Vm is</div><div>null - not perfor=
ming endAction on Vm</div><div>2016-08-17 08:43:33,602
ERROR</div><div>[org=
.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect</div><div>o=
r</div><div>]</div><div>(DefaultQuartzScheduler6) [5d314e49]
Correlation ID=
: 5d314e49, Call</div><div>Stack: null, Custom Event ID: -1, Message: Add-D=
isk operation</div><div>failed</div><div>to
complete.</div><div>2016-08-17 =
08:43:33,605 WARN</div><div>[org.ovirt.engine.core.dal.dbbroker.auditloghan=
dling.AuditLogDirect</div><div>or</div><div>]</div><div>(DefaultQuartzSched=
uler6) [] Correlation ID: 5f5a8daf, Call Stack:</div><div>null, Custom Even=
t ID: -1, Message: Failed to create OVF store disk</div><div>for Storage Do=
main hosted_storage.</div><div> OVF data won't be updated
meanwhile fo=
r that domain.</div><div>2016-08-17 08:43:36,460
INFO</div><div>[org.ovirt.=
engine.core.bll.scheduling.HaReservationHandling]</div><div>(DefaultQuartzS=
cheduler7) [5d314e49] HA reservation status
for</div><div>cluster</div><div=
'Default' is 'OK'</div><div>2016-08-17
08:43:36,662 INFO</div><div>[org.ov=
irt.engine.core.bll.SerialChildCommandsExecutionCallback]</div><div>(Defaul=
tQuartzScheduler4) [5f5a8daf]
Command</div><div>'ProcessOvfUpdateForStorage=
Domain' id:</div><div>'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child
commands=
</div><div>'[84959a4b-6a10-4d22-b37e-6c154e17a0da,</div><div>eb2e6f1a-c756-=
4ccd-85a1-60d97d6880de]' executions were completed,</div><div>status
'FAILE=
D'</div><div>2016-08-17 08:43:37,691
ERROR</div><div>[org.ovirt.engine.core=
.bll.storage.ovfstore.ProcessOvfUpdateForStor</div><div>ag</div><div>eDomai=
nCommand]</div><div>(DefaultQuartzScheduler6) [5f5a8daf] Ending
command</di=
v><div>'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStor<=
/div><div>ag</div><div>eDomainCommand'</div><div>with
failure.</div><div><b=
r></div><div>Can you please check vdsm logs for that time frame on the SPM
=
host?</div><div><br></div></blockquote><div><br></div><div>I
sent in attach=
ment the vdsm logs from both hosts, but i think
the</div><div>SPM</div><div=
host on this time frame it was
ied-blade13</div><div><br></div><blockquote=
type=3D"cite"><div><br></div><div><br></div><div><br></div><div>It
seams t=
hat you also have an issue in the SPM election
procedure:</div><div><br></d=
iv><div>2016-08-17 18:04:31,053
ERROR</div><div>[org.ovirt.engine.core.vdsb=
roker.irsbroker.IrsProxyData]</div><div>(DefaultQuartzScheduler1) [] SPM In=
it: could not find reported vds</div><div>or</div><div>not up -
pool: 'Defa=
ult' vds_spm_id: '2'</div><div>2016-08-17 18:04:31,076
INFO</div><div>[org.=
ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]</div><div>(DefaultQuart=
zScheduler1) [] SPM selection - vds seems as
spm</div><div>'hosted_engine_2=
'</div><div>2016-08-17 18:04:31,076
WARN</div><div>[org.ovirt.engine.core.v=
dsbroker.irsbroker.IrsProxyData]</div><div>(DefaultQuartzScheduler1) [] spm=
vds is non responsive,
stopping</div><div>spm</div><div>selection.</div><d=
iv>2016-08-17 18:04:31,539
INFO</div><div>[org.ovirt.engine.core.vdsbroker.=
monitoring.VmsStatisticsFetcher]</div><div>(DefaultQuartzScheduler7) [] Fet=
ched 1 VMs from
VDS</div><div>'06372186-572c-41ad-916f-7cbb0aba5302'</div><=
div><br></div><div>probably due to:</div><div>2016-08-17
18:02:33,569 ERROR=
</div><div>[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]</div=
<div>(DefaultQuartzScheduler6) [] Failure to refresh Vds runtime
info:</di=
v><div>VDSGenericException: VDSNetworkException: Message
timeout which can<=
/div><div>be</div><div>caused by communication
issues</div><div>2016-08-17 =
18:02:33,569 ERROR</div><div>[org.ovirt.engine.core.vdsbroker.monitoring.Ho=
stMonitoring]</div><div>(DefaultQuartzScheduler6) []
Exception:</div><div>o=
rg.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:</div><div>VDS=
GenericException: VDSNetworkException: Message timeout which can</div><div>=
be</div><div>caused by communication
issues</div><div><br></div></blockquot=
e><div><br></div><div>This messages maybe cause by connection
issues from y=
esterday at 6pm.</div><div><br></div><blockquote
type=3D"cite"><div><br></d=
iv><div><br></div><div>can you please check if the engine VM
could correctl=
y resolve and</div><div>reach each
host?</div></blockquote><div><br></div><=
div>Now i can read engine VM from both
hosts</div><div><br></div><div>[<a h=
ref=3D"mailto:root@ied-blade11">root@ied-blade11</a> ~]# ping
ied-hosted-en=
gine</div><div>PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 5=
6(84)</div><div>bytes</div><div>of data.</div><div>64
bytes from ied-hosted=
-engine.install.eurotux.local (10.10.4.115):</div><div>icmp_seq=3D1 ttl=3D6=
4 time=3D0.179 ms</div><div>64 bytes from ied-hosted-engine.install.eurotux=
.local (10.10.4.115):</div><div>icmp_seq=3D2 ttl=3D64 time=3D0.141
ms</div>=
<div>^C</div><div>--- ied-hosted-engine.install.eurotux.local ping
statisti=
cs ---</div><div>2 packets transmitted, 2 received, 0% packet loss, time 99=
9ms</div><div>rtt min/avg/max/mdev =3D 0.141/0.160/0.179/0.019
ms</div><div=
[<a
href=3D"mailto:root@ied-blade13">root@ied-blade13</a> ~]# ping ied-hos=
ted-engine</div><div>PING ied-hosted-engine.install.eurotux.local
(10.10.4.=
115) 56(84)</div><div>bytes</div><div>of
data.</div><div>64 bytes from ied-=
hosted-engine.install.eurotux.local (10.10.4.115):</div><div>icmp_seq=3D1 t=
tl=3D64 time=3D0.172 ms</div><div>64 bytes from ied-hosted-engine.install.e=
urotux.local (10.10.4.115):</div><div>icmp_seq=3D2 ttl=3D64 time=3D0.169 ms=
</div><div>^C</div><div>---
ied-hosted-engine.install.eurotux.local ping st=
atistics ---</div><div>2 packets transmitted, 2 received, 0% packet loss, t=
ime 1000ms</div><div>rtt min/avg/max/mdev =3D 0.169/0.170/0.172/0.013
ms</d=
iv><div><br></div><div><br></div><div>I have
a message critical of low disk=
space on hosted_storage domain.</div><div>I have 50G of disk and i created=
i VM with 40G. Do i need more
space</div><div>of</div><div>OVF_STORAGE?</d=
iv><div>What is the minimum requirements of disk space for deploy engine VM=
?</div><div><br></div><div>Regards,</div><div>Carlos</div><div><br></div><b=
lockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div><div><=
br></div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><br><=
/div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div=
<blockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div><bl=
ockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div><blockq=
uote
type=3D"cite"><div><br></div><div><br></div><div><br></div><blockquote=
type=3D"cite"><div><br></div><div><br></div><div><br></div><blockquote
typ=
e=3D"cite"><div><br></div><div><br></div><div><br></div><blockquote
type=3D=
"cite"><div><br></div><div><br></div><div><br></div><blockquote
type=3D"cit=
e"><div><br></div><div><br></div><div><br></div><blockquote
type=3D"cite"><=
div><br></div><div><br></div><div><br></div><blockquote
type=3D"cite"><div>=
<br></div><div><br></div><div><br></div><div>Regards,</div><div>Carlos
Rodr=
igues</div><div><br></div><div><br></div><blockquote
type=3D"cite"><div><br=
</div><div><br></div><div><br></div><div><br></div><div><br></div><div><br=
</div><div><br></div><blockquote
type=3D"cite"><div><br></div><div><br></d=
iv><div><br></div><div><br></div><div><br></div><div><br></div><div><br></d=
iv><div><br></div><div>Regards,</div><div><br></div><div>--</div><div>Carlo=
s Rodrigues</div><div><br></div><div>Engenheiro de Software
S=C3=A9nior</di=
v><div><br></div><div>Eurotux Inform=C3=A1tica, S.A. |
www.eurotux.c</div><=
div>om</div><div>(t) +351 253 680 300 (m) +351 911 926
110</div><div><br></=
div><div>_________________________________________</div><div>__</div><div>_=
___</div><div>Users mailing list</div><div><a
href=3D"mailto:Users@ovirt.or=
g">Users@ovirt.org</a></div><div>http://lists.ovirt.org/mailman/listinfo/u<=
/div><div>se</div><div>rs</div><div><br></div></blockquote><div><br></div><=
/blockquote><div>--</div><div>Carlos
Rodrigues</div><div><br></div><div>Eng=
enheiro de Software
S=C3=A9nior</div><div><br></div><div>Eurotux Inform=C3=
=A1tica, S.A. | www.eurotux.com</div><div>(t) +351 253 680 300 (m) +351 911=
926
110</div><div><br></div><div>_________________________________________=
____</div><div>__</div><div>Users mailing
list</div><div><a href=3D"mailto:=
Users@ovirt.org">Users@ovirt.org</a></div><div>http://lists.ovirt.org/mailm=
an/listinfo/users</div></blockquote></blockquote><div>--</div><div>Carlos
R=
odrigues</div><div><br></div><div>Engenheiro de Software
S=C3=A9nior</div><=
div><br></div><div>Eurotux Inform=C3=A1tica, S.A. | <a
href=3D"www.eurotux.=
com">www.eurotux.com</a></div><div>(t) +351 253 680 300 (m) +351
911 926 11=
0</div><div><br></div></blockquote></blockquote><div>--</div><div>Carlos
Ro=
drigues</div><div><br></div><div>Engenheiro de Software
S=C3=A9nior</div><d=
iv><br></div><div>Eurotux Inform=C3=A1tica, S.A. | <a
href=3D"www.eurotux.c=
om">www.eurotux.com</a></div><div>(t) +351 253 680 300 (m) +351
911 926 110=
</div></blockquote></blockquote><div>--</div><div>Carlos
Rodrigues</div><di=
v><br></div><div>Engenheiro de Software
S=C3=A9nior</div><div><br></div><di=
v>Eurotux Inform=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com">www.eurotux.=
com</a></div><div>(t) +351 253 680 300 (m) +351 911 926
110</div><div><br><=
/div></blockquote></blockquote><div>--</div><div>Carlos
Rodrigues</div><div=
<br></div><div>Engenheiro de Software
S=C3=A9nior</div><div><br></div><div=
Eurotux Inform=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com">www.eurotux.c=
om</a></div><div>(t) +351 253 680 300 (m) +351 911 926
110</div><div><br></=
div><div><br></div></blockquote><div><br></div></blockquote><div>--</div><d=
iv>Carlos Rodrigues</div><div><br></div><div>Engenheiro
de Software S=C3=A9=
nior</div><div><br></div><div>Eurotux Inform=C3=A1tica, S.A.
| <a href=3D"w=
ww.eurotux.com">www.eurotux.com</a></div><div>(t) +351 253 680
300 (m) +351=
911 926
110</div></blockquote></blockquote><div>__________________________=
_____________________</div><div>Users mailing list</div><div><a
href=3D"mai=
lto:Users@ovirt.org">Users@ovirt.org</a></div><div><a
href=3D"http://lists.=
ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/...
sers</a></div></blockquote><div>--</div><div>Carlos
Rodrigues</div><div><br=
</div><div>Engenheiro de Software
S=C3=A9nior</div><div><br></div><div>Eur=
otux
Inform=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com">www.eurotux.com</=
a></div><div>(t) +351 253 680 300 (m) +351 911 926
110</div><div><br></div>=
</blockquote></blockquote><div><span><pre>--
<br></pre><div>Carlos Rodrigue=
s <br><br>Engenheiro de Software
S=C3=A9nior<br><br>Eurotux Inform=C3=
=A1tica, S.A. | <a
href=3D"http://www.eurotux.com/">www.eurotux.com</a=
<br>(t) +351 253 680 300 (m) +351 911 926
110<br><br></div></span></div></=
body></html>
--=-PNqkdmkgzkScJoTZyDpl--
--=-c3iGRn1xmIN62/k5uKWa
Content-ID: <1471538309.2273.30.camel(a)eurotux.com>
Content-Disposition: inline; filename="unknown-44PAMY"
Content-Type: image/png; name="unknown-44PAMY"
Content-Transfer-Encoding: base64
iVBORw0KGgoAAAANSUhEUgAABRYAAAGdCAYAAABn4y/WAAAABHNCSVQICAgIfAhkiAAAIABJREFU
eJzs3Xd8FNX6+PHPbjab3giBEEJLSOglEIIUqVYEC8WOflFAxHLx/kSs18u1Xb0qKl64gooCFlBE
mkgJJdKEUARCCwRMQijpJKRn5/fHustm2ZpNhef9euVF2J2dOfOcZ845czIzq8rOzlYQLpk6dSpq
tRoAnU7HnDlz6rlE1yepB9dI/Fwj8XONefy+//77ei5R43L//fdL/rlAjt/ri9S3ayR+NUdi6RqJ
n2sM8XNzc6vvoghRryorK6UNqQZDGzJhwgTU9V0YIYQQQgghhBBCCCFE46Ox9kZubi7vvffelQU1
GgIDA+nSpQtDhgzB09Oz2hstLCzkrbfeolOnTjzyyCNOv18X5s+fT0pKCm+88QYajdUwVUtNxDY9
PZ2MjAzi4uKc3r6iKOzatYs9e/aQmZmJu7s7zZo148Ybb6RLly5Or68my9YQ2ItPTednY4+XMwy5
HxERwaRJk4yv79+/n6VLlzJ06FBuueUWl7bR2OJp2h48+uijdOzYEYDMzEw+/PBDh2JSV/vcENpm
R5xKPceXS9ZxJPlPLhUW4e/rw419ujDl4ZF4e3kAcOxUGsmnzzLqphvqubSNhyN9lzM50ljyyZIv
vviCkydP8vTTT9OyZUvj6+vWrWPLli2MHj2aTp06ObR/NXX82ounaf0NHjyY2267zfjewoULOXr0
KFqtlpkzZ9ZaGRpznTvD/FgB8PX1pW3btowcOZKAgACXt9GYYvn++++TnZ1t8b2WLVvy9NNP10k5
nI1ZQx9PONIO9enTx+rnG1MO1afU1FTmzp1L9+7deeCBB4yvnzhxggULFtC3b1/uvvvueiyhEKIh
sTQGMPD19eWVV16p1e3XV99ld8YsODiYfv36UVxcTHJyMlu3buXo0aNMnToVDw+PuijjNcuV2G7a
tIlLly5VK2FWrVrFzp07CQoKom/fvri5uXHw4EEWL17M2LFj6d27d3V3yeWyNQT24tOhQ4ca3V5j
j1dD05jj+csvvxAdHW28rcdRjXmfa1pxSSnP/et/KDqFh+4eRnATf3buPcLKjbsoKSvn5afuB2DR
T/Fk5uTLxGI12Oq7PD09GT9+PH5+fvVdzFrVq1cvTp48yeHDh6uc0B85cgSNRkO3bt3QaDQOxaKu
j183NzcOHz5snFisqKjg5MmTTrc71XG95IdBkyZN6Nu3L4qikJGRwcGDB8nNzeWpp55CpVLVd/Hq
zNChQykpKQH0/Zy7uzs333wzoD/Jaqgaet/qSDskhBCifhjGy6bc3d1rfbv11XfZnVgMCAhgwIAB
AAwfPpylS5dy4MABdu7cyZAhQzh69Cjr168nKyuLgIAAhg4dapyYSkxMZOvWreTl5eHt7U3v3r25
6aabjOt2c3Nj3bp17Ny5E29vb0aOHEnnzp2rbH/lypXs3bsXT09P7r77bjp16gRAdnY2q1atIiUl
BZVKRevWrbnjjjsIDQ0FsFqu/Px8/v3vfxMbG0tubi4FBQU899xzJCUlsXLlSkpKSoiJiUFRav/R
k9WN7QcffEBWVhYAL730Eq+88gppaWlW68FUdnY2u3btwt/fn2eeeQYvLy9Af/XC4sWLKSgoAPQz
3WvXriU9PR0vLy+GDRtGXFycMX5xcXG4ubmxd+9efHx8jHVnqWx5eXk212VeF9bypi5OehyNj6mM
jAxmz55d5S+W5le8WtunWbNmNep41RZ7x7cz8Tx27FijiE94eDjp6en8/vvvV3VCYP2YND/mAOMV
oWVlZcycOROdTscLL7xAUFAQS5cu5dChQ7z++uvk5+dbjbOlfDO9yhTg2LFjLFy4kF69ejF27NgG
kYsXsvK4VFDEwD5duf/OIQAMHxBD727RhIc2BWD8c++RlpEJwJD7pvPTZ/+guKSU2V+t4MCRU4CK
rh3aMnX8SCJat+Bidh73Tn2LEUP7cD4zl5y8Ar764Hl27D3C59//ytnzWQQH+TN+9HBuH6K/OiRh
9yE++fJnCotKuOXGXuRdukzC7kOs+eoNfLw8OXYqjbmLV3Mi5Sy+Pp48MvqmRjPJaavvio2NZdGi
RVWugLE3FjBoiPlkTdeuXfn5559JSkri1ltvBSArK4uLFy/SrVs349WbprGwdEzpdLoqx++ECROu
ugLGvD+xNe5yRGhoKGfPnuXChQs0b96cEydOUF5eTlhYmLEsYH0cBXDu3DnWrFlDeno6np6exMTE
GCeKwPr4rqSkxGJMrI0pwHrbB9ZzqyHkCEBgYCCDBg0y/j83N5e0tDRycnIIDg6229fZe99cQ42H
aX7++uuvuLu7G9sQsD/mjI2NpbKykkOHDhEcHMwDDzzApk2bOHLkCKGhoTz88MMEBASQl5fHu+++
S9euXXFzc+PIkSN4eXlVOX8w58xY29r4DOon9o60Q87kkL3x7OXLl52qD2jcx6+zbO2PIzl+rY/t
hbjemI6Xzc2ZM4f09HRefvll4x/YPvjgAy5dusSrr77KhQsXamwupq7OhZ1am0qlYuDAgQAkJydT
UFDAt99+i1qtZsqUKQQEBLBs2TIyMzPJzs5m2bJltGrViieeeIIbb7yRHTt2cPz4ceP6Tp8+TXFx
MUOGDCE/P59ly5ah0+mM7ycnJ+Pj48M999xDeXk533//PaWlpZSXlzNv3jzS0tK45557uPvuu0lL
S2PhwoVUVFTYLJfh4bSHDh0iLCyM2267jcLCQuMXBTz00EMEBgby559/uhxcZzgT2wcffBCNRkNI
SAhPPvkkFRUVVpc1d/r0aRRFoWfPnsZJMwBvb28mT57MkCFDKCws5PPPPyc/P5/JkyfTs2dPli9f
ztmzZ43xO3DgAE2aNOH+++/n8uXLxrozL1tlZaXddZnWhSN5U5sciY+zbO1TY49XdWVlZbF69Wrj
z4EDB4zv2Tu+nYlnUVFRo4lP+/btadOmDRs3bqS4uLjKe7aOSfN97tq1K+np6SiKwunTp1Gr1fj6
+nLmzBkA0tLSaN26NYqi2IyzpXwzde7cOb777juioqIYPXp0g8nFsObBBAf5sz0xiZkfLeaXzXtI
z8jkjmFx9OgcAcA/pz2Mu8aN1i2bMefNp/HQuvO3mf/jSHIqf584hucmjuZociovvbeA8vIKNH/F
YuuuQ0S1bckTD91Bdu4lXp+1CI2bmtkzp9K8aSD/+d8PpJ69SG5+IW988i2VOoVXnn6AwABfdu47
AoC7RkNufgF/f+MzsnMv8fHrU7hpQAwfzF/G8ZT0Oo1VTTDvu8w5mhcNNZ+scXd3p2vXrmRmZnLx
4kUAkpKSAIiJibH4GUvHlPnx6+3tbXO7tsYGjmrdujUajYbDhw8by92sWTP8/f0d2k5ZWRlffvkl
mZmZ3HvvvXTt2pUtW7bw22+/GT9vb3xnHhNrYwpbbV9DzxFLDPVbWVlpt6+z9765xhgPsN2/mR4z
UVFRDBw4kAsXLjBv3jyio6MZPHgw6enpbN26FcD46KIjR47QsWNHJk+ejKIoxvMHc86MtW2Nz+or
9vbaIWdzyB5n6+NaO35tsbU/juZ4Yx/bCyGqKi8vJzc3t8qP4RyvZ8+eKIrC0aNHAbh48SJZWVl0
7dqV0tLSGpuLqctzYY21WzFMXzf9PTAwEICioiI8PDyYOnUqvr6++Pv707lzZ1JSUjh//jwtWrQA
9M8Jy8zMpGvXrtx4442AvqMB8PLy4p577gEgJSWF5ORkCgsLjQELCQkxXtWQlpbGjh07OHPmDGVl
ZVy6dIlhw4bRq1cvQP8XsR07dpCSkkLbtm2tlisiQn9iGRAQwB133AHoK6aiooK4uDg6dOhAhw4d
SExMJDs7G5VK5fTtKvaWdzW23bt3B8DDw4M2bdpQWlpqddlmzZpV2bbhVhQ/Pz+r5Tx+/DilpaUM
HTqU8PBwQkNDSUhIYO/evQwfPhyApk2bGuszMjKSo0ePUlhYSFhYWJWyJSYm2l2XaV0YTo4s5Y2z
qnObkSPxMbxuyA1r9Wn4v+HqV1v71BDiZW0/a5JhnZcuXWL79u0W3z927JjN47tJkyaAY/GszfjY
42j8DMspisLIkSOZM2cOmzZtom/fvsb3bR2Td911F3Bln8+fP8/hw4fJzMwkJSWFVq1aERAQQEpK
Cp06dSI7O5uePXvajbPhtirTfDO03ZcvX+brr7/G39+fhx9+GDc3N4fyvC5o3TV8/PqTLPhhPbsP
HGPzzj8AaBnalGmP30Of7tFEtgkDlQpPDy2do9qweecfZOXkM370cG4ZpL+y5vipNH76dTt7D58k
up0+FiHBATw5fiQARcWlzH3zGQL9fWjaJIB+vTqzP+kUJ/88R6WukvLyCkYOj+PGuK7cGNeVDb/t
49zFHAB27jtGUXEpD989nOiIcNqEN2fJqq38umUPHSLCayQOtXn8mv9u2neZt4+28qIh55Mj8evV
qxf79u0jKSmJ5s2bk5SUhK+vLx07dqzSN5j3FabHlIHh+M3IyLBaBpVKZXNsYBjfWBu3GF7TarVE
RUWRlJTEsGHDOH78OHFxcZw7d86h7Vy4cIHCwkJuvvlmunTpQocOHYiIiMDX19e4DXvjO/OYWBtT
JCcnW237+vfvD9TfeMGR9ZWXl5OXl4eiKKSlpXHq1CmCgoIICQnh8OHDNtvg0tJSh9poR4612lad
+Bk+48iYMyQkhF69elFQUMCWLVsIDAwkNjaW4uJi4uPjyczMrJJPYWFhxgn+Hj16sG3bNs6cOUN4
eLhx2/by3HysbWt8Vp+5aKsdspdj5jlkbzxreM3R+rBVtzUZM/Ny1jRrcTH93dbx15DG9kII22qi
DTGsIy0t7apnLQ4bNoxbbrmFHj16sGbNGo4ePUpcXBxHjugvQOjVq1eNzsXUZXvi9LeS5ObmAlee
ibJ161bjwM/QqFZWVhISEsLIkSPZsmULS5cuBfS3+j300EPGe8tNJ70M6ysvLzcOPA0nK4DxeTyF
hYXGyR/T9w2X3Ofn59ssl0FwcLDxd8PJjelzXgICAqw+aLq2OBpbSxxd1vDXckOcTOl0OtRqNUVF
RQBs3LiRTZs2AfoO0zQeprE3fNlMeXn5Vet0ZF2mdWErb4KCgizue01yJD7OcmafGlu8qisiIoLJ
kycb/79//36WLFkC6Ccdwfrx3aFDB4f3ubHFp1WrVnTv3p2dO3cSGRlpfN2RvDAwfC4tLY2UlBQ6
duyIn58fv/32G6mpqSiKQlRUFGlpaYD1OBtOOEzzzSA1NdV4ZUhBQQHBwcENKtbhLZry2rMPoigK
f569yI7EI3z143pmfrSY5Z/9A3f3ql1fZrb+eG8WfCUWIX/9npmdZ5xYbNGsSZXPfbdyC3sOHqeo
qBSFK+1u3iV9n9I06MoXNLRo1sQ4sXip4DIAC35cz8KfNgKgUxTOXqjbPqemmPddphwZCzT0fLIm
MjKSgIAAjhw5QmxsLOnp6fTr189uP2HpmHKGM2MDa7p06cKPP/7IwYMHuXz5Ml26dDFOLNrbzuXL
+vw1jMs0Go3xi98M4yl74ztz1sYUttq+xpAjaWlpvPvuu8b/+/r6cu+996JWq+32dWVlZTbfN32m
HjS+/s7Akf7NcDWt4fnjhpwy/N/8aljTZ3j6+PgAV3LTnKPHU0PNRVvtkL0cM88hRzlaHw01Zs4y
tOnmeWY4RtVqtc39uV7G9kKIqpo3b37VF3CGhIQA+nYzIiKC5ORkKioqSEpKwt/fn8jISOMdIDUx
F1OX7YnG2rMETV83/K4oCgkJCQB07NiR3377jT/++IMRI0YwcOBAtm7dyrp161AUBUVR6N+/P/37
9ycnJ4cjR47wyy+/sHnzZuNzeAzLWdt2fn5+ld9BXwlarRbQn8wY3jec2AQEBNgtl/l2DJNJly5d
Mi5jWJ+1Mtpib/maiK1p2RzdX9APQNRqNQcOHGDIkCHGAVdRURGffvoprVu3Nj7X6MYbb6zyXBx3
d/ertm1t3wzvGwYwttZlHhNreWO4+sFR1XlOpiPxGTlyZJV9NAw4TAeleXl5VZaxt08NIV7mauM5
o9b2wTRvDANWa8e3M/GE2ouPM/vq6HKKonDrrbeSlJTE5s2bja85kheGfQ4ODsbf358TJ06QkZHB
7bffjp+fH8uXL+fw4cNotVpatmxpbFNtxdm8jIZ/27Rpw5133sl///tfVqxYwYQJE4D6i7WpfYdP
Er/9ALcM6kWPThG0DW9O2/Dm7Es6SeLBE+QXFtE0yL/KZ5o11XfOF7PzjK9dzNLHonnTK52u6YTR
D2sSiN++nyfHj2TcHYP4fsUW5n33CwB+vvo+JSv3knH5C1lX1t3sr3XeP2oItw2+Up8e2pp7oHNd
Hb/mfZelPsLeWKAh5pOj8YuJiWHr1q0kJiaiKAq9evW66ngxxMJa+2e6jL3+xJmxga196tSpE2q1
mg0bNhAUFFRlgsHedgyTCKZjpl27duHn50fbtm0dKoN5TKwtb6/tq8/xgiPrMz2p8PDwoFWrVmi1
Wof6OsOtu/ba6MbU31n6jDP9m/kxZO3/hqtEoer5Q3XGz46Oz+ozF621Q46Mp0z30ZHxrOnv9uqj
rmJmqjb6PsNEdXp6OuXl5cY/hKWkpAD6L2mytT+GP/g2hLG9EMK2mmhDDOvw8fG56vtDTN/v2bMn
J0+eZM+ePaSnpxufyexMv2ht3fUxNrB7xWJeXh4JCQmUl5dz8uRJzpw5Q1hYGH379mX9+vWAftLl
9OnTHDx4ENDfI75//36WL1/O8OHDiY6OJigoCJVKVeW5dfZcvHiRhIQEgoKC+OOPP/D09KRdu3aA
PuC///47LVq0oKKigv3799O0aVMiIiI4efKk1XK1bt36qu20b98eNzc3du/eTXh4OKmpqRa/pKOm
VTe2ZWVluLu7k5OTw9GjR41/kbS2rGEiFvRxGzRoEFu2bGH27Nl06dIFjUbDwYMHycvLY8iQIURF
ReHt7U1SUhKRkZFcvHiR3bt3M2jQIKKiouzul2nZWrdu7dS6jh49ynfffedS3rjCkfiYCwoKwt3d
nRMnTnDy5EnS09Or/GXc3j415njVhg4dOtg8vp2JZ0lJicvtUF0LCgpiwIABxmcUATaPyZiYmCr7
HBERQUREBAcPHkStVhufp+bj48P+/fuJiIjAzc3NbpwNV4Zb4u3tbWyrdu7cyeHDh3Fzc2sQuejl
qeXXrXvYnniYkcNvoEmgH3+evcC+wycJax5snFT00LqTcSGb7YlJdO/YjpDgAFas30lkmzDKyspZ
l7CXVi1CiOnanoLCoqu2U1SsP+m/VFDEH0dSiN++H4DT6ee5fXAf3NzUrI7fRVTbME7+mWGcqATo
0yMafz9vftt9iJgukaRmXGTlhl3cP2qw8VbshsxW32WeN460UQ05n+yJiYlhy5YtJCQkEBISUq0r
gEyP3/DwcJv9iWGyydHxjTXe3t60a9eOU6dOWXywuK3t9OvXD29vb37//XfCwsI4e/Ys8fHx3Hzz
zcaJxZpiq+3z9PRs8Dli7aQC7Pd1Op3OqTa6sY4HXB1zWnLx4kW2bt1KcHBwlfMHwxVmBrby3Hys
bWt8Vt+5aK0dcraftzeedVZjP34N/P396dGjB3/88Qfz5s0jKiqKrKwsDh06RFBQEL1797Z5/Dmb
4431WBZCVGUYL5uLjY3F29vb+AVc69atA/QTjeB6v1hf58J27+vMyclh7dq1xMfHk5ubS//+/Zk0
aRIajYb+/fvTqlUrtm3bxtq1axk3bhxhYWFs27YNHx8f+vfvz86dO41XIfTp04dhw4bZLZThgcKd
O3fm/PnzLF26FK1WywMPPIBWq0Wr1TJx4kTCw8NZunQpP//8M5GRkTz22GN2y5WamnrV9vz8/Bgz
ZgyKorBkyRJKS0uNlebs7UXOqG5s09LS6N+/P+Xl5fz444/06NHD5rLmbr31VsaMGYOvry+7d+9m
9+7d+Pv789BDDxEXF4eXlxcTJkzA29ubhQsXsnnzZiIiIujWrZtD+2VatsrKSqfW1aFDh2rnTU2x
Fx9zWq2We+65B41Gw+LFiykqKqJjx46A/rYJe/vU2ONV0+wd387Es1WrVo0yPkOHDjVeLQvYPSZN
97mwsNB4UmqYVARo164dFRUVxr+c24uzI26++Wa8vb1ZtWoVbdu2bRCx7tS+Ne+++DgRrcNYtXEX
n369koTfDzO0Xw8+ePXK7fdjbh9IeXkF785dSklpGR++9gQd27finf9+z6wvltOraxTvvzIJd43l
WzdH3z6QTu1bs3RNAvO+XcPLT99P+7Zh/LjmNzJz8pgx5V50OoV/z11CQWER3Trq/yimAvx8vHjv
pYn4+Xrzyn++YtFP8cR0iWRo/551ESKX2eq7zDnTRjXEfLKnWbNmtGzZkpKSEuMzzJxlevyWlZXZ
7E+cHd/Y0rVrVwDjbczmZbK2nczMTB577DGaNm3KkiVL2LNnD4MHD67Wl5vZY6vta+z9n7022Nk2
urHGw9UxpyXR0dFcuHCBJUuWVDl/MOfMWNvW+Ky+Y2+tHXI2h+yNZ511LR2/o0ePZsiQIVy+fJmE
hAT+/PNPevbsycSJE/Hy8rK5P87meGOLjRDCMsN42fzH8EgZDw8POnToQElJCaGhocbvKKnJuZi6
PBdWZWVl1fw149eZp556qsrzN/773//Wc4muT1IPrpH4uUbi5xrz+H3//ff1XCLXlJaVc7mohCaB
+luoHn9hFuczc1iz4I1a2d79998v+ecCOX6vL1Lfrmmo8SssLOTtt9+mU6dOjB8/vr6L45CGGsvG
QuLnGkP8rD3/VojrRWVlpbQh1WBoQyZMmGD9GYui+iSmDYPUg2skfq6R+F2/iktKGTPlDdw1Gmb+
fTxnz2eTknqOof161FkZJP9cI/G7vkh9u6ahxM/Wc0wbi8Za7oZC4ieEcIW0IdWnqc6l7cI2iWnD
IPXgGomfayR+1y8vTw/efP5RPvvmF2a88wU+3p7cOrg3Ux8eVWdlkPxzjcTv+iL17ZqGEj9DORRF
aTBlclZjLXdDIfETQrhC2pDq09TmMwSvVxLThkHqwTUSP9dI/K5vvbpG8dk7f6u37Uv+uUbid32R
+nZNQ4mfl5cX//znP4GGUyZnNdZyNxQSPyGEK6QNqT65YrEWSEwbBqkH10j8XCPxE/VJ8s81Er/r
i9S3ayR+NUdi6RqJnxDCFdKGVJ+mvLy8vstwzZGYNgxSD66R+LlG4ifqk+SfayR+1xepb9dI/GqO
xNI1Ej8hhCukDak+mVisBRLThkHqwTUSP9dI/ER9kvxzjcTv+iL17RqJX82RWLpG4ieEcIW0IdWn
qaioqO8yXHMkpg2D1INrJH6ukfiJ+iT55xqJ3/VF6ts1Er+aI7F0jcRPCOEKaUOqT56xWANUKlWV
3yWm9UPqwTUSP9dI/FxjHj/hHMk/10j8ri9S366R+NUciaVrJH6ukfGWEFdIG+K8Km3wK6+8otRj
WYQQQgghhBBCCCGEEI3M4MGDUSmKIhOLQgghhBBCCCGEEEIIh23YsAF1fRdCCCGEEEIIIYQQQgjR
+MjEohBCCCGEEEIIIYQQwmkysSiEEEIIIYQQQgghhHCaTCwKIYQQQgghhBBCCCGcJhOLQgghhBBC
CCGEEEIIp2nquwBCCCGEEEIIIYQQQlzPMs5fJDcvr9qfDwoMJCy0Wa2v05xMLAohhBBCCCGEEEII
UU8ME4CR7aKrvY5Tp08AGCcCa2Odlsit0EIIIYQQQgghhBBC1BNXJwABIttFV7k6sTbWaYlMLAoh
hBBCCCGEEEIIIZzm1MRidnY2sbGxrFixosrro0aNoqioqEYKlJ2dTVxcHGPGjGHMmDHcf//9zJo1
q8bWb8m+fft4+eWXa3SdcXFxtVpmc7/++utVr10LsTTk3HfffVfl9b179xIbG8vu3btrbFuuuBZi
XVRUxPz581myZInx56effiIjI6PGtiGEEEIIIYQQQthyNr+cD7cV8sLaS3y7t4DLpZX1XaQG4Wz6
KeNPQ1qX01cstmzZki+++IJLly65vHFr/Pz8WLZsGcuWLeOLL76gsLCQ559/vta216tXL95+++1a
W39tKykpYfHixRbfuxZiGRYWxurVq6u8tmbNGsLCwmp0O666FmKt1Wq57777jD8DBgxg48aNKIpS
o9sRQgghhBBCCCHMHb1Yypill/nxCCSke/HNCT+mrSogp6Cc4rJKLpdUVFn+9VVZ9VTSumU6Adgy
PNLl9Zmuw9XJRae/vMXPz49bbrmFuXPnMmPGjKveX7hwIdu2baOyspKIiAimT5/O2LFj+eabb/Dz
82PGjBn4+Pjwj3/8g+zsbKZOncqSJUusbs/Hx4eXXnqJMWPGkJSURJcuXfjss8/YvXs3Go2GNm3a
MH36dP744w8WLFhA27Zt+fPPPwkJCaFdu3acOnWK1NRUZs2ahZ+fH2+//TapqalUVFTQuXNnpk+f
zu7du/n22295+OGH+eqrr2jdujX5+flkZWUxa9YsvL29nQ2TUWJiot1yHTt2jC+//JLw8HCKi4sp
KSnhzTffxMfHx+q+Lly4kLKyMkaMGEFiYiKpqam8/vrrzJw585qLpa+vL97e3hw/fpwOHTpQUlLC
gQMH6NSpEwCVlZUWy5KYmGixDB4eHhaX1+l0vPnmm6SkpBAUFISXlxc33HADd955p8W81mq111ys
zTVv3hydTkdxcTHe3t788ccfpKamotPpCAoKYsCAAVy4cIH9+/cTGBhIfn4+3t7eBAUFkZOTQ35+
Prfddhuenp4kJiZy9uxZ1Go1gYGB9O/fn5UrV9K/f3+aN28O6CeMu3fvTqtWrSxuy83NzeV9EkII
IYQQQgjRMCWmFbPyfl+a+WnYerKAuYnlVGoD+XhrFh5UolZ0vDiqhXF5teravwimpicVTddlWPfZ
9FPVXrfTVyzqdDoefPBB9u7dy/Hjx6u8t2/fPhITE5k3bx5ffPEFarXv7ZRBAAAgAElEQVSaNWvW
0KdPHw4cOICiKOTm5pKeng7oJ91uuOEGu9vUaDR0796dkydPkpiYyI4dO5g/fz6fffYZhYWF/PLL
L2g0GlJSUnjuuef45JNPiI+PJzo6mpkzZxIVFcW2bdvIy8ujffv2zJ8/nwULFrB//35OnDhRZTsn
Tpzg2Wef5a233qJp06bs2LHD2RBdVXZ75VKr1Zw8eZLp06fzzjvvEBoayooVK2zu6+HDh3nvvfe4
8847eeyxxwgPD7c5qdjYY3n77bezcuVKADZv3lxlkslaWayVwdry27ZtIyMjgwULFjBz5kwSExNR
qVRW8/pajbWp06dP4+npiZeXF+fOnSMjI4NRo0Zx1113oVKpOHHiBGq1mtzcXPr168ftt9/O6dOn
CQ4OZujQoQQHB5OamkpGRgZpaWnceeedjBo1irKyMpKTk2nfvj0pKSkAFBcXk5ubS8uWLa1uSwgh
hBBCCCHEtWt870Ca+emvgRvc3o/Hu5XT3LMc74Ag3INCaBnkbvaJqtNaUTeNt/rjipSUFF577TWe
eOIJCgsLbS5bXFzMCy+8wBNPPEFpaalL262tSUVL66zulYtOX7EI+omM559/nnfffZcvvvjC+Pre
vXs5ffo0kydPBvTBDAwMpG/fvuzfv5/Q0FDatm1LQUEBFy5cIDExkeHDhzu0zcLCQtzc3Dh8+DCx
sbGo1frk6dWrF0lJSbRp04Z27dqh0eh3KSAggOho/bffBAYGUlBQQFBQEPn5+Tz11FN4enqSlZVF
ntm327Rr1w5PT08AmjRpUiO3fNsrV7NmzejYsSNeXl4AdOzYkYMHD1JWVmZ1XyMiIvD3969WeRpj
LG+66Sbmz5/PtGnTWL16NU899ZTx9m9rZdFqtRbLYG355ORkYmJiUKlU+Pv7ExsbC1jP62sx1mVl
ZSxbtgzQP3MxICCAW2+9FZVKRUZGBrm5uaxatQqA8vJyPD09CQoKIigoyLhvHh4eBAcHA+Dp6Ulp
aSlFRUWEhYWhUqkAaNGiBZmZmfTu3ZsVK1bQr18/UlJSiIyMRK1WW92WEEIIIYQQQohr09GsEoI8
NYT66s+PFQUulytoK4tp7uePmxqaVdi+QvF/b/ydKa99aPH16kpLS2P27NmEh4dz8eJFu8v/9NNP
lJeXV3t7BrU9qWi6bleuXKzWxCLov5zkxx9/ZM2aNcbJAq1Wy/Dhw5k2bVqVZfPz8/n+++8JCQmh
V69eXLp0ib1793Lo0CGmT59ud1ulpaUkJSXxzDPPkJCQcNX7hu2b3yZpmOgAUBSFNWvWcOLECWbP
no1arTZOFJkyX0dNPFvOXrlAfyWogU6nM+6TOdNYV0djjaW/vz/dunXj559/JjMzk86dOxvfs1UW
S2Wwtrx53A2ftZbX9jTGWGu1WsaMGQPAqVOnOHLkiHES1c3NjYiIiKuuMj5//vxV+Wotf815e3vj
7+/PxYsXSUlJMa7b2raEEEIIIYQQQlx7Dp8v4XiOhvOFCinZl7lUWMoHd/iz5XgxPp5aigsvAypi
WladC1GUql/sMrxfDE+Pv5tPF/1sfO3p8XczvF9Mtcvm7e3Nq6++yoEDB+zeSWe4Y3H48OHGC2Wq
o64mFU23Ud3JRadvhTb197//nXnz5lFRoX94Zs+ePdm+fTtlZWUALFq0iKNHjxIQEADAjh076N27
NzExMWzYsIGmTZvanSArLS3lnXfeoUePHkRERNC9e3f27t1rnIjbs2cP3bp1c6i8mZmZtG3b1njr
cXJyco3MIteE48ePGy+n3bdvH9HR0Q7vq1qtNtaBLY09liNGjGDu3LnccsstLpXF2vJt27bl8OHD
ABQUFJCYmAhYz2tbGnusASIjI3F3dycpKQmA0NBQUlNTqazUN9x//PEHmZmZDq2refPmnDt3zjjh
efbsWeNzFdu3b8/x48cpKSkhJCTE5W0JIYQQQgghhGhczhfq0Go0eGvd8dKoGNFRg5+Xho/ua8Fb
dwVzZ7SKYa0r6NouoMrn1Oqrr5f726NjGHpDTwCG3tCTvz06xqWyBQcHG+/Ks6WiooLFixczduxY
h+9ytKYmv1zFEa5MZLo0sRgaGspdd91lvBS0R48e3HHHHUyaNInJkyeTnJxMZKS+QL169eLs2bOE
hITQvn17Dh06ZPVqpIKCAu69917GjRvH6NGj8fb25o033jCup3///kyZMoUpU6bQpEkTRowY4VB5
b7vtNn7//XemTp3KihUrmDBhAh9//PFVt5XWh/bt2/Of//yHqVOncvnyZUaNGuXwvoaGhqIoCpMm
TbrqvWsplgMGDEClUnH77bc7VJb8/Hynyt6zZ0+0Wi2PPfYY77zzDjExMbi5udnMa1PXUqwNBg4c
yP79+8nPzyc0NJTo6GhWrlzJqlWryMnJoUmTJg6tp0WLFrRq1YrVq1ezevVqvLy8iIqKAvS3cZ88
eZL27dsbl3dlW0IIIYQQQgghGpfswgrS8nTkFOmoQIuvO5jeCNeymTcdWl/9OLhKk7s/Tc178/9V
+bc2lJaWUlhYSGFhITqdjrVr1xIQEMCAAQNqZP11Nbno6tWRKqUm7vUVLjF8u+9HH31U30W5ruXl
5bFr1y5uu+02FEXh8ccf5/nnn69y27UQQgghhBBCCCFq1vvx2ZQrasp1atJKAyi4XMSTPcsZ3DGA
C7klrN59gcdvbXPV515flcXMUU3rpIzx8fEsXbqUDz74AF9fX5YuXUp8fDwAM2bMYNGiRZw/fx61
Wo1Op0On06HRaHj//feN36lhTdKxE0S2i7b4njMTf6dOn6BLx2i763Rm3abrNLdhw4bqP2NRiGuN
r68v27dv55tvvkGj0dCnTx+ZVBRCCCGEEEIIIWrZkwMDUKvVFJdWMuPXPHIrA3nxtzIq12ejKi3m
qwct34rs6PP9XVFaWkp+fr7x8XVZWVmUl5czZMgQevbU33IdFhbGU089ZXxM3b59+1ixYgUzZsxw
+YtIXf1yFWtq6jmOMrHYAMTFxREXF1ffxbjuaTQa463LQgghhBBCCCGEqBs+HvrpKS93NR+N8uOH
vbnsSaukVSsVj/QJJizY8hV//xxp/9mHrjp69Chz5841/v+dd94hPDyc1157jWbNmhlfN51A9PfX
37bdvHnzGpn8rOnJxZr8chi5FVoIIYQQQgghhBBCiHriyG3LjnD2Vmhn12luw4YNrn15ixBCCCGE
EEIIIYQQ4vokE4tCCCGEEEIIIYQQQtSToMBATp0+4dI6Tp0+QVBgYK2u0xJ5xqIQQgghhBBCCCGE
EPUkLFT/rEZXJgKDAgON66mtdVoiz1gUQgghhBBCCCGEEEI4RZ6xKIQQQgghhBBCCCGEqBaZWBRC
CCGEEEIIIYQQQjhNJhaFEEIIIYQQQgghhBBOk4lFIYQQQgghhBBCCCGE02RiUQghhBBCCCGEEEII
4TSZWBRCCCGEEEIIIYQQQjhNJhaFEEIIIYQQQgghhBBO06TnFNd3GYQQQgghhBBCCCGEEI2Mxs/d
q042dO5sKi1atq6TbTWE7Yprm+SV4yRWojZIXonaIHklnCH5IoTr5DgSIHkg9CQPGi+5FVoIIYQQ
QgghhBBCCOE0mVgUQgghhBBCCCGEEEI4TSYWhRBCCCGEEEIIIYQQTpOJRSGEEEIIIYQQQgghhNNk
YlEIIYQQQgghhBBCCOE0mVgUQgghhBBCCCGEEEI4TSYWhRBCCCGEEEIIIYQQTpOJRSGEEEIIIYQQ
QgghhNOu24nF7du20q5NE9q1aUJ0++YMG9KH1//xApcu5df6thP37KJdmyZs3Rrv8GcM5R15xxAU
RQHg4MH9tGvThIMH99dWUUU1pKae4ckpj9KjWzs6dWjJXaOGEx+/rr6L5bC1v6zk2NGkWt9OYzsG
B/bvYSyv6c8rL/+9FksqquO7b79m+NA4Oka3oHdMFNOenczly4VA3eW3oySvGgfT9sr0Z/26NXVe
loaWw8KyhjAWcKWfrU6e1cY+10S+10SfIMdd3atu/+hIXdkaB9rKF1H36rL/lbpvuOrrvNGZc0bT
tqc655qN3XU7sWgwefIMZs36nptvHsuS7xcz/uFx6HRKrW6zW/cYNm85QFTkAMrKnPvskaRDLPlu
WZXX8nOhoqIGCyiqrby8nEfHj+X3Xdt5+ulXePPNeQQENGPK5PHs3ds4JoD/9a+XOXwoico6yqnG
cgzO/u8XzJu3knvvnQjAzJlz+OyzlYwd8xQy5mg4kk8c4+WXnmPw4Fv55pvNPPfcW6xevZwP3/8A
Ran7/LZH8qpxmTx5Bp99ttL4ExlxA2WldVuGhpbD4moNbSxQnX7W2TyrrX12Nd9rqk+Q467uVbd/
dKauCvKpMg60ly+i/tR2/yt13zjU9XmjM+eMpm2PK/M9jdV1P7EYGdmJocOG8vwLM3j2b69w8I9E
NqzbCsCyH79j2JA+dO4Yzl2jhrN3724Adu3cRrs2Tfho1rvE9ormhr5diN/4K3ffeRNdO7fm09kf
AFBWVsaLM/5GTI9IenRrx+v/eAFFUTh0cD9Dh/TkRPJ29u3Vr2vOf2fR74au9OrZnh9/+NZqeQcM
uJlPP32bwsLyKq9b25ajZQX44vM59I3rTEyPSJ7/f09RWlJS0+G+5m3csJYzZ1J48cX3GTt2IneM
vIPP5i1m+vS38NQ2paLC9bxytU4Nn7eUc0MG9eb8uQymT5/CnDkf1UnMGssxGBMTy9DhA2nfvh0A
Xbr0ZvCQgXz88cvcOaqvcbmnpk5g8I29jH9Zm/n6iwwdHEuf3h34Yek3xuXkeKsd585nABAUFEbH
Th154MF7Sdh2hCef/IfF/LaXY/9+55906dSK9PRUi7mk0+l47dXn6dalDbffdiMvTH+GTh1aGstj
r54lrxqXyMhODLxxIEOH6X9atwlG4+54Hq1Y8aNLbVd9tNHCefbGAtu3Vc2LixfOW82hsrIyXpj+
DD27R9C5YzhTn/w/CgouWX3dEmv9rKN5Zm05Z/a5oqJmxiS21mEaTwNn+gRH47F+3RratWnCkaRD
APxr5st07hhus76E86z1j127RfLLL5aPl+rkrilb+bJ5U4LV/tfWdr5ZvIDBN/aia+fWPDnlUWM+
SH/tHEv9b+Leq499a3G1F2+p+8bB1nmjpbjaapMt1Y95f7Jxw1rjOWPiHut5YN72mJ5rah0YJzo6
F9SQXfcTiwAaDbi7w/DhQwE4diyJffv2M/35p7nzzvtYsSIRH58gJk8cT0FBMRqNBoDTKen88OMW
8nJzmf78s3wy+2uGDBnB7E/e51J+OSmnknFTu/HZvJ94772vWfj152yKTzBut7AAFEW/rgP7D7Fq
1S6io7vxztszKbXSvjzyyLNkZZ1n0dcLqvz1JCXF8rYcLeuO7Qm8+carfPD+5yz/eS/bt/3G/Pmf
g/yFxiknT54AoGfP/vj4gqcXeHm7MXnKJCKjWpF02PW8crVONW7Wc27B10sB+Mc/ZnPfvc9QXFQ3
cWssx6BGA3+FT/9/dxj/yARSUpLZv/cEFRUV/JawmVGjHqCs1AOArKwCVq3aTd++Q/nHay+QnVUg
x1st6tt3AF269ODDD19h+LAuTJv2OPv2biMoGL5aWDW/9+y2n2MH/0ji+yUb+fN0DmoLubRly0YW
L/qSSZP/zjtvf8VvCVtRqVRkZ+JwPUteNR46nQ6oQKXW/7hr4bAD7bohjzy1zYHqt1311UYL59gb
C7hrq+bFkaRUqzmUsDWeH5Z+w6LF61i5cj8oHuzZfZCtWyy/bm3OxFI/e+K4Y3l2JMl2X+rIPu/a
5fqYZPMm2+swxBMlGEWnL5czfYK1/TQvh+EqqbxcqlwVl52J1fqSK56qx1L/ePTYfma8YPl4qU7u
mrKVL/7+WsBy/2utzd6/P5FXX/l/PPTwZL79dgu7f9/F+//5D9ulv3aapf5X61712N+z+4jFuDoy
PpK6bzws9WcJCZbjmmClr9y/z3L9uJn1Jxq3YEB/zqhSWc8D87bHcB5ZWAB7HTindXQuqCHT2F/k
+lFZWQmAm5sbWzZvRFEU7rprIs1DA3nggQd59tmJ7Es8jI+vfvnBg0cQEhJGmzbtaBrSEj/flvSJ
i2XNmqVcvJBHSLNQsnOymf7847j/1fClp2Xg493uqm3fdttYPDx8GTBwAL//vpX8vDKahWqvWi4k
JJRH/+8J5s9/n85dvzS+3szOtuyVdds2/Uz/k08+iEqlv6Xl0MH9lJToB4fCMWq1fq5ep6tE4171
PU9P2LrV9bwyDE6rW6cxMbGA5Zxzd9cXWqNxJyDQDQ/P2o+ZqcZwDJobOuwWwsLC2bhxNcUlcRQW
FjBixAPk5KYDMGzYKFCpueW2m1mzZilJh5PZ9bscb7XFw8ODn1duZP2vm9m5cys7dmxk9arlPPp/
iUyc9ARwJb93LrGfY3fd9TBt23SguDSbnMVX51J2dioAd4x4mLCWwQwffgs//fQ9ANu3V7+eJa8a
ppdeeoyXXrry/9W/bHWorTLk0eWiXKD6bVdkhL7tqq82WjjG3lhArdL/bsiL+Pj/WM2hiMgotFoP
pjwxjv4DbuTu0XcT12cgGedOWny9ohzcbXRdpv1scLBjeabRWl6uvOzKtuzt884dro9JEhNtr8MQ
Ty8f4K8YO9MnWNtP83hoPazH11p92asX4ThbbW5klP6PN/bq1NI4EGzny8iRowDL/W+Xbm0sbufw
obMA3HrLgzQP9Wd34nEu5cHcuW8A0l87w1L/a2A49n/5RT+5Yx7XgoJci6+bxlvqvvEx7c+2Wznv
vWn4bRbb5C++eB+4un4OJ+0Crh63mbKUB+0imwKWx2cJDpz/V/c8tKHIycmRiUVTv/22GYCuXXuz
b/8W4+te3qDjrz99oqaiQp/EWq0WDw9w07ih1WrRaECjcQNAp1OY899ZbNm8gQ0bD5N5MZMxY/rp
b52z8BcJrdYDDw+Ms9aVlQqKAirV1ctOeXIa33/3NYu+/tz42mdzbW/LXlm1f42SVq8+iJ+fPwCK
Is9udFaHDp0ASEzcRnSHcYC+YXvrjVcZPfb+KstWN68M6VPdOk06suuvz1vOOSMLuVfbGssxaEqt
VnPf/eNZ9+tqikvy6NdvEM2bh1NYpJ8AUhQdHh5Q8dfBpFKpcHeX4622ZGSkk5x8nBEjb+KmW26i
rPRfPDL+DuI3/sqDDz5xZUGzerWWYz4+vnh4wsefWM4lwzGjUqn0gwjVleRypV2VvGqYnn32n8TG
3mj8f1BAFIruV+P/7eXRX81TzbRd9dBGC8c4OhYw5IXa5P4h8xxq1ao9G+J3s/Ln1ezencCTT4zn
xRffYNITT1p93RbTfnbeZ47lmdV81F1ZzN4+18SYxN46jMeZydmNM32Co8ed6q+BgfLXZZElJcXG
tyMirNeXqHlXtbmmT4pytE5N2MqX4cP1k0uW+t85n1rejqEPUBQFD08oKSnCw0vBx1f6a2dZ6n8L
Cw4AV459T0/Lcf1ywXsWXzeNt9R942Pan+3dp//dPK4enlhskxUs14/XX5O75uM2U5by4K85Tj0b
4zPr57TVOw9tKJo0aSK3Qp85c4I9e3Ywf96nzJr1b4YOvY1u3fowZOhNqFQqfvjhcy5eOM8PS78h
NDSMqKguVZKlSr9kVvGXLuWjVqspKalkzZqFuLm5cflygfXCOJg4/v4BPDl1Gps3r3ZqW7bK2veG
AQCsWLGYgstnmPrUKLbvXIavn2NlEnrDht9Kp07dePfd6Xz++VzWr1vDlMnj+eabBeTnlnLjINfz
ylR16tTb2/pnDI3ZmTMnqgyUa1NjPAbN3X//eJKTk1i18gfuuvsh3LVXrkhZvfp7Ll68wKoVy/Dx
8aVduw707SvHW23ZuOFX/u+Rcbz77zc5dGg327evIT09hfbtO6Loqua3ozmGynoudenSA4Dlyxdy
OuVklW9AvcHFdlXyquFp2bItsX1i6DdA/9Ms1JOhwxzPI1PVabsMt+jUZRstnGdvLFBhdgJiqy3a
snkdsz54k/sfvJf3P/gfbdq058SJU/y61vLrltLCWj9bUOhYnjnSl9rb5z59XB+TWGtTba3DmT7B
0eOuWfNQAHbt2sz5C+dI2LrJuL34eMfrRVSPreNF4+587pqylS+GSUtL/a+17dzQbxAAK1d+w5kz
KfTr25W33nxN+utqsNT/upnOZKisj7sGDbIfb6n7xsFaf2at7n/fbblN7hNruX4cucjGUh7YOoce
NLh648TG5rqfWJw7920efmgkc+d8xKiR4/jnzM9w10KvXjG8/c4nrFmzhGFD+1BSUsLHH3+Ll7cn
GgejNv6RiQQHhzBmdBwtw1sz/KaRfPLJPzmVkuxyuSc89gQhIaHG/z883rVt9e07gBde+CeLF3/K
yBGDaRYSSt+4EZTW8bddNnZqtZqvF/3AoEG3Mue/7/O3ZyeTmZnJJ598S5cuN9Ctq+t55ShrdVpW
bv0zzZqF0rfvABYt+pSFX82r2QJZ0ViPQVPNmodyww0DKSkpZvCgUVUuf2/evCV33TmIpCOHeO21
D/H29qb/ADneasv4Rx7nqadnsOLnH3jgvlFMf/5pYmP78/LLH9I8tGp+d+/ueI498qjlXGrZqi1j
xj7EF1+8z7PPTKJHj95o/roPsO8NrtWz5FXD5ObGX1cY6n+696j5dt1a21VQWFDnbbRwnr2xgPmz
tGy1RTExvcjJzWXQwB4MHdKV8PCWTJz4dzp3tvx6lasm/mKtn/2/CY7lmbX279SpK32pvX2Oi3N9
TGKtTbW1Dmf6BGv7aR6PHj16cfc99/H55/9h6pRHGDLkZuOXNfTo4Xi9iOqxdbyEtXCsTq2NA23l
i/qvK5cs9b+PWjmWgoKa8tLLb/Ltt3O5c+RQ+g8YzKSJ/6BbN+mvq8O8/7V0UYWluPaMsR9vqfvG
wVp/NmCg5bh26mS5Te4Z089i/TjyPTqW8iAszPo5dLdudXf+X59UeZfq5nHC586m0qJl67rYlMPb
LS+DS/lX/q9W659/4uN75bLT0hIoLgKdTt+AefvoHxxcUQ75eeAXAFqt/gHObm7g5w8lxXC5EIKC
9Z8ryNdfiuvlo/9ceZl+G4UF+s+rVVXXVVwERZehSdOql78ayhvYRL8tRdFvV1cJAUH6Zexty1ZZ
1Wr9touLAUW/rK9/7dRLY2cvn3U6KCqEsjJ9fWg0+jrR/vWoBJfzqtKx5azVqfl2zHMuP0//QHIv
b/1PbcWqsR2DBob1BzaBoqJLJCcf59HxYxk3bgJPP/1PgoJhb+Iuxo0dwezZPzBs2HDjgMHbFzz+
ej6THG/VZ+8YLLqszx1DD2fIK7X66vx2NMcqKq7OpfPnLrJ27UI6dY6lQ3Rvnn56NFqtB/PmraaJ
/nErDtez5FX9c6S98vPH4jPWHM4jF9su/0D9MjXVRovqc2UsYJ4HYD2HdDq4XKBfj0qlf8/XD1BZ
fl1tcuuWvX7WUrtmKc/ctZaXCwjS568j+ww1MyZxZB3mHO0TrO2npeOu8BKUlv41yeGuP36DQ6zX
l9rCLXXCsXNE0/7RkG/WjhdwrE7Nz49MWcqXo8d2cd846/2vtWMpIEj/b3ExKDr9unz99Lkh/fUV
1e1/LR371uLqSLyl7uuXq+eNluJqq00uKb66fiorLI/bTiTv4sEHbI/Bq7Q97lXX4+g40d55aEO0
e9eG6/sZi+5a/QDAFg9PLD4cXeNe9bOBQVd+9/S68vBVtVp/gmBk8lBW0/WarsvaiYJ5eVUqCGpS
dRlHtmWtrLa2LZyjVtvuIGoirxxZDizXqfl2zJcJCLRe9prU2I5BS+tf8fOPvPnGK/SJG8Djj7+A
p9fVnYBGq+90zMnxVnu8ffQ/lpjnt6M5ptFcnUvePsHk5GYx44VJFBcX0bVbD15+6YMq32LpaD1L
XjVs9torh/OoBtquumqjhWtsjQXM8wCs55BarT/hsMTa6wb28tZSu2ZgnmfWljNlb/xTE2MSR9Zh
zpk+wdF4+PqDaRNseAi/rfoS1WM+tgXrxws4XqfWPm8pX9QmfbCl/tfWseRmofwg/bWjbLVjlo59
a3F1JN5S9w2XI+eNluJqq0221LZYG7e5nzF5zcoY3LztMV2Po+PExpob1/UVi0JUl+SV466HWJUU
6/+ypNHor2owsHcFhai+hpZXRYX6K1d0Ov0Awce36hcIVIfkVd1raHklGjbJFyFc15iOI+l/a09D
zwOp+7ohedA4XfdXLAohRE2w9NcusH8Fhbh2ePta/sulKySvhBBCiIZD+t/rl9S9AMkDW66hx0UK
IYQQQgghhBBCCCHqikwsCiGEEEIIIYQQQgghnCYTi0IIIYQQQgghhBBCCKfJxKIQQgghhBBCCCGE
EMJpMrEohBBCCCGEEEIIIYRwmkwsCiGEEEIIIYQQQgghnCYTi0IIIYQQQgghhBBCCKfJxKIQQggh
hBBCCCGEEMJpKkVRlPouhBBCCCGEEEIIIYQQovHYsGGDXLEohBBCCCGEEEIIIYRwnkwsCiGEEEII
IYQQQgghnCYTi0IIIYQQQgghhBBCCKfJxKIQQgghhBBCCCGEEMJpMrEohBBCCCGEEEIIIYRwmkws
CiGEEEIIIYQQQgghnHbdTiyeP38elUpFYWFhja53yZIl5OTkVOuzN9xwA4sXL6637QtR1wIDA9Fq
tXh6euLl5UXnzp157bXXuHz5skOfl3wXlgQGBuLm5oZGo6nyM2fOHM6cOYNKpaKioqLK77Xhxx9/
pH///vj6+uLv70+/fv344YcfgNrrg6qjtuNwLRg+fDivvPKKxfc6dOjAZ599BsCvv/5Kz549CQoK
on379syZM6cuiykaoBdffJGgoCASEhKc+pxp/ybHqLiezZs3D19fXz799NMqr/v4+ODp6Vnl58SJ
EwAkJCQQFxdHUFAQHTp0YO3atTa3sWzZMgYOHIifnx8+Pj506eg0dH8AACAASURBVNKFt956i/Ly
cuMypmNWb29vIiMjee+992p+h4VF1vLA3nsA+fn5tGrViilTptjchuSBENV33U4s1pZXX321Xic6
6nv7Qjhr5cqVlJSUkJWVxf/+9z82bdrEkCFDKC0ttftZyXdhzZo1a6ioqKjyM3XqVFq1asW5c+fQ
aDS1uv1PPvmExx9/nEmTJnHx4kXOnj3LM888w8SJE1mwYEGtblvUvClTprBgwYKrJnYSEhLIyMjg
wQcfJCMjg7Fjx/LOO++Qm5vL999/z/PPP8+ePXvqqdSivpWVlfHdd9/x7rvvGiefHWXav9VVuyVE
Q/Pkk0+ydetWunTpUuX18vJyioqKSE1NpaSkxPgTHR1NZmYmd955J9OnTycnJ4f333+fcePGce7c
OYvb+Pjjj5k4cSKTJ0/m/Pnz5OTkMH/+fJYtW8bEiROrLGsYsxYWFrJw4UL+9a9/sX79+lrbf6Fn
LQ/svWcwbdo0tFqtzW1IHgjhGqcnFrusV9VGOerNihUr6Ny5M/7+/jzyyCPodDoAtm7dSlxcHB07
dqRr1658/PHHAOh0Op599lkiIyOJiooiNjaWnTt3AjB27FhOnjzJrbfeypIlSwDYtWsX/fr1Izo6
mujoaL788kvjthcsWEBERASdOnVi2rRpKIpit7zObt/afpw5cwYfHx/ee+89mjVrxrlz51i7di09
e/akXbt2REZGVjn5/eqrrwgLC6NDhw7MmDGDYcOGsWjRIrv7KISjfHx8GDRoEPHx8WRmZvLVV18B
WM1LS/luK4eFAEhLS6NFixZVJoi++uoroqOjadasGU8//TSVlZUW20hH27rCwkJeffVVZs2axYQJ
E/D29sbPz48HH3yQ5cuXExUVZVzWWh9kLZf//PNPvLy8+PLLL7nrrrvo2rUrDz/8MDqdzuZ7IG21
K+6++250Oh1r1qyp8vrnn3/OQw89hJ+fH4qi8PXXX3P77bcDEBsbS1RUFMeOHauPIosGYPny5fTt
25dHH32UzZs3X/WHsPj4eLp3707z5s3p27cvu3fvBq7u30zbrX79+vHJJ58Y11FZWUloaCgbN24E
5DgX15bHHnuMb775Bj8/vyqv5+XlAfqrx8xt376dsLAwxo0bh0qlYtSoUfTu3Zuff/75qmULCwt5
7bXXmD17No888gg+Pj54eHjQv39/4uPj+eijjyyWS61WM2DAADp16kRycnIN7KmwxVoe2HsP9H9o
PnLkCI888ojV9UseCFEDFCd0XoeCgtJ5nVMfa5DOnTunAMr06dOVyspKJTMzUwkICFA2btyoZGdn
KwEBAcrq1asVRVGUtLQ0JTg4WNm4caOybt06pX379kpJSYmiKIqyevVqZdq0aYqiKEp5ebkCKMnJ
yYqiKEpmZqbi5+enLF26VFEURTl16pQSGBioHD58WElPT1e0Wq2yZ88eRVEUZfny5Yqbm5uyaNEi
m+V2Zvu29iMjI0NRqVTKG2+8oeh0OqW4uFjx9fVV1qxZoyiKomzZskXRaDTKxYsXlbS0NEWj0RjL
OmfOHMXDw0NZtGiRzX0Uwp6AgABl7dq1V73+3HPPKaNHj7aZl+b5bmtZcX2xlleKoiinT59WAKW8
vNz4+7Rp0xSdTqdkZGQoLVq0UJYsWXJVG+lMW7dp0yZFpVIpRUVFVstoqw+ylcsZGRkKoLz//vuK
oihKSUmJEhISYmzXrb1nq/ymMRHWvfTSS8rIkSON/8/Ly1O8vLyUffv2XbVsRUWF8uOPPypNmzZV
0tLS6rKYogEZMmSIsn79ekVRFOWZZ55RPvzwQ+N7WVlZip+fnxIfH68oiqJ8/fXXSlhYmFJeXn5V
/2Z6jH766afKwIEDjevZsGGD0rJlS2M7ImMycS0aPny4Mnv2bOP/jx8/rmg0GuW+++5TWrdurXTr
1k2ZM2eOoij6c6qOHTtW+fzdd99tPF8ytWnTJkWtVhvPq2wxHVtUVlYqmzZtUpo2baqcOnXKlV0T
TjDPA3vv5eTkKO3atVOOHDmivPHGG8oTTzxh8bOSB0K4Zv369YrDVyx2Wa/iyC3634/ccu1cufjM
M8+gVqtp2rQpHTt2JDU1lfj4eFq0aMEdd9wBQHh4OKNHj2bVqlWEhoZy4cIFFi1axIULF7jjjjuY
NWuWxXX/+uuvBAcHM27cOAAiIiIYNWoUS5YsYevWrURGRhIbGwvor4Zo0aKF3fI6s31b+6FSqVAU
hYceegiVSoWnpyfp6enGKy0GDx6Mu7s7p0+fZvPmzXTs2NFY1ieeeAJfX1+7+yhEdYWEhJCbm2sz
L805s6y49t1+++2oVKoqP4Yresz97W9/Q6VS0aJFC0aMGMGWLVuuaiOdaetycnIICgrCy8vLbjkt
9UG2clml0ve9DzzwAAAeHh5ERkaSmppq8z1pq103efJk1q1bx9mzZwH45ptv6NatGzExMVWW++67
79BqtUyZMoXPP/+c8PDw+iiuqGcnTpzgzz//5KabbgJg0qRJzJ8/3/j++vXradWq1f9n777Do6ry
PoB/p08mZWbSG6QAoTcp0pTOrg1F6RF3RdpalrWua1l3Levi4otYEJAiTSOEpi4I2CjqAqKIgAoC
oaQnM2mTTKad948h10wymWRoad/P88zzJPfccu6dc8699zfn3IsRI0YAAO6++24cPnwYCoXC53on
TZqEAwcOICsrCwCQlpaG1NRUyOVy1nNqNTQaDaZNm4a5c+ciIyMDS5YswVNPPYWtW7fihhtuQFZW
FtasWQOn04nPP/8ce/bsgdVqrbWeqvO1RqORps2ZMwfR0dHSJyMjQ0obP348DAYDAgMDMWbMGDz8
8MNITEy8BntMl+Khhx7CnDlz0LlzZ5/zsRwQXb4GBRarBxWrtJTgotFolP5WKpVwOp3Izc1FRESE
x3xhYWHIzc1Fjx49sGXLFmzfvh0dO3bEgAEDsHfvXq/rNpvNyM7ORmJiovTZuXMnCgsLUVhYiNDQ
UI/5a27TG3+272s/qoSHh0t/r169GoMHD8b111+PAQMGwGazweVywWw2e8wnl8ulGyVf+0h0qaqG
fQF1l0tv/JmXWrbt27dDCOHxqbrBryk6Olr6OywszGO4YlXb509bFx4eDpPJhNLS0nrz6e0cBNRf
lkNCQqS/FQqFtFxdaWyrL19iYiJGjhwpDUtftmwZZs+eXWu+KVOmwGazYevWrfjzn/+MTZs2Xeus
UhOwePFiZGdnw2g0wmAw4IYbbsCJEyekl7gUFBR41H+5XI6IiAjpB4K6hIeHY/To0UhPT4fdbsfm
zZulIX6s59RaJCQkYMWKFRg4cCBkMhkGDhyI1NRUfPjhhwgLC8OWLVvw+uuvIz4+HqtWrcLo0aM9
6luVyMhImEwmlJeXS9PmzZuHw4cP4/DhwygqKvJ4dEp6ejqKiopQUVGBM2fO4Ntvv8WsWbOuyT6T
f7Zs2YJTp07h0UcfrXdelgOiy1fvU6C9BRWrVAUXj42p/9mAzUlMTAzy8vI8puXn50uBjhEjRmDE
iBGw2Wx44403MH78eI9gXZX4+HikpKTgyJEjtdLWrl0rPR+kSl0PFa6poduvbz8ASBewmzZtwosv
vogDBw4gISEBTqdT6pUYEhKCkpISaRkhhPRLua99JLoU+fn5SEtLw1tvveWzXNbkz7xE1eXl5aFt
27YA3Df71X9IqWoj/Wnr+vXrB71ej2XLluHhhx/2SPv444/xyy+/IDU1tc7lr0ZZ9pX/6r/Ck29z
5szBo48+irFjx+L06dOYPHmylHb8+HGcPHkSt99+OxQKBQYNGoRbbrkF27Ztw5133tmIuaZrzWq1
YvXq1Th27BiSk5Ol6QsXLsTSpUtx4403IioqyuMaTQiBY8eOoWPHjvUGF1NTU/H222+jffv2SEhI
kF5awGsyai1yc3Nx4cIF9OnTR5pmt9ulF3QMHz7c48VZPXv2lHryVtevXz8YjUasWrUKf/rTnwAA
er0eer2+3jzEx8djxowZmDp1KpYtW3a5u0RXWFpaGs6ePYt27doBcL8Z2uFw4OTJk/jss8885mU5
ILp8Pnss+goqVmkpPRerGzFiBHJzc/HJJ58AcD8sf9OmTRg3bhyWL1+OOXPmwOFwQK1Wo1evXtJL
V+RyORQKBYqLi6X1ZGVlSeuxWCyYOXMmvvvuOwwZMgS//PILvv32WwDAe++916BflP3dfl37UZPZ
bEZYWBjatGkDIQTmzZsHmUwGi8WCQYMG4YcffsDRo0cBAEuXLkVZWVm9+0jkD5vNhv379+Pmm29G
r169MHHiRJ/lsmZ59zUvkS9VF4IFBQXYvn07Ro4cWWsef9o6nU6HefPm4amnnsLChQtRVFSEkpIS
rFmzBnfffXe9w2WuRllmW31l3HrrrbBarXjiiScwbdo06HQ6Ka2oqAipqanSKIKMjAzs2LHD48aX
WocNGzYgOTnZI6gIABMmTMDmzZthMpkwZswY5OTkYOvWrQDcPWBGjRoFmUxW6/xW0+23344ff/wR
K1eu9HghAes5tRa//vorhg0bJr3A8sCBA0hLS8Ndd92FsrIyJCUl4cCBA3C5XHj77bdhNptx8803
11qPVqvF/Pnz8fjjj2PRokUoLS2F3W7HoUOHcMcddyAqKgphYWFe82AymbBy5Ur06NHjqu4rXZq0
tDRkZWUhIyMDGRkZePTRR5GamlorqAiwHBBdEXU9gLHLDgh82/BPc3uhS9WD80tLS6VpgwcPFu+8
844QQojdu3eL/v37i44dO4quXbuKpUuXCiGEKC4uFqmpqSI+Pl4kJyeL3r17i127dknrSE1NFSEh
IeLVV18VQgjxzTffiAEDBoh27dqJ9u3biyeffFI4nU4hhBBvvfWWaNOmjUhMTBQPPfSQGDp0qFi9
erXPfPu7/br2o+b+l5SUiFGjRomkpCTRt29fsX79ejFjxgwRGxsrjh49KubPny89HPmFF14Q119/
vVi7dm29+0jki16vFyqVSmg0GqFWq0VycrJ45plnREVFhRCi/nJZvbzXNy+1Hg19ecvJkyeFRqMR
S5YsET179hTx8fHiL3/5i3A6nV7PEf62dRs3bhQDBgwQOp1O6PV6MWzYMOlFDb7OQb7K8qefflrn
cvWd1+rKP1/e4p/nnntOAPDarqxcuVIkJyeLoKAgERcXJx577DHhcDgaIZfUmAYPHiy9RKmmIUOG
iAULFggh3NdonTt3FuHh4aJ3797i66+/luarfn7zVkenTZsmlEqlyM3N9Vg/r8mopXA4HEKj0QiN
RiPkcrlQKpVCo9GIBx98UAghxPLly0X79u2FXq8XnTp1EitXrpSWXbdunUhISBB6vV4MGDBAHDly
xOe2tm3bJoYOHSqCg4NFQECA6NKli3jmmWeEyWSS5ql+zarRaER4eLiYNGmSyM7Ovir7T26+ykF9
ZaQ6Xy9vqcJyQHRpdu7cKWRCiJY1jpmuCqfT6fFA8ZSUFCxcuFB6uQAREREREREREbUeu3btatjL
W6h1Ky8vR2RkpDS05vPPP0dWVhaHdxERERERERERtWL1vryFrq3jx49j6tSpdaY///zzGDt27DXM
kft5YStWrMBf/vIXVFRUIDg4GO+99x4iIyOvaT6IiIiIiIiIiKjp4FBoIiIiIiIiIiIi8guHQhMR
EREREREREdElYWCRiIiIiIiIiIiI/MbAIhEREREREREREfmNgUUiIiIiIiIiIiLyGwOLRERERERE
RERE5DelyVzc2HkgIiIiIiIiIiKiZkZ5/FxRY+eBiIiIiIiIiIiImhkOhSYiIiIiIiIiIiK/MbBI
REREREREREREfjGZTAwsEhERERERERERkX9CQ0MZWCQiIiIiIiIiIiL/MbBIREREREREREREfmNg
kYiIiIiIiIiIiPymbOwMNBatWom+nePw1ZGzEMK/ZXt2iEZ2QSnyzJZaaW2i9IiLCEGuqQxnssxX
KLdAuCEQRaUVcDhdV2ydV9Kg7m0Bmee073/JRkWlHUE6NdrFhSJArYLd6cS53GLkXzx2vtIAIFyv
Q2xECAID1JABsNocyC+y4EJeCYS/Xxw1OQO6tYFCLkPVN2mtdKCwuBwX8orhdNX//V5uvdAHaZEc
Z8QPJ3PQv0s87A4nDv2c5TGPXC7D9V3jYamw48ivOZe0ncvNb1KsETKZDKczTZe1/dZiQLc2UCrk
tdr201kmmEsqpLZfo7r080BDhOt1iIsIgS5ADUCg3GpHZn4JCorKoVYq0L9rPL758VyDyvrVdDnn
w9aiW7solJZX4mx2Ua20Pp1ikZlfipzCUhiDA5AYY4BGrYTD6UJmfgmyC0obIcfUVCTGGBEdFoSf
zuSj2GJt8HLVzxeso9TaKRVy9O4YC3NJOX694L4W0gdqkRRrhFajhN3hxOlMM8ylFfWmedOQ+w2P
a1YB2BxO5BSW4kJeyVXee6ribznwdX/qDcsB0aVrtYHFSrsDB45duOIXaBGGQPx6oRAFReVXdL2J
0QYcrahskoFFmUwGuVyG/ccuwO5w1krrkhiJszlFyDWVIShAjW7tolBWboPV5qgzraLSjtjwYLSN
NuB0pgmFxeUQwh2ITI4LRYBGhRPnChppj+lKOn4mH+bSCijkMgQFaJAQY4AxOABHfs2Bq54Kejn1
QqmQo2NCOI6dyoPrYmBHLpchJFCDEkulNF+4Xgen88o0FJea34zsIvROiYExJADmkrovjOk3x07n
eb2JkMlwVdr+mmLDg5EQbcDpLDPyiyyQQYZQfQA6xIdBIZfze2xmcgpLkRwbinM5RR5lRx+ohVql
RL7ZArVKgU6JEfg5w92mBenU6NEuGqXllSgrtzVe5qnRyGQyRBh0yMg2IzosyK/AYvXzxdW6ZiVq
LpJijR4dClRKBTonRUj3XKEhAeiUGIFDP2dCCNSZZrM7a63bn/uNqmtWAAgJ1KBrchTKKuwo8hG0
pCvHn3Jgd7jqvD/1huWA6PL4HVicnZuIJVEZVyEr11bNnirBOg2S44xQKhQAgAt5xcg1lQEAokKD
0CZKDyEEzKV1XxR2ToxAgEaJpNhQBAWokZFdBEOQFklxoVAr5bDaHDidaUZpeaXX5ZPjQhEaEgAI
wOFy4VSmCaWWSnRKjIBWo0S35ChkZBehoMgCfZAWSTFGKBQyCOG+6ckqKIVWrcR1HWNxLrcIcREh
+P5ENgK1aiTGGKBQuEe+n8/13LeEaAOcLhcKiysQrFMj11SGPLPF5zGpTnlxvd6CJfogLVxCSMuV
VdhgKqlAhEGHknJbnWmZ+SVIiDHg1AWTR8/QEksljp7K9fHNUnPldAkUW6w4eioXfTrFIjI0yKMH
UM3y661e1DWvN7HhwSgus8Ji/e2G31xiRVRokEdgMTI0CObSCgRoVNI0X9vxpx7XVce81eNzuUVI
jDYwIHWZqrf9VaKMQYiL1EOpkKGgqByns0zQqGp/BxqVskFtokIuQ0KMAaczzdXSBfLNFtjtTo+A
eahehzaRemjUChQWV0gXrnWVMY1aiT6dYnHqgglheh20aiUsFTb8cq7AZxrg+zxHvhUWV6BdHBAa
okNh8W8/HEaFBSHfXAanywWFQoGT5wqkm42ychsqbHboNCoGFlupML0OpeU25JksaBtlgFIh97hW
qusaseb5oqy8Umq3erSPRr7ZgqyLPWFlMqB/l3j8cq4ARaVW1nNqcUJDAqDTqpBnKoNa5S7XIYEa
2OxOqSOHqaQCZRWVCAvRweZw1pmWXejZg7zqfH0p9xsllkpUWO0I0ChRxI7pV52/5aDg4rm6IT/m
sxwQXT6/AouzcxNxfAwwe2fLCC5WUSnl6NYuEifPu3/t0KqV6JUSg9Jy9y/F7eND8cOvOSgrtyFM
r0NMWDCA2i3HTxn56NMpFmeyzDCVVECplKNzUgR+OpOPojIrIo2B6JwYgYM/1f7V2RAcgNDgAHz3
cxZcQiA0JAAReh1KLZX45Ww+wnsk4OjpXFgrHVAq5OicGIET5wpgKqmARqVA75RYlFvtKK+0Qy6X
QSZz/0Ijl8ncPSjO5sNcUgF9kBbdkqNgKqmAXAa0jw/DD79mo6zchpiwYMRGBCPXVObzmJRbPbuP
Vw057Ng2DME6DRwugZyCUmQXlkKnUdaav6LSjkCtGg6nq860IJ0GCrnca8/Ppthrk64clxAoKC6H
MViLvIsBRG/lt2a98FXWvf1SGWEMREaNYY35Zgu6JEXgdKYZTpcLGrUSgVoVcgvLpMCir+0EBqgb
XI/ra3eq12MAMBVXIKVNOAI0qjqHcNCl0WlVOPRzJtQqBXp1iEGxxYoSS6XHd+BPm1jVfuUX1X5c
RlGZ+8cptdJ9URyoVeO7X7KgUsrRp1McDEFalFwMRHsrY0IIyGUyKBVyHD+TB7lMhn5d3MuVV9rr
TLNYbXXm39XIQ7GbA3HxR7Co0CApsKhUyBGu10mPSLDZndKNjEwGhIXooFYqUVzW8F5q1LLEhAXh
fF6xdF6LCg1CZr57uJyva8Sa5wut+rfL9TyzBRGGQCmwqA/SQgigqNTqVztF1BwoFXIkx4Xi+Jk8
hOl1HmmyGkNcHQ4XAjRK2BzOOtNqupz7DX2QFhq1kj/4XgOXUg583Z/WxHJAdPkaHFisCioCaHHB
RWNwAOwOl9SYWG2Oiz3nAlFeaUdFpUPqbVBYXA5bA7pTA4AxKACVNqd0I5lntsBcavU6lMVud0Kl
kiPSGIjCkgqYLn68MQRrYXc4pfTKizczoXodynOLAUB6TqFLCBw8fkFqFIvLrBBCQKtWIkCjREWl
Xdq37MJSJEQb6j0mZ3M8gzEuIZBnLkOOqQyllgIEB2rQNSkSNocTcrm81k2ryyUgl8t8pqkUcjgc
Lo+ePe3jQz1OJj+czIHV5qjr8FMzZne4EBQg91l+yyo866GveWsGFpUKOQI0Ko+eiQBQ6XCgxFKJ
CIMOOaYyRBkDkWe2eAy78LkdP+qxrzpW9Uy26s8bdQmBsgobQgI1DCw2QNfkyFrTqm7Sa6q6QbfZ
nTCXugN5JWXuslH1HfjTJqou9kpqSMCu6ru2O1yoqLRDo1bCVWats4xVXmzzqoKWLiFgtTmgUf/2
I463NLVKUWf+2ZupYXIKy9CnUyzUKgVsdicijIGwWG0oq/DsjRhhCETHhHDYHS78eqEQlV6G3lHL
F6BRQaNWoujiSJfcwlJ0TIiQAou+rhFr3ihXV1BkQXKs8bdyaAiUetj4004RNQft4kKRU1iKcqsd
YfrfphdbrFArFYg0BiK/yAJ9oBb6IC0Kiiw+02ry936jU2KE+wc+uQwyyHAup4j3ItfApZQDX/en
1UceACwHRFdCgwKL1YOKVVpScFGpkEOtUqBf5zhpmlzuHhKnqjFsBYAUpIgKDUJSjBEAUFJeieNn
8jzmUyn9W/anM/mICQ9GYqwRFZV2nMky1wp8uNfrvkGszuF0QlPtF+3q6ZHGQEQYAqWH18ouXrEq
FfJaAZdKu6PeY+It7yfPF0rzlVoqkW+2IDQkAJYKG+RyzytkhVwGl8sFl8tVZ5rN4YRSKYdcLpNu
zjOyi3Auxx047dslrtbDeKnl0KgV0nNw6iq/3jR0XpVSASHgtSdjrqkMcZEhyDGVITLU/cD9mr9y
17Udi9XW4Hrsq45VqVnPbQ4nVBd7upFvdT1jsXrPnyrVn7lkd7igVSs8/gca9n1JyzhdUCrkUMjl
cLp8/9LtcP62bSF+a9bqK8vOaueW6svVlabwI//kndXmQFGZ+3EJ53OLERUa5PXFLPlFFhQUux91
0LFtOADUuomhli86LAhqlQIDurWRpinkcugDtSi2WH1eI/pid7hgLrUiXK9DdmEZwqr1mvWnnSJq
6sL0Omg1Spw4X/uZ6g6HC8cz8pEUY0RirBFFpVbpZUe+0mry936j6hm6AKBRKZAcF4oObcI87oPo
yrrUclBpc9R5f1rznMxyQHT56g0segsqVmkpwcVKuxMVlQ58/0tWrbRIY6D0DMEqVc91yC+ySN2e
vb1kwlsQQKdVoaLS4XXZojIrisqskMlkiA0PRufECGkYZHV2uxMqpWeeVEpFjQcSu9cZptehTZQe
h0/moNLmgEwGDOzeFoD7mXaKOvbN1zGRy2UeeVcpFdCoFB69NmQyGYRwvwU1NiLE8xgEqGGpsPlM
Kyu3weF0IcoYJHVZ5xDo1kGlVCDCECg9J66u8luTP/P6UlhSgXbxoYg0BsLhdMFitXkEFuvbTkPr
sa86ppbaDQ5RvRZUKoXUE1CllNcI6Lq/A1/fV01Vw9mjw34b9lglNCQAARqVR2/Umq5UWa7OV/69
BVvJu5zCMiTFGmEqroBWrfQY7q7TqhCgUUkPfS+xVMJUWuH1JoZaNrlMhihjEL77OcujF0tseLD0
Ehdf14j1tf35ZgtiwoNRYXPAanNIvZX9aaeImroIg879XORO7kC5QiGHTCaDVqPC0VO5KC6z4vDJ
bGn+3h1jpCC6r7TqLud+o9LuRI6pDB3bhjOgdBVdajnwdX9aE8sB0eWT+0r0FVSscnyMe77mrLjM
Co1SAWNwAAB3r7n2bcIQFKBGiaUSARoVgnRqAO7nsqkuBuNcLuF+QLDD6bXxKSq1Qq2SS92oww06
dG8XBUDUWjYqNAjt40Mhk7mf5WSp1ggK4f4o5e7tFpVZoaqWX41aiTC9zuuNi7tXoku6aY6P0APC
vY8llkoEatXQad3PjosOC4bi4jZ8HZOaeQ/QKNG9fTSCAzUA3C8IiDC4H5pbbLFCBiAmPBiA+zkU
xiAt8s0Wn2kuIXAmy4zEWCNiwt35kslkCApQo3NiBOx2JxwOBhpbEplMhmCde5iCpcKGgmKLz/Jb
s174mrcm+8Xn73jr/SeE+yUbSbHGOl9WVNd2/KnHvupYXdRKRYN6tJB/okODALiDisbgAGloYnX+
fF8ul0BGdhESYgyIDQ92915UuIfIp7QNl8pOXfwpyw11Ug+wEAAAIABJREFUKeWNajOVlEMukyEx
1uA+V1Ub7q5UyJHSNhwhF8+FWrUSxuAAvrilFQo36GC9GPSrrqC4HGF6HZQKuc9rxJrni5oKS8qh
06oQFRrk8aIB1nNqSX4+W4ADxy/g4E+ZOPhTJjLzS5BvLsPRU7lQyGXo2zkOwTp3exsT5j7Xmkor
fKbVdDn3G0qFHFGhQXx+6VV2qeXA1/1pTSwHRJevzm4Ks3MTcTwMwKH6V3I8rHm/LdrhdOHYmTwk
xxnRLj4UEEBBsUX6heN0lgmdEyMghPttU96GNda13uOn89EuPhTt48NQaXfgeEa+12csFhSXwxCk
Rd/O8RBCwOF0SW/yBNzP1OneLgrncouRmV+Cn87kIzHWgOQ4I4QAMrLdwy3VNQIlBUXliDAEom/n
ODgcLlzIL0ZekQUpbcNx9HQuMrLN6JoUCYdLoKDIAovVBtGAY1JdiaUSpzNN6NgmHEqle3j16Syz
9Fyh4xn5aB8XioRoA2x2J06cL5Qutn2l5ZrKYLM7ER8ZgsQYA2SQwWpzoLC4HCfPF7IHYwvRJSkC
Au4RBpV2J/LNFpzPLYYQ9Zff6vUip7DM57zVT/gOp/t5diGBGq8B+VxTGWLCg732KvOVp5/O5vtV
j+uqYzXrMeDuARMUoMbJBrY/1AAy98Vkpd2B3ikxUCoVKCiyoLC4vNZ34E+bCAA5haWwO6raLyNc
FwPNP2e4X9Tg7Tuu4quMnThXeyhQQ/jKP3ssNpwQQI6pDG2j9Pguy7NXWNW5MKVtOFRKBZxOF/KL
LMgx8TWRrU10WLDXlzfZ7E6UVdgQGRqErPwSn9eI1c8XNc9TLpeQnp146oJJmu5vO0XUXDldAmdz
itApIRwKhRwVlXYcP50n/djjK60mf+43qq5ZAcDpFCguq8DPGflXe3epDr7KQX33pzWxHBBdHtne
wxkca9eKuXtW/fZ/n05xOJ1p8vpsMqKWpG2UHgEalUfgrykL1+vQJlqP73/Jrn9mIiIiIiIioqus
Iu+E76HQ1LLJ5TJc37WNNGTGEKSFusazKIhaqqyCUhiCtdKjAJoymQxoE6XH2Wy+1ZOIiIiIiIia
Do5/asVcLoGT5wuRHGeEXBYKp0vgl7P5fIYbtQoOpwu/nC1Ax7bh+OHXnDqHyDQFCdFG94sgStiT
mIiIiIiIiJoODoUmIiIiIiIiIiIiv3AoNBEREREREREREV0SBhaJiIiIiIiIiIjIbwwsEhERERER
ERERkd8YWCQiIiIiIiIiIiK/MbBIREREREREREREflN2aWto7DwQERERERERERFRM3IoD1CGGvWN
nQ8iIiIiIiIiIiJqZjgUmoiIiIiIiIiIiPzGwCIRERERERERERH5jYFFIiIiIiIiIiIi8hsDi0RE
REREREREROQ3BhaJiIiIiIiIiIjIbwwsEhERERERERERkd9adWCxb9++WLx4sfR/ZmYmUlNTERcX
h/DwcLRt2xZz5sxBWVmZx3Lr16/HoEGDEBQUBJ1Oh+uuuw7vvPNOg7drMBigVquh1WoREBCALl26
4Nlnn4XFYvF7OwaDAZ06daq1jfLycoSEhGDIkCG10p588kkYjUbs2bOn3mNiMBgwePBgCCE85hsy
ZAjS09MbvM9E3jRWHaSWrSHtlsFggEKhgFKp9PgsWrQIQMPLIrUOI0eOxNNPP+01rWPHjliyZIn0
/9KlSxEUFIQ333zzWmWPmqCa57er4YMPPoDJZAIAZGRkQCaTweFwXNVtEl1Ln3zyCXr16gWj0Yj2
7dtL52gACAwMhFar9ficOHGiznVt3LgRQ4YMQXBwMAIDA9G1a1e89NJLsNvt0jzV79F0Oh3atWuH
V1555aruI9XPVznwleYNy0HzxdhNE4/diFasT58+4u2335b+79+/v3jooYeExWIRQgiRmZkphgwZ
IqZPny7NM3/+fGE0GsWqVauExWIRVqtVbNq0SURHR4vHHnusQdvV6/Vi+/btQgghysrKxO7du8Wg
QYNE3759hdVq9Ws7er1etGnTRuzbt89jG6tXrxaxsbFi8ODBHtMrKytF27ZtxZIlS8TUqVPrPSZ6
vV4kJSV5TBNCiMGDB4sNGzY0aH+J6tJYdZBatoa0W9XbYW8aUhap9Vi/fr2IiYkRdrvdY/ru3btF
UFCQKCkpEUIIMWfOHDF16lTRv39/8cYbbzRGVqmJqHl+uxrat28vTp48KYQQwuFwiOzs7Ku6PaJr
KTMzUwQGBopt27YJIYQ4ePCgCAgIEAcOHBA2m00AELm5uQ1a12uvvSYMBoNYtWqVKCsrE1arVXz1
1Veid+/e4p577pHmq35t4HQ6xb59+0RgYKDYsWPHld9BahBf5cBXmjcsB80bYzdNN3azc+dOUWdg
cQkgvu3Tp8GfJc0wRlnziwgJCanVYOTn54ucnBwhhBBms1nodDrxwQcf1FrX559/LuRyuThz5ky9
2/V2Q1tRUSESEhLE4sWL/dqOXq8Xs2bNEvfee6/HfCNGjBD33ntvrcKZlpYmJkyYIKxWq4iJiRGF
hYUe6d4KZ3p6uggNDfW4YGVgka6ExqqD1LI1pN2qL7BYX1mk1sVms4moqCixZcsWj+nTpk0Ts2fP
lv6vupkZOXIkA4utXPXzW0ZGhtBqtWL58uVi7NixomvXriI1NVU4nU4hhBDbtm0TPXv2FImJiSI5
OVmsWLFCWs+nn34qunfvLiIjI0X//v3F/v37hRBC3HXXXQKASE5OFmlpaeLMmTMCgLDb7WLAgAFi
4cKF0jocDoeIiooSu3btEkII8c0334gBAwaIDh06iA4dOojly5dfq8NC1GAXLlwQ6enpHtN69Ogh
Vq9eLfLy8gQAUVlZWe96SktLRXBwsFizZk2tNJPJJEwmk/S/t2uDvn37ijfffPMS94Iul69y4Cut
JpaD5o+xm6Ybu9m5c6eocyj0LCFw6NAh9GnA59ChQ5hVo7tlczRlyhRMnz4dCxYswJEjR+ByuRAe
Ho6oqCgAwFdffQWn04nx48fXWnb48OGIjY3FZ599dknb1mq1uPPOO7Fz506/t5OamoqNGzeitLQU
AHD27FkcO3YMo0ePrrX84sWLMXPmTGg0GowfPx6rVq2qN2+9evXC3Xffjblz517SvhE1VGPWQWpZ
Lrfdqq8sUuuiUqkwffp0LFu2TJpWXFyM9PR0zJ49W5rWr1+/xsgeNXFqtRpWqxVmsxlbt27FoUOH
sHPnTnzxxRewWq2YOHEi/vWvf+HMmTNYsWIFZs2ahfz8fBQWFmLcuHF47bXXkJubiwceeADjxo2D
w+FAWloaAGDHjh2YNGmSx/buvvtubNiwQfr/iy++gFKpxIgRI1BQUIAxY8bgkUcewYkTJ/DJJ5/g
0UcfxbFjx67pMSGqT1xcHO666y4AgNPpxMaNG5GVlYXhw4fDbDZDqVTinnvuQUJCAnr06IG3337b
63oOHjwIi8WCCRMm1EozGo0wGo1el3O5XPjiiy+QkZGBm2666crtGPnFVznwlVYTy0HLw9iNd40V
u/H5jMVZQmBpPStYenG+lmDRokV45ZVXsG/fPowePRphYWGYPn06srOzAQAFBQWIioqCXO79sMXG
xqKwsPCStx8REQGz2ez3dmJjYzFkyBB88MEHAIBVq1Zh6tSpUKlUHsudOHECZ8+exahRowAAM2fO
bNDzBYQQePHFF/H1119j27Ztl7p7RPVq7DpILUdD2q2bbroJMpnM4/Ppp58CqL8sUusza9Ys7Nix
A5mZmQCAdevWoXv37ujdu3cj54yaOplMBsB9EwQAGo0G7dq1w7lz56DVanHhwgXphnXo0KFQqVQ4
c+YMdu7ciTZt2mDEiBEA3AHDw4cPQ6FQ+NzepEmTcODAAWRlZQEA0tLSkJqaCrlcjk8++QRhYWHS
zXVycjJuu+026RqSqKl5//33oVarMWfOHCxbtgzx8fHQaDSYNm0a5s6di4yMDCxZsgRPPfUUtm7d
Wmt5k8kEo9EIjUYjTZszZw6io6OlT0ZGhpQ2fvx4GAwGBAYGYsyYMXj44YeRmJh4DfaUfPFWDhqS
VoXloOVp7PtGxm481fvyFl/BxZYUVAQAuVyOqVOnYuPGjcjNzcWePXtQUFAgXexFRkYiJycHTqfT
6/JZWVmIjIy85O2fP38eMTExl7Sd6dOnY/ny5RBCYPXq1fjjH/9Ya7nFixcjOzsbRqMRBoMBN9xw
A06cOOH1QaA1BQcH4/XXX8f999+P8vLyS9o/ovo0dh2klqW+dmv79u0QQnh8qk7e9ZVFan0SExMx
cuRIrFy5EgCwbNkyj96KRPUJCQmR/lYoFNK5bPXq1Rg8eDCuv/56DBgwADabDS6XCwUFBR69aORy
OSIiIqRAZV3Cw8MxevRopKenw263Y/PmzbjnnnsAAGazGdnZ2UhMTJQ+O3fu5I9y1GRNmTIFNpsN
W7duxZ///Gds2rQJCQkJWLFiBQYOHAiZTIaBAwciNTUVH374Ya3lIyMjYTKZPK4D5s2bh8OHD+Pw
4cMoKiryeOlReno6ioqKUFFRgTNnzuDbb7/FrFmzrsm+Ut28lYOGpFVhOWh5Gvu+kbEbTw16K7S3
4GJLCypmZ2dLw0qqdO/eHf/4xz/www8/wGq1YvDgwVCpVHjvvfdqLb97927k5ORIN6X+ys/PR1pa
Gm699dZL2s7YsWNx6tQprF27Fnq9Hj169PBIt1qtWL16NY4dO4aioiLp8+qrr2Lp0vr6pbqNGzcO
vXr1wnPPPVcrok50uRq7DlLLdCntVkPKIrVOc+bMwbvvvosjR47g9OnTmDx5cmNniZq5TZs24cUX
X8T777+P/fv346uvvpLaqqioKOTl5UnzCiFw9OhRj7eX1iU1NRXp6enYtWsXEhIS0LVrVwBAfHw8
UlJSkJGRIX1ycnLw1ltvXZ0dJLpEx48fl3ogKhQKDBo0CLfccgu2bduG3NxcHDp0yGN+u90OtVpd
az39+vWD0Wj0GEKo1+ulXmq+xMfHY8aMGVf/bapUJ1/lwFdaTSwHLUtj3zcydlNbgwKLgGdwsaUF
FQH38xNmzpyJV199VXp1eF5eHhYuXIg+ffpAq9UiJCQEL730Eh588EGsWrUK5eXlqKysxNatWzF5
8mQ89dRTXrte+2Kz2bB//37cfPPN6NWrFyZOnHhJ21GpVEhNTcXjjz+Oe++9t9Z2NmzYgOTkZCQn
J3tMnzBhAjZv3gyTydSg/L7xxhtYtmwZzp0759d+EtWnseogtXz+tlsNKYvUOt16662wWq144okn
MG3aNOh0usbOEjVzZrMZYWFhaNOmDYQQmDdvHmQyGSwWC8aMGYOcnBzpxjk9PR2jRo2CTCaDXC6H
QqFAcXGx1/Xefvvt+PHHH7Fy5UqptyIAjBgxAllZWfjkk08AABaLBTNnzsR333139XeWyA9FRUVI
TU3F3r17AQAZGRnYsWMH+vTpg19//RXDhg3DN998AwA4cOAA0tLSpOftVafVajF//nw8/vjjWLRo
EUpLS2G323Ho0CHccccdiIqKQlhYmNc8mEwmrFy5stZNP107vsqBr7SaWA5aFsZummDsxt83vjTH
tz/XpeZbdA4ePChuueUWERkZKUJCQkR0dLS45557xIULFzyW27BhgxgwYIDQ6XQiICBA9OnTR7z7
7rsN3q5erxcqlUpoNBqhVqtFcnKyeOaZZ0RFRYXf29Hr9eLkyZNCCCGOHDki1Gq19LagDRs2SG8W
Gjx4sJg/f77X/AwZMkQsWLDA6zGpvv4qCxYsEAD4Vmi6bI1VB6lla0i7Vd9boRtaFqn1ee655wQA
cfToUY/pDodDaDQaodFohFwuF0qlUmg0GvHggw82Uk6pMVU/v2VnZwsAorS0VEofPHiweOedd0RJ
SYkYNWqUSEpKEn379hXr168XM2bMELGxseLo0aNi9+7donPnziI8PFz07t1bfP3119I6UlNTRUhI
iHj11Vc93gpdZdq0aUKpVIrc3FyPvFW9Fbpdu3aiffv24sknn5TeUE3UlKxcuVIkJyeLoKAgERcX
Jx577DHhcDiEEEIsX75ctG/fXuj1etGpUyexcuVKn+vatm2bGDp0qAgODhYBAQGiS5cu4plnnqn1
NuCqezSNRiPCw8PFpEmTPN6uSteer3LgK80bloPmi7Ebt6YYu9m5c6eQCdHCuh4SERERERERERHR
VbVr166GD4UmIiIiIiIiIiIiqqJs7Ay0NMePH8fUqVPrTH/++ecxduzYa5gjIiIiIiIiIiKqwtjN
lcOh0EREREREREREROQXDoUmIiIiIiIiIiIiv5lMJgYWiYiIiIiIiIiIyD//t7ucgUUiIiIiIiIi
IiLyHwOLRERERERERERE5DcGFomIiIiIiIiIiMhvSpO5uLHzQERERERERERERM2MUh0Q2Nh5ICIi
IiIiIiIiomaGQ6GJiIiIiIiIiIjIbwwsEhERERERERERkd8YWCQiIiIiIiIiIiK/MbBIRERERERE
REREfmNgkYiIiIiIiIiIiPzGwCIRERERERERERH5zWdgUdhsKMs4hdJjP8D8v93I27YR2RtW4fzi
V3H65Wdw6qkHcOyPt+HsuiWAy3Wt8tyozp09i+AAFRwOh9f0jenrYTabLmnZ1qzmsfF1HKnluHHQ
9Vj+ztLGzga1QJs2bsDIYTcgKtyAyNAQDBnQD++uWH7Vt5uVlYn7/ngPUpITkBAXjc4dkjH3ofth
KSuT5rkS7dulnE+2btmE0SOGIjrCiKgwPfpd1wP/mfcy7Hb7Ja+ztbj1pjH453PPek3r3aMLVix7
R/p/5fJliAo3YMnbi65V9qgJCg5Q4eCB/bWm9+/TE6tWrrisdddsQ65Em5Kbm4PgAJVHW3Wpht84
GGnvr7vs9VDrVlhYgOAAFfpd1wOLF70FAIiLDseo4TdCCOEx7+gRQ7Fl80bp/2eeehKv/d98j3n+
/sxTiI+OwFf79npMv+3m36FDUltMnnjXVdoTuhwsB0TNg8/A4rcvPIZfUn+PUzPuxLlHpiP3pb+i
8LUXUfreO7Dv3ALXgX0IyMmC892lKNjywbXKc6OKi4/HrxnnoVQqvaY//4+/w2wyX9KyrVnNY+Pr
OBIR+fL6wgWY++ADuG/mLJw5l4Xz2fn461NP48Xn/4Fn/vbXq7rtqZMmIDQsFIeP/oSzmTn4fM8+
/HT8OB5/7GFpnsZo3xa9+QYemDMb9943A6czLuBcVh7eXLQEWzdvwoN/mn1N89Ic3TdzFtauXlUr
6PrVvr3Izs7GxEmTAQB/+fMD2Ld3Dzp37tIY2aRWomYbwmsmasn2fn0Ac+5/QPo/Jyfb48ccb3bu
2I7RY34v/W+z2ZC+/gO88NLLtZb9aNsOPPbEk1c203TFsRwQNW0+A4tHv9mHEpcMcfHJiG3THrFt
OyIuoRPi2nZ0/x/fHtGxyYiKT4L6y0+vUZavnH1792DYkIG4rmdX9O/TE4vefAMAMGLoELz91pvS
fE6nE+0S4vHF558h88IFtE9sA4fDgXNnzyIqTI/X/m8+ktrEYtTwG3H61CncfttN2Ji+vtb2PJY9
dxYRxmCsWPYOxt95O7qktMOiN9/Aglf/g7vuuA09unb0WMfOHZ9g0PV90LVTe3TvkoK1q1dJaevW
rEaHpLbo3aMLnn36b7jl96Px/ntrAQAHD+zHiKFD0Kt7Z/Tq3hlrVr3r9VjU3JecnOw6lz196hTC
DUF44/XXMG7sLejZrRMenvugdMNV13F1uVx4/NG/oHuXFPTs1gk3DroeB/b/r9axuXvKpFrHsa51
1sx3l5R2eOvN16X9crlcSElOwK6dOxpeMKhRNLU6Qc1TcXERXnr+H1j45luYmjoNOp0OGo0Gt429
AytWrcEbr7+Gc2fP1tuO1VVOqsrpmlXvYtKEO9G/T0/MuPcPcF3stX/ixC/4/U23QKfTAQBiYmLx
/vp0/OP5FwHAa/vmqyx/+cXnGNCvN5LbxmHYDYNw6NuDXvf7nSWL0bd3d5hMhbXSLGVleOH55zB/
wWvuYxIYCI1Gg+sHDMTHn+zEvPmvel1nXfmq7xj4ynNzrX+33nY7XC4Xdmzf5jF91coVmDR5CoKC
gwEA0/5wL5a/uxrBF/8nqkt99aiu+lezDbnSbcrHH3+Ivr27IyYyFLPuu1fKj6+6u3b1KnTr3AF9
enXDXx9/pFYvIqIr6aWX5+Gfzz2L3Nwcr+kXLpxHSXEJunbrJk376MMt6NuvP6bePQ17dn/JUVEt
AMsBUdPiM7CoNBghVBro9WHQBQRBq9ZAqVZDrtFABBtQqVKivLICMpms2fXCM5tNmDThTvzt6Wfx
3Q/HsPnD/2Leyy/hyy8+x+Qpqdi8KV2ad8/uL6FUKjF02HCPdag1alRUVMBms+H0uUx8sutzAMDW
j7bjrvETfW5frVbDarVCqVQifdNWLHxzEZ7+2xOIiY3Fxi0f4V//fgUv/PM5AIDVasU9d0/Bc/98
Ecd+/hVvL1mGhx6Yg4KCfGRmXsCD98/GBxs34/sjx5GQkIj9//sGMpkMhYUFGHvrTXho7l9w+Mef
sOXDbfjbXx/HT8eP185PjX1RqVR1LqtUKlFZWQmXy4XNH/4X3xz4Dp99ugubN6X7PK5ffP4Zdu74
BN9+/yN+OPoznn72OWxK31ArL++uWedxHH2ts2a+H3viSaxZtVJa11f79kIIgREjRzWwZFBjaWp1
gpqn/339NZxOJ+4YV3soy41DhyEmJhZffvG5z3bMVzmpKqfmIjM+2LAJe78+gM8+3YU9u78EAEyY
OAn3z56JN99YiKM//giXy4WwsHBERkYBqN2++SrLJlMhpkwaj3n/+T+cPpeJWXP+hCkTx9fqNffx
R1ux8LVXsfXj7QgNDau134cOfYtyiwXj7hxfK81gMMJgMNaa7itfvo6Brzw35/qnUqkw7Q9/xLvv
/jaEtaS4GFs2b8T0GbOkaX369G2M7FEz5Kse+ap/NduQK92m/HjkCA4c+gFHfzqB//73I+zZ/aXP
upuVlYm5D92P1evScOjwUdxw41Ac/v67Rjmm1Dr06NELk6dOxROPPuI1fcf27Rj9u995TFv+zlL8
cfp90Gg0uOPOO7Fu7ZprkVW6ilgOiJoWn4HF8LbtIBMuCOGCM6UzFE/+E5p/zIfmpdehm/cGTvW+
DjuOHMSJnHM4H6C5Vnm+Ir784nNER0fjdzfdDACIi4vH2DvuwPZtH+OuCRNw6NuDyM7OAgCkb/gA
EydPgVzuebhkMhmEEJg0eSpkMplf26+a/5bbbgMAdOiQAofDgdtuux0A0L59CrKz3NvXarU48WsG
xvzO3ZV7yA03QqVS4WxGBvbs/hIpHTviuuv6AACmz5iJwMAgAMCunTsQGhoq3UwmJiXh5ltu9dqb
sua+NGTZyVOmAgB0Oh1GjhqNvXt2+zyuUVHRyMvLQ9p765CXl4vf3XQz/v0f7z1lqvO1zpr5Hj9h
Ik6fOoXvvjsE4OJ3N2kyFApFw74YajRNrU5Q81RQWIDIyKha7XWV6JgYj1593toxX+WkqpxOmDgJ
AKDRaJCUnIwL588DABYsfBMv/OtlfPPVVxh7y+/RNjYKf5o9Azk52V7z46ssf/bpLsTHx0s/ak2e
koqvD3zr0Z7t/983eOLRR7B5638RFxfvdRtmswkGgxEazW/n6bkP3Y92CfHS59zZsw3Ol69j4CvP
zb3+Tb9vJj7btRNZWZkAgA/S3keXrt3Qs2evRs4ZNUe+6pGv+lefy21T5tz/AORyOcLCwpGS0hEX
zp/3WXf37d2DpORk6Zx76223Izo65socJCIvhBD4+3PPY///vsGOT7bXSt+xY7tU/gHg15Mnce7c
WQwfMRIA8Md7Z+DdFcuuWX7p6mA5IGpafHYzzPv5CHTlpTj461HE3zQWiZ27e6TLQoyw2mzQ2GzQ
5GRd1YxeaXm5eQgPj/CYFhoahnNnzyIsLBzDR47Clk2bMGPWbHy0dSt2fPpFnesKC6vdQwQAVr+7
Es8+/TcAwIBBg/Cf+QtqzVMV8Ki6CQ4M+u1/p9MpzffeurXYsD4NTqcTMpkMNpsNLpcLReYihIWF
S/PJ5XLExccBAIrMRcjNyUHXju2ldKvVitvHjauVt9ffXOSxL76WraLXG6S/g4NDkHHmjM/j2q17
d6St34ili9/GU397AikpHfHSy/MwaPAQr8eviq91VqnKd4hej9vG3oE1q1aiR4+e2Lp5Mz7evtPn
+qlpaaw6QS1DREQkcnNz4HQ6vf6gkJOdjYiISOl/b+1YQ8pJSHCI9LdCoZDKplwux8RJUzBx0hQA
wLGjR/HPfzyLO2+/FV/vP+Q1z3WV5cKCQo/ehHK5vFZbOP0P06BQKBARGVFztR7HxGw2oby8XBqi
/cKLL+OpZ/4OAOjasT0cDketkQd15cvXMfCV5+Ze/9omJGDY8BFYu3oVnnjyKaxauRyz//RA/QtS
qySTyTzOWVVsNptH21RXW1Jf/fPlctoUY7V0pVIJp9OJsrKyOuuuqdAEozHUYx3h4eEgupqCgoPx
n/9bgEfmPoSD3x+RpldWVuLrffuwYuVqadryd5YgNycH8TG/lXVLWRm+2rcXg4fccE3zTVcWywFR
0+EzsOiSyRGiVKJTSCicP9ceqiSDgFouQ0ywHvV0fmxyomOikZ+f5zGtoCAf0dHRAIBJk6dg2dIl
SG7XDm3btkXnLnU/iL2u3orjJ07C7266CYB7yEtpSekl5fXDrZvxyr//hS/3fY22bRPgdDoRHe6+
GQ4JCUFpSYk0rxAC2VnunjFx8XFo36ED/nfw+1rrLC8v98ibzWbz2Bdfy1YF9PLyctG2bQIA9xu7
jKHGeo/r0GHDMXTYcNhsNix++y33s4HOZfrc//rWWT3fAHD3PX/Avffcjd///mbExcWhW3fPgDg1
f1ejTlDLMHDgIChVKqz/4H1MmXq3R9q+vXuQm5sgp9S3AAAgAElEQVSDYSNGwOlw37x7a8d8lZO6
nuUDuB8kvm/vHoyfMEma1rVbNzz1zN9xw8D+0lD/6nyV5cioSI+2TwiBn44fR4eUFGnalo+2YcGr
/8EDc2ZjXZr3nn/X9ekLg8GI99auwYxZ7he1hOj1CNHr69wXX/nyxVeeW0L9u2/GLPztycdx8y23
4UzGGdw1wfdjT6j1io2Nw8kTJzBg4CBpWklxMc5mZKBN27Y+l73U+lffsg1pU7zxVXfT3l+H4uIi
j2k5OXW3k0RXym1j78C6tWvwrxf+CZVKBQDYu2c3evbqJT331mq14r11a3HwuyNITEqSll305htY
uXwZA0otAMsBUdPgMxqoUGuglCuhU2ug8jKsLLhNEiCTozk+o3nosOHIy82TXupx7txZfLhlC267
/Q4AwC23jsWxo0exdvUqTLl7WoPWKZfLoVAoUFxSDMA9tC4qKhpRUdG1fs31R5G5CKFhoYiPbwMh
BBa8+h/IZDJYLBZcP2AgfvzxCI4fOwYAWLl8GSyWMvc+Dh2O7KxsaR/LLRY8eP9sHD78fb1587Vs
ldXvup9laDIVYteOHRg2fITP47r63ZWY+9D9cDgcUKvV6NGjp9cHfNc8jvV9V7XyPmw4dDodHn1k
boO/O2perkadoJYhOCQEz/3jBTz68FysW7sa5eXlqKysxH8/+hB/nJaKx5540mPIsNd27BLLicvl
woP3z8HrCxeg3GIBAOTn5+HtN99A797XQavV1mrffJXlkaNGIzc3F//96EMAwJbNG3Hbzb/z+CGl
Q0oKFix8A8eO/Yh3liz2mi+tVot//fsVPP3UX/HOksUoKy2F3W7H999/h8kT70JkZBRCwzzPA77y
5YuvPLeE+vf7m29BpbUSzz79JKZMTZV6gBLV9ODcv+Dll17Agf3/g91ux5nTp3Hf9D+g//UDMOSG
G30u66v+1WxDrnSb4o2vujto0BCcPHFCegTN+g/e9/oSKaKrYf7/vYZ3V67A+fPnALjfAlx9+Ovm
TelISkryCCYBwLi77sJHH27hyztaCJYDosbnM7CoT2gHd9TQfcHhstlgKy1GZW4Oyi9koPDrL2Fz
uXC+xIw8XcA1yO6VYzAY8UH6Jrz0wj9xXc+uGD9uLF546WVpWK5Op8PNt9yKjz/aiomTJjdonXK5
HOMnTMItvx+NN15/7Yrl9c67xiM2Ng49unbEsCED0a59e0ycPAWz7rsXdrsdz7/0MsaPG4sB/Xqj
oCAfXbt1h0wmQ4hej/TNW/HySy+gR9eOGHh9H4SFhaNHj571brMhy0ZHx2Dw9X3Ru3tX3Hb77bj9
jjt9Htdxd94FS5kF3Tp1QPcuKXjmb3/FilW1H5pb8zjW9115W35K6t3IvHChwd8dNS+NUSeo+bj/
wYewaPFSLH9nKZLaxKBNTATmvfwS/vniS3j62ec85vXWjl1qOYmNjcO2HZ9iz+4v0a1zCmKjwjCw
n/u5Y2npmwDUbt98leWszCykb9qK5/7+NBLjY/DqK/Pw/vr0Wr0eA4OCsHL1Ojz396dx9Mcfvebt
7nv+gDXr0rBp4wZ0aJeAuKgwzLrvj+jatRu+PvBtrRe4+MqXr5et6PWGOvPcEuqfQqHAH+6djk93
7cR9M2Z7pDmdToQbghBuCMKe3V/iySceRbghCI89MreRckuN6cGH5mLuw4/i/jkzERcVhpt/NwoJ
CQl4f316vc999lX/fvn5Z4825Gq0KTX5qrttExLwyvwFSJ00AV07tcfBA/tx/YCBfDM0XRPx8W3w
t2eeRcaZMwCAHZ9sx+gxvwWUVix7B3d66VkeExOLnr164711a69ZXunqYTkganyy0gp7nWf+NeNu
hO70r4gL1kMdEgJtRCjsBSbAXgGZtRJ2pxPZlZWI16gR2CYZHdJ2Xcu800U1nyXWq3tnvDJ/gccv
NVfSubNn0bVTe5hLK5rs28DfXbEc27f/Fx9s2NTYWaFGcK3rBDU/zaEdIyIiaq0KCwuQGB+DfHMp
tFrtVd3WkrcX4YsvPkPa+o1XdTvkP5YDoqZv5CNrfPdYlDmcUMOFGJUMxopSKM9mQGcpRZDDiWCl
EuFaLXrpjYjR6hBst12rfFM15eXlSGoTKw1P2f3lF8jOzkbv665r5Jw1npycbMz/z7/x57kPN3ZW
qBGwThARERERERFdfS+Oi/cdWEy89S4onE4EKhTQymQIlskQLAMCXS4EuFzQOJ1QuOxwOFxwBIX4
WhVdJTqdDm8veQd/ffwRdElph8cf/QtWvrvG462nrclLL/wTg6/vh5mz5vBBvK0U6wQRERFRy3DD
oP5YvOitq7b+227+Hea/8u+rtn66MlgOiJo2n0OhXS4XDr/9H8R+uQMizAiEhEIWEgplqAEICIYi
IhKKQD1U+hAo4pOgjoyua1VERERERERERETUQnyz9wvfgUUiIiIiIiIiIiKimr7Z+4XvodBERERE
RERERERE3jCwSERERERERERERH5jYJGIiIiIiIiIiIj8xsAiERERERERERER+U1pq7A0dh6IiIiI
iIiIiIiomVGGGvWNnQciIiIiIiIiIiJqZjgUmoiIiIiIiIiIiPzGwCIRERERERERERH5jYFFIiIi
IiIiIiIi8hsDi0REREREREREROQ3BhaJiIiIiIiIiIjIbwwsEhERERERERERkd+UK1Ysbew8EBER
ERERERERUTPSpk0SlCkduzZ2PoiIiIiIiIiIiKgZqSgv51BoIiIiIiIiIiIi8h8Di0RERERERERE
ROQ3pbeJVqsVx37+BQUFBXA4HNc6T0RERERERERE1MIolUqEh4WiU0pHBAbqGjs7dAXUCixarVbs
/epr2Oz2xsgPERERERERERG1QA6HAzm5eTCZzLhh8CBotdrGzhJdBpPJVHso9LGff2FQkYiIiIiI
iIiIrgqb3Y7jP//c2NmgyxQaGlo7sFhQUNAYeSEiIiIiIiIiolYiv6CwsbNAVwBf3kJERERERERE
RNeWTNbYOaAroFZgMTwsrDHyQURERERERERErUR4WGhjZ4GugFqBxU4pKVCrVI2RFyIiIiIiIiIi
auHUKhU6paQ0djboCqgVWAwM1OGGwYMQEx0FpbLWS6OJiIiIiIiIiIj8plQqER0dhUEDByBQp2vs
7NAV4DVyqNVqcV2vXtc6L0RERERERERERNRM8OUtRERERERERERE5DcGFomIiIiIiIiIiMhvDCwS
ERERERERERGR35Rf7dvX2HkgIiIioibC4XCgoKAAFRUVUCgUUKlUUCqViIiIaOysEREREVETct11
13l/eQsRERERtU5msxmVlZUIDg5GZGQk1Go1CgoKYLVaodVqGzt7RERERNSEMLBIRERERBIhBIKD
g9GhQwdER0dDqXRfLpaXlzdyzoiIiIioqWFgkYiIiIgkGo0GGo0G/8/efcc1ee1/AP8kJBDCBhkK
TkBAwElREcVRZ7Xaar1trW3t7VW7772/2tt929txO2/3sLW1tdaqrW3d24LiXkUFB4pWluy9Ief3
R5pIQhISiBDg8369fAnkGec53+85z8nJ8zzx8/ODu7s7APXt0TKZDCqVqp1LR0RERES2RLJjxw6h
+UUIofM/6ZJIJDr/62P9WQ/rumthvK2Hddk6rL/OhzG1HYyFbTAUB2MxISIi6uwajzs4FjHN2FhO
e8WiSqWCEAJCCH4abYRUKoVEIoFEIoFUqvuF2qw/62Jddy2Mt/WwLluH9df5MKa2g7GwDabiQERE
1FVxLNI8Y2MIGaCuwMb/ODtrmEqlglQq1Vag5n/Wn/WxrrsWxtt6WJetw/rrfBhT28FY2AZjcSAi
IuqqOBYxj7ExhExTcUqlEgMGDICHhwcHGEaoVCoUFRUhJSVF5wHmrD/rY113LYy39TRXl3Fxce1Y
uo4jISGBudhJsH+xHYyFbTAUBzs7u3YuFRERUfvgnJj5DI0hpFIpJFu3bhUNDQ0YOHAgnJyc2rmY
HUNFRQVOnTqlHYSx/m4c1nXXwnhbj7G67NmzZzuXrGNIT09nLnYy7F9sB2NhGxrHQfPN30RERF1N
fX09xyIWajyGsLOzg1Rz/zgr0HxOTk5N7r9n/d0YrOuuhfG2HkN1yUlF8/Xs2ZO52Mmwf7EdjIVt
aBwHIiKiropjEcvpjyFkmkEdvw3OMpp60/zM+rtxWNddC+NtPfp1SZZhLnY+jKntYCxsQ+M4EBER
dUWcE2uZxmMIGd90tpyhryWnG4N13bUw3tbD+msd5mLnw5jaDsbCNrDuiYioK+OcWMtp6kza+Bcy
HwfDbYd13bUw3tbDumwd1l/nw5jaDsbCNrDuiYiIeD5sicZ1ZrUnNR87dgyHDx9Gbm4uhBDw8PDA
4MGDMWbMGJv6prny8nK89tprCAsLw7333ttm+y0qKsJbb72l/V0mk8Hd3R3h4eEYO3YsFApFs9vI
yMhAVlYWoqOjLd6/EAKHDh3C0aNHkZeXB7lcDh8fH4wePRrh4eEWb8+aZbO2r776ChcvXsSjjz4K
f39/7d+3b9+O+Ph43H777QgLCzMrD6x1XM3lXeP8iIuLw5QpU7SvrVixAmfPnoW9vT1efvnlG1aG
9mobrfXOO++goKDA4Gv+/v549NFH26QcltafLbWZ1riWV4Q7H31d+7tcLoOftwdio8Jxz20T4KRU
oLC4DLcv+g9GRYXjtSX3m9yeJcvaGnP6eUvyxNKcys7Oxs6dO3H16lVUVVVBqVQiPDwcU6dOhYOD
Q6uPr6Ws0be0V3tpz5jq7xsAnJ2d0adPH0yfPh1ubm4tPq6TJ09iy5YtqK2txZQpU7BhwwZtmWz1
XHAj68Nc1qobW61jIiIiah1D4xUNZ2dnPPfcczd0/+01ZrbKxOLmzZuRmJgIV1dXDB06FAqFAhcu
XMCOHTuQmZmJe+65xxq76RS8vLwwcuRIVFVVITU1FQkJCTh79iwefvjhZt/47dmzB6WlpS1Kko0b
N+LgwYPw8PDA8OHDYWdnh1OnTmHlypWYM2cOhg0b1tJDanXZrG3o0KG4ePEizpw5ozOxmJKSAplM
hsjISMhkMsyfPx8uLi4mt9XWx2VnZ4czZ85oJxbr6+tx8eLFNvm6e4VCYVad2Jpx48ahuroaALBl
yxbI5XJMnDgRgLrztlW21GasoYevF26fMgrlFVU4knQBP2yIx4HjKfjstcfh4uSIV5+8D14eru1d
zDZhqp+/Ue2strYWy5YtgxACY8eOhYuLC86dO4fDhw+jtrYWc+fOter+2lp7t5f2iKmGp6cnhg8f
DiEEsrKycOrUKRQVFeGRRx5p8bOAjhw5gvLycrz00kuws7ODm5tbh+n7b0R9mMtase6o51siIiIy
j2bs2JhcLr/h+22vMXOrJxYLCwuxf/9+ODs744knnoBSqQQATJo0CQkJCfDw8IBKpYJUKkVGRga2
bt2KjIwMODo6Yvz48YiOjkZJSQneeOMNREdHw87ODsePH4eTkxOmT5+OAQMGAECz60ZFRaGoqAhl
ZWX4xz/+gbNnz2LHjh3Iz8+Hm5sbxo0b1+rJM2twc3PDqFGjAAATJkzA2rVr8fvvv+PgwYMYO3as
0XK/++67yM/PBwA888wzeO6555Cenm7WMRYUFODQoUNwdXXFY489BkdHRwDqK+NWrlyJsrIyAM3X
sbH4GCpbcXGxRfGypoiICPz6669ITk7G5MmTAQD5+fnIzc1FZGSk9gqT7777Tnu1gKFyqVQqneNa
sGABli9fjuHDh2PWrFkAgC+//BJpaWl45ZVXIJPJWp13fn5+yMzMRE5ODnx9fXHhwgXU1dWhR48e
2rIAMLmf7OxsbN68GRkZGVAoFBgyZIh2og1QT15u374dBw8ehFKp1MaxurraYJ20pF0C6quYExIS
UFxcDKVSiWHDhuHmm2+2+iRp4/rdtm0b5HK5to2ZKmPjmDc0NOD06dPw8vLCXXfdhT179iAlJQV+
fn6455574ObmhuLiYrz55puIiIiAnZ0dUlJS4OjoiFmzZiEsLMxg2Sxpz8baTFvWZWt4e7lhzrTR
AID75kzEax//gF2JJ/HztkRMGxeN59/5VucqxM17jmD1xnhcyyuCm4sTpo6NwoI7JjXZ7qETZ/Hs
W8sxOS4K/3portH1bKkuTPXzUVFROu0MMB5ffefOncOKFSswdOhQzJkzR+e1oqIiVFZWYsCAARgz
ZgwAYPDgwQgODoanpycAmNWmjeWsOfnf3HEY63sA9Xlq48aNSEtLg0QiQa9evXDLLbfAz8/PYHs5
d+5cm7aJ9oiphru7uzamgDrW6enpKCwshEwmM3hONVWfn376KdLT0wEAL730EqZOnYqtW7eavHrO
Fvp6c+rDy8vLovHiAw88YNF5QP882dzxG3vN0HZMxcycttsRzhNERERdReOxo75PP/0UGRkZePbZ
Z7UXwrz77rsoLS3F888/j5ycHKvNy7TVmLnVW7t8+TKEEBg8eLB2UrGmpgYVFRWIiopCYGAgVCoV
ysvLsWzZMpSUlGDhwoUYPHgwfvnlF2RmZmpvlf7999/h6emJO++8ExUVFVi3bp3Z654+fRo9evTA
lClTUFZWhlWrVkEqlWLx4sVwc3PDunXrkJeX19rDtSqJRILY2FgAQGpqqsly33333ZDJZPD29sZD
Dz2E+vp6s4+xcYw0k4oAoFQqsXDhQowdO7ZV8dEvW0NDg0Xxsja5XI6IiAjk5eUhNzcXAJCcnAwA
GDJkiMF1DJVL/7g0+W2MNfKuV69ekMlkOHPmjLbcPj4+cHW9fqWXqf3U1tbi66+/Rl5eHubOnYuI
iAjEx8dj37592vUvX76MqqoqjB07FiUlJdo4GquTlrTLgoICrFu3Dj179sSiRYswevRoHDhwAOfP
nze7LqzB3L4jODgYsbGxyMnJwRdffIH+/fsjLi4OGRkZSEhIAKC+BRJQX/kaGhqKhQsXQgiB1atX
o6ampsm+LWnPptqMrdSlJSQSCebeon7jf/TUhSavZ17Lx9tLf0RoYE989PLDmHvLGKzbmoiDJ87q
LHfpajZe/uB7RA3qjycXzjF7PVui38/rMze+2dnZ+OGHHxAcHIzbb7+9yXa8vLzg4uKCs2fP4ocf
fsCxY8eQn5+PqKgo9OvXD0DzbdpUzjaX/+Ych7G+p66uDl988QXS09Nx2223YdasWUhPT8eKFStQ
X1/fpL1UVla2a5toq5gaozkXNTQ0GDx3NVefs2fPhq+vLwDgoYceQkhIiMn92Xpf37g+LB0vWnoe
0Gfq+C2pm+Zi1lzbtYU4EBER0XV1dXUoKirS+VdVVQVA/eG/EAJnz6rfw+Tm5iI/Px8RERGoqamx
2rxMW46ZtVcstvT2EU3luLm5abexdetWHD58WLvM/PnzUVVVhZqaGowbNw4BAQHw8/PD3r17cfz4
cUyYMAEA0K1bN4werb7iJTAwEGfPnkV5eTlSU1ObXdfNzQ233HILAPXE5sMPPwxnZ2e4urpiwIAB
SEtLw7Vr17RvsCQSiVVvmWluW41fb/yzu7s7AKCyshIODg5Gyz1w4EAAgIODA3r37m3yGH18fHT2
rblN1MXFxWg5z58/3+L49OjRQ6dsx44dsyheljInbkOHDsWJEyeQnJwMX19fJCcnw9nZGaGhoTqx
1/ys+d1QuTTHlZWVZbQMEonEZPyayzvN3+zt7REcHIzk5GSMHz8e58+fR3R0NLKzs83aT05ODsrL
yzFx4kSEh4cjJCQE/fr1g7Ozs3Yfjo6OuO222wAAaWlpSE1NRXl5ubaj0q+TlrTLmJgYAEBeXh7y
8vIQERGh3YalWtJONeuYk9fe3t4YOnQoysrKEB8fD3d3d0RFRaGqqgq7d+9GXl6eTn306NFDO0E9
aNAgJCYm4sqVKwgICNCpP0vas6k2Y826bEveXuq+ray8qslrDQ3qiez0rDxczczFmOGRmDtdPRFZ
WKy+grqopBzPvPE1vDxc8PI/5sPOTmpyvbZgjX5ev+/RPPTYUHzLy8sBABUVFfj222/h6uqKe+65
x+Bzi+VyORYtWoSdO3fiwoULOHXqFAB1+505cyaCg4ObbdMKhaLZPsxY/nt5eTV7HMb6nj/++AOl
paUYP348hg4dCkB9hdyBAweQlpamnfjStBfNhzVt0b+0Z0w1262rq0NxcTGEEEhPT8elS5fg4eEB
b29vVFZWAtA9d506darZ+rS3twcA9O7dW1sm/b5f87OpfrQt+3pz6uPEiRMWjT80x27pecCcWJvK
U/06P3funMmYaR7rYqztmioHERERmcca80OabaSnpzd51uL48eMxadIkDBo0CJs3b8bZs2cRHR2N
lJQUAOo5DGvOy1hzzNycVt8KrfmkuKSkRPu3UaNGITw8HOfOncOBAwcAQDv43bVrF/bs2QNA/YUi
jb90QTNQB6D9MpO6ujqz1tW8qdFISEjQTnxoBlwNDQ2tPVyrKyoqAnD9WXCWlNvcZQ3FSENzm3pr
4qOvJfGytsDAQLi5uSElJQVRUVHIyMjAyJEjm73kt7XlskbehYeH46effsKpU6dQUVGB8PBw7cRi
c/upqKgAAO1zm2QymfbLeTRvZBpPPGvyrq6uzuiXLLWkXXp7e2P69OmIj4/H2rVrAQABAQGYN28e
PDw8LKqP1jAnFzVXg2qecaqpE83v+ldzNn4mlpOTE4DrdavP3HzoCHVpqWt5hQAAT/emzxDr5e+D
R++7FavW/4bXP1kNAAgN7ImX/zEfcvmfV8al/gG5XAYJ1JOMjgoHk+v5ettuXej3842Ziq/mOSxX
r17VXjFYVlZmtJ/q1q0b7rrrLgghkJeXh5SUFOzatQurVq3SeVC0sTatUCiazVlj+R8aGtrscRjr
e0pLS5uUS/NFHIbOW7bQJtoqpoB6YPrmm29qf3d2dsbcuXN1zmeN17e0Pptja/2Tqfpo6fjD0vOA
hqnjNycPNJqLmWZi0VjbtYU2QURERNf5+vpi0iTdxzx5e3sDUI8z+vXrh9TUVNTX1yM5ORmurq4I
DAzU3mlojXmZthwfaCcWW/r12v369YNUKsWJEycQFxcHZ2dneHt7w9vbG5mZmdrlNAOk0aNH6zwT
TS6Xa/cthDBYDnPWbXwM+/btQ1JSEqZNm4bY2FgkJCRg+/btOts3tq+Wam5bhsophMDevXsBAKGh
oRaV25xlNQIDAyGVSvH7779j7Nix2jeDlZWV+Pjjj9GrVy/tM3paEh/91y2Nl6XMXW/IkCFISEjA
sWPHIITA0KFDdcrauMymyqV5XfMmrvEb7uLiYu0yrcm7xn8LCwuDVCrFzp074eHhofMFNM3tR/Nm
qLS0VLuvQ4cOwcXFBX369DGrDPp10tJ2GRMTg5iYGBQWFiIlJQVbtmzBb7/9pr1iyVwtyRPNOpb0
O/o5YOx3zZUywPU36c7Ozi1qo+a2GWvVZVsRQmDNRvWtgyOGhBpcZvbUWMyeGousnAIkHkvGZ99t
wspf92ifsxjRvw/+/tfbsPCZD/DeV7/g7WcfNLne//1tdpscl7mvG+vnDbUrY/HVPBu1d+/euPXW
W/HJJ59g/fr1WLBgQZN9X7p0CUlJSRgyZAj69u0Lb29vxMXF4eLFi7h48SIqKiq0fZixNm1OzprK
/+aOw9h+NZM6RUVF2tc1E3dubm4W1Zm1+5f2jKlmW40Hpg4ODujZsyfs7e2NnrvMrU/9Mhvr+22l
rzenPiwdf7T0PGBuLprbJlrSBvTrpqOdJ4iIiGxNS+cnDG3DyclJO8di6PXBgwfj4sWLOHr0KDIy
MrTPj27NvNmNHDM3p9VXLLq7uyM2NhZ79+7FBx98gIiICDg5OSE9PR2pqalQKBTw9PSEm5sblEol
kpOTERgYiNzcXBw5cgRjxoxBcHCwyX0EBwdbtK7meWeVlZW4fPmy9paw3Nxc9OrVq7WH3CrFxcXY
u3cv6urqcPHiRVy5cgU9evTA8OHDsWPHDgCGy11bWwu5XI7CwkKcPXtW++m2sWU1tzkB6uQcM2YM
4uPj8dFHHyE8PBwymQynTp1CcXExxo4da3Ed62tctl69erVqW9YyZMgQxMfHY+/evfD29taZoDNX
4+MKCAiAXC7HhQsXcPHiRWRkZOhcqWatvFMqlejbty8uXbpk8IGvpvYzcuRIKJVKHD58GD169EBm
ZiZ2796NiRMnaicWrcVUzigUCvzwww+YMGEC+vfvDw8PD0gkEp1nfLaF1ua1Ibm5uUhISICXlxeS
kpKgUCjQt29f1NbW6ixnKk767dlUm7GVumxOXkEJ1mxMQHVNLY6dTsXpc5cR3McfM24egYrKap1l
9x9Lxisffo/75kxC9KD+6O7tCalEAmelQruMm6sTgvr0wMxJI/HLtv1IOHQKMplds+vZAlP9vObR
FBqaZyKaiq9SqdSuf/DgQZw5cwYRERE627G3t8fx48dx9uxZREVFwdXVFbm5uUhLS4OXlxdcXV2N
XlmrYU4fZiz/zTkOY0JCQuDm5obDhw+je/fuqK+vx8mTJ9GtWzftLdiN20t1dTV++eWXNm0T7RFT
DWMDU2PMqU9L2Fpfb6o+bkSfb4qpWFvSJpqLmX6OWVIOIiIianuasaO+qKgoKJVK7RfObt++HYB6
ohFo/VimvcbMrZ5YBICpU6eiW7duOHz4MI4fPw4A8PDwwKhRozB69GjtJ7ELFizA5s2bsWLFCjg4
OCAyMhKRkZHNDpgcHR0tWjcmJgZXrlxBYmIiLl68iDvuuAM//fQTEhMTmzx/sK0VFhZi69atkEgk
cHV1RUxMDCZOnAiZTGay3EFBQYiJiUFCQgJ++uknzJs3D9nZ2UaXDQwM1Nnv5MmT4eXlhUOHDuHI
kSOQyWTw8fHBLbfcon0z09L4ANAp28MPP9yqbVmLj48P/P39kZmZibi4uBZtQ/+4brvtNmzbtg0r
V65EdHQ0QkNDcerUKahUKqvmXUREBC5dun8q9twAACAASURBVKS9jVm/TKby5IEHHsDmzZuxZs0a
ODg4IC4uDmPHjtXeImYtptqlVCpFTEwMDh48iJ07d8LR0RE33XQTxo8fb9UytKaMLc3F/v37Iycn
B7t27YKTkxNuv/122NvbN5lYtKQ9m2oztlKXzcnKKcBnKzdBKpHAy9MVs6fG4oG5k+FgL28ysThi
SBhunxKLn7cl4qvV2+DqosS08dG4b85EVFbpfhHOA3MnY/f+k/jo2w1Y/s7/GV3Plpjq5/WFhIQY
ja9+Tk2cOBFJSUnYuHEjgoODtbdpAkDPnj2xYMECxMfH4+jRo6iqqoJSqURkZGST2zCMMacPM5b/
lhyHPnt7ezz44IPYuHEj1q5dC6lUiqCgIEyfPl1bZ43by0MPPdTmbaI9YtpS5tSnJTpCX29OWW/E
+MNUrDXjOnPyoLUxM1UOIiIianuasaO+sLAwKJVKODg4ICQkBMnJyfDz80P37t0BtH4s015jZsmm
TZtEfX299hsOyTyJiYnawR7r78ZiXXctthrv8vJyvP766wgLC8P8+fPbuzhm0a/LmTNntnOJOpb1
69fbZC62h46Y/4bYav/SFTEWtkETB2tMahMREXVENTU1HIu0gGYMYW9v3/pnLJIa66/tsK67FluJ
tzWeD0odW1eOe2fN/850LB0dY0FERETtiWORltNOLBr7xjsyD+uv7bCuuxZbibemHEIImykTta2u
HPfOmv+d6Vg6OsaCiIiI2hPHIi2nnVhsaGhoz3J0eKy/tsO67lpsJd6Ojo546aWXANhOmahtdeW4
d9b870zH0tExFkRERNSeOBZpOV6xaCWsv7bDuu5aGG+yFczFzocxtR2MBREREbUnjkVaTjuxWFdX
157l6PBYf22Hdd21MN5kK5iLnQ9jajsYCyIiImpPHIu0HCcWrYT113ZY110L4022grnY+TCmtoOx
ICIiovbEsUjLySQSCSQSCerr69u7LB2Kpt40P7P+bhzWddfCeFuPfl2SZZiLnQ9jajsYC9vQOA5E
RERdEefEWqbxGEI7scj7yS2jPyBm/d04rOuuhfG2Hk4stg5zsfNhTG0HY2EbOLFIRERdHefEWqbJ
xKJUKuXsrIWkUqm2Ell/NxbrumthvK1Hvy7JMszFzocxtR2MhW1oHAciIqKuiHNiLdN4DCFLTExs
5+IQEVFbOHjwYHsXgYiIiIiIiDqJuLg4SIQQor0LQkRERERERERERB3Hzp07wXvjiIiIiIiIiIiI
yGKcWCQiIiIiIiIiIiKLcWKRiIiIiIiIiIiILMaJRSIiIiIiIiIiIrIYJxaJiIiIiIiIiIjIYpxY
JCIiIiIiIiIiIotxYpGIiIiIiIiIiIgsxolFIiIiIiIiIiIishgnFomIiIiIiIiIiMhinFgkIiIi
IiIiIiIii3FikYiIiIiIiIiIiCzGiUUiIiIiIiIiIiKyGCcWiYiIiIiIiIiIyGKcWCQiIiIiIiIi
IiKLWTSxWFlZiS+//BJr1qzR/vv555+RlZV1o8p3w125cgUzZsxo8vcJEyagoKDA6HpHjhzB3//+
91bv//XXX8fGjRtbtG5NTQ0SEhLw/fffY/Xq1fj5559x5cqVVpfJHJmZmdi2bZvO34qLi7Fq1aom
y3777beorKy0aFstsW/fPpw/f97i9Qzl9e7du1FTU9PqMlmiM9WfLfcLHbWeiYiIiIiIiGyNzNIV
7O3t8Ze//EX7e05ODrZv34758+dDIpFYtXBk2q5du+Dp6Ym77roLUqkU+fn52Lp1K5ycnODt7d3e
xetQGue1EAKJiYk4efIkRowY0c4l6xjYLxARERERERF1PRZPLOrz9fWFSqVCVVUVlEolkpKScPXq
VahUKnh4eGDUqFHIycnByZMn4e7ujpKSEiiVSnh4eKCwsBAlJSWYMmUKFAoFjh07hszMTEilUri7
uyMmJgYbNmxATEwMfH19AQCbN2/GwIED0bNnT4P7srOza3WlNHbo0CF8/fXXCAgIQFVVFaqrq/Hq
q6/qLLN06VIcOXIEMpkMvXv3xpIlSyCVSvH666/j6tWrqK+vx4ABA7BkyRKoVCq89NJLSE9Ph5eX
F1QqVYvKlZeXh9LSUkybNk07cdOtWzfMnj0bjo6OUKlU2LdvH0pKSqBSqeDt7Y1Ro0YhKysLv//+
O9zc3FBdXY3KykpMmTIFcrkcR48exdWrVyGRSBAWFoawsDAAMFjPLZGRkYGTJ0/C1dUVdXV1qK+v
x/jx43WWMZQDEonE4LEIIRAfH6/NKSFEi8qlTyKRICAgAOfPnzdaj+np6UhJScHkyZMBAAkJCejR
owcCAgKwZ88eqFQq1NfXIyQkBAMGDABguB4tydeOUn+Aef1CbW2twboyVrdOTk5m9SNdqZ6JiIiI
iIiI2lOrJxYvX74MhUIBR0dHZGdnIysrS3tr8b59+3DhwgV4eHigqKgIU6dOhUQiwTfffIOgoCAM
GjQI+/btw9WrV+Hs7Iz09HTMmjULEokEu3fvRmpqKoKCgpCWlgZfX19UVVWhqKgI/v7+RvelmQyz
FqlUiosXL+KDDz6Ao6Mj3nzzTaxfvx5BQUEA1BMMBw4cwPLlyyGVSvHss89iy5YtiI2NRVBQEF54
4QUAwN13340LFy4gJycHubm5WL58OWprazFnzhyMGzfO4nIVFRXBx8enydVgSqUSAFBVVQVPT0/E
xcUBANatW4eCggJIpVIUFBRg0qRJkMlk2L17N9LT02Fvb4/s7GzcfvvtqK+vx/bt2xEUFIT8/HyD
9ezq6mpxmSUSCQoLC7UTmYmJiTh//jw8PT0BAFlZWQZzoFevXgaPpby8HBUVFZg1axYaGhqwdu1a
9OnTx+Jy6VOpVLh8+TJ8fX1RXV1tcN/GXL58GZ6enhg5ciQaGhqQkpICAFbJ145Sf5p6aK5fEEIY
rCtjpFJps/2Ii4tLl6pnIiIiIiIiovZk8cRibW0t1q1bB0D9bDU3NzdMnjwZEokEWVlZKCoq0j4z
sK6uDgqFAh4eHvDw8IBUqn6ko4ODA7y8vAAACoUCNTU1qKysRI8ePbQTZd27d0deXh6GDRuG9evX
Y+TIkUhLS0NgYCCkUqnRfVmTpiyhoaFwdHTU/nzq1CntxOKZM2cQFRWlPbahQ4ciOTkZM2bMQElJ
CR555BEoFArk5+ejuLgYqampGDhwIAD17aODBg1qcflMXe3o6OiImpoabN68GTKZDJWVlaiuroad
nR3c3d0hk8l0lisuLkb37t0hkUggl8sxffp0ADBaz5ZOLDa+qlIul2t/zsnJ0U7Y5ObmGsyBkJAQ
g8dSWFiovZLVzs5O+3NLNM5rIQT8/f0xcOBASKVSg/s2xt/fH6dPn0ZtbS0CAgK0Vyu2Nl87Uv2Z
2y/079/fYF2Z0lw/UlZW1qnrmYiIiIiIiMiWtOgZi7NnzwYAXLp0CSkpKXB3dwegftPcr1+/Js+l
u3btWpMr68x97ppSqYSrqytyc3ORlpam3baxfVlKqVSiuLgYQghtmWpra1FeXq69+q/xBJ5KpWq2
7BKJBJs3b8aFCxfw0UcfQSqVYuHChQCgsx8AaGhoaFG5PT09cfToUTQ0NOjc5pmfnw+lUon09HQU
FBRob5Vu/AUxmokZDf0yNWasnjMzM5ssK5fLUV1drbO9hoYG1NbWaidpGt8Gamq/jV24cMHgsejf
UtqaW0wb53Vj58+fN1qPhvbt5uaGOXPmIDs7G2lpaUhKSsJtt91mVr52lvozt18AYLCu9DUuV3P9
SGevZyIiIiIiIiJbYtG3QusLDAyEXC5HcnIyAMDPzw9Xr17VTpYlJSUhLy/PrG35+voiOztb+6Y7
MzNTe2VPUFAQzp8/j+rqau2XkrRmX435+PggODgYP/30EwD1xOGXX36JuLg47ZVO58+fR3l5OQDg
xIkT6N+/v3b9gQMH4vjx49rJx6NHjyIyMhJ5eXno06eP9lbq1NRU1NXVoV+/fjh9+jQA9e3KSUlJ
FpcZUF9F5enpicTERNTV1QFQP3dxx44dqKysRGVlJdzd3bW3dRYUFJicxPT19UVGRgaEEGhoaMD6
9etRU1NjUT07OTnBy8tLe0urEALHjx9Hnz59tFdI5ufno7a2FoD69mDNFWeaMhjKAWPH4uHhgdzc
XADqK9OuXbvWoro0xdi+7e3ttVcuCiG0dXL58mUUFBQgICAAo0ePRkVFBerr682qx85Sf+b2C8bq
yljdmqMr1TMRERERERFRe2v1MxZjY2Pxyy+/oGfPnvDz80P//v2xYcMGyGQyODs7IyIiwqyJge7d
u6Nnz57YtGkTJBIJ3N3dERwcDADo27cvDhw4gMGDB2uXN7avlnjjjTfw9ttvY82aNZBIJIiMjMTz
zz+vfT0oKAhvv/028vLyoFAoMGPGDO3k4NChQxETE4PFixdDKpWib9++mDZtGq5du4YlS5bg4Ycf
RmBgIBYsWIAPPvgAn3/+OXbu3In7778fPj4+GDhwYIuvYJo4cSIOHz6M1atXQy6XQ6lUYty4cejW
rRscHBywY8cO5Ofnw8PDA0OGDMHhw4dx0003GdyW5otHfv31VwghEBoaCgcHB6P1bGxy5Oabb8b+
/fu1k0q+vr4YM2aM9nVPT0/s378flZWVkMlk6N+/v3bSxVgOlJeXGzyW6dOnIy0tDb/++iucnJxu
yC2mQUFBRvdtb2+PnTt3wsHBQXt1nru7O/bu3QupVAqVSoWBAwdCLpebna+dpf7M6RdkMpnBuvLx
8TFYt+boavVMRERERERE1F4KCwshEbwvz6QjR45g1apVeP/999u7KB1eZmYmTp8+jSlTprR3UTok
1l/bYD0TERERERERNW/nzp2tuxWaiIiIiIiIiIiIuiZesUhEREREREREREQW4RWLRERERERERERE
1CKcWCQiIiIiIiIiIiKLcWKRiIiIiIiIiIiILMaJRSIiIiIiIiIiIrIYJxaJiIiIiIiIiIjIYpxY
JCIiIiIiIiIiIotxYpGIiIiIiIiIiIgsxolFIiIiIiIiIiIishgnFomIiIiIiIiIiMhinFgkIiIi
IiIiIiIii3FikYiIiIiIiIiIiCzGiUUiIiIiIiIiIiKyGCcWiYiIiIiIiIiIyGKyjMKq9i4DERER
ERERERERdTAyF7lje5ehU8rOvIru/r24X2oXjAcBzANSYx5QR8A8pRuFY2O6ERjfzo3xtS2MR+u0
Rf3xVmgiIiIiIiIiIiKyGCcWiYiIiIiIiIiIyGKcWCQiIiIiIiIiIiKLcWKRiIiIiIiIiIiILMaJ
RSIiIiIiIiIiIrIYJxaJiIiIiIiIiIjIYrL2LgABDap6ZF3LQXpmFqrq61FTK4OdSgKFAugZ4Iee
Pfwgt2OoiIiIiIiIiIjIdnC2qp0VlZYgLf0qXF2VGBwRDIVMCWFnj9rKOpRWVOBKRj7+uHoaEQP6
wtvDvb2LS0REREREREREBMDErdBXrqShb29PBPXzRn5+nvbvx44eQt/enkhI2K3zM1muuLQEWdcy
ER4UgKgBgfDwcEeNsEd9NSBUcrgq3DGgTxB6ePbFmXMZyCsqae8iW+zOv8zAqJEDdf721pv/QWDf
btiyeb3J/Nm6ZQPOnU1u8b5N5ecPq77FhHHRCO3fHcOGBOPvjy9ERUV5l8lpY+3bFMaj82nvfr5x
Tll7P/sTE9C3t6f2X2R4bzxw/1+QmZlucr2udo4z1vaA1rd5a2sc0/5Bvhg/9ib8+8WnUFp648+N
XSEXbN3Vq1fw0OL7MCiyL8JC/DFzxgTs3r3dattvq/7I0ty1tXZI1mNqLKYf99bkgTXy+T8vP4sB
oQFN/h4bM0jnXKv599yz/2zxvjqL9h5jWQv7oKasMXZivVoH+6DWsebY2ujE4ob16yCXy6FSqfDj
mvVQqXRfLysBQsOG4Lf43xEcOAq1tRbvu0trUNXjj+xMhPTtCd9uHgAAmQRADVBfCZSXA1VlQF0t
0M3DHb7uPXH67GXUNdS3b8EtNHPmHGRlZeDwwTPav+3atQ3R0bEYMngK9vxmPH/+859nceZ0Mlp7
yGUl0Nl+6oVzePaZfyAubjK+//43/OMfr2HTpl/wv3feRURk18jp5tq3IYxH52NOP19Xd/1na8eg
cU5FDrwxsV648F9YunQDlix5E4cPH8SS//u7WfneFc5xptqeENZr89a2cOG/8N57qzFx4hysWb0S
8++5AyqVuKH7vFH5Seapq6vDffPn4PCh/Xj00efw6qtfwM3NB4sXzsfx4yetso+26o8szV1bbYfU
eqbOwfpxt0YeWOM8XqD3WfRHn3yFL77YgLlzHwQAvPzyp1i6dAPmzH4Ef86zdFmd5b00+yBd1ho7
sV6tg32QdVhjbG10YnHTpl8wfPgYREQMw44dP6O2pukyp0+dxLixg3EhdT8gavH0v57AkEGBGBTZ
F/9+8SkIIVBbW4unljyGwQP7YUBoAB5+6H6UlZVafLCdTVZOARQODvDydMEf2XlY+vMufL91H2Ty
Knh5A917APFnj+DzTetx6HwSBoS4QKlwQlZOTov29967L2n/taWp026FXC5HQsI2NNQD6el/IPXC
OUyaPBsXUk9i/Dh1/pw4noi+vT3xxn9fQnhYT4SG9MC17CwsWbIYn376PnZs34y+vT2RknwagO4n
p7W1hnPPmOxrWQAAD48eCA0LxV13z8XexBQ89NCLOHb0ek7/sOpLnU8+Bkb00W7jq2WfYnj0AAwZ
FIgn/+8R1FRX37hKvAFMte/vVy5H3OihiBjQCw8tvg9lZaUYO2YY49EJmdPP61v30w8YP/YmDAgN
wMwZE3D8+BHta4Zyx1g+6OdU4/OJvdz4fg4dVPcVn37yHkaOiMDQwUH46cdVRssbGBiG2NGxuOvu
OxEbOw5nzyahvNT0cWjol8nQ8T1w/19w8/jh2nUeeXgB4kYPNZnztsJU29OPD9B8TDT9d0bGVYMx
V6lUeOH5JxEZ3htTp4zGU0seQ1iIv7Y85rbjwMAwjBs/Dk8+9S88/sRzOJV0DDu3J5hVxvffexNR
Q/tjxPBw7N61DbNuvRkRA3rh44/eBWC8/2qcC5rzlbk5SK23a+dWXLmShqeffgdz5jyIW6bfgqVf
rMSSJa9BYd8N+xN1czA355rBfLKF/shQ7ppbLoDnu87E2DlYP+76v5saZxk6T2mkpKjH3fp5aiin
VCoV/v3iU4gM741bpsUhOzvT4DEMGRKFcRNiERTUFwAQHj4McWNjEREZiC1bmj/PdmaWvpeW2Rk/
R5rqa8w9vwGGY21q24b6oK7OkrGTuX17c++rOJdinLE+6IMPnsWtM5qOzzVX6L3876cxLi4KNw0L
wY9rv9cu11XPsabG1sbGU43zEjAysXjh/FmkXjiHmyfOwpQptyEp6TCuXs0yWpDyMuD8+VTYSe2w
9Iuf8dZb32LFt8uwZ/de7E3YjR/Xfo/vVm7Hhg0nAeGAo0dOoQO857qhrmaUYmD/nli76xAWvb4M
DSqBo2dTseTT5ZAo6rHp4H7EnzqC4EBnrNq1FQlJxxE3vC8yrxW1aH/Dhg3DsGHD0Lt3b7hd/QV2
KWsgt6vEtatncCZhDc4mrsPZxHXI/uO00W245SXCLS/Rov26u3tg9Jjx2Lt3G2pq1FcryuVyjI2b
AblcvUx5GSCE+nGfp5KSsXrNLqz87jcAwIsvfoS/zH1MezIuLoLOJzsFeUDaJcO5Z8zw4aMQHj4I
//vfc5gwPhx///tfceJ4Ijy8AIXieplm3TYP8QlnsHz5Djg6KjF27HQU5gMH9u/Fq688j3ffWYZf
fj2O/Yn78OWXy4AOktOm2vfJk8fw/HP/h3n3LMSqVfE4cvgQ3nn7bXz9zVoAjEdnYmk/DwCnT5/E
kicfxa23/gXr1x+Dk5MHFj44H2VlVUZz55KRfFj+rW5O1fx53i4vA46fML4fmUzdV/x+8jQ2bjyE
/v0j8d/XX9aur0+lUgGox7WcP3D6zAn07dff5HEYUl4GHD1q+PjunrcAly6l4uTxC6ivr8e+vb9h
xoy7UFIkaUFU2paptvfNCt34HD3SfEw0/fcflwshNRDz+PhdWPnd1/jbwn/iv69/g317EyCRSFCQ
Z3k7lskAuRyYMGEcAODcuWScMCNvLqdl4Mef4lFcVIQlTz6ODz/6FmPHTsNHH76D0pK6Zvuvxucr
c3OQWu/ixQsAgMGDY+DkDCgcAUelHRYu/hsCg3tCbq+bg0ePpBjMJ2Pxbav+CDCcuxeMjKH1y/Xb
Hp7vOgtT52D9uH/2ue7vKcmG88XYeVjznuvkyYN4552v4OfXU5unxvrehPjdWPHtMjzy6DN4843v
cCopyeixyGRA4++YlMmBs+dO4l9PmX+e7Wxa8l56127j50hTfY255zdjsZbZGd+2fi5WVd7giusA
LBk7GWur+vVq6n0V51KaZ6gPmn/vAqSlNR2f19Y4AADy88uwceMRDB8+Di++8BQK8su6/HtKQ+OT
vXsN18neeL28hJEvb9mwYR1kMhliRk6CnawK77zzPLZu+QVBQY8YLYiPjx8KCguw5Mm/Qi5XbzYj
PQsjY26Cvb0DFi+6AzGjRmPW7bMQfVMs6usAub21q6PjKCxqQHVdLX7afQhzJ47AA7eqA3jrP9/C
tgNJOH8lC1KJFPfeEof+PXtAKpFAoZChurZl10vX1NRoryDde6oADl7eEAlbAQCjYsIAOyVgr8Ch
+MPISzkGe++e8A/qD7c/jiLDPQQF2RkQddWAXIGB3pbt+9aZs/GPJxbhWnYudu/ahtjYCXBzc0d+
QdNlZ868B316h6Cg6CoAQCaTw83dDvYOxrfv42s495yUfQ0u7+DggF837MKObb/h4MEEHDiwC5s2
/oL77j+G6dNnaJdzdFRCqZTjn/94AD179sa//vU27B2A/fvVs/cPPXQ3JBL1LVqnT51EdbX6zY6t
M9W+E/fFAwAmT7obvn6uOHLsPEqLgbx8xqOzaUk/vzdhF4QQmDnzQfj6ueOuu+7G448/iBPHzuDU
aXUc9HOnorLAYD4E9lPngyanHBTm7cfJWb3MlClz4ODgjFGxo3D4cAJKimvh49f0pPLMMw/gmWfU
P3fv7o8nn/wv9ifuaHb7+vbvjzd4fDK5Cj16BGDXrk2oqo5GeXkZpk27y2QbsRWm2t6Df1sE4Hp8
Dq5pPiaa/ruqpgCFK5vGvKBA3Y/cMu0e9PD3woQJk/Dzz6sBtLwdNzQ0AADs7OwQ/1vzZYyLmwZv
7x7o3bsvunn7w8XZHzdFR2Hz5rXIzSmGt5GxjKH+y9wcpNaTStWfg6tUDZDJdV9TKADpn/P4mhzc
skX9pk0/n2bPvqtd+6PGGueul5fhvNMv17FjPN91FqbOwfI/P3nXxL22Xvd3mb3hfDlzWn1Vof55
6kzyIQDA7bffjwFhwzBx0lR8+MEbKCmuNdH3VgAAJk2cix7+nhg/YSLW/fSD2cdnqj+OG3eTdSrR
hrVkjHX6lPrNuaFzpIahvkajufNbYqLhWA8ZEmV02/q52Lhv7KosGTsZa6v6fbupMWO/wGDOpbTA
uPGTDI7PC4syAADjx88AJFJMmjIRmzevRfKZVBw6zHMsoDs+2W+k37h5whSdvLxjzq2GJxY3bfwF
9fX1mDQpRPu3HTt+xqLFxjvDpUvfQ/xvO7Fz1xnk5eZh9uyREEKgd+8g7Nx9BBt+3YQjR/bioUXz
8fTTr+Bvix6y5vF3OFJJA+rqGwAhENqnh/bvg/r3wcX0bDx0x2Tc/9In6D39UYyIDMY7T9wDAKiq
rmvR/urq6iCEQH19PRz8AjHcpwwNUmfY2QkgLxuQOQB2dhgx0B+Q9QEqqlBVchH1AMKUxUCgMwBn
JCTnWrzvSZOmwcFBgW3b1uPokYP4zyufQCYHJAYu6HFycoaDQj1jriUBJH8uLIT6ASXV1dc/8fz0
E8O5Z+yxAFlZGUhNPY9p02/GzZNuRm3Nf3Dv/Fuwe9c2TJgwQ2fZN/77Es6dS8YPP/wGJ2dHOLsA
9n/2/ps2nYKLi+uf5QLqO8gzMky1b01HIoSAgwKorq6Eg6OA0qnRBhiPTqEl/XxjjkpABc0Dg6So
qzOcO598akY+mLi4T38/9fXq/djbO8DB4fon9Q0NAkI07Vcef/wlREWNhrOzKwIC+kIml+LIkR3N
bl+f0bahdMJf7pyP7ds2oaq6GCNHjoGvb0CHGICYant3373o+oJ6dWqszjT99wcfGo655tN1iUSi
fnMiuZ4ELW3H+/apr26PiBiGEyfjmy2jvb09HBwAO5kd7O3tIZMBMpkdAEClEhb1X+bmILVeSEgY
AODYsUT0D7kDgHpc89orz+P2OXdql9PkoEJhOJ8+/PD5du2PGmucu18YGUPrl4vnu87D7HOwfg5J
jI+zNPmof55y/PN85OiohMIRUCjUsxENDcJoTn319ZvaXdo7qCf1W6rpeAHau5Y6q9aMsQydIzWM
9TXq10yf34zFOjnlULPbVhfMoirotCwZO5k1pmjmfVW/fpxLaQmpVGpwfF5eqZ5YFEIFBweg/s8T
qEQigVzOcyygOz45fkL9s36dOCigk5eAgVuhT506iT/+uIxFi57CihW7sWLFbtxzzyNISTmJi6mX
jRagtLQEUqkU1dUN2Lx5Bezs7FBRUYb437bjvXdfxZ13z8U7736O3r2DcOHCJVR3jSvhjfLwkcJO
ageZTIbM3Ou3N+87eRbeHm5IvpSO715+FOmbP0FPX098+ctu1NbXQdQanAtuVm1tLerq6lBfXw9R
nIXc3CLYVRQAdVVAdTlUhVkoPn8KZedPo+bSOdQXZOP3xARUVpThUFIa9l8qQ75LCAaPvd3ifTs6
KjFx0lR88817kErtEDtqqulPvCTQXpZ/5coFVFdXwcfXDwBw6NBvuJaTjb0Je7SLG8s9Y3bt3Ib7
770Db77xKk6fPoL9+zcjIyMNQUGhsa7LYgAAIABJREFUqG80b7tzxyZ8/dVneOSRp2Fvr0RFZRbq
6uowYsQoAMD69StRVnEFDz8yA/sProOzi8VV0+aaa9+jRo0BAGzY8D2uXEnDyOEReO3VF2DHeHQq
Le3nx8TdDIlEgh9/XIbcnGv4ce338PPrgeDgcMTEGM4dY/mgn1Pm7kdnYGvGINffvw+ibhqCyEGB
8OwmhYcnMH6CmdtvZKSR4xMCuPPO+UhNTcbGDT9i5qx5kNsDUqNPMLYdptqeUOnGZ+w482NiLObh
4YMAAL/8sgKX0y7qfKOvJe34ypULOHr0AL784mO8994bGDduCiIjbzK7jDpv1fTibWn/xTdabWP8
hMkIC4vEm28uwbJln2HH9s1YvHA+vv9+OUqKaqDzeYDEeD5VVbdvf2Qsd8vKzSsXz3edQ3PnYP0x
sP7vxvqpESONn6e09PJ0+HDDOTUsavD1bV2+ZPE3sJvqjzv7hy8tHWOFRxg/R+owUX+mzm/DjfQf
SqXxdTSTjIb6xq7KkrGTuWNgU++rdu/mXEpLGRyf/5njmzatRm5uDjauXwcnJ2f07RtitD/sCudY
Y+MTY+OOw0d08xIwMLG4ccPPsLe3x9y5ixB10xCMHDUECxcvhlQqxZYtP6PByLdpzrvnQXh5eWP2
7dHwD+iFCTdPx4cfvgSlkwsKi4owJnYQxo2NQECAPx588J9oaPkHX52Cs4MC9jJ7TIgOx497DmLr
gRN4b9VmQAJMjx2CH3cfwnOfrcbZy5nwcHGGp5szyivq4ebu1PzGDbh8+TIuX76M7Oxs7d9yy6px
LTMHaZf+wJX0ayivl6KsXoL88kocPX4GEt9AnKxUIih2KiJGTIVcYeE90I3MnDkHeXnXMGbMFCgU
Sjg0c5ugj68fhg8fhe+++xgrvvkCgwYNxazb/oJly97Gw4vvxdixE7UPqr73PsO5dykt1eC259/7
Vzzy6L+w/tcfcddfZmDJk48iKioGzz77P0jtri+3Y/tGAMDbb7+AqVMjEBsTgfPnziF6+Cg89dRL
WLnyY0yfFgcfbz8Mj56GGjO++KK9Nde+hw4biWeefRWrVn2GW6ePQ8yoOPztwRfh7MR4dCYt7ecj
I4fg9f9+iM2b12D8uJtQXV2NDz5YBUelAiNGGM6dO+4wnA9l5WU6OWXufmQtmLCzs/vz+St/5tPA
gZZvPyrK8PFVVqj7qxEjYlFdXYW4MTM6zK1Cptqer59um7ekzoz1Af49+2D2nHn46qt38Phjf8Og
QcMg+/O+1uEjzG/Hn332Ou6ZNx2fffo+Zky/Ay+9vBRye2Do0Nbnzfx7Leu/qG1IpVJ8+92PGDNm
Mj795B088fhC5OXl4cMPVyE8fEST5x8Zy6c772rf/shY7t6/wLxyWdJOyHY1dw726qbb/+qPiY31
sR4e3Qyep0x994CxnBo58mbMnjMPX3zxJh579EGMHDlGe2WPOUyeM+yaX78ja+kYKy5uotFzpDUM
NzJerjVxM5yPj5/RvrGrsmTsZKyt6vftpt5XDRo0lHMpLWRqfO7r64+Zt45BcsppvPDC/6BUKhEz
quueY42NT0bFGq6TsDDdvAQASXFp00d/VpQDNdWAh9f12zhUDUBRIaB0Ul++XlIMuLipZ321P0uB
shL15ZGOTkB9HVBXC7i6AVWVQG2tensyGeDsAp1Jg84mO/Mquvv3Mvr6tbxC5BZUIrR3N3yz6QAO
nLkEVyd7LLxlFEYNCsKVvAIs3bATGbkF8Pf2wMN3TEJGdhVcnR3Q08/H4v3+44kHtD+/98HXcFNd
xLXDu1BWVKyznIuHO/z8fVHS6zarHi+gzoXSEvWls5qZ//o6w7lk/+czI0qK1Q+xdVSq/5WXAjU1
6hySyYHqKsDLW32JsqHcc3JWPxC58TY1KivUea5pAXJ79fKqhuvlqK1Gk87E3UP9gNiqSqCqCoBQ
b9vZ1aIqu6FMxaO59u2oVNdrVRUgVOp6cXZRL8t4dCytyQNj/by9vXq9qkpApVLHXukE7XPPDOVO
Q4ORc4O7uhyanGq8T1P7adxv2Nurl6msADy76d56qOlzXFxh8Pk15mxf/9j1j0+gFBcvnsd98+fg
jjsW4NFHX9KpU1vQXP9srO1JpU3bvLkxMdQHXMvOxdatKxA2IAoh/Yfh0Udvh729A774YhM8u6n3
3Vw71sRUQyq9Xl5NnZtbxuIi9WSzi6s6rhXl6vagUjXff+nnhbEcJPOZM45QqYDKcvV4Ugh1fB2d
/sy5uqZjCEP5ZOz81Fb9kYZ+7ppbLkclz3eWMie32nq/5ozF9Pvfxr/L7Q3ni5uH+v8m5+F603lq
LKfKy/DnF4So+8vaWmj7a32aftTd8/oHeabGCx2dtcdYNXW5WPfTCoSGGj5Hmupr9ONr7PwmlRrp
F5vpx/RzsSuw1tjJWFs11Lcbe1+lUgEVZV1rLkWfOf144z6osrIUqalNx+fHjx3CHXOm4aOPfsT4
8RO07yuVztBe+NQZz7Gm6s+csbWhOmmcl5cu7TQ8sUit11zy1zXU4/czf8DHsTscHJSokQFOcsBF
or4K3c4F8Gx0gWBpeRVOp15FWL9A2EmN3w5ti4MnanuMBwHMg7aw8ruv8eorz+Gm6FF4478r4OGp
1H0mqQ2wlTxoaGjAK/95DhvWr0NVVSUiIgfh2WfeQ7/AELi5t3fpqL3ZSp5S58OxMd0I1o4vz5G2
he3XtlgaD2Pj82NHr08sTpoyocmFLp3Vjc7nI4c4sXjDmBO84tIKpKUVQOHkBSdHJ9hD/QmEVAY4
yIFuroCDM1BUXoH0nAJ4uHjA1cn0Tf4cPBHAeJAa86BtVFepP7mWydSfQNsaW8uDynL1J/IqlfoT
eSdnvS/soi7J1vKUOg+OjelGuFHx5TnSNrD92paWxMPY+NzQHQ6dXVtMLLKbakfurk7o10+C1D9y
UVtXAl9PVyidHeHsaAeVpAFlDVW4dKUUlVXV8PXyhauTjV0GQ0RE6m/Z7ADfAm0rlM7qf0RERKSL
50gi6zA2PpfJ1beYk3VxYrGdubsqMXRAAHILS5Cdm42LmXUAVHBwkMJZIYOXhwf6BfiYvP2ZiIiI
iIiIiIiorXG2ygbY2cnQ3dsL3b292rsoREREREREREREZpG2dwGIiIiIiIiIiIio4+HEIhERERER
EREREVmME4tERERERERERERkMU4sEhERERERERERkcU4sUhERERENsXNpb1LQERERETm4MQiERER
ERERERERWUwihBDtXQgiIiIiIiIiIiLqOHbu3MkrFomIiIiIiIiIiMhynFgkIiIiIiIiIiIii3Fi
kYiIiIiIiIiIiCzGiUUiIiIiIiIiIiKyGCcWiYiIiIiIiIiIyGKcWCQiIiIiIiIiMsPatWsRExMD
Z2dnKJVKDB06FF9++aXOMu7u7ti2bZv296KiIgwePBjPPPNMWxeX6IYzOLHYXEOZMGECnnvuOYMb
DAkJwdKlSwGoG5OdnR1kMpnOv08//bTZgmVmZmLevHnw9/dHt27d0KtXLyxevBjl5eUAgJkzZ2q3
J5VKIZVKtb/fd999Zh+Lppz29vZQKBRQKBRwdnbGoEGD8P333+ssY+hYQkNDmz0WstwXX3wBZ2dn
fPzxx80uu27dOsTGxsLFxQVOTk4IDw/Ha6+9hrq6Ou0yjWOsVCoRGBiIt95660YeQqfCeHQ++v1e
jx498Ne//hXFxcVW3c+VK1cgkUhQX1+v8/ONsmbNGhQWFrZo3REjRmDlypVWLpHtak08TNXVK6+8
Ai8vLyxZsqS1RdTRmti2BScnJ2170vy7cOECAODo0aMYMWIEunXrhpCQEKxatUq7nqnXAPP61K7k
6aefhoeHB/bu3XtD92PsvHfgwAGMHDkSHh4e6NOnD9577z2zt2lq3ebywFh5SkpKcNddd8HDwwO+
vr548cUXje7fVI5aUtY9e/YgOjoaoaGhiIyMxLJly4zus6XHRdSRSSQSHDp0qMnfIyIiTLYXoHXn
Zmob7777LhYvXozFixcjNzcXRUVFeOGFF/Diiy8aHfuUlZVhypQpmDBhAv773/+2cYk7t6ioKHz+
+eftXYwOrbXzfwAAoeedd94RHh4e4ttvvxUVFRWiurpa/Pzzz8LPz088+eSTQggh1q5dK7p37y7q
6up01k1ISBDOzs6itLRUCCGEm5ub2Lp1q/4uzBIdHS0ee+wxUVFRIYQQIjMzU8TGxooHHnigybLz
5s0TjzzySJO/m3MshspZV1cnNm7cKBwcHMTx48dbfSykq7KyUqxcudLo64sXLxZ33323iI6OFh99
9JHJbb3//vvC3d1dfPvtt6K8vFxUV1eL/fv3iyFDhoh7771Xu1zj+DU0NIjExETh5OQktm/fbp2D
6sAYj65Jv0/7448/RExMjFiwYIFV93P58mUBQNTV1en8fKMEBQWJ1NTUFq07fPhw8d1331m5RLar
vr5eZGdnt2hdU3U1YMAAsWbNmtYUzaDWxPZGq62tFQBETk5Ok9dqamqEv7+/WL58uVCpVOLEiRPC
zc1NnD9/3uRrQpjfp3YVNTU1olevXmLp0qXi7rvvvmH7MXbeKyoqEm5ubuKbb74RQghx/Phx4eTk
JPbv39/sNk2t21wemDoPz507VyxYsEBUVlaKq1evihEjRoikpKQm+zeVo5aUtaSkRLi4uIjffvtN
CKE+d7i5uYmDBw822U5rjouoIwNgsE2Eh4eLL7/80uS6bTFWopYrKioSSqXS4Dhnz549QiqVisuX
Lwshro+1KysrxZgxY8Rjjz3WxqXtGoYNGyY+++yz9i5Gh2WN+b8dO3YInYlFcxtKbW2t8PX1Fb/+
+qvOMvPnzxeLFi3S/t6ayThXV9cmkwx5eXni2rVrTZY1NLHYkkavb8CAAdrOvzNMLP773//W/msP
ly5dEk8++aTo1auXePzxx40ud+TIESGEEBMmTDA50CwrKxMuLi4G39wWFhaKwsJC7e+G4hcVFSU+
/vhjSw+j02A8ujZDMVi/fr3w9fUVQqgHtkqlUrz55pvC29tbZGVliYMHD4oRI0aI4OBgERwcLL76
6ivtulu2bBGDBg0Sffr0Ef369RNff/21djvGJhbj4+PFTTfdJEJCQkR4eLh4//33tdvbtWuXiIyM
FD4+PiI6OlocPny42X3Nnj1bABD9+vUTq1evFkIIk2X++uuvRd++fUVoaKh44oknRHR0dJeaWNSP
hzXqatasWcLe3l4EBASIp59+WghhOpaNNTQ0iMcee0z069dPBAUFiWHDhokDBw4IIQzH1lj+GMpd
YzkjhBDLly8X3bt3F/379xdPPfWUGDdunFixYkWzddJYbm6uACBqamqavLZ9+3bRr18/nb/dc889
4uWXXzb5miV9alexevVqcccdd4jq6mrRvXt3UVBQoH3t7NmzQv/z8kGDBokff/xRCGE6zvqMnfdy
cnLE8uXLdZaNiYkRy5Yta7bsptY1lQemypOfny8UCoXIy8trdv+mclQIdV1ptm2qrElJSUKhUOi8
Nnz4cO14ufF2WnpcRB1dcxOLV65cEQqFQnz11Vfi1ltvFeHh4WLevHmioaGhybn5k08+EWFhYSI/
P9/kekIYPy/27t1b+wFIaWmpkMlkOmOuAQMGiKVLl5rcNqlt2rRJODg4GK2XgIAA7TnBzc1NrF+/
XkyePFn87W9/a8tidimNJxY1beTzzz8Xt9xyi+jVq5d4//33xRtvvCGmTp0qAgMDteNIIYy/pxDC
OuNDW2et+b8mE4uWNJRnnnlGTJ8+XftacXGxcHR0FCdOnND+rTWTcYsWLRL+/v7if//7n0hKSjLZ
qRmaWLS00TcuZ21trVi9erWwt7cXycnJrT4WW7FhwwaxYcP/t3ffUVFcbx/AvwsoiEiRXpSOIqIi
UcCG3Rh7xZrEboy+pJlmEjVojIklRkNi7x3FGhUbqIm9Y0FFBOkiRRSRdt8/+DFhKQMrWNDv55w9
B3bmzjx37p2d2Wdn5u7K32FCt4v0U5vEkydPxM3Qq+LE7k3i5N8B4uTfAeLG1SulLyT8eP6rnPLy
8sS+fftEt27dhKOjo5g3b55ITU0tV9myTjQLOntmZmaZyyp6hdyRI0eEkZGRCA8PL19F3hBsDypQ
0mfa9u3bhZWVlRBCiNjYWKFQKISfn5/Iy8sTDx48ELVq1RJbtmwRQuQnpvX19UVoaKh4+vSp0NHR
EXv37hVC5J/YamhoiMTExFITiw8fPhR6enpiz549Qggh7t+/LwwNDcWhQ4dEUlKSqFWrljh8+LAQ
QojVq1cLCwsLkZ2dLbuu7OxsAUC6qk0u5ujoaFG9enVx9uxZIYQQgYGBQl1d/a1NLFbmtqpXr57Y
vXu3EELItmVRBw4cEA4ODtJnyJ49e8Qnn3wihBDF2lau/xTtu3J95v79+0JDQ0Oqm7+/v9DU1BRr
166V3SZFhYWFCQ0NDeHj4yPq1q0rXF1dhb+/vxBCiAULFiidLwkhhJ+fnxg4cKDsNFU+U98Wbdu2
FUFBQUIIISZNmiTmzZsnTZNLLMq1s5yyjntRUVFCT09P3Lp1S+W6FC4r1w/k4jl8+LCws7MTfn5+
wtHRUTg7OyslCwqT66NCCHHw4EFx586dMmPNzMwUNjY2UsL25s2bwsjISNo3Cy/neetFVNWVlViM
jY0VAMScOXOEEEJkZmYKY2NjcejQIaVjc2BgoLC1tRX3798XQgjZcnLHxdGjR4uffvpJCCHE7t27
hZeXl+jdu7cQIv+HBG1tbXH37t1Sl03/WbVqlahbt26p05s3by5mz54thMg/17axsRE2NjaiR48e
TNK+IIUTiwX7SEGeZ9++fUJDQ0M63gcGBgpHR0chhHgp54evu8rK/wUFBQmlZywmJSXB1NQUamol
j+liYWGBhw8fAgDGjh2LAwcOICYmBgCwfv16uLq6ws3NTalM165doVAolF6HDh0q/Qbv//H398cv
v/yCEydOoFOnTjA0NMTIkSMRFxdXZllV6wIA/fv3h76+PvT19VGjRg3MmzcPu3btQoMGDaR5evbs
WezZNHPmzClXPK+DZ8+eITMzE1lZWTh25SGupWnhSsg+pESFoWULZ3i2aAzPth5IvX8Lx7esxOmj
hxB9PwrpJ7bhRmgoThzcj+M3k3A8/HG517lx40aMHDkSY8eOxc2bN/Hpp59CT0+vUuqTnJwMAwMD
aGpqSu+NHz8eZmZm0uvevXvStII2rlmzJjp37oxPP/0UNjY2lRJLVcH2oNJER0djzpw5GDBgAID8
5wMJITB06FAoFArs378fhoaG0nQ7Ozv06NEDmzdvhpaWFqKjo9G1a1cAgLe3N6pVq4aIiIhS13f4
8GGYm5ujW7duAAArKyv07dsXu3fvRlBQEOrUqYP27dsDAIYNG4ZLly5BXV1dpXXJxRwSEgJ7e3u8
8847AIDevXvD3Ny8MjZllfSitpVcWxZlZmaGhIQErF27FgkJCejWrVupz6+T6z9F+65cnzl69Cjq
168v1W3cuHHQ0dEpc5sUpampieHDh8PX1xf37t3D4sWL8e2332Lnzp148uQJatSooTS/trY2njx5
IjtN1c/UN92tW7cQGRmJjh07AgDGjBlT7JnZpZFr5+cVExODbt26Yfr06XB0dKxQWbl+ICclJQVR
UVHQ09NDWFgYtmzZgpkzZ2Lv3r3F5pXrowDQsWNH2NvblxmrpqYmli1bhpEjR8LIyAguLi6YMmUK
HBwcii3neetF9KZTKBQAgMGDBwPI3z/t7e0RFRUlzfPvv//C19cX+/btg5WVVZnl5I6LnTt3lp5L
e+TIEYwbNw4XL16EEALBwcFo06aNtK/KxUSAiYkJ4uPjkZubW+L02NhYmJiYSP+PGTMGoaGhiIqK
whdffPGywnxrFewjvXr1AgA4OTkhJycHvXv3lv4vyF+9jPPD111l5v+UlqDKjmJjY4MOHTpg5cqV
AIBly5Zh3Lhxxcrs27cPQgilV8FJoRw1NTUMGTIE27ZtQ0JCAo4dO4akpCSp4cui6k4fEBCA1NRU
pKamYsiQIbC1tUWXLl2UyuzatQuZmZlKr6r0AZGdnY3s7Gzk5ORA08wGHpZ5aGajA0/7msCDOCAp
GkiIgGcjS7T2bgQPay0Ypt0BADhrp6KVvQ5a1zdCXmZGudfp5uaGBg0aYPLkyVi0aBHS09MrrT4m
JiZITk5GRsZ/8cyePRuXLl3CpUuXkJqaqvTg44I2fvr0KSIiInDu3DmMHTu20uKpCtgeVFhBcldP
Tw9t2rSBp6cnZs6cqTSPkZERgPwvsHFxcbCxsZFeQUFB0sFmzZo1aNmyJTw8PODp6YmsrCzk5eWV
uu6EhAQYGxsrvWdoaIiEhAQkJSXBwMBAel9NTQ3GxsbSyUJ51yUX88OHD1G7dm2l+YvG8zZ53m21
fPlyGBkZwcjISDqJK0yuLYuWbdSoEXbs2IF9+/ahXr168PT0xPHjx0uMV67/FCjou0DpfSYlJUVp
PjU1NekLnNw2KRq7tbU1VqxYAS8vLygUCnh5eWHo0KHYtWsXdHR0lD4XAeDx48fQ0dGRnabqZ+qb
7q+//kJcXBwMDAygr6+P1q1b49atW+UaxEWunZ/HuXPn0LJlS/j6+sLX17fCZeX6gRx9fX1oampi
4sSJUCgUaNiwIXx8fLBv375i88r1UVViDQ8Px6BBgxAUFISkpCRERkZiyZIl2LhxY7Hyz1svoqpO
oVCU+B00KytL6Yc1XV1d6W91dXWlMkOGDAEApe+rcuXkjosdO3bE6dOnkZubiyNHjqBjx46oV68e
rly5guDgYLz77rvliomAli1bolq1asUGogKAkJAQxMfHK+U6mjZtipo1a2LXrl1Yt26dNMgtvVgF
x5mChFnh/wv36co+P6xqKjP/p5RYVHVHGT9+PFatWoUrV67g7t27GDRoUMVrByAuLg6bNm1Ses/V
1RXTpk3D5cuXkZmZWeYyVK1LYT///DP27t2Lw4cPP18FXlNZWVlSYlGkxiIxMQXqTx4C2U+BzMfI
S45FatgVpIddxbPwm8h5GIdLJ0KQ8SQdpy7fxT/h6UiqVQ/ePfqWe53Ozs44dOgQdu7ciTt37sDZ
2RmTJk0qdRRCVTRr1gwGBgZYvXq19J6enp50JYccKysrjB49GgEBARWOoyphe1BhBcndtLQ03L17
F3Pnzi12dUlBMs/KygpOTk64d++e9IqPj8cff/yB7du3Y8aMGdi4cSNOnz6Nf/75B9WqVZNdt7m5
ORITE5Xee/DgAczNzWFqaqo0TQiB0NBQZGdnq7QuuZgNDAyKjYBd3ivi30TPu60GDx6M0NBQhIaG
Sicahcm1ZUll27dvj23btiExMREDBgxA//79S4xXrv8UKOi7cn1GV1cXjx49UoovNja2zG1SNPaE
hAScP39eKZ7s7GxUr14dDRo0wPXr15WmXb16Fa6urrLTKvKZ+qbJzMzEmjVrcO3aNelH4NTUVMyd
OxdLliwBAOnLeuEfGQraVq6dVXX69Gn06dMHq1atwqhRoyqlrFw/kGNvb4/MzEyl5J0QosQrD+T6
qCqxHj16FHZ2dvD09AQAWFpaomvXrjhw4ECxZTxvvYiqOktLS4SFhSm9l5aWhoiICFhbW5drGQcO
HIC3tzdGjx5drvnljosGBgZwcnLCwYMH8ezZM1haWqJNmzYIDg7G0aNHlRKLJE9XVxczZ87ExIkT
sXr1amRkZODZs2fYuXMnBg0ahG+//bbEH67q1q2L7du347PPPsPBgwdfQeRU1Is4P6xqKjP/p3Tm
oeqO0r17d2RmZuLLL7/E8OHDoa2tXSkVzMvLw5gxYzB37lzpdonExEQsWLAA7u7u0NLSKnMZz7vT
A/mXfH7zzTf4+OOPkZWVVSl1eh1EREQgIiJC6ctzYnom4mMScDc8Evfux+NxjhrScxRIepyBs+dD
oTC1x8UMbTi06oqWnbrC6Dmv6Klfvz5+//133Lx5Ey4uLvjwww8rXJ+CW9EnT54Mf39/pKenIzs7
G+fPn0fv3r1hamoKQ0PDEssmJydj5cqVaNSoUYXjqIrYHqSq9u3bIzY2Fvv37weQf4vbmDFjcOHC
BaSkpMDQ0BB16tSBEAKzZ8+GQqGQvd2tffv2SEhIkJYXGRmJ7du3o0+fPujcuTPi4+OlW/QCAgLQ
sWNHKBQK2XWpqalBXV0daWlpZcbcqlUrhIWF4dy5cwCADRs2VMlfGivL824rbW1tKdFV9KpGALJt
WbTs8uXLMX78eOTk5KB69epo0qQJhBAAUGLbltZ/ipLrMy1atMDly5cRGhoKAFiyZAkeP35c5jYp
GvudO3fQtm1bnDx5EgBw5swZbNq0Cf369YO3tzfy8vLg7++PvLw8BAcHIygoCIMHD5adVpHP1DfN
1q1bYWdnBzs7O6X3BwwYgMDAQCQnJ8Pc3BwaGhq4efMmAOCff/7B/fv3AUC2nVWRkZEBHx8frFmz
Bm3bti02fefOnbh27ZrKZeX6gZyCqwe+++475OTk4Pbt29iyZYt0K2Rhcn0UyE8YFjxSQi7Whg0b
4vr169J2TktLw5EjR6RboQov53nrBeQnQpctW6a0/ZYtW6aURF22bJnSVcpEr4vPPvsM06dPx8mT
J5GdnY3w8HAMGzYMXl5e8Pb2Ltcy6tWrB39/f1y9ehX+/v5lzl/WcbFz587w8/OT1t+mTRsEBATg
2bNnqFev3nPW9O3k6+uL5cuX46+//oKxsTEMDAzg5+eHn3/+GdOnTy+1XKtWrfDbb79hwIABxX50
oZfvRZwfVjWVmv8r6SGNW7duFZ6enkJbW1vUqFFDuLu7i1WrVpX4QMepU6cKACU+rLIiA56cPXtW
dOvWTZiYmAhdXV1hZmYm3n//fREdHV1s3pIGb1GlLiXFmZmZKWxtbcXMmTOledTU1IS6unqxV0kx
vY5GjBghvYQQQqTeFnEH/hQ6uy7hAAAgAElEQVS3Ns1SesUd+FOI0O2vJMacnByhqakpNDU1hZqa
mtDQ0BCamppi4sSJpZb5+++/hbe3t6hVq5aoUaOGaNCggfjuu++KjUJcrVo1adlGRkbCx8dHxMXF
vYxqVVlsjzdXWZ/PcXFxAoBIT0+X3isYAc3e3l44ODiIr7/+WuTm5opHjx6Jjh07CltbW/HOO++I
LVu2iNGjRwsLCwuxZ8+eUkeFDgkJEc2bN5dGL1yyZIm0rpCQEOHs7CyMjIyEm5ubNDqw3LpCQ0PF
0KFDha6urpg7d65szELkj7RYp04dYWNjIyZNmiS8vb1LHSX2TVTaqNAV3VaFB28RovS2LCotLU0M
HTpUWFlZCTs7O+Hm5iYOHjwoTS/atqX1n6J9t6w+M2fOHGkwCz8/P+Hh4SHWrVtX5jYpavny5cLB
wUHo6emJ+vXrK42qe/HiReHl5SX09fWFi4uLCAwMLNc0Icr3mfqma9mypTSgQFGtWrUS8+fPF0II
8csvvwgnJyfRuXNn8dVXX4k2bdpID1eXa+fC5I57W7duFQCk6QWvgkGG3N3dxYIFC0qMs6yypfWD
so7D0dHRokuXLtIgAaWtXwj5Plp4NOeyYl28eLFo0KCBcHBwEA4ODmLy5MkiJyen2HIqUq/jx48r
DcZz//59AUAaxEKI/AEyjh8v/4CCRC/TwoULhbOzs6hRo4aoU6eOmDhxokhKShJClHyO1bJlS7F0
6dJix+Zz584JXV1dcfnyZdlyQsifV504cUIAEBs3bhRC5H/X1dLSEuPHjy8zJqLXWeHBWwr68dOn
T4UQ/53rFrhx44bQ1NQUQry888OqoKL5v6CgIKEQ4n+XAxARERG9ZXJzc5WeeeXk5IQFCxaU+5nO
VDW8jHbesGED1NTUKu3RQERERPRq8Pyw/A4ePIiSh38hIiIiesNlZGTAxMREup3lyJEjiI2Nhbu7
+yuOjCrTy2pndXV1dO/evVKXSURERC8Xzw9Vp/EqVnr9+nVppKuS/Pjjj+jZs+dLjIiIiIjeNtra
2lixYgU++eQTPH36FLVq1cKGDRtKHIWTqq6X1c4+Pj6VujwiIiJ6+Xh+qDreCk1EREREREREREQq
4a3QRERERERERERE9FyYWCQiIiIiIiIiIiKVMbFIREREREREREREKmNikYiIiIiIiIiIiFTGxCIR
ERERERERERGpTCM5Je1Vx0BERERERERERERVjEb1GjVfdQxERERERERERERUxfBWaCIiIiIiIiIi
IlIZE4tERERERERERESkMiYWiYiIiIiIiIiISGVMLBIREREREREREZHKmFgkIiIiIiIiIiIilTGx
SERERERERERUDtu3bUWHtq1haqQPk9q6aOXZDKtWLFeax9LMCAeDDkj/p6amoIWHO6Z+P+Vlh0v0
wpWYWCxrR+netTOmT/2+xAW6NWqAFcuWAsjfmfRqakJfR0vptXTxX2UGFhsbg1Efvg8nO2tYW5rB
2dEOvpMm4MnjxwAAnwF9peXpaleHrnZ16f9xo0eWuy4FcdbW1YaRvg6M9HVgaqQPr+ZNsXnTBqV5
SqpL08YuZdaFVLdy+TKYGulj8Z/+Zc67c8d2dGrvDTNjA5ga6qFZ00b4dfYsZGdnS/MUbmOT2rpw
beCE3+bNeZFVeKOwPd48RT/3HG3rYsL4MUhLS63U9URFRqJWjWrIyclR+vtF2RawBSkpyc9Vtl2b
lti0cX0lR/T6qkh7yG2r2bNmoq6FKb775quKhqikIm37Mpga6kn7U8Hrzu3bAIDz58+hXZuWsLY0
g1ujBtiyeaNUTm4aUL7P1LfJD999CyszY/xz4vgLXU9px73Tp06ivXcrWJkZw6WeAxYtXFDuZcqV
LasflBbPo7Q0jHh/GKzMjGFX1xIzfpxW6vrl+qgqsYYEH0XbVl5o2tgFHu80weqVK0pdp1y9DgYd
QAsPd1iZGaORS71yfT8gqgpq1aiGs2dOF3u/uXtj2f0FqNixmV6O3xfMh+/EjzFqzFhERMXiftwD
fPXtFMz4cVqp5z6P09PRu0c3tG3bHtP9Zr7kiN9sbVp4YPnSJa86jCqtovk/oITEYnl2lFFjxmLd
mtXFPvD+OXEccXFxGOgzSHovIHAXUh9nKr3GjBtfZuWG+AxAbcPauBR6A5Ex8Thy7ARuXL+OyV98
CgDYvHW7tLyBPoMxZtx46f/Fy1aUuy4FNgcEIin1MZJSHyMmPglTp/nh4/FjcenSRdm6XLh8rcy6
kLKnT58qJW2L+uT/PsaJ48fg7NygzGX5L1qIj8ePw4hRo3H3XjSiYhOxyH8xdgZux8SPxinNW9DG
8UmpWLp8FWb9NAOHDx2scH2qOrbH26vw596RYydwKywMX3/5xasOq0J+nPYDUpJTXnUYVYKllRXu
3LsPDQ2NSl1uwNbN+G3hIsyYNbtSl/s6t212djYyMjJw4/ZdaZ9KSn0MB0dHZGVlYcjA/hg9Zhzu
Rcdh1doN+NR3Eu7cvi07DVDtM/VtkJWVhYAtm+E3c5b0I/aLUNpxLy0tFX1798CoMWMRHf8A6zdv
hd/0qTh96mSZy5QrW1Y/kDsOT/r4I2jV0MLtiCgc+/cUjhw+hNCrV4vNJ9dHVYk1/dEjDBrYD34/
/YwLl68hIHAXvv3myxKTKHL1iouLxbAhPpj240xExz/AqrUbMOWbL3H+/LkytyUR0auSlpaKmT9O
w4JFf2DI0OHQ1taGpqYmevTsjRWr12Lh778hKjJSqczTp0/Rv28vNGveHD/N/vUVRU5UssrI/wFF
Eovl3VG69+iFvLw8HNj3t9KCV69cAZ9Bg6FTq1aFK3jrVhje7doN2traAABzcwts3BKAaT/OKFf5
59npC2hoaODd97rB1s4Oly9eLHGeqmjOzzOk16twLyIC333zFdwbN8T5c2dLnW/4ByOwfNUa1Cqj
Hz15/Bh+P07FnPm/5bdxzZrQ1NSEh6cX9uwPwuw5c0ssp6amBk+vFqhfrz7C79ypUJ2qMrYHFVan
Tl189vlkBO3fDyD/F3NTQz38Nm8ObOtYID4+DmfPnEZ771Zo4uqMJq7OWLt6lVQ+6MB+tPBwh0t9
B7g2cMK6NavLXOeJ48ekq16auzeG/6KF0rTgo0fg2cwNdnUt0bZ1C6U+Wtq6hg32wd3wcPTq0RXb
ArYAgGzM69asRkNnR7g3aYivJn8GIURFNmGVExMdDQebOtJJQmVsq8ED++NueDi+/epL6VYfubYs
LC8vD5M//wSuDZzQuGF9tGnhgTOnTwEouW1L6z8l9V25/rl+7Ro42taFW6MG+H7KN+j2bids3LCu
zG1SWMGVvnp6+sWmHT8Wguqa1TF0+PtQKBRo3LgJ3nuvOwK2bpad9ryfqW+y3bt24J1mzTFk2HAc
CwlWuoL1VlgYatWopjR/Cw937AjcBkC+nYsq7biXlZWFX36dh6HD3gcANGniBlfXRgi7ebPM2OXK
yvUDuXiSkx/i7727MeOnn1GjRg1YWdXBkZATaOjqWmz9cn20YFsVXA0pF2tkZCRysrPRuo03gPxj
h5NTPVy/dq3YcuTqJYTAkmUr0LnLuwCApk3dYe/ggFthZW9LoqouKioSxga1sHb1KvgM6Ivm7o0x
esQHyMvLKzbv0sV/4R03VyQnPyyzXGnHRZd6DtIPII/T02FQq4bSOVezpo2wcvmycsf0Njv177/I
zc1F7z79ik1r490W5uYWCD56RHovOysLQ3z6w9HJCb/O/e1lhvpWKthHVixbiv59e6GBkz38Fy3E
/Lm/ol/vHmjkUk86jwTkv79Uxvnh666y8n9AkcRieXeUatWqYfgHH2LVqv8u5X6UloYdgdswcvTY
SqnkgIE+mDBuDBYtXIDQq1eRl5cHQ0MjmJiYlqu8qjt9YdnZ2dgWsAV3w8Ph4elVoXq8Ttzd3eHu
7g5ra2vohO8GLm+DWl4WYsJv4vKhbQg9uhOhR3ci+s6NUpehE3sKOrGnyr1OIQQOBh1A/7690Lvn
ezCzsMCpsxfwy5z5MnG+U65lnz9/DhlPnqBP3/7FpunrG0Bf36DEcnl5eTgWEozIyEjphPZtwfYg
Obl5uahWLf+LeXXN6nj69CmysrJwNyoG1apVQ8/uXTHJ9xNcunoDO3b9jW++mowb168jMzMT7w8b
jKnTZ+DazTv4c/EyTPp4PJKSHpS6rpSUZPgM6ItvpnyPC5evIXDXXsyeNRPBR48gOfkhBvv0x+xf
5+FuVAzGjv8Igwf2R05Ojuy6Vq3NvzV35+596Nd/IB4+TCo15tjYGPhOmoA16zfh/KVQtG7jjUsX
L7yU7fw6qqxttXFLAKxtbPDb74sw3W+mbFsWdfTIYQQd2I9zF6/icuhNTPl+KrYHbAWAYm0r13+K
9l19fYNS+0xMTDQmThiHzdsCcfHKdVhb2+D0qZNQKBSy26So1JRUaGhoYOyoEWjgZA/PZm5YtmQx
gPyEV/0iV5o5OjnhxvXrstOe9zP1TbZ86RJ8OHIUNDU10btvX6xft7Zc5eTauSSlHfeMjU0wdPj7
0v/R0fdx48Z1tGzVuswY5MrK9QO5eK5euQIzc3MsX7oETVyd8Y6bq1KyoDC5PgoAM2f9Ih2D5WJ1
dHKCiamplLC9fesWIu7elRKNhZcjVy8LC0v06t0XAJCbm4udO7YjLjYObbzbym9IojdA9erVkZmZ
iZTUFGzeuh3H/z2Dw4cO4lhIsNJ8e3bvxILf5mLnnn2oXdtQtpzccbFdhw44cfwYgPzkY1P3d3D8
WAgA4MGDRERFRqJ9h47liultl/QwCSYmplBTK3moCjNzcyQnP5T+n/zFp7h1KwwJCQlM0r4EBfuI
hoYGArbvxIJF/pjyzZcwt7DAth278dPPv8Bv+lQAkP1OUVnnh6+7ysz/Ke0RquwoI0eNweGDQYiN
jQEAbN60EQ1cGqJx4yZKZfr26o5aNaopvY4eOVxmJecvWAS/n2bh5D//oGe3d1HXwhQfjRuN+Pi4
MsuqWhcAGDbEB5ZmRrA0M4KxQS0sXPAbNgcEor6zszSPT/8+xZ5Ns+C3eeWK53Xw7NkzZGZmIisr
C8euPMS1NC1cCdmHlKgwtGzhDM8WjeHZ1gOp92/h4q61uHYyGKkPYiHO7cT9Ozdx6fghHL+ZhOPh
j8u9zq1bNmHCuDEYOXI0Lly+homTfKGrp1cp9UlJSYa+vgE0NTWl93wnTYC9tZX0KnxVakEbmxrq
oVf3rpj4f76oa21dKbFUFWwPKk1MTDQWzJ+HPn3zDywKhQJCCPgMGgKFQoGDQQdQu3ZtKclhY2uL
97p1x7aALdDS0sKtO/ekL5OtWrdBtWrVEHnvXqnrCz56BGZmZujS9T0AgKWlFXr27o19f+/B4UMH
YWVlBe+27QAAgwYPxb9nzkFdXV2ldcnFfOL4Mdja2aFpU3cAQPcevWBmZl7xDVlFvahtJdeWRZma
miExMRGbNqxHYmICunR9Dz//WvJVeXL9p2jfleszx0KC4VSvnlS3kaPHoGZNnTK3SVHVNatj0JCh
mDBxEq6F3cHvi/7EtB++w97du5CR8QQ1tGoozV9DWxtPMp7ITlP1M/VNd+f2bURFRaJd+w4AgA9H
jMaqFcvKVVaunZ9XbGwM+vfpiSnfTYW9g0OFysr1AzmpqSmIvn8furp6uHjlOtas24RfZ88qdkUB
IN9HAaBd+w6wtbMrM1ZNTU388ecSfDRuDKwtzdCsaSNM/vob2NnbF1tOeeq1dcsm1NbVhu/Ej/HH
n4thaWlVji1IVLUV/KgxYKAPAEBTUxO2dnaIvn9fmuf0qZP48vPPELhzr7RfyJWTOy526NhJei5t
SPBRjBw9BlcuX4IQAsePhaBlq9bQqqFVZkyU/8NLQkI8cnNzS5weHxcHY2MT6f8RI0fj7PnLiL4f
hSlff/mywnxrFewj3Xr0AAA4OjohJycHPXr0AgA4ODghLjYWAF7K+eHrrjLzf0pLUGVHqWttjbbt
2kuXi65euRyjSrhacfvOPUh/mq30KjgplKOmpoaBPoOxftMW3I2KwYFDR/Hw4UP07dW9zLKq1gUA
1m3YjJj4JMTEJ2Ggz2DY2NiiY6fOSmUKP4+s4OX7yWfliud1kJ2djezsbOTk5EDTzAYelnloZqMD
T/uawIM4ICkaSIiAZyNLtPZuBA9rLRim5d+a6qydilb2Omhd3wh5mRnlXmfjxm6o7+yMKd9+hcV/
+uNxenql1cfY2AQpKcnIyPgvHr8Zs/DvmXP498w5pKWlKl0VU9DGD1LSEXrzNi6cP49JH5f9vM83
CduDCitI7lqYGqJLx3Zo3twDP0z3U5rH0NAQQP7VLgnx8XCp5yC9Dh86KB1sNqxfh47t2qBt6xZo
16YlsrKyZH+ZTUxIhJGRsdJ7tWsbIjEhEQ+THipdjaWmpgYjI2PpZKG865KLOflhMgwMaivNb2Rk
pMLWe7M877Zas2olrC3NYG1pBp8BfYstV64ti5Zt6OqKTVu2IejAfrg1ckG7Ni3x7z8nSoxXrv8U
KOi7QOl9JjUlFYaG/7W7mpoaLK0sy9wmRWOvW9cafy5ehuYenlAoFGju4QmfwYOxd+9u1Kypg4yn
ysfNJ48fQ6emjuw0VT9T33TLly5GQnw8rMyNYWlmhM4d2+LO7dvlGsRFrp2fx4UL59GpnTcmfPx/
mDBxUoXLyvUDOXp6+qiuqYlxH02AQqFAAxcX9BswAEFB+4vNK9dHVYk14u5dfDh8KHbt2YfImHhc
vxWOlcuXYuuWTcXKl6deAwYOQvKjDGwO2I7Jn3+KXTsDZetMVBUoFIoSv4NmZWUp/bCmW0tX+ltd
XV2pzMgPhgMAjE2Uj3WllZM7LrZr3wFnz5xBbm4uQkKOol37DnB0ckLo1as4fiwEHTt1KVdMBHh5
tYBGtWrFBtgC8q8GTUiIR9v27aX3Gjdxg3bNmtgcEIhNGze80OcD038KkoAFCbOaOv/9X7hPV/b5
YVVTmfk/pSe2F95RBg8ZprTQknaUUaPH4puvJ+O9bj0QcS8C/QYMrJQKxsfH4cTxY+g/wEd6z6Vh
Q3z73Q9o7dUcmZmZ0NLSkl2GqnUpbPqMmXBr5ILgo0fQtl3J81RFWVlZAICcnByI1FgkIgcmtZ4C
NWoAOXnIy3qIR8kpUK9WHdW1tKFerTounQ+Fna0trl1+glwdY9Rr8g7cO3mWe5316tfH7r8P4FZY
GJYu+RPuTVzRo1cvjP9oYokPDFdFU/d3oK9vgA3r1mL02PyH2Ovq6ZXrCjxLSyt8MGIkRn44HH/8
+faMIsX2oMLWbdiMTp27yM5TkMyztLKEg6MjTp0t/tzZXTsD8cvPPyH4xL+oW9caubm5MDMq+Tle
BczMzfDgQaLSe0lJD2BmZgYTUxOlaUII3Lh+HY5OTtj3955yr0su5k0b1xcbATs+Pl425jfZ826r
/gN90KVrVwD5t58UJdeWJZX1btsO3m3bISsrC3/9+Uf+sxWjYootV67/FCjou3L9U1dXF+mPHinF
FxcbV+Y2ycjIUIo9MTEBMTExcHNrKs2TnZ2N6tWro76zMxYtVH6u0rXQUDRq3Fh2WkU+U980mZmZ
2LB+Hc5euAIbW1vpff9FC7Fy+TK0bNVa+rKel5cnfZF49L+2lWtnVZ07ewbDBvtg6YpV0u2/FS0r
1w/k2NnZ41lmJp5mZEC7Zk0A+XUr6coDuT6qSqzHQoJhY2uLZs09AAAWFpbo3PldHD54EAMGDlJa
hly9bt64gfA7t9GtR0+oq6vDw9MLXbp2xYH9+9CzVx/ZehO97iwsLHH71i14erWQ3nuUlobIe/dQ
p27dci1jx+6/MX/ur/h4/Dis31T2lVByx0V9fQM4ODriyOFDePbsGSwsLNGyVWscPxaCYyHBmPDx
/6lWwbdYLV1dTJ3mh88/9UVeXh769O0PdXV1HAo6AN9JH+OLL78u8crrOnXqYsPmrejd4z3Y2Nqi
fYeOryB6KuxFnB9WNZWZ/1M68yi8o6xftwYZGRl49uwZ9u7ehQ+HDy22o7z7Xjc8y3yG76d8jcFD
hkoDrVRUXl4eJk4Yj98XzEfGk/zbJR48SMSfixbCza1pmUnF56lLYebmFvhi8lf47JNJUjLuTRAR
EYGIiAhp5B4ASEzPRHxMAu6GR+Le/Xg8zlFDeo4CSY8zcPZ8KBSm9riYoQ2HVl3RuHUnaNV6vmc6
OdWrh1/n/oYLl0Ph7OyCcWNGVrg+Wlpa+OnnXzDl26+wdPFfeJyejuzsbFy8eAGDBvaDiYkpahvW
LrFsSkpy/mAEDYs/4PxtwPYgVXl7t0NcbBwOBh0AAGQ8eYKJE8bh0qWLSE1JRW3D2rCyqgMhBObP
/RUKhQJPnpR+G59323ZITEiUlhcVFYldO3agR6/e6NCxExISEqRb9HYEbkOP97pAoVDIrktNTQ3q
6upIe5RWZswtWrTC7Vu3cOHCeQDAls0bq+QvjZXlebeVtrY2TE3NYGpqVuyqRgCybVm07JpVK+E7
aQJycnJQvXp1NGrUWBokpljbyvSfouT6jIenF65evSINPLFy+TI8efK4zG1SNPa74eHo2rmDNNjM
+XNnEbB1C3r17otWrdtA5AksXfwX8vLycPxYCA4fzk/CyE2ryGfqmyZwewBsbW2VkooA0KdfP+ze
tQMpKckwMzODhoYGboWFAQBOnfwXMdHRACDbzqrIyMjAB8OGYMnylSUmFffu3lXqM5bkysr1AzkF
Vw/8OO0H5OTkIPzOHWwPCECXd98rNq9cHwXyE4YFj5SQi7WBiwtu3rwhbedHaWkICT6KRv+7Farw
cuTqlZaWipEj3peuSo6KjMShg0Fwc8u/7SwxMQGrV/73LKeMjAysXrlC6Qre1StXIDExQXYbEb0K
E30/wayZfjhz+hSys7MRcfcuRo38AM09PNGqdZtyLcPRyQnzFyzEtWtXsXTxX2XOX9ZxsUPHTpg9
a6a0/patWmNH4DY8e/YMjk5Oz1nTt9OEiZPg/9cSLF+6BLZ1zFHH3BizZ83E9BkzMeX7qaWW82rR
ErN/nYfhQwfh5o3SxzSgl+NFnB9WNZWZ/yv2k6YqO4q6ujo+GDEShw4GYdTocZVWQQsLS/x94BCO
hQSjobMTLEwN4dUs/0RjU8D2ci/neXd6AJjk+ymysrLwe6FnKPbv0xP6OlrFXgX3mb/uoqKiEBUV
hcTERDTsOgQmTdsgLzsL6SmpyM3OQm52Fp4+ToMacmBpaQTXD79Hw65D0Kpr3+dOKBZVU0cHo8aM
xeHgkm9dys3NlZ5feSwkGF9/+TmM9HXwxWe+Jc4/7P0PsHb9JmzfthWO9tawNDXE2FEfwsWlIf49
c07pFrzCz8h0c3WBuro61qwvfhn724TtQeWlq6eHgMCdmDXTD41c6sHLwx2GhkZo1Kgx+vbrDwsL
SzRyqYe2rbxg7+CAgYMGY+yoEbhx/VqJy9PXN8DmgO2Y6TcdTRu7oH+fnvCbOQstWraCnp4+Arbv
xNQfpsDGyhxzf5mNjVsCoKGhIbuusJs30X+AD7q92wkLf/9NNua61tb4Zc58DPUZAJf6Djh75jQ8
PL3eupGhC7yobSXXlkX16dsPTx4/QcP6jnBt4ITvvvkKK1bnD86hpqam1LZy/acouT6TnZ2NH2fO
Qv8+PeHZzA1JSQ/g0tAVCoVCdpsU5enVAr/OmY8xoz6EpZkRxo4egV/nzEe79h2goaGBjVu3YdPG
9ahrYYrPP/0/LFm2Aja2trLTANU+U99kK5YtRd8S7ooxN7dA4yZu2LB+HWrq6GDajzMw2Kcfevd4
D3/v3SP1UwdHx1LbuSi5417QgX2IiopE317dlZ63/fXkzwFAGiihJHJl5fpBWcdh/8VLERZ2E9ZW
ZujZ/V18+fW3xR7lA8j3UQD4+svPsf9/z2aUi7VZcw/M+vlXDB08AI0b1kfrlh5o16Ejxn00odhy
5Orl4emFefN/x7gxI2FmbIBO7b3Rq1cfjBg1GgAQfucOJk7477tFSkoyJk4YpzQS+MQJ4xB+5458
5yF6BSZO8oXvp59jwvgxsDQ1xHtdOsLa2hobtwSU+Izh0tTU0cHKNesx9YcpCL16VXbeso6LHTt1
xulTJ6UfC9zfaYaLF86X+HlBZevdpx+OhJxAwsM0JCY/wrF/T2PosPeV5omJTyp2Z9CHI0chJj5J
aRwHejVexvlhVVAZ+b/k5GQo0p9mv53fooiIiOitl5ubq/RFr4mrM36ZM5+j1L9hXkY7b9m8UUqC
ExERUdXF88PyO3n8aPErFomIiIjeBhkZGbCtYyHdzhISfBRxcXFwa9q0jJJUlbysdlZXV0fXrt0q
dZlERET0cvH8UHWv5IrFmzduYOSHw0qd/t330/Be9x4vMSIiIiJ6G+3dvQvff/cNMp9mQqeWDqZN
n8FzkDcQ25mIiIjKi+cN5Xfy+FHeCk1ERERERERERESq4a3QRERERERERERE9FyYWCQiIiIiIiIi
IiKVMbFIREREREREREREKmNikYiIiIiIiIiIiFTGxCIRERERERERERGpTCPr6ZNXHQMRERERERER
ERFVMRq1DfRedQxERERERERERERUxfBWaCIiIiIiIiIiIlIZE4tERERERERERESkMiYWiYiIiIiI
iIiISGVMLBIREREREREREZHKmFgkIiIiIiIiIiIilTGxSERERERERERERCpjYpGIiIiIiIiIiIhU
xsQiERERERERERERqYyJRSIiIiIiIiIiIlIZE4tERERERERERESkMiYWiYiIiIiIiIiISGVMLBIR
EREREREREZHKmFgkIiIiIiIiIiIilTGxSERERERERERERCpjYpGIiIiIiIiIiIhUxsQiERERERER
ERERqYyJRSIiIiIiIiIiIlIZE4tERERERERERESkMiYWiYiIiIiIiIiISGVMLBIREREREREREZHK
mFgkIiIiIiIiIiIilRB2bu8AAAFbSURBVDGxSERERERERERERCpjYpGIiIiIiIiIiIhUxsQiERER
ERERERERqYyJRSIiIiIiIiIiIlIZE4tERERERERERESkMiYWiYiIiIiIiIiISGVMLBIRERERERER
EZHKmFgkIiIiIiIiIiIilTGxSERERERERERERCpjYpGIiIiIiIiIiIhUxsQiERERERERERERqYyJ
RSIiIiIiIiIiIlIZE4tERERERERERESkMiYWiYiIiIiIiIiISGVMLBIREREREREREZHKmFgkIiIi
IiIiIiIilTGxSERERERERERERCpjYpGIiIiIiIiIiIhUxsQiERERERERERERqYyJRSIiIiIiIiIi
IlIZE4tERERERERERESkMiYWiYiIiIiIiIiISGVMLBIREREREREREZHKmFgkIiIiIiIiIiIilTGx
SERERERERERERCpjYpGIiIiIiIiIiIhU9v/P02ueGaWJBQAAAABJRU5ErkJggp==
--=-c3iGRn1xmIN62/k5uKWa--
9:29 a.m.
On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues <cmar(a)eurotux.com>
wrote:
I increase hosted_engine disk space to 160G. How do i force to create
OVF_STORE.
I think that restarting the engine on the engine VM will trigger it
although I'm not sure that it was a size issue.
I found to OVF_STORE on another storage domain with "Domain Type" "Data
(Master)"
Each storage domain has its own OVF_STORE volumes; you should get them also
on the hosted-engine storage domain.
Not really sure about how to trigger it again; adding Roy here.
Regards,
Carlos Rodrigues
On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote:
On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues <cmar(a)eurotux.co
m>
wrote:
On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues <cmar@eurotu
x.
com>
wrote:
On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues <cmar@eu
ro
tux.
com> wrote:
On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi
wrote:
On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues
<cmar@
euro
tux.com>
wrote:
On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi
wrote:
On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues
<cmar@
eurotux.
com>
wrote:
On Thu, 2016-08-18 at 08:54 +0200, Simone
Tiraboschi
wrote:
On Tue, Aug 16, 2016 at 12:53 PM, Carlos
Rodrigues <c
mar@euro
tux.
com>
wrote:
On Sun, 2016-08-14 at 14:22 +0300, Roy Golan
wrote:
On 12 August 2016 at 20:23, Carlos
Rodrigues
<cma
r@eurotu
x.co
m>
wrote:
Hello,
I have one cluster with two hosts with
power
management
correctly
configured and one virtual machine with
HostedEngine
over
shared
storage with FiberChannel.
When i shutdown the network of host with
HostedEngine
VM, it
should be
possible the HostedEngine VM migrate
automatically to
another
host?
migrate on which network?
What is the expected behaviour on this HA
scenario?
After a few minutes your vm will be
shutdown
by
the High
Availability
agent, as it can't see network, and started
on
another
host.
I'm testing this scenario and after shutdown
network, it
should
be
expected that agent shutdown ha and started
on
another
host,
but
after
couple minutes nothing happens and on host
with
network we
getting
the
following messages:
Aug 16 11:44:08 ied-
blade11.install.eurotux.local
ovirt-ha-
agent[2779]:
ovirt-ha-agent
ovirt_hosted_engine_ha.agent.hosted_engine.Ho
st
edEn
gine.con
fig
ERROR
Unable to get vm.conf from OVF_STORE, falling
back
to
initial
vm.conf
I think the HA agent its trying to get vm
configuration but
some
how it
can't get vm.conf to start VM.
No, this is a different issues.
In 3.6 we added a feature to let the engine
manage
also the
engine VM
itself; ovirt-ha-agent will pickup the latest
engine
VM
configuration
from the OVF_STORE which is managed by the
engine.
If something goes wrong, ovirt-ha-agent could
fallback to the
initial
(bootstrap time) vm.conf. This will normally
happen
till you
add
your
first regular storage domain and the engine
imports
the
engine
VM.
But i already have my first storage domain and
storage
engine
domain
and already imported engine VM.
I'm using 4.0 version.
This seams an issue, can you please share your
/var/log/ovirt-hosted-engine-ha/agent.log ?
I sent it in attachment.
Nothing strange here;
do you see a couple of disks with alias OVF_STORE on
the
hosted-
engine
storage domain if you check it from the engine?
Do you mean any disk label?
I don't have it anyone:
[root@ied-blade11 ~]# ls /dev/disk/by-label/
ls: cannot access /dev/disk/by-label/: No such file or
directory
No I mean: go to the engine web-ui, select the hosted-
engine
storage
domain, check the disks there.
No, the alias is virtio-disk0.
And this is the engine VM disk, so the issue is why the engine
has
still to create the OVF_STORE.
Can you please share your engine.log from the engine VM?
Go in attachment.
The creation of the OVF_STORE disk failed but it's not that clear
why:
2016-08-17 08:43:33,538 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
ge
DomainCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
ge
DomainCommand'
with failure.
2016-08-17 08:43:33,540 ERROR
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] Ending command
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with
failure.
2016-08-17 08:43:33,541 WARN
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] VmCommand::EndVmCommand: Vm is
null - not performing endAction on Vm
2016-08-17 08:43:33,553 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
or
]
(DefaultQuartzScheduler6) [6f1f1fd4] Correlation ID: 6f1f1fd4, Call
Stack: null, Custom Event ID: -1, Message: Add-Disk operation
failed
to complete.
2016-08-17 08:43:33,557 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
or
]
(DefaultQuartzScheduler6) [] Correlation ID: 19ac5bda, Call Stack:
null, Custom Event ID: -1, Message: Failed to create OVF store disk
for Storage Domain hosted_storage.
OVF data won't be updated meanwhile for that domain.
2016-08-17 08:43:33,585 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(DefaultQuartzScheduler6) [5f5a8daf] Command
'ProcessOvfUpdateForStorageDomain' (id:
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting on child command
id:
'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
type:'CreateOvfVolumeForStorageDomain' to complete
2016-08-17 08:43:33,595 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
ge
DomainCommand]
(DefaultQuartzScheduler6) [5d314e49] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
ge
DomainCommand'
with failure.
2016-08-17 08:43:33,596 ERROR
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [5d314e49] Ending command
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with
failure.
2016-08-17 08:43:33,596 WARN
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [5d314e49] VmCommand::EndVmCommand: Vm is
null - not performing endAction on Vm
2016-08-17 08:43:33,602 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
or
]
(DefaultQuartzScheduler6) [5d314e49] Correlation ID: 5d314e49, Call
Stack: null, Custom Event ID: -1, Message: Add-Disk operation
failed
to complete.
2016-08-17 08:43:33,605 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
or
]
(DefaultQuartzScheduler6) [] Correlation ID: 5f5a8daf, Call Stack:
null, Custom Event ID: -1, Message: Failed to create OVF store disk
for Storage Domain hosted_storage.
OVF data won't be updated meanwhile for that domain.
2016-08-17 08:43:36,460 INFO
[org.ovirt.engine.core.bll.scheduling.HaReservationHandling]
(DefaultQuartzScheduler7) [5d314e49] HA reservation status for
cluster
'Default' is 'OK'
2016-08-17 08:43:36,662 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(DefaultQuartzScheduler4) [5f5a8daf] Command
'ProcessOvfUpdateForStorageDomain' id:
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child commands
'[84959a4b-6a10-4d22-b37e-6c154e17a0da,
eb2e6f1a-c756-4ccd-85a1-60d97d6880de]' executions were completed,
status 'FAILED'
2016-08-17 08:43:37,691 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStor
ag
eDomainCommand]
(DefaultQuartzScheduler6) [5f5a8daf] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStor
ag
eDomainCommand'
with failure.
Can you please check vdsm logs for that time frame on the SPM host?
I sent in attachment the vdsm logs from both hosts, but i think the
SPM
host on this time frame it was ied-blade13
It seams that you also have an issue in the SPM election procedure:
2016-08-17 18:04:31,053 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] SPM Init: could not find reported vds
or
not up - pool: 'Default' vds_spm_id: '2'
2016-08-17 18:04:31,076 INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] SPM selection - vds seems as spm
'hosted_engine_2'
2016-08-17 18:04:31,076 WARN
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] spm vds is non responsive, stopping
spm
selection.
2016-08-17 18:04:31,539 INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher]
(DefaultQuartzScheduler7) [] Fetched 1 VMs from VDS
'06372186-572c-41ad-916f-7cbb0aba5302'
probably due to:
2016-08-17 18:02:33,569 ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
(DefaultQuartzScheduler6) [] Failure to refresh Vds runtime info:
VDSGenericException: VDSNetworkException: Message timeout which can
be
caused by communication issues
2016-08-17 18:02:33,569 ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
(DefaultQuartzScheduler6) [] Exception:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
VDSGenericException: VDSNetworkException: Message timeout which can
be
caused by communication issues
This messages maybe cause by connection issues from yesterday at 6pm.
can you please check if the engine VM could correctly resolve and
reach each host?
Now i can read engine VM from both hosts
[root@ied-blade11 ~]# ping ied-hosted-engine
PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84)
bytes
of data.
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=1 ttl=64 time=0.179 ms
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=2 ttl=64 time=0.141 ms
^C
--- ied-hosted-engine.install.eurotux.local ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.141/0.160/0.179/0.019 ms
[root@ied-blade13 ~]# ping ied-hosted-engine
PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84)
bytes
of data.
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=1 ttl=64 time=0.172 ms
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=2 ttl=64 time=0.169 ms
^C
--- ied-hosted-engine.install.eurotux.local ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1000ms
rtt min/avg/max/mdev = 0.169/0.170/0.172/0.013 ms
I have a message critical of low disk space on hosted_storage domain.
I have 50G of disk and i created i VM with 40G. Do i need more space
of
OVF_STORAGE?
What is the minimum requirements of disk space for deploy engine VM?
Regards,
Carlos
Regards,
Carlos Rodrigues
Regards,
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.c
om
(t) +351 253 680 300 (m) +351 911 926 110
_________________________________________
__
____
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/u
se
rs
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
_____________________________________________
__
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
12:29 p.m.
--=-G412zPDCG8DfgOzneuZG
Content-Type: multipart/alternative; boundary="=-3octl6QdY29YyJBiKbpy"
--=-3octl6QdY29YyJBiKbpy
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
After night, the OVF_STORE it was created:
Regards,
Carlos Rodrigues
On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote:
> > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues <cmar(a)eurotux.com>
wrote:
> On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote:
> > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues
<cmar(a)eurotux.com> wrote:
> > >
> > > > > > > I increase hosted_engine disk space to 160G. How do i
force to
create
> > > OVF_STORE.
> >
> > > > > I think that restarting the engine on the engine VM will trigger
it
> > although I'm not sure that it was a size issue.
> >
>
> > > I found to OVF_STORE on another storage domain with "Domain
Type"
"Data (Master)"
>
>
> Each storage domain has its own OVF_STORE volumes; you should get
them also on
the hosted-engine storage domain.
Not really sure about how to trigger it again; adding Roy here.
>
>
>
> > >
> > > Regards,
> > > Carlos Rodrigues
> > >
> > > On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote:
> > > >
> > > > On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote:
> > > > >
> > > > >
> > > > > > > > > > > On Thu, Aug 18, 2016 at 12:11 PM,
Carlos Rodrigues
<cmar(a)eurotux.co
> > > > > m>
> > > > > wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > > > > > > > > > On Thu, 2016-08-18 at
11:53 +0200, Simone Tiraboschi
wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > On Thu, Aug
18, 2016 at 11:50 AM, Carlos Rodrigues
<cmar@eurotu
> > > > > > > x.
> > > > > > > com>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > On
Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi
wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues
<cmar@eu
> > > > > > > > > ro
> > > > > > > > > tux.
> > > > > > > > > com> wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > On Thu, 2016-08-18 at 11:04 +0200, Simone
Tiraboschi
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos
Rodrigues
> > > > > > > > > > > <cmar@
> > > > > > > > > > > euro
> > > > > > > > > > > tux.com>
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone
Tiraboschi
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos
Rodrigues
> > > > > > > > > > > > >
<cmar@
> > > > > > > > > > > > > eurotux.
> > > > > > > > > > > > > com>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Thu, 2016-08-18
at 08:54 +0200, Simone
> > > > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > On Tue, Aug 16, 2016 at
12:53 PM,
Carlos
> > > > > > > > > > > > > >
> Rodrigues <c
> > > > > > > > > > > > > > > mar@euro
> > > > > > > > > > > > > > > tux.
> > > > > > > > > > > > > > > com>
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Sun,
2016-08-14 at 14:22 +0300,
Roy Golan
> > > > > > > > > > > > > >
> > wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On
12 August 2016 at 20:23, Carlos
> > > > > > > > > > > > > > > > >
Rodrigues
> > > > > > > > > > > > > > > > >
<cma
> > > > > > > > > > > > > > > > >
r@eurotu
> > > > > > > > > > > > > > > > >
x.co
> > > > > > > > > > > > > > > > >
m>
> > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Hello,
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> I have one cluster with two hosts
with
> > > > > > > > > > > > > >
> > > > power
> > > > > > > > > > > > > > > > > >
management
> > > > > > > > > > > > > > > > > >
correctly
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> configured and one virtual
machine with
> > > > > > > > > > > > > >
> > > > HostedEngine
> > > > > > > > > > > > > > > > > >
over
> > > > > > > > > > > > > > > > > >
shared
> > > > > > > > > > > > > > > > > >
storage with FiberChannel.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> When i shutdown the network of
host with
> > > > > > > > > > > > > >
> > > > HostedEngine
> > > > > > > > > > > > > > > > > >
VM, it
> > > > > > > > > > > > > > > > > >
should be
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> possible the HostedEngine VM
migrate
> > > > > > > > > > > > > >
> > > > automatically to
> > > > > > > > > > > > > > > > > >
another
> > > > > > > > > > > > > > > > > >
host?
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
migrate on which network?
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> What is the expected behaviour on
this HA
> > > > > > > > > > > > > >
> > > > scenario?
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
After a few minutes your vm will be
> > > > > > > > > > > > > > > > >
shutdown
> > > > > > > > > > > > > > > > > by
> > > > > > > > > > > > > > > > > the
High
> > > > > > > > > > > > > > > > >
Availability
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
agent, as it can't see network, and
started
> > > > > > > > > > > > > >
> > > on
> > > > > > > > > > > > > > > > >
another
> > > > > > > > > > > > > > > > >
host.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > I'm testing
this scenario and after
shutdown
> > > > > > > > > > > > > >
> > network, it
> > > > > > > > > > > > > > > > should
> > > > > > > > > > > > > > > > be
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > expected that
agent shutdown ha and
started
> > > > > > > > > > > > > >
> > on
> > > > > > > > > > > > > > > > another
> > > > > > > > > > > > > > > > host,
> > > > > > > > > > > > > > > > but
> > > > > > > > > > > > > > > > after
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > couple minutes
nothing happens and on
host
> > > > > > > > > > > > > >
> > with
> > > > > > > > > > > > > > > > network
we
> > > > > > > > > > > > > > > > getting
> > > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > > following
messages:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Aug 16
11:44:08 ied-
> > > > > > > > > > > > > > > >
blade11.install.eurotux.local
> > > > > > > > > > > > > > > >
ovirt-ha-
> > > > > > > > > > > > > > > >
agent[2779]:
> > > > > > > > > > > > > > > >
ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
ovirt_hosted_engine_ha.agent.hosted_e
ngine.Ho
> > > > > > > > > > > > > >
> > st
> > > > > > > > > > > > > > > > edEn
> > > > > > > > > > > > > > > > gine.con
> > > > > > > > > > > > > > > > fig
> > > > > > > > > > > > > > > > ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Unable to get
vm.conf from OVF_STORE,
falling
> > > > > > > > > > > > > >
> > back
> > > > > > > > > > > > > > > > to
> > > > > > > > > > > > > > > > initial
> > > > > > > > > > > > > > > > vm.conf
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > I think the HA
agent its trying to
get vm
> > > > > > > > > > > > > >
> > configuration but
> > > > > > > > > > > > > > > > some
> > > > > > > > > > > > > > > > how it
> > > > > > > > > > > > > > > > can't
get vm.conf to start VM.
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > No, this is a
different issues.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > In 3.6 we added a feature
to let the
engine
> > > > > > > > > > > > > >
> manage
> > > > > > > > > > > > > > > also the
> > > > > > > > > > > > > > > engine VM
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > itself; ovirt-ha-agent
will pickup the
latest
> > > > > > > > > > > > > >
> engine
> > > > > > > > > > > > > > > VM
> > > > > > > > > > > > > > > configuration
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > from the OVF_STORE which
is managed by
the
> > > > > > > > > > > > > >
> engine.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > If something goes wrong,
ovirt-ha-agent
could
> > > > > > > > > > > > > >
> fallback to the
> > > > > > > > > > > > > > > initial
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > (bootstrap time) vm.conf.
This will
normally
> > > > > > > > > > > > > >
> happen
> > > > > > > > > > > > > > > till you
> > > > > > > > > > > > > > > add
> > > > > > > > > > > > > > > your
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > first regular storage
domain and the
engine
> > > > > > > > > > > > > >
> imports
> > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > engine
> > > > > > > > > > > > > > > VM.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > But i already have my first storage
domain and
> > > > > > > > > > > > > >
storage
> > > > > > > > > > > > > > engine
> > > > > > > > > > > > > > domain
> > > > > > > > > > > > > > and already
imported engine VM.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > I'm using 4.0
version.
> > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > This seams an issue, can you please share
your
> > > > > > > > > > > > >
/var/log/ovirt-hosted-engine-ha/agent.log ?
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > I sent it in attachment.
> > > > > > > > > > >
> > > > > > > > > > > Nothing strange here;
> > > > > > > > > > > > > > > > > >
> > > > > do you see a couple of disks with alias
OVF_STORE on
> > > > > > > > > > > the
> > > > > > > > > > > hosted-
> > > > > > > > > > > engine
> > > > > > > > > > > storage domain if you check it
from the engine?
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Do you mean any disk label?
> > > > > > > > > > I don't have it anyone:
> > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > [root@ied-blade11 ~]# ls /dev/disk/by-label/
> > > > > > > > > > > > > > > > > >
> > > ls: cannot access /dev/disk/by-label/: No such
file or
> > > > > > > > > > directory
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> No I mean: go to the engine web-ui, select the
hosted-
> > > > > > > > > engine
> > > > > > > > > storage
> > > > > > > > > domain, check the disks there.
> > > > > > > >
> > > > > > > > No, the alias is virtio-disk0.
> > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > And this is
the engine VM disk, so the issue is why the
engine
> > > > > > > has
> > > > > > > still to create the OVF_STORE.
> > > > > > > > > > > > > > > Can you please
share your engine.log from the engine
VM?
> > > > > > >
> > > > > >
> > > > > > Go in attachment.
> > > > >
> > > > > > > > > > > The creation of the OVF_STORE disk
failed but it's not that
clear
> > > > > why:
> > > > >
> > > > > 2016-08-17 08:43:33,538 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolume
ForStora
> > > > > ge
> > > > > DomainCommand]
> > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Ending command
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolume
ForStora
> > > > > ge
> > > > > DomainCommand'
> > > > > with failure.
> > > > > 2016-08-17 08:43:33,540 ERROR
> > > > > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Ending command
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand'
with
> > > > > failure.
> > > > > 2016-08-17 08:43:33,541 WARN
> > > > > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4]
VmCommand::EndVmCommand: Vm is
> > > > > null - not performing endAction on Vm
> > > > > 2016-08-17 08:43:33,553 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditL
ogDirect
> > > > > or
> > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4] Correlation ID:
6f1f1fd4, Call
> > > > > > > > > > > Stack: null,
Custom Event ID: -1, Message: Add-Disk
operation
> > > > > failed
> > > > > to complete.
> > > > > 2016-08-17 08:43:33,557 WARN
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditL
ogDirect
> > > > > or
> > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler6) []
Correlation ID: 19ac5bda, Call
Stack:
> > > > > > > > > > > null, Custom
Event ID: -1, Message: Failed to create OVF
store disk
> > > > > for Storage Domain hosted_storage.
> > > > > OVF data won't be updated meanwhile for that domain.
> > > > > 2016-08-17 08:43:33,585 INFO
> > > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCall
back]
> > > > > (DefaultQuartzScheduler6) [5f5a8daf]
Command
> > > > > 'ProcessOvfUpdateForStorageDomain' (id:
> > > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting on child
command
> > > > > id:
> > > > > 'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > > > > type:'CreateOvfVolumeForStorageDomain' to complete
> > > > > 2016-08-17 08:43:33,595 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolume
ForStora
> > > > > ge
> > > > > DomainCommand]
> > > > > (DefaultQuartzScheduler6) [5d314e49] Ending command
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolume
ForStora
> > > > > ge
> > > > > DomainCommand'
> > > > > with failure.
> > > > > 2016-08-17 08:43:33,596 ERROR
> > > > > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > > > (DefaultQuartzScheduler6) [5d314e49] Ending command
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand'
with
> > > > > failure.
> > > > > 2016-08-17 08:43:33,596 WARN
> > > > > [org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49]
VmCommand::EndVmCommand: Vm is
> > > > > null - not performing endAction on Vm
> > > > > 2016-08-17 08:43:33,602 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditL
ogDirect
> > > > > or
> > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49] Correlation ID:
5d314e49, Call
> > > > > > > > > > > Stack: null,
Custom Event ID: -1, Message: Add-Disk
operation
> > > > > failed
> > > > > to complete.
> > > > > 2016-08-17 08:43:33,605 WARN
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditL
ogDirect
> > > > > or
> > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler6) []
Correlation ID: 5f5a8daf, Call
Stack:
> > > > > > > > > > > null, Custom
Event ID: -1, Message: Failed to create OVF
store disk
> > > > > for Storage Domain hosted_storage.
> > > > > OVF data won't be updated meanwhile for that domain.
> > > > > 2016-08-17 08:43:36,460 INFO
> > > > > > > > > > >
[org.ovirt.engine.core.bll.scheduling.HaReservationHandling
]
> > > > > > > > > > >
(DefaultQuartzScheduler7) [5d314e49] HA reservation status
for
> > > > > cluster
> > > > > 'Default' is 'OK'
> > > > > 2016-08-17 08:43:36,662 INFO
> > > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCall
back]
> > > > > (DefaultQuartzScheduler4) [5f5a8daf]
Command
> > > > > 'ProcessOvfUpdateForStorageDomain' id:
> > > > > '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child commands
> > > > > '[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > > > > > > > > > >
eb2e6f1a-c756-4ccd-85a1-60d97d6880de]' executions were
completed,
> > > > > status 'FAILED'
> > > > > 2016-08-17 08:43:37,691 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdat
eForStor
> > > > > ag
> > > > > eDomainCommand]
> > > > > (DefaultQuartzScheduler6) [5f5a8daf] Ending command
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdat
eForStor
> > > > > ag
> > > > > eDomainCommand'
> > > > > with failure.
> > > > >
> > > > > > > > > > > Can you please check vdsm logs for
that time frame on the
SPM host?
> > > > >
> > > >
> > > > > > > > > I sent in attachment the vdsm logs from both
hosts, but i
think the
> > > > SPM
> > > > host on this time frame it was ied-blade13
> > > >
> > > > >
> > > > >
> > > > >
> > > > > > > > > > > It seams that you also have an
issue in the SPM election
procedure:
> > > > >
> > > > > 2016-08-17 18:04:31,053 ERROR
> > > > > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> > > > > > > > > > > (DefaultQuartzScheduler1) [] SPM
Init: could not find
reported vds
> > > > > or
> > > > > not up - pool: 'Default' vds_spm_id: '2'
> > > > > 2016-08-17 18:04:31,076 INFO
> > > > > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> > > > > > > > > > > (DefaultQuartzScheduler1) [] SPM
selection - vds seems as
spm
> > > > > 'hosted_engine_2'
> > > > > 2016-08-17 18:04:31,076 WARN
> > > > > [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
> > > > > > > > > > > (DefaultQuartzScheduler1) [] spm
vds is non responsive,
stopping
> > > > > spm
> > > > > selection.
> > > > > 2016-08-17 18:04:31,539 INFO
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFe
tcher]
> > > > > (DefaultQuartzScheduler7) [] Fetched 1 VMs
from VDS
> > > > > '06372186-572c-41ad-916f-7cbb0aba5302'
> > > > >
> > > > > probably due to:
> > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
> > > > > > > > > > > (DefaultQuartzScheduler6) []
Failure to refresh Vds runtime
info:
> > > > > > > > > > >
VDSGenericException: VDSNetworkException: Message timeout
which can
> > > > > be
> > > > > caused by communication issues
> > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
> > > > > (DefaultQuartzScheduler6) [] Exception:
> > > > > > > > > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkExcepti
on:
> > > > > > > > > > >
VDSGenericException: VDSNetworkException: Message timeout
which can
> > > > > be
> > > > > caused by communication issues
> > > > >
> > > >
> > > > > > > > > This messages maybe cause by connection
issues from yesterday
at 6pm.
> > > >
> > > > >
> > > > >
> > > > > > > > > > > can you please check if the engine
VM could correctly
resolve and
> > > > > reach each host?
> > > >
> > > > Now i can read engine VM from both hosts
> > > >
> > > > > > > > > [root@ied-blade11 ~]# ping
ied-hosted-engine
> > > > > > > > > PING ied-hosted-engine.install.eurotux.local
(10.10.4.115)
56(84)
> > > > bytes
> > > > of data.
> > > > > > > > > 64 bytes from
ied-hosted-engine.install.eurotux.local
(10.10.4.115):
> > > > icmp_seq=1 ttl=64 time=0.179 ms
> > > > > > > > > 64 bytes from
ied-hosted-engine.install.eurotux.local
(10.10.4.115):
> > > > icmp_seq=2 ttl=64 time=0.141 ms
> > > > ^C
> > > > > > > > > --- ied-hosted-engine.install.eurotux.local
ping statistics
---
> > > > 2 packets transmitted, 2 received, 0% packet
loss, time 999ms
> > > > rtt min/avg/max/mdev = 0.141/0.160/0.179/0.019 ms
> > > > > > > > > [root@ied-blade13 ~]# ping
ied-hosted-engine
> > > > > > > > > PING ied-hosted-engine.install.eurotux.local
(10.10.4.115)
56(84)
> > > > bytes
> > > > of data.
> > > > > > > > > 64 bytes from
ied-hosted-engine.install.eurotux.local
(10.10.4.115):
> > > > icmp_seq=1 ttl=64 time=0.172 ms
> > > > > > > > > 64 bytes from
ied-hosted-engine.install.eurotux.local
(10.10.4.115):
> > > > icmp_seq=2 ttl=64 time=0.169 ms
> > > > ^C
> > > > > > > > > --- ied-hosted-engine.install.eurotux.local
ping statistics
---
> > > > > > > > > 2 packets transmitted, 2
received, 0% packet loss, time
1000ms
> > > > rtt min/avg/max/mdev = 0.169/0.170/0.172/0.013
ms
> > > >
> > > >
> > > > > > > > > I have a message critical of low disk space
on hosted_storage
domain.
> > > > > > > > > I have 50G of disk and i
created i VM with 40G. Do i need
more space
> > > > of
> > > > OVF_STORAGE?
> > > > > > > > > What is the minimum requirements of disk
space for deploy
engine VM?
> > > >
> > > > Regards,
> > > > Carlos
> > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Regards,
> > > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Regards,
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
--
> > > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> Eurotux Informática, S.A. |
www.eurotux.c
> > > > > > > > > > > > > >
> > > > om
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> (t) +351 253 680 300 (m) +351 911
926 110
> > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> _________________________________
________
> > > > > > > > > > > > > >
> > > > __
> > > > > > > > > > > > > > > > > >
____
> > > > > > > > > > > > > > > > > >
Users mailing list
> > > > > > > > > > > > > > > > > >
Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> http://lists.ovirt.org/mailman/li
stinfo/u
> > > > > > > > > > > > > >
> > > > se
> > > > > > > > > > > > > > > > > >
rs
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Eurotux
Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> (t) +351 253 680 300 (m) +351 911 926
110
> > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
_____________________________________
________
> > > > > > > > > > > > > >
> > __
> > > > > > > > > > > > > > > > Users
mailing list
> > > > > > > > > > > > > > > >
Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
http://lists.ovirt.org/mailman/listin
fo/users
> > > > > > > > > > > > > >
--
> > > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > > >
(t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > >
> > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > >
> > > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > (t) +351 253 680 300 (m) +351
911 926 110
> > > > > > > > > > --
> > > > > > > > > > Carlos Rodrigues
> > > > > > > > > >
> > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > >
> > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > (t) +351 253 680 300 (m) +351 911 926
110
> > > > > > > > > >
> > > > > > > > --
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > Engenheiro de Software Sénior
> > > > > > > >
> > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > --
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > Engenheiro de Software Sénior
> > > > > >
> > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > _______________________________________________
> > > > Users mailing list
> > > > Users(a)ovirt.org
> > > > http://lists.ovirt.org/mailman/listinfo/users
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> > >
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
>
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--=-3octl6QdY29YyJBiKbpy
Content-Type: text/html; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
<html><head></head><body><div>After night, the OVF_STORE it
was created:</d=
iv><div><br></div><div><img
src=3D"cid:1471598954.2337.13.camel@eurotux.com=
">=E2=80=8B<br></div><div><br></div><div>Regards,</div><div>Carlos
Rodrigue=
s</div><div><br></div><div>On Fri, 2016-08-19 at 08:29
+0200, Simone Tirabo=
schi wrote:</div><blockquote
type=3D"cite"><div><br></div><div><br></div><d=
iv>On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues <<a
href=3D"mailto:=
cmar@eurotux.com">cmar(a)eurotux.com</a>&gt;
wrote:</div><blockquote type=3D"=
cite"><div>On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi
wrote:</div=
<blockquote type=3D"cite"><div>On Thu, Aug 18,
2016 at 5:43 PM, Carlos Rod=
rigues &lt;cmar(a)eurotux.com&gt;
wrote:</div><blockquote type=3D"cite"><div>=
<br></div><div>I increase hosted_engine disk space to 160G. How do i
force =
to
create</div><div>OVF_STORE.</div></blockquote><div><br></div><div>I
thin=
k that restarting the engine on the engine VM will trigger it</div><div>alt=
hough I'm not sure that it was a size
issue.</div><div><br></div></blockquo=
te><div><br></div><div>I found to OVF_STORE on another storage
domain with =
"Domain Type" "Data
(Master)"</div><div><br></div><div><br></div></blockquo=
te><div><br></div><div>Each storage domain has its own
OVF_STORE volumes; y=
ou should get them also on the hosted-engine storage domain.</div><div>Not =
really sure about how to trigger it again; adding Roy
here.</div><div><br><=
/div><div><br></div><div><br></div><div> </div><blockquote
type=3D"cit=
e"><div><br></div><div><br></div><div><br></div><blockquote
type=3D"cite"><=
blockquote
type=3D"cite"><div><br></div><div>Regards,</div><div>Carlos
Rodr=
igues</div><div><br></div><div>On Thu, 2016-08-18 at 12:14
+0100, Carlos Ro=
drigues wrote:</div><blockquote
type=3D"cite"><div><br></div><div>On Thu, 2=
016-08-18 at 12:34 +0200, Simone Tiraboschi wrote:</div><blockquote type=3D=
"cite"><div><br></div><div><br></div><div>On
Thu, Aug 18, 2016 at 12:11 PM,=
Carlos Rodrigues
<cmar@eurotux.co</div><div>m></div><div>wrote:</div=
<blockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div><di=
v>On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi
wrote:</div><blockqu=
ote
type=3D"cite"><div><br></div><div><br></div><div><br></div><div><br></d=
iv><div><br></div><div>On Thu, Aug 18, 2016 at 11:50 AM, Carlos
Rodrigues &=
lt;cmar@eurotu</div><div>x.</div><div>com></div><div>wrote:</div><blockq=
uote
type=3D"cite"><div><br></div><div><br></div><div><br></div><div>On
Thu=
, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote:</div><blockquote type=
=3D"cite"><div><br></div><div><br></div><div><br></div><div>On
Thu, Aug 18,=
2016 at 11:25 AM, Carlos Rodrigues <<a
href=3D"mailto:cmar@eu">cmar@eu<=
/a></div><div>ro</div><div>tux.</div><div>com>
wrote:</div><blockquote t=
ype=3D"cite"><div><br></div><div><br></div><div><br></div><div><br></div><d=
iv>On Thu, 2016-08-18 at 11:04 +0200, Simone
Tiraboschi</div><div>wrote:</d=
iv><blockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div><=
div><br></div><div>On Thu, Aug 18, 2016 at 10:36 AM, Carlos
Rodrigues</div>=
<div><cmar@</div><div>euro</div><div>tux.com></div><div>wrote:</div><=
blockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div><div>=
<br></div><div><br></div><div>On Thu, 2016-08-18 at
10:27 +0200, Simone Tir=
aboschi</div><div>wrote:</div><blockquote
type=3D"cite"><div><br></div><div=
<br></div><div><br></div><div><br></div><div><br></div><div>On
Thu, Aug 18=
, 2016 at 10:22 AM, Carlos
Rodrigues</div><div>&lt;cmar(a)</div><div>eurotux.=
</div><div>com></div><div>wrote:</div><blockquote
type=3D"cite"><div><br=
</div><div><br></div><div><br></div><div><br></div><div><br></div><div><br=
</div><div>On Thu, 2016-08-18 at 08:54 +0200,
Simone</div><div>Tiraboschi<=
/div><div>wrote:</div><blockquote
type=3D"cite"><div><br></div><div><br></d=
iv><div><br></div><div><br></div><div><br></div><div><br></div><div>On
Tue,=
Aug 16, 2016 at 12:53 PM, Carlos</div><div>Rodrigues
<c</div><div><a hr=
ef=3D"mailto:mar@euro">mar@euro</a></div><div>tux.</div><div>com></div><=
div>wrote:</div><blockquote
type=3D"cite"><div><br></div><div><br></div><di=
v><br></div><div><br></div><div><br></div><div><br></div><div><br></div><di=
v>On Sun, 2016-08-14 at 14:22 +0300, Roy
Golan</div><div>wrote:</div><block=
quote
type=3D"cite"><div><br></div><div><br></div><div><br></div><div><br><=
/div><div><br></div><div><br></div><div><br></div><div><br></div><div><br><=
/div><div>On 12 August 2016 at 20:23,
Carlos</div><div>Rodrigues</div><div>=
<cma</div><div><a
href=3D"mailto:r@eurotu">r@eurotu</a></div><div>x.co</=
div><div>m></div><div>wrote:</div><blockquote
type=3D"cite"><div><br></d=
iv><div><br></div><div><br></div><div><br></div><div><br></div><div><br></d=
iv><div><br></div><div>Hello,</div><div><br></div><div>I
have one cluster w=
ith two hosts
with</div><div>power</div><div>management</div><div>correctly=
</div><div>configured and one virtual machine
with</div><div>HostedEngine</=
div><div>over</div><div>shared</div><div>storage with
FiberChannel.</div><d=
iv><br></div><div>When i shutdown the network of host
with</div><div>Hosted=
Engine</div><div>VM, it</div><div>should
be</div><div>possible t=
he HostedEngine VM migrate</div><div>automatically
to</div><div>another</di=
v><div>host?</div><div><br></div></blockquote><div>migrate
on which network=
?</div><div><br></div><blockquote
type=3D"cite"><div><br></div><div><br></d=
iv><div><br></div><div><br></div><div><br></div><div><br></div><div><br></d=
iv><div>What is the expected behaviour on this
HA</div><div>scenario?</div>=
</blockquote><div><br></div><div>After a few minutes your vm
will be</div><=
div>shutdown</div><div>by</div><div>the
High</div><div>Availability</div><d=
iv>agent, as it can't see network, and
started</div><div>on</div><div>anoth=
er</div><div>host.</div></blockquote><div><br></div><div><br></div><div>I'm=
testing this scenario and after shutdown</div><div>network,
it</div><div>s=
hould</div><div>be</div><div>expected that agent shutdown ha and
started</d=
iv><div>on</div><div>another</div><div>host,</div><div>but</div><div>after<=
/div><div>couple minutes nothing happens and on
host</div><div>with</div><d=
iv>network
we</div><div>getting</div><div>the</div><div>following
messages:=
</div><div><br></div><div>Aug 16 11:44:08
ied-</div><div>blade11.install.eu=
rotux.local</div><div>ovirt-ha-</div><div>agent[2779]:</div><div>ovirt-ha-a=
gent</div><div>ovirt_hosted_engine_ha.agent.hosted_engine.Ho</div><div>st</=
div><div>edEn</div><div>gine.con</div><div>fig</div><div>ERROR</div><div>Un=
able to get vm.conf from OVF_STORE,
falling</div><div>back</div><div>to</di=
v><div>initial</div><div>vm.conf</div><div><br></div><div>I
think the HA ag=
ent its trying to get vm</div><div>configuration
but</div><div>some</div><d=
iv>how it</div><div>can't get vm.conf to start
VM.</div></blockquote><div><=
br></div><div>No, this is a different issues.</div><div>In 3.6
we added a f=
eature to let the engine</div><div>manage</div><div>also
the</div><div>engi=
ne VM</div><div>itself; ovirt-ha-agent will pickup the
latest</div><div>eng=
ine</div><div>VM</div><div>configuration</div><div>from
the OVF_STORE which=
is managed by the</div><div>engine.</div><div>If something goes
wrong, ovi=
rt-ha-agent could</div><div>fallback to
the</div><div>initial</div><div>(bo=
otstrap time) vm.conf. This will
normally</div><div>happen</div><div>till y=
ou</div><div>add</div><div>your</div><div>first
regular storage domain and =
the
engine</div><div>imports</div><div>the</div><div>engine</div><div>VM.</=
div></blockquote><div><br></div><div>But i already have
my first storage do=
main
and</div><div>storage</div><div>engine</div><div>domain</div><div>and
=
already imported engine VM.</div><div><br></div><div>I'm
using 4.0 version.=
</div></blockquote><div><br></div><div>This seams an
issue, can you please =
share your</div><div>/var/log/ovirt-hosted-engine-ha/agent.log
?</div><div>=
<br></div></blockquote><div><br></div><div>I
sent it in attachment.</div></=
blockquote><div><br></div><div>Nothing strange
here;</div><div>do you see a=
couple of disks with alias OVF_STORE
on</div><div>the</div><div>hosted-</d=
iv><div>engine</div><div>storage domain if you check it from the
engine?</d=
iv><div><br></div></blockquote><div><br></div><div>Do
you mean any disk lab=
el?</div><div>I don't have it
anyone:</div><div><br></div><div>[<a href=3D"=
mailto:root@ied-blade11">root@ied-blade11</a> ~]# ls
/dev/disk/b=
y-label/</div><div>ls: cannot access /dev/disk/by-label/: No such file
or</=
div><div>directory</div></blockquote><div><br></div><div>No
I mean: go to t=
he engine web-ui, select the
hosted-</div><div>engine</div><div>storage</di=
v><div>domain, check the disks
there.</div></blockquote><div><br></div><div=
No, the alias is
virtio-disk0.</div><div><br></div></blockquote><div><br><=
/div><div>And this is the engine VM disk, so the issue is why the
engine</d=
iv><div>has</div><div>still to create the
OVF_STORE.</div><div>Can you plea=
se share your engine.log from the engine
VM?</div><div><br></div></blockquo=
te><div><br></div><div>Go in
attachment.</div></blockquote><div><br></div><=
div>The creation of the OVF_STORE disk failed but it's not that clear</div>=
<div>why:</div><div><br></div><div>2016-08-17
08:43:33,538 ERROR</div><div>=
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora</div><d=
iv>ge</div><div>DomainCommand]</div><div>(DefaultQuartzScheduler6)
[6f1f1fd=
4] Ending
command</div><div>'org.ovirt.engine.core.bll.storage.ovfstore.Cre=
ateOvfVolumeForStora</div><div>ge</div><div>DomainCommand'</div><div>with
f=
ailure.</div><div>2016-08-17 08:43:33,540
ERROR</div><div>[org.ovirt.engine=
.core.bll.storage.disk.AddDiskCommand]</div><div>(DefaultQuartzScheduler6) =
[6f1f1fd4] Ending
command</div><div>'org.ovirt.engine.core.bll.storage.disk=
.AddDiskCommand' with</div><div>failure.</div><div>2016-08-17
08:43:33,541 =
WARN</div><div>[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]</div=
<div>(DefaultQuartzScheduler6) [6f1f1fd4]
VmCommand::EndVmCommand: Vm is</=
div><div>null - not performing
endAction on Vm</div><div>2016-08-17 08:43:3=
3,553 ERROR</div><div>[org.ovirt.engine.core.dal.dbbroker.auditloghandling.=
AuditLogDirect</div><div>or</div><div>]</div><div>(DefaultQuartzScheduler6)=
[6f1f1fd4] Correlation ID: 6f1f1fd4, Call</div><div>Stack: null, Custom Ev=
ent ID: -1, Message: Add-Disk
operation</div><div>failed</div><div>to compl=
ete.</div><div>2016-08-17 08:43:33,557
WARN</div><div>[org.ovirt.engine.cor=
e.dal.dbbroker.auditloghandling.AuditLogDirect</div><div>or</div><div>]</di=
v><div>(DefaultQuartzScheduler6) [] Correlation ID: 19ac5bda, Call Stack:</=
div><div>null, Custom Event ID: -1, Message: Failed to create OVF store dis=
k</div><div>for Storage Domain
hosted_storage.</div><div> OVF data won=
't be updated meanwhile for that domain.</div><div>2016-08-17 08:43:33,585
=
INFO</div><div>[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallb=
ack]</div><div>(DefaultQuartzScheduler6) [5f5a8daf]
Command</div><div>'Proc=
essOvfUpdateForStorageDomain'
(id:</div><div>'71aaaafe-7b9e-45e8-a40c-6d33b=
df646a0') waiting on child
command</div><div>id:</div><div>'eb2e6f1a-c756-4=
ccd-85a1-60d97d6880de'</div><div>type:'CreateOvfVolumeForStorageDomain'
to =
complete</div><div>2016-08-17 08:43:33,595
ERROR</div><div>[org.ovirt.engin=
e.core.bll.storage.ovfstore.CreateOvfVolumeForStora</div><div>ge</div><div>=
DomainCommand]</div><div>(DefaultQuartzScheduler6) [5d314e49] Ending comman=
d</div><div>'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForS=
tora</div><div>ge</div><div>DomainCommand'</div><div>with
failure.</div><di=
v>2016-08-17 08:43:33,596
ERROR</div><div>[org.ovirt.engine.core.bll.storag=
e.disk.AddDiskCommand]</div><div>(DefaultQuartzScheduler6) [5d314e49] Endin=
g
command</div><div>'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand'=
with</div><div>failure.</div><div>2016-08-17 08:43:33,596
WARN</div><div>[=
org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]</div><div>(DefaultQu=
artzScheduler6) [5d314e49] VmCommand::EndVmCommand: Vm is</div><div>null - =
not performing endAction on Vm</div><div>2016-08-17 08:43:33,602
ERROR</div=
<div>[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect</=
div><div>or</div><div>]</div><div>(DefaultQuartzScheduler6)
[5d314e49] Corr=
elation ID: 5d314e49, Call</div><div>Stack: null, Custom Event ID: -1, Mess=
age: Add-Disk operation</div><div>failed</div><div>to
complete.</div><div>2=
016-08-17 08:43:33,605 WARN</div><div>[org.ovirt.engine.core.dal.dbbroker.a=
uditloghandling.AuditLogDirect</div><div>or</div><div>]</div><div>(DefaultQ=
uartzScheduler6) [] Correlation ID: 5f5a8daf, Call Stack:</div><div>null, C=
ustom Event ID: -1, Message: Failed to create OVF store disk</div><div>for =
Storage Domain hosted_storage.</div><div> OVF data won't be
updated me=
anwhile for that domain.</div><div>2016-08-17 08:43:36,460
INFO</div><div>[=
org.ovirt.engine.core.bll.scheduling.HaReservationHandling]</div><div>(Defa=
ultQuartzScheduler7) [5d314e49] HA reservation status for</div><div>cluster=
</div><div>'Default' is 'OK'</div><div>2016-08-17
08:43:36,662 INFO</div><d=
iv>[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]</div><d=
iv>(DefaultQuartzScheduler4) [5f5a8daf]
Command</div><div>'ProcessOvfUpdate=
ForStorageDomain'
id:</div><div>'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' chil=
d
commands</div><div>'[84959a4b-6a10-4d22-b37e-6c154e17a0da,</div><div>eb2e=
6f1a-c756-4ccd-85a1-60d97d6880de]' executions were
completed,</div><div>sta=
tus 'FAILED'</div><div>2016-08-17 08:43:37,691
ERROR</div><div>[org.ovirt.e=
ngine.core.bll.storage.ovfstore.ProcessOvfUpdateForStor</div><div>ag</div><=
div>eDomainCommand]</div><div>(DefaultQuartzScheduler6) [5f5a8daf] Ending
c=
ommand</div><div>'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpda=
teForStor</div><div>ag</div><div>eDomainCommand'</div><div>with
failure.</d=
iv><div><br></div><div>Can you please check vdsm logs for that
time frame o=
n the SPM
host?</div><div><br></div></blockquote><div><br></div><div>I
sent=
in attachment the vdsm logs from both hosts, but i think the</div><div>SPM=
</div><div>host on this time frame it was
ied-blade13</div><div><br></div><=
blockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div><div>=
It seams that you also have an issue in the SPM election procedure:</div><d=
iv><br></div><div>2016-08-17 18:04:31,053
ERROR</div><div>[org.ovirt.engine=
.core.vdsbroker.irsbroker.IrsProxyData]</div><div>(DefaultQuartzScheduler1)=
[] SPM Init: could not find reported
vds</div><div>or</div><div>not up - p=
ool: 'Default' vds_spm_id: '2'</div><div>2016-08-17
18:04:31,076 INFO</div>=
<div>[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]</div><div>(De=
faultQuartzScheduler1) [] SPM selection - vds seems as
spm</div><div>'hoste=
d_engine_2'</div><div>2016-08-17 18:04:31,076
WARN</div><div>[org.ovirt.eng=
ine.core.vdsbroker.irsbroker.IrsProxyData]</div><div>(DefaultQuartzSchedule=
r1) [] spm vds is non responsive,
stopping</div><div>spm</div><div>selectio=
n.</div><div>2016-08-17 18:04:31,539
INFO</div><div>[org.ovirt.engine.core.=
vdsbroker.monitoring.VmsStatisticsFetcher]</div><div>(DefaultQuartzSchedule=
r7) [] Fetched 1 VMs from
VDS</div><div>'06372186-572c-41ad-916f-7cbb0aba53=
02'</div><div><br></div><div>probably due
to:</div><div>2016-08-17 18:02:33=
,569 ERROR</div><div>[org.ovirt.engine.core.vdsbroker.monitoring.HostMonito=
ring]</div><div>(DefaultQuartzScheduler6) [] Failure to refresh Vds runtime=
info:</div><div>VDSGenericException: VDSNetworkException: Message timeout =
which can</div><div>be</div><div>caused by communication
issues</div><div>2=
016-08-17 18:02:33,569 ERROR</div><div>[org.ovirt.engine.core.vdsbroker.mon=
itoring.HostMonitoring]</div><div>(DefaultQuartzScheduler6) []
Exception:</=
div><div>org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:</di=
v><div>VDSGenericException: VDSNetworkException: Message timeout which can<=
/div><div>be</div><div>caused by communication
issues</div><div><br></div><=
/blockquote><div><br></div><div>This messages maybe cause by
connection iss=
ues from yesterday at 6pm.</div><div><br></div><blockquote
type=3D"cite"><d=
iv><br></div><div><br></div><div>can you please
check if the engine VM coul=
d correctly resolve and</div><div>reach each
host?</div></blockquote><div><=
br></div><div>Now i can read engine VM from both
hosts</div><div><br></div>=
<div>[<a href=3D"mailto:root@ied-blade11">root@ied-blade11</a>
~]# ping ied=
-hosted-engine</div><div>PING ied-hosted-engine.install.eurotux.local (10.1=
0.4.115) 56(84)</div><div>bytes</div><div>of
data.</div><div>64 bytes from =
ied-hosted-engine.install.eurotux.local (10.10.4.115):</div><div>icmp_seq=
=3D1 ttl=3D64 time=3D0.179 ms</div><div>64 bytes from ied-hosted-engine.ins=
tall.eurotux.local (10.10.4.115):</div><div>icmp_seq=3D2 ttl=3D64 time=3D0.=
141 ms</div><div>^C</div><div>---
ied-hosted-engine.install.eurotux.local p=
ing statistics ---</div><div>2 packets transmitted, 2 received, 0% packet l=
oss, time 999ms</div><div>rtt min/avg/max/mdev =3D 0.141/0.160/0.179/0.019 =
ms</div><div>[<a
href=3D"mailto:root@ied-blade13">root@ied-blade13</a> ~]# =
ping ied-hosted-engine</div><div>PING ied-hosted-engine.install.eurotux.loc=
al (10.10.4.115) 56(84)</div><div>bytes</div><div>of
data.</div><div>64 byt=
es from ied-hosted-engine.install.eurotux.local (10.10.4.115):</div><div>ic=
mp_seq=3D1 ttl=3D64 time=3D0.172 ms</div><div>64 bytes from ied-hosted-engi=
ne.install.eurotux.local (10.10.4.115):</div><div>icmp_seq=3D2 ttl=3D64 tim=
e=3D0.169 ms</div><div>^C</div><div>---
ied-hosted-engine.install.eurotux.l=
ocal ping statistics ---</div><div>2 packets transmitted, 2 received, 0% pa=
cket loss, time 1000ms</div><div>rtt min/avg/max/mdev =3D 0.169/0.170/0.172=
/0.013
ms</div><div><br></div><div><br></div><div>I
have a message critical=
of low disk space on hosted_storage domain.</div><div>I have 50G of disk a=
nd i created i VM with 40G. Do i need more
space</div><div>of</div><div>OVF=
_STORAGE?</div><div>What is the minimum requirements of disk space for depl=
oy engine
VM?</div><div><br></div><div>Regards,</div><div>Carlos</div><div>=
<br></div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><br>=
</div><div><br></div><blockquote
type=3D"cite"><div><br></div><div><br></di=
v><div><br></div><blockquote
type=3D"cite"><div><br></div><div><br></div><d=
iv><br></div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><=
br></div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><br><=
/div><blockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div=
<blockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div><bl=
ockquote
type=3D"cite"><div><br></div><div><br></div><div><br></div><blockq=
uote
type=3D"cite"><div><br></div><div><br></div><div><br></div><blockquote=
type=3D"cite"><div><br></div><div><br></div><div><br></div><blockquote
typ=
e=3D"cite"><div><br></div><div><br></div><div><br></div><blockquote
type=3D=
"cite"><div><br></div><div><br></div><div><br></div><div>Regards,</div><div=
Carlos
Rodrigues</div><div><br></div><div><br></div><blockquote
type=3D"ci=
te"><div><br></div><div><br></div><div><br></div><div><br></div><div><br></=
div><div><br></div><div><br></div><blockquote
type=3D"cite"><div><br></div>=
<div><br></div><div><br></div><div><br></div><div><br></div><div><br></div>=
<div><br></div><div><br></div><div>Regards,</div><div><br></div><div>--</di=
v><div>Carlos
Rodrigues</div><div><br></div><div>Engenheiro de Software
S=
=C3=A9nior</div><div><br></div><div>Eurotux
Inform=C3=A1tica, S.A. | www.eu=
rotux.c</div><div>om</div><div>(t) +351 253 680 300 (m) +351 911
926 110</d=
iv><div><br></div><div>_________________________________________</div><div>=
__</div><div>____</div><div>Users mailing
list</div><div><a href=3D"mailto:=
Users@ovirt.org">Users@ovirt.org</a></div><div>http://lists.ovirt.org/mailm=
an/listinfo/u</div><div>se</div><div>rs</div><div><br></div></blockquote><d=
iv><br></div></blockquote><div>--</div><div>Carlos
Rodrigues</div><div><br>=
</div><div>Engenheiro de Software
S=C3=A9nior</div><div><br></div><div>Euro=
tux Inform=C3=A1tica, S.A. | www.eurotux.com</div><div>(t) +351 253 680 300=
(m) +351 911 926
110</div><div><br></div><div>____________________________=
_________________</div><div>__</div><div>Users mailing
list</div><div><a hr=
ef=3D"mailto:Users@ovirt.org">Users@ovirt.org</a></div><div>http://lists.ov=
irt.org/mailman/listinfo/users</div></blockquote></blockqu...
<div>Carlos
Rodrigues</div><div><br></div><div>Engenheiro de Software
S=C3=
=A9nior</div><div><br></div><div>Eurotux Inform=C3=A1tica,
S.A. | www.eurot=
ux.com</div><div>(t) +351 253 680 300 (m) +351 911 926
110</div><div><br></=
div></blockquote></blockquote><div>--</div><div>Carlos
Rodrigues</div><div>=
<br></div><div>Engenheiro de Software
S=C3=A9nior</div><div><br></div><div>=
Eurotux Inform=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com">www.eurotux.co=
m</a></div><div>(t) +351 253 680 300 (m) +351 911 926
110</div></blockquote=
</blockquote><div>--</div><div>Carlos
Rodrigues</div><div><br></div><div>E=
ngenheiro de
Software S=C3=A9nior</div><div><br></div><div>Eurotux
Inform=
=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com">www.eurotux.com</a></div><di=
v>(t) +351 253 680 300 (m) +351 911 926
110</div><div><br></div></blockquot=
e></blockquote><div>--</div><div>Carlos
Rodrigues</div><div><br></div><div>=
Engenheiro de Software
S=C3=A9nior</div><div><br></div><div>Eurotux Inform=
=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com">www.eurotux.com</a></div><di=
v>(t) +351 253 680 300 (m) +351 911 926
110</div><div><br></div><div><br></=
div></blockquote><div><br></div></blockquote><div>--</div><div>Carlos
Rodri=
gues</div><div><br></div><div>Engenheiro de Software
S=C3=A9nior</div><div>=
<br></div><div>Eurotux Inform=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com"=
www.eurotux.com</a></div><div>(t) +351 253 680 300
(m) +351 911 926 110</d=
iv></blockquote></blockquote><div>_________________________________________=
______</div><div>Users mailing list</div><div><a
href=3D"mailto:Users@ovirt=
.org">Users(a)ovirt.org</a></div><div><a
href=3D"http://lists.ovirt.org/mailm=
an/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users&...
/blockquote><div>--</div><div>Carlos
Rodrigues</div><div><br></div><div>Eng=
enheiro de Software
S=C3=A9nior</div><div><br></div><div>Eurotux Inform=C3=
=A1tica, S.A. | <a
href=3D"www.eurotux.com">www.eurotux.com</a></div><div>(=
t) +351 253 680 300 (m) +351 911 926
110</div><div><br></div></blockquote><=
/blockquote><div>-- </div><div>Carlos
Rodrigues </div><div><br></=
div><div>Engenheiro de Software
S=C3=A9nior</div><div><br></div><div>Eurotu=
x Inform=C3=A1tica, S.A. | <a
href=3D"www.eurotux.com">www.eurotux.com=
</a></div><div>(t) +351 253 680 300 (m) +351 911 926
110</div><div><br></di=
v><div><br></div></blockquote><div><br></div></blockquote><div><span><pre>-=
- <br></pre><div>Carlos
Rodrigues <br><br>Engenheiro de Software S=C3=
=A9nior<br><br>Eurotux Inform=C3=A1tica, S.A. | <a
href=3D"http://www.=
eurotux.com/">www.eurotux.com</a><br>(t) +351 253 680 300 (m) +351 911
926 =
110<br><br></div></span></div></body></html>
--=-3octl6QdY29YyJBiKbpy--
--=-G412zPDCG8DfgOzneuZG
Content-ID: <1471598954.2337.13.camel(a)eurotux.com>
Content-Disposition: inline; filename="unknown-MB3RMY"
Content-Type: image/png; name="unknown-MB3RMY"
Content-Transfer-Encoding: base64
iVBORw0KGgoAAAANSUhEUgAAA/sAAAImCAYAAAAMr5p/AAAABHNCSVQICAgIfAhkiAAAIABJREFU
eJzs3Xd4VGX68PHv1CSTnpBCElpC74HQUZpdsKEuFnRtiOha9hVddV2Xta27uu6qqz9RV0UsoKg0
O1KkGzqhBQImIYT0MqkzmXn/GGaYCVMz6dyf68oFmXPmnOfc5z5POS2KuXPnmuPi4lAoFFRUVFBY
WIjZbMaZhoYGTCYTb775ptPpVqWlpfzjH/+w/a5Wq4mIiGDQoEFMnjyZwMBAt993R6/X8/zzzzNg
wABuu+02n6e3hnfeeYesrCyeffZZ1Gq123nnzZuHUqkEaLXY5ubmkpeXx+jRo73YGkdms5mtW7fy
66+/UlhYiEajITY2lgsuuIBBgwb5vLzmLJs/fN0PrniKT3PnZ1vFq7Hmip871txPTk7mnnvusX2+
a9culi5dypQpU7jkkkv8WkdHyz/7+uD222+nf//+ABQWFvKvf/3Lq5i01ja3ZN3cOH6fffZZk5d1
LPsU/1vyPQcyf6NCX01YSDAXjBrE3FunowsKAODQsRwyj59kxkVjm6X8bW3WrFmtdvxaOWu7fMmR
9tDWW/l6/L733nscPXqUBx54gMTERNvn33//PevWreO6665jwIABXm1fcx2/nuJpv/8mTZrEZZdd
Zpu2aNEiDh48iFarZcGCBS1Whvayz1u6vWt8rACEhITQs2dPpk+fTnh4uN/raMtY+hq/l19+meLi
YqfTEhMTeeCBB5q9jM74GrPWaFv9yUVv6qFRo0a5/H57OR790dzH8kMPPeT0c7VazcyZMxk/fjwG
g4HFixeze/duv9blC7W3A/2miI6OZty4cdTU1JCZmcn69es5ePAg8+bNIyAgoNnWcz7yJ7Y///wz
FRUVTaqAVq5cyZYtW4iMjGTMmDGoVCr27t3L4sWLuf766xk5cmRTN8nvsrUHnuLTr1+/Zl1fR49X
e9OR4/nNN9/Qt29fW8PlrY68zc2tpraOR/72f5hNZm65ZirRUWFs2XGAFT9tpbbewJP3zwLgoy/X
UFhS3mkG+63JXdsVGBjI7NmzCQ0NbetitqgRI0Zw9OhR9u/f79DJPnDgAGq1miFDhqBWq72KRWsf
vyqViv3799sG+0ajkaNHj/pc7zTF+ZIfVlFRUYwZMwaz2UxeXh579+6ltLSU+++/H4VC0dbFazVT
pkyhtrYWsLRzGo2Giy++GLCcBGmv2nvb6k09JJqH0Wjkiy++QKFQMG7cOG655RYAnwf8CoWC2NhY
1Go1p06dwmQyOUxXKpV07doVo9FIQUGBbUyvtg70i4qKmnWgDxAeHs6ECRMAmDZtGkuXLmX37t1s
2bKFyZMnc/DgQX744QeKiooIDw9nypQptsFieno669evp6ysDJ1Ox8iRI7noootsy1apVHz//fds
2bIFnU7H9OnTGThwoMP6V6xYwY4dOwgMDOSaa65hwIABABQXF7Ny5UqysrJQKBR0796dK6+8kvj4
eACX5SovL+fvf/87aWlplJaWUllZySOPPEJGRgYrVqygtraW1NTUZo9jc8b2lVdeoaioCIAnnniC
p556ipycHJf7wV5xcTFbt24lLCyMP/zhDwQFBQGWs/yLFy+msrISsJzN/Pbbb8nNzSUoKIipU6cy
evRoW/xGjx6NSqVix44dBAcH2/ads7KVlZW5XVbjfeEqb1qjI+JtfOzl5eXx+uuvM2bMGK655hrg
3DtDXG3Tq6++2qHj1VI8Hd++xPPQoUMdIj5JSUnk5uaybds2xo0bd850V8dk42MOsN05UV9fz4IF
CzCZTDz22GNERkaydOlS9u3bxzPPPEN5ebnLODvLN/u7MQAOHTrEokWLGDFiBNdff327yMXTRWVU
VFYzcdRgZl01GYBpE1IZOaQvSfFdAJj9yD/IySsEYPLv5vPl23+hpraO1z9Yzu4DxwAFg/v1ZN7s
6SR370pBcRk3znueK6aMIr+wlJKySj545VE27zjAu599x8n8IqIjw5h93TQun2y5irJh+z5e+9/X
6KtrueSCEZRVVLFh+z5Wf/AswUGBHDqWw1uLV3Ek6yQhwYHcdt1FHebEg7u2Ky0tjY8++sjhSpGn
voBVe8wnVwYPHszXX39NRkYGl156KQBFRUUUFBQwZMgQ210O9rFwdkyZTCaH4/eOO+7g/fffd9ue
uOt3eSM+Pp6TJ09y+vRp4uLiOHLkCAaDgYSEBFtZwHU/CuDUqVOsXr2a3NxcAgMDSU1NtQ3ewHX/
rra21mlMXPUpwHXdB65zqz3kCEBERAQXXnih7ffS0lJycnIoKSkhOjraY1vnaXpj7TUe9vn53Xff
odFobHUIeO5zpqWl0dDQwL59+4iOjuamm27i559/5sCBA8THx3PrrbcSHh5OWVkZL730EoMHD0al
UnHgwAGCgoIcxg+N+dLXdtU/g7aJvTf1kC855Kk/W1VV5dP+gI59/DbW0NDAsmXL0Gg0pKWlcdNN
N2EwGMjIyPB6GWq1mrFjxzJhwgQ2bdrE6tWrMRqNtmlXXnmlbdo333yDwWAAQGm9ot/47EBzUygU
TJw4EYDMzEwqKyv55JNPUCqVzJ07l/DwcJYtW0ZhYSHFxcUsW7aMbt26ce+993LBBRewefNmDh8+
bFve8ePHqampYfLkyZSXl7Ns2TKHbcjMzCQ4OJhrr70Wg8HAZ599Rl1dHQaDgYULF5KTk8O1117L
NddcQ05ODosWLcJoNLotl0qlAmDfvn0kJCRw2WWXodfrbbeM3nLLLURERPDbb7+1aCwb8yW2N998
M2q1mpiYGO677z6MRqPLeRs7fvw4ZrOZ4cOH2wayADqdjjlz5jB58mT0ej3vvvsu5eXlzJkzh+HD
h/PVV19x8uRJW/x2795NVFQUs2bNoqqqyrbvGpetoaHB47Ls94U3edOSvImPr9xtU0ePV1MVFRWx
atUq24/9mVFPx7cv8ayuru4w8enduzc9evTgp59+oqamxmGau2Oy8TYPHjyY3NxczGYzx48fR6lU
EhISwokTJwDIycmhe/fumM1mt3F2lm/2Tp06xaeffkqfPn247rrr2k0uJsRFEx0Zxqb0DBb8ezHf
rP2V3LxCrpw6mmEDkwH468O3olGr6J4Yy5vPPUCAVsNDC/6PA5nZ/PHumTxy93UczMzmiX+8j8Fg
RH0mFuu37qNPz0TuveVKiksreObVj1CrlLy+YB5xXSL45/99TvbJAkrL9Tz72ic0mMw89cBNRISH
sGXnAQA0ajWl5ZX88dm3KS6t4D/PzOWiCam88s4yDmfltmqsmkPjtqsxb/OiveaTKxqNhsGDB1NY
WEhBQQGArcOXmprq9DvOjqnGx69Op3O7Xnd9A291794dtVrN/v37beWOjY0lLCzMq/XU19fzv//9
j8LCQm688UYGDx7MunXr+OWXX2zf99S/axwTV30Kd3Vfe88RZ6z7t6GhwWNb52l6Yx0xHuC+fbM/
Zvr06cPEiRM5ffo0CxcupG/fvkyaNInc3FzWr18PYHvs9sCBA/Tv3585c+ZgNptt44fGfOlru+uf
tVXsPdVDvuaQJ77uj852/IKlj/rJJ5/w66+/EhgYyO9//3tSUlJ8+v6JEyfQaDRMnTqVmTNnolKp
UKlUzJw5k6lTp6LRaDhx4oRtoA/g/oFyFzzdPmQ/3f7/ERERAFRXVxMQEMC8efMICQkhLCyMgQMH
kpWVRX5+Pl27dgUsz50WFhYyePBgLrjgAsCy8wGCgoK49tprAcjKyiIzMxO9Xm9LppiYGNvZ/5yc
HDZv3syJEyeor6+noqKCqVOnMmLECMBy5mjz5s1kZWXRs2dPl+VKTrZ09sLDw7nyyisBSyNjNBoZ
PXo0/fr1o1+/fqSnp1NcXIxCofD5VquWju3QoUMBCAgIoEePHtTV1bmcNzY21mHd1tuoQkNDXZbz
8OHD1NXVMWXKFJKSkoiPj2fDhg3s2LGDadOmAdClSxfb/kxJSeHgwYPo9XoSEhIcypaenu5xWfb7
wtphcZY3vmrKLXLexMf6uTU3XO1P6+/Wu0TcbVN7iJer7WxO1mVWVFSwadMmp9MPHTrk9viOiooC
vItnS8bHE2/jZ53PbDYzffp03nzzTX7++WfGjBljm+7umLz66quBs9ucn5/P/v37KSwsJCsri27d
uhEeHk5WVhYDBgyguLiY4cOHe4yz9ZZA+3yz1t1VVVV8+OGHhIWFceutt6JSqbzK89ag1aj5zzP3
8f7nP7B99yHWbtkDQGJ8Fx6+61pGDe1LSo8EUCgIDNAysE8P1m7ZQ1FJObOvm8YlF1quQB0+lsOX
321ix/6j9O1liUVMdDj3zZ4OQHVNHW899wciwoLpEhXOuBED2ZVxjKO/naLB1IDBYGT6tNFcMHow
F4wezI+/7ORUQQkAW3YeorqmjluvmUbf5CR6JMWxZOV6vlv3K/2Sk5olDi15/Db+v33b1bh+dJcX
7TmfvInfiBEj2LlzJxkZGcTFxZGRkUFISAj9+/d3aBsatxX2x5SV9fjNy8tzWQaFQuG2b2Dt37jq
t1g/02q19OnTh4yMDKZOncrhw4cZPXo0p06d8mo9p0+fRq/Xc/HFFzNo0CD69etHcnIyISEhtnV4
6t81jomrPkVmZqbLum/8+PFA2/UXvFmewWCgrKwMs9lMTk4Ox44dIzIykpiYGPbv3++2Dq6rq/Oq
jvbmWGtpTYmf9Tve9DljYmIYMWIElZWVrFu3joiICNLS0qipqWHNmjUUFhY65FNCQoLtpNuwYcPY
uHEjJ06cICkpybZuT3neuK/trn/Wlrnorh7ylGONc8hTf9b6mbf7w92+bc6YNS5ne7dnzx4+++wz
brzxRsaPH28r87hx4zAajSxdupQ9e/Y4fEdtPRtbVFTU4lf3S0tLgbPP2Kxfv95WGVsrmoaGBmJi
Ypg+fTrr1q1j6dKlgOU21VtuuQWNRgPgMBC1Ls9gMNgaA2sHArA936XX620DMvvp1ttFysvL3ZbL
Kjo62vZ/a4fD/rmh8PBwly8TaSnextYZb+e1nlW2xsmeyWRCqVRSXV0NwE8//cTPP/8MWAYi9vGw
j731hYL2Z6CsvFmW/b5wlzeRkZFOt705eRMfX/myTR0tXk2VnJzMnDlzbL/v2rWLJUuWAJYTAeD6
+O7Xr5/X29zR4tOtWzeGDh3Kli1bHM4Ue5MXVtbv5eTkkJWVRf/+/QkNDeWXX34hOzsbs9lMnz59
yMnJAVzH2doJsM83q+zsbNsVlMrKSqKjo9tVrJO6duHpB2/GbDbz28kCNqcf4IMvfmDBvxfz1dt/
QaNxPEdeWGw53mOjz8Yi5sz/C4vLbIP9rrFRDt/7dMU6ft17mOrqOsycrXfLKixtSpfIsy/h6hob
ZRvsV1RWAfD+Fz+w6MufADCZzZw83bptTnNp3HbZ86Yv0N7zyZWUlBTCw8M5cOAAaWlp5ObmMm7c
OI/thLNjyhe+9A1cGTRoEF988QV79+6lqqqKQYMG2Qb7ntZTVWXJX2u/TK1W217ua+1PeerfNeaq
T+Gu7usIOZKTk8NLL71k+z0kJIQbb7wRpVLpsa2rr693O93+GW3oeO2dlTftm3WcY32flTWnrL83
HvvYvxMiODgYOJubjXl7PLXXXHRXD3nKscY55C1v90d7jZk/NBoNs2bNIi0tjdraWhYtWsSxY8d8
Xs62bdswGo3cdNNNtkc3DQYDn376KTt27DhnfrXZbLYF3tsX9Hmax3669f9ms5kNGzYA0L9/f375
5Rf27NnDFVdcwcSJE1m/fj3ff/89ZrMZs9nM+PHjGT9+PCUlJRw4cIBvvvmGtWvX2p7rss7nat3l
5eUO/wdLQmm1WsDSwbBOt3Y2wsPDPZar8XqsA7yKigrbPNbluSqjt7HzNL2psbUvm7fbC5ZKQalU
snv3biZPnmyrBKurq3njjTfo3r277Tm5Cy64wOE5K41Gc866XW2bdbq1UnG3rMYxcZU31qsE3mrK
exe8ic/06dMdttHasbNvKMrKyhzm8bRN7SFejbXEeytcbYN93ljrMlfHty/xhJaLjy/b6u18ZrOZ
Sy+9lIyMDNauXWv7zJu8sG5zdHQ0YWFhHDlyhLy8PC6//HJCQ0P56quv2L9/P1qtlsTERFud6i7O
jcto/bdHjx5cddVV/Pe//2X58uXccccdQNvF2t7O/UdZs2k3l1w4gmEDkumZFEfPpDh2Zhwlfe8R
yvXVdIkMc/hObBdLR6iguMz2WUGRJRZxXc52OuwHcZ+v3sCaTbu4b/Z0brjyQj5bvo6Fn34DQGiI
pU0pKq2wzX+66OyyY88sc9aMyVw26ez+DNBq/Nt4O611/DZuu5y1EZ76Au0xn7yNX2pqKuvXryc9
PR2z2cyIESPOOV6ssXBV/9nP46k98aVv4G6bBgwYgFKp5McffyQyMtKh0+9pPdaOvX2faevWrYSG
htKzZ0+vytA4Jq7m91T3tWV/wZvlxcXF2f6aSkBAAN26dUOr1XrV1llvO/dUR3ek9s7Zd3xp3xof
Q65+t95NAY7jh6b0n73tn7VlLrqqh7zpT9lvozf9Wfv/e9ofrRUzey3R9llZb7VPS0ujvr6eTz/9
1Kfn9RvbsWMHDQ0Ntpf9ffzxxy5f+Ke2vmTF1wG/N8rKytiwYQMGg4GjR49y4sQJEhISGDNmDD/8
8ANgGQgdP36cvXv3AlBQUMCuXbv46quvmDZtGn379iUyMhKFQuHwHLQnBQUFbNiwgcjISPbs2UNg
YCC9evUCLEm6bds22xsLd+3aRZcuXUhOTubo0aMuy9W9e/dz1tO7d29UKhXbt28nKSmJ7Oxspy9i
a25NjW19fT0ajYaSkhIOHjxoO3Pnal7ryRGwxO3CCy9k3bp1vP766wwaNAi1Ws3evXspKytj8uTJ
9OnTB51OR0ZGBikpKRQUFLB9+3YuvPBC+vTp43G77MvWvXt3n5Z18OBBPv30U7/yxh/exKexyMhI
NBoNR44c4ejRo+Tm5jqcQfa0TR05Xi2hX79+bo9vX+JZW1vrdz3U2iIjI5kwYYLtmTfA7TGZmprq
sM3JyckkJyezd+9elEql7fnc4OBgdu3aRXJyMiqVymOcrXdQOaPT6Wx11ZYtW9i/fz8qlapd5GJQ
oJbv1v/KpvT9TJ82lqiIUH47eZqd+4+SEBdtG+gHaDXknS5mU3oGQ/v3IiY6nOU/bCGlRwL19Qa+
37CDbl1jSB3cm0p99Tnrqa6xdMQrKqvZcyCLNZt2AXA8N5/LJ41CpVKyas1W+vRM4OhvebaTBwCj
hvUlLFTHL9v3kToohey8Alb8uJVZMybZHiNoz9y1XY3zxps6qj3nkyepqamsW7eODRs2EBMT06Qr
ZfbHb1JSktv2xDoA9LZ/44pOp6NXr14cO3bM4UVp3qxn3Lhx6HQ6tm3bRkJCAidPnmTNmjVcfPHF
tsF+c3FX9wUGBrb7HAkODj7nxdNWnupgk8nkUx3dUfsD/vY5nSkoKGD9+vVER0c7jB+sd0tYucvz
xn1td/2zts5FV/WQr+28p/6srzr68WvP+qf3xo0bh8FgcDsw94X9MtwtT6nX622v5w8LCyM6OrrZ
nlkoKSnh22+/Zc2aNZSWljJ+/Hjuuece1Go148ePp1u3bmzcuJFvv/2WG264gYSEBDZu3EhwcDDj
x49ny5YttrP1o0aNYurUqR7XaX1pxMCBA8nPz2fp0qVotVpuuukmtFotWq2Wu+++m6SkJJYuXcrX
X39NSkoKd955p8dyZWdnn7O+0NBQZs6cidlsZsmSJdTV1dkqGF9vjfNFU2Obk5Nj+zuPX3zxBcOG
DXM7b2OXXnopM2fOJCQkhO3bt7N9+3bCwsK45ZZbGD16NEFBQdxxxx3odDoWLVrE2rVrSU5O9vpP
eNiXraGhwadl9evXr8l501w8xacxrVbLtddei1qtZvHixVRXV9v+VrrJZPK4TR09Xs3N0/HtSzy7
devWIeMzZcoU210lgMdj0n6b9Xq9raNoHegD9OrVC6PRaLvN31OcvXHxxRej0+lYuXIlPXv2bBex
HtC7Oy/96S6Suyew8qetvPHhCjZs28+UccN45c9nHx2ZeflEDAYjL721lNq6ev719L30792NF//7
Ga++9xUjBvfh5afuQaN2ftvxdZdPZEDv7ixdvYGFn6zmyQdm0btnAl+s/oXCkjIen3sjJpOZv7+1
hEp9NUP6W05UK4DQ4CD+8cTdhIboeOqfH/DRl2tIHZTClPHDWyNEfnPXdjXmSx3VHvPJk9jYWBIT
E6mtrbU9E+sr++O3vr7ebXvia//GncGDBwPYbsFvXCZX6yksLOTOO++kS5cuLFmyhF9//ZVJkyY1
6QW2nrir+zp6++epDva1ju6o8fC3z+lM3759OX36NEuWLHEYPzTmS1/bXf+srWPvqh7yNYc89Wd9
1VmOX6VSyZVXXsn48eMxGo18+umnzTLQt9q9e7fH5SluvfVWM1ieoYiNjcVkMnHy5Emnb55saGjA
ZDLx3//+t9kKeb67//77bbe+SGzbjuwH/0j8/CPx80/j+Fn/QkpHVVdvoKq6lqgIy7Ojdz32KvmF
Jax+/9kWWd+sWbMk//wgx+/5Rfa3f9pr/PR6PS+88AIDBgxg9uzZbV0cr7TXWHYUzR2/hx9++JzP
EhMTeeihh9BoNHz22Wds27bNr3U0he3UTEVFBSaTicDAQI+38bfkMw3nO4lt+yD7wT8SP/9I/M5f
NbV1zJz7LBq1mgV/nM3J/GKysk8xZdywViuD5J9/JH7nF9nf/mkv8XP3XoyOoqOWu71oifgZjUY2
bdrEiRMnznlLfmtxuA9Dr9dTXV3tcWNb+q395zOJbfsg+8E/Ej//SPzOX0GBATz36O28/fE3PP7i
ewTrArl00kjm3Tqj1cog+ecfid/5Rfa3f9pL/KzlMJvN7aZMvuqo5W4vWiJ+BQUFfPPNN07/6lhr
OeehC282tCWfRT/fSWzbB9kP/pH4+Ufid34bMbgPb7/4UJutX/LPPxK/84vsb/+0l/gFBQXx17/+
FWg/ZfJVRy13e9ES8TObzW060Acng31vyJmjliOxbR9kP/hH4ucfiZ9oS5J//pH4nV9kf/tH4td8
JJb+6azxa9Jgv63PUHRmEtv2QfaDfyR+/pH4ibYk+ecfid/5Rfa3fyR+zUdi6Z/OGj8Z7LczEtv2
QfaDfyR+/pH4ibYk+ecfid/5Rfa3fyR+zUdi6Z/OGr8mDfatf8teND+Jbfsg+8E/Ej//SPxEW5L8
84/E7/wi+9s/Er/mI7H0T2eNn8+DfYVC0WmfaWgLCoXC4f8S27Yh+8E/Ej//SPz80zh+wjeSf/6R
+J1fZH/7R+LXfCSW/jlf4qd46qmn5I8yCiGEEEIIIYQQnYjCbDbLYF8IIYQQQgghhOhElG1dACGE
EEIIIYQQQjQvGewLIYQQQgghhBCdjAz2hRBCCCGEEEKITkYG+0IIIYQQQgghRCcjg30hhBBCCCGE
EKKTUbd1AYQQQgghhBBCiI4iL7+A0rKyJn8/MiKChPjYFl+mDPaFEEIIIYQQQggvWAflKb36NnkZ
x44fAbANzltimSC38QshhBBCCCGEEF7xd1AOkNKrr8NV/JZYJshgXwghhBBCCCGE6HTcDvaLi4tJ
S0tj+fLlDp/PmDGD6urqZilAcXExo0ePZubMmcycOZNZs2bx6quvNtvyndm5cydPPvlksy5z9OjR
LVrmxr777rtzPusMsbTm3Keffurw+Y4dO0hLS2P79u3Nti5/dIZYV1dX884777BkyRLbz5dffkle
Xl6zrUMIIYQQQnReJ8sN/Gujnse+reCTHZVU1TW0dZHahZO5x2w/bbksj1f2ExMTee+996ioqGhS
4bwRGhrKsmXLWLZsGe+99x56vZ5HH320xdY3YsQIXnjhhRZbfkurra1l8eLFTqd1hlgmJCSwatUq
h89Wr15NQkJCs67HX50h1lqtlt/97ne2nwkTJvDTTz9hNpubdT1CCCGEEKJzOVhQx8ylVXxxADbk
BvHxkVAeXllJSaWBmvoGqmqNDvM/s7KojUrauuwH5YlJKX4vz34Zvg74Pb6gLzQ0lEsuuYS33nqL
xx9//JzpixYtYuPGjTQ0NJCcnMz8+fO5/vrr+fjjjwkNDeXxxx8nODiYv/zlLxQXFzNv3jyWLFni
cn3BwcE88cQTzJw5k4yMDAYNGsTbb7/N9u3bUavV9OjRg/nz57Nnzx7ef/99evbsyW+//UZMTAy9
evXi2LFjZGdn8+qrrxIaGsoLL7xAdnY2RqORgQMHMn/+fLZv384nn3zCrbfeygcffED37t0pLy+n
qKiIV199FZ1O51MQ7aWnp3ss16FDh/jf//5HUlISNTU11NbW8txzzxEcHOxyWxctWkR9fT1XXHEF
6enpZGdn88wzz7BgwYJOF8uQkBB0Oh2HDx+mX79+1NbWsnv3bgYMGABAQ0OD07Kkp6c7LUNAQIDT
+U0mE8899xxZWVlERkYSFBTE2LFjueqqq5zmtVar7XSxbiwuLg6TyURNTQ06nY49e/aQnZ2NyWQi
MjKSCRMmcPr0aXbt2kVERATl5eXodDoiIyMpKSmhvLycyy67jMDAQNLT0zl58iRKpZKIiAjGjx/P
ihUrGD9+PHFxcYDlJM7QoUPp1q2b03WpVCq/t0kIIYQQQjS/9JwaVswKITZUzfqjlbyVbqBBG8F/
1hcRQANKs4k/zehqm1+p6PwXk5p7oG+/LOuyT+Ye83rZHq/sm0wmbr75Znbs2MHhw4cdpu3cuZP0
9HQWLlzIe++9h1KpZPXq1YwaNYrdu3djNpspLS0lNzcXsAyEx44d67FQarWaoUOHcvToUdLT09m8
eTPvvPMOb7/9Nnq9nm+++Qa1Wk1WVhaPPPIIr732GmvWrKFv374sWLCAPn36sHHjRsrKyujduzfv
vPMO77//Prt27eLIkSMO6zly5AgPPvggzz//PF26dGHz5s1eBc5d2T1vyfmsAAAgAElEQVSVS6lU
cvToUebPn8+LL75IfHw8y5cvd7ut+/fv5x//+AdXXXUVd955J0lJSW4H+h09lpdffjkrVqwAYO3a
tQ4DP1dlcVUGV/Nv3LiRvLw83n//fRYsWEB6ejoKhcJlXnfWWNs7fvw4gYGBBAUFcerUKfLy8pgx
YwZXX301CoWCI0eOoFQqKS0tZdy4cVx++eUcP36c6OhopkyZQnR0NNnZ2eTl5ZGTk8NVV13FjBkz
qK+vJzMzk969e5OVlQVATU0NpaWlJCYmulyXEEIIIYRon2aPjCA21HLteFLvUO4aYiAu0IAuPBJN
ZAyJkZpG33Aceva5aLbLH39kZWXx9NNPc++996LX693OW1NTw2OPPca9995LXV2dX+ttqYG+s2V6
e4Xfqz+9p1arefTRR3nppZd47733bJ/v2LGD48ePM2fOHMASrIiICMaMGcOuXbuIj4+nZ8+eVFZW
cvr0adLT05k2bZpXBdPr9ahUKvbv309aWhpKpSU5RowYQUZGBj169KBXr16o1ZZNCA8Pp29fyxsM
IyIiqKysJDIykvLycu6//34CAwMpKiqirNEbCnv16kVgYCAAUVFRzfK4gqdyxcbG0r9/f4KCggDo
378/e/fupb6+3uW2JicnExYW1qTydMRYXnTRRbzzzjs8/PDDrFq1ivvvv9/26IKrsmi1WqdlcDV/
ZmYmqampKBQKwsLCSEtLA1zndWeMdX19PcuWLQMsz/CHh4dz6aWXolAoyMvLo7S0lJUrVwJgMBgI
DAwkMjKSyMhI27YFBAQQHR0NQGBgIHV1dVRXV5OQkIBCoQCga9euFBYWMnLkSJYvX864cePIysoi
JSUFpVLpcl1CCCGEEKL9OVhUS2SgmvgQS5/WbIYqgxltQw1xoWGolBBrdH8l//+e/SNzn/6X08+b
Kicnh9dff52kpCQKCgo8zv/ll19iMBiavD6rlh7o2y/blyv8Xg32wfICui+++ILVq1fbOvBarZZp
06bx8MMPO8xbXl7OZ599RkxMDCNGjKCiooIdO3awb98+5s+f73FddXV1ZGRk8Ic//IENGzacM926
/sa3+FoHHwBms5nVq1dz5MgRXn/9dZRKpW3wZq/xMprjWWVP5QLLHRNWJpPJtk2N2ce6KTpqLMPC
whgyZAhff/01hYWFDBw40DbNXVmclcHV/I3jbv2uq7z2pCPGWqvVMnPmTACOHTvGgQMHbCc2VCoV
ycnJ59yNk5+ff06+usrfxnQ6HWFhYRQUFJCVlWVbtqt1CSGEEEKI9mV/fi2HS9Tk681kFVdRoa/j
lSvDWHe4huBALTX6KkBBaqLj+MVsdnx537RxqTww+xre+Ohr22cPzL6GaeNSm1w2nU7Hn//8Z3bv
3u3xLlHr3bjTpk2zXXBqitYa6Nuvw9sBv09/eu+Pf/wjCxcuxGi0vGxh+PDhbNq0ifr6egA++ugj
Dh48SHh4OACbN29m5MiRpKam8uOPP9KlSxePg9a6ujpefPFFhg0bRnJyMkOHDmXHjh22wfGvv/7K
kCFDvCpvYWEhPXv2tN02n5mZ2SxnbprD4cOHbbeV7Ny5k759+3q9rUql0rYP3Onosbziiit46623
uOSSS/wqi6v5e/bsyf79+wGorKwkPT0dcJ3X7nT0WAOkpKSg0WjIyMgAID4+nuzsbBoaLBXznj17
KCws9GpZcXFxnDp1ynYS4uTJk7bn9Hv37s3hw4epra0lJibG73UJIYQQQojWk683oVWr0Wk1BKkV
XNFfTWiQmn//rivPXx3NVX0VTO1uZHCvcIfvKZXnXmd+6PaZTBk7HIApY4fz0O0z/SpbdHS07Y5T
d4xGI4sXL+b666/3+g5eV/x5gV5T+HJywafBfnx8PFdffbXtlohhw4Zx5ZVXcs899zBnzhwyMzNJ
SbGscMSIEZw8eZKYmBh69+7Nvn37XF61q6ys5MYbb+SGG27guuuuQ6fT8eyzz9qWM378eObOncvc
uXOJioriiiuu8Kq8l112Gdu2bWPevHksX76cO+64g//85z/n3BLdFnr37s0///lP5s2bR1VVFTNm
zPB6W+Pj4zGbzdxzzz3nTOtMsZwwYQIKhYLLL7/cq7KUl5f7VPbhw4ej1Wq58847efHFF0lNTUWl
UrnNa3udKdZWEydOZNeuXZSXlxMfH0/fvn1ZsWIFK1eupKSkhKioKK+W07VrV7p168aqVatYtWoV
QUFB9OnTB7A8gnD06FF69+5tm9+fdQkhhBBCiNZTrDeSU2aipNqEES0hGrC/yTMxVke/7uc+ftxg
d2ezvYXP/T+Hf1tCXV0der0evV6PyWTi22+/JTw8nAkTJjTL8ltrwO/rXQQKs/yNrVZnfav6v//9
77YuynmtrKyMrVu3ctlll2E2m7nrrrt49NFHHR4ZEEIIIYQQQpz18ppiDGYlBpOSnLpwKququW+4
gUn9wzldWsuq7ae569Ie53zvmZVFLJjRpVXKuGbNGpYuXcorr7xCSEgIS5cuZc2aNQA8/vjjfPTR
R+Tn56NUKjGZTJhMJtRqNS+//LLtvWquZBw6Qkqvvk6n+TIYP3b8CIP69/W4TF+Wbb9M8OGZfSE6
m5CQEDZt2sTHH3+MWq1m1KhRMtAXQgghhBDCjfsmhqNUKqmpa+Dx78oobYjgT7/U0/BDMYq6Gj64
2flt9N6+48kfdXV1lJeX2x6XLioqwmAwMHnyZIYPtzwukJCQwP333297LHrnzp0sX76cxx9/3O8X
RDf1T+R50tT3AsiVfSGEEEIIIYQQPquqa+DzHRX8mtNAt3AFt43SkRDt/sp4S9q9ezdvvfWWw2dJ
SUk8/fTTLr+zceNGPvroI1577TUCAgI8rqMlrsK3xN0CIIN9IYQQQgghhBDCK94M9r3h6238vi4T
fHxBnxBCCCGEEEIIIdo/GewLIYQQQgghhBBeiIyI4NjxI34t49jxI0Ta/cm/llgmyG38QgghhBBC
CCGE1/LyCyj1489iR0ZEkBAf2+LLlMG+EEIIIYQQQgjRycht/EIIIYQQQgghRCcjg30hhBBCCCGE
EKKTkcG+EEIIIYQQQgjRychgXwghhBBCCCGE6GRksC+EEEIIIYQQQnQyMtgXQgghhBBCCCE6GRns
CyGEEEIIIYQQnYw6t6SmrcsghBBCCCGEEEKIZqQO1QS1yIJPncyma2L3Fll2e1yv6Nwkr7wnsRIt
QfJKtATJK+ELyRch/CfHUeuS2/iFEEIIIYQQQohORgb7QgghhBBCCCFEJyODfSGEEEIIIYQQopOR
wb4QQgghhBBCCNHJyGBfCCGEEEIIIYToZGSwL4QQQgghhBBCdDIy2BdCCCGEEEIIIToZGewLIYQQ
QgghhBCdzHkz2N+0cT29ekTRq0cUfXvHMXXyKJ75y2NUVJS3+LrTf91Krx5RrF+/xuvvWMs7/crJ
mM1mAPbu3UWvHlHs3burpYoqmiA7+wT3zb2dYUN6MaBfIlfPmMaaNd+3dbG89u03Kzh0MKPF19PR
jsGJ44fZymv/89STf2zBkoqm+PSTD5k2ZTT9+3ZlZGofHn5wDlVVeqD18ttbklcdg319Zf/zw/er
W70s7S2HhXPtoS/gTzvblDxriW1ujnxvjjZBjrvW19T20Zt95a4f6C5fOoPzZrBvNWfO47z66mdc
fPH1LPlsMbNvvQGTydyi6xwyNJW163bTJ2UC9fW+ffdAxj6WfLrM4bPyUjAam7GAoskMBgO3z76e
bVs38cADT/HccwsJD49l7pzZ7NjRMU7K/O1vT7J/XwYNrZRTHeUYfP2/77Fw4QpuvPFuABYseJO3
317B9TPvpxO1AR1e5pFDPPnEI0yadCkff7yWRx55nlWrvuJfL7+C2dz6+e2J5FXHMmfO47z99grb
T0ryWOrrWrcM7S2HxbnaW1+gKe2sr3nWUtvsb743V5sgx13ra2r76Mu+qizHoR/oKV86g/NusJ+S
MoApU6fw6GOP8+BDT7F3Tzo/fr8egGVffMrUyaMY2D+Jq2dMY8eO7QBs3bKRXj2i+PerL5E2oi9j
xwxizU/fcc1VFzF4YHfeeP0VAOrr6/nT4w+ROiyFYUN68cxfHsNsNrNv7y6mTB7OkcxN7NxhWdab
/32VcWMHM2J4b774/BOX5Z0w4WLeeOMF9HqDw+eu1uVtWQHee/dNxoweSOqwFB79f/dTV1vb3OHu
9H768VtOnMjiT396meuvv5srp1/J2wsXM3/+8wRqu2A0+p9X/u5T6/ed5dzkC0eSfyqP+fPn8uab
/26VmHWUYzA1NY0p0ybSu3cvAAYNGsmkyRP5z3+e5KoZY2zz3T/vDiZdMMJ2RWXBM39iyqQ0Ro3s
x+dLP7bNJ8dbyziVnwdAZGQC/Qf056abb2TDxgPcd99fnOa3pxz7+4t/ZdCAbuTmZjvNJZPJxNN/
fpQhg3pw+WUX8Nj8PzCgX6KtPJ72s+RVx5KSMoCJF0xkylTLT/ce0ag13ufR8uVf+FV3tUUdLXzn
qS+waaNjXhSczneZQ/X19Tw2/w8MH5rMwP5JzLvv91RWVrj83BlX7ay3eeZqPl+22Whsnj6Ju2XY
x9PKlzbB23j88P1qevWI4kDGPgD+tuBJBvZPcru/hO9ctY+Dh6TwzTfOj5em5K49d/my9ucNLttf
d+v5ePH7TLpgBIMHdue+ubfb8qGt2uvzbrAPoFaDRgPTpk0B4NChDHbu3MX8Rx/gqqt+x/Ll6QQH
RzLn7tlUVtagVqsBOJ6Vy+dfrKOstJT5jz7Ia69/yOTJV/D6ay9TUW4g61gmKqWKtxd+yT/+8SGL
PnyXn9dssK1XXwlms2VZu3ftY+XKrfTtO4QXX1hAnYv9fdttD1JUlM9HH77vcIYpK8v5urwt6+ZN
G3ju2T/zysvv8tXXO9i08Rfeeedd6CRnsVrL0aNHABg+fDzBIRAYBEE6FXPm3kNKn25k7Pc/r/zd
p2qV65x7/8OlAPzlL6/zuxv/QE1168StoxyDajWcCZ/ldw3Mvu0OsrIy2bXjCEajkV82rGXGjJuo
rwsAoKiokpUrtzNmzBT+8vRjFBdVyvHWgsaMmcCgQcP417+eYtrUQTz88F3s3LGRyGj4YJFjfv+6
3XOO7d2TwWdLfuK34yUoneTSunU/sfij/3HPnD/y4gsf8MuG9SgUCooL8Xo/S151HCaTCTCiUFp+
NFrY70W9bs2jQG0c0PS6q63qaOEbT30BjdYxLw5kZLvMoQ3r1/D50o/5aPH3rFixC8wB/Lp9L+vX
Of/c1TjGWTt75LB3eXYgw31b6s02b93qf59k7c/ul2GNJ+ZozCZLuXxpE1xtZ+NyWO/mKSvF4epx
cSEu91dnuSrc2py1jwcP7eLxx5wfL03JXXvu8iUsTAs4b39d1dm7dqXz56f+H7fcOodPPlnH9m1b
efmf/2RTG7bXas+zdF4NDQ0AqFQq1q39CbPZzNVX301cfAQ33XQzDz54NzvT9xMcYpl/0qQriIlJ
oEePXnSJSSQ0JJFRo9NYvXopBafLiImNp7ikmPmP3oVGYwltbk4ewbpe56z7ssuuJyAghAkTJ7Bt
23rKy+qJjdeeM19MTDy3//5e3nnnZQYO/p/t81gP6/JU1o0bLVdS77vvZhQKy+1Y+/buorbWUmEL
7yiVlvNlJlMDao3jtMBAWL/e/7yyNhhN3aepqWmA85zTaCyFVqs1hEeoCAhs+ZjZ6wjHYGNTpl5C
QkISP/20ipra0ej1lVxxxU2UlOYCMHXqDFAoueSyi1m9eikZ+zPZuk2Ot5YSEBDA1yt+4ofv1rJl
y3o2b/6JVSu/4vbfp3P3PfcCZ/N7yxLPOXb11bfSs0c/auqKKVl8bi4VF2cDcOUVt5KQGM20aZfw
5ZefAbBpU9P3s+RV+/TEE3fyxBNnf1/1zXqv6iprHlVVlwJNr7tSki11V1vV0cI7nvoCSoXl/9a8
WLPmny5zKDmlD1ptAHPvvYHxEy7gmuuuYfSoieSdOur0c6MBNG6aLvt2NjrauzxTa53PZ6g/uy5P
27xls/99kvR098uwxjMoGDgTY1/aBFfb2Tge2gDX8XW1vzztF+E9d3VuSh/LCVVP+9RZPxDc58v0
6TMA5+3voCE9nK5n/76TAFx6yc3ExYexPf0wFWXw1lvPAm3TXp/Xg/1fflkLwODBI9m5a53t8yAd
mDhzihAlRqOlotRqtQQEgEqtQqvVolaDWq0CwGQy8+Z/X2Xd2h/58af9FBYUMnPmOMttn07O2mi1
AQQEYLsK0NBgxmwGheLceefe9zCfffohH334ru2zt99yvy5PZdWeqblWrdpLaGgYAGazvAvAV/36
DQAgPX0jffvdAFgO4Oef/TPXXT/LYd6m5pU1fZq6TzMObD3zfec5Z+Mk91paRzkG7SmVSn43azbf
f7eKmtoyxo27kLi4JPTVlkGZ2WwiIACMZw4mhUKBRiPHW0vJy8slM/MwV0y/iIsuuYj6ur9x2+wr
WfPTd9x8871nZ2y0X13lWHBwCAGB8J/XnOeS9ZhRKBSWgZfibHL5U69KXrVPDz74V9LSLrD9Hhne
B7PpO9vvnvLoTPXUPHVXG9TRwjve9gWseaG0u6+2cQ5169abH9dsZ8XXq9i+fQP33TubP/3pWe65
9z6Xn7tj384ufNu7PHOZj6azs3na5ubok3hahu04sxvN+NImeHvcKc50DMxnbh+ora2xTU5Odr2/
RPM7p861f8rZ231qx12+TJtmGew7a3/ffMP5eqxtgNlsJiAQamurCQgyExzSdu31eXcb/4kTR/j1
1828s/ANXn3170yZchlDhoxi8pSLUCgUfP75uxSczufzpR8TH59Anz6DHBpYh1xp1PBWVJSjVCqp
rW1g9epFqFQqqqoqXRfGy4Y7LCyc++Y9zNq1q3xal7uyjhk7AYDlyxdTWXWCeffPYNOWZYSEelcm
YTF12qUMGDCEl16az7vvvsUP369m7pzZfPzx+5SX1nHBhf7nlb2m7FOdzvV3rI3siRNHHBqvltQR
j8HGZs2aTWZmBitXfM7V19yCRnv2ys2qVZ9RUHCalcuXERwcQq9e/RgzRo63lvLTj9/x+9tu4KW/
P8e+fdvZtGk1ublZ9O7dH7PJMb+9zTEUrnNp0KBhAHz11SKOZx11ePP0WD/rVcmr9icxsSdpo1IZ
N8HyExsfyJSp3ueRvabUXSpV69fRwnee+gJn+v8WCtzWRevWfs+rrzzHrJtv5OVX/o8ePXpz5Mgx
vvvW+efO0sJVO1up9y7PvGlLPW3zqFH+90lc1anuluFLm+DtcRcbFw/A1q1ryT99ig3rf7atb80a
7/eLaBp3x4ta43vu2nOXL9YTCc7aX1frGTvuQgBWrPiYEyeyGDdmMM8/93Sbttfn3WD/rbde4NZb
pvPWm/9mxvQb+OuCt9FoYcSIVF548TVWr17C1CmjqK2t5T//+YQgXSBqL6M0+7a7iY6OYeZ1o0lM
6s60i6bz2mt/5VhWpt/lvuPOe4mJibf9futs/9Y1ZswEHnvsryxe/AbTr5hEbEw8Y0ZfQV0rv2W4
o1MqlXz40edceOGlvPnfl3nowTkUFhby2mufMGjQWIYM9j+vvOVqn9YbXH8nNjaeMWMm8NFHb7Do
g4XNWyAXOuoxaC82Lp6xYydSW1vDpAtnONxaGxeXyNVXXUjGgX08/fS/0Ol0jJ8gx1tLmX3bXdz/
wOMs//pzbvrdDOY/+gBpaeN58sl/ERfvmN9Dh3qfY7fd7jyXErv1ZOb1t/Deey/z4B/uYdiwkajP
3MM6Zqx/+1nyqn1SqThzJd7yM3RY89frruquSn1lq9fRwnee+gKNn8t1Vxelpo6gpLSUCycOY8rk
wSQlJXL33X9k4EDnnzc0nFseV+3s7+/wLs9c1X/Hjp1tSz1t8+jR/vdJXNWp7pbhS5vgajsbx2PY
sBFcc+3vePfdfzJv7m1Mnnyx7WVsw4Z5v19E07g7XhK6erdPXfUD3eWL8sydWc7a39tdHEuRkV14
4snn+OSTt7hq+hTGT5jEPXf/hSFD2q69VpRVtMwrJE6dzKZrYveWWHST12uoB/s/NapUWp6nCQ45
e+tuXS3UVIPJZGnUdcGWl0MYDVBeBqHhoNVaXtKhUkFoGNTWQJUeIqMt36sst9yaERRs+Z6h3rIO
faXl+0qF47JqqqG6CqK6ON5CbC1vRJRlXWazZb2mBgiPtMzjaV3uyqpUWtZdUwOYLfOGhLXMfuno
POWzyQTVesuf8zCbLbkTFGyJKTRDXjV4N5+rfdp4PY1zrrzM8tKZIJ3lp6Vi1dGOQSvr8iOioLq6
gszMw9w++3puuOEOHnjgr0RGw470rdxw/RW8/vrnTJ06zVaB60Ig4MzzfnK8NZ2nY7C6ypI71hbN
mldK5bn57W2OGY3n5lL+qQK+/XYRAwam0a/vSB544Dq02gAWLlxFVBfLur3dz5JXbc+b+io0DKfP
7HqdR37WXWERlnmaq44WTedPX6BxHoDrHDKZoKrSshyFwjItJBRQOP/cOigBz+2ss3rNWZ5ptM7n
C4+05K832wzN0yfxZhmNedsmuNpOZ8edvgLq6s6c+NNYjt/oGNf7y36/iLO8GSPat4/WfHN1vIB3
+7Tx+Mies3w5eGgrv7vBdfvr6lgKj7T8W1MDZpNlWSGhltxoi/b6vHpmX6O1HJTuBATi9AU4ao3j
dyMiz/4/MOjsyxWUSkujbWP30gX75dovy1Xj3bi8CgVERjnO4826XJXV3bqFb5RK9wdsc+SVN/OB
833aeD2N5wmPcF325tTRjkFny1/+9Rc89+xTjBo9gbvueozAoHNPEKi1lsagMTneWo4u2PLjTOP8
9jbH1Opzc0kXHE1JaRGPP3YPNTXVDB4yjCefeMXh7cHe7mfJq/bNU33ldR41Q93VWnW08I+7vkDj
PADXOaRUWgYkzrj63MpT3jqr16wa55mr+ex56v80R5/Em2U05kub4G08QsLAvgq2vpDT3f4STdO4
bwuujxfwfp+6+r6zfFHatcHO2l93x5LKSfmhbdrr8+rKvhBNJXnlvfMhVrU1lrPAarXl7L+VpysN
ounaW15V6y1XeEwmS6czOMTxJVFNIXnV+tpbXon2TfJFCP91pOOoM7S/59WVfSGEaA7OzjiD5ysN
ovPQhTi/yu4PySshhBCi/egM7e9594I+IYQQQgghhBCis5PBvhBCCCGEEEII0cnIYF8IIYQQQggh
hOhkZLAvhBBCCCGEEEJ0MjLYF0IIIYQQQgghOhkZ7AshhBBCCCGEEJ2MDPaFEEIIIYQQQohORgb7
QgghhBBCCCFEJ6P4ZfcJc1sXQgghhBBCCCGEEM1HruwLIYQQQgghhBCdjAz2hRBCCCGEEEKITkYG
+0IIIYQQQgghRCcjg30hhBBCCCGEEKKTkcG+EEIIIYQQQgjRychgXwghhBBCCCGE6GTUbV2A1qJV
qxg9KIkt+7JpMDXfXxvsEhFMWWUNxgaTz98d1ieeU0WVFJRWtcn6hWhtYwd3Q6VUYD0Ca+uMFJdX
k1tQ7tVxKfkunBk7uBtqlRJzoxTKyiuhtKKGtAGJbNr7GwEate3/jedtDl3CdSTGhKEL0gJmqmsN
nCysoKisusXaoKYI1LZsHDqDwSlxVFbX8dupsnOmjeyfwMnCSvKLK4kMDaJn1wgCtGqMDSZOFlZw
qqiyDUos2oueXSOJjw7h4PFCyqtqvf6effsmx6g4n8VHh9ArIYoTp0od6tPxQ7qDwnHeXYdPUVNn
IDw4kF4JkQQGqDEYG8g6WUppZY3LdXQJ15EQE0ZwkBYFUFtvpLCsityCCsxnDjqHPqsZ6o0N5BdX
kltQ0fwb3YLOm8F+S+kZH8H+mro2G3y09fqF8NWB44WUVtagUioICQqgR9cIIkOD2Hs0H5OHXo3k
u3AlI6vAacOuUMD2jNwW7zAndAmlR3wEWXmlFJZVoUBBVHgQfZKiUSmVlFa47nSI9ie/uJLkhCiy
88sccic8OBCtRk1haRVajYr+PWM4dMJSp4XotAxNiaeyug59dX3bFV60GYVCQUyEjhOnSomPDvFp
sG/fvtUZjK1SbwnR3vROikKlVFJd61iHKhQKlEoF2zJyMRgbHKZp1CoG9IrhaG4xRWXVRIUF0b9n
DDsOnaTe4DgvWNrr7vERZJ0sobi8GrMZQnRakhOjCArQcCS7yDavtc8KEBYcwKDkOPQ1BsrcnEho
bzwO9u893ZO34060QlFaR1S4jm6x4QRoVRSX19h2aHhIIL26RqJSKTCbLQ193pmzScmJUUSFBYEZ
jCYTx06WUFlVR/+eMQQGqBmcHMeJU2UUlVURqgsgOTEStUoFQG5BOadL9ADERYXQLS4cs9lMaaX3
DYAv63e1HYFaNSP6JZB9uozEmDB2HTlFcKCWnl0jUKksT3PknHYsa4/4CBpMJorLawjVaTldoqeg
1P02CuGtBpOZ8qpa9h87zcj+CcRGhThcKWucl87y3dW8QljZX823iosMITE2HLVKQVFZNVl5JQRo
zq0jAzRqr+o6lVJBj64RZJ0stZtuprC0CoOhweEklqs2yFUuB2jVjOyfwLHcEqLDdQRq1VTV1HM4
u8jtNEDqaj8Ul9eQkghRYTqKy6ttn8dFh1BYqqfBZEKlUpGZXWTrCOqr66mpN6AL0Mhg/zwVHa6j
srqegpIqusdFoFYpHU5OR4QE0isxCq1aSW29kayTpVRWn9uf01fX2eqtob3jKSytsvVJFQoYPTCJ
w9lFlFXWynEuOpX8Ej366noGp8Q5fK4+0zY6u9gTFhxAvaGBojJLXV1SUYO+po7oMB2nih3vtLK2
18dySxzurK6oqmP/sdNuy1ZRVUdNrYGgADVlHegGLreD/XtP9+TAJXDvD51nwB8cqGXn4Tw0aiUj
+ycSERKIvqaeAT1jOJJdRElFDQEaFal9E6iuNYBCQVRoEDsP5Ra9XHUAACAASURBVGEym4kKCyIm
XEdlVR2Hfyuky9Ae7M86TW2dEY1ayeCUWDJzLGeWArVqhvftSmW15Uxt76Qo9hzNR19dT3S4jq7R
oYD7bIkIDfJ6/WqV0uV2VNcZUCoVKBSWs2JKhcJyReK3QkoraggPCWRwchwlFTUoFdA7KZo9R0+h
r66na3QoCTGhnC7Ru93G6lpD6+xE0amYzGaKyquJDA2k4Myg3lleNs53dznc+KyvEPZ0gRp2HDqJ
VqNieJ+ulFfVUlFV51BH+lLXhegCUCmVFJad+0hWmd5yYlertnTEnbVBFWdO3jrLZbPZjFKhQK1S
cuB4AUqFglEDLd+rrjO4nFZVW++y/KY2foygIzCbzZwu0RMXFWIb7KtVSrqE69h7NB/A0rk8M02h
gOgwHVq1mnK99yfzRefSNTqEnIJyW7sWFxXCyULLLb9qtZIBvWI4eLyQMn0tsZHBDOgZw68Hc89p
3wK1Z7vnBaVVxEQE2wb74SGBmM1QVlkrfTLR6bg6UWp9VK9f92hCdQEYTWbyiyptg3lFo9v7jUYT
QQHnDnOt7bX1xIDDdzzcNRoeEkiAVt3h7tRzOdi3DvSBTjXgtz77YTCaqKkzEKBVo1YrMRgbKDmz
8+rONOBR4TpOF+vRaJTERgZTXFFDyZkfZyJDgzAYTbYEqq03UlJRQ0xEMNV1BmrqjLYkLi6vpt6L
AYnB0OD1+iNCA11uR/XpcgAKz5zFMpnN/Hog15bY5fpazGYzgVo1QQFqauoMtrKeKq6kR3yEx238
Lf/cZxuF8IbBaCIkSOk2L/U1jseLu3llsH/+GZQce85n1o5zY9ZOc72hgdJKy+C6Ql8HnK0jfanr
NGeu3nkziHbWBpn0tS5zua7eUn7riQST2UxtvZEArdrWmXc2TatRuSy/XPXzTn6xnpH9E9BqVNQb
GoiJDKaqth59jWNnNCYimH49umAwmjiaW0ydk9tGRecXFKAhQKum7Mydm6eLK+nXI8Y22I8MCaKu
vsF2ArCgtIrSylrM5nMHKvaKyqpITog8m4cRwbYrktInE+cLk9lMQame/BI9lVVFhAYHMKhXLPXG
BsqratGqVcRGBlNYVkV4cCDhIYEUOTkBr1EpMRpNDnfc9U6KIjpcZ/t9T2Y+tWfa3v49Yywn3ZUK
FCjIzi+zTesonA727Qf6Vp1lwG9sONsIm82W9zxo1JZOUeP5ArRqqmrrOXi8kK5dQumZEElNnYHj
eaVUVNWds2y1SolWo2LUgETbZ0ql5TZRTaNbuQCvBiS+rN/ddpxd59npsZHBxEQE2152oTjT2qhV
ynPKVmcwetxGIZoqQKuyPVflKi+d8WVe0bm5embf/gqZlf0zfAajiUCtyuF38K2uMzSYUKuUqJRK
Gkzurww4a4PAcy432LUf9t9zNU0ldbXfauuNlOlriYsKIed0OXFRIU5fvldYVkVRueURt37duwA4
3Povzg/x0SFoNSrGDu5m+0ylVBIeHEh5leUqfFP6gQajidLKWrqE6zhVrCfa7u4S6ZOJ80VdvZHM
nGLb75VVdRSWVhEVFkRxeTUHThTSq2skPRMiKausdfky53pjA2q1EqVSYTtBf+JUGdn5louiaQMT
HRpY6ztZAAI0KpITo+jTLdqhLO3dOb0gZwN9q84y4G/MYGhAo3b8K4Qa9dnBR5m+ljJ9LQqFgoQu
oQzoGcO2jNxzllNnaKCmzsiuw3nnTIuNDLY9b2Kl1ajOmc8Zb9fvaTssLIkdHa6jW1w4uzPzqas3
olDAuCHdAcuz1CoXZXW3jUI0hUatIiYi2Pbcsau8bMyXeYWwp9GobFfMNWplo5OkljrSl7rO+qhW
fPTZW3atosKCCArQ2O4YcKYlctld+Z2dABHO5Rfr6ZUQSUl5DYFatcOjGrpADUEBGtsLniqq6iip
rLF1PsX5Q6lQEBcZws5DeQ5X/RK6hNpe1FdvbECjduz36QI11NQZAfd3BRWWVtG1Syg19UZq6422
u3qkTybOFxq1igCNyuHOKoVCYXtzfrm+lt2Zp2zTUvt1dXrSS19dj7HBRFxkiO0RAG9f+lxnaCC/
RE+/7l061GDfYUTnbqBvdeASy3ydSZm+Fo1aRWRoEAABWjXR4ZaX8sRFhdA7KQqFwvIMX5VdkpnN
lh+10hLGcn0tAXbLUSkV9O4WTUiQloqqOoICNITotADERAajaTSgdsaX9bvbjsYsV+9Ntg5vUkw4
mC1lrqiqIzhQiy5QA0B8dCgqL7ZRCF8oFP+fvfuOrqLa2zj+nHQC6YEEEnonhK5Upat0qaGISuci
yPXaFUVFLi+KooJI753QFQQsNFEp6lVApfcUQhJKQkib94+YIyflJCAQGL6ftc5aObOn7JnsvWd+
M3v2scjDPaMbVsLVZMVcTLBbLrOWd3vzAvYE+haRlBHo+3gUsnarvd6NtHXp6YZORMSrdHFvlfD3
yHjK75jx+lWlUv7WMpqb21GWaatvjdhLiXKwWFSmhLfOxyXYvKrh5OigSqX85VnYVVLGTRQfj0IM
zncf8vd2V9Jfgfj1Yi4mys/LXU6ODoq/nCQXZwdrd2F/b3eFlg+QZGQ7v2V14VKi3N2cFeBbxGZQ
Meo57heFXJ0UWiFQHn+1tx7urirq7a6Yi4lydLCoXtUgebhnpBX3yzgPx+bQ2y/dMHT8XJzKlPBR
cf+M+MZisahIIRdVLVNUKSlpSk3NOfh3cnRQgG+Re248DOvt/SFRZXTQT9K+vBc66GeuUfpT09L1
+/HzKlPCW+WCfGQY0omIjK7yCUkp8i7ipnpVg2UYhlLT0q0jHUsZ71KFlg/QqaiLOnv+kg4cj1a5
IB+VD/aVDCnmYoL1LtSxc7GqWqaoDCNjpMicuuJnFXMx8Ya2n9t+uGS5mxwTn6ii3oVVr2qQUlPT
deb8RUXHJ6hSKX/tPxalExFxCilbTKnphmLiE5SQlCzjr2Nlbx+BvFQrW1SGMnpJXUtJ0/m4BJ2O
uijDyLtcXl/eIy9csTvvvdYY4w6wZJzor6Wkqnal4nJyclRMfIIuXEzM1kbeaFsXeeGyUlLTFFzM
U2WK+yj9r5uzf5zIGIwr6/qvZ6/cX/8TQDfCXv55sp9/hpExOnSpAC/9dM726emlhGs6djZWlUr5
y9nJUWlp6Tofn6DI2HtomGbcEoF+HjkO0JmckqYrV5NVzLeIzp2/pIPHzqt8sK8qBPvpWkqqDp44
b/15vevPb1kf0qSnG9Z38Y+eibVO55oMZnJ9rzYHi0Vehd1UtoSPoi5c0dGzsTp2NlaVS/pbx1o7
di7OOkbGych4VSntL0dHB129lqKDx6JzHUcnKvaKklMyz9fessiipORUXbiYqMOnL9g86c+8ZpWk
tDRDF69c1R8nzt/W43CrWXb8coJheZFNRk+Cv7/XrRKkY2djc3wnFgAAAABwd8m7HznuOw4OFtUP
KWntFuZdxE0uWd6TAQAAAADcvejLV8Dc3Zyto/fm5GRkfK4/tXe7pKcbOnz6gsoF+cjB4qu0dEN/
njzPz5kBAAAAwD2CbvwAAAAAAJgM3fgBAAAAADAZgn0AAAAAAEyGYB8AAAAAAJMh2AcAAAAAwGQI
9gEAAAAAMBnLhdh4RuMHAAAAAMBEnFwKFS7oPAAAAAAAgFuIbvwAAAAAAJgMwT4AAAAAACZDsA8A
AAAAgMkQ7AMAAAAAYDIE+wAAAAAAmAzBPgAAAAAAJnPfBPunTp6URyFnpaam3vCyzR9urKVLFuWY
Nn7cWJUqEaBRr778T7NoY2X4csXFxd7Sdd5KAX5e8vcuYvM5cviwJGnfvr1q/nBjlQ4KVO0a1bR8
2RLrcvbSJGntmlVq3aKpAov6KMDPSw/UqaH3x49TSkrKHd0/3B5Bgf7y9XSXv3cRFfXxUL3aoRrz
9mglJiTka/l/Wi+2b9uqhg/WUWJiooIC/VWnZki2eRITE1W8mK9at2h609vJdLP5fe3lF/Xi8//+
x9u/XwQF+sursKu8i7jZfGZMm2rT9v+T80B+rFm9Ui2bPaQAf28VL+arFk2baPWqcElSVFSkPAo5
K+HKlduy7Rtxu4+DGbRv84jeHv1Gjmm1a1TT7JkzJElbNm9So/p1FRxYVDVCKmvGtKl3Mpu4C705
6jUFBxbVdzt33NBy158vqKO43126eFFVKpTVyBHDrNO+27lDzZo0VHBgUdWuUU2bN32Zr7Sc5Cfe
uP6atZivp0KrVdJHH0649Tt7m903wX5QcLCOnDgtJyenW7re8BXL9NGkyXp33Phbut533npTcbFx
t3Sdt0pKSooSExP1++Fjiom/Yv1UqFhRycnJ6t2jmwYOGqITZyI0d8FiPTdyhI4cPmw3TZKmTJ6k
Z4YOUb8BA3XsxBmdOhetyVOmae3qVRr+ryEFvNe4VZaFr1ZM/BWdPBOpjydN0bat36rNIy117dq1
PJf9J/Xi0sWL6v9UX82YNU/u7u6SpKuJV/XD97ts5lu7ZpU8injc1Dayutn8vv3uf7V921Zt+nLj
LcnH/SB89TrFX0my+QwaMvS2tf1ZffbpZA0bOlj9+g/U8VPndPjoSQ0d9oye+dcQLZw/77ZuG7fe
gEGDtXD+vGzB1nc7dygiIkI9wnoqIuKcnugdprfeGaszkec1d8Fivf7qS9q3b28B5RoFLTk5WeHL
l2nM2HHWG0L5df354k61W8Dd6qUX/yNnF2fr95iY8+rRrbNG/ud5nY6I1n/Hvae+fXoqMjLCblpO
biTeyLxmjYyJ14xZczXuv+/q66+23NZ9v9XyDPbrb3fOa5Z7wtkzZ1ShTEnriXvP7h/VomkT1Qqt
qlqhVbVg3lzrvAvnz1P1qhVVt1Z1vfzif2QYRo7r7NWjm44dParXXn5Jo994XZK09dtv1OCB2ipX
KkjNHmqkfXv35Lhsenq6Xnz+3wqtVkk1q1fRw43qa/ePP0iSnugVpmNHj6pThzZaGb5ckrRzx3Y1
a9JQdWqG6MG6NTVl8iRJGXd/A/y89NGHE1S2ZAlFRkZo86Yv1ah+XYVUqaDQapVsLjQXLZivimVL
qXaNanrj9VfV7rHWWrJ4YZ7H5HoXL8ZLkry8vLOl7di+TS6uLurT90lZLBbVrFlLbdu2V/iKZXbT
Eq5c0Zh3RmvCxI/Uu09fuRcuLFdXV9Vv0FCff7lZ4yd8kGNecO9yL1xYjZs8pM83blZMTIwWLZgv
SbmW35zqhb2yntWUTyfpoYebqnpoqHVa60cf1by5s23mW7Rgvlq2bm0zLbft3Gg9zq2OZa3HFy7E
6OVXX9fbo0fd7OHFX7K2/VLG/7hWaFWVLVlCzz/3rNLS0nJsS/PbJiZcuaJ33n5T49/7QE88+ZTc
3d1VxMNDPcJ6acmycJWvUME67+efr1O92qEqXsxXgwf0U3p6uqTcy9ipUydV1MdDC+bNVVj3Lnqw
bk0N7PeU0tPT7aZJ+W/TkV37Dp2Unp6uTRs32EyfN2e2wnr2UhEPDxmGoekzZ+uRRx+TJNWpU1fl
K1TQoT//KIgs4y6wft0a1XvgQfV+oq+2b9uarWdXbteIWc8X17dbLZo20WefTrauIy0tTeVLB+vb
b76WRD2H+WzauEF//P67evfpa532w/e7VLx4cXXu0k0Wi0Vt2rVX7dp19Pm6dXbTsrrZeMPBwUEN
GjZSlcpVdPTIkdu277eD3WC//nZnHXzEPAF/pgsXYtSxfRuNGPlv/fLb71qzboNefflF/X7woM6d
O6uRI4Zp/qKl2vfLfj30cFP98vNPOa5nyfJwlS5TRh99Mllvjxmr2NgL6hXWTePf/1DHTp3V4KH/
Uq8e3XLshvXtN19r86Yvtffn3/S//X/o9TdGa1X4CknS3AUZrwysXb9RXbv1UFxcrMK6d9Grr7+h
n/53QKvXfaHx48Zq67ffyMXVRVevXlVycrKOnTorb28fPflEL41++10d+OOIPps2UyOeGaqYmPM6
e/aMhg8bomUrV+vnXw+qdOky+vGH72WxWOwek6zi4+Ll5OSkwQP6qVql8mrwQG3NnD5NknTozz9V
pWo1m/krVqqk3w8etJu2b99eJSYkqHOXbtm25+3tI29vn3z8Z3EvcnNzU8dOj+vrr7YoKSkp1/Kb
tV7YmzcnK5YvVdfu3W2mhfXsrbVrVuvK5cuSMgKr3w8eVIuWrazz2NvOjdRje3Usaz0ODCyutu06
6Mjhwzr055+3/Jjf734/eEA//3pQ3+/Zp3Vr1mjtmlXZ/gfOzs75bhP37durhCtX1K1HWLa0ps2a
q2Gjxtbvv/36q3bv+5/2/35IX3yxXtu3bbVbxlxcXJSUlKS4+DgtW7FKO3bt1tdfbdH2bVvtpt1I
m47snJ2d1feppzX3upuBly5e1JrVK9V/4GBJUokSQer0eBdJGQHY2jWrFHEuQg83bVYQWcZdYNaM
6Xq6/wC5urrq8S5dtGjhAmuavWvErOeL6/Xs1cf6OpCU8Tqak5OTmjZrTj2H6cTHx+n5/4zUtBmz
5ejoaJOW9eGrj4+vjhw+lGfa9W423khPT9f2bVt18uRJ6w3ee0WuwX5moC/JdAH/ls2b5Ovra/1H
lylbVm3btdfK8OXauWO7ypYrpzp16krKuLsfGFg8X+v9+qstCg4OVtNmzSVlNNC7du/NVlglKSAg
UNHR0Vq6eJGio6P0aJu2+r/3c76btPXbbxQYGKhH27SVJAUFBavj449r44bPZbFYZBiGwnr2lsVi
kZubmw4dOWEtiE0eeljOzs46eeKEtm/bqkqVK1v3rf/AQSpcuEiexyQrF1cX9ezdR8OGj9CBP4/o
k8mf6a03R+mL9euUmJigQm6FbOYv5O6uhMQEu2lxcbHy9vaRq6urNW3kiGEqXzrY+jl18mTe/wTc
k/yLFlV8fJzd8pvVjcwbHx+nQ3/+qfoNGtpML168hBo1aqyVfwXoixcuUI+wnnJ2/ru9s7edG6nH
9upY1nqcud1atetYewrAvi6d2sujkLPNJ/PJV1bDhj8ri8WiwMDieuSxx7Rj+7Zs/4MbaRMz269C
hQplS8tq6LBn5ODgID8/f1WqVFlnTp+2W8Yyy0P3v24kuLq6qmy5cjpz+rTdtBvJP3LWf8Agfb1l
s86dOytJWrZ0iaqFVFfNmrVs5luxfKl8Pd01cvgz+vSzaQoKCi6I7KKAHTl8WKdOnVTzFi0lSU/3
G6i5s2da02/kGvF6Xbt31769exQRcU5SxuujPXr2koODA/UcpvPCc//WwEFDVLlKFZvpjRo3UURE
hJYsXqi0tDRt2/qtvtu5Q0nXkuymZXWj8cYTvcMUFOivAD8vdWrfRsOfHalSpUvfvgNwG+QY7F8f
6GcyU8AfHxevqMhIhVSuYP18/dUWxcZeUOyFWPn4+NrM7+/vL0maP3eOSgcFqnRQoMK6d8m23gsx
F2zuCDk4OMjfv6gsFku2ZauHhmrp8pXavOlL1a4RouYPN9au73bmmN/oqGj5+xe1mebr66foqGjr
dz8/P+vfixctVKvmD6vZQ43U/OHGSk5OVnp6uuLj4uXn52+Tv6DgoDyPSda8lypVWp9Nm6kH6zeQ
xWLRg/UbKKxXL33xxXoVLlxEiVcTbfKacOWKihQuYjetaNFiiouLVWLi3+lj3h2nXbv3atfuvbp4
MZ6BakzszJnT1ptquZXfnOR33vPR5+Xo6GhT/jP1feppzZs7W4ZhaPGiBerT96l8b+dG6rG9Opbp
+nosZdwUjIqKzP3AwWrV2s91+WqKzSfzojurYgEB1r99ff1sxlXI/B/k5//19zL+iouLtfYQscfn
unOEk5OT0tLSJOVdlj09PK1/Ozo6WpfLLe1G8o+clSpdWs2at7C+UjFvziwN+Oup/vW69+ip2EuJ
Wha+Si8+/5zWrV19p7OKu8CsGdMUFRmp4OJFFRTor0daNdORw4etA/XZu0a0x8/PX81bttKaVauU
kpKi9WvXWrs3U89hJp+vX6tjx45qxMjnsqX5+vpp6fKVmvrpZFUuX0aLFy5Qi5at5O3tYzctqxuN
NxYuXqazkTE6H3dZ+/84rJ/27dOIZ4bengNwm2Qb+SOnQD/TwUek+pud9ePD9/bI6EHBQapQsaJ+
2PNztrSlSxZZ30nPFBmZcbHdrUeYHm3TRpLk4uKSbdliAcV0/vzfAbhhGPr94EFVrFQpx2WbNmuu
ps2aKzk5WVM/+zTjna1TZ7OtN7B4oM16pYyBKgIDA63fM08W69au1nv/919t3blLpUqVVlpamgL9
M96t9/T01OVLl2zyF3EuIs9jkpiYaJP36OgonT17VrVr17HOk5KSIhcXF1WpWlWTJ31ks/yB/ftV
o2ZNu2l16taTt7ePFi9coIGDMwbH8PTykqeXV7b8wFxiYs4rfPlyffjxJ3bLb1Y3Mm+mnC6q2rbr
oH+PGK6lSxbJy9NL1UNDdeTI312/8tpOfuuxvTqWGdDnlL+8LgRx486fj1bJkqUkZbzW5ef/902W
zONt7/+VVZ269eTp5aW5c2dr+IiRNmlfbvhChw4fUljPXrkufzNlOS/28k8vqfwbMHCwXn3lRbVt
10HHTxxX1+5/d7H+4/ffdfTIYbXr0FGOjo6q36ChHm3TRpu+3KiOnToXYK5xpyUlJWnxooXa89Ov
KlO2rHX6lMmTNGfWTDVu8pDda8S82vmwnr00c/o0lStfXqVKlVLVahmvRN5IOwXc7cKXL9fpU6dU
o1plSdLFixeVmpaqo0eO6PONm/Vw02ba9t3fvR0bPlhHnbt2lSS7adf7J/FGUFCwnurXX/2f7qtP
P5v+j/b1TrJ5sm8v0M9khif8TZs2V8S5CG3ZvEmSlJiQoOHDhuiXX35Wo0ZNdPjQIf300z5J0vJl
S6x3SN3d3RUQEKiAgMBsT/8lqWWr1oqKitIX6zMGhFizeqU6tH1UFosl27Lz587RyBHDlJqaKhcX
F9WoUdP6vomDg4McHR118dLFjPw2a67oqGhrfk+dOql1a9aoQ6fHs+UhPi5evn6+Cg4uKcMwNPGD
92WxWJSQkKD6DRrqt99+1cEDByRJc2bNVELClTyPSda8Hzt6VG0eaWntXrxv7x6Fr1iuTo93UZOH
HpaRbmjGtKlKT0/Xju3b9PXXW9S9R0+7aW5ubvrv/72n1197WTOmTdWVy5eVkpKin3/+ST17dFWx
YgHy9ct+zHHvSk5O1t49u9W1UwfVqFlTXbp2t1t+s9YLe/NmVbRYUaWlpeX4Pr+zs7PCevbSqFdf
0RNPPp0t3d52bqge26ljuYmKilSxYgG5puPmzJuT8R72hQsx2rJpk5o1b5Ftnhv5f7m7u2vMu+P0
9pujNGXyJF28GK/Lly5pyeKFGtD/KZXOo8vfjZTl/LqZ8obsHmvbTteSrumN119Rr959rL/kIWUM
Vtu/35PW3jynTp7UV1s2q3btugWVXRSQ1avCVbZsWZtAX5I6d+2q9evWKC4u1u41YtbzRVbt2nfU
gf37tXD+PPV64u9By6jnMJO5Cxbp8PFTOvDnER3484ie/fdzCuvZS59v3KyEK1cUUqWC9u3do/T0
dM2cPk3xcfF65NE2dtOy+ifxRlxcbMYg7tVDc0y/W1mD/frbnXXQT9K+vD8H/e7tgN/Ty0vhq9dq
3NgxqhFSWQ3r15Wfn79q1KipUqVL670JE9UnrLtCqlTQnt0/qn6DhrmOyH89Ly9vha9aq9Fvvq4y
wcX1wXvjtWR5eI4/ndK5S1clXElQ9SoVFVqtkka9+rJmz8sYyMXBwUHduoep3WOtNemTj+Tt7aNl
4as0dszbqlMzRN06d9SYsePUqHGTbOvt0rWbSpQIUo2QymrWpKHKV6igHj17afCAfkpJSdE7Y8ep
W+eOavBAbcXEnFdI9VBZLBa7xySrBg0b6f0JEzVowNMKCvTX4IH99P6EiWreoqWcnJy0ZMVKLV2y
SKVKBOj5557V9JmzVaZsWbtpkvTEk09pwaKlWrVyhSqWL62gAD8NHvC0QkKqa9fuvQzSZxJh3TrL
37uIihf1Ub+nnlCrRx7VyjXr5ejoaLf8/vnHHzb1wt68WQcn8vb2UaXKlbX7h5zff+/7VD/Fx8ep
R8+e2dLsbadK1ar5rsc3Usck6dq1a/rl55/0YP0G//CII1NqaqpcXV0VFBSsRvXrqnH9B9S1W3e1
a98x27w3+v/qP3CQZs2dr/AVy1SpXGlVqVROC+bN1eKlK6yDuOXmRspyft1o/pEzR0dHPdWvv77a
slkDBtr+JFP9Bg314cRPNGRQfwUW9VHrFk3VqVNn9RswsIByi4Iye+YMdeneI9v04sVLqGat2lq8
aKHda8Ss54us3N3d1bZde32+fq16hP19nqKe435RuEgRjX57jJ7s00slSxTT4kULFL56nQoVKmQ3
LSc3Em9kXrP6exdR7dAQOTo6av6iJXdor28Ny+WrKXlHsTCNtLQ0m8FgaoVW1XsTJt5zI0sCN2rc
2DE6cviwZs2dX9BZyZc1q1dq/Lix+n53zr8GAgAAANhj96f3YC6JiYkqW7KEtbvXtq3fKiIiQrXr
1MljSeDeN2z4CG399hv98fvvBZ2VPKWlpem9//uvRr81pqCzAgAAgHsUT/bvM1+sX6c3Rr2qpKtJ
KuJRRG+9/a7atu9Q0NkC7oit336j1195SVu+3W7z7u3dZtRrrygp6aomfPhxQWcFAAAA9yiCfQAA
AAAATIZu/AAAAAAAmAzBPgAAAAAAJkOwDwAAAACAyRDsAwAAAABgMgT7AAAAAACYjFPy1YSCzgMA
AAAAALiFLIZh8NN7AAAAAACYCN34AQAAAAAwGYJ9AAAAAABMhmAfAAAAAACTIdgHAAAAAMBkCPYB
AAAAADAZgn0AAAAAAEzmvgr269Wrp6lTp1q/nz17Vn369FFQUJD8/f1VqlQpDR06VFeuXLFZbvny
5WrUqJGKFCkid3d31alTRzNmzMj3dr29veXi4iI3NzcVckohWAAAIABJREFUKlRI1apV0xtvvKGE
hIQb3o63t7eqVKmSbRuJiYny9PRUkyZNsqW98sor8vHx0fbt2/M8Jt7e3mrcuLGy/iJjkyZNFB4e
nu99BnJSUHUQ5pafdsvb21uOjo5ycnKy+UyZMkVS/ssi7g8tW7bU66+/nmNa5cqVNW3aNOv36dOn
q0iRIpo8efKdyh7uQlnPb7fDsmXLFBsbK0k6ceKELBaLUlNTb+s2gTvpyy+/VK1ateTj46MKFSpY
z9GSVLhwYbm5udl8Dh06lOu6Vq5cqSZNmsjDw0OFCxdWSEiIxo4dq5SUFOs818do7u7uKl++vN57
773buo932n0V7GfVpUsX+fn56fDhw4qJidEPP/ygAwcOaOTIkdZ5PvjgAw0dOlRDhw5VdHS04uLi
9MYbb+jNN9/Uiy++mO9trVu3TklJSYqJidHUqVP1zTffqFmzZrp27doNbycxMVHfffedzbSVK1fK
w8Mj23aTk5O1ZMkSjR8/3ubixJ6IiIh8zwv8E3eyDsLc8tNuffHFF0pNTbX5DBs2TFL+yiLuH0OH
DtWcOXOyBVLbt2/XuXPn1Lt3b0nSv/71L23btk0hISEFkU3cZ0aNGmUN9kuWLKmIiAg5OTkVcK6A
W+PcuXPq1q2bxo0bp7i4OC1dulQvvPCC9uzZo5SUFCUmJurUqVNKSkqyfipVqpTjuj7++GMNHDhQ
gwcPVmRkpGJjYzVjxgytXLlSAwcOtJk3M0a7cuWK5s+fr3feeUebN2++E7t8Zxh/mSYZe+vWzfdn
2t+L3jPq1q1rfPbZZ9bvnp6exqZNm2zmOX/+vBEZGWkYhmHExcUZ7u7uxrJly7Kt65tvvjEcHByM
48eP57ldLy8vY+PGjTbTrl69apQuXdqYOnXqDW3Hy8vLGDx4sNGvXz+b+Vq0aGH069fPaNy4sc30
pUuXGt27dzeSkpKM4sWLGxcuXLBJz3pMvLy8jPDwcMPX19eIiIiwTm/cuLGxYsWKPPcVsKeg6iDM
LT/tVk7t8PXyKou4vyQnJxsBAQHGmjVrbKb37dvXGDJkiPX77t27DcMwjJYtWxqTJk26o3nE3eX6
89uJEycMNzc3Y9asWUbHjh2NkJAQo0+fPkZaWpphGIaxYcMGo2bNmkaZMmWMcuXKGbNnz7au56uv
vjJCQ0ONYsWKGQ8++KDx448/GoZhGF27djUkGeXKlTOWLl1qHD9+3JBkpKSkGA0aNDA+/vhj6zpS
U1ONgIAAY8uWLYZhGMb3339vNGjQwKhYsaJRsWJFY9asWXfqsAD5dubMGSM8PNxmWo0aNYz58+cb
0dHRhiTj2rVrea7n8uXLhoeHh7FgwYJsabGxsUZsbKz1e07XBvXq1TMmT558k3tx97GJ2KdJhpGP
z70Y6BtG9kBjyJAhRlBQkPHhhx8a//vf/6yNcKbPP//ccHV1zTY9U3BwsDFz5sw8t5vbReZzzz1n
dOnS5Ya24+XlZWzbts3w9PQ0Ll26ZBhGxkklICDAWLx4cbZgv1mzZsbmzZsNwzCMESNGGB9++KFN
ek7B/pEjR4xnn33W6NGjh3U6wT5uhYKqgzC3/LRbeQX7eZVF3H9effVVo3379tbv8fHxRqFChYyf
fvop27wE+7j+/Hbu3DlDkjFhwgTDMAwjKSnJKFq0qPHVV18ZV69eNYoUKWJ88cUXhmEYxtatWw0n
JycjOjraiImJMTw8PIyvv/7aMAzDmDdvnlGiRAkjJSXFSElJMSQZhw8fNgzDsAn2J0+ebDRp0sSa
ly1bthhBQUFGWlqacf78ecPDw8NYvny5YRiGcfToUcPb29vYv3//HTs2wI1KTU01wsPDDX9/f+P0
6dPGn3/+aTg5ORlhYWFGqVKljNDQUGPKlCk5Lpv5MCgpKSnP7Vx/bZCWlmZ88803hr+/v3H06NFb
uj8FyaYb/2DD0PQ8egJM/2s+M5gyZYree+897dy5U61bt5afn5/69++viIgISVJMTIwCAgLk4JDz
2w4lSpTQhQsXbnr7RYsWVVxc3A1vp0SJEmrSpImWLVsmSZo3b5569+4tZ2dnm+UOHTqkkydPqlWr
VpKkQYMG5es9Z8Mw9O6772rXrl3asGHDze4ekKeCroMwj/y0W23atJHFYrH5fPXVV5LyLou4/wwe
PFibNm3S2bNnJUmLFi1SaGioateuXcA5w93OYrFIknr16iVJcnV1Vfny5XXq1Cm5ubnpzJkzatOm
jSSpadOmcnZ21vHjx7V582aVLFlSLVq0kCQ98cQT+uWXX+To6Gh3e2FhYdq9e7fOnTsnSVq6dKn6
9OkjBwcHffnll/Lz81P37t0lSeXKlVOHDh2s15DA3WbJkiVycXHR0KFDNXPmTAUHB8vV1VV9+/bV
yJEjdeLECU2bNk2vvfaa1q5dm2352NhY+fj4yNXV1Tpt6NChCgwMtH5OnDhhTevWrZu8vb1VuHBh
PfLII3ruuedUpkyZO7Cnd0a2K2h7Ab+ZAn1JcnBwUO/evbVy5UpFRUVp+/btiomJsTbAxYoVU2Rk
pNLS0nJc/ty5cypWrNhNb//06dMqXrz4TW2nf//+mjVrlgzD0Pz58/X0009nW27q1KmKiIiQj4+P
vL299dBDD+nQoUM5DtSXlYeHhz755BMNGzZMiYmJN7V/QF4Kug7CXPJqtzZu3Cgjo0eb9ZN5MzSv
soj7T5kyZdSyZUvNmTNHkjRz5kwNGTKkgHOFe4mnp6f1b0dHR+u5bP78+WrcuLHq16+vBg0aKDk5
Wenp6YqJiZGPj491GQcHBxUtWtR68yA3/v7+at26tcLDw5WSkqLVq1frySeflCTFxcUpIiJCZcqU
sX42b97MjXLctXr16qXk5GStXbtWzz77rFatWqXSpUtr9uzZatiwoSwWixo2bKg+ffpo3bp12ZYv
VqyYYmNjba4Dxo8fr19++UW//PKL4uPjbcZjCQ8PV3x8vK5evarjx49r7969Gjx48B3Z1zshx8dl
OQX8Zgv0IyIitHTpUptpoaGheuutt/S///1PSUlJaty4sZydnbV48eJsy2/btk2RkZHWC8Ubdf78
eS1dulTt27e/qe107NhRR48e1cKFC+Xl5aUaNWrYpCclJWn+/Pk6cOCA4uPjrZ8PPvhA06fn1X8j
Q+fOnVWrVi2NHj06W68B4J8q6DoIc7qZdis/ZRH3p6FDh2ru3Ln69ddfdezYMfXs2bOgs4R73KpV
q/Tuu+9qyZIl+vHHH/Xdd99Z26qAgABFR0db5zUMQ/v377cZPTw3ffr0UXh4uLZs2aLSpUtbB40M
Dg5WpUqVdOLECesnMjJSn3766e3ZQeAmHTx40Pqk3tHRUY0aNVK7du20YcMGRUVFad++fTbzp6Sk
yMXFJdt6HnjgAfn4+GjevHnWaV5eXtan+vYEBwdr4MCBpvoFslxH478+4DdboC9J6enpGjRokD74
4APrT+BFR0fr448/Vt26deXm5iZPT0+NHTtWw4cP17x585SYmKhr165p7dq16tmzp1577TUFBwff
0HaTk5P1448/qm3btqpVq5Z69OhxU9txdnZWnz599OKLL6pfv37ZtrNixQqVK1dO5cqVs5nevXt3
rV692jqaa14mTZqkmTNn6tSpUze0n0BeCqoOwvxutN3KT1nE/al9+/ZKSkrSSy+9pL59+8rd3b2g
s4R7XFxcnPz8/FSyZEkZhqHx48fLYrEoISFBjzzyiCIjI60BT3h4uFq1aiWLxSIHBwc5Ojrq4sWL
Oa63U6dO+u233zRnzhzrU31JatGihc6dO6cvv/xSkpSQkKBBgwbpp59+uv07C9yA+Ph49enTRzt2
7JCU8fOSmzZtUt26dXXkyBE1a9ZM33//vSRp9+7dWrp0qbp27ZptPW5ubpowYYJefPFFTZkyRZcv
X1ZKSor27dunxx9/XAEBAfLz88sxD7GxsZozZ062h6j3tLxe6r9XB+PLSdbBwfbs2WO0a9fOKFas
mOHp6WkEBgYaTz75pHHmzBmb5VasWGE0aNDAcHd3NwoVKmTUrVvXmDt3br636+XlZTg7Oxuurq6G
i4uLUa5cOWPUqFHG1atXb3g7Xl5e1sFZfv31V8PFxcU6wv6KFSusA/Q1btzYOjBMVk2aNDEmTpyY
4zG5fv2ZJk6caEhigD78YwVVB2Fu+Wm38hqgL79lEfef0aNHG5KyDWiWmppquLq6Gq6uroaDg4Ph
5ORkuLq6GsOHDy+gnKIgXX9+i4iIMCQZly9ftqY3btzYmDFjhnHp0iWjVatWRtmyZY169eoZy5cv
NwYOHGiUKFHC2L9/v7Ft2zajatWqhr+/v1G7dm1j165d1nX06dPH8PT0ND744AObAfoy9e3b13By
cjKioqJs8pY5Gn/58uWNChUqGK+88gqDkOKuNGfOHKNcuXJGkSJFjKCgIOOFF14wUlNTDcMwjFmz
ZhkVKlQwvLy8jCpVqhhz5syxu64NGzYYTZs2NTw8PIxChQoZ1apVM0aNGpVtNP7MGM3V1dXw9/c3
wsLCbH7Z515nMQyTPbIHAAAAAOA+l2s3fgAAAAAAcG9yKugM3OsOHjyo3r1755r+zjvvqGPHjncw
RwAAAACA+x3d+AEAAAAAMBm68QMAAAAAYDIE+wAAAAAAmAzBPgAAAAAAJkOwDwAAAACAyRDsAwAA
AABgMk6xcRcLOg8AAAAAAOAWcnIpVLig8wAAAAAAAG4huvEDAAAAAGAyBPsAAAAAAJgMwT4AAAAA
ACZDsA8AAAAAgMkQ7AMAAAAAYDIE+wAAAAAAmIxNsG8kJ+vKiaO6fOB/ivthm6I3rFTEink6PfUD
HRs3Skdfe0YHnu6gk4umSenpBZXnO+rUyZPyKOSs1NTUHNNXhi9XXFzsTS17P8t6bOwdR5jHw43q
a9aM6QWdDZjQqpUr1LLZQwrw91YxX081afCA5s6eddu3e+7cWQ14+klVKldapYMCVbViOY0cMUwJ
V65Y57kV7dvNnE/Wrlml1i2aKrCojwL8vPRAnRp6f/w4paSk3PQ67xft2zyit0e/kWNa7RrVNHvm
DOv3ObNmKsDfW9M+m3Knsoe7kEchZ+3Z/WO26Q/Wral5c2b/o3VnbUNuRZsSFRUpj0LONm3VzWr+
cGMtXbLoH68H97cLF2LkUchZD9SpoalTPpUkBQX6q1Xzh2UYhs28rVs01ZrVK63fR732ij76cILN
PG+Oek3BgUX13c4dNtM7tH1UFcuWUs8eXW/TntxdbIL9vWNe0J99HtPRgV106j/9FTX2ZV346F1d
XjxDKZvXKH33ThWKPKe0udMVs2ZZQeX5jgoKDtaRE6fl5OSUY/o7b72puNi4m1r2fpb12Ng7jgBg
zycfT9TI4c9owKDBOn7qnE5HnNfLr72ud995S6Neffm2brt3WHf5+vnql/2/6+TZSH2zfad+P3hQ
L77wnHWegmjfpkyepGeGDlG/AQN17MQZnToXrclTpmnt6lUa/q8hdzQv96IBgwZr4fx52W6EfLdz
hyIiItQjrKck6d/PPqOdO7aratVqBZFN3CeytiFcM8HMduzaraHDnrF+j4yMsLnBmpPNmzaq9SOP
Wb8nJycrfPkyjRk7Ltuy6zds0gsvvXJrM30Xswn293+/U5fSLQoKLqcSJSuoRKnKCipdRUGlKmd8
D66gwBLlFBBcVi5bvyqgLN+8nTu2q1mThqpTM0QP1q2pKZMnSZJaNG2izz6dbJ0vLS1N5UsH69tv
vtbZM2dUoUxJpaam6tTJkwrw89JHH05Q2ZIl1Kr5wzp29Kg6dWijleHLs23PZtlTJ1XUx0OzZ85Q
ty6dVK1SeU2ZPEkTP3hfXR/voBohlW3WsXnTl2pUv65CqlRQaLVKWjh/njVt0YL5qli2lGrXqKY3
Xn9V7R5rrSWLF0qS9uz+US2aNlGt0KqqFVpVC+bNzfFYZN2XyMiIXJc9dvSo/L2LaNInH6lzx3aq
Wb2Knhs53HoRlNtxTU9P14vP/1uh1SqpZvUqerhRfe3+8Ydsx+aJXmHZjmNu68ya72qVyuvTyZ9Y
9ys9PV2VypXWls2b8l8wUCDutjqBe9PFi/Ea+85b+njyp+rdp6/c3d3l6uqqDh0f1+x5CzTpk490
6uTJPNux3MpJZjldMG+uwrp30YN1a2pgv6eU/lfvtkOH/tRjbdrJ3d1dklS8eAktWR6ut955V5Jy
bN/sleWt336jBg/UVrlSQWr2UCPt27snx/2eMW2q6tUOVWzshWxpCVeuaMw7ozVh4kcZx6RwYbm6
uqp+g4b6/MvNGj/hgxzXmVu+8joG9vJ8r9a/9h06KT09XZs2brCZPm/ObIX17KUiHh6SpL5P9dOs
ufPl8dd3IDd51aPc6l/WNuRWtymff75O9WqHqngxXw0e0M+aH3t1d+H8eapetaLq1qqul1/8T7an
rsCtNHbceL09+g1FRUXmmH7mzGldunhJIdWrW6etX7dG9R54UL2f6Kvt27be172HbR45O3n7yEhO
kZeXn1JSUyTDULrFIjk6ynBz17Xkq0pPTJC7a6F77ml1XFyswrp30ew58/Vom7Y6e/aMGj1YT9VC
QtSzVx+Fr1imfz0zXJK0fdtWOTk5qWmz5jpz+rR1HS6uLrp69aqSk5N17NRZpaWlycejkNau36hy
5cvb3b6Li4uSkpLk5OSk8FVrtWXzJvXo+rg+mz5TK9es1+fr12rUa6+oa7ceSkpK0pNP9NK8BYv1
6GNttHPHdnVo+6gea9tW165d0/BhQ/T1tp2qU6euZk6fps8+naS+Tz2tCxdi1LF9G02ZOl2du3TT
iePH1aThg6r3wIOqWs32qUPWfYmNvZDrsoULF9a1a9eUnp6u1eu+UGJioho8UFurV4WrVetHcj2u
aWlp2rzpS+39+Te5urpq08YNWhW+Qg/Wb2CTl7kLFtkcR3v/qypVq9rke86smZo+bYqeGf6spIyn
LoZhqEXLVrei2OA2utvqBO5NP+zapbS0ND3eOXt3vIebNlPx4iW09dtv1Kx5i1zbsRYtW+VaTnx8
fZSUlKS4+DgtW7FK165dU5UKZbV921Y1a95C3XuEadiQQRrx7+fUrFkLVQsJkZ+fvzUPWds3e2XZ
wcFBvcK6aenylWrarLkWL1qgXj266eChozb79fn6tfr4ow+06atv5evrl22/9+3bq8SEBHXu0i1b
mre3T47H0V6+MutqTsegRs2aueb54sX4e7b+OTs7q+9TT2vu3Nlq16GjJOnSxYtas3qltny73Tpf
3br1CiqLuMfYq0cNGjbKtf5lbUM6Pd7llrYpv/36q3bv+5/i4mJVI6SKtm/bqtAaNXKtu17eXho5
Ypi2fLtdderU1efr1/IKC26rGjVqqWfv3nrp+f9o3sLF2dI3bdyo1o8+ajNt1ozpeuGlV+Tq6qrH
u3TRooULNHzEyDuV5buKzZN9/1LlZTHSZRjpSqtUVY6vvC3XtybIdewnch8/SUdr19GmX/foUOQp
nS7kWlB5vilbv/1GgYGBerRNW0lSUFCwOj7+uDZu+Fxdu3fXvr17FBFxTpIUvmKZevTsJQcH2/EL
LRaLDMNQWM/eslgsN7T9zPnbdeggSapYsZJSU1PVoUMnSVKFCpUUcS5j+25ubjp05IQeeTSjO0qT
hx6Ws7OzTp44oe3btqpS5cqqU6euJKn/wEEqXLiIJGnL5k3y9fW1XuCVKVtWbdu1z7HXQdZ9yc+y
PXv1liS5u7urZavW2rF9m93jGhAQqOjoaC1dvEjR0VF6tE1b/d/7OT9Rup69dWbNd7fuPXTs6FH9
9NM+SX/978J6ytHRMX//GBSYu61O4N4UcyFGxYoFZGuvMwUWL27z9DundsxeOcksp917hEmSXF1d
VbZcOeuN4IkfT9aY/47T9999p47tHlOpEgH615CBioyMyDE/9sry119tUXBwsJo2a/5XXvto1+69
Nu3Zjz98r5ee/49Wr/1CQUHBOW4jLi5W3t4+cnX9+zw9csQwlS8dbP2cOnky3/mydwzs5fler3/9
BwzS11s269y5s5KkZUuXqFpIddWsWauAc4Z7kb16ZK/+5eWftilDhz0jBwcH+fn5q1Klyjpz+rTd
urtzx3aVLVfOes5t36GTAgOL35qDBOTAMAy9Ofod/fjD99r05cZs6Zs2bbSWf0k6cviwTp06qeYt
WkqSnu43UHNnz7xj+b3b2Dyej/7jV7knXtaeI/sV3KajylQNtZnZ4umjpORkuSYnyzXy3B3N6D8V
HRUtf/+iNtN8ff106uRJ+fn5q3nLVlqzapUGDh6i9WvXatNX3+a6Lj+/7E9SJGn+3Dl64/VXJUkN
GjXS+xMmZpsnMwjJvDAtXOTv72lpadb5Fi9aqBXLlyotLU0Wi0XJyclKT09XfFy8zVMjBwcHBQUH
SZLi4+IVFRmpkMoVrOlJSUnq1Llztrx9MnmKzb7YWzaTl5e39W8PD0+dOH7c7nGtHhqqpctXavrU
z/Taqy+pUqXKGjtuvBo1bpLj8ctkb52ZMvPt6eWlDh0f14J5c1SjRk2tXb1an2/cbHf9uLsUVJ2A
ORQtWkxRUZFKS0vL8SZfZESEihYtZv2eUzuWn3Li6eFp/dvR0dFaNh0cHNQjrJd6hPWSJB3Yv19v
v/WGunRqr10/7ssxz7mV5QsxF2yevDs4OGRrC/s/1VeOjo4qWqxo1tXaHJO4uFglJiZaXy8Y8+44
vTbqTUlSSOUKSk1NzdZDL7d82TsG9vJ8r9e/UqVLq1nzFlo4f55eeuU1zZszS0P+9UzeC+K+ZLFY
bM5ZmZKTk23aptzakrzqnz3/pE3xuS7dyclJaWlpunLlSq51N/ZCrHx8fG3W4e/vL+B2KuLhofc/
nKj/jByhPT//ap1+7do17dq5U7PnzLdOmzVjmqIiIxVc/O+ynnDlir7buUONmzx0R/N9N7A506db
HOTp5KQqnr5K++NgtpktMuTiYFFxDy/da7/aF1g8UOfPR9tMi4k5r8DAQElSWM9emjl9msqVL69S
pUrZ7WKY21P9bj3C9GibNpIyumtdvnT5pvK6bu1qvfd//9XWnbtUqlRppaWlKdA/4wLV09NTly9d
ss5rGIYizmU8QQoKDlKFihX1w56fs60zMTHRJm/Jyck2+2Jv2cwgOzo6SqVKlZaUMWKmj69Pnse1
abPmatqsuZKTkzX1s08z3jU7ddbu/ue1zuvzLUlPPPmU+j35hB57rK2CgoJUPdT2JhXufbejTsAc
GjZsJCdnZy1ftkS9ej9hk7Zzx3ZFRUWqWYsWSkvNuKDOqR2zV05ye0dQyhg0aOeO7erWPcw6LaR6
db026k091PBB62sq17NXlosFFLNp+wzD0O8HD6pipUrWaWvWb9DED97XM0OHaNHSnJ+Q16lbT97e
Plq8cIEGDs4YjM/Ty0ueXl657ou9fNljL89mqH8DBg7Wq6+8qLbtOuj4iePq2r1HQWcJd6kSJYJ0
+NAhNWjYyDrt0sWLOnnihEqWKmV32Zutf3ktm582JSf26u7SJYt08WK8zbTIyNzbSeBW6dDxcS1a
uED/HfO2nJ2dJUk7tm9TzVq1rOOoJCUlafGihdrz068qU7asddkpkydpzqyZ92WwbxOxO7q4ysnB
Se4urnLOoUukR8myksVB9+I4HE2bNVd0VLR14LZTp05q3Zo16tDpcUlSu/YddWD/fi2cP0+9nuib
r3U6ODjI0dFRFy9dlJTRLTQgIFABAYHZ7nreiPi4ePn6+So4uKQMw9DED96XxWJRQkKC6jdoqN9+
+1UHDxyQlPGTPwkJGT+b0rRpc0Wci7DuY2JCgoYPG6Jffvk5z7zZWzbT/LlzJEmxsRe0ZdMmNWve
wu5xnT93jkaOGKbU1FS5uLioRo2aOQ7ikvU45vW/ypb3Zs3l7u6u5/8zMt//O9xbbkedgDl4eHpq
9Ftj9PxzI7Vo4XwlJibq2rVr+mL9Oj3dt49eeOkVm+7uObZjN1lO0tPTNXzYUH3y8UQlJiRIks6f
j9Znkyepdu06cnNzy9a+2SvLLVu1VlRUlL5Yv06StGb1SnVo+6jNzc2KlSpp4seTdODAb5oxbWqO
+XJzc9N//+89vf7ay5oxbaquXL6slJQU/fzzT+rZo6uKFQuQr5/tecBevuyxl2cz1L/H2rbTtaRr
euP1V9Srdx9rTwkgq+Ej/61xY8do948/KCUlRcePHdOA/k/pwfoN1OShh+0ua6/+ZW1DbnWbkhN7
dbdRoyY6fOiQ9fXJ5cuW5DhQKHA7TPjwI82dM1unT5+SlDEK//Vd+FevClfZsmVtAn1J6ty1q9av
W3NfDtRnE9F7lS6vjEg+oxFIT05W8uWLuhYVqcQzJ3Rh11Ylp6fr9KU4RbsXKoDs3jxvbx8tC1+l
sWPeVp2aIerWuaPGjB1n7VLu7u6utu3a6/P1a60/qZMXBwcHdesepnaPtdakTz66ZXnt0rWbSpQI
Uo2QymrWpKHKV6igHj17afCAfkpJSdE7Y8epW+eOavBAbcXEnFdI9VBZLBZ5enkpfPVajRs7RjVC
Kqth/bry8/NXjRo189xmfpYNDCyuxvXrqXZoiDp06qROj3exe1w7d+mqhCsJql6lokKrVdKoV1/W
7HkL8jyOef2vclq+V58ndPbMmXz/73BvKYg6gXvHsOEjNGXqdM2aMV1lSxZXyeJFNX7cWL397li9
/sZom3lzasdutpyUKBGkDZu+0vZtW1W9aiWVCPBTwwcy3mNdGr5KUvb2zV5ZPnf2nMJXrdXoN19X
meDi+uC98VqyPDxb74DCRYpozvxFGv3m69r/22855u2JJ5/SgkVLtWrlClUsX1pBAX4aPOBphYRU
167de7MN1GcvX78fzN7TL5OXl3eueTZD/XN0dNRT/frrqy2bNWCg7U8WpqWlyd+7iPy9i2j7tq16
5aXn5e9dRC/85/4cBOp+N3zESI187nkNGzpIQQGQdH4CAAAgAElEQVR+avtoK5UuXVpLlofnOY6Q
vfr35x9/2LQht6NNycpe3S1VurTemzBRfcK6K6RKBe3Z/aPqN2jIiPy4I4KDS+rVUW/oxPHjkqRN
X9r+5N7smTPUJYceWMWLl1DNWrW1eNHCO5bXu4Xl8tUUa+1c0PlhuR87oiAPL7l4esqtqK9SYmKl
lKuyJF1TSlqaIq5dU7CriwqXLKeKS7cUZN7vW1nfTa0VWlXvTZhoc2frVjp18qRCqlRQ3OWrd+2v
MMydPUsbN36hZStWFXRWUADudJ3AvedeaMcAALhfXbgQozLBxXU+7rLc3Nxu67amfTZF3377tZYu
X3lbt3M3sHmyb0lNk4vSVdzZIp+rl+V08oTcEy6rSGqaPJyc5O/mplpePiru5i6PlOSCyvN9LTEx
UWVLlrB2rdq29VtFRESodp06BZyzghMZGaEJ7/+fnh35XEFnBQWAOgEAAABkZxPsl2nfVY5paSrs
6Cg3i0UeFos8LFLh9HQVSk+Xa1qaHNNTlJqartQinrmtE7eRu7u7Pps2Qy+/+B9Vq1ReLz7/b82Z
u8BmtOn7ydgxb6tx/Qc0aPDQ+3LQDVAnAAAAzOKhRg9q6pRPb9v6O7R9VBPe+7/btv67jU03/vT0
dP3y2fsqsXWTDD8fydNXFk9fOfl6S4U85Fi0mBwLe8nZy1OOwWXlUizQ3roBAAAAAEABsAn2AQAA
AADAvS/77+sBAAAAAIB7GsE+AAAAAAAmQ7APAAAAAIDJEOwDAAAAAGAyTslXEwo6DwAAAAAA4Bay
GIbBaPwAAAAAAJgI3fgBAAAAADAZgn0AAAAAAEyGYB8AAAAAAJMh2AcAAAAAwGQI9gEAAAAAMBmC
fQAAAAAATIZgHwAAAAAAkyHYBwAAAADAZAj2AQAAAAAwGYJ9AAAAAABMhmAfAAAAAACTIdgHAAAA
AMBkCPYBAAAAADAZgn0AAAAAAEyGYB8AAAAAAJMh2AcAAAAAwGQI9gEAAAAAMBmCfQAAAAAATIZg
HwAAAAAAkyHYBwAAAADAZAj2AQAAAAAwGYJ9AAAAAABMhmAfAAAAAACTIdgHAAAAAMBkCPYBAAAA
ADAZgn0AAAAAAEyGYB8AAAAAAJMh2AcAAAAAwGQI9gEAAAAAMBmCfQAAAAAATIZgHwAAAAAAkyHY
BwAAAADAZAj2AQAAAAAwGYJ9AAAAAABMhmAfAAAAAACTIdgHAAAAAMBkCPYBAAAAADAZgn0AAAAA
AEyGYB8AAAAAAJMh2AcAAAAAwGQI9gEAAAAAMBmCfQAAAAAATIZgHwAAAAAAkyHYBwAAAADAZAj2
AQAAAAAwGYJ9AAAAAABMhmAfAAAAAACTIdgHAAAAAMBkCPYBAAAAADAZgn0AAAAAAEyGYB8AAAAA
AJMh2AcAAAAAwGQI9gEAAAAAMBmCfQAAAAAATIZgHwAAAAAAkyHYBwAAAADAZAj2AQAAAAAwGYJ9
AAAAAABMhmAfAAAAAACTIdgHAAAAAMBkCPYBAAAAADAZgn0AAAAAAEyGYB8AAAAAAJMh2AcAAAAA
wGQI9gEAAAAAMBmCfQAAAAAATIZgHwAAAAAAkyHYBwAAAADAZAj2AQAAAAAwGYJ9AAAAAABMhmAf
AAAAAACTIdgHAAAAAMBkCPYBAAAAADAZgn0AAAAAAEyGYB8AAAAAAJMh2AcAAAAAwGQI9gEAAAAA
MBmCfQAAAAAATIZgHwAAAAAAkyHYBwAAAADAZAj2AQAAAAAwGYJ9AAAAAABMhmAfAAAAAACTIdgH
AAAAAMBkCPYBAAAAADAZgn0AAAAAAEyGYB8AAAAAAJMh2AcAAAAAwGQI9gEAAAAAMBmCfQAAAAAA
TIZgHwAAAAAAkyHYBwAAAADAZAj2AQAAAAAwGYJ9AAAAAABMhmAfAAAAAACTIdgHAAAAAMBkCPYB
AAAAADAZgn0AAAAAAEyGYB8AAAAAAJMh2AcAAAAAwGQI9gEAAAAAMBmCfQAAAAAATIZgHwAAAAAA
kyHYBwAAAADAZAj2AQAAAAAwGYJ9AAAAAABMhmAfAAAAAACTIdgHAAAAAMBkCPYBAAAAADAZgn0A
AAAAAEyGYB8AAAAAAJMh2AcAAAAAwGQI9gEAAAAAMBmCfQAAAAAATIZgHwAAAAAAkyHYBwAAAADA
ZAj2AQAAAAAwGYJ9AAAAAABMhmAfAAAAAACTIdgHAAAAAMBkCPYBAAAAADAZgn0AAAAAAEyGYB8A
AAAAAJMh2AcAAAAAwGQI9gEAAAAAMBmCfQAAAPw/e/cd1uS59wH8m0kIM2wRHGwEN3Ug7jqrrVVr
a1u7TmvtOD3teevp6TqvnafrvK2dp3bYWmu1rbXuraC4tdYBKigqICgbWSGE5P0jTQoxCQkEEsL3
c11eQnjG/fzu33Pfz/2sEBGRi+Fgn4iIiIiIiMjFcLBPRERERERE5GI42CciIiIiIiJyMRzsExER
EREREbkYDvaJiIiIiIiIXAwH+0REREREREQuhoN9IiIiIiIiIhfDwT4RERERERGRi+Fgn4iIiIiI
iMjFcLBPRERERERE5GI42CciIiIiIiJyMRzsExEREREREbkYDvaJiIiIiIiIXAwH+0REREREREQu
hoN9IiIiIiIiIhfDwT4RERERERGRi+Fgn4iIiIiIiMjFcLBPRERERERE5GI42CciIiIiIiJyMRzs
ExEREREREbkYDvaJiIiIiIiIXAwH+0REREREREQuhoN9IiIiIiIiIhfDwT4RERERERGRi+Fgn4iI
iIiIiMjFiL/+eomjy0BEREREREREdiSOiU1wdBmIiIiIiIiIyI54Gz8RERERERGRi+Fgn4iIiIiI
iMjFiAFAqVQi4+w5lJSUQK1WO7pMREREREStJhaLEeDvh7iYWHh4yB1dHCIihxArlUrs3bcfqoYG
R5eFiIiIiKjN1Go1rl4rQllZOUaOSIZMJnN0kYiIOpww4+w5DvSJiIiIyOWoGhqQefaso4tBROQQ
wpKSEkeXgYiIiIioXRSXlDq6CEREDsEX9BERERGR6xIIHF0CIiKHEAb4+zu6DERERERE7SLA38/R
RSAicghhXEwMpBKJo8tBRERERGRXUokEcTExji4GEZFDCD085Bg5IhndQoIhFosdXR4iIiIiojYR
i8UICQlG8vBh8JDzq/eIqGsSA4BMJsOgAQMcXRYiIiIiIiIisgO+oI+IiIiIiIjIxXCwT0RERERE
RORiONgnIiIiIiIicjHifenpji4DERERtRO1Wo2SkhLU1dVBJBJBIpFALBYjMDDQ0UUjIiKidsTX
7xMREbmw8vJy1NfXw8vLC0FBQZBKpSgpKYFSqYRMJnN08YiIiKidcLBPRETkwrRaLby8vBAdHY2Q
kBDD1+zW1tY6uGRERETUnjjYJyIicmFubm5wc3NDSEgIfH19Aehu7ReLxdBoNA4uHREREbUXwfbt
27WtnVmr1d7wc9PP6E8CgaDZ/8YYP/thrO2PMXV9rOOOxXh3Laxv+2Es24bxcz2sU+cgEokcXQST
7HJlX6PRQKvVQqvV8iqBGUKhEAKBAAKBAEJh8y9BYPzsi7G2P8bU9bGOOxbj3bWwvu2HsWwbxs/1
sE6dg8sO9jUaTbN/PGtkmkajgVAoNOyE+v8ZP/tjrO2PMXV9rOOOxXh3Laxv+2Es24bxcz2sU7Kk
TYN9ffLI5XL06dMHCoXihjNKpKPRaFBeXo7MzMxmL0Vi/OyPsbY/xtT1sY47FuPdtbC+7aelWI4e
PdqBpes80tLSmIsugu2Lc9i1a5eji2BSmwb7+ltCIiIiIBKJcP36dXuVyyWJRCJERETg5MmThudq
GL/2wVjbH2Pq+ljHHYvx7lpY3/ZjKZZkHeaia2H7Qua0eIrH3MsegD8H+x4eHnYtlCvz8PC44fkZ
xq99MNb2x5i6PtZxx2K8uxbWt/2YimV4eLiji9VphIeHMxddDNsX56N/l4IjWbyyL5FIIBQK0dDQ
YPKlDvpkcvRGdDb6uOl/ZvzaD2Ntf4yp62MddyzGu2thfduPcSzJNsxF18M6dS5SqRQBAQGoqalB
RUWFQ8pgdrAvkUggk8mg0WjQ0NBgcho2sK1n6msLqX0w1vbHmLo+1nHHYry7Fta3/TB+bcNcdD2s
U+chFAoRGBiI4OBgXL58GaWlpR1fBlMfisViuLm5QavVQq1WW/yqBiaR7bgTdhzG2v4YU9fHOu5Y
jHfXwvq2H8aybRg/18M6dS5KpRLFxcUAdI/O+Pn5dXgZbriyLxaLIZPJAAANDQ1QqVTtXoijR4/i
0KFDKCoqglarhUKhwIABAzBq1Cin+s7C6upqvPHGG4iPj8d9993XYestLy/HO++8Y/hdLBbD19cX
CQkJGDNmjKG+LMnPz0dBQQGGDBli8/q1Wi0OHjyII0eOoLi4GBKJBEFBQRg5ciQSEhJsXp49y2Zv
X331Fc6fP48nn3wS3bt3N3y+detWpKamYubMmYiKijLUx+jRozF58mTDdMuWLcOZM2cglUrxyiuv
3LB8fV1GRETgkUceaf8NslJ71sF7771n9kxm9+7d8eSTT9p9nabYuv+2NiZdsY6taaNsib8t03bF
eFvTTsXHx1sVQ3uVs6U6a5ojtrab9iqDo/rwtupqbaizuVpcjruefNPwu0QiRkigAilJCbj39vHw
kMtQVlGFmY++ihFJCXhj4QMWl2fLtM7GkW09ABQWFmL79u3Izc1FXV0d5HI5EhISMGXKFLi5ubV5
+1rLHm2Lo/YXZ+i/m/L09ESvXr0wbdo0+Pj4tHq7jh8/jk2bNkGlUmHy5MlYt26doUwd2RdotVoU
FhZCJBIhICAAPXr0gEaj6dBb+psN9iUSiWFn0Q/02/us0MaNG5Geng5vb28MGjQIMpkMWVlZ2LZt
G65cuYJ77723Xdffmfj7+2P48OGoq6tDdnY20tLScObMGTz++OMtNnK7du3C9evXW9WIrF+/HgcO
HIBCocDQoUMhEolw8uRJLF++HLNnz8bgwYNbu0ltLpu9DRo0COfPn8fp06ebHURnZmZCLBajb9++
qKurA6B78+np06cNB61qtRrnz5/vlF9t0p51MHbsWCiVSgDApk2bIJFIMGHCBAC6Rt1ZOVNe2kNH
bI+lNkomk2HevHnw8vJqt/U7k/aMtzXtlFgstireHZ3njmw3O2sOsg11DqHB/pg5eQSqa+pw+EQW
fliXiv3HMvHZG0/By8Mdrz97P/wV3o4uZodwRFuvUqnw5ZdfQqvVYsyYMfDy8sLZs2dx6NAhqFQq
zJkzx67r62iO3l8c2X/7+flh6NCh0Gq1KCgowMmTJ1FeXo4nnnii1e8cOHz4MKqrq7Fo0SKIRCL4
+Pg4rO3XaDTIy8sDAAQEBKBXr164dOmSzQN+gUAAqVQKoVAIpVJ5wxhdIBAYHsFvOoY3DPbFYjGk
UimAjhvol5WVYd++ffD09MTf/vY3yOVyAMDEiRORlpYGhUIBjUYDoVCI/Px8bN68Gfn5+XB3d8e4
ceMwZMgQVFZW4q233sKQIUMgEolw7NgxeHh4YNq0aejTpw8AtDhvUlISysvLUVVVhWeeeQZnzpzB
tm3bUFJSAh8fH4wdO7bNA1p78PHxwYgRIwAA48ePx48//ojff/8dBw4cwJgxY8yW+z//+Q9KSkoA
AM8//zxefPFF5OXlWbWNpaWlOHjwILy9vfHXv/4V7u7uAHRXZpYvX46qqioALcfYXP2YKltFRYVN
9WVPiYmJ+PXXX5GRkYFJkyYBAEpKSlBUVIS+fftCJpMZBvshISG4cuUKrl27huDgYGRlZaGhoQGh
oaGGbWpJ021qbGzEqVOn4O/vj7lz52LXrl3IzMxESEgI7r33Xvj4+KCiogJvv/02EhMTIRKJkJmZ
CXd3d8yYMQPx8fGGOlu/fj1ycnIgEAjQo0cP3HLLLQgJCTEZQ41Gc0Md2PMAsmlebdmyBRKJxJDH
gHX7p71iY8yWfcZcXrakK9SxnqU2KikpCd99912zM+lHjx5FWloaKioqIJfLMXjwYNx88803LPfs
2bNYtmwZBg0ahNmzZ1ssQ1eItzXtVHV1dbN4W1POBx98EEuXLsXQoUMxY8YMAMAXX3yBnJwcvPba
axCLxW3uH61tNy2tp7CwEBs3bkR+fj5kMhkGDhxoGPwCuhMKW7duxYEDByCXyw39jVKpNBmT1hw/
AObz194nLrpCG9pRsWyLQH8fzJ46EgBw/+wJeOPjH7Aj/Th+2ZKOqWOH4KX3vm12tX7jrsNYuT4V
V4vL4ePlgSljkvDgHRNvWO7B387ghXeWYtLoJDz32Byz8zlTLBzR1peXl6O2thZ9+vTBqFGjAAAD
BgxAdHS04dZoa/ZpczlrTf63tB3m2h7Acj9ian85e/Zsh+4Tjuy/fX19DXUK6Oo6Ly8PZWVlEIvF
Jo/9LcXz008/NQyuFy1ahClTpmDz5s0Wr+S3d1uv1WqRn58PoVAIPz8/9OzZE1qtFpWVlVYvA9Cd
LAgMDERxcTEKCwsNj9oLhUJ069bN8LeCggLDPEJAl5wymQwCgaDDBvoAcPHiRWi1WgwYMMAw0K+v
r0dNTQ2SkpIQGRkJjUaD6upqfPnll6isrMT8+fMxYMAArFmzBleuXDHc5v/777/Dz88Pd911F2pq
arB69Wqr5z116hRCQ0MxefJkVFVVYcWKFRAKhViwYAF8fHywevVqw/MWzkIgECAlJQUAkJ2dbbHc
d999N8RiMQIDA/HYY49BrVZbvY1N60g/0AcAuVyO+fPnY8yYMW2qH+OyNTY22lRf9iaRSJCYmIji
4mIUFRUBADIyMgAAAwcObDZtjx49IBaLcfr0acN0QUFB8Pa2/sx+022Kjo5GSkoKrl27hiVLliAm
JgajR49Gfn4+0tLSAOhOygG6K3hxcXGYP38+tFotVq5cifr6ejQ0NGDJkiXIy8vD7bffjhkzZiAv
Lw/Lli2DWq02GUPjOmhaz+3N2v3THrExZss+YykvW9JV69i4jTJWWlqK1atXIzw8HI8++ihGjhyJ
/fv349y5c82mKywsxA8//IDo6GjMnDmzxfV2hXjb0k6Ziou5cur7YXPs0T9a025aWo9KpcLXX3+N
4uJizJkzB4mJiUhNTcXevXsN81+8eBF1dXUYM2YMKisrDf2NuZi05vjB2vxtb67QhjpLLG0hEAgw
5xbd4OTIyawb/n7lagne/fwnxEWG46NXHsecW0Zh9eZ0HPjtTLPpLuQW4pXF3yOpfwyenT/b6vmc
SUe19f7+/vDy8sKZM2fwww8/4OjRoygpKUFSUhIiIiIAtLxPW8rZlvLfmu0w1/a01I8Y7y+1tbUO
3Scc1X/r6fuixsZGk31XS/GcNWsWgoODAQCPPfYYYmNjLa6vo9p6jUaDS5cuoaysDCKRCL1797bp
qxG1Wi1qamogFAoRHByMsLAww1f7hYWFITg4GEKhEDU1Nc3G8Ra/es9arb3FQn+F1MfHx7CMzZs3
49ChQ4Zp5s2bh7q6OtTX12Ps2LEICwtDSEgI9uzZg2PHjmH8+PEAdGc6Ro7UnXGNjIzEmTNnUF1d
jezs7Bbn9fHxwS233AJAd7Lh8ccfh6enJ7y9vdGnTx/k5OTg6tWrhsbE3t+Z2NKymv696c++vr4A
gNraWri5uZktd79+/QAAbm5u6Nmzp8VtDAoKarZu/a2DXl5eZst57ty5VtdPaGhos7IdPXrUpvqy
lTX1NmjQIPz222/IyMhAcHAwMjIy4Onpibi4uGZ1L5VKER0djYyMDIwbNw7nzp3DkCFDUFhYaHZd
xnWp/z0wMBCDBg1CVVUVUlNT4evri6SkJNTV1WHnzp0oLi5uNn1oaKjhoL5///5IT0/HpUuXoFKp
cP36dYwbNw6DBg0CoDtbuX//fuTk5Bhu+TUVQ30d2Ko1+4J+Hmtyx16xCQsLM6xbIBDYtM9Yykv9
ck3Fo6vUsTVtlP5z/TbqO6Li4mIUFxcjMTHR0EZUV1cDAGpqavDtt9/C29sb9957r8l3uHTFeAPW
t1P6n/W/Wypn0ysBxmVoaZ9pqX+0pd20tJ5r166huroaEyZMQEJCAmJjYxEREQFPT0/DOtzd3XH7
7bcDAHJycpCdnY3q6mpD/hjHpDXHD8nJyQBM56+tunobas9YdqRAf137VlVdd8PfGht1J5fyCoqR
e6UIo4b2xZxpupMDZRW6OyLLK6vx/Ftfw1/hhVeemQeRSGhxvo7gzG29RCLBo48+iu3btyMrKwsn
T54EoNt/b7vtNkRHR7e4T8tkshbbMHP57+/v3+J2mGt7Ll++bLEf0Q9G9fuL/gRqR7QvztB/NzQ0
oKKiAlqtFnl5ebhw4QIUCgUCAwNRW1sLoHnfdfLkyRbjqb9bvWfPnoYyGbf9+p8ttaPO1j5VVFTg
8uXLCA8PR0BAgOHzgIAAw+MCxo8HiAHdmROlUgk3NzdIJBIA6JCr+/ozN01vYRgxYgQSEhJw9uxZ
7N+/HwAMFb1jxw7s2rULgO7sRtMX1uiTEkCzFwxaM69+B9ZLS0szdPL6GDQ2Ntphi+2rvLwcwJ/P
7NlSbmunNVVHevpHLNpSP8ZaU1/2FhkZCR8fH2RmZiIpKQn5+fkYPny4ydt1EhIS8PPPP+PkyZOo
qalBQkKC4aDVFvqrWvp3L+jrVP+78VWpps8d6c8KVldXG07ONI23/gUnlZWVhoFJe8fQWtbUt71i
Y4q1+4E15WxJV6xj4zaqqcDAQEybNg2pqan48ccfAQBhYWG45557DP1Qbm6u4WpLVVWVTdvk6vG2
pZ1qqq3ltEf/aE27aW49NTU1AP6sL7FYbHhRrH4/b3rSWl/vDQ0NZl/425rjB0v5q1AobIpHW7hC
G+ossbTV1eIyAICf743PAffoHoQn778VK9buxpufrAQAxEWG45Vn5kEi+eMKcvZlSCRiCKAb+LvL
3CzOFxzovLHoqLY+ICAAc+fOhVarRXFxMTIzM7Fjxw6sWLECL774omE6c/u0TCZrMWfN5X9cXFyL
22Gu7bl+/foN5Wraj9gSs47aJzqy/87Ly8Pbb79t+N3T0xNz5sxp1p81nd/WeLako9onoVCIHj16
wM/PD42Njbh06ZKhT7NFaWkptFotevToYRjwazQa5Obmoqys7IbpDVf21Wq14UytrQP+1p4UiIiI
gFAoxG+//YbRo0fD09MTgYGBCAwMbHZ7rL4CR44c2ezZNYlEYli3Vqs1WQ5r5m26DXv37sWJEycw
depUpKSkIC0tDVu3bm22fHPraq2WlmWqnFqtFnv27AEAxMXF2VRua6bVi4yMhFAoxO+//44xY8YY
Gr7a2lp8/PHH6NGjh+F5pNbUj/Hfba0vW1k738CBA5GWloajR49Cq9Vi0KBBzcqqFx8fD6FQiO3b
t0OhUDR7WZal7dX/bLz95v5u/Lv+DCjwZ8Pm6elpOJNZXl5u+Lu+wfbx8bEYw9bmdVvmsWXfbmts
WrMf2JqXxvHoKnVsTRtlqi1ITk5GcnIyysrKkJmZiU2bNmH37t2G56979uyJW2+9FZ988gnWrl2L
Bx98sMV1d4V461nTTpmLg6ly6g+smh4E668Q2LrPWNqmltpNS+vRH3hev37dsK6DBw/Cy8sLvXr1
sqoMxjExN31L+725/NVf2bMW21D7xbKjaLVarFqve/xh2MA4k9PMmpKCWVNSUHCtFOlHM/DZdxuw
/Nddhuf2E2N64em/3I75zy/G+1+twbsvPGxxvv95ZFaHbJe1f+/otv7ChQs4ceIEBg4ciN69eyMw
MBCjR4/G+fPncf78ecPtzcbrbsqanLWU/y1th7n16k+4tdSPWBMze7cvztB/BwcHY+JE3X7h5uaG
8PBwSKVSs32XtfE0LrO5tr8j2if9rfZ+fn7QaDS4fPlyq05M6JWVlUGj0Rj6PUsv/Gt2G39DQwO0
Wi1kMlmHXOH39fVFSkoK9uzZg8WLFyMxMREeHh7Iy8tDdnY2ZDIZ/Pz84OPjA7lcjoyMDERGRqKo
qAiHDx/GqFGjEB0dbXEd0dHRNs2rfy6ttrYWFy9eNNwmVFRUhB49etg/CDaoqKjAnj170NDQgPPn
z+PSpUsIDQ3F0KFDsW3bNgCmy61SqSCRSFBWVoYzZ84YzoiZm1Z/cAvodppRo0YhNTUVH330ERIS
EiAWi3Hy5ElUVFRgzJgxNsfYWNOy9ejRo03LspeBAwciNTUVe/bsQWBgYLOD0abkcjl69+6NCxcu
NHthUnsrKipCWloa/P39ceLECchkMvTu3RuArs4OHTqEbt26Qa1W4/jx4wgICEBERIThKqWxpnUQ
ERHRYV9h09bcMcVcbIy/RtTSvm68z1jKS3PPSLdVZ6xjS22Ucbn0z12OHz8eMTExUCgUEAgEN7wb
RD//gQMHcPr0aSQmJtq93EDnjLe17ZQlTcsZFhYGiUSCrKwsnD9/Hvn5+c2u6Nqrf2yp3bS0nuHD
h0Mul+PQoUMIDQ3FlStXsHPnTkyYMMFw0GMvltonmUzWYv52BFdoQ50lli0pLq3EqvVpUNarcPRU
Nk6dvYjoXt0x/eZhqKlt3g7sO5qB1z78HvfPnogh/WPQLdAPQoEAnvI/vyrZx9sDUb1CcdvE4Viz
ZR/SDp6EWCxqcT5n4Ii2XiqV4tixYzhz5gySkpLg7e2NoqIi5OTkwN/fH97e3mbvQNGzpg0zl//W
bIc5sbGxFvsRoHlbrFQqsWbNmg7dJxzZf3t4eBguHFrDmnjaor3beqFQiLCwMMOt9q15E78pFRUV
uHTpkuFns+s3/kCtVhsqVSKRNBv4tYcpU6Zg5syZ8PHxwbFjx7Bnzx5UVFRgxIgReOaZZxASEgJ3
d3c8+OCDkMvlWLZsGXbv3o2IiAj07du3xeXbOm9ycjLCw8ORnp6OzZs344477kBoaCjS09ORm5tr
7823SVlZGTZv3oydO3eivLwcycnJeOSRR9YRREQAACAASURBVCAWiy2WOy8vD8nJyWhoaMDPP/+M
/v37W5zW2KRJkzBr1ix4enri8OHDOHz4MLy9vXHPPfdgyJAhbaofAM3K1tjY2KZl2UtQUBC6d+8O
pVJpeB7IHH3jpb+VtCPExMTg2rVrWLVqFaRSKebOnQupVAqpVIqHH34YYWFh+PHHH/Hrr78iMjIS
Dz30kOF2KlOa1kFLnaU9tTV3TDEXG2O27DOOyMvOWMeW2ihjsbGxSE5OxoEDBwxn/m+66SaMGzfu
hmknTJgAuVyO9evXm3xRmD10xnjb0k6Z07ScKpUKt99+O8RiMZYvX47a2lrExemuWmo0Grv2j5ba
TUvrKS4uxkMPPYSAgACsWrUKR44cwejRozFmzJhWbb8lltonW/K3PblCG+ossWxJwbVSfLZ8A779
eTuuFpdh1pQUfPC/C+Amldww7bCB8Zg5OQW/bEnHo89/iA++XoOp44bg/tkTbpj2oTmT4O0lx0ff
rkO/+Air53MkR7T14eHhePDBBxEcHIwjR45gw4YNOH36NPr27YuHHnrIqnJb04aZy/+25Kk1/UjT
/SU8PLzD94nO1H+3tl82pz3beoFAgG7duhkG+rm5uXYZ6OtVVFS0uDzB9u3bTV62l0gkhu/qq6ur
M/km2/r6eqjVasMbG8k66enphmRk/NqXq8W6uroab775JuLj4zFv3jyHlMFZY+oMsbEHZ9gOZ63j
9sB4U0dz1vp2hn3BVsaxvO222xxcos5l7dq1TpmLjtAZ898UZ21fuoLjx4/f8Jm7uztiY2MhFApx
+fJlm971ZC9mT3/oX55mzXcIttdt/l0F49dxOnusLT136yjOWA5nKVNrOON2OEs52gPjTY7mLPXt
jPsCdayuXO+umv+utC2dkUajQXFxMWpqaux6Rd8WFu91aGhoaPYVC+aYuupP1mP8Ok5nj7W+/Fqt
1mm2xdnK4UyxaQ1n3A5nKUd7YLzJ0Zylvp1xX6CO1ZXr3VXz35W2pTNSqVQoKChw6EmXFh9ssKZw
zvi1dJ0J49dxOnus3d3dsWjRIgDOsy3OUg5njE1rOON2OEs52gPjTY7mLPXtjPsCdayuXO+umv+u
tC2dkTPcWWH7WwxM4FmjtmH8Og5jbX+MqetjHXcsxrtrYX2Ts2Auuh7WKdllsK9/vp9ah/HrOIy1
/TGmro913LEY766F9U3OgrnoelinxMG+E2D8Og5jbX+MqetjHXcsxrtrYX2Ts2Auuh7WKbVpsC8Q
CCAQCKBWq+1Vni5BHzf9z4xf+2Gs7Y8xdX2s447FeHctrG/7MY4l2Ya56HpYp2TMLoN9Pg9iG+Md
kfFrP4y1/TGmro913LEY766F9W0/HOy3DXPR9bBOyVibB/tCoZBnjWwkFAoNOyLj174Ya/tjTF0f
67hjMd5dC+vbfoxjSbZhLroe1ikZE6empjq6DEREREREbXLgwAFHF4GIyKkItM7wBYBERERERERE
ZDe854mIiIiIiIjIxXCwT0RERERERORiONgnIiIiIiIicjEc7BMRERERERG5GA72iYiIiIiIiFwM
B/tERERERERELoaDfSIiIiIiIiIXw8E+ERERERERkYvhYJ+IiIiIiIjIxXCwT0RERERERORiONgn
IiIiIiIicjEc7BMRERERERG5GA72iYiIiIiIiFwMB/tERERERERELka0aNGiReb+WFtbi2+++Qbn
z59HRkYGMjIykJWVBR8fH3h5eXVgMe3n0qVLmDdvHu6+++5mn48fPx7Tpk2DXC43Od/hw4fx7rvv
YvLkyW1a/5tvvomKigrExsbaPG99fT327duHffv2ITMzE1lZWXB3d4evr2+bymSNK1euYP/+/YiK
ijJ8VlFRgV9++QV9+/ZtNu23336LmJgYSCQSq5fVGnv37oVSqURAQIBN85nK62vXrqF79+4Qi8Vt
KpMtXCl+ztwudNY4ExERERG1RYsjG6lUijvvvNPw+7Vr17B161bMmzcPAoGgXQtHze3YsQN+fn6Y
O3cuhEIhSkpKsHnzZnh4eCAwMNDRxetUmua1VqtFeno6jh8/jmHDhjm4ZJ0D2wUiIiIiIudm82XM
4OBgaDQa1NXVQS6X48SJE8jNzYVGo4FCocCIESNw7do1HD9+HL6+vqisrIRcLodCoUBZWRkqKysx
efJkyGQyHD16FFeuXIFQKISvry+Sk5Oxbt06JCcnIzg4GACwceNG9OvXD+Hh4SbXJRKJ7BqQgwcP
4uuvv0ZYWBjq6uqgVCrx+uuvN5vm888/x+HDhyEWi9GzZ08sXLgQQqEQb775JnJzc6FWq9GnTx8s
XLgQGo0GixYtQl5eHvz9/aHRaFpVruLiYly/fh1Tp041DKYCAgIwa9YsuLu7Q6PRYO/evaisrIRG
o0FgYCBGjBiBgoIC/P777/Dx8YFSqURtbS0mT54MiUSCI0eOIDc3FwKBAPHx8YiPjwcAk3Fujfz8
fBw/fhze3t5oaGiAWq3GuHHjmk1jKgcEAoHJbdFqtUhNTTXklFarbVW5jAkEAoSFheHcuXNm45iX
l4fMzExMmjQJAJCWlobQ0FCEhYVh165d0Gg0UKvViI2NRZ8+fQCYjqMt+dpZ4gdY1y6oVCqTsTIX
Ww8PD6vaka4UZyIiIiIia9k82L948SJkMhnc3d1RWFiIgoICTJ8+HYDudtWsrCwoFAqUl5djypQp
EAgE+OabbxAVFYX+/ftj7969yM3NhaenJ/Ly8jBjxgwIBALs3LkT2dnZiIqKQk5ODoKDg1FXV4fy
8nJ0797d7Lr0A1R7EQqFOH/+PBYvXgx3d3e8/fbbWLt2reFW3qNHj2L//v1YunQphEIhXnjhBWza
tAkpKSmIiorCyy+/DAC4++67kZWVhWvXrqGoqAhLly6FSqXC7NmzMXbsWJvLVV5ejqCgoBuumuof
O6irq4Ofnx9Gjx4NAFi9ejVKS0shFApRWlqKiRMnQiwWY+fOncjLy4NUKkVhYSFmzpwJtVqNrVu3
IioqCiUlJSbj7O3tbXOZBQIBysrKDCcX0tPTce7cOfj5+QEACgoKTOZAjx49TG5LdXU1ampqMGPG
DDQ2NuLHH39Er169bC6XMY1Gg4sXLyI4OBhKpdLkus25ePEi/Pz8MHz4cDQ2NiIzMxMA7JKvnSV+
+ji01C5otVqTsTJHKBS22I54eXl1qTgTEREREVmrxcG+SqXC6tWrAeie1fXx8cGkSZMgEAhQUFCA
8vJyrF+/HgDQ0NAAmUwGhUIBhUIBoVD3/j83Nzf4+/sDAGQyGerr61FbW4vQ0FDD4LVbt24oLi7G
4MGDsXbtWgwfPhw5OTmIjIyEUCg0uy570pclLi4O7u7uhp9PnjxpGOyfPn0aSUlJhm0bNGgQMjIy
MH36dFRWVuKJJ56ATCZDSUkJKioqkJ2djX79+gHQ3frcv3//VpfP0l0B7u7uqK+vx8aNGyEWi1Fb
WwulUgmRSARfX1/Ds+j66SoqKtCtWzcIBAJIJBJMmzYNAMzG2dbBftO7D/TPRAcEBODatWuGQVRR
UZHJHIiNjTW5LWVlZYY7PkQikeHn1mia11qtFt27d0e/fv0gFApNrtuc7t2749SpU1CpVAgLCzNc
1W9rvnam+FnbLsTExJiMlSUttSNVVVUuHWciIiIiotay6pn9WbNmAQAuXLiAzMxMwwvhRCIRIiIi
bnjO+erVqzdcgbb2OV65XA5vb28UFRUhJyfHsGxz67KVXC5HRUUFtFqtoUwqlQrV1dWGq+RNB9Ua
jabFsgsEAmzcuBFZWVn46KOPIBQKMX/+fABoth4AaGxsbFW5/fz8cOTIETQ2Nja7RbmkpARyuRx5
eXkoLS013OavH/wAMAyW9IzL1JS5OF+5cuWGaSUSCZRKZbPlNTY2QqVSGQZOTW9htrTeprKyskxu
i/Ht0G25PbppXjd17tw5s3E0tW4fHx/Mnj0bhYWFyMnJwYkTJ3D77bdbla+uEj9r2wUAJmNlrGm5
WmpHXD3OREREREStZdNX70VGRkIikSAjIwMAEBISgtzcXMMA9sSJEyguLrZqWcHBwSgsLDQcCF+5
csVwBSwqKgrnzp2DUqk0vHiuLetqKigoCNHR0fj5558B6AbzX3zxBUaPHm24Inju3DlUV1cDAH77
7TfExMQY5u/Xrx+OHTtmOCFw5MgR9O3bF8XFxejVq5fhMYDs7Gw0NDQgIiICp06dAqC71f7EiRM2
lxnQXW308/NDeno6GhoaAOie49+2bRtqa2tRW1sLX19fwy3JpaWlFk8sBAcHIz8/H1qtFo2NjVi7
di3q6+ttirOHhwf8/f0Nt2NrtVocO3YMvXr1MtxJUFJSApVKBUB3a7v+yqy+DKZywNy2KBQKFBUV
AdBdwb169WqrYmmJuXVLpVLDFX6tVmuIycWLF1FaWoqwsDCMHDkSNTU1UKvVVsXRVeJnbbtgLlbm
YmuNrhRnIiIiIiJb2PzMfkpKCtasWYPw8HCEhIQgJiYG69atg1gshqenJxITE606WO/WrRvCw8Ox
YcMGCAQC+Pr6Ijo6GgDQu3dv7N+/HwMGDDBMb25drfHWW2/h3XffxapVqyAQCNC3b1+89NJLhr9H
RUXh3XffRXFxMWQyGaZPn24YsA8aNAjJyclYsGABhEIhevfujalTp+Lq1atYuHAhHn/8cURGRuLB
Bx/E4sWL8d///hfbt2/HAw88gKCgIPTr16/VV/omTJiAQ4cOYeXKlZBIJJDL5Rg7diwCAgLg5uaG
bdu2oaSkBAqFAgMHDsShQ4dw0003mVyW/uVyv/76K7RaLeLi4uDm5mY2zuYGLDfffDP27dtnGOgF
Bwdj1KhRhr/7+flh3759qK2thVgsRkxMjGEgZC4HqqurTW7LtGnTkJOTg19//RUeHh7tcnt0VFSU
2XVLpVJs374dbm5uhqvYvr6+2LNnD4RCITQaDfr16weJRGJ1vrpK/KxpF8RisclYBQUFmYytNbpa
nImIiIiIrCXQ8h7TZg4fPowVK1bggw8+cHRROr0rV67g1KlTmDx5sqOL0ikxfh2DcSYiIiIiV2TT
bfxERERERERE5Px4ZZ+IiIiIiIjIxfDKPhEREREREZGL4WCfiIiIiIiIyMVwsE9ERERERETkYjjY
JyIiIiIiInIxHOwTERERERERuRgO9omIiIiIiIhcDAf7RERERERERC6Gg30iIiIiIiIiF8PBPhER
EREREZGL4WCfiIiIiIiIyMVwsE9ERERERETkYjjYJyIiIiIiInIxHOwTERERERERuRhxflmdo8tA
RERERERERHYk9pK4O7oMLqHwSi66de/B9ZJDsD4IYB6QDvOAOgPmKbUXHhtTe+is9cvb+ImIiIiI
iIhcDAf7RERERERERC6Gg30iIiIiIiIiF8PBPhEREREREZGL4WCfiIiIiIiIyMVwsE9ERERERETk
YsSOLkBX1KhRo+DqNeRdKUCdWo16lRgijQAyGRAeFoLw0BBIRKwaIiIiIiIiah2OKDtY+fVK5OTl
wttbjgGJ0ZCJ5dCKpFDVNuB6TQ0u5Zfgcu4pJPbpjUCFr6OLS0RERERERJ2Q4Tb+S5dy0LunH6Ii
AlFSUmyY4OiRg+jd0w9paTub/Uy2q7heiYKrV5AQFYakPpFQKHxRr5VCrQS0Ggm8Zb7o0ysKoX69
cfpsPorLKx1dZJvdded0jBjer9ln77z9KiJ7B2DTxrUW82fzpnU4eyaj1eu2lJ8/rPgW48cOQVxM
NwweGI2nn5qPmprqLpPT5vZvS1gfrsfR7XzTnLL3evalp6F3Tz/Dv74JPfHQA3fiypU8i/N1tT7O
3L4HtH2ft7emdRoTFYxxY27C//7rH7h+vf37xq6QC84uN/cSHltwP/r37Y342O64bfp47Ny51W7L
76j2yNbcdbb9kOzH0rGYcb23JQ/skc+vvvIC+sSF3fB5SnL/Zn2t/t+LL/y91etyFY4+xjLHMNhf
t3Y1JBIJNBoNflq1FhpN8wmrKoG4+IHYnfo7oiNHQKXqsDK6hEaNGpcLryC2dziCAxQAALEAQD2g
rgWqq4G6KqBBBQQofBHsG45TZy6ioVHt2ILb6LbbZqOgIB+HDpw2fLZjxxYMGZKCgQMmY9du8/nz
6qsv4PSpDLR1k6sq0Wz52Vln8cLzz2D06En4/vvdeOaZN7Bhwxr833v/QWLfrpHTLe3fprA+XI81
7XxDw58/27sOmuZU337tU9fz5z+Hzz9fh4UL38ahQwew8H+etirfu0IfZ2nf02rtt8/b2/z5z+H9
91diwoTZWLVyOebdewc0Gm27rrO98pOs09DQgPvnzcahg/vw5JMv4vXXl8DHJwgL5s/DsWPH7bKO
jmqPbM1dZ90Pqe0s9cHG9W6PPLBHP15qdH3oo0++wpIl6zBnzsMAgFde+RSff74Os2c9gT/OG3dZ
zjqWNgz2N2xYg6FDRyExcTC2bfsFqvobJz518jjGjhmArOx9gFaFfz73NwzsH4n+fXvjf//1D2i1
WqhUKvxj4V8xoF8E+sSF4fHHHkBV1fWO2RonVnCtFDI3N/j7eeFyYTE+/2UHvt+8F2JJHfwDgW6h
QOqZw/jvhrU4eO4E+sR6QS7zQMG1a61a3/v/WWT415GmTL0VEokEaWlb0KgG8vIuIzvrLCZOmoWs
7OMYN1aXP78dS0fvnn5469+LkBAfjrjYUFwtLMDChQvw6acfYNvWjejd0w+ZGacAND/DqFKZzj1z
Cq8WAAAUilDExcdh7t1zsCc9E4899i8cPfJnTv+w4otmZyn7JfYyLOOrLz/F0CF9MLB/JJ79nydQ
r1S2XxDbgaX9+/vlSzF65CAk9umBxxbcj6qq6xgzajDrwwVZ084bW/3zDxg35ib0iQvDbdPH49ix
w4a/mcodc/lgnFNN+xOpxPx6Dh7QtRWffvI+hg9LxKABUfj5pxVmyxsZGY+UkSmYe/ddSEkZizNn
TqD6uuXt0DMuk6nte+iBO3HzuKGGeZ54/EGMHjnIYs47C0v7nnH9AC3Xib79zs/PNVnnGo0GL7/0
LPom9MSUySPxj4V/RXxsd0N5rN2PIyPjMXbcWDz7j+fw1N9exMkTR7F9a5pVZfzg/beRNCgGw4Ym
YOeOLZhx681I7NMDH3/0HwDm26+muaDvr6zNQWq7Hds349KlHPzzn+9h9uyHccu0W/D5kuVYuPAN
yKQB2JfePAeLrl01mU/O0B6Zyl1rywWwv3Ml5vpg43o3/t3ScZapfkovM1N33G2cp6ZySqPR4H//
9Q/0TeiJW6aORmHhFZPbMHBgEsaOT0FUVG8AQELCYIwek4LEvpHYtKnlftaV2TqWFovM95GW2hpr
+zdAV9dCAMg6dwbZWWdx84QZmDz5dpw4cQi5uQVmN6a6Cjh3LhsioQifL/kF77zzLZZ9+yV27dyD
PWk78dOP3+O75Vuxbt1xQOuGI4dPohMcB7Wr3Pzr6BcTjh93HMSjb36JRo0WR85kY+GnSyGQqbHh
wD6knjyM6EhPrNixGWknjmH00N64crW8VesbPHgwBg8ejJ49e8Indw1EmasgEdXiau5pnE5bhTPp
q3EmfTUKL58yuwyf4nT4FKfbtF5fXwVGjhqHPXu2oL5ed1VfIpFgzOjpkEh001RXAVqt7nURJ09k
YOWqHVj+3W4AwL/+9RHunPNXww5SUY5mZzVLi4GcC6Zzz5yhQ0cgIaE//u//XsT4cQl4+um/4Ldj
6VD4AzLZn2Wacfs9SE07jaVLt8HdXY4xY6ahrATYv28PXn/tJfznvS+x5tdj2Je+F1988SXQSXLa
0v59/PhRvPTi/+Cee+djxYpUHD50EO+9+y6+/uZHAKwPV2JrOw8Ap04dx8Jnn8Stt96JtWuPwsND
gfkPz0NVVZ3Z3LlgJh+Wfts8p+r/OF6trgKO/WZ+PWKxrq34/fgprF9/EDExffHvN18xzG9Mo9EA
UOPqtcs4dfo39I6IsbgdplRXAUeOmN6+u+95EBcuZOP4sSyo1Wrs3bMb06fPRWW5oBW10rEs7Xvf
LGteP0cOt1wn+vb78sUyCE3UeWrqDiz/7ms8Mv/v+Peb32DvnjQIBAKUFtu+H4vFgEQCjB8/FgBw
9mwGfrMiby7m5OOnn1NRUV6Ohc8+hQ8/+hZjxkzFRx++h+uVDS22X037K2tzkNru/PksAMCAAcnw
8ARk7oC7XIT5Cx5BZHQ4JNLmOXjkcKbJfDJXvx3VHgGmczfLzDG0cbl272J/5yos9cHG9f7Zf5v/
nplhOl/M9cP6Mdfx4wfw3ntfISQk3JCn5tretNSdWPbtl3jiyefx9lvf4eSJE2a3RSwGmr5HXCwB
zpw9juf+YX0/62paM5besdN8H2mprbG2f9PXtRgA1q1bDbFYjOThEyES1+G9917C5k1rEBX1hNlC
BgWFoLSsFAuf/QskEt1K8/MKMDz5Jkilbljw6B1IHjESM2bOwJCbUqBuACRSu8W00ykrb4SyQYWf
dx7EnAnD8NCtukb/1r+/gy37T+DcpQIIBULcd8toxISHQigQQCYTQ6lq3f079fX1hjst9pwshZt/
ILRpmwEAI5LjAZEckMpwMPUQijOPQhoYju5RMfC5fAT5vrEoLcyHtkEJSGToF2jbum+9bRae+duj
uFpYhJ07tiAlZTx8fHxRUnrjtLfddi969YxFaXkuAEAslsDHVwSpm/nlBwWbzj0PeW+T07u5ueHX
dTuwbctuHDiQhv37d2DD+jW4/4GjmDZtumE6d3c55HIJ/v7MQwgP74nnnnsXUjdg3z7dFaTHHrsb
AoHu9sJTJ49DqdQdgDg7S/t3+t5UAMCkiXcjOMQbh4+ew/UKoLiE9eFqWtPO70nbAa1Wi9tuexjB
Ib6YO/duPPXUw/jt6GmcPKWrB+PcqaktNZkPkRG6fNDnlJvMuvV4eOqmmTx5NtzcPDEiZQQOHUpD
ZYUKQSE3dirPP/8Qnn9e93O3bt3x7LP/xr70bS0u39i+fakmt08s0SA0NAw7dmxAnXIIqqurMHXq
XIv7iLOwtO89/MijAP6snwOrWq4TfftdV1+KsuU31nlpqa4duWXqvQjt7o/x4yfil19WAmj9ftzY
2AgAEIlESN3dchlHj56KwMBQ9OzZGwGB3eHl2R03DUnCxo0/ouhaBQLNHMuYar+szUFqO6FQd+Op
RtMIsaT532QyQPjHuTV9Dm7apBscGefTrFlzHdoeNdU0d/39TeedcbmOHmV/5yos9cGSP66G6etd
pW7+u1hqOl9On9JdfTfup05nHAQAzJz5APrED8aEiVPw4eK3UFmhstD21gAAJk6Yg9Dufhg3fgJW
//yD1dtnqT0ePfYm+wTRibXmGOvUSd0jSab6SD1TbY1eS/1berqursUAsGH9GqjVakycGGtYwLZt
v+DRBeYL+Pnn7yN193Zs33EaxUXFmDVrOLRaLXr2jML2nYex7tcNOHx4Dx57dB7++c/X8Mijj7Ui
dK5DKGhEg7oR0GoR1yvU8Hn/mF44n1eIx+6YhAcWfYKe057EsL7ReO9v9wIA6pQNrVpfQ0MDtFot
1Go13EIiMTSoCo1CT4hEWqC4EBC7ASIRhvXrDoh7ATV1qKs8DzWAeHkFEOkJwBNpGUU2r3vixKlw
c5Nhy5a1OHL4AF597ROIJYDAxIUvDw9PuMl0ZwkNBIDgj4m1Wt0DL0rln2cGP/3EdO6ZewyuoCAf
2dnnMHXazbh54s1Q1b+K++bdgp07tmD8+OnNpn3r34tw9mwGfvhhNzw83eHpBUj/OIrfsOEkvLy8
/ygXoO4kz9NZ2r/1Bx9arRZuMkCprIWbuxZyjyYLYH24hNa08025ywEN9A+gCdHQYDp3PvnUinyw
cBHceD1qtW49Uqkb3Nz+PKPd2KiFVntju/LUU4uQlDQSnp7eCAvrDbFEiMOHt7W4fGNm9w25B+68
ax62btmAOmUFhg8fheDgsE5x4G1p37v77kf/nNAopuZipm+/F39ous71V5cEAoFuMCX4Mwlaux/v
3au7CywxcTB+O57aYhmlUinc3ACRWASpVAqxGBCLRQAAjUZrU/tlbQ5S28XGxgMAjh5NR0zsHQB0
xzVvvPYSZs6+yzCdPgdlMtP59OGHLzm0PWqqae4uMXMMbVwu9neuw+o+2DiHBOaPs/T5aNxPuf/R
H7m7yyFzB2Qy3Ymoxkat2Zz66uu3DauUuulOtLXWjccLMNzd66racoxlqo/UM9fW6P5muX/T17Xw
5MnjuHz5Ih599B9Ytmwnli3biXvvfQKZmcdxPvui2YJdv14JoVAIpbIRGzcug0gkQk1NFVJ3b8X7
/3kdd909B+/957/o2TMKWVkXoOwad3GYpQgSQiQUQSwW40rRn7fm7z1+BoEKH2RcyMN3rzyJvI2f
IDzYD1+s2QmVugFaVeu+HVGlUqGhoQFqtRraigIUFZVDVFMKNNQBympoygpQce4kqs6dQv2Fs1CX
FuL39DTU1lTh4Ikc7LtQhRKvWAwYM9Pmdbu7yzFh4hR88837EApFSBkxpdlZ8xsIAPEf9wNdupQF
pbIOQcEhAICDB3fj6rVC7EnbZZjcXO6Zs2P7Fjxw3x14+63XcerUYezbtxH5+TmIioqDusm5lO3b
NuDrrz7DE0/8E1KpHDW1BWhoaMCwYSMAAGvXLkdVzSU8/sR07DuwGp5eNoemw7W0f48YMQoAsG7d
97h0KQfDhybijddfhoj14VJa286PGn0zBAIBfvrpSxRdu4qffvweISGhiI5OQHKy6dwxlw/GOWXt
epod+FgxqOrevReSbhqIvv0j4RcghMIPGDfeyuU3MdzM9mm1wF13zUN2dgbWr/sJt824BxIpIBSa
Xo4zsbTvaTXN62fMWOvrxFydJyT0BwCsWbMMF3PON3uTui378aVLWThyZD++WPIx3n//LYwdOxl9
+95kdRmbHT4Z1bet7Zc1OUhtN278D8V02gAAIABJREFUJMTH98Xbby/El19+hm1bN2LB/Hn4/vul
qCyvR7NzdALz+VSndGx7ZC53q6qtKxf7O9fQUh9sfAxs/Lu5dmrYcPP9lIFRng4dajqnBicN+HNZ
Fy/Y/M0XltpjVz8h2tpjrIRE831kMxbiZ6l/G/pH+yFcv+4XSKVSzJnzKJJuGojhIwZi/oIFEAqF
2LTpFzSaeYvxPfc+DH//QMyaOQTdw3pg/M3T8OGHiyD38EJZeTlGpfTH2DGJCAvrjocf/jsaW3+C
yCV4uskgFUsxfkgCftp1AJv3/4b3V2wEBMC0lIH4aedBvPjZSpy5eAUKL0/4+XiiukYNH1+Plhdu
wsWLF3Hx4kUUFhYaPiuqUuLqlWvIuXAZl/KuolotRJVagJLqWhw5dhqC4Egcr5UjKmUKEodNgURm
4/37Tdx222wUF1/FqFGTIZPJ4dbCLa5BwSEYOnQEvvvuYyz7Zgn69x+EGbffiS+/fBePL7gPY8ZM
MLyM5L77TefehZxsk8ued99f8MSTz2Htrz9h7p3TsfDZJ5GUlIwXXvg/CEV/Trdt63oAwLvvvowp
UxKRkpyIc2fPYsjQEfjHPxZh+fKPMW3qaAQFhmDokKmot+LlZo7W0v49aPBwPP/C61ix4jPcOm0s
kkeMxiMP/wueHqwPV9Ladr5v34F4898fYuPGVRg39iYolUosXrwC7nIZhg0znTt33GE6H6qqq5rl
lLXrEbdiEC0S/fFM4R/51K+f7ctPSjK9fbU1uvZq2LAUKJV1GD1quuWTmU7E0r4XHNJ8n7clZuba
gO7hvTBr9j346qv38NRfH0H//oMh/uOe7KHDrN+PP/vsTdx7zzR89ukHmD7tDix65XNIpMCgQW3P
m3n32dZ+UccQCoX49rufMGrUJHz6yXv421PzUVxcjA8/XIGEhGE3PLNuLp/umuvY9shc7j7woHXl
smU/IefVUh/sH9C8/TU+JjbXxioUASb7KUvvcDSXU8OH34xZs+/BkiVv469PPozhw0dBbcMtJBb7
DFHL83dmrT3GGj16gtk+0h6G/nG8LKi4rtXWVAP1SkDh/+ctSJpGoLwMkHvobr2orAC8fHTPSRl+
Fuq+RkCrBdw9AHWD7qvjvH2Aulrd1z0IBLqDLk8vNDuQdzWFV3LRrXsPs3+/WlyGotJaxPUMwDcb
9mP/6Qvw9pBi/i0jMKJ/FC4Vl+LzdduRX1SK7oEKPH7HROQX1sHb0w3hIUE2r/eZvz1k+Pn9xV/D
R3MeVw/tQFV5RbPpvBS+COkejMoet9t1ewFdLlyvBNxkMJyFVjeYziXpH4+6VVboXgDnLtf9q74O
1NfrckgsAZR1gH+g7hY2U7nn4al76UXTZerV1ujyXH/GUyLVTa9p/LMcKiVu6ER9FboXkdTVAnV1
ALS6ZXt62xSydmWpPlrav93lurjW1QFajS4unl66aVkfnUtb8sBcOy+V6uarqwU0Gl3dyz1geI7W
VO40NprpG3x15dDnVNN1WlpP03ZDKtVNU1sD+AU0v21W3+Z4ecPkM/TWLN942423T4vrOH/+HO6f
Nxt33PEgnnxyUbOYOoOW2mdz+55QeOM+b22dmGoDrhYWYfPmZYjvk4TYmMF48smZkErdsGTJBvgF
6Nbd0n6sr1M9ofDP8upjbm0ZK8p1J4C8vHX1WlOt2x80mpbbL+O8MJeDZD1rjiM0GqC2Wnc8qdXq
6tfd44+ca7jxGMJUPpnrnzqqPdIzzl1ry+UuZ39nK2tyq6PXa82xmHH72/R3idR0vvgodP/f0A+r
LeepuZyqrsIfL4HTtZcqFQzttTF9O+rr9+fJdUvHC52dvY+x6huKsPrnZYiLM91HWmprjOvXXP8m
FEI32O/AOLmslhqWhkY1fj99GUHu3eDmJke9GPCQAF4C3V0XIi/Ar8mF9OvVdTiVnYv4iEiIhOZv
5XfGBo06HuuDAOZBR1j+3dd4/bUXcdOQEXjr38ug8JM3f8eFE3CWPGhsbMRrr76IdWtXo66uFol9
++OF599HRGQsfHwdXTpyNGfJU3I9PDam9mDv+u2oPpKDfTuxJgEqrtcgJ6cUMg9/eLh7QArdWS+h
GHCTAAHegJsnUF5dg7xrpVB4KeDtYfnBLDZoBLA+SId50DGUdbqz62Kx7iqcs3G2PKit1t2ho9Ho
rvB4eBq9lJW6JGfLU3IdPDam9tBe9dvefSS72w7k6+2BiAgBsi8XQdVQiWA/b8g93eHpLoJG0Iiq
xjpcuHQdtXVKBPsHw9vDyS4XERGR7u3GneDt+85C7qn7R0RERM21dx/JwX4H8/WWY1CfMBSVVaKw
qBDnrzQA0MDNTQhPmRj+CgUiwoIs3rpPREREREREZAlHlA4gEonRLdAf3QL9HV0UIiIiIiIickGd
4JuBiYiIiIiIiMgWHOwTERERERERuRgO9omIiIiIiIhcDAf7RERERERERC6Gg30iIiIicigfL0eX
gIjI9XCwT0RERERERORiBFqtVuvoQhARERERERGR/fDKPhEREREREZGL4WCfiIiIiIiIyMVwsE9E
RERERETkYjjYJyIiIiIiInIxHOwTERERERERuRgO9omIiIiIiIhcjNnB/qVLlyAQCKBWq03+fdWq
VSgrK7NqWlsMGzYMy5cvt3qZLU135MgRDBs2DAEBAYiNjcWKFSvaXEayTmVlJcLDw7FgwQLDZ7bW
x+rVq5GSkgIvLy94eHggISEBb7zxBhoaGgzT+Pr6QiqVQiaTQS6XIzIyEu+88067bVdnxfro2prW
i0wmQ2hoKP7yl7+goqLCrutp2ibbs28wp2lfZCt9f9NVXL16FQKBANXV1XZdrqProC3rJ+f3z3/+
EwqFAnv27GnX9SxZsgSenp74+OOPm32+f/9+DB8+HAqFAr169cL7779v9TItzdtS/2uuPJWVlZg7
dy4UCgWCg4Pxr3/9q8VymOr/bZl2y5YtGDBgABQKBaKiovDpp59aXIa5su/ZswdDhgyBQqFAbGws
Nm/e3GJ52tOXS47a/K+1fH19sWXLlhs+DwsLw88//9yWzbBbG+zr6wuRSASxWNzsX1xcXJvK1xHH
Ao4mEAhw8ODBGz5PTEzEl19+aXHe9o6P2cF+eHg4CgsLIRaLTf79pZdeMiRWS9O2hj2WqVKpcPvt
t2PBggUoLi7GypUr8fjjjyMrK8tu5STznn76aUilUsPvttbH4sWL8fDDD2P+/Pm4evUqysrK8MUX
X2D16tV4+OGHm027bt06KJVKVFdXY9myZXj11Vexbdu2dt2+zob1Qfp6USqVOHjwIM6ePYu///3v
ji5WmzTti8gxHF0Hjl4/tR+VSoUffvgBb7/9Nj7//PN2W89jjz2GtLQ0JCQkNPu8oqICU6dOxYIF
C1BeXo5ffvkFL7/8Mvbv39/iMi3N21L/a648ADB//ny4u7ujoKAAR48exfbt23Hy5EmLZTHu/22Z
tqCgALNnz8a///1vlJeXY+XKlXj22Wdx5MgRk/ObK3txcTFuvfVWLFy4EGVlZXjvvfdwxx13oLCw
0KpytZfxE0IR2kOJqBggOk6A6DgY/kXGAL0jGxHeS4WwHiqcy7IcZ0exZxu4ceNGqNXqZv/Onj3b
pmW2xziRrCf88MMPDb80NjYiJCQEO3bsQF5eHrp162a4OuPh4YF33nkHQUFBGDFiBM6fP49JkyZh
1apVzaYFgLS0NAwZMgRxcXFITEzE4sWLzRZg6dKliIiIQHx8PJ5++mlotVoAaLZMjUaDp556CpGR
kYiOjkZSUhIOHDhgcnmffvop+vTpg9LSUqSmpsLNzQ0PPPAABAIBBg4ciOnTp2PlypV2DCGZsnHj
RmRmZuK+++4zfGZLfVRXV+Pll1/GRx99hPvuuw8eHh5wc3NDcnIydu7ciQ8++MDkeoVCIUaMGIH4
+HhkZ2e32/Z1NqwPMtajRw8899xz2LRpEwDc0M4XFhbi4MGDGD58OGJiYhATE4Ovv/7aMP/mzZsx
YMAA9O7dG5GRkVi6dGmL67TUN+zcuRP9+vVDcHAwhg4disOHD7e4rtmzZzfriwBYLLO5/qarWbt2
Lfr06QNvb2/cd9990Gg0AMzXj6U+uCPqwNb1m9sOUzluKY+/+eYbhIaGIjY2Fs899xzGjRuH7777
rsVtJPtZs2YNhg4divvvvx+7d+9uNqA5e/YsBAJBs+kHDBhguEpqqf6MPfTQQ/j+++/h5eXV7HOV
SoUPPvgA999/PwBg0KBB6N+/P86cOdNi2S3N21L/a648paWlWLduHd555x24u7sjPDwcBw4cQL9+
/cyWw1T/r4+V8ZV3U9NqtVp8++23mDJlCgAgKSnp/9u776gorrcP4N9dUIpUQbpKkyIiKhYUFQua
2Es0qGiKohIjMTGaaoohJtGoCTExsRI7IopdQVGxtxh7bIgUaVKlrcDyvH/wMj8W2NlFseHzOWfO
0Zk7t+wzzJ07O3MXrVq1EgaA1fNRVvcTJ07AysoKo0ePhkQiwZAhQ+Dp6Ynt27er/Cyfptt3EnDs
2D+IOXwasUfPwadnR8hkJYiOPomoqOPYH30cu3YdeSZ1eVHPwZUSEhKgo6OD1atXY9iwYWjTpg3G
jx8v9CHK/uaqjulU5dFQz62q2l1V1bGsqv2UHTO2trb/uynZvXt3qnTgwAGytrYmuVxO8fHxBIBK
S0spJSWFJBIJBQcHU3l5OZWWlhIAun37NhGRQtqsrCwyNDSk3bt3ExFRUlISmZiY0MGDB6m65ORk
aty4MZ07d46IiCIjI0lDQ4PWrVunkGdUVBQ5OjqSTCYjIqLdu3fThx9+WKPsyMhIsrOzo6SkJCIi
CgkJocGDByuUGRwcTG+++WaNurD6k52dTXZ2dnT9+nUKDg6mqVOnElHd4nHo0CGSSqVCzMUYGhrS
vn37iIhILpfToUOHyNTUlOLi4uqhNS8/jgcjUoxLpW3btpGNjQ0RUY3z/IMHD0hfX5/Cw8OJiCgu
Lo6MjIzo6tWrVFxcTHp6erRnzx4iIjpy5AhpampSRkaGwjlZ3b4hMzOT9PX1KSYmhoiI1qxZQ1ZW
VlRaWipaVvW+SKzOYv3NqyI1NZUA0OzZs0kul9ODBw/I0NCQDh48KBofsT74WcSgLuWLtaP6MS52
bCUlJZGmpqZQ16VLl5KWlhatW7dOtI2sfvXq1Yuio6OJiCgoKIgWL14sbPvvv/8IgEJ6Dw8P2rJl
i2j8xPTt25eWLFmidHtiYiIZGhrSrVu36tyWqvuq2/9Wr09MTAzZ29tTcHAwtWrVilxdXenXX39V
Wqay/p+o4pr/zp07aqWtVFZWRhEREWRqaipca1fPR1ndIyMjycXFRSHN8OHDhb/l52HFsnO0f/8x
mjnzZ/pgxo/03vvBwraTpy7SzJk/07sBc+itt7+gXbtiadbHqx67rNr6YCIia2tr2rJlywtxDlZW
x0opKSkEgBYuXEhERDKZjJo1a0YHDx4U/ZurPqZUlsfLfG4FQKdOnaqx3s3NjVasWCHabrGxrNh+
YsdMQEAA/fDDD0REJD179ixSUlIAAGFhYfD394dUqvh0v0QiARHB39+/xl3U6mJiYmBpaYlBgwYB
qHgXZeTIkdi1a1eNtLGxsXBwcEDHjh0BAMOHD4elpWWNdBYWFkhPT8e6deuQnp6OQYMG1Xhn6uTJ
k5gxYwb27dsHGxsbAEBhYSF0dHQU0unq6qKwsFC0DezJBAUFITAwEK6urgrr6xKP7OxsGBsbQ0tL
S1gXGBgICwsLYbl3756wbdSoUTAyMkKTJk3Qv39/fPTRR7C1ta3Xdr2sOB6sNsnJycJjlEDN8/z+
/fthYmIibLe3t8eQIUOwefNmaGtrIzk5Wfimx8fHB40aNUJ8fLzS8sT6hujoaDRv3hx9+vQBAIwf
Px4XL16EhoZGncoSq7O6/c2rICgoCFKpFKampnBxcUFiYqJofNTpgys9jRjUpXyxdlQ/xsWOrcOH
D8PFxUWo69SpU6Gnp6eyjaz+3Lp1CwkJCfD19QUATJ48GStWrFBrX7H4Pa779+9j0KBBmDt3Llq1
avVE+z7u9WlOTg4SExNhaGiImzdvIjw8HPPmzcOePXtqTa+s/wcAX19fODg4qJUWADZt2oTGjRsj
MDAQK1euFK61q+ejTI8ePZCSkoJ169ZBLpfj0KFDOHr0KGQymcp9n6ai4kd4WFCI/PwiFOQXCeu7
ennAzLwpigofQU7lePTo0ROXNW7cOIXrJgsLC+E1hhflHDx06FBhbp/KZeHChQAgjAHHjh0LANDS
0oKDgwMSExPV/psTy6Mhn1vF2l2ptrGs2H5ix0z//v2FeU6k/fr1Q0REBEpLSxEZGVnjMZ+qTE1N
VTYmPT0dzZo1U1hnYmKC9PR0rFq1CqampjA1NcWwYcOQlZWFpk2bKqStvi8AtG3bFtu3b8e+ffvg
7OwMLy8vHDt2TCHNuHHjAABmZmbCOj09PRQVFSmkKygoeOITPlNu+/btiIuLw8cff1xjW13iYWZm
huzsbIX08+fPx8WLF3Hx4kXk5uYqTGQRERGB3NxcFBcXIz4+HufPn8eUKVPqsWUvJ44Hq6ryJoyh
oSF69uwJLy8vzJs3TyFN5Xk+JycHqampsLW1FZbo6GhkZWUBANauXQtvb2906dIFXl5eKCkpqfVx
tEpifUNmZiaMjY2F9VKpFM2aNRM6OXXLEquzuv3Nq6DqZ62pqQm5XC4aH3X64EpPIwZ1KV+sHZWq
XssoO7ZycnIU0kmlUuHiS9XfBqsff/31F1JTU2FsbAwjIyP06NEDt27dUmuiPrH4PY7z58/D29sb
M2bMwIwZM55438e9PjUyMoKWlhamT58OiUSCNm3awM/Pr9aJ7sT6/8dJO3bsWJSUlGDHjh344IMP
sG3bNpX5VmViYoLt27fjt99+g42NDdasWYN+/fopnI+eB5lMhqKiYhTLZJBVGdB/F/wnLl68Aa3G
jSCBBDLZkw/2//jjD+G6qXIxNzcHIH7uepbn4Kpz+1Qus2bNUkhjYGAg/FtDQwNyubzOf3PK8nhZ
z60SiQRyubzG+pKSEmhoaAj/r63dlWoby4rtJ3bM+Pr64syZM5DL5dD09/fHn3/+CUdHR7Rs2bLW
yUCqNkQVS0tLZGRkKKx78OABLC0tMXbsWOHuQ+PGjbF3794aM0Erm6ijT58+6NOnD0pKSrBkyRKM
GjVKofOOiorC/PnzERAQgK1btwIAWrduXePO15UrV9CuXTuV7WCPJywsDAkJCcJd3ry8PJSVleH2
7dv44osv1I5Hp06dYGxsjDVr1uC9994DABgaGsLQ0FBlHWxsbBAQEIBx48apnAGzoeN4sKoiIiLw
+uuvi6apPM/b2NjAycmp1omftm3bhu+//x5nz55Fy5YtIZfLVV6kivUN5ubmCtuICNeuXYOzszN2
7dqldllidV6/fr3a/c2rSCw+gOo+uNLTioG65atqB/C/Y1zsODYwMMDDhw+FfYhIeApSrI2sfshk
MqxduxbXrl2Dvb29sD4kJATLly9Hz549hQvo8vJy4YnUypiJxa+uzpw5g1GjRmHdunXo1atXvez7
uNenDg4O/z84LUKTJk0AVLSt+hO5gHj/HxMTo3baJUuW4Pbt2xg2bBg0NDTQrVs3DBo0CHv37sXI
kSPr9Hn07t1bYWI/Dw8P4Vvc56W4WAZZcYnCuoAp3+Dhw4qnLIplj0BECr869LiMjY1hYWGhsK4y
di/6OViV+vibe5nPrdbW1rh58ya8vb2FdXl5eYiPj0fLli3VyqO2sawYsWPG2NgYTk5OOHDgAKTD
hg3DlStXEBoaKvqtflVSqRQaGhrIy8ursa1Pnz5IT08Xfl4iISEB27Ztw4gRI6Crqys8ttK0aVN0
794dN2/exPnzFT9lsXHjxlrv3qxatQqBgYEoKytD48aN0a5duxoTSjg7O2Pp0qW4cuWK8JMgPj4+
KC8vx9KlS1FeXo4jR44gOjpaeBSC1b+wsDCkpKTg3r17uHfvHj7++GP4+/sjJiamTvGofGxo9uzZ
WLp0KfLz81FaWop//vkHw4cPh7m5OUxMTGqtQ3Z2NkJDQ0UnrHlVcDzY4+rTpw9SUlKEc3lhYSEm
T56MCxcuICcnByYmJmjevDmICPPnz4dEIhF9BFWsb+jfvz/S0tKwY8cOABU3JXx9fSGRSETLqt4X
idVZ3f7mVSUWH7E++FnEoK7lK2tHdWLHVrdu3XDp0iVcvXoVQMVPiVX+ZKFYG1n92LJlC+zt7RUG
+gAwevRoREZGIjs7G5aWltDU1BQmijtx4gSSkpIAQDR+dVFUVAQ/Pz+sXbu21oH+jh07cO3atTrv
+7jXp7a2tujbty/mzJkjDMbDw8OFL9KqEuv/gYpXHSpfhxJLm5ubC39/f+Gb5Hv37iEqKgqenp41
8hFTUFAAOzs7nD17FuXl5fjzzz+Rk5ODgQMHAqj4ZrvqFwJFRUVYuXKlwhMQK1eurHWA+yRatrBA
//5dMGiQN4YM7oE1a7ejR/f2GDSwOwYO8MbA170x4PVu9VpmbV7kc7A66uNv7mU+t86cORNz587F
qVOnUFpairi4OIwfPx5du3aFj4+PWnnUNpYVo6q/69+/P4KDgytmNpkwYQJpampSenq6MKFA1ckC
Kif1yc/PF7b7+/uTgYEBLVq0SCEtEVFsbCx17tyZnJ2dyc3NjZYvX650QoM//viDmjdvTra2thQU
FEQ+Pj60du1ahTzz8vLI39+fbGxsyN7entq3b08HDhyoUU8iovPnz5OBgQFdunSJiIj+/fdf6tq1
KxkZGZGbmxtFRkaqnGSB1Z/qk7zUNR579+4lHx8f0tfXJx0dHWrdujXNmTOHsrOzhTSGhobUqFEj
0tLSIi0tLTI1NSU/Pz9KTU19au16WXE8Xl2qJt6p7Tx/6tQp8vLyIgcHB3J0dKTPPvuM5HI5PXz4
kHx9fcnOzo46duxI4eHhFBAQQFZWVrR79+5aJ+gjEu8bYmNjydXVlUxNTal9+/Z08uRJIiLRsq5e
varQF4nVmUh5f/OqqC3G3t7etGLFCiJSHh+xPpiInnoM6lq+snZUb7+qY2vhwoXUokULcnd3p+Dg
YOrSpQutX79eZRvZk/P29hYmpKque/fu9MsvvxAR0YIFC8jJyYn69+9Pn376KfXs2VOY3EssflWV
lZUJ/ZVUKiVNTU3S0tKi6dOn05YtWwiAsL1yqZwczdPTk0JCQmqtp6p9lfW/YvUhqpjc+rXXXiND
Q0OytbVVWn511ft/Dw8PpZMRVk8bGhpK9vb2pKenR9bW1jRr1iwqKyurkY+qum/YsIFatmxJhoaG
5OXlRZcvXxbKOHbsmMKEi0lJSQRAmKiMqGIStGPHjqnVXnWsWHaOZn28qk7L41I1QR/R8z8HGxoa
klQqJQ0NjRpLcnKyyj5E2d+cqjFl1Txe5nPrkiVLyNXVlXR0dKh58+Y0ffp0yszMJCLx/ldsLPu4
/TYR0fHjxwkASYhe0d8eYowxxhhTQi6XK7xr6eTkhJCQEGFCP/Ziexbx27hxI6RSKcaMGVNvebLn
65tvv0VOdg60tbWxYMH8512dlwqfM19MNV/yYYwxxhh7hRUVFcHMzEx4PPLQoUNISUkRHl1mL7Zn
FT8NDQ0MHjy4XvNkz8dff/2FkN9CYKhvAAcHB1hZWyEkJAShoaHPu2ovBT5nvrg0n3cFGGOMMfbq
un79ujALcW2+++47DB069BnWqOJn0FavXo0PP/wQxcXF0NfXx8aNG2udJZm9eJ5V/Pz8/Oo1P/b8
BAYGPu8qvNT4nPni4sf4GWOMMcYYY4yxBoYf42eMMcYYY4wxxhoYHuwzxhhjjDHGGGMNDA/2GWOM
McYYY4yxBoYH+4wxxhhjjDHGWAPDg33GGGOMMcYYY6yB0czOyXvedWCMMcYYY4wxxlg90mys0+R5
14ExxhhjjDHGGGP1iB/jZ4wxxhhjjDHGGhge7DPGGGOMMcYYYw0MD/YZY4wxxhhjjLEGhgf7jDHG
GGOMMcZYA8ODfcYYY4wxxhhjrIHhwT5jjDHGGGOMMdbASAFg29Yt6NurB8xNjWDW1ADdvTrh79Wr
hESDB/TH3G++qjWD9m1bY/XKFQAAawtTGDbRgpGetsKyYtlfKiuSknIfk955C072LdHS2gKurewx
I2gaCgsKAAB+o0cK+RnoNoaBbmPh/1MDJgr5qGpLZT2bGujC1EgPpkZ6MDc1QtfOHbA5bKNCmtra
0sHDTd3PltVB6KqVMDc1wrI/l6pMu2P7NvTr4wOLZsYwNzFEpw5t8fP8H1FaWiqkqRpjs6YGcG/t
hF8XL3yaTWhQOB4NT/XzXiu7FpgWOBl5ebn1Wk5iQgL0dRqhrKxM4d9Py9aIcOTkZD/Wvr17eiNs
04Z6rtGLKz09Dfo6jYR+tb487xg8Sfnsxff1nC9gY9EMJ44fe6rlKOv3Yo8cRq/uXdHBww1dOrbD
mtDVaud55vQp9PHpDhuLZnBzdsTvS0KEbf/8cx69e3qjpbUF2rdtjfDNm9Sqz8O8PLz71njYWDSD
fQtrfP/dt0rLr0tasTJVbatKrF0njh9Dr+5dYWPRDO3btkZ01H7RvBh7WejrNMK5s2dqrO/s6aHy
nPG0r5Wkv4X8ghnT38ekyVMQn5iCpNQH+PSLL/H9d99izuefAgAmTZ6C9WvX1KjEiePHkJqaijf9
xgjrIiJ3IrdAprBMnhqosiLj/EajqUlTXLz6HxLup+HQ0eP47/p1zJ71EQBg85ZtQn5v+o3F5KmB
wv+Xraz4ENVpS6XNEZHIzC1AZm4B7qdl4ptvg/F+4BRcvPivaFsuXLr2eJ/0K6y4uFjhRkp1H37w
Po4fOwpX19Yq81r6+xK8HzgV704KwN17yUhMycDvS5dhR+Q2TH9vqkLayhinZeZixaq/8eMP3yPm
4IEnbs/LjuPx6qp63jt09DjykS9PAAAgAElEQVRu3byJzz6Z9byr9US++/Zr5GTnPO9qvNKedwye
d/ns6SkpKUFE+GYEz/tR+GLpaVDW7+U/fIgxb76B4B9+woVL1xARuRNffP5JrRf11eXl5WLk8CGY
NHkKktMeYMPmLQie+w3OnD6FkpISjHtzFAImT8W95FT8vW4jPpoRhDu3b4vWBwCC3n8P2jrauB2f
iKMnT+NQzEFcvXKl1jrUJa1YmepeF4i1KzPzAd4cNQIzZn6MpNQM/PDjAkzwH4O0tFRVHyVj7AlI
5333LUJ+/wPj/CdAV1cXWlpaGDJ0OFavWYclv/2KxIQEDB4yDOXl5Yjat1dh5zWhq+E3Ziz09PWf
uCK3bt3E6wMGQVdXFwBgaWmFTeER+Pa779XaPy8vF+q0pTaampp4feAg2Nnb49K//9aa5mW08Kfv
heV5uBcfjzmffwpPjzb45/w5pekmvP0uVv29FvoqjqPCggIEf/cNFv7ya0WMmzSBlpYWunh1xe79
0Zi/cFGt+0mlUnh17QYXZxfE3bnzRG16mXE8WFXNm7fAzI9nI3p/xTcriQkJMDcxxK+LF8KuuRXS
0lJx7uwZ9PHpjnburmjn7op1a/4W9o+O2o9uXTzh5uII99ZOWL92jcoyjx87KnxD1tnTA0t/XyJs
O3L4ELw6tYd9C2v06tFN4RhVVtb4sX64GxeHYUMGYGtEOACI1nn92jVo49oKnu3a4NPZM0FET/IR
vrR2796Jju3dYWnWFFMmvYvy8nIAyuNTXl6O2R9/CPfWTvBo44Ke3brg7JnTAJ5NDOpavrJ21HaM
ix3HG9atRSu7FmjftjW++vJzDHq9HzZtXK+yjaz+7Nq5HR07dca48RNwNPaIwhMct27ehL5OI4X0
3bp4YnvkVgDi8atOWb+XkJCAstJS9OjpA6DivOnk5Izr11R/8VNSUoIFPy+G//i3AADt2rWHu3tb
3LxxA8eOxqKxVmP4T3gLEokEHh7tMHDgYERs2Sxan+zsLOzdswvf//ATdHR0YGPTHIdij6ONu3uN
8lWl7dbFU+FberG+X2xb1XzE2nX61ElYWlpixMhRkEgkGDBoMNq374DdO3eq/CwZe9klJiagmbE+
1q35G36jR6KzpwcC3n1b6H+rWrHsL3Rs747s7CyV+ynr79ycHXHm9CkAgKZcLsfwEW/UKKinTy9Y
WlrhyOFDeOuddzHh7Xfw99+rMWjIUAAVjwZtj9yKA4eP1suHMPpNP0ybOhlBH36EXr36oLWbG0xM
TNXe//TJk1C3LdWVlpZi545I3I2LQxevrk/UjheJp6cnACAzMxN6cbtQUFACqfsQJMXfRWb8NWho
aAIAjJo7wcbRtdY89FIqLqgKrLzUKpOIcPBANJb9tRR3bt9CwJRAnD53AQaGhiL17KhW3v/8cx5F
hYUYMXJUjW1GRsZK9ysvL8fxY0eRkJCA/q+9rlZZDQXHg4mRl8vRqFHFxXJjrcYoLi5GSUkJ7ibe
R3Z2FoYOHoClfy3HiJGjcC8+Ht27dkbHTp1hZ2+Pt8aPxZp1G/Ha6wNw/NhRDBn4Gl4fOFBpWTk5
2fAbPRKrQ9fitQEDcf9+Mrp17ojWbm5o6+GBsX6jEBa+FT69emPjhnUY++YoXL8Vh7KyMqVl/b1u
A4z1dbBj1z7YOzggKytTaZ0NjQwxI2gaDhw+ig4dPLF71w61XlNpiK5cvoyz/1xCTk422rq54Gjs
EXi0a6c0PnK5HNFR+3H+3yvQ0tJC1L692BaxBZ27eD2TGBw+FKN2+WLHmYurq8Ix/ujRI6XH1qNH
jzB92lTExB5Hhw6eWLl8Gf78YwkmvP2OaBtdW6t+Ioqpb9WK5Zj1yWfQ0tLC8JEjsWH9OkwPmqFy
v/v3k5XGrzbK+r1WTk4wMzfH9sitGD7iDdy+dQvxd+8Kg38xzZqZwX/CW8L/k5OT8N9/1+HdvQei
o/bDpdq35K2cnHDt6lXR+ly5fBkWlpZYtWI5Nm5YB01NTUycNAXTpgfVOe28HxfA1tZO5WegalvV
fG7dvKm0XW3c3Wvc3DM2boo7t28pzZuxhqJx48aQyWTIyc3B5i3b8OjRI7g42uFo7BHY2zsI6Xbv
2oGQXxch6uBhNG1qgpKSEqX7ifXbvfv2xfFjR9HFqyukZmbmkEprn6fPwtIS2dlZAICJkyYj5kA0
UlLuAwA2h21Ca7c28PBop7DPyGGDoa/TSGE5fChG5YfwS8jvCP7hR5w6cQJDB72OFlbmeG9qgNqP
92RmZULdtgDA+HF+sLYwhbWFKZoZ62NJyK/YHBEJF9f/DXr9Ro0Q3m+tXEJ+XaxWfV4Ejx49gkwm
Q0lJCY5ezsK1PG1cjt2HnMSb8O7mCq9uHvDq1QW5Sbfw7851uHbqCHIfpIDO70DSnRu4eOwgjt3I
xLE49d/v3BIehmlTJ2PixABcuHQN04NmiA4s6yInJxtGRsbQ0tIS1s0ImgaHljbCUvXpjcoYm5sY
YtjgAZj+wQy0aNmyXurysuB4MGXu309GyC+LMWJkxQ1SiUQCIoLfmHGQSCQ4EB2Fpk2bCjdzbO3s
MHDQYGyNCIe2tjZu3bkn3Kzp3qMnGjVqhIR795SWd+TwIVhYWOC1ARU3BKytbTB0+HDs27sbMQcP
wMbGBj69egMAxoz1x8mz56GhoVGnssTqfPzYUdjZ26NDh4qboIOHDIOFheWTf5AvocBp70MqlcLE
xBROTs5ITkoSjY+5uQUyMjIQtnEDMjLS8dqAgfjp59qf3HkaMahL+WLtqH6Mix1bR2OPwMnZWajr
xIDJaNJET2UbWf25c/s2EhMT0LtPXwDAO+8G4O/VK9XaVyx+daGlpYU//lyO96ZORktrC3Tq0Baz
P/sc9g4OqneuIiXlPkaNGIov53wDB0dHFBUVQkdbRyGNjq4uCosKRfPJzc1BclISDAwM8e/l61i7
Pgw/z/+xxpO36qTt3acv7Ozt69SO2lTNR6xd3by7IzU1FZs2rodcLkfskcM4cfwYZI9kT1wHxl50
EokEQMWX20DFucXO3h7JSUlCmjOnT+GTj2cicsceWFvbqNxPrL/r69tPmOdEmp6eBrlcXmvF0lJT
0ayZGQCgRcuW6NW7j/CI25rQVZgUMKXGPtt27EZ+canCUnmiFiOVSvGm31hsCAvH3cT7iDp4GFlZ
WRg5bLDKfYGKO6jqtgUA1m/cjPtpmbiflok3/cbC1tYOvv36K+xT9f3WymXGhzPVqs+LoLS0FKWl
pSgrK4OWhS26WJejk60evByaAA9SgcxkID0eXm2t0cOnLbq01IZJXsVj1a66uejuoIceLqYolxWp
XaaHR3u4uLriyy8+xbI/l6IgP7/e2tOsmRlycrJRVPS/+gR//yNOnj2Pk2fPIy8vV2FeicoYP8jJ
x9Ubt3Hhn38Q9L7q+SMaEo4Hq6ryhouVuQle8+2Nzp274Ou5wQppTExMAAC5OblIT0uDm7OjsMQc
PCDcNN24YT18e/dErx7d0LunN0pKSmp9HK1SRnoGTE2bKaxr2tQEGekZyMrMUngaRCqVwtS0mdDJ
qVuWWJ2zs7JhbNxUIb2pqfpPjzUkxlU+a01NTcjlctH4tHF3R1j4VkRH7Uf7tm7o3dMbJ08crzXv
pxGDupQv1o5Klcc4oPzYys3JVXi6UCqVwtrGWmUbWf1ZtWIZ0tPSYGPZDNYWpujv2wt3bt9Wa6I+
sfjVRfzdu3hngj927t6HhPtpuH4rDqGrVmBLeJjaeVy48A/69fbBtPc/EL5Vb9JED0XFitdWhQUF
0FNxQ8LQ0AiNtbQw9b1pkEgkaO3mhjdGj0Z0dM2J7uqStr6ItatpUxOEhW/FX3/8DmcHW2xcvw59
+vqKPgnI2MtCIpHUOgYtKSmBhoaG8H8DfQPh3xoaGgr7THx7AgCgmZliH6ZsP7H+rnefvjh39izk
cjmkmo0a1ZgBFKh4ByA9PQ29+vQR1k0KmIL169bg6pUriL8XjzdGv6lO+1VKS0sV3lOq5NamDb6Y
8zWuXL4MmUz1Xb+uXbuhLm2pau7387B//14cOXzo8RrwgiopKREG+5SbgoyMHGgUZgGlxYCsAOXZ
Kci9eRn5N6/gUdwNlGWl4uLxWBQV5uP0pbs4EZePTH1nePYbqnaZzi4u2LU3Cpu3ROLu3TvwbOeO
WTNnCJPOPIkOnh1hZGSMjevXCesMDA1hbm4Bc3ML0X2trW3w9rsTsT1y2xPX42XC8WBVVd5wSUnP
wtX/buOH+T9DR0fxW5jKAba1jTUcW7XCtZt3hCUuIRmLf12CnTsiseCnHxC6dj2OHDuJg4ePCq8D
KGNhaYEHDzIU1mVmPoCFhQXMzM0UthERrl+7JrxipW5ZYnU2Mjaq8csDaWlpan92DZ1YfADAp1dv
bAgLR3xiCka8MQrjx/rVms/TioG65atqB/C/Y1zs2DIwMED+w4fCPkSE1JRUlW1k9UMmk2HjhvU4
d+Gy8MXM/bRM/PDTzwhdVfHtfuUFdNUbfw//P2Zi8auLo7FHYGtnh06duwAArKys0b//64g5oN7k
sufPncW4N0fhrxWrFF4jdXF1xY3/riukvXb1KtzatBHNz97eAY9kMhRXuclORLU+1VqXtPVFVbt6
+vRC7InTuHMvCctWrsbNm/+hfYcOT60+jD0rVlbWuH1L8ZWUh3l5SLh3D81btFArj+279qJ7j554
P3Cq6sQQ7++MjIzh2KoVDsUchPSbb4Px8UczsGH9WhQVFeHRo0fYs2sn3pngj1mffCY8RgAArw8c
hEeyR/jqy88wdpy/MJnekyovL8f0aYH4LeQXFBVWPML04EEG/vx9Cdq37wBtbW2VeegbGKAubanK
0tIKs2Z/ipkfBqGkpKRe2vQiiI+PR3x8PFJT/9fBZeTLkHY/HXfjEnAvKQ0FZVLkl0mQWVCEc/9c
hcTcAf8W6cKx+wB49OgHbf3Hu+Pq5OyMnxf9iguXrsLV1Q1TJ09UvZMK2tra+OGnBfjyi0+xYtlf
KMjPR2lpKf799wLGvPkGzMzM0dSkaa375uRkV0wM1abmJDavAo4Hqysfn95ITUnFgegoAEBRYSGm
T5uKixf/RW5OLpqaNIWNTXMQEX5Z9DMkEgkKC5U/gurTqzcy0jOE/BITE7Bz+3YMGTYcfX37IT09
HXt2VUzUtD1yK4YMfA0SiUS0LKlUCg0NDeQ9zFNZ527duuP2rVu4cOEfAED45k38TWwVYvFZ+3co
ZgRNQ1lZGRo3boy2bT2Ed2+fRQzqVL5IO6oTO7a6eHXFlSuXhYnYQletRGFhgco2svoRuS0CdnZ2
sLWzU1g/4o03sGvnduTkZMPCwgKampq4dfMmAOD0qZO4n5wMAKLxq4vWbm64ceM/oYyHeXmIPXIY
bf//FdY9u3biv+vXa923qKgIb48fh+WrQmu849+9R09QOWHFsr9QXl6OY0djERNzAKPfHFNrXpUq
n7L97tuvUVZWhrg7d7AtIgKvvV5zvhRVaY/GHhF99UpdVfMRa1dhQQHcXBzxz/lzKC8vx8rly5Cb
k4v+rw0AAGRkpCv8RFlRURHWhK5WeHpwTehqZGSkP3GdGatv02d8iB/nBePsmdMoLS1F/N27mDTx
bXTu4oXuPXqqlUcrJyf8ErIE165dUetn61X1d319+2H+j/MgnTY9CEv/Wo5VK5bDrrklmls2w/wf
52Hu9/Pw5VffKGSqoaGBt9+diIMHojEpQL27DuqwsrLG3qiDOBp7BG1cnWBlboKunSreswqLUP+b
v7q0pbqgGR+hpKQEv1V5J3/UiKEw0tOusVTOW/CiS0xMRGJiIjIyMtBmwDiYdeiJ8tIS5OfkQl5a
AnlpCYoL8iBFGaytTeH+zldoM2Acug8Y+diD/Oqa6Olh0uQpiDlS+2N3crlcmA/haOwRfPbJxzA1
0sOsmbVPwDP+rbexbkMYtm3dglYOLWFtboIpk96Bm1sbnDx7XuFxsKpzLrR3d4OGhgbWbqj55Mer
hOPB1GVgaIiIyB34cV4w2ro5o2sXT5iYmKJtWw+MfGMUrKys0dbNGb26d4WDoyPeHDMWUya9i/+u
1z5LtZGRMTZHbMO84Lno4OGGUSOGInjej+jm3R2GhkaI2LYD33z9JWxtLLFowXxsCo+ApqamaFk3
b9zAqNF+GPR6Pyz57VfROrdo2RILFv4Cf7/RcHNxxLmzZ9DFq+srOyN/dWLxGTHyDRQWFKKNSyu4
t3bCnM8/xeo1FU/0SKXSpx6DupQv1o7qxI6t0tJSfDfvR4waMRRendojM/MB3Nq4QyKRiLaR1Y/V
K1dgZC1Pj1paWsGjXXts3LAeTfT08O1332Os3xsYPmQg9u7ZLRxPjq1aKY1fdWL9XqfOXfDjTz/D
f+xoeLRxQQ/vLujd1xdT35sGAJj/4zylT4VGR+1DYmICRg4brDD302ezP4ampiY2bdmKsE0b0MLK
HB9/9AGWr1wNWzs7lf3w0mUrcPPmDbS0scDQwa/jk8++qPEaaiWxtJ998jH2///7+2JlqqpP1XzE
2tVETw/fzA3GW/5j0dzKDBs3rENE5E7h6bK4O3cwfdr/xhY5OdmYPm2qwi8wTJ82lX/Fh72QpgfN
wIyPPsa0wMmwNjfBwNd80bJlS2wKj1B4jF+VJnp6CF27Ad98/aXSn8mspKq/8+3XH2dOn4Ikv7iU
r3QYY4wxxqqQy+UKF2nt3F2xYOEv/CsiL4lnEb/wzZuEG06MMfYienov7jDGGGOMvYSKiopg19xK
eDwy9shhpKam8vvFL4lnFT8NDQ0MGDCoXvNkjLH69Ey+2b/x33+Y+M54pdvnfPUtBg4e8rSrwRhj
jLEXzIt6jbBn1058NedzyIpl0NPXw7dzv+drlZcIx48xxp7RYJ8xxhhjjDHGGGPPDj/GzxhjjDHG
GGOMNTA82GeMMcYYY4wxxhoYHuwzxhhjjDHGGGMNDA/2GWOMMcYYY4yxBoYH+4wxxhhjjDHGWAOj
WVJc+LzrwBhjjDHGGGOMsXokISL+6T3GGGOMMcYYY6wB4cf4GWOMMcYYY4yxBoYH+4wxxhhjjDHG
WAPDg33GGGOMMcYYY6yB4cE+Y4wxxhhjjDHWwPBgnzHGGGOMMcYYa2B4sM8YY4wxxhhjjDUwUgAI
Dw9Ht27doKenB11dXXTo0AErVqwQEvXt2xdffvllrRk4Oztj2bJlAAAjIyNoaGhAU1NTYVm6dKnK
ity/fx/+/v6wtraGqakpWrRogcDAQBQUFAAAhg0bJuQnlUohlUqF/7/99ttCPqraUlnPxo0bQ1tb
G9ra2tDT04OHhwc2bNigkKa2tri4uKj72bI6WL58OfT09PD777+rTLt161Z0794d+vr6aNKkCdzc
3DBv3jyUlpYKaarGWFdXFw4ODliwYMHTbEKDwvFoeKqf96ysrDBp0iTk5ubWazn37t2DRCJBWVmZ
wr+fls2bNyM7O/ux9vXy8sL69evruUYvrrS0NEgkEqFfrS/POwZPUj578X322WcwNjbG0aNHn2o5
yvq9Q4cOoXPnznBxcYG7uztWrlypdp4nT55E165dYWxsDFtbW/zyyy/CtnPnzsHLywumpqZwdnbG
xo0b1apPXl4exo4dC2NjY5ibm+Prr79WWn5d0oqVqWrb08qHsZeFRCLB6dOna6xv06aNynPG075W
ki5atAiBgYEIDAxERkYGcnJy8NVXX+Hrr7/G7NmzAQCBgYEIDQ2tUYmjR48iJSUF48aNE9bt2bMH
ZWVlCsu0adNUVmTkyJEwMTHB7du3kZmZidOnT+PatWuYMWMGAGDHjh1CfuPGjcO0adOE/69ZswYA
oE5bKu3cuRMymQwymQy5ubmYN28eJk2ahAsXLoi25caNG4/3Sb/CiouLFW6kVPfee+8hNjYWbm5u
KvMKCQlBQEAApkyZgrS0NGRnZ2PFihXYunUrAgICFNJWxrigoABr167Fd999h+jo6Cduz8uO4/Hq
qnreO336NG7cuIGZM2c+72o9kTlz5vBA7zl73jF43uWzp6ekpASbNm3C/PnzhS+WngZl/d7Dhw8x
fPhwLFiwADdu3MCePXswa9asWi/qq8vNzcXAgQMRGBiInJwcbNu2DV999RVOnjyJkpISjBgxAoGB
gXjw4AHCwsIwbdo03Lp1S7Q+ADBlyhTo6OggJSUF58+fx4EDB3D58uVa61CXtGJl1uW6oL7yYYzV
E11dXdq8eTNVd+jQIZJKpRQfH08lJSVkbm5O27dvV0gzYcIEmjp1qvB/Q0ND2rdvX4281GFgYEBR
UVEK6x48eEBpaWk10vr7+9P777+vsC4nJ4fUaYtYPVu3bk0rVqx44ra8KL755htheR7i4uJo1qxZ
1KJFC/rggw+Upjt79iwREfXt25eWLFmiNF1+fj7p6+vTunXramzLzs6m7Oxs4f+1xa9jx470+++/
17UZDQbH49VWWwx27NhB5ubmREQUHx9Purq6NH/+fGrWrBmlpKTQqVOnyMvLi1q1akWtWrWiVatW
Cfvu3buXPDw8yNbWluzt7Wn16tVCPgCotLRU4d9EREeOHKFOnTqRs7Mzubm50a+//irkd/DgQXJ3
dyczMzPq3LkznTlzRmVZb7zxBgEge3t7CgsLIyISrfPq1avJzs6OXFxcaMaMGdS5c+daj9+GKjU1
lQDQ+vXrydXVlfT19WnChAkkl8uJSHl85HI5BQUFkb29PTk6OpKnpyedPHmSiJ5NDOpavrJ21HaM
Kzu2iIhCQ0PJ0tKSnJyc6JNPPqHevXvT2rVrVbaR1Z+wsDAaPXo0yWQysrS0pKysLGHbf//9RwAU
0nt4eNCWLVuISDx+1Snr9y5dukTa2toKabt06SJcK4pJT0+n0NBQhXXdunWjlStXUlRUFNnb2yts
Gz9+PM2dO1e0PpmZmaStrU0PHjxQWb6qtB4eHgp5i/X9YtvqKx/GXmYA6NSpUzXWu7m50YoVK+je
vXukra1Nq1atoqFDh5Kbmxv5+/uTXC6vca30xx9/kKurK2VmZoruR6S8v2vZsiWdOHGiom5aWlrC
DtXZ2NjQypUriYjo888/p8GDBwvbcnNzSUdHhy5cuCCse5IB8tSpU8na2poWL15Mly5dUlonotoH
+7t37yZ121K9niUlJRQWFkaNGzema9euPXFbXhQ7d+6knTt3Vly8XN1G+afDqLCwkG5cvULHd4XR
qb0RdGpvBP135bLyTOKOVSxqKi8vp3379tGgQYOoVatWtHjxYsrNzVVrX1Un/8qbNjKZTGVeVeMn
l8vp0KFDZGpqSnFxceo1pIHgeLBKtZ3Ttm3bRjY2NkRElJKSQhKJhIKDg6m8vJwePHhA+vr6FB4e
TkQVN4uMjIzo6tWrVFxcTHp6erRnzx4iquhsNDU1KSMjQ+lgPysriwwNDWn37t1ERJSUlEQmJiZ0
8OBByszMJH19fYqJiSEiojVr1pCVlRWVlpaKllVaWkoA6Pbt20REonVOTk6mxo0b07lz54iIKDIy
kjQ0NF7Jwf7s2bNJLpfTgwcPyNDQkA4ePCgan6ioKHJ0dBT+1nfv3k0ffvghEdEziUFdyhdrR/Vj
XOzYSkpKIk1NTaGuS5cuJS0tLVq3bp1oG1n96tWrF0VHRxMRUVBQEC1evFjYJjbYF4ufmOr9nkwm
I1tbW+EGwo0bN8jU1FQ43uoiMTGRDA0N6datWxQSEqJwTU1EFBwcTG+++aZofWJiYsje3p6Cg4Op
VatW5OrqqnDTtCpVaQ8cOEB37txR+Rmo2lZf+TD2MlM12E9JSSEAtHDhQiKqOLc0a9aMDh48qHCt
FBkZSXZ2dpSUlEREJLqfWH8XEBBAP/zwAxERSc3NzSGV1j5Pn5WVFbKysgBUPAoUFRWF+/fvAwA2
bNgAd3d3tG/fXmGfAQMGQCKRKCwHDx5U+YTB0qVLsWDBAhw/fhz9+vWDiYkJJk6ciNTUVLWeUMjM
zIS6bQGAUaNGwcjICEZGRtDR0cHixYuxc+dOtG7dWkgzdOhQ4f3WymXhwoVq1edF8OjRI8hkMpSU
lODo5Sxcy9PG5dh9yEm8Ce9urvDq5gGvXl2Qm3QLx8JDcebwQSQnJSL/+Fb8d/Uqjh/Yj2M3MnEs
Tv33Ozdt2oSJEydiypQpuHHjBj766CMYGhrWS3uys7NhbGwMLS0tYV1gYCAsLCyE5d69e8K2yhg3
adIE/fv3x0cffQRbW9t6qcvLguPBlElOTsbChQsxevRoABXvmxER/P39IZFIsH//fpiYmAjb7e3t
MWTIEGzevBna2tpITk7GgAEDAAA+Pj5o1KgR4uPjlZYXExMDS0tLDBo0CABgY2ODkSNHYteuXYiO
jkbz5s3Rp08fAMD48eNx8eJFaGho1KkssTrHxsbCwcEBHTt2BAAMHz4clpaW9fFRvnSCgoIglUph
amoKFxcXJCYmisbHwsIC6enpWLduHdLT0zFo0CCFd4+rehoxqEv5Yu2ofoyLHVuHDx+Gi4uLUNep
U6dCT09PZRtZ/bl16xYSEhLg6+sLAJg8eXKNOZiUEYtfXWhpaWHlypWYOHEiTE1N4ebmhi+//BKO
jo51yuf+/fsYNGgQ5s6di1atWqGwsBA6OjoKaXR1dVFYWCiaT05ODhITE2FoaIibN28iPDwc8+bN
w549e+qc1tfXFw4ODnVqR23qKx/GGjKJRAIAGDt2LICKc4uDgwMSExOFNCdPnsSMGTOwb98+2NjY
qNxPrL/r37+/MM+JNC0tDXK5vNaKpaSkwMzMDABga2uLvn37IjQ0FACwcuVKTJ06tcY++/btAxEp
LJUnajFSqRTjxo3D1q1bkZ6ejqNHjyIzM1PohFUxMzODum0BgIiICOTm5iI3Nxfjxo2DnZ0dXnvt
NYV9qr7fWrnMmjVLrfq8CEpLS1FaWoqysjJoWdiii3U5OtnqwcuhCfAgFchMBtLj4dXWGj182qJL
S22Y5N0BALjq5qK7g23ObTQAAAqrSURBVB56uJiiXFakdpnt27dH69atMXv2bPz+++/Iz8+vt/aY
mZkhOzsbRUX/q8/8+fNx8eJFXLx4Ebm5uQrzSlTGuLi4GPHx8Th//jymTJlSb/V5GXA8WFWVN1wM
DQ3Rs2dPeHl5Yd68eQppTE1NAVRcKKampsLW1lZYoqOjhZuma9euhbe3N7p06QIvLy+UlJSgvLxc
adnp6elo1qyZwjoTExOkp6cjMzMTxsbGwnqpVIpmzZoJnZy6ZYnVOSsrC02bNlVIX70+r4qqn7Wm
pibkcrlofNq2bYvt27dj3759cHZ2hpeXF44dO1Zr3k8jBnUpX6wdlSqPcUD5sZWTk6OQTiqVChdf
qv42WP3466+/kJqaCmNjYxgZGaFHjx64deuWWhP1icWvLuLi4jBmzBhER0cjMzMTCQkJWL58OTZt
2qR2HufPn4e3tzdmzJghzEOlp6en0HcCQEFBgcobEkZGRtDS0sL06dMhkUjQpk0b+Pn5Yd++fU+U
ljH2ZCQSSa1j0JKSEmhoaAj/NzAwEP6toaGhsE/lHHhVx6ti+4n1d76+vjhz5gzkcjmkjRo1qjED
KADExsYiLS1NYaAeGBiIv//+G5cvX8bdu3cxZswYddqvUmpqKsLCwhTWubu749tvv8WlS5cgk8lU
5uHt7Y26tKWqn376CXv27EFMTMzjNeAFVVJSIgz2KTcFGRk50CjMAkqLAVkByrNTkHvzMvJvXsGj
uBsoy0rFxeOxKCrMx+lLd3EiLh+Z+s7wGTJS7TJdXV1x8OBB7NixA3fu3IGrqyuCgoKESWeeRKdO
nWBsbCxMyAgAhoaGwrfIYmxsbBAQEICIiIgnrsfLhOPBqqq84ZKXl4e7d+9i0aJFNb5dqhxg29jY
wMnJCffu3ROWtLQ0/PHHH9i2bRu+//57bNq0CWfOnMGJEyfQqFEj0bItLS2RkZGhsO7BgwewtLSE
ubm5wjYiwtWrV1FaWlqnssTqbGxsXOOXB9R9cuxVIBYfAOjTpw+2bt2KjIwMjB49GqNGjao1n6cV
A3XLV9UO4H/HuNixZWBggIcPHwr7EBFSUlJUtpHVD5lMhrVr1+LatWvCFzO5ublYtGgRli9fDgDC
BXTVG3+VMROLX10cPnwY9vb28PLyAgBYW1tjwIABiIqKUmv/M2fOYMSIEfj7778xadIkYX3r1q1x
/fp1hbRXrlyBu7u7aH4ODg6QyWQKNwqIqNanWuuSljH2ZKytrXHz5k2FdXl5eYiPj0fLli3VyiMq
Kgo+Pj41JrhWRqy/MzY2hpOTEw4cOADpvHnzMH36dKxZswZFRUV49OgRduzYgTFjxuCLL75QuBM6
ePBgyGQyfPLJJ5gwYQJ0dXXVqowq5eXlmDx5MhYtWiQ8wpSRkYGQkBB4enpCW1tbZR4GBgaoS1uq
srKywueff473338fJSUl9dKmF0F8fDzi4+MVLqYy8mVIu5+Ou3EJuJeUhoIyKfLLJMgsKMK5f65C
Yu6Af4t04dh9ALz7DYDpY37z5eLigt9++w03btyAm5sb3nnnnSduT+VrFLNnz8bSpUuRn5+P0tJS
/PPPPxg+fDjMzc1hYmJS677Z2dkIDQ1F27Ztn7geLyOOB6urPn36ICUlBfv37wcAFBYWYvLkybhw
4QJycnJgYmKC5s2bg4gwf/58SCQS0UdQ+/Tpg/T0dCG/hIQEbNu2DSNGjED//v2RlpaGHTt2AKi4
KeHr6wuJRCJallQqhYaGBvLy8lTWuXv37rh58ybOnz8PANi4cSN/E1uFWHxWrVqFwMBAlJWVoXHj
xmjXrh0qXlHEM4lBXctX1o7qxI6tbt264dKlS7h69SqAip8Lq/zJQrE2svqxZcsW2Nvbw97eXmH9
6NGjERkZiezsbFhaWkJTU1P4laQTJ04gKSkJAETjVxdt2rTB9evXhTLy8vJw6NAh4RXWHTt24Nq1
a7XuW1RUBD8/P6xduxa9evVS2Obj44Py8nIsXboU5eXlOHLkCKKjo4VHdZWpfMp2zpw5KCsrw+3b
txEeHi48xluXtIcPHxZ99Upd9ZVPenq6wk+UFRUVYeXKlQo3K1auXKnwlA5jL4qZM2di7ty5OHXq
FEpLSxEXF4fx48eja9eu8PHxUSsPZ2dnLF26FFeuXFHrZ+tV9Xf9+/dHcHBwxcwmW7ZsIS8vL9LV
1SUdHR3y9PSkv//+u9YJCL755hsCUOtENE8yqd25c+do0KBBZGZmRgYGBmRhYUFvvfUWJScn10hb
2wR9ldRpS231lMlkZGdnR/PmzRPSSKVS0tDQqLHUVqcX0bvvvissRESUe5tSo/6kW2E/KiypUX8S
Xd32XOpYVlZGWlpapKWlRVKplDQ1NUlLS4umT5+udJ+9e/eSj48P6evrk46ODrVu3ZrmzJlTY/b3
Ro0aCXmbmpqSn58fpaamPotmvbQ4Hg2XqvNz5eRt+fn5wrrKGccdHBzI0dGRPvvsM5LL5fTw4UPy
9fUlOzs76tixI4WHh1NAQABZWVnR7t27lc7GHxsbS507dxZmjV2+fLlQVmxsLLm6upKpqSm1b99e
mG1drKyrV6+Sv78/GRgY0KJFi0TrTFQxw23z5s3J1taWgoKCyMfHR+ns3A1RbTH29vYWZhZXFp+8
vDzy9/cnGxsbsre3p/bt29OBAweEPJ52DOpavrJ2VG+/qmNr4cKF1KJFC3J3d6fg4GDq0qULrV+/
XmUb2ZPz9vYWJqSqrnv37vTLL78QEdGCBQvIycmJ+vfvT59++in17NlTmDhRLH5Vqer3li1bRq1b
tyZHR0dydHSk2bNnU1lZGREReXp6UkhISK313LJlCwEQ8q5cKieX/Pfff6lr165kZGREbm5uFBkZ
qVZ9kpOT6bXXXiNDQ0OytbVVWr6qtFVn0RcrU1V96iufY8eOKUy4mJSURACEicqIKiZBO3ZM/Umj
GXuWlixZQq6urqSjo0PNmzen6dOnU2ZmJhGJ97/Vr5XOnz9PBgYGdOnSpcfut4mIjh8/TgBIQvT/
t8cZY4wxxhgAQC6XK7xr6eTkhJCQELXnEmLP17OI38aNGyGVSuvttVbGGKtv/OIOY4wxxlgVRUVF
MDMzEx6PPHToEFJSUuDp6fmca8bU8azip6GhgcGDB9drnowxVp80n0Uh169fF2YYrM13332HoUOH
PouqMMYYY+wF8iJeI+jq6mL16tX48MMPUVxcDH19fWzcuLHWWZLZi+dZxc/Pz69e82OMsfrGj/Ez
xhhjjDHGGGMNDD/GzxhjjDHGGGOMNTA82GeMMcYYY4wxxhoYHuwzxhhjjDHGGGMNDA/2GWOMMcYY
Y4yxBoYH+4wxxhhjjDHGWAOjmZ2T97zrwBhjjDHGGGOMsXrEP73HGGOMMcYYY4w1MPwYP2OMMcYY
Y4wx1sDwYJ8xxhhjjDHGGGtgeLDPGGOMMcYYY4w1MDzYZ4wxxhhjjDHGGhge7DPGGGOMMcYYYw0M
D/YZY4wxxhhjjLEGhgf7jDHGGGOMMcZYA8ODfcYYY4wxxhhjrIHhwT5jjDHGGGOMMdbA8GCfMcYY
Y4wxxhhrYHiwzxhjjDHGGGOMNTA82GeMMcYYY4wxxhoYHuwzxhhjjDHGGGMNDA/2GWOMMcYYY4yx
BoYH+4wxxhhjjDHGWAPzf1uBGnsEEcUmAAAAAElFTkSuQmCC
--=-G412zPDCG8DfgOzneuZG--
12:36 p.m.
On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
After night, the OVF_STORE it was created:
It's quite strange that it got so long but now it looks fine.
If the ISO_DOMAIN that I see in your screenshot is served by the engine VM
itself, I suggest to remove it and export from an external server.
Serving the ISO storage domain from the engine VM itself is not a good idea
since when the engine VM is down you can experiment long delays before
getting the engine VM restarted due to the unavailable storage domain.
Regards,
Carlos Rodrigues
On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues <cmar(a)eurotux.com>
wrote:
On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues <cmar(a)eurotux.com>
wrote:
I increase hosted_engine disk space to 160G. How do i force to create
OVF_STORE.
I think that restarting the engine on the engine VM will trigger it
although I'm not sure that it was a size issue.
I found to OVF_STORE on another storage domain with "Domain Type" "Data
(Master)"
Each storage domain has its own OVF_STORE volumes; you should get them
also on the hosted-engine storage domain.
Not really sure about how to trigger it again; adding Roy here.
Regards,
Carlos Rodrigues
On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote:
On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues <cmar(a)eurotux.co
m>
wrote:
On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues <cmar@eurotu
x.
com>
wrote:
On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote:
On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues <cmar@eu
ro
tux.
com> wrote:
On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi
wrote:
On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues
<cmar@
euro
tux.com>
wrote:
On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi
wrote:
On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues
<cmar@
eurotux.
com>
wrote:
On Thu, 2016-08-18 at 08:54 +0200, Simone
Tiraboschi
wrote:
On Tue, Aug 16, 2016 at 12:53 PM, Carlos
Rodrigues <c
mar@euro
tux.
com>
wrote:
On Sun, 2016-08-14 at 14:22 +0300, Roy Golan
wrote:
On 12 August 2016 at 20:23, Carlos
Rodrigues
<cma
r@eurotu
x.co
m>
wrote:
Hello,
I have one cluster with two hosts with
power
management
correctly
configured and one virtual machine with
HostedEngine
over
shared
storage with FiberChannel.
When i shutdown the network of host with
HostedEngine
VM, it
should be
possible the HostedEngine VM migrate
automatically to
another
host?
migrate on which network?
What is the expected behaviour on this HA
scenario?
After a few minutes your vm will be
shutdown
by
the High
Availability
agent, as it can't see network, and started
on
another
host.
I'm testing this scenario and after shutdown
network, it
should
be
expected that agent shutdown ha and started
on
another
host,
but
after
couple minutes nothing happens and on host
with
network we
getting
the
following messages:
Aug 16 11:44:08 ied-
blade11.install.eurotux.local
ovirt-ha-
agent[2779]:
ovirt-ha-agent
ovirt_hosted_engine_ha.agent.hosted_engine.Ho
st
edEn
gine.con
fig
ERROR
Unable to get vm.conf from OVF_STORE, falling
back
to
initial
vm.conf
I think the HA agent its trying to get vm
configuration but
some
how it
can't get vm.conf to start VM.
No, this is a different issues.
In 3.6 we added a feature to let the engine
manage
also the
engine VM
itself; ovirt-ha-agent will pickup the latest
engine
VM
configuration
from the OVF_STORE which is managed by the
engine.
If something goes wrong, ovirt-ha-agent could
fallback to the
initial
(bootstrap time) vm.conf. This will normally
happen
till you
add
your
first regular storage domain and the engine
imports
the
engine
VM.
But i already have my first storage domain and
storage
engine
domain
and already imported engine VM.
I'm using 4.0 version.
This seams an issue, can you please share your
/var/log/ovirt-hosted-engine-ha/agent.log ?
I sent it in attachment.
Nothing strange here;
do you see a couple of disks with alias OVF_STORE on
the
hosted-
engine
storage domain if you check it from the engine?
Do you mean any disk label?
I don't have it anyone:
[root@ied-blade11 ~]# ls /dev/disk/by-label/
ls: cannot access /dev/disk/by-label/: No such file or
directory
No I mean: go to the engine web-ui, select the hosted-
engine
storage
domain, check the disks there.
No, the alias is virtio-disk0.
And this is the engine VM disk, so the issue is why the engine
has
still to create the OVF_STORE.
Can you please share your engine.log from the engine VM?
Go in attachment.
The creation of the OVF_STORE disk failed but it's not that clear
why:
2016-08-17 08:43:33,538 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
ge
DomainCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
ge
DomainCommand'
with failure.
2016-08-17 08:43:33,540 ERROR
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] Ending command
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with
failure.
2016-08-17 08:43:33,541 WARN
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [6f1f1fd4] VmCommand::EndVmCommand: Vm is
null - not performing endAction on Vm
2016-08-17 08:43:33,553 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
or
]
(DefaultQuartzScheduler6) [6f1f1fd4] Correlation ID: 6f1f1fd4, Call
Stack: null, Custom Event ID: -1, Message: Add-Disk operation
failed
to complete.
2016-08-17 08:43:33,557 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
or
]
(DefaultQuartzScheduler6) [] Correlation ID: 19ac5bda, Call Stack:
null, Custom Event ID: -1, Message: Failed to create OVF store disk
for Storage Domain hosted_storage.
OVF data won't be updated meanwhile for that domain.
2016-08-17 08:43:33,585 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(DefaultQuartzScheduler6) [5f5a8daf] Command
'ProcessOvfUpdateForStorageDomain' (id:
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting on child command
id:
'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
type:'CreateOvfVolumeForStorageDomain' to complete
2016-08-17 08:43:33,595 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
ge
DomainCommand]
(DefaultQuartzScheduler6) [5d314e49] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora
ge
DomainCommand'
with failure.
2016-08-17 08:43:33,596 ERROR
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [5d314e49] Ending command
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand' with
failure.
2016-08-17 08:43:33,596 WARN
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
(DefaultQuartzScheduler6) [5d314e49] VmCommand::EndVmCommand: Vm is
null - not performing endAction on Vm
2016-08-17 08:43:33,602 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
or
]
(DefaultQuartzScheduler6) [5d314e49] Correlation ID: 5d314e49, Call
Stack: null, Custom Event ID: -1, Message: Add-Disk operation
failed
to complete.
2016-08-17 08:43:33,605 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirect
or
]
(DefaultQuartzScheduler6) [] Correlation ID: 5f5a8daf, Call Stack:
null, Custom Event ID: -1, Message: Failed to create OVF store disk
for Storage Domain hosted_storage.
OVF data won't be updated meanwhile for that domain.
2016-08-17 08:43:36,460 INFO
[org.ovirt.engine.core.bll.scheduling.HaReservationHandling]
(DefaultQuartzScheduler7) [5d314e49] HA reservation status for
cluster
'Default' is 'OK'
2016-08-17 08:43:36,662 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(DefaultQuartzScheduler4) [5f5a8daf] Command
'ProcessOvfUpdateForStorageDomain' id:
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child commands
'[84959a4b-6a10-4d22-b37e-6c154e17a0da,
eb2e6f1a-c756-4ccd-85a1-60d97d6880de]' executions were completed,
status 'FAILED'
2016-08-17 08:43:37,691 ERROR
[org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStor
ag
eDomainCommand]
(DefaultQuartzScheduler6) [5f5a8daf] Ending command
'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStor
ag
eDomainCommand'
with failure.
Can you please check vdsm logs for that time frame on the SPM host?
I sent in attachment the vdsm logs from both hosts, but i think the
SPM
host on this time frame it was ied-blade13
It seams that you also have an issue in the SPM election procedure:
2016-08-17 18:04:31,053 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] SPM Init: could not find reported vds
or
not up - pool: 'Default' vds_spm_id: '2'
2016-08-17 18:04:31,076 INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] SPM selection - vds seems as spm
'hosted_engine_2'
2016-08-17 18:04:31,076 WARN
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData]
(DefaultQuartzScheduler1) [] spm vds is non responsive, stopping
spm
selection.
2016-08-17 18:04:31,539 INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher]
(DefaultQuartzScheduler7) [] Fetched 1 VMs from VDS
'06372186-572c-41ad-916f-7cbb0aba5302'
probably due to:
2016-08-17 18:02:33,569 ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
(DefaultQuartzScheduler6) [] Failure to refresh Vds runtime info:
VDSGenericException: VDSNetworkException: Message timeout which can
be
caused by communication issues
2016-08-17 18:02:33,569 ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring]
(DefaultQuartzScheduler6) [] Exception:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
VDSGenericException: VDSNetworkException: Message timeout which can
be
caused by communication issues
This messages maybe cause by connection issues from yesterday at 6pm.
can you please check if the engine VM could correctly resolve and
reach each host?
Now i can read engine VM from both hosts
[root@ied-blade11 ~]# ping ied-hosted-engine
PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84)
bytes
of data.
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=1 ttl=64 time=0.179 ms
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=2 ttl=64 time=0.141 ms
^C
--- ied-hosted-engine.install.eurotux.local ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.141/0.160/0.179/0.019 ms
[root@ied-blade13 ~]# ping ied-hosted-engine
PING ied-hosted-engine.install.eurotux.local (10.10.4.115) 56(84)
bytes
of data.
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=1 ttl=64 time=0.172 ms
64 bytes from ied-hosted-engine.install.eurotux.local (10.10.4.115):
icmp_seq=2 ttl=64 time=0.169 ms
^C
--- ied-hosted-engine.install.eurotux.local ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1000ms
rtt min/avg/max/mdev = 0.169/0.170/0.172/0.013 ms
I have a message critical of low disk space on hosted_storage domain.
I have 50G of disk and i created i VM with 40G. Do i need more space
of
OVF_STORAGE?
What is the minimum requirements of disk space for deploy engine VM?
Regards,
Carlos
Regards,
Carlos Rodrigues
Regards,
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.c
om
(t) +351 253 680 300 (m) +351 911 926 110
_________________________________________
__
____
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/u
se
rs
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
_____________________________________________
__
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
12:47 p.m.
On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote:
On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues <cmar(a)eurotux.com>
wrote:
> After night, the OVF_STORE it was created:
>
It's quite strange that it got so long but now it looks fine.
If the ISO_DOMAIN that I see in your screenshot is served by the
engine VM itself, I suggest to remove it and export from an external
server.
Serving the ISO storage domain from the engine VM itself is not a
good idea since when the engine VM is down you can experiment long
delays before getting the engine VM restarted due to the unavailable
storage domain.
Ok, thank you for advice.
Now, apparently is all ok. I'll do more tests with HA and any issue
i'll tell you.
Thank you for your support.
Regards,
Carlos Rodrigues
>
>
>
> Regards,
> Carlos Rodrigues
>
> On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote:
> >
> >
> > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues <cmar(a)eurotux.c
> > om> wrote:
> > > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote:
> > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues <cmar@eurot
> > > > ux.com> wrote:
> > > > >
> > > > > I increase hosted_engine disk space to 160G. How do i force
> > > > > to create
> > > > > OVF_STORE.
> > > >
> > > > I think that restarting the engine on the engine VM will
> > > > trigger it
> > > > although I'm not sure that it was a size issue.
> > > >
> > >
> > > I found to OVF_STORE on another storage domain with "Domain
> > > Type" "Data (Master)"
> > >
> > >
> >
> > Each storage domain has its own OVF_STORE volumes; you should get
> > them also on the hosted-engine storage domain.
> > Not really sure about how to trigger it again; adding Roy here.
> >
> >
> >
> >
> > >
> > >
> > >
> > > > >
> > > > > Regards,
> > > > > Carlos Rodrigues
> > > > >
> > > > > On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote:
> > > > > >
> > > > > > On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi
> > > > > > wrote:
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues
<cma
> > > > > > > r(a)eurotux.co
> > > > > > > m>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, 2016-08-18 at 11:53 +0200, Simone
Tiraboschi
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Aug 18, 2016 at 11:50 AM, Carlos
Rodrigues
> > > > > > > > > <cmar@eurotu
> > > > > > > > > x.
> > > > > > > > > com>
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, 2016-08-18 at 11:42 +0200,
Simone
> > > > > > > > > > Tiraboschi wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Thu, Aug 18, 2016 at 11:25 AM,
Carlos
> > > > > > > > > > > Rodrigues <cmar@eu
> > > > > > > > > > > ro
> > > > > > > > > > > tux.
> > > > > > > > > > > com> wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, 2016-08-18 at 11:04
+0200, Simone
> > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, Aug 18, 2016 at
10:36 AM, Carlos
> > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > <cmar@
> > > > > > > > > > > > > euro
> > > > > > > > > > > > > tux.com>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Thu, 2016-08-18
at 10:27 +0200, Simone
> > > > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Thu, Aug
18, 2016 at 10:22 AM,
> > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > > <cmar@
> > > > > > > > > > > > > > > eurotux.
> > > > > > > > > > > > > > > com>
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Thu,
2016-08-18 at 08:54 +0200,
> > > > > > > > > > > > > > > > Simone
> > > > > > > > > > > > > > > >
Tiraboschi
> > > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On
Tue, Aug 16, 2016 at 12:53 PM,
> > > > > > > > > > > > > > > > >
Carlos
> > > > > > > > > > > > > > > > >
Rodrigues <c
> > > > > > > > > > > > > > > > >
mar@euro
> > > > > > > > > > > > > > > > >
tux.
> > > > > > > > > > > > > > > > >
com>
> > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
On Sun, 2016-08-14 at 14:22
> > > > > > > > > > > > > > > > > >
+0300, Roy Golan
> > > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> On 12 August 2016 at 20:23,
> > > > > > > > > > > > > > > > > >
> Carlos
> > > > > > > > > > > > > > > > > >
> Rodrigues
> > > > > > > > > > > > > > > > > >
> <cma
> > > > > > > > > > > > > > > > > >
> r@eurotu
> > > > > > > > > > > > > > > > > >
> x.co
> > > > > > > > > > > > > > > > > >
> m>
> > > > > > > > > > > > > > > > > >
> wrote:
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Hello,
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > I have one cluster with two
> > > > > > > > > > > > > > > > > >
> > hosts with
> > > > > > > > > > > > > > > > > >
> > power
> > > > > > > > > > > > > > > > > >
> > management
> > > > > > > > > > > > > > > > > >
> > correctly
> > > > > > > > > > > > > > > > > >
> > configured and one virtual
> > > > > > > > > > > > > > > > > >
> > machine with
> > > > > > > > > > > > > > > > > >
> > HostedEngine
> > > > > > > > > > > > > > > > > >
> > over
> > > > > > > > > > > > > > > > > >
> > shared
> > > > > > > > > > > > > > > > > >
> > storage with FiberChannel.
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > When i shutdown the network
> > > > > > > > > > > > > > > > > >
> > of host with
> > > > > > > > > > > > > > > > > >
> > HostedEngine
> > > > > > > > > > > > > > > > > >
> > VM, it
> > > > > > > > > > > > > > > > > >
> > should be
> > > > > > > > > > > > > > > > > >
> > possible the HostedEngine VM
> > > > > > > > > > > > > > > > > >
> > migrate
> > > > > > > > > > > > > > > > > >
> > automatically to
> > > > > > > > > > > > > > > > > >
> > another
> > > > > > > > > > > > > > > > > >
> > host?
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> migrate on which network?
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > What is the expected
> > > > > > > > > > > > > > > > > >
> > behaviour on this HA
> > > > > > > > > > > > > > > > > >
> > scenario?
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> After a few minutes your vm
> > > > > > > > > > > > > > > > > >
> will be
> > > > > > > > > > > > > > > > > >
> shutdown
> > > > > > > > > > > > > > > > > >
> by
> > > > > > > > > > > > > > > > > >
> the High
> > > > > > > > > > > > > > > > > >
> Availability
> > > > > > > > > > > > > > > > > >
> agent, as it can't see network,
> > > > > > > > > > > > > > > > > >
> and started
> > > > > > > > > > > > > > > > > >
> on
> > > > > > > > > > > > > > > > > >
> another
> > > > > > > > > > > > > > > > > >
> host.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
I'm testing this scenario and
> > > > > > > > > > > > > > > > > >
after shutdown
> > > > > > > > > > > > > > > > > >
network, it
> > > > > > > > > > > > > > > > > >
should
> > > > > > > > > > > > > > > > > >
be
> > > > > > > > > > > > > > > > > >
expected that agent shutdown ha
> > > > > > > > > > > > > > > > > >
and started
> > > > > > > > > > > > > > > > > >
on
> > > > > > > > > > > > > > > > > >
another
> > > > > > > > > > > > > > > > > >
host,
> > > > > > > > > > > > > > > > > >
but
> > > > > > > > > > > > > > > > > >
after
> > > > > > > > > > > > > > > > > >
couple minutes nothing happens
> > > > > > > > > > > > > > > > > >
and on host
> > > > > > > > > > > > > > > > > >
with
> > > > > > > > > > > > > > > > > >
network we
> > > > > > > > > > > > > > > > > >
getting
> > > > > > > > > > > > > > > > > >
the
> > > > > > > > > > > > > > > > > >
following messages:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Aug 16 11:44:08 ied-
> > > > > > > > > > > > > > > > > >
blade11.install.eurotux.local
> > > > > > > > > > > > > > > > > >
ovirt-ha-
> > > > > > > > > > > > > > > > > >
agent[2779]:
> > > > > > > > > > > > > > > > > >
ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
ovirt_hosted_engine_ha.agent.host
> > > > > > > > > > > > > > > > > >
ed_engine.Ho
> > > > > > > > > > > > > > > > > >
st
> > > > > > > > > > > > > > > > > >
edEn
> > > > > > > > > > > > > > > > > >
gine.con
> > > > > > > > > > > > > > > > > >
fig
> > > > > > > > > > > > > > > > > >
ERROR
> > > > > > > > > > > > > > > > > >
Unable to get vm.conf from
> > > > > > > > > > > > > > > > > >
OVF_STORE, falling
> > > > > > > > > > > > > > > > > >
back
> > > > > > > > > > > > > > > > > >
to
> > > > > > > > > > > > > > > > > >
initial
> > > > > > > > > > > > > > > > > >
vm.conf
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
I think the HA agent its trying
> > > > > > > > > > > > > > > > > >
to get vm
> > > > > > > > > > > > > > > > > >
configuration but
> > > > > > > > > > > > > > > > > >
some
> > > > > > > > > > > > > > > > > >
how it
> > > > > > > > > > > > > > > > > >
can't get vm.conf to start VM.
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > No,
this is a different issues.
> > > > > > > > > > > > > > > > > In
3.6 we added a feature to let
> > > > > > > > > > > > > > > > > the
engine
> > > > > > > > > > > > > > > > >
manage
> > > > > > > > > > > > > > > > > also
the
> > > > > > > > > > > > > > > > >
engine VM
> > > > > > > > > > > > > > > > >
itself; ovirt-ha-agent will pickup
> > > > > > > > > > > > > > > > > the
latest
> > > > > > > > > > > > > > > > >
engine
> > > > > > > > > > > > > > > > > VM
> > > > > > > > > > > > > > > > >
configuration
> > > > > > > > > > > > > > > > > from
the OVF_STORE which is managed
> > > > > > > > > > > > > > > > > by
the
> > > > > > > > > > > > > > > > >
engine.
> > > > > > > > > > > > > > > > > If
something goes wrong, ovirt-ha-
> > > > > > > > > > > > > > > > >
agent could
> > > > > > > > > > > > > > > > >
fallback to the
> > > > > > > > > > > > > > > > >
initial
> > > > > > > > > > > > > > > > >
(bootstrap time) vm.conf. This will
> > > > > > > > > > > > > > > > >
normally
> > > > > > > > > > > > > > > > >
happen
> > > > > > > > > > > > > > > > > till
you
> > > > > > > > > > > > > > > > > add
> > > > > > > > > > > > > > > > >
your
> > > > > > > > > > > > > > > > >
first regular storage domain and
> > > > > > > > > > > > > > > > > the
engine
> > > > > > > > > > > > > > > > >
imports
> > > > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > > >
engine
> > > > > > > > > > > > > > > > > VM.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > But i
already have my first storage
> > > > > > > > > > > > > > > > domain
and
> > > > > > > > > > > > > > > > storage
> > > > > > > > > > > > > > > > engine
> > > > > > > > > > > > > > > > domain
> > > > > > > > > > > > > > > > and
already imported engine VM.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > I'm
using 4.0 version.
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > This seams an
issue, can you please
> > > > > > > > > > > > > > > share your
> > > > > > > > > > > > > > >
/var/log/ovirt-hosted-engine-
> > > > > > > > > > > > > > > ha/agent.log
?
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > I sent it in
attachment.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Nothing strange here;
> > > > > > > > > > > > > do you see a couple of
disks with alias
> > > > > > > > > > > > > OVF_STORE on
> > > > > > > > > > > > > the
> > > > > > > > > > > > > hosted-
> > > > > > > > > > > > > engine
> > > > > > > > > > > > > storage domain if you
check it from the
> > > > > > > > > > > > > engine?
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Do you mean any disk label?
> > > > > > > > > > > > I don't have it anyone:
> > > > > > > > > > > >
> > > > > > > > > > > > [root@ied-blade11 ~]# ls
/dev/disk/by-label/
> > > > > > > > > > > > ls: cannot access
/dev/disk/by-label/: No
> > > > > > > > > > > > such file or
> > > > > > > > > > > > directory
> > > > > > > > > > >
> > > > > > > > > > > No I mean: go to the engine
web-ui, select the
> > > > > > > > > > > hosted-
> > > > > > > > > > > engine
> > > > > > > > > > > storage
> > > > > > > > > > > domain, check the disks there.
> > > > > > > > > >
> > > > > > > > > > No, the alias is virtio-disk0.
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > And this is the engine VM disk, so the issue
is why
> > > > > > > > > the engine
> > > > > > > > > has
> > > > > > > > > still to create the OVF_STORE.
> > > > > > > > > Can you please share your engine.log from
the
> > > > > > > > > engine VM?
> > > > > > > > >
> > > > > > > >
> > > > > > > > Go in attachment.
> > > > > > >
> > > > > > > The creation of the OVF_STORE disk failed but it's
not
> > > > > > > that clear
> > > > > > > why:
> > > > > > >
> > > > > > > 2016-08-17 08:43:33,538 ERROR
> > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVo
> > > > > > > lumeForStora
> > > > > > > ge
> > > > > > > DomainCommand]
> > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Ending command
> > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVo
> > > > > > > lumeForStora
> > > > > > > ge
> > > > > > > DomainCommand'
> > > > > > > with failure.
> > > > > > > 2016-08-17 08:43:33,540 ERROR
> > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Ending command
> > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand'
> > > > > > > with
> > > > > > > failure.
> > > > > > > 2016-08-17 08:43:33,541 WARN
> > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4]
> > > > > > > VmCommand::EndVmCommand: Vm is
> > > > > > > null - not performing endAction on Vm
> > > > > > > 2016-08-17 08:43:33,553 ERROR
> > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.Au
> > > > > > > ditLogDirect
> > > > > > > or
> > > > > > > ]
> > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Correlation ID:
> > > > > > > 6f1f1fd4, Call
> > > > > > > Stack: null, Custom Event ID: -1, Message: Add-Disk
> > > > > > > operation
> > > > > > > failed
> > > > > > > to complete.
> > > > > > > 2016-08-17 08:43:33,557 WARN
> > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.Au
> > > > > > > ditLogDirect
> > > > > > > or
> > > > > > > ]
> > > > > > > (DefaultQuartzScheduler6) [] Correlation ID:
19ac5bda,
> > > > > > > Call Stack:
> > > > > > > null, Custom Event ID: -1, Message: Failed to create
> > > > > > > OVF store disk
> > > > > > > for Storage Domain hosted_storage.
> > > > > > > OVF data won't be updated meanwhile for that
domain.
> > > > > > > 2016-08-17 08:43:33,585 INFO
> > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExecution
> > > > > > > Callback]
> > > > > > > (DefaultQuartzScheduler6) [5f5a8daf] Command
> > > > > > > 'ProcessOvfUpdateForStorageDomain' (id:
> > > > > > > '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0')
waiting on
> > > > > > > child command
> > > > > > > id:
> > > > > > > 'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > > > > > > type:'CreateOvfVolumeForStorageDomain' to
complete
> > > > > > > 2016-08-17 08:43:33,595 ERROR
> > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVo
> > > > > > > lumeForStora
> > > > > > > ge
> > > > > > > DomainCommand]
> > > > > > > (DefaultQuartzScheduler6) [5d314e49] Ending command
> > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVo
> > > > > > > lumeForStora
> > > > > > > ge
> > > > > > > DomainCommand'
> > > > > > > with failure.
> > > > > > > 2016-08-17 08:43:33,596 ERROR
> > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > > > > > (DefaultQuartzScheduler6) [5d314e49] Ending command
> > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDiskCommand'
> > > > > > > with
> > > > > > > failure.
> > > > > > > 2016-08-17 08:43:33,596 WARN
> > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskCommand]
> > > > > > > (DefaultQuartzScheduler6) [5d314e49]
> > > > > > > VmCommand::EndVmCommand: Vm is
> > > > > > > null - not performing endAction on Vm
> > > > > > > 2016-08-17 08:43:33,602 ERROR
> > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.Au
> > > > > > > ditLogDirect
> > > > > > > or
> > > > > > > ]
> > > > > > > (DefaultQuartzScheduler6) [5d314e49] Correlation ID:
> > > > > > > 5d314e49, Call
> > > > > > > Stack: null, Custom Event ID: -1, Message: Add-Disk
> > > > > > > operation
> > > > > > > failed
> > > > > > > to complete.
> > > > > > > 2016-08-17 08:43:33,605 WARN
> > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.Au
> > > > > > > ditLogDirect
> > > > > > > or
> > > > > > > ]
> > > > > > > (DefaultQuartzScheduler6) [] Correlation ID:
5f5a8daf,
> > > > > > > Call Stack:
> > > > > > > null, Custom Event ID: -1, Message: Failed to create
> > > > > > > OVF store disk
> > > > > > > for Storage Domain hosted_storage.
> > > > > > > OVF data won't be updated meanwhile for that
domain.
> > > > > > > 2016-08-17 08:43:36,460 INFO
> > > > > > >
[org.ovirt.engine.core.bll.scheduling.HaReservationHand
> > > > > > > ling]
> > > > > > > (DefaultQuartzScheduler7) [5d314e49] HA reservation
> > > > > > > status for
> > > > > > > cluster
> > > > > > > 'Default' is 'OK'
> > > > > > > 2016-08-17 08:43:36,662 INFO
> > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExecution
> > > > > > > Callback]
> > > > > > > (DefaultQuartzScheduler4) [5f5a8daf] Command
> > > > > > > 'ProcessOvfUpdateForStorageDomain' id:
> > > > > > > '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child
commands
> > > > > > > '[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > > > > > > eb2e6f1a-c756-4ccd-85a1-60d97d6880de]' executions
were
> > > > > > > completed,
> > > > > > > status 'FAILED'
> > > > > > > 2016-08-17 08:43:37,691 ERROR
> > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfU
> > > > > > > pdateForStor
> > > > > > > ag
> > > > > > > eDomainCommand]
> > > > > > > (DefaultQuartzScheduler6) [5f5a8daf] Ending command
> > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfU
> > > > > > > pdateForStor
> > > > > > > ag
> > > > > > > eDomainCommand'
> > > > > > > with failure.
> > > > > > >
> > > > > > > Can you please check vdsm logs for that time frame on
> > > > > > > the SPM host?
> > > > > > >
> > > > > >
> > > > > > I sent in attachment the vdsm logs from both hosts, but i
> > > > > > think the
> > > > > > SPM
> > > > > > host on this time frame it was ied-blade13
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > It seams that you also have an issue in the SPM
> > > > > > > election procedure:
> > > > > > >
> > > > > > > 2016-08-17 18:04:31,053 ERROR
> > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData
> > > > > > > ]
> > > > > > > (DefaultQuartzScheduler1) [] SPM Init: could not find
> > > > > > > reported vds
> > > > > > > or
> > > > > > > not up - pool: 'Default' vds_spm_id:
'2'
> > > > > > > 2016-08-17 18:04:31,076 INFO
> > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData
> > > > > > > ]
> > > > > > > (DefaultQuartzScheduler1) [] SPM selection - vds
seems
> > > > > > > as spm
> > > > > > > 'hosted_engine_2'
> > > > > > > 2016-08-17 18:04:31,076 WARN
> > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData
> > > > > > > ]
> > > > > > > (DefaultQuartzScheduler1) [] spm vds is non
responsive,
> > > > > > > stopping
> > > > > > > spm
> > > > > > > selection.
> > > > > > > 2016-08-17 18:04:31,539 INFO
> > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisti
> > > > > > > csFetcher]
> > > > > > > (DefaultQuartzScheduler7) [] Fetched 1 VMs from VDS
> > > > > > > '06372186-572c-41ad-916f-7cbb0aba5302'
> > > > > > >
> > > > > > > probably due to:
> > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitor
> > > > > > > ing]
> > > > > > > (DefaultQuartzScheduler6) [] Failure to refresh Vds
> > > > > > > runtime info:
> > > > > > > VDSGenericException: VDSNetworkException: Message
> > > > > > > timeout which can
> > > > > > > be
> > > > > > > caused by communication issues
> > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonitor
> > > > > > > ing]
> > > > > > > (DefaultQuartzScheduler6) [] Exception:
> > > > > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkExc
> > > > > > > eption:
> > > > > > > VDSGenericException: VDSNetworkException: Message
> > > > > > > timeout which can
> > > > > > > be
> > > > > > > caused by communication issues
> > > > > > >
> > > > > >
> > > > > > This messages maybe cause by connection issues from
> > > > > > yesterday at 6pm.
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > > can you please check if the engine VM could correctly
> > > > > > > resolve and
> > > > > > > reach each host?
> > > > > >
> > > > > > Now i can read engine VM from both hosts
> > > > > >
> > > > > > [root@ied-blade11 ~]# ping ied-hosted-engine
> > > > > > PING ied-hosted-engine.install.eurotux.local
> > > > > > (10.10.4.115) 56(84)
> > > > > > bytes
> > > > > > of data.
> > > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
> > > > > > (10.10.4.115):
> > > > > > icmp_seq=1 ttl=64 time=0.179 ms
> > > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
> > > > > > (10.10.4.115):
> > > > > > icmp_seq=2 ttl=64 time=0.141 ms
> > > > > > ^C
> > > > > > --- ied-hosted-engine.install.eurotux.local ping
> > > > > > statistics ---
> > > > > > 2 packets transmitted, 2 received, 0% packet loss, time
> > > > > > 999ms
> > > > > > rtt min/avg/max/mdev = 0.141/0.160/0.179/0.019 ms
> > > > > > [root@ied-blade13 ~]# ping ied-hosted-engine
> > > > > > PING ied-hosted-engine.install.eurotux.local
> > > > > > (10.10.4.115) 56(84)
> > > > > > bytes
> > > > > > of data.
> > > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
> > > > > > (10.10.4.115):
> > > > > > icmp_seq=1 ttl=64 time=0.172 ms
> > > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
> > > > > > (10.10.4.115):
> > > > > > icmp_seq=2 ttl=64 time=0.169 ms
> > > > > > ^C
> > > > > > --- ied-hosted-engine.install.eurotux.local ping
> > > > > > statistics ---
> > > > > > 2 packets transmitted, 2 received, 0% packet loss, time
> > > > > > 1000ms
> > > > > > rtt min/avg/max/mdev = 0.169/0.170/0.172/0.013 ms
> > > > > >
> > > > > >
> > > > > > I have a message critical of low disk space on
> > > > > > hosted_storage domain.
> > > > > > I have 50G of disk and i created i VM with 40G. Do i need
> > > > > > more space
> > > > > > of
> > > > > > OVF_STORAGE?
> > > > > > What is the minimum requirements of disk space for deploy
> > > > > > engine VM?
> > > > > >
> > > > > > Regards,
> > > > > > Carlos
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Regards,
> > > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Regards,
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > --
> > > > > > > > > > > > > > > > > >
> > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Eurotux Informática, S.A. | w
> > > > > > > > > > > > > > > > > >
> > ww.eurotux.c
> > > > > > > > > > > > > > > > > >
> > om
> > > > > > > > > > > > > > > > > >
> > (t) +351 253 680 300 (m) +351
> > > > > > > > > > > > > > > > > >
> > 911 926 110
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > _____________________________
> > > > > > > > > > > > > > > > > >
> > ____________
> > > > > > > > > > > > > > > > > >
> > __
> > > > > > > > > > > > > > > > > >
> > ____
> > > > > > > > > > > > > > > > > >
> > Users mailing list
> > > > > > > > > > > > > > > > > >
> > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > http://lists.ovirt.org/mailma
> > > > > > > > > > > > > > > > > >
> > n/listinfo/u
> > > > > > > > > > > > > > > > > >
> > se
> > > > > > > > > > > > > > > > > >
> > rs
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
--
> > > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Eurotux Informática, S.A. | www.e
> > > > > > > > > > > > > > > > > >
urotux.com
> > > > > > > > > > > > > > > > > >
(t) +351 253 680 300 (m) +351 911
> > > > > > > > > > > > > > > > > >
926 110
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
_________________________________
> > > > > > > > > > > > > > > > > >
____________
> > > > > > > > > > > > > > > > > >
__
> > > > > > > > > > > > > > > > > >
Users mailing list
> > > > > > > > > > > > > > > > > >
Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
http://lists.ovirt.org/mailman/li
> > > > > > > > > > > > > > > > > >
stinfo/users
> > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurot
> > > > > > > > > > > > > > > > ux.com
> > > > > > > > > > > > > > > > (t) +351
253 680 300 (m) +351 911 926
> > > > > > > > > > > > > > > > 110
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > --
> > > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurotux.c
> > > > > > > > > > > > > > om
> > > > > > > > > > > > > > (t) +351 253 680
300 (m) +351 911 926 110
> > > > > > > > > > > > --
> > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > >
> > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > >
> > > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > (t) +351 253 680 300 (m) +351
911 926 110
> > > > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Carlos Rodrigues
> > > > > > > > > >
> > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > >
> > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > (t) +351 253 680 300 (m) +351 911 926
110
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > --
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > Engenheiro de Software Sénior
> > > > > > > >
> > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > _______________________________________________
> > > > > > Users mailing list
> > > > > > Users(a)ovirt.org
> > > > > > http://lists.ovirt.org/mailman/listinfo/users
> > > > > --
> > > > > Carlos Rodrigues
> > > > >
> > > > > Engenheiro de Software Sénior
> > > > >
> > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > >
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> > >
> > >
> >
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
>
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
1:07 p.m.
On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote:
On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote:
>
>
>
> On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues <cmar(a)eurotux.co
> m>
> wrote:
> >
> > After night, the OVF_STORE it was created:
> >
>
> It's quite strange that it got so long but now it looks fine.
>
> If the ISO_DOMAIN that I see in your screenshot is served by the
> engine VM itself, I suggest to remove it and export from an
> external
> server.
> Serving the ISO storage domain from the engine VM itself is not a
> good idea since when the engine VM is down you can experiment long
> delays before getting the engine VM restarted due to the
> unavailable
> storage domain.
Ok, thank you for advice.
Now, apparently is all ok. I'll do more tests with HA and any issue
i'll tell you.
Thank you for your support.
Regards,
Carlos Rodrigues
I shutdown the network of host with engine VM and i expected that other
host fence the host and start engine VM but i don't see any fence
action and the "free" host keep trying to start VM but get and error of
sanlock
Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm:
sending ioctl 5326 to a partition!
Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm:
sending ioctl 80200204 to a partition!
Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: 1 guest
now active
Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016-
08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 delta 1 9
245502 alive
Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016-
08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error -243
Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016-
08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862 acquire_token
-243 lease owned by other host
Aug 19 11:03:03 ied-blade11.install.eurotux.local libvirtd[1369]:
resource busy: Failed to acquire lock: error -243
Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: ovirtmgmt:
port 2(vnet0) entered disabled state
Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: device vnet0
left promiscuous mode
Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: ovirtmgmt:
port 2(vnet0) entered disabled state
Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: 0 guests
now active
Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd-
machined[7863]: Machine qemu-4-HostedEngine terminated.
>
>
> >
> >
> >
> >
> > Regards,
> > Carlos Rodrigues
> >
> > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote:
> > >
> > >
> > >
> > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues <cmar@eurotux
> > > .c
> > > om> wrote:
> > > >
> > > > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote:
> > > > >
> > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues <cmar@eur
> > > > > ot
> > > > > ux.com> wrote:
> > > > > >
> > > > > >
> > > > > > I increase hosted_engine disk space to 160G. How do i
> > > > > > force
> > > > > > to create
> > > > > > OVF_STORE.
> > > > >
> > > > > I think that restarting the engine on the engine VM will
> > > > > trigger it
> > > > > although I'm not sure that it was a size issue.
> > > > >
> > > >
> > > > I found to OVF_STORE on another storage domain with "Domain
> > > > Type" "Data (Master)"
> > > >
> > > >
> > >
> > > Each storage domain has its own OVF_STORE volumes; you should
> > > get
> > > them also on the hosted-engine storage domain.
> > > Not really sure about how to trigger it again; adding Roy here.
> > >
> > >
> > >
> > >
> > > >
> > > >
> > > >
> > > >
> > > > >
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues
> > > > > > wrote:
> > > > > > >
> > > > > > >
> > > > > > > On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Aug 18, 2016 at 12:11 PM, Carlos
Rodrigues
> > > > > > > > <cma
> > > > > > > > r(a)eurotux.co
> > > > > > > > m>
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, 2016-08-18 at 11:53 +0200, Simone
> > > > > > > > > Tiraboschi
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, Aug 18, 2016 at 11:50 AM,
Carlos
> > > > > > > > > > Rodrigues
> > > > > > > > > > <cmar@eurotu
> > > > > > > > > > x.
> > > > > > > > > > com>
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Thu, 2016-08-18 at 11:42 +0200,
Simone
> > > > > > > > > > > Tiraboschi wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, Aug 18, 2016 at 11:25
AM, Carlos
> > > > > > > > > > > > Rodrigues <cmar@eu
> > > > > > > > > > > > ro
> > > > > > > > > > > > tux.
> > > > > > > > > > > > com> wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, 2016-08-18 at
11:04 +0200, Simone
> > > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Thu, Aug 18,
2016 at 10:36 AM, Carlos
> > > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > > <cmar@
> > > > > > > > > > > > > > euro
> > > > > > > > > > > > > > tux.com>
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Thu,
2016-08-18 at 10:27 +0200,
> > > > > > > > > > > > > > > Simone
> > > > > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Thu,
Aug 18, 2016 at 10:22 AM,
> > > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > > >
<cmar@
> > > > > > > > > > > > > > > > eurotux.
> > > > > > > > > > > > > > > > com>
> > > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On
Thu, 2016-08-18 at 08:54 +0200,
> > > > > > > > > > > > > > > > >
Simone
> > > > > > > > > > > > > > > > >
Tiraboschi
> > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
On Tue, Aug 16, 2016 at 12:53 PM,
> > > > > > > > > > > > > > > > > >
Carlos
> > > > > > > > > > > > > > > > > >
Rodrigues <c
> > > > > > > > > > > > > > > > > >
mar@euro
> > > > > > > > > > > > > > > > > >
tux.
> > > > > > > > > > > > > > > > > >
com>
> > > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> On Sun, 2016-08-14 at 14:22
> > > > > > > > > > > > > > > > > >
> +0300, Roy Golan
> > > > > > > > > > > > > > > > > >
> wrote:
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > On 12 August 2016 at 20:23,
> > > > > > > > > > > > > > > > > >
> > Carlos
> > > > > > > > > > > > > > > > > >
> > Rodrigues
> > > > > > > > > > > > > > > > > >
> > <cma
> > > > > > > > > > > > > > > > > >
> > r@eurotu
> > > > > > > > > > > > > > > > > >
> > x.co
> > > > > > > > > > > > > > > > > >
> > m>
> > > > > > > > > > > > > > > > > >
> > wrote:
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > Hello,
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > I have one cluster with two
> > > > > > > > > > > > > > > > > >
> > > hosts with
> > > > > > > > > > > > > > > > > >
> > > power
> > > > > > > > > > > > > > > > > >
> > > management
> > > > > > > > > > > > > > > > > >
> > > correctly
> > > > > > > > > > > > > > > > > >
> > > configured and one virtual
> > > > > > > > > > > > > > > > > >
> > > machine with
> > > > > > > > > > > > > > > > > >
> > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > over
> > > > > > > > > > > > > > > > > >
> > > shared
> > > > > > > > > > > > > > > > > >
> > > storage with FiberChannel.
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > When i shutdown the network
> > > > > > > > > > > > > > > > > >
> > > of host with
> > > > > > > > > > > > > > > > > >
> > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > VM, it
> > > > > > > > > > > > > > > > > >
> > > should be
> > > > > > > > > > > > > > > > > >
> > > possible the HostedEngine
> > > > > > > > > > > > > > > > > >
> > > VM
> > > > > > > > > > > > > > > > > >
> > > migrate
> > > > > > > > > > > > > > > > > >
> > > automatically to
> > > > > > > > > > > > > > > > > >
> > > another
> > > > > > > > > > > > > > > > > >
> > > host?
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > migrate on which network?
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > What is the expected
> > > > > > > > > > > > > > > > > >
> > > behaviour on this HA
> > > > > > > > > > > > > > > > > >
> > > scenario?
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > After a few minutes your vm
> > > > > > > > > > > > > > > > > >
> > will be
> > > > > > > > > > > > > > > > > >
> > shutdown
> > > > > > > > > > > > > > > > > >
> > by
> > > > > > > > > > > > > > > > > >
> > the High
> > > > > > > > > > > > > > > > > >
> > Availability
> > > > > > > > > > > > > > > > > >
> > agent, as it can't see
> > > > > > > > > > > > > > > > > >
> > network,
> > > > > > > > > > > > > > > > > >
> > and started
> > > > > > > > > > > > > > > > > >
> > on
> > > > > > > > > > > > > > > > > >
> > another
> > > > > > > > > > > > > > > > > >
> > host.
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> I'm testing this scenario and
> > > > > > > > > > > > > > > > > >
> after shutdown
> > > > > > > > > > > > > > > > > >
> network, it
> > > > > > > > > > > > > > > > > >
> should
> > > > > > > > > > > > > > > > > >
> be
> > > > > > > > > > > > > > > > > >
> expected that agent shutdown ha
> > > > > > > > > > > > > > > > > >
> and started
> > > > > > > > > > > > > > > > > >
> on
> > > > > > > > > > > > > > > > > >
> another
> > > > > > > > > > > > > > > > > >
> host,
> > > > > > > > > > > > > > > > > >
> but
> > > > > > > > > > > > > > > > > >
> after
> > > > > > > > > > > > > > > > > >
> couple minutes nothing happens
> > > > > > > > > > > > > > > > > >
> and on host
> > > > > > > > > > > > > > > > > >
> with
> > > > > > > > > > > > > > > > > >
> network we
> > > > > > > > > > > > > > > > > >
> getting
> > > > > > > > > > > > > > > > > >
> the
> > > > > > > > > > > > > > > > > >
> following messages:
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Aug 16 11:44:08 ied-
> > > > > > > > > > > > > > > > > >
> blade11.install.eurotux.local
> > > > > > > > > > > > > > > > > >
> ovirt-ha-
> > > > > > > > > > > > > > > > > >
> agent[2779]:
> > > > > > > > > > > > > > > > > >
> ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
> ovirt_hosted_engine_ha.agent.ho
> > > > > > > > > > > > > > > > > >
> st
> > > > > > > > > > > > > > > > > >
> ed_engine.Ho
> > > > > > > > > > > > > > > > > >
> st
> > > > > > > > > > > > > > > > > >
> edEn
> > > > > > > > > > > > > > > > > >
> gine.con
> > > > > > > > > > > > > > > > > >
> fig
> > > > > > > > > > > > > > > > > >
> ERROR
> > > > > > > > > > > > > > > > > >
> Unable to get vm.conf from
> > > > > > > > > > > > > > > > > >
> OVF_STORE, falling
> > > > > > > > > > > > > > > > > >
> back
> > > > > > > > > > > > > > > > > >
> to
> > > > > > > > > > > > > > > > > >
> initial
> > > > > > > > > > > > > > > > > >
> vm.conf
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> I think the HA agent its trying
> > > > > > > > > > > > > > > > > >
> to get vm
> > > > > > > > > > > > > > > > > >
> configuration but
> > > > > > > > > > > > > > > > > >
> some
> > > > > > > > > > > > > > > > > >
> how it
> > > > > > > > > > > > > > > > > >
> can't get vm.conf to start VM.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
No, this is a different issues.
> > > > > > > > > > > > > > > > > >
In 3.6 we added a feature to let
> > > > > > > > > > > > > > > > > >
the engine
> > > > > > > > > > > > > > > > > >
manage
> > > > > > > > > > > > > > > > > >
also the
> > > > > > > > > > > > > > > > > >
engine VM
> > > > > > > > > > > > > > > > > >
itself; ovirt-ha-agent will
> > > > > > > > > > > > > > > > > >
pickup
> > > > > > > > > > > > > > > > > >
the latest
> > > > > > > > > > > > > > > > > >
engine
> > > > > > > > > > > > > > > > > >
VM
> > > > > > > > > > > > > > > > > >
configuration
> > > > > > > > > > > > > > > > > >
from the OVF_STORE which is
> > > > > > > > > > > > > > > > > >
managed
> > > > > > > > > > > > > > > > > >
by the
> > > > > > > > > > > > > > > > > >
engine.
> > > > > > > > > > > > > > > > > >
If something goes wrong, ovirt-
> > > > > > > > > > > > > > > > > >
ha-
> > > > > > > > > > > > > > > > > >
agent could
> > > > > > > > > > > > > > > > > >
fallback to the
> > > > > > > > > > > > > > > > > >
initial
> > > > > > > > > > > > > > > > > >
(bootstrap time) vm.conf. This
> > > > > > > > > > > > > > > > > >
will
> > > > > > > > > > > > > > > > > >
normally
> > > > > > > > > > > > > > > > > >
happen
> > > > > > > > > > > > > > > > > >
till you
> > > > > > > > > > > > > > > > > >
add
> > > > > > > > > > > > > > > > > >
your
> > > > > > > > > > > > > > > > > >
first regular storage domain and
> > > > > > > > > > > > > > > > > >
the engine
> > > > > > > > > > > > > > > > > >
imports
> > > > > > > > > > > > > > > > > >
the
> > > > > > > > > > > > > > > > > >
engine
> > > > > > > > > > > > > > > > > >
VM.
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > But
i already have my first storage
> > > > > > > > > > > > > > > > >
domain and
> > > > > > > > > > > > > > > > >
storage
> > > > > > > > > > > > > > > > >
engine
> > > > > > > > > > > > > > > > >
domain
> > > > > > > > > > > > > > > > > and
already imported engine VM.
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
I'm using 4.0 version.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > This
seams an issue, can you please
> > > > > > > > > > > > > > > > share
your
> > > > > > > > > > > > > > > >
/var/log/ovirt-hosted-engine-
> > > > > > > > > > > > > > > >
ha/agent.log ?
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > I sent it in
attachment.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Nothing strange
here;
> > > > > > > > > > > > > > do you see a couple
of disks with alias
> > > > > > > > > > > > > > OVF_STORE on
> > > > > > > > > > > > > > the
> > > > > > > > > > > > > > hosted-
> > > > > > > > > > > > > > engine
> > > > > > > > > > > > > > storage domain if
you check it from the
> > > > > > > > > > > > > > engine?
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Do you mean any disk
label?
> > > > > > > > > > > > > I don't have it
anyone:
> > > > > > > > > > > > >
> > > > > > > > > > > > > [root@ied-blade11
~]# ls /dev/disk/by-
> > > > > > > > > > > > > label/
> > > > > > > > > > > > > ls: cannot access
/dev/disk/by-label/: No
> > > > > > > > > > > > > such file or
> > > > > > > > > > > > > directory
> > > > > > > > > > > >
> > > > > > > > > > > > No I mean: go to the engine
web-ui, select
> > > > > > > > > > > > the
> > > > > > > > > > > > hosted-
> > > > > > > > > > > > engine
> > > > > > > > > > > > storage
> > > > > > > > > > > > domain, check the disks
there.
> > > > > > > > > > >
> > > > > > > > > > > No, the alias is virtio-disk0.
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > And this is the engine VM disk, so the
issue is
> > > > > > > > > > why
> > > > > > > > > > the engine
> > > > > > > > > > has
> > > > > > > > > > still to create the OVF_STORE.
> > > > > > > > > > Can you please share your engine.log
from the
> > > > > > > > > > engine VM?
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Go in attachment.
> > > > > > > >
> > > > > > > > The creation of the OVF_STORE disk failed but
it's
> > > > > > > > not
> > > > > > > > that clear
> > > > > > > > why:
> > > > > > > >
> > > > > > > > 2016-08-17 08:43:33,538 ERROR
> > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvf
> > > > > > > > Vo
> > > > > > > > lumeForStora
> > > > > > > > ge
> > > > > > > > DomainCommand]
> > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Ending
command
> > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvf
> > > > > > > > Vo
> > > > > > > > lumeForStora
> > > > > > > > ge
> > > > > > > > DomainCommand'
> > > > > > > > with failure.
> > > > > > > > 2016-08-17 08:43:33,540 ERROR
> > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > d]
> > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Ending
command
> > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > d'
> > > > > > > > with
> > > > > > > > failure.
> > > > > > > > 2016-08-17 08:43:33,541 WARN
> > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > d]
> > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4]
> > > > > > > > VmCommand::EndVmCommand: Vm is
> > > > > > > > null - not performing endAction on Vm
> > > > > > > > 2016-08-17 08:43:33,553 ERROR
> > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.
> > > > > > > > Au
> > > > > > > > ditLogDirect
> > > > > > > > or
> > > > > > > > ]
> > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Correlation
ID:
> > > > > > > > 6f1f1fd4, Call
> > > > > > > > Stack: null, Custom Event ID: -1, Message:
Add-Disk
> > > > > > > > operation
> > > > > > > > failed
> > > > > > > > to complete.
> > > > > > > > 2016-08-17 08:43:33,557 WARN
> > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.
> > > > > > > > Au
> > > > > > > > ditLogDirect
> > > > > > > > or
> > > > > > > > ]
> > > > > > > > (DefaultQuartzScheduler6) [] Correlation ID:
> > > > > > > > 19ac5bda,
> > > > > > > > Call Stack:
> > > > > > > > null, Custom Event ID: -1, Message: Failed to
create
> > > > > > > > OVF store disk
> > > > > > > > for Storage Domain hosted_storage.
> > > > > > > > OVF data won't be updated meanwhile for that
domain.
> > > > > > > > 2016-08-17 08:43:33,585 INFO
> > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExecuti
> > > > > > > > on
> > > > > > > > Callback]
> > > > > > > > (DefaultQuartzScheduler6) [5f5a8daf] Command
> > > > > > > > 'ProcessOvfUpdateForStorageDomain' (id:
> > > > > > > > '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0')
waiting on
> > > > > > > > child command
> > > > > > > > id:
> > > > > > > > 'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > > > > > > > type:'CreateOvfVolumeForStorageDomain' to
complete
> > > > > > > > 2016-08-17 08:43:33,595 ERROR
> > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvf
> > > > > > > > Vo
> > > > > > > > lumeForStora
> > > > > > > > ge
> > > > > > > > DomainCommand]
> > > > > > > > (DefaultQuartzScheduler6) [5d314e49] Ending
command
> > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvf
> > > > > > > > Vo
> > > > > > > > lumeForStora
> > > > > > > > ge
> > > > > > > > DomainCommand'
> > > > > > > > with failure.
> > > > > > > > 2016-08-17 08:43:33,596 ERROR
> > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > d]
> > > > > > > > (DefaultQuartzScheduler6) [5d314e49] Ending
command
> > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > d'
> > > > > > > > with
> > > > > > > > failure.
> > > > > > > > 2016-08-17 08:43:33,596 WARN
> > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > d]
> > > > > > > > (DefaultQuartzScheduler6) [5d314e49]
> > > > > > > > VmCommand::EndVmCommand: Vm is
> > > > > > > > null - not performing endAction on Vm
> > > > > > > > 2016-08-17 08:43:33,602 ERROR
> > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.
> > > > > > > > Au
> > > > > > > > ditLogDirect
> > > > > > > > or
> > > > > > > > ]
> > > > > > > > (DefaultQuartzScheduler6) [5d314e49] Correlation
ID:
> > > > > > > > 5d314e49, Call
> > > > > > > > Stack: null, Custom Event ID: -1, Message:
Add-Disk
> > > > > > > > operation
> > > > > > > > failed
> > > > > > > > to complete.
> > > > > > > > 2016-08-17 08:43:33,605 WARN
> > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.
> > > > > > > > Au
> > > > > > > > ditLogDirect
> > > > > > > > or
> > > > > > > > ]
> > > > > > > > (DefaultQuartzScheduler6) [] Correlation ID:
> > > > > > > > 5f5a8daf,
> > > > > > > > Call Stack:
> > > > > > > > null, Custom Event ID: -1, Message: Failed to
create
> > > > > > > > OVF store disk
> > > > > > > > for Storage Domain hosted_storage.
> > > > > > > > OVF data won't be updated meanwhile for that
domain.
> > > > > > > > 2016-08-17 08:43:36,460 INFO
> > > > > > > >
[org.ovirt.engine.core.bll.scheduling.HaReservationHa
> > > > > > > > nd
> > > > > > > > ling]
> > > > > > > > (DefaultQuartzScheduler7) [5d314e49] HA
reservation
> > > > > > > > status for
> > > > > > > > cluster
> > > > > > > > 'Default' is 'OK'
> > > > > > > > 2016-08-17 08:43:36,662 INFO
> > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExecuti
> > > > > > > > on
> > > > > > > > Callback]
> > > > > > > > (DefaultQuartzScheduler4) [5f5a8daf] Command
> > > > > > > > 'ProcessOvfUpdateForStorageDomain' id:
> > > > > > > > '71aaaafe-7b9e-45e8-a40c-6d33bdf646a0'
child commands
> > > > > > > > '[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > > > > > > > eb2e6f1a-c756-4ccd-85a1-60d97d6880de]'
executions
> > > > > > > > were
> > > > > > > > completed,
> > > > > > > > status 'FAILED'
> > > > > > > > 2016-08-17 08:43:37,691 ERROR
> > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.ProcessOv
> > > > > > > > fU
> > > > > > > > pdateForStor
> > > > > > > > ag
> > > > > > > > eDomainCommand]
> > > > > > > > (DefaultQuartzScheduler6) [5f5a8daf] Ending
command
> > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOv
> > > > > > > > fU
> > > > > > > > pdateForStor
> > > > > > > > ag
> > > > > > > > eDomainCommand'
> > > > > > > > with failure.
> > > > > > > >
> > > > > > > > Can you please check vdsm logs for that time
frame on
> > > > > > > > the SPM host?
> > > > > > > >
> > > > > > >
> > > > > > > I sent in attachment the vdsm logs from both hosts,
but
> > > > > > > i
> > > > > > > think the
> > > > > > > SPM
> > > > > > > host on this time frame it was ied-blade13
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > It seams that you also have an issue in the SPM
> > > > > > > > election procedure:
> > > > > > > >
> > > > > > > > 2016-08-17 18:04:31,053 ERROR
> > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyDa
> > > > > > > > ta
> > > > > > > > ]
> > > > > > > > (DefaultQuartzScheduler1) [] SPM Init: could not
find
> > > > > > > > reported vds
> > > > > > > > or
> > > > > > > > not up - pool: 'Default' vds_spm_id:
'2'
> > > > > > > > 2016-08-17 18:04:31,076 INFO
> > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyDa
> > > > > > > > ta
> > > > > > > > ]
> > > > > > > > (DefaultQuartzScheduler1) [] SPM selection - vds
> > > > > > > > seems
> > > > > > > > as spm
> > > > > > > > 'hosted_engine_2'
> > > > > > > > 2016-08-17 18:04:31,076 WARN
> > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyDa
> > > > > > > > ta
> > > > > > > > ]
> > > > > > > > (DefaultQuartzScheduler1) [] spm vds is non
> > > > > > > > responsive,
> > > > > > > > stopping
> > > > > > > > spm
> > > > > > > > selection.
> > > > > > > > 2016-08-17 18:04:31,539 INFO
> > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatis
> > > > > > > > ti
> > > > > > > > csFetcher]
> > > > > > > > (DefaultQuartzScheduler7) [] Fetched 1 VMs from
VDS
> > > > > > > > '06372186-572c-41ad-916f-7cbb0aba5302'
> > > > > > > >
> > > > > > > > probably due to:
> > > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonit
> > > > > > > > or
> > > > > > > > ing]
> > > > > > > > (DefaultQuartzScheduler6) [] Failure to refresh
Vds
> > > > > > > > runtime info:
> > > > > > > > VDSGenericException: VDSNetworkException:
Message
> > > > > > > > timeout which can
> > > > > > > > be
> > > > > > > > caused by communication issues
> > > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonit
> > > > > > > > or
> > > > > > > > ing]
> > > > > > > > (DefaultQuartzScheduler6) [] Exception:
> > > > > > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkE
> > > > > > > > xc
> > > > > > > > eption:
> > > > > > > > VDSGenericException: VDSNetworkException:
Message
> > > > > > > > timeout which can
> > > > > > > > be
> > > > > > > > caused by communication issues
> > > > > > > >
> > > > > > >
> > > > > > > This messages maybe cause by connection issues from
> > > > > > > yesterday at 6pm.
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > can you please check if the engine VM could
correctly
> > > > > > > > resolve and
> > > > > > > > reach each host?
> > > > > > >
> > > > > > > Now i can read engine VM from both hosts
> > > > > > >
> > > > > > > [root@ied-blade11 ~]# ping ied-hosted-engine
> > > > > > > PING ied-hosted-engine.install.eurotux.local
> > > > > > > (10.10.4.115) 56(84)
> > > > > > > bytes
> > > > > > > of data.
> > > > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
> > > > > > > (10.10.4.115):
> > > > > > > icmp_seq=1 ttl=64 time=0.179 ms
> > > > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
> > > > > > > (10.10.4.115):
> > > > > > > icmp_seq=2 ttl=64 time=0.141 ms
> > > > > > > ^C
> > > > > > > --- ied-hosted-engine.install.eurotux.local ping
> > > > > > > statistics ---
> > > > > > > 2 packets transmitted, 2 received, 0% packet loss,
time
> > > > > > > 999ms
> > > > > > > rtt min/avg/max/mdev = 0.141/0.160/0.179/0.019 ms
> > > > > > > [root@ied-blade13 ~]# ping ied-hosted-engine
> > > > > > > PING ied-hosted-engine.install.eurotux.local
> > > > > > > (10.10.4.115) 56(84)
> > > > > > > bytes
> > > > > > > of data.
> > > > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
> > > > > > > (10.10.4.115):
> > > > > > > icmp_seq=1 ttl=64 time=0.172 ms
> > > > > > > 64 bytes from ied-hosted-engine.install.eurotux.local
> > > > > > > (10.10.4.115):
> > > > > > > icmp_seq=2 ttl=64 time=0.169 ms
> > > > > > > ^C
> > > > > > > --- ied-hosted-engine.install.eurotux.local ping
> > > > > > > statistics ---
> > > > > > > 2 packets transmitted, 2 received, 0% packet loss,
time
> > > > > > > 1000ms
> > > > > > > rtt min/avg/max/mdev = 0.169/0.170/0.172/0.013 ms
> > > > > > >
> > > > > > >
> > > > > > > I have a message critical of low disk space on
> > > > > > > hosted_storage domain.
> > > > > > > I have 50G of disk and i created i VM with 40G. Do i
> > > > > > > need
> > > > > > > more space
> > > > > > > of
> > > > > > > OVF_STORAGE?
> > > > > > > What is the minimum requirements of disk space for
> > > > > > > deploy
> > > > > > > engine VM?
> > > > > > >
> > > > > > > Regards,
> > > > > > > Carlos
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Regards,
> > > > > > > > > > > > > > > > > >
> Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > Regards,
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > --
> > > > > > > > > > > > > > > > > >
> > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > Engenheiro de Software
> > > > > > > > > > > > > > > > > >
> > > Sénior
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > Eurotux Informática, S.A. |
> > > > > > > > > > > > > > > > > >
> > > w
> > > > > > > > > > > > > > > > > >
> > > ww.eurotux.c
> > > > > > > > > > > > > > > > > >
> > > om
> > > > > > > > > > > > > > > > > >
> > > (t) +351 253 680 300 (m)
> > > > > > > > > > > > > > > > > >
> > > +351
> > > > > > > > > > > > > > > > > >
> > > 911 926 110
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > ___________________________
> > > > > > > > > > > > > > > > > >
> > > __
> > > > > > > > > > > > > > > > > >
> > > ____________
> > > > > > > > > > > > > > > > > >
> > > __
> > > > > > > > > > > > > > > > > >
> > > ____
> > > > > > > > > > > > > > > > > >
> > > Users mailing list
> > > > > > > > > > > > > > > > > >
> > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > http://lists.ovirt.org/mail
> > > > > > > > > > > > > > > > > >
> > > ma
> > > > > > > > > > > > > > > > > >
> > > n/listinfo/u
> > > > > > > > > > > > > > > > > >
> > > se
> > > > > > > > > > > > > > > > > >
> > > rs
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> --
> > > > > > > > > > > > > > > > > >
> Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Eurotux Informática, S.A. |
> > > > > > > > > > > > > > > > > >
> www.e
> > > > > > > > > > > > > > > > > >
> urotux.com
> > > > > > > > > > > > > > > > > >
> (t) +351 253 680 300 (m) +351
> > > > > > > > > > > > > > > > > >
> 911
> > > > > > > > > > > > > > > > > >
> 926 110
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> _______________________________
> > > > > > > > > > > > > > > > > >
> __
> > > > > > > > > > > > > > > > > >
> ____________
> > > > > > > > > > > > > > > > > >
> __
> > > > > > > > > > > > > > > > > >
> Users mailing list
> > > > > > > > > > > > > > > > > >
> Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> http://lists.ovirt.org/mailman/
> > > > > > > > > > > > > > > > > >
> li
> > > > > > > > > > > > > > > > > >
> stinfo/users
> > > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
Eurotux Informática, S.A. | www.eur
> > > > > > > > > > > > > > > > > ot
> > > > > > > > > > > > > > > > >
ux.com
> > > > > > > > > > > > > > > > > (t)
+351 253 680 300 (m) +351 911
> > > > > > > > > > > > > > > > > 926
> > > > > > > > > > > > > > > > > 110
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurotux
> > > > > > > > > > > > > > > .c
> > > > > > > > > > > > > > > om
> > > > > > > > > > > > > > > (t) +351 253
680 300 (m) +351 911 926
> > > > > > > > > > > > > > > 110
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > >
> > > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > > >
> > > > > > > > > > > > > Eurotux Informática,
S.A. | www.eurotux.com
> > > > > > > > > > > > > (t) +351 253 680 300 (m)
+351 911 926 110
> > > > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > >
> > > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > > >
> > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > (t) +351 253 680 300 (m) +351 911
926 110
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Carlos Rodrigues
> > > > > > > > >
> > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > >
> > > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > _______________________________________________
> > > > > > > Users mailing list
> > > > > > > Users(a)ovirt.org
> > > > > > > http://lists.ovirt.org/mailman/listinfo/users
> > > > > > --
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > Engenheiro de Software Sénior
> > > > > >
> > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > >
> > > > --
> > > > Carlos Rodrigues
> > > >
> > > > Engenheiro de Software Sénior
> > > >
> > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > >
> > > >
> > >
> > --
> > Carlos Rodrigues
> >
> > Engenheiro de Software Sénior
> >
> > Eurotux Informática, S.A. | www.eurotux.com
> > (t) +351 253 680 300 (m) +351 911 926 110
> >
> >
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
1:24 p.m.
On Fri, Aug 19, 2016 at 12:07 PM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote:
> On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote:
> >
> >
> >
> > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues <cmar(a)eurotux.co
> > m>
> > wrote:
> > >
> > > After night, the OVF_STORE it was created:
> > >
> >
> > It's quite strange that it got so long but now it looks fine.
> >
> > If the ISO_DOMAIN that I see in your screenshot is served by the
> > engine VM itself, I suggest to remove it and export from an
> > external
> > server.
> > Serving the ISO storage domain from the engine VM itself is not a
> > good idea since when the engine VM is down you can experiment long
> > delays before getting the engine VM restarted due to the
> > unavailable
> > storage domain.
>
> Ok, thank you for advice.
>
> Now, apparently is all ok. I'll do more tests with HA and any issue
> i'll tell you.
>
> Thank you for your support.
>
> Regards,
> Carlos Rodrigues
>
I shutdown the network of host with engine VM and i expected that other
host fence the host and start engine VM but i don't see any fence
action and the "free" host keep trying to start VM but get and error of
sanlock
Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm:
sending ioctl 5326 to a partition!
Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm:
sending ioctl 80200204 to a partition!
Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: 1 guest
now active
Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016-
08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 delta 1 9
245502 alive
Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016-
08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error -243
Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016-
08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862 acquire_token
-243 lease owned by other host
Aug 19 11:03:03 ied-blade11.install.eurotux.local libvirtd[1369]:
resource busy: Failed to acquire lock: error -243
Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: ovirtmgmt:
port 2(vnet0) entered disabled state
Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: device vnet0
left promiscuous mode
Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: ovirtmgmt:
port 2(vnet0) entered disabled state
Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: 0 guests
now active
Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd-
machined[7863]: Machine qemu-4-HostedEngine terminated.
Maybe you hit this one:
https://bugzilla.redhat.com/show_bug.cgi?id=1322849
Can you please check it as described in comment 28 and eventually
apply the workaround in comment 18?
> > > Regards,
> > > Carlos Rodrigues
> > >
> > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote:
> > > >
> > > >
> > > >
> > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues <cmar@eurotux
> > > > .c
> > > > om> wrote:
> > > > >
> > > > > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote:
> > > > > >
> > > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues
<cmar@eur
> > > > > > ot
> > > > > > ux.com> wrote:
> > > > > > >
> > > > > > >
> > > > > > > I increase hosted_engine disk space to 160G. How do i
> > > > > > > force
> > > > > > > to create
> > > > > > > OVF_STORE.
> > > > > >
> > > > > > I think that restarting the engine on the engine VM will
> > > > > > trigger it
> > > > > > although I'm not sure that it was a size issue.
> > > > > >
> > > > >
> > > > > I found to OVF_STORE on another storage domain with "Domain
> > > > > Type" "Data (Master)"
> > > > >
> > > > >
> > > >
> > > > Each storage domain has its own OVF_STORE volumes; you should
> > > > get
> > > > them also on the hosted-engine storage domain.
> > > > Not really sure about how to trigger it again; adding Roy here.
> > > >
> > > >
> > > >
> > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Regards,
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > > On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, 2016-08-18 at 12:34 +0200, Simone
Tiraboschi
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Aug 18, 2016 at 12:11 PM, Carlos
Rodrigues
> > > > > > > > > <cma
> > > > > > > > > r(a)eurotux.co
> > > > > > > > > m>
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, 2016-08-18 at 11:53 +0200,
Simone
> > > > > > > > > > Tiraboschi
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Thu, Aug 18, 2016 at 11:50 AM,
Carlos
> > > > > > > > > > > Rodrigues
> > > > > > > > > > > <cmar@eurotu
> > > > > > > > > > > x.
> > > > > > > > > > > com>
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, 2016-08-18 at 11:42
+0200, Simone
> > > > > > > > > > > > Tiraboschi wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, Aug 18, 2016 at
11:25 AM, Carlos
> > > > > > > > > > > > > Rodrigues <cmar@eu
> > > > > > > > > > > > > ro
> > > > > > > > > > > > > tux.
> > > > > > > > > > > > > com> wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Thu, 2016-08-18
at 11:04 +0200, Simone
> > > > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Thu, Aug 18,
2016 at 10:36 AM, Carlos
> > > > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > > > <cmar@
> > > > > > > > > > > > > > > euro
> > > > > > > > > > > > > > > tux.com>
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Thu,
2016-08-18 at 10:27 +0200,
> > > > > > > > > > > > > > > > Simone
> > > > > > > > > > > > > > > >
Tiraboschi
> > > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On
Thu, Aug 18, 2016 at 10:22 AM,
> > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > >
<cmar@
> > > > > > > > > > > > > > > > >
eurotux.
> > > > > > > > > > > > > > > > >
com>
> > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
On Thu, 2016-08-18 at 08:54 +0200,
> > > > > > > > > > > > > > > > > >
Simone
> > > > > > > > > > > > > > > > > >
Tiraboschi
> > > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> On Tue, Aug 16, 2016 at 12:53 PM,
> > > > > > > > > > > > > > > > > >
> Carlos
> > > > > > > > > > > > > > > > > >
> Rodrigues <c
> > > > > > > > > > > > > > > > > >
> mar@euro
> > > > > > > > > > > > > > > > > >
> tux.
> > > > > > > > > > > > > > > > > >
> com>
> > > > > > > > > > > > > > > > > >
> wrote:
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > On Sun, 2016-08-14 at 14:22
> > > > > > > > > > > > > > > > > >
> > +0300, Roy Golan
> > > > > > > > > > > > > > > > > >
> > wrote:
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > On 12 August 2016 at 20:23,
> > > > > > > > > > > > > > > > > >
> > > Carlos
> > > > > > > > > > > > > > > > > >
> > > Rodrigues
> > > > > > > > > > > > > > > > > >
> > > <cma
> > > > > > > > > > > > > > > > > >
> > > r@eurotu
> > > > > > > > > > > > > > > > > >
> > > x.co
> > > > > > > > > > > > > > > > > >
> > > m>
> > > > > > > > > > > > > > > > > >
> > > wrote:
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > Hello,
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > I have one cluster with two
> > > > > > > > > > > > > > > > > >
> > > > hosts with
> > > > > > > > > > > > > > > > > >
> > > > power
> > > > > > > > > > > > > > > > > >
> > > > management
> > > > > > > > > > > > > > > > > >
> > > > correctly
> > > > > > > > > > > > > > > > > >
> > > > configured and one virtual
> > > > > > > > > > > > > > > > > >
> > > > machine with
> > > > > > > > > > > > > > > > > >
> > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > over
> > > > > > > > > > > > > > > > > >
> > > > shared
> > > > > > > > > > > > > > > > > >
> > > > storage with FiberChannel.
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > When i shutdown the network
> > > > > > > > > > > > > > > > > >
> > > > of host with
> > > > > > > > > > > > > > > > > >
> > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > VM, it
> > > > > > > > > > > > > > > > > >
> > > > should be
> > > > > > > > > > > > > > > > > >
> > > > possible the HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > VM
> > > > > > > > > > > > > > > > > >
> > > > migrate
> > > > > > > > > > > > > > > > > >
> > > > automatically to
> > > > > > > > > > > > > > > > > >
> > > > another
> > > > > > > > > > > > > > > > > >
> > > > host?
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > migrate on which network?
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > What is the expected
> > > > > > > > > > > > > > > > > >
> > > > behaviour on this HA
> > > > > > > > > > > > > > > > > >
> > > > scenario?
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > After a few minutes your vm
> > > > > > > > > > > > > > > > > >
> > > will be
> > > > > > > > > > > > > > > > > >
> > > shutdown
> > > > > > > > > > > > > > > > > >
> > > by
> > > > > > > > > > > > > > > > > >
> > > the High
> > > > > > > > > > > > > > > > > >
> > > Availability
> > > > > > > > > > > > > > > > > >
> > > agent, as it can't see
> > > > > > > > > > > > > > > > > >
> > > network,
> > > > > > > > > > > > > > > > > >
> > > and started
> > > > > > > > > > > > > > > > > >
> > > on
> > > > > > > > > > > > > > > > > >
> > > another
> > > > > > > > > > > > > > > > > >
> > > host.
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > I'm testing this scenario and
> > > > > > > > > > > > > > > > > >
> > after shutdown
> > > > > > > > > > > > > > > > > >
> > network, it
> > > > > > > > > > > > > > > > > >
> > should
> > > > > > > > > > > > > > > > > >
> > be
> > > > > > > > > > > > > > > > > >
> > expected that agent shutdown ha
> > > > > > > > > > > > > > > > > >
> > and started
> > > > > > > > > > > > > > > > > >
> > on
> > > > > > > > > > > > > > > > > >
> > another
> > > > > > > > > > > > > > > > > >
> > host,
> > > > > > > > > > > > > > > > > >
> > but
> > > > > > > > > > > > > > > > > >
> > after
> > > > > > > > > > > > > > > > > >
> > couple minutes nothing happens
> > > > > > > > > > > > > > > > > >
> > and on host
> > > > > > > > > > > > > > > > > >
> > with
> > > > > > > > > > > > > > > > > >
> > network we
> > > > > > > > > > > > > > > > > >
> > getting
> > > > > > > > > > > > > > > > > >
> > the
> > > > > > > > > > > > > > > > > >
> > following messages:
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Aug 16 11:44:08 ied-
> > > > > > > > > > > > > > > > > >
> > blade11.install.eurotux.local
> > > > > > > > > > > > > > > > > >
> > ovirt-ha-
> > > > > > > > > > > > > > > > > >
> > agent[2779]:
> > > > > > > > > > > > > > > > > >
> > ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
> > ovirt_hosted_engine_ha.agent.ho
> > > > > > > > > > > > > > > > > >
> > st
> > > > > > > > > > > > > > > > > >
> > ed_engine.Ho
> > > > > > > > > > > > > > > > > >
> > st
> > > > > > > > > > > > > > > > > >
> > edEn
> > > > > > > > > > > > > > > > > >
> > gine.con
> > > > > > > > > > > > > > > > > >
> > fig
> > > > > > > > > > > > > > > > > >
> > ERROR
> > > > > > > > > > > > > > > > > >
> > Unable to get vm.conf from
> > > > > > > > > > > > > > > > > >
> > OVF_STORE, falling
> > > > > > > > > > > > > > > > > >
> > back
> > > > > > > > > > > > > > > > > >
> > to
> > > > > > > > > > > > > > > > > >
> > initial
> > > > > > > > > > > > > > > > > >
> > vm.conf
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > I think the HA agent its trying
> > > > > > > > > > > > > > > > > >
> > to get vm
> > > > > > > > > > > > > > > > > >
> > configuration but
> > > > > > > > > > > > > > > > > >
> > some
> > > > > > > > > > > > > > > > > >
> > how it
> > > > > > > > > > > > > > > > > >
> > can't get vm.conf to start VM.
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> No, this is a different issues.
> > > > > > > > > > > > > > > > > >
> In 3.6 we added a feature to let
> > > > > > > > > > > > > > > > > >
> the engine
> > > > > > > > > > > > > > > > > >
> manage
> > > > > > > > > > > > > > > > > >
> also the
> > > > > > > > > > > > > > > > > >
> engine VM
> > > > > > > > > > > > > > > > > >
> itself; ovirt-ha-agent will
> > > > > > > > > > > > > > > > > >
> pickup
> > > > > > > > > > > > > > > > > >
> the latest
> > > > > > > > > > > > > > > > > >
> engine
> > > > > > > > > > > > > > > > > >
> VM
> > > > > > > > > > > > > > > > > >
> configuration
> > > > > > > > > > > > > > > > > >
> from the OVF_STORE which is
> > > > > > > > > > > > > > > > > >
> managed
> > > > > > > > > > > > > > > > > >
> by the
> > > > > > > > > > > > > > > > > >
> engine.
> > > > > > > > > > > > > > > > > >
> If something goes wrong, ovirt-
> > > > > > > > > > > > > > > > > >
> ha-
> > > > > > > > > > > > > > > > > >
> agent could
> > > > > > > > > > > > > > > > > >
> fallback to the
> > > > > > > > > > > > > > > > > >
> initial
> > > > > > > > > > > > > > > > > >
> (bootstrap time) vm.conf. This
> > > > > > > > > > > > > > > > > >
> will
> > > > > > > > > > > > > > > > > >
> normally
> > > > > > > > > > > > > > > > > >
> happen
> > > > > > > > > > > > > > > > > >
> till you
> > > > > > > > > > > > > > > > > >
> add
> > > > > > > > > > > > > > > > > >
> your
> > > > > > > > > > > > > > > > > >
> first regular storage domain and
> > > > > > > > > > > > > > > > > >
> the engine
> > > > > > > > > > > > > > > > > >
> imports
> > > > > > > > > > > > > > > > > >
> the
> > > > > > > > > > > > > > > > > >
> engine
> > > > > > > > > > > > > > > > > >
> VM.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
But i already have my first storage
> > > > > > > > > > > > > > > > > >
domain and
> > > > > > > > > > > > > > > > > >
storage
> > > > > > > > > > > > > > > > > >
engine
> > > > > > > > > > > > > > > > > >
domain
> > > > > > > > > > > > > > > > > >
and already imported engine VM.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
I'm using 4.0 version.
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > This
seams an issue, can you please
> > > > > > > > > > > > > > > > > share
your
> > > > > > > > > > > > > > > > >
/var/log/ovirt-hosted-engine-
> > > > > > > > > > > > > > > > >
ha/agent.log ?
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > I sent it
in attachment.
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Nothing strange
here;
> > > > > > > > > > > > > > > do you see a
couple of disks with alias
> > > > > > > > > > > > > > > OVF_STORE on
> > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > hosted-
> > > > > > > > > > > > > > > engine
> > > > > > > > > > > > > > > storage domain
if you check it from the
> > > > > > > > > > > > > > > engine?
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Do you mean any disk
label?
> > > > > > > > > > > > > > I don't have it
anyone:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > [root@ied-blade11
~]# ls /dev/disk/by-
> > > > > > > > > > > > > > label/
> > > > > > > > > > > > > > ls: cannot access
/dev/disk/by-label/: No
> > > > > > > > > > > > > > such file or
> > > > > > > > > > > > > > directory
> > > > > > > > > > > > >
> > > > > > > > > > > > > No I mean: go to the
engine web-ui, select
> > > > > > > > > > > > > the
> > > > > > > > > > > > > hosted-
> > > > > > > > > > > > > engine
> > > > > > > > > > > > > storage
> > > > > > > > > > > > > domain, check the disks
there.
> > > > > > > > > > > >
> > > > > > > > > > > > No, the alias is
virtio-disk0.
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > And this is the engine VM disk, so
the issue is
> > > > > > > > > > > why
> > > > > > > > > > > the engine
> > > > > > > > > > > has
> > > > > > > > > > > still to create the OVF_STORE.
> > > > > > > > > > > Can you please share your
engine.log from the
> > > > > > > > > > > engine VM?
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Go in attachment.
> > > > > > > > >
> > > > > > > > > The creation of the OVF_STORE disk failed but
it's
> > > > > > > > > not
> > > > > > > > > that clear
> > > > > > > > > why:
> > > > > > > > >
> > > > > > > > > 2016-08-17 08:43:33,538 ERROR
> > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvf
> > > > > > > > > Vo
> > > > > > > > > lumeForStora
> > > > > > > > > ge
> > > > > > > > > DomainCommand]
> > > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Ending
command
> > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvf
> > > > > > > > > Vo
> > > > > > > > > lumeForStora
> > > > > > > > > ge
> > > > > > > > > DomainCommand'
> > > > > > > > > with failure.
> > > > > > > > > 2016-08-17 08:43:33,540 ERROR
> > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > > d]
> > > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4] Ending
command
> > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > > d'
> > > > > > > > > with
> > > > > > > > > failure.
> > > > > > > > > 2016-08-17 08:43:33,541 WARN
> > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > > d]
> > > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4]
> > > > > > > > > VmCommand::EndVmCommand: Vm is
> > > > > > > > > null - not performing endAction on Vm
> > > > > > > > > 2016-08-17 08:43:33,553 ERROR
> > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.
> > > > > > > > > Au
> > > > > > > > > ditLogDirect
> > > > > > > > > or
> > > > > > > > > ]
> > > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4]
Correlation ID:
> > > > > > > > > 6f1f1fd4, Call
> > > > > > > > > Stack: null, Custom Event ID: -1, Message:
Add-Disk
> > > > > > > > > operation
> > > > > > > > > failed
> > > > > > > > > to complete.
> > > > > > > > > 2016-08-17 08:43:33,557 WARN
> > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.
> > > > > > > > > Au
> > > > > > > > > ditLogDirect
> > > > > > > > > or
> > > > > > > > > ]
> > > > > > > > > (DefaultQuartzScheduler6) [] Correlation ID:
> > > > > > > > > 19ac5bda,
> > > > > > > > > Call Stack:
> > > > > > > > > null, Custom Event ID: -1, Message: Failed to
create
> > > > > > > > > OVF store disk
> > > > > > > > > for Storage Domain hosted_storage.
> > > > > > > > > OVF data won't be updated meanwhile for
that domain.
> > > > > > > > > 2016-08-17 08:43:33,585 INFO
> > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExecuti
> > > > > > > > > on
> > > > > > > > > Callback]
> > > > > > > > > (DefaultQuartzScheduler6) [5f5a8daf] Command
> > > > > > > > > 'ProcessOvfUpdateForStorageDomain'
(id:
> > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting on
> > > > > > > > > child command
> > > > > > > > > id:
> > > > > > > > >
'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > > > > > > > >
type:'CreateOvfVolumeForStorageDomain' to complete
> > > > > > > > > 2016-08-17 08:43:33,595 ERROR
> > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.CreateOvf
> > > > > > > > > Vo
> > > > > > > > > lumeForStora
> > > > > > > > > ge
> > > > > > > > > DomainCommand]
> > > > > > > > > (DefaultQuartzScheduler6) [5d314e49] Ending
command
> > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.CreateOvf
> > > > > > > > > Vo
> > > > > > > > > lumeForStora
> > > > > > > > > ge
> > > > > > > > > DomainCommand'
> > > > > > > > > with failure.
> > > > > > > > > 2016-08-17 08:43:33,596 ERROR
> > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > > d]
> > > > > > > > > (DefaultQuartzScheduler6) [5d314e49] Ending
command
> > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > > d'
> > > > > > > > > with
> > > > > > > > > failure.
> > > > > > > > > 2016-08-17 08:43:33,596 WARN
> > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskComman
> > > > > > > > > d]
> > > > > > > > > (DefaultQuartzScheduler6) [5d314e49]
> > > > > > > > > VmCommand::EndVmCommand: Vm is
> > > > > > > > > null - not performing endAction on Vm
> > > > > > > > > 2016-08-17 08:43:33,602 ERROR
> > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.
> > > > > > > > > Au
> > > > > > > > > ditLogDirect
> > > > > > > > > or
> > > > > > > > > ]
> > > > > > > > > (DefaultQuartzScheduler6) [5d314e49]
Correlation ID:
> > > > > > > > > 5d314e49, Call
> > > > > > > > > Stack: null, Custom Event ID: -1, Message:
Add-Disk
> > > > > > > > > operation
> > > > > > > > > failed
> > > > > > > > > to complete.
> > > > > > > > > 2016-08-17 08:43:33,605 WARN
> > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.
> > > > > > > > > Au
> > > > > > > > > ditLogDirect
> > > > > > > > > or
> > > > > > > > > ]
> > > > > > > > > (DefaultQuartzScheduler6) [] Correlation ID:
> > > > > > > > > 5f5a8daf,
> > > > > > > > > Call Stack:
> > > > > > > > > null, Custom Event ID: -1, Message: Failed to
create
> > > > > > > > > OVF store disk
> > > > > > > > > for Storage Domain hosted_storage.
> > > > > > > > > OVF data won't be updated meanwhile for
that domain.
> > > > > > > > > 2016-08-17 08:43:36,460 INFO
> > > > > > > > >
[org.ovirt.engine.core.bll.scheduling.HaReservationHa
> > > > > > > > > nd
> > > > > > > > > ling]
> > > > > > > > > (DefaultQuartzScheduler7) [5d314e49] HA
reservation
> > > > > > > > > status for
> > > > > > > > > cluster
> > > > > > > > > 'Default' is 'OK'
> > > > > > > > > 2016-08-17 08:43:36,662 INFO
> > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExecuti
> > > > > > > > > on
> > > > > > > > > Callback]
> > > > > > > > > (DefaultQuartzScheduler4) [5f5a8daf] Command
> > > > > > > > > 'ProcessOvfUpdateForStorageDomain'
id:
> > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child commands
> > > > > > > > > '[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > > > > > > > > eb2e6f1a-c756-4ccd-85a1-60d97d6880de]'
executions
> > > > > > > > > were
> > > > > > > > > completed,
> > > > > > > > > status 'FAILED'
> > > > > > > > > 2016-08-17 08:43:37,691 ERROR
> > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.ProcessOv
> > > > > > > > > fU
> > > > > > > > > pdateForStor
> > > > > > > > > ag
> > > > > > > > > eDomainCommand]
> > > > > > > > > (DefaultQuartzScheduler6) [5f5a8daf] Ending
command
> > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOv
> > > > > > > > > fU
> > > > > > > > > pdateForStor
> > > > > > > > > ag
> > > > > > > > > eDomainCommand'
> > > > > > > > > with failure.
> > > > > > > > >
> > > > > > > > > Can you please check vdsm logs for that time
frame on
> > > > > > > > > the SPM host?
> > > > > > > > >
> > > > > > > >
> > > > > > > > I sent in attachment the vdsm logs from both
hosts, but
> > > > > > > > i
> > > > > > > > think the
> > > > > > > > SPM
> > > > > > > > host on this time frame it was ied-blade13
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > It seams that you also have an issue in the
SPM
> > > > > > > > > election procedure:
> > > > > > > > >
> > > > > > > > > 2016-08-17 18:04:31,053 ERROR
> > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyDa
> > > > > > > > > ta
> > > > > > > > > ]
> > > > > > > > > (DefaultQuartzScheduler1) [] SPM Init: could
not find
> > > > > > > > > reported vds
> > > > > > > > > or
> > > > > > > > > not up - pool: 'Default' vds_spm_id:
'2'
> > > > > > > > > 2016-08-17 18:04:31,076 INFO
> > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyDa
> > > > > > > > > ta
> > > > > > > > > ]
> > > > > > > > > (DefaultQuartzScheduler1) [] SPM selection -
vds
> > > > > > > > > seems
> > > > > > > > > as spm
> > > > > > > > > 'hosted_engine_2'
> > > > > > > > > 2016-08-17 18:04:31,076 WARN
> > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyDa
> > > > > > > > > ta
> > > > > > > > > ]
> > > > > > > > > (DefaultQuartzScheduler1) [] spm vds is non
> > > > > > > > > responsive,
> > > > > > > > > stopping
> > > > > > > > > spm
> > > > > > > > > selection.
> > > > > > > > > 2016-08-17 18:04:31,539 INFO
> > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatis
> > > > > > > > > ti
> > > > > > > > > csFetcher]
> > > > > > > > > (DefaultQuartzScheduler7) [] Fetched 1 VMs
from VDS
> > > > > > > > >
'06372186-572c-41ad-916f-7cbb0aba5302'
> > > > > > > > >
> > > > > > > > > probably due to:
> > > > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonit
> > > > > > > > > or
> > > > > > > > > ing]
> > > > > > > > > (DefaultQuartzScheduler6) [] Failure to
refresh Vds
> > > > > > > > > runtime info:
> > > > > > > > > VDSGenericException: VDSNetworkException:
Message
> > > > > > > > > timeout which can
> > > > > > > > > be
> > > > > > > > > caused by communication issues
> > > > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.HostMonit
> > > > > > > > > or
> > > > > > > > > ing]
> > > > > > > > > (DefaultQuartzScheduler6) [] Exception:
> > > > > > > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkE
> > > > > > > > > xc
> > > > > > > > > eption:
> > > > > > > > > VDSGenericException: VDSNetworkException:
Message
> > > > > > > > > timeout which can
> > > > > > > > > be
> > > > > > > > > caused by communication issues
> > > > > > > > >
> > > > > > > >
> > > > > > > > This messages maybe cause by connection issues
from
> > > > > > > > yesterday at 6pm.
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > can you please check if the engine VM could
correctly
> > > > > > > > > resolve and
> > > > > > > > > reach each host?
> > > > > > > >
> > > > > > > > Now i can read engine VM from both hosts
> > > > > > > >
> > > > > > > > [root@ied-blade11 ~]# ping ied-hosted-engine
> > > > > > > > PING ied-hosted-engine.install.eurotux.local
> > > > > > > > (10.10.4.115) 56(84)
> > > > > > > > bytes
> > > > > > > > of data.
> > > > > > > > 64 bytes from
ied-hosted-engine.install.eurotux.local
> > > > > > > > (10.10.4.115):
> > > > > > > > icmp_seq=1 ttl=64 time=0.179 ms
> > > > > > > > 64 bytes from
ied-hosted-engine.install.eurotux.local
> > > > > > > > (10.10.4.115):
> > > > > > > > icmp_seq=2 ttl=64 time=0.141 ms
> > > > > > > > ^C
> > > > > > > > --- ied-hosted-engine.install.eurotux.local ping
> > > > > > > > statistics ---
> > > > > > > > 2 packets transmitted, 2 received, 0% packet loss,
time
> > > > > > > > 999ms
> > > > > > > > rtt min/avg/max/mdev = 0.141/0.160/0.179/0.019 ms
> > > > > > > > [root@ied-blade13 ~]# ping ied-hosted-engine
> > > > > > > > PING ied-hosted-engine.install.eurotux.local
> > > > > > > > (10.10.4.115) 56(84)
> > > > > > > > bytes
> > > > > > > > of data.
> > > > > > > > 64 bytes from
ied-hosted-engine.install.eurotux.local
> > > > > > > > (10.10.4.115):
> > > > > > > > icmp_seq=1 ttl=64 time=0.172 ms
> > > > > > > > 64 bytes from
ied-hosted-engine.install.eurotux.local
> > > > > > > > (10.10.4.115):
> > > > > > > > icmp_seq=2 ttl=64 time=0.169 ms
> > > > > > > > ^C
> > > > > > > > --- ied-hosted-engine.install.eurotux.local ping
> > > > > > > > statistics ---
> > > > > > > > 2 packets transmitted, 2 received, 0% packet loss,
time
> > > > > > > > 1000ms
> > > > > > > > rtt min/avg/max/mdev = 0.169/0.170/0.172/0.013 ms
> > > > > > > >
> > > > > > > >
> > > > > > > > I have a message critical of low disk space on
> > > > > > > > hosted_storage domain.
> > > > > > > > I have 50G of disk and i created i VM with 40G. Do
i
> > > > > > > > need
> > > > > > > > more space
> > > > > > > > of
> > > > > > > > OVF_STORAGE?
> > > > > > > > What is the minimum requirements of disk space
for
> > > > > > > > deploy
> > > > > > > > engine VM?
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > Carlos
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Regards,
> > > > > > > > > > > > > > > > > >
> > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > Regards,
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > --
> > > > > > > > > > > > > > > > > >
> > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > Engenheiro de Software
> > > > > > > > > > > > > > > > > >
> > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > Eurotux Informática, S.A. |
> > > > > > > > > > > > > > > > > >
> > > > w
> > > > > > > > > > > > > > > > > >
> > > > ww.eurotux.c
> > > > > > > > > > > > > > > > > >
> > > > om
> > > > > > > > > > > > > > > > > >
> > > > (t) +351 253 680 300 (m)
> > > > > > > > > > > > > > > > > >
> > > > +351
> > > > > > > > > > > > > > > > > >
> > > > 911 926 110
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > ___________________________
> > > > > > > > > > > > > > > > > >
> > > > __
> > > > > > > > > > > > > > > > > >
> > > > ____________
> > > > > > > > > > > > > > > > > >
> > > > __
> > > > > > > > > > > > > > > > > >
> > > > ____
> > > > > > > > > > > > > > > > > >
> > > > Users mailing list
> > > > > > > > > > > > > > > > > >
> > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > http://lists.ovirt.org/mail
> > > > > > > > > > > > > > > > > >
> > > > ma
> > > > > > > > > > > > > > > > > >
> > > > n/listinfo/u
> > > > > > > > > > > > > > > > > >
> > > > se
> > > > > > > > > > > > > > > > > >
> > > > rs
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > --
> > > > > > > > > > > > > > > > > >
> > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Eurotux Informática, S.A. |
> > > > > > > > > > > > > > > > > >
> > www.e
> > > > > > > > > > > > > > > > > >
> > urotux.com
> > > > > > > > > > > > > > > > > >
> > (t) +351 253 680 300 (m) +351
> > > > > > > > > > > > > > > > > >
> > 911
> > > > > > > > > > > > > > > > > >
> > 926 110
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > _______________________________
> > > > > > > > > > > > > > > > > >
> > __
> > > > > > > > > > > > > > > > > >
> > ____________
> > > > > > > > > > > > > > > > > >
> > __
> > > > > > > > > > > > > > > > > >
> > Users mailing list
> > > > > > > > > > > > > > > > > >
> > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > http://lists.ovirt.org/mailman/
> > > > > > > > > > > > > > > > > >
> > li
> > > > > > > > > > > > > > > > > >
> > stinfo/users
> > > > > > > > > > > > > > > > > >
--
> > > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Eurotux Informática, S.A. | www.eur
> > > > > > > > > > > > > > > > > >
ot
> > > > > > > > > > > > > > > > > >
ux.com
> > > > > > > > > > > > > > > > > >
(t) +351 253 680 300 (m) +351 911
> > > > > > > > > > > > > > > > > >
926
> > > > > > > > > > > > > > > > > >
110
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Engenheiro
de Software Sénior
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurotux
> > > > > > > > > > > > > > > > .c
> > > > > > > > > > > > > > > > om
> > > > > > > > > > > > > > > > (t) +351
253 680 300 (m) +351 911 926
> > > > > > > > > > > > > > > > 110
> > > > > > > > > > > > > > --
> > > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Eurotux Informática,
S.A. | www.eurotux.com
> > > > > > > > > > > > > > (t) +351 253 680 300
(m) +351 911 926 110
> > > > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > >
> > > > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > > > >
> > > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > (t) +351 253 680 300 (m) +351
911 926 110
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Carlos Rodrigues
> > > > > > > > > >
> > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > >
> > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > (t) +351 253 680 300 (m) +351 911 926
110
> > > > > > > > _______________________________________________
> > > > > > > > Users mailing list
> > > > > > > > Users(a)ovirt.org
> > > > > > > > http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > --
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > > Engenheiro de Software Sénior
> > > > > > >
> > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > >
> > > > > --
> > > > > Carlos Rodrigues
> > > > >
> > > > > Engenheiro de Software Sénior
> > > > >
> > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > >
> > > > >
> > > >
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> > >
> > >
> >
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
1:50 p.m.
On Fri, 2016-08-19 at 12:24 +0200, Simone Tiraboschi wrote:
On Fri, Aug 19, 2016 at 12:07 PM, Carlos Rodrigues
<cmar(a)eurotux.com>
wrote:
>
> On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote:
> >
> > On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote:
> > >
> > >
> > >
> > >
> > > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues <cmar@eurotu
> > > x.co
> > > m>
> > > wrote:
> > > >
> > > >
> > > > After night, the OVF_STORE it was created:
> > > >
> > >
> > > It's quite strange that it got so long but now it looks fine.
> > >
> > > If the ISO_DOMAIN that I see in your screenshot is served by
> > > the
> > > engine VM itself, I suggest to remove it and export from an
> > > external
> > > server.
> > > Serving the ISO storage domain from the engine VM itself is not
> > > a
> > > good idea since when the engine VM is down you can experiment
> > > long
> > > delays before getting the engine VM restarted due to the
> > > unavailable
> > > storage domain.
> >
> > Ok, thank you for advice.
> >
> > Now, apparently is all ok. I'll do more tests with HA and any
> > issue
> > i'll tell you.
> >
> > Thank you for your support.
> >
> > Regards,
> > Carlos Rodrigues
> >
>
> I shutdown the network of host with engine VM and i expected that
> other
> host fence the host and start engine VM but i don't see any fence
> action and the "free" host keep trying to start VM but get and
> error of
> sanlock
>
> Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm:
> sending ioctl 5326 to a partition!
> Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm:
> sending ioctl 80200204 to a partition!
> Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: 1
> guest
> now active
> Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]:
> 2016-
> 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 delta 1 9
> 245502 alive
> Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]:
> 2016-
> 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error -243
> Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]:
> 2016-
> 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862
> acquire_token
> -243 lease owned by other host
> Aug 19 11:03:03 ied-blade11.install.eurotux.local libvirtd[1369]:
> resource busy: Failed to acquire lock: error -243
> Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> ovirtmgmt:
> port 2(vnet0) entered disabled state
> Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: device
> vnet0
> left promiscuous mode
> Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> ovirtmgmt:
> port 2(vnet0) entered disabled state
> Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: 0
> guests
> now active
> Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd-
> machined[7863]: Machine qemu-4-HostedEngine terminated.
Maybe you hit this one:
https://bugzilla.redhat.com/show_bug.cgi?id=1322849
Can you please check it as described in comment 28 and eventually
apply the workaround in comment 18?
Apparently the host-id its ok. I don't need to apply the workaround.
>
> >
> > >
> > > >
> > > > Regards,
> > > > Carlos Rodrigues
> > > >
> > > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote:
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues <cmar@eur
> > > > > otux
> > > > > .c
> > > > > om> wrote:
> > > > > >
> > > > > >
> > > > > > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi
> > > > > > wrote:
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues
<cmar
> > > > > > > @eur
> > > > > > > ot
> > > > > > > ux.com> wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > I increase hosted_engine disk space to 160G. How
do i
> > > > > > > > force
> > > > > > > > to create
> > > > > > > > OVF_STORE.
> > > > > > >
> > > > > > > I think that restarting the engine on the engine VM
> > > > > > > will
> > > > > > > trigger it
> > > > > > > although I'm not sure that it was a size issue.
> > > > > > >
> > > > > >
> > > > > > I found to OVF_STORE on another storage domain with
> > > > > > "Domain
> > > > > > Type" "Data (Master)"
> > > > > >
> > > > > >
> > > > >
> > > > > Each storage domain has its own OVF_STORE volumes; you
> > > > > should
> > > > > get
> > > > > them also on the hosted-engine storage domain.
> > > > > Not really sure about how to trigger it again; adding Roy
> > > > > here.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > On Thu, 2016-08-18 at 12:14 +0100, Carlos
Rodrigues
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, 2016-08-18 at 12:34 +0200, Simone
> > > > > > > > > Tiraboschi
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, Aug 18, 2016 at 12:11 PM,
Carlos
> > > > > > > > > > Rodrigues
> > > > > > > > > > <cma
> > > > > > > > > > r(a)eurotux.co
> > > > > > > > > > m>
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Thu, 2016-08-18 at 11:53 +0200,
Simone
> > > > > > > > > > > Tiraboschi
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, Aug 18, 2016 at 11:50
AM, Carlos
> > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > <cmar@eurotu
> > > > > > > > > > > > x.
> > > > > > > > > > > > com>
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, 2016-08-18 at
11:42 +0200, Simone
> > > > > > > > > > > > > Tiraboschi wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Thu, Aug 18,
2016 at 11:25 AM, Carlos
> > > > > > > > > > > > > > Rodrigues
<cmar@eu
> > > > > > > > > > > > > > ro
> > > > > > > > > > > > > > tux.
> > > > > > > > > > > > > > com> wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Thu,
2016-08-18 at 11:04 +0200,
> > > > > > > > > > > > > > > Simone
> > > > > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Thu,
Aug 18, 2016 at 10:36 AM,
> > > > > > > > > > > > > > > > Carlos
> > > > > > > > > > > > > > > >
Rodrigues
> > > > > > > > > > > > > > > >
<cmar@
> > > > > > > > > > > > > > > > euro
> > > > > > > > > > > > > > > >
tux.com>
> > > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On
Thu, 2016-08-18 at 10:27 +0200,
> > > > > > > > > > > > > > > > >
Simone
> > > > > > > > > > > > > > > > >
Tiraboschi
> > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
On Thu, Aug 18, 2016 at 10:22 AM,
> > > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
<cmar@
> > > > > > > > > > > > > > > > > >
eurotux.
> > > > > > > > > > > > > > > > > >
com>
> > > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> On Thu, 2016-08-18 at 08:54
> > > > > > > > > > > > > > > > > >
> +0200,
> > > > > > > > > > > > > > > > > >
> Simone
> > > > > > > > > > > > > > > > > >
> Tiraboschi
> > > > > > > > > > > > > > > > > >
> wrote:
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > On Tue, Aug 16, 2016 at 12:53
> > > > > > > > > > > > > > > > > >
> > PM,
> > > > > > > > > > > > > > > > > >
> > Carlos
> > > > > > > > > > > > > > > > > >
> > Rodrigues <c
> > > > > > > > > > > > > > > > > >
> > mar@euro
> > > > > > > > > > > > > > > > > >
> > tux.
> > > > > > > > > > > > > > > > > >
> > com>
> > > > > > > > > > > > > > > > > >
> > wrote:
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > On Sun, 2016-08-14 at 14:22
> > > > > > > > > > > > > > > > > >
> > > +0300, Roy Golan
> > > > > > > > > > > > > > > > > >
> > > wrote:
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > On 12 August 2016 at
> > > > > > > > > > > > > > > > > >
> > > > 20:23,
> > > > > > > > > > > > > > > > > >
> > > > Carlos
> > > > > > > > > > > > > > > > > >
> > > > Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > <cma
> > > > > > > > > > > > > > > > > >
> > > > r@eurotu
> > > > > > > > > > > > > > > > > >
> > > > x.co
> > > > > > > > > > > > > > > > > >
> > > > m>
> > > > > > > > > > > > > > > > > >
> > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > Hello,
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > I have one cluster with
> > > > > > > > > > > > > > > > > >
> > > > > two
> > > > > > > > > > > > > > > > > >
> > > > > hosts with
> > > > > > > > > > > > > > > > > >
> > > > > power
> > > > > > > > > > > > > > > > > >
> > > > > management
> > > > > > > > > > > > > > > > > >
> > > > > correctly
> > > > > > > > > > > > > > > > > >
> > > > > configured and one
> > > > > > > > > > > > > > > > > >
> > > > > virtual
> > > > > > > > > > > > > > > > > >
> > > > > machine with
> > > > > > > > > > > > > > > > > >
> > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > over
> > > > > > > > > > > > > > > > > >
> > > > > shared
> > > > > > > > > > > > > > > > > >
> > > > > storage with
> > > > > > > > > > > > > > > > > >
> > > > > FiberChannel.
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > When i shutdown the
> > > > > > > > > > > > > > > > > >
> > > > > network
> > > > > > > > > > > > > > > > > >
> > > > > of host with
> > > > > > > > > > > > > > > > > >
> > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > VM, it
> > > > > > > > > > > > > > > > > >
> > > > > should be
> > > > > > > > > > > > > > > > > >
> > > > > possible the
> > > > > > > > > > > > > > > > > >
> > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > VM
> > > > > > > > > > > > > > > > > >
> > > > > migrate
> > > > > > > > > > > > > > > > > >
> > > > > automatically to
> > > > > > > > > > > > > > > > > >
> > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > host?
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > migrate on which network?
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > What is the expected
> > > > > > > > > > > > > > > > > >
> > > > > behaviour on this HA
> > > > > > > > > > > > > > > > > >
> > > > > scenario?
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > After a few minutes your
> > > > > > > > > > > > > > > > > >
> > > > vm
> > > > > > > > > > > > > > > > > >
> > > > will be
> > > > > > > > > > > > > > > > > >
> > > > shutdown
> > > > > > > > > > > > > > > > > >
> > > > by
> > > > > > > > > > > > > > > > > >
> > > > the High
> > > > > > > > > > > > > > > > > >
> > > > Availability
> > > > > > > > > > > > > > > > > >
> > > > agent, as it can't see
> > > > > > > > > > > > > > > > > >
> > > > network,
> > > > > > > > > > > > > > > > > >
> > > > and started
> > > > > > > > > > > > > > > > > >
> > > > on
> > > > > > > > > > > > > > > > > >
> > > > another
> > > > > > > > > > > > > > > > > >
> > > > host.
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > I'm testing this scenario
> > > > > > > > > > > > > > > > > >
> > > and
> > > > > > > > > > > > > > > > > >
> > > after shutdown
> > > > > > > > > > > > > > > > > >
> > > network, it
> > > > > > > > > > > > > > > > > >
> > > should
> > > > > > > > > > > > > > > > > >
> > > be
> > > > > > > > > > > > > > > > > >
> > > expected that agent
> > > > > > > > > > > > > > > > > >
> > > shutdown ha
> > > > > > > > > > > > > > > > > >
> > > and started
> > > > > > > > > > > > > > > > > >
> > > on
> > > > > > > > > > > > > > > > > >
> > > another
> > > > > > > > > > > > > > > > > >
> > > host,
> > > > > > > > > > > > > > > > > >
> > > but
> > > > > > > > > > > > > > > > > >
> > > after
> > > > > > > > > > > > > > > > > >
> > > couple minutes nothing
> > > > > > > > > > > > > > > > > >
> > > happens
> > > > > > > > > > > > > > > > > >
> > > and on host
> > > > > > > > > > > > > > > > > >
> > > with
> > > > > > > > > > > > > > > > > >
> > > network we
> > > > > > > > > > > > > > > > > >
> > > getting
> > > > > > > > > > > > > > > > > >
> > > the
> > > > > > > > > > > > > > > > > >
> > > following messages:
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > Aug 16 11:44:08 ied-
> > > > > > > > > > > > > > > > > >
> > > blade11.install.eurotux.loc
> > > > > > > > > > > > > > > > > >
> > > al
> > > > > > > > > > > > > > > > > >
> > > ovirt-ha-
> > > > > > > > > > > > > > > > > >
> > > agent[2779]:
> > > > > > > > > > > > > > > > > >
> > > ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
> > > ovirt_hosted_engine_ha.agen
> > > > > > > > > > > > > > > > > >
> > > t.ho
> > > > > > > > > > > > > > > > > >
> > > st
> > > > > > > > > > > > > > > > > >
> > > ed_engine.Ho
> > > > > > > > > > > > > > > > > >
> > > st
> > > > > > > > > > > > > > > > > >
> > > edEn
> > > > > > > > > > > > > > > > > >
> > > gine.con
> > > > > > > > > > > > > > > > > >
> > > fig
> > > > > > > > > > > > > > > > > >
> > > ERROR
> > > > > > > > > > > > > > > > > >
> > > Unable to get vm.conf from
> > > > > > > > > > > > > > > > > >
> > > OVF_STORE, falling
> > > > > > > > > > > > > > > > > >
> > > back
> > > > > > > > > > > > > > > > > >
> > > to
> > > > > > > > > > > > > > > > > >
> > > initial
> > > > > > > > > > > > > > > > > >
> > > vm.conf
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > I think the HA agent its
> > > > > > > > > > > > > > > > > >
> > > trying
> > > > > > > > > > > > > > > > > >
> > > to get vm
> > > > > > > > > > > > > > > > > >
> > > configuration but
> > > > > > > > > > > > > > > > > >
> > > some
> > > > > > > > > > > > > > > > > >
> > > how it
> > > > > > > > > > > > > > > > > >
> > > can't get vm.conf to start
> > > > > > > > > > > > > > > > > >
> > > VM.
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > No, this is a different
> > > > > > > > > > > > > > > > > >
> > issues.
> > > > > > > > > > > > > > > > > >
> > In 3.6 we added a feature to
> > > > > > > > > > > > > > > > > >
> > let
> > > > > > > > > > > > > > > > > >
> > the engine
> > > > > > > > > > > > > > > > > >
> > manage
> > > > > > > > > > > > > > > > > >
> > also the
> > > > > > > > > > > > > > > > > >
> > engine VM
> > > > > > > > > > > > > > > > > >
> > itself; ovirt-ha-agent will
> > > > > > > > > > > > > > > > > >
> > pickup
> > > > > > > > > > > > > > > > > >
> > the latest
> > > > > > > > > > > > > > > > > >
> > engine
> > > > > > > > > > > > > > > > > >
> > VM
> > > > > > > > > > > > > > > > > >
> > configuration
> > > > > > > > > > > > > > > > > >
> > from the OVF_STORE which is
> > > > > > > > > > > > > > > > > >
> > managed
> > > > > > > > > > > > > > > > > >
> > by the
> > > > > > > > > > > > > > > > > >
> > engine.
> > > > > > > > > > > > > > > > > >
> > If something goes wrong,
> > > > > > > > > > > > > > > > > >
> > ovirt-
> > > > > > > > > > > > > > > > > >
> > ha-
> > > > > > > > > > > > > > > > > >
> > agent could
> > > > > > > > > > > > > > > > > >
> > fallback to the
> > > > > > > > > > > > > > > > > >
> > initial
> > > > > > > > > > > > > > > > > >
> > (bootstrap time) vm.conf.
> > > > > > > > > > > > > > > > > >
> > This
> > > > > > > > > > > > > > > > > >
> > will
> > > > > > > > > > > > > > > > > >
> > normally
> > > > > > > > > > > > > > > > > >
> > happen
> > > > > > > > > > > > > > > > > >
> > till you
> > > > > > > > > > > > > > > > > >
> > add
> > > > > > > > > > > > > > > > > >
> > your
> > > > > > > > > > > > > > > > > >
> > first regular storage domain
> > > > > > > > > > > > > > > > > >
> > and
> > > > > > > > > > > > > > > > > >
> > the engine
> > > > > > > > > > > > > > > > > >
> > imports
> > > > > > > > > > > > > > > > > >
> > the
> > > > > > > > > > > > > > > > > >
> > engine
> > > > > > > > > > > > > > > > > >
> > VM.
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> But i already have my first
> > > > > > > > > > > > > > > > > >
> storage
> > > > > > > > > > > > > > > > > >
> domain and
> > > > > > > > > > > > > > > > > >
> storage
> > > > > > > > > > > > > > > > > >
> engine
> > > > > > > > > > > > > > > > > >
> domain
> > > > > > > > > > > > > > > > > >
> and already imported engine VM.
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> I'm using 4.0 version.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
This seams an issue, can you
> > > > > > > > > > > > > > > > > >
please
> > > > > > > > > > > > > > > > > >
share your
> > > > > > > > > > > > > > > > > >
/var/log/ovirt-hosted-engine-
> > > > > > > > > > > > > > > > > >
ha/agent.log ?
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > I
sent it in attachment.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Nothing
strange here;
> > > > > > > > > > > > > > > > do you
see a couple of disks with
> > > > > > > > > > > > > > > > alias
> > > > > > > > > > > > > > > > OVF_STORE
on
> > > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > > hosted-
> > > > > > > > > > > > > > > > engine
> > > > > > > > > > > > > > > > storage
domain if you check it from
> > > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > > engine?
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Do you mean
any disk label?
> > > > > > > > > > > > > > > I don't
have it anyone:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
[root@ied-blade11 ~]# ls /dev/disk/by-
> > > > > > > > > > > > > > > label/
> > > > > > > > > > > > > > > ls: cannot
access /dev/disk/by-label/:
> > > > > > > > > > > > > > > No
> > > > > > > > > > > > > > > such file or
> > > > > > > > > > > > > > > directory
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > No I mean: go to
the engine web-ui,
> > > > > > > > > > > > > > select
> > > > > > > > > > > > > > the
> > > > > > > > > > > > > > hosted-
> > > > > > > > > > > > > > engine
> > > > > > > > > > > > > > storage
> > > > > > > > > > > > > > domain, check the
disks there.
> > > > > > > > > > > > >
> > > > > > > > > > > > > No, the alias is
virtio-disk0.
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > And this is the engine VM
disk, so the issue
> > > > > > > > > > > > is
> > > > > > > > > > > > why
> > > > > > > > > > > > the engine
> > > > > > > > > > > > has
> > > > > > > > > > > > still to create the
OVF_STORE.
> > > > > > > > > > > > Can you please share your
engine.log from the
> > > > > > > > > > > > engine VM?
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Go in attachment.
> > > > > > > > > >
> > > > > > > > > > The creation of the OVF_STORE disk
failed but
> > > > > > > > > > it's
> > > > > > > > > > not
> > > > > > > > > > that clear
> > > > > > > > > > why:
> > > > > > > > > >
> > > > > > > > > > 2016-08-17 08:43:33,538 ERROR
> > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.Creat
> > > > > > > > > > eOvf
> > > > > > > > > > Vo
> > > > > > > > > > lumeForStora
> > > > > > > > > > ge
> > > > > > > > > > DomainCommand]
> > > > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4]
Ending
> > > > > > > > > > command
> > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.Creat
> > > > > > > > > > eOvf
> > > > > > > > > > Vo
> > > > > > > > > > lumeForStora
> > > > > > > > > > ge
> > > > > > > > > > DomainCommand'
> > > > > > > > > > with failure.
> > > > > > > > > > 2016-08-17 08:43:33,540 ERROR
> > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskCo
> > > > > > > > > > mman
> > > > > > > > > > d]
> > > > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4]
Ending
> > > > > > > > > > command
> > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDiskCo
> > > > > > > > > > mman
> > > > > > > > > > d'
> > > > > > > > > > with
> > > > > > > > > > failure.
> > > > > > > > > > 2016-08-17 08:43:33,541 WARN
> > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskCo
> > > > > > > > > > mman
> > > > > > > > > > d]
> > > > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4]
> > > > > > > > > > VmCommand::EndVmCommand: Vm is
> > > > > > > > > > null - not performing endAction on Vm
> > > > > > > > > > 2016-08-17 08:43:33,553 ERROR
> > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandl
> > > > > > > > > > ing.
> > > > > > > > > > Au
> > > > > > > > > > ditLogDirect
> > > > > > > > > > or
> > > > > > > > > > ]
> > > > > > > > > > (DefaultQuartzScheduler6) [6f1f1fd4]
Correlation
> > > > > > > > > > ID:
> > > > > > > > > > 6f1f1fd4, Call
> > > > > > > > > > Stack: null, Custom Event ID: -1,
Message: Add-
> > > > > > > > > > Disk
> > > > > > > > > > operation
> > > > > > > > > > failed
> > > > > > > > > > to complete.
> > > > > > > > > > 2016-08-17 08:43:33,557 WARN
> > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandl
> > > > > > > > > > ing.
> > > > > > > > > > Au
> > > > > > > > > > ditLogDirect
> > > > > > > > > > or
> > > > > > > > > > ]
> > > > > > > > > > (DefaultQuartzScheduler6) []
Correlation ID:
> > > > > > > > > > 19ac5bda,
> > > > > > > > > > Call Stack:
> > > > > > > > > > null, Custom Event ID: -1, Message:
Failed to
> > > > > > > > > > create
> > > > > > > > > > OVF store disk
> > > > > > > > > > for Storage Domain hosted_storage.
> > > > > > > > > > OVF data won't be updated
meanwhile for that
> > > > > > > > > > domain.
> > > > > > > > > > 2016-08-17 08:43:33,585 INFO
> > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExe
> > > > > > > > > > cuti
> > > > > > > > > > on
> > > > > > > > > > Callback]
> > > > > > > > > > (DefaultQuartzScheduler6) [5f5a8daf]
Command
> > > > > > > > > >
'ProcessOvfUpdateForStorageDomain' (id:
> > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting
> > > > > > > > > > on
> > > > > > > > > > child command
> > > > > > > > > > id:
> > > > > > > > > >
'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > > > > > > > > >
type:'CreateOvfVolumeForStorageDomain' to
> > > > > > > > > > complete
> > > > > > > > > > 2016-08-17 08:43:33,595 ERROR
> > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.Creat
> > > > > > > > > > eOvf
> > > > > > > > > > Vo
> > > > > > > > > > lumeForStora
> > > > > > > > > > ge
> > > > > > > > > > DomainCommand]
> > > > > > > > > > (DefaultQuartzScheduler6) [5d314e49]
Ending
> > > > > > > > > > command
> > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.Creat
> > > > > > > > > > eOvf
> > > > > > > > > > Vo
> > > > > > > > > > lumeForStora
> > > > > > > > > > ge
> > > > > > > > > > DomainCommand'
> > > > > > > > > > with failure.
> > > > > > > > > > 2016-08-17 08:43:33,596 ERROR
> > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskCo
> > > > > > > > > > mman
> > > > > > > > > > d]
> > > > > > > > > > (DefaultQuartzScheduler6) [5d314e49]
Ending
> > > > > > > > > > command
> > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDiskCo
> > > > > > > > > > mman
> > > > > > > > > > d'
> > > > > > > > > > with
> > > > > > > > > > failure.
> > > > > > > > > > 2016-08-17 08:43:33,596 WARN
> > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDiskCo
> > > > > > > > > > mman
> > > > > > > > > > d]
> > > > > > > > > > (DefaultQuartzScheduler6) [5d314e49]
> > > > > > > > > > VmCommand::EndVmCommand: Vm is
> > > > > > > > > > null - not performing endAction on Vm
> > > > > > > > > > 2016-08-17 08:43:33,602 ERROR
> > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandl
> > > > > > > > > > ing.
> > > > > > > > > > Au
> > > > > > > > > > ditLogDirect
> > > > > > > > > > or
> > > > > > > > > > ]
> > > > > > > > > > (DefaultQuartzScheduler6) [5d314e49]
Correlation
> > > > > > > > > > ID:
> > > > > > > > > > 5d314e49, Call
> > > > > > > > > > Stack: null, Custom Event ID: -1,
Message: Add-
> > > > > > > > > > Disk
> > > > > > > > > > operation
> > > > > > > > > > failed
> > > > > > > > > > to complete.
> > > > > > > > > > 2016-08-17 08:43:33,605 WARN
> > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghandl
> > > > > > > > > > ing.
> > > > > > > > > > Au
> > > > > > > > > > ditLogDirect
> > > > > > > > > > or
> > > > > > > > > > ]
> > > > > > > > > > (DefaultQuartzScheduler6) []
Correlation ID:
> > > > > > > > > > 5f5a8daf,
> > > > > > > > > > Call Stack:
> > > > > > > > > > null, Custom Event ID: -1, Message:
Failed to
> > > > > > > > > > create
> > > > > > > > > > OVF store disk
> > > > > > > > > > for Storage Domain hosted_storage.
> > > > > > > > > > OVF data won't be updated
meanwhile for that
> > > > > > > > > > domain.
> > > > > > > > > > 2016-08-17 08:43:36,460 INFO
> > > > > > > > > >
[org.ovirt.engine.core.bll.scheduling.HaReservati
> > > > > > > > > > onHa
> > > > > > > > > > nd
> > > > > > > > > > ling]
> > > > > > > > > > (DefaultQuartzScheduler7) [5d314e49]
HA
> > > > > > > > > > reservation
> > > > > > > > > > status for
> > > > > > > > > > cluster
> > > > > > > > > > 'Default' is 'OK'
> > > > > > > > > > 2016-08-17 08:43:36,662 INFO
> > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsExe
> > > > > > > > > > cuti
> > > > > > > > > > on
> > > > > > > > > > Callback]
> > > > > > > > > > (DefaultQuartzScheduler4) [5f5a8daf]
Command
> > > > > > > > > >
'ProcessOvfUpdateForStorageDomain' id:
> > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child
> > > > > > > > > > commands
> > > > > > > > > >
'[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > > > > > > > > >
eb2e6f1a-c756-4ccd-85a1-60d97d6880de]' executions
> > > > > > > > > > were
> > > > > > > > > > completed,
> > > > > > > > > > status 'FAILED'
> > > > > > > > > > 2016-08-17 08:43:37,691 ERROR
> > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.Proce
> > > > > > > > > > ssOv
> > > > > > > > > > fU
> > > > > > > > > > pdateForStor
> > > > > > > > > > ag
> > > > > > > > > > eDomainCommand]
> > > > > > > > > > (DefaultQuartzScheduler6) [5f5a8daf]
Ending
> > > > > > > > > > command
> > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.Proce
> > > > > > > > > > ssOv
> > > > > > > > > > fU
> > > > > > > > > > pdateForStor
> > > > > > > > > > ag
> > > > > > > > > > eDomainCommand'
> > > > > > > > > > with failure.
> > > > > > > > > >
> > > > > > > > > > Can you please check vdsm logs for that
time
> > > > > > > > > > frame on
> > > > > > > > > > the SPM host?
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > I sent in attachment the vdsm logs from both
hosts,
> > > > > > > > > but
> > > > > > > > > i
> > > > > > > > > think the
> > > > > > > > > SPM
> > > > > > > > > host on this time frame it was ied-blade13
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > It seams that you also have an issue in
the SPM
> > > > > > > > > > election procedure:
> > > > > > > > > >
> > > > > > > > > > 2016-08-17 18:04:31,053 ERROR
> > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsPro
> > > > > > > > > > xyDa
> > > > > > > > > > ta
> > > > > > > > > > ]
> > > > > > > > > > (DefaultQuartzScheduler1) [] SPM Init:
could not
> > > > > > > > > > find
> > > > > > > > > > reported vds
> > > > > > > > > > or
> > > > > > > > > > not up - pool: 'Default'
vds_spm_id: '2'
> > > > > > > > > > 2016-08-17 18:04:31,076 INFO
> > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsPro
> > > > > > > > > > xyDa
> > > > > > > > > > ta
> > > > > > > > > > ]
> > > > > > > > > > (DefaultQuartzScheduler1) [] SPM
selection - vds
> > > > > > > > > > seems
> > > > > > > > > > as spm
> > > > > > > > > > 'hosted_engine_2'
> > > > > > > > > > 2016-08-17 18:04:31,076 WARN
> > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsPro
> > > > > > > > > > xyDa
> > > > > > > > > > ta
> > > > > > > > > > ]
> > > > > > > > > > (DefaultQuartzScheduler1) [] spm vds is
non
> > > > > > > > > > responsive,
> > > > > > > > > > stopping
> > > > > > > > > > spm
> > > > > > > > > > selection.
> > > > > > > > > > 2016-08-17 18:04:31,539 INFO
> > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.VmsSt
> > > > > > > > > > atis
> > > > > > > > > > ti
> > > > > > > > > > csFetcher]
> > > > > > > > > > (DefaultQuartzScheduler7) [] Fetched 1
VMs from
> > > > > > > > > > VDS
> > > > > > > > > >
'06372186-572c-41ad-916f-7cbb0aba5302'
> > > > > > > > > >
> > > > > > > > > > probably due to:
> > > > > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.HostM
> > > > > > > > > > onit
> > > > > > > > > > or
> > > > > > > > > > ing]
> > > > > > > > > > (DefaultQuartzScheduler6) [] Failure to
refresh
> > > > > > > > > > Vds
> > > > > > > > > > runtime info:
> > > > > > > > > > VDSGenericException:
VDSNetworkException: Message
> > > > > > > > > > timeout which can
> > > > > > > > > > be
> > > > > > > > > > caused by communication issues
> > > > > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.HostM
> > > > > > > > > > onit
> > > > > > > > > > or
> > > > > > > > > > ing]
> > > > > > > > > > (DefaultQuartzScheduler6) []
Exception:
> > > > > > > > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetw
> > > > > > > > > > orkE
> > > > > > > > > > xc
> > > > > > > > > > eption:
> > > > > > > > > > VDSGenericException:
VDSNetworkException: Message
> > > > > > > > > > timeout which can
> > > > > > > > > > be
> > > > > > > > > > caused by communication issues
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > This messages maybe cause by connection
issues from
> > > > > > > > > yesterday at 6pm.
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > can you please check if the engine VM
could
> > > > > > > > > > correctly
> > > > > > > > > > resolve and
> > > > > > > > > > reach each host?
> > > > > > > > >
> > > > > > > > > Now i can read engine VM from both hosts
> > > > > > > > >
> > > > > > > > > [root@ied-blade11 ~]# ping
ied-hosted-engine
> > > > > > > > > PING
ied-hosted-engine.install.eurotux.local
> > > > > > > > > (10.10.4.115) 56(84)
> > > > > > > > > bytes
> > > > > > > > > of data.
> > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > engine.install.eurotux.local
> > > > > > > > > (10.10.4.115):
> > > > > > > > > icmp_seq=1 ttl=64 time=0.179 ms
> > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > engine.install.eurotux.local
> > > > > > > > > (10.10.4.115):
> > > > > > > > > icmp_seq=2 ttl=64 time=0.141 ms
> > > > > > > > > ^C
> > > > > > > > > --- ied-hosted-engine.install.eurotux.local
ping
> > > > > > > > > statistics ---
> > > > > > > > > 2 packets transmitted, 2 received, 0% packet
loss,
> > > > > > > > > time
> > > > > > > > > 999ms
> > > > > > > > > rtt min/avg/max/mdev =
0.141/0.160/0.179/0.019 ms
> > > > > > > > > [root@ied-blade13 ~]# ping
ied-hosted-engine
> > > > > > > > > PING
ied-hosted-engine.install.eurotux.local
> > > > > > > > > (10.10.4.115) 56(84)
> > > > > > > > > bytes
> > > > > > > > > of data.
> > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > engine.install.eurotux.local
> > > > > > > > > (10.10.4.115):
> > > > > > > > > icmp_seq=1 ttl=64 time=0.172 ms
> > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > engine.install.eurotux.local
> > > > > > > > > (10.10.4.115):
> > > > > > > > > icmp_seq=2 ttl=64 time=0.169 ms
> > > > > > > > > ^C
> > > > > > > > > --- ied-hosted-engine.install.eurotux.local
ping
> > > > > > > > > statistics ---
> > > > > > > > > 2 packets transmitted, 2 received, 0% packet
loss,
> > > > > > > > > time
> > > > > > > > > 1000ms
> > > > > > > > > rtt min/avg/max/mdev =
0.169/0.170/0.172/0.013 ms
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I have a message critical of low disk space
on
> > > > > > > > > hosted_storage domain.
> > > > > > > > > I have 50G of disk and i created i VM with
40G. Do
> > > > > > > > > i
> > > > > > > > > need
> > > > > > > > > more space
> > > > > > > > > of
> > > > > > > > > OVF_STORAGE?
> > > > > > > > > What is the minimum requirements of disk
space for
> > > > > > > > > deploy
> > > > > > > > > engine VM?
> > > > > > > > >
> > > > > > > > > Regards,
> > > > > > > > > Carlos
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > Regards,
> > > > > > > > > > > > > > > > > >
> > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > Regards,
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > --
> > > > > > > > > > > > > > > > > >
> > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > Engenheiro de Software
> > > > > > > > > > > > > > > > > >
> > > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > Eurotux Informática,
> > > > > > > > > > > > > > > > > >
> > > > > S.A. |
> > > > > > > > > > > > > > > > > >
> > > > > w
> > > > > > > > > > > > > > > > > >
> > > > > ww.eurotux.c
> > > > > > > > > > > > > > > > > >
> > > > > om
> > > > > > > > > > > > > > > > > >
> > > > > (t) +351 253 680 300
> > > > > > > > > > > > > > > > > >
> > > > > (m)
> > > > > > > > > > > > > > > > > >
> > > > > +351
> > > > > > > > > > > > > > > > > >
> > > > > 911 926 110
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > _______________________
> > > > > > > > > > > > > > > > > >
> > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > ____________
> > > > > > > > > > > > > > > > > >
> > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > Users mailing list
> > > > > > > > > > > > > > > > > >
> > > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > http://lists.ovirt.org/
> > > > > > > > > > > > > > > > > >
> > > > > mail
> > > > > > > > > > > > > > > > > >
> > > > > ma
> > > > > > > > > > > > > > > > > >
> > > > > n/listinfo/u
> > > > > > > > > > > > > > > > > >
> > > > > se
> > > > > > > > > > > > > > > > > >
> > > > > rs
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > --
> > > > > > > > > > > > > > > > > >
> > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > Engenheiro de Software
> > > > > > > > > > > > > > > > > >
> > > Sénior
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > Eurotux Informática, S.A. |
> > > > > > > > > > > > > > > > > >
> > > www.e
> > > > > > > > > > > > > > > > > >
> > > urotux.com
> > > > > > > > > > > > > > > > > >
> > > (t) +351 253 680 300 (m)
> > > > > > > > > > > > > > > > > >
> > > +351
> > > > > > > > > > > > > > > > > >
> > > 911
> > > > > > > > > > > > > > > > > >
> > > 926 110
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > ___________________________
> > > > > > > > > > > > > > > > > >
> > > ____
> > > > > > > > > > > > > > > > > >
> > > __
> > > > > > > > > > > > > > > > > >
> > > ____________
> > > > > > > > > > > > > > > > > >
> > > __
> > > > > > > > > > > > > > > > > >
> > > Users mailing list
> > > > > > > > > > > > > > > > > >
> > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > http://lists.ovirt.org/mail
> > > > > > > > > > > > > > > > > >
> > > man/
> > > > > > > > > > > > > > > > > >
> > > li
> > > > > > > > > > > > > > > > > >
> > > stinfo/users
> > > > > > > > > > > > > > > > > >
> --
> > > > > > > > > > > > > > > > > >
> Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Eurotux Informática, S.A. | www
> > > > > > > > > > > > > > > > > >
> .eur
> > > > > > > > > > > > > > > > > >
> ot
> > > > > > > > > > > > > > > > > >
> ux.com
> > > > > > > > > > > > > > > > > >
> (t) +351 253 680 300 (m) +351
> > > > > > > > > > > > > > > > > >
> 911
> > > > > > > > > > > > > > > > > >
> 926
> > > > > > > > > > > > > > > > > >
> 110
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
Eurotux Informática, S.A. | www.eur
> > > > > > > > > > > > > > > > >
otux
> > > > > > > > > > > > > > > > > .c
> > > > > > > > > > > > > > > > > om
> > > > > > > > > > > > > > > > > (t)
+351 253 680 300 (m) +351 911
> > > > > > > > > > > > > > > > > 926
> > > > > > > > > > > > > > > > > 110
> > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurotux
> > > > > > > > > > > > > > > .com
> > > > > > > > > > > > > > > (t) +351 253
680 300 (m) +351 911 926
> > > > > > > > > > > > > > > 110
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > >
> > > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > > >
> > > > > > > > > > > > > Eurotux Informática,
S.A. | www.eurotux.com
> > > > > > > > > > > > > (t) +351 253 680 300 (m)
+351 911 926 110
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > >
> > > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > > >
> > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > (t) +351 253 680 300 (m) +351 911
926 110
> > > > > > > > >
_______________________________________________
> > > > > > > > > Users mailing list
> > > > > > > > > Users(a)ovirt.org
> > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > --
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > Engenheiro de Software Sénior
> > > > > > > >
> > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > >
> > > > > > --
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > Engenheiro de Software Sénior
> > > > > >
> > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > >
> > > > > >
> > > > >
> > > > --
> > > > Carlos Rodrigues
> > > >
> > > > Engenheiro de Software Sénior
> > > >
> > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > >
> > > >
> > >
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
>
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
2:10 p.m.
On Fri, 2016-08-19 at 11:50 +0100, Carlos Rodrigues wrote:
On Fri, 2016-08-19 at 12:24 +0200, Simone Tiraboschi wrote:
>
> On Fri, Aug 19, 2016 at 12:07 PM, Carlos Rodrigues <cmar(a)eurotux.co
> m>
> wrote:
> >
> >
> > On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote:
> > >
> > >
> > > On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote:
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues <cmar@euro
> > > > tu
> > > > x.co
> > > > m>
> > > > wrote:
> > > > >
> > > > >
> > > > >
> > > > > After night, the OVF_STORE it was created:
> > > > >
> > > >
> > > > It's quite strange that it got so long but now it looks fine.
> > > >
> > > > If the ISO_DOMAIN that I see in your screenshot is served by
> > > > the
> > > > engine VM itself, I suggest to remove it and export from an
> > > > external
> > > > server.
> > > > Serving the ISO storage domain from the engine VM itself is
> > > > not
> > > > a
> > > > good idea since when the engine VM is down you can experiment
> > > > long
> > > > delays before getting the engine VM restarted due to the
> > > > unavailable
> > > > storage domain.
> > >
> > > Ok, thank you for advice.
> > >
> > > Now, apparently is all ok. I'll do more tests with HA and any
> > > issue
> > > i'll tell you.
> > >
> > > Thank you for your support.
> > >
> > > Regards,
> > > Carlos Rodrigues
> > >
> >
> > I shutdown the network of host with engine VM and i expected that
> > other
> > host fence the host and start engine VM but i don't see any fence
> > action and the "free" host keep trying to start VM but get and
> > error of
> > sanlock
> >
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-
> > kvm:
> > sending ioctl 5326 to a partition!
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-
> > kvm:
> > sending ioctl 80200204 to a partition!
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: 1
> > guest
> > now active
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]:
> > 2016-
> > 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 delta 1
> > 9
> > 245502 alive
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]:
> > 2016-
> > 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error -243
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]:
> > 2016-
> > 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862
> > acquire_token
> > -243 lease owned by other host
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local libvirtd[1369]:
> > resource busy: Failed to acquire lock: error -243
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > ovirtmgmt:
> > port 2(vnet0) entered disabled state
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: device
> > vnet0
> > left promiscuous mode
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > ovirtmgmt:
> > port 2(vnet0) entered disabled state
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: 0
> > guests
> > now active
> > Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd-
> > machined[7863]: Machine qemu-4-HostedEngine terminated.
>
> Maybe you hit this one:
> https://bugzilla.redhat.com/show_bug.cgi?id=1322849
>
>
> Can you please check it as described in comment 28 and eventually
> apply the workaround in comment 18?
>
Apparently the host-id its ok. I don't need to apply the workaround.
Any other suggestion?
I check that second host doens't fence the failed host and maybe this
cause the lock of hosted storage domain.
After recover network, engine VM check hosts and send fence commands to
the hosts. In some cases, it sends fence commands to both hosts.
Regards,
Carlos Rodrigues
>
>
>
> >
> >
> > >
> > >
> > > >
> > > >
> > > > >
> > > > >
> > > > > Regards,
> > > > > Carlos Rodrigues
> > > > >
> > > > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues
<cmar@e
> > > > > > ur
> > > > > > otux
> > > > > > .c
> > > > > > om> wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos
Rodrigues
> > > > > > > > <cmar
> > > > > > > > @eur
> > > > > > > > ot
> > > > > > > > ux.com> wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I increase hosted_engine disk space to 160G.
How do
> > > > > > > > > i
> > > > > > > > > force
> > > > > > > > > to create
> > > > > > > > > OVF_STORE.
> > > > > > > >
> > > > > > > > I think that restarting the engine on the engine
VM
> > > > > > > > will
> > > > > > > > trigger it
> > > > > > > > although I'm not sure that it was a size
issue.
> > > > > > > >
> > > > > > >
> > > > > > > I found to OVF_STORE on another storage domain with
> > > > > > > "Domain
> > > > > > > Type" "Data (Master)"
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > Each storage domain has its own OVF_STORE volumes; you
> > > > > > should
> > > > > > get
> > > > > > them also on the hosted-engine storage domain.
> > > > > > Not really sure about how to trigger it again; adding Roy
> > > > > > here.
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Regards,
> > > > > > > > > Carlos Rodrigues
> > > > > > > > >
> > > > > > > > > On Thu, 2016-08-18 at 12:14 +0100, Carlos
Rodrigues
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, 2016-08-18 at 12:34 +0200,
Simone
> > > > > > > > > > Tiraboschi
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Thu, Aug 18, 2016 at 12:11 PM,
Carlos
> > > > > > > > > > > Rodrigues
> > > > > > > > > > > <cma
> > > > > > > > > > > r(a)eurotux.co
> > > > > > > > > > > m>
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, 2016-08-18 at 11:53
+0200, Simone
> > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, Aug 18, 2016 at
11:50 AM, Carlos
> > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > <cmar@eurotu
> > > > > > > > > > > > > x.
> > > > > > > > > > > > > com>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Thu, 2016-08-18
at 11:42 +0200, Simone
> > > > > > > > > > > > > > Tiraboschi wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Thu, Aug
18, 2016 at 11:25 AM,
> > > > > > > > > > > > > > > Carlos
> > > > > > > > > > > > > > > Rodrigues
<cmar@eu
> > > > > > > > > > > > > > > ro
> > > > > > > > > > > > > > > tux.
> > > > > > > > > > > > > > > com>
wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Thu,
2016-08-18 at 11:04 +0200,
> > > > > > > > > > > > > > > > Simone
> > > > > > > > > > > > > > > >
Tiraboschi
> > > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On
Thu, Aug 18, 2016 at 10:36 AM,
> > > > > > > > > > > > > > > > >
Carlos
> > > > > > > > > > > > > > > > >
Rodrigues
> > > > > > > > > > > > > > > > >
<cmar@
> > > > > > > > > > > > > > > > >
euro
> > > > > > > > > > > > > > > > >
tux.com>
> > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
On Thu, 2016-08-18 at 10:27
> > > > > > > > > > > > > > > > > >
+0200,
> > > > > > > > > > > > > > > > > >
Simone
> > > > > > > > > > > > > > > > > >
Tiraboschi
> > > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> On Thu, Aug 18, 2016 at 10:22
> > > > > > > > > > > > > > > > > >
> AM,
> > > > > > > > > > > > > > > > > >
> Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> <cmar@
> > > > > > > > > > > > > > > > > >
> eurotux.
> > > > > > > > > > > > > > > > > >
> com>
> > > > > > > > > > > > > > > > > >
> wrote:
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > On Thu, 2016-08-18 at 08:54
> > > > > > > > > > > > > > > > > >
> > +0200,
> > > > > > > > > > > > > > > > > >
> > Simone
> > > > > > > > > > > > > > > > > >
> > Tiraboschi
> > > > > > > > > > > > > > > > > >
> > wrote:
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > On Tue, Aug 16, 2016 at
> > > > > > > > > > > > > > > > > >
> > > 12:53
> > > > > > > > > > > > > > > > > >
> > > PM,
> > > > > > > > > > > > > > > > > >
> > > Carlos
> > > > > > > > > > > > > > > > > >
> > > Rodrigues <c
> > > > > > > > > > > > > > > > > >
> > > mar@euro
> > > > > > > > > > > > > > > > > >
> > > tux.
> > > > > > > > > > > > > > > > > >
> > > com>
> > > > > > > > > > > > > > > > > >
> > > wrote:
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > On Sun, 2016-08-14 at
> > > > > > > > > > > > > > > > > >
> > > > 14:22
> > > > > > > > > > > > > > > > > >
> > > > +0300, Roy Golan
> > > > > > > > > > > > > > > > > >
> > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > On 12 August 2016 at
> > > > > > > > > > > > > > > > > >
> > > > > 20:23,
> > > > > > > > > > > > > > > > > >
> > > > > Carlos
> > > > > > > > > > > > > > > > > >
> > > > > Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > <cma
> > > > > > > > > > > > > > > > > >
> > > > > r@eurotu
> > > > > > > > > > > > > > > > > >
> > > > > x.co
> > > > > > > > > > > > > > > > > >
> > > > > m>
> > > > > > > > > > > > > > > > > >
> > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > Hello,
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > I have one cluster
> > > > > > > > > > > > > > > > > >
> > > > > > with
> > > > > > > > > > > > > > > > > >
> > > > > > two
> > > > > > > > > > > > > > > > > >
> > > > > > hosts with
> > > > > > > > > > > > > > > > > >
> > > > > > power
> > > > > > > > > > > > > > > > > >
> > > > > > management
> > > > > > > > > > > > > > > > > >
> > > > > > correctly
> > > > > > > > > > > > > > > > > >
> > > > > > configured and one
> > > > > > > > > > > > > > > > > >
> > > > > > virtual
> > > > > > > > > > > > > > > > > >
> > > > > > machine with
> > > > > > > > > > > > > > > > > >
> > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > over
> > > > > > > > > > > > > > > > > >
> > > > > > shared
> > > > > > > > > > > > > > > > > >
> > > > > > storage with
> > > > > > > > > > > > > > > > > >
> > > > > > FiberChannel.
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > When i shutdown the
> > > > > > > > > > > > > > > > > >
> > > > > > network
> > > > > > > > > > > > > > > > > >
> > > > > > of host with
> > > > > > > > > > > > > > > > > >
> > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > VM, it
> > > > > > > > > > > > > > > > > >
> > > > > > should be
> > > > > > > > > > > > > > > > > >
> > > > > > possible the
> > > > > > > > > > > > > > > > > >
> > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > VM
> > > > > > > > > > > > > > > > > >
> > > > > > migrate
> > > > > > > > > > > > > > > > > >
> > > > > > automatically to
> > > > > > > > > > > > > > > > > >
> > > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > > host?
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > migrate on which
> > > > > > > > > > > > > > > > > >
> > > > > network?
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > What is the expected
> > > > > > > > > > > > > > > > > >
> > > > > > behaviour on this HA
> > > > > > > > > > > > > > > > > >
> > > > > > scenario?
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > After a few minutes
> > > > > > > > > > > > > > > > > >
> > > > > your
> > > > > > > > > > > > > > > > > >
> > > > > vm
> > > > > > > > > > > > > > > > > >
> > > > > will be
> > > > > > > > > > > > > > > > > >
> > > > > shutdown
> > > > > > > > > > > > > > > > > >
> > > > > by
> > > > > > > > > > > > > > > > > >
> > > > > the High
> > > > > > > > > > > > > > > > > >
> > > > > Availability
> > > > > > > > > > > > > > > > > >
> > > > > agent, as it can't see
> > > > > > > > > > > > > > > > > >
> > > > > network,
> > > > > > > > > > > > > > > > > >
> > > > > and started
> > > > > > > > > > > > > > > > > >
> > > > > on
> > > > > > > > > > > > > > > > > >
> > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > host.
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > I'm testing this scenario
> > > > > > > > > > > > > > > > > >
> > > > and
> > > > > > > > > > > > > > > > > >
> > > > after shutdown
> > > > > > > > > > > > > > > > > >
> > > > network, it
> > > > > > > > > > > > > > > > > >
> > > > should
> > > > > > > > > > > > > > > > > >
> > > > be
> > > > > > > > > > > > > > > > > >
> > > > expected that agent
> > > > > > > > > > > > > > > > > >
> > > > shutdown ha
> > > > > > > > > > > > > > > > > >
> > > > and started
> > > > > > > > > > > > > > > > > >
> > > > on
> > > > > > > > > > > > > > > > > >
> > > > another
> > > > > > > > > > > > > > > > > >
> > > > host,
> > > > > > > > > > > > > > > > > >
> > > > but
> > > > > > > > > > > > > > > > > >
> > > > after
> > > > > > > > > > > > > > > > > >
> > > > couple minutes nothing
> > > > > > > > > > > > > > > > > >
> > > > happens
> > > > > > > > > > > > > > > > > >
> > > > and on host
> > > > > > > > > > > > > > > > > >
> > > > with
> > > > > > > > > > > > > > > > > >
> > > > network we
> > > > > > > > > > > > > > > > > >
> > > > getting
> > > > > > > > > > > > > > > > > >
> > > > the
> > > > > > > > > > > > > > > > > >
> > > > following messages:
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > Aug 16 11:44:08 ied-
> > > > > > > > > > > > > > > > > >
> > > > blade11.install.eurotux.l
> > > > > > > > > > > > > > > > > >
> > > > oc
> > > > > > > > > > > > > > > > > >
> > > > al
> > > > > > > > > > > > > > > > > >
> > > > ovirt-ha-
> > > > > > > > > > > > > > > > > >
> > > > agent[2779]:
> > > > > > > > > > > > > > > > > >
> > > > ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
> > > > ovirt_hosted_engine_ha.ag
> > > > > > > > > > > > > > > > > >
> > > > en
> > > > > > > > > > > > > > > > > >
> > > > t.ho
> > > > > > > > > > > > > > > > > >
> > > > st
> > > > > > > > > > > > > > > > > >
> > > > ed_engine.Ho
> > > > > > > > > > > > > > > > > >
> > > > st
> > > > > > > > > > > > > > > > > >
> > > > edEn
> > > > > > > > > > > > > > > > > >
> > > > gine.con
> > > > > > > > > > > > > > > > > >
> > > > fig
> > > > > > > > > > > > > > > > > >
> > > > ERROR
> > > > > > > > > > > > > > > > > >
> > > > Unable to get vm.conf
> > > > > > > > > > > > > > > > > >
> > > > from
> > > > > > > > > > > > > > > > > >
> > > > OVF_STORE, falling
> > > > > > > > > > > > > > > > > >
> > > > back
> > > > > > > > > > > > > > > > > >
> > > > to
> > > > > > > > > > > > > > > > > >
> > > > initial
> > > > > > > > > > > > > > > > > >
> > > > vm.conf
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > I think the HA agent its
> > > > > > > > > > > > > > > > > >
> > > > trying
> > > > > > > > > > > > > > > > > >
> > > > to get vm
> > > > > > > > > > > > > > > > > >
> > > > configuration but
> > > > > > > > > > > > > > > > > >
> > > > some
> > > > > > > > > > > > > > > > > >
> > > > how it
> > > > > > > > > > > > > > > > > >
> > > > can't get vm.conf to
> > > > > > > > > > > > > > > > > >
> > > > start
> > > > > > > > > > > > > > > > > >
> > > > VM.
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > No, this is a different
> > > > > > > > > > > > > > > > > >
> > > issues.
> > > > > > > > > > > > > > > > > >
> > > In 3.6 we added a feature
> > > > > > > > > > > > > > > > > >
> > > to
> > > > > > > > > > > > > > > > > >
> > > let
> > > > > > > > > > > > > > > > > >
> > > the engine
> > > > > > > > > > > > > > > > > >
> > > manage
> > > > > > > > > > > > > > > > > >
> > > also the
> > > > > > > > > > > > > > > > > >
> > > engine VM
> > > > > > > > > > > > > > > > > >
> > > itself; ovirt-ha-agent will
> > > > > > > > > > > > > > > > > >
> > > pickup
> > > > > > > > > > > > > > > > > >
> > > the latest
> > > > > > > > > > > > > > > > > >
> > > engine
> > > > > > > > > > > > > > > > > >
> > > VM
> > > > > > > > > > > > > > > > > >
> > > configuration
> > > > > > > > > > > > > > > > > >
> > > from the OVF_STORE which is
> > > > > > > > > > > > > > > > > >
> > > managed
> > > > > > > > > > > > > > > > > >
> > > by the
> > > > > > > > > > > > > > > > > >
> > > engine.
> > > > > > > > > > > > > > > > > >
> > > If something goes wrong,
> > > > > > > > > > > > > > > > > >
> > > ovirt-
> > > > > > > > > > > > > > > > > >
> > > ha-
> > > > > > > > > > > > > > > > > >
> > > agent could
> > > > > > > > > > > > > > > > > >
> > > fallback to the
> > > > > > > > > > > > > > > > > >
> > > initial
> > > > > > > > > > > > > > > > > >
> > > (bootstrap time) vm.conf.
> > > > > > > > > > > > > > > > > >
> > > This
> > > > > > > > > > > > > > > > > >
> > > will
> > > > > > > > > > > > > > > > > >
> > > normally
> > > > > > > > > > > > > > > > > >
> > > happen
> > > > > > > > > > > > > > > > > >
> > > till you
> > > > > > > > > > > > > > > > > >
> > > add
> > > > > > > > > > > > > > > > > >
> > > your
> > > > > > > > > > > > > > > > > >
> > > first regular storage
> > > > > > > > > > > > > > > > > >
> > > domain
> > > > > > > > > > > > > > > > > >
> > > and
> > > > > > > > > > > > > > > > > >
> > > the engine
> > > > > > > > > > > > > > > > > >
> > > imports
> > > > > > > > > > > > > > > > > >
> > > the
> > > > > > > > > > > > > > > > > >
> > > engine
> > > > > > > > > > > > > > > > > >
> > > VM.
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > But i already have my first
> > > > > > > > > > > > > > > > > >
> > storage
> > > > > > > > > > > > > > > > > >
> > domain and
> > > > > > > > > > > > > > > > > >
> > storage
> > > > > > > > > > > > > > > > > >
> > engine
> > > > > > > > > > > > > > > > > >
> > domain
> > > > > > > > > > > > > > > > > >
> > and already imported engine
> > > > > > > > > > > > > > > > > >
> > VM.
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > I'm using 4.0 version.
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> This seams an issue, can you
> > > > > > > > > > > > > > > > > >
> please
> > > > > > > > > > > > > > > > > >
> share your
> > > > > > > > > > > > > > > > > >
> /var/log/ovirt-hosted-engine-
> > > > > > > > > > > > > > > > > >
> ha/agent.log ?
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
I sent it in attachment.
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
Nothing strange here;
> > > > > > > > > > > > > > > > > do
you see a couple of disks with
> > > > > > > > > > > > > > > > >
alias
> > > > > > > > > > > > > > > > >
OVF_STORE on
> > > > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > > >
hosted-
> > > > > > > > > > > > > > > > >
engine
> > > > > > > > > > > > > > > > >
storage domain if you check it from
> > > > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > > >
engine?
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Do you
mean any disk label?
> > > > > > > > > > > > > > > > I
don't have it anyone:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
[root@ied-blade11 ~]# ls
> > > > > > > > > > > > > > > >
/dev/disk/by-
> > > > > > > > > > > > > > > > label/
> > > > > > > > > > > > > > > > ls:
cannot access /dev/disk/by-
> > > > > > > > > > > > > > > > label/:
> > > > > > > > > > > > > > > > No
> > > > > > > > > > > > > > > > such file
or
> > > > > > > > > > > > > > > >
directory
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > No I mean: go
to the engine web-ui,
> > > > > > > > > > > > > > > select
> > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > hosted-
> > > > > > > > > > > > > > > engine
> > > > > > > > > > > > > > > storage
> > > > > > > > > > > > > > > domain, check
the disks there.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > No, the alias is
virtio-disk0.
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > And this is the engine
VM disk, so the
> > > > > > > > > > > > > issue
> > > > > > > > > > > > > is
> > > > > > > > > > > > > why
> > > > > > > > > > > > > the engine
> > > > > > > > > > > > > has
> > > > > > > > > > > > > still to create the
OVF_STORE.
> > > > > > > > > > > > > Can you please share
your engine.log from
> > > > > > > > > > > > > the
> > > > > > > > > > > > > engine VM?
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Go in attachment.
> > > > > > > > > > >
> > > > > > > > > > > The creation of the OVF_STORE disk
failed but
> > > > > > > > > > > it's
> > > > > > > > > > > not
> > > > > > > > > > > that clear
> > > > > > > > > > > why:
> > > > > > > > > > >
> > > > > > > > > > > 2016-08-17 08:43:33,538 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.Cre
> > > > > > > > > > > at
> > > > > > > > > > > eOvf
> > > > > > > > > > > Vo
> > > > > > > > > > > lumeForStora
> > > > > > > > > > > ge
> > > > > > > > > > > DomainCommand]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4] Ending
> > > > > > > > > > > command
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.Cre
> > > > > > > > > > > at
> > > > > > > > > > > eOvf
> > > > > > > > > > > Vo
> > > > > > > > > > > lumeForStora
> > > > > > > > > > > ge
> > > > > > > > > > > DomainCommand'
> > > > > > > > > > > with failure.
> > > > > > > > > > > 2016-08-17 08:43:33,540 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > Co
> > > > > > > > > > > mman
> > > > > > > > > > > d]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4] Ending
> > > > > > > > > > > command
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > Co
> > > > > > > > > > > mman
> > > > > > > > > > > d'
> > > > > > > > > > > with
> > > > > > > > > > > failure.
> > > > > > > > > > > 2016-08-17 08:43:33,541 WARN
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > Co
> > > > > > > > > > > mman
> > > > > > > > > > > d]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4]
> > > > > > > > > > > VmCommand::EndVmCommand: Vm is
> > > > > > > > > > > null - not performing endAction on
Vm
> > > > > > > > > > > 2016-08-17 08:43:33,553 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghan
> > > > > > > > > > > dl
> > > > > > > > > > > ing.
> > > > > > > > > > > Au
> > > > > > > > > > > ditLogDirect
> > > > > > > > > > > or
> > > > > > > > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4]
> > > > > > > > > > > Correlation
> > > > > > > > > > > ID:
> > > > > > > > > > > 6f1f1fd4, Call
> > > > > > > > > > > Stack: null, Custom Event ID: -1,
Message: Add-
> > > > > > > > > > > Disk
> > > > > > > > > > > operation
> > > > > > > > > > > failed
> > > > > > > > > > > to complete.
> > > > > > > > > > > 2016-08-17 08:43:33,557 WARN
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghan
> > > > > > > > > > > dl
> > > > > > > > > > > ing.
> > > > > > > > > > > Au
> > > > > > > > > > > ditLogDirect
> > > > > > > > > > > or
> > > > > > > > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler6) []
Correlation ID:
> > > > > > > > > > > 19ac5bda,
> > > > > > > > > > > Call Stack:
> > > > > > > > > > > null, Custom Event ID: -1,
Message: Failed to
> > > > > > > > > > > create
> > > > > > > > > > > OVF store disk
> > > > > > > > > > > for Storage Domain
hosted_storage.
> > > > > > > > > > > OVF data won't be updated
meanwhile for that
> > > > > > > > > > > domain.
> > > > > > > > > > > 2016-08-17 08:43:33,585 INFO
> > > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsE
> > > > > > > > > > > xe
> > > > > > > > > > > cuti
> > > > > > > > > > > on
> > > > > > > > > > > Callback]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5f5a8daf] Command
> > > > > > > > > > >
'ProcessOvfUpdateForStorageDomain' (id:
> > > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting
> > > > > > > > > > > on
> > > > > > > > > > > child command
> > > > > > > > > > > id:
> > > > > > > > > > >
'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > > > > > > > > > >
type:'CreateOvfVolumeForStorageDomain' to
> > > > > > > > > > > complete
> > > > > > > > > > > 2016-08-17 08:43:33,595 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.Cre
> > > > > > > > > > > at
> > > > > > > > > > > eOvf
> > > > > > > > > > > Vo
> > > > > > > > > > > lumeForStora
> > > > > > > > > > > ge
> > > > > > > > > > > DomainCommand]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49] Ending
> > > > > > > > > > > command
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.Cre
> > > > > > > > > > > at
> > > > > > > > > > > eOvf
> > > > > > > > > > > Vo
> > > > > > > > > > > lumeForStora
> > > > > > > > > > > ge
> > > > > > > > > > > DomainCommand'
> > > > > > > > > > > with failure.
> > > > > > > > > > > 2016-08-17 08:43:33,596 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > Co
> > > > > > > > > > > mman
> > > > > > > > > > > d]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49] Ending
> > > > > > > > > > > command
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > Co
> > > > > > > > > > > mman
> > > > > > > > > > > d'
> > > > > > > > > > > with
> > > > > > > > > > > failure.
> > > > > > > > > > > 2016-08-17 08:43:33,596 WARN
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > Co
> > > > > > > > > > > mman
> > > > > > > > > > > d]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49]
> > > > > > > > > > > VmCommand::EndVmCommand: Vm is
> > > > > > > > > > > null - not performing endAction on
Vm
> > > > > > > > > > > 2016-08-17 08:43:33,602 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghan
> > > > > > > > > > > dl
> > > > > > > > > > > ing.
> > > > > > > > > > > Au
> > > > > > > > > > > ditLogDirect
> > > > > > > > > > > or
> > > > > > > > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49]
> > > > > > > > > > > Correlation
> > > > > > > > > > > ID:
> > > > > > > > > > > 5d314e49, Call
> > > > > > > > > > > Stack: null, Custom Event ID: -1,
Message: Add-
> > > > > > > > > > > Disk
> > > > > > > > > > > operation
> > > > > > > > > > > failed
> > > > > > > > > > > to complete.
> > > > > > > > > > > 2016-08-17 08:43:33,605 WARN
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghan
> > > > > > > > > > > dl
> > > > > > > > > > > ing.
> > > > > > > > > > > Au
> > > > > > > > > > > ditLogDirect
> > > > > > > > > > > or
> > > > > > > > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler6) []
Correlation ID:
> > > > > > > > > > > 5f5a8daf,
> > > > > > > > > > > Call Stack:
> > > > > > > > > > > null, Custom Event ID: -1,
Message: Failed to
> > > > > > > > > > > create
> > > > > > > > > > > OVF store disk
> > > > > > > > > > > for Storage Domain
hosted_storage.
> > > > > > > > > > > OVF data won't be updated
meanwhile for that
> > > > > > > > > > > domain.
> > > > > > > > > > > 2016-08-17 08:43:36,460 INFO
> > > > > > > > > > >
[org.ovirt.engine.core.bll.scheduling.HaReserva
> > > > > > > > > > > ti
> > > > > > > > > > > onHa
> > > > > > > > > > > nd
> > > > > > > > > > > ling]
> > > > > > > > > > > (DefaultQuartzScheduler7)
[5d314e49] HA
> > > > > > > > > > > reservation
> > > > > > > > > > > status for
> > > > > > > > > > > cluster
> > > > > > > > > > > 'Default' is 'OK'
> > > > > > > > > > > 2016-08-17 08:43:36,662 INFO
> > > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsE
> > > > > > > > > > > xe
> > > > > > > > > > > cuti
> > > > > > > > > > > on
> > > > > > > > > > > Callback]
> > > > > > > > > > > (DefaultQuartzScheduler4)
[5f5a8daf] Command
> > > > > > > > > > >
'ProcessOvfUpdateForStorageDomain' id:
> > > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child
> > > > > > > > > > > commands
> > > > > > > > > > >
'[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > > > > > > > > > >
eb2e6f1a-c756-4ccd-85a1-60d97d6880de]'
> > > > > > > > > > > executions
> > > > > > > > > > > were
> > > > > > > > > > > completed,
> > > > > > > > > > > status 'FAILED'
> > > > > > > > > > > 2016-08-17 08:43:37,691 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.Pro
> > > > > > > > > > > ce
> > > > > > > > > > > ssOv
> > > > > > > > > > > fU
> > > > > > > > > > > pdateForStor
> > > > > > > > > > > ag
> > > > > > > > > > > eDomainCommand]
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5f5a8daf] Ending
> > > > > > > > > > > command
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.Pro
> > > > > > > > > > > ce
> > > > > > > > > > > ssOv
> > > > > > > > > > > fU
> > > > > > > > > > > pdateForStor
> > > > > > > > > > > ag
> > > > > > > > > > > eDomainCommand'
> > > > > > > > > > > with failure.
> > > > > > > > > > >
> > > > > > > > > > > Can you please check vdsm logs for
that time
> > > > > > > > > > > frame on
> > > > > > > > > > > the SPM host?
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > I sent in attachment the vdsm logs from
both
> > > > > > > > > > hosts,
> > > > > > > > > > but
> > > > > > > > > > i
> > > > > > > > > > think the
> > > > > > > > > > SPM
> > > > > > > > > > host on this time frame it was
ied-blade13
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > It seams that you also have an
issue in the SPM
> > > > > > > > > > > election procedure:
> > > > > > > > > > >
> > > > > > > > > > > 2016-08-17 18:04:31,053 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsP
> > > > > > > > > > > ro
> > > > > > > > > > > xyDa
> > > > > > > > > > > ta
> > > > > > > > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler1) [] SPM
Init: could
> > > > > > > > > > > not
> > > > > > > > > > > find
> > > > > > > > > > > reported vds
> > > > > > > > > > > or
> > > > > > > > > > > not up - pool: 'Default'
vds_spm_id: '2'
> > > > > > > > > > > 2016-08-17 18:04:31,076 INFO
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsP
> > > > > > > > > > > ro
> > > > > > > > > > > xyDa
> > > > > > > > > > > ta
> > > > > > > > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler1) [] SPM
selection -
> > > > > > > > > > > vds
> > > > > > > > > > > seems
> > > > > > > > > > > as spm
> > > > > > > > > > > 'hosted_engine_2'
> > > > > > > > > > > 2016-08-17 18:04:31,076 WARN
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsP
> > > > > > > > > > > ro
> > > > > > > > > > > xyDa
> > > > > > > > > > > ta
> > > > > > > > > > > ]
> > > > > > > > > > > (DefaultQuartzScheduler1) [] spm
vds is non
> > > > > > > > > > > responsive,
> > > > > > > > > > > stopping
> > > > > > > > > > > spm
> > > > > > > > > > > selection.
> > > > > > > > > > > 2016-08-17 18:04:31,539 INFO
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.Vms
> > > > > > > > > > > St
> > > > > > > > > > > atis
> > > > > > > > > > > ti
> > > > > > > > > > > csFetcher]
> > > > > > > > > > > (DefaultQuartzScheduler7) []
Fetched 1 VMs from
> > > > > > > > > > > VDS
> > > > > > > > > > >
'06372186-572c-41ad-916f-7cbb0aba5302'
> > > > > > > > > > >
> > > > > > > > > > > probably due to:
> > > > > > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.Hos
> > > > > > > > > > > tM
> > > > > > > > > > > onit
> > > > > > > > > > > or
> > > > > > > > > > > ing]
> > > > > > > > > > > (DefaultQuartzScheduler6) []
Failure to refresh
> > > > > > > > > > > Vds
> > > > > > > > > > > runtime info:
> > > > > > > > > > > VDSGenericException:
VDSNetworkException:
> > > > > > > > > > > Message
> > > > > > > > > > > timeout which can
> > > > > > > > > > > be
> > > > > > > > > > > caused by communication issues
> > > > > > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.Hos
> > > > > > > > > > > tM
> > > > > > > > > > > onit
> > > > > > > > > > > or
> > > > > > > > > > > ing]
> > > > > > > > > > > (DefaultQuartzScheduler6) []
Exception:
> > > > > > > > > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNe
> > > > > > > > > > > tw
> > > > > > > > > > > orkE
> > > > > > > > > > > xc
> > > > > > > > > > > eption:
> > > > > > > > > > > VDSGenericException:
VDSNetworkException:
> > > > > > > > > > > Message
> > > > > > > > > > > timeout which can
> > > > > > > > > > > be
> > > > > > > > > > > caused by communication issues
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > This messages maybe cause by connection
issues
> > > > > > > > > > from
> > > > > > > > > > yesterday at 6pm.
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > can you please check if the engine
VM could
> > > > > > > > > > > correctly
> > > > > > > > > > > resolve and
> > > > > > > > > > > reach each host?
> > > > > > > > > >
> > > > > > > > > > Now i can read engine VM from both
hosts
> > > > > > > > > >
> > > > > > > > > > [root@ied-blade11 ~]# ping
ied-hosted-engine
> > > > > > > > > > PING
ied-hosted-engine.install.eurotux.local
> > > > > > > > > > (10.10.4.115) 56(84)
> > > > > > > > > > bytes
> > > > > > > > > > of data.
> > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > (10.10.4.115):
> > > > > > > > > > icmp_seq=1 ttl=64 time=0.179 ms
> > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > (10.10.4.115):
> > > > > > > > > > icmp_seq=2 ttl=64 time=0.141 ms
> > > > > > > > > > ^C
> > > > > > > > > > ---
ied-hosted-engine.install.eurotux.local ping
> > > > > > > > > > statistics ---
> > > > > > > > > > 2 packets transmitted, 2 received, 0%
packet
> > > > > > > > > > loss,
> > > > > > > > > > time
> > > > > > > > > > 999ms
> > > > > > > > > > rtt min/avg/max/mdev =
0.141/0.160/0.179/0.019 ms
> > > > > > > > > > [root@ied-blade13 ~]# ping
ied-hosted-engine
> > > > > > > > > > PING
ied-hosted-engine.install.eurotux.local
> > > > > > > > > > (10.10.4.115) 56(84)
> > > > > > > > > > bytes
> > > > > > > > > > of data.
> > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > (10.10.4.115):
> > > > > > > > > > icmp_seq=1 ttl=64 time=0.172 ms
> > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > (10.10.4.115):
> > > > > > > > > > icmp_seq=2 ttl=64 time=0.169 ms
> > > > > > > > > > ^C
> > > > > > > > > > ---
ied-hosted-engine.install.eurotux.local ping
> > > > > > > > > > statistics ---
> > > > > > > > > > 2 packets transmitted, 2 received, 0%
packet
> > > > > > > > > > loss,
> > > > > > > > > > time
> > > > > > > > > > 1000ms
> > > > > > > > > > rtt min/avg/max/mdev =
0.169/0.170/0.172/0.013 ms
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > I have a message critical of low disk
space on
> > > > > > > > > > hosted_storage domain.
> > > > > > > > > > I have 50G of disk and i created i VM
with 40G.
> > > > > > > > > > Do
> > > > > > > > > > i
> > > > > > > > > > need
> > > > > > > > > > more space
> > > > > > > > > > of
> > > > > > > > > > OVF_STORAGE?
> > > > > > > > > > What is the minimum requirements of
disk space
> > > > > > > > > > for
> > > > > > > > > > deploy
> > > > > > > > > > engine VM?
> > > > > > > > > >
> > > > > > > > > > Regards,
> > > > > > > > > > Carlos
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > Regards,
> > > > > > > > > > > > > > > > > >
> > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > Regards,
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > --
> > > > > > > > > > > > > > > > > >
> > > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > Engenheiro de
> > > > > > > > > > > > > > > > > >
> > > > > > Software
> > > > > > > > > > > > > > > > > >
> > > > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > Eurotux Informática,
> > > > > > > > > > > > > > > > > >
> > > > > > S.A. |
> > > > > > > > > > > > > > > > > >
> > > > > > w
> > > > > > > > > > > > > > > > > >
> > > > > > ww.eurotux.c
> > > > > > > > > > > > > > > > > >
> > > > > > om
> > > > > > > > > > > > > > > > > >
> > > > > > (t) +351 253 680 300
> > > > > > > > > > > > > > > > > >
> > > > > > (m)
> > > > > > > > > > > > > > > > > >
> > > > > > +351
> > > > > > > > > > > > > > > > > >
> > > > > > 911 926 110
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > _____________________
> > > > > > > > > > > > > > > > > >
> > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > ____________
> > > > > > > > > > > > > > > > > >
> > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > Users mailing list
> > > > > > > > > > > > > > > > > >
> > > > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > http://lists.ovirt.or
> > > > > > > > > > > > > > > > > >
> > > > > > g/
> > > > > > > > > > > > > > > > > >
> > > > > > mail
> > > > > > > > > > > > > > > > > >
> > > > > > ma
> > > > > > > > > > > > > > > > > >
> > > > > > n/listinfo/u
> > > > > > > > > > > > > > > > > >
> > > > > > se
> > > > > > > > > > > > > > > > > >
> > > > > > rs
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > --
> > > > > > > > > > > > > > > > > >
> > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > Engenheiro de Software
> > > > > > > > > > > > > > > > > >
> > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > Eurotux Informática, S.A.
> > > > > > > > > > > > > > > > > >
> > > > |
> > > > > > > > > > > > > > > > > >
> > > > www.e
> > > > > > > > > > > > > > > > > >
> > > > urotux.com
> > > > > > > > > > > > > > > > > >
> > > > (t) +351 253 680 300 (m)
> > > > > > > > > > > > > > > > > >
> > > > +351
> > > > > > > > > > > > > > > > > >
> > > > 911
> > > > > > > > > > > > > > > > > >
> > > > 926 110
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > _________________________
> > > > > > > > > > > > > > > > > >
> > > > __
> > > > > > > > > > > > > > > > > >
> > > > ____
> > > > > > > > > > > > > > > > > >
> > > > __
> > > > > > > > > > > > > > > > > >
> > > > ____________
> > > > > > > > > > > > > > > > > >
> > > > __
> > > > > > > > > > > > > > > > > >
> > > > Users mailing list
> > > > > > > > > > > > > > > > > >
> > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > http://lists.ovirt.org/ma
> > > > > > > > > > > > > > > > > >
> > > > il
> > > > > > > > > > > > > > > > > >
> > > > man/
> > > > > > > > > > > > > > > > > >
> > > > li
> > > > > > > > > > > > > > > > > >
> > > > stinfo/users
> > > > > > > > > > > > > > > > > >
> > --
> > > > > > > > > > > > > > > > > >
> > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Eurotux Informática, S.A. |
> > > > > > > > > > > > > > > > > >
> > www
> > > > > > > > > > > > > > > > > >
> > .eur
> > > > > > > > > > > > > > > > > >
> > ot
> > > > > > > > > > > > > > > > > >
> > ux.com
> > > > > > > > > > > > > > > > > >
> > (t) +351 253 680 300 (m) +351
> > > > > > > > > > > > > > > > > >
> > 911
> > > > > > > > > > > > > > > > > >
> > 926
> > > > > > > > > > > > > > > > > >
> > 110
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
--
> > > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Eurotux Informática, S.A. | www.e
> > > > > > > > > > > > > > > > > >
ur
> > > > > > > > > > > > > > > > > >
otux
> > > > > > > > > > > > > > > > > >
.c
> > > > > > > > > > > > > > > > > >
om
> > > > > > > > > > > > > > > > > >
(t) +351 253 680 300 (m) +351 911
> > > > > > > > > > > > > > > > > >
926
> > > > > > > > > > > > > > > > > >
110
> > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurot
> > > > > > > > > > > > > > > > ux
> > > > > > > > > > > > > > > > .com
> > > > > > > > > > > > > > > > (t) +351
253 680 300 (m) +351 911 926
> > > > > > > > > > > > > > > > 110
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > --
> > > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurotux.c
> > > > > > > > > > > > > > om
> > > > > > > > > > > > > > (t) +351 253 680
300 (m) +351 911 926 110
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > >
> > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > >
> > > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > (t) +351 253 680 300 (m) +351
911 926 110
> > > > > > > > > >
_______________________________________________
> > > > > > > > > > Users mailing list
> > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > > --
> > > > > > > > > Carlos Rodrigues
> > > > > > > > >
> > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > >
> > > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > > >
> > > > > > > --
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > > Engenheiro de Software Sénior
> > > > > > >
> > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > >
> > > > > > >
> > > > > >
> > > > > --
> > > > > Carlos Rodrigues
> > > > >
> > > > > Engenheiro de Software Sénior
> > > > >
> > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > >
> > > > >
> > > >
> > --
> > Carlos Rodrigues
> >
> > Engenheiro de Software Sénior
> >
> > Eurotux Informática, S.A. | www.eurotux.com
> > (t) +351 253 680 300 (m) +351 911 926 110
> >
> >
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
3:16 p.m.
On Mon, Aug 22, 2016 at 1:10 PM, Carlos Rodrigues <cmar(a)eurotux.com> wrote:
On Fri, 2016-08-19 at 11:50 +0100, Carlos Rodrigues wrote:
> On Fri, 2016-08-19 at 12:24 +0200, Simone Tiraboschi wrote:
> >
> > On Fri, Aug 19, 2016 at 12:07 PM, Carlos Rodrigues <cmar(a)eurotux.co
> > m>
> > wrote:
> > >
> > >
> > > On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote:
> > > >
> > > >
> > > > On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote:
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues <cmar@euro
> > > > > tu
> > > > > x.co
> > > > > m>
> > > > > wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > > After night, the OVF_STORE it was created:
> > > > > >
> > > > >
> > > > > It's quite strange that it got so long but now it looks
fine.
> > > > >
> > > > > If the ISO_DOMAIN that I see in your screenshot is served by
> > > > > the
> > > > > engine VM itself, I suggest to remove it and export from an
> > > > > external
> > > > > server.
> > > > > Serving the ISO storage domain from the engine VM itself is
> > > > > not
> > > > > a
> > > > > good idea since when the engine VM is down you can experiment
> > > > > long
> > > > > delays before getting the engine VM restarted due to the
> > > > > unavailable
> > > > > storage domain.
> > > >
> > > > Ok, thank you for advice.
> > > >
> > > > Now, apparently is all ok. I'll do more tests with HA and any
> > > > issue
> > > > i'll tell you.
> > > >
> > > > Thank you for your support.
> > > >
> > > > Regards,
> > > > Carlos Rodrigues
> > > >
> > >
> > > I shutdown the network of host with engine VM and i expected that
> > > other
> > > host fence the host and start engine VM but i don't see any fence
> > > action and the "free" host keep trying to start VM but get and
> > > error of
> > > sanlock
> > >
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-
> > > kvm:
> > > sending ioctl 5326 to a partition!
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-
> > > kvm:
> > > sending ioctl 80200204 to a partition!
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: 1
> > > guest
> > > now active
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]:
> > > 2016-
> > > 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 delta 1
> > > 9
> > > 245502 alive
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]:
> > > 2016-
> > > 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error -243
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]:
> > > 2016-
> > > 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862
> > > acquire_token
> > > -243 lease owned by other host
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local libvirtd[1369]:
> > > resource busy: Failed to acquire lock: error -243
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > ovirtmgmt:
> > > port 2(vnet0) entered disabled state
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: device
> > > vnet0
> > > left promiscuous mode
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > ovirtmgmt:
> > > port 2(vnet0) entered disabled state
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: 0
> > > guests
> > > now active
> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd-
> > > machined[7863]: Machine qemu-4-HostedEngine terminated.
> >
> > Maybe you hit this one:
> > https://bugzilla.redhat.com/show_bug.cgi?id=1322849
> >
> >
> > Can you please check it as described in comment 28 and eventually
> > apply the workaround in comment 18?
> >
>
> Apparently the host-id its ok. I don't need to apply the workaround.
>
Any other suggestion?
I check that second host doens't fence the failed host and maybe this
cause the lock of hosted storage domain.
The picture isn't still that clear to me: ovirt-ha-agent is not trying
to fence other hosted-engine hosts.
The communication between hosts simply acts trough the metadata area
on the shared storage.
Do you also loose the connection to the storage domain when you play
with the management network on your host?
After recover network, engine VM check hosts and send fence commands
to
the hosts. In some cases, it sends fence commands to both hosts.
Regards,
Carlos Rodrigues
>
> >
> >
> >
> > >
> > >
> > > >
> > > >
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues
<cmar@e
> > > > > > > ur
> > > > > > > otux
> > > > > > > .c
> > > > > > > om> wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, 2016-08-18 at 17:45 +0200, Simone
Tiraboschi
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos
Rodrigues
> > > > > > > > > <cmar
> > > > > > > > > @eur
> > > > > > > > > ot
> > > > > > > > > ux.com> wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > I increase hosted_engine disk space to
160G. How do
> > > > > > > > > > i
> > > > > > > > > > force
> > > > > > > > > > to create
> > > > > > > > > > OVF_STORE.
> > > > > > > > >
> > > > > > > > > I think that restarting the engine on the
engine VM
> > > > > > > > > will
> > > > > > > > > trigger it
> > > > > > > > > although I'm not sure that it was a size
issue.
> > > > > > > > >
> > > > > > > >
> > > > > > > > I found to OVF_STORE on another storage domain
with
> > > > > > > > "Domain
> > > > > > > > Type" "Data (Master)"
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > > Each storage domain has its own OVF_STORE volumes; you
> > > > > > > should
> > > > > > > get
> > > > > > > them also on the hosted-engine storage domain.
> > > > > > > Not really sure about how to trigger it again; adding
Roy
> > > > > > > here.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Regards,
> > > > > > > > > > Carlos Rodrigues
> > > > > > > > > >
> > > > > > > > > > On Thu, 2016-08-18 at 12:14 +0100,
Carlos Rodrigues
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Thu, 2016-08-18 at 12:34 +0200,
Simone
> > > > > > > > > > > Tiraboschi
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, Aug 18, 2016 at 12:11
PM, Carlos
> > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > <cma
> > > > > > > > > > > > r(a)eurotux.co
> > > > > > > > > > > > m>
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, 2016-08-18 at
11:53 +0200, Simone
> > > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Thu, Aug 18, 2016
at 11:50 AM, Carlos
> > > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > > <cmar@eurotu
> > > > > > > > > > > > > > x.
> > > > > > > > > > > > > > com>
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Thu,
2016-08-18 at 11:42 +0200, Simone
> > > > > > > > > > > > > > > Tiraboschi
wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Thu,
Aug 18, 2016 at 11:25 AM,
> > > > > > > > > > > > > > > > Carlos
> > > > > > > > > > > > > > > > Rodrigues
<cmar@eu
> > > > > > > > > > > > > > > > ro
> > > > > > > > > > > > > > > > tux.
> > > > > > > > > > > > > > > > com>
wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On
Thu, 2016-08-18 at 11:04 +0200,
> > > > > > > > > > > > > > > > >
Simone
> > > > > > > > > > > > > > > > >
Tiraboschi
> > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
On Thu, Aug 18, 2016 at 10:36 AM,
> > > > > > > > > > > > > > > > > >
Carlos
> > > > > > > > > > > > > > > > > >
Rodrigues
> > > > > > > > > > > > > > > > > >
<cmar@
> > > > > > > > > > > > > > > > > >
euro
> > > > > > > > > > > > > > > > > >
tux.com>
> > > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> On Thu, 2016-08-18 at 10:27
> > > > > > > > > > > > > > > > > >
> +0200,
> > > > > > > > > > > > > > > > > >
> Simone
> > > > > > > > > > > > > > > > > >
> Tiraboschi
> > > > > > > > > > > > > > > > > >
> wrote:
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > On Thu, Aug 18, 2016 at 10:22
> > > > > > > > > > > > > > > > > >
> > AM,
> > > > > > > > > > > > > > > > > >
> > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > <cmar@
> > > > > > > > > > > > > > > > > >
> > eurotux.
> > > > > > > > > > > > > > > > > >
> > com>
> > > > > > > > > > > > > > > > > >
> > wrote:
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > On Thu, 2016-08-18 at 08:54
> > > > > > > > > > > > > > > > > >
> > > +0200,
> > > > > > > > > > > > > > > > > >
> > > Simone
> > > > > > > > > > > > > > > > > >
> > > Tiraboschi
> > > > > > > > > > > > > > > > > >
> > > wrote:
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > On Tue, Aug 16, 2016 at
> > > > > > > > > > > > > > > > > >
> > > > 12:53
> > > > > > > > > > > > > > > > > >
> > > > PM,
> > > > > > > > > > > > > > > > > >
> > > > Carlos
> > > > > > > > > > > > > > > > > >
> > > > Rodrigues <c
> > > > > > > > > > > > > > > > > >
> > > > mar@euro
> > > > > > > > > > > > > > > > > >
> > > > tux.
> > > > > > > > > > > > > > > > > >
> > > > com>
> > > > > > > > > > > > > > > > > >
> > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > On Sun, 2016-08-14 at
> > > > > > > > > > > > > > > > > >
> > > > > 14:22
> > > > > > > > > > > > > > > > > >
> > > > > +0300, Roy Golan
> > > > > > > > > > > > > > > > > >
> > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > On 12 August 2016 at
> > > > > > > > > > > > > > > > > >
> > > > > > 20:23,
> > > > > > > > > > > > > > > > > >
> > > > > > Carlos
> > > > > > > > > > > > > > > > > >
> > > > > > Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > <cma
> > > > > > > > > > > > > > > > > >
> > > > > > r@eurotu
> > > > > > > > > > > > > > > > > >
> > > > > > x.co
> > > > > > > > > > > > > > > > > >
> > > > > > m>
> > > > > > > > > > > > > > > > > >
> > > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > Hello,
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > I have one cluster
> > > > > > > > > > > > > > > > > >
> > > > > > > with
> > > > > > > > > > > > > > > > > >
> > > > > > > two
> > > > > > > > > > > > > > > > > >
> > > > > > > hosts with
> > > > > > > > > > > > > > > > > >
> > > > > > > power
> > > > > > > > > > > > > > > > > >
> > > > > > > management
> > > > > > > > > > > > > > > > > >
> > > > > > > correctly
> > > > > > > > > > > > > > > > > >
> > > > > > > configured and one
> > > > > > > > > > > > > > > > > >
> > > > > > > virtual
> > > > > > > > > > > > > > > > > >
> > > > > > > machine with
> > > > > > > > > > > > > > > > > >
> > > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > > over
> > > > > > > > > > > > > > > > > >
> > > > > > > shared
> > > > > > > > > > > > > > > > > >
> > > > > > > storage with
> > > > > > > > > > > > > > > > > >
> > > > > > > FiberChannel.
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > When i shutdown the
> > > > > > > > > > > > > > > > > >
> > > > > > > network
> > > > > > > > > > > > > > > > > >
> > > > > > > of host with
> > > > > > > > > > > > > > > > > >
> > > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > > VM, it
> > > > > > > > > > > > > > > > > >
> > > > > > > should be
> > > > > > > > > > > > > > > > > >
> > > > > > > possible the
> > > > > > > > > > > > > > > > > >
> > > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > > VM
> > > > > > > > > > > > > > > > > >
> > > > > > > migrate
> > > > > > > > > > > > > > > > > >
> > > > > > > automatically to
> > > > > > > > > > > > > > > > > >
> > > > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > > > host?
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > migrate on which
> > > > > > > > > > > > > > > > > >
> > > > > > network?
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > What is the expected
> > > > > > > > > > > > > > > > > >
> > > > > > > behaviour on this HA
> > > > > > > > > > > > > > > > > >
> > > > > > > scenario?
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > After a few minutes
> > > > > > > > > > > > > > > > > >
> > > > > > your
> > > > > > > > > > > > > > > > > >
> > > > > > vm
> > > > > > > > > > > > > > > > > >
> > > > > > will be
> > > > > > > > > > > > > > > > > >
> > > > > > shutdown
> > > > > > > > > > > > > > > > > >
> > > > > > by
> > > > > > > > > > > > > > > > > >
> > > > > > the High
> > > > > > > > > > > > > > > > > >
> > > > > > Availability
> > > > > > > > > > > > > > > > > >
> > > > > > agent, as it can't see
> > > > > > > > > > > > > > > > > >
> > > > > > network,
> > > > > > > > > > > > > > > > > >
> > > > > > and started
> > > > > > > > > > > > > > > > > >
> > > > > > on
> > > > > > > > > > > > > > > > > >
> > > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > > host.
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > I'm testing this scenario
> > > > > > > > > > > > > > > > > >
> > > > > and
> > > > > > > > > > > > > > > > > >
> > > > > after shutdown
> > > > > > > > > > > > > > > > > >
> > > > > network, it
> > > > > > > > > > > > > > > > > >
> > > > > should
> > > > > > > > > > > > > > > > > >
> > > > > be
> > > > > > > > > > > > > > > > > >
> > > > > expected that agent
> > > > > > > > > > > > > > > > > >
> > > > > shutdown ha
> > > > > > > > > > > > > > > > > >
> > > > > and started
> > > > > > > > > > > > > > > > > >
> > > > > on
> > > > > > > > > > > > > > > > > >
> > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > host,
> > > > > > > > > > > > > > > > > >
> > > > > but
> > > > > > > > > > > > > > > > > >
> > > > > after
> > > > > > > > > > > > > > > > > >
> > > > > couple minutes nothing
> > > > > > > > > > > > > > > > > >
> > > > > happens
> > > > > > > > > > > > > > > > > >
> > > > > and on host
> > > > > > > > > > > > > > > > > >
> > > > > with
> > > > > > > > > > > > > > > > > >
> > > > > network we
> > > > > > > > > > > > > > > > > >
> > > > > getting
> > > > > > > > > > > > > > > > > >
> > > > > the
> > > > > > > > > > > > > > > > > >
> > > > > following messages:
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > Aug 16 11:44:08 ied-
> > > > > > > > > > > > > > > > > >
> > > > > blade11.install.eurotux.l
> > > > > > > > > > > > > > > > > >
> > > > > oc
> > > > > > > > > > > > > > > > > >
> > > > > al
> > > > > > > > > > > > > > > > > >
> > > > > ovirt-ha-
> > > > > > > > > > > > > > > > > >
> > > > > agent[2779]:
> > > > > > > > > > > > > > > > > >
> > > > > ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
> > > > > ovirt_hosted_engine_ha.ag
> > > > > > > > > > > > > > > > > >
> > > > > en
> > > > > > > > > > > > > > > > > >
> > > > > t.ho
> > > > > > > > > > > > > > > > > >
> > > > > st
> > > > > > > > > > > > > > > > > >
> > > > > ed_engine.Ho
> > > > > > > > > > > > > > > > > >
> > > > > st
> > > > > > > > > > > > > > > > > >
> > > > > edEn
> > > > > > > > > > > > > > > > > >
> > > > > gine.con
> > > > > > > > > > > > > > > > > >
> > > > > fig
> > > > > > > > > > > > > > > > > >
> > > > > ERROR
> > > > > > > > > > > > > > > > > >
> > > > > Unable to get vm.conf
> > > > > > > > > > > > > > > > > >
> > > > > from
> > > > > > > > > > > > > > > > > >
> > > > > OVF_STORE, falling
> > > > > > > > > > > > > > > > > >
> > > > > back
> > > > > > > > > > > > > > > > > >
> > > > > to
> > > > > > > > > > > > > > > > > >
> > > > > initial
> > > > > > > > > > > > > > > > > >
> > > > > vm.conf
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > I think the HA agent its
> > > > > > > > > > > > > > > > > >
> > > > > trying
> > > > > > > > > > > > > > > > > >
> > > > > to get vm
> > > > > > > > > > > > > > > > > >
> > > > > configuration but
> > > > > > > > > > > > > > > > > >
> > > > > some
> > > > > > > > > > > > > > > > > >
> > > > > how it
> > > > > > > > > > > > > > > > > >
> > > > > can't get vm.conf to
> > > > > > > > > > > > > > > > > >
> > > > > start
> > > > > > > > > > > > > > > > > >
> > > > > VM.
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > No, this is a different
> > > > > > > > > > > > > > > > > >
> > > > issues.
> > > > > > > > > > > > > > > > > >
> > > > In 3.6 we added a feature
> > > > > > > > > > > > > > > > > >
> > > > to
> > > > > > > > > > > > > > > > > >
> > > > let
> > > > > > > > > > > > > > > > > >
> > > > the engine
> > > > > > > > > > > > > > > > > >
> > > > manage
> > > > > > > > > > > > > > > > > >
> > > > also the
> > > > > > > > > > > > > > > > > >
> > > > engine VM
> > > > > > > > > > > > > > > > > >
> > > > itself; ovirt-ha-agent will
> > > > > > > > > > > > > > > > > >
> > > > pickup
> > > > > > > > > > > > > > > > > >
> > > > the latest
> > > > > > > > > > > > > > > > > >
> > > > engine
> > > > > > > > > > > > > > > > > >
> > > > VM
> > > > > > > > > > > > > > > > > >
> > > > configuration
> > > > > > > > > > > > > > > > > >
> > > > from the OVF_STORE which is
> > > > > > > > > > > > > > > > > >
> > > > managed
> > > > > > > > > > > > > > > > > >
> > > > by the
> > > > > > > > > > > > > > > > > >
> > > > engine.
> > > > > > > > > > > > > > > > > >
> > > > If something goes wrong,
> > > > > > > > > > > > > > > > > >
> > > > ovirt-
> > > > > > > > > > > > > > > > > >
> > > > ha-
> > > > > > > > > > > > > > > > > >
> > > > agent could
> > > > > > > > > > > > > > > > > >
> > > > fallback to the
> > > > > > > > > > > > > > > > > >
> > > > initial
> > > > > > > > > > > > > > > > > >
> > > > (bootstrap time) vm.conf.
> > > > > > > > > > > > > > > > > >
> > > > This
> > > > > > > > > > > > > > > > > >
> > > > will
> > > > > > > > > > > > > > > > > >
> > > > normally
> > > > > > > > > > > > > > > > > >
> > > > happen
> > > > > > > > > > > > > > > > > >
> > > > till you
> > > > > > > > > > > > > > > > > >
> > > > add
> > > > > > > > > > > > > > > > > >
> > > > your
> > > > > > > > > > > > > > > > > >
> > > > first regular storage
> > > > > > > > > > > > > > > > > >
> > > > domain
> > > > > > > > > > > > > > > > > >
> > > > and
> > > > > > > > > > > > > > > > > >
> > > > the engine
> > > > > > > > > > > > > > > > > >
> > > > imports
> > > > > > > > > > > > > > > > > >
> > > > the
> > > > > > > > > > > > > > > > > >
> > > > engine
> > > > > > > > > > > > > > > > > >
> > > > VM.
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > But i already have my first
> > > > > > > > > > > > > > > > > >
> > > storage
> > > > > > > > > > > > > > > > > >
> > > domain and
> > > > > > > > > > > > > > > > > >
> > > storage
> > > > > > > > > > > > > > > > > >
> > > engine
> > > > > > > > > > > > > > > > > >
> > > domain
> > > > > > > > > > > > > > > > > >
> > > and already imported engine
> > > > > > > > > > > > > > > > > >
> > > VM.
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > I'm using 4.0 version.
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > This seams an issue, can you
> > > > > > > > > > > > > > > > > >
> > please
> > > > > > > > > > > > > > > > > >
> > share your
> > > > > > > > > > > > > > > > > >
> > /var/log/ovirt-hosted-engine-
> > > > > > > > > > > > > > > > > >
> > ha/agent.log ?
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> I sent it in attachment.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Nothing strange here;
> > > > > > > > > > > > > > > > > >
do you see a couple of disks with
> > > > > > > > > > > > > > > > > >
alias
> > > > > > > > > > > > > > > > > >
OVF_STORE on
> > > > > > > > > > > > > > > > > >
the
> > > > > > > > > > > > > > > > > >
hosted-
> > > > > > > > > > > > > > > > > >
engine
> > > > > > > > > > > > > > > > > >
storage domain if you check it from
> > > > > > > > > > > > > > > > > >
the
> > > > > > > > > > > > > > > > > >
engine?
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > Do
you mean any disk label?
> > > > > > > > > > > > > > > > > I
don't have it anyone:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
[root@ied-blade11 ~]# ls
> > > > > > > > > > > > > > > > >
/dev/disk/by-
> > > > > > > > > > > > > > > > >
label/
> > > > > > > > > > > > > > > > > ls:
cannot access /dev/disk/by-
> > > > > > > > > > > > > > > > >
label/:
> > > > > > > > > > > > > > > > > No
> > > > > > > > > > > > > > > > > such
file or
> > > > > > > > > > > > > > > > >
directory
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > No I mean:
go to the engine web-ui,
> > > > > > > > > > > > > > > > select
> > > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > > hosted-
> > > > > > > > > > > > > > > > engine
> > > > > > > > > > > > > > > > storage
> > > > > > > > > > > > > > > > domain,
check the disks there.
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > No, the alias
is virtio-disk0.
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > And this is the
engine VM disk, so the
> > > > > > > > > > > > > > issue
> > > > > > > > > > > > > > is
> > > > > > > > > > > > > > why
> > > > > > > > > > > > > > the engine
> > > > > > > > > > > > > > has
> > > > > > > > > > > > > > still to create the
OVF_STORE.
> > > > > > > > > > > > > > Can you please share
your engine.log from
> > > > > > > > > > > > > > the
> > > > > > > > > > > > > > engine VM?
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Go in attachment.
> > > > > > > > > > > >
> > > > > > > > > > > > The creation of the OVF_STORE
disk failed but
> > > > > > > > > > > > it's
> > > > > > > > > > > > not
> > > > > > > > > > > > that clear
> > > > > > > > > > > > why:
> > > > > > > > > > > >
> > > > > > > > > > > > 2016-08-17 08:43:33,538 ERROR
> > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.Cre
> > > > > > > > > > > > at
> > > > > > > > > > > > eOvf
> > > > > > > > > > > > Vo
> > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > ge
> > > > > > > > > > > > DomainCommand]
> > > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4] Ending
> > > > > > > > > > > > command
> > > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.Cre
> > > > > > > > > > > > at
> > > > > > > > > > > > eOvf
> > > > > > > > > > > > Vo
> > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > ge
> > > > > > > > > > > > DomainCommand'
> > > > > > > > > > > > with failure.
> > > > > > > > > > > > 2016-08-17 08:43:33,540 ERROR
> > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > > Co
> > > > > > > > > > > > mman
> > > > > > > > > > > > d]
> > > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4] Ending
> > > > > > > > > > > > command
> > > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > > Co
> > > > > > > > > > > > mman
> > > > > > > > > > > > d'
> > > > > > > > > > > > with
> > > > > > > > > > > > failure.
> > > > > > > > > > > > 2016-08-17 08:43:33,541 WARN
> > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > > Co
> > > > > > > > > > > > mman
> > > > > > > > > > > > d]
> > > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4]
> > > > > > > > > > > > VmCommand::EndVmCommand: Vm
is
> > > > > > > > > > > > null - not performing
endAction on Vm
> > > > > > > > > > > > 2016-08-17 08:43:33,553 ERROR
> > > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghan
> > > > > > > > > > > > dl
> > > > > > > > > > > > ing.
> > > > > > > > > > > > Au
> > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > or
> > > > > > > > > > > > ]
> > > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4]
> > > > > > > > > > > > Correlation
> > > > > > > > > > > > ID:
> > > > > > > > > > > > 6f1f1fd4, Call
> > > > > > > > > > > > Stack: null, Custom Event ID:
-1, Message: Add-
> > > > > > > > > > > > Disk
> > > > > > > > > > > > operation
> > > > > > > > > > > > failed
> > > > > > > > > > > > to complete.
> > > > > > > > > > > > 2016-08-17 08:43:33,557 WARN
> > > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghan
> > > > > > > > > > > > dl
> > > > > > > > > > > > ing.
> > > > > > > > > > > > Au
> > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > or
> > > > > > > > > > > > ]
> > > > > > > > > > > > (DefaultQuartzScheduler6) []
Correlation ID:
> > > > > > > > > > > > 19ac5bda,
> > > > > > > > > > > > Call Stack:
> > > > > > > > > > > > null, Custom Event ID: -1,
Message: Failed to
> > > > > > > > > > > > create
> > > > > > > > > > > > OVF store disk
> > > > > > > > > > > > for Storage Domain
hosted_storage.
> > > > > > > > > > > > OVF data won't be updated
meanwhile for that
> > > > > > > > > > > > domain.
> > > > > > > > > > > > 2016-08-17 08:43:33,585 INFO
> > > > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsE
> > > > > > > > > > > > xe
> > > > > > > > > > > > cuti
> > > > > > > > > > > > on
> > > > > > > > > > > > Callback]
> > > > > > > > > > > > (DefaultQuartzScheduler6)
[5f5a8daf] Command
> > > > > > > > > > > >
'ProcessOvfUpdateForStorageDomain' (id:
> > > > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0') waiting
> > > > > > > > > > > > on
> > > > > > > > > > > > child command
> > > > > > > > > > > > id:
> > > > > > > > > > > >
'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > > > > > > > > > > >
type:'CreateOvfVolumeForStorageDomain' to
> > > > > > > > > > > > complete
> > > > > > > > > > > > 2016-08-17 08:43:33,595 ERROR
> > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.Cre
> > > > > > > > > > > > at
> > > > > > > > > > > > eOvf
> > > > > > > > > > > > Vo
> > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > ge
> > > > > > > > > > > > DomainCommand]
> > > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49] Ending
> > > > > > > > > > > > command
> > > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.Cre
> > > > > > > > > > > > at
> > > > > > > > > > > > eOvf
> > > > > > > > > > > > Vo
> > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > ge
> > > > > > > > > > > > DomainCommand'
> > > > > > > > > > > > with failure.
> > > > > > > > > > > > 2016-08-17 08:43:33,596 ERROR
> > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > > Co
> > > > > > > > > > > > mman
> > > > > > > > > > > > d]
> > > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49] Ending
> > > > > > > > > > > > command
> > > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > > Co
> > > > > > > > > > > > mman
> > > > > > > > > > > > d'
> > > > > > > > > > > > with
> > > > > > > > > > > > failure.
> > > > > > > > > > > > 2016-08-17 08:43:33,596 WARN
> > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.AddDisk
> > > > > > > > > > > > Co
> > > > > > > > > > > > mman
> > > > > > > > > > > > d]
> > > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49]
> > > > > > > > > > > > VmCommand::EndVmCommand: Vm
is
> > > > > > > > > > > > null - not performing
endAction on Vm
> > > > > > > > > > > > 2016-08-17 08:43:33,602 ERROR
> > > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghan
> > > > > > > > > > > > dl
> > > > > > > > > > > > ing.
> > > > > > > > > > > > Au
> > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > or
> > > > > > > > > > > > ]
> > > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49]
> > > > > > > > > > > > Correlation
> > > > > > > > > > > > ID:
> > > > > > > > > > > > 5d314e49, Call
> > > > > > > > > > > > Stack: null, Custom Event ID:
-1, Message: Add-
> > > > > > > > > > > > Disk
> > > > > > > > > > > > operation
> > > > > > > > > > > > failed
> > > > > > > > > > > > to complete.
> > > > > > > > > > > > 2016-08-17 08:43:33,605 WARN
> > > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditloghan
> > > > > > > > > > > > dl
> > > > > > > > > > > > ing.
> > > > > > > > > > > > Au
> > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > or
> > > > > > > > > > > > ]
> > > > > > > > > > > > (DefaultQuartzScheduler6) []
Correlation ID:
> > > > > > > > > > > > 5f5a8daf,
> > > > > > > > > > > > Call Stack:
> > > > > > > > > > > > null, Custom Event ID: -1,
Message: Failed to
> > > > > > > > > > > > create
> > > > > > > > > > > > OVF store disk
> > > > > > > > > > > > for Storage Domain
hosted_storage.
> > > > > > > > > > > > OVF data won't be updated
meanwhile for that
> > > > > > > > > > > > domain.
> > > > > > > > > > > > 2016-08-17 08:43:36,460 INFO
> > > > > > > > > > > >
[org.ovirt.engine.core.bll.scheduling.HaReserva
> > > > > > > > > > > > ti
> > > > > > > > > > > > onHa
> > > > > > > > > > > > nd
> > > > > > > > > > > > ling]
> > > > > > > > > > > > (DefaultQuartzScheduler7)
[5d314e49] HA
> > > > > > > > > > > > reservation
> > > > > > > > > > > > status for
> > > > > > > > > > > > cluster
> > > > > > > > > > > > 'Default' is
'OK'
> > > > > > > > > > > > 2016-08-17 08:43:36,662 INFO
> > > > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCommandsE
> > > > > > > > > > > > xe
> > > > > > > > > > > > cuti
> > > > > > > > > > > > on
> > > > > > > > > > > > Callback]
> > > > > > > > > > > > (DefaultQuartzScheduler4)
[5f5a8daf] Command
> > > > > > > > > > > >
'ProcessOvfUpdateForStorageDomain' id:
> > > > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0' child
> > > > > > > > > > > > commands
> > > > > > > > > > > >
'[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > > > > > > > > > > >
eb2e6f1a-c756-4ccd-85a1-60d97d6880de]'
> > > > > > > > > > > > executions
> > > > > > > > > > > > were
> > > > > > > > > > > > completed,
> > > > > > > > > > > > status 'FAILED'
> > > > > > > > > > > > 2016-08-17 08:43:37,691 ERROR
> > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore.Pro
> > > > > > > > > > > > ce
> > > > > > > > > > > > ssOv
> > > > > > > > > > > > fU
> > > > > > > > > > > > pdateForStor
> > > > > > > > > > > > ag
> > > > > > > > > > > > eDomainCommand]
> > > > > > > > > > > > (DefaultQuartzScheduler6)
[5f5a8daf] Ending
> > > > > > > > > > > > command
> > > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore.Pro
> > > > > > > > > > > > ce
> > > > > > > > > > > > ssOv
> > > > > > > > > > > > fU
> > > > > > > > > > > > pdateForStor
> > > > > > > > > > > > ag
> > > > > > > > > > > > eDomainCommand'
> > > > > > > > > > > > with failure.
> > > > > > > > > > > >
> > > > > > > > > > > > Can you please check vdsm logs
for that time
> > > > > > > > > > > > frame on
> > > > > > > > > > > > the SPM host?
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > I sent in attachment the vdsm logs
from both
> > > > > > > > > > > hosts,
> > > > > > > > > > > but
> > > > > > > > > > > i
> > > > > > > > > > > think the
> > > > > > > > > > > SPM
> > > > > > > > > > > host on this time frame it was
ied-blade13
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > It seams that you also have an
issue in the SPM
> > > > > > > > > > > > election procedure:
> > > > > > > > > > > >
> > > > > > > > > > > > 2016-08-17 18:04:31,053 ERROR
> > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsP
> > > > > > > > > > > > ro
> > > > > > > > > > > > xyDa
> > > > > > > > > > > > ta
> > > > > > > > > > > > ]
> > > > > > > > > > > > (DefaultQuartzScheduler1) []
SPM Init: could
> > > > > > > > > > > > not
> > > > > > > > > > > > find
> > > > > > > > > > > > reported vds
> > > > > > > > > > > > or
> > > > > > > > > > > > not up - pool:
'Default' vds_spm_id: '2'
> > > > > > > > > > > > 2016-08-17 18:04:31,076 INFO
> > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsP
> > > > > > > > > > > > ro
> > > > > > > > > > > > xyDa
> > > > > > > > > > > > ta
> > > > > > > > > > > > ]
> > > > > > > > > > > > (DefaultQuartzScheduler1) []
SPM selection -
> > > > > > > > > > > > vds
> > > > > > > > > > > > seems
> > > > > > > > > > > > as spm
> > > > > > > > > > > > 'hosted_engine_2'
> > > > > > > > > > > > 2016-08-17 18:04:31,076 WARN
> > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsP
> > > > > > > > > > > > ro
> > > > > > > > > > > > xyDa
> > > > > > > > > > > > ta
> > > > > > > > > > > > ]
> > > > > > > > > > > > (DefaultQuartzScheduler1) []
spm vds is non
> > > > > > > > > > > > responsive,
> > > > > > > > > > > > stopping
> > > > > > > > > > > > spm
> > > > > > > > > > > > selection.
> > > > > > > > > > > > 2016-08-17 18:04:31,539 INFO
> > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.Vms
> > > > > > > > > > > > St
> > > > > > > > > > > > atis
> > > > > > > > > > > > ti
> > > > > > > > > > > > csFetcher]
> > > > > > > > > > > > (DefaultQuartzScheduler7) []
Fetched 1 VMs from
> > > > > > > > > > > > VDS
> > > > > > > > > > > >
'06372186-572c-41ad-916f-7cbb0aba5302'
> > > > > > > > > > > >
> > > > > > > > > > > > probably due to:
> > > > > > > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.Hos
> > > > > > > > > > > > tM
> > > > > > > > > > > > onit
> > > > > > > > > > > > or
> > > > > > > > > > > > ing]
> > > > > > > > > > > > (DefaultQuartzScheduler6) []
Failure to refresh
> > > > > > > > > > > > Vds
> > > > > > > > > > > > runtime info:
> > > > > > > > > > > > VDSGenericException:
VDSNetworkException:
> > > > > > > > > > > > Message
> > > > > > > > > > > > timeout which can
> > > > > > > > > > > > be
> > > > > > > > > > > > caused by communication
issues
> > > > > > > > > > > > 2016-08-17 18:02:33,569 ERROR
> > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring.Hos
> > > > > > > > > > > > tM
> > > > > > > > > > > > onit
> > > > > > > > > > > > or
> > > > > > > > > > > > ing]
> > > > > > > > > > > > (DefaultQuartzScheduler6) []
Exception:
> > > > > > > > > > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNe
> > > > > > > > > > > > tw
> > > > > > > > > > > > orkE
> > > > > > > > > > > > xc
> > > > > > > > > > > > eption:
> > > > > > > > > > > > VDSGenericException:
VDSNetworkException:
> > > > > > > > > > > > Message
> > > > > > > > > > > > timeout which can
> > > > > > > > > > > > be
> > > > > > > > > > > > caused by communication
issues
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > This messages maybe cause by
connection issues
> > > > > > > > > > > from
> > > > > > > > > > > yesterday at 6pm.
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > can you please check if the
engine VM could
> > > > > > > > > > > > correctly
> > > > > > > > > > > > resolve and
> > > > > > > > > > > > reach each host?
> > > > > > > > > > >
> > > > > > > > > > > Now i can read engine VM from both
hosts
> > > > > > > > > > >
> > > > > > > > > > > [root@ied-blade11 ~]# ping
ied-hosted-engine
> > > > > > > > > > > PING
ied-hosted-engine.install.eurotux.local
> > > > > > > > > > > (10.10.4.115) 56(84)
> > > > > > > > > > > bytes
> > > > > > > > > > > of data.
> > > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > icmp_seq=1 ttl=64 time=0.179 ms
> > > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > icmp_seq=2 ttl=64 time=0.141 ms
> > > > > > > > > > > ^C
> > > > > > > > > > > ---
ied-hosted-engine.install.eurotux.local ping
> > > > > > > > > > > statistics ---
> > > > > > > > > > > 2 packets transmitted, 2 received,
0% packet
> > > > > > > > > > > loss,
> > > > > > > > > > > time
> > > > > > > > > > > 999ms
> > > > > > > > > > > rtt min/avg/max/mdev =
0.141/0.160/0.179/0.019 ms
> > > > > > > > > > > [root@ied-blade13 ~]# ping
ied-hosted-engine
> > > > > > > > > > > PING
ied-hosted-engine.install.eurotux.local
> > > > > > > > > > > (10.10.4.115) 56(84)
> > > > > > > > > > > bytes
> > > > > > > > > > > of data.
> > > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > icmp_seq=1 ttl=64 time=0.172 ms
> > > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > icmp_seq=2 ttl=64 time=0.169 ms
> > > > > > > > > > > ^C
> > > > > > > > > > > ---
ied-hosted-engine.install.eurotux.local ping
> > > > > > > > > > > statistics ---
> > > > > > > > > > > 2 packets transmitted, 2 received,
0% packet
> > > > > > > > > > > loss,
> > > > > > > > > > > time
> > > > > > > > > > > 1000ms
> > > > > > > > > > > rtt min/avg/max/mdev =
0.169/0.170/0.172/0.013 ms
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > I have a message critical of low
disk space on
> > > > > > > > > > > hosted_storage domain.
> > > > > > > > > > > I have 50G of disk and i created i
VM with 40G.
> > > > > > > > > > > Do
> > > > > > > > > > > i
> > > > > > > > > > > need
> > > > > > > > > > > more space
> > > > > > > > > > > of
> > > > > > > > > > > OVF_STORAGE?
> > > > > > > > > > > What is the minimum requirements of
disk space
> > > > > > > > > > > for
> > > > > > > > > > > deploy
> > > > > > > > > > > engine VM?
> > > > > > > > > > >
> > > > > > > > > > > Regards,
> > > > > > > > > > > Carlos
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > Regards,
> > > > > > > > > > > > > > > > > >
> > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > Regards,
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > --
> > > > > > > > > > > > > > > > > >
> > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > Engenheiro de
> > > > > > > > > > > > > > > > > >
> > > > > > > Software
> > > > > > > > > > > > > > > > > >
> > > > > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > Eurotux Informática,
> > > > > > > > > > > > > > > > > >
> > > > > > > S.A. |
> > > > > > > > > > > > > > > > > >
> > > > > > > w
> > > > > > > > > > > > > > > > > >
> > > > > > > ww.eurotux.c
> > > > > > > > > > > > > > > > > >
> > > > > > > om
> > > > > > > > > > > > > > > > > >
> > > > > > > (t) +351 253 680 300
> > > > > > > > > > > > > > > > > >
> > > > > > > (m)
> > > > > > > > > > > > > > > > > >
> > > > > > > +351
> > > > > > > > > > > > > > > > > >
> > > > > > > 911 926 110
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > _____________________
> > > > > > > > > > > > > > > > > >
> > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > ____________
> > > > > > > > > > > > > > > > > >
> > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > > Users mailing list
> > > > > > > > > > > > > > > > > >
> > > > > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > > http://lists.ovirt.or
> > > > > > > > > > > > > > > > > >
> > > > > > > g/
> > > > > > > > > > > > > > > > > >
> > > > > > > mail
> > > > > > > > > > > > > > > > > >
> > > > > > > ma
> > > > > > > > > > > > > > > > > >
> > > > > > > n/listinfo/u
> > > > > > > > > > > > > > > > > >
> > > > > > > se
> > > > > > > > > > > > > > > > > >
> > > > > > > rs
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > --
> > > > > > > > > > > > > > > > > >
> > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > Engenheiro de Software
> > > > > > > > > > > > > > > > > >
> > > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > Eurotux Informática, S.A.
> > > > > > > > > > > > > > > > > >
> > > > > |
> > > > > > > > > > > > > > > > > >
> > > > > www.e
> > > > > > > > > > > > > > > > > >
> > > > > urotux.com
> > > > > > > > > > > > > > > > > >
> > > > > (t) +351 253 680 300 (m)
> > > > > > > > > > > > > > > > > >
> > > > > +351
> > > > > > > > > > > > > > > > > >
> > > > > 911
> > > > > > > > > > > > > > > > > >
> > > > > 926 110
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > _________________________
> > > > > > > > > > > > > > > > > >
> > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > ____________
> > > > > > > > > > > > > > > > > >
> > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > Users mailing list
> > > > > > > > > > > > > > > > > >
> > > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > http://lists.ovirt.org/ma
> > > > > > > > > > > > > > > > > >
> > > > > il
> > > > > > > > > > > > > > > > > >
> > > > > man/
> > > > > > > > > > > > > > > > > >
> > > > > li
> > > > > > > > > > > > > > > > > >
> > > > > stinfo/users
> > > > > > > > > > > > > > > > > >
> > > --
> > > > > > > > > > > > > > > > > >
> > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > Eurotux Informática, S.A. |
> > > > > > > > > > > > > > > > > >
> > > www
> > > > > > > > > > > > > > > > > >
> > > .eur
> > > > > > > > > > > > > > > > > >
> > > ot
> > > > > > > > > > > > > > > > > >
> > > ux.com
> > > > > > > > > > > > > > > > > >
> > > (t) +351 253 680 300 (m) +351
> > > > > > > > > > > > > > > > > >
> > > 911
> > > > > > > > > > > > > > > > > >
> > > 926
> > > > > > > > > > > > > > > > > >
> > > 110
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> --
> > > > > > > > > > > > > > > > > >
> Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Eurotux Informática, S.A. | www.e
> > > > > > > > > > > > > > > > > >
> ur
> > > > > > > > > > > > > > > > > >
> otux
> > > > > > > > > > > > > > > > > >
> .c
> > > > > > > > > > > > > > > > > >
> om
> > > > > > > > > > > > > > > > > >
> (t) +351 253 680 300 (m) +351 911
> > > > > > > > > > > > > > > > > >
> 926
> > > > > > > > > > > > > > > > > >
> 110
> > > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
Eurotux Informática, S.A. | www.eurot
> > > > > > > > > > > > > > > > > ux
> > > > > > > > > > > > > > > > > .com
> > > > > > > > > > > > > > > > > (t)
+351 253 680 300 (m) +351 911 926
> > > > > > > > > > > > > > > > > 110
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurotux.c
> > > > > > > > > > > > > > > om
> > > > > > > > > > > > > > > (t) +351 253
680 300 (m) +351 911 926 110
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > >
> > > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > > >
> > > > > > > > > > > > > Eurotux Informática, S.A.
| www.eurotux.com
> > > > > > > > > > > > > (t) +351 253 680 300 (m)
+351 911 926 110
> > > > > > > > > > >
_______________________________________________
> > > > > > > > > > > Users mailing list
> > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > > > --
> > > > > > > > > > Carlos Rodrigues
> > > > > > > > > >
> > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > >
> > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > (t) +351 253 680 300 (m) +351 911 926
110
> > > > > > > > > >
> > > > > > > > --
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > Engenheiro de Software Sénior
> > > > > > > >
> > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > --
> > > > > > Carlos Rodrigues
> > > > > >
> > > > > > Engenheiro de Software Sénior
> > > > > >
> > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > >
> > > > > >
> > > > >
> > > --
> > > Carlos Rodrigues
> > >
> > > Engenheiro de Software Sénior
> > >
> > > Eurotux Informática, S.A. | www.eurotux.com
> > > (t) +351 253 680 300 (m) +351 911 926 110
> > >
> > >
> >
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
4:29 p.m.
On Tue, 2016-08-23 at 14:16 +0200, Simone Tiraboschi wrote:
On Mon, Aug 22, 2016 at 1:10 PM, Carlos Rodrigues
<cmar(a)eurotux.com>
wrote:
>
> On Fri, 2016-08-19 at 11:50 +0100, Carlos Rodrigues wrote:
> >
> > On Fri, 2016-08-19 at 12:24 +0200, Simone Tiraboschi wrote:
> > >
> > >
> > > On Fri, Aug 19, 2016 at 12:07 PM, Carlos Rodrigues <cmar@eurotu
> > > x.co
> > > m>
> > > wrote:
> > > >
> > > >
> > > >
> > > > On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote:
> > > > >
> > > > >
> > > > >
> > > > > On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues
<cmar@
> > > > > > euro
> > > > > > tu
> > > > > > x.co
> > > > > > m>
> > > > > > wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > After night, the OVF_STORE it was created:
> > > > > > >
> > > > > >
> > > > > > It's quite strange that it got so long but now it
looks
> > > > > > fine.
> > > > > >
> > > > > > If the ISO_DOMAIN that I see in your screenshot is served
> > > > > > by
> > > > > > the
> > > > > > engine VM itself, I suggest to remove it and export from
> > > > > > an
> > > > > > external
> > > > > > server.
> > > > > > Serving the ISO storage domain from the engine VM itself
> > > > > > is
> > > > > > not
> > > > > > a
> > > > > > good idea since when the engine VM is down you can
> > > > > > experiment
> > > > > > long
> > > > > > delays before getting the engine VM restarted due to the
> > > > > > unavailable
> > > > > > storage domain.
> > > > >
> > > > > Ok, thank you for advice.
> > > > >
> > > > > Now, apparently is all ok. I'll do more tests with HA and
> > > > > any
> > > > > issue
> > > > > i'll tell you.
> > > > >
> > > > > Thank you for your support.
> > > > >
> > > > > Regards,
> > > > > Carlos Rodrigues
> > > > >
> > > >
> > > > I shutdown the network of host with engine VM and i expected
> > > > that
> > > > other
> > > > host fence the host and start engine VM but i don't see any
> > > > fence
> > > > action and the "free" host keep trying to start VM but get
> > > > and
> > > > error of
> > > > sanlock
> > > >
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > > qemu-
> > > > kvm:
> > > > sending ioctl 5326 to a partition!
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > > qemu-
> > > > kvm:
> > > > sending ioctl 80200204 to a partition!
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]:
> > > > 1
> > > > guest
> > > > now active
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local
> > > > sanlock[884]:
> > > > 2016-
> > > > 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1
> > > > delta 1
> > > > 9
> > > > 245502 alive
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local
> > > > sanlock[884]:
> > > > 2016-
> > > > 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error
> > > > -243
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local
> > > > sanlock[884]:
> > > > 2016-
> > > > 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862
> > > > acquire_token
> > > > -243 lease owned by other host
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local
> > > > libvirtd[1369]:
> > > > resource busy: Failed to acquire lock: error -243
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > > ovirtmgmt:
> > > > port 2(vnet0) entered disabled state
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > > device
> > > > vnet0
> > > > left promiscuous mode
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > > ovirtmgmt:
> > > > port 2(vnet0) entered disabled state
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]:
> > > > 0
> > > > guests
> > > > now active
> > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd-
> > > > machined[7863]: Machine qemu-4-HostedEngine terminated.
> > >
> > > Maybe you hit this one:
> > > https://bugzilla.redhat.com/show_bug.cgi?id=1322849
> > >
> > >
> > > Can you please check it as described in comment 28 and
> > > eventually
> > > apply the workaround in comment 18?
> > >
> >
> > Apparently the host-id its ok. I don't need to apply the
> > workaround.
> >
>
> Any other suggestion?
> I check that second host doens't fence the failed host and maybe
> this
> cause the lock of hosted storage domain.
The picture isn't still that clear to me: ovirt-ha-agent is not
trying
to fence other hosted-engine hosts.
The communication between hosts simply acts trough the metadata area
on the shared storage.
Do you also loose the connection to the storage domain when you play
with the management network on your host?
No, the storage domain is connected over fiber channel, we saw that
agent tries to read metadata and tries to start engine VM but after
couple seconds it shuts down the VM because its not able to acquire san
lock.
>
> After recover network, engine VM check hosts and send fence
> commands to
> the hosts. In some cases, it sends fence commands to both hosts.
>
> Regards,
> Carlos Rodrigues
>
>
> >
> >
> > >
> > >
> > >
> > >
> > > >
> > > >
> > > >
> > > > >
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Regards,
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues
<cm
> > > > > > > > ar@e
> > > > > > > > ur
> > > > > > > > otux
> > > > > > > > .c
> > > > > > > > om> wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, 2016-08-18 at 17:45 +0200, Simone
> > > > > > > > > Tiraboschi
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos
Rodrigues
> > > > > > > > > > <cmar
> > > > > > > > > > @eur
> > > > > > > > > > ot
> > > > > > > > > > ux.com> wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > I increase hosted_engine disk
space to 160G.
> > > > > > > > > > > How do
> > > > > > > > > > > i
> > > > > > > > > > > force
> > > > > > > > > > > to create
> > > > > > > > > > > OVF_STORE.
> > > > > > > > > >
> > > > > > > > > > I think that restarting the engine on
the engine
> > > > > > > > > > VM
> > > > > > > > > > will
> > > > > > > > > > trigger it
> > > > > > > > > > although I'm not sure that it was a
size issue.
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > I found to OVF_STORE on another storage
domain with
> > > > > > > > > "Domain
> > > > > > > > > Type" "Data (Master)"
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > > Each storage domain has its own OVF_STORE
volumes;
> > > > > > > > you
> > > > > > > > should
> > > > > > > > get
> > > > > > > > them also on the hosted-engine storage domain.
> > > > > > > > Not really sure about how to trigger it again;
adding
> > > > > > > > Roy
> > > > > > > > here.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Regards,
> > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > >
> > > > > > > > > > > On Thu, 2016-08-18 at 12:14 +0100,
Carlos
> > > > > > > > > > > Rodrigues
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, 2016-08-18 at 12:34
+0200, Simone
> > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, Aug 18, 2016 at
12:11 PM, Carlos
> > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > <cma
> > > > > > > > > > > > > r(a)eurotux.co
> > > > > > > > > > > > > m>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Thu, 2016-08-18
at 11:53 +0200, Simone
> > > > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Thu, Aug
18, 2016 at 11:50 AM,
> > > > > > > > > > > > > > > Carlos
> > > > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > > >
<cmar@eurotu
> > > > > > > > > > > > > > > x.
> > > > > > > > > > > > > > > com>
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Thu,
2016-08-18 at 11:42 +0200,
> > > > > > > > > > > > > > > > Simone
> > > > > > > > > > > > > > > >
Tiraboschi wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On
Thu, Aug 18, 2016 at 11:25 AM,
> > > > > > > > > > > > > > > > >
Carlos
> > > > > > > > > > > > > > > > >
Rodrigues <cmar@eu
> > > > > > > > > > > > > > > > > ro
> > > > > > > > > > > > > > > > >
tux.
> > > > > > > > > > > > > > > > >
com> wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
On Thu, 2016-08-18 at 11:04
> > > > > > > > > > > > > > > > > >
+0200,
> > > > > > > > > > > > > > > > > >
Simone
> > > > > > > > > > > > > > > > > >
Tiraboschi
> > > > > > > > > > > > > > > > > >
wrote:
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> On Thu, Aug 18, 2016 at 10:36
> > > > > > > > > > > > > > > > > >
> AM,
> > > > > > > > > > > > > > > > > >
> Carlos
> > > > > > > > > > > > > > > > > >
> Rodrigues
> > > > > > > > > > > > > > > > > >
> <cmar@
> > > > > > > > > > > > > > > > > >
> euro
> > > > > > > > > > > > > > > > > >
> tux.com>
> > > > > > > > > > > > > > > > > >
> wrote:
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > On Thu, 2016-08-18 at 10:27
> > > > > > > > > > > > > > > > > >
> > +0200,
> > > > > > > > > > > > > > > > > >
> > Simone
> > > > > > > > > > > > > > > > > >
> > Tiraboschi
> > > > > > > > > > > > > > > > > >
> > wrote:
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > On Thu, Aug 18, 2016 at
> > > > > > > > > > > > > > > > > >
> > > 10:22
> > > > > > > > > > > > > > > > > >
> > > AM,
> > > > > > > > > > > > > > > > > >
> > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > <cmar@
> > > > > > > > > > > > > > > > > >
> > > eurotux.
> > > > > > > > > > > > > > > > > >
> > > com>
> > > > > > > > > > > > > > > > > >
> > > wrote:
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > On Thu, 2016-08-18 at
> > > > > > > > > > > > > > > > > >
> > > > 08:54
> > > > > > > > > > > > > > > > > >
> > > > +0200,
> > > > > > > > > > > > > > > > > >
> > > > Simone
> > > > > > > > > > > > > > > > > >
> > > > Tiraboschi
> > > > > > > > > > > > > > > > > >
> > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > On Tue, Aug 16, 2016 at
> > > > > > > > > > > > > > > > > >
> > > > > 12:53
> > > > > > > > > > > > > > > > > >
> > > > > PM,
> > > > > > > > > > > > > > > > > >
> > > > > Carlos
> > > > > > > > > > > > > > > > > >
> > > > > Rodrigues <c
> > > > > > > > > > > > > > > > > >
> > > > > mar@euro
> > > > > > > > > > > > > > > > > >
> > > > > tux.
> > > > > > > > > > > > > > > > > >
> > > > > com>
> > > > > > > > > > > > > > > > > >
> > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > On Sun, 2016-08-14 at
> > > > > > > > > > > > > > > > > >
> > > > > > 14:22
> > > > > > > > > > > > > > > > > >
> > > > > > +0300, Roy Golan
> > > > > > > > > > > > > > > > > >
> > > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > On 12 August 2016
> > > > > > > > > > > > > > > > > >
> > > > > > > at
> > > > > > > > > > > > > > > > > >
> > > > > > > 20:23,
> > > > > > > > > > > > > > > > > >
> > > > > > > Carlos
> > > > > > > > > > > > > > > > > >
> > > > > > > Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > > <cma
> > > > > > > > > > > > > > > > > >
> > > > > > > r@eurotu
> > > > > > > > > > > > > > > > > >
> > > > > > > x.co
> > > > > > > > > > > > > > > > > >
> > > > > > > m>
> > > > > > > > > > > > > > > > > >
> > > > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > Hello,
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > I have one
> > > > > > > > > > > > > > > > > >
> > > > > > > > cluster
> > > > > > > > > > > > > > > > > >
> > > > > > > > with
> > > > > > > > > > > > > > > > > >
> > > > > > > > two
> > > > > > > > > > > > > > > > > >
> > > > > > > > hosts with
> > > > > > > > > > > > > > > > > >
> > > > > > > > power
> > > > > > > > > > > > > > > > > >
> > > > > > > > management
> > > > > > > > > > > > > > > > > >
> > > > > > > > correctly
> > > > > > > > > > > > > > > > > >
> > > > > > > > configured and
> > > > > > > > > > > > > > > > > >
> > > > > > > > one
> > > > > > > > > > > > > > > > > >
> > > > > > > > virtual
> > > > > > > > > > > > > > > > > >
> > > > > > > > machine with
> > > > > > > > > > > > > > > > > >
> > > > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > > > over
> > > > > > > > > > > > > > > > > >
> > > > > > > > shared
> > > > > > > > > > > > > > > > > >
> > > > > > > > storage with
> > > > > > > > > > > > > > > > > >
> > > > > > > > FiberChannel.
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > When i shutdown
> > > > > > > > > > > > > > > > > >
> > > > > > > > the
> > > > > > > > > > > > > > > > > >
> > > > > > > > network
> > > > > > > > > > > > > > > > > >
> > > > > > > > of host with
> > > > > > > > > > > > > > > > > >
> > > > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > > > VM, it
> > > > > > > > > > > > > > > > > >
> > > > > > > > should be
> > > > > > > > > > > > > > > > > >
> > > > > > > > possible the
> > > > > > > > > > > > > > > > > >
> > > > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > > > VM
> > > > > > > > > > > > > > > > > >
> > > > > > > > migrate
> > > > > > > > > > > > > > > > > >
> > > > > > > > automatically to
> > > > > > > > > > > > > > > > > >
> > > > > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > > > > host?
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > migrate on which
> > > > > > > > > > > > > > > > > >
> > > > > > > network?
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > What is the
> > > > > > > > > > > > > > > > > >
> > > > > > > > expected
> > > > > > > > > > > > > > > > > >
> > > > > > > > behaviour on this
> > > > > > > > > > > > > > > > > >
> > > > > > > > HA
> > > > > > > > > > > > > > > > > >
> > > > > > > > scenario?
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > After a few minutes
> > > > > > > > > > > > > > > > > >
> > > > > > > your
> > > > > > > > > > > > > > > > > >
> > > > > > > vm
> > > > > > > > > > > > > > > > > >
> > > > > > > will be
> > > > > > > > > > > > > > > > > >
> > > > > > > shutdown
> > > > > > > > > > > > > > > > > >
> > > > > > > by
> > > > > > > > > > > > > > > > > >
> > > > > > > the High
> > > > > > > > > > > > > > > > > >
> > > > > > > Availability
> > > > > > > > > > > > > > > > > >
> > > > > > > agent, as it can't
> > > > > > > > > > > > > > > > > >
> > > > > > > see
> > > > > > > > > > > > > > > > > >
> > > > > > > network,
> > > > > > > > > > > > > > > > > >
> > > > > > > and started
> > > > > > > > > > > > > > > > > >
> > > > > > > on
> > > > > > > > > > > > > > > > > >
> > > > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > > > host.
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > I'm testing this
> > > > > > > > > > > > > > > > > >
> > > > > > scenario
> > > > > > > > > > > > > > > > > >
> > > > > > and
> > > > > > > > > > > > > > > > > >
> > > > > > after shutdown
> > > > > > > > > > > > > > > > > >
> > > > > > network, it
> > > > > > > > > > > > > > > > > >
> > > > > > should
> > > > > > > > > > > > > > > > > >
> > > > > > be
> > > > > > > > > > > > > > > > > >
> > > > > > expected that agent
> > > > > > > > > > > > > > > > > >
> > > > > > shutdown ha
> > > > > > > > > > > > > > > > > >
> > > > > > and started
> > > > > > > > > > > > > > > > > >
> > > > > > on
> > > > > > > > > > > > > > > > > >
> > > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > > host,
> > > > > > > > > > > > > > > > > >
> > > > > > but
> > > > > > > > > > > > > > > > > >
> > > > > > after
> > > > > > > > > > > > > > > > > >
> > > > > > couple minutes
> > > > > > > > > > > > > > > > > >
> > > > > > nothing
> > > > > > > > > > > > > > > > > >
> > > > > > happens
> > > > > > > > > > > > > > > > > >
> > > > > > and on host
> > > > > > > > > > > > > > > > > >
> > > > > > with
> > > > > > > > > > > > > > > > > >
> > > > > > network we
> > > > > > > > > > > > > > > > > >
> > > > > > getting
> > > > > > > > > > > > > > > > > >
> > > > > > the
> > > > > > > > > > > > > > > > > >
> > > > > > following messages:
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > Aug 16 11:44:08 ied-
> > > > > > > > > > > > > > > > > >
> > > > > > blade11.install.eurot
> > > > > > > > > > > > > > > > > >
> > > > > > ux.l
> > > > > > > > > > > > > > > > > >
> > > > > > oc
> > > > > > > > > > > > > > > > > >
> > > > > > al
> > > > > > > > > > > > > > > > > >
> > > > > > ovirt-ha-
> > > > > > > > > > > > > > > > > >
> > > > > > agent[2779]:
> > > > > > > > > > > > > > > > > >
> > > > > > ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
> > > > > > ovirt_hosted_engine_h
> > > > > > > > > > > > > > > > > >
> > > > > > a.ag
> > > > > > > > > > > > > > > > > >
> > > > > > en
> > > > > > > > > > > > > > > > > >
> > > > > > t.ho
> > > > > > > > > > > > > > > > > >
> > > > > > st
> > > > > > > > > > > > > > > > > >
> > > > > > ed_engine.Ho
> > > > > > > > > > > > > > > > > >
> > > > > > st
> > > > > > > > > > > > > > > > > >
> > > > > > edEn
> > > > > > > > > > > > > > > > > >
> > > > > > gine.con
> > > > > > > > > > > > > > > > > >
> > > > > > fig
> > > > > > > > > > > > > > > > > >
> > > > > > ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > Unable to get vm.conf
> > > > > > > > > > > > > > > > > >
> > > > > > from
> > > > > > > > > > > > > > > > > >
> > > > > > OVF_STORE, falling
> > > > > > > > > > > > > > > > > >
> > > > > > back
> > > > > > > > > > > > > > > > > >
> > > > > > to
> > > > > > > > > > > > > > > > > >
> > > > > > initial
> > > > > > > > > > > > > > > > > >
> > > > > > vm.conf
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > I think the HA agent
> > > > > > > > > > > > > > > > > >
> > > > > > its
> > > > > > > > > > > > > > > > > >
> > > > > > trying
> > > > > > > > > > > > > > > > > >
> > > > > > to get vm
> > > > > > > > > > > > > > > > > >
> > > > > > configuration but
> > > > > > > > > > > > > > > > > >
> > > > > > some
> > > > > > > > > > > > > > > > > >
> > > > > > how it
> > > > > > > > > > > > > > > > > >
> > > > > > can't get vm.conf to
> > > > > > > > > > > > > > > > > >
> > > > > > start
> > > > > > > > > > > > > > > > > >
> > > > > > VM.
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > No, this is a different
> > > > > > > > > > > > > > > > > >
> > > > > issues.
> > > > > > > > > > > > > > > > > >
> > > > > In 3.6 we added a
> > > > > > > > > > > > > > > > > >
> > > > > feature
> > > > > > > > > > > > > > > > > >
> > > > > to
> > > > > > > > > > > > > > > > > >
> > > > > let
> > > > > > > > > > > > > > > > > >
> > > > > the engine
> > > > > > > > > > > > > > > > > >
> > > > > manage
> > > > > > > > > > > > > > > > > >
> > > > > also the
> > > > > > > > > > > > > > > > > >
> > > > > engine VM
> > > > > > > > > > > > > > > > > >
> > > > > itself; ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
> > > > > will
> > > > > > > > > > > > > > > > > >
> > > > > pickup
> > > > > > > > > > > > > > > > > >
> > > > > the latest
> > > > > > > > > > > > > > > > > >
> > > > > engine
> > > > > > > > > > > > > > > > > >
> > > > > VM
> > > > > > > > > > > > > > > > > >
> > > > > configuration
> > > > > > > > > > > > > > > > > >
> > > > > from the OVF_STORE
> > > > > > > > > > > > > > > > > >
> > > > > which is
> > > > > > > > > > > > > > > > > >
> > > > > managed
> > > > > > > > > > > > > > > > > >
> > > > > by the
> > > > > > > > > > > > > > > > > >
> > > > > engine.
> > > > > > > > > > > > > > > > > >
> > > > > If something goes
> > > > > > > > > > > > > > > > > >
> > > > > wrong,
> > > > > > > > > > > > > > > > > >
> > > > > ovirt-
> > > > > > > > > > > > > > > > > >
> > > > > ha-
> > > > > > > > > > > > > > > > > >
> > > > > agent could
> > > > > > > > > > > > > > > > > >
> > > > > fallback to the
> > > > > > > > > > > > > > > > > >
> > > > > initial
> > > > > > > > > > > > > > > > > >
> > > > > (bootstrap time)
> > > > > > > > > > > > > > > > > >
> > > > > vm.conf.
> > > > > > > > > > > > > > > > > >
> > > > > This
> > > > > > > > > > > > > > > > > >
> > > > > will
> > > > > > > > > > > > > > > > > >
> > > > > normally
> > > > > > > > > > > > > > > > > >
> > > > > happen
> > > > > > > > > > > > > > > > > >
> > > > > till you
> > > > > > > > > > > > > > > > > >
> > > > > add
> > > > > > > > > > > > > > > > > >
> > > > > your
> > > > > > > > > > > > > > > > > >
> > > > > first regular storage
> > > > > > > > > > > > > > > > > >
> > > > > domain
> > > > > > > > > > > > > > > > > >
> > > > > and
> > > > > > > > > > > > > > > > > >
> > > > > the engine
> > > > > > > > > > > > > > > > > >
> > > > > imports
> > > > > > > > > > > > > > > > > >
> > > > > the
> > > > > > > > > > > > > > > > > >
> > > > > engine
> > > > > > > > > > > > > > > > > >
> > > > > VM.
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > But i already have my
> > > > > > > > > > > > > > > > > >
> > > > first
> > > > > > > > > > > > > > > > > >
> > > > storage
> > > > > > > > > > > > > > > > > >
> > > > domain and
> > > > > > > > > > > > > > > > > >
> > > > storage
> > > > > > > > > > > > > > > > > >
> > > > engine
> > > > > > > > > > > > > > > > > >
> > > > domain
> > > > > > > > > > > > > > > > > >
> > > > and already imported
> > > > > > > > > > > > > > > > > >
> > > > engine
> > > > > > > > > > > > > > > > > >
> > > > VM.
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > I'm using 4.0 version.
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > This seams an issue, can
> > > > > > > > > > > > > > > > > >
> > > you
> > > > > > > > > > > > > > > > > >
> > > please
> > > > > > > > > > > > > > > > > >
> > > share your
> > > > > > > > > > > > > > > > > >
> > > /var/log/ovirt-hosted-
> > > > > > > > > > > > > > > > > >
> > > engine-
> > > > > > > > > > > > > > > > > >
> > > ha/agent.log ?
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > I sent it in attachment.
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Nothing strange here;
> > > > > > > > > > > > > > > > > >
> do you see a couple of disks
> > > > > > > > > > > > > > > > > >
> with
> > > > > > > > > > > > > > > > > >
> alias
> > > > > > > > > > > > > > > > > >
> OVF_STORE on
> > > > > > > > > > > > > > > > > >
> the
> > > > > > > > > > > > > > > > > >
> hosted-
> > > > > > > > > > > > > > > > > >
> engine
> > > > > > > > > > > > > > > > > >
> storage domain if you check it
> > > > > > > > > > > > > > > > > >
> from
> > > > > > > > > > > > > > > > > >
> the
> > > > > > > > > > > > > > > > > >
> engine?
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Do you mean any disk label?
> > > > > > > > > > > > > > > > > >
I don't have it anyone:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
[root@ied-blade11 ~]# ls
> > > > > > > > > > > > > > > > > >
/dev/disk/by-
> > > > > > > > > > > > > > > > > >
label/
> > > > > > > > > > > > > > > > > >
ls: cannot access /dev/disk/by-
> > > > > > > > > > > > > > > > > >
label/:
> > > > > > > > > > > > > > > > > >
No
> > > > > > > > > > > > > > > > > >
such file or
> > > > > > > > > > > > > > > > > >
directory
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > No I
mean: go to the engine web-ui,
> > > > > > > > > > > > > > > > >
select
> > > > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > > >
hosted-
> > > > > > > > > > > > > > > > >
engine
> > > > > > > > > > > > > > > > >
storage
> > > > > > > > > > > > > > > > >
domain, check the disks there.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > No, the
alias is virtio-disk0.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > And this is
the engine VM disk, so the
> > > > > > > > > > > > > > > issue
> > > > > > > > > > > > > > > is
> > > > > > > > > > > > > > > why
> > > > > > > > > > > > > > > the engine
> > > > > > > > > > > > > > > has
> > > > > > > > > > > > > > > still to
create the OVF_STORE.
> > > > > > > > > > > > > > > Can you please
share your engine.log
> > > > > > > > > > > > > > > from
> > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > engine VM?
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Go in attachment.
> > > > > > > > > > > > >
> > > > > > > > > > > > > The creation of the
OVF_STORE disk failed
> > > > > > > > > > > > > but
> > > > > > > > > > > > > it's
> > > > > > > > > > > > > not
> > > > > > > > > > > > > that clear
> > > > > > > > > > > > > why:
> > > > > > > > > > > > >
> > > > > > > > > > > > > 2016-08-17 08:43:33,538
ERROR
> > > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore
> > > > > > > > > > > > > .Cre
> > > > > > > > > > > > > at
> > > > > > > > > > > > > eOvf
> > > > > > > > > > > > > Vo
> > > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > > ge
> > > > > > > > > > > > > DomainCommand]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [6f1f1fd4] Ending
> > > > > > > > > > > > > command
> > > > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore
> > > > > > > > > > > > > .Cre
> > > > > > > > > > > > > at
> > > > > > > > > > > > > eOvf
> > > > > > > > > > > > > Vo
> > > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > > ge
> > > > > > > > > > > > > DomainCommand'
> > > > > > > > > > > > > with failure.
> > > > > > > > > > > > > 2016-08-17 08:43:33,540
ERROR
> > > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.Add
> > > > > > > > > > > > > Disk
> > > > > > > > > > > > > Co
> > > > > > > > > > > > > mman
> > > > > > > > > > > > > d]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [6f1f1fd4] Ending
> > > > > > > > > > > > > command
> > > > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.Add
> > > > > > > > > > > > > Disk
> > > > > > > > > > > > > Co
> > > > > > > > > > > > > mman
> > > > > > > > > > > > > d'
> > > > > > > > > > > > > with
> > > > > > > > > > > > > failure.
> > > > > > > > > > > > > 2016-08-17 08:43:33,541
WARN
> > > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.Add
> > > > > > > > > > > > > Disk
> > > > > > > > > > > > > Co
> > > > > > > > > > > > > mman
> > > > > > > > > > > > > d]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [6f1f1fd4]
> > > > > > > > > > > > > VmCommand::EndVmCommand:
Vm is
> > > > > > > > > > > > > null - not performing
endAction on Vm
> > > > > > > > > > > > > 2016-08-17 08:43:33,553
ERROR
> > > > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditlo
> > > > > > > > > > > > > ghan
> > > > > > > > > > > > > dl
> > > > > > > > > > > > > ing.
> > > > > > > > > > > > > Au
> > > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > > or
> > > > > > > > > > > > > ]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [6f1f1fd4]
> > > > > > > > > > > > > Correlation
> > > > > > > > > > > > > ID:
> > > > > > > > > > > > > 6f1f1fd4, Call
> > > > > > > > > > > > > Stack: null, Custom
Event ID: -1, Message:
> > > > > > > > > > > > > Add-
> > > > > > > > > > > > > Disk
> > > > > > > > > > > > > operation
> > > > > > > > > > > > > failed
> > > > > > > > > > > > > to complete.
> > > > > > > > > > > > > 2016-08-17 08:43:33,557
WARN
> > > > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditlo
> > > > > > > > > > > > > ghan
> > > > > > > > > > > > > dl
> > > > > > > > > > > > > ing.
> > > > > > > > > > > > > Au
> > > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > > or
> > > > > > > > > > > > > ]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [] Correlation
> > > > > > > > > > > > > ID:
> > > > > > > > > > > > > 19ac5bda,
> > > > > > > > > > > > > Call Stack:
> > > > > > > > > > > > > null, Custom Event ID:
-1, Message: Failed
> > > > > > > > > > > > > to
> > > > > > > > > > > > > create
> > > > > > > > > > > > > OVF store disk
> > > > > > > > > > > > > for Storage Domain
hosted_storage.
> > > > > > > > > > > > > OVF data won't be
updated meanwhile for
> > > > > > > > > > > > > that
> > > > > > > > > > > > > domain.
> > > > > > > > > > > > > 2016-08-17 08:43:33,585
INFO
> > > > > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildComma
> > > > > > > > > > > > > ndsE
> > > > > > > > > > > > > xe
> > > > > > > > > > > > > cuti
> > > > > > > > > > > > > on
> > > > > > > > > > > > > Callback]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [5f5a8daf]
> > > > > > > > > > > > > Command
> > > > > > > > > > > > >
'ProcessOvfUpdateForStorageDomain' (id:
> > > > > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0')
> > > > > > > > > > > > > waiting
> > > > > > > > > > > > > on
> > > > > > > > > > > > > child command
> > > > > > > > > > > > > id:
> > > > > > > > > > > > >
'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > > > > > > > > > > > >
type:'CreateOvfVolumeForStorageDomain' to
> > > > > > > > > > > > > complete
> > > > > > > > > > > > > 2016-08-17 08:43:33,595
ERROR
> > > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore
> > > > > > > > > > > > > .Cre
> > > > > > > > > > > > > at
> > > > > > > > > > > > > eOvf
> > > > > > > > > > > > > Vo
> > > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > > ge
> > > > > > > > > > > > > DomainCommand]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [5d314e49] Ending
> > > > > > > > > > > > > command
> > > > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore
> > > > > > > > > > > > > .Cre
> > > > > > > > > > > > > at
> > > > > > > > > > > > > eOvf
> > > > > > > > > > > > > Vo
> > > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > > ge
> > > > > > > > > > > > > DomainCommand'
> > > > > > > > > > > > > with failure.
> > > > > > > > > > > > > 2016-08-17 08:43:33,596
ERROR
> > > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.Add
> > > > > > > > > > > > > Disk
> > > > > > > > > > > > > Co
> > > > > > > > > > > > > mman
> > > > > > > > > > > > > d]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [5d314e49] Ending
> > > > > > > > > > > > > command
> > > > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.Add
> > > > > > > > > > > > > Disk
> > > > > > > > > > > > > Co
> > > > > > > > > > > > > mman
> > > > > > > > > > > > > d'
> > > > > > > > > > > > > with
> > > > > > > > > > > > > failure.
> > > > > > > > > > > > > 2016-08-17 08:43:33,596
WARN
> > > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.Add
> > > > > > > > > > > > > Disk
> > > > > > > > > > > > > Co
> > > > > > > > > > > > > mman
> > > > > > > > > > > > > d]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [5d314e49]
> > > > > > > > > > > > > VmCommand::EndVmCommand:
Vm is
> > > > > > > > > > > > > null - not performing
endAction on Vm
> > > > > > > > > > > > > 2016-08-17 08:43:33,602
ERROR
> > > > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditlo
> > > > > > > > > > > > > ghan
> > > > > > > > > > > > > dl
> > > > > > > > > > > > > ing.
> > > > > > > > > > > > > Au
> > > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > > or
> > > > > > > > > > > > > ]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [5d314e49]
> > > > > > > > > > > > > Correlation
> > > > > > > > > > > > > ID:
> > > > > > > > > > > > > 5d314e49, Call
> > > > > > > > > > > > > Stack: null, Custom
Event ID: -1, Message:
> > > > > > > > > > > > > Add-
> > > > > > > > > > > > > Disk
> > > > > > > > > > > > > operation
> > > > > > > > > > > > > failed
> > > > > > > > > > > > > to complete.
> > > > > > > > > > > > > 2016-08-17 08:43:33,605
WARN
> > > > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.auditlo
> > > > > > > > > > > > > ghan
> > > > > > > > > > > > > dl
> > > > > > > > > > > > > ing.
> > > > > > > > > > > > > Au
> > > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > > or
> > > > > > > > > > > > > ]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [] Correlation
> > > > > > > > > > > > > ID:
> > > > > > > > > > > > > 5f5a8daf,
> > > > > > > > > > > > > Call Stack:
> > > > > > > > > > > > > null, Custom Event ID:
-1, Message: Failed
> > > > > > > > > > > > > to
> > > > > > > > > > > > > create
> > > > > > > > > > > > > OVF store disk
> > > > > > > > > > > > > for Storage Domain
hosted_storage.
> > > > > > > > > > > > > OVF data won't be
updated meanwhile for
> > > > > > > > > > > > > that
> > > > > > > > > > > > > domain.
> > > > > > > > > > > > > 2016-08-17 08:43:36,460
INFO
> > > > > > > > > > > > >
[org.ovirt.engine.core.bll.scheduling.HaRes
> > > > > > > > > > > > > erva
> > > > > > > > > > > > > ti
> > > > > > > > > > > > > onHa
> > > > > > > > > > > > > nd
> > > > > > > > > > > > > ling]
> > > > > > > > > > > > >
(DefaultQuartzScheduler7) [5d314e49] HA
> > > > > > > > > > > > > reservation
> > > > > > > > > > > > > status for
> > > > > > > > > > > > > cluster
> > > > > > > > > > > > > 'Default' is
'OK'
> > > > > > > > > > > > > 2016-08-17 08:43:36,662
INFO
> > > > > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildComma
> > > > > > > > > > > > > ndsE
> > > > > > > > > > > > > xe
> > > > > > > > > > > > > cuti
> > > > > > > > > > > > > on
> > > > > > > > > > > > > Callback]
> > > > > > > > > > > > >
(DefaultQuartzScheduler4) [5f5a8daf]
> > > > > > > > > > > > > Command
> > > > > > > > > > > > >
'ProcessOvfUpdateForStorageDomain' id:
> > > > > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0'
> > > > > > > > > > > > > child
> > > > > > > > > > > > > commands
> > > > > > > > > > > > >
'[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > > > > > > > > > > > >
eb2e6f1a-c756-4ccd-85a1-60d97d6880de]'
> > > > > > > > > > > > > executions
> > > > > > > > > > > > > were
> > > > > > > > > > > > > completed,
> > > > > > > > > > > > > status 'FAILED'
> > > > > > > > > > > > > 2016-08-17 08:43:37,691
ERROR
> > > > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfstore
> > > > > > > > > > > > > .Pro
> > > > > > > > > > > > > ce
> > > > > > > > > > > > > ssOv
> > > > > > > > > > > > > fU
> > > > > > > > > > > > > pdateForStor
> > > > > > > > > > > > > ag
> > > > > > > > > > > > > eDomainCommand]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [5f5a8daf] Ending
> > > > > > > > > > > > > command
> > > > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfstore
> > > > > > > > > > > > > .Pro
> > > > > > > > > > > > > ce
> > > > > > > > > > > > > ssOv
> > > > > > > > > > > > > fU
> > > > > > > > > > > > > pdateForStor
> > > > > > > > > > > > > ag
> > > > > > > > > > > > > eDomainCommand'
> > > > > > > > > > > > > with failure.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Can you please check
vdsm logs for that
> > > > > > > > > > > > > time
> > > > > > > > > > > > > frame on
> > > > > > > > > > > > > the SPM host?
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > I sent in attachment the vdsm
logs from both
> > > > > > > > > > > > hosts,
> > > > > > > > > > > > but
> > > > > > > > > > > > i
> > > > > > > > > > > > think the
> > > > > > > > > > > > SPM
> > > > > > > > > > > > host on this time frame it
was ied-blade13
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > It seams that you also
have an issue in the
> > > > > > > > > > > > > SPM
> > > > > > > > > > > > > election procedure:
> > > > > > > > > > > > >
> > > > > > > > > > > > > 2016-08-17 18:04:31,053
ERROR
> > > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.
> > > > > > > > > > > > > IrsP
> > > > > > > > > > > > > ro
> > > > > > > > > > > > > xyDa
> > > > > > > > > > > > > ta
> > > > > > > > > > > > > ]
> > > > > > > > > > > > >
(DefaultQuartzScheduler1) [] SPM Init:
> > > > > > > > > > > > > could
> > > > > > > > > > > > > not
> > > > > > > > > > > > > find
> > > > > > > > > > > > > reported vds
> > > > > > > > > > > > > or
> > > > > > > > > > > > > not up - pool:
'Default' vds_spm_id: '2'
> > > > > > > > > > > > > 2016-08-17 18:04:31,076
INFO
> > > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.
> > > > > > > > > > > > > IrsP
> > > > > > > > > > > > > ro
> > > > > > > > > > > > > xyDa
> > > > > > > > > > > > > ta
> > > > > > > > > > > > > ]
> > > > > > > > > > > > >
(DefaultQuartzScheduler1) [] SPM selection
> > > > > > > > > > > > > -
> > > > > > > > > > > > > vds
> > > > > > > > > > > > > seems
> > > > > > > > > > > > > as spm
> > > > > > > > > > > > >
'hosted_engine_2'
> > > > > > > > > > > > > 2016-08-17 18:04:31,076
WARN
> > > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroker.
> > > > > > > > > > > > > IrsP
> > > > > > > > > > > > > ro
> > > > > > > > > > > > > xyDa
> > > > > > > > > > > > > ta
> > > > > > > > > > > > > ]
> > > > > > > > > > > > >
(DefaultQuartzScheduler1) [] spm vds is non
> > > > > > > > > > > > > responsive,
> > > > > > > > > > > > > stopping
> > > > > > > > > > > > > spm
> > > > > > > > > > > > > selection.
> > > > > > > > > > > > > 2016-08-17 18:04:31,539
INFO
> > > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring
> > > > > > > > > > > > > .Vms
> > > > > > > > > > > > > St
> > > > > > > > > > > > > atis
> > > > > > > > > > > > > ti
> > > > > > > > > > > > > csFetcher]
> > > > > > > > > > > > >
(DefaultQuartzScheduler7) [] Fetched 1 VMs
> > > > > > > > > > > > > from
> > > > > > > > > > > > > VDS
> > > > > > > > > > > > >
'06372186-572c-41ad-916f-7cbb0aba5302'
> > > > > > > > > > > > >
> > > > > > > > > > > > > probably due to:
> > > > > > > > > > > > > 2016-08-17 18:02:33,569
ERROR
> > > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring
> > > > > > > > > > > > > .Hos
> > > > > > > > > > > > > tM
> > > > > > > > > > > > > onit
> > > > > > > > > > > > > or
> > > > > > > > > > > > > ing]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [] Failure to
> > > > > > > > > > > > > refresh
> > > > > > > > > > > > > Vds
> > > > > > > > > > > > > runtime info:
> > > > > > > > > > > > > VDSGenericException:
VDSNetworkException:
> > > > > > > > > > > > > Message
> > > > > > > > > > > > > timeout which can
> > > > > > > > > > > > > be
> > > > > > > > > > > > > caused by communication
issues
> > > > > > > > > > > > > 2016-08-17 18:02:33,569
ERROR
> > > > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitoring
> > > > > > > > > > > > > .Hos
> > > > > > > > > > > > > tM
> > > > > > > > > > > > > onit
> > > > > > > > > > > > > or
> > > > > > > > > > > > > ing]
> > > > > > > > > > > > >
(DefaultQuartzScheduler6) [] Exception:
> > > > > > > > > > > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.V
> > > > > > > > > > > > > DSNe
> > > > > > > > > > > > > tw
> > > > > > > > > > > > > orkE
> > > > > > > > > > > > > xc
> > > > > > > > > > > > > eption:
> > > > > > > > > > > > > VDSGenericException:
VDSNetworkException:
> > > > > > > > > > > > > Message
> > > > > > > > > > > > > timeout which can
> > > > > > > > > > > > > be
> > > > > > > > > > > > > caused by communication
issues
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > This messages maybe cause by
connection
> > > > > > > > > > > > issues
> > > > > > > > > > > > from
> > > > > > > > > > > > yesterday at 6pm.
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > can you please check if
the engine VM could
> > > > > > > > > > > > > correctly
> > > > > > > > > > > > > resolve and
> > > > > > > > > > > > > reach each host?
> > > > > > > > > > > >
> > > > > > > > > > > > Now i can read engine VM from
both hosts
> > > > > > > > > > > >
> > > > > > > > > > > > [root@ied-blade11 ~]# ping
ied-hosted-engine
> > > > > > > > > > > > PING
ied-hosted-engine.install.eurotux.local
> > > > > > > > > > > > (10.10.4.115) 56(84)
> > > > > > > > > > > > bytes
> > > > > > > > > > > > of data.
> > > > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > > icmp_seq=1 ttl=64 time=0.179
ms
> > > > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > > icmp_seq=2 ttl=64 time=0.141
ms
> > > > > > > > > > > > ^C
> > > > > > > > > > > > ---
ied-hosted-engine.install.eurotux.local
> > > > > > > > > > > > ping
> > > > > > > > > > > > statistics ---
> > > > > > > > > > > > 2 packets transmitted, 2
received, 0% packet
> > > > > > > > > > > > loss,
> > > > > > > > > > > > time
> > > > > > > > > > > > 999ms
> > > > > > > > > > > > rtt min/avg/max/mdev =
> > > > > > > > > > > > 0.141/0.160/0.179/0.019 ms
> > > > > > > > > > > > [root@ied-blade13 ~]# ping
ied-hosted-engine
> > > > > > > > > > > > PING
ied-hosted-engine.install.eurotux.local
> > > > > > > > > > > > (10.10.4.115) 56(84)
> > > > > > > > > > > > bytes
> > > > > > > > > > > > of data.
> > > > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > > icmp_seq=1 ttl=64 time=0.172
ms
> > > > > > > > > > > > 64 bytes from ied-hosted-
> > > > > > > > > > > > engine.install.eurotux.local
> > > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > > icmp_seq=2 ttl=64 time=0.169
ms
> > > > > > > > > > > > ^C
> > > > > > > > > > > > ---
ied-hosted-engine.install.eurotux.local
> > > > > > > > > > > > ping
> > > > > > > > > > > > statistics ---
> > > > > > > > > > > > 2 packets transmitted, 2
received, 0% packet
> > > > > > > > > > > > loss,
> > > > > > > > > > > > time
> > > > > > > > > > > > 1000ms
> > > > > > > > > > > > rtt min/avg/max/mdev =
> > > > > > > > > > > > 0.169/0.170/0.172/0.013 ms
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > I have a message critical of
low disk space
> > > > > > > > > > > > on
> > > > > > > > > > > > hosted_storage domain.
> > > > > > > > > > > > I have 50G of disk and i
created i VM with
> > > > > > > > > > > > 40G.
> > > > > > > > > > > > Do
> > > > > > > > > > > > i
> > > > > > > > > > > > need
> > > > > > > > > > > > more space
> > > > > > > > > > > > of
> > > > > > > > > > > > OVF_STORAGE?
> > > > > > > > > > > > What is the minimum
requirements of disk
> > > > > > > > > > > > space
> > > > > > > > > > > > for
> > > > > > > > > > > > deploy
> > > > > > > > > > > > engine VM?
> > > > > > > > > > > >
> > > > > > > > > > > > Regards,
> > > > > > > > > > > > Carlos
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > Regards,
> > > > > > > > > > > > > > > > > >
> > > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > Regards,
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > --
> > > > > > > > > > > > > > > > > >
> > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > Engenheiro de
> > > > > > > > > > > > > > > > > >
> > > > > > > > Software
> > > > > > > > > > > > > > > > > >
> > > > > > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > Eurotux
> > > > > > > > > > > > > > > > > >
> > > > > > > > Informática,
> > > > > > > > > > > > > > > > > >
> > > > > > > > S.A. |
> > > > > > > > > > > > > > > > > >
> > > > > > > > w
> > > > > > > > > > > > > > > > > >
> > > > > > > > ww.eurotux.c
> > > > > > > > > > > > > > > > > >
> > > > > > > > om
> > > > > > > > > > > > > > > > > >
> > > > > > > > (t) +351 253 680
> > > > > > > > > > > > > > > > > >
> > > > > > > > 300
> > > > > > > > > > > > > > > > > >
> > > > > > > > (m)
> > > > > > > > > > > > > > > > > >
> > > > > > > > +351
> > > > > > > > > > > > > > > > > >
> > > > > > > > 911 926 110
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > _________________
> > > > > > > > > > > > > > > > > >
> > > > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > > ____________
> > > > > > > > > > > > > > > > > >
> > > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > > > Users mailing
> > > > > > > > > > > > > > > > > >
> > > > > > > > list
> > > > > > > > > > > > > > > > > >
> > > > > > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > > > http://lists.ovir
> > > > > > > > > > > > > > > > > >
> > > > > > > > t.or
> > > > > > > > > > > > > > > > > >
> > > > > > > > g/
> > > > > > > > > > > > > > > > > >
> > > > > > > > mail
> > > > > > > > > > > > > > > > > >
> > > > > > > > ma
> > > > > > > > > > > > > > > > > >
> > > > > > > > n/listinfo/u
> > > > > > > > > > > > > > > > > >
> > > > > > > > se
> > > > > > > > > > > > > > > > > >
> > > > > > > > rs
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > --
> > > > > > > > > > > > > > > > > >
> > > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > Engenheiro de
> > > > > > > > > > > > > > > > > >
> > > > > > Software
> > > > > > > > > > > > > > > > > >
> > > > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > Eurotux Informática,
> > > > > > > > > > > > > > > > > >
> > > > > > S.A.
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > www.e
> > > > > > > > > > > > > > > > > >
> > > > > > urotux.com
> > > > > > > > > > > > > > > > > >
> > > > > > (t) +351 253 680 300
> > > > > > > > > > > > > > > > > >
> > > > > > (m)
> > > > > > > > > > > > > > > > > >
> > > > > > +351
> > > > > > > > > > > > > > > > > >
> > > > > > 911
> > > > > > > > > > > > > > > > > >
> > > > > > 926 110
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > _____________________
> > > > > > > > > > > > > > > > > >
> > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > ____________
> > > > > > > > > > > > > > > > > >
> > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > Users mailing list
> > > > > > > > > > > > > > > > > >
> > > > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > http://lists.ovirt.or
> > > > > > > > > > > > > > > > > >
> > > > > > g/ma
> > > > > > > > > > > > > > > > > >
> > > > > > il
> > > > > > > > > > > > > > > > > >
> > > > > > man/
> > > > > > > > > > > > > > > > > >
> > > > > > li
> > > > > > > > > > > > > > > > > >
> > > > > > stinfo/users
> > > > > > > > > > > > > > > > > >
> > > > --
> > > > > > > > > > > > > > > > > >
> > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > Engenheiro de Software
> > > > > > > > > > > > > > > > > >
> > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > Eurotux Informática, S.A.
> > > > > > > > > > > > > > > > > >
> > > > |
> > > > > > > > > > > > > > > > > >
> > > > www
> > > > > > > > > > > > > > > > > >
> > > > .eur
> > > > > > > > > > > > > > > > > >
> > > > ot
> > > > > > > > > > > > > > > > > >
> > > > ux.com
> > > > > > > > > > > > > > > > > >
> > > > (t) +351 253 680 300 (m)
> > > > > > > > > > > > > > > > > >
> > > > +351
> > > > > > > > > > > > > > > > > >
> > > > 911
> > > > > > > > > > > > > > > > > >
> > > > 926
> > > > > > > > > > > > > > > > > >
> > > > 110
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > --
> > > > > > > > > > > > > > > > > >
> > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Eurotux Informática, S.A. |
> > > > > > > > > > > > > > > > > >
> > www.e
> > > > > > > > > > > > > > > > > >
> > ur
> > > > > > > > > > > > > > > > > >
> > otux
> > > > > > > > > > > > > > > > > >
> > .c
> > > > > > > > > > > > > > > > > >
> > om
> > > > > > > > > > > > > > > > > >
> > (t) +351 253 680 300 (m) +351
> > > > > > > > > > > > > > > > > >
> > 911
> > > > > > > > > > > > > > > > > >
> > 926
> > > > > > > > > > > > > > > > > >
> > 110
> > > > > > > > > > > > > > > > > >
--
> > > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
Eurotux Informática, S.A. | www.e
> > > > > > > > > > > > > > > > > >
urot
> > > > > > > > > > > > > > > > > >
ux
> > > > > > > > > > > > > > > > > >
.com
> > > > > > > > > > > > > > > > > >
(t) +351 253 680 300 (m) +351 911
> > > > > > > > > > > > > > > > > >
926
> > > > > > > > > > > > > > > > > >
110
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurot
> > > > > > > > > > > > > > > > ux.c
> > > > > > > > > > > > > > > > om
> > > > > > > > > > > > > > > > (t) +351
253 680 300 (m) +351 911 926
> > > > > > > > > > > > > > > > 110
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > --
> > > > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Eurotux
Informática, S.A. | www.eurotux.c
> > > > > > > > > > > > > > om
> > > > > > > > > > > > > > (t) +351 253 680
300 (m) +351 911 926 110
> > > > > > > > > > > >
_____________________________________________
> > > > > > > > > > > > __
> > > > > > > > > > > > Users mailing list
> > > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > > >
http://lists.ovirt.org/mailman/listinfo/users
> > > > > > > > > > > --
> > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > >
> > > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > > >
> > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > (t) +351 253 680 300 (m) +351 911
926 110
> > > > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Carlos Rodrigues
> > > > > > > > >
> > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > >
> > > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > --
> > > > > > > Carlos Rodrigues
> > > > > > >
> > > > > > > Engenheiro de Software Sénior
> > > > > > >
> > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > >
> > > > > > >
> > > > > >
> > > > --
> > > > Carlos Rodrigues
> > > >
> > > > Engenheiro de Software Sénior
> > > >
> > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > >
> > > >
> > >
> --
> Carlos Rodrigues
>
> Engenheiro de Software Sénior
>
> Eurotux Informática, S.A. | www.eurotux.com
> (t) +351 253 680 300 (m) +351 911 926 110
>
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
9:25 p.m.
I made more tests and i have two hosts (hosted_engine1
and hosted_engine2) configured to be hosted engine and after sent down
the network interface (ifdown bond0 and i have ovirtmgmt over bond0)
on hosted_engine1, the hosted_engined2 try to start engine:
==> /var/log/ovirt-hosted-engine-ha/agent.log <==
MainThread::INFO::2016-11-07
18:17:18,598::ovf_store::103::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan)
Found OVF_STORE: imgUUID:8f567072-82d7-4a80-b643-76a1e1d273ef,
volUUID:7b12f649-b8cd-426a-95d8-37bb223ac86f
MainThread::INFO::2016-11-07
18:17:18,875::ovf_store::112::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
Extracting Engine VM OVF from the OVF_STORE
MainThread::INFO::2016-11-07
18:17:18,896::ovf_store::119::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
OVF_STORE volume path:
/rhev/data-center/mnt/blockSD/4c0104e0-dc8d-44b6-ab70-9d46599eb7f6/images/8f567072-82d7-4a80-b643-76a1e1d273ef/7b12f649-b8cd-426a-95d8-37bb223ac86f
MainThread::INFO::2016-11-07
18:17:18,991::config::226::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
Found an OVF for HE VM, trying to convert
MainThread::INFO::2016-11-07
18:17:18,994::config::231::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
Got vm.conf from OVF_STORE
MainThread::INFO::2016-11-07
18:17:18,994::hosted_engine::1148::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state)
Ensuring VDSM state is clear for engine VM
MainThread::INFO::2016-11-07
18:17:19,011::hosted_engine::1160::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state)
Vdsm state for VM clean
MainThread::INFO::2016-11-07
18:17:19,011::hosted_engine::1109::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm)
Starting vm using `/usr/sbin/hosted-engine --vm-start`
MainThread::INFO::2016-11-07
18:17:19,410::hosted_engine::1115::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm)
stdout:
fe6a0618-62aa-434d-b9b8-459603a690ce
Status = WaitForLaunch
nicModel = rtl8139,pv
statusTime = 4905357140
emulatedMachine = pc
pid = 0
vmName = HostedEngine
devices = [{'index': '0', 'iface': 'virtio',
'format': 'raw', 'bootOrder': '1', 'address':
'None', 'volumeID': '5e24a8ba-ff1f-409b-918c-b0c31565ae89',
'imageID': '23ec5c8d-d154-488b-8dd2-de29a0fd941d', 'readonly':
'false', 'domainID': '4c0104e0-dc8d-44b6-ab70-9d46599eb7f6',
'deviceId': '23ec5c8d-d154-488b-8dd2-de29a0fd941d', 'poolID':
'00000000-0000-0000-0000-000000000000', 'device': 'disk',
'shared': 'exclusive', 'propagateErrors': 'off',
'type': 'disk'}, {'nicModel': 'pv', 'macAddr':
'00:16:3e:1c:f3:7c', 'linkActive': 'true', 'network':
'ovirtmgmt', 'deviceId': '113617eb-d506-4df1-b542-26248ffd8027',
'address': 'None', 'device': 'bridge', 'type':
'interface'}, {'index': '2', 'iface': 'ide',
'readonly': 'true', 'deviceId':
'8c3179ac-b322-4f5c-9449-c52e3665e0ae', 'address': {'bus':
'1', 'controller': '0', 'type': 'drive',
'target': '0', 'unit': '0'}, 'device':
'cdrom', 'shared': 'false', 'path': '',
'type': 'disk'}]
guestDiskMapping = {}
vmType = kvm
displaySecurePort = -1
memSize = 4096
displayPort = -1
clientIp =
spiceSecureChannels =
smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir
smp = 2
displayIp = 0
display = vnc
MainThread::INFO::2016-11-07
18:17:19,411::hosted_engine::1116::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm)
stderr: /usr/share/vdsm/vdsClient.py:33: DeprecationWarning: vdscli uses xmlrpc. since
ovirt 3.6 xmlrpc is deprecated, please use vdsm.jsonrpcvdscli
from vdsm import utils, vdscli, constants
/usr/share/vdsm/vdsClient.py:33: DeprecationWarning: vdscli uses xmlrpc. since ovirt 3.6
xmlrpc is deprecated, please use vdsm.jsonrpcvdscli
from vdsm import utils, vdscli, constants
MainThread::INFO::2016-11-07
18:17:19,411::hosted_engine::1128::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm)
Engine VM started on localhost
MainThread::INFO::2016-11-07
18:17:19,416::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)
Trying: notify time=1478542639.42 type=state_transition detail=EngineStart-EngineStarting
hostname='ied-blade11.install.eurotux.local'
MainThread::INFO::2016-11-07
18:17:19,681::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)
Success, was notification of state_transition (EngineStart-EngineStarting) sent? sent
MainThread::INFO::2016-11-07
18:17:19,681::hosted_engine::612::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm)
Initializing VDSM
But i get the following error and don't see the hosted_engine1
receiving fence:
==> /var/log/ovirt-hosted-engine-ha/broker.log <==
Thread-1007::INFO::2016-11-07 18:17:21,407::ping::52::ping.Ping::(action) Successfully
pinged 10.10.4.254
Thread-297080::INFO::2016-11-07
18:17:21,622::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup)
Connection established
Thread-297080::INFO::2016-11-07
18:17:21,676::listener::186::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle)
Connection closed
Thread-297081::INFO::2016-11-07
18:17:21,676::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup)
Connection established
Thread-297081::INFO::2016-11-07
18:17:21,678::listener::186::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle)
Connection closed
Thread-297082::INFO::2016-11-07
18:17:21,678::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup)
Connection established
Thread-297082::INFO::2016-11-07
18:17:21,680::listener::186::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle)
Connection closed
Thread-1010::ERROR::2016-11-07
18:17:23,596::cpu_load_no_engine::156::cpu_load_no_engine.EngineHealth::(update_stat_file)
Failed to getVmStats: 'pid'
Thread-1010::INFO::2016-11-07
18:17:23,597::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load)
System load total=0.0732, engine=0.0000, non-engine=0.0732
Can you help me to understand what goes wrong?
Regards,
Carlos Rodrigues
On Tue, 2016-08-23 at 14:29 +0100, Carlos Rodrigues wrote:
On Tue, 2016-08-23 at 14:16 +0200, Simone Tiraboschi wrote:
> > > On Mon, Aug 22, 2016 at 1:10 PM, Carlos Rodrigues <cmar(a)eurotux.com
> wrote:
> >
> > On Fri, 2016-08-19 at 11:50 +0100, Carlos Rodrigues wrote:
> > >
> > > On Fri, 2016-08-19 at 12:24 +0200, Simone Tiraboschi wrote:
> > > >
> > > >
> > > > > > > > > On Fri, Aug 19, 2016 at 12:07 PM, Carlos
Rodrigues <cmar@euro
tu
> > > > x.co
> > > > m>
> > > > wrote:
> > > > >
> > > > >
> > > > >
> > > > > On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > > > > > > > > > On Fri, 2016-08-19 at
11:36 +0200, Simone Tiraboschi
wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > On Fri, Aug
19, 2016 at 11:29 AM, Carlos Rodrigues
<cmar@
> > > > > > > euro
> > > > > > > tu
> > > > > > > x.co
> > > > > > > m>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > After night, the OVF_STORE it was created:
> > > > > > > >
> > > > > > >
> > > > > > > It's quite strange that it got so long but now it
looks
> > > > > > > fine.
> > > > > > >
> > > > > > > > > > > > > > > If the
ISO_DOMAIN that I see in your screenshot is
served
> > > > > > > by
> > > > > > > the
> > > > > > > > > > > > > > > engine VM
itself, I suggest to remove it and export
from
> > > > > > > an
> > > > > > > external
> > > > > > > server.
> > > > > > > > > > > > > > > Serving the
ISO storage domain from the engine VM
itself
> > > > > > > is
> > > > > > > not
> > > > > > > a
> > > > > > > good idea since when the engine VM is down you can
> > > > > > > experiment
> > > > > > > long
> > > > > > > > > > > > > > > delays before
getting the engine VM restarted due to
the
> > > > > > > unavailable
> > > > > > > storage domain.
> > > > > >
> > > > > > Ok, thank you for advice.
> > > > > >
> > > > > > Now, apparently is all ok. I'll do more tests with HA
and
> > > > > > any
> > > > > > issue
> > > > > > i'll tell you.
> > > > > >
> > > > > > Thank you for your support.
> > > > > >
> > > > > > Regards,
> > > > > > Carlos Rodrigues
> > > > > >
> > > > >
> > > > > > > > > > > I shutdown the network of host
with engine VM and i
expected
> > > > > that
> > > > > other
> > > > > host fence the host and start engine VM but i don't see any
> > > > > fence
> > > > > action and the "free" host keep trying to start VM but
get
> > > > > and
> > > > > error of
> > > > > sanlock
> > > > >
> > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > > > qemu-
> > > > > kvm:
> > > > > sending ioctl 5326 to a partition!
> > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > > > qemu-
> > > > > kvm:
> > > > > sending ioctl 80200204 to a partition!
> > > > > > > > > > > Aug 19 11:03:03
ied-blade11.install.eurotux.local
kvm[7867]:
> > > > > 1
> > > > > guest
> > > > > now active
> > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local
> > > > > sanlock[884]:
> > > > > 2016-
> > > > > 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1
> > > > > delta 1
> > > > > 9
> > > > > 245502 alive
> > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local
> > > > > sanlock[884]:
> > > > > 2016-
> > > > > 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error
> > > > > -243
> > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local
> > > > > sanlock[884]:
> > > > > 2016-
> > > > > 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862
> > > > > acquire_token
> > > > > -243 lease owned by other host
> > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local
> > > > > libvirtd[1369]:
> > > > > resource busy: Failed to acquire lock: error -243
> > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > > > ovirtmgmt:
> > > > > port 2(vnet0) entered disabled state
> > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > > > device
> > > > > vnet0
> > > > > left promiscuous mode
> > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel:
> > > > > ovirtmgmt:
> > > > > port 2(vnet0) entered disabled state
> > > > > > > > > > > Aug 19 11:03:03
ied-blade11.install.eurotux.local
kvm[7885]:
> > > > > 0
> > > > > guests
> > > > > now active
> > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd-
> > > > > machined[7863]: Machine qemu-4-HostedEngine terminated.
> > > >
> > > > Maybe you hit this one:
> > > > https://bugzilla.redhat.com/show_bug.cgi?id=1322849
> > > >
> > > >
> > > > Can you please check it as described in comment 28 and
> > > > eventually
> > > > apply the workaround in comment 18?
> > > >
> > >
> > > Apparently the host-id its ok. I don't need to apply the
> > > workaround.
> > >
> >
> > Any other suggestion?
> > I check that second host doens't fence the failed host and maybe
> > this
> > cause the lock of hosted storage domain.
>
> The picture isn't still that clear to me: ovirt-ha-agent is not
> trying
> to fence other hosted-engine hosts.
> > > The communication between hosts simply acts trough the metadata
area
> on the shared storage.
>
> > > Do you also loose the connection to the storage domain when you
play
> with the management network on your host?
>
No, the storage domain is connected over fiber channel, we saw that
agent tries to read metadata and tries to start engine VM but after
> couple seconds it shuts down the VM because its not able to acquire
san
lock.
> >
> > After recover network, engine VM check hosts and send fence
> > commands to
> > the hosts. In some cases, it sends fence commands to both hosts.
> >
> > Regards,
> > Carlos Rodrigues
> >
> >
> > >
> > >
> > > >
> > > >
> > > >
> > > >
> > > > >
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > On Fri, 2016-08-19 at 08:29 +0200, Simone
Tiraboschi
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues
<cm
> > > > > > > > > ar@e
> > > > > > > > > ur
> > > > > > > > > otux
> > > > > > > > > .c
> > > > > > > > > om> wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, 2016-08-18 at 17:45 +0200,
Simone
> > > > > > > > > > Tiraboschi
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos
Rodrigues
> > > > > > > > > > > <cmar
> > > > > > > > > > > @eur
> > > > > > > > > > > ot
> > > > > > > > > > > ux.com> wrote:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > I increase hosted_engine disk
space to 160G.
> > > > > > > > > > > > How do
> > > > > > > > > > > > i
> > > > > > > > > > > > force
> > > > > > > > > > > > to create
> > > > > > > > > > > > OVF_STORE.
> > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > I think that restarting the engine on the
engine
> > > > > > > > > > > VM
> > > > > > > > > > > will
> > > > > > > > > > > trigger it
> > > > > > > > > > > although I'm not sure that it
was a size issue.
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > I found to OVF_STORE on another storage domain
with
> > > > > > > > > > "Domain
> > > > > > > > > > Type" "Data (Master)"
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Each storage domain has its own OVF_STORE
volumes;
> > > > > > > > > you
> > > > > > > > > should
> > > > > > > > > get
> > > > > > > > > them also on the hosted-engine storage
domain.
> > > > > > > > > > > > > > > > > >
> Not really sure about how to trigger it again;
adding
> > > > > > > > > Roy
> > > > > > > > > here.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Regards,
> > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, 2016-08-18 at 12:14
+0100, Carlos
> > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, 2016-08-18 at
12:34 +0200, Simone
> > > > > > > > > > > > > Tiraboschi
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Thu, Aug 18,
2016 at 12:11 PM, Carlos
> > > > > > > > > > > > > > Rodrigues
> > > > > > > > > > > > > > <cma
> > > > > > > > > > > > > > r(a)eurotux.co
> > > > > > > > > > > > > > m>
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, 2016-08-18 at
11:53 +0200,
Simone
> > > > > > > > > > > > > >
> Tiraboschi
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Thu,
Aug 18, 2016 at 11:50 AM,
> > > > > > > > > > > > > > > > Carlos
> > > > > > > > > > > > > > > >
Rodrigues
> > > > > > > > > > > > > > > >
<cmar@eurotu
> > > > > > > > > > > > > > > > x.
> > > > > > > > > > > > > > > > com>
> > > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On
Thu, 2016-08-18 at 11:42 +0200,
> > > > > > > > > > > > > > > > >
Simone
> > > > > > > > > > > > > > > > >
Tiraboschi wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
On Thu, Aug 18, 2016 at 11:25 AM,
> > > > > > > > > > > > > > > > > >
Carlos
> > > > > > > > > > > > > > > > > >
Rodrigues <cmar@eu
> > > > > > > > > > > > > > > > > >
ro
> > > > > > > > > > > > > > > > > >
tux.
> > > > > > > > > > > > > > > > > >
com> wrote:
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> On Thu, 2016-08-18 at 11:04
> > > > > > > > > > > > > > > > > >
> +0200,
> > > > > > > > > > > > > > > > > >
> Simone
> > > > > > > > > > > > > > > > > >
> Tiraboschi
> > > > > > > > > > > > > > > > > >
> wrote:
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > On Thu, Aug 18, 2016 at 10:36
> > > > > > > > > > > > > > > > > >
> > AM,
> > > > > > > > > > > > > > > > > >
> > Carlos
> > > > > > > > > > > > > > > > > >
> > Rodrigues
> > > > > > > > > > > > > > > > > >
> > <cmar@
> > > > > > > > > > > > > > > > > >
> > euro
> > > > > > > > > > > > > > > > > >
> > tux.com>
> > > > > > > > > > > > > > > > > >
> > wrote:
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > On Thu, 2016-08-18 at 10:27
> > > > > > > > > > > > > > > > > >
> > > +0200,
> > > > > > > > > > > > > > > > > >
> > > Simone
> > > > > > > > > > > > > > > > > >
> > > Tiraboschi
> > > > > > > > > > > > > > > > > >
> > > wrote:
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > On Thu, Aug 18, 2016 at
> > > > > > > > > > > > > > > > > >
> > > > 10:22
> > > > > > > > > > > > > > > > > >
> > > > AM,
> > > > > > > > > > > > > > > > > >
> > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > <cmar@
> > > > > > > > > > > > > > > > > >
> > > > eurotux.
> > > > > > > > > > > > > > > > > >
> > > > com>
> > > > > > > > > > > > > > > > > >
> > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > On Thu, 2016-08-18 at
> > > > > > > > > > > > > > > > > >
> > > > > 08:54
> > > > > > > > > > > > > > > > > >
> > > > > +0200,
> > > > > > > > > > > > > > > > > >
> > > > > Simone
> > > > > > > > > > > > > > > > > >
> > > > > Tiraboschi
> > > > > > > > > > > > > > > > > >
> > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > On Tue, Aug 16, 2016
at
> > > > > > > > > > > > > >
> > > > > > > > > > 12:53
> > > > > > > > > > > > > > > > > >
> > > > > > PM,
> > > > > > > > > > > > > > > > > >
> > > > > > Carlos
> > > > > > > > > > > > > > > > > >
> > > > > > Rodrigues <c
> > > > > > > > > > > > > > > > > >
> > > > > > mar@euro
> > > > > > > > > > > > > > > > > >
> > > > > > tux.
> > > > > > > > > > > > > > > > > >
> > > > > > com>
> > > > > > > > > > > > > > > > > >
> > > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Sun,
2016-08-14
at
> > > > > > > > > > > > > >
> > > > > > > > > > > 14:22
> > > > > > > > > > > > > > > > > >
> > > > > > > +0300, Roy Golan
> > > > > > > > > > > > > > > > > >
> > > > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > On 12 August 2016
> > > > > > > > > > > > > > > > > >
> > > > > > > > at
> > > > > > > > > > > > > > > > > >
> > > > > > > > 20:23,
> > > > > > > > > > > > > > > > > >
> > > > > > > > Carlos
> > > > > > > > > > > > > > > > > >
> > > > > > > > Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > > > <cma
> > > > > > > > > > > > > > > > > >
> > > > > > > > r@eurotu
> > > > > > > > > > > > > > > > > >
> > > > > > > > x.co
> > > > > > > > > > > > > > > > > >
> > > > > > > > m>
> > > > > > > > > > > > > > > > > >
> > > > > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > Hello,
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > I have one
> > > > > > > > > > > > > > > > > >
> > > > > > > > > cluster
> > > > > > > > > > > > > > > > > >
> > > > > > > > > with
> > > > > > > > > > > > > > > > > >
> > > > > > > > > two
> > > > > > > > > > > > > > > > > >
> > > > > > > > > hosts with
> > > > > > > > > > > > > > > > > >
> > > > > > > > > power
> > > > > > > > > > > > > > > > > >
> > > > > > > > > management
> > > > > > > > > > > > > > > > > >
> > > > > > > > > correctly
> > > > > > > > > > > > > > > > > >
> > > > > > > > > configured and
> > > > > > > > > > > > > > > > > >
> > > > > > > > > one
> > > > > > > > > > > > > > > > > >
> > > > > > > > > virtual
> > > > > > > > > > > > > > > > > >
> > > > > > > > > machine with
> > > > > > > > > > > > > > > > > >
> > > > > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > > > > over
> > > > > > > > > > > > > > > > > >
> > > > > > > > > shared
> > > > > > > > > > > > > > > > > >
> > > > > > > > > storage with
> > > > > > > > > > > > > > > > > >
> > > > > > > > > FiberChannel.
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > When i shutdown
> > > > > > > > > > > > > > > > > >
> > > > > > > > > the
> > > > > > > > > > > > > > > > > >
> > > > > > > > > network
> > > > > > > > > > > > > > > > > >
> > > > > > > > > of host with
> > > > > > > > > > > > > > > > > >
> > > > > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > > > > VM, it
> > > > > > > > > > > > > > > > > >
> > > > > > > > > should be
> > > > > > > > > > > > > > > > > >
> > > > > > > > > possible the
> > > > > > > > > > > > > > > > > >
> > > > > > > > > HostedEngine
> > > > > > > > > > > > > > > > > >
> > > > > > > > > VM
> > > > > > > > > > > > > > > > > >
> > > > > > > > > migrate
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> automatically
to
> > > > > > > > > > > > > >
> > > > > > > > > > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > > > > > host?
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > migrate on which
> > > > > > > > > > > > > > > > > >
> > > > > > > > network?
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > What is the
> > > > > > > > > > > > > > > > > >
> > > > > > > > > expected
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> behaviour on
this
> > > > > > > > > > > > > >
> > > > > > > > > > > > > HA
> > > > > > > > > > > > > > > > > >
> > > > > > > > > scenario?
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > After
a few
minutes
> > > > > > > > > > > > > >
> > > > > > > > > > > > your
> > > > > > > > > > > > > > > > > >
> > > > > > > > vm
> > > > > > > > > > > > > > > > > >
> > > > > > > > will be
> > > > > > > > > > > > > > > > > >
> > > > > > > > shutdown
> > > > > > > > > > > > > > > > > >
> > > > > > > > by
> > > > > > > > > > > > > > > > > >
> > > > > > > > the High
> > > > > > > > > > > > > > > > > >
> > > > > > > > Availability
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
agent, as it
can't
> > > > > > > > > > > > > >
> > > > > > > > > > > > see
> > > > > > > > > > > > > > > > > >
> > > > > > > > network,
> > > > > > > > > > > > > > > > > >
> > > > > > > > and started
> > > > > > > > > > > > > > > > > >
> > > > > > > > on
> > > > > > > > > > > > > > > > > >
> > > > > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > > > > host.
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > I'm testing this
> > > > > > > > > > > > > > > > > >
> > > > > > > scenario
> > > > > > > > > > > > > > > > > >
> > > > > > > and
> > > > > > > > > > > > > > > > > >
> > > > > > > after shutdown
> > > > > > > > > > > > > > > > > >
> > > > > > > network, it
> > > > > > > > > > > > > > > > > >
> > > > > > > should
> > > > > > > > > > > > > > > > > >
> > > > > > > be
> > > > > > > > > > > > > > > > > >
> > > > > > > expected that agent
> > > > > > > > > > > > > > > > > >
> > > > > > > shutdown ha
> > > > > > > > > > > > > > > > > >
> > > > > > > and started
> > > > > > > > > > > > > > > > > >
> > > > > > > on
> > > > > > > > > > > > > > > > > >
> > > > > > > another
> > > > > > > > > > > > > > > > > >
> > > > > > > host,
> > > > > > > > > > > > > > > > > >
> > > > > > > but
> > > > > > > > > > > > > > > > > >
> > > > > > > after
> > > > > > > > > > > > > > > > > >
> > > > > > > couple minutes
> > > > > > > > > > > > > > > > > >
> > > > > > > nothing
> > > > > > > > > > > > > > > > > >
> > > > > > > happens
> > > > > > > > > > > > > > > > > >
> > > > > > > and on host
> > > > > > > > > > > > > > > > > >
> > > > > > > with
> > > > > > > > > > > > > > > > > >
> > > > > > > network we
> > > > > > > > > > > > > > > > > >
> > > > > > > getting
> > > > > > > > > > > > > > > > > >
> > > > > > > the
> > > > > > > > > > > > > > > > > >
> > > > > > > following messages:
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Aug 16 11:44:08
ied-
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> blade11.install.eur
ot
> > > > > > > > > > > > > >
> > > > > > > > > > > ux.l
> > > > > > > > > > > > > > > > > >
> > > > > > > oc
> > > > > > > > > > > > > > > > > >
> > > > > > > al
> > > > > > > > > > > > > > > > > >
> > > > > > > ovirt-ha-
> > > > > > > > > > > > > > > > > >
> > > > > > > agent[2779]:
> > > > > > > > > > > > > > > > > >
> > > > > > > ovirt-ha-agent
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
ovirt_hosted_engine
_h
> > > > > > > > > > > > > >
> > > > > > > > > > > a.ag
> > > > > > > > > > > > > > > > > >
> > > > > > > en
> > > > > > > > > > > > > > > > > >
> > > > > > > t.ho
> > > > > > > > > > > > > > > > > >
> > > > > > > st
> > > > > > > > > > > > > > > > > >
> > > > > > > ed_engine.Ho
> > > > > > > > > > > > > > > > > >
> > > > > > > st
> > > > > > > > > > > > > > > > > >
> > > > > > > edEn
> > > > > > > > > > > > > > > > > >
> > > > > > > gine.con
> > > > > > > > > > > > > > > > > >
> > > > > > > fig
> > > > > > > > > > > > > > > > > >
> > > > > > > ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Unable to get
vm.conf
> > > > > > > > > > > > > >
> > > > > > > > > > > from
> > > > > > > > > > > > > > > > > >
> > > > > > > OVF_STORE, falling
> > > > > > > > > > > > > > > > > >
> > > > > > > back
> > > > > > > > > > > > > > > > > >
> > > > > > > to
> > > > > > > > > > > > > > > > > >
> > > > > > > initial
> > > > > > > > > > > > > > > > > >
> > > > > > > vm.conf
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > I think the HA
agent
> > > > > > > > > > > > > >
> > > > > > > > > > > its
> > > > > > > > > > > > > > > > > >
> > > > > > > trying
> > > > > > > > > > > > > > > > > >
> > > > > > > to get vm
> > > > > > > > > > > > > > > > > >
> > > > > > > configuration but
> > > > > > > > > > > > > > > > > >
> > > > > > > some
> > > > > > > > > > > > > > > > > >
> > > > > > > how it
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > can't get
vm.conf
to
> > > > > > > > > > > > > >
> > > > > > > > > > > start
> > > > > > > > > > > > > > > > > >
> > > > > > > VM.
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > No, this is a
different
> > > > > > > > > > > > > >
> > > > > > > > > > issues.
> > > > > > > > > > > > > > > > > >
> > > > > > In 3.6 we added a
> > > > > > > > > > > > > > > > > >
> > > > > > feature
> > > > > > > > > > > > > > > > > >
> > > > > > to
> > > > > > > > > > > > > > > > > >
> > > > > > let
> > > > > > > > > > > > > > > > > >
> > > > > > the engine
> > > > > > > > > > > > > > > > > >
> > > > > > manage
> > > > > > > > > > > > > > > > > >
> > > > > > also the
> > > > > > > > > > > > > > > > > >
> > > > > > engine VM
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > itself; ovirt-ha-
agent
> > > > > > > > > > > > > >
> > > > > > > > > > will
> > > > > > > > > > > > > > > > > >
> > > > > > pickup
> > > > > > > > > > > > > > > > > >
> > > > > > the latest
> > > > > > > > > > > > > > > > > >
> > > > > > engine
> > > > > > > > > > > > > > > > > >
> > > > > > VM
> > > > > > > > > > > > > > > > > >
> > > > > > configuration
> > > > > > > > > > > > > > > > > >
> > > > > > from the OVF_STORE
> > > > > > > > > > > > > > > > > >
> > > > > > which is
> > > > > > > > > > > > > > > > > >
> > > > > > managed
> > > > > > > > > > > > > > > > > >
> > > > > > by the
> > > > > > > > > > > > > > > > > >
> > > > > > engine.
> > > > > > > > > > > > > > > > > >
> > > > > > If something goes
> > > > > > > > > > > > > > > > > >
> > > > > > wrong,
> > > > > > > > > > > > > > > > > >
> > > > > > ovirt-
> > > > > > > > > > > > > > > > > >
> > > > > > ha-
> > > > > > > > > > > > > > > > > >
> > > > > > agent could
> > > > > > > > > > > > > > > > > >
> > > > > > fallback to the
> > > > > > > > > > > > > > > > > >
> > > > > > initial
> > > > > > > > > > > > > > > > > >
> > > > > > (bootstrap time)
> > > > > > > > > > > > > > > > > >
> > > > > > vm.conf.
> > > > > > > > > > > > > > > > > >
> > > > > > This
> > > > > > > > > > > > > > > > > >
> > > > > > will
> > > > > > > > > > > > > > > > > >
> > > > > > normally
> > > > > > > > > > > > > > > > > >
> > > > > > happen
> > > > > > > > > > > > > > > > > >
> > > > > > till you
> > > > > > > > > > > > > > > > > >
> > > > > > add
> > > > > > > > > > > > > > > > > >
> > > > > > your
> > > > > > > > > > > > > > > > > >
> > > > > > first regular storage
> > > > > > > > > > > > > > > > > >
> > > > > > domain
> > > > > > > > > > > > > > > > > >
> > > > > > and
> > > > > > > > > > > > > > > > > >
> > > > > > the engine
> > > > > > > > > > > > > > > > > >
> > > > > > imports
> > > > > > > > > > > > > > > > > >
> > > > > > the
> > > > > > > > > > > > > > > > > >
> > > > > > engine
> > > > > > > > > > > > > > > > > >
> > > > > > VM.
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > But i already have my
> > > > > > > > > > > > > > > > > >
> > > > > first
> > > > > > > > > > > > > > > > > >
> > > > > storage
> > > > > > > > > > > > > > > > > >
> > > > > domain and
> > > > > > > > > > > > > > > > > >
> > > > > storage
> > > > > > > > > > > > > > > > > >
> > > > > engine
> > > > > > > > > > > > > > > > > >
> > > > > domain
> > > > > > > > > > > > > > > > > >
> > > > > and already imported
> > > > > > > > > > > > > > > > > >
> > > > > engine
> > > > > > > > > > > > > > > > > >
> > > > > VM.
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > I'm using 4.0 version.
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > This seams an issue, can
> > > > > > > > > > > > > > > > > >
> > > > you
> > > > > > > > > > > > > > > > > >
> > > > please
> > > > > > > > > > > > > > > > > >
> > > > share your
> > > > > > > > > > > > > > > > > >
> > > > /var/log/ovirt-hosted-
> > > > > > > > > > > > > > > > > >
> > > > engine-
> > > > > > > > > > > > > > > > > >
> > > > ha/agent.log ?
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > I sent it in attachment.
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > Nothing strange here;
> > > > > > > > > > > > > > > > > >
> > do you see a couple of disks
> > > > > > > > > > > > > > > > > >
> > with
> > > > > > > > > > > > > > > > > >
> > alias
> > > > > > > > > > > > > > > > > >
> > OVF_STORE on
> > > > > > > > > > > > > > > > > >
> > the
> > > > > > > > > > > > > > > > > >
> > hosted-
> > > > > > > > > > > > > > > > > >
> > engine
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > storage domain if you check
it
> > > > > > > > > > > > > >
> > > > > > from
> > > > > > > > > > > > > > > > > >
> > the
> > > > > > > > > > > > > > > > > >
> > engine?
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Do you mean any disk label?
> > > > > > > > > > > > > > > > > >
> I don't have it anyone:
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > [root@ied-blade11 ~]# ls
> > > > > > > > > > > > > > > > > >
> /dev/disk/by-
> > > > > > > > > > > > > > > > > >
> label/
> > > > > > > > > > > > > > > > > >
> ls: cannot access /dev/disk/by-
> > > > > > > > > > > > > > > > > >
> label/:
> > > > > > > > > > > > > > > > > >
> No
> > > > > > > > > > > > > > > > > >
> such file or
> > > > > > > > > > > > > > > > > >
> directory
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> No I mean: go to the engine web-
ui,
> > > > > > > > > > > > > >
> > > > select
> > > > > > > > > > > > > > > > > >
the
> > > > > > > > > > > > > > > > > >
hosted-
> > > > > > > > > > > > > > > > > >
engine
> > > > > > > > > > > > > > > > > >
storage
> > > > > > > > > > > > > > > > > >
domain, check the disks there.
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > No,
the alias is virtio-disk0.
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > And this is the
engine VM disk, so
the
> > > > > > > > > > > > > >
> > issue
> > > > > > > > > > > > > > > > is
> > > > > > > > > > > > > > > > why
> > > > > > > > > > > > > > > > the
engine
> > > > > > > > > > > > > > > > has
> > > > > > > > > > > > > > > > still to
create the OVF_STORE.
> > > > > > > > > > > > > > > > Can you
please share your engine.log
> > > > > > > > > > > > > > > > from
> > > > > > > > > > > > > > > > the
> > > > > > > > > > > > > > > > engine
VM?
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Go in
attachment.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > The creation of the
OVF_STORE disk failed
> > > > > > > > > > > > > > but
> > > > > > > > > > > > > > it's
> > > > > > > > > > > > > > not
> > > > > > > > > > > > > > that clear
> > > > > > > > > > > > > > why:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > 2016-08-17
08:43:33,538 ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfsto
re
> > > > > > > > > > > > > >
.Cre
> > > > > > > > > > > > > > at
> > > > > > > > > > > > > > eOvf
> > > > > > > > > > > > > > Vo
> > > > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > > > ge
> > > > > > > > > > > > > > DomainCommand]
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4]
Ending
> > > > > > > > > > > > > >
command
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfsto
re
> > > > > > > > > > > > > >
.Cre
> > > > > > > > > > > > > > at
> > > > > > > > > > > > > > eOvf
> > > > > > > > > > > > > > Vo
> > > > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > > > ge
> > > > > > > > > > > > > > DomainCommand'
> > > > > > > > > > > > > > with failure.
> > > > > > > > > > > > > > 2016-08-17
08:43:33,540 ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.A
dd
> > > > > > > > > > > > > >
Disk
> > > > > > > > > > > > > > Co
> > > > > > > > > > > > > > mman
> > > > > > > > > > > > > > d]
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > (DefaultQuartzScheduler6)
[6f1f1fd4]
Ending
> > > > > > > > > > > > > >
command
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.A
dd
> > > > > > > > > > > > > >
Disk
> > > > > > > > > > > > > > Co
> > > > > > > > > > > > > > mman
> > > > > > > > > > > > > > d'
> > > > > > > > > > > > > > with
> > > > > > > > > > > > > > failure.
> > > > > > > > > > > > > > 2016-08-17
08:43:33,541 WARN
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.A
dd
> > > > > > > > > > > > > >
Disk
> > > > > > > > > > > > > > Co
> > > > > > > > > > > > > > mman
> > > > > > > > > > > > > > d]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler6) [6f1f1fd4]
> > > > > > > > > > > > > >
VmCommand::EndVmCommand: Vm is
> > > > > > > > > > > > > > null - not
performing endAction on Vm
> > > > > > > > > > > > > > 2016-08-17
08:43:33,553 ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.audit
lo
> > > > > > > > > > > > > >
ghan
> > > > > > > > > > > > > > dl
> > > > > > > > > > > > > > ing.
> > > > > > > > > > > > > > Au
> > > > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > > > or
> > > > > > > > > > > > > > ]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler6) [6f1f1fd4]
> > > > > > > > > > > > > > Correlation
> > > > > > > > > > > > > > ID:
> > > > > > > > > > > > > > 6f1f1fd4, Call
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > Stack: null, Custom Event ID: -1,
Message:
> > > > > > > > > > > > > >
Add-
> > > > > > > > > > > > > > Disk
> > > > > > > > > > > > > > operation
> > > > > > > > > > > > > > failed
> > > > > > > > > > > > > > to complete.
> > > > > > > > > > > > > > 2016-08-17
08:43:33,557 WARN
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.audit
lo
> > > > > > > > > > > > > >
ghan
> > > > > > > > > > > > > > dl
> > > > > > > > > > > > > > ing.
> > > > > > > > > > > > > > Au
> > > > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > > > or
> > > > > > > > > > > > > > ]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler6) [] Correlation
> > > > > > > > > > > > > > ID:
> > > > > > > > > > > > > > 19ac5bda,
> > > > > > > > > > > > > > Call Stack:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > null, Custom Event ID: -1, Message:
Failed
> > > > > > > > > > > > > >
to
> > > > > > > > > > > > > > create
> > > > > > > > > > > > > > OVF store disk
> > > > > > > > > > > > > > for Storage Domain
hosted_storage.
> > > > > > > > > > > > > > OVF data won't
be updated meanwhile for
> > > > > > > > > > > > > > that
> > > > > > > > > > > > > > domain.
> > > > > > > > > > > > > > 2016-08-17
08:43:33,585 INFO
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCom
ma
> > > > > > > > > > > > > >
ndsE
> > > > > > > > > > > > > > xe
> > > > > > > > > > > > > > cuti
> > > > > > > > > > > > > > on
> > > > > > > > > > > > > > Callback]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler6) [5f5a8daf]
> > > > > > > > > > > > > > Command
> > > > > > > > > > > > > >
'ProcessOvfUpdateForStorageDomain' (id:
> > > > > > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0')
> > > > > > > > > > > > > > waiting
> > > > > > > > > > > > > > on
> > > > > > > > > > > > > > child command
> > > > > > > > > > > > > > id:
> > > > > > > > > > > > > >
'eb2e6f1a-c756-4ccd-85a1-60d97d6880de'
> > > > > > > > > > > > > >
type:'CreateOvfVolumeForStorageDomain' to
> > > > > > > > > > > > > > complete
> > > > > > > > > > > > > > 2016-08-17
08:43:33,595 ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfsto
re
> > > > > > > > > > > > > >
.Cre
> > > > > > > > > > > > > > at
> > > > > > > > > > > > > > eOvf
> > > > > > > > > > > > > > Vo
> > > > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > > > ge
> > > > > > > > > > > > > > DomainCommand]
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49]
Ending
> > > > > > > > > > > > > >
command
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfsto
re
> > > > > > > > > > > > > >
.Cre
> > > > > > > > > > > > > > at
> > > > > > > > > > > > > > eOvf
> > > > > > > > > > > > > > Vo
> > > > > > > > > > > > > > lumeForStora
> > > > > > > > > > > > > > ge
> > > > > > > > > > > > > > DomainCommand'
> > > > > > > > > > > > > > with failure.
> > > > > > > > > > > > > > 2016-08-17
08:43:33,596 ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.A
dd
> > > > > > > > > > > > > >
Disk
> > > > > > > > > > > > > > Co
> > > > > > > > > > > > > > mman
> > > > > > > > > > > > > > d]
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5d314e49]
Ending
> > > > > > > > > > > > > >
command
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.disk.A
dd
> > > > > > > > > > > > > >
Disk
> > > > > > > > > > > > > > Co
> > > > > > > > > > > > > > mman
> > > > > > > > > > > > > > d'
> > > > > > > > > > > > > > with
> > > > > > > > > > > > > > failure.
> > > > > > > > > > > > > > 2016-08-17
08:43:33,596 WARN
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.disk.A
dd
> > > > > > > > > > > > > >
Disk
> > > > > > > > > > > > > > Co
> > > > > > > > > > > > > > mman
> > > > > > > > > > > > > > d]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler6) [5d314e49]
> > > > > > > > > > > > > >
VmCommand::EndVmCommand: Vm is
> > > > > > > > > > > > > > null - not
performing endAction on Vm
> > > > > > > > > > > > > > 2016-08-17
08:43:33,602 ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.audit
lo
> > > > > > > > > > > > > >
ghan
> > > > > > > > > > > > > > dl
> > > > > > > > > > > > > > ing.
> > > > > > > > > > > > > > Au
> > > > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > > > or
> > > > > > > > > > > > > > ]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler6) [5d314e49]
> > > > > > > > > > > > > > Correlation
> > > > > > > > > > > > > > ID:
> > > > > > > > > > > > > > 5d314e49, Call
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > Stack: null, Custom Event ID: -1,
Message:
> > > > > > > > > > > > > >
Add-
> > > > > > > > > > > > > > Disk
> > > > > > > > > > > > > > operation
> > > > > > > > > > > > > > failed
> > > > > > > > > > > > > > to complete.
> > > > > > > > > > > > > > 2016-08-17
08:43:33,605 WARN
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.dal.dbbroker.audit
lo
> > > > > > > > > > > > > >
ghan
> > > > > > > > > > > > > > dl
> > > > > > > > > > > > > > ing.
> > > > > > > > > > > > > > Au
> > > > > > > > > > > > > > ditLogDirect
> > > > > > > > > > > > > > or
> > > > > > > > > > > > > > ]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler6) [] Correlation
> > > > > > > > > > > > > > ID:
> > > > > > > > > > > > > > 5f5a8daf,
> > > > > > > > > > > > > > Call Stack:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > null, Custom Event ID: -1, Message:
Failed
> > > > > > > > > > > > > >
to
> > > > > > > > > > > > > > create
> > > > > > > > > > > > > > OVF store disk
> > > > > > > > > > > > > > for Storage Domain
hosted_storage.
> > > > > > > > > > > > > > OVF data won't
be updated meanwhile for
> > > > > > > > > > > > > > that
> > > > > > > > > > > > > > domain.
> > > > > > > > > > > > > > 2016-08-17
08:43:36,460 INFO
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.bll.scheduling.HaR
es
> > > > > > > > > > > > > >
erva
> > > > > > > > > > > > > > ti
> > > > > > > > > > > > > > onHa
> > > > > > > > > > > > > > nd
> > > > > > > > > > > > > > ling]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler7) [5d314e49] HA
> > > > > > > > > > > > > > reservation
> > > > > > > > > > > > > > status for
> > > > > > > > > > > > > > cluster
> > > > > > > > > > > > > > 'Default'
is 'OK'
> > > > > > > > > > > > > > 2016-08-17
08:43:36,662 INFO
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.bll.SerialChildCom
ma
> > > > > > > > > > > > > >
ndsE
> > > > > > > > > > > > > > xe
> > > > > > > > > > > > > > cuti
> > > > > > > > > > > > > > on
> > > > > > > > > > > > > > Callback]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler4) [5f5a8daf]
> > > > > > > > > > > > > > Command
> > > > > > > > > > > > > >
'ProcessOvfUpdateForStorageDomain' id:
> > > > > > > > > > > > > >
'71aaaafe-7b9e-45e8-a40c-6d33bdf646a0'
> > > > > > > > > > > > > > child
> > > > > > > > > > > > > > commands
> > > > > > > > > > > > > >
'[84959a4b-6a10-4d22-b37e-6c154e17a0da,
> > > > > > > > > > > > > >
eb2e6f1a-c756-4ccd-85a1-60d97d6880de]'
> > > > > > > > > > > > > > executions
> > > > > > > > > > > > > > were
> > > > > > > > > > > > > > completed,
> > > > > > > > > > > > > > status
'FAILED'
> > > > > > > > > > > > > > 2016-08-17
08:43:37,691 ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.bll.storage.ovfsto
re
> > > > > > > > > > > > > >
.Pro
> > > > > > > > > > > > > > ce
> > > > > > > > > > > > > > ssOv
> > > > > > > > > > > > > > fU
> > > > > > > > > > > > > > pdateForStor
> > > > > > > > > > > > > > ag
> > > > > > > > > > > > > > eDomainCommand]
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > (DefaultQuartzScheduler6)
[5f5a8daf]
Ending
> > > > > > > > > > > > > >
command
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
'org.ovirt.engine.core.bll.storage.ovfsto
re
> > > > > > > > > > > > > >
.Pro
> > > > > > > > > > > > > > ce
> > > > > > > > > > > > > > ssOv
> > > > > > > > > > > > > > fU
> > > > > > > > > > > > > > pdateForStor
> > > > > > > > > > > > > > ag
> > > > > > > > > > > > > >
eDomainCommand'
> > > > > > > > > > > > > > with failure.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Can you please
check vdsm logs for that
> > > > > > > > > > > > > > time
> > > > > > > > > > > > > > frame on
> > > > > > > > > > > > > > the SPM host?
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > I sent in attachment the vdsm logs from
both
> > > > > > > > > > > > >
hosts,
> > > > > > > > > > > > > but
> > > > > > > > > > > > > i
> > > > > > > > > > > > > think the
> > > > > > > > > > > > > SPM
> > > > > > > > > > > > > host on this time frame
it was ied-blade13
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > It seams that you also have an
issue in
the
> > > > > > > > > > > > > >
SPM
> > > > > > > > > > > > > > election
procedure:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > 2016-08-17
18:04:31,053 ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroke
r.
> > > > > > > > > > > > > >
IrsP
> > > > > > > > > > > > > > ro
> > > > > > > > > > > > > > xyDa
> > > > > > > > > > > > > > ta
> > > > > > > > > > > > > > ]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler1) [] SPM Init:
> > > > > > > > > > > > > > could
> > > > > > > > > > > > > > not
> > > > > > > > > > > > > > find
> > > > > > > > > > > > > > reported vds
> > > > > > > > > > > > > > or
> > > > > > > > > > > > > > not up - pool:
'Default' vds_spm_id: '2'
> > > > > > > > > > > > > > 2016-08-17
18:04:31,076 INFO
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroke
r.
> > > > > > > > > > > > > >
IrsP
> > > > > > > > > > > > > > ro
> > > > > > > > > > > > > > xyDa
> > > > > > > > > > > > > > ta
> > > > > > > > > > > > > > ]
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > (DefaultQuartzScheduler1) [] SPM
selection
> > > > > > > > > > > > > >
-
> > > > > > > > > > > > > > vds
> > > > > > > > > > > > > > seems
> > > > > > > > > > > > > > as spm
> > > > > > > > > > > > > >
'hosted_engine_2'
> > > > > > > > > > > > > > 2016-08-17
18:04:31,076 WARN
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.irsbroke
r.
> > > > > > > > > > > > > >
IrsP
> > > > > > > > > > > > > > ro
> > > > > > > > > > > > > > xyDa
> > > > > > > > > > > > > > ta
> > > > > > > > > > > > > > ]
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > (DefaultQuartzScheduler1) [] spm
vds is
non
> > > > > > > > > > > > > >
responsive,
> > > > > > > > > > > > > > stopping
> > > > > > > > > > > > > > spm
> > > > > > > > > > > > > > selection.
> > > > > > > > > > > > > > 2016-08-17
18:04:31,539 INFO
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitori
ng
> > > > > > > > > > > > > >
.Vms
> > > > > > > > > > > > > > St
> > > > > > > > > > > > > > atis
> > > > > > > > > > > > > > ti
> > > > > > > > > > > > > > csFetcher]
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > (DefaultQuartzScheduler7) []
Fetched 1
VMs
> > > > > > > > > > > > > >
from
> > > > > > > > > > > > > > VDS
> > > > > > > > > > > > > >
'06372186-572c-41ad-916f-7cbb0aba5302'
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > probably due to:
> > > > > > > > > > > > > > 2016-08-17
18:02:33,569 ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitori
ng
> > > > > > > > > > > > > >
.Hos
> > > > > > > > > > > > > > tM
> > > > > > > > > > > > > > onit
> > > > > > > > > > > > > > or
> > > > > > > > > > > > > > ing]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler6) [] Failure to
> > > > > > > > > > > > > > refresh
> > > > > > > > > > > > > > Vds
> > > > > > > > > > > > > > runtime info:
> > > > > > > > > > > > > >
VDSGenericException: VDSNetworkException:
> > > > > > > > > > > > > > Message
> > > > > > > > > > > > > > timeout which can
> > > > > > > > > > > > > > be
> > > > > > > > > > > > > > caused by
communication issues
> > > > > > > > > > > > > > 2016-08-17
18:02:33,569 ERROR
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
[org.ovirt.engine.core.vdsbroker.monitori
ng
> > > > > > > > > > > > > >
.Hos
> > > > > > > > > > > > > > tM
> > > > > > > > > > > > > > onit
> > > > > > > > > > > > > > or
> > > > > > > > > > > > > > ing]
> > > > > > > > > > > > > >
(DefaultQuartzScheduler6) [] Exception:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > >
org.ovirt.engine.core.vdsbroker.vdsbroker
.V
> > > > > > > > > > > > > >
DSNe
> > > > > > > > > > > > > > tw
> > > > > > > > > > > > > > orkE
> > > > > > > > > > > > > > xc
> > > > > > > > > > > > > > eption:
> > > > > > > > > > > > > >
VDSGenericException: VDSNetworkException:
> > > > > > > > > > > > > > Message
> > > > > > > > > > > > > > timeout which can
> > > > > > > > > > > > > > be
> > > > > > > > > > > > > > caused by
communication issues
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > This messages maybe
cause by connection
> > > > > > > > > > > > > issues
> > > > > > > > > > > > > from
> > > > > > > > > > > > > yesterday at 6pm.
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > can you please check if the engine
VM
could
> > > > > > > > > > > > > >
correctly
> > > > > > > > > > > > > > resolve and
> > > > > > > > > > > > > > reach each host?
> > > > > > > > > > > > >
> > > > > > > > > > > > > Now i can read engine VM
from both hosts
> > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > [root@ied-blade11 ~]# ping ied-hosted-
engine
> > > > > > > > > > > > > >
> > > > > > > > > > > > > PING ied-hosted-
engine.install.eurotux.local
> > > > > > > > > > > > >
(10.10.4.115) 56(84)
> > > > > > > > > > > > > bytes
> > > > > > > > > > > > > of data.
> > > > > > > > > > > > > 64 bytes from
ied-hosted-
> > > > > > > > > > > > >
engine.install.eurotux.local
> > > > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > > > icmp_seq=1 ttl=64
time=0.179 ms
> > > > > > > > > > > > > 64 bytes from
ied-hosted-
> > > > > > > > > > > > >
engine.install.eurotux.local
> > > > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > > > icmp_seq=2 ttl=64
time=0.141 ms
> > > > > > > > > > > > > ^C
> > > > > > > > > > > > > ---
ied-hosted-engine.install.eurotux.local
> > > > > > > > > > > > > ping
> > > > > > > > > > > > > statistics ---
> > > > > > > > > > > > > > > > > >
> > > > > > > > > 2 packets transmitted, 2 received, 0%
packet
> > > > > > > > > > > > >
loss,
> > > > > > > > > > > > > time
> > > > > > > > > > > > > 999ms
> > > > > > > > > > > > > rtt min/avg/max/mdev =
> > > > > > > > > > > > > 0.141/0.160/0.179/0.019
ms
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > [root@ied-blade13 ~]# ping ied-hosted-
engine
> > > > > > > > > > > > > >
> > > > > > > > > > > > > PING ied-hosted-
engine.install.eurotux.local
> > > > > > > > > > > > >
(10.10.4.115) 56(84)
> > > > > > > > > > > > > bytes
> > > > > > > > > > > > > of data.
> > > > > > > > > > > > > 64 bytes from
ied-hosted-
> > > > > > > > > > > > >
engine.install.eurotux.local
> > > > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > > > icmp_seq=1 ttl=64
time=0.172 ms
> > > > > > > > > > > > > 64 bytes from
ied-hosted-
> > > > > > > > > > > > >
engine.install.eurotux.local
> > > > > > > > > > > > > (10.10.4.115):
> > > > > > > > > > > > > icmp_seq=2 ttl=64
time=0.169 ms
> > > > > > > > > > > > > ^C
> > > > > > > > > > > > > ---
ied-hosted-engine.install.eurotux.local
> > > > > > > > > > > > > ping
> > > > > > > > > > > > > statistics ---
> > > > > > > > > > > > > > > > > >
> > > > > > > > > 2 packets transmitted, 2 received, 0%
packet
> > > > > > > > > > > > >
loss,
> > > > > > > > > > > > > time
> > > > > > > > > > > > > 1000ms
> > > > > > > > > > > > > rtt min/avg/max/mdev =
> > > > > > > > > > > > > 0.169/0.170/0.172/0.013
ms
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > I have a message
critical of low disk space
> > > > > > > > > > > > > on
> > > > > > > > > > > > > hosted_storage domain.
> > > > > > > > > > > > > I have 50G of disk and i
created i VM with
> > > > > > > > > > > > > 40G.
> > > > > > > > > > > > > Do
> > > > > > > > > > > > > i
> > > > > > > > > > > > > need
> > > > > > > > > > > > > more space
> > > > > > > > > > > > > of
> > > > > > > > > > > > > OVF_STORAGE?
> > > > > > > > > > > > > What is the minimum
requirements of disk
> > > > > > > > > > > > > space
> > > > > > > > > > > > > for
> > > > > > > > > > > > > deploy
> > > > > > > > > > > > > engine VM?
> > > > > > > > > > > > >
> > > > > > > > > > > > > Regards,
> > > > > > > > > > > > > Carlos
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > Regards,
> > > > > > > > > > > > > > > > > >
> > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > Regards,
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > --
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> Carlos
Rodrigues
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > Engenheiro de
> > > > > > > > > > > > > > > > > >
> > > > > > > > > Software
> > > > > > > > > > > > > > > > > >
> > > > > > > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > Eurotux
> > > > > > > > > > > > > > > > > >
> > > > > > > > > Informática,
> > > > > > > > > > > > > > > > > >
> > > > > > > > > S.A. |
> > > > > > > > > > > > > > > > > >
> > > > > > > > > w
> > > > > > > > > > > > > > > > > >
> > > > > > > > > ww.eurotux.c
> > > > > > > > > > > > > > > > > >
> > > > > > > > > om
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> (t) +351 253
680
> > > > > > > > > > > > > >
> > > > > > > > > > > > > 300
> > > > > > > > > > > > > > > > > >
> > > > > > > > > (m)
> > > > > > > > > > > > > > > > > >
> > > > > > > > > +351
> > > > > > > > > > > > > > > > > >
> > > > > > > > > 911 926 110
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> _______________
__
> > > > > > > > > > > > > >
> > > > > > > > > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > > > ____________
> > > > > > > > > > > > > > > > > >
> > > > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > > > > Users mailing
> > > > > > > > > > > > > > > > > >
> > > > > > > > > list
> > > > > > > > > > > > > > > > > >
> > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> http://lists.ov
ir
> > > > > > > > > > > > > >
> > > > > > > > > > > > > t.or
> > > > > > > > > > > > > > > > > >
> > > > > > > > > g/
> > > > > > > > > > > > > > > > > >
> > > > > > > > > mail
> > > > > > > > > > > > > > > > > >
> > > > > > > > > ma
> > > > > > > > > > > > > > > > > >
> > > > > > > > > n/listinfo/u
> > > > > > > > > > > > > > > > > >
> > > > > > > > > se
> > > > > > > > > > > > > > > > > >
> > > > > > > > > rs
> > > > > > > > > > > > > > > > > >
> > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > --
> > > > > > > > > > > > > > > > > >
> > > > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > Engenheiro de
> > > > > > > > > > > > > > > > > >
> > > > > > > Software
> > > > > > > > > > > > > > > > > >
> > > > > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Eurotux
Informática,
> > > > > > > > > > > > > >
> > > > > > > > > > > S.A.
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > www.e
> > > > > > > > > > > > > > > > > >
> > > > > > > urotux.com
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > (t) +351 253
680
300
> > > > > > > > > > > > > >
> > > > > > > > > > > (m)
> > > > > > > > > > > > > > > > > >
> > > > > > > +351
> > > > > > > > > > > > > > > > > >
> > > > > > > 911
> > > > > > > > > > > > > > > > > >
> > > > > > > 926 110
> > > > > > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
___________________
__
> > > > > > > > > > > > > >
> > > > > > > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > ____
> > > > > > > > > > > > > > > > > >
> > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > ____________
> > > > > > > > > > > > > > > > > >
> > > > > > > __
> > > > > > > > > > > > > > > > > >
> > > > > > > Users mailing list
> > > > > > > > > > > > > > > > > >
> > > > > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
http://lists.ovirt.
or
> > > > > > > > > > > > > >
> > > > > > > > > > > g/ma
> > > > > > > > > > > > > > > > > >
> > > > > > > il
> > > > > > > > > > > > > > > > > >
> > > > > > > man/
> > > > > > > > > > > > > > > > > >
> > > > > > > li
> > > > > > > > > > > > > > > > > >
> > > > > > > stinfo/users
> > > > > > > > > > > > > > > > > >
> > > > > --
> > > > > > > > > > > > > > > > > >
> > > > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > Engenheiro de Software
> > > > > > > > > > > > > > > > > >
> > > > > Sénior
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > Eurotux Informática,
S.A.
> > > > > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > www
> > > > > > > > > > > > > > > > > >
> > > > > .eur
> > > > > > > > > > > > > > > > > >
> > > > > ot
> > > > > > > > > > > > > > > > > >
> > > > > ux.com
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > (t) +351 253 680 300
(m)
> > > > > > > > > > > > > >
> > > > > > > > > +351
> > > > > > > > > > > > > > > > > >
> > > > > 911
> > > > > > > > > > > > > > > > > >
> > > > > 926
> > > > > > > > > > > > > > > > > >
> > > > > 110
> > > > > > > > > > > > > > > > > >
> > > > >
> > > > > > > > > > > > > > > > > >
> > > --
> > > > > > > > > > > > > > > > > >
> > > Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
> > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > > > > > > >
> > > Eurotux Informática, S.A. |
> > > > > > > > > > > > > > > > > >
> > > www.e
> > > > > > > > > > > > > > > > > >
> > > ur
> > > > > > > > > > > > > > > > > >
> > > otux
> > > > > > > > > > > > > > > > > >
> > > .c
> > > > > > > > > > > > > > > > > >
> > > om
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > (t) +351 253 680 300 (m)
+351
> > > > > > > > > > > > > >
> > > > > > > 911
> > > > > > > > > > > > > > > > > >
> > > 926
> > > > > > > > > > > > > > > > > >
> > > 110
> > > > > > > > > > > > > > > > > >
> --
> > > > > > > > > > > > > > > > > >
> Carlos Rodrigues
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > Eurotux Informática, S.A. |
www.e
> > > > > > > > > > > > > >
> > > > > urot
> > > > > > > > > > > > > > > > > >
> ux
> > > > > > > > > > > > > > > > > >
> .com
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > (t) +351 253 680 300 (m) +351
911
> > > > > > > > > > > > > >
> > > > > 926
> > > > > > > > > > > > > > > > > >
> 110
> > > > > > > > > > > > > > > > > >
>
> > > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > >
Carlos Rodrigues
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
Engenheiro de Software Sénior
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
Eurotux Informática, S.A. | www.eur
ot
> > > > > > > > > > > > > >
> > > ux.c
> > > > > > > > > > > > > > > > > om
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > (t)
+351 253 680 300 (m) +351 911
926
> > > > > > > > > > > > > >
> > > 110
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > Carlos
Rodrigues
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Engenheiro de
Software Sénior
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > Eurotux Informática, S.A.
| www.eurotux
.c
> > > > > > > > > > > > > >
> om
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > (t) +351 253 680 300 (m)
+351 911 926
110
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
___________________________________________
__
> > > > > > > > > > > > > __
> > > > > > > > > > > > > Users mailing list
> > > > > > > > > > > > > Users(a)ovirt.org
> > > > > > > > > > > > > > > > > >
> > > > > > > > > http://lists.ovirt.org/mailman/listinfo/use
rs
> > > > > > > > > > > > --
> > > > > > > > > > > > Carlos Rodrigues
> > > > > > > > > > > >
> > > > > > > > > > > > Engenheiro de Software
Sénior
> > > > > > > > > > > >
> > > > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > > > (t) +351 253 680 300 (m) +351
911 926 110
> > > > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Carlos Rodrigues
> > > > > > > > > >
> > > > > > > > > > Engenheiro de Software Sénior
> > > > > > > > > >
> > > > > > > > > > Eurotux Informática, S.A. |
www.eurotux.com
> > > > > > > > > > (t) +351 253 680 300 (m) +351 911 926
110
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > --
> > > > > > > > Carlos Rodrigues
> > > > > > > >
> > > > > > > > Engenheiro de Software Sénior
> > > > > > > >
> > > > > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > --
> > > > > Carlos Rodrigues
> > > > >
> > > > > Engenheiro de Software Sénior
> > > > >
> > > > > Eurotux Informática, S.A. | www.eurotux.com
> > > > > (t) +351 253 680 300 (m) +351 911 926 110
> > > > >
> > > > >
> > > >
> > --
> > Carlos Rodrigues
> >
> > Engenheiro de Software Sénior
> >
> > Eurotux Informática, S.A. | www.eurotux.com
> > (t) +351 253 680 300 (m) +351 911 926 110
> >
--
Carlos Rodrigues
Engenheiro de Software Sénior
Eurotux Informática, S.A. | www.eurotux.com
(t) +351 253 680 300 (m) +351 911 926 110
2436
days inactive
3023
days old
30 comments
4 participants
participants (4)
-
Carlos Rodrigues -
Hanson Turner -
Roy Golan -
Simone Tiraboschi