Re: [ovirt-users] SLA : RAM scheduling

28 May 2014

      ...
Hi Nathanaël,
happy to assist :) hope it will work in first run:
1) install the proxy and ovirtsdk.
yum install -y ovirt-scheduler-proxy
2) put attached file in the right place (according to docs: ".../plugins"),
according to the docs 
(http://www.ovirt.org/Features/oVirt_External_Scheduling_Proxy), the
...
make sure to edit the file with your ovirt's ip, user@domain and PW.
My engine API can't be reached in http, so there is some work to do this 
with https. Here is what I did : according to 
/usr/lib/python2.6/site-packages/ovirtsdk/api.py, I add insecure=True to
This is a multi-part message in MIME format.
--------------000809050505090608080605
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

Hi Gilad,

I followed your instructions, but it didn't work for me, I think for 
many reasons.

Le 26/05/2014 16:22, Gilad Chaplik a écrit :
place should be "plugins_path=$PYTHONPATH/ovirt_scheduler/plugins", 
which is should be mentionned in Scheduler conf file 
(/etc/ovirt/scheduler/scheduler.conf), but none of them exists in the 
filesystem!!! I've only found /usr/share/ovirt-scheduler-proxy/plugins 
for placing the python file and no scheduler.conf is present where I 
could change that path.
the chain
connection = API(url='http*s*://host:port',
                              username='user@domain', 
password=''*insecure='True'*)
Maybe it is not enough and it would be useful to add 
validate_cert_chain=False...
...
3) restart proxy service.
3) use config tool to configure ovirt-engine:
* "ExternalSchedulerServiceURL"="http://<ip>:18781/"
The scheduler proxy listens to localhost:18781, none of ips that can be 
filled here will be reached on that port.
* "ExternalSchedulerEnabled"=true
4) restart ovirt-engine service.
5) under configure->cluster_policy see that weight function memory_even_distribution was added (should be in manage policy units or /sth- you will see it in the main dialog as well).
6) clone/copy currernt cluster's used cluster policy (probably none - prefer it to have no balancing modules to avoid conflicts), name it 'your_name' and attach memory_even_distribution weight (you can leave it as the only weight module in weight section to avoid configuring factors).
7) replace cluster's cluster policy with newly created one.
try it out and let me know how goes :-)
Thanks,
Gilad.
If all above is tru, should be a good idea to update the wiki...
----- Original Message -----
...
From: "Nathanaël Blanchet" <blanchet@abes.fr>
To: "Gilad Chaplik" <gchaplik@redhat.com>
Cc: "Karli Sjöberg" <Karli.Sjoberg@slu.se>, "users" <users@ovirt.org>
Sent: Monday, May 26, 2014 12:12:41 PM
Subject: Re: [ovirt-users] SLA : RAM scheduling
Hi Gilad,
Yes, I'm interested in that feature, I'vebegun to read this following
your advices
http://www.ovirt.org/Features/oVirt_External_Scheduling_Proxy, I don't
think I will have time enough to get it work quickly, I'm not
experienced enough with this kind of feature, unless you help me.
Le 24/05/2014 10:49, Gilad Chaplik a écrit :
...
Hi Nathanaël,
You have 2 ways to get what you're after (quick/slow):
1) install 'oVirt's external scheduling proxy', and write an extremely
simple weight function that orders hosts by used memory, then add that to
your cluster policy.
2) open an RFE for oVirt 3.4 to have that in
(https://bugzilla.redhat.com/enter_bug.cgi?product=oVirt).
let me know if you consider (1), and I'll assist.
anyway I suggest you'll open an RFE for 3.5.
Thanks,
Gilad.
----- Original Message -----
...
From: "Nathanaël Blanchet" <blanchet@abes.fr>
To: "Karli Sjöberg" <Karli.Sjoberg@slu.se>
Cc: "users" <users@ovirt.org>
Sent: Friday, May 23, 2014 7:38:40 PM
Subject: Re: [ovirt-users] SLA : RAM scheduling
even distribution is for cpu only
Le 23/05/2014 17:48, Karli Sjöberg a écrit :
Den 23 maj 2014 17:13 skrev =?ISO-8859-1?Q?Nathana=EBl_Blanchet?=
<blanchet@abes.fr> :
...
Le 23/05/2014 17:11, Nathanaël Blanchet a écrit :
...
Hello,
On ovirt 3.4, is it possible to schedule vms distribution depending on
host RAM availibility?
Concretly, I had to manually move vms all the vms to the second host
of the cluster, this lead to reach 90% occupation of memory on the
destination host. When my first host has rebooted, none vms of the
second host automatically migrated to the first one which had full
RAM. How to make this happen?
... so as to both hosts be RAM evenly distributed... hope to be enough
clear...
Sounds like you just want to apply the cluster policy for even
distribution.
Have you assigned any policy for that cluster?
/K
...
--
Nathanaël Blanchet
Supervision réseau
Pôle exploitation et maintenance
Département des systèmes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5
Tél. 33 (0)4 67 54 84 55
Fax 33 (0)4 67 54 84 14
blanchet@abes.fr
_______________________________________________
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Nathanaël Blanchet
Supervision réseau
Pôle exploitation et maintenance
Département des systèmes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5
Tél. 33 (0)4 67 54 84 55
Fax  33 (0)4 67 54 84 14 blanchet@abes.fr
_______________________________________________
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Nathanaël Blanchet
Supervision réseau
Pôle exploitation et maintenance
Département des systèmes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5
Tél. 33 (0)4 67 54 84 55
Fax  33 (0)4 67 54 84 14
blanchet@abes.fr
-- 
Nathanaël Blanchet

Supervision réseau
Pôle exploitation et maintenance
Département des systèmes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5 	
Tél. 33 (0)4 67 54 84 55
Fax  33 (0)4 67 54 84 14
blanchet@abes.fr

--------------000809050505090608080605
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit

<html>
  <head>
    <meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <font size="-1">Hi Gilad,<br>
      <br>
      I followed your instructions, but it didn't work for me, I think
      for many reasons.</font><br>
    <br>
    <div class="moz-cite-prefix">Le 26/05/2014 16:22, Gilad Chaplik a
      écrit :<br>
    </div>
    <blockquote
      cite="mid:2012612350.8277212.1401114136183.JavaMail.zimbra@redhat.com"
      type="cite">
      <pre wrap="">Hi Nathanaël,

happy to assist :) hope it will work in first run:

1) install the proxy and ovirtsdk.</pre>
    </blockquote>
    yum install -y ovirt-scheduler-proxy<br>
    <blockquote
      cite="mid:2012612350.8277212.1401114136183.JavaMail.zimbra@redhat.com"
      type="cite">
      <pre wrap="">
2) put attached file in the right place (according to docs: ".../plugins"), </pre>
    </blockquote>
    according to the docs
    (<a class="moz-txt-link-freetext" href="http://www.ovirt.org/Features/oVirt_External_Scheduling_Proxy">http://www.ovirt.org/Features/oVirt_External_Scheduling_Proxy</a>), the
    place should be "plugins_path=$PYTHONPATH/ovirt_scheduler/plugins",
    which is should be mentionned in Scheduler conf file
    (/etc/ovirt/scheduler/scheduler.conf), but none of them exists in
    the filesystem!!! I've only found
    /usr/share/ovirt-scheduler-proxy/plugins for placing the python file
    and no scheduler.conf is present where I could change that path.<br>
    <blockquote
      cite="mid:2012612350.8277212.1401114136183.JavaMail.zimbra@redhat.com"
      type="cite">
      <pre wrap="">make sure to edit the file with your ovirt's ip, user@domain and PW.
</pre>
    </blockquote>
    My engine API can't be reached in http, so there is some work to do
    this with https. Here is what I did : according to
    /usr/lib/python2.6/site-packages/ovirtsdk/api.py, I add
    insecure=True to the chain <br>
    connection = API(url='http<font color="#ff0000"><b>s</b></font>://host:port',<br>
                                 username='user@domain', password=''<b>
      <font color="#ff0000">insecure='True'</font></b>)<br>
    Maybe it is not enough and it would be useful to add
    validate_cert_chain=False...<br>
    <blockquote
      cite="mid:2012612350.8277212.1401114136183.JavaMail.zimbra@redhat.com"
      type="cite">
      <pre wrap="">
3) restart proxy service.
3) use config tool to configure ovirt-engine:
* "ExternalSchedulerServiceURL"="<a class="moz-txt-link-freetext" href="http://">http://</a><ip>:18781/"</pre>
    </blockquote>
    The scheduler proxy listens to localhost:18781, none of ips that can
    be filled here will be reached on that port.<br>
    <blockquote
      cite="mid:2012612350.8277212.1401114136183.JavaMail.zimbra@redhat.com"
      type="cite">
      <pre wrap="">
* "ExternalSchedulerEnabled"=true
4) restart ovirt-engine service.
5) under configure->cluster_policy see that weight function memory_even_distribution was added (should be in manage policy units or /sth- you will see it in the main dialog as well).
6) clone/copy currernt cluster's used cluster policy (probably none - prefer it to have no balancing modules to avoid conflicts), name it 'your_name' and attach memory_even_distribution weight (you can leave it as the only weight module in weight section to avoid configuring factors).
7) replace cluster's cluster policy with newly created one.

try it out and let me know how goes :-)

Thanks, 
Gilad.
</pre>
    </blockquote>
    If all above is tru, should be a good idea to update the wiki...<br>
    <blockquote
      cite="mid:2012612350.8277212.1401114136183.JavaMail.zimbra@redhat.com"
      type="cite">
      <pre wrap="">
----- Original Message -----
</pre>
      <blockquote type="cite">
        <pre wrap="">From: "Nathanaël Blanchet" <a class="moz-txt-link-rfc2396E" href="mailto:blanchet@abes.fr"><blanchet@abes.fr></a>
To: "Gilad Chaplik" <a class="moz-txt-link-rfc2396E" href="mailto:gchaplik@redhat.com"><gchaplik@redhat.com></a>
Cc: "Karli Sjöberg" <a class="moz-txt-link-rfc2396E" href="mailto:Karli.Sjoberg@slu.se"><Karli.Sjoberg@slu.se></a>, "users" <a class="moz-txt-link-rfc2396E" href="mailto:users@ovirt.org"><users@ovirt.org></a>
Sent: Monday, May 26, 2014 12:12:41 PM
Subject: Re: [ovirt-users] SLA : RAM scheduling

Hi Gilad,

Yes, I'm interested in that feature, I'vebegun to read this following
your advices
<a class="moz-txt-link-freetext" href="http://www.ovirt.org/Features/oVirt_External_Scheduling_Proxy">http://www.ovirt.org/Features/oVirt_External_Scheduling_Proxy</a>, I don't
think I will have time enough to get it work quickly, I'm not
experienced enough with this kind of feature, unless you help me.

Le 24/05/2014 10:49, Gilad Chaplik a écrit :
</pre>
        <blockquote type="cite">
          <pre wrap="">Hi Nathanaël,

You have 2 ways to get what you're after (quick/slow):
1) install 'oVirt's external scheduling proxy', and write an extremely
simple weight function that orders hosts by used memory, then add that to
your cluster policy.
2) open an RFE for oVirt 3.4 to have that in
(<a class="moz-txt-link-freetext" href="https://bugzilla.redhat.com/enter_bug.cgi?product=oVirt">https://bugzilla.redhat.com/enter_bug.cgi?product=oVirt</a>).

let me know if you consider (1), and I'll assist.

anyway I suggest you'll open an RFE for 3.5.

Thanks,
Gilad.

----- Original Message -----
</pre>
          <blockquote type="cite">
            <pre wrap="">From: "Nathanaël Blanchet" <a class="moz-txt-link-rfc2396E" href="mailto:blanchet@abes.fr"><blanchet@abes.fr></a>
To: "Karli Sjöberg" <a class="moz-txt-link-rfc2396E" href="mailto:Karli.Sjoberg@slu.se"><Karli.Sjoberg@slu.se></a>
Cc: "users" <a class="moz-txt-link-rfc2396E" href="mailto:users@ovirt.org"><users@ovirt.org></a>
Sent: Friday, May 23, 2014 7:38:40 PM
Subject: Re: [ovirt-users] SLA : RAM scheduling

even distribution is for cpu only

Le 23/05/2014 17:48, Karli Sjöberg a écrit :

Den 23 maj 2014 17:13 skrev =?ISO-8859-1?Q?Nathana=EBl_Blanchet?=
<a class="moz-txt-link-rfc2396E" href="mailto:blanchet@abes.fr"><blanchet@abes.fr></a> :
</pre>
            <blockquote type="cite">
              <pre wrap="">
Le 23/05/2014 17:11, Nathanaël Blanchet a écrit :
</pre>
              <blockquote type="cite">
                <pre wrap="">Hello,
On ovirt 3.4, is it possible to schedule vms distribution depending on
host RAM availibility?
Concretly, I had to manually move vms all the vms to the second host
of the cluster, this lead to reach 90% occupation of memory on the
destination host. When my first host has rebooted, none vms of the
second host automatically migrated to the first one which had full
RAM. How to make this happen?

</pre>
              </blockquote>
              <pre wrap="">... so as to both hosts be RAM evenly distributed... hope to be enough
clear...
</pre>
            </blockquote>
            <pre wrap="">Sounds like you just want to apply the cluster policy for even
distribution.
Have you assigned any policy for that cluster?

/K

</pre>
            <blockquote type="cite">
              <pre wrap="">--
Nathanaël Blanchet

Supervision réseau
Pôle exploitation et maintenance
Département des systèmes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5
Tél. 33 (0)4 67 54 84 55
Fax 33 (0)4 67 54 84 14
<a class="moz-txt-link-abbreviated" href="mailto:blanchet@abes.fr">blanchet@abes.fr</a>

_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a>
</pre>
            </blockquote>
            <pre wrap="">--
Nathanaël Blanchet

Supervision réseau
Pôle exploitation et maintenance
Département des systèmes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5
Tél. 33 (0)4 67 54 84 55
Fax  33 (0)4 67 54 84 14 <a class="moz-txt-link-abbreviated" href="mailto:blanchet@abes.fr">blanchet@abes.fr</a>

_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a>

</pre>
          </blockquote>
        </blockquote>
        <pre wrap="">
--
Nathanaël Blanchet

Supervision réseau
Pôle exploitation et maintenance
Département des systèmes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5
Tél. 33 (0)4 67 54 84 55
Fax  33 (0)4 67 54 84 14
<a class="moz-txt-link-abbreviated" href="mailto:blanchet@abes.fr">blanchet@abes.fr</a>

</pre>
      </blockquote>
      <pre wrap="">></pre>
    </blockquote>
    <br>
    <pre class="moz-signature" cols="72">-- 
Nathanaël Blanchet

Supervision réseau
Pôle exploitation et maintenance
Département des systèmes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5 	
Tél. 33 (0)4 67 54 84 55
Fax  33 (0)4 67 54 84 14
<a class="moz-txt-link-abbreviated" href="mailto:blanchet@abes.fr">blanchet@abes.fr</a> </pre>
  </body>
</html>

--------------000809050505090608080605--