I just tried installing fedora 30 host with no pre-installed cockpit, just
ovirt-release-master repo. Same as always:
2020-03-20 14:01:30,134+01 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-1) [4029908e] EVENT_ID: VDS_INSTALL_FAILED(505),
Host banana installation failed. Failed to execute Ansible host-deploy role: Internal
server error, please check Ansible runner error log.. Please check logs for more details:
/home/apple/ovirt-engine/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20200320140129-banana-4029908e.log.
No logs as usual. The error must be on the engine side somewhere...
----- Original Message -----
From: "Fedor Gavrilov" <fgavrilo(a)redhat.com>
To: "Nir Soffer" <nsoffer(a)redhat.com>
Cc: "Liran Rotenberg" <lrotenbe(a)redhat.com>, "Dana Elfassy"
<delfassy(a)redhat.com>, "devel" <devel(a)ovirt.org>
Sent: Thursday, March 19, 2020 4:20:23 PM
Subject: [ovirt-devel] Re: what's up with ansible-runner-service-dev package?
Thanks for the response, Nir.
I've been
virtualizing both engine and host vm since I joined the team, so enabling ssh access is
the first thing I do after OS is installed.
I did install ovirt-release-master rpm on the host and somehow managed to not copy that
(facepalm). But believe me it's there.
Regarding cockpit, I was following what's written in
Yum had a bug on both previous CentOS and Fedora around 28 or 29 where it would silently
fail when you try installing from the URL :D
Yesterday I tried Fedoa 30
host and just now I tried CentOS 8 host (that's the lengths I went to get this thing
working!). Both fail.
Look at the full half of the glass, you have engine.
Nice one.
Though I'm afraid that part might be poisoned since host configuration that worked for
me for a year now instantly fails no matter what OS is used...
Fedor
----- Original Message -----
From: "Nir Soffer" <nsoffer(a)redhat.com>
To: "Fedor Gavrilov" <fgavrilo(a)redhat.com>
Cc: "Martin Perina" <mperina(a)redhat.com>, "Liran Rotenberg"
<lrotenbe(a)redhat.com>, "Dana Elfassy" <delfassy(a)redhat.com>,
"devel" <devel(a)ovirt.org>
Sent: Thursday, March 19, 2020 2:31:39 AM
Subject: Re: [ovirt-devel] Re: what's up with ansible-runner-service-dev package?
On Wed, Mar 18, 2020 at 5:27 PM Fedor Gavrilov <fgavrilo(a)redhat.com> wrote:
Wow. I did not expect that, but after clean setup the error is still there.
I can't add fedora 30 host to fedora 30 engine.
Here is a full bash history for the host machine since OS was installed:
sudo yum update
sudo nmcli connection mod ens3 ipv4.addresses 192.168.111.3/24
sudo nmcli connection mod ens3 ipv4.dns 192.168.111.1
sudo nmcli connection mod ens3 ipv4.gateway 192.168.111.1
sudo nmcli connection mod ens3 ipv4.method manual
sudo vi /etc/hosts
sudo poweroff
sudo yum install cockpit-ovirt-dashboard
sudo systemctl enable cockpit.socket --now
>
> Same for the engine machine (I was installing dependencies separetely because 1. yum
bugs & 2. I was checking if versions are correct one by one):
>
> sudo yum update
> sudo nmcli connection mod ens3
ipv4.addresses 192.168.111.2/24
> sudo nmcli connection mod ens3 ipv4.dns 192.168.111.1
> sudo nmcli connection mod ens3 ipv4.gateway 192.168.111.1
> sudo nmcli connection mod ens3 ipv4.method manual
> sudo vi /etc/hosts
> sudo poweroff
> sudo yum install java-11-openjdk-devel
> sudo yum install java-1.8.0-openjdk-headless
> sudo yum install mailcap
> sudo yum install unzip
> sudo yum install openssl
> sudo yum install bind-utils
> sudo yum install postgresql-server
> sudo yum install postgresql
> sudo yum install postgresql-contrib
> sudo yum install python2-dateutil
> sudo yum install python3-dateutil
> sudo yum install python2-m2crypto
> sudo yum install python3-m2crypto
> sudo yum install python2-psycopg2
> sudo yum install python3-psycopg2
> sudo yum install python2-jinja2
> sudo yum install python3-jinja2
> sudo yum install python2-libxml2
> sudo yum install python3-libxml2
> sudo yum install python2-daemon
> sudo yum install python3-daemon
Also, you want to instal this first - before you install other
packages, so you get packages
from ovirt dependencies.
sudo yum install otopi
sudo yum install python3-ovirt-setup-lib
sudo yum install maven
sudo yum install ansible
sudo yum install ansible-runner-service-dev
sudo yum install ovirt-ansible-roles
sudo yum install ovirt-engine-metrics
sudo yum install python3-ovirt-engine-sdk4
sudo yum install pyflakes
sudo yum install python-pep8
sudo yum install python3-docker
sudo yum install python3-isort
sudo yum install gcc
sudo yum install python2-devel
sudo yum install systemd-python
sudo yum install python-webob
sudo yum install redhat-rpm-config
sudo yum install scl-utils
sudo yum install ovirt-imageio-common
sudo yum install make
sudo yum install python-requests
sudo yum install python-subprocess32
sudo alternatives --config java
sudo yum install ovirt-engine-wildfly
sudo yum install ovirt-engine-wildfly-overlay
sudo vi /etc/security/limits.d/10-nofile.conf
sudo firewall-cmd --add-port=8080/tcp --permanent
sudo firewall-cmd --add-port=8443/tcp --permanent
sudo firewall-cmd --add-port=8787/tcp --permanent
sudo firewall-cmd --add-port=5432/tcp --permanent
sudo firewall-cmd --add-port=54323/tcp --permanent
sudo firewall-cmd --reload
sudo postgresql-setup --initdb --unit postgresql
sudo vi /var/lib/pgsql/data/pg_hba.conf
sudo vi /var/lib/pgsql/data/postgresql.conf
sudo systemctl enable postgresql --now
sudo systemctl status postgresql
sudo su - postgres -c "psql -d template1"
sudo su - postgres -c "psql -d engine"
Look at the full half of the glass, you have engine.
Did you to add centos 7.7 host? 8.1?
----- Original Message -----
From: "Martin Perina" <mperina(a)redhat.com>
To: "Fedor Gavrilov" <fgavrilo(a)redhat.com>
Cc: "Liran Rotenberg" <lrotenbe(a)redhat.com>, "Dana Elfassy"
<delfassy(a)redhat.com>, "devel" <devel(a)ovirt.org>
Sent: Wednesday, March 18, 2020 3:15:15 PM
Subject: Re: [ovirt-devel] Re: what's up with ansible-runner-service-dev package?
On Wed, Mar 18, 2020 at 2:57 PM Fedor Gavrilov <fgavrilo(a)redhat.com> wrote:
> Thanks! Wow! This bug is 1 month old today (congrats :D), I wonder why I
> haven't got this error sooner.
> Also, given the workaround, does that mean that ansible-lint is optional?
>
Yes, same as pep8, pyflake and other build check tools
>
> ----- Original Message -----
> From: "Liran Rotenberg" <lrotenbe(a)redhat.com>
> To: "Fedor Gavrilov" <fgavrilo(a)redhat.com>
> Cc: "Dana Elfassy" <delfassy(a)redhat.com>, "devel"
<devel(a)ovirt.org>
> Sent: Wednesday, March 18, 2020 2:21:14 PM
> Subject: [ovirt-devel] Re: what's up with ansible-runner-service-dev
> package?
>
>
>
> On Wed, Mar 18, 2020 at 3:09 PM Fedor Gavrilov < fgavrilo(a)redhat.com >
> wrote:
>
>
> Ok, thanks for the reaction :)
>
> Getting back to the main topic, can anyone (please) try to compile the
> engine master now?
> That's what I get when I try to:
>
> [602] Don't compare to empty string
> /usr/share/ansible/roles/oVirt.metrics/roles/oVirt.logging/tasks/main.yml:61
>
> when: hosted_engine_vm_cluster_name_result.stdout | trim != ""
>
> [602] Don't compare to empty string
> /usr/share/ansible/roles/oVirt.metrics/roles/oVirt.logging/tasks/main.yml:67
>
> when: hosted_engine_vm_cluster_name_result.stdout | trim == "" or
> hosted_engine_vm_cluster_name_result.stdout is undefined
>
> [403] Package installs should not use latest
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/ovirt-collectd-package/tasks/main.yml:2
>
> Task/Handler: Install collectd package
>
> [403] Package installs should not use latest
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/ovirt-collectd-package/tasks/main.yml:9
>
> Task/Handler: Install collectd plugins on engine
>
> [403] Package installs should not use latest
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/ovirt-collectd-package/tasks/main.yml:19
>
> Task/Handler: Install collectd plugins on hosts
>
> [403] Package installs should not use latest
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/ovirt-collectd-package/tasks/main.yml:28
>
> Task/Handler: Install collectd write_syslog plugin
>
> [303] systemctl used in place of systemd module
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:14
>
> Task/Handler: Check if fluentd is running
>
> [601] Don't compare to literal True/False
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:34
>
> - fluentd_is_running|default(false)|bool == true
>
> [601] Don't compare to literal True/False
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:35
>
> changed_when: fluentd_is_running|default(false)|bool == true
>
> [601] Don't compare to literal True/False
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:45
>
> - fluentd_is_running|default(false)|bool == true
>
> [601] Don't compare to literal True/False
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:51
>
> when: fluentd_is_running|default(false)|bool == false
>
> [303] systemctl used in place of systemd module
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:60
>
> Task/Handler: Check if rsyslog is running
>
> [601] Don't compare to literal True/False
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:80
>
> - rsyslog_is_running|default(false)|bool == true
>
> [601] Don't compare to literal True/False
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:81
>
> changed_when: rsyslog_is_running|default(false)|bool == true
>
> [601] Don't compare to literal True/False
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:91
>
> - rsyslog_is_running|default(false)|bool == true
>
> [601] Don't compare to literal True/False
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:97
>
> when: rsyslog_is_running|default(false)|bool == false
>
> [303] systemctl used in place of systemd module
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-collectd/restart-collectd-if-needed/tasks/main.yml:100
>
> Task/Handler: Check if collectd is running
>
> [403] Package installs should not use latest
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-fluentd/ovirt-fluentd-package/tasks/main.yml:2
>
> Task/Handler: Install fluentd package
>
> [403] Package installs should not use latest
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-fluentd/ovirt-fluentd-package/tasks/main.yml:9
>
> Task/Handler: Install fluentd engine plugins
>
> [403] Package installs should not use latest
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-fluentd/ovirt-fluentd-package/tasks/main.yml:19
>
> Task/Handler: Install fluentd host plugins
>
> [601] Don't compare to literal True/False
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.ovirt-include-vars-files/tasks/main.yml:12
>
> when: stat_result.stat.exists == True
>
> [301] Commands should not change things if nothing needs doing
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.read-local-engine-defaults/tasks/main.yml:2
>
> Task/Handler: Get ovirt_engine_fqdn
>
> [301] Commands should not change things if nothing needs doing
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.read-local-engine-defaults/tasks/main.yml:13
>
> Task/Handler: Get ovirt_engine_db_name
>
> [301] Commands should not change things if nothing needs doing
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.read-local-engine-defaults/tasks/main.yml:22
>
> Task/Handler: Get ovirt_engine_db_user
>
> [301] Commands should not change things if nothing needs doing
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.read-local-engine-defaults/tasks/main.yml:31
>
> Task/Handler: Get ovirt_engine_history_db_name
>
> [301] Commands should not change things if nothing needs doing
>
/usr/share/ansible/roles/oVirt.metrics/roles/oVirt.read-local-engine-defaults/tasks/main.yml:40
>
> Task/Handler: Get ovirt_engine_history_db_user
>
> make[1]: *** [Makefile:401: validations] Error 2
> make[1]: Leaving directory '/home/apple/git/ovirt-engine'
> make: *** [Makefile:584: all-dev] Error 2
>
> An extensive lecture from ansible, but what is this even about?
>
https://bugzilla.redhat.com/show_bug.cgi?id=1804268
>
>
>
> ...
>
>
> ----- Original Message -----
> From: "Nir Soffer" < nsoffer(a)redhat.com >
> To: "Fedor Gavrilov" < fgavrilo(a)redhat.com >
> Cc: "Liran Rotenberg" < lrotenbe(a)redhat.com >, "Dana
Elfassy" <
> delfassy(a)redhat.com >, "devel" < devel(a)ovirt.org >
> Sent: Wednesday, March 18, 2020 11:45:28 AM
> Subject: [ovirt-devel] Re: what's up with ansible-runner-service-dev
> package?
>
> On Wed, Mar 18, 2020 at 12:29 PM Fedor Gavrilov < fgavrilo(a)redhat.com >
> wrote:
> >
> > For the time being I'm doing super careful clean installation of both
> engine and host in hopes of getting dev env working again... results are
> yet to be seen.
> > What I noticed is there is no python-ovirt-engine-sdk4 in ovirt master
> rpm for Fedora 30. Correct name for the package is
> python3-ovirt-engine-sdk4. And more examples like that with random package
> renamings.
> >
> > README definitely needs an update. If you ask me, I would rather provide
> users with a single version (Fedora 30 only) of dev installation docs that
> works rather than with two versions that don't.
>
> Please do the update.
>
> Hopefully you will have more luck, my last README patch was abandoned
> after
> it was neglected by engine maintainers.
>
https://gerrit.ovirt.org/c/106467/
>
> > Are there any reasons to keep CentOS 7 info there that's irrelevant now?
>
> It should be dropped now.
>
> > I can rework the docs for FC30 eventually if no one minds.
>
> There is already a working fedora 30 instructions in the bottom of the
> readme. It used to
> work when Amit added it.
>
> > Or, if plans are to move to CentOS 8, maybe another brave soul can do
> that.
> > Fedor
> >
> > ----- Original Message -----
> > From: "Liran Rotenberg" < lrotenbe(a)redhat.com >
> > To: "Fedor Gavrilov" < fgavrilo(a)redhat.com >
> > Cc: "Dana Elfassy" < delfassy(a)redhat.com >, "devel"
< devel(a)ovirt.org >
> > Sent: Tuesday, March 17, 2020 1:13:48 PM
> > Subject: [ovirt-devel] Re: what's up with ansible-runner-service-dev
> package?
> >
> >
> >
> > On Tue, Mar 17, 2020 at 2:03 PM Fedor Gavrilov < fgavrilo(a)redhat.com >
> wrote:
> >
> >
> > I just tried installing on Fedora 30 host and error stays the same, so
> it's probably not as OS. Might try clean setup next, what else...
> >
> > Liran, do you see anything of interest when you journalctl -u
> ansible-runner-service | grep fatal ?
> > No, we do see a trackback on the command pointing out to
> python3.7/site-packages/runner_service/services/jobs.py
> > But, because breakpoint that only makes things slower, I think it's
> timing/locking issue somehow.
> >
> >
> >
> > Fedor
> >
> > ----- Original Message -----
> > From: "Liran Rotenberg" < lrotenbe(a)redhat.com >
> > To: "Fedor Gavrilov" < fgavrilo(a)redhat.com >
> > Cc: "Martin Perina" < mperina(a)redhat.com >, "Dana
Elfassy" <
> delfassy(a)redhat.com >, "devel" < devel(a)ovirt.org >
> > Sent: Tuesday, March 17, 2020 12:49:32 PM
> > Subject: Re: [ovirt-devel] Re: what's up with ansible-runner-service-dev
> package?
> >
> > On Tue, Mar 17, 2020 at 12:18 PM Fedor Gavrilov < fgavrilo(a)redhat.com >
> wrote:
> >
> > > I tried installing python 2 versions of some dependencies in addition
> to
> > > python 3 (as
>
https://github.com/oVirt/ovirt-engine/blob/master/README.adoc
> > > is not clear about it at all. on Fedora 30 default versions of these
> > > libraries you get when not specifying python vesion in the name are
> python
> > > 2.)
> > > Now error looks slightly different :'D
> > >
> > > 2020-03-17 11:08:27,294+01 ERROR
> > > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
> > > (EE-ManagedThreadFactory-engine-Thread-1) [703ff77e] EVENT_ID:
> > > VDS_INSTALL_FAILED(505), Host banana installation failed. Internal
> server
> > > error, please check Ansible runner error log..
> > >
> > > Everything else stays the same, host install fails almost immediately.
> > > Does someone have any notes for Fedora 30 install they can share?
> > >
> > I start seeing it too:
> > ansible-runner-service-dev-1.0.1-1.fc30.noarch
> > python3-ansible-runner-1.3.4-2.fc30.noarch
> > engine:
> >
http://pastebin.test.redhat.com/845373
> > of course no ansible log..
> > This is what journalctl show:
> >
http://pastebin.test.redhat.com/845375
> >
> > After doing some debugging in the engine, after setting a breakpoint in
> > AnsibleRunnerHTTPClient.java *runPlaybook* method, passing with
> Step-Over
> > until the execution (lines 139-147) it does work. Without breaking point
> > and making things slower it throws the error.
> >
> > >
> > > Thanks,
> > > Fedor
> > >
> > > ----- Original Message -----
> > > From: "Fedor Gavrilov" < fgavrilo(a)redhat.com >
> > > To: "Martin Perina" < mperina(a)redhat.com >
> > > Cc: "Dana Elfassy" < delfassy(a)redhat.com >,
"devel" < devel(a)ovirt.org
> >
> > > Sent: Monday, March 16, 2020 3:52:47 PM
> > > Subject: [ovirt-devel] Re: what's up with ansible-runner-service-dev
> > > package?
> > >
> > > Sorry, my bad, it was just under my nose. Systemctl is not aware of
> > > gunicorn-3, but when I check journalctl for ansible-runner-service I
> see
> > > the following:
> > >
> > > Mar 16 15:49:55 apple systemd[1]: Started Ansible Runner Service.
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: [2020-03-16 15:49:55 +0100]
> [2992]
> > > [INFO] Starting gunicorn 19.9.0
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: [2020-03-16 15:49:55 +0100]
> [2992]
> > > [INFO] Listening at:
http://127.0.0.1:50001 (2992)
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: [2020-03-16 15:49:55 +0100]
> [2992]
> > > [INFO] Using worker: sync
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: [2020-03-16 15:49:55 +0100]
> [2995]
> > > [INFO] Booting worker with pid: 2995
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: [2020-03-16 15:49:55 +0100]
> [2997]
> > > [INFO] Booting worker with pid: 2997
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: Analysing local configuration
> > > options from /etc/ansible-runner-service/config.yaml
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: - setting playbooks_root_dir
> to
> > >
> /home/apple/ovirt-engine/share/ovirt-engine/ansible-runner-service-project
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: - setting port to 50001
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: - setting target_user to root
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: - setting ssh_private_key to
> > > /home/apple/ovirt-engine/etc/pki/ovirt-engine/keys/engine_id_rsa
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: Analysing runtime overrides
> from
> > > environment variables
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: No configuration settings
> > > overridden
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: Analysing local configuration
> > > options from /etc/ansible-runner-service/config.yaml
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: - setting playbooks_root_dir
> to
> > >
> /home/apple/ovirt-engine/share/ovirt-engine/ansible-runner-service-project
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: - setting port to 50001
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: - setting target_user to root
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: - setting ssh_private_key to
> > > /home/apple/ovirt-engine/etc/pki/ovirt-engine/keys/engine_id_rsa
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: Analysing runtime overrides
> from
> > > environment variables
> > > Mar 16 15:49:55 apple gunicorn-3[2992]: No configuration settings
> > > overridden
> > >
> > > Is that any suspicious? :)
> > >
> > > ----- Original Message -----
> > > From: "Martin Perina" < mperina(a)redhat.com >
> > > To: "Fedor Gavrilov" < fgavrilo(a)redhat.com >
> > > Cc: "Dana Elfassy" < delfassy(a)redhat.com >,
"devel" < devel(a)ovirt.org
> >
> > > Sent: Monday, March 16, 2020 3:36:40 PM
> > > Subject: [ovirt-devel] Re: what's up with ansible-runner-service-dev
> > > package?
> > >
> > >
> > >
> > > On Mon, Mar 16, 2020 at 3:32 PM Fedor Gavrilov < fgavrilo(a)redhat.com
> >
> > > wrote:
> > >
> > >
> > > Nothing since there is no such service (or similarly named).
> > > Package python3-gunicorn is installed though.
> > >
> > > After you start ansible-runner-service service, you should see similar
> > > logs in journalctl:
> > >
> > > Mar 15 15:28:01 mperina gunicorn-3[1386]: [2020-03-15 15:28:01 +0100]
> > > [1386] [INFO] Starting gunicorn 19.9.0
> > > Mar 15 15:28:01 mperina gunicorn-3[1386]: [2020-03-15 15:28:01 +0100]
> > > [1386] [INFO] Listening at:
http://127.0.0.1:50001 (1386)
> > > Mar 15 15:28:01 mperina gunicorn-3[1386]: [2020-03-15 15:28:01 +0100]
> > > [1386] [INFO] Using worker: sync
> > > Mar 15 15:28:01 mperina gunicorn-3[1386]: [2020-03-15 15:28:01 +0100]
> > > [1496] [INFO] Booting worker with pid: 1496
> > > And more if you execute some action from engine (like install new host
> or
> > > upgrade a host)
> > >
> > >
> > >
> > > So does that mean that something was supposed to register it as a
> service
> > > but did not?
> > >
> > > Fedor
> > >
> > > ----- Original Message -----
> > > From: "Martin Perina" < mperina(a)redhat.com >
> > > To: "Fedor Gavrilov" < fgavrilo(a)redhat.com >
> > > Cc: "Dana Elfassy" < delfassy(a)redhat.com >,
"devel" < devel(a)ovirt.org
> >
> > > Sent: Monday, March 16, 2020 3:13:03 PM
> > > Subject: Re: [ovirt-devel] Re: what's up with
> ansible-runner-service-dev
> > > package?
> > >
> > > On Mon, Mar 16, 2020 at 3:10 PM Fedor Gavrilov < fgavrilo(a)redhat.com
> >
> > > wrote:
> > >
> > > > FC30 dev env engine indeed :) I've done this before on other OS,
so
> > > unless
> > > > there is a blindspot somewhere in my eye it should be configured
> fine.
> > > >
> > > > [apple@apple ~]$ sudo systemctl status ansible-runner-service
> > > > ● ansible-runner-service.service - Ansible Runner Service
> > > > Loaded: loaded
> (/usr/lib/systemd/system/ansible-runner-service.service;
> > > > enabled; vendor preset: disabled)
> > > > Active: active (running) since Mon 2020-03-16 14:27:15 CET; 16min
> ago
> > > > Main PID: 909 (gunicorn-3)
> > > > Tasks: 9 (limit: 4915)
> > > > Memory: 193.4M
> > > > CGroup: /system.slice/ansible-runner-service.service
> > > > ├─ 909 /usr/bin/python3 /usr/bin/gunicorn-3 -b localhost:50001
> > > > -w 2 runner_service.wsgi:application
> > > > ├─ 965 /usr/bin/python3 /usr/bin/gunicorn-3 -b localhost:50001
> > > > -w 2 runner_service.wsgi:application
> > > > ├─ 973 /usr/bin/python3 /usr/bin/gunicorn-3 -b localhost:50001
> > > > -w 2 runner_service.wsgi:application
> > > > ├─1501 /usr/bin/python3 -s /usr/bin/ansible-playbook
> > > > --private-key
> > > > /home/apple/ovirt-engine/etc/pki/ovirt-engine/keys/engine_id_rsa -i
> > > > /home/apple/ovirt-engine/share/ovirt-engine/ansible-runner-servi>
> > > > ├─1512 ssh: /root/.ansible/cp/29e7064c0e [mux]
> > > > ├─2601 /usr/bin/python3 -s /usr/bin/ansible-playbook
> > > > --private-key
> > > > /home/apple/ovirt-engine/etc/pki/ovirt-engine/keys/engine_id_rsa -i
> > > > /home/apple/ovirt-engine/share/ovirt-engine/ansible-runner-servi>
> > > > └─2607 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o
> > > > StrictHostKeyChecking=no -o Port=22 -o
> > > >
> > >
>
IdentityFile="/home/apple/ovirt-engine/etc/pki/ovirt-engine/keys/engine_id_rsa"
>
> > >
> > > > -o KbdInteractiveAu>
> > > >
> > > > And the config:
> > > >
> > > > ---
> > > > version: 1
> > > >
> > > > # playbooks_root_dir
> > > > # location of the playbooks that the service will start
> > > > playbooks_root_dir:
> > > >
> > >
>
'/home/apple/ovirt-engine/share/ovirt-engine/ansible-runner-service-project'
>
> > >
> > > > # port
> > > > # tcp port for the service to listen to
> > > > port: 50001
> > > > #
> > > > # ip_address
> > > > # Specific IP address to bind to
> > > > # ip_address: '0.0.0.0'
> > > > target_user: root
> > > > #event_cache_size: 3
> > > > ssh_private_key:
> > > >
'/home/apple/ovirt-engine/etc/pki/ovirt-engine/keys/engine_id_rsa'
> > > >
> > > > /home/apple/ovirt-engine is where engine is dev-installed. Not sure
> what
> > > > else to check now...
> > > >
> > >
> > > Anything strange in journalctl for gunicorn-3 service?
> > >
> > > >
> > > >
> > > > ----- Original Message -----
> > > > From: "Martin Perina" < mperina(a)redhat.com >
> > > > To: "Fedor Gavrilov" < fgavrilo(a)redhat.com >
> > > > Cc: "Dana Elfassy" < delfassy(a)redhat.com >,
"devel" <
> devel(a)ovirt.org >
> > > > Sent: Monday, March 16, 2020 2:56:59 PM
> > > > Subject: Re: [ovirt-devel] Re: what's up with
> ansible-runner-service-dev
> > > > package?
> > > >
> > > > On Mon, Mar 16, 2020 at 2:53 PM Fedor Gavrilov <
fgavrilo(a)redhat.com
> >
> > > > wrote:
> > > >
> > > > > Actually, it was too early for me to celebrate.
> > > > >
> > > > > On Fedora 30, the engine compiles and runs fine, but when I try
> adding
> > > > the
> > > > > host installation fails almost immediately and I get the
following
> > > errors
> > > > > in the engine logs:
> > > > >
> > > > > ERROR
> [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
> > > > > (EE-ManagedThreadFactory-engine-Thread-1) [bdc3c01] Host
> installation
> > > > > failed for host '6402d350-69de-4181-bfc1-50e0e79c8228',
'banana':
> > > Failed
> > > > to
> > > > > execute Ansible host-deploy role: Internal server error, please
> check
> > > > > Ansible runner error log.. Please check logs for more details:
> > > > >
> > > >
> > >
>
/home/apple/ovirt-engine/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20200316144056-banana-bdc3c01.log
>
> > >
> > > > >
> > > > > There is nothing else. There is no file
> > > > >
> > > >
> > >
>
/home/apple/ovirt-engine/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20200316144056-banana-bdc3c01.log
>
> > >
> > > > > Snapshot I'm using for the host is the same that worked just
fine
> when
> > > > > engine was running on CentOS 7 and is CentOS 7 itself. Is that
an
> > > issue?
> > > > >
> > > >
> > > > As you mentioned building engine I assume you are using engine in
> dev
> > > env
> > > > on FC30, right? If so, have you manually configured
> > > ansible-runner-service
> > > > for dev env as mentioned in
> > > >
> > > >
> > >
>
https://github.com/oVirt/ovirt-engine/blob/master/README.adoc#ansible-run...
> > > > ?
> > > >
> > > >
> > > > > Thanks,
> > > > > Fedor
> > > > >
> > > > > ----- Original Message -----
> > > > > From: "Fedor Gavrilov" < fgavrilo(a)redhat.com >
> > > > > To: "Martin Perina" < mperina(a)redhat.com >
> > > > > Cc: "Dana Elfassy" < delfassy(a)redhat.com >,
"devel" <
> devel(a)ovirt.org
> > > >
> > > > > Sent: Monday, March 16, 2020 12:37:44 PM
> > > > > Subject: [ovirt-devel] Re: what's up with
> ansible-runner-service-dev
> > > > > package?
> > > > >
> > > > > Hi,
> > > > >
> > > > > Resolved through installing engine on Fedora 30. From what I
> > > understand,
> > > > > CentOS 7 is not supported anymore.
> > > > >
> > > > > Fedor
> > > > >
> > > > > ----- Original Message -----
> > > > > From: "Martin Perina" < mperina(a)redhat.com >
> > > > > To: "Fedor Gavrilov" < fgavrilo(a)redhat.com >
> > > > > Cc: "Benny Zlotnik" < bzlotnik(a)redhat.com >,
"Dana Elfassy" <
> > > > > delfassy(a)redhat.com >, "devel" < devel(a)ovirt.org
>, "Eyal
> Shenitzky"
> > > <
> > > > > eshenitz(a)redhat.com >
> > > > > Sent: Monday, March 16, 2020 8:11:35 AM
> > > > > Subject: Re: [ovirt-devel] Re: what's up with
> > > ansible-runner-service-dev
> > > > > package?
> > > > >
> > > > > Hi Fedor,
> > > > >
> > > > > ansible-runner-service-dev package is available from
> > > > >
> > > > >
> > > >
> > >
>
https://copr-be.cloud.fedoraproject.org/results/ondramachacek/ansible-run...
> > > > > repos which is included in ovirt-master-release package, which
> > > > > includes all repositories necessary for oVirt development:
> > > > >
https://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm
> > > > >
> > > > > Was your issue resolved or not?
> > > > >
> > > > > Regards,
> > > > > Martin
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Thu, Mar 12, 2020 at 9:30 AM Eyal Shenitzky <
> eshenitz(a)redhat.com
> > > >
> > > > > wrote:
> > > > >
> > > > > > Adding also +Dana Elfassy < delfassy(a)redhat.com >
> > > > > >
> > > > > > On Wed, 11 Mar 2020 at 15:12, Benny Zlotnik <
> bzlotnik(a)redhat.com >
> > > > wrote:
> > > > > >
> > > > > >> ansible-runner was added in 4.4, you shouldn't need
in 4.3
> > > > > >>
> > > > > >> On Wed, Mar 11, 2020 at 1:58 PM Fedor Gavrilov <
> > > fgavrilo(a)redhat.com >
> > > > > >> wrote:
> > > > > >> >
> > > > > >> > Hi Sandro,
> > > > > >> >
> > > > > >> > Thanks for the suggestion, but it seems to not
help much.
> > > > > >> >
> > > > > >> > ansible-runner-service-dev still can't be
found, I checked
> repos
> > > > that
> > > > > >> are installed from
> > > > > >>
> > >
https://resources.ovirt.org/pub/yum-repo/ovirt-release43-snapshot.rpm
> > > > > >> and haven't found similarly names packages
either...
> > > > > >> >
> > > > > >> > $ sudo yum install ansible-runner-service-dev
> > > > > >> > Loaded plugins: fastestmirror
> > > > > >> > Repository centos-sclo-rh-release is listed more
than once in
> the
> > > > > >> configuration
> > > > > >> > Repository sac-gluster-ansible is listed more than
once in
> the
> > > > > >> configuration
> > > > > >> > Determining fastest mirrors
> > > > > >> > ovirt-4.3-epel/x86_64/metalink
> > > > > >>
> > > > > >> | 30 kB 00:00:00
> > > > > >> > ovirt-master-epel/x86_64/metalink
> > > > > >>
> > > > > >> | 30 kB 00:00:00
> > > > > >> > * base: ftp.sh.cvut.cz
> > > > > >> > * centos-sclo-rh: ftp.sh.cvut.cz
> > > > > >> > * centos-sclo-sclo: ftp.sh.cvut.cz
> > > > > >> > * extras: ftp.sh.cvut.cz
> > > > > >> > * ovirt-4.3-epel: mirror.karneval.cz
> > > > > >> > * ovirt-4.3-snapshot:
ftp.plusline.net
> > > > > >> > * ovirt-4.3-snapshot-static:
ftp.plusline.net
> > > > > >> > * ovirt-master-epel: mirror.karneval.cz
> > > > > >> > * ovirt-master-snapshot:
ftp.plusline.net
> > > > > >> > * ovirt-master-snapshot-static:
ftp.plusline.net
> > > > > >> > * updates: ftp.sh.cvut.cz
> > > > > >> > base
> > > > > >>
> > > > > >> | 3.6 kB 00:00:00
> > > > > >> > centos-opstools-release
> > > > > >>
> > > > > >> | 2.9 kB 00:00:00
> > > > > >> > centos-ovirt-common-testing
> > > > > >>
> > > > > >> | 3.4 kB 00:00:00
> > > > > >> > centos-ovirt44-testing
> > > > > >>
> > > > > >> | 3.4 kB 00:00:00
> > > > > >> > centos-qemu-ev-release
> > > > > >>
> > > > > >> | 3.4 kB 00:00:00
> > > > > >> > centos-sclo-rh
> > > > > >>
> > > > > >> | 3.0 kB 00:00:00
> > > > > >> > centos-sclo-rh-release
> > > > > >>
> > > > > >> | 3.0 kB 00:00:00
> > > > > >> > centos-sclo-sclo
> > > > > >>
> > > > > >> | 2.9 kB 00:00:00
> > > > > >> > epel-apache-maven
> > > > > >>
> > > > > >> | 3.3 kB 00:00:00
> > > > > >> > extras
> > > > > >>
> > > > > >> | 2.9 kB 00:00:00
> > > > > >> > ovirt-4.3-centos-gluster6
> > > > > >>
> > > > > >> | 2.9 kB 00:00:00
> > > > > >> > ovirt-4.3-centos-opstools
> > > > > >>
> > > > > >> | 2.9 kB 00:00:00
> > > > > >> > ovirt-4.3-centos-ovirt43
> > > > > >>
> > > > > >> | 2.9 kB 00:00:00
> > > > > >> > ovirt-4.3-centos-qemu-ev
> > > > > >>
> > > > > >> | 2.9 kB 00:00:00
> > > > > >> > ovirt-4.3-epel
> > > > > >>
> > > > > >> | 5.3 kB 00:00:00
> > > > > >> > ovirt-4.3-snapshot
> > > > > >>
> > > > > >> | 3.0 kB 00:00:00
> > > > > >> > ovirt-4.3-snapshot-static
> > > > > >>
> > > > > >> | 3.0 kB 00:00:00
> > > > > >> > ovirt-4.3-virtio-win-latest
> > > > > >>
> > > > > >> | 3.0 kB 00:00:00
> > > > > >> > ovirt-master-centos-gluster6
> > > > > >>
> > > > > >> | 2.9 kB 00:00:00
> > > > > >> > ovirt-master-centos-opstools-testing
> > > > > >>
> > > > > >> | 2.9 kB 00:00:00
> > > > > >> > ovirt-master-epel
> > > > > >>
> > > > > >> | 5.3 kB 00:00:00
> > > > > >> > ovirt-master-snapshot
> > > > > >>
> > > > > >> | 3.0 kB 00:00:00
> > > > > >> > ovirt-master-snapshot-static
> > > > > >>
> > > > > >> | 3.0 kB 00:00:00
> > > > > >> > ovirt-master-virtio-win-latest
> > > > > >>
> > > > > >> | 3.0 kB 00:00:00
> > > > > >> > ovirtwebui-ovirt-web-ui-master
> > > > > >>
> > > > > >> | 3.0 kB 00:00:00
> > > > > >> > sac-gluster-ansible
> > > > > >>
> > > > > >> | 3.3 kB 00:00:00
> > > > > >> > updates
> > > > > >>
> > > > > >> | 2.9 kB 00:00:00
> > > > > >> > (1/32): base/7/x86_64/group_gz
> > > > > >>
> > > > > >> | 165 kB 00:00:00
> > > > > >> > (2/32): base/7/x86_64/primary_db
> > > > > >>
> > > > > >> | 6.0 MB 00:00:00
> > > > > >> > (3/32): centos-sclo-rh/x86_64/primary_db
> > > > > >>
> > > > > >> | 4.2 MB 00:00:00
> > > > > >> > (4/32): centos-qemu-ev-release/x86_64/primary_db
> > > > > >>
> > > > > >> | 9.3 kB 00:00:00
> > > > > >> > (5/32): centos-sclo-sclo/x86_64/primary_db
> > > > > >>
> > > > > >> | 344 kB 00:00:00
> > > > > >> > (6/32): centos-ovirt44-testing/x86_64/primary_db
> > > > > >>
> > > > > >> | 1.1 kB 00:00:01
> > > > > >> > (7/32): extras/7/x86_64/primary_db
> > > > > >>
> > > > > >> | 164 kB 00:00:00
> > > > > >> > (8/32): centos-opstools-release/x86_64/primary_db
> > > > > >>
> > > > > >> | 429 kB 00:00:01
> > > > > >> > (9/32):
centos-ovirt-common-testing/x86_64/primary_db
> > > > > >>
> > > > > >> | 101 kB 00:00:01
> > > > > >> > (10/32):
ovirt-4.3-centos-gluster6/x86_64/primary_db
> > > > > >>
> > > > > >> | 116 kB 00:00:00
> > > > > >> > (11/32):
ovirt-4.3-centos-qemu-ev/x86_64/primary_db
> > > > > >>
> > > > > >> | 73 kB 00:00:00
> > > > > >> > (12/32): ovirt-4.3-epel/x86_64/group_gz
> > > > > >>
> > > > > >> | 90 kB 00:00:00
> > > > > >> > (13/32): epel-apache-maven/x86_64/primary_db
> > > > > >>
> > > > > >> | 5.0 kB 00:00:01
> > > > > >> > (14/32): ovirt-4.3-epel/x86_64/updateinfo
> > > > > >>
> > > > > >> | 1.0 MB 00:00:00
> > > > > >> > (15/32):
ovirt-4.3-centos-opstools/x86_64/primary_db
> > > > > >>
> > > > > >> | 429 kB 00:00:00
> > > > > >> > (16/32):
ovirt-4.3-centos-ovirt43/x86_64/primary_db
> > > > > >>
> > > > > >> | 211 kB 00:00:00
> > > > > >> > (17/32): ovirt-4.3-snapshot-static/7/primary_db
> > > > > >>
> > > > > >> | 3.4 kB 00:00:00
> > > > > >> > (18/32): ovirt-4.3-snapshot/7/primary_db
> > > > > >>
> > > > > >> | 109 kB 00:00:00
> > > > > >> > (19/32):
ovirt-master-centos-gluster6/x86_64/primary_db
> > > > > >>
> > > > > >> | 116 kB 00:00:00
> > > > > >> > (20/32): ovirt-4.3-epel/x86_64/primary_db
> > > > > >>
> > > > > >> | 6.7 MB 00:00:00
> > > > > >> > (21/32): ovirt-master-epel/x86_64/group_gz
> > > > > >>
> > > > > >> | 90 kB 00:00:00
> > > > > >> > (22/32): ovirt-master-epel/x86_64/updateinfo
> > > > > >>
> > > > > >> | 1.0 MB 00:00:00
> > > > > >> > (23/32): ovirt-master-snapshot/7/primary_db
> > > > > >>
> > > > > >> | 54 kB 00:00:00
> > > > > >> > (24/32): ovirt-4.3-virtio-win-latest/primary_db
> > > > > >>
> > > > > >> | 7.6 kB 00:00:01
> > > > > >> > (25/32):
ovirt-master-snapshot-static/7/primary_db
> > > > > >>
> > > > > >> | 4.6 kB 00:00:00
> > > > > >> > (26/32): ovirt-master-epel/x86_64/primary_db
> > > > > >>
> > > > > >> | 6.7 MB 00:00:00
> > > > > >> > (27/32):
ovirt-master-virtio-win-latest/primary_db
> > > > > >>
> > > > > >> | 7.6 kB 00:00:00
> > > > > >> > (28/32): centos-sclo-rh-release/x86_64/primary_db
> > > > > >>
> > > > > >> | 4.2 MB 00:00:03
> > > > > >> > (29/32): updates/7/x86_64/primary_db
> > > > > >>
> > > > > >> | 6.7 MB 00:00:00
> > > > > >> > (30/32):
> ovirt-master-centos-opstools-testing/x86_64/primary_db
> > > > > >>
> > > > > >> | 611 kB 00:00:01
> > > > > >> > (31/32):
ovirtwebui-ovirt-web-ui-master/x86_64/primary_db
> > > > > >>
> > > > > >> | 2.3 kB 00:00:00
> > > > > >> > (32/32): sac-gluster-ansible/x86_64/primary_db
> > > > > >>
> > > > > >> | 13 kB 00:00:00
> > > > > >> > No package ansible-runner-service-dev available.
> > > > > >> > Error: Nothing to do
> > > > > >> >
> > > > > >> >
> > > > > >> > Fedor
> > > > > >> >
> > > > > >> > ----- Original Message -----
> > > > > >> > From: "Sandro Bonazzola" <
sbonazzo(a)redhat.com >
> > > > > >> > To: "Fedor Gavrilov" <
fgavrilo(a)redhat.com >
> > > > > >> > Cc: "Eyal Shenitzky" <
eshenitz(a)redhat.com >, "devel" <
> > > > devel(a)ovirt.org >
> > > > > >> > Sent: Tuesday, March 10, 2020 5:56:53 PM
> > > > > >> > Subject: Re: [ovirt-devel] Re: what's up with
> > > > > >> ansible-runner-service-dev package?
> > > > > >> >
> > > > > >> > Il giorno mar 10 mar 2020 alle ore 15:39 Fedor
Gavrilov <
> > > > > >> fgavrilo(a)redhat.com >
> > > > > >> > ha scritto:
> > > > > >> >
> > > > > >> > > Thanks for the response, Eyal!
> > > > > >> > >
> > > > > >> > > I already had ovirt-master repo installed,
but updated
> > > everything
> > > > > >> just in
> > > > > >> > > case.
> > > > > >> > > I even tried both yum and dnf (since yum on
centos was
> giving
> > > me
> > > > > lots
> > > > > >> of
> > > > > >> > > grief before and I learned their behaviour
differs,
> especially
> > > > when
> > > > > it
> > > > > >> > > comes to bugs) but none works...
> > > > > >> > >
> > > > > >> > > >No package ansible-runner-service-dev
available.
> > > > > >> > > >No match for argument:
ansible-runner-service-dev
> > > > > >> > >
> > > > > >> > > Fedor
> > > > > >> > >
> > > > > >> > >
> > > > > >> > Looks like you're trying to install
ovirt-master-snapshot on
> el7.
> > > > > >> > It won't work.
> > > > > >> > Master is not supporting el7 anymore.
> > > > > >> > You can use 4.3 snapshot rpm at :
> > > > > >> >
> > > >
>
https://resources.ovirt.org/pub/yum-repo/ovirt-release43-snapshot.rpm
> > > > > >> if
> > > > > >> > you need to stay on el7.
> > > > > >> >
> > > > > >> >
> > > > > >> > > ----- Original Message -----
> > > > > >> > > From: "Eyal Shenitzky" <
eshenitz(a)redhat.com >
> > > > > >> > > To: "Fedor Gavrilov" <
fgavrilo(a)redhat.com >
> > > > > >> > > Cc: "devel" < devel(a)ovirt.org
>
> > > > > >> > > Sent: Tuesday, March 10, 2020 2:24:16 PM
> > > > > >> > > Subject: Re: [ovirt-devel] what's up
with
> > > > ansible-runner-service-dev
> > > > > >> > > package?
> > > > > >> > >
> > > > > >> > > Hi Fedor,
> > > > > >> > >
> > > > > >> > > Please try:
> > > > > >> > > 1. dnf install
> > > > > >> > >
> > >
http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm
> > > > > >> > > 2. dnf update
> > > > > >> > > 3. dnf install ansible-runner-service-dev
> > > > > >> > > 4. flow the instruction from thread 'New
dependency for
> > > > development
> > > > > >> > > environment'
> > > > > >> > > The
> > > > > >> > >
> > > > > >> > > On Tue, 10 Mar 2020 at 14:55, Fedor Gavrilov
<
> > > fgavrilo(a)redhat.com
> > > > >
> > > > > >> wrote:
> > > > > >> > >
> > > > > >> > > > Hi everyone,
> > > > > >> > > >
> > > > > >> > > > After I screwed up my dev environment
beyond repair I
> have to
> > > > set
> > > > > >> it up
> > > > > >> > > > again and I see something I haven't
last time (CentOS 7):
> > > > > >> > > >
> > > > > >> > > > $ sudo yum install
ansible-runner-service-dev
> > > > > >> > > > Loaded plugins: fastestmirror
> > > > > >> > > > Loading mirror speeds from cached
hostfile
> > > > > >> > > > * base: mirror.hosting90.cz
> > > > > >> > > > * centos-sclo-rh: mirror.hosting90.cz
> > > > > >> > > > * centos-sclo-sclo: mirror.hosting90.cz
> > > > > >> > > > * extras: mirror.hosting90.cz
> > > > > >> > > > * ovirt-master-epel:
mirror.hosting90.cz
> > > > > >> > > > * ovirt-master-snapshot: ftp.nluug.nl
> > > > > >> > > > * ovirt-master-snapshot-static:
ftp.nluug.nl
> > > > > >> > > > * updates: mirror.hosting90.cz
> > > > > >> > > > No package ansible-runner-service-dev
available.
> > > > > >> > > >
> > > > > >> > > > Maybe something's missing from my
notes, but where did it
> go?
> > > > > >> Should I
> > > > > >> > > add
> > > > > >> > > > some repo?
> > > > > >> > > >
> > > > > >> > > > Fedor
> > > > > >> > > >
_______________________________________________
> > > > > >> > > > Devel mailing list -- devel(a)ovirt.org
> > > > > >> > > > To unsubscribe send an email to
devel-leave(a)ovirt.org
> > > > > >> > > > Privacy Statement:
>
https://www.ovirt.org/privacy-policy.html
> > > > > >> > > > oVirt Code of Conduct:
> > > > > >> > > >
>
https://www.ovirt.org/community/about/community-guidelines/
> > > > > >> > > > List Archives:
> > > > > >> > > >
> > > > > >> > >
> > > > > >>
> > > > >
> > > >
> > >
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/3KH5INHYMY3...
> > > > > >> > > >
> > > > > >> > >
> > > > > >> > >
> > > > > >> > > --
> > > > > >> > > Regards,
> > > > > >> > > Eyal Shenitzky
> > > > > >> > >
_______________________________________________
> > > > > >> > > Devel mailing list -- devel(a)ovirt.org
> > > > > >> > > To unsubscribe send an email to
devel-leave(a)ovirt.org
> > > > > >> > > Privacy Statement:
>
https://www.ovirt.org/privacy-policy.html
> > > > > >> > > oVirt Code of Conduct:
> > > > > >> > >
https://www.ovirt.org/community/about/community-guidelines/
> > > > > >> > > List Archives:
> > > > > >> > >
> > > > > >>
> > > > >
> > > >
> > >
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/52BHRXMZGSV...
> > > > > >> > >
> > > > > >> >
> > > > > >> >
> > > > > >> > --
> > > > > >> >
> > > > > >> > Sandro Bonazzola
> > > > > >> >
> > > > > >> > MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV
> > > > > >> >
> > > > > >> > Red Hat EMEA <
https://www.redhat.com/ >
> > > > > >> >
> > > > > >> > sbonazzo(a)redhat.com
> > > > > >> > <
https://www.redhat.com/ >*Red Hat respects
your work life
> > > balance.
> > > > > >> > Therefore there is no need to answer this email
out of your
> > > office
> > > > > >> hours.
> > > > > >> > <
https://mojo.redhat.com/docs/DOC-1199578
>*
> > > > > >> > _______________________________________________
> > > > > >> > Devel mailing list -- devel(a)ovirt.org
> > > > > >> > To unsubscribe send an email to
devel-leave(a)ovirt.org
> > > > > >> > Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> > > > > >> > oVirt Code of Conduct:
> > > > > >>
https://www.ovirt.org/community/about/community-guidelines/
> > > > > >> > List Archives:
> > > > > >>
> > > > >
> > > >
> > >
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/26DWVGS47AN...
> > > > > >> _______________________________________________
> > > > > >> Devel mailing list -- devel(a)ovirt.org
> > > > > >> To unsubscribe send an email to devel-leave(a)ovirt.org
> > > > > >> Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> > > > > >> oVirt Code of Conduct:
> > > > > >>
https://www.ovirt.org/community/about/community-guidelines/
> > > > > >> List Archives:
> > > > > >>
> > > > >
> > > >
> > >
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/CLZ6L4VZCG3...
> > > > > >>
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Regards,
> > > > > > Eyal Shenitzky
> > > > > > _______________________________________________
> > > > > > Devel mailing list -- devel(a)ovirt.org
> > > > > > To unsubscribe send an email to devel-leave(a)ovirt.org
> > > > > > Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> > > > > > oVirt Code of Conduct:
> > > > > >
https://www.ovirt.org/community/about/community-guidelines/
> > > > > > List Archives:
> > > > > >
> > > > >
> > > >
> > >
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/4SY64VTL7AL...
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Martin Perina
> > > > > Manager, Software Engineering
> > > > > Red Hat Czech s.r.o.
> > > > > _______________________________________________
> > > > > Devel mailing list -- devel(a)ovirt.org
> > > > > To unsubscribe send an email to devel-leave(a)ovirt.org
> > > > > Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> > > > > oVirt Code of Conduct:
> > > > >
https://www.ovirt.org/community/about/community-guidelines/
> > > > > List Archives:
> > > > >
> > > >
> > >
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/VJOHBN5RHFQ...
> > > > >
> > > > >
> > > >
> > > > --
> > > > Martin Perina
> > > > Manager, Software Engineering
> > > > Red Hat Czech s.r.o.
> > > >
> > > >
> > >
> > > --
> > > Martin Perina
> > > Manager, Software Engineering
> > > Red Hat Czech s.r.o.
> > >
> > >
> > >
> > > --
> > > Martin Perina
> > > Manager, Software Engineering
> > > Red Hat Czech s.r.o.
> > >
> > > _______________________________________________
> > > Devel mailing list -- devel(a)ovirt.org
> > > To unsubscribe send an email to devel-leave(a)ovirt.org
> > > Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> > > oVirt Code of Conduct:
> > >
https://www.ovirt.org/community/about/community-guidelines/
> > > List Archives:
> > >
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/XUSAKMZHVN7...
> > > _______________________________________________
> > > Devel mailing list -- devel(a)ovirt.org
> > > To unsubscribe send an email to devel-leave(a)ovirt.org
> > > Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> > > oVirt Code of Conduct:
> > >
https://www.ovirt.org/community/about/community-guidelines/
> > > List Archives:
> > >
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/6XPXETA6PNC...
> > > _______________________________________________
> > > Devel mailing list -- devel(a)ovirt.org
> > > To unsubscribe send an email to devel-leave(a)ovirt.org
> > > Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> > > oVirt Code of Conduct:
> > >
https://www.ovirt.org/community/about/community-guidelines/
> > > List Archives:
> > >
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/LOAF7RE5TSZ...
> > >
> >
> >
> > _______________________________________________
> > Devel mailing list -- devel(a)ovirt.org
> > To unsubscribe send an email to devel-leave(a)ovirt.org
> > Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> > oVirt Code of Conduct:
>
https://www.ovirt.org/community/about/community-guidelines/
> > List Archives:
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/GBTKNRVPN6F...
> > _______________________________________________
> > Devel mailing list -- devel(a)ovirt.org
> > To unsubscribe send an email to devel-leave(a)ovirt.org
> > Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> > oVirt Code of Conduct:
>
https://www.ovirt.org/community/about/community-guidelines/
> > List Archives:
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/FVXUOQAVVHJ...
> _______________________________________________
> Devel mailing list -- devel(a)ovirt.org
> To unsubscribe send an email to devel-leave(a)ovirt.org
> Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> oVirt Code of Conduct:
>
https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/L4654P3ZUVF...
>
>
> _______________________________________________
> Devel mailing list -- devel(a)ovirt.org
> To unsubscribe send an email to devel-leave(a)ovirt.org
> Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> oVirt Code of Conduct:
>
https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/DGT7TW4B5X7...
> _______________________________________________
> Devel mailing list -- devel(a)ovirt.org
> To unsubscribe send an email to devel-leave(a)ovirt.org
> Privacy Statement:
https://www.ovirt.org/privacy-policy.html
> oVirt Code of Conduct:
>
https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
>
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/K2BTKQFTJVC...
>
--
Martin Perina
Manager, Software Engineering
Red Hat Czech s.r.o.
_______________________________________________
Devel mailing list -- devel(a)ovirt.org
To unsubscribe send an email to devel-leave(a)ovirt.org
Privacy Statement:
https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/devel@ovirt.org/message/Z7TKYPARKUQ...
_______________________________________________
Devel mailing list -- devel(a)ovirt.org
To unsubscribe send an email to devel-leave(a)ovirt.org
Privacy Statement: