[ovirt-devel] Re: [rhev-devel] Re: New dependency for development environment

Dear Kaustav Majumder, We resolved the issue I had and the symptoms sound similar to what you are experiencing. 1. One needs to have the ansible versions installs from these packages [1] which includes ansible-runner 1.3.4 2. If you do ansible-runner --version and you get version 1.0.1 you need to install python2-ansible-runner from the link to get version 1.3.4 (this was the issue I had). 3. One still needs to start from a clean engine and a newly installed Host using master [2], an older deployment did not work [1] https://cbs.centos.org/repos/virt7-ovirt-44-testing/x86_64/os/Packages/ [2] yum install -y https://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm With Best Regards. Steven Rosenberg. On Mon, Dec 16, 2019 at 4:32 PM Steven Rosenberg <srosenbe(a)redhat.com&gt; wrote: > Dear Amit, > > There are a few scenarios, but on adding a new Host freshly installed, > the errors are as follows: > > 2019-12-15 16:41:55,347+02 INFO > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] EVENT_ID: > VDS_ANSIBLE_INSTALL_STARTED(560), Ansible host-deploy playbook execution > has started on host Host1. > > 2019-12-15 16:41:55,622+02 ERROR > [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] > (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] Exception: Internal > server error, please check Ansible runner error log. > > 2019-12-15 16:41:55,623+02 ERROR > [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] > (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] Host installation > failed for host '0e2b5314-4313-4f40-9dca-d716403aa51a', 'Host1': Failed to > execute Ansible host-deploy role: Internal server error, please check > Ansible runner error log.. Please check logs for more details: > /home/srosenbe/ovirt_engine_master/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20191215164155-10.35.0.35-67eb9528.log > > 2019-12-15 16:41:55,630+02 INFO > [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] > (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] START, > SetVdsStatusVDSCommand(HostName = Host1, > SetVdsStatusVDSCommandParameters:{hostId='0e2b5314-4313-4f40-9dca-d716403aa51a', > status='InstallFailed', nonOperationalReason='NONE', > stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 64eb8f0b > > 2019-12-15 16:41:55,640+02 INFO > [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] > (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] FINISH, > SetVdsStatusVDSCommand, return: , log id: 64eb8f0b > > 2019-12-15 16:41:55,669+02 ERROR > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] EVENT_ID: > VDS_INSTALL_FAILED(505), Host Host1 installation failed. Failed to execute > Ansible host-deploy role: Internal server error, please check Ansible > runner error log.. Please check logs for more details: > /home/srosenbe/ovirt_engine_master/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20191215164155-10.35.0.35-67eb9528.log. > > 2019-12-15 16:41:55,683+02 INFO > [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] > (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] Lock freed to object > 'EngineLock:{exclusiveLocks='[0e2b5314-4313-4f40-9dca-d716403aa51a=VDS]', > sharedLocks=''}' > > The host-deploy directory is empty however and the gunicorn journal fails > as follows: > > > Dec 15 16:41:55 srosenbe.tlv.csb gunicorn[3206]: Creating env/cmdline > file: --private-key > /home/srosenbe/ovirt_engine_master/etc/pki/ovirt-engine/keys/engine_id_rsa > Dec 15 16:41:55 srosenbe.tlv.csb gunicorn[3206]: Exception on > /api/v1/playbooks/ovirt-host-deploy.yml [POST] Dec 15 16:41:55 > srosenbe.tlv.csb gunicorn[3206]: Traceback (most recent call last): > > > The traceback is quite long. > > > I can provide more information accordingly. > > > With Best Regards. > > > Steven. > > > > > > On Mon, Dec 16, 2019 at 4:26 PM Amit Bawer <abawer(a)redhat.com&gt; wrote: > >> what do you see for your host on engine.log ? any SSH timeout issue? >> >> On Mon, Dec 16, 2019 at 4:18 PM Kaustav Majumder <kmajumde(a)redhat.com&gt; >> wrote: >> >>> >>> >>> On Mon, Dec 16, 2019 at 7:45 PM Amit Bawer <abawer(a)redhat.com&gt; wrote: >>> >>>> from snippet is seems you are under >>>> ~/work/ovirt-engine-builds/11-12-global-options >>>> >>> This is my $PREFIX . >>> ⌂120% [kmajumde:~/work/ovirt-engine-builds/11-12-global-options] $ ls >>> var/log/ovirt-engine/ >>> ansible boot.log cinderlib dump engine.log host-deploy notifier >>> ova server.log setup ui.log >>> >>>> trying to ls var in relative path to your working directory >>>> is it possible you have omitted the leading backslash? >>>> >>>> ls */*var/log/ovirt-engine/host-deploy/ >>>> >>>> >>>> On Mon, Dec 16, 2019 at 4:11 PM Kaustav Majumder <kmajumde(a)redhat.com&gt; >>>> wrote: >>>> >>>>> No logs whatsoever. >>>>> ``` >>>>> ls var/log/ovirt-engine/host-deploy/ >>>>> ⌂142% [kmajumde:~/work/ovirt-engine-builds/11-12-global-options] $ >>>>> ``` >>>>> >>>>> >>>>> On Mon, Dec 16, 2019 at 7:39 PM Amit Bawer <abawer(a)redhat.com&gt; wrote: >>>>> >>>>>> >>>>>> >>>>>> On Mon, Dec 16, 2019 at 2:46 PM Kaustav Majumder < >>>>>> kmajumde(a)redhat.com&gt; wrote: >>>>>> >>>>>>> Hi, >>>>>>> i have tried setting up my devel env on an updated fedora 30. >>>>>>> Engine is running well but when I am trying to add a new host to the engine >>>>>>> (Centos 7.7) it is taking 2+ hrs and has still not added the host. Is this >>>>>>> expected behaviour? Also I can't find any host deploy or ansible logs. >>>>>>> >>>>>> >>>>>> Aren't any new logs under engine machine path at >>>>>> /var/log/ovirt-engine/host-deploy/ ? >>>>>> >>>>>> >>>>>>> On Thu, Dec 12, 2019 at 2:11 AM Martin Perina <mperina(a)redhat.com&gt; >>>>>>> wrote: >>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Wed, Dec 11, 2019 at 4:29 PM Dominik Holler <dholler(a)redhat.com&gt; >>>>>>>> wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Wed, Nov 27, 2019 at 8:37 AM Ondra Machacek < >>>>>>>>> omachace(a)redhat.com&gt; wrote: >>>>>>>>> >>>>>>>>>> Hello, >>>>>>>>>> >>>>>>>>>> we are going to merge a series of patches to master branch, which >>>>>>>>>> integrates ansible-runner with oVirt engine. When the patches >>>>>>>>>> will be >>>>>>>>>> merged you will need to install new package called >>>>>>>>>> ansible-runner- >>>>>>>>>> service-dev, and follow instructions so your dev-env will keep >>>>>>>>>> working >>>>>>>>>> smoothly(all relevant info will be also in README.adoc): >>>>>>>>>> >>>>>>>>>> 1) sudo dnf update ovirt-release-master >>>>>>>>>> >>>>>>>>>> 2) sudo dnf install -y ansible-runner-service-dev >>>>>>>>>> >>>>>>>>>> >>>>>>>>> "dnf install -y ansible-runner-service-dev" did not work for me >>>>>>>>> on fedora 29. >>>>>>>>> >>>>>>>> >>>>>>>> You need to have at least FC30, because ansible-runner on FC29 is >>>>>>>> too old >>>>>>>> >>>>>>>>> I created manually the file /etc/yum.repos.d/centos.repo: >>>>>>>>> [centos-ovirt44-testing] >>>>>>>>> name=CentOS-7 - oVirt 4.4 >>>>>>>>> baseurl= >>>>>>>>> http://cbs.centos.org/repos/virt7-ovirt-44-testing/$basearch/os/ >>>>>>>>> gpgcheck=0 >>>>>>>>> enabled=1 >>>>>>>>> >>>>>>>>> which made the ansible-runner-service-dev available. >>>>>>>>> >>>>>>>>> >>>>>>>>>> 3) Edit `/etc/ansible-runner-service/config.yaml` file as >>>>>>>>>> follows: >>>>>>>>>> >>>>>>>>>> --- >>>>>>>>>> playbooks_root_dir: >>>>>>>>>> '$PREFIX/share/ovirt-engine/ansible-runner-service-project' >>>>>>>>>> ssh_private_key: >>>>>>>>>> '$PREFIX/etc/pki/ovirt-engine/keys/engine_id_rsa' >>>>>>>>>> port: 50001 >>>>>>>>>> target_user: root >>>>>>>>>> >>>>>>>>>> Where `$PREFIX` is the prefix of your development environment >>>>>>>>>> prefix, >>>>>>>>>> which you've specified during the compilation of the engine. >>>>>>>>>> >>>>>>>>>> 4) Restart and enable ansible-runner-service: >>>>>>>>>> >>>>>>>>>> # systemctl restart ansible-runner-service >>>>>>>>>> # systemctl enable ansible-runner-service >>>>>>>>>> >>>>>>>>>> That's it, your dev-env should start using the >>>>>>>>>> ansible-runner-service >>>>>>>>>> for host-deployment etc. >>>>>>>>>> >>>>>>>>>> Please note that only Fedora 30/31 and Centos7 was packaged, and >>>>>>>>>> are >>>>>>>>>> natively supported! >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> Ondra >>>>>>>>>> _______________________________________________ >>>>>>>>>> Devel mailing list -- devel(a)ovirt.org >>>>>>>>>> To unsubscribe send an email to devel-leave(a)ovirt.org >>>>>>>>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>>>>>>>> oVirt Code of Conduct: >>>>>>>>>> https://www.ovirt.org/community/about/community-guidelines/ >>>>>>>>>> List Archives: >>>>>>>>>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/AFKGTV4WDNO... >>>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Devel mailing list -- devel(a)ovirt.org >>>>>>>>> To unsubscribe send an email to devel-leave(a)ovirt.org >>>>>>>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>>>>>>> oVirt Code of Conduct: >>>>>>>>> https://www.ovirt.org/community/about/community-guidelines/ >>>>>>>>> List Archives: >>>>>>>>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/RMNEQG7KNFW... >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Martin Perina >>>>>>>> Manager, Software Engineering >>>>>>>> Red Hat Czech s.r.o. >>>>>>>> _______________________________________________ >>>>>>>> Devel mailing list -- devel(a)ovirt.org >>>>>>>> To unsubscribe send an email to devel-leave(a)ovirt.org >>>>>>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>>>>>> oVirt Code of Conduct: >>>>>>>> https://www.ovirt.org/community/about/community-guidelines/ >>>>>>>> List Archives: >>>>>>>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/5TMTVOWQLF7... >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> >>>>>>> Thanks, >>>>>>> >>>>>>> Kaustav Majumder >>>>>>> >>>>>> >>>>> >>>>> -- >>>>> >>>>> Thanks, >>>>> >>>>> Kaustav Majumder >>>>> >>>> >>> >>> -- >>> >>> Thanks, >>> >>> Kaustav Majumder >>> >>