[ovirt-devel] Re: [rhev-devel] Re: New dependency for development environment

Dear Amit, There are a few scenarios, but on adding a new Host freshly installed, the errors are as follows: 2019-12-15 16:41:55,347+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] EVENT_ID: VDS_ANSIBLE_INSTALL_STARTED(560), Ansible host-deploy playbook execution has started on host Host1. 2019-12-15 16:41:55,622+02 ERROR [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] Exception: Internal server error, please check Ansible runner error log. 2019-12-15 16:41:55,623+02 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] Host installation failed for host '0e2b5314-4313-4f40-9dca-d716403aa51a', 'Host1': Failed to execute Ansible host-deploy role: Internal server error, please check Ansible runner error log.. Please check logs for more details: /home/srosenbe/ovirt_engine_master/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20191215164155-10.35.0.35-67eb9528.log 2019-12-15 16:41:55,630+02 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] START, SetVdsStatusVDSCommand(HostName = Host1, SetVdsStatusVDSCommandParameters:{hostId='0e2b5314-4313-4f40-9dca-d716403aa51a', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 64eb8f0b 2019-12-15 16:41:55,640+02 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] FINISH, SetVdsStatusVDSCommand, return: , log id: 64eb8f0b 2019-12-15 16:41:55,669+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] EVENT_ID: VDS_INSTALL_FAILED(505), Host Host1 installation failed. Failed to execute Ansible host-deploy role: Internal server error, please check Ansible runner error log.. Please check logs for more details: /home/srosenbe/ovirt_engine_master/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20191215164155-10.35.0.35-67eb9528.log. 2019-12-15 16:41:55,683+02 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-1) [67eb9528] Lock freed to object 'EngineLock:{exclusiveLocks='[0e2b5314-4313-4f40-9dca-d716403aa51a=VDS]', sharedLocks=''}' The host-deploy directory is empty however and the gunicorn journal fails as follows: Dec 15 16:41:55 srosenbe.tlv.csb gunicorn[3206]: Creating env/cmdline file: --private-key /home/srosenbe/ovirt_engine_master/etc/pki/ovirt-engine/keys/engine_id_rsa Dec 15 16:41:55 srosenbe.tlv.csb gunicorn[3206]: Exception on /api/v1/playbooks/ovirt-host-deploy.yml [POST] Dec 15 16:41:55 srosenbe.tlv.csb gunicorn[3206]: Traceback (most recent call last): The traceback is quite long. I can provide more information accordingly. With Best Regards. Steven. On Mon, Dec 16, 2019 at 4:26 PM Amit Bawer <abawer(a)redhat.com&gt; wrote: > what do you see for your host on engine.log ? any SSH timeout issue? > > On Mon, Dec 16, 2019 at 4:18 PM Kaustav Majumder <kmajumde(a)redhat.com&gt; > wrote: > >> >> >> On Mon, Dec 16, 2019 at 7:45 PM Amit Bawer <abawer(a)redhat.com&gt; wrote: >> >>> from snippet is seems you are under >>> ~/work/ovirt-engine-builds/11-12-global-options >>> >> This is my $PREFIX . >> ⌂120% [kmajumde:~/work/ovirt-engine-builds/11-12-global-options] $ ls >> var/log/ovirt-engine/ >> ansible boot.log cinderlib dump engine.log host-deploy notifier >> ova server.log setup ui.log >> >>> trying to ls var in relative path to your working directory >>> is it possible you have omitted the leading backslash? >>> >>> ls */*var/log/ovirt-engine/host-deploy/ >>> >>> >>> On Mon, Dec 16, 2019 at 4:11 PM Kaustav Majumder <kmajumde(a)redhat.com&gt; >>> wrote: >>> >>>> No logs whatsoever. >>>> ``` >>>> ls var/log/ovirt-engine/host-deploy/ >>>> ⌂142% [kmajumde:~/work/ovirt-engine-builds/11-12-global-options] $ >>>> ``` >>>> >>>> >>>> On Mon, Dec 16, 2019 at 7:39 PM Amit Bawer <abawer(a)redhat.com&gt; wrote: >>>> >>>>> >>>>> >>>>> On Mon, Dec 16, 2019 at 2:46 PM Kaustav Majumder <kmajumde(a)redhat.com&gt; >>>>> wrote: >>>>> >>>>>> Hi, >>>>>> i have tried setting up my devel env on an updated fedora 30. Engine >>>>>> is running well but when I am trying to add a new host to the engine >>>>>> (Centos 7.7) it is taking 2+ hrs and has still not added the host. Is this >>>>>> expected behaviour? Also I can't find any host deploy or ansible logs. >>>>>> >>>>> >>>>> Aren't any new logs under engine machine path at >>>>> /var/log/ovirt-engine/host-deploy/ ? >>>>> >>>>> >>>>>> On Thu, Dec 12, 2019 at 2:11 AM Martin Perina <mperina(a)redhat.com&gt; >>>>>> wrote: >>>>>> >>>>>>> >>>>>>> >>>>>>> On Wed, Dec 11, 2019 at 4:29 PM Dominik Holler <dholler(a)redhat.com&gt; >>>>>>> wrote: >>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Wed, Nov 27, 2019 at 8:37 AM Ondra Machacek < >>>>>>>> omachace(a)redhat.com&gt; wrote: >>>>>>>> >>>>>>>>> Hello, >>>>>>>>> >>>>>>>>> we are going to merge a series of patches to master branch, which >>>>>>>>> integrates ansible-runner with oVirt engine. When the patches >>>>>>>>> will be >>>>>>>>> merged you will need to install new package called ansible-runner- >>>>>>>>> service-dev, and follow instructions so your dev-env will keep >>>>>>>>> working >>>>>>>>> smoothly(all relevant info will be also in README.adoc): >>>>>>>>> >>>>>>>>> 1) sudo dnf update ovirt-release-master >>>>>>>>> >>>>>>>>> 2) sudo dnf install -y ansible-runner-service-dev >>>>>>>>> >>>>>>>>> >>>>>>>> "dnf install -y ansible-runner-service-dev" did not work for me on >>>>>>>> fedora 29. >>>>>>>> >>>>>>> >>>>>>> You need to have at least FC30, because ansible-runner on FC29 is >>>>>>> too old >>>>>>> >>>>>>>> I created manually the file /etc/yum.repos.d/centos.repo: >>>>>>>> [centos-ovirt44-testing] >>>>>>>> name=CentOS-7 - oVirt 4.4 >>>>>>>> baseurl= >>>>>>>> http://cbs.centos.org/repos/virt7-ovirt-44-testing/$basearch/os/ >>>>>>>> gpgcheck=0 >>>>>>>> enabled=1 >>>>>>>> >>>>>>>> which made the ansible-runner-service-dev available. >>>>>>>> >>>>>>>> >>>>>>>>> 3) Edit `/etc/ansible-runner-service/config.yaml` file as follows: >>>>>>>>> >>>>>>>>> --- >>>>>>>>> playbooks_root_dir: >>>>>>>>> '$PREFIX/share/ovirt-engine/ansible-runner-service-project' >>>>>>>>> ssh_private_key: >>>>>>>>> '$PREFIX/etc/pki/ovirt-engine/keys/engine_id_rsa' >>>>>>>>> port: 50001 >>>>>>>>> target_user: root >>>>>>>>> >>>>>>>>> Where `$PREFIX` is the prefix of your development environment >>>>>>>>> prefix, >>>>>>>>> which you've specified during the compilation of the engine. >>>>>>>>> >>>>>>>>> 4) Restart and enable ansible-runner-service: >>>>>>>>> >>>>>>>>> # systemctl restart ansible-runner-service >>>>>>>>> # systemctl enable ansible-runner-service >>>>>>>>> >>>>>>>>> That's it, your dev-env should start using the >>>>>>>>> ansible-runner-service >>>>>>>>> for host-deployment etc. >>>>>>>>> >>>>>>>>> Please note that only Fedora 30/31 and Centos7 was packaged, and >>>>>>>>> are >>>>>>>>> natively supported! >>>>>>>>> >>>>>>>>> Thanks, >>>>>>>>> Ondra >>>>>>>>> _______________________________________________ >>>>>>>>> Devel mailing list -- devel(a)ovirt.org >>>>>>>>> To unsubscribe send an email to devel-leave(a)ovirt.org >>>>>>>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>>>>>>> oVirt Code of Conduct: >>>>>>>>> https://www.ovirt.org/community/about/community-guidelines/ >>>>>>>>> List Archives: >>>>>>>>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/AFKGTV4WDNO... >>>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Devel mailing list -- devel(a)ovirt.org >>>>>>>> To unsubscribe send an email to devel-leave(a)ovirt.org >>>>>>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>>>>>> oVirt Code of Conduct: >>>>>>>> https://www.ovirt.org/community/about/community-guidelines/ >>>>>>>> List Archives: >>>>>>>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/RMNEQG7KNFW... >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Martin Perina >>>>>>> Manager, Software Engineering >>>>>>> Red Hat Czech s.r.o. >>>>>>> _______________________________________________ >>>>>>> Devel mailing list -- devel(a)ovirt.org >>>>>>> To unsubscribe send an email to devel-leave(a)ovirt.org >>>>>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>>>>> oVirt Code of Conduct: >>>>>>> https://www.ovirt.org/community/about/community-guidelines/ >>>>>>> List Archives: >>>>>>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/5TMTVOWQLF7... >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> Thanks, >>>>>> >>>>>> Kaustav Majumder >>>>>> >>>>> >>>> >>>> -- >>>> >>>> Thanks, >>>> >>>> Kaustav Majumder >>>> >>> >> >> -- >> >> Thanks, >> >> Kaustav Majumder >> > _______________________________________________ Devel mailing list -- devel(a)ovirt.org To unsubscribe send an email to devel-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/CGGJJGZOTOF...