[ovirt-devel] Re: Error adding host to ovirt-engine in local development environment

Forgive me for being slightly off topic -- I made an ansible role to setup an engine dev environment. It works for me with the fc28 --> el7 setup (well, as of a few weeks ago). https://github.com/gregsheremeta/ovirt-engine-devel It installs all the dependencies for you. Hope it helps. My goal was to get some community interest / help in maintaining a shared stand-up script / role. Best wishes, Greg On Thu, Jul 12, 2018 at 8:34 AM Yedidyah Bar David <didi(a)redhat.com <mailto:didi@redhat.com>> wrote: On Thu, Jul 12, 2018 at 3:26 PM, Kaustav Majumder <kmajumde(a)redhat.com <mailto:kmajumde@redhat.com>> wrote: Hi, I installed python2-ovirt-host-deploy too but its the same error. Will install clean f27 on my system  and try on that. If it's because you are interested in re-adding fedora/dnf/python3 support, then fine, thanks! Gal is currently working on that, also Yuval and me a bit. If you just want to get something working, it's easier to use el7 for now. On Thursday 12 July 2018 05:51 PM, Yedidyah Bar David wrote: > On Thu, Jul 12, 2018 at 2:22 PM, Kaustav Majumder > <kmajumde(a)redhat.com <mailto:kmajumde@redhat.com>> wrote: > > Hi, > > I checked the symlinks and it was broken in mine too. I > have manually changed them to point to python2.7. > > > Did you try installing python2-ovirt-host-deploy? > > localhost in > /usr/share/ovirt-host-deploy/interface-3/pythonlib ○ → ls -l > total 4 > lrwxrwxrwx. 1 root root 45 Jun 24 15:29 otopi -> > ../../../../lib/python3.6/site-packages/otopi > lrwxrwxrwx. 1 root root 60 Jul 12 16:34 ovirt_host_deploy > -> > ../../../../../lib/python2.7/site-packages/ovirt_host_deploy > lrwxrwxrwx. 1 root root 58 Jul 12 16:34 ovirt_host_mgmt > -> ../../../../../lib/python2.7/site-packages/ovirt_host_mgmt > > Now when I am trying to run bin/engine-setup. It is > giving the following error > > bin/engine-setup > ***L:ERROR Internal error: No module named 'M2Crypto' > > > I do not follow. It worked for you in the past? What changed > since then? > > Also tried the following: > > 1.install python3.6 . setup in alternatives > > 2. installed ovirt python 3.6 dependecies > (otopi,ovirt_host_deploy,ovirt_host_mgmt) > > 3.Fixed symlinks > > 4. Tried running bin/engine-setup > > Giving the error as: > >  bin/engine-setup > ***L:ERROR Internal error: No module named 'M2Crypto' > > > > > > On Thursday 12 July 2018 12:31 PM, Yedidyah Bar David wrote: >> On Wed, Jul 11, 2018 at 4:54 PM, Kaustav Majumder&lt;kmajumde(a)redhat.com&gt; <mailto:kmajumde@redhat.com> wrote: >>> Hi, >>> >>> I installed python2-otopi rpm in the host and then when I try to add host it gives the following error--> An error has occurred during installation of Host10.70.43.129 <http://10.70.43.129>;: Internal error: No module named ovirt_host_deploy. >>> >>> I am getting the same error when I manually copy the tar and run in the host. >>> >>> error log -->https://pastebin.com/4RYZd1js >>> >>> Am I missing some dependencies in my dev env? >>> >>> >>> On Wednesday 11 July 2018 07:10 PM, Yuval Turgeman wrote: >>> >>> It looks like you don't have python3 installed, so otopi falls back to /bin/python which is python2, but the python2 otopi module is not installed - try to install the python2-otopi rpm and see if it works for you. >> This should not be needed on the _host_. >> >> Perhaps you need them on the engine machine. Didn't check, but it >> makes sense. Please try, on the engine machine: >> >> 1. Install all relevant python2 packages (otopi, ovirt-host-deploy, ?) >> 2. rm /var/cache/ovirt-engine/ovirt-host-deploy.tar >> 3. Then try to add the host >> >>> Thanks, >>> Yuval. >>> >>> On Wed, Jul 11, 2018 at 4:13 PM, Kaustav Majumder&lt;kmajumde(a)redhat.com&gt; <mailto:kmajumde@redhat.com> wrote: >>>> Hi, >>>> >>>> 'pythonlib' directory is empty.Is it something to do with that? >> Yes, that's the problem. No idea why exactly, I still didn't try that >> myself. Please check: >> >> ls -l /usr/share/ovirt-host-deploy/interface-3/pythonlib >> >> Both before and after installing python2 packages as suggested above. >> >> Now tried these on an fc28 machine, and I get: >> >> [pythonlib]# ls -l >> total 0 >> lrwxrwxrwx. 1 root root 45 Jun 24 12:59 otopi -> >> ../../../../lib/python3.6/site-packages/otopi >> lrwxrwxrwx. 1 root root 57 Jun 24 12:59 ovirt_host_deploy -> >> ../../../../lib/python3.6/site-packages/ovirt_host_deploy >> lrwxrwxrwx. 1 root root 55 Jun 24 12:59 ovirt_host_mgmt -> >> ../../../../lib/python3.6/site-packages/ovirt_host_mgmt >> >> [pythonlib]# rpm -qf * >> ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >> ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >> ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >> >> Where the two latter links are dead. This is because I did only 'dnf >> install ovirt-engine', which does not carry (for now) >> python3-ovirt-host-deploy. >> >> It seems (mainly thinking out loud, also adding Yuval) that this is the process: >> >> 1. You install either py2 or py3 otopi+host-deploy on the engine (or both) >> 2. The engine creates an otopi bundle: >> 2.1. It copies the plugins from the common path/pkg, which is always installed. >> 2.2. It copies the library files from the python lib of the python >> that otopi chose to run, on the _engine_. If you have python3, it will >> be python3 files. If 2, 2. In your case, you ran 3, but (perhaps?) >> pythonlib is empty, need to check why. >> 2.3. So the bundle contains python-version-specific files in >> pythonlib, but this in theory should not be a big concern: >> 3. Engine copies the bundle to the host, untars, and runs. >> 4. If on the host otopi chooses a different python than the one used >> to create the bundle, pythonlib will include wrong binary (.pyc/.pyo) >> files (at least in wrong locations), but the text/source files should >> still be available, if all goes well. >> >> Yuval - does this sound like the plan we (vaguely) had? >> >> (Kaustav - please "reply all" - it's much easier to follow a >> conversation this way. Thanks) >> >> Also, perhaps open a bug about this. Still not sure what's the best >> option. Some I can think of: >> >> 1. Just ignore this case. Assume that engine and host machines use >> same python, and developers that want to test something else will need >> to install the relevant other packages. >> >> 2. Make the engine require both py2 and py3 packages. Not sure this >> makes much sense, need to think about it. We also need to continue >> support the engine on el7, where we do not have py3 by default (and >> probably do not want to install it). So perhaps do this only on >> fedora. >> >> 3. Something else? E.g. check for any available python and use that? >> That's not very easy for now, as the above links are packaged, meaning >> created during building/packaging time, not run time, so then we still >> do not know which python will actually be available. >> >>>> On Wednesday 11 July 2018 06:30 PM, Kaustav Majumder wrote: >>>> >>>> Hi, >>>> >>>> The output of sh -x otopi -->https://pastebin.com/WeeCJYdk >>>> >>>> tar in the attachment >>>> >>>> >>>> On Wednesday 11 July 2018 06:14 PM, Yedidyah Bar David wrote: >>>> >>>> On Wed, Jul 11, 2018 at 10:21 AM, Kaustav Majumder&lt;kmajumde(a)redhat.com&gt; <mailto:kmajumde@redhat.com> wrote: >>>>> Hi, >>>>> >>>>> Following are the versions >>>>> >>>>> otopi-1.8.0-0.0.master.20180704073752.git9eed7fe.fc28 >>>>> >>>>> ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >>>>> python2-ovirt-host-deploy-1.8.0-0.0.master.20180624095611.gi >>>>> <http://0-0.0.master.20180624095611.gi>t827d6d1.fc28.noarch >>>>> >>>>> I copied the tar to the host and when I am trying to install its giving the following error >>>>> >>>>> [root@dhcp43-133 ~]# ./ovirt-host-deploy >>>>> ***L:ERROR: Python is required but missing >>>> Can you please try running, from the same directory on the host, 'sh -x otopi' ? >>>> >>>> Also, can you please share the bundle tar file? >>>> >>>> Thanks, >>>> >>>>> On Wednesday 11 July 2018 11:04 AM, Yedidyah Bar David wrote: >>>>> >>>>> On Tue, Jul 10, 2018 at 1:24 PM, Kaustav Majumder&lt;kmajumde(a)redhat.com&gt; <mailto:kmajumde@redhat.com> wrote: >>>>>> Hi, >>>>>> >>>>>> I am trying to setup ovirt engine dev environment in my local Fedora 28 machine. >>>>> Do you want to use fedora 28 specifically? Or just get a dev env working? If latter, it's currently easier to use el7. >>>>> >>>>>> I have followed this guide ->https://gerrit.ovirt.org/gitweb?p=ovirt-engine.git;a=blob_plain;f=README.adoc;hb=HEAD >>>>>> >>>>>> When I am trying to add a new host (Centos 7) ,it is failing with the following error. >>>>>> >>>>>> >>>>>> [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host 10.70.43.157. Connected to host 10.70.43.157 with SSH key fingerprint: SHA256:rZfUGylVh3PLqfH2Siey0+CA9RUctK2ITQ2UGtV5ggA. >>>>>> 2018-07-10 15:47:50,447+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Installation of 10.70.43.157. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar >>>>>> 2018-07-10 15:47:50,447+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Tarball '/home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh >>>>>> 2018-07-10 15:47:50,471+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH execute &#39;root(a)10.70.43.157 <mailto:root@10.70.43.157>' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' >>>>>> 2018-07-10 15:47:50,676+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host10.70.43.157 <http://10.70.43.157>;: Python is required but missing. >>>>>> 2018-07-10 15:47:50,685+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [35eb76d9] Error during deploy dialog >>>>>> 2018-07-10 15:47:50,686+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH error running commandroot(a)10.70.43.157 <mailto:root@10.70.43.157>:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session &#39;root(a)10.70.43.157 <mailto:root@10.70.43.157>' >>>>>> 2018-07-10 15:47:50,690+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 10.70.43.157 install >>>>>> 2018-07-10 15:47:50,697+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host10.70.43.157 <http://10.70.43.157>;: Command returned failure code 1 during SSH session &#39;root(a)10.70.43.157 <mailto:root@10.70.43.157>'. >>>>>> 2018-07-10 15:47:50,698+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 10.70.43.157 install, preferring first exception: Unexpected connection termination >>>>>> 2018-07-10 15:47:50,698+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Host installation failed for host '3a52f700-a1d3-47b0-9518-f7f94231a874', '10.70.43.157': Unexpected connection termination >>>>>> 2018-07-10 15:47:50,700+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] START, SetVdsStatusVDSCommand(HostName = 10.70.43.157, SetVdsStatusVDSCommandParameters:{hostId='3a52f700-a1d3-47b0-9518-f7f94231a874', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 48d6c653 >>>>>> 2018-07-10 15:47:50,704+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] FINISH, SetVdsStatusVDSCommand, return: , log id: 48d6c653 >>>>>> 2018-07-10 15:47:50,710+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: VDS_INSTALL_FAILED(505), Host 10.70.43.157 installation failed. Unexpected connection termination. >>>>>> >>>>>> >>>>>> I have tried installing it several times and it has failed. >>>>> Which versions of otopi and ovirt-host-deploy do you have? >>>>> >>>>> Can you install otopi on the host and run it? Does it work? >>>>> >>>>> You can also try copying and running the host-deploy bundle manually to the host. It's on the engine machine in /var/cache/ovirt-engine. Copy it to the host, untar in some directory, and run from inside it: >>>>> >>>>> $PWD/ovirt-host-deploy >>>>> >>>>> Best regards, >>>>> -- >>>>> Didi >>>>> >>>>> >>>>> _______________________________________________ >>>>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>>>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>>>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>>>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>>>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/2V... >>>>> >>>>> >>>>> -- >>>>> >>>>> Kaustav Majumder >>>>> >>>>> Associate Software Engineer >>>>> >>>>> Red Hat India PVT LTD. >>>>> >>>>> kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: 08981884037 IM: IRC: kmajumder >>>>> >>>>> TRIED. TESTED. TRUSTED. >>>>> @redhatway @redhatinc @redhatsnaps >>>>> >>>>> _______________________________________________ >>>>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>>>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>>>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>>>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>>>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/MM... >>>>> >>>> -- >>>> Didi >>>> >>>> >>>> _______________________________________________ >>>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7R... >>>> >>>> >>>> -- >>>> >>>> Kaustav Majumder >>>> >>>> Associate Software Engineer >>>> >>>> Red Hat India PVT LTD. >>>> >>>> kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: 08981884037 IM: IRC: kmajumder >>>> >>>> TRIED. TESTED. TRUSTED. >>>> @redhatway @redhatinc @redhatsnaps >>>> >>>> >>>> _______________________________________________ >>>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/EZ... >>>> >>>> >>>> -- >>>> >>>> Kaustav Majumder >>>> >>>> Associate Software Engineer >>>> >>>> Red Hat India PVT LTD. >>>> >>>> kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: 08981884037 IM: IRC: kmajumder >>>> >>>> TRIED. TESTED. TRUSTED. >>>> @redhatway @redhatinc @redhatsnaps >>>> >>>> _______________________________________________ >>>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/OP... >>>> >>> _______________________________________________ >>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/HC... >>> >>> >>> -- >>> >>> Kaustav Majumder >>> >>> Associate Software Engineer >>> >>> Red Hat India PVT LTD. >>> >>> kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: 08981884037 IM: IRC: kmajumder >>> >>> TRIED. TESTED. TRUSTED. >>> @redhatway @redhatinc @redhatsnaps >>> >>> _______________________________________________ >>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/YJ... >>> > > -- > > Kaustav Majumder > > Associate Software Engineer > > Red Hat India PVT LTD. <https://www.redhat.com> > > kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: > 08981884037 <tel:08981884037> IM: IRC: kmajumder > > <https://red.ht/sig> > TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> > > @redhatway <https://twitter.com/redhatway> @redhatinc > <https://instagram.com/redhatinc> @redhatsnaps > <https://snapchat.com/add/redhatsnaps> > > > > > -- > Didi -- Kaustav Majumder Associate Software Engineer Red Hat India PVT LTD. <https://www.redhat.com> kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: 08981884037 <tel:08981884037> IM: IRC: kmajumder <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> @redhatway <https://twitter.com/redhatway> @redhatinc <https://instagram.com/redhatinc> @redhatsnaps <https://snapchat.com/add/redhatsnaps> -- Didi _______________________________________________ Devel mailing list -- devel(a)ovirt.org <mailto:devel@ovirt.org> To unsubscribe send an email to devel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/ZGNJMCI2QTL... -- GREG SHEREMETA SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX Red Hat NA <https://www.redhat.com/> gshereme(a)redhat.com <mailto:gshereme@redhat.com> IRC: gshereme <https://red.ht/sig>