[ovirt-devel] Re: Error adding host to ovirt-engine in local development environment

On Thu, Jul 12, 2018 at 2:22 PM, Kaustav Majumder <kmajumde(a)redhat.com <mailto:kmajumde@redhat.com>> wrote: Hi, I checked the symlinks and it was broken in mine too. I have manually changed them to point to python2.7. Did you try installing python2-ovirt-host-deploy? localhost in /usr/share/ovirt-host-deploy/interface-3/pythonlib ○ → ls -l total 4 lrwxrwxrwx. 1 root root 45 Jun 24 15:29 otopi -> ../../../../lib/python3.6/site-packages/otopi lrwxrwxrwx. 1 root root 60 Jul 12 16:34 ovirt_host_deploy -> ../../../../../lib/python2.7/site-packages/ovirt_host_deploy lrwxrwxrwx. 1 root root 58 Jul 12 16:34 ovirt_host_mgmt -> ../../../../../lib/python2.7/site-packages/ovirt_host_mgmt Now when I am trying to run bin/engine-setup. It is giving the following error bin/engine-setup ***L:ERROR Internal error: No module named 'M2Crypto' I do not follow. It worked for you in the past? What changed since then? Also tried the following: 1.install python3.6 . setup in alternatives 2. installed ovirt python 3.6 dependecies (otopi,ovirt_host_deploy,ovirt_host_mgmt) 3.Fixed symlinks 4. Tried running bin/engine-setup Giving the error as:  bin/engine-setup ***L:ERROR Internal error: No module named 'M2Crypto' On Thursday 12 July 2018 12:31 PM, Yedidyah Bar David wrote: > On Wed, Jul 11, 2018 at 4:54 PM, Kaustav Majumder&lt;kmajumde(a)redhat.com&gt; <mailto:kmajumde@redhat.com> wrote: >> Hi, >> >> I installed python2-otopi rpm in the host and then when I try to add host it gives the following error--> An error has occurred during installation of Host10.70.43.129 <http://10.70.43.129>;: Internal error: No module named ovirt_host_deploy. >> >> I am getting the same error when I manually copy the tar and run in the host. >> >> error log -->https://pastebin.com/4RYZd1js <https://pastebin.com/4RYZd1js> >> >> Am I missing some dependencies in my dev env? >> >> >> On Wednesday 11 July 2018 07:10 PM, Yuval Turgeman wrote: >> >> It looks like you don't have python3 installed, so otopi falls back to /bin/python which is python2, but the python2 otopi module is not installed - try to install the python2-otopi rpm and see if it works for you. > This should not be needed on the _host_. > > Perhaps you need them on the engine machine. Didn't check, but it > makes sense. Please try, on the engine machine: > > 1. Install all relevant python2 packages (otopi, ovirt-host-deploy, ?) > 2. rm /var/cache/ovirt-engine/ovirt-host-deploy.tar > 3. Then try to add the host > >> Thanks, >> Yuval. >> >> On Wed, Jul 11, 2018 at 4:13 PM, Kaustav Majumder&lt;kmajumde(a)redhat.com&gt; <mailto:kmajumde@redhat.com> wrote: >>> Hi, >>> >>> 'pythonlib' directory is empty.Is it something to do with that? > Yes, that's the problem. No idea why exactly, I still didn't try that > myself. Please check: > > ls -l /usr/share/ovirt-host-deploy/interface-3/pythonlib > > Both before and after installing python2 packages as suggested above. > > Now tried these on an fc28 machine, and I get: > > [pythonlib]# ls -l > total 0 > lrwxrwxrwx. 1 root root 45 Jun 24 12:59 otopi -> > ../../../../lib/python3.6/site-packages/otopi > lrwxrwxrwx. 1 root root 57 Jun 24 12:59 ovirt_host_deploy -> > ../../../../lib/python3.6/site-packages/ovirt_host_deploy > lrwxrwxrwx. 1 root root 55 Jun 24 12:59 ovirt_host_mgmt -> > ../../../../lib/python3.6/site-packages/ovirt_host_mgmt > > [pythonlib]# rpm -qf * > ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch > ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch > ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch > > Where the two latter links are dead. This is because I did only 'dnf > install ovirt-engine', which does not carry (for now) > python3-ovirt-host-deploy. > > It seems (mainly thinking out loud, also adding Yuval) that this is the process: > > 1. You install either py2 or py3 otopi+host-deploy on the engine (or both) > 2. The engine creates an otopi bundle: > 2.1. It copies the plugins from the common path/pkg, which is always installed. > 2.2. It copies the library files from the python lib of the python > that otopi chose to run, on the _engine_. If you have python3, it will > be python3 files. If 2, 2. In your case, you ran 3, but (perhaps?) > pythonlib is empty, need to check why. > 2.3. So the bundle contains python-version-specific files in > pythonlib, but this in theory should not be a big concern: > 3. Engine copies the bundle to the host, untars, and runs. > 4. If on the host otopi chooses a different python than the one used > to create the bundle, pythonlib will include wrong binary (.pyc/.pyo) > files (at least in wrong locations), but the text/source files should > still be available, if all goes well. > > Yuval - does this sound like the plan we (vaguely) had? > > (Kaustav - please "reply all" - it's much easier to follow a > conversation this way. Thanks) > > Also, perhaps open a bug about this. Still not sure what's the best > option. Some I can think of: > > 1. Just ignore this case. Assume that engine and host machines use > same python, and developers that want to test something else will need > to install the relevant other packages. > > 2. Make the engine require both py2 and py3 packages. Not sure this > makes much sense, need to think about it. We also need to continue > support the engine on el7, where we do not have py3 by default (and > probably do not want to install it). So perhaps do this only on > fedora. > > 3. Something else? E.g. check for any available python and use that? > That's not very easy for now, as the above links are packaged, meaning > created during building/packaging time, not run time, so then we still > do not know which python will actually be available. > >>> On Wednesday 11 July 2018 06:30 PM, Kaustav Majumder wrote: >>> >>> Hi, >>> >>> The output of sh -x otopi -->https://pastebin.com/WeeCJYdk >>> >>> tar in the attachment >>> >>> >>> On Wednesday 11 July 2018 06:14 PM, Yedidyah Bar David wrote: >>> >>> On Wed, Jul 11, 2018 at 10:21 AM, Kaustav Majumder&lt;kmajumde(a)redhat.com&gt; <mailto:kmajumde@redhat.com> wrote: >>>> Hi, >>>> >>>> Following are the versions >>>> >>>> otopi-1.8.0-0.0.master.20180704073752.git9eed7fe.fc28 >>>> >>>> ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >>>> python2-ovirt-host-deploy-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >>>> >>>> I copied the tar to the host and when I am trying to install its giving the following error >>>> >>>> [root@dhcp43-133 ~]# ./ovirt-host-deploy >>>> ***L:ERROR: Python is required but missing >>> Can you please try running, from the same directory on the host, 'sh -x otopi' ? >>> >>> Also, can you please share the bundle tar file? >>> >>> Thanks, >>> >>>> On Wednesday 11 July 2018 11:04 AM, Yedidyah Bar David wrote: >>>> >>>> On Tue, Jul 10, 2018 at 1:24 PM, Kaustav Majumder&lt;kmajumde(a)redhat.com&gt; <mailto:kmajumde@redhat.com> wrote: >>>>> Hi, >>>>> >>>>> I am trying to setup ovirt engine dev environment in my local Fedora 28 machine. >>>> Do you want to use fedora 28 specifically? Or just get a dev env working? If latter, it's currently easier to use el7. >>>> >>>>> I have followed this guide ->https://gerrit.ovirt.org/gitweb?p=ovirt-engine.git;a=blob_plain;f=README.adoc;hb=HEAD >>>>> <https://gerrit.ovirt.org/gitweb?p=ovirt-engine.git;a=blob_plain;f=README.... >>>>> >>>>> When I am trying to add a new host (Centos 7) ,it is failing with the following error. >>>>> >>>>> >>>>> [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host 10.70.43.157. Connected to host 10.70.43.157 with SSH key fingerprint: SHA256:rZfUGylVh3PLqfH2Siey0+CA9RUctK2ITQ2UGtV5ggA. >>>>> 2018-07-10 15:47:50,447+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Installation of 10.70.43.157. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar >>>>> 2018-07-10 15:47:50,447+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Tarball '/home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh >>>>> 2018-07-10 15:47:50,471+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH execute &#39;root(a)10.70.43.157 <mailto:root@10.70.43.157>' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' >>>>> 2018-07-10 15:47:50,676+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host10.70.43.157 <http://10.70.43.157>;: Python is required but missing. >>>>> 2018-07-10 15:47:50,685+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [35eb76d9] Error during deploy dialog >>>>> 2018-07-10 15:47:50,686+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH error running commandroot(a)10.70.43.157 <mailto:root@10.70.43.157>:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session &#39;root(a)10.70.43.157 <mailto:root@10.70.43.157>' >>>>> 2018-07-10 15:47:50,690+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 10.70.43.157 install >>>>> 2018-07-10 15:47:50,697+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host10.70.43.157 <http://10.70.43.157>;: Command returned failure code 1 during SSH session &#39;root(a)10.70.43.157 <mailto:root@10.70.43.157>'. >>>>> 2018-07-10 15:47:50,698+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 10.70.43.157 install, preferring first exception: Unexpected connection termination >>>>> 2018-07-10 15:47:50,698+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Host installation failed for host '3a52f700-a1d3-47b0-9518-f7f94231a874', '10.70.43.157': Unexpected connection termination >>>>> 2018-07-10 15:47:50,700+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] START, SetVdsStatusVDSCommand(HostName = 10.70.43.157, SetVdsStatusVDSCommandParameters:{hostId='3a52f700-a1d3-47b0-9518-f7f94231a874', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 48d6c653 >>>>> 2018-07-10 15:47:50,704+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] FINISH, SetVdsStatusVDSCommand, return: , log id: 48d6c653 >>>>> 2018-07-10 15:47:50,710+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: VDS_INSTALL_FAILED(505), Host 10.70.43.157 installation failed. Unexpected connection termination. >>>>> >>>>> >>>>> I have tried installing it several times and it has failed. >>>> Which versions of otopi and ovirt-host-deploy do you have? >>>> >>>> Can you install otopi on the host and run it? Does it work? >>>> >>>> You can also try copying and running the host-deploy bundle manually to the host. It's on the engine machine in /var/cache/ovirt-engine. Copy it to the host, untar in some directory, and run from inside it: >>>> >>>> $PWD/ovirt-host-deploy >>>> >>>> Best regards, >>>> -- >>>> Didi >>>> >>>> >>>> _______________________________________________ >>>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>>> <https://www.ovirt.org/site/privacy-policy/> >>>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>>> <https://www.ovirt.org/community/about/community-guidelines/> >>>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/2V... >>>> <https://lists.ovirt.org/archives/list/devel@ovirt.org/message/2VVLZDOWS32... >>>> >>>> >>>> -- >>>> >>>> Kaustav Majumder >>>> >>>> Associate Software Engineer >>>> >>>> Red Hat India PVT LTD. >>>> >>>> kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: 08981884037 IM: IRC: kmajumder >>>> >>>> TRIED. TESTED. TRUSTED. >>>> @redhatway @redhatinc @redhatsnaps >>>> >>>> _______________________________________________ >>>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>>> <https://www.ovirt.org/site/privacy-policy/> >>>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>>> <https://www.ovirt.org/community/about/community-guidelines/> >>>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/MM... >>>> <https://lists.ovirt.org/archives/list/devel@ovirt.org/message/MMMDGQ7Y6AW... >>>> >>> -- >>> Didi >>> >>> >>> _______________________________________________ >>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>> <https://www.ovirt.org/site/privacy-policy/> >>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>> <https://www.ovirt.org/community/about/community-guidelines/> >>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7R... >>> <https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7RAM4B3PUM2... >>> >>> >>> -- >>> >>> Kaustav Majumder >>> >>> Associate Software Engineer >>> >>> Red Hat India PVT LTD. >>> >>> kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: 08981884037 IM: IRC: kmajumder >>> >>> TRIED. TESTED. TRUSTED. >>> @redhatway @redhatinc @redhatsnaps >>> >>> >>> _______________________________________________ >>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>> <https://www.ovirt.org/site/privacy-policy/> >>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>> <https://www.ovirt.org/community/about/community-guidelines/> >>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/EZ... >>> <https://lists.ovirt.org/archives/list/devel@ovirt.org/message/EZXFRA5YKHY... >>> >>> >>> -- >>> >>> Kaustav Majumder >>> >>> Associate Software Engineer >>> >>> Red Hat India PVT LTD. >>> >>> kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: 08981884037 IM: IRC: kmajumder >>> >>> TRIED. TESTED. TRUSTED. >>> @redhatway @redhatinc @redhatsnaps >>> >>> _______________________________________________ >>> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >>> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >>> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >>> <https://www.ovirt.org/site/privacy-policy/> >>> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >>> <https://www.ovirt.org/community/about/community-guidelines/> >>> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/OP... >>> <https://lists.ovirt.org/archives/list/devel@ovirt.org/message/OPPX3VMACC5... >>> >> _______________________________________________ >> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >> <https://www.ovirt.org/site/privacy-policy/> >> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >> <https://www.ovirt.org/community/about/community-guidelines/> >> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/HC... >> <https://lists.ovirt.org/archives/list/devel@ovirt.org/message/HCXHSJBQ6QB... >> >> >> -- >> >> Kaustav Majumder >> >> Associate Software Engineer >> >> Red Hat India PVT LTD. >> >> kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: 08981884037 IM: IRC: kmajumder >> >> TRIED. TESTED. TRUSTED. >> @redhatway @redhatinc @redhatsnaps >> >> _______________________________________________ >> Devel mailing list --devel(a)ovirt.org <mailto:devel@ovirt.org> >> To unsubscribe send an email todevel-leave(a)ovirt.org <mailto:devel-leave@ovirt.org> >> Privacy Statement:https://www.ovirt.org/site/privacy-policy/ >> <https://www.ovirt.org/site/privacy-policy/> >> oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ >> <https://www.ovirt.org/community/about/community-guidelines/> >> List Archives:https://lists.ovirt.org/archives/list/devel@ovirt.org/message/YJ... >> <https://lists.ovirt.org/archives/list/devel@ovirt.org/message/YJ6DYKVBJ43... >> -- Kaustav Majumder Associate Software Engineer Red Hat India PVT LTD. <https://www.redhat.com> kmajumder(a)redhat.com <mailto:kmajumder@redhat.com> M: 08981884037 <tel:08981884037> IM: IRC: kmajumder <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> @redhatway <https://twitter.com/redhatway> @redhatinc <https://instagram.com/redhatinc> @redhatsnaps <https://snapchat.com/add/redhatsnaps> -- Didi