[ovirt-devel] Re: Error adding host to ovirt-engine in local development environment

On Thu, Jul 12, 2018 at 3:26 PM, Kaustav Majumder <kmajumde(a)redhat.com&gt; wrote: > Hi, > > I installed python2-ovirt-host-deploy too but its the same error. Will > install clean f27 on my system and try on that. > If it's because you are interested in re-adding fedora/dnf/python3 support, then fine, thanks! Gal is currently working on that, also Yuval and me a bit. If you just want to get something working, it's easier to use el7 for now. > > On Thursday 12 July 2018 05:51 PM, Yedidyah Bar David wrote: > > On Thu, Jul 12, 2018 at 2:22 PM, Kaustav Majumder <kmajumde(a)redhat.com&gt; > wrote: > >> Hi, >> >> I checked the symlinks and it was broken in mine too. I have manually >> changed them to point to python2.7. >> > > Did you try installing python2-ovirt-host-deploy? > > >> localhost in /usr/share/ovirt-host-deploy/interface-3/pythonlib ○ → ls -l >> total 4 >> lrwxrwxrwx. 1 root root 45 Jun 24 15:29 otopi -> >> ../../../../lib/python3.6/site-packages/otopi >> lrwxrwxrwx. 1 root root 60 Jul 12 16:34 ovirt_host_deploy -> >> ../../../../../lib/python2.7/site-packages/ovirt_host_deploy >> lrwxrwxrwx. 1 root root 58 Jul 12 16:34 ovirt_host_mgmt -> >> ../../../../../lib/python2.7/site-packages/ovirt_host_mgmt >> >> Now when I am trying to run bin/engine-setup. It is giving the following >> error >> >> bin/engine-setup >> ***L:ERROR Internal error: No module named 'M2Crypto' >> > > I do not follow. It worked for you in the past? What changed since then? > > >> Also tried the following: >> >> 1.install python3.6 . setup in alternatives >> >> 2. installed ovirt python 3.6 dependecies >> (otopi,ovirt_host_deploy,ovirt_host_mgmt) >> >> 3.Fixed symlinks >> >> 4. Tried running bin/engine-setup >> >> Giving the error as: >> >> bin/engine-setup >> ***L:ERROR Internal error: No module named 'M2Crypto' >> >> >> >> >> >> On Thursday 12 July 2018 12:31 PM, Yedidyah Bar David wrote: >> >> On Wed, Jul 11, 2018 at 4:54 PM, Kaustav Majumder <kmajumde(a)redhat.com&gt; <kmajumde(a)redhat.com&gt; wrote: >> >> Hi, >> >> I installed python2-otopi rpm in the host and then when I try to add host it gives the following error--> An error has occurred during installation of Host 10.70.43.129: Internal error: No module named ovirt_host_deploy. >> >> I am getting the same error when I manually copy the tar and run in the host. >> >> error log -->https://pastebin.com/4RYZd1js >> >> Am I missing some dependencies in my dev env? >> >> >> On Wednesday 11 July 2018 07:10 PM, Yuval Turgeman wrote: >> >> It looks like you don't have python3 installed, so otopi falls back to /bin/python which is python2, but the python2 otopi module is not installed - try to install the python2-otopi rpm and see if it works for you. >> >> This should not be needed on the _host_. >> >> Perhaps you need them on the engine machine. Didn't check, but it >> makes sense. Please try, on the engine machine: >> >> 1. Install all relevant python2 packages (otopi, ovirt-host-deploy, ?) >> 2. rm /var/cache/ovirt-engine/ovirt-host-deploy.tar >> 3. Then try to add the host >> >> >> Thanks, >> Yuval. >> >> On Wed, Jul 11, 2018 at 4:13 PM, Kaustav Majumder <kmajumde(a)redhat.com&gt; <kmajumde(a)redhat.com&gt; wrote: >> >> Hi, >> >> 'pythonlib' directory is empty.Is it something to do with that? >> >> Yes, that's the problem. No idea why exactly, I still didn't try that >> myself. Please check: >> >> ls -l /usr/share/ovirt-host-deploy/interface-3/pythonlib >> >> Both before and after installing python2 packages as suggested above. >> >> Now tried these on an fc28 machine, and I get: >> >> [pythonlib]# ls -l >> total 0 >> lrwxrwxrwx. 1 root root 45 Jun 24 12:59 otopi -> >> ../../../../lib/python3.6/site-packages/otopi >> lrwxrwxrwx. 1 root root 57 Jun 24 12:59 ovirt_host_deploy -> >> ../../../../lib/python3.6/site-packages/ovirt_host_deploy >> lrwxrwxrwx. 1 root root 55 Jun 24 12:59 ovirt_host_mgmt -> >> ../../../../lib/python3.6/site-packages/ovirt_host_mgmt >> >> [pythonlib]# rpm -qf * >> ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >> ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >> ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >> >> Where the two latter links are dead. This is because I did only 'dnf >> install ovirt-engine', which does not carry (for now) >> python3-ovirt-host-deploy. >> >> It seems (mainly thinking out loud, also adding Yuval) that this is the process: >> >> 1. You install either py2 or py3 otopi+host-deploy on the engine (or both) >> 2. The engine creates an otopi bundle: >> 2.1. It copies the plugins from the common path/pkg, which is always installed. >> 2.2. It copies the library files from the python lib of the python >> that otopi chose to run, on the _engine_. If you have python3, it will >> be python3 files. If 2, 2. In your case, you ran 3, but (perhaps?) >> pythonlib is empty, need to check why. >> 2.3. So the bundle contains python-version-specific files in >> pythonlib, but this in theory should not be a big concern: >> 3. Engine copies the bundle to the host, untars, and runs. >> 4. If on the host otopi chooses a different python than the one used >> to create the bundle, pythonlib will include wrong binary (.pyc/.pyo) >> files (at least in wrong locations), but the text/source files should >> still be available, if all goes well. >> >> Yuval - does this sound like the plan we (vaguely) had? >> >> (Kaustav - please "reply all" - it's much easier to follow a >> conversation this way. Thanks) >> >> Also, perhaps open a bug about this. Still not sure what's the best >> option. Some I can think of: >> >> 1. Just ignore this case. Assume that engine and host machines use >> same python, and developers that want to test something else will need >> to install the relevant other packages. >> >> 2. Make the engine require both py2 and py3 packages. Not sure this >> makes much sense, need to think about it. We also need to continue >> support the engine on el7, where we do not have py3 by default (and >> probably do not want to install it). So perhaps do this only on >> fedora. >> >> 3. Something else? E.g. check for any available python and use that? >> That's not very easy for now, as the above links are packaged, meaning >> created during building/packaging time, not run time, so then we still >> do not know which python will actually be available. >> >> >> On Wednesday 11 July 2018 06:30 PM, Kaustav Majumder wrote: >> >> Hi, >> >> The output of sh -x otopi --> https://pastebin.com/WeeCJYdk >> >> tar in the attachment >> >> >> On Wednesday 11 July 2018 06:14 PM, Yedidyah Bar David wrote: >> >> On Wed, Jul 11, 2018 at 10:21 AM, Kaustav Majumder <kmajumde(a)redhat.com&gt; <kmajumde(a)redhat.com&gt; wrote: >> >> Hi, >> >> Following are the versions >> >> otopi-1.8.0-0.0.master.20180704073752.git9eed7fe.fc28 >> >> ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >> python2-ovirt-host-deploy-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >> >> I copied the tar to the host and when I am trying to install its giving the following error >> >> [root@dhcp43-133 ~]# ./ovirt-host-deploy >> ***L:ERROR: Python is required but missing >> >> Can you please try running, from the same directory on the host, 'sh -x otopi' ? >> >> Also, can you please share the bundle tar file? >> >> Thanks, >> >> >> On Wednesday 11 July 2018 11:04 AM, Yedidyah Bar David wrote: >> >> On Tue, Jul 10, 2018 at 1:24 PM, Kaustav Majumder <kmajumde(a)redhat.com&gt; <kmajumde(a)redhat.com&gt; wrote: >> >> Hi, >> >> I am trying to setup ovirt engine dev environment in my local Fedora 28 machine. >> >> Do you want to use fedora 28 specifically? Or just get a dev env working? If latter, it's currently easier to use el7. >> >> >> I have followed this guide -> https://gerrit.ovirt.org/gitweb?p=ovirt-engine.git;a=blob_plain;f=README.... >> >> When I am trying to add a new host (Centos 7) ,it is failing with the following error. >> >> >> [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host 10.70.43.157. Connected to host 10.70.43.157 with SSH key fingerprint: SHA256:rZfUGylVh3PLqfH2Siey0+CA9RUctK2ITQ2UGtV5ggA. >> 2018-07-10 15:47:50,447+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Installation of 10.70.43.157. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar >> 2018-07-10 15:47:50,447+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Tarball '/home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh >> 2018-07-10 15:47:50,471+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH execute &#39;root(a)10.70.43.157&#39; 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' >> 2018-07-10 15:47:50,676+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host 10.70.43.157: Python is required but missing. >> 2018-07-10 15:47:50,685+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [35eb76d9] Error during deploy dialog >> 2018-07-10 15:47:50,686+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH error running command root@10.70.43.157:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session &#39;root(a)10.70.43.157&#39; >> 2018-07-10 15:47:50,690+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 10.70.43.157 install >> 2018-07-10 15:47:50,697+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host 10.70.43.157: Command returned failure code 1 during SSH session &#39;root(a)10.70.43.157&#39;. >> 2018-07-10 15:47:50,698+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 10.70.43.157 install, preferring first exception: Unexpected connection termination >> 2018-07-10 15:47:50,698+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Host installation failed for host '3a52f700-a1d3-47b0-9518-f7f94231a874', '10.70.43.157': Unexpected connection termination >> 2018-07-10 15:47:50,700+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] START, SetVdsStatusVDSCommand(HostName = 10.70.43.157, SetVdsStatusVDSCommandParameters:{hostId='3a52f700-a1d3-47b0-9518-f7f94231a874', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 48d6c653 >> 2018-07-10 15:47:50,704+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] FINISH, SetVdsStatusVDSCommand, return: , log id: 48d6c653 >> 2018-07-10 15:47:50,710+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: VDS_INSTALL_FAILED(505), Host 10.70.43.157 installation failed. Unexpected connection termination. >> >> >> I have tried installing it several times and it has failed. >> >> Which versions of otopi and ovirt-host-deploy do you have? >> >> Can you install otopi on the host and run it? Does it work? >> >> You can also try copying and running the host-deploy bundle manually to the host. It's on the engine machine in /var/cache/ovirt-engine. Copy it to the host, untar in some directory, and run from inside it: >> >> $PWD/ovirt-host-deploy >> >> Best regards, >> -- >> Didi >> >> >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/2VVLZDOWS32... >> >> >> -- >> >> Kaustav Majumder >> >> Associate Software Engineer >> >> Red Hat India PVT LTD. >> kmajumder(a)redhat.com M: 08981884037 IM: IRC: kmajumder >> >> TRIED. TESTED. TRUSTED. >> @redhatway @redhatinc @redhatsnaps >> >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/MMMDGQ7Y6AW... >> >> -- >> Didi >> >> >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7RAM4B3PUM2... >> >> >> -- >> >> Kaustav Majumder >> >> Associate Software Engineer >> >> Red Hat India PVT LTD. >> kmajumder(a)redhat.com M: 08981884037 IM: IRC: kmajumder >> >> TRIED. TESTED. TRUSTED. >> @redhatway @redhatinc @redhatsnaps >> >> >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/EZXFRA5YKHY... >> >> >> -- >> >> Kaustav Majumder >> >> Associate Software Engineer >> >> Red Hat India PVT LTD. >> kmajumder(a)redhat.com M: 08981884037 IM: IRC: kmajumder >> >> TRIED. TESTED. TRUSTED. >> @redhatway @redhatinc @redhatsnaps >> >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/OPPX3VMACC5... >> >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/HCXHSJBQ6QB... >> >> >> -- >> >> Kaustav Majumder >> >> Associate Software Engineer >> >> Red Hat India PVT LTD. >> kmajumder(a)redhat.com M: 08981884037 IM: IRC: kmajumder >> >> TRIED. TESTED. TRUSTED. >> @redhatway @redhatinc @redhatsnaps >> >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/YJ6DYKVBJ43... >> >> >> -- >> >> Kaustav Majumder >> >> Associate Software Engineer >> >> Red Hat India PVT LTD. <https://www.redhat.com> >> >> kmajumder(a)redhat.com M: 08981884037 IM: IRC: kmajumder >> <https://red.ht/sig> >> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> >> @redhatway <https://twitter.com/redhatway> @redhatinc >> <https://instagram.com/redhatinc> @redhatsnaps >> <https://snapchat.com/add/redhatsnaps> >> > > > > -- > Didi > > > -- > > Kaustav Majumder > > Associate Software Engineer > > Red Hat India PVT LTD. <https://www.redhat.com> > > kmajumder(a)redhat.com M: 08981884037 IM: IRC: kmajumder > <https://red.ht/sig> > TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> > @redhatway <https://twitter.com/redhatway> @redhatinc > <https://instagram.com/redhatinc> @redhatsnaps > <https://snapchat.com/add/redhatsnaps> > -- Didi _______________________________________________ Devel mailing list -- devel(a)ovirt.org To unsubscribe send an email to devel-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/ZGNJMCI2QTL...