[ovirt-devel] Re: Error adding host to ovirt-engine in local development environment

On Wed, Jul 11, 2018 at 4:54 PM, Kaustav Majumder <kmajumde(a)redhat.com&gt; wrote: > Hi, > > I installed python2-otopi rpm in the host and then when I try to add host it gives the following error--> An error has occurred during installation of Host 10.70.43.129: Internal error: No module named ovirt_host_deploy. > > I am getting the same error when I manually copy the tar and run in the host. > > error log -->https://pastebin.com/4RYZd1js > > Am I missing some dependencies in my dev env? > > > On Wednesday 11 July 2018 07:10 PM, Yuval Turgeman wrote: > > It looks like you don't have python3 installed, so otopi falls back to /bin/python which is python2, but the python2 otopi module is not installed - try to install the python2-otopi rpm and see if it works for you. This should not be needed on the _host_. Perhaps you need them on the engine machine. Didn't check, but it makes sense. Please try, on the engine machine: 1. Install all relevant python2 packages (otopi, ovirt-host-deploy, ?) 2. rm /var/cache/ovirt-engine/ovirt-host-deploy.tar 3. Then try to add the host > > Thanks, > Yuval. > > On Wed, Jul 11, 2018 at 4:13 PM, Kaustav Majumder <kmajumde(a)redhat.com&gt; wrote: >> Hi, >> >> 'pythonlib' directory is empty.Is it something to do with that? Yes, that's the problem. No idea why exactly, I still didn't try that myself. Please check: ls -l /usr/share/ovirt-host-deploy/interface-3/pythonlib Both before and after installing python2 packages as suggested above. Now tried these on an fc28 machine, and I get: [pythonlib]# ls -l total 0 lrwxrwxrwx. 1 root root 45 Jun 24 12:59 otopi -> ../../../../lib/python3.6/site-packages/otopi lrwxrwxrwx. 1 root root 57 Jun 24 12:59 ovirt_host_deploy -> ../../../../lib/python3.6/site-packages/ovirt_host_deploy lrwxrwxrwx. 1 root root 55 Jun 24 12:59 ovirt_host_mgmt -> ../../../../lib/python3.6/site-packages/ovirt_host_mgmt [pythonlib]# rpm -qf * ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch Where the two latter links are dead. This is because I did only 'dnf install ovirt-engine', which does not carry (for now) python3-ovirt-host-deploy. It seems (mainly thinking out loud, also adding Yuval) that this is the process: 1. You install either py2 or py3 otopi+host-deploy on the engine (or both) 2. The engine creates an otopi bundle: 2.1. It copies the plugins from the common path/pkg, which is always installed. 2.2. It copies the library files from the python lib of the python that otopi chose to run, on the _engine_. If you have python3, it will be python3 files. If 2, 2. In your case, you ran 3, but (perhaps?) pythonlib is empty, need to check why. 2.3. So the bundle contains python-version-specific files in pythonlib, but this in theory should not be a big concern: 3. Engine copies the bundle to the host, untars, and runs. 4. If on the host otopi chooses a different python than the one used to create the bundle, pythonlib will include wrong binary (.pyc/.pyo) files (at least in wrong locations), but the text/source files should still be available, if all goes well. Yuval - does this sound like the plan we (vaguely) had? (Kaustav - please "reply all" - it's much easier to follow a conversation this way. Thanks) Also, perhaps open a bug about this. Still not sure what's the best option. Some I can think of: 1. Just ignore this case. Assume that engine and host machines use same python, and developers that want to test something else will need to install the relevant other packages. 2. Make the engine require both py2 and py3 packages. Not sure this makes much sense, need to think about it. We also need to continue support the engine on el7, where we do not have py3 by default (and probably do not want to install it). So perhaps do this only on fedora. 3. Something else? E.g. check for any available python and use that? That's not very easy for now, as the above links are packaged, meaning created during building/packaging time, not run time, so then we still do not know which python will actually be available. >> >> On Wednesday 11 July 2018 06:30 PM, Kaustav Majumder wrote: >> >> Hi, >> >> The output of sh -x otopi --> https://pastebin.com/WeeCJYdk >> >> tar in the attachment >> >> >> On Wednesday 11 July 2018 06:14 PM, Yedidyah Bar David wrote: >> >> On Wed, Jul 11, 2018 at 10:21 AM, Kaustav Majumder <kmajumde(a)redhat.com&gt; wrote: >>> Hi, >>> >>> Following are the versions >>> >>> otopi-1.8.0-0.0.master.20180704073752.git9eed7fe.fc28 >>> >>> ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >>> python2-ovirt-host-deploy-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch >>> >>> I copied the tar to the host and when I am trying to install its giving the following error >>> >>> [root@dhcp43-133 ~]# ./ovirt-host-deploy >>> ***L:ERROR: Python is required but missing >> >> Can you please try running, from the same directory on the host, 'sh -x otopi' ? >> >> Also, can you please share the bundle tar file? >> >> Thanks, >> >>> >>> >>> >>> >>> On Wednesday 11 July 2018 11:04 AM, Yedidyah Bar David wrote: >>> >>> On Tue, Jul 10, 2018 at 1:24 PM, Kaustav Majumder <kmajumde(a)redhat.com&gt; wrote: >>>> Hi, >>>> >>>> I am trying to setup ovirt engine dev environment in my local Fedora 28 machine. >>> >>> Do you want to use fedora 28 specifically? Or just get a dev env working? If latter, it's currently easier to use el7. >>> >>>> I have followed this guide -> https://gerrit.ovirt.org/gitweb?p=ovirt-engine.git;a=blob_plain;f=README.... >>>> >>>> When I am trying to add a new host (Centos 7) ,it is failing with the following error. >>>> >>>> >>>> [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host 10.70.43.157. Connected to host 10.70.43.157 with SSH key fingerprint: SHA256:rZfUGylVh3PLqfH2Siey0+CA9RUctK2ITQ2UGtV5ggA. >>>> 2018-07-10 15:47:50,447+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Installation of 10.70.43.157. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar >>>> 2018-07-10 15:47:50,447+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Tarball '/home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh >>>> 2018-07-10 15:47:50,471+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH execute &#39;root(a)10.70.43.157&#39; 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' >>>> 2018-07-10 15:47:50,676+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host 10.70.43.157: Python is required but missing. >>>> 2018-07-10 15:47:50,685+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [35eb76d9] Error during deploy dialog >>>> 2018-07-10 15:47:50,686+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH error running command root@10.70.43.157:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session &#39;root(a)10.70.43.157&#39; >>>> 2018-07-10 15:47:50,690+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 10.70.43.157 install >>>> 2018-07-10 15:47:50,697+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host 10.70.43.157: Command returned failure code 1 during SSH session &#39;root(a)10.70.43.157&#39;. >>>> 2018-07-10 15:47:50,698+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 10.70.43.157 install, preferring first exception: Unexpected connection termination >>>> 2018-07-10 15:47:50,698+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Host installation failed for host '3a52f700-a1d3-47b0-9518-f7f94231a874', '10.70.43.157': Unexpected connection termination >>>> 2018-07-10 15:47:50,700+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] START, SetVdsStatusVDSCommand(HostName = 10.70.43.157, SetVdsStatusVDSCommandParameters:{hostId='3a52f700-a1d3-47b0-9518-f7f94231a874', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 48d6c653 >>>> 2018-07-10 15:47:50,704+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] FINISH, SetVdsStatusVDSCommand, return: , log id: 48d6c653 >>>> 2018-07-10 15:47:50,710+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: VDS_INSTALL_FAILED(505), Host 10.70.43.157 installation failed. Unexpected connection termination. >>>> >>>> >>>> I have tried installing it several times and it has failed. >>> >>> Which versions of otopi and ovirt-host-deploy do you have? >>> >>> Can you install otopi on the host and run it? Does it work? >>> >>> You can also try copying and running the host-deploy bundle manually to the host. It's on the engine machine in /var/cache/ovirt-engine. Copy it to the host, untar in some directory, and run from inside it: >>> >>> $PWD/ovirt-host-deploy >>> >>> Best regards, >>> -- >>> Didi >>> >>> >>> _______________________________________________ >>> Devel mailing list -- devel(a)ovirt.org >>> To unsubscribe send an email to devel-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/2VVLZDOWS32... >>> >>> >>> -- >>> >>> Kaustav Majumder >>> >>> Associate Software Engineer >>> >>> Red Hat India PVT LTD. >>> >>> kmajumder(a)redhat.com M: 08981884037 IM: IRC: kmajumder >>> >>> TRIED. TESTED. TRUSTED. >>> @redhatway @redhatinc @redhatsnaps >>> >>> _______________________________________________ >>> Devel mailing list -- devel(a)ovirt.org >>> To unsubscribe send an email to devel-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/MMMDGQ7Y6AW... >>> >> >> >> -- >> Didi >> >> >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7RAM4B3PUM2... >> >> >> -- >> >> Kaustav Majumder >> >> Associate Software Engineer >> >> Red Hat India PVT LTD. >> >> kmajumder(a)redhat.com M: 08981884037 IM: IRC: kmajumder >> >> TRIED. TESTED. TRUSTED. >> @redhatway @redhatinc @redhatsnaps >> >> >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/EZXFRA5YKHY... >> >> >> -- >> >> Kaustav Majumder >> >> Associate Software Engineer >> >> Red Hat India PVT LTD. >> >> kmajumder(a)redhat.com M: 08981884037 IM: IRC: kmajumder >> >> TRIED. TESTED. TRUSTED. >> @redhatway @redhatinc @redhatsnaps >> >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/OPPX3VMACC5... >> > > > _______________________________________________ > Devel mailing list -- devel(a)ovirt.org > To unsubscribe send an email to devel-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/HCXHSJBQ6QB... > > > -- > > Kaustav Majumder > > Associate Software Engineer > > Red Hat India PVT LTD. > > kmajumder(a)redhat.com M: 08981884037 IM: IRC: kmajumder > > TRIED. TESTED. TRUSTED. > @redhatway @redhatinc @redhatsnaps > > _______________________________________________ > Devel mailing list -- devel(a)ovirt.org > To unsubscribe send an email to devel-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/YJ6DYKVBJ43... >