On Fri, Jul 13, 2018, 6:45 AM Kaustav Majumder <kmajumde@redhat.com> wrote:

Hi,

Thanks for the script. Setting dev environment works fine. But were you able to add hosts to it?

On Friday 13 July 2018 03:26 AM, Greg Sheremeta wrote:

Forgive me for being slightly off topic -- I made an ansible role to setup an engine dev environment. It works for me with the fc28 --> el7 setup (well, as of a few weeks ago).

https://github.com/gregsheremeta/ovirt-engine-devel

It installs all the dependencies for you. Hope it helps. My goal was to get some community interest / help in maintaining a shared stand-up script / role.

Best wishes,

Greg

On Thu, Jul 12, 2018 at 8:34 AM Yedidyah Bar David <didi@redhat.com> wrote:

On Thu, Jul 12, 2018 at 3:26 PM, Kaustav Majumder <kmajumde@redhat.com> wrote:

Hi,

I installed python2-ovirt-host-deploy too but its the same error. Will install clean f27 on my system and try on that.

If it's because you are interested in re-adding fedora/dnf/python3 support, then fine, thanks! Gal is currently working on that, also Yuval and me a bit.

If you just want to get something working, it's easier to use el7 for now.

On Thursday 12 July 2018 05:51 PM, Yedidyah Bar David wrote:

On Thu, Jul 12, 2018 at 2:22 PM, Kaustav Majumder <kmajumde@redhat.com> wrote:

Hi,

I checked the symlinks and it was broken in mine too. I have manually changed them to point to python2.7.

Did you try installing python2-ovirt-host-deploy?

localhost in /usr/share/ovirt-host-deploy/interface-3/pythonlib ○ → ls -l
total 4
lrwxrwxrwx. 1 root root 45 Jun 24 15:29 otopi -> ../../../../lib/python3.6/site-packages/otopi
lrwxrwxrwx. 1 root root 60 Jul 12 16:34 ovirt_host_deploy -> ../../../../../lib/python2.7/site-packages/ovirt_host_deploy
lrwxrwxrwx. 1 root root 58 Jul 12 16:34 ovirt_host_mgmt -> ../../../../../lib/python2.7/site-packages/ovirt_host_mgmt

Now when I am trying to run bin/engine-setup. It is giving the following error

bin/engine-setup
***L:ERROR Internal error: No module named 'M2Crypto'

I do not follow. It worked for you in the past? What changed since then?

Also tried the following:

1.install python3.6 . setup in alternatives

2. installed ovirt python 3.6 dependecies (otopi,ovirt_host_deploy,ovirt_host_mgmt)

3.Fixed symlinks

4. Tried running bin/engine-setup

Giving the error as:

bin/engine-setup
***L:ERROR Internal error: No module named 'M2Crypto'

On Thursday 12 July 2018 12:31 PM, Yedidyah Bar David wrote:

On Wed, Jul 11, 2018 at 4:54 PM, Kaustav Majumder <kmajumde@redhat.com> wrote:

Hi,

I installed python2-otopi rpm in the host and then when I try to add host it gives the following error--> An error has occurred during installation of Host 10.70.43.129: Internal error: No module named ovirt_host_deploy.

I  am getting the same error when I manually copy the tar and run in the host.

error log -->https://pastebin.com/4RYZd1js

Am I missing some dependencies in my dev env?


On Wednesday 11 July 2018 07:10 PM, Yuval Turgeman wrote:

It looks like you don't have python3 installed, so otopi falls back to /bin/python which is python2, but the python2 otopi module is not installed - try to install the python2-otopi rpm and see if it works for you.

This should not be needed on the _host_.

Perhaps you need them on the engine machine. Didn't check, but it
makes sense. Please try, on the engine machine:

1. Install all relevant python2 packages (otopi, ovirt-host-deploy, ?)
2. rm /var/cache/ovirt-engine/ovirt-host-deploy.tar
3. Then try to add the host

Thanks,
Yuval.

On Wed, Jul 11, 2018 at 4:13 PM, Kaustav Majumder <kmajumde@redhat.com> wrote:

Hi,

'pythonlib' directory is empty.Is it something to do with that?

Yes, that's the problem. No idea why exactly, I still didn't try that
myself. Please check:

ls -l /usr/share/ovirt-host-deploy/interface-3/pythonlib

Both before and after installing python2 packages as suggested above.

Now tried these on an fc28 machine, and I get:

[pythonlib]# ls -l
total 0
lrwxrwxrwx. 1 root root 45 Jun 24 12:59 otopi ->
../../../../lib/python3.6/site-packages/otopi
lrwxrwxrwx. 1 root root 57 Jun 24 12:59 ovirt_host_deploy ->
../../../../lib/python3.6/site-packages/ovirt_host_deploy
lrwxrwxrwx. 1 root root 55 Jun 24 12:59 ovirt_host_mgmt ->
../../../../lib/python3.6/site-packages/ovirt_host_mgmt

[pythonlib]# rpm -qf *
ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch
ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch
ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch

Where the two latter links are dead. This is because I did only 'dnf
install ovirt-engine', which does not carry (for now)
python3-ovirt-host-deploy.

It seems (mainly thinking out loud, also adding Yuval) that this is the process:

1. You install either py2 or py3 otopi+host-deploy on the engine (or both)
2. The engine creates an otopi bundle:
2.1. It copies the plugins from the common path/pkg, which is always installed.
2.2. It copies the library files from the python lib of the python
that otopi chose to run, on the _engine_. If you have python3, it will
be python3 files. If 2, 2. In your case, you ran 3, but (perhaps?)
pythonlib is empty, need to check why.
2.3. So the bundle contains python-version-specific files in
pythonlib, but this in theory should not be a big concern:
3. Engine copies the bundle to the host, untars, and runs.
4. If on the host otopi chooses a different python than the one used
to create the bundle, pythonlib will include wrong binary (.pyc/.pyo)
files (at least in wrong locations), but the text/source files should
still be available, if all goes well.

Yuval - does this sound like the plan we (vaguely) had?

(Kaustav - please "reply all" - it's much easier to follow a
conversation this way. Thanks)

Also, perhaps open a bug about this. Still not sure what's the best
option. Some I can think of:

1. Just ignore this case. Assume that engine and host machines use
same python, and developers that want to test something else will need
to install the relevant other packages.

2. Make the engine require both py2 and py3 packages. Not sure this
makes much sense, need to think about it. We also need to continue
support the engine on el7, where we do not have py3 by default (and
probably do not want to install it). So perhaps do this only on
fedora.

3. Something else? E.g. check for any available python and use that?
That's not very easy for now, as the above links are packaged, meaning
created during building/packaging time, not run time, so then we still
do not know which python will actually be available.

On Wednesday 11 July 2018 06:30 PM, Kaustav Majumder wrote:

Hi,

The output of sh -x otopi --> https://pastebin.com/WeeCJYdk

tar in the attachment


On Wednesday 11 July 2018 06:14 PM, Yedidyah Bar David wrote:

On Wed, Jul 11, 2018 at 10:21 AM, Kaustav Majumder <kmajumde@redhat.com> wrote:

Hi,

Following are the versions

otopi-1.8.0-0.0.master.20180704073752.git9eed7fe.fc28

ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch
python2-ovirt-host-deploy-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch

I copied the tar to the  host  and when I am trying to install its giving the following error

[root@dhcp43-133 ~]# ./ovirt-host-deploy
***L:ERROR: Python is required but missing

Can you please try running, from the same directory on the host, 'sh -x otopi' ?

Also, can you please share the bundle tar file?

Thanks,

On Wednesday 11 July 2018 11:04 AM, Yedidyah Bar David wrote:

On Tue, Jul 10, 2018 at 1:24 PM, Kaustav Majumder <kmajumde@redhat.com> wrote:

Hi,

I am trying to setup ovirt engine dev environment in my local Fedora 28 machine.

Do you want to use fedora 28 specifically? Or just get a dev env working? If latter, it's currently easier to use el7.

I have followed this guide -> https://gerrit.ovirt.org/gitweb?p=ovirt-engine.git;a=blob_plain;f=README.adoc;hb=HEAD

When I am trying to add a new host (Centos 7) ,it is failing with the following error.


[35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host 10.70.43.157. Connected to host 10.70.43.157 with SSH key fingerprint: SHA256:rZfUGylVh3PLqfH2Siey0+CA9RUctK2ITQ2UGtV5ggA.
2018-07-10 15:47:50,447+05 INFO  [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Installation of 10.70.43.157. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x &&  "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar
2018-07-10 15:47:50,447+05 INFO  [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Tarball '/home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh
2018-07-10 15:47:50,471+05 INFO  [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH execute 'root@10.70.43.157' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x &&  "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True'
2018-07-10 15:47:50,676+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host 10.70.43.157: Python is required but missing.
2018-07-10 15:47:50,685+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [35eb76d9] Error during deploy dialog
2018-07-10 15:47:50,686+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH error running command root@10.70.43.157:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x &&  "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@10.70.43.157'
2018-07-10 15:47:50,690+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 10.70.43.157 install
2018-07-10 15:47:50,697+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host 10.70.43.157: Command returned failure code 1 during SSH session 'root@10.70.43.157'.
2018-07-10 15:47:50,698+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 10.70.43.157 install, preferring first exception: Unexpected connection termination
2018-07-10 15:47:50,698+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Host installation failed for host '3a52f700-a1d3-47b0-9518-f7f94231a874', '10.70.43.157': Unexpected connection termination
2018-07-10 15:47:50,700+05 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] START, SetVdsStatusVDSCommand(HostName = 10.70.43.157, SetVdsStatusVDSCommandParameters:{hostId='3a52f700-a1d3-47b0-9518-f7f94231a874', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 48d6c653
2018-07-10 15:47:50,704+05 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] FINISH, SetVdsStatusVDSCommand, return: , log id: 48d6c653
2018-07-10 15:47:50,710+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: VDS_INSTALL_FAILED(505), Host 10.70.43.157 installation failed. Unexpected connection termination.


I have tried installing it several times and it has failed.

Which versions of otopi and ovirt-host-deploy do you have?

Can you install otopi on the host and run it? Does it work?

You can also try copying and running the host-deploy bundle manually to the host. It's on the engine machine in /var/cache/ovirt-engine. Copy it to the host, untar in some directory, and run from inside it:

$PWD/ovirt-host-deploy

Best regards,
--
Didi


_______________________________________________
Devel mailing list -- devel@ovirt.org
To unsubscribe send an email to devel-leave@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/2VVLZDOWS32H7IP5JQBJZCUTABWTKZOC/


--

Kaustav Majumder

Associate Software Engineer

Red Hat India PVT LTD.

kmajumder@redhat.com    M: 08981884037     IM: IRC: kmajumder

TRIED. TESTED. TRUSTED.
@redhatway   @redhatinc   @redhatsnaps

_______________________________________________
Devel mailing list -- devel@ovirt.org
To unsubscribe send an email to devel-leave@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/MMMDGQ7Y6AWR2D7WCWQ4I66O5R5N5KSA/

--
Didi


_______________________________________________
Devel mailing list -- devel@ovirt.org
To unsubscribe send an email to devel-leave@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7RAM4B3PUM2SD27EZCLJMKKS3UPO7JXZ/


--

Kaustav Majumder

Associate Software Engineer

Red Hat India PVT LTD.

kmajumder@redhat.com    M: 08981884037     IM: IRC: kmajumder

TRIED. TESTED. TRUSTED.
@redhatway   @redhatinc   @redhatsnaps


_______________________________________________
Devel mailing list -- devel@ovirt.org
To unsubscribe send an email to devel-leave@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/EZXFRA5YKHYMKLAJVHJB7VRBYI4WTRV6/


--

Kaustav Majumder

Associate Software Engineer

Red Hat India PVT LTD.

kmajumder@redhat.com    M: 08981884037     IM: IRC: kmajumder

TRIED. TESTED. TRUSTED.
@redhatway   @redhatinc   @redhatsnaps

_______________________________________________
Devel mailing list -- devel@ovirt.org
To unsubscribe send an email to devel-leave@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/OPPX3VMACC5YMJLINTEVNL3BLQKASQF4/

_______________________________________________
Devel mailing list -- devel@ovirt.org
To unsubscribe send an email to devel-leave@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/HCXHSJBQ6QBD76DYBVYCU35GZJHHTELK/


--

Kaustav Majumder

Associate Software Engineer

Red Hat India PVT LTD.

kmajumder@redhat.com    M: 08981884037     IM: IRC: kmajumder

TRIED. TESTED. TRUSTED.
@redhatway   @redhatinc   @redhatsnaps

_______________________________________________
Devel mailing list -- devel@ovirt.org
To unsubscribe send an email to devel-leave@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/YJ6DYKVBJ43QAN6HI5PFRJTQTBKMBBAX/