Hosted Engine stalled and unable to restart

Hello, We are on an older version (3.x - cannot be specific as I cannot get my ovirt hosted engine up). We experienced a storage failure earlier this evening - the hosted engine was originally installed with this storage domain although we have moved all VM's and disks off of it. The storage was restored and all the VM's are now running, but the ovirt engine is not pinging and is unreachable. I have attempted to locate it on my HV's using 'virsh list --all' but only one of those is taking my credentials - all the others fail to authenticate. Is there a way to locate what the credentials are on each HV since the default is not working? Additionally, is there any other way to locate the hosted engine and restart it directly from a HV? Thank you for your time and consideration. *** *Mark Steele*

Have you tried hosted-engine --vm-start On any of the HVs ? On Wed, 1 Apr 2020 at 02:57, Mark Steele <msteele@telvue.com> wrote:
Hello,
We are on an older version (3.x - cannot be specific as I cannot get my ovirt hosted engine up).
We experienced a storage failure earlier this evening - the hosted engine was originally installed with this storage domain although we have moved all VM's and disks off of it.
The storage was restored and all the VM's are now running, but the ovirt engine is not pinging and is unreachable.
I have attempted to locate it on my HV's using 'virsh list --all' but only one of those is taking my credentials - all the others fail to authenticate.
Is there a way to locate what the credentials are on each HV since the default is not working? Additionally, is there any other way to locate the hosted engine and restart it directly from a HV?
Thank you for your time and consideration.
*** *Mark Steele*
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/XTA35SOC737FLI...

On April 1, 2020 4:53:42 AM GMT+03:00, Mark Steele <msteele@telvue.com> wrote:
Hello,
We are on an older version (3.x - cannot be specific as I cannot get my ovirt hosted engine up).
We experienced a storage failure earlier this evening - the hosted engine was originally installed with this storage domain although we have moved all VM's and disks off of it.
The storage was restored and all the VM's are now running, but the ovirt engine is not pinging and is unreachable.
I have attempted to locate it on my HV's using 'virsh list --all' but only one of those is taking my credentials - all the others fail to authenticate.
Is there a way to locate what the credentials are on each HV since the default is not working? Additionally, is there any other way to locate the hosted engine and restart it directly from a HV?
Thank you for your time and consideration.
*** *Mark Steele*
For the virsh, I use this alias: alias virsh='virsh -c qemu:///system?authfile=/etc/ovirt-hosted-engine/virsh_auth.conf' In order to reach the HostedEngine, you need to first assign a console password: hosted-engine --add-console-password --password=pass It should provide you with IP/port for the console connection (I use VNC, but I'm not sure on v3.X). Once you got a connection, you can try to fix the issue. Maybe it's just a bad entry in /etc/fstab . Best Regards, Strahil Nikolov

Thank you all! We were able to locate it on HV-02 and restart it using virsh. This is how we got virsh working on that HV: Virsh Authorization If Virsh is set for Auth If attempting to use any virsh commands and get auth request you will either need the auth credentials or to create your own.Example: $ virsh list Please enter your authentication name: root Please enter your password: error: Failed to reconnect to the hypervisor error: no valid connection error: authentication failed: authentication failed Solution $ saslpasswd2 -a libvirt <username> *** *Mark Steele* CIO / VP Technical Operations | TelVue Corporation TelVue - We Share Your Vision 16000 Horizon Way, Suite 100 | Mt. Laurel, NJ 08054 800.885.8886 | msteele@telvue.com | http://www.telvue.com twitter: http://twitter.com/telvue | facebook: https://www.facebook.com/telvue On Wed, Apr 1, 2020 at 12:34 AM Strahil Nikolov <hunter86_bg@yahoo.com> wrote:
On April 1, 2020 4:53:42 AM GMT+03:00, Mark Steele <msteele@telvue.com> wrote:
Hello,
We are on an older version (3.x - cannot be specific as I cannot get my ovirt hosted engine up).
We experienced a storage failure earlier this evening - the hosted engine was originally installed with this storage domain although we have moved all VM's and disks off of it.
The storage was restored and all the VM's are now running, but the ovirt engine is not pinging and is unreachable.
I have attempted to locate it on my HV's using 'virsh list --all' but only one of those is taking my credentials - all the others fail to authenticate.
Is there a way to locate what the credentials are on each HV since the default is not working? Additionally, is there any other way to locate the hosted engine and restart it directly from a HV?
Thank you for your time and consideration.
*** *Mark Steele*
For the virsh, I use this alias: alias virsh='virsh -c qemu:///system?authfile=/etc/ovirt-hosted-engine/virsh_auth.conf'
In order to reach the HostedEngine, you need to first assign a console password: hosted-engine --add-console-password --password=pass
It should provide you with IP/port for the console connection (I use VNC, but I'm not sure on v3.X).
Once you got a connection, you can try to fix the issue. Maybe it's just a bad entry in /etc/fstab .
Best Regards, Strahil Nikolov

Sasl-passwd <local account> It will give you access to virsh on nodes to check status of vm’s etc. Eric Evans Digital Data Services LLC. 304.660.9080 From: Mark Steele <msteele@telvue.com> Sent: Tuesday, March 31, 2020 9:54 PM To: users <users@ovirt.org> Subject: [ovirt-users] Hosted Engine stalled and unable to restart Hello, We are on an older version (3.x - cannot be specific as I cannot get my ovirt hosted engine up). We experienced a storage failure earlier this evening - the hosted engine was originally installed with this storage domain although we have moved all VM's and disks off of it. The storage was restored and all the VM's are now running, but the ovirt engine is not pinging and is unreachable. I have attempted to locate it on my HV's using 'virsh list --all' but only one of those is taking my credentials - all the others fail to authenticate. Is there a way to locate what the credentials are on each HV since the default is not working? Additionally, is there any other way to locate the hosted engine and restart it directly from a HV? Thank you for your time and consideration. *** Mark Steele

Eric - thank you - we have added this to our Wiki. Best regards, *** *Mark Steele* CIO / VP Technical Operations | TelVue Corporation TelVue - We Share Your Vision 16000 Horizon Way, Suite 100 | Mt. Laurel, NJ 08054 800.885.8886 | msteele@telvue.com | http://www.telvue.com twitter: http://twitter.com/telvue | facebook: https://www.facebook.com/telvue On Wed, Apr 1, 2020 at 3:18 PM <eevans@digitaldatatechs.com> wrote:
Sasl-passwd <local account> It will give you access to virsh on nodes to check status of vm’s etc.
Eric Evans
Digital Data Services LLC.
304.660.9080
*From:* Mark Steele <msteele@telvue.com> *Sent:* Tuesday, March 31, 2020 9:54 PM *To:* users <users@ovirt.org> *Subject:* [ovirt-users] Hosted Engine stalled and unable to restart
Hello,
We are on an older version (3.x - cannot be specific as I cannot get my ovirt hosted engine up).
We experienced a storage failure earlier this evening - the hosted engine was originally installed with this storage domain although we have moved all VM's and disks off of it.
The storage was restored and all the VM's are now running, but the ovirt engine is not pinging and is unreachable.
I have attempted to locate it on my HV's using 'virsh list --all' but only one of those is taking my credentials - all the others fail to authenticate.
Is there a way to locate what the credentials are on each HV since the default is not working? Additionally, is there any other way to locate the hosted engine and restart it directly from a HV?
Thank you for your time and consideration.
***
*Mark Steele*

Glad it worked out and was able to help. Take care. Eric Evans Digital Data Services LLC. 304.660.9080 From: Mark Steele <msteele@telvue.com> Sent: Wednesday, April 01, 2020 3:21 PM To: eevans@digitaldatatechs.com Cc: users <users@ovirt.org> Subject: [ovirt-users] Re: Hosted Engine stalled and unable to restart Eric - thank you - we have added this to our Wiki. Best regards, *** Mark Steele CIO / VP Technical Operations | TelVue Corporation TelVue - We Share Your Vision 16000 Horizon Way, Suite 100 | Mt. Laurel, NJ 08054 800.885.8886 | msteele@telvue.com <mailto:msteele@telvue.com> | <http://www.telvue.com/> http://www.telvue.com twitter: <http://twitter.com/telvue> http://twitter.com/telvue | facebook: <https://www.facebook.com/telvue> https://www.facebook.com/telvue On Wed, Apr 1, 2020 at 3:18 PM <eevans@digitaldatatechs.com <mailto:eevans@digitaldatatechs.com> > wrote: Sasl-passwd <local account> It will give you access to virsh on nodes to check status of vm’s etc. Eric Evans Digital Data Services LLC. 304.660.9080 From: Mark Steele <msteele@telvue.com <mailto:msteele@telvue.com> > Sent: Tuesday, March 31, 2020 9:54 PM To: users <users@ovirt.org <mailto:users@ovirt.org> > Subject: [ovirt-users] Hosted Engine stalled and unable to restart Hello, We are on an older version (3.x - cannot be specific as I cannot get my ovirt hosted engine up). We experienced a storage failure earlier this evening - the hosted engine was originally installed with this storage domain although we have moved all VM's and disks off of it. The storage was restored and all the VM's are now running, but the ovirt engine is not pinging and is unreachable. I have attempted to locate it on my HV's using 'virsh list --all' but only one of those is taking my credentials - all the others fail to authenticate. Is there a way to locate what the credentials are on each HV since the default is not working? Additionally, is there any other way to locate the hosted engine and restart it directly from a HV? Thank you for your time and consideration. *** Mark Steele

On Wed, Apr 1, 2020 at 10:37 PM Mark Steele <msteele@telvue.com> wrote:
Eric - thank you - we have added this to our Wiki.
Looks like content for ovirt site: https://github.com/ovirt/ovirt-site To get read-only access you can use: virsh -r list Without special configuration. Using read-write access and modifying vms managed by oVirt is asking for trouble. Should be used as a last resort if there is no way to control the vm via oVirt. Nir Best regards,
*** *Mark Steele* CIO / VP Technical Operations | TelVue Corporation TelVue - We Share Your Vision 16000 Horizon Way, Suite 100 | Mt. Laurel, NJ 08054 800.885.8886 | msteele@telvue.com | http://www.telvue.com twitter: http://twitter.com/telvue | facebook: https://www.facebook.com/telvue
On Wed, Apr 1, 2020 at 3:18 PM <eevans@digitaldatatechs.com> wrote:
Sasl-passwd <local account> It will give you access to virsh on nodes to check status of vm’s etc.
Eric Evans
Digital Data Services LLC.
304.660.9080
*From:* Mark Steele <msteele@telvue.com> *Sent:* Tuesday, March 31, 2020 9:54 PM *To:* users <users@ovirt.org> *Subject:* [ovirt-users] Hosted Engine stalled and unable to restart
Hello,
We are on an older version (3.x - cannot be specific as I cannot get my ovirt hosted engine up).
We experienced a storage failure earlier this evening - the hosted engine was originally installed with this storage domain although we have moved all VM's and disks off of it.
The storage was restored and all the VM's are now running, but the ovirt engine is not pinging and is unreachable.
I have attempted to locate it on my HV's using 'virsh list --all' but only one of those is taking my credentials - all the others fail to authenticate.
Is there a way to locate what the credentials are on each HV since the default is not working? Additionally, is there any other way to locate the hosted engine and restart it directly from a HV?
Thank you for your time and consideration.
***
*Mark Steele*
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/GRGF65PIVAIFFB...

On April 1, 2020 11:20:49 PM GMT+03:00, Nir Soffer <nsoffer@redhat.com> wrote:
On Wed, Apr 1, 2020 at 10:37 PM Mark Steele <msteele@telvue.com> wrote:
Eric - thank you - we have added this to our Wiki.
Looks like content for ovirt site: https://github.com/ovirt/ovirt-site
To get read-only access you can use:
virsh -r list
Without special configuration.
Using read-write access and modifying vms managed by oVirt is asking for trouble. Should be used as a last resort if there is no way to control the vm via oVirt.
Nir
Best regards,
*** *Mark Steele* CIO / VP Technical Operations | TelVue Corporation TelVue - We Share Your Vision 16000 Horizon Way, Suite 100 | Mt. Laurel, NJ 08054 800.885.8886 | msteele@telvue.com | http://www.telvue.com twitter: http://twitter.com/telvue | facebook: https://www.facebook.com/telvue
On Wed, Apr 1, 2020 at 3:18 PM <eevans@digitaldatatechs.com> wrote:
Sasl-passwd <local account> It will give you access to virsh on
check status of vm’s etc.
Eric Evans
Digital Data Services LLC.
304.660.9080
*From:* Mark Steele <msteele@telvue.com> *Sent:* Tuesday, March 31, 2020 9:54 PM *To:* users <users@ovirt.org> *Subject:* [ovirt-users] Hosted Engine stalled and unable to restart
Hello,
We are on an older version (3.x - cannot be specific as I cannot get my ovirt hosted engine up).
We experienced a storage failure earlier this evening - the hosted engine was originally installed with this storage domain although we have moved all VM's and disks off of it.
The storage was restored and all the VM's are now running, but the ovirt engine is not pinging and is unreachable.
I have attempted to locate it on my HV's using 'virsh list --all' but only one of those is taking my credentials - all the others fail to authenticate.
Is there a way to locate what the credentials are on each HV since
nodes to the
default is not working? Additionally, is there any other way to locate the hosted engine and restart it directly from a HV?
Thank you for your time and consideration.
***
*Mark Steele*
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/GRGF65PIVAIFFB...
The auth file is located at /etc/ovirt-hosted-engine/virsh_auth.conf The simple alias: alias virsh='virsh -c qemu:///system?authfile=/etc/ovirt-hosted-engine/virsh_auth.conf' Is enough to play with the toys directly :) It's quite handy if you need to play with the HostedEngine VM :) Best Regards, Strahil Nikolov
participants (5)
-
eevans@digitaldatatechs.com
-
Mark Steele
-
Maton, Brett
-
Nir Soffer
-
Strahil Nikolov