Ovirt Node migration
by Juan Carlos YJ. Lin
--=_c3753451-1e9e-43c0-ae92-6ab64862f914
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
I like to know if a node adopted by a ovirt engine can safely adopted by a new ovirt engine, keeping all running vms in local storage mode, ovirt node 3.4, new ovirt engine 3.5
Thanks
Juan Carlos Lin
Unisoft S.A.
+595-993-288330
---------------------------------------------------
"Antes de imprimir, recuérdese de su compromiso con el Medio Ambiente"
"Aviso: Este mensaje es dirigido para su destinatario y contiene informaciones que no pueden ser usadas por otras personas que no sean su(s) destinatario(s). La retransmisión del contenido no está autorizada fuera del contexto de su envío y a quien corresponde. El uso no autorizado de la información en este mensaje se halla penado por las leyes vigentes en todo el mundo. Si ha recibido este mensaje por error, por favor bórrala y notifique al remitente en la brevedad posible. El contenido de este mensaje no es responsabilidad de la Empresa y debe ser atribuido siempre a su autor. Gracias."
--=_c3753451-1e9e-43c0-ae92-6ab64862f914
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 7bit
<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: Arial; font-size: 10pt; color: #000000'><span>I like to know if a node adopted by a ovirt engine can safely adopted by a new ovirt engine, keeping all running vms in local storage mode, ovirt node 3.4, new ovirt engine 3.5<br>Thanks<br><br><span name="x"></span>Juan Carlos Lin<br>Unisoft S.A.<br>+595-993-288330<span name="x"></span><br></span><br></div>
<br>
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd"> <HTML lang="es"> <HEAD> <TITLE>System-wide Disclaimer</TITLE> </HEAD> <BODY>---------------------------------------------------<br>"Antes de imprimir, recuérdese de su compromiso con el Medio Ambiente"<br>"Aviso: Este mensaje es dirigido para su destinatario y contiene informaciones que no pueden ser usadas por otras personas que no sean su(s) destinatario(s). La retransmisión del contenido no está autorizada fuera del contexto de su envío y a quien corresponde. El uso no autorizado de la información en este mensaje se halla penado por las leyes vigentes en todo el mundo. Si ha recibido este mensaje por error, por favor bórrala y notifique al remitente en la brevedad posible. El contenido de este mensaje no es responsabilidad de la Empresa y debe ser atribuido siempre a su autor. Gracias." </BODY> </HTML><br>
</body></html>
--=_c3753451-1e9e-43c0-ae92-6ab64862f914--
10 years
3.5 install issues: The VDSM host was found in a failed state
by Robert Story
--Sig_/KBhnfZf0d.2Hynd8..nLq1U
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: quoted-printable
So I tried install #6 today on another machine. I dedicated eth0 to
ovirmgmt and put the default route and vlans on eth1. The install got to
the point of starting the VM the second time for the engine install (which
completed fine), but then:
[ INFO ] Engine replied: DB Up!Welcome to Health Status!
Enter the name of the cluster to which you want to add the host (=
Default) [Default]:=20
[ INFO ] Waiting for the host to become operational in the engine. This ma=
y take several minutes...
[ ERROR ] The VDSM host was found in a failed state. Please check engine an=
d bootstrap installation logs.
[ ERROR ] Unable to add hosted_engine_1 to the manager
Please shutdown the VM allowing the system to launch it as a moni=
tored service.
I shut down the engine VM, but now it seems to be in a reboot loop,
starting and then being shutdown and rebooted, by the HA agent, I assume..
Logs for this install are at http://futz.org/users/tmp/ovirt6/. (The first
hosted-engine was aborted before it started to fix DNS for of engine VM,
but I included it for completeness).
Robert
--=20
Senior Software Engineer @ Parsons
--Sig_/KBhnfZf0d.2Hynd8..nLq1U
Content-Type: application/pgp-signature; name=signature.asc
Content-Disposition: attachment; filename=signature.asc
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2
iEYEARECAAYFAlRNSRgACgkQ7/fVLLY1mnh+7gCeOxUfE8sSUpXJ9EaiwyGUhkbM
QF8AoI4ItO+BtOJgR6rQgs3Xy0QWsDCW
=uXFK
-----END PGP SIGNATURE-----
--Sig_/KBhnfZf0d.2Hynd8..nLq1U--
10 years
oVirt Monthly Newsletter: October 2014
by Brian Proffitt
October 2014 was a big month for oVirt. A new release, a new workshop, a new way of installing oVirt... there was nothing about October that didn't feel like success for the community and the software. As we start looking ahead to oVirt 3.6, here's a look back at one memorable month!
----------------
In the Community
----------------
oVirt is very happy to announce its participation in the GNOME Foundation's Outreach Program for Women: http://www.ovirt.org/Outreach_Program_for_Women Registration closed on Oct. 22, and have two excellent participants working with the oVirt community.
With all of the work being done on oVirt 3.5, our development team took the time to create some videos and deep-dive hangouts about 3.5 features: http://community.redhat.com/blog/2014/09/a-cinematic-peek-at-ovirt-3-5/
October 16 was the next big event for the oVirt community, the 2014 KVM Forum oVirt Workshop in Düsseldorf, Germany. Learn more at http://community.redhat.com/blog/2014/10/ovirt-workshop-2014/ and http://ow.ly/i/7gCmZ
Other October events for oVirt included:
* LinuxCon EU, Düsseldorf, Germany, Oct. 13-15
http://events.linuxfoundation.org/events/linuxcon-europe
* CloudOpen Europe, Düsseldorf, Germany, Oct. 13-15
http://events.linuxfoundation.org/events/cloudopen-europe
* KVM Forum, Düsseldorf, Germany, Oct. 14-16
http://events.linuxfoundation.org/events/kvm-forum
* All Things Open, Raleigh, North Carolina, Oct. 22-23
http://allthingsopen.org/
* Open World Forum 2014, Paris, France, Oct. 30-31
http://www.openworldforum.paris/en/
Douglas Landsgraf reveals his take on Latinoware 2014 (http://dougsland.livejournal.com/123871.html)
In November, oVirt will be featured at more events:
* OpenAlt.cz, Brno, Czech Republic, Nov. 1-2
http://www.openalt.cz/
* LISA 14, Seattle, Washington, Nov. 9-14
https://www.usenix.org/conference/lisa14
* DevOps at Red Hat #2, Nov. 18
http://www.geektime.co.il/events/devops-at-red-hat-2/
* DevOps Days, Tel Aviv, Nov. 23-24
http://devopsdays.org/events/2014-telaviv/
And for the future, there's a Call for Particpation for the IaaS DevRoom at FOSDEM'15 (http://lists.ovirt.org/pipermail/users/2014-October/028644.html)!
-------------------------
oVirt Software Milestones
-------------------------
On October 19, the journey to our next release was complete, and oVirt 3.5 was released! http://community.redhat.com/blog/2014/10/ovirt-3-5-rolls-out/
Along with the release of oVirt 3.5, a new User Guide (http://www.ovirt.org/OVirt_User_Guide) and Administrator Guide (http://www.ovirt.org/OVirt_Administration_Guide) were released, ready to help people using oVirt faster!
Earlier in October, ovirt-3.5 ovirt-guest-agent Linux builds were also made available:
http://permalink.gmane.org/gmane.comp.emulators.ovirt.user/22322
------------------------------------
Deep Dives and Technical Discussions
------------------------------------
oVirt and Docker are proving to be a great combination! Moran Goldboim rolls out a two-part blog on how you can install oVirt as a Docker container today! (http://community.redhat.com/blog/2014/10/ovirt-dockerized/, http://community.redhat.com/blog/2014/10/ovirt-dockerized-part-2/)
Jason Brooks continues his Up and Running series with a look on how to install and use oVirt 3.5 (http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/)!
You can also learn about what's new in oVirt 3.5 in Korean (https://ovirtkorea.wordpress.com/2014/10/26/whatsnew_in_ovirt35/).
Like oVirt? Want to tell your friends and colleagues? Use our slide presentation as a
basis to share oVirt with the community: http://www.ovirt.org/OVirt_Slide_Decks#Introduction_to_oVirt_Deck
The oVirt 3.5 Features and Deep Dives YouTube playlist has been expanded! http://ow.ly/DrBlt
Douglas Landsgraf wrote a nice write up abaout how Hosted Engine is going to work on oVirt Node http://dougsland.livejournal.com/124084.html
Discover moVirt: the mobile interface for oVirt (http://events.linuxfoundation.org/sites/events/files/slides/movirt.pdf)
RaspberryPi + SPICE + oVirt = Red Hat Powered VDI. Learn more in this video (http://www.spice-space.org/vdi.html)!
Some answers to the question: HA Cluster Gluster or DRBD iSCSI for oVirt 3.5 (http://www.redgrid.net/uncategorized/ovirt-3-5-ha-cluster-gluster-or-drbd...).
How to get directory services easily connected to oVirt with Docker and FreeIPA:
http://www.projectatomic.io/blog/2014/10/containerized-directory-services...
Seven steps to VM management with oVirt (in German) (http://www.datacenter-insider.de/index.cfm?pid=13397&pk=464532&p=1).
Find out more about the Python API for oVirt and RHEV (in Italian) (http://www.extraordy.com/introduzione-alle-python-api-per-rhev/).
Check out this Russian review of oVirt 3.5: http://youtu.be/kUqdKF9eW7Y
--
Brian Proffitt
Community Liaison
oVirt
Open Source and Standards, Red Hat - http://community.redhat.com
Phone: +1 574 383 9BKP
IRC: bkp @ OFTC
10 years
Certificate Enrollment Failed
by Dinuwan
This is a multipart message in MIME format.
------=_NextPart_000_09DE_01CFF75D.1124B030
Content-Type: text/plain;
charset="us-ascii"
Content-Transfer-Encoding: 7bit
Hello Everyone!
I am trying to re-install a host in an ovirt hosted-engine environment but
the second host keeps on failing with the Certificate Enrollment failed
error.
I have deleted the Host from the Engine but it always fails at the
certificate enrollment.
The following problem is similar to mine but I have checked my file
permissions and they are all as they should:
http://lists.ovirt.org/pipermail/users/2014-May/024738.html
engine.log :
2014-11-03 11:22:38,485 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(VdsDeploy) Correlation ID: 2f0410ee, Call Stack: null, Custom Event ID: -1$
2014-11-03 11:22:39,496 ERROR
[org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign
Certificate request failed with exit code 1
2014-11-03 11:22:39,497 ERROR
[org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) Sign
Certificate request script errors:
Using configuration from openssl.conf
unable to load number from serial.txt
error while loading serial number
139842728826696:error:0D066096:asn1 encoding routines:a2i_ASN1_INTEGER:short
line:f_int.c:215:
Cannot sign certificate
2014-11-03 11:22:39,499 ERROR [org.ovirt.engine.core.bll.VdsDeploy]
(VdsDeploy) Error during deploy dialog: java.lang.RuntimeException:
Certificate enrollment failed
at
org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper.signCertificateRequ
est(OpenSslCAWrapper.java:56) [utils.jar:]
at
org.ovirt.engine.core.bll.VdsDeploy._threadMain(VdsDeploy.java:927)
[bll.jar:]
at
org.ovirt.engine.core.bll.VdsDeploy.access$2000(VdsDeploy.java:83)
[bll.jar:]
at org.ovirt.engine.core.bll.VdsDeploy$51.run(VdsDeploy.java:969)
[bll.jar:]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_71]
2014-11-03 11:22:39,510 ERROR [org.ovirt.engine.core.bll.VdsDeploy]
(org.ovirt.thread.pool-8-thread-2) [2f0410ee] Error during host 10.10.10.2
install: java.lang.RuntimeExc$
at
org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper.signCertificateRequ
est(OpenSslCAWrapper.java:56) [utils.jar:]
at
org.ovirt.engine.core.bll.VdsDeploy._threadMain(VdsDeploy.java:927)
[bll.jar:]
at
org.ovirt.engine.core.bll.VdsDeploy.access$2000(VdsDeploy.java:83)
[bll.jar:]
at org.ovirt.engine.core.bll.VdsDeploy$51.run(VdsDeploy.java:969)
[bll.jar:]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_71]
2014-11-03 11:22:39,516 ERROR [org.ovirt.engine.core.bll.InstallerMessages]
(org.ovirt.thread.pool-8-thread-2) [2f0410ee] Installation 10.10.10.2:
Certificate enrollment fa$
2014-11-03 11:22:39,546 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(org.ovirt.thread.pool-8-thread-2) [2f0410ee] Correlation ID: 2f0410ee, Cal$
2014-11-03 11:22:39,548 ERROR [org.ovirt.engine.core.bll.VdsDeploy]
(org.ovirt.thread.pool-8-thread-2) [2f0410ee] Error during host 10.10.10.2
install, prefering first exce$
at
org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper.signCertificateRequ
est(OpenSslCAWrapper.java:56) [utils.jar:]
at
org.ovirt.engine.core.bll.VdsDeploy._threadMain(VdsDeploy.java:927)
[bll.jar:]
at
org.ovirt.engine.core.bll.VdsDeploy.access$2000(VdsDeploy.java:83)
[bll.jar:]
at org.ovirt.engine.core.bll.VdsDeploy$51.run(VdsDeploy.java:969)
[bll.jar:]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_71]
I've been struggling with this problem for about a week now, and I have
tried changing HostIDs and re-installing ovirt-hosted-engine-setup but it
still appears. The only thing I couldn't try is to re-install the machine.
The problem with that is I have my gluster bricks running on the same
therefore it is the last option I want to consider.
Hopefully somebody will be able to assist me with this.
Thanks in advance.
Dinu.
------=_NextPart_000_09DE_01CFF75D.1124B030
Content-Type: text/html;
charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta =
http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 =
(filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-US link=3Dblue =
vlink=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal>Hello =
Everyone!<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p =
class=3DMsoNormal>I am trying to re-install a host in an ovirt =
hosted-engine environment but the second host keeps on failing with the =
Certificate Enrollment failed error. <o:p></o:p></p><p =
class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>I have =
deleted the Host from the Engine but it always fails at the certificate =
enrollment. <o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p =
class=3DMsoNormal>The following problem is similar to mine but I have =
checked my file permissions and they are all as they =
should:<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p =
class=3DMsoNormal><a =
href=3D"http://lists.ovirt.org/pipermail/users/2014-May/024738.html">http=
://lists.ovirt.org/pipermail/users/2014-May/024738.html</a><o:p></o:p></p=
><p class=3DMsoNormal><o:p> </o:p></p><p =
class=3DMsoNormal>engine.log :<o:p></o:p></p><p =
class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>2014-11-03 =
11:22:38,485 INFO =
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] =
(VdsDeploy) Correlation ID: 2f0410ee, Call Stack: null, Custom Event ID: =
-1$<o:p></o:p></p><p class=3DMsoNormal>2014-11-03 11:22:39,496 ERROR =
[org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) =
Sign Certificate request failed with exit code 1<o:p></o:p></p><p =
class=3DMsoNormal>2014-11-03 11:22:39,497 ERROR =
[org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper] (VdsDeploy) =
Sign Certificate request script errors:<o:p></o:p></p><p =
class=3DMsoNormal>Using configuration from openssl.conf<o:p></o:p></p><p =
class=3DMsoNormal>unable to load number from serial.txt<o:p></o:p></p><p =
class=3DMsoNormal>error while loading serial number<o:p></o:p></p><p =
class=3DMsoNormal>139842728826696:error:0D066096:asn1 encoding =
routines:a2i_ASN1_INTEGER:short line:f_int.c:215:<o:p></o:p></p><p =
class=3DMsoNormal>Cannot sign certificate<o:p></o:p></p><p =
class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>2014-11-03 =
11:22:39,499 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) =
Error during deploy dialog: java.lang.RuntimeException: Certificate =
enrollment failed<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper.signCertificateR=
equest(OpenSslCAWrapper.java:56) [utils.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.bll.VdsDeploy._threadMain(VdsDeploy.java:927) =
[bll.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.bll.VdsDeploy.access$2000(VdsDeploy.java:83) =
[bll.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.bll.VdsDeploy$51.run(VdsDeploy.java:969) =
[bll.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_71]<o:p></o:p></p><p =
class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>2014-11-03 =
11:22:39,510 ERROR [org.ovirt.engine.core.bll.VdsDeploy] =
(org.ovirt.thread.pool-8-thread-2) [2f0410ee] Error during host =
10.10.10.2 install: java.lang.RuntimeExc$<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper.signCertificateR=
equest(OpenSslCAWrapper.java:56) [utils.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.bll.VdsDeploy._threadMain(VdsDeploy.java:927) =
[bll.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.bll.VdsDeploy.access$2000(VdsDeploy.java:83) =
[bll.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.bll.VdsDeploy$51.run(VdsDeploy.java:969) =
[bll.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_71]<o:p></o:p></p><p =
class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>2014-11-03 =
11:22:39,516 ERROR [org.ovirt.engine.core.bll.InstallerMessages] =
(org.ovirt.thread.pool-8-thread-2) [2f0410ee] Installation 10.10.10.2: =
Certificate enrollment fa$<o:p></o:p></p><p class=3DMsoNormal>2014-11-03 =
11:22:39,546 ERROR =
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] =
(org.ovirt.thread.pool-8-thread-2) [2f0410ee] Correlation ID: 2f0410ee, =
Cal$<o:p></o:p></p><p class=3DMsoNormal>2014-11-03 11:22:39,548 ERROR =
[org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-8-thread-2) =
[2f0410ee] Error during host 10.10.10.2 install, prefering first =
exce$<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.utils.hostinstall.OpenSslCAWrapper.signCertificateR=
equest(OpenSslCAWrapper.java:56) [utils.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.bll.VdsDeploy._threadMain(VdsDeploy.java:927) =
[bll.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.bll.VdsDeploy.access$2000(VdsDeploy.java:83) =
[bll.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
org.ovirt.engine.core.bll.VdsDeploy$51.run(VdsDeploy.java:969) =
[bll.jar:]<o:p></o:p></p><p =
class=3DMsoNormal> at =
java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_71]<o:p></o:p></p><p =
class=3DMsoNormal><o:p> </o:p></p><p =
class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>I’ve =
been struggling with this problem for about a week now, and I have tried =
changing HostIDs and re-installing ovirt-hosted-engine-setup but it =
still appears. The only thing I couldn’t try is to re-install the =
machine. The problem with that is I have my gluster bricks running on =
the same therefore it is the last option I want to =
consider.<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p =
class=3DMsoNormal>Hopefully somebody will be able to assist me with =
this.<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p =
class=3DMsoNormal>Thanks in advance.<o:p></o:p></p><p =
class=3DMsoNormal><br>Dinu.<o:p></o:p></p></div></body></html>
------=_NextPart_000_09DE_01CFF75D.1124B030--
10 years
Re: [ovirt-users] Add multiple files to a VM via cloud-init
by Amedeo Salvati
Hi Juan,
this means that example of python code on
http://www.ovirt.org/Features/Cloud-Init_Integration that I wrote some
months ago against v3.4 could be changed by encoding the content on base64?
at this time of this writing I haven't v3.5 to test the script / new code
best regards
Amedeo Salvati
Il 01/11/2014 00:00, users-request(a)ovirt.org ha scritto:
> The "custom_script" element doesn't work in combination with cloud-init
> and run once. To make it work you have to use cloud-init and a file
> element containing your custom script. Here you have an example:
>
> #!/usr/bin/python
>
> import base64
> import re
>
> from ovirtsdk.api import API
> from ovirtsdk.xml import params
>
> # A simple function to encode using base64 and now new lines:
> def encode(s):
> return re.sub("\s+", "", base64.encodestring(s))
>
> # Connect to the server:
> api = API(
> url="https://engine35.example.com/ovirt-engine/api",
> username="admin@internal",
> password="redhat123",
> insecure=True,
> debug=True
> )
>
> # Find the virtual machine:
> myvm = api.vms.get(name="myvm")
>
> # Prepare the cloud-init custom script to write files:
> myscript = """\
> write_files:
> """
>
> # Append one file:
> myscript += """\
> - encoding: b64
> content: %s
> owner: root:root
> path: /etc/firstfile.txt
> permissions: '0644'
> """ % encode("The content of the first file")
>
> # Append another file:
> myscript += """\
> - encoding: b64
> content: %s
> owner: root:root
> path: /etc/secondfile.txt
> permissions: '0644'
> """ % encode("The content of the second file")
>
> # Prepare the action to trigger initialization using cloud-init:
> action = params.Action(
> vm=params.VM(
> initialization=params.Initialization(
> cloud_init=params.CloudInit(
> files=params.Files(
> file=[
> params.File(
> name="myscript",
> type_="plaintext",
> content=myscript
> )
> ]
> )
> )
> )
> )
> )
>
> # Start the virtual machine:
> myvm.start(action)
>
> # Disconnect from the server:
> api.disconnect()
>
> Regarding the problem with the root password we have a bug in 3.5 that
> makes this fail. See here:
>
> https://bugzilla.redhat.com/1156155
>
> The problem is that we are not passing the user name to cloud-init, and
> as a result it is changing the default cloud-init user password, not the
> root pssword. To workaround the issue you can edit the
> "/etc/cloud/cloud.cfg" file of the VM and change the default user name:
>
> system_info:
> distro: ...
> default_user:
> name: root <-- Change this from "fedora" or "cloud-init" to root
10 years
gluster-server 3.5.2 requies gluasterfs-3.52
by Juan Carlos YJ. Lin
--=_a05514ec-05a6-482e-8971-36fe00447517
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
gluster-server 3.5.2 requies gluasterfs-3.52, but ovirt3.5 install glusterfs-3.6.0
how to solve the dependency?
Juan Carlos Lin
Unisoft S.A.
+595-993-288330
---------------------------------------------------
"Antes de imprimir, recuérdese de su compromiso con el Medio Ambiente"
"Aviso: Este mensaje es dirigido para su destinatario y contiene informaciones que no pueden ser usadas por otras personas que no sean su(s) destinatario(s). La retransmisión del contenido no está autorizada fuera del contexto de su envío y a quien corresponde. El uso no autorizado de la información en este mensaje se halla penado por las leyes vigentes en todo el mundo. Si ha recibido este mensaje por error, por favor bórrala y notifique al remitente en la brevedad posible. El contenido de este mensaje no es responsabilidad de la Empresa y debe ser atribuido siempre a su autor. Gracias."
--=_a05514ec-05a6-482e-8971-36fe00447517
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 7bit
<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: Arial; font-size: 10pt; color: #000000'><span>gluster-server 3.5.2 requies gluasterfs-3.52, but ovirt3.5 install glusterfs-3.6.0<br>how to solve the dependency?<br><br><span name="x"></span>Juan Carlos Lin<br>Unisoft S.A.<br>+595-993-288330<span name="x"></span><br></span><br></div>
<br>
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd"> <HTML lang="es"> <HEAD> <TITLE>System-wide Disclaimer</TITLE> </HEAD> <BODY>---------------------------------------------------<br>"Antes de imprimir, recuérdese de su compromiso con el Medio Ambiente"<br>"Aviso: Este mensaje es dirigido para su destinatario y contiene informaciones que no pueden ser usadas por otras personas que no sean su(s) destinatario(s). La retransmisión del contenido no está autorizada fuera del contexto de su envío y a quien corresponde. El uso no autorizado de la información en este mensaje se halla penado por las leyes vigentes en todo el mundo. Si ha recibido este mensaje por error, por favor bórrala y notifique al remitente en la brevedad posible. El contenido de este mensaje no es responsabilidad de la Empresa y debe ser atribuido siempre a su autor. Gracias." </BODY> </HTML><br>
</body></html>
--=_a05514ec-05a6-482e-8971-36fe00447517--
10 years
Re: [ovirt-users] Hosted-Engine HA problem
by Jaicel
Hi,
my engine runs on Host1. current status and agent logs below.
Host 1
MainThread::INFO::2014-10-31 16:55:39,918::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engi
ne-ha agent 1.1.6 started
MainThread::INFO::2014-10-31 16:55:39,985::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(_get_hostname) Found certificate common name: 192.168.12.11
MainThread::INFO::2014-10-31 16:55:40,228::hosted_engine::367::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(_initialize_broker) Initializing ha-broker connection
MainThread::INFO::2014-10-31 16:55:40,228::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Starting monitor ping, options {'addr': '192.168.12.254'}
MainThread::INFO::2014-10-31 16:55:40,231::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Success, id 140634215107920
MainThread::INFO::2014-10-31 16:55:40,231::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'ovirtmgmt', 'address': '0'}
MainThread::INFO::2014-10-31 16:55:40,237::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Success, id 140634215108432
MainThread::INFO::2014-10-31 16:55:40,237::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'}
MainThread::INFO::2014-10-31 16:55:40,240::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Success, id 39956688
MainThread::INFO::2014-10-31 16:55:40,240::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': '41d4aff1-54e1-4946-a812-2e656bb7d3f
9', 'address': '0'}
MainThread::INFO::2014-10-31 16:55:40,243::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Success, id 140634215107664
MainThread::INFO::2014-10-31 16:55:40,244::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': '41d4aff1-54e1-4946-a812-2e656bb7d3f9', '
address': '0'}
MainThread::INFO::2014-10-31 16:55:40,249::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Success, id 140634006879632
MainThread::INFO::2014-10-31 16:55:40,249::hosted_engine::391::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(_initialize_broker) Broker initialized, all submonitors started
MainThread::INFO::2014-10-31 16:55:40,298::hosted_engine::476::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 1 is acquired (file: /rhev/data-center/mnt/g
luster1:_engine/6eb220be-daff-4785-8f78-111cc24139c4/ha_agent/hosted-engine.lockspace)
MainThread::INFO::2014-10-31 16:55:40,322::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(refresh) Global metadata: {'maintenance': False}
MainThread::INFO::2014-10-31 16:55:40,322::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(refresh) Host 192.168.12.12 (id 2): {'live-data': False, 'extra': 'metadata_parse_version=1\nmetadata_feature_version
=1\ntimestamp=1413882675 (Tue Oct 21 17:11:15 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineDown\n', 'hostname': '192.168.12.12', 'host-id': 2, 'engine-status': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'score': 2400, 'maintenance': False, 'host-ts': 1413882675}
MainThread::INFO::2014-10-31 16:55:40,322::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': None, 'bridge': True, 'mem-free': None, 'maintenance': False, 'cpu-load': None, 'gateway': True}
MainThread::INFO::2014-10-31 16:55:40,323::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1414745740.32 type=state_transition detail=StartState-ReinitializeFSM hostname='ovirt1'
MainThread::INFO::2014-10-31 16:55:40,392::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (StartState-ReinitializeFSM) sent? ignored
MainThread::INFO::2014-10-31 16:55:40,675::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state ReinitializeFSM (score: 0)
MainThread::INFO::2014-10-31 16:55:50,710::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)
Trying: notify time=1414745750.71 type=state_transition detail=ReinitializeFSM-EngineUp hostname='ovirt1'
MainThread::INFO::2014-10-31 16:55:50,710::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-EngineUp) sent? ignored
MainThread::INFO::2014-10-31 16:55:51,001::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
MainThread::CRITICAL::2014-10-31 16:56:01,033::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Could not start ha-agent
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 97, in run
self._run_agent()
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 154, in _run_agent
hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring()
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 307, in start_monitoring
for old_state, state, delay in self.fsm:
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", line 125, in next
new_data = self.refresh(self._state.data)
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 77, in refresh
stats.update(self.hosted_engine.collect_stats())
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 700, in collect_stats
stats = self.process_remote_metadata(host_id, remote_data)
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 747, in process_remote_metadata
md['engine-status'] = engine_status(md["engine-status"])
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 79, in engine_status
in json.loads(status).iteritems()])
AttributeError: 'NoneType' object has no attribute 'iteritems'
[root@ovirt1 ~]# hosted-engine --vm-status
--== Host 1 status ==--
Status up-to-date : False
Hostname : 192.168.12.11
Host ID : 1
Engine status : unknown stale-data
Score : 2400
Local maintenance : False
Host timestamp : 1414745750
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=1414745750 (Fri Oct 31 16:55:50 2014)
host-id=1
score=2400
maintenance=False
state=EngineUp
--== Host 2 status ==--
Status up-to-date : False
Hostname : 192.168.12.12
Host ID : 2
Engine status : unknown stale-data
Score : 2400
Local maintenance : False
Host timestamp : 1414745821
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=1414745821 (Fri Oct 31 16:57:01 2014)
host-id=2
score=2400
maintenance=False
state=EngineStart
[root@ovirt1 ~]# service ovirt-ha-agent status
ovirt-ha-agent dead but subsys locked
Host2
MainThread::INFO::2014-10-31 16:55:59,642::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engi
ne-ha agent 1.1.6 started
MainThread::INFO::2014-10-31 16:55:59,678::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(_get_hostname) Found certificate common name: 192.168.12.12
MainThread::INFO::2014-10-31 16:55:59,918::hosted_engine::367::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(_initialize_broker) Initializing ha-broker connection
MainThread::INFO::2014-10-31 16:55:59,919::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Starting monitor ping, options {'addr': '192.168.12.254'}
MainThread::INFO::2014-10-31 16:55:59,922::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Success, id 25353488
MainThread::INFO::2014-10-31 16:55:59,922::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'ovirtmgmt', 'address': '0'}
MainThread::INFO::2014-10-31 16:55:59,928::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Success, id 25354128
MainThread::INFO::2014-10-31 16:55:59,928::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'}
MainThread::INFO::2014-10-31 16:55:59,931::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Success, id 25353552
MainThread::INFO::2014-10-31 16:55:59,931::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': '41d4aff1-54e1-4946-a812-2e656bb7d3f
9', 'address': '0'}
MainThread::INFO::2014-10-31 16:55:59,934::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Success, id 139976608389584
MainThread::INFO::2014-10-31 16:55:59,934::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': '41d4aff1-54e1-4946-a812-2e656bb7d3f9', '
address': '0'}
MainThread::INFO::2014-10-31 16:55:59,939::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_mo
nitor) Success, id 139976608447760
MainThread::INFO::2014-10-31 16:55:59,939::hosted_engine::391::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(_initialize_broker) Broker initialized, all submonitors started
MainThread::INFO::2014-10-31 16:55:59,983::hosted_engine::476::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 2 is acquired (file: /rhev/data-center/mnt/g
luster1:_engine/6eb220be-daff-4785-8f78-111cc24139c4/ha_agent/hosted-engine.lockspace)
MainThread::INFO::2014-10-31 16:56:00,001::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(refresh) Global metadata: {'maintenance': False}
MainThread::INFO::2014-10-31 16:56:00,001::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(refresh) Host 192.168.12.11 (id 1): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=
1\ntimestamp=1414745750 (Fri Oct 31 16:55:50 2014)\nhost-id=1\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostn
ame': '192.168.12.11', 'host-id': 1, 'engine-status': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'score': 2400, 'm
aintenance': False, 'host-ts': 1414745750}
MainThread::INFO::2014-10-31 16:56:00,001::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(refresh) Local (id 2): {'engine-health': None, 'bridge': True, 'mem-free': None, 'maintenance': False, 'cpu-load': No
ne, 'gateway': True}
MainThread::INFO::2014-10-31 16:56:00,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)
Trying: notify time=1414745760.0 type=state_transition detail=StartState-ReinitializeFSM hostname='ovirt2'
MainThread::INFO::2014-10-31 16:56:00,045::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)
Success, was notification of state_transition (StartState-ReinitializeFSM) sent? ignored
MainThread::INFO::2014-10-31 16:56:00,325::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:
:(start_monitoring) Current state ReinitializeFSM (score: 0)
MainThread::INFO::2014-10-31 16:56:10,352::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1414745770.35 type=state_transition detail=ReinitializeFSM-EngineDown hostname='ovirt2'
MainThread::INFO::2014-10-31 16:56:10,353::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-EngineDown) sent? ignored
MainThread::INFO::2014-10-31 16:56:10,638::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
MainThread::INFO::2014-10-31 16:56:20,663::states::441::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
MainThread::INFO::2014-10-31 16:56:20,663::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1414745780.66 type=state_transition detail=EngineDown-EngineDown hostname='ovirt2'
MainThread::INFO::2014-10-31 16:56:20,664::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
MainThread::INFO::2014-10-31 16:56:20,943::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
MainThread::INFO::2014-10-31 16:56:30,968::states::441::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
MainThread::INFO::2014-10-31 16:56:30,969::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1414745790.97 type=state_transition detail=EngineDown-EngineDown hostname='ovirt2'
MainThread::INFO::2014-10-31 16:56:30,969::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
MainThread::INFO::2014-10-31 16:56:31,248::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
MainThread::INFO::2014-10-31 16:56:41,274::states::441::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
MainThread::INFO::2014-10-31 16:56:41,275::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1414745801.28 type=state_transition detail=EngineDown-EngineDown hostname='ovirt2'
MainThread::INFO::2014-10-31 16:56:41,276::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
MainThread::INFO::2014-10-31 16:56:41,555::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
MainThread::INFO::2014-10-31 16:56:51,583::states::441::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
MainThread::INFO::2014-10-31 16:56:51,584::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1414745811.58 type=state_transition detail=EngineDown-EngineDown hostname='ovirt2'
MainThread::INFO::2014-10-31 16:56:51,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
MainThread::INFO::2014-10-31 16:56:51,864::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
MainThread::INFO::2014-10-31 16:57:01,897::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down and local host has best score (2400), attempting to start engine VM
MainThread::INFO::2014-10-31 16:57:01,898::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1414745821.9 type=state_transition detail=EngineDown-EngineStart hostname='ovirt2'
MainThread::INFO::2014-10-31 16:57:01,906::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineStart) sent? ignored
MainThread::INFO::2014-10-31 16:57:02,189::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineStart (score: 2400)
MainThread::CRITICAL::2014-10-31 16:57:02,207::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Could not start ha-agent
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 97, in run
self._run_agent()
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 154, in _run_agent
hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring()
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 307, in start_monitoring
for old_state, state, delay in self.fsm:
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", line 125, in next
new_data = self.refresh(self._state.data)
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 77, in refresh
stats.update(self.hosted_engine.collect_stats())
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 662, in collect_stats
constants.SERVICE_TYPE)
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 171, in get_stats_from_storage
result = self._checked_communicate(request)
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 199, in _checked_communicate
.format(message or response))
RequestError: Request failed: <type 'exceptions.OSError'>
[root@ovirt2 ~]# hosted-engine --vm-status
Traceback (most recent call last):
File "/usr/lib64/python2.6/runpy.py", line 122, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib64/python2.6/runpy.py", line 34, in _run_code
exec code in run_globals
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_setup/vm_status.py", line 111, in <module>
if not status_checker.print_status():
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_setup/vm_status.py", line 58, in print_status
all_host_stats = ha_cli.get_all_host_stats()
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 137, in get_all_host_stats
return self.get_all_stats(self.StatModes.HOST)
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 86, in get_all_stats
constants.SERVICE_TYPE)
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 171, in get_stats_from_storage
result = self._checked_communicate(request)
File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 199, in _checked_communicate
.format(message or response))
ovirt_hosted_engine_ha.lib.exceptions.RequestError: Request failed: <type 'exceptions.OSError'>
[root@ovirt2 ~]# service ovirt-ha-agent status
ovirt-ha-agent dead but subsys locked
Thanks,
Jaicel
----- Original Message -----
From: "Jiri Moskovcak" <jmoskovc(a)redhat.com>
To: "Jaicel" <jaicel(a)asti.dost.gov.ph>
Cc: "Niels de Vos" <ndevos(a)redhat.com>, "Vijay Bellur" <vbellur(a)redhat.com>, users(a)ovirt.org, "Gluster Devel" <gluster-devel(a)gluster.org>
Sent: Friday, October 31, 2014 11:05:32 PM
Subject: Re: [ovirt-users] Hosted-Engine HA problem
On 10/31/2014 10:26 AM, Jaicel wrote:
> i've increased the limit and then restarted agent and broker. status normalize, but then right now it went to "False" state again but still both having 2400 score. agent logs remains the same, with "ovirt-ha-agent dead but subsys locked" status. ha-broker logs below
>
> Thread-138::INFO::2014-10-31 17:24:22,981::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
> Thread-138::INFO::2014-10-31 17:24:22,991::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
> Thread-139::INFO::2014-10-31 17:24:38,385::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
> Thread-139::INFO::2014-10-31 17:24:38,395::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
> Thread-140::INFO::2014-10-31 17:24:53,816::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
> Thread-140::INFO::2014-10-31 17:24:53,827::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
> Thread-141::INFO::2014-10-31 17:25:09,172::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
> Thread-141::INFO::2014-10-31 17:25:09,182::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
> Thread-142::INFO::2014-10-31 17:25:24,551::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
> Thread-142::INFO::2014-10-31 17:25:24,562::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
>
> Thanks,
> Jaicel
ok, now it seems that broker runs fine, so I need the recent agent.log
to debug it more.
--Jirka
>
> ----- Original Message -----
> From: "Jiri Moskovcak" <jmoskovc(a)redhat.com>
> To: "Jaicel R. Sabonsolin" <jaicel(a)asti.dost.gov.ph>, "Niels de Vos" <ndevos(a)redhat.com>
> Cc: "Vijay Bellur" <vbellur(a)redhat.com>, users(a)ovirt.org, "Gluster Devel" <gluster-devel(a)gluster.org>
> Sent: Friday, October 31, 2014 4:32:02 PM
> Subject: Re: [ovirt-users] Hosted-Engine HA problem
>
> On 10/31/2014 03:53 AM, Jaicel R. Sabonsolin wrote:
>> Hi guys,
>>
>> these logs appear on both hosts just like the result of --vm-status. tried to tcpdump on ovirt hosts and gluster nodes but only packets exchange with my monitoring VM(zabbix) appeared.
>>
>> agent.log
>> new_data = self.refresh(self._state.data)
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 77, in refresh
>> stats.update(self.hosted_engine.collect_stats())
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 662, in collect_stats
>> constants.SERVICE_TYPE)
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 171, in get_stats_from_storage
>> result = self._checked_communicate(request)
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 199, in _checked_communicate
>> .format(message or response))
>> RequestError: Request failed: <type 'exceptions.OSError'>
>>
>> broker.log
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 165, in handle
>> response = "success " + self._dispatch(data)
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 261, in _dispatch
>> .get_all_stats_for_service_type(**options)
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/storage_broker.py", line 41, in get_all_stats_for_service_type
>> d = self.get_raw_stats_for_service_type(storage_dir, service_type)
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/storage_broker.py", line 74, in get_raw_stats_for_service_type
>> f = os.open(path, direct_flag | os.O_RDONLY)
>> OSError: [Errno 24] Too many open files: '/rhev/data-center/mnt/gluster1:_engine/6eb220be-daff-4785-8f78-111cc24139c4/ha_agent/hosted-engine.metadata'
>
> - ah, there we go ^^^^^^ you might need to tweak the limit of allowed
> open files as described here [1] or find the app keeps so many files open
>
>
> --Jirka
>
> [1]
> http://www.cyberciti.biz/faq/linux-increase-the-maximum-number-of-open-fi...
>
>> Thread-38160::INFO::2014-10-31 10:28:37,989::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
>> Thread-38161::INFO::2014-10-31 10:28:53,656::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
>> Thread-38161::ERROR::2014-10-31 10:28:53,657::listener::190::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Error handling request, data: 'get-stats storage_dir=/rhev/data-center/mnt/gluster1:_engine/6eb220be-daff-4785-8f78-111cc24139c4/ha_agent service_type=hosted-engine'
>> Traceback (most recent call last):
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 165, in handle
>> response = "success " + self._dispatch(data)
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 261, in _dispatch
>> .get_all_stats_for_service_type(**options)
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/storage_broker.py", line 41, in get_all_stats_for_service_type
>> d = self.get_raw_stats_for_service_type(storage_dir, service_type)
>> File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/storage_broker.py", line 74, in get_raw_stats_for_service_type
>> f = os.open(path, direct_flag | os.O_RDONLY)
>> OSError: [Errno 24] Too many open files: '/rhev/data-center/mnt/gluster1:_engine/6eb220be-daff-4785-8f78-111cc24139c4/ha_agent/hosted-engine.metadata'
>> Thread-38161::INFO::2014-10-31 10:28:53,658::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
>>
>> Thanks,
>> Jaicel
>>
>> ----- Original Message -----
>> From: "Niels de Vos" <ndevos(a)redhat.com>
>> To: "Vijay Bellur" <vbellur(a)redhat.com>
>> Cc: "Jiri Moskovcak" <jmoskovc(a)redhat.com>, "Jaicel R. Sabonsolin" <jaicel(a)asti.dost.gov.ph>, users(a)ovirt.org, "Gluster Devel" <gluster-devel(a)gluster.org>
>> Sent: Friday, October 31, 2014 4:11:25 AM
>> Subject: Re: [ovirt-users] Hosted-Engine HA problem
>>
>> On Thu, Oct 30, 2014 at 09:07:24PM +0530, Vijay Bellur wrote:
>>> On 10/30/2014 06:45 PM, Jiri Moskovcak wrote:
>>>> On 10/30/2014 09:22 AM, Jaicel R. Sabonsolin wrote:
>>>>> Hi Guys,
>>>>>
>>>>> I need help with my ovirt Hosted-Engine HA setup. I am running on 2
>>>>> ovirt hosts and 2 gluster nodes with replicated volumes. i already have
>>>>> VMs running on my hosts and they can migrate normally once i for example
>>>>> power off the host that they are running on. the problem is that the
>>>>> engine can't migrate once i switch off the host that hosts the engine.
>>>>>
>>>>> oVirt 3.4.3-1.el6
>>>>> KVM 0.12.1.2 - 2.415.el6_5.10
>>>>> LIBVIRT libvirt-0.10.2-29.el6_5.9
>>>>> VDSM vdsm-4.14.17-0.el6
>>>>>
>>>>>
>>>>> right now, i have this result from hosted-engine --vm-status.
>>>>>
>>>>> File "/usr/lib64/python2.6/runpy.py", line 122, in
>>>>> _run_module_as_main
>>>>> "__main__", fname, loader, pkg_name)
>>>>> File "/usr/lib64/python2.6/runpy.py", line 34, in _run_code
>>>>> exec code in run_globals
>>>>> File
>>>>>
>>>>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_setup/vm_status.py",
>>>>>
>>>>> line 111, in <module>
>>>>> if not status_checker.print_status():
>>>>> File
>>>>>
>>>>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_setup/vm_status.py",
>>>>>
>>>>> line 58, in print_status
>>>>> all_host_stats = ha_cli.get_all_host_stats()
>>>>> File
>>>>>
>>>>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py",
>>>>>
>>>>> line 137, in get_all_host_stats
>>>>> return self.get_all_stats(self.StatModes.HOST)
>>>>> File
>>>>>
>>>>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py",
>>>>>
>>>>> line 86, in get_all_stats
>>>>> constants.SERVICE_TYPE)
>>>>> File
>>>>>
>>>>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
>>>>>
>>>>> line 171, in get_stats_from_storage
>>>>> result = self._checked_communicate(request)
>>>>> File
>>>>>
>>>>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
>>>>>
>>>>> line 199, in _checked_communicate
>>>>> .format(message or response))
>>>>> ovirt_hosted_engine_ha.lib.exceptions.RequestError: Request failed:
>>>>> <type 'exceptions.OSError'>
>>>>>
>>>>>
>>>>> restarting ha-broker and ha-agent normalizes the status but eventually
>>>>> it would become "false" and then return to the result above. hope you
>>>>> guys could help me with this.
>>>>>
>>>>
>>>> Hi Jaicel,
>>>> please attach agent.log and broker.log from the host where you trying to
>>>> run hosted-engine --vm-status. I have a feeling that you ran into a
>>>> known problem on gluster - stalled file descriptor, in that case the
>>>> only known solution at this time is to restart the broker & agent as you
>>>> have already found out.
>>>>
>>>
>>> Adding Niels and gluster-devel to troubleshoot from Gluster NFS perspective.
>>
>> I'd welcome any details on this "stalled file descriptor" problem. Is
>> there a bug filed with some details like logs, sysrq-t and maybe even
>> tcpdumps? If there is an easy way to reproduce this behaviour, I can
>> surely look into it and hopefully come up with some advise or fix.
>>
>> Thanks,
>> Niels
>>
10 years
q35 machine support?
by Paul Jansen
---360795340-209196801-1414977774=:40763
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
<SNIP>=0A> > > After doing some more searching I came across these two page=
s:=0A> > > http://www.ovirt.org/Cluster_emulation_modes=0A> > > http://www.=
ovirt.org/Features/Cluster_parameters_override=0A> > >=0A> > > It sounds li=
ke this may allow me to achieve what I've described above.=0A> > > From wha=
t I can tell the 'emulated machine type' is tied to the ovirt cluster =0A> =
> > level - ie: 3.5.=0A> > >=0A> >=0A> > you can switch q35 with pc-1.0 in =
ClusterEmulatedMachines config value for =0A> > version 3.5=0A> Thanks Paul=
for asking and Roy for answering. I thought q35 would be the=0A> default a=
nyway the whole time ;)=0A> >=0A> > engine-config -s ClusterEmulatedMach=
ines=3D"q35,rhel6.5.0"=0A> >=0A> > then create a new cluster and add that h=
ost to it. once the host is up this =0A> > emulation mode should be set.=0A=
> >=0A> > in 3.6 you'd be able to choose an emulation mode per VM.=0A> Paul=
, since this is really useful would you mind to open an RFE in BZ=0A> and p=
ost the link here, so we can keep track of this feature?=0A=0AHi Daniel.=0A=
Sorry for the late reply on this.=0AI'm happy that this feature is currentl=
y documented in the wiki pages that I'd referenced above and is on the feat=
ure plan for 3.6.=0AThe workaround that was specified does what I need for =
now.=0AProper support in 3.6 will need to consider some other things, such =
as allowing attaching of disks to the sata interface on the q35 machine.=0A=
3.5s current workflow doesn't provide a way to cater for that. Perhaps all=
owing atachign 'virtio-scsi disks to this interface woudl work fine, but th=
en there's issue with the naming.=0AAdditionally, there have been issues re=
ported with live migration of machines that have the ICH9-AHCI controller e=
nabled.=0AAny RFE should handle these multifaceted issues - and others I'm =
not aware of - so given I don't understand all the ins and outs I'd prefer =
not to raise this.=0AI'd be interested to hear Sandro's take on how this sh=
ould likely proceed though.
---360795340-209196801-1414977774=:40763
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable
<html><body><div style=3D"color:#000; background-color:#fff; font-family:He=
lveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, Sans-Serif;fo=
nt-size:12px"><div style=3D"" class=3D""><SNIP><br style=3D"" class=
=3D"">> > > After doing some more searching I came across these tw=
o pages:<br style=3D"" class=3D"">> > > http://www.ovirt.org/Clust=
er_emulation_modes<br style=3D"" class=3D"">> > > http://www.ovirt=
.org/Features/Cluster_parameters_override<br style=3D"" class=3D"">> >=
; ><br style=3D"" class=3D"">> > > It sounds like this may allo=
w me to achieve what I've described above.<br style=3D"" class=3D"">> &g=
t; > From what I can tell the 'emulated machine type' is tied to the ovi=
rt cluster <br style=3D"" class=3D"">> > > level - ie: 3.5.<br sty=
le=3D"" class=3D"">> > ><br style=3D"" class=3D"">> ><br sty=
le=3D"" class=3D"">> > you can switch q35 with pc-1.0 in ClusterEmula=
tedMachines config value for <br style=3D""
class=3D"">> > version 3.5<br style=3D"" class=3D"">> Thanks Paul=
for asking and Roy for answering. I thought q35 would be the<br style=3D""=
class=3D"">> default anyway the whole time ;)<br style=3D"" class=3D"">=
> ><br style=3D"" class=3D"">> > engine-confi=
g -s ClusterEmulatedMachines=3D"q35,rhel6.5.0"<br style=3D"" class=3D"">>=
; ><br style=3D"" class=3D"">> > then create a new cluster and add=
that host to it. once the host is up this <br style=3D"" class=3D"">> &=
gt; emulation mode should be set.<br style=3D"" class=3D"">> ><br sty=
le=3D"" class=3D"">> > in 3.6 you'd be able to choose an emulation mo=
de per VM.<br style=3D"" class=3D"">> Paul, since this is really useful =
would you mind to open an RFE in BZ<br style=3D"" class=3D"">> and post =
the link here, so we can keep track of this feature?<br style=3D"" class=3D=
""><br style=3D"" class=3D"">Hi Daniel.<br style=3D"" class=3D"">Sorry for =
the late reply on this.<br style=3D"" class=3D"">I'm
happy that this feature is currently documented in the wiki pages that I'd=
referenced above and is on the feature plan for 3.6.<br style=3D"" class=
=3D"">The workaround that was specified does what I need for now.<br style=
=3D"" class=3D"">Proper support in 3.6 will need to consider some other thi=
ngs, such as allowing attaching of disks to the sata interface on the q35 m=
achine.<br style=3D"" class=3D"">3.5s current workflow doesn't provide a wa=
y to cater for that. Perhaps allowing atachign 'virtio-scsi disks to =
this interface woudl work fine, but then there's issue with the naming.<br =
style=3D"" class=3D"">Additionally, there have been issues reported with li=
ve migration of machines that have the ICH9-AHCI controller enabled.<br sty=
le=3D"" class=3D"">Any RFE should handle these multifaceted issues - and ot=
hers I'm not aware of - so given I don't understand all the ins and outs I'=
d prefer not to raise this.<br style=3D"" class=3D"">I'd be interested to h=
ear Sandro's take on
how this should likely proceed though.<br style=3D"" class=3D""><br style=
=3D"" class=3D""></div><div style=3D"" class=3D""><br style=3D"" class=3D""=
></div></div></body></html>
---360795340-209196801-1414977774=:40763--
10 years
Understanding Cluster / Datacenter upgrades
by Daniel Helgenberger
Hello,
I seem to have some issues understating what and when something happens
if I change a cluster or datacenter to a higher version after upgrading
engine.
Maybe somebody could help me understand how this works in general and
when features will get enabled? If possible, pinpoint it to concrete
features added in 3.5.
My assumptions learned form experience so far, upgrading oVirt 3.4 to
3.5; please correct if wrong:
- New features are enabled if I set the cluster compat version to a
newer version after upgrade
- Prior to upgrading a datacenter all cluster need to run the higher
version (seems logical).
- This involves Engine database updates (?) and, more crucial, it will
change settings and data on the storage domains.
- Because of that, downgrade is not possible any more
- Also, its usually safer to keep the old cluster version while using a
newer engine version; because it is more likely to run into regressions
with an upgraded datacenter (see regression blockers for oVirt 3.5.1).
My questions so far:
- What happens if I only upgrade the cluster and *not* yet the datacenter?
- In case of 3.5; exactly when could I have used the new NUMA
management? I assume after upgrading the cluster?
- In case of 3.5; exactly when could I have used the new QoS settings
(like disk profiles) - here I assume after upgrading the datacenter?
If the the case of NUMA policy is not true but happens only after
upgrading the datacenter, what is the purpose of the cluster compat
version setting? I can think of making sure a certain minimum VDSM
version is running?
Thanks a million,
--
Daniel Helgenberger
m box bewegtbild GmbH
P: +49/30/2408781-22
F: +49/30/2408781-10
ACKERSTR. 19
D-10115 BERLIN
www.m-box.de www.monkeymen.tv
Geschäftsführer: Martin Retschitzegger / Michaela Göllner
Handeslregister: Amtsgericht Charlottenburg / HRB 112767
10 years