9:20 a.m.
This is a multi-part message in MIME format.
------=_NextPartTM-000-9fe6758f-1f20-44e4-a5a7-2c9b16fc854b
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Von: Roy Golan [rgolan(a)redhat.com]=0A=
Gesendet: Donnerstag, 12. September 2013 15:58=0A=
An: Markus Stockhausen=0A=
Betreff: Re: [Users] single VM disappeared=0A=
=0A=
On Thu 12 Sep 2013 02:57:13 PM IDT, Markus Stockhausen wrote:=0A=
> Hello,=0A=
>=0A=
> continuing with my 3.3 error series. I just lost one of my VMs after=0A=
> restart of ovirt-engine. The things I remember are:=0A=
>=0A=
> - The machine was up and running.=0A=
> - I changed the cluster cpu from penryn to nehalem=0A=
> - Machine was stopped=0A=
> - Restart failed with error in ovirt-engine.log=0A=
>=0A=
> Failed creating vm win2k3std_de in vds =3D=0A=
> 30b9bd7e-ea05-4910-85a7-f014ba8a8bab :=0A=
> colovn1 error =3D=0A=
> org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:=0A=
> org.apache.xmlrpc.common.XmlRpcExtensionException:=0A=
> Null values aren't supported, if isEnabledForExtensions() =3D=3D false=
=0A=
>=0A=
> - Without any idea how to solve the error I restarted ovirt-engine=0A=
> - Now Machine is missing=0A=
> - Error log reads=0A=
>=0A=
> Correlation ID: 2c29cebd, Call Stack: null, Custom=0A=
> Event ID: -1, Message: Failed to import Vm win2k3std_de to=0A=
> Data Center Collogia, Cluster Produktion=0A=
>=0A=
> I uploaded the engine.log to http://pastebin.com/sHspGTgy=0A=
>=0A=
> Markus=0A=
>=0A=
>=0A=
> _______________________________________________=0A=
> Users mailing list=0A=
> Users(a)ovirt.org=0A=
> http://lists.ovirt.org/mailman/listinfo/users=0A=
=0A=
I think thats an emulated machine problem which I'm just takin care of.=
=0A=
=0A=
to check:=0A=
=0A=
go to cluster, select your cluster, got to the genral subtab and check=0A=
what is "emulated machine" value=0A=
I guess its null. to make it work,=0A=
1.take one of your host which belongs to that cluster to maintenance=0A=
2.activate it back.=0A=
3. check the emulated machine value is set now=0A=
=0A=
cause:=0A=
Bug https://bugzilla.redhat.com/1004695=0A=
Editing the cluster nullify the emulated machine value=0A=
=0A=
Roy=0A=
=0A=
Hello,=0A=
=0A=
thanks for helping me through that minefield. Ok here are the results =0A=
when following your guide.=0A=
=0A=
- Emulated machine: pc-1.0=0A=
- maintenance/activate one node of the cluster:=0A=
- Emulated machine is still: pc-1.0=0A=
=0A=
I guess that is nothing you wanted to see. So I changed the CPU=0A=
type of the cluster and was able to understand what you think of. =0A=
The emulated machine will go blank. After reactivating a node=0A=
the value goes back to pc-1.0=0A=
=0A=
I played with the cluster settings in between and cannot say if the=0A=
value was empty when the error occured. Just in case the emulated =0A=
machine value was empty during restart of ovirt-engine. Did I loose =0A=
the machine because of that? As I'm testing that is no problem but =0A=
I want to make sure if I can recover from that situation in any way.=0A=
=0A=
Best regards.=0A=
=0A=
Markus=0A=
=0A=
=0A=
------=_NextPartTM-000-9fe6758f-1f20-44e4-a5a7-2c9b16fc854b
Content-Type: text/plain;
name="InterScan_Disclaimer.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
filename="InterScan_Disclaimer.txt"
****************************************************************************
Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte
Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail
irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und
vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte
Weitergabe dieser Mail ist nicht gestattet.
Über das Internet versandte E-Mails können unter fremden Namen erstellt oder
manipuliert werden. Deshalb ist diese als E-Mail verschickte Nachricht keine
rechtsverbindliche Willenserklärung.
Collogia
Unternehmensberatung AG
Ubierring 11
D-50678 Köln
Vorstand:
Kadir Akin
Dr. Michael Höhnerbach
Vorsitzender des Aufsichtsrates:
Hans Kristian Langva
Registergericht: Amtsgericht Köln
Registernummer: HRB 52 497
This e-mail may contain confidential and/or privileged information. If you
are not the intended recipient (or have received this e-mail in error)
please notify the sender immediately and destroy this e-mail. Any
unauthorized copying, disclosure or distribution of the material in this
e-mail is strictly forbidden.
e-mails sent over the internet may have been written under a wrong name or
been manipulated. That is why this message sent as an e-mail is not a
legally binding declaration of intention.
Collogia
Unternehmensberatung AG
Ubierring 11
D-50678 Köln
executive board:
Kadir Akin
Dr. Michael Höhnerbach
President of the supervisory board:
Hans Kristian Langva
Registry office: district court Cologne
Register number: HRB 52 497
****************************************************************************
------=_NextPartTM-000-9fe6758f-1f20-44e4-a5a7-2c9b16fc854b--
10:11 a.m.
New subject: [Users] single VM disappeared
On 09/12/2013 05:20 PM, Markus Stockhausen wrote:
> Von: Roy Golan [rgolan(a)redhat.com]
> Gesendet: Donnerstag, 12. September 2013 15:58
> An: Markus Stockhausen
> Betreff: Re: [Users] single VM disappeared
>
> On Thu 12 Sep 2013 02:57:13 PM IDT, Markus Stockhausen wrote:
>> Hello,
>>
>> continuing with my 3.3 error series. I just lost one of my VMs after
>> restart of ovirt-engine. The things I remember are:
>>
>> - The machine was up and running.
>> - I changed the cluster cpu from penryn to nehalem
here the emulated
machine nullified.
>> - Machine was stopped
>> - Restart failed with error in ovirt-engine.log
>>
>> Failed creating vm win2k3std_de in vds =
>> 30b9bd7e-ea05-4910-85a7-f014ba8a8bab :
>> colovn1 error =
>> org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
>> org.apache.xmlrpc.common.XmlRpcExtensionException:
>> Null values aren't supported, if isEnabledForExtensions() == false
>>
>> - Without any idea how to solve the error I restarted ovirt-engine
>> - Now Machine is missing
>> - Error log reads
>>
>> Correlation ID: 2c29cebd, Call Stack: null, Custom
>> Event ID: -1, Message: Failed to import Vm win2k3std_de to
>> Data Center Collogia, Cluster Produktion
>>
>> I uploaded the engine.log tohttp://pastebin.com/sHspGTgy
>>
>> Markus
>>
>>
>> _______________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
> I think thats an emulated machine problem which I'm just takin care of.
>
> to check:
>
> go to cluster, select your cluster, got to the genral subtab and check
> what is "emulated machine" value
> I guess its null. to make it work,
> 1.take one of your host which belongs to that cluster to maintenance
> 2.activate it back.
> 3. check the emulated machine value is set now
>
> cause:
> Bughttps://bugzilla.redhat.com/1004695
> Editing the cluster nullify the emulated machine value
>
> Roy
Hello,
thanks for helping me through that minefield. Ok here are the results
when following your guide.
please provide the output of:
psql engine postgres -c "select * from async_tasks;"
- Emulated machine: pc-1.0
right, you restart the engine so the host already was
reactivated so
this is actually expected.
- maintenance/activate one node of the cluster:
- Emulated machine is still: pc-1.0
I guess that is nothing you wanted to see. So I changed the CPU
type of the cluster and was able to understand what you think of.
The emulated machine will go blank. After reactivating a node
the value goes back to pc-1.0
I played with the cluster settings in between and cannot say if the
value was empty when the error occured. Just in case the emulated
machine value was empty during restart of ovirt-engine. Did I loose
the machine because of that?
no this can't lead to that but the restart of
ovirt can.
Yair, seems like importVM task is still in the DB after an engine
restart during run VM fail.
As I'm testing that is no problem but
I want to make sure if I can recover from that situation in any way.
Best regards.
Markus
3:27 p.m.
New subject: [Users] single VM disappeared
This is a multi-part message in MIME format.
------=_NextPartTM-000-0c3b3637-12e0-4981-9cfa-170d77dbdd4d
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
please provide the output of:=0A=
=0A=
psql engine postgres -c "select * from async_tasks;"=0A=
=0A=
Ok, this is going really crazy now. We are talking about two errors =0A=
that occured at nearly the same time. The first one is what you=0A=
described. The bug on the CPU pane prohibits me from starting the=0A=
VM because "Emulated machine" is empty. No problem with that=0A=
I have a workaround.=0A=
=0A=
But now to the other bug. Took me quite some time to reproduce=0A=
it. But the setup is very simple. =0A=
=0A=
1) Import a VM from an export domain into the cluster. =0A=
2) Wait for the successful finished message=0A=
3) See the machine in the VM overview of the cluster=0A=
Everything looks fine (vm, disks, ...)=0A=
4) stop and start cluster=0A=
5) machine is missing=0A=
6) cluster spits failure messages=0A=
=0A=
Have a look:=0A=
=0A=
2013-Sep-12, 22:07 Failed to import Vm win2k3std_de to Data Center Collogia=
, Cluster Produktion=0A=
2013-Sep-12, 22:07 Failed to import Vm win2k3std_de to Data Center Collogia=
, Cluster Produktion=0A=
2013-Sep-12, 22:07 User admin@internal logged out.=0A=
2013-Sep-12, 22:07 Storage Pool Manager runs on Host colovn1 (Address: 192.=
168.10.51).=0A=
2013-Sep-12, 22:07 Data Center is being initialized, please wait for initia=
lization to complete.=0A=
2013-Sep-12, 22:07 State was set to Up for host colovn1.=0A=
2013-Sep-12, 22:07 State was set to Up for host colovn3.=0A=
2013-Sep-12, 22:03 Vm win2k3std_de was imported successfully to Data Center=
Collogia, Cluster Produktion=0A=
2013-Sep-12, 22:01 Used Network resources of host colovn1 [100%] exceeded d=
efined threshold [95%].=0A=
2013-Sep-12, 22:01 Starting to import Vm win2k3std_de to Data Center Collog=
ia, Cluster Produktion=0A=
2013-Sep-12, 22:01 VM win2k3std_de was successfully removed.=0A=
=0A=
Reproducing the issue two times was no problem. The=0A=
content of async_tasks during downtime of the engine=0A=
is 600k. If you need this log because you cannot reproduce =0A=
the bug yourself please do not hestitate to contact me.=0A=
=0A=
Markus=0A=
------=_NextPartTM-000-0c3b3637-12e0-4981-9cfa-170d77dbdd4d
Content-Type: text/plain;
name="InterScan_Disclaimer.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
filename="InterScan_Disclaimer.txt"
****************************************************************************
Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte
Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail
irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und
vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte
Weitergabe dieser Mail ist nicht gestattet.
Über das Internet versandte E-Mails können unter fremden Namen erstellt oder
manipuliert werden. Deshalb ist diese als E-Mail verschickte Nachricht keine
rechtsverbindliche Willenserklärung.
Collogia
Unternehmensberatung AG
Ubierring 11
D-50678 Köln
Vorstand:
Kadir Akin
Dr. Michael Höhnerbach
Vorsitzender des Aufsichtsrates:
Hans Kristian Langva
Registergericht: Amtsgericht Köln
Registernummer: HRB 52 497
This e-mail may contain confidential and/or privileged information. If you
are not the intended recipient (or have received this e-mail in error)
please notify the sender immediately and destroy this e-mail. Any
unauthorized copying, disclosure or distribution of the material in this
e-mail is strictly forbidden.
e-mails sent over the internet may have been written under a wrong name or
been manipulated. That is why this message sent as an e-mail is not a
legally binding declaration of intention.
Collogia
Unternehmensberatung AG
Ubierring 11
D-50678 Köln
executive board:
Kadir Akin
Dr. Michael Höhnerbach
President of the supervisory board:
Hans Kristian Langva
Registry office: district court Cologne
Register number: HRB 52 497
****************************************************************************
------=_NextPartTM-000-0c3b3637-12e0-4981-9cfa-170d77dbdd4d--
4:21 p.m.
New subject: [Users] single VM disappeared
On 12 Sep 2013, at 21:27, Markus Stockhausen <stockhausen(a)collogia.de> wrote:
> please provide the output of:
>
> psql engine postgres -c "select * from async_tasks;"
Ok, this is going really crazy now. We are talking about two errors
that occured at nearly the same time. The first one is what you
described. The bug on the CPU pane prohibits me from starting the
VM because "Emulated machine" is empty. No problem with that
I have a workaround.
But now to the other bug. Took me quite some time to reproduce
it. But the setup is very simple.
1) Import a VM from an export domain into the cluster.
2) Wait for the successful finished message
3) See the machine in the VM overview of the cluster
Everything looks fine (vm, disks, ...)
4) stop and start cluster
5) machine is missing
6) cluster spits failure messages
This exact thing is happening to me. I'm trying to import oVirt 3.2 VM's from an
export domain. The import is successful, to the point I can fire up the VM's.
Restart ovirt-engine and the VM is gone. Prior to the latest ovirt-engine update, only
the VM container was removed and the disk remained. Since updating to
ovirt-engine-3.3.0-3.el6.noarch a few moments ago, the container still gets removed, but
now the disk is gone too!
CentOS 6.4 x86_64 / oVirt 3.3
12:56 a.m.
New subject: [Users] single VM disappeared
This is a multi-part message in MIME format.
------=_NextPartTM-000-2b3a5f67-7363-4253-a0b9-0965121deba6
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
This exact thing is happening to me. I'm trying to import oVirt
3.2 VM's=
from an export domain. The import is successful, to the point I can
fire =
up the VM's.=0A=
=0A=
Restart ovirt-engine and the VM is gone. Prior to the latest ovirt-engin=
e
update, only the VM container was removed and the disk remained. Since u=
pdating > to ovirt-engine-3.3.0-3.el6.noarch a few moments ago, the contain=
er still gets removed, but now the disk is gone too!=0A=
=0A=
CentOS 6.4 x86_64 / oVirt 3.3=0A=
_______________________________________________=0A=
Users mailing list=0A=
Users(a)ovirt.org=0A=
http://lists.ovirt.org/mailman/listinfo/users=0A=
=0A=
Two people facing the same issue so I opened a ticket. I opted to set the s=
everity to high.=0A=
=0A=
Markus=0A=
------=_NextPartTM-000-2b3a5f67-7363-4253-a0b9-0965121deba6
Content-Type: text/plain;
name="InterScan_Disclaimer.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
filename="InterScan_Disclaimer.txt"
****************************************************************************
Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte
Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail
irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und
vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte
Weitergabe dieser Mail ist nicht gestattet.
Über das Internet versandte E-Mails können unter fremden Namen erstellt oder
manipuliert werden. Deshalb ist diese als E-Mail verschickte Nachricht keine
rechtsverbindliche Willenserklärung.
Collogia
Unternehmensberatung AG
Ubierring 11
D-50678 Köln
Vorstand:
Kadir Akin
Dr. Michael Höhnerbach
Vorsitzender des Aufsichtsrates:
Hans Kristian Langva
Registergericht: Amtsgericht Köln
Registernummer: HRB 52 497
This e-mail may contain confidential and/or privileged information. If you
are not the intended recipient (or have received this e-mail in error)
please notify the sender immediately and destroy this e-mail. Any
unauthorized copying, disclosure or distribution of the material in this
e-mail is strictly forbidden.
e-mails sent over the internet may have been written under a wrong name or
been manipulated. That is why this message sent as an e-mail is not a
legally binding declaration of intention.
Collogia
Unternehmensberatung AG
Ubierring 11
D-50678 Köln
executive board:
Kadir Akin
Dr. Michael Höhnerbach
President of the supervisory board:
Hans Kristian Langva
Registry office: district court Cologne
Register number: HRB 52 497
****************************************************************************
------=_NextPartTM-000-2b3a5f67-7363-4253-a0b9-0965121deba6--
3884
days inactive
3885
days old
4 comments
3 participants
participants (3)
-
James Wilson -
Markus Stockhausen -
Roy Golan