[Users] All VMs disappeared
Jakub Bittner
j.bittner at nbu.cz
Fri Aug 23 08:32:47 UTC 2013
Dne 23.8.2013 10:24, Jakub Bittner napsal(a):
> Dne 14.8.2013 18:04, j.bittner at nbu.cz napsal(a):
>> Cituji "Laszlo Hornyak" <lhornyak at redhat.com>:
>>
>>>
>>>
>>> ----- Original Message -----
>>>> From: "Itamar Heim" <iheim at redhat.com>
>>>> To: "Jakub Bittner" <j.bittner at nbu.cz>
>>>> Cc: "Michal Skrivanek" <mskrivan at redhat.com>, users at ovirt.org
>>>> Sent: Wednesday, August 14, 2013 4:27:17 PM
>>>> Subject: Re: [Users] All VMs disappeared
>>>>
>>>> On 08/14/2013 05:19 PM, Jakub Bittner wrote:
>>>> > Dne 14.8.2013 10:48, Jakub Bittner napsal(a):
>>>> >> Dne 14.8.2013 09:57, Liron Aravot napsal(a):
>>>> >>> Jakub, are only your vms disappear? what about the disks?
>>>> >>>
>>>> >>> ----- Original Message -----
>>>> >>>> From: "Laszlo Hornyak" <lhornyak at redhat.com>
>>>> >>>> To: "Jakub Bittner" <j.bittner at nbu.cz>
>>>> >>>> Cc: users at ovirt.org
>>>> >>>> Sent: Wednesday, August 14, 2013 10:39:48 AM
>>>> >>>> Subject: Re: [Users] All VMs disappeared
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>>> ----- Original Message -----
>>>> >>>>> From: "Jakub Bittner" <j.bittner at nbu.cz>
>>>> >>>>> To: users at ovirt.org
>>>> >>>>> Sent: Wednesday, August 14, 2013 8:09:45 AM
>>>> >>>>> Subject: Re: [Users] All VMs disappeared
>>>> >>>>>
>>>> >>>>> Dne 13.8.2013 18:29, Laszlo Hornyak napsal(a):
>>>> >>>>>> Ahoj Jakub,
>>>> >>>>>>
>>>> >>>>>> Just one more idea: could you turn statement logging on in
>>>> postgresql
>>>> >>>>>> before you try again?
>>>> >>>>>> It is in /var/lib/pgsql/data/postgresql.conf
>>>> >>>>>> log_statement = 'all'
>>>> >>>>>>
>>>> >>>>>>
>>>> >>>>>> ----- Original Message -----
>>>> >>>>>>> From: "Jakub Bittner" <j.bittner at nbu.cz>
>>>> >>>>>>> To: "Itamar Heim" <iheim at redhat.com>
>>>> >>>>>>> Cc: users at ovirt.org
>>>> >>>>>>> Sent: Tuesday, August 13, 2013 5:20:29 PM
>>>> >>>>>>> Subject: Re: [Users] All VMs disappeared
>>>> >>>>>>>
>>>> >>>>>>> Dne 13.8.2013 17:02, Itamar Heim napsal(a):
>>>> >>>>>>>> On 08/13/2013 05:31 PM, Jakub Bittner wrote:
>>>> >>>>>>>>> Dne 13.8.2013 15:39, Itamar Heim napsal(a):
>>>> >>>>>>>>>> On 08/13/2013 08:50 AM, Jakub Bittner wrote:
>>>> >>>>>>>>>>> Dne 12.8.2013 22:44, Itamar Heim napsal(a):
>>>> >>>>>>>>>>>> On 08/12/2013 06:59 PM, Jakub Bittner wrote:
>>>> >>>>>>>>>>>>> Dne 12.8.2013 14:54, Jakub Bittner napsal(a):
>>>> >>>>>>>>>>>>>> Dne 12.8.2013 14:29, Laszlo Hornyak napsal(a):
>>>> >>>>>>>>>>>>>>> I looked around Noam's patch and that should not
>>>> cause such
>>>> >>>>>>>>>>>>>>> behavior.
>>>> >>>>>>>>>>>>>>> I am wondering how that lost VM's could happen.
>>>> >>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>> Jakub, can you give a more detailed description
>>>> what you
>>>> >>>>>>>>>>>>>>> were
>>>> >>>>>>>>>>>>>>> doing
>>>> >>>>>>>>>>>>>>> with oVirt when this happened? Maybe the bug is
>>>> still there.
>>>> >>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>> Thank you,
>>>> >>>>>>>>>>>>>>> Laszlo
>>>> >>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>> ----- Original Message -----
>>>> >>>>>>>>>>>>>>>> From: "Greg Sheremeta" <gshereme at redhat.com>
>>>> >>>>>>>>>>>>>>>> To: "Laszlo Hornyak" <lhornyak at redhat.com>
>>>> >>>>>>>>>>>>>>>> Cc: "Jakub Bittner" <j.bittner at nbu.cz>, "Noam
>>>> Slomianko"
>>>> >>>>>>>>>>>>>>>> <nslomian at redhat.com>, users at ovirt.org
>>>> >>>>>>>>>>>>>>>> Sent: Monday, August 12, 2013 1:23:40 PM
>>>> >>>>>>>>>>>>>>>> Subject: Re: [Users] All VMs disappeared
>>>> >>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>> Not the one I fixed, 987907. It was a simple UI
>>>> >>>>>>>>>>>>>>>> NullPointerException.
>>>> >>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>> Greg
>>>> >>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>> ----- Original Message -----
>>>> >>>>>>>>>>>>>>>>> From: "Laszlo Hornyak" <lhornyak at redhat.com>
>>>> >>>>>>>>>>>>>>>>> To: "Jakub Bittner" <j.bittner at nbu.cz>, "Noam
>>>> Slomianko"
>>>> >>>>>>>>>>>>>>>>> <nslomian at redhat.com>, "Greg Sheremeta"
>>>> >>>>>>>>>>>>>>>>> <gshereme at redhat.com>
>>>> >>>>>>>>>>>>>>>>> Cc: users at ovirt.org
>>>> >>>>>>>>>>>>>>>>> Sent: Monday, August 12, 2013 7:21:26 AM
>>>> >>>>>>>>>>>>>>>>> Subject: Re: [Users] All VMs disappeared
>>>> >>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>> Well if they are no longer in DB then that
>>>> explains why
>>>> >>>>>>>>>>>>>>>>> the
>>>> >>>>>>>>>>>>>>>>> exception no
>>>> >>>>>>>>>>>>>>>>> longer occurs, but at the cost of database
>>>> corruption.
>>>> >>>>>>>>>>>>>>>>> Noam and Greg, can these bugs cause data corruption?
>>>> >>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>> Thank you,
>>>> >>>>>>>>>>>>>>>>> Laszlo
>>>> >>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>> ----- Original Message -----
>>>> >>>>>>>>>>>>>>>>>> From: "Jakub Bittner" <j.bittner at nbu.cz>
>>>> >>>>>>>>>>>>>>>>>> To: "Greg Sheremeta" <gshereme at redhat.com>
>>>> >>>>>>>>>>>>>>>>>> Cc: users at ovirt.org, "Laszlo Hornyak"
>>>> >>>>>>>>>>>>>>>>>> <lhornyak at redhat.com>
>>>> >>>>>>>>>>>>>>>>>> Sent: Monday, August 12, 2013 9:05:09 AM
>>>> >>>>>>>>>>>>>>>>>> Subject: Re: [Users] All VMs disappeared
>>>> >>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>> Dne 10.8.2013 01:54, Greg Sheremeta napsal(a):
>>>> >>>>>>>>>>>>>>>>>>> It could also be this bug[1], for which I just
>>>> >>>>>>>>>>>>>>>>>>> submitted a
>>>> >>>>>>>>>>>>>>>>>>> fix.
>>>> >>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>> [1]
>>>> https://bugzilla.redhat.com/show_bug.cgi?id=987907
>>>> >>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>> You can work around it by typing just "VMs:"
>>>> (without
>>>> >>>>>>>>>>>>>>>>>>> the
>>>> >>>>>>>>>>>>>>>>>>> quotes) in
>>>> >>>>>>>>>>>>>>>>>>> the
>>>> >>>>>>>>>>>>>>>>>>> search bar.
>>>> >>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>> Greg
>>>> >>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>> ----- Original Message -----
>>>> >>>>>>>>>>>>>>>>>>>> From: "Laszlo Hornyak" <lhornyak at redhat.com>
>>>> >>>>>>>>>>>>>>>>>>>> To: "Jakub Bittner" <j.bittner at nbu.cz>
>>>> >>>>>>>>>>>>>>>>>>>> Cc: users at ovirt.org
>>>> >>>>>>>>>>>>>>>>>>>> Sent: Friday, August 9, 2013 11:21:26 AM
>>>> >>>>>>>>>>>>>>>>>>>> Subject: Re: [Users] All VMs disappeared
>>>> >>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>> Hi Jakub,
>>>> >>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>> Could you check through DB or REST-API if the
>>>> VM's
>>>> >>>>>>>>>>>>>>>>>>>> are in
>>>> >>>>>>>>>>>>>>>>>>>> your
>>>> >>>>>>>>>>>>>>>>>>>> DB?
>>>> >>>>>>>>>>>>>>>>>>>> select * from vm_static;
>>>> >>>>>>>>>>>>>>>>>>>> or
>>>> >>>>>>>>>>>>>>>>>>>> curl -u admin at internal:blablabla
>>>> [engine-url]api/vms
>>>> >>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>> It seems Noam fixed this issue already in
>>>> >>>>>>>>>>>>>>>>>>>> c2295c31fa645e1ba1b94cd557bd1fecb40c8829.
>>>> >>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>> Thank you,
>>>> >>>>>>>>>>>>>>>>>>>> Laszlo
>>>> >>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>> ----- Original Message -----
>>>> >>>>>>>>>>>>>>>>>>>>> From: "Jakub Bittner" <j.bittner at nbu.cz>
>>>> >>>>>>>>>>>>>>>>>>>>> To: users at ovirt.org
>>>> >>>>>>>>>>>>>>>>>>>>> Sent: Friday, August 9, 2013 1:06:53 PM
>>>> >>>>>>>>>>>>>>>>>>>>> Subject: Re: [Users] All VMs disappeared
>>>> >>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>> Dne 9.8.2013 09:48, Jakub Bittner napsal(a):
>>>> >>>>>>>>>>>>>>>>>>>>>> Hello,
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> Iam running ovirt 3.3.0.beta1 on centos 6,4 and
>>>> >>>>>>>>>>>>>>>>>>>>>> all our
>>>> >>>>>>>>>>>>>>>>>>>>>> VMs
>>>> >>>>>>>>>>>>>>>>>>>>>> disappeared from VMs tab. Nodes running on
>>>> centos
>>>> >>>>>>>>>>>>>>>>>>>>>> too.
>>>> >>>>>>>>>>>>>>>>>>>>>> Repeating
>>>> >>>>>>>>>>>>>>>>>>>>>> problem in log is:
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> 2013-08-09 09:44:24,203 WARN
>>>> >>>>>>>>>>>>>>>>>>>>>> [org.ovirt.engine.core.vdsbroker.VdsManager]
>>>> >>>>>>>>>>>>>>>>>>>>>> (DefaultQuartzScheduler_Worker-45) Failed to
>>>> >>>>>>>>>>>>>>>>>>>>>> refresh VDS
>>>> >>>>>>>>>>>>>>>>>>>>>> ,
>>>> >>>>>>>>>>>>>>>>>>>>>> vds =
>>>> >>>>>>>>>>>>>>>>>>>>>> 7cb6aedf-47bc-40b0-877f-2a537fca5c64 :
>>>> >>>>>>>>>>>>>>>>>>>>>> node2.x.com, error
>>>> >>>>>>>>>>>>>>>>>>>>>> =
>>>> >>>>>>>>>>>>>>>>>>>>>> java.lang.NullPointerException, continuing.:
>>>> >>>>>>>>>>>>>>>>>>>>>> java.lang.NullPointerException
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.proceedGuaranteedMemoryCheck(VdsUpdateRunTimeInfo.java:1313)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:968)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:542)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:383)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:237)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> sun.reflect.GeneratedMethodAccessor171.invoke(Unknown
>>>> >>>>>>>>>>>>>>>>>>>>>> Source) [:1.7.0_25]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [rt.jar:1.7.0_25]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> java.lang.reflect.Method.invoke(Method.java:606)
>>>> >>>>>>>>>>>>>>>>>>>>>> [rt.jar:1.7.0_25]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [scheduler.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.quartz.core.JobRunShell.run(JobRunShell.java:213)
>>>> >>>>>>>>>>>>>>>>>>>>>> [quartz.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [quartz.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> 2013-08-09 09:44:27,039 WARN
>>>> >>>>>>>>>>>>>>>>>>>>>> [org.ovirt.engine.core.vdsbroker.VdsManager]
>>>> >>>>>>>>>>>>>>>>>>>>>> (DefaultQuartzScheduler_Worker-47) Failed to
>>>> >>>>>>>>>>>>>>>>>>>>>> refresh VDS
>>>> >>>>>>>>>>>>>>>>>>>>>> ,
>>>> >>>>>>>>>>>>>>>>>>>>>> vds =
>>>> >>>>>>>>>>>>>>>>>>>>>> 653e34a6-6b7e-4757-9042-dc02e7a0cddf :
>>>> >>>>>>>>>>>>>>>>>>>>>> node3.x.com, error
>>>> >>>>>>>>>>>>>>>>>>>>>> =
>>>> >>>>>>>>>>>>>>>>>>>>>> java.lang.NullPointerException, continuing.:
>>>> >>>>>>>>>>>>>>>>>>>>>> java.lang.NullPointerException
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.proceedGuaranteedMemoryCheck(VdsUpdateRunTimeInfo.java:1313)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:968)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:542)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:383)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:237)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> sun.reflect.GeneratedMethodAccessor171.invoke(Unknown
>>>> >>>>>>>>>>>>>>>>>>>>>> Source) [:1.7.0_25]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [rt.jar:1.7.0_25]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> java.lang.reflect.Method.invoke(Method.java:606)
>>>> >>>>>>>>>>>>>>>>>>>>>> [rt.jar:1.7.0_25]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [scheduler.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.quartz.core.JobRunShell.run(JobRunShell.java:213)
>>>> >>>>>>>>>>>>>>>>>>>>>> [quartz.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> at
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>>>> [quartz.jar:]
>>>> >>>>>>>>>>>>>>>>>>>>>> _______________________________________________
>>>> >>>>>>>>>>>>>>>>>>>>>> Users mailing list
>>>> >>>>>>>>>>>>>>>>>>>>>> Users at ovirt.org
>>>> >>>>>>>>>>>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>> >>>>>>>>>>>>>>>>>>>>> I restarted management node and both nodes
>>>> and this
>>>> >>>>>>>>>>>>>>>>>>>>> problem
>>>> >>>>>>>>>>>>>>>>>>>>> disappeared.
>>>> >>>>>>>>>>>>>>>>>>>>> But I still can not see any VMs.
>>>> >>>>>>>>>>>>>>>>>>>>> _______________________________________________
>>>> >>>>>>>>>>>>>>>>>>>>> Users mailing list
>>>> >>>>>>>>>>>>>>>>>>>>> Users at ovirt.org
>>>> >>>>>>>>>>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>> >>>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>>>> _______________________________________________
>>>> >>>>>>>>>>>>>>>>>>>> Users mailing list
>>>> >>>>>>>>>>>>>>>>>>>> Users at ovirt.org
>>>> >>>>>>>>>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>> >>>>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>> Hi,
>>>> >>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>>>> I do not have them in database. Both commands shows
>>>> >>>>>>>>>>>>>>>>>> nothing
>>>> >>>>>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>> Hello,
>>>> >>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>> we run ovirt 3.2.1 (or 2). I upgraded to RC1,
>>>> everything was
>>>> >>>>>>>>>>>>>> great
>>>> >>>>>>>>>>>>>> (except SPICE. VNC and creating new WM due to
>>>> serialization
>>>> >>>>>>>>>>>>>> bug.).
>>>> >>>>>>>>>>>>>> Because those bugs were irritating, we switched to
>>>> >>>>>>>>>>>>>> nightly. Still
>>>> >>>>>>>>>>>>>> works fine (but bug with VMs is not fixed there),
>>>> than I
>>>> >>>>>>>>>>>>>> installed
>>>> >>>>>>>>>>>>>> new
>>>> >>>>>>>>>>>>>> ovirt engine management server in KVM virtualization
>>>> (using
>>>> >>>>>>>>>>>>>> libvirtd)
>>>> >>>>>>>>>>>>>> due to taking snapshots before deploying nightly
>>>> builds. New
>>>> >>>>>>>>>>>>>> virtualized engine works great and I delete old one.
>>>> Next
>>>> >>>>>>>>>>>>>> day I
>>>> >>>>>>>>>>>>>> came
>>>> >>>>>>>>>>>>>> to work and engine web page was very very slow, every
>>>> >>>>>>>>>>>>>> operation
>>>> >>>>>>>>>>>>>> takes
>>>> >>>>>>>>>>>>>> ages, that time I found there were no VMs, no HDDs
>>>> and so. I
>>>> >>>>>>>>>>>>>> converted
>>>> >>>>>>>>>>>>>> its qcow2 image to raw, because I think it has slow DB
>>>> >>>>>>>>>>>>>> because of
>>>> >>>>>>>>>>>>>> running i qcow2. Did not helped, than I take a look
>>>> in nodes
>>>> >>>>>>>>>>>>>> logs and
>>>> >>>>>>>>>>>>>> found this problem, which I posted in first email
>>>> (VMs still
>>>> >>>>>>>>>>>>>> running,
>>>> >>>>>>>>>>>>>> but not visible in engine VMs tab, but on host I can
>>>> see
>>>> >>>>>>>>>>>>>> number
>>>> >>>>>>>>>>>>>> of
>>>> >>>>>>>>>>>>>> running VMs). After restart bug disappeared, but VMs
>>>> too.
>>>> >>>>>>>>>>>>>> Today I reinstalled engine with oVirt 3.3.0rc1. But
>>>> all my
>>>> >>>>>>>>>>>>>> VMs
>>>> >>>>>>>>>>>>>> are
>>>> >>>>>>>>>>>>>> gone. Even from storage. (but disappearing from storage
>>>> >>>>>>>>>>>>>> may be my
>>>> >>>>>>>>>>>>>> fault during recovery).
>>>> >>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>> I can provide logs from both two nodes and
>>>> (hopefully) from
>>>> >>>>>>>>>>>>>> engine
>>>> >>>>>>>>>>>>>> too. I can provide you with those logs, but not
>>>> publicly.
>>>> >>>>>>>>>>>>>> Sorry.
>>>> >>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>> Thank you,
>>>> >>>>>>>>>>>>>> Jakub Bittner, NSA Czech
>>>> >>>>>>>>>>>>>> _______________________________________________
>>>> >>>>>>>>>>>>>> Users mailing list
>>>> >>>>>>>>>>>>>> Users at ovirt.org
>>>> >>>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>> >>>>>>>>>>>>> Well I reinstalled to 3.3.0 RC1, rebooted server and
>>>> my VMs
>>>> >>>>>>>>>>>>> are
>>>> >>>>>>>>>>>>> gone
>>>> >>>>>>>>>>>>> again.
>>>> >>>>>>>>>>>>> _______________________________________________
>>>> >>>>>>>>>>>>> Users mailing list
>>>> >>>>>>>>>>>>> Users at ovirt.org
>>>> >>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>> >>>>>>>>>>>> can you verify the db from before the upgrade has the
>>>> VMs?
>>>> >>>>>>>>>>> I dont know what you mean by verify database. Please,
>>>> could you
>>>> >>>>>>>>>>> point me
>>>> >>>>>>>>>>> how to do it? Thank you
>>>> >>>>>>>>>>> _______________________________________________
>>>> >>>>>>>>>>> Users mailing list
>>>> >>>>>>>>>>> Users at ovirt.org
>>>> >>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>> >>>>>>>>>> I assume from your expectation to see the VMs from the
>>>> previous
>>>> >>>>>>>>>> install that you upgraded your system rather than do a
>>>> clean
>>>> >>>>>>>>>> install?
>>>> >>>>>>>>>> in an upgrade, there should be a backup of the db from
>>>> before the
>>>> >>>>>>>>>> upgrade.
>>>> >>>>>>>>>> (in a clean install, engine is not aware of VMs running on
>>>> >>>>>>>>>> hosts from
>>>> >>>>>>>>>> previous installs - we need to cover "import existing
>>>> storage
>>>> >>>>>>>>>> domain"
>>>> >>>>>>>>>> in a future version to close this gap. current alternatives
>>>> >>>>>>>>>> around
>>>> >>>>>>>>>> this are to convert the storage domain to an export domain
>>>> >>>>>>>>>> (for an
>>>> >>>>>>>>>> nfs
>>>> >>>>>>>>>> data domain) an re-import them to the system or a few other
>>>> >>>>>>>>>> options.
>>>> >>>>>>>>>>
>>>> >>>>>>>>>> how many VMs are there?
>>>> >>>>>>>>> They(VMs) are deleted. So, my situation is this:
>>>> >>>>>>>>>
>>>> >>>>>>>>> I have clean install of ovirt 3.3.0beta with imported VMs
>>>> from
>>>> >>>>>>>>> export
>>>> >>>>>>>>> domain. Everything works except snapshots. But when I
>>>> restart
>>>> >>>>>>>>> ovirt
>>>> >>>>>>>>> mgmt
>>>> >>>>>>>>> server, VMs will disappear. Right now I am doing hourly
>>>> backup
>>>> >>>>>>>>> of DB.
>>>> >>>>>>>> this is very fishy...
>>>> >>>>>>>> can you arrange for a remote access session for someone to
>>>> take
>>>> >>>>>>>> a look?
>>>> >>>>>>>>
>>>> >>>>>>>>> I can not use workaround with converting domain to export
>>>> domain,
>>>> >>>>>>>>> because we use iscsi. It would be perfect if I can retake
>>>> existing
>>>> >>>>>>>>> domain. Another gap is if I dont detach export domain I
>>>> can not
>>>> >>>>>>>>> attach
>>>> >>>>>>>>> it to new datacenter and I have to manually edit some
>>>> files. It
>>>> >>>>>>>>> would
>>>> >>>>>>>>> be
>>>> >>>>>>>>> absolutely perfect to do it from ovirt web gui (for
>>>> example by
>>>> >>>>>>>>> "force
>>>> >>>>>>>>> override button")
>>>> >>>>>>>> i thought 3.3 allowed for that, but i could be wrong.
>>>> >>>>>>> Well, I will backup all VMs to export domain, than create
>>>> >>>>>>> snapshot of
>>>> >>>>>>> ovirt and I will try to restart that server if its going to
>>>> >>>>>>> delete VMs
>>>> >>>>>>> from DB. Than I will report back. I think, that remote session
>>>> >>>>>>> will not
>>>> >>>>>>> be possible, but I can be wrong (I hope).
>>>> >>>>>>>
>>>> >>>>>>>
>>>> >>>>>>> _______________________________________________
>>>> >>>>>>> Users mailing list
>>>> >>>>>>> Users at ovirt.org
>>>> >>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>> >>>>>>>
>>>> >>>>> I change it. But I can not restart postgres.
>>>> >>>> You can restart it only when the engine is down, it will not
>>>> restart
>>>> >>>> with
>>>> >>>> database connections open.
>>>> >>>>
>>>> >>>>> _______________________________________________
>>>> >>>>> Users mailing list
>>>> >>>>> Users at ovirt.org
>>>> >>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>> >>>>>
>>>> >>>> _______________________________________________
>>>> >>>> Users mailing list
>>>> >>>> Users at ovirt.org
>>>> >>>> http://lists.ovirt.org/mailman/listinfo/users
>>>> >>>>
>>>> >> I think, that disks did not disappeared, but new instance of ovirt
>>>> >> deleted them as I thought that it can import them back.
>>>> >> _______________________________________________
>>>> >> Users mailing list
>>>> >> Users at ovirt.org
>>>> >> http://lists.ovirt.org/mailman/listinfo/users
>>>> >
>>>> >
>>>> > hello,
>>>> >
>>>> > right now I restarted ovirt-engine and postgresql and my VMs
>>>> disappeared
>>>> > again, but not all of them! Some of them persists. (two) And I get
>>>> > messages about failed export and import of those who disappeared.
>>>> Than I
>>>> > restored postgresql from backup and everything is OK. Restarting
>>>> > postgresql is like using way back machine ;-)
>>>>
>>>> Laszlo hinted this may be around some compnesation logic -
>>>> detecting an
>>>> incomplete import, thus deleting them. yair - what should the logs
>>>> indicate for this?
>>>
>>> I thought of the compensation because it runs after engine start and
>>> does changes in the DB if there is something to compensate in
>>> business_entity_snapshot.
>>> So for example having records there could undo the import of VM's
>>> and at the same time delete their disks from the storage.
>>> However, when last time I had anything to do with the compensation,
>>> if it failed, it did not allow the engine to start. I don't know if
>>> it is still like that, I just noticed last week that some services
>>> may fail to configure and the engine ignores them in such cases.
>>>
>>> Jakub, do you have anything in the business_entity_snapshot table?
>>>
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users at ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>
>>>
>>
>> I do appologies, but I will be at work on Friday 23 and than I take a
>> look. Sorry.
>> But thank you for hints ;-)
>>
>> ----------------------------------------------------------------
>> This message was sent using IMP, the Internet Messaging Program.
>>
>> _______________________________________________
>> Users mailing list
>> Users at ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>
> May I ask where to find engine db password or how to get to pg?
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
My business_entity_snapshot is empty.
More information about the Users
mailing list