[Users] All VMs disappeared
j.bittner at nbu.cz
j.bittner at nbu.cz
Wed Aug 14 12:04:37 EDT 2013
Cituji "Laszlo Hornyak" <lhornyak at redhat.com>:
>
>
> ----- Original Message -----
>> From: "Itamar Heim" <iheim at redhat.com>
>> To: "Jakub Bittner" <j.bittner at nbu.cz>
>> Cc: "Michal Skrivanek" <mskrivan at redhat.com>, users at ovirt.org
>> Sent: Wednesday, August 14, 2013 4:27:17 PM
>> Subject: Re: [Users] All VMs disappeared
>>
>> On 08/14/2013 05:19 PM, Jakub Bittner wrote:
>> > Dne 14.8.2013 10:48, Jakub Bittner napsal(a):
>> >> Dne 14.8.2013 09:57, Liron Aravot napsal(a):
>> >>> Jakub, are only your vms disappear? what about the disks?
>> >>>
>> >>> ----- Original Message -----
>> >>>> From: "Laszlo Hornyak" <lhornyak at redhat.com>
>> >>>> To: "Jakub Bittner" <j.bittner at nbu.cz>
>> >>>> Cc: users at ovirt.org
>> >>>> Sent: Wednesday, August 14, 2013 10:39:48 AM
>> >>>> Subject: Re: [Users] All VMs disappeared
>> >>>>
>> >>>>
>> >>>>
>> >>>> ----- Original Message -----
>> >>>>> From: "Jakub Bittner" <j.bittner at nbu.cz>
>> >>>>> To: users at ovirt.org
>> >>>>> Sent: Wednesday, August 14, 2013 8:09:45 AM
>> >>>>> Subject: Re: [Users] All VMs disappeared
>> >>>>>
>> >>>>> Dne 13.8.2013 18:29, Laszlo Hornyak napsal(a):
>> >>>>>> Ahoj Jakub,
>> >>>>>>
>> >>>>>> Just one more idea: could you turn statement logging on in postgresql
>> >>>>>> before you try again?
>> >>>>>> It is in /var/lib/pgsql/data/postgresql.conf
>> >>>>>> log_statement = 'all'
>> >>>>>>
>> >>>>>>
>> >>>>>> ----- Original Message -----
>> >>>>>>> From: "Jakub Bittner" <j.bittner at nbu.cz>
>> >>>>>>> To: "Itamar Heim" <iheim at redhat.com>
>> >>>>>>> Cc: users at ovirt.org
>> >>>>>>> Sent: Tuesday, August 13, 2013 5:20:29 PM
>> >>>>>>> Subject: Re: [Users] All VMs disappeared
>> >>>>>>>
>> >>>>>>> Dne 13.8.2013 17:02, Itamar Heim napsal(a):
>> >>>>>>>> On 08/13/2013 05:31 PM, Jakub Bittner wrote:
>> >>>>>>>>> Dne 13.8.2013 15:39, Itamar Heim napsal(a):
>> >>>>>>>>>> On 08/13/2013 08:50 AM, Jakub Bittner wrote:
>> >>>>>>>>>>> Dne 12.8.2013 22:44, Itamar Heim napsal(a):
>> >>>>>>>>>>>> On 08/12/2013 06:59 PM, Jakub Bittner wrote:
>> >>>>>>>>>>>>> Dne 12.8.2013 14:54, Jakub Bittner napsal(a):
>> >>>>>>>>>>>>>> Dne 12.8.2013 14:29, Laszlo Hornyak napsal(a):
>> >>>>>>>>>>>>>>> I looked around Noam's patch and that should not cause such
>> >>>>>>>>>>>>>>> behavior.
>> >>>>>>>>>>>>>>> I am wondering how that lost VM's could happen.
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>> Jakub, can you give a more detailed description what you
>> >>>>>>>>>>>>>>> were
>> >>>>>>>>>>>>>>> doing
>> >>>>>>>>>>>>>>> with oVirt when this happened? Maybe the bug is still there.
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>> Thank you,
>> >>>>>>>>>>>>>>> Laszlo
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>> ----- Original Message -----
>> >>>>>>>>>>>>>>>> From: "Greg Sheremeta" <gshereme at redhat.com>
>> >>>>>>>>>>>>>>>> To: "Laszlo Hornyak" <lhornyak at redhat.com>
>> >>>>>>>>>>>>>>>> Cc: "Jakub Bittner" <j.bittner at nbu.cz>, "Noam Slomianko"
>> >>>>>>>>>>>>>>>> <nslomian at redhat.com>, users at ovirt.org
>> >>>>>>>>>>>>>>>> Sent: Monday, August 12, 2013 1:23:40 PM
>> >>>>>>>>>>>>>>>> Subject: Re: [Users] All VMs disappeared
>> >>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>> Not the one I fixed, 987907. It was a simple UI
>> >>>>>>>>>>>>>>>> NullPointerException.
>> >>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>> Greg
>> >>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>> ----- Original Message -----
>> >>>>>>>>>>>>>>>>> From: "Laszlo Hornyak" <lhornyak at redhat.com>
>> >>>>>>>>>>>>>>>>> To: "Jakub Bittner" <j.bittner at nbu.cz>, "Noam Slomianko"
>> >>>>>>>>>>>>>>>>> <nslomian at redhat.com>, "Greg Sheremeta"
>> >>>>>>>>>>>>>>>>> <gshereme at redhat.com>
>> >>>>>>>>>>>>>>>>> Cc: users at ovirt.org
>> >>>>>>>>>>>>>>>>> Sent: Monday, August 12, 2013 7:21:26 AM
>> >>>>>>>>>>>>>>>>> Subject: Re: [Users] All VMs disappeared
>> >>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>> Well if they are no longer in DB then that explains why
>> >>>>>>>>>>>>>>>>> the
>> >>>>>>>>>>>>>>>>> exception no
>> >>>>>>>>>>>>>>>>> longer occurs, but at the cost of database corruption.
>> >>>>>>>>>>>>>>>>> Noam and Greg, can these bugs cause data corruption?
>> >>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>> Thank you,
>> >>>>>>>>>>>>>>>>> Laszlo
>> >>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>> ----- Original Message -----
>> >>>>>>>>>>>>>>>>>> From: "Jakub Bittner" <j.bittner at nbu.cz>
>> >>>>>>>>>>>>>>>>>> To: "Greg Sheremeta" <gshereme at redhat.com>
>> >>>>>>>>>>>>>>>>>> Cc: users at ovirt.org, "Laszlo Hornyak"
>> >>>>>>>>>>>>>>>>>> <lhornyak at redhat.com>
>> >>>>>>>>>>>>>>>>>> Sent: Monday, August 12, 2013 9:05:09 AM
>> >>>>>>>>>>>>>>>>>> Subject: Re: [Users] All VMs disappeared
>> >>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>> Dne 10.8.2013 01:54, Greg Sheremeta napsal(a):
>> >>>>>>>>>>>>>>>>>>> It could also be this bug[1], for which I just
>> >>>>>>>>>>>>>>>>>>> submitted a
>> >>>>>>>>>>>>>>>>>>> fix.
>> >>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>> [1] https://bugzilla.redhat.com/show_bug.cgi?id=987907
>> >>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>> You can work around it by typing just "VMs:" (without
>> >>>>>>>>>>>>>>>>>>> the
>> >>>>>>>>>>>>>>>>>>> quotes) in
>> >>>>>>>>>>>>>>>>>>> the
>> >>>>>>>>>>>>>>>>>>> search bar.
>> >>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>> Greg
>> >>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>> ----- Original Message -----
>> >>>>>>>>>>>>>>>>>>>> From: "Laszlo Hornyak" <lhornyak at redhat.com>
>> >>>>>>>>>>>>>>>>>>>> To: "Jakub Bittner" <j.bittner at nbu.cz>
>> >>>>>>>>>>>>>>>>>>>> Cc: users at ovirt.org
>> >>>>>>>>>>>>>>>>>>>> Sent: Friday, August 9, 2013 11:21:26 AM
>> >>>>>>>>>>>>>>>>>>>> Subject: Re: [Users] All VMs disappeared
>> >>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>> Hi Jakub,
>> >>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>> Could you check through DB or REST-API if the VM's
>> >>>>>>>>>>>>>>>>>>>> are in
>> >>>>>>>>>>>>>>>>>>>> your
>> >>>>>>>>>>>>>>>>>>>> DB?
>> >>>>>>>>>>>>>>>>>>>> select * from vm_static;
>> >>>>>>>>>>>>>>>>>>>> or
>> >>>>>>>>>>>>>>>>>>>> curl -u admin at internal:blablabla [engine-url]api/vms
>> >>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>> It seems Noam fixed this issue already in
>> >>>>>>>>>>>>>>>>>>>> c2295c31fa645e1ba1b94cd557bd1fecb40c8829.
>> >>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>> Thank you,
>> >>>>>>>>>>>>>>>>>>>> Laszlo
>> >>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>> ----- Original Message -----
>> >>>>>>>>>>>>>>>>>>>>> From: "Jakub Bittner" <j.bittner at nbu.cz>
>> >>>>>>>>>>>>>>>>>>>>> To: users at ovirt.org
>> >>>>>>>>>>>>>>>>>>>>> Sent: Friday, August 9, 2013 1:06:53 PM
>> >>>>>>>>>>>>>>>>>>>>> Subject: Re: [Users] All VMs disappeared
>> >>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>> Dne 9.8.2013 09:48, Jakub Bittner napsal(a):
>> >>>>>>>>>>>>>>>>>>>>>> Hello,
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> Iam running ovirt 3.3.0.beta1 on centos 6,4 and
>> >>>>>>>>>>>>>>>>>>>>>> all our
>> >>>>>>>>>>>>>>>>>>>>>> VMs
>> >>>>>>>>>>>>>>>>>>>>>> disappeared from VMs tab. Nodes running on centos
>> >>>>>>>>>>>>>>>>>>>>>> too.
>> >>>>>>>>>>>>>>>>>>>>>> Repeating
>> >>>>>>>>>>>>>>>>>>>>>> problem in log is:
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> 2013-08-09 09:44:24,203 WARN
>> >>>>>>>>>>>>>>>>>>>>>> [org.ovirt.engine.core.vdsbroker.VdsManager]
>> >>>>>>>>>>>>>>>>>>>>>> (DefaultQuartzScheduler_Worker-45) Failed to
>> >>>>>>>>>>>>>>>>>>>>>> refresh VDS
>> >>>>>>>>>>>>>>>>>>>>>> ,
>> >>>>>>>>>>>>>>>>>>>>>> vds =
>> >>>>>>>>>>>>>>>>>>>>>> 7cb6aedf-47bc-40b0-877f-2a537fca5c64 :
>> >>>>>>>>>>>>>>>>>>>>>> node2.x.com, error
>> >>>>>>>>>>>>>>>>>>>>>> =
>> >>>>>>>>>>>>>>>>>>>>>> java.lang.NullPointerException, continuing.:
>> >>>>>>>>>>>>>>>>>>>>>> java.lang.NullPointerException
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.proceedGuaranteedMemoryCheck(VdsUpdateRunTimeInfo.java:1313)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:968)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:542)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:383)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:237)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>> sun.reflect.GeneratedMethodAccessor171.invoke(Unknown
>> >>>>>>>>>>>>>>>>>>>>>> Source) [:1.7.0_25]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [rt.jar:1.7.0_25]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:606)
>> >>>>>>>>>>>>>>>>>>>>>> [rt.jar:1.7.0_25]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [scheduler.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>> org.quartz.core.JobRunShell.run(JobRunShell.java:213)
>> >>>>>>>>>>>>>>>>>>>>>> [quartz.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [quartz.jar:]
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> 2013-08-09 09:44:27,039 WARN
>> >>>>>>>>>>>>>>>>>>>>>> [org.ovirt.engine.core.vdsbroker.VdsManager]
>> >>>>>>>>>>>>>>>>>>>>>> (DefaultQuartzScheduler_Worker-47) Failed to
>> >>>>>>>>>>>>>>>>>>>>>> refresh VDS
>> >>>>>>>>>>>>>>>>>>>>>> ,
>> >>>>>>>>>>>>>>>>>>>>>> vds =
>> >>>>>>>>>>>>>>>>>>>>>> 653e34a6-6b7e-4757-9042-dc02e7a0cddf :
>> >>>>>>>>>>>>>>>>>>>>>> node3.x.com, error
>> >>>>>>>>>>>>>>>>>>>>>> =
>> >>>>>>>>>>>>>>>>>>>>>> java.lang.NullPointerException, continuing.:
>> >>>>>>>>>>>>>>>>>>>>>> java.lang.NullPointerException
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.proceedGuaranteedMemoryCheck(VdsUpdateRunTimeInfo.java:1313)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:968)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:542)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:383)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:237)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [vdsbroker.jar:]
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>> sun.reflect.GeneratedMethodAccessor171.invoke(Unknown
>> >>>>>>>>>>>>>>>>>>>>>> Source) [:1.7.0_25]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [rt.jar:1.7.0_25]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:606)
>> >>>>>>>>>>>>>>>>>>>>>> [rt.jar:1.7.0_25]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [scheduler.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>> org.quartz.core.JobRunShell.run(JobRunShell.java:213)
>> >>>>>>>>>>>>>>>>>>>>>> [quartz.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> at
>> >>>>>>>>>>>>>>>>>>>>>>
>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>>> [quartz.jar:]
>> >>>>>>>>>>>>>>>>>>>>>> _______________________________________________
>> >>>>>>>>>>>>>>>>>>>>>> Users mailing list
>> >>>>>>>>>>>>>>>>>>>>>> Users at ovirt.org
>> >>>>>>>>>>>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>> >>>>>>>>>>>>>>>>>>>>> I restarted management node and both nodes and this
>> >>>>>>>>>>>>>>>>>>>>> problem
>> >>>>>>>>>>>>>>>>>>>>> disappeared.
>> >>>>>>>>>>>>>>>>>>>>> But I still can not see any VMs.
>> >>>>>>>>>>>>>>>>>>>>> _______________________________________________
>> >>>>>>>>>>>>>>>>>>>>> Users mailing list
>> >>>>>>>>>>>>>>>>>>>>> Users at ovirt.org
>> >>>>>>>>>>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>> >>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>> _______________________________________________
>> >>>>>>>>>>>>>>>>>>>> Users mailing list
>> >>>>>>>>>>>>>>>>>>>> Users at ovirt.org
>> >>>>>>>>>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>> >>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>> Hi,
>> >>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>> I do not have them in database. Both commands shows
>> >>>>>>>>>>>>>>>>>> nothing
>> >>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>> Hello,
>> >>>>>>>>>>>>>>
>> >>>>>>>>>>>>>> we run ovirt 3.2.1 (or 2). I upgraded to RC1, everything was
>> >>>>>>>>>>>>>> great
>> >>>>>>>>>>>>>> (except SPICE. VNC and creating new WM due to serialization
>> >>>>>>>>>>>>>> bug.).
>> >>>>>>>>>>>>>> Because those bugs were irritating, we switched to
>> >>>>>>>>>>>>>> nightly. Still
>> >>>>>>>>>>>>>> works fine (but bug with VMs is not fixed there), than I
>> >>>>>>>>>>>>>> installed
>> >>>>>>>>>>>>>> new
>> >>>>>>>>>>>>>> ovirt engine management server in KVM virtualization (using
>> >>>>>>>>>>>>>> libvirtd)
>> >>>>>>>>>>>>>> due to taking snapshots before deploying nightly builds. New
>> >>>>>>>>>>>>>> virtualized engine works great and I delete old one. Next
>> >>>>>>>>>>>>>> day I
>> >>>>>>>>>>>>>> came
>> >>>>>>>>>>>>>> to work and engine web page was very very slow, every
>> >>>>>>>>>>>>>> operation
>> >>>>>>>>>>>>>> takes
>> >>>>>>>>>>>>>> ages, that time I found there were no VMs, no HDDs and so. I
>> >>>>>>>>>>>>>> converted
>> >>>>>>>>>>>>>> its qcow2 image to raw, because I think it has slow DB
>> >>>>>>>>>>>>>> because of
>> >>>>>>>>>>>>>> running i qcow2. Did not helped, than I take a look in nodes
>> >>>>>>>>>>>>>> logs and
>> >>>>>>>>>>>>>> found this problem, which I posted in first email (VMs still
>> >>>>>>>>>>>>>> running,
>> >>>>>>>>>>>>>> but not visible in engine VMs tab, but on host I can see
>> >>>>>>>>>>>>>> number
>> >>>>>>>>>>>>>> of
>> >>>>>>>>>>>>>> running VMs). After restart bug disappeared, but VMs too.
>> >>>>>>>>>>>>>> Today I reinstalled engine with oVirt 3.3.0rc1. But all my
>> >>>>>>>>>>>>>> VMs
>> >>>>>>>>>>>>>> are
>> >>>>>>>>>>>>>> gone. Even from storage. (but disappearing from storage
>> >>>>>>>>>>>>>> may be my
>> >>>>>>>>>>>>>> fault during recovery).
>> >>>>>>>>>>>>>>
>> >>>>>>>>>>>>>> I can provide logs from both two nodes and (hopefully) from
>> >>>>>>>>>>>>>> engine
>> >>>>>>>>>>>>>> too. I can provide you with those logs, but not publicly.
>> >>>>>>>>>>>>>> Sorry.
>> >>>>>>>>>>>>>>
>> >>>>>>>>>>>>>> Thank you,
>> >>>>>>>>>>>>>> Jakub Bittner, NSA Czech
>> >>>>>>>>>>>>>> _______________________________________________
>> >>>>>>>>>>>>>> Users mailing list
>> >>>>>>>>>>>>>> Users at ovirt.org
>> >>>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>> >>>>>>>>>>>>> Well I reinstalled to 3.3.0 RC1, rebooted server and my VMs
>> >>>>>>>>>>>>> are
>> >>>>>>>>>>>>> gone
>> >>>>>>>>>>>>> again.
>> >>>>>>>>>>>>> _______________________________________________
>> >>>>>>>>>>>>> Users mailing list
>> >>>>>>>>>>>>> Users at ovirt.org
>> >>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>> >>>>>>>>>>>> can you verify the db from before the upgrade has the VMs?
>> >>>>>>>>>>> I dont know what you mean by verify database. Please, could you
>> >>>>>>>>>>> point me
>> >>>>>>>>>>> how to do it? Thank you
>> >>>>>>>>>>> _______________________________________________
>> >>>>>>>>>>> Users mailing list
>> >>>>>>>>>>> Users at ovirt.org
>> >>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>> >>>>>>>>>> I assume from your expectation to see the VMs from the previous
>> >>>>>>>>>> install that you upgraded your system rather than do a clean
>> >>>>>>>>>> install?
>> >>>>>>>>>> in an upgrade, there should be a backup of the db from before the
>> >>>>>>>>>> upgrade.
>> >>>>>>>>>> (in a clean install, engine is not aware of VMs running on
>> >>>>>>>>>> hosts from
>> >>>>>>>>>> previous installs - we need to cover "import existing storage
>> >>>>>>>>>> domain"
>> >>>>>>>>>> in a future version to close this gap. current alternatives
>> >>>>>>>>>> around
>> >>>>>>>>>> this are to convert the storage domain to an export domain
>> >>>>>>>>>> (for an
>> >>>>>>>>>> nfs
>> >>>>>>>>>> data domain) an re-import them to the system or a few other
>> >>>>>>>>>> options.
>> >>>>>>>>>>
>> >>>>>>>>>> how many VMs are there?
>> >>>>>>>>> They(VMs) are deleted. So, my situation is this:
>> >>>>>>>>>
>> >>>>>>>>> I have clean install of ovirt 3.3.0beta with imported VMs from
>> >>>>>>>>> export
>> >>>>>>>>> domain. Everything works except snapshots. But when I restart
>> >>>>>>>>> ovirt
>> >>>>>>>>> mgmt
>> >>>>>>>>> server, VMs will disappear. Right now I am doing hourly backup
>> >>>>>>>>> of DB.
>> >>>>>>>> this is very fishy...
>> >>>>>>>> can you arrange for a remote access session for someone to take
>> >>>>>>>> a look?
>> >>>>>>>>
>> >>>>>>>>> I can not use workaround with converting domain to export domain,
>> >>>>>>>>> because we use iscsi. It would be perfect if I can retake existing
>> >>>>>>>>> domain. Another gap is if I dont detach export domain I can not
>> >>>>>>>>> attach
>> >>>>>>>>> it to new datacenter and I have to manually edit some files. It
>> >>>>>>>>> would
>> >>>>>>>>> be
>> >>>>>>>>> absolutely perfect to do it from ovirt web gui (for example by
>> >>>>>>>>> "force
>> >>>>>>>>> override button")
>> >>>>>>>> i thought 3.3 allowed for that, but i could be wrong.
>> >>>>>>> Well, I will backup all VMs to export domain, than create
>> >>>>>>> snapshot of
>> >>>>>>> ovirt and I will try to restart that server if its going to
>> >>>>>>> delete VMs
>> >>>>>>> from DB. Than I will report back. I think, that remote session
>> >>>>>>> will not
>> >>>>>>> be possible, but I can be wrong (I hope).
>> >>>>>>>
>> >>>>>>>
>> >>>>>>> _______________________________________________
>> >>>>>>> Users mailing list
>> >>>>>>> Users at ovirt.org
>> >>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>> >>>>>>>
>> >>>>> I change it. But I can not restart postgres.
>> >>>> You can restart it only when the engine is down, it will not restart
>> >>>> with
>> >>>> database connections open.
>> >>>>
>> >>>>> _______________________________________________
>> >>>>> Users mailing list
>> >>>>> Users at ovirt.org
>> >>>>> http://lists.ovirt.org/mailman/listinfo/users
>> >>>>>
>> >>>> _______________________________________________
>> >>>> Users mailing list
>> >>>> Users at ovirt.org
>> >>>> http://lists.ovirt.org/mailman/listinfo/users
>> >>>>
>> >> I think, that disks did not disappeared, but new instance of ovirt
>> >> deleted them as I thought that it can import them back.
>> >> _______________________________________________
>> >> Users mailing list
>> >> Users at ovirt.org
>> >> http://lists.ovirt.org/mailman/listinfo/users
>> >
>> >
>> > hello,
>> >
>> > right now I restarted ovirt-engine and postgresql and my VMs disappeared
>> > again, but not all of them! Some of them persists. (two) And I get
>> > messages about failed export and import of those who disappeared. Than I
>> > restored postgresql from backup and everything is OK. Restarting
>> > postgresql is like using way back machine ;-)
>>
>> Laszlo hinted this may be around some compnesation logic - detecting an
>> incomplete import, thus deleting them. yair - what should the logs
>> indicate for this?
>
> I thought of the compensation because it runs after engine start and
> does changes in the DB if there is something to compensate in
> business_entity_snapshot.
> So for example having records there could undo the import of VM's
> and at the same time delete their disks from the storage.
> However, when last time I had anything to do with the compensation,
> if it failed, it did not allow the engine to start. I don't know if
> it is still like that, I just noticed last week that some services
> may fail to configure and the engine ignores them in such cases.
>
> Jakub, do you have anything in the business_entity_snapshot table?
>
>> _______________________________________________
>> Users mailing list
>> Users at ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>
I do appologies, but I will be at work on Friday 23 and than I take a
look. Sorry.
But thank you for hints ;-)
----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.
More information about the Users
mailing list