[Users] All VMs disappeared

[Frank Wall]

On 09.08.2013 09:48, Jakub Bittner wrote:
> Iam running ovirt 3.3.0.beta1 on centos 6,4 and all our VMs
> disappeared from VMs tab. Nodes running on centos too. Repeating
> problem in log is:

I have the same problem, but with a slightly different setup:

- fresh install of Fedora 19 (all updates installed)
- fresh install of oVirt 3.3 RC (no upgrade)
- All-in-One setup with only local storage
- VMs installed from scratch (no import)
- VM/node/engine uptime was about 22 hours before reboot

Now the problem is very the same as reported by Jakub:
Every time I reboot ovirt-engine the VMs will disappear. No matter what 
I do before rebooting ovirt-engine - set storage to maintenance, set 
host to maintenance - it's always the same.

One interesting thing to note: Only VMs created from my custom template 
will disappear! If I create a VM from the "blank" template, it will NOT 
disappear.

Of course, the VM Disks can still be found in the filesystem, but it's a 
nightmare trying to guess what disk should be attached to what VM... I 
consider these VMs lost, since it's (fortunately) my test server, but 
still a day of work is lost.

Here are some interesting log entries from engine startup AFTER REBOOT:

2013-08-26 23:03:20,479 INFO  
[org.ovirt.engine.core.bll.AsyncTaskManager] (pool-6-thread-7) Failing 
task with empty vdsm id AsyncTaskType copyImage : Task 
7fa218c7-14c3-4a7f-97e8-341f18c6cb3d Parent Command AddVmFromTemplate

2013-08-26 23:03:20,497 INFO  
[org.ovirt.engine.core.bll.AsyncTaskManager] (pool-6-thread-7) Calling 
updateTask for task with out vdsm id and AsyncTaskType copyImage : Task 
7fa218c7-14c3-4a7f-97e8-341f18c6cb3d Parent Command AddVmFromTemplate 
Parameters class {3}

2013-08-26 23:03:20,506 INFO  
[org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-7) 
CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 
4202990d-e85f-4935-a91b-a832bc8582cc

2013-08-26 23:03:20,787 INFO  
[org.ovirt.engine.core.bll.AddVmFromTemplateCommand] (pool-6-thread-7) 
[10025b02] Lock Acquired to object EngineLock [exclusiveLocks= key: 
vm1.example.com value: VM_NAME

2013-08-26 23:03:20,788 INFO  
[org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-6-thread-7) 
[10025b02] CommandMultiAsyncTasks::AttachTask: Attaching task 
00000000-0000-0000-0000-000000000000 to command 
4202990d-e85f-4935-a91b-a832bc8582cc.

2013-08-26 23:03:20,796 ERROR [org.ovirt.engine.core.bll.SPMAsyncTask] 
(pool-6-thread-7) [10025b02] BaseAsyncTask::LogEndTaskFailure: Task 
00000000-0000-0000-0000-000000000000 (Parent Command AddVmFromTemplate, 
Parameters Type 
org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with 
failure:

2013-08-26 23:03:20,805 INFO  
[org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-6-thread-7) 
[10025b02] task with DB task ID 00000000-0000-0000-0000-000000000000 has 
  empty vdsm  task ID and is about to be cleared

2013-08-26 23:03:20,806 INFO  
[org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-7) 
[10025b02] CommandAsyncTask::EndActionIfNecessary: All tasks of command 
4202990d-e85f-4935-a91b-a832bc8582cc has ended -> executing EndAction

2013-08-26 23:03:20,807 INFO  
[org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-7) 
[10025b02] CommandAsyncTask::EndAction: Ending action for 1 tasks 
(command ID: 4202990d-e85f-4935-a91b-a832bc8582cc): calling EndAction .

Needless to say that I'm ABSOLUTELY SURE the template-copy tasks 
actually did succeed before rebooting, as I was using the VMs, 
installing software, rebooting, ... they were all running fine for 22 
hours!

These messages exist for every missing VM. A show-stopper for 3.3 if you 
ask me :-/


Thanks
- Frank