[ovirt-users] Unable to shutdown VM's

Thursday, 5 June 2014

This is a multi-part message in MIME format.
--------------000602090709060001060807
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Hi,

After upgrading to 3.4.2 rc I want to reinstall the nodes. But there are 
some benchmark VM's that I'm unable to shutdown to put the nodes in 
maintenance. How can I kill these VM's without having to kill the power 
to the nodes manually?

Kind regards,
Jorick Astrego

Netbulae B.V.

2014-Jun-05, 12:24

Failed to switch Host node1.test.now to Maintenance mode.

2014-Jun-05, 12:24

Host node1.test.now cannot change into maintenance mode - not all Vms 
have been migrated successfully. Consider manual intervention: 
stopping/migrating Vms: Bench1 (User: admin).

2014-Jun-05, 12:05

Shutdown of VM Bench2 failed.

2014-Jun-05, 12:05

Shutdown of VM Bench4 failed.

2014-Jun-05, 12:05

Shutdown of VM Bench3 failed.

2014-Jun-05, 12:05

Shutdown of VM Bench1 failed.

2014-Jun-05, 12:00

VM shutdown initiated by admin on VM Bench2 (Host: node2.test.now).

2014-Jun-05, 12:00

VM shutdown initiated by admin on VM Bench4 (Host: node4.test.now).

2014-Jun-05, 12:00

VM shutdown initiated by admin on VM Bench3 (Host: node3.test.now).

2014-Jun-05, 12:00

VM shutdown initiated by admin on VM Bench1 (Host: node1.test.now).

2014-06-05 12:00:33,127 INFO 
[org.ovirt.engine.core.bll.MultipleActionsRunner] 
(org.ovirt.thread.pool-6-thread-8) [7c4b08f7] Start running CanDoAction 
for command number 1/3 (Command type: ShutdownVm)
2014-06-05 12:00:33,130 INFO 
[org.ovirt.engine.core.bll.MultipleActionsRunner] 
(org.ovirt.thread.pool-6-thread-14) [2239cfe1] Start running CanDoAction 
for command number 2/3 (Command type: ShutdownVm)
2014-06-05 12:00:33,134 INFO 
[org.ovirt.engine.core.bll.MultipleActionsRunner] 
(org.ovirt.thread.pool-6-thread-50) [17ece55] Start running CanDoAction 
for command number 3/3 (Command type: ShutdownVm)
2014-06-05 12:00:33,225 INFO 
[org.ovirt.engine.core.bll.MultipleActionsRunner] 
(org.ovirt.thread.pool-6-thread-50) [17ece55] Finish handling 
CanDoAction for command number 3/3 (Command type: ShutdownVm)
2014-06-05 12:00:33,229 INFO 
[org.ovirt.engine.core.bll.MultipleActionsRunner] 
(org.ovirt.thread.pool-6-thread-8) [7c4b08f7] Finish handling 
CanDoAction for command number 1/3 (Command type: ShutdownVm)
2014-06-05 12:00:33,234 INFO 
[org.ovirt.engine.core.bll.MultipleActionsRunner] 
(org.ovirt.thread.pool-6-thread-14) [2239cfe1] Finish handling 
CanDoAction for command number 2/3 (Command type: ShutdownVm)
2014-06-05 12:00:33,710 INFO 
[org.ovirt.engine.core.bll.ShutdownVmCommand] 
(org.ovirt.thread.pool-6-thread-3) [7c4b08f7] Running command: 
ShutdownVmCommand internal: false. Entities affected :  ID: 
6709eaa1-163f-4dc5-9101-e46870438f38 Type: VM
2014-06-05 12:00:33,728 INFO 
[org.ovirt.engine.core.bll.ShutdownVmCommand] 
(org.ovirt.thread.pool-6-thread-3) [7c4b08f7] Entered (VM Bench3).
2014-06-05 12:00:33,728 INFO 
[org.ovirt.engine.core.bll.ShutdownVmCommand] 
(org.ovirt.thread.pool-6-thread-3) [7c4b08f7] Sending shutdown command 
for VM Bench3.
2014-06-05 12:00:33,764 INFO 
[org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [7c4b08f7] START, 
DestroyVmVDSCommand(HostName = node3.test.now, HostId = 
7415506c-cda7-4018-804d-5f6d3beddbfb, 
vmId=6709eaa1-163f-4dc5-9101-e46870438f38, force=false, 
secondsToWait=30, gracefully=true), log id: 5eddc358
2014-06-05 12:00:33,790 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [7c4b08f7] START, 
DestroyVDSCommand(HostName = node3.test.now, HostId = 
7415506c-cda7-4018-804d-5f6d3beddbfb, 
vmId=6709eaa1-163f-4dc5-9101-e46870438f38, force=false, 
secondsToWait=30, gracefully=true), log id: 19f6f7c8
2014-06-05 12:00:33,838 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [7c4b08f7] FINISH, DestroyVDSCommand, 
log id: 19f6f7c8
2014-06-05 12:00:33,843 INFO 
[org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [7c4b08f7] FINISH, 
DestroyVmVDSCommand, return: PoweringDown, log id: 5eddc358
2014-06-05 12:00:33,855 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(org.ovirt.thread.pool-6-thread-3) [7c4b08f7] Correlation ID: 7c4b08f7, 
Job ID: 406c481e-102b-4488-9286-c9b38197ef36, Call Stack: null, Custom 
Event ID: -1, Message: VM shutdown initiated by admin on VM Bench3 
(Host: node3.test.now).
2014-06-05 12:00:33,921 INFO 
[org.ovirt.engine.core.bll.ShutdownVmCommand] 
(org.ovirt.thread.pool-6-thread-3) [2239cfe1] Running command: 
ShutdownVmCommand internal: false. Entities affected :  ID: 
8b305f06-2c82-4a13-99f2-5beab5a056ea Type: VM
2014-06-05 12:00:33,967 INFO 
[org.ovirt.engine.core.bll.ShutdownVmCommand] 
(org.ovirt.thread.pool-6-thread-3) [2239cfe1] Entered (VM Bench4).
2014-06-05 12:00:33,969 INFO 
[org.ovirt.engine.core.bll.ShutdownVmCommand] 
(org.ovirt.thread.pool-6-thread-3) [2239cfe1] Sending shutdown command 
for VM Bench4.
2014-06-05 12:00:34,001 INFO 
[org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [2239cfe1] START, 
DestroyVmVDSCommand(HostName = node4.test.now, HostId = 
bb13752e-85cb-4945-822b-48ab2a7b1329, 
vmId=8b305f06-2c82-4a13-99f2-5beab5a056ea, force=false, 
secondsToWait=30, gracefully=true), log id: 23611c0e
2014-06-05 12:00:34,041 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [2239cfe1] START, 
DestroyVDSCommand(HostName = node4.test.now, HostId = 
bb13752e-85cb-4945-822b-48ab2a7b1329, 
vmId=8b305f06-2c82-4a13-99f2-5beab5a056ea, force=false, 
secondsToWait=30, gracefully=true), log id: 4f1663eb
2014-06-05 12:00:34,048 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [2239cfe1] FINISH, DestroyVDSCommand, 
log id: 4f1663eb
2014-06-05 12:00:34,257 INFO 
[org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [2239cfe1] FINISH, 
DestroyVmVDSCommand, return: PoweringDown, log id: 23611c0e
2014-06-05 12:00:34,455 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(org.ovirt.thread.pool-6-thread-3) [2239cfe1] Correlation ID: 2239cfe1, 
Job ID: 00fb00a7-88b0-4fb1-b14a-fa099e3d6409, Call Stack: null, Custom 
Event ID: -1, Message: VM shutdown initiated by admin on VM Bench4 
(Host: node4.test.now).
2014-06-05 12:00:34,677 INFO 
[org.ovirt.engine.core.bll.ShutdownVmCommand] 
(org.ovirt.thread.pool-6-thread-3) [17ece55] Running command: 
ShutdownVmCommand internal: false. Entities affected :  ID: 
764b60fd-c255-479b-9082-3f4f04b95cb2 Type: VM
2014-06-05 12:00:34,695 INFO 
[org.ovirt.engine.core.bll.ShutdownVmCommand] 
(org.ovirt.thread.pool-6-thread-3) [17ece55] Entered (VM Bench2).
2014-06-05 12:00:34,696 INFO 
[org.ovirt.engine.core.bll.ShutdownVmCommand] 
(org.ovirt.thread.pool-6-thread-3) [17ece55] Sending shutdown command 
for VM Bench2.
2014-06-05 12:00:34,718 INFO 
[org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [17ece55] START, 
DestroyVmVDSCommand(HostName = node2.test.now, HostId = 
28fdcb5d-7acd-410e-8b65-0b4f483cb575, 
vmId=764b60fd-c255-479b-9082-3f4f04b95cb2, force=false, 
secondsToWait=30, gracefully=true), log id: 215e8d55
2014-06-05 12:00:34,740 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [17ece55] START, 
DestroyVDSCommand(HostName = node2.test.now, HostId = 
28fdcb5d-7acd-410e-8b65-0b4f483cb575, 
vmId=764b60fd-c255-479b-9082-3f4f04b95cb2, force=false, 
secondsToWait=30, gracefully=true), log id: 6a5599de
2014-06-05 12:00:34,755 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [17ece55] FINISH, DestroyVDSCommand, 
log id: 6a5599de
2014-06-05 12:00:34,777 INFO 
[org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] 
(org.ovirt.thread.pool-6-thread-3) [17ece55] FINISH, 
DestroyVmVDSCommand, return: PoweringDown, log id: 215e8d55
2014-06-05 12:00:34,833 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(org.ovirt.thread.pool-6-thread-3) [17ece55] Correlation ID: 17ece55, 
Job ID: d92b0c9a-fb0f-4ca6-bc51-8d363aaf378c, Call Stack: null, Custom 
Event ID: -1, Message: VM shutdown initiated by admin on VM Bench2 
(Host: node2.test.now).
2014-06-05 12:01:00,648 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-45) [22ac5fb6] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 7045fa3b
2014-06-05 12:01:00,650 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-48) [4fbc37fa] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 306b54b0
2014-06-05 12:01:00,657 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-25) [760d647e] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 7f7a769d
2014-06-05 12:01:00,661 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-44) [6949bbc8] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 610dcd45
2014-06-05 12:01:00,663 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-94) [21aa560a] ConnectDomainToStorage. 
After Connect all hosts to pool. Time:6/5/14 12:01 PM
2014-06-05 12:02:12,172 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-50) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:02:15,245 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-37) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:02:30,697 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-9) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:02:30,724 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-2) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:03:07,860 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-39) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:04:27,836 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-19) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:04:27,841 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-50) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:05:00,296 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-28) [10a45e4f] Autorecovering 1 storage 
domains
2014-06-05 12:05:00,296 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-28) [10a45e4f] Autorecovering storage 
domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53
2014-06-05 12:05:00,299 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-28) [9bf7039] Running command: 
ConnectDomainToStorageCommand internal: true. Entities affected : ID: 
9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage
2014-06-05 12:05:00,304 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-28) [9bf7039] ConnectDomainToStorage. 
Before Connect all hosts to pool. Time:6/5/14 12:05 PM
2014-06-05 12:05:00,441 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-35) [3164009c] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:05:00,446 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-29) [1a51a7f5] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:05:00,450 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-5) [19f33713] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:05:00,454 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-10) [3dd2802] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:05:00,577 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-35) [3164009c] START, 
ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId = 
bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 7ea7832a
2014-06-05 12:05:00,581 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-29) [1a51a7f5] START, 
ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId = 
7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 143f44d4
2014-06-05 12:05:00,580 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-10) [3dd2802] START, 
ConnectStorageServerVDSCommand(HostName = node1.test.now, HostId = 
e17a740c-47ba-4a81-99ab-6c386b572f26, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 4058bc78
2014-06-05 12:05:00,578 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-5) [19f33713] START, 
ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId = 
28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 6eb8491e
2014-06-05 12:05:23,071 INFO 
[org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] 
(DefaultQuartzScheduler_Worker-10) [77f10397] VM Bench1 
63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e moved from PoweringDown --> Up
2014-06-05 12:05:23,153 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(DefaultQuartzScheduler_Worker-10) [77f10397] Correlation ID: null, Call 
Stack: null, Custom Event ID: -1, Message: Shutdown of VM Bench1 failed.
2014-06-05 12:05:34,341 INFO 
[org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] 
(DefaultQuartzScheduler_Worker-65) [604c5b5d] VM Bench3 
6709eaa1-163f-4dc5-9101-e46870438f38 moved from PoweringDown --> Up
2014-06-05 12:05:34,411 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(DefaultQuartzScheduler_Worker-65) [604c5b5d] Correlation ID: null, Call 
Stack: null, Custom Event ID: -1, Message: Shutdown of VM Bench3 failed.
2014-06-05 12:05:35,312 INFO 
[org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] 
(DefaultQuartzScheduler_Worker-38) [3bbcf288] VM Bench4 
8b305f06-2c82-4a13-99f2-5beab5a056ea moved from PoweringDown --> Up
2014-06-05 12:05:35,439 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(DefaultQuartzScheduler_Worker-38) [3bbcf288] Correlation ID: null, Call 
Stack: null, Custom Event ID: -1, Message: Shutdown of VM Bench4 failed.
2014-06-05 12:05:35,663 INFO 
[org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] 
(DefaultQuartzScheduler_Worker-64) [40fb7b62] VM Bench2 
764b60fd-c255-479b-9082-3f4f04b95cb2 moved from PoweringDown --> Up
2014-06-05 12:05:36,101 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(DefaultQuartzScheduler_Worker-64) [40fb7b62] Correlation ID: null, Call 
Stack: null, Custom Event ID: -1, Message: Shutdown of VM Bench2 failed.
2014-06-05 12:06:00,627 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-10) [3dd2802] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 4058bc78
2014-06-05 12:06:00,629 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-29) [1a51a7f5] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 143f44d4
2014-06-05 12:06:00,632 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-35) [3164009c] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 7ea7832a
2014-06-05 12:06:00,645 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-5) [19f33713] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 6eb8491e
2014-06-05 12:06:00,647 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-28) [9bf7039] ConnectDomainToStorage. 
After Connect all hosts to pool. Time:6/5/14 12:06 PM
2014-06-05 12:07:17,243 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-11) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:08:16,532 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-1) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:08:25,687 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-46) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:10:00,442 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-77) [7cace458] Autorecovering 1 storage 
domains
2014-06-05 12:10:00,442 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-77) [7cace458] Autorecovering storage 
domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53
2014-06-05 12:10:00,443 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-77) [77f9bcd3] Running command: 
ConnectDomainToStorageCommand internal: true. Entities affected : ID: 
9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage
2014-06-05 12:10:00,444 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-77) [77f9bcd3] ConnectDomainToStorage. 
Before Connect all hosts to pool. Time:6/5/14 12:10 PM
2014-06-05 12:10:00,597 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-37) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 3 tasks in the 
queue.
2014-06-05 12:10:00,598 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-10) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 2 tasks in the 
queue.
2014-06-05 12:10:00,599 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-35) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:10:00,600 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-5) [7ecb4630] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:10:00,602 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-35) [25233142] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:10:00,606 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-37) [175926fc] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:10:00,607 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-10) [8d05e48] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:10:00,745 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-35) [25233142] START, 
ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId = 
28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 16b62d67
2014-06-05 12:10:00,748 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-5) [7ecb4630] START, 
ConnectStorageServerVDSCommand(HostName = node1.test.now, HostId = 
e17a740c-47ba-4a81-99ab-6c386b572f26, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 2bc2c88
2014-06-05 12:10:00,748 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-10) [8d05e48] START, 
ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId = 
7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 4cb7e97c
2014-06-05 12:10:00,747 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-37) [175926fc] START, 
ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId = 
bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 442ca304
2014-06-05 12:10:51,626 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-38) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:10:54,669 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-14) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:11:00,801 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-10) [8d05e48] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 4cb7e97c
2014-06-05 12:11:00,811 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-37) [175926fc] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 442ca304
2014-06-05 12:11:00,814 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-5) [7ecb4630] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 2bc2c88
2014-06-05 12:11:00,852 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-35) [25233142] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 16b62d67
2014-06-05 12:11:00,854 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-77) [77f9bcd3] ConnectDomainToStorage. 
After Connect all hosts to pool. Time:6/5/14 12:11 PM
2014-06-05 12:11:40,654 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-25) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:12:14,657 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-31) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:12:27,462 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-37) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:13:59,781 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-22) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:14:15,341 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-10) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:14:21,429 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-35) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:14:21,455 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-4) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:14:40,159 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-17) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:14:52,383 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-15) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:14:52,412 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-27) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:14:55,658 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-42) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:15:00,031 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-65) [604c5b5d] Autorecovering 1 storage 
domains
2014-06-05 12:15:00,031 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-65) [604c5b5d] Autorecovering storage 
domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53
2014-06-05 12:15:00,032 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-65) [7d4ef42] Running command: 
ConnectDomainToStorageCommand internal: true. Entities affected : ID: 
9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage
2014-06-05 12:15:00,035 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-65) [7d4ef42] ConnectDomainToStorage. 
Before Connect all hosts to pool. Time:6/5/14 12:15 PM
2014-06-05 12:15:00,109 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-45) [6c18413] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:15:00,114 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-5) [d3ad154] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:15:00,118 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-1) [32d6d63f] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:15:00,122 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-24) [718f19c7] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:15:00,247 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-24) [718f19c7] START, 
ConnectStorageServerVDSCommand(HostName = node1.test.now, HostId = 
e17a740c-47ba-4a81-99ab-6c386b572f26, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 4bba2a9a
2014-06-05 12:15:00,255 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-5) [d3ad154] START, 
ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId = 
7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 4c27ad04
2014-06-05 12:15:00,249 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-1) [32d6d63f] START, 
ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId = 
28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 1d382d00
2014-06-05 12:15:00,252 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-45) [6c18413] START, 
ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId = 
bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 7daf7955
2014-06-05 12:16:00,301 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-5) [d3ad154] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 4c27ad04
2014-06-05 12:16:00,302 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-24) [718f19c7] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 4bba2a9a
2014-06-05 12:16:00,305 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-45) [6c18413] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 7daf7955
2014-06-05 12:16:00,313 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-1) [32d6d63f] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 1d382d00
2014-06-05 12:16:00,424 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-65) [7d4ef42] ConnectDomainToStorage. 
After Connect all hosts to pool. Time:6/5/14 12:16 PM
2014-06-05 12:18:27,725 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-30) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:18:43,043 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-48) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:18:43,064 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-9) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:18:55,383 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-40) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:18:58,450 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-31) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:19:02,314 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-6) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:20:00,088 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-58) [2e5174b2] Autorecovering 1 storage 
domains
2014-06-05 12:20:00,088 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-58) [2e5174b2] Autorecovering storage 
domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53
2014-06-05 12:20:00,089 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-58) [106f43a5] Running command: 
ConnectDomainToStorageCommand internal: true. Entities affected : ID: 
9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage
2014-06-05 12:20:00,090 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-58) [106f43a5] ConnectDomainToStorage. 
Before Connect all hosts to pool. Time:6/5/14 12:20 PM
2014-06-05 12:20:00,175 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-23) [4233af79] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:20:00,180 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-11) [4aa18a96] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:20:00,184 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-40) [48fedac6] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:20:00,188 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-26) [4b39df17] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:20:00,317 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-40) [48fedac6] START, 
ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId = 
28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 2eb75130
2014-06-05 12:20:00,321 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-26) [4b39df17] START, 
ConnectStorageServerVDSCommand(HostName = node1.test.now, HostId = 
e17a740c-47ba-4a81-99ab-6c386b572f26, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 957b133
2014-06-05 12:20:00,313 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-11) [4aa18a96] START, 
ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId = 
7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 28e7a51e
2014-06-05 12:20:00,320 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-23) [4233af79] START, 
ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId = 
bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 1e3eb653
2014-06-05 12:21:00,371 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-40) [48fedac6] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 2eb75130
2014-06-05 12:21:00,375 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-11) [4aa18a96] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 28e7a51e
2014-06-05 12:21:00,376 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-26) [4b39df17] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 957b133
2014-06-05 12:21:00,400 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-23) [4233af79] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 1e3eb653
2014-06-05 12:21:00,403 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-58) [106f43a5] ConnectDomainToStorage. 
After Connect all hosts to pool. Time:6/5/14 12:21 PM
2014-06-05 12:23:10,334 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-23) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:23:34,686 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] 
(DefaultQuartzScheduler_Worker-7) [74449d64] Attempting to update 
VMs/Templates Ovf.
2014-06-05 12:23:34,687 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] 
(DefaultQuartzScheduler_Worker-7) [74449d64] Attempting to update VM 
OVFs in Data Center Default
2014-06-05 12:23:34,692 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] 
(DefaultQuartzScheduler_Worker-7) [74449d64] Successfully updated VM 
OVFs in Data Center Default
2014-06-05 12:23:34,693 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] 
(DefaultQuartzScheduler_Worker-7) [74449d64] Attempting to update 
template OVFs in Data Center Default
2014-06-05 12:23:34,695 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] 
(DefaultQuartzScheduler_Worker-7) [74449d64] Successfully updated 
templates OVFs in Data Center Default
2014-06-05 12:23:34,695 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] 
(DefaultQuartzScheduler_Worker-7) [74449d64] Attempting to remove 
unneeded template/vm OVFs in Data Center Default
2014-06-05 12:23:34,697 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] 
(DefaultQuartzScheduler_Worker-7) [74449d64] Successfully removed 
unneeded template/vm OVFs in Data Center Default
2014-06-05 12:23:38,356 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-29) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:23:44,441 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-16) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:24:00,113 INFO 
[org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] 
(org.ovirt.thread.pool-6-thread-44) [43b031c4] Running command: 
MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 
e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS
2014-06-05 12:24:00,146 INFO 
[org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] 
(org.ovirt.thread.pool-6-thread-44) [43b031c4] START, 
SetVdsStatusVDSCommand(HostName = node1.test.now, HostId = 
e17a740c-47ba-4a81-99ab-6c386b572f26, status=PreparingForMaintenance, 
nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 1d0d3a10
2014-06-05 12:24:00,171 INFO 
[org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] 
(org.ovirt.thread.pool-6-thread-44) [43b031c4] FINISH, 
SetVdsStatusVDSCommand, log id: 1d0d3a10
2014-06-05 12:24:00,460 INFO 
[org.ovirt.engine.core.bll.MaintenanceVdsCommand] 
(org.ovirt.thread.pool-6-thread-44) [43b031c4] Running command: 
MaintenanceVdsCommand internal: true. Entities affected :  ID: 
e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS
2014-06-05 12:24:00,539 INFO 
[org.ovirt.engine.core.bll.InternalMigrateVmCommand] 
(org.ovirt.thread.pool-6-thread-44) [155d3855] Lock Acquired to object 
EngineLock [exclusiveLocks= key: 63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e 
value: VM
, sharedLocks= ]
2014-06-05 12:24:00,622 INFO 
[org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] 
(DefaultQuartzScheduler_Worker-69) [2b68c51d] Running command: 
MaintenanceNumberOfVdssCommand internal: true. Entities affected : ID: 
e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS
2014-06-05 12:24:00,779 INFO 
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] 
(org.ovirt.thread.pool-6-thread-44) [155d3855] Candidate host 
node2.test.now (28fdcb5d-7acd-410e-8b65-0b4f483cb575) was filtered out 
by VAR__FILTERTYPE__INTERNAL filter Memory
2014-06-05 12:24:00,808 INFO 
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] 
(org.ovirt.thread.pool-6-thread-44) [155d3855] Candidate host 
node3.test.now (7415506c-cda7-4018-804d-5f6d3beddbfb) was filtered out 
by VAR__FILTERTYPE__INTERNAL filter Memory
2014-06-05 12:24:00,809 INFO 
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] 
(org.ovirt.thread.pool-6-thread-44) [155d3855] Candidate host 
node4.test.now (bb13752e-85cb-4945-822b-48ab2a7b1329) was filtered out 
by VAR__FILTERTYPE__INTERNAL filter Memory
2014-06-05 12:24:00,813 WARN 
[org.ovirt.engine.core.bll.InternalMigrateVmCommand] 
(org.ovirt.thread.pool-6-thread-44) [155d3855] CanDoAction of action 
InternalMigrateVm failed. 
Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName

node2.test.now,$filterName 
Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName 
node4.test.now,$filterName 
Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName 
node3.test.now,$filterName Memory,SCHEDULING_HOST_FILTERED_REASON
2014-06-05 12:24:00,825 INFO 
[org.ovirt.engine.core.bll.InternalMigrateVmCommand] 
(org.ovirt.thread.pool-6-thread-44) [155d3855] Lock freed to object 
EngineLock [exclusiveLocks= key: 63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e 
value: VM
, sharedLocks= ]
2014-06-05 12:24:00,860 ERROR 
[org.ovirt.engine.core.bll.MaintenanceVdsCommand] 
(org.ovirt.thread.pool-6-thread-44) [155d3855] 
ResourceManager::vdsMaintenance - Failed migrating desktop Bench1
2014-06-05 12:24:00,883 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(org.ovirt.thread.pool-6-thread-44) [155d3855] Correlation ID: 43b031c4, 
Job ID: 38a05481-0ced-4285-b3ee-6574ce39eb77, Call Stack: null, Custom 
Event ID: -1, Message: Host node1.test.now cannot change into 
maintenance mode - not all Vms have been migrated successfully. Consider 
manual intervention: stopping/migrating Vms: Bench1 (User: admin).
2014-06-05 12:24:00,894 INFO 
[org.ovirt.engine.core.bll.MaintenanceVdsCommand] 
(DefaultQuartzScheduler_Worker-69) [2b68c51d] Running command: 
MaintenanceVdsCommand internal: true. Entities affected :  ID: 
e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS
2014-06-05 12:24:01,005 INFO 
[org.ovirt.engine.core.bll.InternalMigrateVmCommand] 
(DefaultQuartzScheduler_Worker-69) [36b0c4c7] Lock Acquired to object 
EngineLock [exclusiveLocks= key: 63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e 
value: VM
, sharedLocks= ]
2014-06-05 12:24:01,147 INFO 
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] 
(DefaultQuartzScheduler_Worker-69) [36b0c4c7] Candidate host 
node2.test.now (28fdcb5d-7acd-410e-8b65-0b4f483cb575) was filtered out 
by VAR__FILTERTYPE__INTERNAL filter Memory
2014-06-05 12:24:01,155 INFO 
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] 
(DefaultQuartzScheduler_Worker-69) [36b0c4c7] Candidate host 
node3.test.now (7415506c-cda7-4018-804d-5f6d3beddbfb) was filtered out 
by VAR__FILTERTYPE__INTERNAL filter Memory
2014-06-05 12:24:01,166 INFO 
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] 
(DefaultQuartzScheduler_Worker-69) [36b0c4c7] Candidate host 
node4.test.now (bb13752e-85cb-4945-822b-48ab2a7b1329) was filtered out 
by VAR__FILTERTYPE__INTERNAL filter Memory
2014-06-05 12:24:01,174 WARN 
[org.ovirt.engine.core.bll.InternalMigrateVmCommand] 
(DefaultQuartzScheduler_Worker-69) [36b0c4c7] CanDoAction of action 
InternalMigrateVm failed. 
Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName

node2.test.now,$filterName 
Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName 
node4.test.now,$filterName 
Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName 
node3.test.now,$filterName Memory,SCHEDULING_HOST_FILTERED_REASON
2014-06-05 12:24:01,187 INFO 
[org.ovirt.engine.core.bll.InternalMigrateVmCommand] 
(DefaultQuartzScheduler_Worker-69) [36b0c4c7] Lock freed to object 
EngineLock [exclusiveLocks= key: 63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e 
value: VM
, sharedLocks= ]
2014-06-05 12:24:01,228 ERROR 
[org.ovirt.engine.core.bll.MaintenanceVdsCommand] 
(DefaultQuartzScheduler_Worker-69) [36b0c4c7] 
ResourceManager::vdsMaintenance - Failed migrating desktop Bench1
2014-06-05 12:24:01,238 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(DefaultQuartzScheduler_Worker-69) [36b0c4c7] Correlation ID: 2b68c51d, 
Job ID: 3a956cf5-ec2e-45b5-a2bc-40632496fec6, Call Stack: null, Custom 
Event ID: -1, Message: Failed to switch Host node1.test.now to 
Maintenance mode.
2014-06-05 12:24:40,507 INFO [org.ovirt.engine.core.bll.StopVdsCommand] 
(ajp--127.0.0.1-8702-4) [32d3da21] Lock Acquired to object EngineLock 
[exclusiveLocks= key: e17a740c-47ba-4a81-99ab-6c386b572f26 value: VDS_FENCE
, sharedLocks= ]
2014-06-05 12:24:40,798 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null, Custom 
Event ID: -1, Message: Host node3.test.now from cluster Default was 
chosen as a proxy to execute Status command on Host node1.test.now.
2014-06-05 12:24:40,799 INFO [org.ovirt.engine.core.bll.FenceExecutor] 
(ajp--127.0.0.1-8702-4) Using Host node3.test.now from cluster Default 
as proxy to execute Status command on Host node1.test.now
2014-06-05 12:24:40,800 WARN [org.ovirt.engine.core.bll.StopVdsCommand] 
(ajp--127.0.0.1-8702-4) CanDoAction of action StopVds failed. 
Reasons:VAR__ACTION__STOP,VDS_STATUS_NOT_VALID_FOR_STOP
2014-06-05 12:24:40,811 INFO [org.ovirt.engine.core.bll.StopVdsCommand] 
(ajp--127.0.0.1-8702-4) Lock freed to object EngineLock [exclusiveLocks= 
key: e17a740c-47ba-4a81-99ab-6c386b572f26 value: VDS_FENCE
, sharedLocks= ]
2014-06-05 12:25:00,021 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-27) [70486be2] Autorecovering 1 storage 
domains
2014-06-05 12:25:00,021 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-27) [70486be2] Autorecovering storage 
domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53
2014-06-05 12:25:00,022 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-27) [70d58101] Running command: 
ConnectDomainToStorageCommand internal: true. Entities affected : ID: 
9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage
2014-06-05 12:25:00,023 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-27) [70d58101] ConnectDomainToStorage. 
Before Connect all hosts to pool. Time:6/5/14 12:25 PM
2014-06-05 12:25:00,088 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-6) [362a5fe3] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:25:00,093 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-47) [683e82b0] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:25:00,100 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-14) [6ed26267] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:25:00,196 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-6) [362a5fe3] START, 
ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId = 
bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 4591e85a
2014-06-05 12:25:00,197 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-14) [6ed26267] START, 
ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId = 
28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 17ef6900
2014-06-05 12:25:00,197 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-47) [683e82b0] START, 
ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId = 
7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: db1af1a
2014-06-05 12:25:00,207 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-2) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:25:19,989 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-42) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:26:00,247 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-47) [683e82b0] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: db1af1a
2014-06-05 12:26:00,256 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-6) [362a5fe3] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 4591e85a
2014-06-05 12:26:00,263 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-14) [6ed26267] FINISH, 
ConnectStorageServerVDSCommand, return: 
{f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 17ef6900
2014-06-05 12:26:00,265 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-27) [70d58101] ConnectDomainToStorage. 
After Connect all hosts to pool. Time:6/5/14 12:26 PM
2014-06-05 12:28:15,399 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-17) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:28:18,443 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-8) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:28:55,121 WARN 
[org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] 
(org.ovirt.thread.pool-6-thread-45) Executing a command: 
java.util.concurrent.FutureTask , but note that there are 1 tasks in the 
queue.
2014-06-05 12:29:04,927 INFO 
[org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] 
(DefaultQuartzScheduler_Worker-51) [51b730a8] Running command: 
MaintenanceNumberOfVdssCommand internal: true. Entities affected : ID: 
e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS
2014-06-05 12:29:05,029 INFO 
[org.ovirt.engine.core.bll.MaintenanceVdsCommand] 
(DefaultQuartzScheduler_Worker-51) [51b730a8] Running command: 
MaintenanceVdsCommand internal: true. Entities affected :  ID: 
e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS
2014-06-05 12:29:05,073 INFO 
[org.ovirt.engine.core.bll.InternalMigrateVmCommand] 
(DefaultQuartzScheduler_Worker-51) [63736865] Lock Acquired to object 
EngineLock [exclusiveLocks= key: 63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e 
value: VM
, sharedLocks= ]
2014-06-05 12:29:05,164 INFO 
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] 
(DefaultQuartzScheduler_Worker-51) [63736865] Candidate host 
node2.test.now (28fdcb5d-7acd-410e-8b65-0b4f483cb575) was filtered out 
by VAR__FILTERTYPE__INTERNAL filter Memory
2014-06-05 12:29:05,167 INFO 
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] 
(DefaultQuartzScheduler_Worker-51) [63736865] Candidate host 
node3.test.now (7415506c-cda7-4018-804d-5f6d3beddbfb) was filtered out 
by VAR__FILTERTYPE__INTERNAL filter Memory
2014-06-05 12:29:05,170 INFO 
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] 
(DefaultQuartzScheduler_Worker-51) [63736865] Candidate host 
node4.test.now (bb13752e-85cb-4945-822b-48ab2a7b1329) was filtered out 
by VAR__FILTERTYPE__INTERNAL filter Memory
2014-06-05 12:29:05,173 WARN 
[org.ovirt.engine.core.bll.InternalMigrateVmCommand] 
(DefaultQuartzScheduler_Worker-51) [63736865] CanDoAction of action 
InternalMigrateVm failed. 
Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName

node2.test.now,$filterName 
Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName 
node4.test.now,$filterName 
Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName 
node3.test.now,$filterName Memory,SCHEDULING_HOST_FILTERED_REASON
2014-06-05 12:29:05,181 INFO 
[org.ovirt.engine.core.bll.InternalMigrateVmCommand] 
(DefaultQuartzScheduler_Worker-51) [63736865] Lock freed to object 
EngineLock [exclusiveLocks= key: 63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e 
value: VM
, sharedLocks= ]
2014-06-05 12:29:05,207 ERROR 
[org.ovirt.engine.core.bll.MaintenanceVdsCommand] 
(DefaultQuartzScheduler_Worker-51) [63736865] 
ResourceManager::vdsMaintenance - Failed migrating desktop Bench1
2014-06-05 12:29:05,218 INFO 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(DefaultQuartzScheduler_Worker-51) [63736865] Correlation ID: 51b730a8, 
Job ID: b8441378-051c-4af0-8802-e2efb9e5d4a4, Call Stack: null, Custom 
Event ID: -1, Message: Failed to switch Host node1.test.now to 
Maintenance mode.
2014-06-05 12:30:00,018 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-52) [2e3993e6] Autorecovering 1 storage 
domains
2014-06-05 12:30:00,018 INFO 
[org.ovirt.engine.core.bll.AutoRecoveryManager] 
(DefaultQuartzScheduler_Worker-52) [2e3993e6] Autorecovering storage 
domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53
2014-06-05 12:30:00,021 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-52) [1585ee27] Running command: 
ConnectDomainToStorageCommand internal: true. Entities affected : ID: 
9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage
2014-06-05 12:30:00,024 INFO 
[org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] 
(DefaultQuartzScheduler_Worker-52) [1585ee27] ConnectDomainToStorage. 
Before Connect all hosts to pool. Time:6/5/14 12:30 PM
2014-06-05 12:30:00,119 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-17) [6c0a8af9] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:30:00,121 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-26) [10056f73] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:30:00,134 INFO 
[org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] 
(org.ovirt.thread.pool-6-thread-24) [750ef0f4] Running command: 
ConnectStorageToVdsCommand internal: true. Entities affected :  ID: 
aaa00000-0000-0000-0000-123456789aaa Type: System
2014-06-05 12:30:00,248 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-17) [6c0a8af9] START, 
ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId = 
bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 1c35901d
2014-06-05 12:30:00,250 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-24) [750ef0f4] START, 
ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId = 
28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 1a4d78a1
2014-06-05 12:30:00,250 INFO 
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] 
(org.ovirt.thread.pool-6-thread-26) [10056f73] START, 
ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId = 
7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId = 
00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList 
= [{ id: f47e9f99-9989-4297-a84f-4f75338eeced, connection: 
10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType: null, 
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null 
};]), log id: 60464b56

--------------000602090709060001060807
Content-Type: multipart/related;
 boundary="------------090404080503060404080706"

--------------090404080503060404080706
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

<html>
  <head>

    <meta http-equiv="content-type" content="text/html;
charset=ISO-8859-1">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    Hi,<br>
    <br>
    After upgrading to 3.4.2 rc I want to reinstall the nodes. But there
    are some benchmark VM's that I'm unable to shutdown to put the nodes
    in maintenance. How can I kill these VM's without having to kill the
    power to the nodes manually?<br>
    <br>
    Kind regards, <br>
    Jorick Astrego<br>
    <br>
    Netbulae B.V.<br>
    <br>
    <table style="table-layout: fixed;" class="GIIOMO5DDTB"
      __gwtcellbasedwidgetimpldispatchingblur="true"
      __gwtcellbasedwidgetimpldispatchingfocus="true" height="403"
      width="825" cellspacing="0">
      <tbody>
        <tr __gwt_row="1" __gwt_subrow="0" class="GIIOMO5DMSB
          GIIOMO5DDSB">
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DORB GIIOMO5DESB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18350">
              <div style="line-height: 100%; text-align: center;
                vertical-align: middle;"><br>
                <img onload='this.__gwtLastUnhandledEvent="load";'
                  src="cid:part1.07090907.08000003@netbulae.eu"

style="width:14px;height:12px;background:url(data:image/gif;base64,R0lGODlhDgAMAJEDAMwzAP8zAGYAAP///yH5BAEAAAMALAAAAAAOAAwAAAIs3GA5ogeYQGBGyADlo+u+gHHVBQJiYpVnBJaN4XmNJ6QYG45uZypWX1nVEgUAOw==)
                  no-repeat 0px 0px;" border="0"></div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DESB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18351">
              <div id="gwt-uid-3662_col1_row1">2014-Jun-05,
12:24</div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DISB GIIOMO5DESB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18352">
              <div id="gwt-uid-3662_col2_row1">Failed to switch Host
                node1.test.now to Maintenance mode.</div>
            </div>
          </td>
        </tr>
        <tr __gwt_row="2" __gwt_subrow="0"
class="GIIOMO5DMRB">
          <td class="GIIOMO5DLRB GIIOMO5DNRB GIIOMO5DORB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18350">
              <div style="line-height: 100%; text-align: center;
                vertical-align: middle;"><img
                  onload='this.__gwtLastUnhandledEvent="load";'
                  src="cid:part1.07090907.08000003@netbulae.eu"

style="width:14px;height:12px;background:url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAA4AAAAMCAYAAABSgIzaAAAAKklEQVR42mNgwAL+n0n7/3+mMRifSTP+z0AsGNVIC40gxciYgeZgcPoRAJrmd4n8GZZPAAAAAElFTkSuQmCC)
                  no-repeat 0px 0px;" border="0"></div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNRB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18351">
              <div id="gwt-uid-3662_col1_row2">2014-Jun-05,
12:24</div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNRB GIIOMO5DISB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18352">
              <div id="gwt-uid-3662_col2_row2">Host node1.test.now
                cannot change into maintenance mode - not all Vms have
                been migrated successfully. Consider manual
                intervention: stopping/migrating Vms: Bench1 (User:
                admin).</div>
            </div>
          </td>
        </tr>
        <tr __gwt_row="3" __gwt_subrow="0"
class="GIIOMO5DMSB">
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DORB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18350">
              <div style="line-height: 100%; text-align: center;
                vertical-align: middle;"><img
                  onload='this.__gwtLastUnhandledEvent="load";'
                  src="cid:part1.07090907.08000003@netbulae.eu"

style="width:14px;height:12px;background:url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAA4AAAAMCAYAAABSgIzaAAAAKklEQVR42mNgwAL+n0n7/3+mMRifSTP+z0AsGNVIC40gxciYgeZgcPoRAJrmd4n8GZZPAAAAAElFTkSuQmCC)
                  no-repeat 0px 0px;" border="0"></div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNSB">
            <div tabindex="0" style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18351">
              <div id="gwt-uid-3662_col1_row3">2014-Jun-05,
12:05</div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DISB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18352">
              <div id="gwt-uid-3662_col2_row3">Shutdown of VM Bench2
                failed.</div>
            </div>
          </td>
        </tr>
        <tr __gwt_row="4" __gwt_subrow="0"
class="GIIOMO5DMRB">
          <td class="GIIOMO5DLRB GIIOMO5DNRB GIIOMO5DORB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18350">
              <div style="line-height: 100%; text-align: center;
                vertical-align: middle;"><img
                  onload='this.__gwtLastUnhandledEvent="load";'
                  src="cid:part1.07090907.08000003@netbulae.eu"

style="width:14px;height:12px;background:url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAA4AAAAMCAYAAABSgIzaAAAAKklEQVR42mNgwAL+n0n7/3+mMRifSTP+z0AsGNVIC40gxciYgeZgcPoRAJrmd4n8GZZPAAAAAElFTkSuQmCC)
                  no-repeat 0px 0px;" border="0"></div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNRB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18351">
              <div id="gwt-uid-3662_col1_row4">2014-Jun-05,
12:05</div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNRB GIIOMO5DISB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18352">
              <div id="gwt-uid-3662_col2_row4">Shutdown of VM Bench4
                failed.</div>
            </div>
          </td>
        </tr>
        <tr __gwt_row="5" __gwt_subrow="0"
class="GIIOMO5DMSB">
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DORB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18350">
              <div style="line-height: 100%; text-align: center;
                vertical-align: middle;"><img
                  onload='this.__gwtLastUnhandledEvent="load";'
                  src="cid:part1.07090907.08000003@netbulae.eu"

style="width:14px;height:12px;background:url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAA4AAAAMCAYAAABSgIzaAAAAKklEQVR42mNgwAL+n0n7/3+mMRifSTP+z0AsGNVIC40gxciYgeZgcPoRAJrmd4n8GZZPAAAAAElFTkSuQmCC)
                  no-repeat 0px 0px;" border="0"></div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNSB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18351">
              <div id="gwt-uid-3662_col1_row5">2014-Jun-05,
12:05</div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DISB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18352">
              <div id="gwt-uid-3662_col2_row5">Shutdown of VM Bench3
                failed.&nbsp;&nbsp;&nbsp;&nbsp; <br>
              </div>
            </div>
          </td>
        </tr>
        <tr __gwt_row="6" __gwt_subrow="0"
class="GIIOMO5DMRB">
          <td class="GIIOMO5DLRB GIIOMO5DNRB GIIOMO5DORB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18350">
              <div style="line-height: 100%; text-align: center;
                vertical-align: middle;"><img
                  onload='this.__gwtLastUnhandledEvent="load";'
                  src="cid:part1.07090907.08000003@netbulae.eu"

style="width:14px;height:12px;background:url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAA4AAAAMCAYAAABSgIzaAAAAKklEQVR42mNgwAL+n0n7/3+mMRifSTP+z0AsGNVIC40gxciYgeZgcPoRAJrmd4n8GZZPAAAAAElFTkSuQmCC)
                  no-repeat 0px 0px;" border="0"></div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNRB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18351">
              <div id="gwt-uid-3662_col1_row6">2014-Jun-05,
12:05</div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNRB GIIOMO5DISB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18352">
              <div id="gwt-uid-3662_col2_row6">Shutdown of VM Bench1
                failed.</div>
            </div>
          </td>
        </tr>
        <tr __gwt_row="7" __gwt_subrow="0" class="GIIOMO5DMSB
          GIIOMO5DOSB">
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DORB GIIOMO5DPSB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18350">
              <div style="line-height: 100%; text-align: center;
                vertical-align: middle;"><img
                  onload='this.__gwtLastUnhandledEvent="load";'
                  src="cid:part1.07090907.08000003@netbulae.eu"

style="width:14px;height:12px;background:url(data:image/gif;base64,R0lGODlhDgAMAKIHAE3SEhlQAGHwKiYmJje5BqL/olXgG////yH5BAEAAAcALAAAAAAOAAwAAAM0eLp8ES2GAmBUUxArizDbMQxMBkIDUZCOdypDIY8eEMKAIMiGzeG63q0xABiHkRTyMvgxEgA7)
                  no-repeat 0px 0px;" border="0"></div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DPSB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18351">
              <div id="gwt-uid-3662_col1_row7">2014-Jun-05,
12:00</div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DPSB GIIOMO5DISB">
            <div title="" tabindex="0" style="outline-style:
none;"
              __gwt_cell="cell-gwt-uid-18352">
              <div id="gwt-uid-3662_col2_row7">VM shutdown initiated by
                admin on VM Bench2 (Host: node2.test.now).</div>
            </div>
          </td>
        </tr>
        <tr __gwt_row="8" __gwt_subrow="0"
class="GIIOMO5DMRB">
          <td class="GIIOMO5DLRB GIIOMO5DNRB GIIOMO5DORB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18350">
              <div style="line-height: 100%; text-align: center;
                vertical-align: middle;"><img
                  onload='this.__gwtLastUnhandledEvent="load";'
                  src="cid:part1.07090907.08000003@netbulae.eu"

style="width:14px;height:12px;background:url(data:image/gif;base64,R0lGODlhDgAMAKIHAE3SEhlQAGHwKiYmJje5BqL/olXgG////yH5BAEAAAcALAAAAAAOAAwAAAM0eLp8ES2GAmBUUxArizDbMQxMBkIDUZCOdypDIY8eEMKAIMiGzeG63q0xABiHkRTyMvgxEgA7)
                  no-repeat 0px 0px;" border="0"></div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNRB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18351">
              <div id="gwt-uid-3662_col1_row8">2014-Jun-05,
12:00</div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNRB GIIOMO5DISB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18352">
              <div id="gwt-uid-3662_col2_row8">VM shutdown initiated by
                admin on VM Bench4 (Host: node4.test.now).</div>
            </div>
          </td>
        </tr>
        <tr __gwt_row="9" __gwt_subrow="0"
class="GIIOMO5DMSB">
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DORB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18350">
              <div style="line-height: 100%; text-align: center;
                vertical-align: middle;"><img
                  onload='this.__gwtLastUnhandledEvent="load";'
                  src="cid:part1.07090907.08000003@netbulae.eu"

style="width:14px;height:12px;background:url(data:image/gif;base64,R0lGODlhDgAMAKIHAE3SEhlQAGHwKiYmJje5BqL/olXgG////yH5BAEAAAcALAAAAAAOAAwAAAM0eLp8ES2GAmBUUxArizDbMQxMBkIDUZCOdypDIY8eEMKAIMiGzeG63q0xABiHkRTyMvgxEgA7)
                  no-repeat 0px 0px;" border="0"></div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNSB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18351">
              <div id="gwt-uid-3662_col1_row9">2014-Jun-05,
12:00</div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNSB GIIOMO5DISB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18352">
              <div id="gwt-uid-3662_col2_row9">VM shutdown initiated by
                admin on VM Bench3 (Host: node3.test.now).</div>
            </div>
          </td>
        </tr>
        <tr __gwt_row="10" __gwt_subrow="0"
class="GIIOMO5DMRB">
          <td class="GIIOMO5DLRB GIIOMO5DNRB GIIOMO5DORB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18350">
              <div style="line-height: 100%; text-align: center;
                vertical-align: middle;"><img
                  onload='this.__gwtLastUnhandledEvent="load";'
                  src="cid:part1.07090907.08000003@netbulae.eu"

style="width:14px;height:12px;background:url(data:image/gif;base64,R0lGODlhDgAMAKIHAE3SEhlQAGHwKiYmJje5BqL/olXgG////yH5BAEAAAcALAAAAAAOAAwAAAM0eLp8ES2GAmBUUxArizDbMQxMBkIDUZCOdypDIY8eEMKAIMiGzeG63q0xABiHkRTyMvgxEgA7)
                  no-repeat 0px 0px;" border="0"></div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNRB">
            <div style="outline-style:none;"
              __gwt_cell="cell-gwt-uid-18351">
              <div id="gwt-uid-3662_col1_row10">2014-Jun-05,
12:00</div>
            </div>
          </td>
          <td class="GIIOMO5DLRB GIIOMO5DNRB GIIOMO5DISB">
            <div title="" style="outline-style: none;"
              __gwt_cell="cell-gwt-uid-18352">
              <div id="gwt-uid-3662_col2_row10">VM shutdown initiated by
                admin on VM Bench1 (Host: node1.test.now).&nbsp;&nbsp;&nbsp;
&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; <br>
              </div>
            </div>
          </td>
        </tr>
      </tbody>
    </table>
    <br>
    <br>
    <br>
    2014-06-05 12:00:33,127 INFO&nbsp;
    [org.ovirt.engine.core.bll.MultipleActionsRunner]
    (org.ovirt.thread.pool-6-thread-8) [7c4b08f7] Start running
    CanDoAction for command number 1/3 (Command type: ShutdownVm)<br>
    2014-06-05 12:00:33,130 INFO&nbsp;
    [org.ovirt.engine.core.bll.MultipleActionsRunner]
    (org.ovirt.thread.pool-6-thread-14) [2239cfe1] Start running
    CanDoAction for command number 2/3 (Command type: ShutdownVm)<br>
    2014-06-05 12:00:33,134 INFO&nbsp;
    [org.ovirt.engine.core.bll.MultipleActionsRunner]
    (org.ovirt.thread.pool-6-thread-50) [17ece55] Start running
    CanDoAction for command number 3/3 (Command type: ShutdownVm)<br>
    2014-06-05 12:00:33,225 INFO&nbsp;
    [org.ovirt.engine.core.bll.MultipleActionsRunner]
    (org.ovirt.thread.pool-6-thread-50) [17ece55] Finish handling
    CanDoAction for command number 3/3 (Command type: ShutdownVm)<br>
    2014-06-05 12:00:33,229 INFO&nbsp;
    [org.ovirt.engine.core.bll.MultipleActionsRunner]
    (org.ovirt.thread.pool-6-thread-8) [7c4b08f7] Finish handling
    CanDoAction for command number 1/3 (Command type: ShutdownVm)<br>
    2014-06-05 12:00:33,234 INFO&nbsp;
    [org.ovirt.engine.core.bll.MultipleActionsRunner]
    (org.ovirt.thread.pool-6-thread-14) [2239cfe1] Finish handling
    CanDoAction for command number 2/3 (Command type: ShutdownVm)<br>
    2014-06-05 12:00:33,710 INFO&nbsp;
    [org.ovirt.engine.core.bll.ShutdownVmCommand]
    (org.ovirt.thread.pool-6-thread-3) [7c4b08f7] Running command:
    ShutdownVmCommand internal: false. Entities affected :&nbsp; ID:
    6709eaa1-163f-4dc5-9101-e46870438f38 Type: VM<br>
    2014-06-05 12:00:33,728 INFO&nbsp;
    [org.ovirt.engine.core.bll.ShutdownVmCommand]
    (org.ovirt.thread.pool-6-thread-3) [7c4b08f7] Entered (VM Bench3).<br>
    2014-06-05 12:00:33,728 INFO&nbsp;
    [org.ovirt.engine.core.bll.ShutdownVmCommand]
    (org.ovirt.thread.pool-6-thread-3) [7c4b08f7] Sending shutdown
    command for VM Bench3.<br>
    2014-06-05 12:00:33,764 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [7c4b08f7] START,
    DestroyVmVDSCommand(HostName = node3.test.now, HostId =
    7415506c-cda7-4018-804d-5f6d3beddbfb,
    vmId=6709eaa1-163f-4dc5-9101-e46870438f38, force=false,
    secondsToWait=30, gracefully=true), log id: 5eddc358<br>
    2014-06-05 12:00:33,790 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [7c4b08f7] START,
    DestroyVDSCommand(HostName = node3.test.now, HostId =
    7415506c-cda7-4018-804d-5f6d3beddbfb,
    vmId=6709eaa1-163f-4dc5-9101-e46870438f38, force=false,
    secondsToWait=30, gracefully=true), log id: 19f6f7c8<br>
    2014-06-05 12:00:33,838 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [7c4b08f7] FINISH,
    DestroyVDSCommand, log id: 19f6f7c8<br>
    2014-06-05 12:00:33,843 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [7c4b08f7] FINISH,
    DestroyVmVDSCommand, return: PoweringDown, log id: 5eddc358<br>
    2014-06-05 12:00:33,855 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (org.ovirt.thread.pool-6-thread-3) [7c4b08f7] Correlation ID:
    7c4b08f7, Job ID: 406c481e-102b-4488-9286-c9b38197ef36, Call Stack:
    null, Custom Event ID: -1, Message: VM shutdown initiated by admin
    on VM Bench3 (Host: node3.test.now).<br>
    2014-06-05 12:00:33,921 INFO&nbsp;
    [org.ovirt.engine.core.bll.ShutdownVmCommand]
    (org.ovirt.thread.pool-6-thread-3) [2239cfe1] Running command:
    ShutdownVmCommand internal: false. Entities affected :&nbsp; ID:
    8b305f06-2c82-4a13-99f2-5beab5a056ea Type: VM<br>
    2014-06-05 12:00:33,967 INFO&nbsp;
    [org.ovirt.engine.core.bll.ShutdownVmCommand]
    (org.ovirt.thread.pool-6-thread-3) [2239cfe1] Entered (VM Bench4).<br>
    2014-06-05 12:00:33,969 INFO&nbsp;
    [org.ovirt.engine.core.bll.ShutdownVmCommand]
    (org.ovirt.thread.pool-6-thread-3) [2239cfe1] Sending shutdown
    command for VM Bench4.<br>
    2014-06-05 12:00:34,001 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [2239cfe1] START,
    DestroyVmVDSCommand(HostName = node4.test.now, HostId =
    bb13752e-85cb-4945-822b-48ab2a7b1329,
    vmId=8b305f06-2c82-4a13-99f2-5beab5a056ea, force=false,
    secondsToWait=30, gracefully=true), log id: 23611c0e<br>
    2014-06-05 12:00:34,041 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [2239cfe1] START,
    DestroyVDSCommand(HostName = node4.test.now, HostId =
    bb13752e-85cb-4945-822b-48ab2a7b1329,
    vmId=8b305f06-2c82-4a13-99f2-5beab5a056ea, force=false,
    secondsToWait=30, gracefully=true), log id: 4f1663eb<br>
    2014-06-05 12:00:34,048 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [2239cfe1] FINISH,
    DestroyVDSCommand, log id: 4f1663eb<br>
    2014-06-05 12:00:34,257 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [2239cfe1] FINISH,
    DestroyVmVDSCommand, return: PoweringDown, log id: 23611c0e<br>
    2014-06-05 12:00:34,455 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (org.ovirt.thread.pool-6-thread-3) [2239cfe1] Correlation ID:
    2239cfe1, Job ID: 00fb00a7-88b0-4fb1-b14a-fa099e3d6409, Call Stack:
    null, Custom Event ID: -1, Message: VM shutdown initiated by admin
    on VM Bench4 (Host: node4.test.now).<br>
    2014-06-05 12:00:34,677 INFO&nbsp;
    [org.ovirt.engine.core.bll.ShutdownVmCommand]
    (org.ovirt.thread.pool-6-thread-3) [17ece55] Running command:
    ShutdownVmCommand internal: false. Entities affected :&nbsp; ID:
    764b60fd-c255-479b-9082-3f4f04b95cb2 Type: VM<br>
    2014-06-05 12:00:34,695 INFO&nbsp;
    [org.ovirt.engine.core.bll.ShutdownVmCommand]
    (org.ovirt.thread.pool-6-thread-3) [17ece55] Entered (VM Bench2).<br>
    2014-06-05 12:00:34,696 INFO&nbsp;
    [org.ovirt.engine.core.bll.ShutdownVmCommand]
    (org.ovirt.thread.pool-6-thread-3) [17ece55] Sending shutdown
    command for VM Bench2.<br>
    2014-06-05 12:00:34,718 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [17ece55] START,
    DestroyVmVDSCommand(HostName = node2.test.now, HostId =
    28fdcb5d-7acd-410e-8b65-0b4f483cb575,
    vmId=764b60fd-c255-479b-9082-3f4f04b95cb2, force=false,
    secondsToWait=30, gracefully=true), log id: 215e8d55<br>
    2014-06-05 12:00:34,740 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [17ece55] START,
    DestroyVDSCommand(HostName = node2.test.now, HostId =
    28fdcb5d-7acd-410e-8b65-0b4f483cb575,
    vmId=764b60fd-c255-479b-9082-3f4f04b95cb2, force=false,
    secondsToWait=30, gracefully=true), log id: 6a5599de<br>
    2014-06-05 12:00:34,755 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [17ece55] FINISH,
    DestroyVDSCommand, log id: 6a5599de<br>
    2014-06-05 12:00:34,777 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand]
    (org.ovirt.thread.pool-6-thread-3) [17ece55] FINISH,
    DestroyVmVDSCommand, return: PoweringDown, log id: 215e8d55<br>
    2014-06-05 12:00:34,833 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (org.ovirt.thread.pool-6-thread-3) [17ece55] Correlation ID:
    17ece55, Job ID: d92b0c9a-fb0f-4ca6-bc51-8d363aaf378c, Call Stack:
    null, Custom Event ID: -1, Message: VM shutdown initiated by admin
    on VM Bench2 (Host: node2.test.now).<br>
    2014-06-05 12:01:00,648 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-45) [22ac5fb6] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 7045fa3b<br>
    2014-06-05 12:01:00,650 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-48) [4fbc37fa] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 306b54b0<br>
    2014-06-05 12:01:00,657 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-25) [760d647e] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 7f7a769d<br>
    2014-06-05 12:01:00,661 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-44) [6949bbc8] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 610dcd45<br>
    2014-06-05 12:01:00,663 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-94) [21aa560a]
    ConnectDomainToStorage. After Connect all hosts to pool. Time:6/5/14
    12:01 PM<br>
    2014-06-05 12:02:12,172 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-50) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:02:15,245 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-37) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:02:30,697 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-9) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:02:30,724 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-2) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:03:07,860 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-39) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:04:27,836 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-19) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:04:27,841 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-50) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:05:00,296 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-28) [10a45e4f] Autorecovering 1
    storage domains<br>
    2014-06-05 12:05:00,296 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-28) [10a45e4f] Autorecovering storage
    domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53<br>
    2014-06-05 12:05:00,299 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-28) [9bf7039] Running command:
    ConnectDomainToStorageCommand internal: true. Entities affected :&nbsp;
    ID: 9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage<br>
    2014-06-05 12:05:00,304 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-28) [9bf7039] ConnectDomainToStorage.
    Before Connect all hosts to pool. Time:6/5/14 12:05 PM<br>
    2014-06-05 12:05:00,441 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-35) [3164009c] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:05:00,446 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-29) [1a51a7f5] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:05:00,450 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-5) [19f33713] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:05:00,454 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-10) [3dd2802] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:05:00,577 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-35) [3164009c] START,
    ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId =
    bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 7ea7832a<br>
    2014-06-05 12:05:00,581 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-29) [1a51a7f5] START,
    ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId =
    7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 143f44d4<br>
    2014-06-05 12:05:00,580 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-10) [3dd2802] START,
    ConnectStorageServerVDSCommand(HostName = node1.test.now, HostId =
    e17a740c-47ba-4a81-99ab-6c386b572f26, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 4058bc78<br>
    2014-06-05 12:05:00,578 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-5) [19f33713] START,
    ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId =
    28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 6eb8491e<br>
    2014-06-05 12:05:23,071 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
    (DefaultQuartzScheduler_Worker-10) [77f10397] VM Bench1
    63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e moved from PoweringDown --&gt;
    Up<br>
    2014-06-05 12:05:23,153 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (DefaultQuartzScheduler_Worker-10) [77f10397] Correlation ID: null,
    Call Stack: null, Custom Event ID: -1, Message: Shutdown of VM
    Bench1 failed.<br>
    2014-06-05 12:05:34,341 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
    (DefaultQuartzScheduler_Worker-65) [604c5b5d] VM Bench3
    6709eaa1-163f-4dc5-9101-e46870438f38 moved from PoweringDown --&gt;
    Up<br>
    2014-06-05 12:05:34,411 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (DefaultQuartzScheduler_Worker-65) [604c5b5d] Correlation ID: null,
    Call Stack: null, Custom Event ID: -1, Message: Shutdown of VM
    Bench3 failed.<br>
    2014-06-05 12:05:35,312 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
    (DefaultQuartzScheduler_Worker-38) [3bbcf288] VM Bench4
    8b305f06-2c82-4a13-99f2-5beab5a056ea moved from PoweringDown --&gt;
    Up<br>
    2014-06-05 12:05:35,439 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (DefaultQuartzScheduler_Worker-38) [3bbcf288] Correlation ID: null,
    Call Stack: null, Custom Event ID: -1, Message: Shutdown of VM
    Bench4 failed.<br>
    2014-06-05 12:05:35,663 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
    (DefaultQuartzScheduler_Worker-64) [40fb7b62] VM Bench2
    764b60fd-c255-479b-9082-3f4f04b95cb2 moved from PoweringDown --&gt;
    Up<br>
    2014-06-05 12:05:36,101 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (DefaultQuartzScheduler_Worker-64) [40fb7b62] Correlation ID: null,
    Call Stack: null, Custom Event ID: -1, Message: Shutdown of VM
    Bench2 failed.<br>
    2014-06-05 12:06:00,627 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-10) [3dd2802] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 4058bc78<br>
    2014-06-05 12:06:00,629 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-29) [1a51a7f5] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 143f44d4<br>
    2014-06-05 12:06:00,632 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-35) [3164009c] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 7ea7832a<br>
    2014-06-05 12:06:00,645 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-5) [19f33713] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 6eb8491e<br>
    2014-06-05 12:06:00,647 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-28) [9bf7039] ConnectDomainToStorage.
    After Connect all hosts to pool. Time:6/5/14 12:06 PM<br>
    2014-06-05 12:07:17,243 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-11) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:08:16,532 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-1) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:08:25,687 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-46) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:10:00,442 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-77) [7cace458] Autorecovering 1
    storage domains<br>
    2014-06-05 12:10:00,442 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-77) [7cace458] Autorecovering storage
    domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53<br>
    2014-06-05 12:10:00,443 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-77) [77f9bcd3] Running command:
    ConnectDomainToStorageCommand internal: true. Entities affected :&nbsp;
    ID: 9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage<br>
    2014-06-05 12:10:00,444 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-77) [77f9bcd3]
    ConnectDomainToStorage. Before Connect all hosts to pool.
    Time:6/5/14 12:10 PM<br>
    2014-06-05 12:10:00,597 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-37) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 3 tasks in
    the queue.<br>
    2014-06-05 12:10:00,598 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-10) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 2 tasks in
    the queue.<br>
    2014-06-05 12:10:00,599 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-35) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:10:00,600 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-5) [7ecb4630] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:10:00,602 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-35) [25233142] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:10:00,606 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-37) [175926fc] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:10:00,607 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-10) [8d05e48] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:10:00,745 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-35) [25233142] START,
    ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId =
    28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 16b62d67<br>
    2014-06-05 12:10:00,748 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-5) [7ecb4630] START,
    ConnectStorageServerVDSCommand(HostName = node1.test.now, HostId =
    e17a740c-47ba-4a81-99ab-6c386b572f26, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 2bc2c88<br>
    2014-06-05 12:10:00,748 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-10) [8d05e48] START,
    ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId =
    7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 4cb7e97c<br>
    2014-06-05 12:10:00,747 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-37) [175926fc] START,
    ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId =
    bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 442ca304<br>
    2014-06-05 12:10:51,626 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-38) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:10:54,669 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-14) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:11:00,801 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-10) [8d05e48] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 4cb7e97c<br>
    2014-06-05 12:11:00,811 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-37) [175926fc] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 442ca304<br>
    2014-06-05 12:11:00,814 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-5) [7ecb4630] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 2bc2c88<br>
    2014-06-05 12:11:00,852 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-35) [25233142] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 16b62d67<br>
    2014-06-05 12:11:00,854 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-77) [77f9bcd3]
    ConnectDomainToStorage. After Connect all hosts to pool. Time:6/5/14
    12:11 PM<br>
    2014-06-05 12:11:40,654 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-25) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:12:14,657 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-31) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:12:27,462 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-37) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:13:59,781 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-22) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:14:15,341 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-10) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:14:21,429 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-35) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:14:21,455 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-4) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:14:40,159 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-17) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:14:52,383 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-15) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:14:52,412 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-27) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:14:55,658 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-42) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:15:00,031 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-65) [604c5b5d] Autorecovering 1
    storage domains<br>
    2014-06-05 12:15:00,031 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-65) [604c5b5d] Autorecovering storage
    domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53<br>
    2014-06-05 12:15:00,032 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-65) [7d4ef42] Running command:
    ConnectDomainToStorageCommand internal: true. Entities affected :&nbsp;
    ID: 9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage<br>
    2014-06-05 12:15:00,035 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-65) [7d4ef42] ConnectDomainToStorage.
    Before Connect all hosts to pool. Time:6/5/14 12:15 PM<br>
    2014-06-05 12:15:00,109 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-45) [6c18413] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:15:00,114 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-5) [d3ad154] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:15:00,118 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-1) [32d6d63f] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:15:00,122 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-24) [718f19c7] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:15:00,247 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-24) [718f19c7] START,
    ConnectStorageServerVDSCommand(HostName = node1.test.now, HostId =
    e17a740c-47ba-4a81-99ab-6c386b572f26, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 4bba2a9a<br>
    2014-06-05 12:15:00,255 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-5) [d3ad154] START,
    ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId =
    7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 4c27ad04<br>
    2014-06-05 12:15:00,249 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-1) [32d6d63f] START,
    ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId =
    28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 1d382d00<br>
    2014-06-05 12:15:00,252 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-45) [6c18413] START,
    ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId =
    bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 7daf7955<br>
    2014-06-05 12:16:00,301 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-5) [d3ad154] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 4c27ad04<br>
    2014-06-05 12:16:00,302 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-24) [718f19c7] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 4bba2a9a<br>
    2014-06-05 12:16:00,305 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-45) [6c18413] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 7daf7955<br>
    2014-06-05 12:16:00,313 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-1) [32d6d63f] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 1d382d00<br>
    2014-06-05 12:16:00,424 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-65) [7d4ef42] ConnectDomainToStorage.
    After Connect all hosts to pool. Time:6/5/14 12:16 PM<br>
    2014-06-05 12:18:27,725 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-30) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:18:43,043 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-48) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:18:43,064 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-9) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:18:55,383 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-40) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:18:58,450 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-31) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:19:02,314 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-6) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:20:00,088 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-58) [2e5174b2] Autorecovering 1
    storage domains<br>
    2014-06-05 12:20:00,088 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-58) [2e5174b2] Autorecovering storage
    domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53<br>
    2014-06-05 12:20:00,089 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-58) [106f43a5] Running command:
    ConnectDomainToStorageCommand internal: true. Entities affected :&nbsp;
    ID: 9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage<br>
    2014-06-05 12:20:00,090 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-58) [106f43a5]
    ConnectDomainToStorage. Before Connect all hosts to pool.
    Time:6/5/14 12:20 PM<br>
    2014-06-05 12:20:00,175 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-23) [4233af79] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:20:00,180 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-11) [4aa18a96] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:20:00,184 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-40) [48fedac6] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:20:00,188 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-26) [4b39df17] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:20:00,317 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-40) [48fedac6] START,
    ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId =
    28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 2eb75130<br>
    2014-06-05 12:20:00,321 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-26) [4b39df17] START,
    ConnectStorageServerVDSCommand(HostName = node1.test.now, HostId =
    e17a740c-47ba-4a81-99ab-6c386b572f26, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 957b133<br>
    2014-06-05 12:20:00,313 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-11) [4aa18a96] START,
    ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId =
    7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 28e7a51e<br>
    2014-06-05 12:20:00,320 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-23) [4233af79] START,
    ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId =
    bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 1e3eb653<br>
    2014-06-05 12:21:00,371 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-40) [48fedac6] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 2eb75130<br>
    2014-06-05 12:21:00,375 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-11) [4aa18a96] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 28e7a51e<br>
    2014-06-05 12:21:00,376 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-26) [4b39df17] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 957b133<br>
    2014-06-05 12:21:00,400 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-23) [4233af79] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 1e3eb653<br>
    2014-06-05 12:21:00,403 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-58) [106f43a5]
    ConnectDomainToStorage. After Connect all hosts to pool. Time:6/5/14
    12:21 PM<br>
    2014-06-05 12:23:10,334 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-23) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:23:34,686 INFO&nbsp;
    [org.ovirt.engine.core.bll.OvfDataUpdater]
    (DefaultQuartzScheduler_Worker-7) [74449d64] Attempting to update
    VMs/Templates Ovf.<br>
    2014-06-05 12:23:34,687 INFO&nbsp;
    [org.ovirt.engine.core.bll.OvfDataUpdater]
    (DefaultQuartzScheduler_Worker-7) [74449d64] Attempting to update VM
    OVFs in Data Center Default<br>
    2014-06-05 12:23:34,692 INFO&nbsp;
    [org.ovirt.engine.core.bll.OvfDataUpdater]
    (DefaultQuartzScheduler_Worker-7) [74449d64] Successfully updated VM
    OVFs in Data Center Default<br>
    2014-06-05 12:23:34,693 INFO&nbsp;
    [org.ovirt.engine.core.bll.OvfDataUpdater]
    (DefaultQuartzScheduler_Worker-7) [74449d64] Attempting to update
    template OVFs in Data Center Default<br>
    2014-06-05 12:23:34,695 INFO&nbsp;
    [org.ovirt.engine.core.bll.OvfDataUpdater]
    (DefaultQuartzScheduler_Worker-7) [74449d64] Successfully updated
    templates OVFs in Data Center Default<br>
    2014-06-05 12:23:34,695 INFO&nbsp;
    [org.ovirt.engine.core.bll.OvfDataUpdater]
    (DefaultQuartzScheduler_Worker-7) [74449d64] Attempting to remove
    unneeded template/vm OVFs in Data Center Default<br>
    2014-06-05 12:23:34,697 INFO&nbsp;
    [org.ovirt.engine.core.bll.OvfDataUpdater]
    (DefaultQuartzScheduler_Worker-7) [74449d64] Successfully removed
    unneeded template/vm OVFs in Data Center Default<br>
    2014-06-05 12:23:38,356 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-29) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:23:44,441 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-16) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:24:00,113 INFO&nbsp;
    [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand]
    (org.ovirt.thread.pool-6-thread-44) [43b031c4] Running command:
    MaintenanceNumberOfVdssCommand internal: false. Entities affected :&nbsp;
    ID: e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS<br>
    2014-06-05 12:24:00,146 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand]
    (org.ovirt.thread.pool-6-thread-44) [43b031c4] START,
    SetVdsStatusVDSCommand(HostName = node1.test.now, HostId =
    e17a740c-47ba-4a81-99ab-6c386b572f26,
    status=PreparingForMaintenance, nonOperationalReason=NONE,
    stopSpmFailureLogged=true), log id: 1d0d3a10<br>
    2014-06-05 12:24:00,171 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand]
    (org.ovirt.thread.pool-6-thread-44) [43b031c4] FINISH,
    SetVdsStatusVDSCommand, log id: 1d0d3a10<br>
    2014-06-05 12:24:00,460 INFO&nbsp;
    [org.ovirt.engine.core.bll.MaintenanceVdsCommand]
    (org.ovirt.thread.pool-6-thread-44) [43b031c4] Running command:
    MaintenanceVdsCommand internal: true. Entities affected :&nbsp; ID:
    e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS<br>
    2014-06-05 12:24:00,539 INFO&nbsp;
    [org.ovirt.engine.core.bll.InternalMigrateVmCommand]
    (org.ovirt.thread.pool-6-thread-44) [155d3855] Lock Acquired to
    object EngineLock [exclusiveLocks= key:
    63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e value: VM<br>
    , sharedLocks= ]<br>
    2014-06-05 12:24:00,622 INFO&nbsp;
    [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand]
    (DefaultQuartzScheduler_Worker-69) [2b68c51d] Running command:
    MaintenanceNumberOfVdssCommand internal: true. Entities affected :&nbsp;
    ID: e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS<br>
    2014-06-05 12:24:00,779 INFO&nbsp;
    [org.ovirt.engine.core.bll.scheduling.SchedulingManager]
    (org.ovirt.thread.pool-6-thread-44) [155d3855] Candidate host
    node2.test.now (28fdcb5d-7acd-410e-8b65-0b4f483cb575) was filtered
    out by VAR__FILTERTYPE__INTERNAL filter Memory<br>
    2014-06-05 12:24:00,808 INFO&nbsp;
    [org.ovirt.engine.core.bll.scheduling.SchedulingManager]
    (org.ovirt.thread.pool-6-thread-44) [155d3855] Candidate host
    node3.test.now (7415506c-cda7-4018-804d-5f6d3beddbfb) was filtered
    out by VAR__FILTERTYPE__INTERNAL filter Memory<br>
    2014-06-05 12:24:00,809 INFO&nbsp;
    [org.ovirt.engine.core.bll.scheduling.SchedulingManager]
    (org.ovirt.thread.pool-6-thread-44) [155d3855] Candidate host
    node4.test.now (bb13752e-85cb-4945-822b-48ab2a7b1329) was filtered
    out by VAR__FILTERTYPE__INTERNAL filter Memory<br>
    2014-06-05 12:24:00,813 WARN&nbsp;
    [org.ovirt.engine.core.bll.InternalMigrateVmCommand]
    (org.ovirt.thread.pool-6-thread-44) [155d3855] CanDoAction of action
    InternalMigrateVm failed.

Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName
    node2.test.now,$filterName
    Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName
    node4.test.now,$filterName
    Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName
    node3.test.now,$filterName Memory,SCHEDULING_HOST_FILTERED_REASON<br>
    2014-06-05 12:24:00,825 INFO&nbsp;
    [org.ovirt.engine.core.bll.InternalMigrateVmCommand]
    (org.ovirt.thread.pool-6-thread-44) [155d3855] Lock freed to object
    EngineLock [exclusiveLocks= key:
    63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e value: VM<br>
    , sharedLocks= ]<br>
    2014-06-05 12:24:00,860 ERROR
    [org.ovirt.engine.core.bll.MaintenanceVdsCommand]
    (org.ovirt.thread.pool-6-thread-44) [155d3855]
    ResourceManager::vdsMaintenance - Failed migrating desktop Bench1<br>
    2014-06-05 12:24:00,883 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (org.ovirt.thread.pool-6-thread-44) [155d3855] Correlation ID:
    43b031c4, Job ID: 38a05481-0ced-4285-b3ee-6574ce39eb77, Call Stack:
    null, Custom Event ID: -1, Message: Host node1.test.now cannot
    change into maintenance mode - not all Vms have been migrated
    successfully. Consider manual intervention: stopping/migrating Vms:
    Bench1 (User: admin).<br>
    2014-06-05 12:24:00,894 INFO&nbsp;
    [org.ovirt.engine.core.bll.MaintenanceVdsCommand]
    (DefaultQuartzScheduler_Worker-69) [2b68c51d] Running command:
    MaintenanceVdsCommand internal: true. Entities affected :&nbsp; ID:
    e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS<br>
    2014-06-05 12:24:01,005 INFO&nbsp;
    [org.ovirt.engine.core.bll.InternalMigrateVmCommand]
    (DefaultQuartzScheduler_Worker-69) [36b0c4c7] Lock Acquired to
    object EngineLock [exclusiveLocks= key:
    63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e value: VM<br>
    , sharedLocks= ]<br>
    2014-06-05 12:24:01,147 INFO&nbsp;
    [org.ovirt.engine.core.bll.scheduling.SchedulingManager]
    (DefaultQuartzScheduler_Worker-69) [36b0c4c7] Candidate host
    node2.test.now (28fdcb5d-7acd-410e-8b65-0b4f483cb575) was filtered
    out by VAR__FILTERTYPE__INTERNAL filter Memory<br>
    2014-06-05 12:24:01,155 INFO&nbsp;
    [org.ovirt.engine.core.bll.scheduling.SchedulingManager]
    (DefaultQuartzScheduler_Worker-69) [36b0c4c7] Candidate host
    node3.test.now (7415506c-cda7-4018-804d-5f6d3beddbfb) was filtered
    out by VAR__FILTERTYPE__INTERNAL filter Memory<br>
    2014-06-05 12:24:01,166 INFO&nbsp;
    [org.ovirt.engine.core.bll.scheduling.SchedulingManager]
    (DefaultQuartzScheduler_Worker-69) [36b0c4c7] Candidate host
    node4.test.now (bb13752e-85cb-4945-822b-48ab2a7b1329) was filtered
    out by VAR__FILTERTYPE__INTERNAL filter Memory<br>
    2014-06-05 12:24:01,174 WARN&nbsp;
    [org.ovirt.engine.core.bll.InternalMigrateVmCommand]
    (DefaultQuartzScheduler_Worker-69) [36b0c4c7] CanDoAction of action
    InternalMigrateVm failed.

Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName
    node2.test.now,$filterName
    Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName
    node4.test.now,$filterName
    Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName
    node3.test.now,$filterName Memory,SCHEDULING_HOST_FILTERED_REASON<br>
    2014-06-05 12:24:01,187 INFO&nbsp;
    [org.ovirt.engine.core.bll.InternalMigrateVmCommand]
    (DefaultQuartzScheduler_Worker-69) [36b0c4c7] Lock freed to object
    EngineLock [exclusiveLocks= key:
    63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e value: VM<br>
    , sharedLocks= ]<br>
    2014-06-05 12:24:01,228 ERROR
    [org.ovirt.engine.core.bll.MaintenanceVdsCommand]
    (DefaultQuartzScheduler_Worker-69) [36b0c4c7]
    ResourceManager::vdsMaintenance - Failed migrating desktop Bench1<br>
    2014-06-05 12:24:01,238 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (DefaultQuartzScheduler_Worker-69) [36b0c4c7] Correlation ID:
    2b68c51d, Job ID: 3a956cf5-ec2e-45b5-a2bc-40632496fec6, Call Stack:
    null, Custom Event ID: -1, Message: Failed to switch Host
    node1.test.now to Maintenance mode.<br>
    2014-06-05 12:24:40,507 INFO&nbsp;
    [org.ovirt.engine.core.bll.StopVdsCommand] (ajp--127.0.0.1-8702-4)
    [32d3da21] Lock Acquired to object EngineLock [exclusiveLocks= key:
    e17a740c-47ba-4a81-99ab-6c386b572f26 value: VDS_FENCE<br>
    , sharedLocks= ]<br>
    2014-06-05 12:24:40,798 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null,
    Custom Event ID: -1, Message: Host node3.test.now from cluster
    Default was chosen as a proxy to execute Status command on Host
    node1.test.now.<br>
    2014-06-05 12:24:40,799 INFO&nbsp;
    [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-4)
    Using Host node3.test.now from cluster Default as proxy to execute
    Status command on Host node1.test.now<br>
    2014-06-05 12:24:40,800 WARN&nbsp;
    [org.ovirt.engine.core.bll.StopVdsCommand] (ajp--127.0.0.1-8702-4)
    CanDoAction of action StopVds failed.
    Reasons:VAR__ACTION__STOP,VDS_STATUS_NOT_VALID_FOR_STOP<br>
    2014-06-05 12:24:40,811 INFO&nbsp;
    [org.ovirt.engine.core.bll.StopVdsCommand] (ajp--127.0.0.1-8702-4)
    Lock freed to object EngineLock [exclusiveLocks= key:
    e17a740c-47ba-4a81-99ab-6c386b572f26 value: VDS_FENCE<br>
    , sharedLocks= ]<br>
    2014-06-05 12:25:00,021 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-27) [70486be2] Autorecovering 1
    storage domains<br>
    2014-06-05 12:25:00,021 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-27) [70486be2] Autorecovering storage
    domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53<br>
    2014-06-05 12:25:00,022 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-27) [70d58101] Running command:
    ConnectDomainToStorageCommand internal: true. Entities affected :&nbsp;
    ID: 9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage<br>
    2014-06-05 12:25:00,023 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-27) [70d58101]
    ConnectDomainToStorage. Before Connect all hosts to pool.
    Time:6/5/14 12:25 PM<br>
    2014-06-05 12:25:00,088 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-6) [362a5fe3] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:25:00,093 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-47) [683e82b0] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:25:00,100 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-14) [6ed26267] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:25:00,196 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-6) [362a5fe3] START,
    ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId =
    bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 4591e85a<br>
    2014-06-05 12:25:00,197 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-14) [6ed26267] START,
    ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId =
    28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 17ef6900<br>
    2014-06-05 12:25:00,197 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-47) [683e82b0] START,
    ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId =
    7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: db1af1a<br>
    2014-06-05 12:25:00,207 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-2) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:25:19,989 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-42) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:26:00,247 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-47) [683e82b0] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: db1af1a<br>
    2014-06-05 12:26:00,256 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-6) [362a5fe3] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 4591e85a<br>
    2014-06-05 12:26:00,263 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-14) [6ed26267] FINISH,
    ConnectStorageServerVDSCommand, return:
    {f47e9f99-9989-4297-a84f-4f75338eeced=0}, log id: 17ef6900<br>
    2014-06-05 12:26:00,265 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-27) [70d58101]
    ConnectDomainToStorage. After Connect all hosts to pool. Time:6/5/14
    12:26 PM<br>
    2014-06-05 12:28:15,399 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-17) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:28:18,443 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-8) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:28:55,121 WARN&nbsp;
    [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
    (org.ovirt.thread.pool-6-thread-45) Executing a command:
    java.util.concurrent.FutureTask , but note that there are 1 tasks in
    the queue.<br>
    2014-06-05 12:29:04,927 INFO&nbsp;
    [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand]
    (DefaultQuartzScheduler_Worker-51) [51b730a8] Running command:
    MaintenanceNumberOfVdssCommand internal: true. Entities affected :&nbsp;
    ID: e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS<br>
    2014-06-05 12:29:05,029 INFO&nbsp;
    [org.ovirt.engine.core.bll.MaintenanceVdsCommand]
    (DefaultQuartzScheduler_Worker-51) [51b730a8] Running command:
    MaintenanceVdsCommand internal: true. Entities affected :&nbsp; ID:
    e17a740c-47ba-4a81-99ab-6c386b572f26 Type: VDS<br>
    2014-06-05 12:29:05,073 INFO&nbsp;
    [org.ovirt.engine.core.bll.InternalMigrateVmCommand]
    (DefaultQuartzScheduler_Worker-51) [63736865] Lock Acquired to
    object EngineLock [exclusiveLocks= key:
    63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e value: VM<br>
    , sharedLocks= ]<br>
    2014-06-05 12:29:05,164 INFO&nbsp;
    [org.ovirt.engine.core.bll.scheduling.SchedulingManager]
    (DefaultQuartzScheduler_Worker-51) [63736865] Candidate host
    node2.test.now (28fdcb5d-7acd-410e-8b65-0b4f483cb575) was filtered
    out by VAR__FILTERTYPE__INTERNAL filter Memory<br>
    2014-06-05 12:29:05,167 INFO&nbsp;
    [org.ovirt.engine.core.bll.scheduling.SchedulingManager]
    (DefaultQuartzScheduler_Worker-51) [63736865] Candidate host
    node3.test.now (7415506c-cda7-4018-804d-5f6d3beddbfb) was filtered
    out by VAR__FILTERTYPE__INTERNAL filter Memory<br>
    2014-06-05 12:29:05,170 INFO&nbsp;
    [org.ovirt.engine.core.bll.scheduling.SchedulingManager]
    (DefaultQuartzScheduler_Worker-51) [63736865] Candidate host
    node4.test.now (bb13752e-85cb-4945-822b-48ab2a7b1329) was filtered
    out by VAR__FILTERTYPE__INTERNAL filter Memory<br>
    2014-06-05 12:29:05,173 WARN&nbsp;
    [org.ovirt.engine.core.bll.InternalMigrateVmCommand]
    (DefaultQuartzScheduler_Worker-51) [63736865] CanDoAction of action
    InternalMigrateVm failed.

Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,ACTION_TYPE_FAILED_VDS_VM_MEMORY,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName
    node2.test.now,$filterName
    Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName
    node4.test.now,$filterName
    Memory,SCHEDULING_HOST_FILTERED_REASON,VAR__FILTERTYPE__INTERNAL,$hostName
    node3.test.now,$filterName Memory,SCHEDULING_HOST_FILTERED_REASON<br>
    2014-06-05 12:29:05,181 INFO&nbsp;
    [org.ovirt.engine.core.bll.InternalMigrateVmCommand]
    (DefaultQuartzScheduler_Worker-51) [63736865] Lock freed to object
    EngineLock [exclusiveLocks= key:
    63b1fd02-1fb5-44d1-b1cc-54cb5c0fdb0e value: VM<br>
    , sharedLocks= ]<br>
    2014-06-05 12:29:05,207 ERROR
    [org.ovirt.engine.core.bll.MaintenanceVdsCommand]
    (DefaultQuartzScheduler_Worker-51) [63736865]
    ResourceManager::vdsMaintenance - Failed migrating desktop Bench1<br>
    2014-06-05 12:29:05,218 INFO&nbsp;
    [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
    (DefaultQuartzScheduler_Worker-51) [63736865] Correlation ID:
    51b730a8, Job ID: b8441378-051c-4af0-8802-e2efb9e5d4a4, Call Stack:
    null, Custom Event ID: -1, Message: Failed to switch Host
    node1.test.now to Maintenance mode.<br>
    2014-06-05 12:30:00,018 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-52) [2e3993e6] Autorecovering 1
    storage domains<br>
    2014-06-05 12:30:00,018 INFO&nbsp;
    [org.ovirt.engine.core.bll.AutoRecoveryManager]
    (DefaultQuartzScheduler_Worker-52) [2e3993e6] Autorecovering storage
    domains id: 9923a5a1-61e0-4edb-a04d-22c962190c53<br>
    2014-06-05 12:30:00,021 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-52) [1585ee27] Running command:
    ConnectDomainToStorageCommand internal: true. Entities affected :&nbsp;
    ID: 9923a5a1-61e0-4edb-a04d-22c962190c53 Type: Storage<br>
    2014-06-05 12:30:00,024 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand]
    (DefaultQuartzScheduler_Worker-52) [1585ee27]
    ConnectDomainToStorage. Before Connect all hosts to pool.
    Time:6/5/14 12:30 PM<br>
    2014-06-05 12:30:00,119 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-17) [6c0a8af9] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:30:00,121 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-26) [10056f73] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:30:00,134 INFO&nbsp;
    [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand]
    (org.ovirt.thread.pool-6-thread-24) [750ef0f4] Running command:
    ConnectStorageToVdsCommand internal: true. Entities affected :&nbsp; ID:
    aaa00000-0000-0000-0000-123456789aaa Type: System<br>
    2014-06-05 12:30:00,248 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-17) [6c0a8af9] START,
    ConnectStorageServerVDSCommand(HostName = node4.test.now, HostId =
    bb13752e-85cb-4945-822b-48ab2a7b1329, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 1c35901d<br>
    2014-06-05 12:30:00,250 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-24) [750ef0f4] START,
    ConnectStorageServerVDSCommand(HostName = node2.test.now, HostId =
    28fdcb5d-7acd-410e-8b65-0b4f483cb575, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 1a4d78a1<br>
    2014-06-05 12:30:00,250 INFO&nbsp;
    [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
    (org.ovirt.thread.pool-6-thread-26) [10056f73] START,
    ConnectStorageServerVDSCommand(HostName = node3.test.now, HostId =
    7415506c-cda7-4018-804d-5f6d3beddbfb, storagePoolId =
    00000000-0000-0000-0000-000000000000, storageType = NFS,
    connectionList = [{ id: f47e9f99-9989-4297-a84f-4f75338eeced,
    connection: 10.100.100.105:/var/lib/exports/iso, iqn: null, vfsType:
    null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
    nfsTimeo: null };]), log id: 60464b56<br>
    <br>
  </body>
</html>

--------------090404080503060404080706--

--------------000602090709060001060807--

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

[ovirt-users] Unable to shutdown VM's