12:55 p.m.
I had occasion to shutdown a VM for the purpose of adding RAM and processor to it and the
VM willnot boot back up. I'm seeing "VM Issabel_PBX is down with error. Exit
message: Bad volume specification {'address': {'bus': '0',
'controller': '0', 'type': 'drive', 'target':
'0', 'unit': '0'}, 'serial':
'6af66318-e6f8-45d7-8b4e-2183faf0a917', 'index': 0, 'iface':
'scsi', 'apparentsize': '5706743808', 'specParams': {},
'cache': 'none', 'imageID':
'6af66318-e6f8-45d7-8b4e-2183faf0a917', 'truesize': '5950070784',
'type': 'disk', 'domainID':
'24c4dc1b-c843-4ae2-963f-9d0548305192', 'reqsize': '0',
'format': 'cow', 'poolID':
'31fdd642-6b06-11ea-a4c4-00163e333bd2', 'device': 'disk',
'path':
'/rhev/data-center/31fdd642-6b06-11ea-a4c4-00163e333bd2/24c4dc1b-c843-4ae2-963f-9d0548305192/images/6af66318-e6f8-45d7-8b4e-2183faf0a917/576b2761-a5bc-427b-95a9-0594447f0705',
'propagateErrors': 'off', 'name': 'sda',
'bootOrder': '1', 'volumeID':
'576b2761-a5bc-427b-95a9-0594447f0705', 'diskType': 'file',
'a
lias': 'ua-6af66318-e6f8-45d7-8b4e-2183faf0a917', 'discard':
False}."
in the log. I tried to move the VMs disk from one gluster datastore to another to see if
the problem would clear and now the disk is locked and the move is stuck at %10. In the
engine logs I have "2022-09-19 12:48:25,614-05 INFO
[org.ovirt.engine.core.bll.tasks.SPMAsyncTask]
(EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: At
time of attempt to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' the response
code was 'TaskStateError' and message was 'Operation is not allowed in this
task state: ("can't clean in state running",)'. Task will not be
cleaned
2022-09-19 12:48:25,614-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask]
(EE-ManagedThreadFactory-engineScheduled-Thread-87) [] Task id
'4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' has passed pre-polling period time and
should be polled. Pre-polling period is 60000 millis.
2022-09-19 12:48:25,631-05 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engineScheduled-Thread-87) [] EVENT_ID:
TASK_CLEARING_ASYNC_TASK(9,501), Clearing asynchronous task Unknown that started at Tue
Jul 12 12:19:21 CDT 2022
2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager]
(EE-ManagedThreadFactory-engineScheduled-Thread-87) [] Cleaning zombie tasks: Clearing
async task 'Unknown' that started at 'Tue Jul 12 12:19:21 CDT 2022' since
it reached a timeout of 3000 minutes
2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask]
(EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask:
Attempting to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6'
2022-09-19 12:48:25,632-05 INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-87) [] START, SPMClearTaskVDSCommand(
SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='31fdd642-6b06-11ea-a4c4-00163e333bd2',
ignoreFailoverLimit='false',
taskId='4b96a8e1-ab65-4d1c-97dd-e985ab7816c6'}), log id: 40d6d67f
2022-09-19 12:48:25,633-05 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-87) [] START,
HSMClearTaskVDSCommand(HostName = hprvsr00.locacore.com,
HSMTaskGuidBaseVDSCommandParameters:{hostId='6c910725-fb42-4a64-b614-2a29bf0800e2',
taskId='4b96a8e1-ab65-4d1c-97dd-e985ab7816c6'}), log id: 22c28060
2022-09-19 12:48:25,638-05 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-87) [] FINISH, HSMClearTaskVDSCommand,
return: , log id: 22c28060
2022-09-19 12:48:25,639-05 INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-87) [] FINISH, SPMClearTaskVDSCommand,
return: , log id: 40d6d67f
2022-09-19 12:48:25,639-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask]
(EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: At
time of attempt to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' the response
code was 'TaskStateError' and message was 'Operation is not allowed in this
task state: ("can't clean in state running",)'. Task will not be
cleaned
2022-09-19 12:48:25,876-05 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(EE-ManagedThreadFactory-engineScheduled-Thread-98) [149db168-34c0-4814-869e-1ca0fdbde768]
Command 'CopyImageGroupWithData' (id:
'9e73adde-e485-461a-b349-7fd814890aa6') waiting on child command id:
'5b4d0a00-7e40-4016-bf5c-0db013e22983' type:'CopyImageGroupVolumesData' to
complete
2022-09-19 12:48:26,878-05 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(EE-ManagedThreadFactory-engineScheduled-Thread-84) [149db168-34c0-4814-869e-1ca0fdbde768]
Command 'CopyImageGroupVolumesData' (id:
'5b4d0a00-7e40-4016-bf5c-0db013e22983') waiting on child command id:
'1b496e55-9407-4fd7-a2f2-bb70bf4e7aa0' type:'CopyData' to complete
2022-09-19 12:48:27,886-05 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-89) [149db168-34c0-4814-869e-1ca0fdbde768]
START, GetHostJobsVDSCommand(HostName = hprvsr00.locacore.com,
GetHostJobsVDSCommandParameters:{hostId='6c910725-fb42-4a64-b614-2a29bf0800e2',
type='storage', jobIds='[06208564-b66d-4947-a96f-4d163ef2fbe0]'}), log id:
75ca6198
2022-09-19 12:48:27,894-05 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-89) [149db168-34c0-4814-869e-1ca0fdbde768]
FINISH, GetHostJobsVDSCommand, return:
{06208564-b66d-4947-a96f-4d163ef2fbe0=HostJobInfo:{id='06208564-b66d-4947-a96f-4d163ef2fbe0',
type='storage', description='copy_data', status='running',
progress='null', error='null'}}, log id: 75ca6198
2022-09-19 12:48:27,902-05 INFO [org.ovirt.engine.core.bll.StorageJobCallback]
(EE-ManagedThreadFactory-engineScheduled-Thread-89) [149db168-34c0-4814-869e-1ca0fdbde768]
Command CopyData id: '1b496e55-9407-4fd7-a2f2-bb70bf4e7aa0': waiting for job
'06208564-b66d-4947-a96f-4d163ef2fbe0' on host 'hprvsr00.locacore.com'
(id: '6c910725-fb42-4a64-b614-2a29bf0800e2') to complete
2022-09-19 12:48:29,911-05 INFO
[org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback]
(EE-ManagedThreadFactory-engineScheduled-Thread-57) [149db168-34c0-4814-869e-1ca0fdbde768]
Command 'MoveOrCopyDisk' (id: '2ec06560-b552-4418-abd7-e2945cd98c12')
waiting on child command id: '80a2481e-707f-49bf-b469-33cd90c1a51c'
type:'MoveImageGroup' to complete
2022-09-19 12:48:29,915-05 INFO
[org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback]
(EE-ManagedThreadFactory-engineScheduled-Thread-57) [149db168-34c0-4814-869e-1ca0fdbde768]
Command 'MoveImageGroup' (id: '80a2481e-707f-49bf-b469-33cd90c1a51c')
waiting on child command id: '9e73adde-e485-461a-b349-7fd814890aa6'
type:'CopyImageGroupWithData' to complete"
Any help would be appreciated as the client's PBX is currently down as a result.