2:46 a.m.
I had original ovirt-engine that had stuck tasks and just had storage issues. I decided
to load a new engine appliance and import existing servers and VMs into new engine. This
actually worked perfect until I went to import the storage domain into new engine, which
has failed. I was unable to move the domain to maintenance mode or anything from the old
engine. Any way to force import?
Error messages / logs:
Failed to attach Storage Domains to Data Center Default. (User: admin@internal-authz) (in
GUI log)
engine.log:
2019-01-13 16:31:27,973-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler8) [176267b0] START, GlusterVolumesListVDSCommand(HostName =
prometheus.redforest.wanderingmad.com,
GlusterVolumesListVDSParameters:{hostId='b5b9e763-704c-47ee-817b-19d081ad9aab'}),
log id: 2e7162ed
2019-01-13 16:31:28,204-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler8) [176267b0] Could not associate brick
'Daedalus.redforest.wanderingmad.com:/gluster_bricks/nvme-storagetwo/nvme-storagetwo'
of volume 'fe0c3620-6a33-48fa-98b7-847ad76edaba' with correct network as no
gluster network found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:28,205-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler8) [176267b0] Could not associate brick
'10.100.50.14:/gluster_bricks/nvme-storagetwo/nvme-storagetwo' of volume
'fe0c3620-6a33-48fa-98b7-847ad76edaba' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:28,206-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler8) [176267b0] Could not associate brick
'10.100.50.12:/gluster_bricks/nvme-storagetwo/nvme-storagetwo' of volume
'fe0c3620-6a33-48fa-98b7-847ad76edaba' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:28,208-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler8) [176267b0] Could not associate brick
'Daedalus.redforest.wanderingmad.com:/gluster_bricks/ssd-storagetwo/ssd-storagetwo'
of volume '7add3797-9b03-433c-aa1a-90ad7c5ac280' with correct network as no
gluster network found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:28,209-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler8) [176267b0] Could not associate brick
'10.100.50.14:/gluster_bricks/ssd-storagetwo/ssd-storagetwo' of volume
'7add3797-9b03-433c-aa1a-90ad7c5ac280' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:28,221-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler8) [176267b0] Could not associate brick
'10.100.50.12:/gluster_bricks/ssd-storagetwo/ssd-storagetwo' of volume
'7add3797-9b03-433c-aa1a-90ad7c5ac280' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:28,232-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler8) [176267b0] FINISH, GlusterVolumesListVDSCommand, return:
{7add3797-9b03-433c-aa1a-90ad7c5ac280=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4205765f,
fe0c3620-6a33-48fa-98b7-847ad76edaba=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40fccb},
log id: 2e7162ed
2019-01-13 16:31:37,612-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand]
(DefaultQuartzScheduler10) [2876ae97] START, GlusterTasksListVDSCommand(HostName =
daedalus.redforest.wanderingmad.com,
VdsIdVDSCommandParametersBase:{hostId='b79fe49c-761f-4710-adf4-8fa6d1143dae'}),
log id: 30c3bd7c
2019-01-13 16:31:37,863-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand]
(DefaultQuartzScheduler10) [2876ae97] FINISH, GlusterTasksListVDSCommand, return: [], log
id: 30c3bd7c
2019-01-13 16:31:43,248-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand]
(DefaultQuartzScheduler7) [70a256c0] START, GlusterServersListVDSCommand(HostName =
prometheus.redforest.wanderingmad.com,
VdsIdVDSCommandParametersBase:{hostId='b5b9e763-704c-47ee-817b-19d081ad9aab'}),
log id: 7f890a8
2019-01-13 16:31:43,705-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand]
(DefaultQuartzScheduler7) [70a256c0] FINISH, GlusterServersListVDSCommand, return:
[10.100.50.12/24:CONNECTED, icarus.redforest.wanderingmad.com:CONNECTED,
daedalus.redforest.wanderingmad.com:CONNECTED], log id: 7f890a8
2019-01-13 16:31:43,708-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler7) [70a256c0] START, GlusterVolumesListVDSCommand(HostName =
prometheus.redforest.wanderingmad.com,
GlusterVolumesListVDSParameters:{hostId='b5b9e763-704c-47ee-817b-19d081ad9aab'}),
log id: 50f59aca
2019-01-13 16:31:43,943-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler7) [70a256c0] Could not associate brick
'Daedalus.redforest.wanderingmad.com:/gluster_bricks/nvme-storagetwo/nvme-storagetwo'
of volume 'fe0c3620-6a33-48fa-98b7-847ad76edaba' with correct network as no
gluster network found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:43,944-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler7) [70a256c0] Could not associate brick
'10.100.50.14:/gluster_bricks/nvme-storagetwo/nvme-storagetwo' of volume
'fe0c3620-6a33-48fa-98b7-847ad76edaba' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:43,945-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler7) [70a256c0] Could not associate brick
'10.100.50.12:/gluster_bricks/nvme-storagetwo/nvme-storagetwo' of volume
'fe0c3620-6a33-48fa-98b7-847ad76edaba' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:43,947-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler7) [70a256c0] Could not associate brick
'Daedalus.redforest.wanderingmad.com:/gluster_bricks/ssd-storagetwo/ssd-storagetwo'
of volume '7add3797-9b03-433c-aa1a-90ad7c5ac280' with correct network as no
gluster network found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:43,948-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler7) [70a256c0] Could not associate brick
'10.100.50.14:/gluster_bricks/ssd-storagetwo/ssd-storagetwo' of volume
'7add3797-9b03-433c-aa1a-90ad7c5ac280' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:43,949-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler7) [70a256c0] Could not associate brick
'10.100.50.12:/gluster_bricks/ssd-storagetwo/ssd-storagetwo' of volume
'7add3797-9b03-433c-aa1a-90ad7c5ac280' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:43,949-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler7) [70a256c0] FINISH, GlusterVolumesListVDSCommand, return:
{7add3797-9b03-433c-aa1a-90ad7c5ac280=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4205765f,
fe0c3620-6a33-48fa-98b7-847ad76edaba=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40fccb},
log id: 50f59aca
2019-01-13 16:31:58,987-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand]
(DefaultQuartzScheduler4) [59b635f4] START, GlusterServersListVDSCommand(HostName =
prometheus.redforest.wanderingmad.com,
VdsIdVDSCommandParametersBase:{hostId='b5b9e763-704c-47ee-817b-19d081ad9aab'}),
log id: 512ef5c0
2019-01-13 16:31:59,518-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand]
(DefaultQuartzScheduler4) [59b635f4] FINISH, GlusterServersListVDSCommand, return:
[10.100.50.12/24:CONNECTED, icarus.redforest.wanderingmad.com:CONNECTED,
daedalus.redforest.wanderingmad.com:CONNECTED], log id: 512ef5c0
2019-01-13 16:31:59,521-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler4) [59b635f4] START, GlusterVolumesListVDSCommand(HostName =
prometheus.redforest.wanderingmad.com,
GlusterVolumesListVDSParameters:{hostId='b5b9e763-704c-47ee-817b-19d081ad9aab'}),
log id: 2de38416
2019-01-13 16:31:59,773-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler4) [59b635f4] Could not associate brick
'Daedalus.redforest.wanderingmad.com:/gluster_bricks/nvme-storagetwo/nvme-storagetwo'
of volume 'fe0c3620-6a33-48fa-98b7-847ad76edaba' with correct network as no
gluster network found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:59,774-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler4) [59b635f4] Could not associate brick
'10.100.50.14:/gluster_bricks/nvme-storagetwo/nvme-storagetwo' of volume
'fe0c3620-6a33-48fa-98b7-847ad76edaba' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:59,775-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler4) [59b635f4] Could not associate brick
'10.100.50.12:/gluster_bricks/nvme-storagetwo/nvme-storagetwo' of volume
'fe0c3620-6a33-48fa-98b7-847ad76edaba' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:59,776-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler4) [59b635f4] Could not associate brick
'Daedalus.redforest.wanderingmad.com:/gluster_bricks/ssd-storagetwo/ssd-storagetwo'
of volume '7add3797-9b03-433c-aa1a-90ad7c5ac280' with correct network as no
gluster network found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:59,777-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler4) [59b635f4] Could not associate brick
'10.100.50.14:/gluster_bricks/ssd-storagetwo/ssd-storagetwo' of volume
'7add3797-9b03-433c-aa1a-90ad7c5ac280' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:59,778-05 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn]
(DefaultQuartzScheduler4) [59b635f4] Could not associate brick
'10.100.50.12:/gluster_bricks/ssd-storagetwo/ssd-storagetwo' of volume
'7add3797-9b03-433c-aa1a-90ad7c5ac280' with correct network as no gluster network
found in cluster '8e8cc8a7-9f45-4054-85e5-8014ec421b7f'
2019-01-13 16:31:59,778-05 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler4) [59b635f4] FINISH, GlusterVolumesListVDSCommand, return:
{7add3797-9b03-433c-aa1a-90ad7c5ac280=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4205765f,
fe0c3620-6a33-48fa-98b7-847ad76edaba=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40fccb},
log id: 2de38416
and of course, none of the gluster hosts is set as the SPM
9:29 p.m.
I ended up finally figuring this out after I read a few more articles. I managed to not
reboot all the original gluster hosts. Once I rebooted all the gluster hosts and the
engine (just in case) I was successfully able to import the storage domains and managed to
not lose any VMs at all.
10:19 a.m.
Thanks for the report!
On Mon, Jan 14, 2019 at 8:31 PM <michael(a)wanderingmad.com> wrote:
I ended up finally figuring this out after I read a few more articles. I managed to not
reboot all the original gluster hosts. Once I rebooted all the gluster hosts and the
engine (just in case) I was successfully able to import the storage domains and managed to
not lose any VMs at all.
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/ETLVQWM24Z6...
--
Didi
2135
days inactive
2137
days old
2 comments
2 participants
participants (2)
-
michael＠wanderingmad.com -
Yedidyah Bar David