--Apple-Mail=_97F20318-4210-46C0-9A0F-2858849CBFCD
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8
On 28 Dec 2017, at 00:02, Blaster <Blaster(a)556nato.com> wrote:
=20
Well, I've spent the last 2.5 days trying to get oVirt 4.2 up and =
running.
=20
I sneeze on it, vdsm has a conniption and there appears to be no way =
to recover
from it.
=20
1) Install 4.2. Everything looks good. Start copying over some =
data..accidently
wipe out the master storage domain...It's gone. The =
only method google could suggest was to re-initialize the data center. =
Great. I'd love to! It's greyed out. Can't get it back...Try several =
hosted-engine uninstall methods, including=20
/usr/sbin/ovirt-hosted-engine-cleanup and wiping out the storage.
=20
=20
re-run hosted-engine --deploy
All I get over and over in the vdsm log file while waiting for vdsm =
to become
operational is..
2017-12-27 16:36:22,150-0600 ERROR (periodic/3) =
[virt.periodic.Operation] <vdsm.virt.sampling.VMBulkstatsMonitor object =
at 0x397b250> operation failed (periodic:215)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/vdsm/virt/periodic.py", line =
213, in __call__
self._func()
File "/usr/lib/python2.7/site-packages/vdsm/virt/sampling.py", line =
522, in __call__
self._send_metrics()
File "/usr/lib/python2.7/site-packages/vdsm/virt/sampling.py", line =
538, in _send_metrics
vm_sample.interval)
File "/usr/lib/python2.7/site-packages/vdsm/virt/vmstats.py", line =
45, in produce
networks(vm, stats, first_sample, last_sample, interval)
File "/usr/lib/python2.7/site-packages/vdsm/virt/vmstats.py", line =
322, in networks
if nic.name.startswith('hostdev'):
AttributeError: name
not relevant to your issue, just fyi
this error is not significant and fixed by =
9a2f73a4384e1d72c3285ef88876e404ec8228ff now
2017-12-27 16:36:22,620-0600 INFO (periodic/1) [vdsm.api] START =
repoStats(domains=3D()) from=3Dinternal, =
task_id=3D94688cf1-a991-433e-9e22-7065ed5dc1bf (api:46)
2017-12-27 16:36:22,620-0600 INFO (periodic/1) [vdsm.api] FINISH =
repoStats return=3D{} from=3Dinternal, =
task_id=3D94688cf1-a991-433e-9e22-7065ed5dc1bf (api:52)
2017-12-27 16:36:22,621-0600 INFO (periodic/1) [vdsm.api] START =
multipath_health() from=3Dinternal, =
task_id=3D9c680369-8f2a-439e-8fe5-b2a1e33c0706 (api:46)
2017-12-27 16:36:22,622-0600 INFO (periodic/1) [vdsm.api] FINISH =
multipath_health return=3D{} from=3Dinternal, =
task_id=3D9c680369-8f2a-439e-8fe5-b2a1e33c0706 (api:52)
2017-12-27 16:36:22,633-0600 ERROR (periodic/1) [root] failed to =
retrieve Hosted Engine HA score '[Errno 2] No such file or directory'Is =
the Hosted Engine setup finished? (api:196)
2017-12-27 16:36:23,178-0600 INFO (vmrecovery) [vdsm.api] START =
getConnectedStoragePoolsList(options=3DNone) from=3Dinternal, =
task_id=3Da7e48a2f-8cb7-4ec5-acd7-452c8f0c522b (api:46)
2017-12-27 16:36:23,179-0600 INFO (vmrecovery) [vdsm.api] FINISH =
getConnectedStoragePoolsList return=3D{'poollist': []} from=3Dinternal, =
task_id=3Da7e48a2f-8cb7-4ec5-acd7-452c8f0c522b (api:52)
2017-12-27 16:36:23,179-0600 INFO (vmrecovery) [vds] recovery: =
waiting for storage pool to go up (clientIF:643)
=20
sigh...reinstall 7.4 and do it all over again.
=20
2) copying data to master storage pool. Didn't wipe it out this time, =
but
filled the volume instead. Environment freezes.
vdsm can't start...infinite loop waiting for storage pool again.
Try =
clean up and redeploy. Same problem as above.
7.4 reinstall #2 here we go...
=20
3)Up and running again. Forgot to add my NIC card. Shut it down. =
Boot back up.
vdsm sees new network interfaces.
for some reason, it switches ovirtmgmt over to one of the new =
interfaces which doesn't have a cable=20
attached to it. Clean up ifcfg- files and reboot. ifcfg-ovirtmgmt
is =
now gone. recreate and reboot. Interface
comes alive, but vdsm is not starting.
supervdsm log shows:
Multiple southbound ports per network detected, ignoring this network =
for the
QoS report (network: ovirtmgmt, ports: ['enp3s0', 'enp4s0'])
restore-net::DEBUG::2017-12-27 =
13:10:39,815::cmdutils::150::root::(exec_cmd) =
/usr/share/openvswitch/scripts/ovs-ctl status (cwd None)
restore-net::DEBUG::2017-12-27 =
13:10:39,856::cmdutils::158::root::(exec_cmd) SUCCESS: <err> =3D '';
=
<rc> =3D 0
restore-net::DEBUG::2017-12-27
13:10:39,863::vsctl::58::root::(commit) =
Executing commands: /usr/bin/ovs-vsctl
--oneline --format=3Djson -- list =
Bridge -- list Port -- list Interface
restore-net::DEBUG::2017-12-27 =
13:10:39,864::cmdutils::150::root::(exec_cmd) /usr/bin/ovs-vsctl =
--oneline --format=3Djson -- list Bridge -- list Port -- list Interface =
(cwd None)
restore-net::DEBUG::2017-12-27 =
13:10:39,944::cmdutils::158::root::(exec_cmd) SUCCESS: <err> =3D '';
=
<rc> =3D 0
restore-net::ERROR::2017-12-27 =
13:10:39,954::restore_net_config::454::root::(restore) unified =
restoration failed.
Traceback (most recent call last):
File =
"/usr/lib/python2.7/site-packages/vdsm/network/restore_net_config.py", =
line 448, in restore
unified_restoration()
File =
"/usr/lib/python2.7/site-packages/vdsm/network/restore_net_config.py", =
line 131, in unified_restoration
classified_conf =3D
_classify_nets_bonds_config(available_config)
File =
"/usr/lib/python2.7/site-packages/vdsm/network/restore_net_config.py", =
line 260, in _classify_nets_bonds_config
current_config =3D kernelconfig.KernelConfig(net_info)
File =
"/usr/lib/python2.7/site-packages/vdsm/network/kernelconfig.py",
line =
44, in __init__
for net, net_attr in self._analyze_netinfo_nets(netinfo):
File =
"/usr/lib/python2.7/site-packages/vdsm/network/kernelconfig.py",
line =
57, in _analyze_netinfo_nets
attrs =3D _translate_netinfo_net(net, net_attr, netinfo,
_routes)
File =
"/usr/lib/python2.7/site-packages/vdsm/network/kernelconfig.py",
line =
99, in _translate_netinfo_net
raise MultipleSouthBoundNicsPerNetworkError(net, nics)
MultipleSouthBoundNicsPerNetworkError: ('ovirtmgmt', ['enp3s0', =
'enp4s0'])
=20
Remove new nic. reboot. vdsm once again stuck waiting for storage =
pool to come
up.
i=E2=80=99m not clear on what are you actually trying to do. You do a =
clean install with a new SD, and then you write over it? With what? data =
from your former installation, just plain file-level copy? Why?
=20
So this is where I'm at now. Stuck. once again.
=20
I've been running 3.6.3 All In One for many years because I've been =
concerned about the complexity of the self hosted
configuration. Guess I was right.
=20
Google shows lots of other people also concerned about the stability =
of
oVirt..It's great when it runs, but=20
any little issue and you're basically reinstalling from scratch.
=20
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--Apple-Mail=_97F20318-4210-46C0-9A0F-2858849CBFCD
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=utf-8
<html><head><meta http-equiv=3D"Content-Type"
content=3D"text/html; =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; line-break: after-white-space;"
class=3D""><br =
class=3D""><div><br class=3D""><blockquote
type=3D"cite" class=3D""><div =
class=3D"">On 28 Dec 2017, at 00:02, Blaster <<a =
href=3D"mailto:Blaster@556nato.com"
class=3D"">Blaster(a)556nato.com</a>&gt;=
wrote:</div><br class=3D"Apple-interchange-newline"><div
class=3D"">
=20
<meta http-equiv=3D"content-type" content=3D"text/html; =
charset=3Dutf-8" class=3D"">
=20
<div text=3D"#000000" bgcolor=3D"#FFFFFF"
class=3D""><p class=3D"">Well,=
I've spent the last 2.5 days trying to get oVirt 4.2 up and
running.</p><p class=3D"">I sneeze on it, vdsm has a
conniption =
and there appears to be no
way to recover from it.</p><p class=3D"">1) Install
4.2. =
Everything looks good. Start copying over some
data..accidently wipe out the master storage domain...It's =
gone.
The only method google could suggest was to re-initialize the data
center. Great. I'd love to! It's greyed =
out. Can't get it
back...Try several hosted-engine uninstall methods, including <br =
class=3D"">
</p>
<pre class=3D"screen">/usr/sbin/ovirt-hosted-engine-cleanup and =
wiping out the storage. =20
re-run hosted-engine --deploy
All I get over and over in the vdsm log file while waiting for vdsm to =
become operational is..
2017-12-27 16:36:22,150-0600 ERROR (periodic/3) =
[virt.periodic.Operation] <vdsm.virt.sampling.VMBulkstatsMonitor =
object at 0x397b250> operation failed (periodic:215)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/vdsm/virt/periodic.py", line =
213, in __call__
self._func()
File "/usr/lib/python2.7/site-packages/vdsm/virt/sampling.py", line =
522, in __call__
self._send_metrics()
File "/usr/lib/python2.7/site-packages/vdsm/virt/sampling.py", line =
538, in _send_metrics
vm_sample.interval)
File "/usr/lib/python2.7/site-packages/vdsm/virt/vmstats.py", line 45, =
in produce
networks(vm, stats, first_sample, last_sample, interval)
File "/usr/lib/python2.7/site-packages/vdsm/virt/vmstats.py", line =
322, in networks
if nic.name.startswith('hostdev'):
AttributeError: name
</pre></div></div></blockquote><div>not relevant to your
issue, just =
fyi</div>this error is not significant and fixed =
by 9a2f73a4384e1d72c3285ef88876e404ec8228ff now</div><div><br =
class=3D""><blockquote type=3D"cite"
class=3D""><div class=3D""><div =
text=3D"#000000" bgcolor=3D"#FFFFFF" class=3D""><pre
=
class=3D"screen">2017-12-27 16:36:22,620-0600 INFO (periodic/1) =
[vdsm.api] START repoStats(domains=3D()) from=3Dinternal, =
task_id=3D94688cf1-a991-433e-9e22-7065ed5dc1bf (api:46)
2017-12-27 16:36:22,620-0600 INFO (periodic/1) [vdsm.api] FINISH =
repoStats return=3D{} from=3Dinternal, =
task_id=3D94688cf1-a991-433e-9e22-7065ed5dc1bf (api:52)
2017-12-27 16:36:22,621-0600 INFO (periodic/1) [vdsm.api] START =
multipath_health() from=3Dinternal, =
task_id=3D9c680369-8f2a-439e-8fe5-b2a1e33c0706 (api:46)
2017-12-27 16:36:22,622-0600 INFO (periodic/1) [vdsm.api] FINISH =
multipath_health return=3D{} from=3Dinternal, =
task_id=3D9c680369-8f2a-439e-8fe5-b2a1e33c0706 (api:52)
2017-12-27 16:36:22,633-0600 ERROR (periodic/1) [root] failed to =
retrieve Hosted Engine HA score '[Errno 2] No such file or directory'Is =
the Hosted Engine setup finished? (api:196)
2017-12-27 16:36:23,178-0600 INFO (vmrecovery) [vdsm.api] START =
getConnectedStoragePoolsList(options=3DNone) from=3Dinternal, =
task_id=3Da7e48a2f-8cb7-4ec5-acd7-452c8f0c522b (api:46)
2017-12-27 16:36:23,179-0600 INFO (vmrecovery) [vdsm.api] FINISH =
getConnectedStoragePoolsList return=3D{'poollist': []} from=3Dinternal, =
task_id=3Da7e48a2f-8cb7-4ec5-acd7-452c8f0c522b (api:52)
2017-12-27 16:36:23,179-0600 INFO (vmrecovery) [vds] recovery: waiting =
for storage pool to go up (clientIF:643)
sigh...reinstall 7.4 and do it all over again.
2) copying data to master storage pool. Didn't wipe it out this time, =
but filled the volume instead. Environment freezes.
vdsm can't start...infinite loop waiting for storage pool again. Try =
clean up and redeploy. Same problem as above.
7.4 reinstall #2 here we go...
3)Up and running again. Forgot to add my NIC card. Shut it down. Boot =
back up. vdsm sees new network interfaces.
for some reason, it switches ovirtmgmt over to one of the new interfaces =
which doesn't have a cable=20
attached to it. Clean up ifcfg- files and reboot. ifcfg-ovirtmgmt is =
now gone. recreate and reboot. Interface
comes alive, but vdsm is not starting.
supervdsm log shows:
Multiple southbound ports per network detected, ignoring this network =
for the QoS report (network: ovirtmgmt, ports: ['enp3s0', 'enp4s0'])
restore-net::DEBUG::2017-12-27 =
13:10:39,815::cmdutils::150::root::(exec_cmd) =
/usr/share/openvswitch/scripts/ovs-ctl status (cwd None)
restore-net::DEBUG::2017-12-27 =
13:10:39,856::cmdutils::158::root::(exec_cmd) SUCCESS: <err> =3D =
''; <rc> =3D 0
restore-net::DEBUG::2017-12-27 13:10:39,863::vsctl::58::root::(commit) =
Executing commands: /usr/bin/ovs-vsctl --oneline --format=3Djson -- list =
Bridge -- list Port -- list Interface
restore-net::DEBUG::2017-12-27 =
13:10:39,864::cmdutils::150::root::(exec_cmd) /usr/bin/ovs-vsctl =
--oneline --format=3Djson -- list Bridge -- list Port -- list Interface =
(cwd None)
restore-net::DEBUG::2017-12-27 =
13:10:39,944::cmdutils::158::root::(exec_cmd) SUCCESS: <err> =3D =
''; <rc> =3D 0
restore-net::ERROR::2017-12-27 =
13:10:39,954::restore_net_config::454::root::(restore) unified =
restoration failed.
Traceback (most recent call last):
File =
"/usr/lib/python2.7/site-packages/vdsm/network/restore_net_config.py", =
line 448, in restore
unified_restoration()
File =
"/usr/lib/python2.7/site-packages/vdsm/network/restore_net_config.py", =
line 131, in unified_restoration
classified_conf =3D _classify_nets_bonds_config(available_config)
File =
"/usr/lib/python2.7/site-packages/vdsm/network/restore_net_config.py", =
line 260, in _classify_nets_bonds_config
current_config =3D kernelconfig.KernelConfig(net_info)
File "/usr/lib/python2.7/site-packages/vdsm/network/kernelconfig.py", =
line 44, in __init__
for net, net_attr in self._analyze_netinfo_nets(netinfo):
File "/usr/lib/python2.7/site-packages/vdsm/network/kernelconfig.py", =
line 57, in _analyze_netinfo_nets
attrs =3D _translate_netinfo_net(net, net_attr, netinfo, _routes)
File "/usr/lib/python2.7/site-packages/vdsm/network/kernelconfig.py", =
line 99, in _translate_netinfo_net
raise MultipleSouthBoundNicsPerNetworkError(net, nics)
MultipleSouthBoundNicsPerNetworkError: ('ovirtmgmt', ['enp3s0', =
'enp4s0'])
Remove new nic. reboot. vdsm once again stuck waiting for storage pool =
to come up.
</pre></div></div></blockquote><div><br
class=3D""></div>i=E2=80=99m not =
clear on what are you actually trying to do. You do a clean install with =
a new SD, and then you write over it? With what? data from your former =
installation, just plain file-level copy? Why?<br
class=3D""><blockquote =
type=3D"cite" class=3D""><div class=3D""><div
text=3D"#000000" =
bgcolor=3D"#FFFFFF" class=3D""><pre
class=3D"screen">
So this is where I'm at now. Stuck. once again.
I've been running 3.6.3 All In One for many years because I've been =
concerned about the complexity of the self hosted
configuration. Guess I was right.
Google shows lots of other people also concerned about the stability of =
oVirt..It's great when it runs, but=20
any little issue and you're basically reinstalling from scratch.
</pre>
</div>
_______________________________________________<br class=3D"">Users =
mailing list<br class=3D""><a href=3D"mailto:Users@ovirt.org"
=
class=3D"">Users(a)ovirt.org</a><br =
class=3D"">http://lists.ovirt.org/mailman/listinfo/users<br =
class=3D""></div></blockquote></div><br
class=3D""></body></html>=
--Apple-Mail=_97F20318-4210-46C0-9A0F-2858849CBFCD--