no network with matching name 'vdsm-ovirtmgmt'
by William Kwan
------=_Part_1779680_195441767.1463183776452
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
HI all,
I have a problem with my 3.5 setup with hosted-engine. =C2=A0After reboot, =
I can get things started. =C2=A0When i try to start vdsm manually, it says =
"no network with matching name 'vdsm-ovirtmgmt'
The bridge "ovirtmgmt" is up with underlying bond0 are good. =C2=A0I'm not =
sure where to start. =C2=A0Can anyone shed some light on where to start to =
fix this? =C2=A0Much appreciated.
ThanksWill
# /etc/init.d/vdsmd startinitctl: Job is already running: libvirtdvdsm: Run=
ning mkdirsvdsm: Running configure_coredumpvdsm: Running configure_vdsm_log=
svdsm: Running run_init_hooksvdsm: Running upgraded_version_checkvdsm: Runn=
ing check_is_configuredlibvirt is already configured for vdsmvdsm: Running =
validate_configurationSUCCESS: ssl configured to true. No conflictsvdsm: Ru=
nning prepare_transient_repositoryvdsm: Running syslog_availablevdsm: Runni=
ng nwfiltervdsm: Running dummybrvdsm: Running load_needed_modulesvdsm: Runn=
ing tune_systemvdsm: Running test_spacevdsm: Running test_lovdsm: Running u=
nified_network_persistence_upgradevdsm: Running restore_netslibvirt: Networ=
k Driver error : Network not found: no network with matching name 'vdsm-ovi=
rtmgmt'Traceback (most recent call last):=C2=A0 File "/usr/share/vdsm/vdsm-=
restore-net-config", line 137, in <module>=C2=A0 =C2=A0 restore()=C2=A0 Fil=
e "/usr/share/vdsm/vdsm-restore-net-config", line 123, in restore=C2=A0 =C2=
=A0 unified_restoration()=C2=A0 File "/usr/share/vdsm/vdsm-restore-net-conf=
ig", line 69, in unified_restoration=C2=A0 =C2=A0 setupNetworks(nets, bonds=
, connectivityCheck=3DFalse, _inRollback=3DTrue)=C2=A0 File "/usr/share/vds=
m/network/api.py", line 680, in setupNetworks=C2=A0 =C2=A0 implicitBonding=
=3DTrue, _netinfo=3D_netinfo, **d)=C2=A0 File "/usr/share/vdsm/network/api.=
py", line 226, in wrapped=C2=A0 =C2=A0 ret =3D func(**attrs)=C2=A0 File "/u=
sr/share/vdsm/network/api.py", line 315, in addNetwork=C2=A0 =C2=A0 netEnt.=
configure(**options)=C2=A0 File "/usr/share/vdsm/network/models.py", line 1=
69, in configure=C2=A0 =C2=A0 self.configurator.configureBridge(self, **opt=
s)=C2=A0 File "/usr/share/vdsm/network/configurators/ifcfg.py", line 88, in=
configureBridge=C2=A0 =C2=A0 ifup(bridge.name, bridge.ipConfig.async)=C2=
=A0 File "/usr/share/vdsm/network/configurators/ifcfg.py", line 819, in ifu=
p=C2=A0 =C2=A0 rc, out, err =3D _ifup(iface)=C2=A0 File "/usr/share/vdsm/ne=
twork/configurators/ifcfg.py", line 808, in _ifup=C2=A0 =C2=A0 raise Config=
NetworkError(ERR_FAILED_IFUP, out[-1] if out else '')network.errors.ConfigN=
etworkError: (29, 'Determining IP information for DMZ... failed.')vdsm: sto=
pped during execute restore_nets task (task returned with error code 1).vds=
m start =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 [FAILED]
------=_Part_1779680_195441767.1463183776452
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<html><head></head><body><div style=3D"color:#000; background-color:#fff; f=
ont-family:Courier New, courier, monaco, monospace, sans-serif;font-size:13=
px"><div id=3D"yui_3_16_0_ym19_1_1463183424286_3052">HI all,</div><div id=
=3D"yui_3_16_0_ym19_1_1463183424286_3052"><br></div><div id=3D"yui_3_16_0_y=
m19_1_1463183424286_3052" dir=3D"ltr">I have a problem with my 3.5 setup wi=
th hosted-engine. After reboot, I can get things started. When =
i try to start vdsm manually, it says "<span style=3D"font-family: Menlo; f=
ont-size: 12px;" id=3D"yui_3_16_0_ym19_1_1463183424286_3161">no network wit=
h matching name 'vdsm-ovirtmgmt'</span></div><div id=3D"yui_3_16_0_ym19_1_1=
463183424286_3052" dir=3D"ltr"><span style=3D"font-family: Menlo; font-size=
: 12px;"><br></span></div><div id=3D"yui_3_16_0_ym19_1_1463183424286_3052" =
dir=3D"ltr"><span style=3D"font-family: Menlo; font-size: 12px;" id=3D"yui_=
3_16_0_ym19_1_1463183424286_3500">The bridge "ovirtmgmt" is up with underly=
ing bond0 are good. I'm not sure where to start. Can anyone she=
d some light on where to start to fix this? Much appreciated.</span><=
/div><div id=3D"yui_3_16_0_ym19_1_1463183424286_3052" dir=3D"ltr"><span sty=
le=3D"font-family: Menlo; font-size: 12px;"><br></span></div><div id=3D"yui=
_3_16_0_ym19_1_1463183424286_3052" dir=3D"ltr"><span style=3D"font-family: =
Menlo; font-size: 12px;" id=3D"yui_3_16_0_ym19_1_1463183424286_3501">Thanks=
</span></div><div id=3D"yui_3_16_0_ym19_1_1463183424286_3052" dir=3D"ltr"><=
span style=3D"font-family: Menlo; font-size: 12px;" id=3D"yui_3_16_0_ym19_1=
_1463183424286_3522">Will</span></div><div id=3D"yui_3_16_0_ym19_1_14631834=
24286_3052" dir=3D"ltr"><br></div><div style=3D"margin-top: 0px; margin-bot=
tom: 0px; font-size: 12px; line-height: normal; font-family: Menlo;" id=3D"=
yui_3_16_0_ym19_1_1463183424286_3400"><span style=3D"font-variant-ligatures=
: no-common-ligatures;" id=3D"yui_3_16_0_ym19_1_1463183424286_3401"># /etc/=
init.d/vdsmd start</span></div><div style=3D"margin-top: 0px; margin-bottom=
: 0px; font-size: 12px; line-height: normal; font-family: Menlo;" id=3D"yui=
_3_16_0_ym19_1_1463183424286_3402"><span style=3D"font-variant-ligatures: n=
o-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3403">initctl: Jo=
b is already running: libvirtd</span></div><div style=3D"margin-top: 0px; m=
argin-bottom: 0px; font-size: 12px; line-height: normal; font-family: Menlo=
;" id=3D"yui_3_16_0_ym19_1_1463183424286_3404"><span style=3D"font-variant-=
ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3405"=
>vdsm: Running mkdirs</span></div><div style=3D"margin-top: 0px; margin-bot=
tom: 0px; font-size: 12px; line-height: normal; font-family: Menlo;" id=3D"=
yui_3_16_0_ym19_1_1463183424286_3406"><span style=3D"font-variant-ligatures=
: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3407">vdsm: Ru=
nning configure_coredump</span></div><div style=3D"margin-top: 0px; margin-=
bottom: 0px; font-size: 12px; line-height: normal; font-family: Menlo;" id=
=3D"yui_3_16_0_ym19_1_1463183424286_3408"><span style=3D"font-variant-ligat=
ures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3409">vdsm=
: Running configure_vdsm_logs</span></div><div style=3D"margin-top: 0px; ma=
rgin-bottom: 0px; font-size: 12px; line-height: normal; font-family: Menlo;=
" id=3D"yui_3_16_0_ym19_1_1463183424286_3410"><span style=3D"font-variant-l=
igatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3411">=
vdsm: Running run_init_hooks</span></div><div style=3D"margin-top: 0px; mar=
gin-bottom: 0px; font-size: 12px; line-height: normal; font-family: Menlo;"=
id=3D"yui_3_16_0_ym19_1_1463183424286_3412"><span style=3D"font-variant-li=
gatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3413">v=
dsm: Running upgraded_version_check</span></div><div style=3D"margin-top: 0=
px; margin-bottom: 0px; font-size: 12px; line-height: normal; font-family: =
Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3414"><span style=3D"font-var=
iant-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_=
3415">vdsm: Running check_is_configured</span></div><div style=3D"margin-to=
p: 0px; margin-bottom: 0px; font-size: 12px; line-height: normal; font-fami=
ly: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3416"><span style=3D"font=
-variant-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424=
286_3417">libvirt is already configured for vdsm</span></div><div style=3D"=
margin-top: 0px; margin-bottom: 0px; font-size: 12px; line-height: normal; =
font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3418"><span styl=
e=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1=
463183424286_3419">vdsm: Running validate_configuration</span></div><div st=
yle=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px; line-height: n=
ormal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3420"><sp=
an style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui_3_16_0_y=
m19_1_1463183424286_3421">SUCCESS: ssl configured to true. No conflicts</sp=
an></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px=
; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183=
424286_3422"><span style=3D"font-variant-ligatures: no-common-ligatures" id=
=3D"yui_3_16_0_ym19_1_1463183424286_3423">vdsm: Running prepare_transient_r=
epository</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; fo=
nt-size: 12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_y=
m19_1_1463183424286_3424"><span style=3D"font-variant-ligatures: no-common-=
ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3425">vdsm: Running syslog=
_available</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; f=
ont-size: 12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_=
ym19_1_1463183424286_3426"><span style=3D"font-variant-ligatures: no-common=
-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3427">vdsm: Running nwfil=
ter</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-siz=
e: 12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_=
1463183424286_3428"><span style=3D"font-variant-ligatures: no-common-ligatu=
res" id=3D"yui_3_16_0_ym19_1_1463183424286_3429">vdsm: Running dummybr</spa=
n></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px;=
line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_14631834=
24286_3430"><span style=3D"font-variant-ligatures: no-common-ligatures" id=
=3D"yui_3_16_0_ym19_1_1463183424286_3431">vdsm: Running load_needed_modules=
</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: =
12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_146=
3183424286_3432"><span style=3D"font-variant-ligatures: no-common-ligatures=
" id=3D"yui_3_16_0_ym19_1_1463183424286_3433">vdsm: Running tune_system</sp=
an></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px=
; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183=
424286_3434"><span style=3D"font-variant-ligatures: no-common-ligatures" id=
=3D"yui_3_16_0_ym19_1_1463183424286_3435">vdsm: Running test_space</span></=
div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px; lin=
e-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_146318342428=
6_3436"><span style=3D"font-variant-ligatures: no-common-ligatures" id=3D"y=
ui_3_16_0_ym19_1_1463183424286_3437">vdsm: Running test_lo</span></div><div=
style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px; line-height=
: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3438">=
<span style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui_3_16_=
0_ym19_1_1463183424286_3439">vdsm: Running unified_network_persistence_upgr=
ade</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-siz=
e: 12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_=
1463183424286_3440"><span style=3D"font-variant-ligatures: no-common-ligatu=
res" id=3D"yui_3_16_0_ym19_1_1463183424286_3441">vdsm: Running restore_nets=
</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: =
12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_146=
3183424286_3442"><span style=3D"font-variant-ligatures: no-common-ligatures=
" id=3D"yui_3_16_0_ym19_1_1463183424286_3443">libvirt: Network Driver error=
: Network not found: no network with matching name 'vdsm-ovirtmgmt'</span>=
</div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px; l=
ine-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424=
286_3444"><span style=3D"font-variant-ligatures: no-common-ligatures" id=3D=
"yui_3_16_0_ym19_1_1463183424286_3445">Traceback (most recent call last):</=
span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12=
px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_14631=
83424286_3446"><span style=3D"font-variant-ligatures: no-common-ligatures" =
id=3D"yui_3_16_0_ym19_1_1463183424286_3447"> File "/usr/share/vdsm/vd=
sm-restore-net-config", line 137, in <module></span></div><div style=
=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px; line-height: norm=
al; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3448"><span =
style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19=
_1_1463183424286_3449"> restore()</span></div><div style=3D"ma=
rgin-top: 0px; margin-bottom: 0px; font-size: 12px; line-height: normal; fo=
nt-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3450"><span style=
=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_14=
63183424286_3451"> File "/usr/share/vdsm/vdsm-restore-net-config", li=
ne 123, in restore</span></div><div style=3D"margin-top: 0px; margin-bottom=
: 0px; font-size: 12px; line-height: normal; font-family: Menlo;" id=3D"yui=
_3_16_0_ym19_1_1463183424286_3452"><span style=3D"font-variant-ligatures: n=
o-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3453"> &nbs=
p; unified_restoration()</span></div><div style=3D"margin-top: 0px; margin-=
bottom: 0px; font-size: 12px; line-height: normal; font-family: Menlo;" id=
=3D"yui_3_16_0_ym19_1_1463183424286_3454"><span style=3D"font-variant-ligat=
ures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3455">&nbs=
p; File "/usr/share/vdsm/vdsm-restore-net-config", line 69, in unified_rest=
oration</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font=
-size: 12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym1=
9_1_1463183424286_3456"><span style=3D"font-variant-ligatures: no-common-li=
gatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3457"> setupNet=
works(nets, bonds, connectivityCheck=3DFalse, _inRollback=3DTrue)</span></d=
iv><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px; line=
-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286=
_3458"><span style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yu=
i_3_16_0_ym19_1_1463183424286_3459"> File "/usr/share/vdsm/network/ap=
i.py", line 680, in setupNetworks</span></div><div style=3D"margin-top: 0px=
; margin-bottom: 0px; font-size: 12px; line-height: normal; font-family: Me=
nlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3460"><span style=3D"font-varia=
nt-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_34=
61"> implicitBonding=3DTrue, _netinfo=3D_netinfo, **d)</span><=
/div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px; li=
ne-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_14631834242=
86_3462"><span style=3D"font-variant-ligatures: no-common-ligatures" id=3D"=
yui_3_16_0_ym19_1_1463183424286_3463"> File "/usr/share/vdsm/network/=
api.py", line 226, in wrapped</span></div><div style=3D"margin-top: 0px; ma=
rgin-bottom: 0px; font-size: 12px; line-height: normal; font-family: Menlo;=
" id=3D"yui_3_16_0_ym19_1_1463183424286_3464"><span style=3D"font-variant-l=
igatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3465">=
ret =3D func(**attrs)</span></div><div style=3D"margin-top: 0=
px; margin-bottom: 0px; font-size: 12px; line-height: normal; font-family: =
Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3466"><span style=3D"font-var=
iant-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_=
3467"> File "/usr/share/vdsm/network/api.py", line 315, in addNetwork=
</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: =
12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_146=
3183424286_3468"><span style=3D"font-variant-ligatures: no-common-ligatures=
" id=3D"yui_3_16_0_ym19_1_1463183424286_3469"> netEnt.configur=
e(**options)</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px;=
font-size: 12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_=
0_ym19_1_1463183424286_3470"><span style=3D"font-variant-ligatures: no-comm=
on-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3471"> File "/usr=
/share/vdsm/network/models.py", line 169, in configure</span></div><div sty=
le=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px; line-height: no=
rmal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3472"><spa=
n style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym=
19_1_1463183424286_3473"> self.configurator.configureBridge(se=
lf, **opts)</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; =
font-size: 12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0=
_ym19_1_1463183424286_3474"><span style=3D"font-variant-ligatures: no-commo=
n-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3475"> File "/usr/=
share/vdsm/network/configurators/ifcfg.py", line 88, in configureBridge</sp=
an></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px=
; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183=
424286_3476"><span style=3D"font-variant-ligatures: no-common-ligatures" id=
=3D"yui_3_16_0_ym19_1_1463183424286_3477"> ifup(bridge.name, b=
ridge.ipConfig.async)</span></div><div style=3D"margin-top: 0px; margin-bot=
tom: 0px; font-size: 12px; line-height: normal; font-family: Menlo;" id=3D"=
yui_3_16_0_ym19_1_1463183424286_3478"><span style=3D"font-variant-ligatures=
: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3479"> F=
ile "/usr/share/vdsm/network/configurators/ifcfg.py", line 819, in ifup</sp=
an></div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px=
; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183=
424286_3480"><span style=3D"font-variant-ligatures: no-common-ligatures" id=
=3D"yui_3_16_0_ym19_1_1463183424286_3481"> rc, out, err =3D _i=
fup(iface)</span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; f=
ont-size: 12px; line-height: normal; font-family: Menlo;" id=3D"yui_3_16_0_=
ym19_1_1463183424286_3482"><span style=3D"font-variant-ligatures: no-common=
-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3483"> File "/usr/s=
hare/vdsm/network/configurators/ifcfg.py", line 808, in _ifup</span></div><=
div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px; line-hei=
ght: normal; font-family: Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_348=
4"><span style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui_3_=
16_0_ym19_1_1463183424286_3485"> raise ConfigNetworkError(ERR_=
FAILED_IFUP, out[-1] if out else '')</span></div><div style=3D"margin-top: =
0px; margin-bottom: 0px; font-size: 12px; line-height: normal; font-family:=
Menlo;" id=3D"yui_3_16_0_ym19_1_1463183424286_3486"><span style=3D"font-va=
riant-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286=
_3487">network.errors.ConfigNetworkError: (29, 'Determining IP information =
for DMZ... failed.')</span></div><div style=3D"margin-top: 0px; margin-bott=
om: 0px; font-size: 12px; line-height: normal; font-family: Menlo;" id=3D"y=
ui_3_16_0_ym19_1_1463183424286_3488"><span style=3D"font-variant-ligatures:=
no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_3489">vdsm: sto=
pped during execute restore_nets task (task returned with error code 1).</s=
pan></div><div id=3D"yui_3_16_0_ym19_1_1463183424286_3052" dir=3D"ltr">
</div><div style=3D"margin-top: 0px; margin-bottom: 0px; font-size: 12px; l=
ine-height: normal; font-family: Menlo;" dir=3D"ltr" id=3D"yui_3_16_0_ym19_=
1_1463183424286_3490"><span style=3D"font-variant-ligatures: no-common-liga=
tures;" id=3D"yui_3_16_0_ym19_1_1463183424286_3491">vdsm start  =
; &nb=
sp; &=
nbsp; [</span><span style=3D"font-variant-ligatures: no-common-ligatures;" =
id=3D"yui_3_16_0_ym19_1_1463183424286_3492">FAILED</span><span style=3D"fon=
t-variant-ligatures: no-common-ligatures;" id=3D"yui_3_16_0_ym19_1_14631834=
24286_3493">]</span></div></div></body></html>
------=_Part_1779680_195441767.1463183776452--
7 years, 11 months
Hosted Engine Appliance hostname causing issues in production environment
by Langley, Robert
--_000_BY1PR09MB082435A552E5222B006CC6ED87730BY1PR09MB0824namp_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Hello;
I discovered, the hard way, that the appliance is configured with the hostn=
ame of localhost.localdomain.localdomain
It seems that something did not go well with the hosted-engine -deploy
I can go into the engine VM and edit the hostname, but if for any reason I =
need to poweroff the engine VM, I get in trouble. Because, then the hostnam=
e goes back to localhost.localdomain.localdomain and both DHCP & DNS within=
our enterprise/production environment ends up assuming that for the hostna=
me to IP address reference or record. And it seems that other linux systems=
(not the ones I administer; none of my almost 50 systems are effected. Of =
those, I have about 5 linux/UNIX based systems attached to the production n=
etwork) are going offline because of this.
I assume they do not have their HOSTS file configured correctly, but they (=
the other administrators) are not listening to me. I have already told them=
what to look for, in order to fix the issue on their own systems, but they=
've ended up with this now for the third time.
This is because I work for a local government and we have various administr=
ators for the various agencies within our County government.
I have unplugged my initial physical host from our County network and I thi=
nk I'm going to end up bringing up a physical engine host, then work on con=
verting that to a VM for a hosted engine. I hope that is going to work. I t=
ried bringing up the OVA of the appliance within VirtualBox, but that doesn=
't work. Is there another virtual software I can bring up within a Windows =
PC to simply edit the hostname, then export the appliance again?
I think the appliance for download needs to be changed to have something ot=
her than "localhost.localdomain.localdomain" as the hostname in the hosted-=
engine appliance. I downloaded the OVA file from the Jenkins.ovirt.org site=
.
Sincerely,
-Robert
--_000_BY1PR09MB082435A552E5222B006CC6ED87730BY1PR09MB0824namp_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=3D"EN-US" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal">Hello;<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
<p class=3D"MsoNormal">I discovered, the hard way, that the appliance is co=
nfigured with the hostname of localhost.localdomain.localdomain<o:p></o:p><=
/p>
<p class=3D"MsoNormal">It seems that something did not go well with the hos=
ted-engine –deploy<o:p></o:p></p>
<p class=3D"MsoNormal">I can go into the engine VM and edit the hostname, b=
ut if for any reason I need to poweroff the engine VM, I get in trouble. Be=
cause, then the hostname goes back to localhost.localdomain.localdomain and=
both DHCP & DNS within our enterprise/production
environment ends up assuming that for the hostname to IP address reference=
or record. And it seems that other linux systems (not the ones I administe=
r; none of my almost 50 systems are effected. Of those, I have about 5 linu=
x/UNIX based systems attached to
the production network) are going offline because of this.<o:p></o:p></p>
<p class=3D"MsoNormal">I assume they do not have their HOSTS file configure=
d correctly, but they (the other administrators) are not listening to me. I=
have already told them what to look for, in order to fix the issue on thei=
r own systems, but they’ve ended up
with this now for the third time.<o:p></o:p></p>
<p class=3D"MsoNormal">This is because I work for a local government and we=
have various administrators for the various agencies within our County gov=
ernment.<o:p></o:p></p>
<p class=3D"MsoNormal">I have unplugged my initial physical host from our C=
ounty network and I think I’m going to end up bringing up a physical =
engine host, then work on converting that to a VM for a hosted engine. I ho=
pe that is going to work. I tried bringing
up the OVA of the appliance within VirtualBox, but that doesn’t work=
. Is there another virtual software I can bring up within a Windows PC to s=
imply edit the hostname, then export the appliance again?<o:p></o:p></p>
<p class=3D"MsoNormal">I think the appliance for download needs to be chang=
ed to have something other than “localhost.localdomain.localdomain=
221; as the hostname in the hosted-engine appliance. I downloaded the OVA f=
ile from the Jenkins.ovirt.org site.<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
<p class=3D"MsoNormal">Sincerely,<o:p></o:p></p>
<p class=3D"MsoNormal">-Robert<o:p></o:p></p>
</div>
</body>
</html>
--_000_BY1PR09MB082435A552E5222B006CC6ED87730BY1PR09MB0824namp_--
7 years, 11 months
creation of lun disks
by Fabrice Bacchella
--Apple-Mail=_86495AA0-19B5-42EB-9515-670209434AA3
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=us-ascii
I'm trying to generated a lun disk, using the python SDK.
My code can be found at =
https://github.com/fbacchella/ovirtcmd/blob/master/ovlib/disks/__init__.py=
If a try to see the content of a existing disk and test with :
print disk.get_type()
print disk.get_storage_type()
I'm getting :
None
lun
Now I try to create another LUN disk with
kwargs['storage_type'] =3D 'lun'
kwargs['type_'] =3D 'system'
I'm getting:
> POST /api/disks HTTP/1.1
> <disk>
> <type>system</type>
> <interface>virtio-scsi</interface>
> <lun_storage>
> <logical_unit id=3D"3600c0ff00026285aed8f355701000000"/>
> </lun_storage>
> <storage_type>lun</storage_type>
> </disk>
...
< <fault>
< <reason>Incomplete parameters</reason>
< <detail>Storage [type] required for invoke0</detail>
< </fault>
changing to=20
kwargs['type_'] =3D None=20
change nothing, I'm still getting the same error message.
> POST /api/disks HTTP/1.1
> <disk>
> <interface>virtio-scsi</interface>
> <lun_storage>
> <logical_unit id=3D"3600c0ff00026285aed8f355701000000"/>
> </lun_storage>
> <storage_type>lun</storage_type>
> </disk>
...
< <fault>
< <reason>Incomplete parameters</reason>
< <detail>Storage [type] required for invoke0</detail>
< </fault>
What did I do wrong ? There is nothing about that in the logs
--Apple-Mail=_86495AA0-19B5-42EB-9515-670209434AA3
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=us-ascii
<html><body style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; =
-webkit-line-break: after-white-space;" class=3D"">I'm trying to =
generated a lun disk, using the python SDK.<br class=3D""><br =
class=3D"">My code can be found at <a =
href=3D"https://github.com/fbacchella/ovirtcmd/blob/master/ovlib/disks/__i=
nit__.py" =
class=3D"">https://github.com/fbacchella/ovirtcmd/blob/master/ovlib/disks/=
__init__.py</a><br class=3D""><br class=3D"">If a try to see the content =
of a existing disk and test with :<br =
class=3D"">print disk.get_type()<br =
class=3D"">print disk.get_storage_type()<br class=3D""><br =
class=3D"">I'm getting :<br class=3D"">None<br class=3D"">lun<br =
class=3D""><br class=3D"">Now I try to create another LUN disk with<br =
class=3D"">kwargs['storage_type'] =3D 'lun'<br =
class=3D"">kwargs['type_'] =3D 'system'<br class=3D""><br =
class=3D"">I'm getting:<div class=3D""><br class=3D""><font face=3D"Menlo"=
class=3D"">> POST /api/disks HTTP/1.1<br class=3D"">> =
<disk><br class=3D"">> =
<type>system</type><br class=3D"">> =
<interface>virtio-scsi</interface><br =
class=3D"">> <lun_storage><br =
class=3D"">> <logical_unit =
id=3D"3600c0ff00026285aed8f355701000000"/><br =
class=3D"">> </lun_storage><br =
class=3D"">> =
<storage_type>lun</storage_type><br =
class=3D"">> </disk><br class=3D"">...<br class=3D"">< =
<fault><br class=3D"">< =
<reason>Incomplete parameters</reason><br =
class=3D"">< <detail>Storage [type] =
required for invoke0</detail><br class=3D"">< </fault><br =
class=3D""></font><div class=3D""><br class=3D""></div><div =
class=3D"">changing to </div><div class=3D""><font face=3D"Menlo" =
class=3D""> kwargs['type_'] =3D None </font></div><div =
class=3D"">change nothing, I'm still getting the same error =
message.</div><div class=3D""><br class=3D""></div><font face=3D"Menlo" =
class=3D"">> POST /api/disks HTTP/1.1<br class=3D"">> =
<disk><br class=3D"">> =
<interface>virtio-scsi</interface><br =
class=3D"">> <lun_storage><br =
class=3D"">> <logical_unit =
id=3D"3600c0ff00026285aed8f355701000000"/><br =
class=3D"">> </lun_storage><br =
class=3D"">> =
<storage_type>lun</storage_type><br =
class=3D"">> </disk><br class=3D"">...<br class=3D"">< =
<fault><br class=3D"">< =
<reason>Incomplete parameters</reason><br =
class=3D"">< <detail>Storage [type] =
required for invoke0</detail><br class=3D"">< </fault><br =
class=3D""><br class=3D""></font><div class=3D""><br class=3D""></div><div=
class=3D""> What did I do wrong ? There is nothing about that in =
the logs</div><br class=3D"Apple-interchange-newline"><br class=3D""><br =
class=3D""><br class=3D""></div></body></html>=
--Apple-Mail=_86495AA0-19B5-42EB-9515-670209434AA3--
7 years, 11 months
Problem remove snapshot
by Marcelo Leandro
hello,
i have problem for delete one snapshot.
i see the error:
Due to partial snapshot removal, Snapshot 'Backup the VM' of VM 'vmname'
now contains only the following disks: 'vmdiskname'.
Failed to delete snapshot 'Backup the VM' for VM 'vmname'.
information in db :
imagestatus | storage_pool_id |
storage_domain_id | image_group_id |
im
age_guid | parentid
-------------+--------------------------------------+--------------------------------------+--------------------------------------+----------------
----------------------+--------------------------------------
1 | 77e24b20-9d21-4952-a089-3c5c592b4e6d |
6e5cce71-3438-4045-9d54-607123e0557e | bfb1e6b5-7a06-41e4-b8b4-2e237ed0c7ab
| 1bb7bd08-5ee8-4
a3b-8978-c15e15d1c5e4 | 6008671c-2f9d-48de-94f3-cc7d6273de31
4 | 77e24b20-9d21-4952-a089-3c5c592b4e6d |
6e5cce71-3438-4045-9d54-607123e0557e | bfb1e6b5-7a06-41e4-b8b4-2e237ed0c7ab
| 6008671c-2f9d-4
8de-94f3-cc7d6273de31 | 00000000-0000-0000-0000-000000000000
output the script vm-disk-info.py
Disk bfb1e6b5-7a06-41e4-b8b4-2e237ed0c7ab
(sd:6e5cce71-3438-4045-9d54-607123e0557e)
Warning: volume 1bb7bd08-5ee8-4a3b-8978-c15e15d1c5e4 is in chain but illegal
Volumes:
6008671c-2f9d-48de-94f3-cc7d6273de31
1bb7bd08-5ee8-4a3b-8978-c15e15d1c5e4
output the command md5sum :
volume : 1bb7bd08-5ee8-4a3b-8978-c15e15d1c5e4
4c05c8258ed5746da6ac2cdb80c8974e 1bb7bd08-5ee8-4a3b-8978-c15e15d1c5e4
ec74d4d8189a5ea24720349868ff7ab7 1bb7bd08-5ee8-4a3b-8978-c15e15d1c5e4
the volume change
output the command md5sum :
volume: 6008671c-2f9d-48de-94f3-cc7d6273de31
86daf229ad0b65fb8be3a3de6b0ee840 6008671c-2f9d-48de-94f3-cc7d6273de31
86daf229ad0b65fb8be3a3de6b0ee840 6008671c-2f9d-48de-94f3-cc7d6273de31
the volume not change
Thanks.
7 years, 11 months
Trying to understand the mixed storage configuration options.
by Jason Ziemba
I'm fairly new to oVirt (coming from ProxMox) and trying to wrap my head
around the mixed (local/NAS) data domain options that are available.
I'm trying to configure a set of systems to have local storage, as their
primary data storage domain, though also want to have the ability to have a
NAS based data domain for guests that are 'mobile' between hosts.
Currently I'm able to do one or the other, but not both (so it seems).
When I put all of the systems in to a single cluster (or single
data-center) I'm able to have the shared data domain, though have only
found the ability to configure one system for local storage (not all of
them). When I split them out in to separate data centers, they all have
their local data domain working, but only a single dc is able to access the
shared data domain at a time.
Am I missing something along the way (probably fairly obvious) that does
exactly what I'm outlining, or is this functionality not available by
design?
Any assistance/guidance is greatly appreciated.
7 years, 11 months
[moVirt] Add several datacenters
by Nicolas Ecarnot
Hello,
I finally was able to correctly connect to one of our DC with moVirt, so
I can show off and it is so cool.
But I find no way to add several datacenters.
May someone help please?
--
Nicolas ECARNOT
7 years, 11 months
Changing of master storage domain
by Roman A. Chukov
Hello there,
I have a question about the algorithm of changing of master storage
domain. I have a fresh installation of oVirt 3.6 on 2 hardware nodes,
using a number of NFS shares as storage domains, and one of them was a
master. When I was adding the second node into cluster, master storage
domain had been changed by oVirt. Actually it didn't bring any harmful
consequences at that point but it was unexpected for me. So, could
anybody please explain such behavior of oVirt and also explain whether I
could change master storage domain back to the previous?
--
Thanks in advance, Roman Chukov.
7 years, 11 months
volume_utilization_chunk_mb not working
by Grundmann, Christian
--_000_6A17C71B52524C408E7AAF69103E9E490F72FF7Cfabamailserverf_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Hi
I create a lot of Thin Disk VMs from templates every day, and get "paused d=
ue to no storage space error" and "paused due to unknown storage error" on =
a few of them.
Sometimes the VMs are resumed a few seconds later but sometime not, but I c=
an resume them myself.
I tried to set
volume_utilization_percent=3D15
volume_utilization_chunk_mb=3D4048
in /etc/vdsm/vdsm.conf on every Host
But the Initial Size of the Disk is always 1GB and then increments to 2GB
4GB would be the maximum Size I need before I destroy the VM. So if the ini=
tial Size would be 4GB the pausing shouldn't happen anymore
Thx a lot for your help
Christian
--_000_6A17C71B52524C408E7AAF69103E9E490F72FF7Cfabamailserverf_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.E-MailFormatvorlage17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=3D"DE-AT" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal"><span lang=3D"EN-US">Hi<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US">I create a lot of Thin Disk VMs=
from templates every day, and get „paused due to no storage space er=
ror“ and „paused due to unknown storage error“ on a few o=
f them.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US">Sometimes the VMs are resumed a=
few seconds later but sometime not, but I can resume them myself.<o:p></o:=
p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US">I tried to set<o:p></o:p></span=
></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US">volume_utilization_percent=3D15=
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US">volume_utilization_chunk_mb=3D4=
048<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US">in /etc/vdsm/vdsm.conf on every=
Host<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US">But the Initial Size of the Dis=
k is always 1GB and then increments to 2GB<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US">4GB would be the maximum Size I=
need before I destroy the VM. So if the initial Size would be 4GB the paus=
ing shouldn’t happen anymore<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US">Thx a lot for your help<o:p></o=
:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US">Christian<o:p></o:p></span></p>
</div>
</body>
</html>
--_000_6A17C71B52524C408E7AAF69103E9E490F72FF7Cfabamailserverf_--
7 years, 11 months
oVirt 4.0 hosted-engine deploy exits without messages or logs
by Gianluca Cecchi
Hello,
trying to have an insight at 4.0 alpha1, using CentOS 7.2 and hosted engine.
Installed packages after configuring repo at
http://plain.resources.ovirt.org/pub/ovirt-4.0_alpha1/rpm/el7/noarch/ovir...
are
ovirt-hosted-engine-setup-2.0.0-0.0.master.20160325145108.gita9a3495.el7.centos.noarch
ovirt-engine-appliance-4.0-20160405.1.el7.centos.noarch
otopi-1.5.0-0.0.master.20160403070351.gitfa92bb0.el7.noarch
but
[root@ovirtita ~]# hosted-engine --deploy
[root@ovirtita ~]# echo $?
1
[root@ovirtita ~]# ls /var/log
anaconda chrony dmesg.old libvirt ovirt-hosted-engine-ha secure
vdsm
audit core glusterfs maillog ovirt-hosted-engine-setup spooler
wpa_supplicant.log
boot.log cron grubby messages ppp tallylog
wtmp
btmp dmesg lastlog ntpstats sa tuned
yum.log
[root@ovirtita ~]# ls /var/log/ovirt-hosted-engine-*
/var/log/ovirt-hosted-engine-ha:
/var/log/ovirt-hosted-engine-setup:
[root@ovirtita ~]#
[root@ovirtita log]# ll /var/log/vdsm/
total 0
drwxr-xr-x. 2 vdsm kvm 6 Apr 4 19:15 backup
-rw-r--r--. 1 vdsm kvm 0 May 12 14:29 connectivity.log
-rw-r--r--. 1 vdsm kvm 0 May 12 14:29 mom.log
-rw-r--r--. 1 root root 0 May 12 14:29 supervdsm.log
-rw-r--r--. 1 vdsm kvm 0 May 12 14:29 vdsm.log
[root@ovirtita log]# ll /var/log/vdsm/backup/
total 0
[root@ovirtita log]#
?
7 years, 11 months
