4:27 p.m.
--_000_D1895248CBF5soerenmalchowmconnet_
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
Dear all,
In version 3.5.2 on CentOS 7.1 we now have the problem that the backup scri=
pt seems to trigger a crash of Vms, this is the second time, the first time=
i could only solve the problem by rebooting the hypervisor host and acknow=
leding =93host has been rebooted=94
This problems happens while removing snapshots after snapshot =96> clone ->=
export procedures.
The actual qemu process is still running after following log output, but th=
e VM is not responsive anymore, i can kill the process problem.
Two questions for this:
How can I avoid this problem ?
Is there a way to tell ovirt that the qemu process is gone and that the VM =
can be started again ?
<=97 snip =97 May 25 22:03:47
mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad=
ata not found: Requested metadata element is not present
May 25 22:03:47 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad=
ata not found: Requested metadata element is not present
May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: inter=
nal error: End of file from monitor
May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: IDMZ_MC_PUBLI=
C: port 3(vnet3) entered disabled state
May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: device vnet3 =
left promiscuous mode
May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: IDMZ_MC_PUBLI=
C: port 3(vnet3) entered disabled state
May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kvm[22973]: 15 guests=
now active
May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net systemd-machined[1441=
2]: Machine qemu-mc-glpi-app-01-live.mc.mcon.net terminated.
May 25 22:04:11 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: Canno=
t start job (modify, none) for domain mc-glpi-app-01-live.mc.mcon.net; curr=
ent job is (modify, none) own
ed by (1534, 0)
May 25 22:04:11 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: Timed=
out during operation: cannot acquire state change lock
May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: Canno=
t start job (modify, none) for domain mc-glpi-app-01-live.mc.mcon.net; curr=
ent job is (modify, none) own
ed by (1534, 0)
May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: Timed=
out during operation: cannot acquire state change lock
May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad=
ata not found: Requested metadata element is not present
May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm vm.V=
m ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Error getting block =
job info
Traceback=
(most recent call last):
File "/=
usr/share/vdsm/virt/vm.py", line 5759, in queryBlockJobs
liveI=
nfo =3D self._dom.blockJobInfo(drive.name, 0)
File "/=
usr/share/vdsm/virt/vm.py", line 697, in f
raise=
toe
TimeoutEr=
ror: Timed out during operation: cannot acquire state change lock
<=97 snip =97
<=97 snip =97 May 25 22:04:18
mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm vm.V=
m ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function faile=
d: <AdvancedStatsFunction _samp
Traceback=
(most recent call last):
File "/=
usr/share/vdsm/virt/sampling.py", line 484, in collect
stats=
Function()
File "/=
usr/share/vdsm/virt/sampling.py", line 359, in __call__
retVa=
lue =3D self._function(*args, **kwargs)
File "/=
usr/share/vdsm/virt/vm.py", line 346, in _sampleVmJobs
retur=
n self._vm.queryBlockJobs()
File "/=
usr/share/vdsm/virt/vm.py", line 5759, in queryBlockJobs
liveI=
nfo =3D self._dom.blockJobInfo(drive.name, 0)
Attribute=
Error: 'NoneType' object has no attribute 'blockJobInfo'
May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad=
ata not found: Requested metadata element is not present
May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad=
ata not found: Requested metadata element is not present
May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad=
ata not found: Requested metadata element is not present
May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm vm.V=
m ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function faile=
d: <AdvancedStatsFunction _samp
Traceback=
(most recent call last):
File "/=
usr/share/vdsm/virt/sampling.py", line 484, in collect
stats=
Function()
File "/=
usr/share/vdsm/virt/sampling.py", line 359, in __call__
retVa=
lue =3D self._function(*args, **kwargs)
File "/=
usr/share/vdsm/virt/vm.py", line 338, in _sampleVcpuPinning
vCpuI=
nfos =3D self._vm._dom.vcpus()
Attribute=
Error: 'NoneType' object has no attribute 'vcpus'
May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm vm.V=
m ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function faile=
d: <AdvancedStatsFunction _samp
Traceback=
(most recent call last):
File "/=
usr/share/vdsm/virt/sampling.py", line 484, in collect
stats=
Function()
File "/=
usr/share/vdsm/virt/sampling.py", line 359, in __call__
retVa=
lue =3D self._function(*args, **kwargs)
File "/=
usr/share/vdsm/virt/vm.py", line 349, in _sampleCpuTune
infos=
=3D self._vm._dom.schedulerParameters()
Attribute=
Error: 'NoneType' object has no attribute =91schedulerParameters'
<=97 snip =97
--_000_D1895248CBF5soerenmalchowmconnet_
Content-Type: text/html; charset="Windows-1252"
Content-ID: <CF351B4FD1FD454793EFD6973604A49A(a)liquidcampaign.com Content-Transfer-Encoding: quoted-printable
<html <head <meta http-equiv=3D"Content-Type"
content=3D"text/html; charset=3DWindows-1=
252" </head <body style=3D"word-wrap: break-word;
-webkit-nbsp-mode: space; -webkit-lin=
e-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-fami=
ly: Calibri, sans-serif;" <div>Dear all,</div <div><br
</div <div>In version 3.5.2 on
CentOS 7.1 we now have the problem that the backup=
script seems to trigger a crash of Vms, this is the second time, the first=
time i could only solve the problem by rebooting the hypervisor host and a=
cknowleding =93host has been rebooted=94</div
<div><br </div <div>This problems happens while removing snapshots after
snapshot =96> =
clone -> export procedures.</div
<div><br </div <div>The actual qemu process is still running after
following log output, b=
ut the VM is not responsive anymore, i can kill the process problem.</div <div><br
</div <div>Two questions for
this:</div <div><br </div
<div>How can I avoid this problem ?</div
<div>Is there a way to tell ovirt that the qemu process is gone and that th=
e VM can be started again ? </div
<div><br </div <div><=97 snip =97> </div <div <div>May 25 22:03:47
mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
metadata not found: Requested metadata element is not present</div <div>May 25 22:03:47
mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
metadata not found: Requested metadata element is not present</div <div>May 25 22:03:48
mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
internal error: End of file from monitor</div
<div>May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: IDMZ_MC_=
PUBLIC: port 3(vnet3) entered disabled state</div
<div>May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: device v=
net3 left promiscuous mode</div <div>May 25 22:03:48
mc-dc3ham-compute-02-live.mc.mcon.net kernel: IDMZ_MC_=
PUBLIC: port 3(vnet3) entered disabled state</div
<div>May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kvm[22973]: 15 g=
uests now active</div <div>May 25 22:03:48
mc-dc3ham-compute-02-live.mc.mcon.net systemd-machined=
[14412]: Machine qemu-mc-glpi-app-01-live.mc.mcon.net terminated.</div <div>May 25 22:04:11
mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
Cannot start job (modify, none) for domain mc-glpi-app-01-live.mc.mcon.net;=
current job is (modify, none) own</div
<div>ed by (1534, 0)</div
<div>May 25 22:04:11 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
Timed out during operation: cannot acquire state change lock</div <div>May 25 22:04:18
mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
Cannot start job (modify, none) for domain mc-glpi-app-01-live.mc.mcon.net;=
current job is (modify, none) own</div
<div>ed by (1534, 0)</div
<div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
Timed out during operation: cannot acquire state change lock</div <div>May 25 22:04:18
mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
metadata not found: Requested metadata element is not present</div <div>May 25 22:04:18
mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm=
vm.Vm ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Error getting b=
lock job info</div <div>
=
 =
;
&nb=
sp; Traceback (most recent call last):</div
<div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/vm.py", line 5759,
i=
n queryBlockJobs</div <div>
=
 =
;
&nb=
sp; liveInfo =3D self._dom.blockJobInfo(drive.name, 0)=
</div <div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/vm.py", line 697,
in=
f</div <div>
=
 =
;
&nb=
sp; raise toe</div
<div>
=
 =
;
&nb=
sp; TimeoutError: Timed out during operation: cannot acquire state c=
hange lock</div </div <div><=97 snip =97></div <div><br
</div <div><br </div
<div><=97 snip =97></div
<div <div>May 25 22:04:18
mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm=
vm.Vm ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function =
failed: <AdvancedStatsFunction _samp</div
<div>
=
 =
;
&nb=
sp; Traceback (most recent call last):</div
<div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/sampling.py", line
4=
84, in collect</div <div>
=
 =
;
&nb=
sp; statsFunction()</div
<div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/sampling.py", line
3=
59, in __call__</div <div>
=
 =
;
&nb=
sp; retValue =3D self._function(*args,
**kwargs)</div <div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/vm.py", line 346,
in=
_sampleVmJobs</div <div>
=
 =
;
&nb=
sp; return self._vm.queryBlockJobs()</div <div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/vm.py", line 5759,
i=
n queryBlockJobs</div <div>
=
 =
;
&nb=
sp; liveInfo =3D self._dom.blockJobInfo(drive.name, 0)=
</div <div>
=
 =
;
&nb=
sp; AttributeError: 'NoneType' object has no attribute
'blockJobInfo=
'</div <div>May 25 22:04:18
mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
metadata not found: Requested metadata element is not present</div <div>May 25 22:04:18
mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
metadata not found: Requested metadata element is not present</div <div>May 25 22:04:18
mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: =
metadata not found: Requested metadata element is not present</div <div>May 25 22:04:18
mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm=
vm.Vm ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function =
failed: <AdvancedStatsFunction _samp</div
<div>
=
 =
;
&nb=
sp; Traceback (most recent call last):</div
<div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/sampling.py", line
4=
84, in collect</div <div>
=
 =
;
&nb=
sp; statsFunction()</div
<div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/sampling.py", line
3=
59, in __call__</div <div>
=
 =
;
&nb=
sp; retValue =3D self._function(*args,
**kwargs)</div <div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/vm.py", line 338,
in=
_sampleVcpuPinning</div <div>
=
 =
;
&nb=
sp; vCpuInfos =3D self._vm._dom.vcpus()</div <div>
=
 =
;
&nb=
sp; AttributeError: 'NoneType' object has no attribute
'vcpus'</div <div>May 25 22:04:18
mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm=
vm.Vm ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function =
failed: <AdvancedStatsFunction _samp</div
<div>
=
 =
;
&nb=
sp; Traceback (most recent call last):</div
<div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/sampling.py", line
4=
84, in collect</div <div>
=
 =
;
&nb=
sp; statsFunction()</div
<div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/sampling.py", line
3=
59, in __call__</div <div>
=
 =
;
&nb=
sp; retValue =3D self._function(*args,
**kwargs)</div <div>
=
 =
;
&nb=
sp; File "/usr/share/vdsm/virt/vm.py", line 349,
in=
_sampleCpuTune</div <div>
=
 =
;
&nb=
sp; infos =3D
self._vm._dom.schedulerParameters()</div=
<div>
=
 =
;
&nb=
sp; AttributeError: 'NoneType' object has no attribute =91schedulerP=
arameters'</div </div <div><br
</div <div><=97 snip
=97> </div </body </html
--_000_D1895248CBF5soerenmalchowmconnet_--