--_000_D1895248CBF5soerenmalchowmconnet_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Dear all, In version 3.5.2 on CentOS 7.1 we now have the problem that the backup scri= pt seems to trigger a crash of Vms, this is the second time, the first time= i could only solve the problem by rebooting the hypervisor host and acknow= leding =93host has been rebooted=94 This problems happens while removing snapshots after snapshot =96> clone ->= export procedures. The actual qemu process is still running after following log output, but th= e VM is not responsive anymore, i can kill the process problem. Two questions for this: How can I avoid this problem ? Is there a way to tell ovirt that the qemu process is gone and that the VM = can be started again ? <=97 snip =97> May 25 22:03:47 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad= ata not found: Requested metadata element is not present May 25 22:03:47 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad= ata not found: Requested metadata element is not present May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: inter= nal error: End of file from monitor May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: IDMZ_MC_PUBLI= C: port 3(vnet3) entered disabled state May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: device vnet3 = left promiscuous mode May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: IDMZ_MC_PUBLI= C: port 3(vnet3) entered disabled state May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kvm[22973]: 15 guests= now active May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net systemd-machined[1441= 2]: Machine qemu-mc-glpi-app-01-live.mc.mcon.net terminated. May 25 22:04:11 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: Canno= t start job (modify, none) for domain mc-glpi-app-01-live.mc.mcon.net; curr= ent job is (modify, none) own ed by (1534, 0) May 25 22:04:11 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: Timed= out during operation: cannot acquire state change lock May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: Canno= t start job (modify, none) for domain mc-glpi-app-01-live.mc.mcon.net; curr= ent job is (modify, none) own ed by (1534, 0) May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: Timed= out during operation: cannot acquire state change lock May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad= ata not found: Requested metadata element is not present May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm vm.V= m ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Error getting block = job info Traceback= (most recent call last): File "/= usr/share/vdsm/virt/vm.py", line 5759, in queryBlockJobs liveI= nfo =3D self._dom.blockJobInfo(drive.name, 0) File "/= usr/share/vdsm/virt/vm.py", line 697, in f raise= toe TimeoutEr= ror: Timed out during operation: cannot acquire state change lock <=97 snip =97> <=97 snip =97> May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm vm.V= m ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function faile= d: <AdvancedStatsFunction _samp Traceback= (most recent call last): File "/= usr/share/vdsm/virt/sampling.py", line 484, in collect stats= Function() File "/= usr/share/vdsm/virt/sampling.py", line 359, in __call__ retVa= lue =3D self._function(*args, **kwargs) File "/= usr/share/vdsm/virt/vm.py", line 346, in _sampleVmJobs retur= n self._vm.queryBlockJobs() File "/= usr/share/vdsm/virt/vm.py", line 5759, in queryBlockJobs liveI= nfo =3D self._dom.blockJobInfo(drive.name, 0) Attribute= Error: 'NoneType' object has no attribute 'blockJobInfo' May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad= ata not found: Requested metadata element is not present May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad= ata not found: Requested metadata element is not present May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: metad= ata not found: Requested metadata element is not present May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm vm.V= m ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function faile= d: <AdvancedStatsFunction _samp Traceback= (most recent call last): File "/= usr/share/vdsm/virt/sampling.py", line 484, in collect stats= Function() File "/= usr/share/vdsm/virt/sampling.py", line 359, in __call__ retVa= lue =3D self._function(*args, **kwargs) File "/= usr/share/vdsm/virt/vm.py", line 338, in _sampleVcpuPinning vCpuI= nfos =3D self._vm._dom.vcpus() Attribute= Error: 'NoneType' object has no attribute 'vcpus' May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm vm.V= m ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function faile= d: <AdvancedStatsFunction _samp Traceback= (most recent call last): File "/= usr/share/vdsm/virt/sampling.py", line 484, in collect stats= Function() File "/= usr/share/vdsm/virt/sampling.py", line 359, in __call__ retVa= lue =3D self._function(*args, **kwargs) File "/= usr/share/vdsm/virt/vm.py", line 349, in _sampleCpuTune infos= =3D self._vm._dom.schedulerParameters() Attribute= Error: 'NoneType' object has no attribute =91schedulerParameters' <=97 snip =97> --_000_D1895248CBF5soerenmalchowmconnet_ Content-Type: text/html; charset="Windows-1252" Content-ID: <CF351B4FD1FD454793EFD6973604A49A@liquidcampaign.com> Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DWindows-1= 252"> </head> <body style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-lin= e-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-fami= ly: Calibri, sans-serif;"> <div>Dear all,</div> <div><br> </div> <div>In version 3.5.2 on CentOS 7.1 we now have the problem that the backup= script seems to trigger a crash of Vms, this is the second time, the first= time i could only solve the problem by rebooting the hypervisor host and a= cknowleding =93host has been rebooted=94</div> <div><br> </div> <div>This problems happens while removing snapshots after snapshot =96> = clone -> export procedures.</div> <div><br> </div> <div>The actual qemu process is still running after following log output, b= ut the VM is not responsive anymore, i can kill the process problem.</div> <div><br> </div> <div>Two questions for this:</div> <div><br> </div> <div>How can I avoid this problem ?</div> <div>Is there a way to tell ovirt that the qemu process is gone and that th= e VM can be started again ? </div> <div><br> </div> <div><=97 snip =97> </div> <div> <div>May 25 22:03:47 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = metadata not found: Requested metadata element is not present</div> <div>May 25 22:03:47 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = metadata not found: Requested metadata element is not present</div> <div>May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = internal error: End of file from monitor</div> <div>May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: IDMZ_MC_= PUBLIC: port 3(vnet3) entered disabled state</div> <div>May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: device v= net3 left promiscuous mode</div> <div>May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kernel: IDMZ_MC_= PUBLIC: port 3(vnet3) entered disabled state</div> <div>May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net kvm[22973]: 15 g= uests now active</div> <div>May 25 22:03:48 mc-dc3ham-compute-02-live.mc.mcon.net systemd-machined= [14412]: Machine qemu-mc-glpi-app-01-live.mc.mcon.net terminated.</div> <div>May 25 22:04:11 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = Cannot start job (modify, none) for domain mc-glpi-app-01-live.mc.mcon.net;= current job is (modify, none) own</div> <div>ed by (1534, 0)</div> <div>May 25 22:04:11 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = Timed out during operation: cannot acquire state change lock</div> <div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = Cannot start job (modify, none) for domain mc-glpi-app-01-live.mc.mcon.net;= current job is (modify, none) own</div> <div>ed by (1534, 0)</div> <div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = Timed out during operation: cannot acquire state change lock</div> <div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = metadata not found: Requested metadata element is not present</div> <div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm= vm.Vm ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Error getting b= lock job info</div> <div> = = ; &nb= sp; Traceback (most recent call last):</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/vm.py", line 5759, i= n queryBlockJobs</div> <div> = = ; &nb= sp; liveInfo =3D self._dom.blockJobInfo(drive.name, 0)= </div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/vm.py", line 697, in= f</div> <div> = = ; &nb= sp; raise toe</div> <div> = = ; &nb= sp; TimeoutError: Timed out during operation: cannot acquire state c= hange lock</div> </div> <div><=97 snip =97></div> <div><br> </div> <div><br> </div> <div><=97 snip =97></div> <div> <div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm= vm.Vm ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function = failed: <AdvancedStatsFunction _samp</div> <div> = = ; &nb= sp; Traceback (most recent call last):</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/sampling.py", line 4= 84, in collect</div> <div> = = ; &nb= sp; statsFunction()</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/sampling.py", line 3= 59, in __call__</div> <div> = = ; &nb= sp; retValue =3D self._function(*args, **kwargs)</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/vm.py", line 346, in= _sampleVmJobs</div> <div> = = ; &nb= sp; return self._vm.queryBlockJobs()</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/vm.py", line 5759, i= n queryBlockJobs</div> <div> = = ; &nb= sp; liveInfo =3D self._dom.blockJobInfo(drive.name, 0)= </div> <div> = = ; &nb= sp; AttributeError: 'NoneType' object has no attribute 'blockJobInfo= '</div> <div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = metadata not found: Requested metadata element is not present</div> <div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = metadata not found: Requested metadata element is not present</div> <div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net libvirtd[1386]: = metadata not found: Requested metadata element is not present</div> <div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm= vm.Vm ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function = failed: <AdvancedStatsFunction _samp</div> <div> = = ; &nb= sp; Traceback (most recent call last):</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/sampling.py", line 4= 84, in collect</div> <div> = = ; &nb= sp; statsFunction()</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/sampling.py", line 3= 59, in __call__</div> <div> = = ; &nb= sp; retValue =3D self._function(*args, **kwargs)</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/vm.py", line 338, in= _sampleVcpuPinning</div> <div> = = ; &nb= sp; vCpuInfos =3D self._vm._dom.vcpus()</div> <div> = = ; &nb= sp; AttributeError: 'NoneType' object has no attribute 'vcpus'</div> <div>May 25 22:04:18 mc-dc3ham-compute-02-live.mc.mcon.net vdsm[3230]: vdsm= vm.Vm ERROR vmId=3D`598bdf61-2f2c-4569-9513-93043890f676`::Stats function = failed: <AdvancedStatsFunction _samp</div> <div> = = ; &nb= sp; Traceback (most recent call last):</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/sampling.py", line 4= 84, in collect</div> <div> = = ; &nb= sp; statsFunction()</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/sampling.py", line 3= 59, in __call__</div> <div> = = ; &nb= sp; retValue =3D self._function(*args, **kwargs)</div> <div> = = ; &nb= sp; File "/usr/share/vdsm/virt/vm.py", line 349, in= _sampleCpuTune</div> <div> = = ; &nb= sp; infos =3D self._vm._dom.schedulerParameters()</div=
<div> = = ; &nb= sp; AttributeError: 'NoneType' object has no attribute =91schedulerP= arameters'</div> </div> <div><br> </div> <div><=97 snip =97> </div> </body> </html> --_000_D1895248CBF5soerenmalchowmconnet_--