question mark in oVirt - "cannot acquire state change lock"

This is a multi-part message in MIME format. --------------000004040200040204070407 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hello all, how can I eliminate question mark from "hanged" VM? ( it happened in shutdown process via oVirt env. ) Best solution without hypervizor reboot, meaning "power off" , "kill" or another workaround for that VM . Will help removing task DB record from oVirt mgmt server - if exists , ofcourse ?? Running gluster 3.7.5 / oVirt 3.5.2 / libvirt-daemon-kvm-1.2.8-16.el7_1.5.x86_64 on centos 7.1.1503 . thx a lot. Pa. PS: I found similar problem in libvirt library a many years ago ( redhat 5.6 ) https://bugzilla.redhat.com/show_bug.cgi?id=676205 https://bugzilla.redhat.com/show_bug.cgi?id=668438 problem explanation: http://linux.india365.org/2012/01/libvirt-virsh-cannot-acquire-state-change-... So it means that this bug was not fixed to this time ?? regs. --------------000004040200040204070407 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body text="#000066" bgcolor="#FFFFFF"> <pre wrap="">Hello all, how can I eliminate question mark from "hanged" VM? ( it happened in shutdown process via oVirt env. ) Best solution without hypervizor reboot, meaning "power off" , "kill" or another workaround for that VM . Will help removing task DB record from oVirt mgmt server - if exists , ofcourse ?? Running gluster 3.7.5 / oVirt 3.5.2 / libvirt-daemon-kvm-1.2.8-16.el7_1.5.x86_64 on centos 7.1.1503 . thx a lot. Pa. PS: I found similar problem in libvirt library a many years ago ( redhat 5.6 ) <a class="moz-txt-link-freetext" href="https://bugzilla.redhat.com/show_bug.cgi?id=676205">https://bugzilla.redhat.com/show_bug.cgi?id=676205</a> <a class="moz-txt-link-freetext" href="https://bugzilla.redhat.com/show_bug.cgi?id=668438">https://bugzilla.redhat.com/show_bug.cgi?id=668438</a> problem explanation: <a class="moz-txt-link-freetext" href="http://linux.india365.org/2012/01/libvirt-virsh-cannot-acquire-state-change-lock-error-explained/">http://linux.india365.org/2012/01/libvirt-virsh-cannot-acquire-state-change-lock-error-explained/</a> So it means that this bug was not fixed to this time ?? regs. </pre> </body> </html> --------------000004040200040204070407--

On Tue, Feb 16, 2016 at 9:58 PM, paf1@email.cz <paf1@email.cz> wrote:
Hello all, how can I eliminate question mark from "hanged" VM? ( it happened in shutdown process via oVirt env. ) Best solution without hypervizor reboot, meaning "power off" , "kill" or another workaround for that VM . Will help removing task DB record from oVirt mgmt server - if exists , ofcourse ?? Running gluster 3.7.5 / oVirt 3.5.2 / libvirt-daemon-kvm-1.2.8-16.el7_1.5.x86_64 on centos 7.1.1503 .
thx a lot. Pa.
PS: I found similar problem in libvirt library a many years ago ( redhat 5.6 ) https://bugzilla.redhat.com/show_bug.cgi?id=676205 https://bugzilla.redhat.com/show_bug.cgi?id=668438 problem explanation: http://linux.india365.org/2012/01/libvirt-virsh-cannot-acquire-state-change-...
This is very interesting, I have seen this error in testing environment on rhel 7.1 or 7.2. Can you provide vdsm logs showing the time of the error? Nir

This is a multi-part message in MIME format. --------------070108050505080207080606 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hello, some requested outputs Vdsm generate a huge count of records in time, so I'm not shure if "hang" time is still included . Problems occured 17-feb-2016 17:00-18:00 when VM shutdown was requested. But some performance problems occured a day before ( I'm not shure about application problem = JAVA = running EBS ) In mail before I attached pointers to bugs with any workaround killall -9 libvirtd rm /var/run/libvirtd.pid /etc/init.d/libvirt-bin restart which would solve current situation. Is this workaround safe enought?? Will stay VMs running ??? THX for any help, because I can't reboot hypervizor due huge DB traffic and no VM migration possibility via oVirt engine. ( mem synchro overloaded ?? ) Pa. PS: logs sent directly to RH. On 17.2.2016 08:22, Nir Soffer wrote:
On Tue, Feb 16, 2016 at 9:58 PM, paf1@email.cz <paf1@email.cz> wrote:
Hello all, how can I eliminate question mark from "hanged" VM? ( it happened in shutdown process via oVirt env. ) Best solution without hypervizor reboot, meaning "power off" , "kill" or another workaround for that VM . Will help removing task DB record from oVirt mgmt server - if exists , ofcourse ?? Running gluster 3.7.5 / oVirt 3.5.2 / libvirt-daemon-kvm-1.2.8-16.el7_1.5.x86_64 on centos 7.1.1503 .
thx a lot. Pa.
PS: I found similar problem in libvirt library a many years ago ( redhat 5.6 ) https://bugzilla.redhat.com/show_bug.cgi?id=676205 https://bugzilla.redhat.com/show_bug.cgi?id=668438 problem explanation: http://linux.india365.org/2012/01/libvirt-virsh-cannot-acquire-state-change-... This is very interesting, I have seen this error in testing environment on rhel 7.1 or 7.2.
Can you provide vdsm logs showing the time of the error?
Nir
--------------070108050505080207080606 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body text="#000066" bgcolor="#FFFFFF"> Hello,<br> some requested outputs<br> <br> Vdsm generate a huge count of records in time, so I'm not shure if "hang" time is still included .<br> Problems occured 17-feb-2016 17:00-18:00 when VM shutdown was requested.<br> But some performance problems occured a day before ( I'm not shure about application problem = JAVA = running EBS )<br> <br> In mail before I attached pointers to bugs with any workaround<br> <pre class="bz_comment_text bz_wrap_comment_text">killall -9 libvirtd rm /var/run/libvirtd.pid /etc/init.d/libvirt-bin restart </pre> which would solve current situation.<br> Is this workaround safe enought?? Will stay VMs running ???<br> <br> THX for any help, because I can't reboot hypervizor due huge DB traffic and no VM migration possibility via oVirt engine. ( mem synchro overloaded ?? )<br> <br> Pa.<br> PS: logs sent directly to RH.<br> <br> <br> <div class="moz-cite-prefix">On 17.2.2016 08:22, Nir Soffer wrote:<br> </div> <blockquote cite="mid:CAMRbyyt32Z7qhYykZ6CEsjcfxHcdr6QLqN5XVK_UUsoWg58mpw@mail.gmail.com" type="cite"> <pre wrap="">On Tue, Feb 16, 2016 at 9:58 PM, <a class="moz-txt-link-abbreviated" href="mailto:paf1@email.cz">paf1@email.cz</a> <a class="moz-txt-link-rfc2396E" href="mailto:paf1@email.cz"><paf1@email.cz></a> wrote: </pre> <blockquote type="cite"> <pre wrap="">Hello all, how can I eliminate question mark from "hanged" VM? ( it happened in shutdown process via oVirt env. ) Best solution without hypervizor reboot, meaning "power off" , "kill" or another workaround for that VM . Will help removing task DB record from oVirt mgmt server - if exists , ofcourse ?? Running gluster 3.7.5 / oVirt 3.5.2 / libvirt-daemon-kvm-1.2.8-16.el7_1.5.x86_64 on centos 7.1.1503 . thx a lot. Pa. PS: I found similar problem in libvirt library a many years ago ( redhat 5.6 ) <a class="moz-txt-link-freetext" href="https://bugzilla.redhat.com/show_bug.cgi?id=676205">https://bugzilla.redhat.com/show_bug.cgi?id=676205</a> <a class="moz-txt-link-freetext" href="https://bugzilla.redhat.com/show_bug.cgi?id=668438">https://bugzilla.redhat.com/show_bug.cgi?id=668438</a> problem explanation: <a class="moz-txt-link-freetext" href="http://linux.india365.org/2012/01/libvirt-virsh-cannot-acquire-state-change-lock-error-explained/">http://linux.india365.org/2012/01/libvirt-virsh-cannot-acquire-state-change-lock-error-explained/</a> </pre> </blockquote> <pre wrap=""> This is very interesting, I have seen this error in testing environment on rhel 7.1 or 7.2. Can you provide vdsm logs showing the time of the error? Nir </pre> </blockquote> <br> </body> </html> --------------070108050505080207080606--
participants (2)
-
Nir Soffer
-
paf1@email.cz