It seems that your guest file system is corrupted. The dd approach won't help cause this is a virtual disk, you need to fix the virtual disk inside the lv, that's why any operations= on the lv won't help. You can try shutting down the vm (not paused, but literally down) and add=
This is a multi-part message in MIME format. --------------000007070806030102080207 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Thanks for your reply Yeela. I appreciate your feedback. Please see my feedback to the list earlier..... weird that I was able to=20 repair the disk using another physical system.Butwhen attached to the=20 guestoVirt kept pausing the guest which prevented fsck from completing. Get important Linux and industry-related news at: facebook.com/dcdata=20 <http://facebook.com/dcdata> Kind regards, David Wilson CNS,CLS, LINUX+, CLA, DCTS, LPIC3 *LinuxTech CC t/a DcData* CK number: 2001/058368/23 *Website:* =09http://www.dcdata.co.za *Support:* =09+27(0)860-1-LINUX *Mobile:* =09+27(0)824147413 *Tel:* =09+27(0)333446100 *Fax:* =09+27(0)866878971 On 12/03/2012 10:36 AM, Yeela Kaplan wrote: the guest vm disk as
a second disk to another vm. In the second vm try to run fsck on the disk and see if it helps. In any case before trying to manipulate the disk image please save a back= up!!! let me know how it goes...
----- Original Message -----
From: "David Wilson" <dave@dcdata.co.za> To: users@ovirt.org Sent: Sunday, December 2, 2012 11:17:43 AM Subject: [Users] VM has paused due to unknown storage error
H i everyone,
Sunday fun : )
One of our cr itical Linux VMs ran out of disk space. I cleared up space by removing old application logs within the guest, rebooted the g uest and was presented with the following information message during bootup when the filesystem ext3/ 4 scan runs: Clearing orhpaned inode ..... Shortly after this message the the guest is p aused by oVirt and the "VM has paused due to unknown storage error" message is displayed in the oVirt web GUI.
On the physical node itself, I fo und t he following error in /var/log/vdsm/vd sm.log: libvirtEventLoop:: INFO::2012-12-02 09:05:50,296::libvirtvm::1965::vm.Vm::(_onAbnormalStop) vmId=3D`23b9212c-1e25-4003-aa18-b1e819bf6bb1`::abnormal vm stop device ide0-0-1 error eother
Any ideas on how to get more inf ormation on what exactly the error is?
I've tried booting the guest into r es cue mode , run a manual fsck on the logical v olume but each time the guest is automaticall paused due to the "unknown storage error".
We are using a FC SAN for s torage , s o what I've decided to try is expo rt the disk using "dd" on the physical node and t hen try repairing it by mounting it as a loop filesystem on a nother physical ser ver , and then use "dd" to import it back in again.
Is this the right approach to take to get the system back online?
--
Get important Linux and industry-related news at: facebook.com/dcdata
Kind regards,
David Wilson CNS,CLS, LINUX+, CLA, DCTS, LPIC3 LinuxTech CC t/a DcData CK number: 2001/058368/23
=09Website: =09http://www.dcdata.co.za =09Support: =09+27(0)860-1-LINUX =09Mobile: =09+27(0)824147413 =09Tel: =09+27(0)333446100 =09Fax: =09+27(0)866878971
Time to evaluate your email security provider? Watch the video and take advantage of Mimecast=E2=80=99s first ever limited promotion. _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------000007070806030102080207 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
<html> <head> <meta content=3D"text/html; charset=3DUTF-8" http-equiv=3D"Content-Type= "> </head> <body bgcolor=3D"#FFFFFF" text=3D"#000000"> <div class=3D"moz-cite-prefix"><font size=3D"-1">Thanks for your reply Yeela. I appreciate your feedback.<br> <br> <font size=3D"-1">Please see my <font size=3D"-1">feedback to the list earlier..... weird that I was a<font size=3D"-1">ble to repair the disk using another physical system<font size=3D"-1"><font size=3D"-1">.<font size=3D"-1"> Bu<font size=3D"-1">t<font size=3D"-1"> when attached to the guest</font></font></font></font><font size=3D"-1"> oVirt kept pausing the guest which prevented fsck from completing<font size=3D"-1">.<br> <font size=3D"-1"><font size=3D"-1"></font></font><br> <br> </font></font></font></font></font></font><br> </font> <div class=3D"moz-signature"> <br> <br> Get important Linux and industry-related news at: <a href=3D"http://facebook.com/dcdata">facebook.com/dcdata</a><br> <br> <font color=3D"#000000"><font face=3D"arial" size=3D"2">Kind regard= s,</font><br> <br> =C2=A0<font color=3D"#000000"><font face=3D"arial"><font size=3D"= 4">David Wilson</font></font></font><br> =C2=A0<font color=3D"#000000"><font face=3D"arial"><font size=3D"= 1">CNS,CLS, LINUX+, CLA, DCTS, LPIC3</font></font></font><br> =C2=A0<font color=3D"#0779b5"><font face=3D"arial"><font size=3D"= 3"><b>LinuxTech CC t/a DcData</b></font></font></font><br> =C2=A0<font color=3D"#0779b5"><font face=3D"arial"><font size=3D"= 1">CK number: 2001/058368/23</font></font></font><br> <table border=3D"0"> <tbody> <tr> <td width=3D"75"><font color=3D"#000000"><font face=3D"aria= l"><font size=3D"2"><b>Website:</b></font></font></font></td=
<td><font color=3D"#000000"><font face=3D"arial"><font size=3D"2"><a class=3D"moz-txt-link-freetext" href= =3D"http://www.dcdata.co.za">http://www.dcdata.co.za</a></font></font></fon= t></td> </tr> <tr> <td><font color=3D"#000000"><font face=3D"arial"><font size=3D"2"><b>Support:</b></font></font></font></td=
<td><font color=3D"#000000"><font face=3D"arial"><font size=3D"2">+27(0)860-1-LINUX</font></font></font></= td> </tr> <tr> <td><font color=3D"#000000"><font face=3D"arial"><font size=3D"2"><b>Mobile:</b></font></font></font></td> <td><font color=3D"#000000"><font face=3D"arial"><font size=3D"2">+27(0)824147413</font></font></font></td=
</tr> <tr> <td><font color=3D"#000000"><font face=3D"arial"><font size=3D"2"><b>Tel:</b></font></font></font></td> <td><font color=3D"#000000"><font face=3D"arial"><font size=3D"2">+27(0)333446100</font></font></font></td=
</tr> <tr> <td><font color=3D"#000000"><font face=3D"arial"><font size=3D"2"><b>Fax:</b></font></font></font></td> <td><font color=3D"#000000"><font face=3D"arial"><font size=3D"2">+27(0)866878971</font></font></font></td=
</tr> </tbody> </table> </font></div> On 12/03/2012 10:36 AM, Yeela Kaplan wrote:<br> </div> <blockquote cite=3D"mid:636934950.27906854.1354523800172.JavaMail.root@redhat.com= " type=3D"cite"> <pre wrap=3D"">It seems that your guest file system is corrupted. The dd approach won't help cause this is a virtual disk, you need to fix the virtual disk inside the lv, that's why any operations o= n the lv won't help.=20 You can try shutting down the vm (not paused, but literally down) and add t= he guest vm disk as a second disk to another vm. In the second vm try to run fsck on the disk and see if it helps. In any case before trying to manipulate the disk image please save a backup= !!! let me know how it goes... ----- Original Message ----- </pre> <blockquote type=3D"cite"> <pre wrap=3D"">From: "David Wilson" <a class=3D"moz-txt-link-rfc239= 6E" href=3D"mailto:dave@dcdata.co.za"><dave@dcdata.co.za></a> To: <a class=3D"moz-txt-link-abbreviated" href=3D"mailto:users@ovirt.org">u= sers@ovirt.org</a> Sent: Sunday, December 2, 2012 11:17:43 AM Subject: [Users] VM has paused due to unknown storage error H i everyone, Sunday fun : ) One of our cr itical Linux VMs ran out of disk space. I cleared up space by removing old application logs within the guest, rebooted the g uest and was presented with the following information message during bootup when the filesystem ext3/ 4 scan runs: Clearing orhpaned inode ..... Shortly after this message the the guest is p aused by oVirt and the "VM has paused due to unknown storage error" message is displayed in the oVirt web GUI. On the physical node itself, I fo und t he following error in /var/log/vdsm/vd sm.log: libvirtEventLoop:: <a class=3D"moz-txt-link-freetext" href=3D"INFO::2012-12= -02">INFO::2012-12-02</a> 09:05:50,296::libvirtvm::1965::vm.Vm::(_onAbnormalStop) vmId=3D`23b9212c-1e25-4003-aa18-b1e819bf6bb1`::abnormal vm stop device ide0-0-1 error eother Any ideas on how to get more inf ormation on what exactly the error is? I've tried booting the guest into r es cue mode , run a manual fsck on the logical v olume but each time the guest is automaticall paused due to the "unknown storage error". We are using a FC SAN for s torage , s o what I've decided to try is expo rt the disk using "dd" on the physical node and t hen try repairing it by mounting it as a loop filesystem on a nother physical ser ver , and then use "dd" to import it back in again. Is this the right approach to take to get the system back online? -- Get important Linux and industry-related news at: facebook.com/dcdata Kind regards, David Wilson CNS,CLS, LINUX+, CLA, DCTS, LPIC3 LinuxTech CC t/a DcData CK number: 2001/058368/23 =09Website: =09<a class=3D"moz-txt-link-freetext" href=3D"http://www.dcdata= .co.za">http://www.dcdata.co.za</a> =09Support: =09+27(0)860-1-LINUX =09Mobile: =09+27(0)824147413 =09Tel: =09+27(0)333446100 =09Fax: =09+27(0)866878971 Time to evaluate your email security provider? Watch the video and take advantage of Mimecast=E2=80=99s first ever limited promotion. _______________________________________________ Users mailing list <a class=3D"moz-txt-link-abbreviated" href=3D"mailto:Users@ovirt.org">Users= @ovirt.org</a> <a class=3D"moz-txt-link-freetext" href=3D"http://lists.ovirt.org/mailman/l= istinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <pre wrap=3D""> </pre> </blockquote> <br> =20 <br><br> <p style=3D"font-family: Verdana; font-size:8pt; color:#666666;" align=3D"j= ustify"> Time to evaluate your email security provider? <a href=3D"http://www.mimeca= st.com/emailsecurity/">Watch the video</a> and take advantage of Mimecast= =E2=80=99s first ever limited promotion. </p> </body> </html> --------------000007070806030102080207--