<div dir="ltr">And here's the prepareVolumePath entry<div><br></div><div><p class=""><span style="font-family:'Courier New'">Thread-622::DEBUG::2013-12-31
05:06:02,576::task::974::TaskManager.Task::(_decref)
Task=`8ae0743d-8e3e-4516-9d67-7713fa546759`::ref 0 aborting False<br>
Thread-622::INFO::2013-12-31 05:06:02,576::clientIF::350::vds::(prepareVolumePath)
prepared volume path:
/rhev/data-center/mnt/_data_images_rhev/66e0b27c-dcbb-4b6e-9a58-8213e8380c65/images/7c063b30-634a-483b-82aa-7f19d2ae46cd/b0839e46-9f79-49b2-ae34-f7cafb626c75<br>
Thread-622::DEBUG::2013-12-31 05:06:02,589::utils::489::root::(execCmd)
'/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None)<br>
Thread-622::DEBUG::2013-12-31 05:06:02,642::utils::509::root::(execCmd)
SUCCESS: <err> = ''; <rc> = 0<br>
Thread-622::INFO::2013-12-31 05:06:02,642::hooks::88::root::(_runHooksDir)
<br>
Thread-622::DEBUG::2013-12-31 05:06:02,643::vm::2925::vm.Vm::(_run)
vmId=`147a1deb-3795-4153-a820-ceabd8db15f3`::<?xml version="1.0"... </span></p></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Jan 1, 2014 at 12:12 PM, Nauman Abbas <span dir="ltr"><<a href="mailto:nauman.abbas@seecs.edu.pk" target="_blank">nauman.abbas@seecs.edu.pk</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Found it. <div><a href="http://ur1.ca/gakse" style="color:rgb(0,102,204);text-decoration:none;font-family:'Liberation Sans','Lucida Grande','Luxi Sans','Bitstream Vera Sans',helvetica,verdana,arial,sans-serif" target="_blank">http://ur1.ca/gakse</a><br>
</div><div><br></div><div>Also here's the versions</div><div><div>vdsm 4.13</div><div>sanlock 2.8</div><div>libvirt 1.1.3.1</div><div>qemu 1.6.1</div><div><br></div><div><br></div></div></div><div class="HOEnZb"><div class="h5">
<div class="gmail_extra">
<br><br><div class="gmail_quote">On Wed, Jan 1, 2014 at 11:56 AM, Gadi Ickowicz <span dir="ltr"><<a href="mailto:gickowic@redhat.com" target="_blank">gickowic@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
the lines you added that are right before the Fpaste link are the actual lines messages from libvirt that the vm dies. This message from libvirt is then shown later as the ERROR in vdsm in the Fpaste link.<br>
<br>
The log should contain, very close to the lines you paste, but a bit before, an xml. it should look something like what I am pasting below. Also, the line right before the xml should contain a prepareVolumePath entry:<br>
Thread-50::DEBUG::2013-12-25 14:30:45,282::vm::3031::vm.Vm::(_run) vmId=`fdfaec39-b981-4bd7-9852-6d5ac6ce2b37`::<?xml version="1.0" encoding="utf-8"?><br>
...<the xml continues a bit with all the vm properties><br>
<br>
also - what versions of vdsm, libvirt, sanlock and qemu are you using?<br>
<div><br>
Gadi Ickowicz<br>
<br>
----- Original Message -----<br>
From: "Nauman Abbas" <<a href="mailto:nauman.abbas@seecs.edu.pk" target="_blank">nauman.abbas@seecs.edu.pk</a>><br>
</div><div><div>To: "Gadi Ickowicz" <<a href="mailto:gickowic@redhat.com" target="_blank">gickowic@redhat.com</a>><br>
Cc: "<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>" <<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a>><br>
Sent: Wednesday, January 1, 2014 7:30:24 AM<br>
Subject: Re: [Users] VM not starting up<br>
<br>
Also I believe these lines right before what I pasted with Fpaste link<br>
would be relevant.<br>
<br>
Thread-622::DEBUG::2013-12-31<br>
05:06:02,957::libvirtconnection::108::libvirtconnection::(wrapper) Unknown<br>
libvirterror: ecode: 38 edom: 0 level: 2 message: Child quit during startup<br>
handshake: Input/output error<br>
Thread-622::DEBUG::2013-12-31<br>
05:06:02,957::vm::2106::vm.Vm::(_startUnderlyingVm)<br>
vmId=`147a1deb-3795-4153-a820-ceabd8db15f3`::_ongoingCreations released<br>
<br>
<br>
On Wed, Jan 1, 2014 at 10:23 AM, Nauman Abbas <<a href="mailto:nauman.abbas@seecs.edu.pk" target="_blank">nauman.abbas@seecs.edu.pk</a>>wrote:<br>
<br>
> I'm going through the log (which is quite big) and I've found out this<br>
> part which is like 2 seconds after the vmcreate part. Have a look maybe<br>
> this is what you're looking for. It contains the ERROR and Traceback in it.<br>
><br>
><br>
> <a href="http://ur1.ca/gakhc" target="_blank">http://ur1.ca/gakhc</a><br>
><br>
><br>
> On Tue, Dec 31, 2013 at 4:36 PM, Gadi Ickowicz <<a href="mailto:gickowic@redhat.com" target="_blank">gickowic@redhat.com</a>>wrote:<br>
><br>
>> It would be helpful to get a bit more information from the logs - after<br>
>> the vmCreate there are several other things that occur before the vm<br>
>> process is actually launched (prepareImage and following that the actual<br>
>> vm's should be visible in the log). Try to search for an error in the vdsm<br>
>> log, and if you cannot find one attach logs containing the vmCreate and the<br>
>> other operations I mentioned.<br>
>><br>
>> Errors in the vdsm log are usually logged in lines containing ERROR, but<br>
>> sometimes if the error comes from libvirt it may not contain the uppercase<br>
>> ERROR and be logged as libvirtError or something similar.<br>
>><br>
>> you should also have the qemu log for the vm you are trying to run.<br>
>> usually under /var/log/libvirt/qemu/<name_of_the_vm>.log - maybe that will<br>
>> give more information regarding the failure<br>
>><br>
>> Gadi Ickowicz<br>
>><br>
>> ----- Original Message -----<br>
>> From: "Joop" <<a href="mailto:jvdwege@xs4all.nl" target="_blank">jvdwege@xs4all.nl</a>><br>
>> To: "Nauman Abbas" <<a href="mailto:nauman.abbas@seecs.edu.pk" target="_blank">nauman.abbas@seecs.edu.pk</a>><br>
>> Cc: "<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>" <<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a>><br>
>> Sent: Tuesday, December 31, 2013 12:51:10 PM<br>
>> Subject: Re: [Users] VM not starting up<br>
>><br>
>> Nauman Abbas <<a href="mailto:nauman.abbas@seecs.edu.pk" target="_blank">nauman.abbas@seecs.edu.pk</a>> wrote:<br>
>><br>
>><br>
>> I've attached the portions with vmcreate. I found 5 instances of pairs of<br>
>> call vmcreate and return vmcreate. I've separated them with lines. See if<br>
>> that helps.<br>
>><br>
>><br>
>> On Tue, Dec 31, 2013 at 2:58 PM, Gadi Ickowicz < <a href="mailto:gickowic@redhat.com" target="_blank">gickowic@redhat.com</a> ><br>
>> wrote:<br>
>><br>
>><br>
>> Hi,<br>
>><br>
>> Maybe you can send just the relevant part of the vdsm logs that contain<br>
>> the attempt to launch the vm itself - it should start with vmCreate. Try to<br>
>> find "::call vmCreate with (..." and either find the matching "return<br>
>> vmCreate with"<br>
>> or an maybe there is an ERROR or Traceback in the vdsm log following the<br>
>> vmCreate call.<br>
>><br>
>> Gadi Ickowicz<br>
>><br>
>> ----- Original Message -----<br>
>> From: "Nauman Abbas" < <a href="mailto:nauman.abbas@seecs.edu.pk" target="_blank">nauman.abbas@seecs.edu.pk</a> ><br>
>> To: "Meital Bourvine" < <a href="mailto:mbourvin@redhat.com" target="_blank">mbourvin@redhat.com</a> ><br>
>> Cc: " <a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a> " < <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a> ><br>
>> Sent: Tuesday, December 31, 2013 11:47:12 AM<br>
>> Subject: Re: [Users] VM not starting up<br>
>><br>
>> Vdsm is running fine. Also checked the clocks. You were right, the Engine<br>
>> clock was 5 hours ahead of Node clock. I've corrected that but still the<br>
>> same issue.<br>
>><br>
>><br>
>> On Tue, Dec 31, 2013 at 12:44 PM, Meital Bourvine < <a href="mailto:mbourvin@redhat.com" target="_blank">mbourvin@redhat.com</a>> wrote:<br>
>><br>
>><br>
>><br>
>> Are you sure that vdsm is running?<br>
>><br>
>> The error happened at 2013-12-31 11:32:56,999 (engine.log)<br>
>> but the last line in vdsm.log is from 2013-12-31 07:20:50,807<br>
>><br>
>> Also make sure that your clocked are synced.<br>
>><br>
>><br>
>><br>
>><br>
>><br>
>><br>
>> From: "Nauman Abbas" < <a href="mailto:nauman.abbas@seecs.edu.pk" target="_blank">nauman.abbas@seecs.edu.pk</a> ><br>
>> To: "Meital Bourvine" < <a href="mailto:mbourvin@redhat.com" target="_blank">mbourvin@redhat.com</a> ><br>
>> Cc: " <a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a> " < <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a> ><br>
>> Sent: Tuesday, December 31, 2013 9:39:09 AM<br>
>><br>
>> Subject: Re: [Users] VM not starting up<br>
>><br>
>> Sending files one by one. Vdsm.log<br>
>><br>
>><br>
>> On Tue, Dec 31, 2013 at 11:48 AM, Meital Bourvine < <a href="mailto:mbourvin@redhat.com" target="_blank">mbourvin@redhat.com</a>> wrote:<br>
>><br>
>><br>
>><br>
>> Engine log can be found on the engine (while vdsm.log is on the host).<br>
>> The full path is - /var/log/ovirt-engine/engine.log<br>
>><br>
>> audit.log - /var/log/audit/audit.log<br>
>><br>
>> About the vdsm log - I don't see any error there, I think that you cut<br>
>> too much from it.<br>
>><br>
>><br>
>><br>
>><br>
>> From: "Nauman Abbas" < <a href="mailto:nauman.abbas@seecs.edu.pk" target="_blank">nauman.abbas@seecs.edu.pk</a> ><br>
>> To: "Meital Bourvine" < <a href="mailto:mbourvin@redhat.com" target="_blank">mbourvin@redhat.com</a> ><br>
>> Cc: " <a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a> " < <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a> ><br>
>> Sent: Tuesday, December 31, 2013 8:42:43 AM<br>
>> Subject: Re: [Users] VM not starting up<br>
>><br>
>><br>
>> Hello Meital<br>
>><br>
>> SELinux is off. The cluster doesn't work if SELinux is on, my hosts and<br>
>> storage is showing up as okay but VM is not starting up.<br>
>><br>
>> I've managed to get vdsm.log but cannot find engine.log and audit.log.<br>
>> Sorry for being a noob, if you can tell me the path to these files I'll<br>
>> send them right away.<br>
>><br>
>><br>
>> On Tue, Dec 31, 2013 at 11:17 AM, Meital Bourvine < <a href="mailto:mbourvin@redhat.com" target="_blank">mbourvin@redhat.com</a>> wrote:<br>
>><br>
>><br>
>><br>
>> Hi Nauman,<br>
>><br>
>> Maybe it's a selinux issue?<br>
>> Please try running `setenforce 0` before starting the vm.<br>
>><br>
>> Also please attach engine.log, vdsm.log, and audit.log<br>
>><br>
>><br>
>><br>
>><br>
>> From: "Nauman Abbas" < <a href="mailto:nauman.abbas@seecs.edu.pk" target="_blank">nauman.abbas@seecs.edu.pk</a> ><br>
>> To: " <a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a> " < <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a> ><br>
>> Sent: Tuesday, December 31, 2013 7:13:01 AM<br>
>> Subject: [Users] VM not starting up<br>
>><br>
>><br>
>> Hello all,<br>
>><br>
>> First of all thank you for your help, I've finally managed to get my<br>
>> Cluster configured properly but now that I create VMs I'm facing another<br>
>> problem. Whenever I start my VM I get this error.<br>
>><br>
>> " VM TestVm is down. Exit message: Child quit during startup handshake:<br>
>> Input/output error."<br>
>><br>
>> I've googled around but haven't found any satisfactory solution. If<br>
>> anyone can help out it would be great.<br>
>><br>
>> Regards<br>
>><br>
>> Nauman Abbas<br>
>> Assistant System Administrator (LMS),<br>
>> Room No. A-207, SEECS,<br>
>> National University of Sciences & Technology,<br>
>> <a href="tel:%2B%2092%20321%205359946" value="+923215359946" target="_blank">+ 92 321 5359946</a><br>
>><br>
>> _______________________________________________<br>
>> Users mailing list<br>
>> <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
>> <a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
>><br>
>><br>
>><br>
>><br>
>> --<br>
>><br>
>> Nauman Abbas<br>
>> Assistant System Administrator (LMS),<br>
>> Room No. A-207, SEECS,<br>
>> National University of Sciences & Technology,<br>
>> <a href="tel:%2B%2092%20321%205359946" value="+923215359946" target="_blank">+ 92 321 5359946</a><br>
>><br>
>><br>
>><br>
>><br>
>> --<br>
>><br>
>> Nauman Abbas<br>
>> Assistant System Administrator (LMS),<br>
>> Room No. A-207, SEECS,<br>
>> National University of Sciences & Technology,<br>
>> <a href="tel:%2B%2092%20321%205359946" value="+923215359946" target="_blank">+ 92 321 5359946</a><br>
>><br>
>><br>
>><br>
>><br>
>> --<br>
>><br>
>> Nauman Abbas<br>
>> Assistant System Administrator (LMS),<br>
>> Room No. A-207, SEECS,<br>
>> National University of Sciences & Technology,<br>
>> <a href="tel:%2B%2092%20321%205359946" value="+923215359946" target="_blank">+ 92 321 5359946</a><br>
>><br>
>> _______________________________________________<br>
>> Users mailing list<br>
>> <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
>> <a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
>><br>
>><br>
>><br>
>> --<br>
>><br>
>> Nauman Abbas<br>
>> Assistant System Administrator (LMS),<br>
>> Room No. A-207, SEECS,<br>
>> National University of Sciences & Technology,<br>
>> <a href="tel:%2B%2092%20321%205359946" value="+923215359946" target="_blank">+ 92 321 5359946</a><br>
>><br>
>> Paste your logs to <a href="http://fpaste.org" target="_blank">fpaste.org</a> or similar and put the url in the mail.<br>
>> Your snippets don‘t contain any errors that i can see.<br>
>><br>
>> --<br>
>> Sent from my Android tablet with K-9 Mail. Please excuse my brevity.<br>
>><br>
>> _______________________________________________<br>
>> Users mailing list<br>
>> <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
>> <a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
>><br>
><br>
><br>
><br>
> --<br>
><br>
> Nauman Abbas<br>
> Assistant System Administrator (LMS),<br>
> Room No. A-207, SEECS,<br>
> National University of Sciences & Technology,<br>
> <a href="tel:%2B%2092%20321%205359946" value="+923215359946" target="_blank">+ 92 321 5359946</a><br>
><br>
<br>
<br>
<br>
--<br>
<br>
Nauman Abbas<br>
Assistant System Administrator (LMS),<br>
Room No. A-207, SEECS,<br>
National University of Sciences & Technology,<br>
<a href="tel:%2B%2092%20321%205359946" value="+923215359946" target="_blank">+ 92 321 5359946</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr"><div><br></div><font color="#3d85c6">Nauman Abbas<br></font><div><div><font color="#3d85c6"><font>Assistant System Administrator</font><span style="font-size:small"> (LMS),</span></font></div>
<div><font color="#3d85c6">Room No. A-207, SEECS,</font></div><div><font color="#3d85c6">National University of Sciences & Technology,</font></div><div><a value="+923455146301"><font color="#3d85c6">+ 92 321 5359946</font></a></div>
</div></div>
</div>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr"><div><br></div><font color="#3d85c6">Nauman Abbas<br></font><div><div><font color="#3d85c6"><font>Assistant System Administrator</font><span style="font-size:small"> (LMS),</span></font></div>
<div><font color="#3d85c6">Room No. A-207, SEECS,</font></div><div><font color="#3d85c6">National University of Sciences & Technology,</font></div><div><a value="+923455146301"><font color="#3d85c6">+ 92 321 5359946</font></a></div>
</div></div>
</div>