And here's the prepareVolumePath entry
Thread-622::DEBUG::2013-12-31
05:06:02,576::task::974::TaskManager.Task::(_decref)
Task=`8ae0743d-8e3e-4516-9d67-7713fa546759`::ref 0 aborting False
Thread-622::INFO::2013-12-31
05:06:02,576::clientIF::350::vds::(prepareVolumePath) prepared volume path:
/rhev/data-center/mnt/_data_images_rhev/66e0b27c-dcbb-4b6e-9a58-8213e8380c65/images/7c063b30-634a-483b-82aa-7f19d2ae46cd/b0839e46-9f79-49b2-ae34-f7cafb626c75
Thread-622::DEBUG::2013-12-31 05:06:02,589::utils::489::root::(execCmd)
'/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None)
Thread-622::DEBUG::2013-12-31 05:06:02,642::utils::509::root::(execCmd)
SUCCESS: <err> = ''; <rc> = 0
Thread-622::INFO::2013-12-31 05:06:02,642::hooks::88::root::(_runHooksDir)
Thread-622::DEBUG::2013-12-31 05:06:02,643::vm::2925::vm.Vm::(_run)
vmId=`147a1deb-3795-4153-a820-ceabd8db15f3`::<?xml version="1.0"...
On Wed, Jan 1, 2014 at 12:12 PM, Nauman Abbas <nauman.abbas(a)seecs.edu.pk>wrote:
Found it.
http://ur1.ca/gakse
Also here's the versions
vdsm 4.13
sanlock 2.8
libvirt 1.1.3.1
qemu 1.6.1
On Wed, Jan 1, 2014 at 11:56 AM, Gadi Ickowicz <gickowic(a)redhat.com>wrote:
> the lines you added that are right before the Fpaste link are the actual
> lines messages from libvirt that the vm dies. This message from libvirt is
> then shown later as the ERROR in vdsm in the Fpaste link.
>
> The log should contain, very close to the lines you paste, but a bit
> before, an xml. it should look something like what I am pasting below.
> Also, the line right before the xml should contain a prepareVolumePath
> entry:
> Thread-50::DEBUG::2013-12-25 14:30:45,282::vm::3031::vm.Vm::(_run)
> vmId=`fdfaec39-b981-4bd7-9852-6d5ac6ce2b37`::<?xml version="1.0"
> encoding="utf-8"?>
> ...<the xml continues a bit with all the vm properties>
>
> also - what versions of vdsm, libvirt, sanlock and qemu are you using?
>
> Gadi Ickowicz
>
> ----- Original Message -----
> From: "Nauman Abbas" <nauman.abbas(a)seecs.edu.pk>
> To: "Gadi Ickowicz" <gickowic(a)redhat.com>
> Cc: "users(a)ovirt.org" <Users(a)ovirt.org>
> Sent: Wednesday, January 1, 2014 7:30:24 AM
> Subject: Re: [Users] VM not starting up
>
> Also I believe these lines right before what I pasted with Fpaste link
> would be relevant.
>
> Thread-622::DEBUG::2013-12-31
> 05:06:02,957::libvirtconnection::108::libvirtconnection::(wrapper) Unknown
> libvirterror: ecode: 38 edom: 0 level: 2 message: Child quit during
> startup
> handshake: Input/output error
> Thread-622::DEBUG::2013-12-31
> 05:06:02,957::vm::2106::vm.Vm::(_startUnderlyingVm)
> vmId=`147a1deb-3795-4153-a820-ceabd8db15f3`::_ongoingCreations released
>
>
> On Wed, Jan 1, 2014 at 10:23 AM, Nauman Abbas <nauman.abbas(a)seecs.edu.pk
> >wrote:
>
> > I'm going through the log (which is quite big) and I've found out this
> > part which is like 2 seconds after the vmcreate part. Have a look maybe
> > this is what you're looking for. It contains the ERROR and Traceback in
> it.
> >
> >
> >
http://ur1.ca/gakhc
> >
> >
> > On Tue, Dec 31, 2013 at 4:36 PM, Gadi Ickowicz <gickowic(a)redhat.com
> >wrote:
> >
> >> It would be helpful to get a bit more information from the logs - after
> >> the vmCreate there are several other things that occur before the vm
> >> process is actually launched (prepareImage and following that the
> actual
> >> vm's should be visible in the log). Try to search for an error in the
> vdsm
> >> log, and if you cannot find one attach logs containing the vmCreate
> and the
> >> other operations I mentioned.
> >>
> >> Errors in the vdsm log are usually logged in lines containing ERROR,
> but
> >> sometimes if the error comes from libvirt it may not contain the
> uppercase
> >> ERROR and be logged as libvirtError or something similar.
> >>
> >> you should also have the qemu log for the vm you are trying to run.
> >> usually under /var/log/libvirt/qemu/<name_of_the_vm>.log - maybe that
> will
> >> give more information regarding the failure
> >>
> >> Gadi Ickowicz
> >>
> >> ----- Original Message -----
> >> From: "Joop" <jvdwege(a)xs4all.nl>
> >> To: "Nauman Abbas" <nauman.abbas(a)seecs.edu.pk>
> >> Cc: "users(a)ovirt.org" <Users(a)ovirt.org>
> >> Sent: Tuesday, December 31, 2013 12:51:10 PM
> >> Subject: Re: [Users] VM not starting up
> >>
> >> Nauman Abbas <nauman.abbas(a)seecs.edu.pk> wrote:
> >>
> >>
> >> I've attached the portions with vmcreate. I found 5 instances of pairs
> of
> >> call vmcreate and return vmcreate. I've separated them with lines. See
> if
> >> that helps.
> >>
> >>
> >> On Tue, Dec 31, 2013 at 2:58 PM, Gadi Ickowicz < gickowic(a)redhat.com
>
> >> wrote:
> >>
> >>
> >> Hi,
> >>
> >> Maybe you can send just the relevant part of the vdsm logs that contain
> >> the attempt to launch the vm itself - it should start with vmCreate.
> Try to
> >> find "::call vmCreate with (..." and either find the matching
"return
> >> vmCreate with"
> >> or an maybe there is an ERROR or Traceback in the vdsm log following
> the
> >> vmCreate call.
> >>
> >> Gadi Ickowicz
> >>
> >> ----- Original Message -----
> >> From: "Nauman Abbas" < nauman.abbas(a)seecs.edu.pk >
> >> To: "Meital Bourvine" < mbourvin(a)redhat.com >
> >> Cc: " users(a)ovirt.org " < Users(a)ovirt.org >
> >> Sent: Tuesday, December 31, 2013 11:47:12 AM
> >> Subject: Re: [Users] VM not starting up
> >>
> >> Vdsm is running fine. Also checked the clocks. You were right, the
> Engine
> >> clock was 5 hours ahead of Node clock. I've corrected that but still
> the
> >> same issue.
> >>
> >>
> >> On Tue, Dec 31, 2013 at 12:44 PM, Meital Bourvine <
> mbourvin(a)redhat.com> wrote:
> >>
> >>
> >>
> >> Are you sure that vdsm is running?
> >>
> >> The error happened at 2013-12-31 11:32:56,999 (engine.log)
> >> but the last line in vdsm.log is from 2013-12-31 07:20:50,807
> >>
> >> Also make sure that your clocked are synced.
> >>
> >>
> >>
> >>
> >>
> >>
> >> From: "Nauman Abbas" < nauman.abbas(a)seecs.edu.pk >
> >> To: "Meital Bourvine" < mbourvin(a)redhat.com >
> >> Cc: " users(a)ovirt.org " < Users(a)ovirt.org >
> >> Sent: Tuesday, December 31, 2013 9:39:09 AM
> >>
> >> Subject: Re: [Users] VM not starting up
> >>
> >> Sending files one by one. Vdsm.log
> >>
> >>
> >> On Tue, Dec 31, 2013 at 11:48 AM, Meital Bourvine <
> mbourvin(a)redhat.com> wrote:
> >>
> >>
> >>
> >> Engine log can be found on the engine (while vdsm.log is on the host).
> >> The full path is - /var/log/ovirt-engine/engine.log
> >>
> >> audit.log - /var/log/audit/audit.log
> >>
> >> About the vdsm log - I don't see any error there, I think that you cut
> >> too much from it.
> >>
> >>
> >>
> >>
> >> From: "Nauman Abbas" < nauman.abbas(a)seecs.edu.pk >
> >> To: "Meital Bourvine" < mbourvin(a)redhat.com >
> >> Cc: " users(a)ovirt.org " < Users(a)ovirt.org >
> >> Sent: Tuesday, December 31, 2013 8:42:43 AM
> >> Subject: Re: [Users] VM not starting up
> >>
> >>
> >> Hello Meital
> >>
> >> SELinux is off. The cluster doesn't work if SELinux is on, my hosts and
> >> storage is showing up as okay but VM is not starting up.
> >>
> >> I've managed to get vdsm.log but cannot find engine.log and audit.log.
> >> Sorry for being a noob, if you can tell me the path to these files I'll
> >> send them right away.
> >>
> >>
> >> On Tue, Dec 31, 2013 at 11:17 AM, Meital Bourvine <
> mbourvin(a)redhat.com> wrote:
> >>
> >>
> >>
> >> Hi Nauman,
> >>
> >> Maybe it's a selinux issue?
> >> Please try running `setenforce 0` before starting the vm.
> >>
> >> Also please attach engine.log, vdsm.log, and audit.log
> >>
> >>
> >>
> >>
> >> From: "Nauman Abbas" < nauman.abbas(a)seecs.edu.pk >
> >> To: " users(a)ovirt.org " < Users(a)ovirt.org >
> >> Sent: Tuesday, December 31, 2013 7:13:01 AM
> >> Subject: [Users] VM not starting up
> >>
> >>
> >> Hello all,
> >>
> >> First of all thank you for your help, I've finally managed to get my
> >> Cluster configured properly but now that I create VMs I'm facing
> another
> >> problem. Whenever I start my VM I get this error.
> >>
> >> " VM TestVm is down. Exit message: Child quit during startup
handshake:
> >> Input/output error."
> >>
> >> I've googled around but haven't found any satisfactory solution. If
> >> anyone can help out it would be great.
> >>
> >> Regards
> >>
> >> Nauman Abbas
> >> Assistant System Administrator (LMS),
> >> Room No. A-207, SEECS,
> >> National University of Sciences & Technology,
> >> + 92 321 5359946
> >>
> >> _______________________________________________
> >> Users mailing list
> >> Users(a)ovirt.org
> >>
http://lists.ovirt.org/mailman/listinfo/users
> >>
> >>
> >>
> >>
> >> --
> >>
> >> Nauman Abbas
> >> Assistant System Administrator (LMS),
> >> Room No. A-207, SEECS,
> >> National University of Sciences & Technology,
> >> + 92 321 5359946
> >>
> >>
> >>
> >>
> >> --
> >>
> >> Nauman Abbas
> >> Assistant System Administrator (LMS),
> >> Room No. A-207, SEECS,
> >> National University of Sciences & Technology,
> >> + 92 321 5359946
> >>
> >>
> >>
> >>
> >> --
> >>
> >> Nauman Abbas
> >> Assistant System Administrator (LMS),
> >> Room No. A-207, SEECS,
> >> National University of Sciences & Technology,
> >> + 92 321 5359946
> >>
> >> _______________________________________________
> >> Users mailing list
> >> Users(a)ovirt.org
> >>
http://lists.ovirt.org/mailman/listinfo/users
> >>
> >>
> >>
> >> --
> >>
> >> Nauman Abbas
> >> Assistant System Administrator (LMS),
> >> Room No. A-207, SEECS,
> >> National University of Sciences & Technology,
> >> + 92 321 5359946
> >>
> >> Paste your logs to
fpaste.org or similar and put the url in the mail.
> >> Your snippets don‘t contain any errors that i can see.
> >>
> >> --
> >> Sent from my Android tablet with K-9 Mail. Please excuse my brevity.
> >>
> >> _______________________________________________
> >> Users mailing list
> >> Users(a)ovirt.org
> >>
http://lists.ovirt.org/mailman/listinfo/users
> >>
> >
> >
> >
> > --
> >
> > Nauman Abbas
> > Assistant System Administrator (LMS),
> > Room No. A-207, SEECS,
> > National University of Sciences & Technology,
> > + 92 321 5359946
> >
>
>
>
> --
>
> Nauman Abbas
> Assistant System Administrator (LMS),
> Room No. A-207, SEECS,
> National University of Sciences & Technology,
> + 92 321 5359946
>
--
Nauman Abbas
Assistant System Administrator (LMS),
Room No. A-207, SEECS,
National University of Sciences & Technology,
+ 92 321 5359946
--
Nauman Abbas
Assistant System Administrator (LMS),
Room No. A-207, SEECS,
National University of Sciences & Technology,
+ 92 321 5359946