[Users] VM not starting up

Wed Jan 1 07:25:17 UTC 2014

And here's the prepareVolumePath entry

Thread-622::DEBUG::2013-12-31
05:06:02,576::task::974::TaskManager.Task::(_decref)
Task=`8ae0743d-8e3e-4516-9d67-7713fa546759`::ref 0 aborting False
Thread-622::INFO::2013-12-31
05:06:02,576::clientIF::350::vds::(prepareVolumePath) prepared volume path:
/rhev/data-center/mnt/_data_images_rhev/66e0b27c-dcbb-4b6e-9a58-8213e8380c65/images/7c063b30-634a-483b-82aa-7f19d2ae46cd/b0839e46-9f79-49b2-ae34-f7cafb626c75
Thread-622::DEBUG::2013-12-31 05:06:02,589::utils::489::root::(execCmd)
'/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None)
Thread-622::DEBUG::2013-12-31 05:06:02,642::utils::509::root::(execCmd)
SUCCESS: <err> = ''; <rc> = 0
Thread-622::INFO::2013-12-31 05:06:02,642::hooks::88::root::(_runHooksDir)
Thread-622::DEBUG::2013-12-31 05:06:02,643::vm::2925::vm.Vm::(_run)
vmId=`147a1deb-3795-4153-a820-ceabd8db15f3`::<?xml version="1.0"...

On Wed, Jan 1, 2014 at 12:12 PM, Nauman Abbas <nauman.abbas at seecs.edu.pk>wrote:

> Found it.
> http://ur1.ca/gakse
>
> Also here's the versions
> vdsm 4.13
> sanlock 2.8
> libvirt 1.1.3.1
> qemu 1.6.1
>
>
>
>
> On Wed, Jan 1, 2014 at 11:56 AM, Gadi Ickowicz <gickowic at redhat.com>wrote:
>
>> the lines you added that are right before the Fpaste link are the actual
>> lines messages from libvirt that the vm dies. This message from libvirt is
>> then shown later as the ERROR in vdsm in the Fpaste link.
>>
>> The log should contain, very close to the lines you paste, but a bit
>> before, an xml. it should look something like what I am pasting below.
>> Also, the line right before the xml should contain a prepareVolumePath
>> entry:
>> Thread-50::DEBUG::2013-12-25 14:30:45,282::vm::3031::vm.Vm::(_run)
>> vmId=`fdfaec39-b981-4bd7-9852-6d5ac6ce2b37`::<?xml version="1.0"
>> encoding="utf-8"?>
>> ...<the xml continues a bit with all the vm properties>
>>
>> also - what versions of vdsm, libvirt, sanlock and qemu are you using?
>>
>> Gadi Ickowicz
>>
>> ----- Original Message -----
>> From: "Nauman Abbas" <nauman.abbas at seecs.edu.pk>
>> To: "Gadi Ickowicz" <gickowic at redhat.com>
>> Cc: "users at ovirt.org" <Users at ovirt.org>
>> Sent: Wednesday, January 1, 2014 7:30:24 AM
>> Subject: Re: [Users] VM not starting up
>>
>> Also I believe these lines right before what I pasted with Fpaste link
>> would be relevant.
>>
>> Thread-622::DEBUG::2013-12-31
>> 05:06:02,957::libvirtconnection::108::libvirtconnection::(wrapper) Unknown
>> libvirterror: ecode: 38 edom: 0 level: 2 message: Child quit during
>> startup
>> handshake: Input/output error
>> Thread-622::DEBUG::2013-12-31
>> 05:06:02,957::vm::2106::vm.Vm::(_startUnderlyingVm)
>> vmId=`147a1deb-3795-4153-a820-ceabd8db15f3`::_ongoingCreations released
>>
>>
>> On Wed, Jan 1, 2014 at 10:23 AM, Nauman Abbas <nauman.abbas at seecs.edu.pk
>> >wrote:
>>
>> > I'm going through the log (which is quite big) and I've found out this
>> > part which is like 2 seconds after the vmcreate part. Have a look maybe
>> > this is what you're looking for. It contains the ERROR and Traceback in
>> it.
>> >
>> >
>> > http://ur1.ca/gakhc
>> >
>> >
>> > On Tue, Dec 31, 2013 at 4:36 PM, Gadi Ickowicz <gickowic at redhat.com
>> >wrote:
>> >
>> >> It would be helpful to get a bit more information from the logs - after
>> >> the vmCreate there are several other things that occur before the vm
>> >> process is actually launched (prepareImage and following that the
>> actual
>> >> vm's should be visible in the log). Try to search for an error in the
>> vdsm
>> >> log, and if you cannot find one attach logs containing the vmCreate
>> and the
>> >> other operations I mentioned.
>> >>
>> >> Errors in the vdsm log are usually logged in lines containing ERROR,
>> but
>> >> sometimes if the error comes from libvirt it may not contain the
>> uppercase
>> >> ERROR and be logged as libvirtError or something similar.
>> >>
>> >> you should also have the qemu log for the vm you are trying to run.
>> >> usually under /var/log/libvirt/qemu/<name_of_the_vm>.log - maybe that
>> will
>> >> give more information regarding the failure
>> >>
>> >> Gadi Ickowicz
>> >>
>> >> ----- Original Message -----
>> >> From: "Joop" <jvdwege at xs4all.nl>
>> >> To: "Nauman Abbas" <nauman.abbas at seecs.edu.pk>
>> >> Cc: "users at ovirt.org" <Users at ovirt.org>
>> >> Sent: Tuesday, December 31, 2013 12:51:10 PM
>> >> Subject: Re: [Users] VM not starting up
>> >>
>> >> Nauman Abbas <nauman.abbas at seecs.edu.pk> wrote:
>> >>
>> >>
>> >> I've attached the portions with vmcreate. I found 5 instances of pairs
>> of
>> >> call vmcreate and return vmcreate. I've separated them with lines. See
>> if
>> >> that helps.
>> >>
>> >>
>> >> On Tue, Dec 31, 2013 at 2:58 PM, Gadi Ickowicz < gickowic at redhat.com >
>> >> wrote:
>> >>
>> >>
>> >> Hi,
>> >>
>> >> Maybe you can send just the relevant part of the vdsm logs that contain
>> >> the attempt to launch the vm itself - it should start with vmCreate.
>> Try to
>> >> find "::call vmCreate with (..." and either find the matching "return
>> >> vmCreate with"
>> >> or an maybe there is an ERROR or Traceback in the vdsm log following
>> the
>> >> vmCreate call.
>> >>
>> >> Gadi Ickowicz
>> >>
>> >> ----- Original Message -----
>> >> From: "Nauman Abbas" < nauman.abbas at seecs.edu.pk >
>> >> To: "Meital Bourvine" < mbourvin at redhat.com >
>> >> Cc: " users at ovirt.org " < Users at ovirt.org >
>> >> Sent: Tuesday, December 31, 2013 11:47:12 AM
>> >> Subject: Re: [Users] VM not starting up
>> >>
>> >> Vdsm is running fine. Also checked the clocks. You were right, the
>> Engine
>> >> clock was 5 hours ahead of Node clock. I've corrected that but still
>> the
>> >> same issue.
>> >>
>> >>
>> >> On Tue, Dec 31, 2013 at 12:44 PM, Meital Bourvine <
>> mbourvin at redhat.com> wrote:
>> >>
>> >>
>> >>
>> >> Are you sure that vdsm is running?
>> >>
>> >> The error happened at 2013-12-31 11:32:56,999 (engine.log)
>> >> but the last line in vdsm.log is from 2013-12-31 07:20:50,807
>> >>
>> >> Also make sure that your clocked are synced.
>> >>
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> From: "Nauman Abbas" < nauman.abbas at seecs.edu.pk >
>> >> To: "Meital Bourvine" < mbourvin at redhat.com >
>> >> Cc: " users at ovirt.org " < Users at ovirt.org >
>> >> Sent: Tuesday, December 31, 2013 9:39:09 AM
>> >>
>> >> Subject: Re: [Users] VM not starting up
>> >>
>> >> Sending files one by one. Vdsm.log
>> >>
>> >>
>> >> On Tue, Dec 31, 2013 at 11:48 AM, Meital Bourvine <
>> mbourvin at redhat.com> wrote:
>> >>
>> >>
>> >>
>> >> Engine log can be found on the engine (while vdsm.log is on the host).
>> >> The full path is - /var/log/ovirt-engine/engine.log
>> >>
>> >> audit.log - /var/log/audit/audit.log
>> >>
>> >> About the vdsm log - I don't see any error there, I think that you cut
>> >> too much from it.
>> >>
>> >>
>> >>
>> >>
>> >> From: "Nauman Abbas" < nauman.abbas at seecs.edu.pk >
>> >> To: "Meital Bourvine" < mbourvin at redhat.com >
>> >> Cc: " users at ovirt.org " < Users at ovirt.org >
>> >> Sent: Tuesday, December 31, 2013 8:42:43 AM
>> >> Subject: Re: [Users] VM not starting up
>> >>
>> >>
>> >> Hello Meital
>> >>
>> >> SELinux is off. The cluster doesn't work if SELinux is on, my hosts and
>> >> storage is showing up as okay but VM is not starting up.
>> >>
>> >> I've managed to get vdsm.log but cannot find engine.log and audit.log.
>> >> Sorry for being a noob, if you can tell me the path to these files I'll
>> >> send them right away.
>> >>
>> >>
>> >> On Tue, Dec 31, 2013 at 11:17 AM, Meital Bourvine <
>> mbourvin at redhat.com> wrote:
>> >>
>> >>
>> >>
>> >> Hi Nauman,
>> >>
>> >> Maybe it's a selinux issue?
>> >> Please try running `setenforce 0` before starting the vm.
>> >>
>> >> Also please attach engine.log, vdsm.log, and audit.log
>> >>
>> >>
>> >>
>> >>
>> >> From: "Nauman Abbas" < nauman.abbas at seecs.edu.pk >
>> >> To: " users at ovirt.org " < Users at ovirt.org >
>> >> Sent: Tuesday, December 31, 2013 7:13:01 AM
>> >> Subject: [Users] VM not starting up
>> >>
>> >>
>> >> Hello all,
>> >>
>> >> First of all thank you for your help, I've finally managed to get my
>> >> Cluster configured properly but now that I create VMs I'm facing
>> another
>> >> problem. Whenever I start my VM I get this error.
>> >>
>> >> " VM TestVm is down. Exit message: Child quit during startup handshake:
>> >> Input/output error."
>> >>
>> >> I've googled around but haven't found any satisfactory solution. If
>> >> anyone can help out it would be great.
>> >>
>> >> Regards
>> >>
>> >> Nauman Abbas
>> >> Assistant System Administrator (LMS),
>> >> Room No. A-207, SEECS,
>> >> National University of Sciences & Technology,
>> >> + 92 321 5359946
>> >>
>> >> _______________________________________________
>> >> Users mailing list
>> >> Users at ovirt.org
>> >> http://lists.ovirt.org/mailman/listinfo/users
>> >>
>> >>
>> >>
>> >>
>> >> --
>> >>
>> >> Nauman Abbas
>> >> Assistant System Administrator (LMS),
>> >> Room No. A-207, SEECS,
>> >> National University of Sciences & Technology,
>> >> + 92 321 5359946
>> >>
>> >>
>> >>
>> >>
>> >> --
>> >>
>> >> Nauman Abbas
>> >> Assistant System Administrator (LMS),
>> >> Room No. A-207, SEECS,
>> >> National University of Sciences & Technology,
>> >> + 92 321 5359946
>> >>
>> >>
>> >>
>> >>
>> >> --
>> >>
>> >> Nauman Abbas
>> >> Assistant System Administrator (LMS),
>> >> Room No. A-207, SEECS,
>> >> National University of Sciences & Technology,
>> >> + 92 321 5359946
>> >>
>> >> _______________________________________________
>> >> Users mailing list
>> >> Users at ovirt.org
>> >> http://lists.ovirt.org/mailman/listinfo/users
>> >>
>> >>
>> >>
>> >> --
>> >>
>> >> Nauman Abbas
>> >> Assistant System Administrator (LMS),
>> >> Room No. A-207, SEECS,
>> >> National University of Sciences & Technology,
>> >> + 92 321 5359946
>> >>
>> >> Paste your logs to fpaste.org or similar and put the url in the mail.
>> >> Your snippets don‘t contain any errors that i can see.
>> >>
>> >> --
>> >> Sent from my Android tablet with K-9 Mail. Please excuse my brevity.
>> >>
>> >> _______________________________________________
>> >> Users mailing list
>> >> Users at ovirt.org
>> >> http://lists.ovirt.org/mailman/listinfo/users
>> >>
>> >
>> >
>> >
>> > --
>> >
>> > Nauman Abbas
>> > Assistant System Administrator (LMS),
>> > Room No. A-207, SEECS,
>> > National University of Sciences & Technology,
>> > + 92 321 5359946
>> >
>>
>>
>>
>> --
>>
>> Nauman Abbas
>> Assistant System Administrator (LMS),
>> Room No. A-207, SEECS,
>> National University of Sciences & Technology,
>> + 92 321 5359946
>>
>
>
>
> --
>
> Nauman Abbas
> Assistant System Administrator (LMS),
> Room No. A-207, SEECS,
> National University of Sciences & Technology,
> + 92 321 5359946
>

-- 

Nauman Abbas
Assistant System Administrator (LMS),
Room No. A-207, SEECS,
National University of Sciences & Technology,
+ 92 321 5359946
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20140101/2a37ddfc/attachment-0001.html>