[Users] attempted live snapshot, machine paused, wouldn't restart
I attempted to take a snapshot of a machine while it was running. I noticed that the machine was paused, and then I attempted to resume it. The machine looked like it was going to launch, but the events tab simply indicated that execution of launching the vm failed. Here's the engine.log at the time: 2012-12-18 22:53:55,838 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--0.0.0.0-8009-5) START, IsValidVDSCommand(storagePoolId = 2ccd03b1-fd0e-4578-88ce-e5065a9742d7, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 19399f32 2012-12-18 22:53:55,848 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--0.0.0.0-8009-5) FINISH, IsValidVDSCommand, return: true, log id: 19399f32 2012-12-18 22:53:55,894 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--0.0.0.0-8009-5) START, IsVmDuringInitiatingVDSCommand(vmId = 35d58779-ee24-4926-8612-e053ff48881b), log id: 76d4a2b2 2012-12-18 22:53:55,895 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--0.0.0.0-8009-5) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 76d4a2b2 2012-12-18 22:53:55,935 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Lock Acquired to object EngineLock [exclusiveLocks= key: 35d58779-ee24-4926-8612-e053ff48881b value: VM , sharedLocks= ] 2012-12-18 22:53:55,952 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Running command: RunVmCommand internal: false. Entities affected : ID: 35d58779-ee24-4926-8612-e053ff48881b Type: VM 2012-12-18 22:53:55,966 INFO [org.ovirt.engine.core.vdsbroker.ResumeVDSCommand] (pool-3-thread-49) [17252a1c] START, ResumeVDSCommand(vdsId = 0a7046ea-216d-11e2-8fe8-001372eb596b, vmId=35d58779-ee24-4926-8612-e053ff48881b), log id: 607d6dc2 2012-12-18 22:53:55,976 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResumeBrokerVDSCommand] (pool-3-thread-49) [17252a1c] START, ResumeBrokerVDSCommand(vdsId = 0a7046ea-216d-11e2-8fe8-001372eb596b, vmId=35d58779-ee24-4926-8612-e053ff48881b), log id: 66b1872c 2012-12-18 22:53:56,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResumeBrokerVDSCommand] (pool-3-thread-49) [17252a1c] FINISH, ResumeBrokerVDSCommand, log id: 66b1872c 2012-12-18 22:53:56,298 INFO [org.ovirt.engine.core.vdsbroker.ResumeVDSCommand] (pool-3-thread-49) [17252a1c] FINISH, ResumeVDSCommand, return: PoweringUp, log id: 607d6dc2 2012-12-18 22:53:56,302 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Lock freed to object EngineLock [exclusiveLocks= key: 35d58779-ee24-4926-8612-e053ff48881b value: VM , sharedLocks= ] I'm not sure if I was missing something, or if I needed to wait for something to complete, or what. I ended up just stopping the machine and then starting it from cold. Any thoughts here? I'm happy to attempt this again and to see if it breaks the same way and to capture more data. Cheers, -- Erik Jacobs ATLElite / www.atlelite.com DGTrials / www.DGTrials.com FestiveGarage / www.FestiveGarage.com Riding Resource / www.RidingResource.com www.erikjacobs.com (C) 646-284-3482 (F) 404-585-4409
Hi Erik, in order to debug it, we need some more details, such as engine and vdsm logs, can you please attach those logs from the moment you took the snapshot? from the log below, it seems as if vm resume operation succeeded and vm state changed to powering up. btw, did you have an operating system installed on this vm ? what was the status of the vm prior to the live snapshot attempt? Thanks. Haim ----- Original Message -----
From: "Erik Jacobs" <erikmjacobs@gmail.com> To: users@ovirt.org Sent: Wednesday, December 19, 2012 5:58:18 AM Subject: [Users] attempted live snapshot, machine paused, wouldn't restart
I attempted to take a snapshot of a machine while it was running. I noticed that the machine was paused, and then I attempted to resume it. The machine looked like it was going to launch, but the events tab simply indicated that execution of launching the vm failed.
Here's the engine.log at the time: 2012-12-18 22:53:55,838 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--0.0.0.0-8009-5) START, IsValidVDSCommand(storagePoolId = 2ccd03b1-fd0e-4578-88ce-e5065a9742d7, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 19399f32 2012-12-18 22:53:55,848 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--0.0.0.0-8009-5) FINISH, IsValidVDSCommand, return: true, log id: 19399f32 2012-12-18 22:53:55,894 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--0.0.0.0-8009-5) START, IsVmDuringInitiatingVDSCommand(vmId = 35d58779-ee24-4926-8612-e053ff48881b), log id: 76d4a2b2 2012-12-18 22:53:55,895 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--0.0.0.0-8009-5) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 76d4a2b2 2012-12-18 22:53:55,935 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Lock Acquired to object EngineLock [exclusiveLocks= key: 35d58779-ee24-4926-8612-e053ff48881b value: VM , sharedLocks= ] 2012-12-18 22:53:55,952 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Running command: RunVmCommand internal: false. Entities affected : ID: 35d58779-ee24-4926-8612-e053ff48881b Type: VM 2012-12-18 22:53:55,966 INFO [org.ovirt.engine.core.vdsbroker.ResumeVDSCommand] (pool-3-thread-49) [17252a1c] START, ResumeVDSCommand(vdsId = 0a7046ea-216d-11e2-8fe8-001372eb596b, vmId=35d58779-ee24-4926-8612-e053ff48881b), log id: 607d6dc2 2012-12-18 22:53:55,976 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResumeBrokerVDSCommand] (pool-3-thread-49) [17252a1c] START, ResumeBrokerVDSCommand(vdsId = 0a7046ea-216d-11e2-8fe8-001372eb596b, vmId=35d58779-ee24-4926-8612-e053ff48881b), log id: 66b1872c 2012-12-18 22:53:56,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResumeBrokerVDSCommand] (pool-3-thread-49) [17252a1c] FINISH, ResumeBrokerVDSCommand, log id: 66b1872c 2012-12-18 22:53:56,298 INFO [org.ovirt.engine.core.vdsbroker.ResumeVDSCommand] (pool-3-thread-49) [17252a1c] FINISH, ResumeVDSCommand, return: PoweringUp, log id: 607d6dc2 2012-12-18 22:53:56,302 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Lock freed to object EngineLock [exclusiveLocks= key: 35d58779-ee24-4926-8612-e053ff48881b value: VM , sharedLocks= ]
I'm not sure if I was missing something, or if I needed to wait for something to complete, or what. I ended up just stopping the machine and then starting it from cold.
Any thoughts here? I'm happy to attempt this again and to see if it breaks the same way and to capture more data.
Cheers,
-- Erik Jacobs ATLElite / www.atlelite.com DGTrials / www.DGTrials.com FestiveGarage / www.FestiveGarage.com Riding Resource / www.RidingResource.com www.erikjacobs.com (C) 646-284-3482 (F) 404-585-4409
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Haim, In-line responses follow. On Wed, Dec 19, 2012 at 4:02 AM, Haim Ateya <hateya@redhat.com> wrote:
Hi Erik,
in order to debug it, we need some more details, such as engine and vdsm logs, can you please attach those logs from the moment you took the snapshot?
http://pastie.org/5553030 (engine.log) http://pastebin.ca/2294934 (vdsm.log)
from the log below, it seems as if vm resume operation succeeded and vm state changed to powering up. btw, did you have an operating system installed on this vm ? what was the status of the vm prior to the live snapshot attempt?
Centos 5.6 guest that was running at the time I hit the "create snapshot" button. Status of my 3 storage domains: /dev/mapper/mediavg-121028_rhev 148G 21G 121G 15% /mnt/rhev /dev/mapper/mediavg-121028_rheviso 20G 4.2G 15G 23% /mnt/rheviso /dev/mapper/mediavg-121028_rhevimport 9.9G 5.1G 4.3G 55% /mnt/rhevimport Thanks! -E
Thanks. Haim
----- Original Message -----
From: "Erik Jacobs" <erikmjacobs@gmail.com> To: users@ovirt.org Sent: Wednesday, December 19, 2012 5:58:18 AM Subject: [Users] attempted live snapshot, machine paused, wouldn't restart
I attempted to take a snapshot of a machine while it was running. I noticed that the machine was paused, and then I attempted to resume it. The machine looked like it was going to launch, but the events tab simply indicated that execution of launching the vm failed.
Here's the engine.log at the time: 2012-12-18 22:53:55,838 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--0.0.0.0-8009-5) START, IsValidVDSCommand(storagePoolId = 2ccd03b1-fd0e-4578-88ce-e5065a9742d7, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 19399f32 2012-12-18 22:53:55,848 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--0.0.0.0-8009-5) FINISH, IsValidVDSCommand, return: true, log id: 19399f32 2012-12-18 22:53:55,894 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--0.0.0.0-8009-5) START, IsVmDuringInitiatingVDSCommand(vmId = 35d58779-ee24-4926-8612-e053ff48881b), log id: 76d4a2b2 2012-12-18 22:53:55,895 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--0.0.0.0-8009-5) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 76d4a2b2 2012-12-18 22:53:55,935 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Lock Acquired to object EngineLock [exclusiveLocks= key: 35d58779-ee24-4926-8612-e053ff48881b value: VM , sharedLocks= ] 2012-12-18 22:53:55,952 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Running command: RunVmCommand internal: false. Entities affected : ID: 35d58779-ee24-4926-8612-e053ff48881b Type: VM 2012-12-18 22:53:55,966 INFO [org.ovirt.engine.core.vdsbroker.ResumeVDSCommand] (pool-3-thread-49) [17252a1c] START, ResumeVDSCommand(vdsId = 0a7046ea-216d-11e2-8fe8-001372eb596b, vmId=35d58779-ee24-4926-8612-e053ff48881b), log id: 607d6dc2 2012-12-18 22:53:55,976 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResumeBrokerVDSCommand] (pool-3-thread-49) [17252a1c] START, ResumeBrokerVDSCommand(vdsId = 0a7046ea-216d-11e2-8fe8-001372eb596b, vmId=35d58779-ee24-4926-8612-e053ff48881b), log id: 66b1872c 2012-12-18 22:53:56,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResumeBrokerVDSCommand] (pool-3-thread-49) [17252a1c] FINISH, ResumeBrokerVDSCommand, log id: 66b1872c 2012-12-18 22:53:56,298 INFO [org.ovirt.engine.core.vdsbroker.ResumeVDSCommand] (pool-3-thread-49) [17252a1c] FINISH, ResumeVDSCommand, return: PoweringUp, log id: 607d6dc2 2012-12-18 22:53:56,302 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Lock freed to object EngineLock [exclusiveLocks= key: 35d58779-ee24-4926-8612-e053ff48881b value: VM , sharedLocks= ]
I'm not sure if I was missing something, or if I needed to wait for something to complete, or what. I ended up just stopping the machine and then starting it from cold.
Any thoughts here? I'm happy to attempt this again and to see if it breaks the same way and to capture more data.
Cheers,
-- Erik Jacobs ATLElite / www.atlelite.com DGTrials / www.DGTrials.com FestiveGarage / www.FestiveGarage.com Riding Resource / www.RidingResource.com www.erikjacobs.com (C) 646-284-3482 (F) 404-585-4409
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Erik Jacobs ATLElite / www.atlelite.com DGTrials / www.DGTrials.com FestiveGarage / www.FestiveGarage.com Riding Resource / www.RidingResource.com www.erikjacobs.com (C) 646-284-3482 (F) 404-585-4409
Hi Erik, How much free storage space do you have in your domains? Can you please add VDSM log. Regards, Maor On 12/19/2012 05:58 AM, Erik Jacobs wrote:
I attempted to take a snapshot of a machine while it was running. I noticed that the machine was paused, and then I attempted to resume it. The machine looked like it was going to launch, but the events tab simply indicated that execution of launching the vm failed.
Here's the engine.log at the time: 2012-12-18 22:53:55,838 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--0.0.0.0-8009-5) START, IsValidVDSCommand(storagePoolId = 2ccd03b1-fd0e-4578-88ce-e5065a9742d7, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 19399f32 2012-12-18 22:53:55,848 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--0.0.0.0-8009-5) FINISH, IsValidVDSCommand, return: true, log id: 19399f32 2012-12-18 22:53:55,894 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--0.0.0.0-8009-5) START, IsVmDuringInitiatingVDSCommand(vmId = 35d58779-ee24-4926-8612-e053ff48881b), log id: 76d4a2b2 2012-12-18 22:53:55,895 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--0.0.0.0-8009-5) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 76d4a2b2 2012-12-18 22:53:55,935 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Lock Acquired to object EngineLock [exclusiveLocks= key: 35d58779-ee24-4926-8612-e053ff48881b value: VM , sharedLocks= ] 2012-12-18 22:53:55,952 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Running command: RunVmCommand internal: false. Entities affected : ID: 35d58779-ee24-4926-8612-e053ff48881b Type: VM 2012-12-18 22:53:55,966 INFO [org.ovirt.engine.core.vdsbroker.ResumeVDSCommand] (pool-3-thread-49) [17252a1c] START, ResumeVDSCommand(vdsId = 0a7046ea-216d-11e2-8fe8-001372eb596b, vmId=35d58779-ee24-4926-8612-e053ff48881b), log id: 607d6dc2 2012-12-18 22:53:55,976 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResumeBrokerVDSCommand] (pool-3-thread-49) [17252a1c] START, ResumeBrokerVDSCommand(vdsId = 0a7046ea-216d-11e2-8fe8-001372eb596b, vmId=35d58779-ee24-4926-8612-e053ff48881b), log id: 66b1872c 2012-12-18 22:53:56,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResumeBrokerVDSCommand] (pool-3-thread-49) [17252a1c] FINISH, ResumeBrokerVDSCommand, log id: 66b1872c 2012-12-18 22:53:56,298 INFO [org.ovirt.engine.core.vdsbroker.ResumeVDSCommand] (pool-3-thread-49) [17252a1c] FINISH, ResumeVDSCommand, return: PoweringUp, log id: 607d6dc2 2012-12-18 22:53:56,302 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [17252a1c] Lock freed to object EngineLock [exclusiveLocks= key: 35d58779-ee24-4926-8612-e053ff48881b value: VM , sharedLocks= ]
I'm not sure if I was missing something, or if I needed to wait for something to complete, or what. I ended up just stopping the machine and then starting it from cold.
Any thoughts here? I'm happy to attempt this again and to see if it breaks the same way and to capture more data.
Cheers,
-- Erik Jacobs ATLElite / www.atlelite.com <http://www.atlelite.com> DGTrials / www.DGTrials.com <http://www.DGTrials.com> FestiveGarage / www.FestiveGarage.com <http://www.FestiveGarage.com> Riding Resource / www.RidingResource.com <http://www.RidingResource.com> www.erikjacobs.com <http://www.erikjacobs.com> (C) 646-284-3482 (F) 404-585-4409
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
participants (3)
-
Erik Jacobs -
Haim Ateya -
Maor Lipchuk