I have 2 vm's, which are the most important in my world, that paused and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space. I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know.
On February 18, 2020 6:52:44 AM GMT+02:00, eevans@digitaldatatechs.com wrote:
I have 2 vm's, which are the most important in my world, that paused and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space. I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JBXNV3WT2W72I2...
Anything in libvirt/vdsm logs ? Did you update gluster recently ? I had such issues when gluster refused reading of shards. Can you read the disk via: sudo -u vdsm dd if=/rhev/full/path/to/mountpoint/long_string_representing_file of=/dev/null bs=4M status=progress What happens when you run dd as root -> can you read from the image ? Any errors in gluster logs ? Best Regards, Strahil Nikolov
What version of ovirt are you running? What is your storage domain, nfs or gluster? Using libglfapi? How full is your storage domain? If it’s gluster, what type is it and how full are all the bricks? Have you tried stopping and restarting them? Not ideal, but may get you a running system again. Are there other VMs which continue running without trouble? If so, do these two do heavy disk IO? good luck, -Darrell
On Feb 17, 2020, at 11:57 PM, Strahil Nikolov <hunter86_bg@yahoo.com> wrote:
On February 18, 2020 6:52:44 AM GMT+02:00, eevans@digitaldatatechs.com wrote:
I have 2 vm's, which are the most important in my world, that paused and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space. I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JBXNV3WT2W72I2...
Anything in libvirt/vdsm logs ?
Did you update gluster recently ? I had such issues when gluster refused reading of shards. Can you read the disk via: sudo -u vdsm dd if=/rhev/full/path/to/mountpoint/long_string_representing_file of=/dev/null bs=4M status=progress
What happens when you run dd as root -> can you read from the image ?
Any errors in gluster logs ?
Best Regards, Strahil Nikolov _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/AVNOLJSLTXOHPJ...
On Tue, Feb 18, 2020 at 6:56 AM <eevans@digitaldatatechs.com> wrote:
I have 2 vm's, which are the most important in my world, that paused and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space.
Can you share the VM XML of these VMs? The easier way is: # virsh -r list # virsh -r dumpxml vm-id Also having vdsm.log from the time the vm was paused would help to understand why the vm was paused. For block storage, paused vms are expected to be resumed once the vm disk is extended, or if the vm paused because storage was not accessible temporarily, once the storage becomes accessible again. For file based storage, we don't support yet resuming paused vms. Nir
I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JBXNV3WT2W72I2...
When I used virsh it always asks for credentials. I used the saslpasswd and gave a user a password to get it to work, but it still failed. I had copies of my disks and had to import them to get it up and running again. I will definitely try this if it crops up again. I hope I never have to. Thanks for your help. Eric Evans Digital Data Services LLC. 304.660.9080 -----Original Message----- From: Nir Soffer <nsoffer@redhat.com> Sent: Tuesday, February 18, 2020 12:00 PM To: eevans@digitaldatatechs.com Cc: users <users@ovirt.org> Subject: [ovirt-users] Re: paused vm's will not resume On Tue, Feb 18, 2020 at 6:56 AM <eevans@digitaldatatechs.com> wrote:
I have 2 vm's, which are the most important in my world, that paused and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space.
Can you share the VM XML of these VMs? The easier way is: # virsh -r list # virsh -r dumpxml vm-id Also having vdsm.log from the time the vm was paused would help to understand why the vm was paused. For block storage, paused vms are expected to be resumed once the vm disk is extended, or if the vm paused because storage was not accessible temporarily, once the storage becomes accessible again. For file based storage, we don't support yet resuming paused vms. Nir
I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JBXNV3WT 2W72I2E7EXM2KY4YN37STIMC/
Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KFU4CMDLWBPARN...
This default credentials may help you for virsh operations: login: vdsm@ovirt password: shibboleth Le 18/02/2020 à 19:45, eevans@digitaldatatechs.com a écrit :
When I used virsh it always asks for credentials. I used the saslpasswd and gave a user a password to get it to work, but it still failed. I had copies of my disks and had to import them to get it up and running again. I will definitely try this if it crops up again. I hope I never have to. Thanks for your help.
Eric Evans Digital Data Services LLC. 304.660.9080
-----Original Message----- From: Nir Soffer <nsoffer@redhat.com> Sent: Tuesday, February 18, 2020 12:00 PM To: eevans@digitaldatatechs.com Cc: users <users@ovirt.org> Subject: [ovirt-users] Re: paused vm's will not resume
On Tue, Feb 18, 2020 at 6:56 AM <eevans@digitaldatatechs.com> wrote:
I have 2 vm's, which are the most important in my world, that paused and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space. Can you share the VM XML of these VMs?
The easier way is:
# virsh -r list
# virsh -r dumpxml vm-id
Also having vdsm.log from the time the vm was paused would help to understand why the vm was paused.
For block storage, paused vms are expected to be resumed once the vm disk is extended, or if the vm paused because storage was not accessible temporarily, once the storage becomes accessible again.
For file based storage, we don't support yet resuming paused vms.
Nir
I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JBXNV3WT 2W72I2E7EXM2KY4YN37STIMC/
Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KFU4CMDLWBPARN... _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JRBRYRWDG5XLKV...
-- Nathanaël Blanchet Supervision réseau SIRE 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet@abes.fr
On Tue, Feb 18, 2020 at 8:46 PM <eevans@digitaldatatechs.com> wrote:
When I used virsh it always asks for credentials.
This is why I use the -r flag. $ man virsh ... · -r, --readonly Make the initial connection read-only, as if by the --readonly option of the connect command.
-----Original Message----- From: Nir Soffer <nsoffer@redhat.com> Sent: Tuesday, February 18, 2020 12:00 PM To: eevans@digitaldatatechs.com Cc: users <users@ovirt.org> Subject: [ovirt-users] Re: paused vm's will not resume
On Tue, Feb 18, 2020 at 6:56 AM <eevans@digitaldatatechs.com> wrote:
I have 2 vm's, which are the most important in my world, that paused and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space.
Can you share the VM XML of these VMs?
The easier way is:
# virsh -r list
# virsh -r dumpxml vm-id
Also having vdsm.log from the time the vm was paused would help to understand why the vm was paused.
For block storage, paused vms are expected to be resumed once the vm disk is extended, or if the vm paused because storage was not accessible temporarily, once the storage becomes accessible again.
For file based storage, we don't support yet resuming paused vms.
Nir
I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JBXNV3WT 2W72I2E7EXM2KY4YN37STIMC/
Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KFU4CMDLWBPARN...
On February 18, 2020 8:45:34 PM GMT+02:00, eevans@digitaldatatechs.com wrote:
When I used virsh it always asks for credentials. I used the saslpasswd and gave a user a password to get it to work, but it still failed. I had copies of my disks and had to import them to get it up and running again. I will definitely try this if it crops up again. I hope I never have to. Thanks for your help.
Eric Evans Digital Data Services LLC. 304.660.9080
-----Original Message----- From: Nir Soffer <nsoffer@redhat.com> Sent: Tuesday, February 18, 2020 12:00 PM To: eevans@digitaldatatechs.com Cc: users <users@ovirt.org> Subject: [ovirt-users] Re: paused vm's will not resume
On Tue, Feb 18, 2020 at 6:56 AM <eevans@digitaldatatechs.com> wrote:
I have 2 vm's, which are the most important in my world, that paused
and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space.
Can you share the VM XML of these VMs?
The easier way is:
# virsh -r list
# virsh -r dumpxml vm-id
Also having vdsm.log from the time the vm was paused would help to understand why the vm was paused.
For block storage, paused vms are expected to be resumed once the vm disk is extended, or if the vm paused because storage was not accessible temporarily, once the storage becomes accessible again.
For file based storage, we don't support yet resuming paused vms.
Nir
I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/JBXNV3WT
2W72I2E7EXM2KY4YN37STIMC/
Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KFU4CMDLWBPARN... _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JRBRYRWDG5XLKV...
Hi Eric, In order to use virsh , set the following alias: alias virsh='virsh -c qemu:///system?authfile=/etc/ovirt-hosted-engine/virsh_auth.conf' Best Regards, Strahil Nikolov
I had several vm's pause again. The message in the event log is: VDSM command SetVolumeDescriptionVDS failed: Volume does not exist: (u'e3f79840-8355-45b0-ad2b-440c877be637',) I restarted nfs on that node and clicked run and they all resumed. This is local storage on the node with over 200GB of free space but they were paused due to a storage error. Do you still want the xml files? It seems ovirt is losing contact with the export. Eric Evans Digital Data Services LLC. 304.660.9080 -----Original Message----- From: Nir Soffer <nsoffer@redhat.com> Sent: Tuesday, February 18, 2020 12:00 PM To: eevans@digitaldatatechs.com Cc: users <users@ovirt.org> Subject: [ovirt-users] Re: paused vm's will not resume On Tue, Feb 18, 2020 at 6:56 AM <eevans@digitaldatatechs.com> wrote:
I have 2 vm's, which are the most important in my world, that paused and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space.
Can you share the VM XML of these VMs? The easier way is: # virsh -r list # virsh -r dumpxml vm-id Also having vdsm.log from the time the vm was paused would help to understand why the vm was paused. For block storage, paused vms are expected to be resumed once the vm disk is extended, or if the vm paused because storage was not accessible temporarily, once the storage becomes accessible again. For file based storage, we don't support yet resuming paused vms. Nir
I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JBXNV3WT 2W72I2E7EXM2KY4YN37STIMC/
Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KFU4CMDLWBPARN...
On Wed, Feb 19, 2020 at 8:23 AM <eevans@digitaldatatechs.com> wrote:
I had several vm's pause again. The message in the event log is: VDSM command SetVolumeDescriptionVDS failed: Volume does not exist: (u'e3f79840-8355-45b0-ad2b-440c877be637',) I restarted nfs on that node and clicked run and they all resumed. This is local storage on the node with over 200GB of free space but they were paused due to a storage error. Do you still want the xml files? It seems ovirt is losing contact with the export.
Yes, having the VM XML is the first step to understand your deployment.
Eric Evans Digital Data Services LLC. 304.660.9080
-----Original Message----- From: Nir Soffer <nsoffer@redhat.com> Sent: Tuesday, February 18, 2020 12:00 PM To: eevans@digitaldatatechs.com Cc: users <users@ovirt.org> Subject: [ovirt-users] Re: paused vm's will not resume
On Tue, Feb 18, 2020 at 6:56 AM <eevans@digitaldatatechs.com> wrote:
I have 2 vm's, which are the most important in my world, that paused and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space.
Can you share the VM XML of these VMs?
The easier way is:
# virsh -r list
# virsh -r dumpxml vm-id
Also having vdsm.log from the time the vm was paused would help to understand why the vm was paused.
For block storage, paused vms are expected to be resumed once the vm disk is extended, or if the vm paused because storage was not accessible temporarily, once the storage becomes accessible again.
For file based storage, we don't support yet resuming paused vms.
Nir
I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JBXNV3WT 2W72I2E7EXM2KY4YN37STIMC/
Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KFU4CMDLWBPARN...
I've had problems with resuming after pausing VMs if you changed the compatibility level without rebooting VMs to new level: https://bugzilla.redhat.com/show_bug.cgi?id=1693813 so depending on if you're already on a recent version this could be an issue. Note https://bugzilla.redhat.com/show_bug.cgi?id=1693813#c6 for a possible way to resume the VMs in this state. Greetings Klaas On 18.02.20 05:52, eevans@digitaldatatechs.com wrote:
I have 2 vm's, which are the most important in my world, that paused and will not resume. I have googled this to death but no solution. It stated a lack of space but none of the drives on my hosts are using more than 30% or there space and these 2 have ran on kvm host for several years and always had at least 50% free space. I like ovirt and want to use it but I cannot tolerate the down time. If I cannot get this resolved, I'm going back to kvm hosts. I am pulling my hair out here. If anyone can help with this issue, please let me know. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JBXNV3WT2W72I2...
participants (6)
-
Darrell Budic -
eevans＠digitaldatatechs.com -
klaasdemter＠gmail.com -
Nathanaël Blanchet -
Nir Soffer -
Strahil Nikolov