Issue with ovirt self hosted engine instalaltion 4.4
Hello, Good Day! I'm Hariharan and I'm working as System Administrator in Linux platform for RWTH Uniklink - Germany. Currently I'm managing the Ovirt environment and I'm very new to this domain. Currently I'm facing an issue with Ovirt self hosted engine installation 4.4 in CentOS 8 server. I have an issue when mounting the glusterfs storage to a target machine. Below is the exact issue what I face; Error: "changed": false, "msg": "Error: the target storage domain contains only 11.0GiB of available space while a minimum of 61.0GiB is required If you wish to use the current target storage domain by extending it, make sure it contains nothing before adding it. Note: (gluster storage was installed and configured in Linux work station with adding additional hard disk in one of the two gluster storage linux work station. I used replicated volumes (replica 2) in creating gluster volumes) Hardware detail: device model: Dell R540 Capacity: 240 GB I tried best possibilities to resolve this issue but still I'm facing the same issue. Could you please help me in resolving this issue with your guidance or support.
When you mount the gluster volume manually and run "df -h /gluster/mount/point" , how much space does it show ? Best Regards, Strahil Nikolov В сряда, 4 ноември 2020 г., 17:48:56 Гринуич+2, hjadavalluva@ukaachen.de <hjadavalluva@ukaachen.de> написа: Hello, Good Day! I'm Hariharan and I'm working as System Administrator in Linux platform for RWTH Uniklink - Germany. Currently I'm managing the Ovirt environment and I'm very new to this domain. Currently I'm facing an issue with Ovirt self hosted engine installation 4.4 in CentOS 8 server. I have an issue when mounting the glusterfs storage to a target machine. Below is the exact issue what I face; Error: "changed": false, "msg": "Error: the target storage domain contains only 11.0GiB of available space while a minimum of 61.0GiB is required If you wish to use the current target storage domain by extending it, make sure it contains nothing before adding it. Note: (gluster storage was installed and configured in Linux work station with adding additional hard disk in one of the two gluster storage linux work station. I used replicated volumes (replica 2) in creating gluster volumes) Hardware detail: device model: Dell R540 Capacity: 240 GB I tried best possibilities to resolve this issue but still I'm facing the same issue. Could you please help me in resolving this issue with your guidance or support. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/QQJ5DNKR3WFTRX...
Dear Mr.Strahil Nikolov, Thanks for yoor quick response! It shows like . Below is the data shared to your knowledge when I mount it manually. Dateisystem Größe Benutzt Verf. Verw% Eingehängt auf 192.168.0.85:/engine 50G 39G 12G 78% /mnt gluster volume : engine Host verser of gluster volume: 192.168.0.85 mount point : /mnt Best Regards, Hariharan
Dear Mr.Strahil Nikolov, Thanks for yoor quick response! It shows like 39G was sued and 12G is still available. Below is the data shared to your knowledge when I mount it manually. Dateisystem Größe Benutzt Verf. Verw% Eingehängt auf 192.168.0.85:/engine 50G 39G 12G 78% /mnt gluster volume : engine Host verser of gluster volume: 192.168.0.85 mount point : /mnt Best Regards, Hariharan
I think the minimum is 60G and it seems that your deployment has failed, so can you cleanup the share and extend it to 65G ? Best Regards, Strahil Nikolov В четвъртък, 5 ноември 2020 г., 11:17:48 Гринуич+2, hjadavalluva@ukaachen.de <hjadavalluva@ukaachen.de> написа: Dear Mr.Strahil Nikolov, Thanks for yoor quick response! It shows like . Below is the data shared to your knowledge when I mount it manually. Dateisystem Größe Benutzt Verf. Verw% Eingehängt auf 192.168.0.85:/engine 50G 39G 12G 78% /mnt gluster volume : engine Host verser of gluster volume: 192.168.0.85 mount point : /mnt Best Regards, Hariharan _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/465PQ3TEV2W67B...
Dear Mr.Strahil Nikolov, Thanks for yoor quick response! It shows like 39G is used and 12G is still available. Below is the data shared to your knowledge when I mount it manually. Dateisystem Größe Benutzt Verf. Verw% Eingehängt auf 192.168.0.85:/engine 50G 39G 12G 78% /mnt gluster volume : engine Host verser of gluster volume: 192.168.0.85 mount point : /mnt Best Regards, Hariharan
Dear Mr.Strahil Nikolov, Thank you once again! "cleanup the share and extend it to 65G ? "- You mean in target server (where the ovirt gets installed)? if so, the target server is in production side (but now its in testing side to test the ovirt deployment) so this needs to be cleaned up? Best Reagrds, Hariharan
Dear Mr.Strahil Nikolov, Thank you once again! "cleanup the share and extend it to 65G ? "- You mean the disk where the gluster storage volume gets mounted in the target server or may I know clearly where I have to clean the space? Also if possible let em know how to increase the disk space? cause its a physical VM so let me have your guidance on how to increase the space on this particular disk. Thanks once again! Best Regards, Hariharan
The engine volume has to be cleaned up . Here is mine: [root@ovirt1 ~]# df -h /rhev/data-center/mnt/glusterSD/gluster1\:_engine/ Filesystem Size Used Avail Use% Mounted on gluster1:/engine 100G 19G 82G 19% /rhev/data-center/mnt/glusterSD/gluster1:_engine It seems that https://www.ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engine... clearly states that 25G is enough. Best Regards, Strahil Nikolov В четвъртък, 5 ноември 2020 г., 15:44:19 Гринуич+2, hjadavalluva@ukaachen.de <hjadavalluva@ukaachen.de> написа: Dear Mr.Strahil Nikolov, Thank you once again! "cleanup the share and extend it to 65G ? "- You mean in target server (where the ovirt gets installed)? if so, the target server is in production side (but now its in testing side to test the ovirt deployment) so this needs to be cleaned up? Best Reagrds, Hariharan _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/3KQXNNAORQ7ZZN...
Moin, Thats sounds interessing. How you can cleanup a gluster volume of the hosted engine. We had an engine running with round 200 VMs on a big systems and every 3 days we los 1 % of the engine storage. the devices has 150 GB and is a replicated over 6 bricks. as this systems has reached the 90 % of the storage we have decide to restart from 0 and have completely rebuild the system.. We have nothing found to clean-up the meta files from the glusterfs. Thanks Marcel ------ Originalnachricht ------ Von: "Strahil Nikolov via Users" <users@ovirt.org> An: "users@ovirt.org" <users@ovirt.org>; "hjadavalluva@ukaachen.de" <hjadavalluva@ukaachen.de> Gesendet: 05.11.2020 17:10:35 Betreff: [ovirt-users] Re: Issue with ovirt self hosted engine instalaltion 4.4
The engine volume has to be cleaned up . Here is mine:
[root@ovirt1 ~]# df -h /rhev/data-center/mnt/glusterSD/gluster1\:_engine/ Filesystem Size Used Avail Use% Mounted on gluster1:/engine 100G 19G 82G 19% /rhev/data-center/mnt/glusterSD/gluster1:_engine
It seems that https://www.ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engine... clearly states that 25G is enough.
Best Regards, Strahil Nikolov
В четвъртък, 5 ноември 2020 г., 15:44:19 Гринуич+2, hjadavalluva@ukaachen.de <hjadavalluva@ukaachen.de> написа:
Dear Mr.Strahil Nikolov,
Thank you once again!
"cleanup the share and extend it to 65G ? "- You mean in target server (where the ovirt gets installed)? if so, the target server is in production side (but now its in testing side to test the ovirt deployment) so this needs to be cleaned up?
Best Reagrds,
Hariharan _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/3KQXNNAORQ7ZZN... _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/QBGH255AZDLRXS...
Well, cleanup for me means to just mount the volume and delete any data there. Yet, this means that you are willing to loose the data there and you should do it only if you plan to reuse the volume (for example for redeploying the engine). Let's summarize . Your engine failed, so you tried to rebuild it from scratch but it is complaining as it has too few space on the volume - right ? Best Regards, Strahil Nikolov В четвъртък, 5 ноември 2020 г., 20:44:48 Гринуич+2, Marcel <marcel@deheureu.se> написа: Moin, Thats sounds interessing. How you can cleanup a gluster volume of the hosted engine. We had an engine running with round 200 VMs on a big systems and every 3 days we los 1 % of the engine storage. the devices has 150 GB and is a replicated over 6 bricks. as this systems has reached the 90 % of the storage we have decide to restart from 0 and have completely rebuild the system.. We have nothing found to clean-up the meta files from the glusterfs. Thanks Marcel ------ Originalnachricht ------ Von: "Strahil Nikolov via Users" <users@ovirt.org> An: "users@ovirt.org" <users@ovirt.org>; "hjadavalluva@ukaachen.de" <hjadavalluva@ukaachen.de> Gesendet: 05.11.2020 17:10:35 Betreff: [ovirt-users] Re: Issue with ovirt self hosted engine instalaltion 4.4
The engine volume has to be cleaned up . Here is mine:
[root@ovirt1 ~]# df -h /rhev/data-center/mnt/glusterSD/gluster1\:_engine/ Filesystem Size Used Avail Use% Mounted on gluster1:/engine 100G 19G 82G 19% /rhev/data-center/mnt/glusterSD/gluster1:_engine
It seems that https://www.ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engine... clearly states that 25G is enough.
Best Regards, Strahil Nikolov
В четвъртък, 5 ноември 2020 г., 15:44:19 Гринуич+2, hjadavalluva@ukaachen.de <hjadavalluva@ukaachen.de> написа:
Dear Mr.Strahil Nikolov,
Thank you once again!
"cleanup the share and extend it to 65G ? "- You mean in target server (where the ovirt gets installed)? if so, the target server is in production side (but now its in testing side to test the ovirt deployment) so this needs to be cleaned up?
Best Reagrds,
Hariharan _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/3KQXNNAORQ7ZZN...
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/QBGH255AZDLRXS...
No, the edge was running and we have crashed the engine with reboot hard or setup a server with the same IP address to see what happens. all tests will be solved well but the .shred folder of the gluster will be bigger and bigger. the engine it selve has round 5 GB but the .shred has 60 up to 90 GB. so I want to let the engine like it is but the .shred folder I want to clean. or will the oldest files delete by gluster and I don't need to do anything? br marcel Am 5. November 2020 22:11:51 MEZ schrieb Strahil Nikolov <hunter86_bg@yahoo.com>:
Well,
cleanup for me means to just mount the volume and delete any data there. Yet, this means that you are willing to loose the data there and you should do it only if you plan to reuse the volume (for example for redeploying the engine).
Let's summarize . Your engine failed, so you tried to rebuild it from scratch but it is complaining as it has too few space on the volume - right ?
Best Regards, Strahil Nikolov
В четвъртък, 5 ноември 2020 г., 20:44:48 Гринуич+2, Marcel <marcel@deheureu.se> написа:
Moin,
Thats sounds interessing. How you can cleanup a gluster volume of the hosted engine.
We had an engine running with round 200 VMs on a big systems and every 3 days we los 1 % of the engine storage. the devices has 150 GB and is a replicated over 6 bricks. as this systems has reached the 90 % of the storage we have decide to restart from 0 and have completely rebuild the system..
We have nothing found to clean-up the meta files from the glusterfs.
Thanks Marcel
------ Originalnachricht ------ Von: "Strahil Nikolov via Users" <users@ovirt.org> An: "users@ovirt.org" <users@ovirt.org>; "hjadavalluva@ukaachen.de" <hjadavalluva@ukaachen.de> Gesendet: 05.11.2020 17:10:35 Betreff: [ovirt-users] Re: Issue with ovirt self hosted engine instalaltion 4.4
The engine volume has to be cleaned up . Here is mine:
[root@ovirt1 ~]# df -h /rhev/data-center/mnt/glusterSD/gluster1\:_engine/ Filesystem Size Used Avail Use% Mounted on gluster1:/engine 100G 19G 82G 19% /rhev/data-center/mnt/glusterSD/gluster1:_engine
It seems that https://www.ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engine... clearly states that 25G is enough.
Best Regards, Strahil Nikolov
В четвъртък, 5 ноември 2020 г., 15:44:19 Гринуич+2, hjadavalluva@ukaachen.de <hjadavalluva@ukaachen.de> написа:
Dear Mr.Strahil Nikolov,
Thank you once again!
"cleanup the share and extend it to 65G ? "- You mean in target server (where the ovirt gets installed)? if so, the target server is in production side (but now its in testing side to test the ovirt deployment) so this needs to be cleaned up?
Best Reagrds,
Hariharan _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/3KQXNNAORQ7ZZN...
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/QBGH255AZDLRXS...
What is the output of 'gluster volume info engine' & 'gluster volume status engine' (where engine is the volume name) ? Best Regards, Strahil Nikolov В четвъртък, 5 ноември 2020 г., 23:37:35 Гринуич+2, marcel d'heureuse <marcel@deheureu.se> написа: No, the edge was running and we have crashed the engine with reboot hard or setup a server with the same IP address to see what happens. all tests will be solved well but the .shred folder of the gluster will be bigger and bigger. the engine it selve has round 5 GB but the .shred has 60 up to 90 GB. so I want to let the engine like it is but the .shred folder I want to clean. or will the oldest files delete by gluster and I don't need to do anything? br marcel Am 5. November 2020 22:11:51 MEZ schrieb Strahil Nikolov <hunter86_bg@yahoo.com>:
Well,cleanup for me means to just mount the volume and delete any data there.Yet, this means that you are willing to loose the data there and you should do it only if you plan to reuse the volume (for example for redeploying the engine).Let's summarize . Your engine failed, so you tried to rebuild it from scratch but it is complaining as it has too few space on the volume - right ?Best Regards,Strahil NikolovВ четвъртък, 5 ноември 2020 г., 20:44:48 Гринуич+2, Marcel <marcel@deheureu.se> написа: Moin,Thats sounds interessing. How you can cleanup a gluster volume of the hosted engine.We had an engine running with round 200 VMs on a big systems and every 3 days we los 1 % of the engine storage. the devices has 150 GB and is a replicated over 6 bricks.as this systems has reached the 90 % of the storage we have decide to restart from 0 and have completely rebuild the system..We have nothing found to clean-up the meta files from the glusterfs.ThanksMarcel------ Originalnachricht ------Von: "Strahil Nikolov via Users" <users@ovirt.org>An: "users@ovirt.org" <users@ovirt.org>; "hjadavalluva@ukaachen.de" <hjadavalluva@ukaachen.de>Gesendet: 05.11.2020 17:10:35Betreff: [ovirt-users] Re: Issue with ovirt self hosted engine instalaltion 4.4> The engine volume has to be cleaned up .
Here is mine:
[root@ovirt1 ~]# df -h /rhev/data-center/mnt/glusterSD/gluster1\:_engine/ Filesystem Size Used Avail Use% Mounted on gluster1:/engine 100G 19G 82G 19% /rhev/data-center/mnt/glusterSD/gluster1:_engine
It seems that https://www.ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engine... clearly states that 25G is enough.
Best Regards, Strahil Nikolov
В четвъртък, 5 ноември 2020 г., 15:44:19 Гринуич+2, hjadavalluva@ukaachen.de <hjadavalluva@ukaachen.de> написа:
Dear Mr.Strahil Nikolov,
Thank you once again!
"cleanup the share and extend it to 65G ? "- You mean in target server (where the ovirt gets installed)? if so, the target server is in production side (but now its in testing side to test the ovirt deployment) so this needs to be cleaned up?
Best Reagrds,
Hariharan ________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/3KQXNNAORQ7ZZN...
________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/QBGH255AZDLRXS...
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/BGRMEB354LOFWV...
Dear Mr.Strahil Nikolov, Thank you once again! I tried cleaning up the storage path but I'm still facing this same issue. I would like to know whether am I doing it in a correct way or not. I jus deleted the storage data and again ran the script from the error point but still the same error. Could you guide me on how to cleanup the storage in any other means? Best Regards, Hariharan
Cleaning up is OK, but I got no idea why it fails. What was the exact error ? Best Regards, Strahil Nikolov В петък, 6 ноември 2020 г., 12:38:03 Гринуич+2, hjadavalluva@ukaachen.de <hjadavalluva@ukaachen.de> написа: Dear Mr.Strahil Nikolov, Thank you once again! I tried cleaning up the storage path but I'm still facing this same issue. I would like to know whether am I doing it in a correct way or not. I jus deleted the storage data and again ran the script from the error point but still the same error. Could you guide me on how to cleanup the storage in any other means? Best Regards, Hariharan _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/YHX2ZMCS5PCYNY...
Dear Mr.Strahil Nikolov, Thank you once again! Again, I'm getting the same error as before. Below is the error; fatal: [localhost]: FAILED! => {"changed": false, "msg": "Error: the target storage domain contains only 11.0GiB of available space while a minimum of 61.0GiB is required If you wish to use the current target storage domain by extending it, make sure it contains nothing before adding it."} Can you help me in adding the space in this storage path(/rhev/data-center/mnt/glusterSD/192.168.0.85:_engine)? I mean, how to add the space for this path? cause it contains only 50G but I think min 90G is required. Can you guide in adding the space in this storage? Best Regards, Hariharan
You just need to get the bricks via: gluster volume info engine Then you need to go to each server and extend the mount point to at least 61GB. Also, you need to mount and delete everything inside the content. Last issue: /usr/sbin/ovirt-hosted-engine-cleanup Best Regards, Strahil Nikolov В петък, 6 ноември 2020 г., 15:30:13 Гринуич+2, <hjadavalluva@ukaachen.de> написа: Dear Mr.Strahil Nikolov, Thank you once again! Again, I'm getting the same error as before. Below is the error; fatal: [localhost]: FAILED! => {"changed": false, "msg": "Error: the target storage domain contains only 11.0GiB of available space while a minimum of 61.0GiB is required If you wish to use the current target storage domain by extending it, make sure it contains nothing before adding it."} Can you help me in adding the space in this storage path(/rhev/data-center/mnt/glusterSD/192.168.0.85:_engine)? I mean, how to add the space for this path? cause it contains only 50G but I think min 90G is required. Can you guide in adding the space in this storage? Best Regards, Hariharan _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/53G2ORCUSEDK4M...
Dear Mr.Strahil Nikolov,, "Then you need to go to each server and extend the mount point to at least 61GB." - this means I have to get into each bricks (brick 1 & brick2) then have to extend the mount point on each bricks at-least 61GB? Let me know if I understood correct or not. Thanks once again! Best Regards, Hariharan
Yes, replica volume size is the size of the smallest brick. If you have 3 hosts with 3 directories called /gluster_bricks/engine/engine , you need to extend every block device that is used for mounting on /gluster_bricks/engine. Best Regards, Strahil Nikolov В петък, 6 ноември 2020 г., 18:35:11 Гринуич+2, hjadavalluva@ukaachen.de <hjadavalluva@ukaachen.de> написа: Dear Mr.Strahil Nikolov,, "Then you need to go to each server and extend the mount point to at least 61GB." - this means I have to get into each bricks (brick 1 & brick2) then have to extend the mount point on each bricks at-least 61GB? Let me know if I understood correct or not. Thanks once again! Best Regards, Hariharan _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/J5DTRHB2ZKVPM4...
participants (4)
-
hjadavalluva＠ukaachen.de -
Marcel -
marcel d'heureuse
-
Strahil Nikolov