Thanks for the reply. I have been told by a couple of different people not use software raid with this gluster setup. Did you end creating your volumes in command line or did you follow the wizard? Thanks

Once again thanks for the reply. I have 3 identical drives in EACH host. Thanks

Thanks. Trying to figure out if I should use dedup/comp now. If I don't is the total usable space if I follow your setup guide for my storage domain going to be 21tb once I am done with everything (3 vm storage volumes, one per disk)? Thanks, Donnie

You are using NVMEs, so you can safely use JBOD mode. I think that the size should be for a single disk, but you can experiment on that. If the LVs are too small, you can just extend them or even recreate them. What is you network speed ? If your network bandwidth matches your NVMEs' combined Read speed - then avoid dedup and compression unless you really need them. Most probably your NVMEs have a 4096 sector size . If yes, you will need vdo with '--emulate512'. Yet, tuning VDO for such fast devices is not a trivial task. Most probably you can configure a VDO per each NVME (or even per pertition/lv) , and configure it with compression and dedup disabled (emulate512 only if needed). Also check the UDS index topic, as it is quite important: https://access.redhat.com/documentation/en_us/red_hat_enterprise_linux/7/... If your network is slower than your disks, you can enable dedup and compression. Also gluster has a setting called 'cluster.choose-local' . You can enable it in order to tell the FUSE driver to prefer local brick instead those over the network. Best Regards, Strahil Nikolov В сряда, 2 декември 2020 г., 14:10:21 Гринуич+2, dofranklin(a)port-orange.org <dofranklin(a)port-orange.org&gt; написа: I am about to setup a new hyperconverged setup with the following 3 host setup 2 x nvme 240gb hd for OS on each host (raid) 3 x nvme 7 tb hd for vm storage on each host (no raid card) 500gb RAM per each host I am confused during the gluster setup portion using the web ui setup wizard.  When asked for the LV size do I input the maximum size of the hard drive on a single host or do I combine the total capacity of the matching hard drives on all 3 host?  Example that I would be putting in is hard drive: /dev/nvme1p1 capacity 7tb or should it be 21tb (combined capacity of the matching single HD on the other host).  Or is there a better method you recommend?  And since I am using nvme hard drive would you recommend using dedup and compression or no? Thanks _______________________________________________ Users mailing list -- users(a)ovirt.org To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/CLIXBOMZ7EE...

With 10GBE you can reach no more than 1.25GB , so you should enable cluster.choose-local if your disks can squeeze more than that. With Replica 3 , you got 1/3 of total space so it seems normal. You can always expand a distributed-replicated volume as long as you expand with 3 bricks at a time (but you will have to rebalance your volume). Keep the replica set (the 3 bricks) of the same size or you will waste space. Best Regards, Strahil Nikolov В четвъртък, 3 декември 2020 г., 21:29:16 Гринуич+2, cpo cpo <dofranklin(a)port-orange.org&gt; написа: Thanks for info.  My storage network speed is 10gb.  I rolled out a config where I created 2 domains 1 for and engine the other for vmstore.  I decided not to use dedup.  I kept my 3 disk on each host  non raided.  For my vmstore domain I created 9 bricks 1 for each physical disk with a LV size of 6.6tb  I created the bricks using the gui wizard. The management engine says I have 19tb of useable space  and my vmstore volume is distributed replicate.  Would it be ok to create more bricks for this domain with 6.6 TB LV size or will I run into issues with physical space?  The reason why I ask is the having 40TB of physical space and only getting 20 TB usable space in my current config gives me a little heart burn. Thanks _______________________________________________ Users mailing list -- users(a)ovirt.org To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KBBDIQ42YIW...