November 2017 - Users - oVirt List Archives

recommendations for best performance and reliability
by Rudi Ahlers 14 Nov '17

14 Nov '17

Hi, Can someone please give me some pointers, what would be the best setup for performance and reliability? We have the following hardware setup: 3x Supermicro server with following features per server: 128GB RAM 4x 8TB SATA HDD 2x SSD drives (intel_ssdsc2ba400g4 - 400GB DC S3710) 2x 12 core CPU (Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz Quad port 10Gbe Inter NIC 2x 10GB Cisco switches (to isolate storage network from LAN) One of the servers will be in another office, with a 600Mb wireless link for Disaster Recovery. What is recommended for the best setup in terms of redundancy and speed? I am guessing GlusterFS with a Distributed Striped Replicated Volume across 3 of the servers. For added performance I want to use the SSD drives, perhaps with dm-cache? Should I combine the 4x HDD's using LVM on each host node? What about RAID 6? Virtual Machines will then reside on the oVirt Cluster and any one of the 3 host nodes can fail, or any single HDD can fail and all should still work, right/? -- Kind Regards Rudi Ahlers Website: http://www.rudiahlers.co.za

4 3

Re: [ovirt-users] how to redo oVirt cluster?
by Luca 'remix_tj' Lorenzetto 14 Nov '17

14 Nov '17

Usually db is inside the engine vm. Is a postgres. Deleting it is not a problem, engine installation tools should recreate itt. Il 14 nov 2017 8:05 AM, "Rudi Ahlers" <rudiahlers(a)gmail.com> ha scritto: > Hi Luca, > > Where is the engine DB stored? Can I simply delete it, or would that > compromise a reinstallation? Though I can't imagine it would be problem. > > On Tue, Nov 14, 2017 at 8:58 AM, Luca 'remix_tj' Lorenzetto < > lorenzetto.luca(a)gmail.com> wrote: > >> Hello Rudi, >> >> I think that uninstalling ovirt-engine and removing vdsm from hosts >> should be enough. Pay attention to cleaning up engine db which contains all >> the engine data. >> >> Luca >> >> >> Il 14 nov 2017 7:20 AM, "Rudi Ahlers" <rudiahlers(a)gmail.com> ha scritto: >> >>> Hi, >>> >>> I have setup an oVirt cluster and did some tests. But how do I redo >>> everything, without reinstalling CentOS as well? >>> Would it be as simple as uninstalling all the ovirt? Or do I need to >>> manually delete some config files and other traces off the install as well? >>> >>> -- >>> Kind Regards >>> Rudi Ahlers >>> Website: http://www.rudiahlers.co.za >>> >>> _______________________________________________ >>> Users mailing list >>> Users(a)ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >>> >>> > > > -- > Kind Regards > Rudi Ahlers > Website: http://www.rudiahlers.co.za >

1 0

how to redo oVirt cluster?
by Rudi Ahlers 14 Nov '17

14 Nov '17

Hi, I have setup an oVirt cluster and did some tests. But how do I redo everything, without reinstalling CentOS as well? Would it be as simple as uninstalling all the ovirt? Or do I need to manually delete some config files and other traces off the install as well? -- Kind Regards Rudi Ahlers Website: http://www.rudiahlers.co.za

3 2

Unable to clone a vm
by Budur Nagaraju 14 Nov '17

14 Nov '17

HI When I clone a vm from the existing vm , getting the error " https://pastebin.com/2p90TU2y". Below is the attached logs ,can some one help me on this ? https://pastebin.com/2p90TU2y Thanks, Nagaraju

1 0

Re: [ovirt-users] iSCSI domain on 4kn drives
by Martijn Grendelman 13 Nov '17

13 Nov '17

--------------DE48748F7C67E1FABE46EEAF Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Op 7-8-2016 om 8:19 schreef Yaniv Kaul: > > On Fri, Aug 5, 2016 at 4:42 PM, Martijn Grendelman > <martijn.grendelman(a)isaac.nl <mailto:martijn.grendelman@isaac.nl>> wrote: > > Op 4-8-2016 om 18:36 schreef Yaniv Kaul: >> On Thu, Aug 4, 2016 at 11:49 AM, Martijn Grendelman >> <martijn.grendelman(a)isaac.nl >> <mailto:martijn.grendelman@isaac.nl>> wrote: >> >> Hi, >> >> Does oVirt support iSCSI storage domains on target LUNs using >> a block >> size of 4k? >> >> >> No, we do not - not if it exposes 4K blocks. >> Y. > > Is this on the roadmap? > > > Not in the short term roadmap. > Of course, patches are welcome. It's mainly in VDSM. > I wonder if it'll work in NFS. > Y. I don't think I ever replied to this, but I can confirm that in RHEV 3.6 it works with NFS. Best regards, Martijn. --------------DE48748F7C67E1FABE46EEAF Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: 7bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> Op 7-8-2016 om 8:19 schreef Yaniv Kaul:<br> <blockquote cite="mid:280cfbd3a16ad1b76cc7de56bda88f45,CAJgorsbJHLV1e3fH4b4AR3GBp1oi44fDhfeii+PQ1iY1RwUStw@mail.gmail.com" type="cite"> <div dir="ltr"><br> <div class="gmail_extra">On Fri, Aug 5, 2016 at 4:42 PM, Martijn Grendelman <span dir="ltr"><<a moz-do-not-send="true" href="mailto:martijn.grendelman@isaac.nl" target="_blank">martijn.grendelman(a)isaac.nl</a>></span> wrote:<br> <div class="gmail_quote"> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000"> Op 4-8-2016 om 18:36 schreef Yaniv Kaul:<br> <blockquote type="cite"> <div dir="ltr"> <div class="gmail_extra"> <div class="gmail_quote"><span class="">On Thu, Aug 4, 2016 at 11:49 AM, Martijn Grendelman <span dir="ltr"><<a moz-do-not-send="true" href="mailto:martijn.grendelman@isaac.nl" target="_blank">martijn.grendelman(a)isaac.nl</a>></span> wrote:<br> </span><span class=""> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi,<br> <br> Does oVirt support iSCSI storage domains on target LUNs using a block<br> size of 4k?<br> </blockquote> <div><br> </div> </span><span class=""> <div>No, we do not - not if it exposes 4K blocks.</div> <div>Y.</div> </span></div> </div> </div> </blockquote> <br> Is this on the roadmap?<br> </div> </blockquote> <div><br> </div> <div>Not in the short term roadmap.</div> <div>Of course, patches are welcome. It's mainly in VDSM.</div> <div>I wonder if it'll work in NFS.</div> <div>Y.</div> </div> </div> </div> </blockquote> <br> I don't think I ever replied to this, but I can confirm that in RHEV 3.6 it works with NFS.<br> <br> Best regards,<br> Martijn.<br> </body> </html> --------------DE48748F7C67E1FABE46EEAF--

4 4

Host in kdumping state
by Davide Ferrari 13 Nov '17

13 Nov '17

Hello I've got a faulty host that keeps rebooting itself from time to time (due to HW issues), that is/was part of the 3 hosts group hosting the HostedEngine, and now it always appears as "Kdumping" in the web administration panel. All my hosts are oVirt 4.1 on Centos 7.3 with glusterfs 3.7 but this one that was updated by mistake to Centos 7.4 with glusterfs 3.8. Is this due to the different OS/gluster version? How can I "reset" it? I want to remove it permanently and assign the HostedEngine to another host? Moreover, the main glusterfs volume, the one which holds the HE image, has some bricks on this failing machine (vm03): # gluster volume status data_ssd Status of volume: data_ssd Gluster process TCP Port RDMA Port Online Pid ------------------------------------------------------------------------------ Brick vm01.storage.billy:/gluster/ssd/data/ brick 49156 0 Y 6039 Brick vm02.storage.billy:/gluster/ssd/data/ brick 49153 0 Y 99097 Brick vm03.storage.billy:/gluster/ssd/data/ arbiter_brick 49159 0 Y 5325 Brick vm03.storage.billy:/gluster/ssd/data/ brick N/A N/A N N/A Brick vm04.storage.billy:/gluster/ssd/data/ brick 49152 0 Y 14811 Brick vm02.storage.billy:/gluster/ssd/data/ arbiter_brick 49154 0 Y 99104 Self-heal Daemon on localhost N/A N/A Y 6753 Self-heal Daemon on vm01.storage.billy N/A N/A Y 79317 Self-heal Daemon on vm02.storage.billy N/A N/A Y 41778 Self-heal Daemon on vm04.storage.billy N/A N/A Y 125116 What's the best way to replace them? Is this guide still useful? https://support.rackspace.com/how-to/recover-from-a-failed-server-in-a-glus… (I guess so) Thanks! -- Davide Ferrari Lead System Engineer Billy Performance Network

2 3

oVirt 4.1 - "Create virtual disk - thin provisioning" makes RAW by default not QCOW2
by andreil1 13 Nov '17

13 Nov '17

Hi, Just got test setup of oVirt 4.1 running. Seem to be really brilliant piece of software. 1) Defined local storage domain. Create virtual disk - thin provisioning makes RAW images by default instead of QCOW2. It preallocated all space in advance. I looked inside META file in the same folder as disk image - it is marked as RAW. May be its converted to RAW because I formatted it as 3 partitions: SWAP + Boot Ext4 + Root Ext4 ? Should I use single Ext4 partition per virtual disk image to keep it QCOW2 ? Is there any way to change this behaviour, or convert RAW into QCOW2 within oVirt? Certainly I can do it with QEMU, but image become unregistered, or may be some functionality become broken. 2) SWAP partition - is it better to create small 1GB SWAP as RAM disk or use 4GB partition on virtual RAW disk, or I’m wrong here ? Thanks in advance. Andrei

1 0

Re: [ovirt-users] recommendations for best performance and reliability
by FERNANDO FREDIANI 13 Nov '17

13 Nov '17

This is a multi-part message in MIME format. --------------6C7C95E00858D75DD80BDF80 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hello Rudi If you have a 4th server it may work,but I am not knowledgeable about Gluster's GEOreplication. Perhaps someone else can advise. With regards RAID 5 for 4 disks this is intended for capacity and as mentioned 4 disks is the maximum I would use for RAID5. As you have SSDs and intend to use a caching technique like bcache ou dm-cache this should cover the performance hit of RAID 5 write. If you consider using RAID 6 in only 4 disks you are much better of using RAID 10 then as you will have double write performance and same capacity. I normally use RAID 10 or in ZFS configurations (not this case) multiple vdevs of RAID6. For RAID in Linux I have been using mdraid. I know LVM does some Raid but I personally never done myself so can't advise. Regards. Fernando On 13/11/2017 10:19, Rudi Ahlers wrote: > Hi Fernando, > > Thanx. > > I meant to say, the 4th server will be in another office. It's about > 3Km away and I was thinking of using Gluster's GEOreplication for this > purpose. > > I am not a fond user of RAID5 at all. But this raises the question: > does RAID add any unnecessary overhead? I would rather run RAID 6 or > RAI10. > And then, if RAID is the preferred way (over LVM?), as I don't have > dedicated hardware RAID cards, would mdraid add any benefit? > > On Mon, Nov 13, 2017 at 1:47 PM, FERNANDO FREDIANI > <fernando.frediani(a)upx.com <mailto:fernando.frediani@upx.com>> wrote: > > Helli Rudi > > Nice specs. > > I wouldn't use GlusterFS for this setup with the third server in a > different location. Just have this server as an Standalone and > replicate the VMs there. You won't have real time replication, but > much less hassle and probably to have constant failures, specially > knowing you have a wireless link. > > For the SSDs I have been using bcache with success. Relatively > simple to setup and pretty good performance. > > For your specs as you have 4 mechanical disks I would recommend > you to have a RAID 5 between them (4 disks is my limit for RAID 5) > and a RAID 0 made of SSDs for the bcache device. If the RAID 0 > fails for any reason it will fall back directly to the mechanical > disks and you can do maintenance on the Node doing live migration > in order to replace the failed disks. > > However as you have you have 2 remaining server to create your > cluster you may need to consider GlusterFS on the top of this RAID > to have the replication and Highavaibility. > > Hope it helps. > > Fernando > > > On 13/11/2017 08:03, Rudi Ahlers wrote: >> Hi, >> >> Can someone please give me some pointers, what would be the best >> setup for performance and reliability? >> >> We have the following hardware setup: >> >> 3x Supermicro server with following features per server: >> 128GB RAM >> 4x 8TB SATA HDD >> 2x SSD drives (intel_ssdsc2ba400g4 - 400GB DC S3710) >> 2x 12 core CPU (Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz >> Quad port 10Gbe Inter NIC >> 2x 10GB Cisco switches (to isolate storage network from LAN) >> >> One of the servers will be in another office, with a 600Mb >> wireless link for Disaster Recovery. >> >> What is recommended for the best setup in terms of redundancy and >> speed? >> >> I am guessing GlusterFS with a Distributed Striped Replicated >> Volume across 3 of the servers. >> >> For added performance I want to use the SSD drives, perhaps with >> dm-cache? >> >> Should I combine the 4x HDD's using LVM on each host node? >> What about RAID 6? >> >> >> >> Virtual Machines will then reside on the oVirt Cluster and any >> one of the 3 host nodes can fail, or any single HDD can fail and >> all should still work, right/? >> >> >> >> >> -- >> Kind Regards >> Rudi Ahlers >> Website: http://www.rudiahlers.co.za >> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org <mailto:Users@ovirt.org> >> http://lists.ovirt.org/mailman/listinfo/users >> <http://lists.ovirt.org/mailman/listinfo/users> > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org <mailto:Users@ovirt.org> > http://lists.ovirt.org/mailman/listinfo/users > <http://lists.ovirt.org/mailman/listinfo/users> > > > > > -- > Kind Regards > Rudi Ahlers > Website: http://www.rudiahlers.co.za --------------6C7C95E00858D75DD80BDF80 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> <p>Hello Rudi</p> <p>If you have a 4th server it may work,but I am not knowledgeable about Gluster's GEOreplication. Perhaps someone else can advise.</p> <p>With regards RAID 5 for 4 disks this is intended for capacity and as mentioned 4 disks is the maximum I would use for RAID5. As you have SSDs and intend to use a caching technique like bcache ou dm-cache this should cover the performance hit of RAID 5 write.<br> If you consider using RAID 6 in only 4 disks you are much better of using RAID 10 then as you will have double write performance and same capacity. I normally use RAID 10 or in ZFS configurations (not this case) multiple vdevs of RAID6.<br> </p> <p>For RAID in Linux I have been using mdraid. I know LVM does some Raid but I personally never done myself so can't advise.</p> <p>Regards.<br> Fernando<br> </p> <br> <div class="moz-cite-prefix">On 13/11/2017 10:19, Rudi Ahlers wrote:<br> </div> <blockquote type="cite" cite="mid:CAAj3DjmTaxR5JEESLTVtqyzk4H_cN6StKVB_JNXBjJtWrDJXEw@mail.gmail.com"> <div dir="ltr">Hi Fernando, <div><br> </div> <div>Thanx. </div> <div><br> </div> <div>I meant to say, the 4th server will be in another office. It's about 3Km away and I was thinking of using Gluster's GEOreplication for this purpose. </div> <div><br> </div> <div>I am not a fond user of RAID5 at all. But this raises the question: does RAID add any unnecessary overhead? I would rather run RAID 6 or RAI10. </div> <div>And then, if RAID is the preferred way (over LVM?), as I don't have dedicated hardware RAID cards, would mdraid add any benefit?</div> </div> <div class="gmail_extra"><br> <div class="gmail_quote">On Mon, Nov 13, 2017 at 1:47 PM, FERNANDO FREDIANI <span dir="ltr"><<a href="mailto:fernando.frediani@upx.com" target="_blank" moz-do-not-send="true">fernando.frediani(a)upx.com</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000"> <p>Helli Rudi</p> <p>Nice specs.</p> <p>I wouldn't use GlusterFS for this setup with the third server in a different location. Just have this server as an Standalone and replicate the VMs there. You won't have real time replication, but much less hassle and probably to have constant failures, specially knowing you have a wireless link.</p> <p>For the SSDs I have been using bcache with success. Relatively simple to setup and pretty good performance.</p> <p>For your specs as you have 4 mechanical disks I would recommend you to have a RAID 5 between them (4 disks is my limit for RAID 5) and a RAID 0 made of SSDs for the bcache device. If the RAID 0 fails for any reason it will fall back directly to the mechanical disks and you can do maintenance on the Node doing live migration in order to replace the failed disks.</p> <p>However as you have you have 2 remaining server to create your cluster you may need to consider GlusterFS on the top of this RAID to have the replication and Highavaibility.</p> <p>Hope it helps.</p> <p>Fernando<br> </p> <div> <div class="h5"> <br> <div class="m_-8722418027031101913moz-cite-prefix">On 13/11/2017 08:03, Rudi Ahlers wrote:<br> </div> </div> </div> <blockquote type="cite"> <div> <div class="h5"> <div dir="ltr">Hi, <div><br> </div> <div>Can someone please give me some pointers, what would be the best setup for performance and reliability?</div> <div><br> </div> <div>We have the following hardware setup:</div> <div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px"><br> </span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">3x Supermicro server with following features per server:</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">128GB RAM</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">4x 8TB SATA HDD</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">2x SSD drives (intel_ssdsc2ba400g4 - 400GB DC S3710)</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">2x 12 core CPU (Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">Quad port 10Gbe Inter NIC</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">2x 10GB Cisco switches (to isolate storage network from LAN)</span></font></div> </div> <div><br> </div> <div> <div>One of the servers will be in another office, with a 600Mb wireless link for Disaster Recovery. </div> <div><br> </div> <div>What is recommended for the best setup in terms of redundancy and speed?</div> <div><br> </div> <div>I am guessing GlusterFS with a Distributed Striped Replicated Volume across 3 of the servers. </div> <div><br> </div> <div>For added performance I want to use the SSD drives, perhaps with dm-cache?</div> <div><br> </div> <div>Should I combine the 4x HDD's using LVM on each host node?</div> <div>What about RAID 6?</div> <div><br> </div> <div><br> </div> <div><br> </div> <div> <div>Virtual Machines will then reside on the oVirt Cluster and any one of the 3 host nodes can fail, or any single HDD can fail and all should still work, right/? </div> </div> <div><br> </div> <div><br> </div> <div><br> </div> <div><br> </div> -- <br> <div class="m_-8722418027031101913gmail_signature">Kind Regards<br> Rudi Ahlers<br> Website: <a href="http://www.rudiahlers.co.za" target="_blank" moz-do-not-send="true">http://www.rudiahlers.co.za</a><br> </div> </div> </div> <br> <fieldset class="m_-8722418027031101913mimeAttachmentHeader"></fieldset> <br> </div> </div> <pre>______________________________<wbr>_________________ Users mailing list <a class="m_-8722418027031101913moz-txt-link-abbreviated" href="mailto:Users@ovirt.org" target="_blank" moz-do-not-send="true">Users(a)ovirt.org</a> <a class="m_-8722418027031101913moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank" moz-do-not-send="true">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a> </pre> </blockquote> <br> </div> <br> ______________________________<wbr>_________________<br> Users mailing list<br> <a href="mailto:Users@ovirt.org" moz-do-not-send="true">Users(a)ovirt.org</a><br> <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank" moz-do-not-send="true">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><br> <br> </blockquote> </div> <br> <br clear="all"> <div><br> </div> -- <br> <div class="gmail_signature" data-smartmail="gmail_signature">Kind Regards<br> Rudi Ahlers<br> Website: <a href="http://www.rudiahlers.co.za" target="_blank" moz-do-not-send="true">http://www.rudiahlers.co.za</a><br> </div> </div> </blockquote> <br> </body> </html> --------------6C7C95E00858D75DD80BDF80--

1 0

Re: [ovirt-users] Installation of oVirt 4.1, Gluster Storage and Hosted Engine
by Open tech 13 Nov '17

13 Nov '17

Hi All, I am new to Ovirt. I am hitting the exact same error while trying a new install in a nested virtualization setup on esxi 6.5. I am following this tutorial as well. Have three nodes on esxi with dual networks & passwordless ssh enabled. https://www.ovirt.org/blog/2017/04/up-and-running-with-ovirt-4.1-and-gluste… Node install goes through without issue. Run into this error when i hit deploy. TASK [Run a shell script] ****************************************************** fatal: [ovirt3]: FAILED! => {"failed": true, "msg": "The conditional check 'result.rc != 0' failed. The error was: error while evaluating conditional (result.rc != 0): 'dict object' has no attribute 'rc'"} fatal: [ovirt1]: FAILED! => {"failed": true, "msg": "The conditional check 'result.rc != 0' failed. The error was: error while evaluating conditional (result.rc != 0): 'dict object' has no attribute 'rc'"} fatal: [ovirt2]: FAILED! => {"failed": true, "msg": "The conditional check 'result.rc != 0' failed. The error was: error while evaluating conditional (result.rc != 0): 'dict object' has no attribute 'rc'"} to retry, use: --limit @/tmp/tmpbDBjAt/run-script.retry @Simone Marchioni were you able to find a solution ???. Thanks hk

2 3

oVirt 4.1.9 will be the last 4.1 release
by Sandro Bonazzola 13 Nov '17

13 Nov '17

Hi, we are now targeting oVirt 4.2.0 GA around December 12th and oVirt 4.1.8 around December 5th. Against tradition that would have set 4.1.8 as last 4.1 release, this round we'll release also oVIrt 4.1.9 being it already in development just before 4.2.0 GA. We suggest to be prepared to upgrade to 4.2 since 4.1 won't receive any further update after 4.1.9 release. -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> <http://www.teraplan.it/redhat-osd-2017/>

1 0