- Users - oVirt List Archives

How to enable tunnel migration
by like.ma＠cs2c.com.cn 08 Mar '17

08 Mar '17

This is a multi-part message in MIME format. ------=_001_NextPart686558146187_=---- Content-Type: text/plain; charset="GB2312" Content-Transfer-Encoding: base64 SGksDQogDQpJJ20gdXNpbmcgb1ZpcnQgMy42Ljcgbm93LiBJIHdhbnQgdG8gZW5hYmxlIHR1bm5l bCBtaWdyYXRpb24gZmVhdHVyZS4gDQpCdXQgd2hlbiBpIHNldCB0dW5uZWxfbWlncmF0aW9uIHZh bHVlIG9mIHZtIGFzIFR1cmUgdGhyb3VnaCBweXRob24NClNESyhJIGNhbid0IGZpbmQgYW55IHBs YWNlIHRvIGVuYWJsZSB0dW5uZWwgbWlncmF0aW9uIG9uIHRoZSB3ZWIgdWksDQpzbyBpIHVzZSBT REspLCB0aGVuIG1pZ3JhdGUgdGhlIHZtIGkgZ290IHRoZSBmb2xsb3dpbmcgZXJyb3IgbWVzc2Fn ZToNCiANClRocmVhZC05NDE3NjI4OjpFUlJPUjo6MjAxNy0wMy0wNyAxMToyNTo0OCw1Mzg6Om1p Z3JhdGlvbjo6MzEwOjp2aXJ0LnZtOjoocnVuKSB2bUlkPWAwOGI0Y2NjMS1jNTA4LTQzOWItYTli YS1jYTBkNDJhNzA3MmNgOjpGYWlsZWQgdG8gbWlncmF0ZQ0KVHJhY2ViYWNrIChtb3N0IHJlY2Vu dCBjYWxsIGxhc3QpOg0KICBGaWxlICIvdXNyL3NoYXJlL3Zkc20vdmlydC9taWdyYXRpb24ucHki LCBsaW5lIDI5OCwgaW4gcnVuDQogICAgc2VsZi5fc3RhcnRVbmRlcmx5aW5nTWlncmF0aW9uKHRp bWUudGltZSgpKQ0KICBGaWxlICIvdXNyL3NoYXJlL3Zkc20vdmlydC9taWdyYXRpb24ucHkiLCBs aW5lIDM2NCwgaW4gX3N0YXJ0VW5kZXJseWluZ01pZ3JhdGlvbg0KICAgIHNlbGYuX3BlcmZvcm1f bWlncmF0aW9uKGR1cmksIG11cmkpDQogIEZpbGUgIi91c3Ivc2hhcmUvdmRzbS92aXJ0L21pZ3Jh dGlvbi5weSIsIGxpbmUgNDAzLCBpbiBfcGVyZm9ybV9taWdyYXRpb24NCiAgICBzZWxmLl92bS5f ZG9tLm1pZ3JhdGVUb1VSSTMoZHVyaSwgcGFyYW1zLCBmbGFncykNCiAgRmlsZSAiL3Vzci9zaGFy ZS92ZHNtL3ZpcnQvdmlyZG9tYWluLnB5IiwgbGluZSA2OCwgaW4gZg0KICAgIHJldCA9IGF0dHIo KmFyZ3MsICoqa3dhcmdzKQ0KICBGaWxlICIvdXNyL2xpYi9weXRob24yLjcvc2l0ZS1wYWNrYWdl cy92ZHNtL2xpYnZpcnRjb25uZWN0aW9uLnB5IiwgbGluZSAxMjQsIGluIHdyYXBwZXINCiAgICBy ZXQgPSBmKCphcmdzLCAqKmt3YXJncykNCiAgRmlsZSAiL3Vzci9saWIvcHl0aG9uMi43L3NpdGUt cGFja2FnZXMvdmRzbS91dGlscy5weSIsIGxpbmUgMTMxMywgaW4gd3JhcHBlcg0KICAgIHJldHVy biBmdW5jKGluc3QsICphcmdzLCAqKmt3YXJncykNCiAgRmlsZSAiL3Vzci9saWI2NC9weXRob24y Ljcvc2l0ZS1wYWNrYWdlcy9saWJ2aXJ0LnB5IiwgbGluZSAxODM2LCBpbiBtaWdyYXRlVG9VUkkz DQogICAgaWYgcmV0ID09IC0xOiByYWlzZSBsaWJ2aXJ0RXJyb3IgKCd2aXJEb21haW5NaWdyYXRl VG9VUkkzKCkgZmFpbGVkJywgZG9tPXNlbGYpDQpsaWJ2aXJ0RXJyb3I6ILK71qez1rXEss7K/aO6 bWlncmF0aW9uIFVSSSBpcyBub3Qgc3VwcG9ydGVkIGJ5IHR1bm5lbGxlZCBtaWdyYXRpb24NCg0K U28sIGkgd2FudCB0byBrbm93IGhvdyBzaG91bGQgaSBlbmFibGUgdGhlIHR1bm5lbCBtaWdyYXRp b24gZmVhdHVyZS4gQ2FuIGFueW9uZSBoZWxwIG1lPw0KVGhhbmtzDQogDQpSZWdhcmRzLg0KDQoN Cg0KbGlrZS5tYUBjczJjLmNvbS5jbg0K ------=_001_NextPart686558146187_=---- Content-Type: text/html; charset="GB2312" Content-Transfer-Encoding: quoted-printable <html><head><meta http-equiv=3D"content-type" content=3D"text/html; charse= t=3DGB2312"><style>body { line-height: 1.5; }body { font-size: 10.5pt; fon= t-family: =CE=A2=C8=ED=D1=C5=BA=DA; color: rgb(0, 0, 0); line-height: 1.5;= }</style></head><body>=0A<div><span></span><div>Hi,</div><div> </div= ><div>I'm using oVirt 3.6.7 now. I want to enable tunnel migration feature= . </div><div>But when i set tunnel_migration value of vm as Ture thro= ugh python</div><div>SDK(I can't find any place to enable tunnel migration= on the web ui,</div><div>so i use SDK), then migrate the vm i got the fol= lowing error message:</div><div> </div>Thread-9417628::ERROR::2017-03= -07 11:25:48,538::migration::310::virt.vm::(run) vmId=3D`08b4ccc= 1-c508-439b-a9ba-ca0d42a7072c`::Failed to migrate<br>Traceback&n= bsp;(most recent call last):<br>  File "/usr= /share/vdsm/virt/migration.py", line 298, in run<br>&n= bsp;   self._startUnderlyingMigration(time.time())<br>&nbsp= ; File "/usr/share/vdsm/virt/migration.py", line 364,&= nbsp;in _startUnderlyingMigration<br>    self._pe= rform_migration(duri, muri)<br>  File "/usr/share/vdsm= /virt/migration.py", line 403, in _perform_migration<b= r>    self._vm._dom.migrateToURI3(duri, params,&n= bsp;flags)<br>  File "/usr/share/vdsm/virt/virdomain.py",&n= bsp;line 68, in f<br>    ret =3D&n= bsp;attr(*args, **kwargs)<br>  File "/usr/lib/python2.= 7/site-packages/vdsm/libvirtconnection.py", line 124, in&nb= sp;wrapper<br>    ret =3D f(*args, **kw= args)<br>  File "/usr/lib/python2.7/site-packages/vdsm/util= s.py", line 1313, in wrapper<br>   &nbs= p;return func(inst, *args, **kwargs)<br>  File&nb= sp;"/usr/lib64/python2.7/site-packages/libvirt.py", line 1836,&n= bsp;in migrateToURI3<br>    if ret =3D= =3D -1: raise libvirtError ('virDomainMigrateToURI3()&= nbsp;failed', dom=3Dself)<br><div><span style=3D"font-size: 10.5pt; l= ine-height: 1.5; background-color: window;">libvirtError: =B2=BB=D6= =A7=B3=D6=B5=C4=B2=CE=CA=FD=A3=BAmigration URI is not = supported by tunnelled migration</span></div><div><span sty= le=3D"font-size: 10.5pt; line-height: 1.5; background-color: window;"><br>= </span></div><div><span style=3D"font-size: 10.5pt; line-height: 1.5; back= ground-color: window;">So, i want to know how should i enable the tunnel m= igration feature. Can anyone help me?</span></div><div><span style=3D"font= -size: 10.5pt; line-height: 1.5; background-color: window;">Thanks</span><= /div><div><span style=3D"font-size: 10.5pt; line-height: 1.5; background-c= olor: window;"> </span></div><div>Regards.</div></div>=0A<div><br></d= iv><hr style=3D"width: 210px; height: 1px;" color=3D"#b5c4df" size=3D"1" a= lign=3D"left">=0A<div><span><div style=3D"MARGIN: 10px; FONT-FAMILY: verda= na; FONT-SIZE: 10pt"><div>like.ma(a)cs2c.com.cn</div></div></span></div>=0A<= /body></html> ------=_001_NextPart686558146187_=------

2 3

Second node ovirt 4.0 no ovirtmgmt bridge, non-operational issue
by Ian Neilsen 08 Mar '17

08 Mar '17

Hi all I currently have a non-operational second node in my "ovirt 4.0 hosted-engine" installation running on Centos7, kernel 3.10.0-514.10.2.el7.x86_64. When I ran "hosted-engine --deploy" on the second node, it produce the following error(see bottom of email). I now cannot set the second node into operational mode, no matter what I try. I did notice a few things though. #1 - no ovirtmgt bridge was created during hosted-engine deploy; should I create this bridge and retry? #2- vdsmd keep throwing start errors before I ran hosted-engine deploy. I ran vdsm-tool configure --force this seem to fix it. #3 - second node complained of no fencing agent, so I added in a DRAC fence agent and it worked/tested fine. But still not able to go opertional on second node. #4 Ive tried restarting vdsmd, ovirt-ha-agent and ovirt-ha-broker. Both the agent and broker throw error messages.(see bottom of email for errors) Any advice of where to look next, what to fix? ***Hosted-engine --deploy message*** [WARNING] Host left in non-operational state To finish deploying, please: - activate it - restart the hosted-engine high availability services by running on this machine: # service ovirt-ha-agent restart # service ovirt-ha-broker restart [ INFO ] Enabling and starting HA services [ INFO ] Stage: Clean up [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20170307062116.conf' [ INFO ] Generating answer file '/etc/ovirt-hosted-engine/answers.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ INFO ] Hosted Engine successfully deployed ***ovirt-ha-agent error message*** ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf ***ovirt-ha-broker error message*** ovirt-ha-broker ovirt_hosted_engine_ha.broker.notifications.Notifications ERROR Connection unexpectedly closed Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/notifications.py", line 34, in send_email message.as_string()) File "/usr/lib64/python2.7/smtplib.py", line 749, in sendmail self.rset() File "/usr/lib64/python2.7/smtplib.py", line 468, in rsetreturn self.docmd("rset") File "/usr/lib64/python2.7/smtplib.py", line 393, in docmdreturn self.getreply() File "/usr/lib64/python2.7/smtplib.py", line 367, in getreplyraise SMTPServerDisconnected("Connection unexpectedly closed") SMTPServerDisconnected: Connection unexpectedly closed -- Ian Neilsen Mobile: 0424 379 762 Linkedin: http://au.linkedin.com/in/ianneilsen Twitter : ineilsen

1 0

oVirt global utilization trend
by Abi Askushi 07 Mar '17

07 Mar '17

Hi, I see that the global utilization 24h trend graph (CPU, RAM, Disk) at dashboard is showing only the last 3 hours. The line for previous hours is flat (see attached). I remember that on a previous installation I had tested it was showing the full 24 hours. Tried to run again engine-setup but issue remains. Any suggestions? Thanx, Alex

3 2

3.5->3.6 did not import hosted engine storage domain
by Chris Adams 07 Mar '17

07 Mar '17

So, on to my next upgrade issue (sorry for all the questions and thanks for everybody's help)... I upgraded my test cluster from 3.5 to 3.6 (latest version of each, all on CentOS 7 except the engine on CentOS 6). Now I'm working on the next step, upgrading to 4.0 and migrating the HE to the appliance. When I went from 3.5 to 3.6, I ended up with an fhanswers.conf in the shared storage that only contained "None"; I fixed that based on some mailing list messages (but just mentioning it in case it could be related). My problem is that the hosted engine storage domain did not get imported into the engine DB, so I can't proceed with "hosted-engine --upgrade-appliance". I didn't see any errors, so I'm not sure how that happened. I'm also not sure how to fix that. Suggestions? -- Chris Adams <cma(a)cmadams.net>

3 11

restapi
by qinglong.dong＠horebdata.cn 07 Mar '17

07 Mar '17

This is a multi-part message in MIME format. ------=_001_NextPart508384553316_=---- Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: base64 SGksIGFsbA0KICAgICAgICBJIGhhdmUgYSBjbG91ZCBmb3VuZHJ5IGVudmlyb25tZW50LiBJIGhh dmUgbm90aWNlZCB0aGF0IGNsb3VkIGZvdW5kcnkgY2FuIHNjaGVkdWxlIHZpdHVhbCBtYWNoaW5l cyBjcmVhdGVkIGJ5IHZtd2FyZSBvciBvcGVuc3RhY2sgdXNpbmcgcmVzdGFwaS4gT3ZpcnQgc3Vw cG9ydHMgcmVzdGFwaSwgdG9vLiBTbyBJIHdhbnQgdG8ga25vdyBpZiBpdCBpcyBwb3NzaWJsZSB0 byBzY2hlZHVsZSB2aXR1YWwgbWFjaGluZXMgd2hpY2ggY3JlYXRlZCBieSBvdmlydCB1c2luZyBj bG91ZCBmb3VuZHJ5LiBBbnlvbmUgY2FuIGhlbHA/IFRoYW5rcyENCg== ------=_001_NextPart508384553316_=---- Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html><head><meta http-equiv=3D"content-type" content=3D"text/html; charse= t=3Dus-ascii"><style>body { line-height: 1.5; }body { font-size: 10.5pt; f= ont-family: ????; color: rgb(0, 0, 0); line-height: 1.5; }</style></head><= body>Hi, all<div>    <span style=3D"font-size: 10.5pt; line= -height: 1.5; background-color: window;">    I have a </spa= n><span style=3D"font-size: 10.5pt; line-height: 1.5; background-color: wi= ndow;">cloud foundry environment. I have noticed that cloud foundry c= an s</span><span style=3D"font-size: 10.5pt; line-height: 1.5; background-= color: window;">chedule vitual machines created by vmware or openstack usi= ng restapi. Ovirt supports restapi, too. So I want to know if it is possib= le to </span><span style=3D"font-size: 10.5pt; line-height: 1.5; back= ground-color: window;">s</span><span style=3D"font-size: 10.5pt; line-heig= ht: 1.5; background-color: window;">chedule vitual machines which created = by ovirt using </span><span style=3D"font-size: 10.5pt; line-height: = 1.5; background-color: window;">cloud foundry. Anyone can help? Thank= s!</span></div></body></html> ------=_001_NextPart508384553316_=------

3 2

Replicated Glusterfs on top of ZFS
by Arman Khalatyan 07 Mar '17

07 Mar '17

Hi, I use 3 nodes with zfs and glusterfs. Are there any suggestions to optimize it? host zfs config 4TB-HDD+250GB-SSD: [root@clei22 ~]# zpool status pool: zclei22 state: ONLINE scan: scrub repaired 0 in 0h0m with 0 errors on Tue Feb 28 14:16:07 2017 config: NAME STATE READ WRITE CKSUM zclei22 ONLINE 0 0 0 HGST_HUS724040ALA640_PN2334PBJ4SV6T1 ONLINE 0 0 0 logs lv_slog ONLINE 0 0 0 cache lv_cache ONLINE 0 0 0 errors: No known data errors Name: GluReplica Volume ID: ee686dfe-203a-4caa-a691-26353460cc48 Volume Type: Replicate (Arbiter) Replica Count: 2 + 1 Number of Bricks: 3 Transport Types: TCP, RDMA Maximum no of snapshots: 256 Capacity: 3.51 TiB total, 190.56 GiB used, 3.33 TiB free

6 16

Re: [ovirt-users] Storage balancer project
by nicolas＠devels.es 07 Mar '17

07 Mar '17

Hi, I added the LICENCE file [1] to the project. Regards. [1]: https://github.com/nkovacne/ovirt-storage-balancer/blob/master/LICENCE El 2017-03-07 06:36, Yaniv Kaul escribió: > On Mon, Mar 6, 2017, 10:18 PM <nicolas(a)devels.es> wrote: > >> Hi, >> >> I implemented a storage domain balancer [1], i.e. a script that >> tries to >> keep all storage domains under a defined threshold. We use our >> oVirt >> infrastructure for teaching so have several hundreds of users and >> cca. >> 800 VMs at this time, so something like this is really needed >> considering that when students create their VMs they tend to create >> their disks under the same storage domain (normally the first >> available >> one). This results in one or two heavily used SDs and the rest >> underused. >> >> I tried to keep it as simple as possible and doesn't have many >> features, >> but it seems to work (I tried it under our conditions: About 10 >> SDs, >> relatively highly used). If someone want to improve something on >> it, >> pull requests are welcome. >> >> Might also be an inspiration on [2]. >> >> Regards. >> >> [1]: https://github.com/nkovacne/ovirt-storage-balancer [1] > > Can you clarify the license? > Y. > >> [2]: https://bugzilla.redhat.com/show_bug.cgi?id=1331544 [2] >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users [3] > > > Links: > ------ > [1] https://github.com/nkovacne/ovirt-storage-balancer > [2] https://bugzilla.redhat.com/show_bug.cgi?id=1331544 > [3] http://lists.ovirt.org/mailman/listinfo/users

1 0

Storage balancer project
by nicolas＠devels.es 06 Mar '17

06 Mar '17

Hi, I implemented a storage domain balancer [1], i.e. a script that tries to keep all storage domains under a defined threshold. We use our oVirt infrastructure for teaching so have several hundreds of users and cca. 800 VMs at this time, so something like this is really needed considering that when students create their VMs they tend to create their disks under the same storage domain (normally the first available one). This results in one or two heavily used SDs and the rest underused. I tried to keep it as simple as possible and doesn't have many features, but it seems to work (I tried it under our conditions: About 10 SDs, relatively highly used). If someone want to improve something on it, pull requests are welcome. Might also be an inspiration on [2]. Regards. [1]: https://github.com/nkovacne/ovirt-storage-balancer [2]: https://bugzilla.redhat.com/show_bug.cgi?id=1331544

1 0

[ANN] oVirt 4.1.1 First Release Candidate
by Sandro Bonazzola 06 Mar '17

06 Mar '17

The oVirt Project is pleased to announce the availability of the First Release Candidate of oVirt 4.1.1 for testing, as of March 3rd, 2017 This is pre-release software. Please take a look at our community page[1] to know how to ask questions and interact with developers and users. All issues or bugs should be reported via oVirt Bugzilla[2]. This pre-release should not to be used in production. This update is the first release candidate of the first in a series of stabilization updates to the 4.1 series. 4.1.1 brings 26 enhancements and more than 350 bugfixes, including more than 130 high or urgent severity fixes, on top of oVirt 4.1 series This release is available now for: * Fedora 24 (tech preview) * Red Hat Enterprise Linux 7.3 or later * CentOS Linux (or similar) 7.3 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.3 or later * CentOS Linux (or similar) 7.3 or later * Fedora 24 (tech preview) See the release notes draft [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Live has been already built [4] - oVirt Node and Appliance has not been built for this release due to build issues we're still investigating. Additional Resources: * Read more about the oVirt 4.1.1 release highlights: http://www.ovirt.org/release/4.1.1/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.1.1/ [4] http://resources.ovirt.org/pub/ovirt-4.1-pre/iso/ -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

5 10

Re: [ovirt-users] [Gluster-users] Hot to force glusterfs to use RDMA?
by Arman Khalatyan 06 Mar '17

06 Mar '17

Dear Deepak, thank you for the hints, which gluster are you using? As you can see from my previous email that the RDMA connection tested with qperf. It is working as expected. In my case the clients are servers as well, they are hosts for the ovirt. Disabling selinux is nor recommended by ovirt, but i will give a try. Am 03.03.2017 7:50 vorm. schrieb "Deepak Naidu" <dnaidu(a)nvidia.com>: I have been testing glusterfs over RDMA & below is the command I use. Reading up the logs, it looks like your IB(InfiniBand) device is not being initialized. I am not sure if u have an issue on the client IB or the storage server IB. Also have you configured ur IB devices correctly. I am using IPoIB. Can you check your firewall, disable selinux, I think, you might have checked it already ? *mount -t glusterfs -o transport=rdma storageN1:/vol0 /mnt/vol0* · *The below error seems if you have issue starting your volume. I had issue, when my transport was set to tcp,rdma. I had to force start my volume. If I had set it only to tcp on the volume, the volume would start easily.* [2017-03-02 11:49:47.829391] E [MSGID: 114022] [client.c:2530:client_init_rpc] 0-GluReplica-client-2: failed to initialize RPC [2017-03-02 11:49:47.829413] E [MSGID: 101019] [xlator.c:433:xlator_init] 0-GluReplica-client-2: Initialization of volume 'GluReplica-client-2' failed, review your volfile again [2017-03-02 11:49:47.829425] E [MSGID: 101066] [graph.c:324:glusterfs_graph_init] 0-GluReplica-client-2: initializing translator failed [2017-03-02 11:49:47.829436] E [MSGID: 101176] [graph.c:673:glusterfs_graph_activate] 0-graph: init failed · *The below error seems if you have issue with IB device. If not configured properly.* [2017-03-02 11:49:47.828996] W [MSGID: 103071] [rdma.c:4589:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed [No such device] [2017-03-02 11:49:47.829067] W [MSGID: 103055] [rdma.c:4896:init] 0-GluReplica-client-2: Failed to initialize IB Device [2017-03-02 11:49:47.829080] W [rpc-transport.c:354:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed -- Deepak *From:* gluster-users-bounces(a)gluster.org [mailto:gluster-users-bounces@ gluster.org] *On Behalf Of *Sahina Bose *Sent:* Thursday, March 02, 2017 10:26 PM *To:* Arman Khalatyan; gluster-users(a)gluster.org; Rafi Kavungal Chundattu Parambil *Cc:* users *Subject:* Re: [Gluster-users] [ovirt-users] Hot to force glusterfs to use RDMA? [Adding gluster users to help with error] [2017-03-02 11:49:47.828996] W [MSGID: 103071] [rdma.c:4589:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed [No such device] On Thu, Mar 2, 2017 at 5:36 PM, Arman Khalatyan <arm2arm(a)gmail.com> wrote: BTW RDMA is working as expected: root@clei26 ~]# qperf clei22.vib tcp_bw tcp_lat tcp_bw: bw = 475 MB/sec tcp_lat: latency = 52.8 us [root@clei26 ~]# thank you beforehand. Arman. On Thu, Mar 2, 2017 at 12:54 PM, Arman Khalatyan <arm2arm(a)gmail.com> wrote: just for reference: gluster volume info Volume Name: GluReplica Type: Replicate Volume ID: ee686dfe-203a-4caa-a691-26353460cc48 Status: Started Snapshot Count: 0 Number of Bricks: 1 x (2 + 1) = 3 Transport-type: tcp,rdma Bricks: Brick1: 10.10.10.44:/zclei22/01/glu Brick2: 10.10.10.42:/zclei21/01/glu Brick3: 10.10.10.41:/zclei26/01/glu (arbiter) Options Reconfigured: network.ping-timeout: 30 server.allow-insecure: on storage.owner-gid: 36 storage.owner-uid: 36 cluster.data-self-heal-algorithm: full features.shard: on cluster.server-quorum-type: server cluster.quorum-type: auto network.remote-dio: enable cluster.eager-lock: enable performance.stat-prefetch: off performance.io-cache: off performance.read-ahead: off performance.quick-read: off performance.readdir-ahead: on nfs.disable: on [root@clei21 ~]# gluster volume status Status of volume: GluReplica Gluster process TCP Port RDMA Port Online Pid ------------------------------------------------------------ ------------------ Brick 10.10.10.44:/zclei22/01/glu 49158 49159 Y 15870 Brick 10.10.10.42:/zclei21/01/glu 49156 49157 Y 17473 Brick 10.10.10.41:/zclei26/01/glu 49153 49154 Y 18897 Self-heal Daemon on localhost N/A N/A Y 17502 Self-heal Daemon on 10.10.10.41 N/A N/A Y 13353 Self-heal Daemon on 10.10.10.44 N/A N/A Y 32745 Task Status of Volume GluReplica ------------------------------------------------------------ ------------------ There are no active volume tasks On Thu, Mar 2, 2017 at 12:52 PM, Arman Khalatyan <arm2arm(a)gmail.com> wrote: I am not able to mount with RDMA over cli.... Are there some volfile parameters needs to be tuned? /usr/bin/mount -t glusterfs -o backup-volfile-servers=10.10. 10.44:10.10.10.42:10.10.10.41,transport=rdma 10.10.10.44:/GluReplica /mnt [2017-03-02 11:49:47.795511] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.9 (args: /usr/sbin/glusterfs --volfile-server=10.10.10.44 --volfile-server=10.10.10.44 --volfile-server=10.10.10.42 --volfile-server=10.10.10.41 --volfile-server-transport=rdma --volfile-id=/GluReplica.rdma /mnt) [2017-03-02 11:49:47.812699] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2017-03-02 11:49:47.825210] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2017-03-02 11:49:47.828996] W [MSGID: 103071] [rdma.c:4589:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed [No such device] [2017-03-02 11:49:47.829067] W [MSGID: 103055] [rdma.c:4896:init] 0-GluReplica-client-2: Failed to initialize IB Device [2017-03-02 11:49:47.829080] W [rpc-transport.c:354:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed [2017-03-02 11:49:47.829272] W [rpc-clnt.c:1070:rpc_clnt_connection_init] 0-GluReplica-client-2: loading of new rpc-transport failed [2017-03-02 11:49:47.829325] I [MSGID: 101053] [mem-pool.c:641:mem_pool_destroy] 0-GluReplica-client-2: size=588 max=0 total=0 [2017-03-02 11:49:47.829371] I [MSGID: 101053] [mem-pool.c:641:mem_pool_destroy] 0-GluReplica-client-2: size=124 max=0 total=0 [2017-03-02 11:49:47.829391] E [MSGID: 114022] [client.c:2530:client_init_rpc] 0-GluReplica-client-2: failed to initialize RPC [2017-03-02 11:49:47.829413] E [MSGID: 101019] [xlator.c:433:xlator_init] 0-GluReplica-client-2: Initialization of volume 'GluReplica-client-2' failed, review your volfile again [2017-03-02 11:49:47.829425] E [MSGID: 101066] [graph.c:324:glusterfs_graph_init] 0-GluReplica-client-2: initializing translator failed [2017-03-02 11:49:47.829436] E [MSGID: 101176] [graph.c:673:glusterfs_graph_activate] 0-graph: init failed [2017-03-02 11:49:47.830003] W [glusterfsd.c:1327:cleanup_and_exit] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x3c1) [0x7f524c9dbeb1] -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x172) [0x7f524c9d65d2] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f524c9d5b4b] ) 0-: received signum (1), shutting down [2017-03-02 11:49:47.830053] I [fuse-bridge.c:5794:fini] 0-fuse: Unmounting '/mnt'. [2017-03-02 11:49:47.831014] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f524b343dc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f524c9d5cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f524c9d5b4b] ) 0-: received signum (15), shutting down [2017-03-02 11:49:47.831014] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f524b343dc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f524c9d5cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f524c9d5b4b] ) 0-: received signum (15), shutting down On Thu, Mar 2, 2017 at 12:11 PM, Sahina Bose <sabose(a)redhat.com> wrote: You will need to pass additional mount options while creating the storage domain (transport=rdma) Please let us know if this works. On Thu, Mar 2, 2017 at 2:42 PM, Arman Khalatyan <arm2arm(a)gmail.com> wrote: Hi, Are there way to force the connections over RDMA only? If I check host mounts I cannot see rdma mount option: mount -l| grep gluster 10.10.10.44:/GluReplica on /rhev/data-center/mnt/glusterSD/10.10.10.44:_GluReplica type fuse.glusterfs (rw,relatime,user_id=0,group_id=0,default_permissions, allow_other,max_read=131072) I have glusterized 3 nodes: GluReplica Volume ID: ee686dfe-203a-4caa-a691-26353460cc48 Volume Type: Replicate (Arbiter) Replica Count: 2 + 1 Number of Bricks: 3 Transport Types: TCP, RDMA Maximum no of snapshots: 256 Capacity: 3.51 TiB total, 190.56 GiB used, 3.33 TiB free _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users ------------------------------ This email message is for the sole use of the intended recipient(s) and may contain confidential information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. ------------------------------

4 7