summaryrefslogtreecommitdiffstats
path: root/done/GlusterFS 3.6/RDMA Improvements.md
blob: 1e7172951181be49e61c4e81e75d8026eedfc191 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
Feature
-------

**RDMA Improvements**

Summary
-------

This proposal is regarding getting RDMA volumes out of tech preview.

Owners
------

Raghavendra Gowdappa <rgowdapp@redhat.com>  
Vijay Bellur <vbellur@redhat.com>

Current status
--------------

Work in progress

Detailed Description
--------------------

Fix known & unknown issues in volumes with transport type rdma so that
RDMA can be used as the interconnect between client - servers & between
servers.

-   Performance Issues - Had found that performance was bad when
    compared with plain ib-verbs send/recv v/s RDMA reads and writes.
-   Co-existence with tcp - There seemed to be some memory corruptions
    when we had both tcp and rdma transports.
-   librdmacm for connection management - with this there is a
    requirement that the brick has to listen on an IPoIB address and
    this affects our current ability where a peer has the flexibility to
    connect to either ethernet or infiniband address. Another related
    feature Better peer identification will help us to resolve this
    issue.
-   More testing required

Benefit to GlusterFS
--------------------

Scope
-----

### Nature of proposed change

Bug-fixes to transport/rdma

### Implications on manageability

Remove the warning about creation of rdma volumes in CLI.

### Implications on presentation layer

TBD

### Implications on persistence layer

No impact

### Implications on 'GlusterFS' backend

No impact

### Modification to GlusterFS metadata

No impact

### Implications on 'glusterd'

No impact

How To Test
-----------

TBD

User Experience
---------------

TBD

Dependencies
------------

Better Peer identification

Documentation
-------------

TBD

Status
------

In development

Comments and Discussion
-----------------------