Posix: Optimize posix code to improve file creation

Problem: Before executing a fop in POSIX xlator it builds an internal
         path based on GFID.To validate the path it call's (l)stat
         system call and while .glusterfs is heavily loaded kernel takes
         time to lookup inode and due to that performance drops

Solution: In this patch we followed two ways to improve the performance.
          1) Keep open fd specific to first level directory(gfid[0])
             in .glusterfs, it would force to kernel keep the inodes
             from all those files in cache. In case of memory pressure
             kernel won't uncache first level inodes. We need to open
             256 fd's per brick to access the entry faster.
          2) Use at based call's to access relative path to reduce
             path based lookup time.

Note: To verify the patch we have executed kernel untar 100 times on 6
      different clients after enabling metadata group-cache and some
      other option.We were getting more than 20 percent improvement in
      kenel untar after applying the patch.

Credits: Xavi Hernandez <xhernandez@redhat.com>
Change-Id: I1643e6b01ed669b2bb148d02f4e6a8e08da45343
updates: #891
Signed-off-by: Mohit Agrawal <moagrawal@redhat.com>

1 files changed, 11 insertions, 0 deletions

diff --git a/xlators/storage/posix/src/posix-handle.h b/xlators/storage/posix/src/posix-handle.h
index 70c68c3d89c..f33ed92620d 100644
--- a/xlators/storage/posix/src/posix-handle.h
+++ b/xlators/storage/posix/src/posix-handle.h
@@ -141,6 +141,16 @@
                  __priv->base_path, gfid[0], gfid[1], uuid_utoa(gfid));        \
     } while (0)
 
+#define MAKE_HANDLE_ABSPATH_FD(var, this, gfid, dfd)                           \
+    do {                                                                       \
+        struct posix_private *__priv = this->private;                          \
+        int findex = gfid[0];                                                  \
+        int __len = POSIX_GFID_HASH2_LEN;                                      \
+        var = alloca(__len);                                                   \
+        snprintf(var, __len, "%02x/%s", gfid[1], uuid_utoa(gfid));             \
+        dfd = __priv->arrdfd[findex];                                          \
+    } while (0)
+
 #define MAKE_ENTRY_HANDLE(entp, parp, this, loc, ent_p)                        \
     do {                                                                       \
         char *__parp;                                                          \
@@ -184,6 +194,7 @@
         /* expand ELOOP */                                                     \
     } while (0)
 
+#define POSIX_GFID_HASH2_LEN 45
 int
 posix_handle_gfid_path(xlator_t *this, uuid_t gfid, char *buf, size_t len);