glusterfs.git/xlators/storage, branch v3.7.6

afr: write zeros to sink for non-sparse files

2015-10-29T08:40:19+00:00

Backport of http://review.gluster.org/#/c/12371/
Problem: If a file is created with zeroes ('dd', 'fallocate' etc.) when
a brick is down, the self-heal does not write the zeroes to the sink
after it comes up. Consequenty, there is a mismatch in disk-usage
amongst the bricks of the replica.

Fix: If we definitely know that the file is not sparse, then write the
zeroes to the sink even if the checksums match.

Change-Id: Ic739b3da5dbf47d99801c0e1743bb13aeb3af864
BUG: 1275921
Signed-off-by: Ravishankar N 
Reviewed-on: http://review.gluster.org/12436
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Pranith Kumar Karampuri

fuse: resolve complete path after a graph switch

2015-10-08T16:13:35+00:00

If a graph switch has happended as part of a attach-tier,
then there is a chance to hash fops to newly added brick
before fix-layout. This causes on going i/o to fail.

This patch will resolve a path, for graph switch by sending
recursive lookup to the parent directories. Those lookups
will help to heal the directory.

backport of>
>Change-Id: Ia2bb4b43a21e5cc6875ba1205628744c3f0ce4e5
>BUG: 1263549
>Signed-off-by: Mohammed Rafi KC 
>Reviewed-on: http://review.gluster.org/12184
>Tested-by: NetBSD Build System 
>Tested-by: Dan Lambright 
>Reviewed-by: Dan Lambright 

(cherry picked from commit d0edb6d555d687f76837515207b9408be0bdd55e)

Change-Id: Ie92cecd5e77178d227ef21242cd0e1af0fe9ee72
BUG: 1259081
Signed-off-by: Mohammed Rafi KC 
Reviewed-on: http://review.gluster.org/12319
Tested-by: NetBSD Build System 
Reviewed-by: Dan Lambright 
Tested-by: Dan Lambright

cluster/ec : Mark new entry changelog in entry self-heal

2015-10-06T16:38:42+00:00

Problem :
When a new entry is created dirty mark xattrs are not
created this will need full heal to be performed, even
when there are partial failures.

Solution :
Marks new entry changelog in self-heal.

PS: Also fixed erasing of dirty markers when no data heal
is required.

BUG: 1258313
Signed-off-by: Ashish Pandey 
Change-Id: I156e3d3201afa77efe118e1aaace1d91c90a9613
Reviewed-on: http://review.gluster.org/12306
Tested-by: NetBSD Build System 
Reviewed-by: Pranith Kumar Karampuri

storage/posix: Reduce number of getxattrs for internal xattrs

2015-10-05T06:49:07+00:00

Most of the gluster internal xattrs don't exceed 256 bytes. So try
getxattr with ~256 bytes. If it gives ERANGE then go the old way
of getxattr with NULL 'buf' to find the length and then getxattr with
allocated 'buf' to fill the data. This way we reduce lot of getxattrs.

 >Change-Id: I716d484bc9ba67a81d0cedb5ee3e72a5ba661f6d
 >BUG: 1265893
 >Signed-off-by: Pranith Kumar K 
 >Reviewed-on: http://review.gluster.org/12240
 >Tested-by: NetBSD Build System 
 >Reviewed-by: N Balachandran 
 >Reviewed-by: Raghavendra Bhat 
 >(cherry picked from commit 801b7bd50a51c66e327ad79cdfc131654e069cdc)

Change-Id: I96d026e6ebee0111185c1d0a33e10a6d6577fbe7
BUG: 1267823
Signed-off-by: Pranith Kumar K 
Reviewed-on: http://review.gluster.org/12270
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Raghavendra G

storage/posix: Prevent extra handle-path

2015-10-01T09:27:24+00:00

In readdirp_fill we already have the path of the file/directory.
No need to construct handle-path again. This saves two lstats and
at least two readlink calls per directory.

 >Change-Id: I8d1b2afeda3e053265a243d4e9a101192f5f509e
 >BUG: 1265893
 >Signed-off-by: Pranith Kumar K 
 >Reviewed-on: http://review.gluster.org/12222
 >Tested-by: NetBSD Build System 
 >Tested-by: Gluster Build System 
 >Reviewed-by: Raghavendra Bhat 
 >(cherry picked from commit 7f33579e8a42eb19e92559a6c3acaeb92b6bb184)

Change-Id: I6e0654256e09551ed4763aea4c24e17a2039c405
BUG: 1267149
Signed-off-by: Pranith Kumar K 
Reviewed-on: http://review.gluster.org/12249
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System 
Reviewed-by: Raghavendra Bhat

posix: xattrop 'GF_XATTROP_ADD_ARRAY_WITH_DEFAULT' implementation

2015-09-29T05:35:19+00:00

This is a backport of http://review.gluster.org/#/c/11702

Implementation of xattrop type:
GF_XATTROP_ADD_ARRAY_WITH_DEFAULT
GF_XATTROP_ADD_ARRAY64_WITH_DEFAULT

These operations are similar to 'GF_XATTROP_ADD_ARRAY',
except that it adds a default value if xattr is missing
or its value is zero on disk.

One use-case of this operation is in inode-quota.
When a new directory is created, its default dir_count
should be set to 1. So when a xattrop performed setting
inode-xattrs, it should account initial dir_count
1 if the xattrs are not present

Here is the usage of this operation

value required in xdata for each key
struct array {
    int32_t   newvalue_1;
    int32_t   newvalue_2;
    ...
    int32_t   newvalue_n;
    int32_t   default_1;
    int32_t   default_2;
    ...
    int32_t   default_n;
};

or

struct array {
    int32_t   value_1;
    int32_t   value_2;
    ...
    int32_t   value_n;
} data[2];
fill data[0] with new value to add
fill data[1] with default value

xattrop GF_XATTROP_ADD_ARRAY_WITH_DEFAULT
for i from 1 to n
{
    if (xattr (dest_i) is zero or not set in the disk)
        dest_i = newvalue_i + default_i
    else
        dest_i = dest_i + newvalue_i
}

value in xdata after xattrop is successful
struct array {
    int32_t   dest_1;
    int32_t   dest_2;
    ...
    int32_t   dest_n;
};

> Change-Id: Ic6a08473e99fd98299a839d4d8416081a7534efd
> BUG: 1243946
> Signed-off-by: vmallika 
> Reviewed-on: http://review.gluster.org/11702
> Tested-by: NetBSD Build System 
> Reviewed-by: Raghavendra G 

Change-Id: Ie0c8285d9d582afbc808b0fd878f6c02957ff928
BUG: 1266882
Signed-off-by: vmallika 
Reviewed-on: http://review.gluster.org/12241
Tested-by: NetBSD Build System 
Reviewed-by: Raghavendra G

posix.c posix-helpers.c: porting new log messages

2015-09-02T04:35:05+00:00

        Backport of review.gluster.org/#/c/11609/

> Change-Id: I0c306d796ff49263d8a6c191b24a41da8a21bd2c
> BUG: 1252695
> Signed-off-by: Hari Gowtham 

Change-Id: I0c306d796ff49263d8a6c191b24a41da8a21bd2c
BUG: 1258736
Signed-off-by: Hari Gowtham 
Reviewed-on: http://review.gluster.org/12074
Reviewed-by: Pranith Kumar Karampuri 
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System

cluster/dht: Don't set posix acls on linkto files

2015-09-01T04:11:52+00:00

Posix acls on a linkto file change the file's permission
bits and cause DHT to treat it as a non-linkto file.This
happens on the migration failure of a file on which posix
 acls were set.

The fix prevents posix acls from being set on a linkto
file and copies them across only after a file has
been successfully migrated.

Change-Id: Iccf7ff6fba49fe05d691d9b83bf76a240848b212
BUG: 1258377
Signed-off-by: Nithya Balachandran 
Reviewed-on: http://review.gluster.org/12025
Tested-by: NetBSD Build System 
Reviewed-by: Raghavendra G 
Reviewed-by: Pranith Kumar Karampuri 
Signed-off-by: N Balachandran 
Reviewed-on: http://review.gluster.org/12062
Tested-by: Gluster Build System

posix: xattrop 'GF_XATTROP_GET_AND_SET' implementation

2015-08-27T13:45:50+00:00

This is a backport of http://review.gluster.org/#/c/11995

GF_XATTROP_GET_AND_SET stores the existing xattr
value in xdata and sets the new value

xattrop was reusing input xattr dict to set the results
instead of creating new dict.
This can be problem for server side xlators as the inout dict
will have the value changed.

> Change-Id: I43369082e1d0090d211381181e9f3b9075b8e771
> BUG: 1251454
> Signed-off-by: vmallika 

Change-Id: I7e0c27fd415131e9983a10d27067f63ed3a7701e
BUG: 1257441
Signed-off-by: vmallika 
Reviewed-on: http://review.gluster.org/12022
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Raghavendra G

posix: posix_make_ancestryfromgfid shouldn't log ENOENT

2015-08-17T04:25:45+00:00

This is a backport of http://review.gluster.org/11861

posix_make_ancestryfromgfid shouldn't log ENOENT
and it should set proper op_errno

> Change-Id: I8a87f30bc04d33cab06c91c74baa9563a1c7b45d
> BUG: 1251449
> Signed-off-by: vmallika 
> Reviewed-on: http://review.gluster.org/11861
> Tested-by: NetBSD Build System 
> Tested-by: Gluster Build System 
> Reviewed-by: Manikandan Selvaganesh 
> Reviewed-by: Raghavendra G 

Change-Id: Iefe010117e64586ac6b499459286721b0065cea8
BUG: 1253260
Signed-off-by: vmallika 
Reviewed-on: http://review.gluster.org/11910
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System 
Reviewed-by: Raghavendra G