glusterfs.git/geo-replication, branch v3.7.3

geo-rep: Fix fd referenced before assignment

2015-07-13T02:48:02+00:00

Fix fd reference before assignment in mgmt_lock
function.

BUG: 1240607
Change-Id: Ib8a5207a516eecb55a5f906ff5d49abc98cab2a6
Reviewed-on: http://review.gluster.org/11318
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/11563
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System 
Reviewed-by: Saravanakumar Arumugam 
Reviewed-by: Milind Changire 
Reviewed-by: Venky Shankar

geo-rep: Fix add user in mountbroker user management

2015-06-28T14:48:26+00:00

The CLI 'gluster system:: execute mountbroker user  '
to set volumes associated with a user replaces existing user and associated
volumes upon setting with existing user. This patch fixes it by appending
the volumes if the user already exists.

It also introduces following CLI to remove volume for a corresponding user.

'gluster system:: execute mountbroker volumedel  '
: username
: comman separated list of volumes to delete

If it is the last volume to be deleted associated with the user,
it will delete the user as well as it doesn't make sense to keep
only user without volumes associated.

Change-Id: I4c7240ce912e1b836794bf0682a5fc6e5b2adc70
BUG: 1235428
Reviewed-On: http://review.gluster.org/11385
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/11386
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Milind Changire 
Reviewed-by: Vijay Bellur

geo-rep: ignore ESTALE as ENOENT

2015-06-28T14:47:40+00:00

When DHT can't resolve a File it raises ESTALE, ignore ESTALE errors
same as ENOENT after retry.

Affected places:
    Xattr.lgetxattr
    os.listdir
    os.link
    Xattr.lsetxattr
    os.chmod
    os.chown
    os.utime
    os.readlink

BUG: 1236093
Change-Id: I53f8dfa47911da93e0dcc20213afcbb47a14ccd8
Reviewed-On: http://review.gluster.org/11296
Original-Author: Aravinda VK 
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/11430
Tested-by: NetBSD Build System 
Reviewed-by: Milind Changire 
Reviewed-by: Vijay Bellur

geo-rep: Fix geo-rep fanout setup with meta volume

2015-06-25T17:27:28+00:00

Lock filename was formed with 'master volume id'
and 'subvol number'. Hence multiple slaves try
acquiring lock on same file and become PASSIVE
ending up not syncing data. Using 'slave volume id'
in lock filename will fix the issue making lock
file unique across different slaves.

Change-Id: I64c84670a5d9e1b0dfbdeb4479ee6b8e0c6b829e
BUG: 1234898
Reviewed-On: http://review.gluster.org/11367
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/11366
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System 
Reviewed-by: Saravanakumar Arumugam 
Reviewed-by: Venky Shankar

geo-rep: Fix glusterd working directory

2015-06-25T17:24:51+00:00

Mountbroker setup in geo-replication requires
the script 'set_geo_rep_pem_keys.sh to be
run manually out of gluster context. Hence
the ${GLUSTERD_WORKDIR} is never set. So
getting glusterd working dir using 'gluster
system:: getwd'.

BUG: 1235297
Reviewed-On: http://review.gluster.org/11381
Change-Id: If708ad4294ee726ba7769b8052a0b3a25f93df2a
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/11382
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Saravanakumar Arumugam 
Reviewed-by: Venky Shankar

geo-rep: Fix toggling of use_meta_volume config

2015-06-25T17:15:41+00:00

If meta-volume is deleted and use_meta_volume
is set to false, geo-rep still fails complaining
meta volume is not mounted. The patch fixes that
issue.

BUG: 1234695
Change-Id: I5ec7ad85399b90e85bca1d36750dd3fb29222db9
Reviewe-On: http://review.gluster.org/11358
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/11359
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Saravanakumar Arumugam 
Reviewed-by: Venky Shankar

build: fix compiling on older distributions

2015-06-11T14:29:03+00:00

data-tiering is disabled on RHEL-5 because it depends on a too new
SQLite version.

This change also prevents installing some of files that are used by
geo-replication, which is also not available on RHEL-5. geo-replication
depends on a too recent version of Python.

Due to an older version of OpenSSL, some of the newer functions can not
be used. A fallback to previous functions is done. Unfortunately RHEL-5
does not seem to have TLSv1.2 support, so only older versions can be
used.

Cherry picked from commit 0209b18fd65f9df5ebd0a8764ebf864d0d392998:
> Change-Id: I672264a673f5432358d2e83b17e2a34efd9fd913
> BUG: 1222317
> Signed-off-by: Niels de Vos 
> Reviewed-on: http://review.gluster.org/10803
> Tested-by: NetBSD Build System 
> Tested-by: Gluster Build System 
> Reviewed-by: Kaleb KEITHLEY 
> Reviewed-by: Vijay Bellur 

Also including the changes from http://review.gluster.org/11140:

> build: improve detection of new OpenSSL features
>
> Building on Mac OS X revealed that the current check for
> CRYPTO_THREADID_set_callback() availability in OpenSSL is not correct.
>
> There also does not seem to be a guarantee that TLSv1_2_method() is
> available when TLS1_2_VERSION is #define'd.
>
> Change-Id: I21508065fc181a1c74bee4fd6d23bb5bdf7cea7a
> BUG: 1222317
> Reviewed-on: http://review.gluster.org/11140
> Original-author: Kaleb KEITHLEY 
> Signed-off-by: Niels de Vos 

Change-Id: I672264a673f5432358d2e83b17e2a34efd9fd913
BUG: 1228510
Signed-off-by: Niels de Vos 
Reviewed-on: http://review.gluster.org/11096
Tested-by: Gluster Build System 
Reviewed-by: Atin Mukherjee 
Reviewed-by: Kaleb KEITHLEY

geo-rep: Ignore ESTALE during unlink/rmdir

2015-06-01T06:38:15+00:00

during unlink/rmdir of Parent_GFID/Basename, if parent
directory does not exists. Parent GFID will not get resolved
and DHT raises ESTALE instead of ENOENT.

Now ESTALE errors ignored during unlink/rmdir

BUG: 1223286
Change-Id: If275c89fb9fc7d16004550805a4cd65be818540d
Signed-off-by: Aravinda VK 
Reviewed On: http://review.gluster.org/#/c/10837/
Reviewed-on: http://review.gluster.org/10913
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Kotresh HR 
Reviewed-by: Venky Shankar

geo-rep: Fix Data counter issue in status

2015-05-31T14:44:20+00:00

ENTRY and META operations executed sequentially, DATA operations
are handled async, increment happens when a changelog parsed.
Decrement happens after the sync of all files.

files_in_batch was reset multiple times in batch instead of once.

BUG: 1224100
Change-Id: I87617f2fd5f4d3221a1c9f9d5a8efb0686c42bbe
Signed-off-by: Aravinda VK 
Reviewed On: http://review.gluster.org/#/c/10911/
Reviewed-on: http://review.gluster.org/10912
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System 
Reviewed-by: Venky Shankar

geo-rep: Disable xattrs and acls support with tar_ssh

2015-05-29T09:02:32+00:00

Geo-rep can't sync xattrs and acls with tar over ssh
for following reasons.

Issue 1: xattrs doesn't sync with tar over ssh.

Reason: untar doesn't respect '--overwrite' option when used along
        with '--xattrs'. So it sends unlink if the file exists on
        destination and re-creates afresh. But all entry operations
        are banned in aux-gfid-mount as it may lead to gfid-mismatch.
        Hence fails with EPERM. This happens only when some xattr is
        set on a file in master volume.

Issue2: acls on directories does not sync with tar over ssh.

Reason: tar tries to opendir ".gfid/" and is not supported
        by gfid-access-translator as readirp can't be handled on
        virtual inodes and hence fails with ENOTSUP where as it syncs
        for files.

Since the issue is with tar commmand it self and nothing could be
done from gluster side, disabling xattr and acls support with tar
over ssh option.

Geo-rep can sync xattrs and acls with 'rsync' as the sync engine.

BUG: 1223644
Change-Id: Ieba9e749ddbc41683b58ed8b1cc2ca50517fe58b
Reviewed On: http://review.gluster.org/#/c/10873
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/10899
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System
Reviewed-by: Aravinda VK