glusterfs.git, branch v3.9rc1

doc: add work-in-progress release-notes for 3.9.0

2016-09-21T13:47:17+00:00

BUG: 1350744
Change-Id: Ide35a8a786bd8f69a93c788ebcec5b9db4829e3f
Signed-off-by: Pranith Kumar K 
Reviewed-on: http://review.gluster.org/15538
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System 
Reviewed-by: Niels de Vos 
Smoke: Gluster Build System

rpc: increase RPC/XID with each callback

2016-09-21T03:11:47+00:00

The RPC/XID for callbacks has been hardcoded to GF_UNIVERSAL_ANSWER. In
Wireshark these RPC-calls are marked as "RPC retransmissions" because of
the repeating RPC/XID. This is most confusing when verifying the
callbacks that the upcall framework sends. There is no way to see the
difference between real retransmissions and new callbacks.

This change was verified by create and removal of files through
different Gluster clients. The RPC/XID is increased on a per connection
(or client) base. The expectations of the RPC protocol are met this way.

> Change-Id: I2116bec0e294df4046d168d8bcbba011284cd0b2
> BUG: 1377097
> Signed-off-by: Niels de Vos 
> Reviewed-on: http://review.gluster.org/15524
> Smoke: Gluster Build System 
> NetBSD-regression: NetBSD Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Raghavendra G 
(cherry picked from commit e9b39527d5dcfba95c4c52a522c8ce1f4512ac21)

Change-Id: I2116bec0e294df4046d168d8bcbba011284cd0b2
BUG: 1377288
Signed-off-by: Niels de Vos 
Reviewed-on: http://review.gluster.org/15527
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Raghavendra G

tests: fix bug-963541.t spurious failure

2016-09-19T05:40:34+00:00

wait for remove brick to complete before attempt for a commit.

>Reviewed-on: http://review.gluster.org/15457
>Smoke: Gluster Build System 
>NetBSD-regression: NetBSD Build System 
>CentOS-regression: Gluster Build System 
>Reviewed-by: Vijay Bellur 

Change-Id: I66ea6c48b6a69fe33d79f9d9080b6f2c1462578e
BUG: 1375042
Signed-off-by: Atin Mukherjee 
Reviewed-on: http://review.gluster.org/15458
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Aravinda VK

feature/bitrot: Fix recovery of corrupted hardlink

2016-09-19T05:37:55+00:00

Problem:
When a file with hardlink is corrupted in ec volume,
the recovery steps mentioned was not working.
Only name and metadata was healing but not the data.

Cause:
The bad file marker in the inode context is not removed.
Hence when self heal tries to open the file for data
healing, it fails with EIO.

Background:
The bitrot deletes inode context during forget.

Briefly, the recovery steps involves following steps.
   1. Delete the entry marked with bad file xattr
      from backend. Delete all the hardlinks including
      .glusters hardlink as well.
   2. Access the each hardlink of the file including
      original from the mount.

The step 2 will send lookup to the brick where the files
are deleted from backend and returns with ENOENT. On
ENOENT, server xlator forgets the inode if there are
no dentries associated with it. But in case hardlinks,
the forget won't be called as dentries (other hardlink
files) are associated with the inode. Hence bitrot stube
won't delete it's context failing the data self heal.

Fix:
Bitrot-stub should delete the inode context on getting
ENOENT during lookup.

>Change-Id: Ice6adc18625799e7afd842ab33b3517c2be264c1
>BUG: 1373520
>Signed-off-by: Kotresh HR 
>Reviewed-on: http://review.gluster.org/15408
>Smoke: Gluster Build System 
>NetBSD-regression: NetBSD Build System 
>CentOS-regression: Gluster Build System 
>Reviewed-by: Raghavendra Bhat 
(cherry picked from commit b86a7de9b5ea9dcd0a630dbe09fce6d9ad0d8944)

Change-Id: Ice6adc18625799e7afd842ab33b3517c2be264c1
BUG: 1374567
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/15434
Smoke: Gluster Build System 
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System 
Reviewed-by: Atin Mukherjee 
Reviewed-by: Aravinda VK

build: add systemd dependency

2016-09-17T14:28:42+00:00

Installs break with glusterfs getting installed before systemd
installation. This patch adds a dependency for systemd appropriately
for Fedora and RHEL platforms for glusterfs-server and glusterfs-events
packages.

> Reviewed-on: http://review.gluster.org/15469
> Smoke: Gluster Build System 
> NetBSD-regression: NetBSD Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Niels de Vos 
> Reviewed-by: Kaleb KEITHLEY 

(cherry picked from commit 73c6c2c307c8bcaac51aa94b1af518955f35d1b8)

Change-Id: Ica18f82a5e37c7755f0d386ce2ac6c70e8082815
BUG: 1376396
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/15508
Smoke: Gluster Build System 
Reviewed-by: Niels de Vos 
Tested-by: Kaleb KEITHLEY 
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System

dht/events: Added rebalance events

2016-09-17T10:51:48+00:00

The rebalance process will now send an event when it is
complete.
Also fixed a problem where the run-time was not always
set causing spurious rebalance failure events to be sent.

> Change-Id: Ib445171c78c9560940022bca20c887d31a9bb1ca
> BUG: 1371874
> Signed-off-by: N Balachandran 
> Reviewed-on: http://review.gluster.org/15501
> Reviewed-by: Raghavendra G 
> Reviewed-by: Shyamsundar Ranganathan 
(cherry picked from commit e872917dbf4563703b8f396d7d30f8168ed646cd)

Change-Id: Ia24038c04548a98aac899df10414585b988caa76
BUG: 1376477
Signed-off-by: N Balachandran 
Reviewed-on: http://review.gluster.org/15520
Smoke: Gluster Build System 
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System 
Reviewed-by: Atin Mukherjee

ganesha/glusterd : Correct the path for ganesha conf dir in Makefile

2016-09-17T10:44:00+00:00

The value for ganesha conf dir in Makefile.am is mistakenly entered as
following :
DCONFDIR=\"/$(runstatedir)/gluster/shared_storage/nfs-ganesha\"

Here value for runstatedir is seems to "NULL" which results wrong path
for ganesha configuration directory

Upstream reference :
> Change-Id: I0b7ebd8e2503de0cb79b601553c4405d0d1fd711
> BUG: 1355956
> Signed-off-by: Jiffin Tony Thottan 
> Reviewed-on: http://review.gluster.org/15355
> NetBSD-regression: NetBSD Build System 
> Reviewed-by: soumya k 
> Reviewed-by: Niels de Vos 
> CentOS-regression: Gluster Build System 
> Smoke: Gluster Build System 
> (cherry picked from commit 7e18e16f9f62ed95acded0fb3f2a8784087f59c0)

Change-Id: I0b7ebd8e2503de0cb79b601553c4405d0d1fd711
BUG: 1376874
Signed-off-by: Jiffin Tony Thottan 
Reviewed-on: http://review.gluster.org/15521
Reviewed-by: soumya k 
Smoke: Gluster Build System 
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System 
Reviewed-by: Atin Mukherjee

events/dht: dht cli events

2016-09-16T01:40:15+00:00

Adding events for add/remove brick and rebalance
from the cli.

> Change-Id: I4e07cb7224e1b63a2926db055f87a02220c5d043
> BUG: 1371874
> Signed-off-by: N Balachandran 
> Reviewed-on: http://review.gluster.org/15500
> NetBSD-regression: NetBSD Build System 
> Smoke: Gluster Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Atin Mukherjee 
(cherry picked from commit 957e40060734f1a0b2d9e3d37c4b0f7961f56b51)

Change-Id: I207af253997adf1b2cbc49fd496fc96913fcdd15
BUG: 1376477
Signed-off-by: N Balachandran 
Reviewed-on: http://review.gluster.org/15512
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Atin Mukherjee

Tier: failing detach commit on detach failure and in-progress

2016-09-15T20:49:38+00:00

        back-port of: http://review.gluster.org/#/c/15438/

PROBLEM: if detach status has failed or if it remains in progress
we allow detach commit to happen. only detach force should
be allowed.

FIX: check the detach status for failure or inprogress and disallow
with the apt error message.

>Change-Id: Ib97d540fec67717bb55c18d133187c665cf69ef1
>BUG: 1374584
>Signed-off-by: hari gowtham 
>Reviewed-on: http://review.gluster.org/15438
>Smoke: Gluster Build System 
>Tested-by: hari gowtham 
>NetBSD-regression: NetBSD Build System 
>CentOS-regression: Gluster Build System 
>Reviewed-by: Dan Lambright 
>Tested-by: Dan Lambright 
Signed-off-by: hari gowtham 

Change-Id: I4f8c3859121ee0827df57348069a243a2502889a
BUG: 1375570
Reviewed-on: http://review.gluster.org/15493
Tested-by: hari gowtham 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Smoke: Gluster Build System 
Reviewed-by: Dan Lambright

eventsapi/packaging: Fix conflict during rpm install

2016-09-15T11:31:27+00:00

RPM installation fails with following error

  Error: Transaction check error:
    file /etc/glusterfs/eventsconfig.json conflicts between attempted
    installs of glusterfs-events-3.10dev-0.51.gitc9271ff.fc24.x86_64
    and glusterfs-server-3.10dev-0.51.gitc9271ff.fc24.x86_64

Changed attributes of eventsconfig.json file as same as other
config files and excluded this file in server rpm.

> Reviewed-on: http://review.gluster.org/15486
> Smoke: Gluster Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Niels de Vos 
> NetBSD-regression: NetBSD Build System 

BUG: 1376331
Change-Id: I3708c8fc58448cd5a6ebe611250f10e0658bdd58
Signed-off-by: Aravinda VK 
(cherry picked from commit 656873c4c8f5f3b05823c51f20c2a44106662550)
Reviewed-on: http://review.gluster.org/15502
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Milind Changire