glusterfs.git/xlators/mgmt/glusterd/src/glusterd-brick-ops.c, branch v3.7.0

glusterd/tiering : cksum mismatch for tiered volume

2015-05-10T16:43:03+00:00

        Back port of http://review.gluster.org/#/c/10406

Once we updated the volinfo from orginator node, the hot
type was overwritten with volume type.

Then the same dictionary was sent to peer node to perform
the commit of attach-tier, that will cause hot type to
replace with volume type, eventually end up in cksum
mismatch

Change-Id: I402dceb4d672d0b3a7b91a92f52c1057050dbedc
BUG: 1219845
Signed-off-by: Mohammed Rafi KC 
Reviewed-on: http://review.gluster.org/10677
Reviewed-by: Niels de Vos 
Tested-by: NetBSD Build System
Tested-by: Gluster Build System

dht: make lookup-unhashed=auto do something actually useful

2015-05-10T04:55:09+00:00

The key concept here is to determine whether a directory is "clean" by
comparing its last-known-good topology to the current one for the
volume.  These are stored as "commit hashes" on the directory and the
volume root respectively.  The volume's commit hash changes whenever a
brick is added or removed, and a fix-layout is done.  A directory's
commit hash changes only when a full rebalance (not just fix-layout)
is done on it.  If all bricks are present and have a directory
commit hash that matches the volume commit hash, then we can assume
that every file is in its "proper" place. Therefore, if we look for
a file in that proper place and don't find it, we can assume it's not
on any other subvolume and *safely* skip the global (broadcast to all)
lookup.

Change-Id: Id6ce4593ba1f7daffa74cfab591cb45960629ae3
BUG: 1220064
Reviewed-on-master: http://review.gluster.org/#/c/7702/
Signed-off-by: Jeff Darcy 
Signed-off-by: Shyam 
Reviewed-on: http://review.gluster.org/10729
Tested-by: Gluster Build System 
Reviewed-by: Krishnan Parthasarathi 
Reviewed-by: Vijay Bellur

cli/tiering: volume info should display details about tier

2015-05-10T04:50:45+00:00

        Back port of http://review.gluster.org/#/c/10339/

>> gluster volume info patchy

Volume Name: patchy
Type: Tier
Volume ID: 8bf1a1ca-6417-484f-821f-18973a7502a8
Status: Created
Number of Bricks: 8
Transport-type: tcp
Hot Tier :
Hot Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick1: hostname:/home/brick30
Brick2: hostname:/home/brick31
Cold Bricks:
Cold Tier Type : Disperse
Number of Bricks: 1 x (4 + 2) = 6
Brick3: hostname:/home/brick20
Brick4: hostname:/home/brick21
Brick5: hostname:/home/brick23
Brick6: hostname:/home/brick24
Brick7: hostname:/home/brick25
Brick8: hostname:/home/brick26

Change-Id: I7b9025af81263ebecd641b4b6897b20db8b67195
BUG: 1219842
Signed-off-by: Mohammed Rafi KC 
Reviewed-on: http://review.gluster.org/10676
Reviewed-by: Dan Lambright 
Tested-by: NetBSD Build System
Tested-by: Gluster Build System

glusterd/tiering: disable tiering if cluster runs older gluster versions

2015-05-10T04:14:44+00:00

This is a backport of fix 10531 to Gluster 3.7.

Do not allow attach or detach tier to work if any of the nodes
is running gluster code < 3.7.

> http://review.gluster.org/#/c/10531/
> Change-Id: Id9af8f4057f6fad9cb703ec7645bc01eccb11fc1
> BUG: 1218287
> Signed-off-by: Dan Lambright 
> Reviewed-on: http://review.gluster.org/10531
> Tested-by: Gluster Build System 
> Reviewed-by: Atin Mukherjee 
> Signed-off-by: Dan Lambright 

Change-Id: Id9af8f4057f6fad9cb703ec7645bc01eccb11fc1
BUG: 1219600
Signed-off-by: Dan Lambright 
Reviewed-on: http://review.gluster.org/10651
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System
Reviewed-by: Krishnan Parthasarathi 
Tested-by: Krishnan Parthasarathi

tiering: Remove unwanted check for tier type volume

2015-05-10T03:27:02+00:00

        Back port of http://review.gluster.org/10494

>Change-Id: I2def61ebf348558e5f6a138265e3329d9a5407a3
>BUG: 1216898
>Signed-off-by: Mohammed Rafi KC 
>Reviewed-on: http://review.gluster.org/10494
>Reviewed-by: Dan Lambright 
>Tested-by: Gluster Build System 
>Tested-by: NetBSD Build System

Change-Id: I35f460297dfd6b6883c62a6826c99e4f1f3aece2
BUG: 1220051
Signed-off-by: Mohammed Rafi KC 
Reviewed-on: http://review.gluster.org/10712
Reviewed-by: Dan Lambright 
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System

cli/tiering: Enhance cli output for tiering

2015-05-09T17:26:36+00:00

        back port of http://review.gluster.org/10284

Fix for handling cli output for attach-tier and
detach-tier

>Change-Id: I4d17f4b09612754fe1b8cec6c2e14927029b9678
>BUG: 1211562
>Signed-off-by: Mohammed Rafi KC 
>Reviewed-on: http://review.gluster.org/10284
>Reviewed-by: Dan Lambright 
>Tested-by: Gluster Build System 
>Tested-by: NetBSD Build System
>Reviewed-by: Vijay Bellur 

Change-Id: Ic30c8f0a104d89bf98f5d0069937a34674ee3f2d
BUG: 1220052
Signed-off-by: Mohammed Rafi KC 
Reviewed-on: http://review.gluster.org/10713
Tested-by: Gluster Build System 
Reviewed-by: Vijay Bellur

glusterd: support for tier volumes 'detach start' and 'detach commit'

2015-05-09T15:35:14+00:00

        Back port of http://review.gluster.org/10108

These commands work in a manner analagous to rebalancing when removing a
brick. The existing migration daemon detects "detach start" and switches
to moving data off the hot tier. While in this state all lookups are
directed to the cold tier.

gluster v detach-tier  start
gluster v detach-tier  commit

The status and stop cli commands shall be submitted separately.

>Change-Id: I24fda5cc3ba74f5fb8aa9a3234ad51f18b80a8a0
>BUG: 1205540
>Signed-off-by: Dan Lambright 
>Signed-off-by: root 
>Signed-off-by: Dan Lambright 
>Reviewed-on: http://review.gluster.org/10108
>Reviewed-by: Kaleb KEITHLEY 

Change-Id: I212d748d077fb5870ee84b316c653acbafbea3f7
BUG: 1220047
Signed-off-by: Mohammed Rafi KC 
Reviewed-on: http://review.gluster.org/10708
Reviewed-by: Dan Lambright 
Tested-by: Gluster Build System 
Reviewed-by: Vijay Bellur

glusterd: remove replace brick with data migration support form cli/glusterd

2015-05-07T07:08:07+00:00

Replace-brick operation with data migration support have been
deprecated from gluster.

With this fix replace brick command will support only one commad

gluster volume replace-brick    {commit force}

Change-Id: Ib81d49e5d8e7eaa4ccb5830cfec2bc081191b43b
BUG: 1218602
Signed-off-by: Gaurav Kumar Garg 
Reviewed-on: http://review.gluster.org/10577
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System
Reviewed-by: Kaushal M

glusterd: Coverity fix

2015-05-06T09:02:54+00:00

CID: 1293504 (Calling xlator_set_option without checking return value )

CID: 1293502 (Dereferencing a pointer that might be null xl when calling
              xlator_set_option)

CID: 1293500 (Assigning value from dict_get_int32(dict, "type", &type)
              to ret here, but that stored value is overwritten before
              it can be used.)

Change-Id: I5314fb399480df70bd77bc374e3b573f2efd5710
BUG: 1093692
Signed-off-by: Gaurav Kumar Garg 
Reviewed-on: http://review.gluster.org/10201
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System
Reviewed-by: Kaushal M 
(cherry picked from commit ed9e9c3b1867867a828020b8569c0c7ab1d3be24)
Reviewed-on: http://review.gluster.org/10578

glusterd: Support distributed replicated volumes on hot tier

2015-04-08T07:28:21+00:00

We did not set up the graph properly for hot tiers with replicated
subvolumes. Also add check that the file has not already been moved
by another replicated brick on the same node.

Change-Id: I9adef565ab60f6774810962d912168b77a6032fa
BUG: 1206517
Signed-off-by: Dan Lambright 
Reviewed-on: http://review.gluster.org/10054
Reviewed-by: Joseph Fernandes 
Tested-by: Gluster Build System 
Reviewed-by: Kaleb KEITHLEY