glusterfs.git/tools/glusterfind, branch v3.7.3

tools/glusterfind: RENAME and MODIFY issues

2015-07-13T03:06:07+00:00

If Modification happens before RENAME, GFID to Path Conversion
converts it into New Path. Delete Modify Entry and insert again
So that MODIFY  comes after RENAME.

Default value of pgfids and basenames changed to "" instead of NULL
Also fixed RENAME issue of displaying "RENAME  ".
Also fixed RENAME followed by missing MODIFY

Change-Id: I8202f6e6ec33f7bd921e71da38677f2ee2dab87a
BUG: 1236282
Signed-off-by: Kotresh HR 
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/11443
Tested-by: Gluster Build System 
Reviewed-by: Aravinda VK 
Tested-by: NetBSD Build System 
(cherry picked from commit adc704557a141a624fc702f7303b8b81582e1598)
Reviewed-on: http://review.gluster.org/11548
Reviewed-by: Venky Shankar

tools/glusterfind: Fail glusterfind creation if volume is offline

2015-06-24T06:16:21+00:00

Following two fixes are done.

1. Fail glusterfind session creation if volume is not online
   even before session directories are created. This avoids
   'glusterfind list' to pick the session directories and show
   status as 'Session Corrupted'.

2. Check of '!Started' instead of wether the volume is 'Stopped'.
   It covers all the cases.

BUG: 1233518
Change-Id: Ie01a87500578b9cc3eb72aabd0f24f632fbee58f
Reviewed-on: http://review.gluster.org/11278
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/11322
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Aravinda VK

tools/glusterfind: print message for good cases

2015-06-14T04:53:12+00:00

Added messages for printing status of good or default cases
for 'create', 'list', 'post' and 'delete' commands

Change-Id: I59a9219250536bdce1deaca4b6d2351a6e278af2
BUG: 1230791
Reviewed-On: http://review.gluster.org/11208
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/11189
Tested-by: Gluster Build System 
Reviewed-by: Aravinda VK

tools/glusterfind: ignoring deleted files

2015-06-13T06:46:11+00:00

OSError and IOError exceptions were being thrown if files
were deleted after session was created and a subsequent
glusterfind pre was attmepted. glusterfind now detects
this scenario and safely ignores these changes to the
file-system. We also avoid recording deleted file paths
into database in the case where gfid to path resolution
cannot be performed for deleted files.

Also, we now turn on volume option to capture delete paths.

Change-Id: Iaf3883463f5e64643497bd77229ad80a9b2d5da5
BUG: 1230783
Reviewed-on: http://review.gluster.org/#/c/11194/
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/11199
Tested-by: Gluster Build System 
Reviewed-by: Aravinda VK

tools/glusterfind: Cleanup session dir after delete

2015-06-12T18:32:59+00:00

Sessions directories are created in
/var/lib/glusterd/glusterfind//, only 
dir is created since same session name can exists for two volumes.

Now cleanup is added,  dir will be removed if 
contains only one Volume.

Change-Id: I236393659e63eb98342570e0255739f4adea4491
Signed-off-by: Aravinda VK 
BUG: 1230715
Reviewed-on: http://review.gluster.org/#/c/11157/
Reviewed-on: http://review.gluster.org/11185
Tested-by: Gluster Build System 
Reviewed-by: Kotresh HR

tools/glusterfind: Fix GFID to Path conversion for dir

2015-06-12T10:51:02+00:00

For Directories, GFID to Path conversion was fine, but wrong
filter was used while updating to db.

Change-Id: Id588adbb25ff5fd357f8cc2d5485bd2eb4a52b65
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/#/c/11158/
BUG: 1230712
Reviewed-on: http://review.gluster.org/11184
Tested-by: Gluster Build System 
Reviewed-by: Vijay Bellur

tools/glusterfind: verifying volume is online

2015-06-11T19:06:41+00:00

Volume needs to be online (Started) to perform meaningful
operations i.e. for "create" and "pre". This is now verified.

Change-Id: I207cf1f5e30be0f67a776b866349b59d70a13984
BUG: 1225565
Reviewed-On: http://review.gluster.org/#/c/10955/
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/11187
Tested-by: Gluster Build System 
Reviewed-by: Vijay Bellur

tools/glusterfind: verifying volume presence

2015-06-11T09:37:32+00:00

An invalid volume name passed to "pre", "post" and "delete"
operations throws up unfriendly errors. This patch presents
friendly error messages.

Change-Id: I233809653379b80b34c2e74c0b6f4fe502c8961e
BUG: 1225548
Reviewed On: http://review.gluster.org/#/c/10945/
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/10989
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System 
Reviewed-by: Aravinda VK

tools/glusterfind: GFID to Path conversion using Changelog

2015-05-10T03:44:00+00:00

Records fop information collected from Changelogs in sqlite database.
This is only working database, not required after processing.

After post processing, output file is generated by reading these
database files.

This is applicable only in incremental run, when a changelog is
parsed, all the details are saved in DB. GFID to Path is converted
to those files for which information is available in Changelogs.

For all the failed cases, it tries to convert to Path using Pgfid,
if not found GFID to Path is done using find.

BUG: 1219475
Change-Id: Iaccc9d063b1187d973137e592f024979b724e85c
Reviewed-On: http://review.gluster.org/#/c/10463/
Original-Author: Aravinda VK 
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/10640
Tested-by: Gluster Build System 
Reviewed-by: Aravinda VK

tools/glusterfind: Partial Find

2015-05-09T10:25:07+00:00

This is optional and enabled by default, if one node fails Glusterfind
will not fail to return list of files from other nodes. This behavior
can be changed using --disable-partial

Now session is maintained in each nodes as well as in initiator node.
Every pre command will pick the status file from respective node and
start collecting list of changes happened after the status time.

--reset-session-time, new option to force reset the session time.
Next incremental run will start from this time.

Change-detector argument is removed since Changelog mode is required
to detect deletes and Renames.

BUG: 1219467
Change-Id: I1d0a0629facc3d26780200ccdf39b221ab4037c4
Original-Author: Aravinda VK 
Reviewed-On: http://review.gluster.org/#/c/10320
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/10639
Tested-by: Gluster Build System 
Reviewed-by: Vijay Bellur