glusterfs.git/tools, branch v3.7.11

tools/glusterfind: add --full option to query command

2016-04-05T06:49:50+00:00

The --full option will use brickfind.py to list all files in the volume.
The output file will contain url-encoded file names prefixed with the
tag string to indicate that all files should be considered as new.
The default tag string for the --full option is "NEW". This can be
changed with the --tag-for-full-find command-line option.

Change-Id: Ic85ba5db062e19df13ae9dc2de8a08eacb5c9792
BUG: 1286280
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/12779
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Aravinda VK 
(cherry picked from commit 16a3f0d020d23978b22a07354c25c654c88163a2)
Reviewed-on: http://review.gluster.org/13864

tools/glusterfind: Handling Unicode file names

2016-03-31T05:13:36+00:00

Unicode filenames handled cleanly with this patch. Changelog
files and output files are opened with utf-8 encoding using codecs.open.

urllib.quote_plus and unquote_plus will not handle Unicode so, encode
Unicode to 8-bit string version before calling unquote. urllib.quote_plus
requires 8-bit string itself so do not decode to Unicode if we need to use
quote_plus(when --no-encode=false). Decode to unicode in --no-encode is set.

BUG: 1322431
Change-Id: If5561c749ab5529445650d322c831eb4da22b65a
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/13798
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Milind Changire 
Reviewed-by: Kotresh HR 
(cherry picked from commit 48a0a38fadf9c5164869a908dcff8a951aa21b4b)
Reviewed-on: http://review.gluster.org/13856

tools/glusterfind: Do not fail cleanup script on volume delete

2016-03-09T12:02:44+00:00

If glusterfind dir is not present inside GLUSTERD_WORKDIR, then
cleanup script Post Volume delete was failing. This patch safely
handles the absence of glusterfind directory in GLUSTERD_WORKDIR

BUG: 1315639
Change-Id: I9f7e6035e3dc6079927803df942b0f921218c79a
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/12923
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Kotresh HR 
(cherry picked from commit 62047c80f541985bf9caa41336f471d95de3ce1c)
Reviewed-on: http://review.gluster.org/13642
Reviewed-by: Vijay Bellur

tools/glusterfind: New option --no-encode

2016-03-08T09:58:57+00:00

New option added to skip encoding path in output file. Also handled
Unicode strings.

File paths can have newline characters, to differentiate between each
path patch is encoded according to
RFC3986(https://www.ietf.org/rfc/rfc3986.txt). Due to this consumer
applications have to decode the path before consuming it. With this
option Paths are not encoded, can be directly consumed by
applications.

Unicode encoding is handled automatically

BUG: 1313310
Change-Id: I83d59831997dbd1264b48e9b1aa732c7dfc700b5
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/13477
Smoke: Gluster Build System 
Reviewed-by: Milind Changire 
NetBSD-regression: NetBSD Build System 
Reviewed-by: Kotresh HR 
CentOS-regression: Gluster Build System 
Reviewed-by: Venky Shankar 
(cherry picked from commit 1b897c39ba8c0f1bf180316637cc2d87e6920800)
Reviewed-on: http://review.gluster.org/13559

tools/glusterfind: add query command to list files

2015-12-11T08:29:12+00:00

When session information is maintained outside Gluster, there needs to
be some mechanism to list files starting from a time-stamp. This patch
implements the feature via the "query" command-line option.

The only caveat is that the first time the query command is run for the
volume, it will likely report that "historical changelogs are not
available". This is due to the fact that changelogs had not been turned
on for the volume so far. So the volume options need to be turned on
outside glusterfind or the since_time need to be greater than the
current time when the query command is run for the very first time for
the volume. The query command turns on the required volume options for
collecting changelogs.

Change-Id: I6cb7a57a5ecd166210e2eb4deede06d40ccfa996
BUG: 1272007
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/12362
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Aravinda VK 
 (cherry picked from commit a56e32e19703c0fbe2cedebcaf5edc8a6307d5a1)
Reviewed-on: http://review.gluster.org/12742

tools/glusterfind: Prepend prefix in case of delete

2015-11-25T07:20:34+00:00

In case of delete operation alone, output prefix adding
was not handled earlier. 
Output prefix is added now.

Change-Id: Ia91444dddbff501b26a864f6185ca4c0aaf4c802
Reviewed-on: http://review.gluster.org/11712/
BUG: 1257141
Signed-off-by: Saravanakumar Arumugam 
Reviewed-on: http://review.gluster.org/12016
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Milind Changire 
Reviewed-by: Aravinda VK

tools/glusterfind: Handle Keyboard interrupt

2015-11-25T07:19:46+00:00

Do not print Python traceback when glusterfind command is interrupted

Change-Id: I67383534f965e410fef7ce09798e9d435ef738ae
Signed-off-by: Aravinda VK 
BUG: 1282465
Reviewed-on: http://review.gluster.org/11698
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Milind Changire 
Reviewed-by: Saravanakumar Arumugam 
Reviewed-by: Venky Shankar 
 (cherry picked from commit 6c3895fd132765a5ad098b9ef35e037be7d116b1)
Reviewed-on: http://review.gluster.org/12649
Reviewed-by: Kotresh HR

tools/glusterfind: password prompts for peer nodes on delete

2015-11-19T04:38:50+00:00

SSH keys getting deleted on local node caused password prompts for peer
nodes on a delete operation.

This race for session directory cleanup on local node is now addressed
by avoiding the delete path for local node in node_cmd()
The session directory tree is deleted anyway in mode_delete()

Change-Id: I51c4baf4f9c1ed3caa319d4163bef343bd621429
BUG: 1250410
Reviewed-on: http://review.gluster.org/11693
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/11832
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Aravinda VK

tools/glusterfind: Do not show session corrupted if no status file

2015-11-19T04:02:30+00:00

When a glusterfind session is created it creates session directories
in all the nodes which are part of the Volume. But session status
file only present in initiated node.

Show Session corrupted only if status file exists and invalid content.

Change-Id: I8443c0335b872645b54c0aa77d9893dbe2589c92
Signed-off-by: Aravinda VK 
BUG: 1257546
Reviewed-on: http://review.gluster.org/11699
Reviewed-on: http://review.gluster.org/12028
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Venky Shankar 
Reviewed-by: Milind Changire

rpm: include required directory for glusterfind

2015-08-25T15:50:55+00:00

The directory was marked as %ghost, which causes the following
installation failure:

  Error unpacking rpm package glusterfs-server-3.8dev-0.446.git45e13fe.el7.centos.x86_64
  error: unpacking of archive failed on file /var/lib/glusterd/hooks/1/delete/post/S57glusterfind-delete-post.py;5581f20e: cpio: open

Also, *all* Python files should be part of the RPM package. This
includes generated .pyc and .pyo files.

BUG: 1256307
Change-Id: Iee74905b101912c4a845257742c470c3fe42ce2a
Signed-off-by: Niels de Vos 
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/11298
Reviewed-on: http://review.gluster.org/12000
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System